Problem:

• Delay in marketing decision making (assortment selection and pricing) due to 3-6 weeks time for processing POS and distributor data collected from third party

Challenges:

• Extremely inconsistently formatted data
• Large number of files (20+) with 10M+ rows to be processed, cleaned and stitched to build analytics and large number of dashboards within a short span of time

Our Solution:

• Built automated data pipelines to process and store data on Azure
• Implemented complex pattern matching logic to address inconsistently formatted data

Business Benefits:

• Required analytics was delivered within 2 days as compared to earlier 3 - 6 weeks
• Increased business user confidence in pricing products due to more available time

Technology