Case Study
Cracking Nielsen's ETL: From 20 Days to 3
Faster POS data: cutting Nielsen ETL from 20 days to 3.
At P&G Canada, our founder reverse-engineered Nielsen's backend to bypass its slow, failure-prone web UI. By connecting directly via ODBC and automating extraction with KNIME workflows on dedicated VMs, he cut the POS data SLA from 20 days to 3 — giving P&G's Walmart team fresher data than competitors and directly supporting Category Captaincy wins worth ~$5M in annual POS uplift.
Key Results
The Transformation
The Challenge
P&G Canada's sales and planning teams depended on Nielsen POS data, but the standard extraction path — Nielsen's Nitro web UI — was a consistent bottleneck:
- Full data downloads took up to 20 days through the UI, with frequent failures and session timeouts requiring manual restarts
- Sales teams operated with stale data while competitors with faster Nielsen access gained ground in category negotiations
- The Walmart Canada team needed weekly POS refreshes across Oral Care, Feminine Care, and Baby Care to support Category Captaincy pitches
- No API or supported automation path existed — Nielsen's official tooling assumed manual, browser-based interaction
Our Approach
**Reverse Engineering & Direct Connection:**
- Analyzed Nielsen Nitro's network traffic to identify backend ODBC endpoints, bypassing the web UI entirely
- Established direct ODBC connections to Nielsen's data layer, eliminating the browser-based bottleneck
**Automated Pipeline Build:**
- Built KNIME workflows on dedicated VMs to automate the full extraction sequence — authentication, query execution, data staging
- Implemented cron scheduling for continuous overnight extraction runs with error handling and retry logic
**Distribution & Adoption:**
- Packaged refreshed datasets into standardized formats distributed weekly to the P&G Walmart team
- Sales teams received Monday-ready POS data covering all managed categories across Canadian retail
The Outcome
**Speed & Competitive Advantage:**
- SLA reduced from 20 days to 3 days — an 85% improvement that gave P&G fresher POS data than Walmart's other suppliers
- Sales teams built category reviews and pitches with data that was weeks ahead of competitors
**Business Impact:**
- Walmart Category Captaincy secured in Oral Care, Feminine Care, and Baby Care — directly supported by faster, more current POS insights
- ~$5M annual POS uplift attributed to decisions made possible by timely data access
- Approach adopted by other P&G teams as a template for Nielsen automation
What the Client Says
Arturo rapidly learned new technologies and applied them to business problems—redesigned our bulk data extraction to be 10× faster within two months, then enabled others to scale the approach.
Aamir Mohatarem
Senior Manager - Business Analytics, Procter & Gamble
Want similar results for your organization?
Get in touchYou May Also Like
How High is High: Breaking the Negative Feedback Loop in Automated Replenishment
Identified critical flaw in Walmart's automated replenishment, developed custom OSA algorithm, and drove $3M incremental revenue across two P&G categories in 4 months.
Read case studyAutomated Replenishment Reports Saved 120+ Hours Monthly
Cutting analysis time from days to minutes — boosting in-stock rates across Walmart Canada.
Read case studyReady to turn data into decisions?
Let's discuss how Clarivant can help you achieve measurable ROI in months.