The client is a leading retailer that operates over 1500 stores across Europe under multiple brands.
Challenges
The client faced challenges with disparate on-premise data systems and did not have a consolidated view of their products performance.
The data warehouse currently runs reports in batch mode and takes up to 20 hours for report generation.
Needed a technology partner who can enable near real time reporting over a cloud based data lake.
Implement a phased data migration approach without impacting the existing data warehouse model.
Solutions
Cognine worked with the client team to migrate the legacy data warehouse to Azure cloud to ensure agility and scalability of reporting architectures.
Data handling: Designed the cloud migration strategy by performing data profiling of all the major on-premise data sources and data warehouse systems.
A comprehensive data architecture was defined to enable accelerated ingestion and reduce latencies across the value chain
Technologies: Snowflake was chosen for hosting the data warehouse and data mart. Attunity, a cloud based replication tool was leveraged to accelerate the migration of the on-premise data to Snowflake. Power BI was chosen for visualization, dash-boarding and self service analytics.
Key Benefits
The new data architectures reduced the processing times from 12 hours to minutes. Usage of Attunity brought down the batch load times considerably.
Data science teams were provided with flexibility to access data from the analytics work-spaces