The Client
dm-drogerie markt GmbH is a leading European drugstore retailer. The project was executed with its technology subsidiary, dmTECH GmbH.
The Challenge
Automated acquisition, cleansing, and provisioning of complex project and ERP resource data for enterprise-wide reporting.
Our Solution
-
Data Warehouse
Modeling of a scalable Snowflake Data Warehouse on the Google Cloud Platform (GCP) following modern Medallion architecture principles.
-
Data Integration & Virtualization
Implementation of a highly efficient interface to the Planisware data source using Denodo virtualization layers.
-
ETL Framework
Development of robust data pipelines using Apache Airflow and Snowpark Python (SCD and CDC logic).
-
CI/CD
Establishment of a modern CI/CD infrastructure based on GitLab and Terraform for automated deployment to Kubernetes clusters (AKS).
Results
Measurable Results
- Load Times
- A dramatic reduction in ETL load times from a previous 160 minutes to just 10 minutes through targeted pipeline tuning.
- Reporting
- Provision of near real-time data for MicroStrategy reports.
- Impact
- The newly created data architecture serves as a reliable foundation for strategic and operational decisions across more than 500 dm retail stores.