Retail data warehouse with CDC
- Type
- Project
The Data Warehousing module's coursework, and the widest single project in the whole MSc: Change Data Capture implemented in both SQL Server and Oracle, a Kimball-style dimensional retail-sales star schema with surrogate keys and Slowly Changing Dimension handling, and the ETL itself built in SSIS.
Then a full Azure section on top of that: provisioning and networking an Azure SQL Database, pushing warehouse data into it via SSIS, and building a real Azure Data Factory pipeline, linked services, source and sink datasets, a parameterized Copy Data task, debug-run before it was published to production, moving data between two Azure SQL databases. Azure Data Lake Storage came next, provisioned with a hash-distributed table for the analytics side.
Separately, in the same module: materialized views over Oracle, and a comparison of Oracle's table-partitioning strategies, range, hash, list, reference, and composite, evaluated specifically against a data-warehouse workload rather than in the abstract.