Bronze/silver/gold billing pipelines on S3, change-data-capture services migrated to Airflow, and a reliable refunds path into Redshift.
Problem
A legacy orchestrator was being retired while billing and refunds data needed a medallion architecture. Change-data-capture tables behaved differently across environments, and new payment and refund tables needed merges, data-quality checks, and warehouse loads.
Approach
Migrate billing CDC pipelines to Airflow with custom SQL and primary-key tests. Deploy bronze-to-silver dedup for change-data-capture operations, then ship the refunds orchestration path to production.
Architecture
Medallion billing path
CDC microservices through bronze, silver dedup, and gold into Redshift.