Modern Data Engineering: Designing a Real-time Architecture
In this article, I share my journey building a data pipeline for Formula 1 racing data using modern technologies. Learn how I leveraged PostgreSQL for storage, Kafka and Debezium for streaming, and DuckDB with dbt for analytics, implementing advanced patterns like CDC and SCD Type 2 along the way.