Skip to content

DEV Community

Pipeline Whiteboard

Production data engineering explained on a whiteboard: CDC, Kafka, lakehouses, and the bugs that break pipelines. New video every week on YouTube.

Joined on Oct 23, 2026 https://www.youtube.com/@PipelineWhiteboard

Pipeline Whiteboard

Nov 2

Running CDC in Production: The WAL Slot Trap

#postgres #dataengineering #devops #aws

7 min read

Pipeline Whiteboard

Oct 31

CDC Schema Changes: What Breaks and How to Ship Them

#dataengineering #kafka #snowflake #database

7 min read

Pipeline Whiteboard

Oct 30

CDC Deletes, Tombstones and the Idempotent MERGE

#dataengineering #kafka #snowflake #sql

7 min read

Pipeline Whiteboard

Oct 27

The Silent CDC Bug: Data Loss With No Errors

#dataengineering #postgres #kafka #database

7 min read

Pipeline Whiteboard

Oct 27

Debezium Postgres to Kafka: Every Setting Explained

#dataengineering #postgres #kafka #tutorial

8 min read

Pipeline Whiteboard

Oct 23

Change Data Capture (CDC) Explained: From the Transaction Log to a Snowflake MERGE

#dataengineering #database #aws #tutorial

6 min read

loading...