[Verse 1]
First we deploy our KafkaConnect cluster
Debezium PostgreSQL connector
Configure the database connection string
Watch the changes as they begin to sing
Source connector reads the transaction log
Every insert, update in the catalog
[Chorus]
CDC pipeline flowing free
Debezium captures what we need to see
From database to Kafka streams
Change data capture living the dream
Connect, capture, observe, and store
That's the pipeline we're building for
[Verse 2]
KafkaConnector resource we create
Point it to our sample database
Set the table whitelist configuration
Enable schema change documentation
Every row change becomes an event
To Kafka topics they are sent
[Chorus]
CDC pipeline flowing free
Debezium captures what we need to see
From database to Kafka streams
Change data capture living the dream
Connect, capture, observe, and store
That's the pipeline we're building for
[Bridge]
Watch the topics fill with data
Insert events and updates later
Delete operations marked as tombstones
Schema registry keeps us in the zone
Offsets tracked for exactly once
No duplicate events by happenstance
[Verse 3]
Now we add a sink connector too
S3 compatible storage for me and you
MinIO or AWS will do the trick
Parquet format makes queries quick
Events flow from source to destination
Complete pipeline configuration
[Chorus]
CDC pipeline flowing free
Debezium captures what we need to see
From database to Kafka streams
Change data capture living the dream
Connect, capture, observe, and store
That's the pipeline we're building for
[Outro]
From PostgreSQL to object store
Kafka Connect gives us so much more
Debezium makes the data flow
Now you've got the skills to go