How to build a CDC Pipeline for MongoDB Using Memphis.dev and Debezium

🚨Workshop alert🚨
Change data capture (CDC) is a pattern for monitoring database updates and generating events for downstream secondary processing. CDC enables downstream pipelines for data replication, real-time analytics, and machine learning operations. In this talk, we will walk through an implementation of a CDC pipeline for MongoDB using the Debezium CDC tool and the Memphis.dev event-processing platform so you’d be able to implement your own functional CDC pipeline.

Key Points:

• Walk through of pipeline architecture and benefits
• Setting up MongoDB managed instance on Atlas
• Setting up Debezium with MongoDB
• Insert data into MongoDB and generate CDC events
• Setting up a broker in Memphis.dev cloud
• Connecting Memphis.dev broker with Debezium

Requirements:

• Docker engine installed o your machine
• MongoDB Atlas account
• Memphis.dev cloud account