Name: How to build a CDC Pipeline for MongoDB Using Memphis.dev and Debezium
Start: 2023-07-21T02:00:00+03:00
End: 2023-07-21T04:00:00+03:00

🚨Workshop alert🚨
Change data capture (CDC) is a pattern for monitoring database updates and generating events for downstream secondary processing. CDC enables downstream pipelines for data replication, real-time analytics, and machine learning operations. In this talk, we will walk through an implementation of a CDC pipeline for MongoDB using the Debezium CDC tool and the Memphis.dev event-processing platform so you’d be able to implement your own functional CDC pipeline.

**Key Points:**

* Walk through of pipeline architecture and benefits
* Setting up MongoDB managed instance on Atlas
* Setting up Debezium with MongoDB
* Insert data into MongoDB and generate CDC events
* Setting up a broker in Memphis.dev cloud
* Connecting Memphis.dev broker with Debezium

**Requirements:**

* Docker engine installed o your machine
* MongoDB Atlas account
* Memphis.dev cloud account

Avital Trifsik

Devs & Data - Data Engineers Hometown (By Memphis.dev)

Devs_and_Data

Memphis dev

Memphis.dev is an alternative to traditional streaming engines.

Technology

Big Data

Data Science

Apache Kafka

Apache Flink

Real-Time

Data Engineering

Data Pipelines

Industrial Internet of Things (IIOT)

Apache Spark

RJ Nowling is a developer advocate at Memphis.dev and an associate professor of Computer Science at the Milwaukee School of Engineering. From 2014–2018, RJ was a data science engineer with a focus on building and maintaining ML production systems for digital advertising. RJ’s Ph.D. focused on numerical simulations for computational chemistry and applications of machine learning and statistical algorithms to genomics.

Devs & Data - Data Engineers Hometown (By Memphis.dev)

How to build a CDC Pipeline for MongoDB Using Memphis.dev and Debezium

Devs & Data - Data Engineers Hometown (By Memphis.dev)

Details

Sponsors

Members are also interested in