For our July meetup, we welcome Ben Bowers and Rami Ruhayel for a reprise of their Latency Conference 2025 talk: Conjuring Events out of Thin Air: Leveraging CDC for Real-Time Insights.
Change Data Capture (CDC) offers a powerful solution for organisations struggling with rigid data architectures. By transforming database changes into real-time event streams, CDC enables companies to generate insights and synchronise data across systems without completely rebuilding their applications.
This talk will dive into how AWS services like Database Migration Service (DMS), Kinesis, and S3 can create seamless event streams from various databases. You'll learn practical approaches for capturing changes in different database environments, including DynamoDB Streams and Debezium.
We'll explore how to:
- Convert database changes into event streams
- Process and store events using AWS Kinesis and S3
- Use Amazon Athena for ad-hoc analysis
- Address challenges like schema changes and data consistency
You'll discover how to build a responsive analytics ecosystem that provides near real-time insights, empowering businesses to make faster, more informed decisions—even without a fully event-driven architecture.
Knowledge Level
Level 200: Experienced. You'll benefit most if you already have awareness of this topic, but you don't need to have practical experience.
Drinks and pizza from 5.30pm for a 6.00pm start.
Our sincere thanks to sponsors JourneyOne, Mantel Group, KZN, Akkodis, Versent, and AWS.
---
This session is being held on a Wednesday due to venue availability.
We have had to do some day-of-the-week shuffling for the remainder of the year, so please take careful note of the dates for all our upcoming events.
