Streaming your database - Easier said than done?

Data Engineers in Toronto September 2026 Semimonthly Meeting

Topic: Streaming your database - Easier said than done?

Abstract:
Do you need to stream your database? So did I! Here’s what to expect.

In my journey as a contractor for a major cybersecurity company, I implemented a Change Data Capture (CDC) system that aimed to seamlessly stream client databases into a centralized cloud solution for analytics and enhanced features. However, after deploying the code, I quickly realized that the reality was far more complex than anticipated.

Despite using an off-the-shelf product, I encountered unexpected challenges related to scaling, data formats, integrations, and deployment—issues that took me by surprise and required significant adjustments.

Over the course of 18 months, my team and I navigated these hurdles to create a robust system designed for scalability and resilience against failures.

In this talk, I’ll share key lessons learned and practical tips for developers and architects embarking on similar projects. You'll gain insights into preparing for potential surprises and overcoming challenges in building a reliable CDC system.

Speaker: Sigal Shaharabani, Technical Group Leader & Couchbase Ambassador

Speaker Profile:
Sigal Shaharabani is a Technical Leader and a Group Leader at Tikal and a Couchbase ambassador, with a great passion for backend and data systems. She started her technological career way back in 1996, working for the government, a variety of corporations, and small start-ups. Her favorite programming language is Kotlin, and will love any excuse to talk about it. In her spare time she enjoys swimming and Israeli folk dancing.

The meeting is over Microsoft Teams, and the joining link is https://teams.microsoft.com/l/meetup-join/19%3ameeting_NzZkYWIyOTAtODk1MC00MjVmLWJlNjUtNTRiODZmODA2Zjdh%40thread.v2/0?context=%7b%22Tid%22%3a%22bd9727e8-f539-4c76-983c-6c30130c0bee%22%2c%22Oid%22%3a%229e8d5a64-e773-4ca2-90f6-9a266129171e%22%7d

See you at the meeting!