Sydney Data Eng meetup, June 2025

Hey all, please join us for our June Sydney Data Eng meetup. Join us for an engaging session filled with exciting discussions and networking opportunities.

Don't miss out—RSVP to secure your spot. A big shout-out to ClickHouse for providing us with the venue! 🎉

🏠 Location: Work Club Chifley Square, Level 21/8 Chifley Square, Sydney NSW 2000
🍕 Catering: ClickHouse and Confluent 😊
💬 Join our Slack Group here: Data Engineers Slack Channel

Schedule:
- 5.30pm: Doors Open
- 6.00pm: Announcements and Welcome
- 6.10pm: 1st Talk
- 6.40pm: 2nd Talk
- 6.40pm: Networking
- 7.10pm: Doors Close

Speakers:
🎤 Johnny Mirza, ClickHouse Solution Architect
🎤 Ravi Bhardwaj, Confluent Principal Technical Support Engineer
Talk Title: Maximising Analytics with ClickHouse and Kafka Integration
Talk Summary: This session will explore how to build a scalable real-time analytics solution by integrating ClickHouse, a high-performance columnar database, with Kafka, a distributed streaming platform. ClickHouse excels at fast ingestion and analytical querying of large-scale data, making it ideal for real-time reporting. Kafka, on the other hand, enhances ClickHouse by providing high-throughput data ingestion, message ordering, and fault tolerance. Together, they enable the creation of a robust data pipeline for efficient real-time data processing. The session will explain how these technologies work in tandem to power high-performance analytics and include a live demo on configuring ClickPipes for Kafka.
Speaker Bio: TBC

🎤 James Carpenter, Senior Infrastructure Engineer @ Laravel
Talk Title: Nightwatch: how Laravel monitors billions of events a month with ClickHouse
Talk Summary: Following the success of Laravel Pulse, it was clear developers wanted more; a powerful, Laravel-native monitoring platform which could handle production-scale workloads. But as the product took shape, one question loomed: how to process and query billions of events from thousands of applications in real-time? Enter ClickHouse…
Speaker Bio: James Carpenter joined Laravel in 2024 as Infrastructure Lead for the Nightwatch team, bringing experience from 15 years in sport and healthcare. Specialising in DevOps and Infrastructure, he is passionate about solving complex problems and creating exceptional experiences for both customers and developers.

🎤 Ravi Bhardwaj, Confluent Principal Technical Support Engineer
Talk Title: Real-Time CDC at Scale: Building Secure Data Pipelines with ClickHouse Cloud and AWS PrivateLink
Talk Summary: This technical deep-dive explores how to architect secure, real-time Change Data Capture (CDC) pipelines that transform operational bottlenecks into competitive advantages. Peter Hanssens will demonstrate the end-to-end implementation of a production-grade solution using ClickHouse Cloud's ClickPipes, AWS PrivateLink, and modern data orchestration with Mage AI, covering critical architectural decisions like handling Aurora PostgreSQL failover scenarios, separating OLTP/OLAP workloads, and building fault-tolerant streaming pipelines with proper monitoring. You'll see real configuration examples, security group setups, and Lambda functions that ensure zero-downtime data replication while maintaining enterprise security standards. The business impact: transforming days-long decision cycles into real-time insights while reducing infrastructure costs by 45% and enabling 10x operational scaling.
Speaker Bio: Peter Hanssens is the founder and principal consultant at a Data Engineering consultancy, Cloud Shuttle, which delivers projects to its customers to help them accelerate on their data platform journey!

If you'd like to present at future meetups, please submit your talk here!

Remember to bring along some great questions! See you all there...