

What we’re about
Anyone who is interested in the movement of data and getting data from one place to another. We will be talking about cloud based and open sourced solutions - sharing our knowledge on how we've managed to achieve real-time streaming and the challenges we've faced along the way
We have our own slack group and website which you can find out more details about here: https://sydneydataengineers.github.io/
Sponsors
See allUpcoming events (2)
See all- Sydney Data Eng meetup, June 2025Work Club Chifley Square, Sydney
Hey all, please join us for our June Sydney Data Eng meetup. Join us for an engaging session filled with exciting discussions and networking opportunities.
Don't miss out—RSVP to secure your spot. A big shout-out to ClickHouse for providing us with the venue! 🎉
🏠 Location: Work Club Chifley Square, Level 21/8 Chifley Square, Sydney NSW 2000
🍕 Catering: ClickHouse and Confluent 😊
💬 Join our Slack Group here: Data Engineers Slack ChannelSchedule:
- 5.30pm: Doors Open
- 6.00pm: Announcements and Welcome
- 6.10pm: 1st Talk
- 6.40pm: 2nd Talk
- 6.40pm: Networking
- 7.10pm: Doors CloseSpeakers:
🎤 Johnny Mirza, ClickHouse Solution Architect
🎤 Ravi Bhardwaj, Confluent Principal Technical Support Engineer
Talk Title: Maximising Analytics with ClickHouse and Kafka Integration
Talk Summary: This session will explore how to build a scalable real-time analytics solution by integrating ClickHouse, a high-performance columnar database, with Kafka, a distributed streaming platform. ClickHouse excels at fast ingestion and analytical querying of large-scale data, making it ideal for real-time reporting. Kafka, on the other hand, enhances ClickHouse by providing high-throughput data ingestion, message ordering, and fault tolerance. Together, they enable the creation of a robust data pipeline for efficient real-time data processing. The session will explain how these technologies work in tandem to power high-performance analytics and include a live demo on configuring ClickPipes for Kafka.
Speaker Bio: TBC🎤 James Carpenter, Senior Infrastructure Engineer @ Laravel
Talk Title: Nightwatch: how Laravel monitors billions of events a month with ClickHouse
Talk Summary: Following the success of Laravel Pulse, it was clear developers wanted more; a powerful, Laravel-native monitoring platform which could handle production-scale workloads. But as the product took shape, one question loomed: how to process and query billions of events from thousands of applications in real-time? Enter ClickHouse…
Speaker Bio: James Carpenter joined Laravel in 2024 as Infrastructure Lead for the Nightwatch team, bringing experience from 15 years in sport and healthcare. Specialising in DevOps and Infrastructure, he is passionate about solving complex problems and creating exceptional experiences for both customers and developers.🎤 Ravi Bhardwaj, Confluent Principal Technical Support Engineer
Talk Title: Real-Time CDC at Scale: Building Secure Data Pipelines with ClickHouse Cloud and AWS PrivateLink
Talk Summary: This technical deep-dive explores how to architect secure, real-time Change Data Capture (CDC) pipelines that transform operational bottlenecks into competitive advantages. Peter Hanssens will demonstrate the end-to-end implementation of a production-grade solution using ClickHouse Cloud's ClickPipes, AWS PrivateLink, and modern data orchestration with Mage AI, covering critical architectural decisions like handling Aurora PostgreSQL failover scenarios, separating OLTP/OLAP workloads, and building fault-tolerant streaming pipelines with proper monitoring. You'll see real configuration examples, security group setups, and Lambda functions that ensure zero-downtime data replication while maintaining enterprise security standards. The business impact: transforming days-long decision cycles into real-time insights while reducing infrastructure costs by 45% and enabling 10x operational scaling.
Speaker Bio: Peter Hanssens is the founder and principal consultant at a Data Engineering consultancy, Cloud Shuttle, which delivers projects to its customers to help them accelerate on their data platform journey!If you'd like to present at future meetups, please submit your talk here!
Remember to bring along some great questions! See you all there...
- Data Engineering Day, DataEngBytes Sydney 2025ILUMINA at Macquarie Group, SydneyA$497.00
Welcome to DataEngBytes 2025!
We're a conference for data engineers, by data engineers.Agenda: https://dataengbytes.com/
DataEngBytes is the largest independent conference for data engineers and practitioners in Oceania. We are a vendor-neutral forum to bring together data experts, leaders, practitioners and community members in one place to learn about the latest in the field, share challenges, and discover new solutions. Our mission is to drive excellence and innovation in data engineering practices through the power of community.
This year, we'll be featuring prominent international thought leaders and awesome speakers from the data engineering community to share their insights and knowledge in a multi-track conference format.
What are you waiting for? Purchase your ticket now! Click on our website for more information and to view the agenda when it is ready.
https://dataengbytes.comPlease note that this event requires tickets for attendance. To secure your spot, please purchase tickets here: [Buy Ticket]
Accessibility: ILUMINA is a fully accessible venue.
Refunds: If cancellation is made less than 14 days from the event start date, no refunds will be issued. This policy is in place because we need to finalise all vendor, catering and venue arrangements well in advance to ensure a seamless experience for all attendees. DataEngBytes Conference accepts no responsibility for changes to work or personal circumstances within this 14-day period. Your understanding and cooperation are greatly appreciated.
Thank you!