ClickHouse + Sydney Data Engineering Meetup

ClickHouse and Sydney Data Engineering communities are coming together for an evening of data tales in the Sydney CBD. Join us for an evening of sharing, learning, and connecting with fellow data professionals and enthusiasts on various use cases where real-time data analytics come alive.

📣 A big shout-out to Rokt for providing us with the venue and catering!

Agenda

• 5:30 PM: Doors Open
• 6:00 PM: Announcements & Welcome
• 6:10 PM: What’s new with ClickHouse by Johnny Mirza, Solution Architect @ ClickHouse
• 6:30 PM: Our Journey to Ingest and Analyse 5 Billion Network Events / Day by Sharat Madanapalli, Head of Data & AI @ Canopus
• 6:50 PM: Searchable encryption in-use for ClickHouse by Dan Draper, Founder & CEO @ CipherStash
• 7:10 PM: Networking
• 8:00 PM: Wrap-up

______________________________________________

🎤 Session Details: What’s new with ClickHouse: Updates, Integrations & Acquisitions
With tons of feature updates and performance optimisations in 24.x Keeping up with the rapid pace of feature updates and performance optimisations in ClickHouse 24.x can be challenging. In this talk, we’ll spotlight key enhancements, integrations, and performance improvements that you need to know about. We’ll give an update on new tools and trainings designed to boost your success with ClickHouse. We'll look into recent strategic acquisitions—chDB and PeerDB—exploring the reasons behind these moves and how they fit into the ClickHouse ecosystem.

Speaker: Johnny Mirza, Solution Architect @ ClickHouse
Johnny Mirza is a Solution Architect with ClickHouse, working with users across APAC. With over 20 years of background in solutions engineering, Johnny has a high level of expertise in integration between both public cloud and on-premise infrastructure, while focussing on service assurance, monitoring platforms, and open-source technologies.

🎤 Session Details: Our Journey to Ingest and Analyse 5 Billion Network Events / Day
In this talk, Sharat will detail his team’s journey managing massive-scale network event data, leading to their current system processing 5 billion events daily with ClickHouse. He’ll cover the challenges of AI-powered network analytics for telcos and their evolution through various data solutions. Key topics include ingestion process, comparing Kafka Connect with our custom Go-based implementation (ch-go), and data rollups approach using DBT and Prefect versus materialized views.

Sharat will share key takeaways and tips, including effective use of system tables, monitoring, and strategies for materializing slow queries. He’ll conclude by sharing his experience with leveraging ClickHouse community’s invaluable support and knowledge, which greatly aided in their journey.

Speaker: Sharat Madanapalli, Head of Data and AI @ Canopus
As the head of data engineering and AI at Canopus, with a PhD and six years of industry experience spanning software, data, AI, Sharat will share his team’s path from starting with simple CSV dumps to a sophisticated, high-performance analytics platform.

🎤 Session Details: Searchable encryption in-use for ClickHouse: what, how and why
Encryption is a powerful way to keep data protected…but maybe not in the way you think! You may be familiar with traditional at-rest encryption but in this talk, Dan will introduce the concept of encryption in use and how to use it for granular access control in ClickHouse.

The talk will explain how encryption in use can be made practical for large datasets while maintaining high levels of performance, as well as how full query functionality can be maintained through the use of searchable encryption.

The talk should leave you with a new perspective on encryption and the role it can play in keeping data safe with affecting usability. Dan will share some tips and resources for further exploration.

Speaker: Dan Draper, Founder & CEO @ CipherStash
Dan is the CEO and founder of CipherStash which provides a highly secure, frictionless data protection platform that works everywhere sensitive data is stored. Dan is a life-long techie, nerd and is proudly neuro-spicy having been diagnosed with ADHD at the age of 40. Dan’s obsession for the past 8 years has been cryptography and the powerful ways it can be used for data protection and privacy.
_____________________________________________________

Space is limited, so please RSVP as soon as possible to secure your spot!

If anyone from the community is interested in sharing a talk at future events, complete this CFP form and we’ll be in touch.