IN-PERSON: Apache Kafka® x Apache Flink® Meetup

Join us for an Apache Kafka® x Apache Flink® meetup on Thursday, May 29th from 6:00pm in Dublin hosted by Autodesk!

📍Venue:
Autodesk
1 Windmill Lane, 2nd Floor, Dublin D02 F206

NOTE: IF YOU RSVP HERE, YOU DON'T ALSO NEED TO RSVP AT https://www.meetup.com/dublin-flink/

🗓 Agenda:

• 6:00pm: Doors open
• 6:00pm – 6:30pm: Food, Drinks & Networking
• 6:30pm - 7:15pm: Tom Scott, CEO, Streambased & Roman Kolesnev, Principal Software Engineer, Streambased
• 7:15pm - 8:00pm: Tejansh Rana, Senior Principal Engineer, Autodesk
• 8:00pm - 9:00pm: Additional Q&A and Networking

💡 First Speakers:
Streambased

Title of Talk:
Kafka Projections – Accessing Data on Kafka in New Ways

Abstract:
Apache Kafka has become a foundational tool in the world of streaming data, with modern operations relying heavily on real-time and near-real-time processing capabilities.

However, this often confines operations to the stream processing paradigm or requires shipping data elsewhere for further analysis.
But what if the data in Kafka could be accessed differently? What if you could directly query a stream, as you would with a table, address the stream data as if it was an Iceberg table or even load a chunk as if it's a file on the filesystem?

In physics, there’s a concept known as particle-wave duality, where particles can be understood as both discrete entities and continuous waves. Could we apply a similar idea to data streams, seeing them not just as unbounded event streams, but also as records state at point in time?

In this talk, we’ll explore three different projections over Kafka data - Kafka as a S3 compatible filesystem, Kafka as a set of Iceberg tables and Kafka as a JDBC/ODBC compatible database. We’ll explore how they work, the semantics they introduce, and the powerful new capabilities they unlock.

You’ll learn about stream-table duality, how Kafka can function as a storage layer, and the potential of unconventional access patterns that make use of the data already flowing through your streaming platform.

Join us for an exciting session that will transform how you interact with and leverage streaming data!

Bios:
Tom Scott (CEO Streambased) is the founder of Streambased, Tom is building multi tenant, on-prem and cloud Kafka services to attack common Kafka pain points and break down barriers to starting your data journey.

Roman is a Principal Software Engineer at Streambased. His experience includes building business critical event streaming applications and distributed systems in the financial and technology sectors.

💡 Second Speaker:
Tejansh Rana, Senior Principal Engineer, Autodesk

Title of Talk:
Streaming the Future: Autodesk's Real-Time Data Platform with Apache Flink

Abstract:
Autodesk's extensive software suite is utilized across the Construction, Manufacturing, and Media & Entertainment industries. Our products generate a vast volume of complex data from millions of active users. To unlock the potential of this data for enhanced workflows and insights, we built the real-time and highly scalable Change Data Layer (CDL) Platform using Apache Flink. This internal data streaming and processing platform empowers teams to easily create Flink-powered data pipelines with customized operators for Autodesk data models, enabling real-time aggregation, transformation, and contextualization to facilitate granular search, analytics, and various other data-driven workflows. This presentation details the CDL platform's architecture, leveraging Flink for high-scale data processing. We will explore its components, discuss challenges in supporting diverse data sources, and share our experience running it at scale with AWS Managed Service for Apache Flink.

Bio:
Tejansh is a Senior Principal engineer at Autodesk and leads the data streaming and processing platform teams. With a deep-seated passion for the data streaming paradigm, Tejansh has been at the forefront of building large scale, low-latency systems. His passion lies in unlocking the power of real-time data to drive innovation and efficiency.

***
DISCLAIMER
We are unable to cater for any attendees under the age of 18.
If you would like to speak or host our next event please let us know! community@confluent.io