What we’re about
New to Apache Kafka®? Start with these free resources: https://cnfl.io/learn-ak-mu
This is an open community - if you want to present, host or contribute in other ways follow this link (http://cnfl.io/get-involved-mu) - first time speakers welcome!
This meetup is for your fellow event streaming enthusiasts!
The topics discussed at our events are all about event streaming, including Confluent Platform, Confluent Cloud, Apache Kafka®, Kafka Connect, streaming data pipelines, ksqlDB, Kafka Streams as well as stream processing, Security, Microservices and a lot more!!
Code of conduct: https://cnfl.io/code-of-conduct-welcome
Beyond this group, we also have the following resources to help you learn and develop your skills! See them here:
*The Meetup Hub*
Find recordings of previous meetups around the world and see upcoming dates for many more at the Meetup Hub
https://cnfl.io/meetup-hub-desc
*Ask The Community:*
-Forum;
This is a place for all the community to ask the tough questions, share knowledge and win badges :D http://cnfl.io/forum-desc
-Slack;
Join tens of thousands of community members in this community cross-collaboration tool, exchanging thousands of messages every month:
cnfl.io/slack
*Confluent Community Catalysts*
Nominate the next Community Catalysts (MVPs) and find out more here:
*Confluent Training and Certification discounts!*
Learn Apache Kafka® and become Confluent Certified (with 20% off your certification exam with the code MU2021CERT): https://cnfl.io/train-cert
--
Also here’s a gift: Get $200 worth of free Confluent Cloud usage every month for your first 3 months; (that could be $600 worth, without spending a single penny) (Ts & Cs apply) http://cnfl.io/mu-try-cloud
If you’re already a user, you can get an extra $60 on top with the code: CC60COMM
Head to http://cnfl.io/get-involved-mu if you have any questions, ideas, concerns or if you want to contribute in some way!
Apache Kafka®, Kafka, and associated open source project names are trademarks of the Apache Software Foundation. The Apache Software Foundation has no affiliation with and does not endorse, or review the materials provided here or at any of our Meetups.
Upcoming events (1)
See all- IN-PERSON: Apache Kafka® x Apache Flink® MeetupAutodesk, Dublin
Join us for an Apache Kafka® x Apache Flink® meetup on Thursday, May 29th from 6:00pm in Dublin hosted by Autodesk!
📍Venue:
Autodesk
1 Windmill Lane, 2nd Floor, Dublin D02 F206NOTE: IF YOU RSVP HERE, YOU DON'T ALSO NEED TO RSVP AT https://www.meetup.com/dublin-flink/
🗓 Agenda:
- 6:00pm: Doors open
- 6:00pm – 6:30pm: Food, Drinks & Networking
- 6:30pm - 7:15pm: Tom Scott, CEO, Streambased & Roman Kolesnev, Principal Software Engineer, Streambased
- 7:15pm - 8:00pm: Tejansh Rana, Senior Principal Engineer, Autodesk
- 8:00pm - 9:00pm: Additional Q&A and Networking
💡 First Speakers:
StreambasedTitle of Talk:
Kafka Projections – Accessing Data on Kafka in New WaysAbstract:
Apache Kafka has become a foundational tool in the world of streaming data, with modern operations relying heavily on real-time and near-real-time processing capabilities.However, this often confines operations to the stream processing paradigm or requires shipping data elsewhere for further analysis.
But what if the data in Kafka could be accessed differently? What if you could directly query a stream, as you would with a table, address the stream data as if it was an Iceberg table or even load a chunk as if it's a file on the filesystem?In physics, there’s a concept known as particle-wave duality, where particles can be understood as both discrete entities and continuous waves. Could we apply a similar idea to data streams, seeing them not just as unbounded event streams, but also as records state at point in time?
In this talk, we’ll explore three different projections over Kafka data - Kafka as a S3 compatible filesystem, Kafka as a set of Iceberg tables and Kafka as a JDBC/ODBC compatible database. We’ll explore how they work, the semantics they introduce, and the powerful new capabilities they unlock.
You’ll learn about stream-table duality, how Kafka can function as a storage layer, and the potential of unconventional access patterns that make use of the data already flowing through your streaming platform.
Join us for an exciting session that will transform how you interact with and leverage streaming data!
Bios:
Tom Scott (CEO Streambased) is the founder of Streambased, Tom is building multi tenant, on-prem and cloud Kafka services to attack common Kafka pain points and break down barriers to starting your data journey.Roman is a Principal Software Engineer at Streambased. His experience includes building business critical event streaming applications and distributed systems in the financial and technology sectors.
💡 Second Speaker:
Tejansh Rana, Senior Principal Engineer, AutodeskTitle of Talk:
Streaming the Future: Autodesk's Real-Time Data Platform with Apache FlinkAbstract:
Autodesk's extensive software suite is utilized across the Construction, Manufacturing, and Media & Entertainment industries. Our products generate a vast volume of complex data from millions of active users. To unlock the potential of this data for enhanced workflows and insights, we built the real-time and highly scalable Change Data Layer (CDL) Platform using Apache Flink. This internal data streaming and processing platform empowers teams to easily create Flink-powered data pipelines with customized operators for Autodesk data models, enabling real-time aggregation, transformation, and contextualization to facilitate granular search, analytics, and various other data-driven workflows. This presentation details the CDL platform's architecture, leveraging Flink for high-scale data processing. We will explore its components, discuss challenges in supporting diverse data sources, and share our experience running it at scale with AWS Managed Service for Apache Flink.Bio:
Tejansh is a Senior Principal engineer at Autodesk and leads the data streaming and processing platform teams. With a deep-seated passion for the data streaming paradigm, Tejansh has been at the forefront of building large scale, low-latency systems. His passion lies in unlocking the power of real-time data to drive innovation and efficiency.***
DISCLAIMER
We are unable to cater for any attendees under the age of 18.
If you would like to speak or host our next event please let us know! community@confluent.io