What we’re about
New to Apache Flink®? Find out more: Apache Flink® https://flink.apache.org/what-is-flink/flink-architecture/
Interested in speaking or hosting here (first-timers welcome)?
Read the Confluent Community event rules of engagement then reach out to community@confluent.io (https://cnfl.io/roe-desc)
Become a Community Champion with our Meetup in a Box Program. (https://cnfl.io/miab-desc)
What is this group about?
The topics discussed at these events are all about Apache Flink®, Stream/Batch Processing, related/complimentary technologies like Confluent, and much more! We welcome all sorts of talks that will inspire the audience to try something new, whether that’s by presenting an explanation of how some part of Flink works, talking about a real-world use case, or sharing experiences with a best practice.
The Apache Software Foundation has no affiliation with and does not endorse, or review the materials provided here or at any of our Meetups. For more information about Apache Flink® go to the project website https://flink.apache.org/community/
The Confluent Community is a safe space for everyone: please read our simple code of conduct. (https://cnfl.io/code-of-conduct-welcome)
The Global Confluent Community (http://cnfl.io/community)
We have plenty of resources and programs to help you get the most from your learning and share your knowledge and experience with the world!
Join thousands on the Confluent Community Slack and Forum to talk about the entire ecosystem with your peers! (http://cnfl.io/forum-desc)
Stay up to date with our online Global Meetup schedule (upcoming and recorded on-demand talks!). (https://cnfl.io/meetup-hub-desc)
Meet the Confluent Community Catalysts or nominate your own! (https://cnfl.io/nominate-desc)
Important:
Apache Flink, Flink®, Apache®, the squirrel logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation.
Upcoming events (1)
See all- IN-PERSON: Apache Kafka® x Apache Flink® MeetupAutodesk , Dublin
Join us for an Apache Kafka® x Apache Flink® meetup on Thursday, May 29th from 6:00pm in Dublin hosted by Autodesk!
📍Venue:
Autodesk
1 Windmill Lane, 2nd Floor, Dublin D02 F206NOTE: IF YOU RSVP HERE, YOU DON'T ALSO NEED TO RSVP AT https://www.meetup.com/dublin-apache-kafka-meetup-by-confluent/.
🗓 Agenda:
- 6:00pm: Doors open
- 6:00pm – 6:30pm: Food, Drinks & Networking
- 6:30pm - 7:15pm: Tom Scott, CEO, Streambased & Roman Kolesnev, Principal Software Engineer, Streambased
- 7:15pm - 8:00pm: Tejansh Rana, Senior Principal Engineer, Autodesk
- 8:00pm - 9:00pm: Additional Q&A and Networking
💡 First Speakers:
StreambasedTitle of Talk:
Kafka Projections – Accessing Data on Kafka in New WaysAbstract:
Apache Kafka has become a foundational tool in the world of streaming data, with modern operations relying heavily on real-time and near-real-time processing capabilities.However, this often confines operations to the stream processing paradigm or requires shipping data elsewhere for further analysis.
But what if the data in Kafka could be accessed differently? What if you could directly query a stream, as you would with a table, address the stream data as if it was an Iceberg table or even load a chunk as if it's a file on the filesystem?In physics, there’s a concept known as particle-wave duality, where particles can be understood as both discrete entities and continuous waves. Could we apply a similar idea to data streams, seeing them not just as unbounded event streams, but also as records state at point in time?
In this talk, we’ll explore three different projections over Kafka data - Kafka as a S3 compatible filesystem, Kafka as a set of Iceberg tables and Kafka as a JDBC/ODBC compatible database. We’ll explore how they work, the semantics they introduce, and the powerful new capabilities they unlock.
You’ll learn about stream-table duality, how Kafka can function as a storage layer, and the potential of unconventional access patterns that make use of the data already flowing through your streaming platform.
Join us for an exciting session that will transform how you interact with and leverage streaming data!
Bios:
Tom Scott (CEO Streambased) is the founder of Streambased, Tom is building multi tenant, on-prem and cloud Kafka services to attack common Kafka pain points and break down barriers to starting your data journey.Roman is a Principal Software Engineer at Streambased. His experience includes building business critical event streaming applications and distributed systems in the financial and technology sectors.
💡 Second Speaker:
Tejansh Rana, Senior Principal Engineer, AutodeskTitle of Talk:
Streaming the Future: Autodesk's Real-Time Data Platform with Apache FlinkAbstract:
Autodesk's extensive software suite is utilized across the Construction, Manufacturing, and Media & Entertainment industries. Our products generate a vast volume of complex data from millions of active users. To unlock the potential of this data for enhanced workflows and insights, we built the real-time and highly scalable Change Data Layer (CDL) Platform using Apache Flink. This internal data streaming and processing platform empowers teams to easily create Flink-powered data pipelines with customized operators for Autodesk data models, enabling real-time aggregation, transformation, and contextualization to facilitate granular search, analytics, and various other data-driven workflows. This presentation details the CDL platform's architecture, leveraging Flink for high-scale data processing. We will explore its components, discuss challenges in supporting diverse data sources, and share our experience running it at scale with AWS Managed Service for Apache Flink.Bio:
Tejansh is a Senior Principal engineer at Autodesk and leads the data streaming and processing platform teams. With a deep-seated passion for the data streaming paradigm, Tejansh has been at the forefront of building large scale, low-latency systems. His passion lies in unlocking the power of real-time data to drive innovation and efficiency.***
DISCLAIMER
We are unable to cater for any attendees under the age of 18.
If you would like to speak or host our next event please let us know! community@confluent.io
