Über uns
This meetup group is intended for people interested in big data and particularly in streaming large amounts of data using Apache Kafka. We intend to organise Meetups every now and then where we will at least have a talk of our own, and a guest speaker. If the topic supports it, we might also have a hands-on part.
Kommende Veranstaltungen
1

Producers, Pipelines & Connectors: Real Kafka Stories from ING, Rabobank & Axual
Axual B.V., Jaarbeursplein 22, Utrecht, UT, NLHi all,
We are excited to bring the Kafka community together once again for a new Kafka meetup! This time we'll host an evening featuring three speakers sharing practical lessons from different corners of the Kafka ecosystem: tuning producers for peak performance, scaling a data science team's streaming pipeline in a bank, and automating the testing of Kafka connectors.The Speakers:
We are very excited to welcome Nupur Agarwal (Dev Engineer @ ING), who will take us deep into Kafka producer internals and show how to turn a misconfigured producer into a high-throughput, low-latency workhorse.We are also happy to have Diederik Wieles (Software Engineer @ Rabobank, Enterprise Analytics Products), who will share the lessons and cultural shifts his data science team went through while taking full ownership of a transaction-enrichment pipeline: from notebook to production event streaming.
Finally, Nick Serban (Software Engineer @ Axual) will close the evening by walking us through how his team replaced manual connector testing with a full discovery, testing, and publishing pipeline for Kafka connectors.
Agenda:
17:30: Doors open
17:30 – 18:30: Networking, food & drinks
18:30 – 19:00: "From Kafka Misconfigurations to High Performance" , Nupur Agarwal (ING)
19:05 – 19:35: "From Notebook to Event Streaming" , Diederik Wieles (Rabobank)
19:40 – 20:10: "Going from Manual Testing of Connectors to a Full Discovery, Testing and Publishing Pipeline" , Nick Serban (Axual)
20:10 – 21:00: Drinks & Kafka chit-chatAbstracts:
From Kafka Misconfigurations to High Performance: A Practical Guide to Keeping Your Producer Sane
Nupur Agarwal, Dev Engineer @ ING
Ever felt like your Kafka producer is more chaos than control? I have. Join me as I share how I tuned my Kafka producer from a nightmare into a smooth, efficient system handling high throughput and low latency without a hitch. I'll dive into what actually happens at the broker end when you call kafkaTemplate.send(), and how that shapes settings like linger.ms, batch.size, buffer.memory and request.timeout.ms for batching your Kafka records. Whether you're a seasoned Kafka user or just starting out, you'll walk away with practical tips to avoid common misconfigurations and keep your Kafka producer running efficiently.From Notebook to Event Streaming: Lessons from an End-to-End Data Science Team in Banking
Diederik Wieles, Software Engineer @ Rabobank
Transaction enrichment may start with a notebook, but delivering it at scale requires much more than a model. In this talk, I'll share the lessons, challenges, and cultural shifts we encountered as a data science team took ownership of the entire journey from idea to production.
I'm a software engineer at Rabobank, working there for 4 years in Enterprise Analytics Products. I've worked with various tech stacks in the past, but because I work in the data science part of the bank, it's been mostly Python in the last few years. I live in Woerden and in my free time I like to run, cycle and do the occasional triathlon.Going from Manual Testing of Connectors to a Full Discovery, Testing and Publishing Pipeline
Nick Serban, Software Engineer @ Axual
This session will cover how we're tackled the manual process of discovering new versions for open source connectors and testing them. How we're iterated through the process and built a multi-scenario testing platform to validate against our own platform. Easily extendable to not only open source but also closed source connectors.Location:
Axual HQ, Jaarbeursplein 22, Utrecht)
Please RSVP so we can arrange enough food & drinks.
We're looking forward to seeing you there! Team Kafka Meetup Utrecht.Parking:
• https://www.p1.nl/parkeerplaats/parkeergarage-kop-van-lombok/ (cheapest)
• https://www.p1.nl/parkeerplaats/parkeergarage-croeselaan/ (more expensive, but closer)
• https://www.ns.nl/fietsenstallingen/info/utrecht-centraal-jaarbeurspleiPhotography/Video consent:
Photos and videos will be taken at the event for social media and promotional use. By attending, you consent to being recorded..17 Teilnehmer
Vergangene Veranstaltungen
14


