Zum Inhalt springen

Über uns

This meetup group is intended for people interested in big data and particularly in streaming large amounts of data using Apache Kafka. We intend to organise Meetups every now and then where we will at least have a talk of our own, and a guest speaker. If the topic supports it, we might also have a hands-on part.

Kommende Veranstaltungen

1

Alles ansehen
  • Producers, Pipelines & Connectors: Real Kafka Stories from ING, Rabobank & Axual

    Producers, Pipelines & Connectors: Real Kafka Stories from ING, Rabobank & Axual

    Axual B.V., Jaarbeursplein 22, Utrecht, UT, NL

    Hi all,
    We are excited to bring the Kafka community together once again for a new Kafka meetup! This time we'll host an evening featuring three speakers sharing practical lessons from different corners of the Kafka ecosystem: tuning producers for peak performance, scaling a data science team's streaming pipeline in a bank, and automating the testing of Kafka connectors.

    The Speakers:
    We are very excited to welcome
    Nupur Agarwal (Dev Engineer @ ING), who will take us deep into Kafka producer internals and show how to turn a misconfigured producer into a high-throughput, low-latency workhorse.

    We are also happy to have Diederik Wieles (Software Engineer @ Rabobank, Enterprise Analytics Products), who will share the lessons and cultural shifts his data science team went through while taking full ownership of a transaction-enrichment pipeline: from notebook to production event streaming.

    Finally, Nick Serban (Software Engineer @ Axual) will close the evening by walking us through how his team replaced manual connector testing with a full discovery, testing, and publishing pipeline for Kafka connectors.

    Agenda:
    17:30: Doors open
    17:30 – 18:30: Networking, food & drinks
    18:30 – 19:00: "From Kafka Misconfigurations to High Performance" , Nupur Agarwal (ING)
    19:05 – 19:35: "From Notebook to Event Streaming" , Diederik Wieles (Rabobank)
    19:40 – 20:10: "Going from Manual Testing of Connectors to a Full Discovery, Testing and Publishing Pipeline" , Nick Serban (Axual)
    20:10 – 21:00: Drinks & Kafka chit-chat

    Abstracts:

    From Kafka Misconfigurations to High Performance: A Practical Guide to Keeping Your Producer Sane
    Nupur Agarwal, Dev Engineer @ ING
    Ever felt like your Kafka producer is more chaos than control? I have. Join me as I share how I tuned my Kafka producer from a nightmare into a smooth, efficient system handling high throughput and low latency without a hitch. I'll dive into what actually happens at the broker end when you call kafkaTemplate.send(), and how that shapes settings like linger.ms, batch.size, buffer.memory and request.timeout.ms for batching your Kafka records. Whether you're a seasoned Kafka user or just starting out, you'll walk away with practical tips to avoid common misconfigurations and keep your Kafka producer running efficiently.

    From Notebook to Event Streaming: Lessons from an End-to-End Data Science Team in Banking
    Diederik Wieles, Software Engineer @ Rabobank
    Transaction enrichment may start with a notebook, but delivering it at scale requires much more than a model. In this talk, I'll share the lessons, challenges, and cultural shifts we encountered as a data science team took ownership of the entire journey from idea to production.
    I'm a software engineer at Rabobank, working there for 4 years in Enterprise Analytics Products. I've worked with various tech stacks in the past, but because I work in the data science part of the bank, it's been mostly Python in the last few years. I live in Woerden and in my free time I like to run, cycle and do the occasional triathlon.

    Going from Manual Testing of Connectors to a Full Discovery, Testing and Publishing Pipeline
    Nick Serban, Software Engineer @ Axual
    This session will cover how we're tackled the manual process of discovering new versions for open source connectors and testing them. How we're iterated through the process and built a multi-scenario testing platform to validate against our own platform. Easily extendable to not only open source but also closed source connectors.

    Location:
    Axual HQ, Jaarbeursplein 22, Utrecht)
    Please RSVP so we can arrange enough food & drinks.
    We're looking forward to seeing you there! Team Kafka Meetup Utrecht.

    Parking:
    https://www.p1.nl/parkeerplaats/parkeergarage-kop-van-lombok/ (cheapest)
    https://www.p1.nl/parkeerplaats/parkeergarage-croeselaan/ (more expensive, but closer)
    https://www.ns.nl/fietsenstallingen/info/utrecht-centraal-jaarbeursplei

    Photography/Video consent:
    Photos and videos will be taken at the event for social media and promotional use. By attending, you consent to being recorded..

    • Foto des Nutzers
    • Foto des Nutzers
    • Foto des Nutzers
    17 Teilnehmer

Gruppenlinks

Organisatoren

Mitglieder

595
Alle anzeigen
Foto des Nutzers Jason Zhou
Foto des Nutzers Leo Alves
Foto des Nutzers Zhenhao Li
Foto des Nutzers Yegor Andreenko
Foto des Nutzers Ray Burgemeestre
Foto des Nutzers Pascal Schuchhard
Foto des Nutzers Niels Basjes
Foto des Nutzers Derk Crezee
Foto des Nutzers Kris Geusebroek
Foto des Nutzers Subhojit Banerjee
Foto des Nutzers Jethro Bakker
Foto des Nutzers Friso van Vollenhoven

Besuche uns auch auf