Topic Management at Scale

Details

** IMPORTANT: Please make sure you sign up with your full first name and last name and bring photo ID to ensure entrance to the building for security purposes **

Join us for an Apache Kafka meetup on Tuesday, June 18th from 5:30 pm at ING in Amsterdam. The address, agenda and speaker information can be found below. See you there!

-----
Agenda:

6:00 pm-6:45 pm: Registration, Networking, Pizza and Drinks

6:45 pm - 7:20 pm: Using Kafka to integrate DWH and Cloud Based big data systems: Mic Hussey, Systems Engineer, Confluent

7:20 pm-7:55 pm: Topic Management at Scale: Filip Yonov, Constantin Mota and Josephine Dik, ING

7:55pm - 8:30pm: Real Time Investment Alerts using Apache Kafka & Spring Kafka at ING Bank: Tim van Baarsen and Marcos Maia

8:30pm - 9:00pm: Drinks and Networking

-----
First Talk:
Mic Hussey, Systems Engineer, Nordics and Netherlands, Confluent

Title of the Talk:
Using Kafka to integrate DWH and Cloud Based big data systems

Abstract:
Data storage has become cheaper and cheaper over time. We're no longer scared of duplicating data many times if it helps optimize our analytics jobs. When migrating from a traditional Data Warehouse to a Big Data system what's involved. For example how do we extract data stored in third normal form in a form usable by BigQuery?

Second Talk:
Filip Yonov, Constantin Mota and Josephine Dik, ING

Title of the Talk:
Topic Management at Scale

Abstract:
Kafka at ING has a long history. It all started in 2014 and in the following years we saw Kafka growing until 2018 when it took the spotlight at ING as the #1 searched-for technology with an unprecedented adoption curve. Suddenly what was a small trickle of niche use-cases, became a flood of customers on-boarding for every imaginable usage pattern. Even more astonishing was that our single cluster configuration saw almost 700% load increase just in 2018. During the explosion our team was so busy with on-boarding, maintenance and ops that it wasn’t clear whether we were supporting or sabotaging our long-term success. It was clear that we needed to challenge our view of how we used Kafka. We asked ourselves: given the demand, how can our clients easily manage their streams while not caring about scaling, clusters or technologies. In this talk we would like to discuss our experience of running a single cluster with more than 750 topics and show how we are in progress of making Kafka self-service via our Stream Marketplace.

Third Talk:
Tim van Baarsen and Marcos Maia

Title of the Talk:
Real Time Investment Alerts using Apache Kafka & Spring Kafka at ING Bank

Abstract:
Nowadays our customers are expecting real time interactions with investments products and services we deliver at ING Bank especially because financial market fluctuations can have a direct impact on the investments performance of our customers.

In this talk, we present how we deal with the massive stream of price updates on stocks and how we leverage many features of Apache Kafka and Spring Kafka to improve and simplify our solutions. From simple producer / consumer up to advanced usage of streams we strongly rely on Kafka to solve our functional and non-functional requirements delivering high quality, real time stream processing software that is reliable, precise and extremely valuable to our customers.

Don't forget to join our Community Slack Team! https://launchpass.com/confluentcommunity

If you would like to speak or host our next event please let us know! community@confluent.io

NOTE: We are unable to cater for any attendees under the age of 18. Please do not sign up for this event if you are under 18.