SCALENGINEERING WINTER SERIES #3 - Kafka Hacks

Hi Scalegineerings,

Our 3rd meetup this winter is just around the corner, and this time, it is all about kafka!
So join us for a hybrid ironSource & Taboola meetup!

Location: ironSource offices & zoom

18:00-18:30 - Cheers and Beers

18:30-19:00 - 1st lecture - The Client is Not Always Right - Gal Vishnevsky
Backend Team Leader, ironSource
In the past year, we developed a new product from scratch with more than 1 million messages in Kafka per second. This significant change in scale led us to many production issues that sometimes took a long time to resolve. In most cases, we upscaled the Kafka cluster, but changes on server-side are not always the best practice solution. We learned that the kafka client has lots of contributions to the Kafka system in terms of optimization and performance issues. In this session, I will talk about measuring and optimizing our performance on the kafka client-side.

19:00-19:15 - short break

19:15-19:45 - 2nd lecture - Oops I Started A Broker - Yinon Kahta - Software Engineer, Data Platform Team, Taboola
What happened when our most important Kafka cluster suddenly went rogue, and while trying to recover it, we made things even worse? In one word: a disaster. While dealing with our high scale Kafka clusters, we always try to ensure Kafka behaves well under high loads of traffic and unexpected cluster failures. You can imagine the challenges we had to deal with when our main Kafka cluster went crazy. This session is the story of how we learned the hard way about mitigating cluster failures with the proper configurations in place.

19:45 - Giveaway time!

*Lectures will be in Hebrew

*Please make sure you register in this link to get a zoom link and event in your calendar:
https://kafkahacksmeetup.splashthat.com/?utm_source=taboola&utm_medium=social_organic

COVID-19 safety measures
Masks are required during the whole session
Green pass or negative PCR test (within 3 days) is required
Rapid (Antigen) Diagnostic Testing will be available for you at the entrance

Event will be indoors