Riding Endless Streams with Kafka

On September 19th, Ivan Nakov, Software Engineer at Leanplum will do a walkthrough of the decisions and challenges during the implementation of Leanplum's counting service (a.k.a i++ service).

Incrementing numbers is a common problem in computer science but things get complicated when you have to solve it reliably and at scale. In the case of Leanplum, we speak about the scale of more than 50k events per second. So how do we do it?

In his talk, Ivan will go to the heart of our solution where Kafka primitives (Consumers, Producers, and Transactions) allow us to process hundreds of thousands of events per second with an exactly-once guarantee. We will cover some of the core tools available in Kafka tool suite like offset management, batching, transactions and discuss how to achieve exactly-once delivery.

About the speaker:
Ivan Nakov is a functional programming enthusiast with experience in designing and building distributed systems on both Scala and Java.
Currently part of the Campaign Insights team at Leanplum, Ivan has also worked at Paddy Power Betfair and Ocado Technology.

Agenda:
19:00 - 19:50 Riding Endless Streams with Kafka
19:50 - 20:00 Q&A
20:00 - Networking

More about Leanplum:
Leanplum, the leading multichannel engagement platform helps forward-looking brands like Tinder and Tesco meet the real-time needs of their customers. By transforming data into an understanding of users' needs and wants, our platform delivers unified experiences that are timely, tested, and relevant — building customer loyalty that fuels business growth.

Founded in San Francisco, Leanplum has offices across North America, Europe, and Asia, and has received more than $98 million in funding from leading Silicon Valley venture capital firms. Leanplum has also been recognized as Fortune's Best Companies to Work For and Entrepreneur's Best Entrepreneurial Companies in America.