Hosted at Confluent HQ: Apache Kafka® controller with Jun Rao and Kafka at Uber

TO ATTEND

1. RSVP Via Meetup

2. Fill in this short form: https://forms.gle/4gasaaNnJ4d2nXic8 [DL: 18:00 PDT, 28 Apr]

3. Prior to the event, you will receive an email asking you to register for the event and sign an NDA. Complete these steps.

4. Join us on the 29th April!

---

Join us for an Apache Kafka meetup on April 29th from 6:00pm, hosted by Confluent in Palo Alto! The address, agenda and speaker information can be found below. See you there!

Agenda:
5:30pm - 6:30pm: Entry, Networking, Pizza and Drinks
6:30pm - 7:10pm: Joseph Rea, Confluent
7:10pm - 7:50pm: Yupeng Fu, Uber
7:50pm - 8:30pm: Jun Rao, Confluent
8:45pm - 9:00pm: Additional Q&A and Networking

---

Talks:

Speaker:
Joseph Rea

Talk:
Building the message browser UI

Joseph will talk about how to visualize topics in Kafka, the difference between a stream and table in KSQL and his lessons learned on tackling this technical challenge with millions of Kafka messages consumed per second. With such functionalities, users can understand their data easier and in a highly performant and scalable way. This talk covers understanding web workers as they relate to webpack, web socket management, debugging browser performance, and the future of the applications that can now be built.

Bio:
Joseph Rea started engineering with the LAMP stack building custom e-commerce checkouts, ERP systems and enterprise water/sewer billing software. He worked at Yahoo as a front end engineer in the media org before doing Android and iOS development for the video SDK. He also worked at LifeLock to build an application that updated PII on various service sites. He likes turtles. He currently works at Confluent building so much UI.

Speaker: Yupeng Fu

Talk:
Disaster recovery for multi-region Kafka at Uber

High availability and reliability are important requirements to Uber services, and the services shall tolerate data center failures in a region and fail over to another region. In this talk, we will present the active-active Kafka at Uber and how it facilitates disaster discovery across regions for Uber services. In particular, we will highlight the key components including topic replication, topic aggregation, offsets sync, and then walk through several use cases of their disaster recovery strategy using active-active Kafka. Lastly, we will present several interesting challenges and the future work we planned.

Bio:
Yupeng Fu is a Staff Engineer in Uber Data Org leading streaming data platform. Previously, he worked at Alluxio and Palantir, building distributed data analysis and storage platforms. Yupeng holds a BS and an MS from Tsinghua University and did his PhD research on database at UCSD.

---

Speaker:
Jun Rao

Talk:
Kafka Controller: A Deep Dive

The controller is the brain of Apache Kafka. A big part of what the controller does is to maintain the consistency of the replicas and determine which replica can be used to serve the clients, especially during individual broker failure.

In this talk Jun will outline the main data flow in the controller—in particular, when a broker fails, how the controller automatically promotes another replica as the leader to serve the clients, and when a broker is started, how the controller resumes the replication pipeline in the restarted broker. Jun will then describe recent improvements to the controller that allow it to handle certain edge cases correctly and increase its performance, which allows for more partitions in a Kafka cluster.

Bio:
Jun Rao is the cofounder of Confluent, a company that provides a streaming data platform on top of Apache Kafka. Previously, Jun was a senior staff engineer at LinkedIn, where he led the development of Kafka, and a researcher at IBM's Almaden research data center, where he conducted research on database and distributed systems. Jun is the PMC chair of Apache Kafka and a committer of Apache Cassandra.

----

Join the Slack Team! https://launchpass.com/confluentcommunity