Past Meetup

Stream Processing Meetup @ LinkedIn - Wednesday, November 2 2016

This Meetup is past

235 people went

Location image of event venue


Welcome to the November 2016 Stream Processing Meetup hosted by LinkedIn in Sunnyvale.

This meetup focusses on Apache Kafka, Apache Samza and related streaming technologies.

New Location:
LinkedIn is in process of moving our Corporate HQ from Mountain View to Sunnyvale. This meetup will be hosted at a new location in Sunnyvale instead of the Mountain View location where previous meetups were hosted.


6PM: Doors open

6-6:35PM: Networking & Welcome

6:35-7:15 PM: Apache Samza: Past, Present, and Future (Kartik Paramasivam, LinkedIn)

Samza got registered with Apache Incubator in July 2013 and became a top level project in Jan of 2015.

In this presentation we will quickly walk-through the journey so far. We will then spend some time on the current state of Samza and cover some of the key differentiators of Samza in the crowded field of Stream processing. In closing, we will go into the details of some of the big changes that are coming next in Samza.

7:15-7:55PM: Cruise Control: Dynamic Workload Balancing for Kafka (Jiangjie (Becket) Qin, LinkedIn)

At LinkedIn, we have over 80 Kafka clusters and more than 1800 Kafka brokers. When running Kafka at this scale, operation becomes critical to ensure the availability as well as the performance of the system. Kafka Cruise Control is developed to help us to solve this problem by automatically managing the Kafka clusters. It handles broker failure/addition and performs dynamic workload balance for the Kafka clusters. We will talk in detail about how it works and the challenges we have faced and solved.

7:55-8:30 PM: General Q& A MC'd by Kartik Paramasivam, will likely pull in committers.

RSVP: Please RSVP *only* if you plan to attend in person. Our facility can host 200 guests.

Parking: You can park in the uncovered parking that surrounds 580 Mary Ave or in the nearby parking garage. There is also street parking available for overflow.

NDA: You will need to sign a standard NDA when you enter the lobby of 605 W Maude Ave.

Food & Drink: Food & drink will be provided.

Can’t join us live?: We will be live-streaming this event ( as well as posting recordings of the presentations.

Want to talk at a future meetup?: Please contact us via the “Contact” button in