Past Meetup

Stream Processing with Apache Kafka & Apache Samza

This Meetup is past

413 people went

Location image of event venue



Welcome to the upcoming Stream Processing Meetup hosted by LinkedIn in Sunnyvale. This meetup focuses on Apache Kafka, Apache Samza, and related streaming technologies.

Location: Unify Conference Room, LinkedIn Corporate HQ in Sunnyvale. We will be on the 1st floor of 950 W Maude Ave, Sunnyvale, CA 94085

6PM: Doors open

6-6:35 PM: Networking

6:35-7:10 PM: How LinkedIn navigates Streams Infrastructure using Cruise Control - (Speaker: Efe Gencer, LinkedIn)
We’ll share our work and experiences towards alleviating the management overhead of large-scale Kafka clusters using Cruise Control at LinkedIn. The talk will consist of two parts: The first part will provide an overview of Cruise Control, including the operational challenges that it solves, its high-level architecture, and some evaluation results from real-world scenarios. The second part will go through a hands-on tutorial to demonstrate how we can manage a real Kafka cluster using Cruise Control.

7:15-7:50 PM: Stream Analytics Manager -(Speaker: Sriharsha Chintalapani, Uber)
Stream Analytics Manager provides a simplified UI interface to build complex big data applications. It makes it possible for the end user to not only build but also deploy and monitor streaming applications. It provides pluggable interfaces to provide user supplied business logic through Custom Processors, UDFs. Streamline’s main goal is to let developers build, deploy, manage, monitor streaming applications easily in minutes.
In this talk we will go through how we can add other engines like Flink, Spark, Airflow into Streamline and allow users to build both Batch and Streaming applications.

7:55-8:30 PM:: Operating Samza at LinkedIn -(Speaker: Abhishek Shivanna, Stephan Soileau, LinkedIn)
Operating Samza at LinkedIn, which, processes around a trillion of messages a day with over several thousand jobs, is a daunting task. This talk will go over the best practices of running Samza as a managed service and will take a look at how SREs at LinkedIn use intelligent automation to operate at LinkedIn scale.

8:30-9PM: Additional networking and Q&A

Please RSVP *only* if you plan to attend in person. Our facility can host 250 guests.

You can park in the uncovered parking that is along the building or in the parking garage located next to the building.

You will need to sign a standard NDA when you enter the lobby.

Food & Drink:
Food & drink will be provided.

Can’t join us in person?:
Join the live video stream!

Want to talk at a future meetup?
Please contact us via the “Contact” button in