Talks from the Four Comma Club

Meet the Apache Kafka "Four Comma Club" (http://redmonk.com/fryan/2016/05/23/kafka-summit-the-four-comma-club/) at the next meetup session: LinkedIn, Netflix and Microsoft. Mark your calendars for April 18 for this session! Looking forward having everyone join and make it a great session. Please RSVP and also forward it to your friends who may be interested.

Date: Apr 18, 2017

Location: Microsoft City Center Plaza, conference room 2130/2150 (second floor).

Agenda

5:30 pm: Doors Open

5:30 to 6:00 Check-in, Food+Drinks, Network

6:00 to 8:00 pm: Talks

8:00 pm: Finish

1. 6:00 to 6:30 pm

Speaker: Joel Koshy, Staff Software Engineer, LinkedIn

Joel Koshy is a member of the Kafka team within the Data Infrastructure group at LinkedIn and has worked on distributed systems infrastructure and applications for the past eight years. He is also a PMC member and committer for the Apache Kafka project. Prior to LinkedIn, he was with the Yahoo! search team where he worked on web crawlers. Joel received his PhD in Computer Science from UC Davis and his bachelors in Computer Science from IIT Madras.

Title: "Redlining Kafka Pipelines"

Abstract: LinkedIn’s deployment of Kafka and its use cases have grown tremendously over the last couple of years. Given our large scale deployments, we keep careful watch on performance and capex. In this talk we will take a close look at some of the shifting performance bottlenecks and cost considerations that we have had to grapple with over the years, and how newer features in Kafka 0.10 and hardware improvements have helped address these.

2. 6:30 to 7:00 pm

Speaker: Allen Wang, Senior Software Engineer, Netflix

Allen Wang is a member in Real Time Data Infrastructure team in Netflix. He has been working with Kafka for more than two years and one of the early adopters to run Kafka at scale in AWS. He is the contributor for Apache Kafka (KIP-36: Rack aware replica assignment) and NetflixOSS.

Title: "From Three Nines to Five Nines: A Kafka Journey"

Abstract: Netflix built its Kafka based data pipeline at the end of 2015 in AWS. Through lessons learned, we have made notable changes to our deployment strategy and fine-tuned our broker and client configuration. At the scale of delivering over a trillion messages per day, we improved our producer side message delivery rate from three nines to five nines. The talk will introduce our data pipeline architecture and highlight the challenges of running Kafka in cloud and the steps we have taken since our initial deployment to improve our SLA.

3. 7:00 to 7:30 pm

Speaker: Thomas Alex, Principal Program Manager, Microsoft

Thomas Alex is a Program Manager in the Shared Data team at Microsoft, and has worked on many aspects of big data: data ingestion, data distribution, master data management, orchestration and ETL pipeline management, data virtualization, in-memory databases, business intelligence, and reporting.

Title: "Challenges of a multi-tenant data streaming service"

Abstract: Microsoft has extensive deployments of Kafka supporting large scale data streaming. This talk will introduce the challenges in building a multi-tenant system for the enterprise, and discuss the design approach we have taken.

4. 7:30 to 8:00 pm

Speaker: Jeremy Custenborder, Systems Engineer, Confluent

Title: "Kafka Connect"