September Apache Kafka Meetup

Join us for the September Apache Kafka meetup on September 15 from 6:00pm - 8:30pm, hosted by [24]7 in Campbell.

Please see the agenda and speaker information below. See you there!

Agenda

6:00pm: Doors open

6:00pm - 6:30pm: Networking

6:30pm - 7:15pm: Presentation #1 Suneet Grover, [24]7

7:15pm - 8:00pm: Presentation #2 Jun Rao, Confluent

8:00pm - 8:30pm: Additional Q & A and Networking

First Talk

Speaker: Suneet Grover (Engineering Manager - Big Data Platform at 24[7] Customer Inc.)

Bio: Suneet is an engineering manager at [24]7 where he is leading a team of experienced engineers working on design, development, performance, scale and operations of the big data platform, used for real time intent predictions, data analytics, model training and more. Prior to [24]7, Suneet has worked with Amazon, Microsoft and few startups, working on diverse set of technologies, applications and services. Suneet holds Masters in Technology in Computer Science.

Title: Journey from Kafka 0.7 to 0.10 and recipes for resilient cross-DC data pipeline

Abstract: We will talk about our journey with Kafka starting from Kafka 0.7 through 0.8, 0.8.2.2 and finally to Kafka 0.10. We will present our learnings and the challenges we had faced during the upgrades, in managing the Kafka clusters and in operating the cross-DC mirror makers. We will showcase a set of configurations that have worked for us and the transparency and monitoring that have helped us to build a highly reliable and resilient real time data pipeline.

Second Talk

Speaker: Jun Rao, Co-founder, Confluent

Bio: Jun Rao is the co-founder of Confluent, a company that provides a stream data platform on top of Apache Kafka. Before Confluent, Jun Rao was a senior staff engineer at LinkedIn where he led the development of Kafka. Before LinkedIn, Jun Rao was a researcher at IBM's Almaden research data center, where he conducted research on database and distributed systems. Jun Rao is the PMC chair of Apache Kafka and a committer of Apache Cassandra.

Title: Building Large-Scale Stream Infrastructures Across Multiple Data Centers with Apache Kafka

Abstract: To manage the ever-increasing volume and velocity of data within your company you have successfully made the transition from single machines and one-off solutions to large, distributed stream infrastructures in your data center powered by Apache Kafka. But what needs to be done if one data center is not enough? In this session we describe building resilient data pipelines with Apache Kafka that span multiple data centers and points of presence. We provide an overview of best practices and common patterns while covering key areas such as architecture guidelines, data replication and mirroring as well as disaster scenarios and failure handling.