Streaming, HBase and Data at Lyft

We are excited to have Lyft to host and speak at this event. Thanks Mark Grover (Lyft) for help organizing the event.

Important Note:

It is required to register for the event (free) on ti.to (https://ti.to/meetup/data-meetup-october-25-2017), 48 hours before the event. You will then be sent an eNDA which needs to be signed 24 hours before the event, for security reasons. Signing the eNDA means that a badge would be pre-printed and waiting for you when you arrive at the event. Please register here.

Talk #1: Building complex, event-driven services using Apache Flink

Apache Flink has moved beyond the realm of analytics and has become a robust platform on which to build complex, event-driven, stateful services in addition to real-time analytics applications. In this hands-on talk Jamie will explain what this means and demonstrate how easy it is to build these types of services using Flink.

He'll also talk a bit about the goals of Lyft's Streaming Platform and why we've selected Flink as the computation engine. Finally, time permitting there could be some random pontification about the future of stream processing and some of the remaining unsolved problems in the space :)

Speaker : Jamie Grier

Jamie Grier is the technical lead of the Streaming Platform Team @ Lyft. He has been working with Apache Flink extensively over the last 2 years and stream processing, in the general sense, for the last decade at companies such as Twitter, Gnip and Boulder Imaging.

Talk #2: Scalable systems and HBase at Salesforce

This talk will build the bridge from the CAP theorem to distributed systems design to HBase as it is currently used at Salesforce.

We will cover practical implications of the CAP theorem, go over some aspects of DC and network design, and introduce the HBase and HDFS architecture and outline a few use cases and the scale we have at Salesforce.

Speaker : Lars Hofhansl

Lars currently works as Vice President, BigData Engineering and Principal Architect at Salesforce, a public cloud SaaS and PaaS provider with $10B in yearly cloud revenue, serving over 50B business transactions a month.

He has held previous titles at Digital Equipment Corporation, Peoplesoft, Oracle, and various startups.

Talk #3: Dogfooding our data at Lyft

This talk gives an overview of how we leverage application metrics, logs & auditing to monitor and troubleshoot our data platform at Lyft. We share how we dogfood our own platform to provide, security, auditing, alerting & replayability in our platform. We also detail some of the services & tools we have developed internally to make our data more robust, scalable & self-serving.

Speakers: Arup Malakar, Mark Grover

Arup Malakar is a Software Engineer at Lyft, working on the Data Platform team. Mark Grover is a Product Manager at Lyft and a co-author of O’Reilly’s Hadoop Application Architectures.

Agenda:

6 - 6:30 pm: Check in and settle, networking
6:30 - 7:00 pm -Building complex, event-driven services using Apache Flink
7:05 - 7:35 pm - Scalable systems and HBase at Salesforce
7:40 - 8:10 pm - Dogfooding our data at Lyft
8:10 - 8:30 pm - Networking and wrap up