- Bay Area Apache Spark Meetup @ LinkedIn, Sunnyvale
Join us for an evening featuring tech-talks about Apache Spark and Delta Lake at scale from LinkedIn and Databricks. This meetup is hosted and sponsored by LinkedIn. Agenda: 6:00 - 6:30 pm: Social Hour with Food & Drinks 6:30 - 6:35 pm: Introduction & Announcements 6:35 - 7:55 pm: Tech Talk-1 from LinkedIn 7:55 - 8:15 pm: Tech Talk-2 from LinkedIn 8:20 - 9:00 pm: Tech Talk-3 from Databricks Talk 1 Title: Dali-Spark: Apache Spark Data Access at LinkedIn to Achieve Data Agility Presenter: Adwait Tumbde Abstract & Bio: Coming soon ... Talk 2 Title: Optimizing Apache Spark SQL at LinkedIn Presenter: Fangshi Li Abstract & Bio: Coming soon ... Talk 3 Title: Open Source Reliability for Data Lake with Apache Spark Presenter: Michael Armbrust (https://databricks.com/speaker/michael-armbrust) Abstract: Delta Lake is an open-source storage layer that brings reliability to data lakes. Delta Lake offers ACID transactions, scalable metadata handling, and unifies the streaming and batch data processing. It runs on top of your existing data lake and is fully compatible with Apache Spark APIs. In this talk, we will cover: * What data quality problems Delta helps address * How to convert your existing application to delta * How the Delta transaction protocol works internally * The Delta Lake roadmap for the next few releases * How to get involved! Bio: Michael Armbrust is a committer and PMC member of Apache Spark and the original creator of Spark SQL. He currently leads the team at Databricks that designed and built Structured Streaming and the Delta Lake open source project. He received his Ph.D. from UC Berkeley in 2013 and was advised by Michael Franklin, David Patterson, and Armando Fox. His thesis focused on building systems that allow developers to rapidly build scalable interactive applications and specifically defined the notion of scale independence. His interests broadly include distributed systems, large-scale structured storage, and query optimization. NOTE: You may need a government-issued ID to enter the premises or the conference room.