A Sneak Peek into Spark 1.6: From RDD to DataFrames to Datasets

Denny Lee, Technology Evangelist at Databricks, will provide a sneak peek into Apache Spark 1.6 - from RDD to DataFrames to Datasets.

Spark 1.6 will include (but not limited to) adaptive query execution [SPARK-9850], a type-safe API called Dataset on top of DataFrames that leverages all the work in Project Tungsten to have more robust and efficient execution (including memory management, code generation, and query optimization) [SPARK-9999], and unified memory management by consolidating cache and execution memory [SPARK-10000].

Come to this Vancouver Spark Meetup session to learn more and ask questions about Spark 1.6!

Schedule

6:00-6:30 Food & Networking

6:30-7:30 Presentation

7:30-8:00 Networking