Live Stream: https://www.youtube.com/watch?v=ju2OQEXqONU
Tagged, in San Francisco, will be hosting us for a Meetup on Spark SQL.
This event will be live-streamed and recorded.
Arrive at 6:30pm, Talks start at 7pm.
Adding Native SQL Support to Spark with Catalyst
By Michael Armburst
In this talk I'll describe Spark SQL, a new Alpha component that is part of the Spark 1.0 release. Spark SQL lets developers natively query data stored in both existing RDDs and external sources such as Apache Hive. A key feature of Spark SQL is the ability to blur the lines between relational tables and RDDs, making it easy for developers to intermix SQL commands that query external data with complex analytics. In addition to Spark SQL, I'll also talk about the Catalyst optimizer framework, which allows Spark SQL to automatically rewrite query plans to execute more efficiently.