Deep Dive: Spark SQL+DataFrames Cassandra Connector

We would like to welcome Chris Fregly to Scotland as our guest speaker. Chris is in Europe for the Spark Summit later in the month. He has been planning meetups in Cities throughout Europe - and he wanted to make sure he included us....

***
Chris Fregly is a Principal Data Solutions Engineer for the IBM Spark Technology Center, Apache Spark Contributor, Netflix Open Source Committer - as well as the Organizer of the San Francisco-based Advanced Apache Spark Meetup.

https://www.linkedin.com/in/cfregly

Formerly, Chris was a Data and Platform Engineer at Databricks and Netflix.
***

Event schedule:

7.00pm – 7:30 PM: Networking

7:30 PM – 8.15 PM PM: Spark SQL Data Sources API Overview - Chris Fregly is a Principal Data Solutions Engineer for the IBM Spark Technology Center

8:15 PM – 8:45 PM: Q & A Session

8:45 PM – 9:15 PM: Networking & Drinks

If you would like to join us for a relaxed evening of insight, debate, pizza and beer then just RSVP :) !

Look forward to seeing everyone on the 13th October!

Related Links

0. Overview of the Data Sources API

https://www.youtube.com/watch?v=uxuLRiNoDio

1. The spark-cassandra-connector (https://github.com/datastax/spark-cassandra-connector) is an implementation of the Spark SQL DataSources API similar to the following:

https://github.com/databricks/spark-csv

https://github.com/databricks/spark-avro

2. Examples of the spark-cassandra-connector in action:

https://github.com/killrweather/killrweather

https://github.com/fluxcapacitor/pipeline

3. Spark SQL Data Sources API

http://blog.madhukaraphatak.com/anatomy-of-spark-dataframe-api/