Scheduled to coincide with the start of the Elasticon 2016 Conference (https://www.elastic.co/elasticon/conf/2016/sf) in San Francisco!
We've asked the Elastic (http://www.elastic.co) authors of the elasticsearch-spark connector (https://github.com/elastic/elasticsearch-hadoop) - including Costin Leau - to join us to give a deep dive into the details of their implementation of the Spark SQL Data Sources API.
Additionally, we'll provide a quick overview of the somewhat-hidden Spark SQL Data Sources API - as well as DataFrames and DataSets.
Special thanks to Rackspace (https://www.rackspace.com/) for offering up their awesome office space to host this awesome meetup.
6:30-7pm: Arrive and Mingle
7:00-7:15pm: Announcements and Updates (Chris Fregly and Kimberly Palmer)
7:15-7:30pm: Quick Overview of the somewhat-hidden Spark SQL Data Sources API - as well as DataFrames and DataSets. (Chris Fregly, IBM Spark Tech Center)
7:30-8:30pm: Code-level, Deep-dive of the elasticsearch-spark connector from the Elastic developers, themselves! (Costin Leau, Elastic)
8:30-9:00pm: Spark + ElasticSearch In Action (Urvish Mahida, Loggly)
9pm: De-mingle and Leave
Here is more info on the ElasticSearch-Spark integration:
Elasticsearch AWS Service:
This is an implementation of the Spark SQL Data Sources API similar to the following: