Apache Spark - Introduction to Spark DataFrames/SQL and Deep dive

In our last meetup ( refer link : https://www.meetup.com/Big-Data-Developers-in-Bangalore/events/225159947/ ), we discussed about spark, its unit of abstraction i.e. RDDs, and RDD Internals.

Continuing from our earlier efforts, we will discuss the next level of abstraction upon RDDS i.e. DataFrames, and also a peek into spark SQL

Agenda :

· Introduction to DataFrames

· Internals of a DataFrame and spark SQL

· Optimization Techniques.

· We will supplement theory concepts with sufficient examples

Speakers :

Ravi (Developer at IBM Labs)

Profile : https://www.linkedin.com/in/ravishankarks

Sachin Parmar(Developer at IBM Labs)

Profile : https://in.linkedin.com/in/sachinparmar

PS : We will upload demo code a few days in advance.

Github Link for Demo Code:

https://github.com/parmarsachin/spark-dataframe-demo

Previous meetup video: https://www.youtube.com/watch?v=MkeRWyF1y_0

Looking forward to have a great interactive session. Do provide feedback.