Spark SQL and DataFrames using Azure Databricks

On this time meetup, we will host Oshik Avioz, a Microsoft Cloud Solution Architect, to discuss and demonstrate insights and visualizations from datasets using Azure Databricks

Azure Databricks brings together the best of the Apache Spark analytics platform and Azure cloud. Once you manage data at scale in the cloud, you open up massive possibilities for predictive analytics, AI, and real-time applications. Azure Databricks provides an end-to-end, managed Apache Spark platform optimized for the cloud. Featuring one-click deployment, autoscaling, and an optimized Databricks Runtime that can improve the performance of Spark jobs in the cloud, yet simple and cost-efficient.

Agenda:

• 17:00 - 17:30 Gathering

• 17:30 – 18:15 Hands-on tutorial - Rotem and Oshik will demonstrate Spark SQL and DataFrames, to retrieve insights and visualizations from datasets, using Azure Databricks:
  • Basic of Spark SQL + DF
  • Date/Time Analysis
  • Memory + Caching
  • Spark Internals

• 18:15 - 18:30 Q&A

• 18:30 – 19:00 Pizza time

About Oshik Avioz:
Oshik Avioz has over 15 years’ experience in architecture of large distributed systems, technical consulting, project management and technology implementation in Cloud, Big Data, Hadoop, Enterprise Information Management, Data Management, Product Management and Application integration.