Introduction to Big Data Analytics using Apache Spark and Apache Zeppelin

This workshop will provide an introduction to Big Data Analytics using Apache Spark and Apache Zeppelin.

There will be a short lecture that includes an introduction to Spark, the Spark components.

Spark is a unified framework for big data analytics. Spark provides one integrated API for use by developers, data scientists, and analysts to perform diverse tasks that would have previously required separate processing engines such as batch analytics, stream processing and statistical modeling. Spark supports a wide range of popular languages including Python, R, Scala, SQL, and Java. Spark can read from diverse data sources and scale to thousands of nodes.

The lecture will be followed by demo . There will be a short lecture on Hadoop and how Spark and Hadoop interact and compliment each other. You will learn how to move data into HDFS using Spark APIs, create Hive table, explore the data with Spark and SQL, transform the data and then issue some SQL queries. We will be using Scala and/or PySpark for labs.

Users have 2 options to follow along with the demo labs. You can use the:

Hortonworks Sandbox on a VM No data center, no cloud service and no internet connection needed! Full control of the environment. http://hortonworks.com/products/hortonworks-sandbox/#install HDP 2.4 on Azure with Hortonworks Sandbox. Try Hortonworks Sandbox on Windows Azure. It’s free for the the first month, and there’s no need to download the VM! (HDP 2.4 is now available , steps below for 2.3 sandbox are the same) http://hortonworks.com/blog/hortonworks-sandbox-with-hdp-2-3-is-now-available-on-microsoft-azure-gallery/

Speaker:

Alex Zeltov is Solutions Engineer / Software Engineer / Programmer Analyst / Data Scientist with over 15 years of industry experience in Information Technology and most recently in Big Data and Predictive Analytics. Specializing in designing, developing and implementing complex software solutions. Experienced in all areas of the software development life cycle. Currently working as Solutions Engineer at Hortonworks, where he is responsible for creating high-value Hadoop solutions for customers. He created and delivered in-depth technical demonstrations and delivered custom big data workshops, POC’s for new and existing accounts. He holds an M.S. in Software Engineering degree from Penn State, as well as an undergraduate degree in Computer Science from Temple University. You can catch Alex on twitter @azeltov

IF YOU REQUIRE WIFI ACCESS FOR THE MEETUP, PLEASE DO THE FOLLOWING:

Send ( Prakash.navaneetham@ey.com ) your full names and email addresses, he will work to get registered for Wifi.