Spark

PLEASE NOTE. This month we will be running the meetup at ThoughtWorks. It's nearby to Queens Collective and Peoplebank, so you won't get too lost!

Presentation Overview

Spark - Ned Shawa

Apache Spark is a fast and general-purpose cluster computing system. It provides high-level APIs in Java, Scala and Python, and an optimized engine that supports general execution graphs. It also supports a rich set of higher-level tools including Spark SQL (https://spark.apache.org/docs/latest/sql-programming-guide.html) for SQL and structured data processing, MLlib (https://spark.apache.org/docs/latest/mllib-guide.html) for machine learning, GraphX (https://spark.apache.org/docs/latest/graphx-programming-guide.html) for graph processing, and Spark Streaming (https://spark.apache.org/docs/latest/streaming-programming-guide.html).

In this talk, Ned will explain us the basics of Apache Spark with some demos and examples with real data, he will also cover some roadmap coverage for Spark and some related projects.

Presenter Bio:

Ned is a diversified data engineer with over 10 years of experience and working currently at Hortonworks following his Data passion, prior to Hortonworks Ned worked at EMC where he was the Isilon & Big Data Specialist for Australia and NewZealand. Ned has a wide diverse skill set as he started his career as an Oracle DBA with a leading ERP company followed by a passion led career across EMEA and APJ as a strong technical resource, held many positions in the past with companies like NetApp, NTT and IFS focusing on Databases architecture, Linux and Storage systems.
on top of his day duties, after hours Ned leads 2 major Apache Spark meetups in Melbourne (https://www.meetup.com/Melbourne-Apache-Spark-Meetup/)and Sydney (https://www.meetup.com/Sydney-Apache-spark-Meetup/) and have a personal blog (http://nedsblog.com/)that he contributes to whenever there is time. In his free time (when not spinning up spot instances on AWS and playing with Spark), Ned loves oceans and Seas following another sort of passion under water as a Scuba diving Instructor discovering very tiny parts of the %71 part of the world that consists of water, in addition to camping outdoors and riding fast motorcycles...

Info on getting there:

Doors in the building close about 6.30. We'll have people downstairs letting people in and up the lifts.

We will be having a raffle, so when you get to Level 23, there will be someone to greet you, get a name-tag, and also put you in the raffle draw.