Basics of Spark coding

Stream will be here:

http://ustre.am/1uMAT

Let's Spark together - Beginners Edition!
Máté Gulyás

We will code our first Spark program together and I will explain the process step by step. We will dig deep what happens when we run our program, and how to set up your Spark environment at home.

​​Bio:

​​Mate is Co-founder and CTO of enbrite.ly (http://enbrite.ly/), a Budapest based startup with the vision to create the next generation decision supporting system in online advertising that covers the market needs of the future. Mate has many years of experience with Big Data architectures, data analytics pipelines, operation of infrastructures and growing organizations by focusing on culture.​​Beside enbrite.ly (http://enbrite.ly/), he is Chief Architect at Dmlab, a leading data analytics company providing innovative data products and services. Mate​teaches Big Data analytics​​ ​at Budapest University of Technology and Economics​ and ​runs courses for companies. Speaker of local and international conferences and meetups.

Apache Spark at enbrite.ly (http://enbrite.ly/)
József Mészáros

The vision we all share at enbrite.ly (http://enbrite.ly/) is to create the next generation decision supporting system in online advertising that combines the market needs; anti-fraud, viewability, brand safety and traffic quality assurances in one platform that covers the market needs of the future. We do this by analyzing vast amount of data to create value for our customers. In the last 6 months we created our ETL pipeline, the core component of our data platform based on Apache Spark. In this presentation I share the journey from the whiteboard designs to the maintenance of a TB-scale data pipeline. I share the lessons we lessons we learned and the ups and downs using Spark in scale.

Bio​​:

Joe is the happiest developer of enbrite.ly (http://enbrite.ly/). He has proved experience with building highly available and scalable systems, which are currently running from Canada to Dubai. At his first startup company as the member of the tech team he created a leading recommendation engine, after he started to focus on Big Data technologies and Analytics solutions. In addition to company life he is an open source evangelist and contributes to open source projects in a wide range.

--

We will take a look into the basics concepts of Spark: RDDs. You also will learn how you can start coding Spark.

In the second part of the Meetup we are going to go through a Spark use case, just like as we did at our first Meetup.