Spark Meetup @ DataWorks Summit

Welcome to the pre-DataWorks Summit Spark Meetup!

On the night before the exciting conference, we have two exciting talks around the latest on big data and Spark.

Mike Seddon from AGL:

Hadoop has been a major influence on organisations decisions on how to manage and process large volumes of data outside of the traditional OLTP database market. Whilst it has been relatively successful in terms of market adoption our thesis is that is that it has not been successful on delivering on its promises due to an architecture that is close to 15 years old and based on some flawed assumptions (such as the importance of data locality).

This talk intends to explain the history of how we got to Hadoop, its strengths and weaknesses and why a lot of the core assumptions are not necessarily relevant in 2017 where technical constraints are vastly different from 2004 when Hadoop was born.

Andy from Servian:

Artificial Intelligence at scale in a container era. Andy will share their latest learning on deploying containerised data science workloads using Kubernetes and Spark.