Python for Data Engineers and How to blend the database world with Apache Spark

Join Data Science Festival - London at WorldRemit this month for 'Data on the Rocks' with two great speakers. Shachar Meir and Kostas Perifanos.

SCHEDULE
6.00pm doors open
6.15-6.45pm talk - Kostas Perifanos
6.45 - 7:15 pm Whiskey (on the rocks), Beer & Pizza
7:15 - 8:15pm talk - Shachar Meir
8:15 - 8.45pm drinks and close

Kostas Perifanos: How to blend the database world with Apache Spark and Spark Dataframes.

Summary: An introduction to structured data processing with Apache Spark.

Bio:Kostas has been working in publishing and research for more than 15 years. In the past, he worked at MailOnline, Pearson, ILSP and he was involved in a broad range of projects from European FP6 research programs to EdTech, Learner's Analytics, Search, Predictive Modelling, Behaviour Analysis, using fancy tools and technologies, machine learning and artificial intelligence.In 2015, he joined Royal Mail as Senior Data Scientist

Shachar Meir: Python for Data Engineers

Summary: If you are a Data Engineer or a DBA and you’re often told that you must learn Python, but you’re not sure why, this talk is exactly for you!

In the past few years, and not coincidentally with the introduction of open-source Big Data technologies, we encounter constant changes in the role of the Data Engineer. The transition from a world of large monolithic enterprise platforms with centric relational databases, to a world of micro-services with all sorts of structured and unstructured data-stores, requires adaptation in the skill set and toolbox of the Data Engineer.

Python is an extremely powerful and popular language, and has become a standard tool for Data Engineers and Data Scientists because data manipulation is a natively embedded part of the language.With Python you can easily interact with REST APIs, parse JSONs and XMLs, transform unstructured data in a streams, build your own tools and frameworks, and much more..

In this talk we will get a first glimpse to Python through a live demo! We will extract data from an external API, and see how to easily manipulate and transform the data, and take actions upon it.

Bio: Shachar Meir is the Head of Big Data at WorldRemit, with over 10 years of experience with all aspects of data management.Shachar started his career as a DBA, and in the recent years, prior to WorldRemit, assumed the roles of Head of Analytics in Pontis and Data Engineering Manager at PayPal.