This meetup is co-organized with PyAmsterdam (https://py.amsterdam/), and it's all about ETL/ELT in action.

Important !!! How to join:
On the morning of the event, you will get a link via Meetup. Make sure that you have opted for emails from Meetup.

Talks Level: Intermediate-Advanced

Talk 1 - Data Processing with Python: a Containerized, Scheduled, and Monitored Pipeline on the Google Cloud Platform

During the talk, you will learn how to containerize a Python pipeline for data processing and execute it as a scheduled job that sends email messages for critical errors.

Speaker:
Nancy Irisarri Méndez
https://www.linkedin.com/in/nancyirisarrimendez

I studied economics and astronomy and have worked within research groups, government organizations, and health care. My strong suit is data science and data engineering, using Python and cloud providers as favorite tools.

Talk 2 - AWS Glue: the good, the bad, the ugly

AWS Glue offers Serverless ETL pipeline and workflows, while it can be rather simple to start using it via console it quickly become non trivial for deployment via CI/CD pipeline. Management of multiple environments, working with the pipeline state and keeping your code DRY is a challenge. During the talk I will walk you through guts of AWS Glue and show my approach to more streamlined deployment.

Speaker:
Jan Gazda
https://github.com/1oglop1/
Jan is a co-founder of PyAmsterdam, Pythonista and open-source contributor. Coming from Czech Republic he decided to bring the Python community spirit to Amsterdam. Python is his swiss army knife but he is not afraid of Golang as well. (But who needs types, right?)

======================================
Agenda:
18:30 Intro
18:40 Data Processing with Python: a Containerized, Scheduled, and Monitored Pipeline on the Google Cloud Platform - Nancy Irisarri Méndez
19:15 AWS Glue - the good, the bad, the ugly - Jan Gazda
19:50 Lightning talks
20:00 Free chat

GitHub Repo:
https://github.com/pyladiesams/ETL-intermediate-dec2020

Any questions --> amsterdam@pyladies.com