Name: [ONLINE] aggregate(PyLadies, PyAmsterdam, ETL).byebye(2020)
Start: 2020-12-22T18:30:00+01:00
End: 2020-12-22T20:30:00+01:00

This time together with PyLadies Amsterdam [1] and it's all about
ETL/ELT in action. Talks Level: Intermediate-Advanced

You can join the Pyladies meetup in this link!
https://www.meetup.com/PyLadiesAMS/events/274429108/

**Important!!!** How to join: On the morning of the event, you will
get a link via Meetup. Make sure that you have opted for emails from
Meetup.

Schedule
--------

+-------+--------------------------------------------------------------------------------------------------------------------------------------+
| 18:30 | Intro |
+-------+--------------------------------------------------------------------------------------------------------------------------------------+
| 18:40 | Data Processing with Python: a Containerized, Scheduled, and Monitored Pipeline on the Google Cloud Platform - Nancy Irisarri Méndez |
+-------+--------------------------------------------------------------------------------------------------------------------------------------+
| 19:15 | AWS Glue - the good, the bad, the ugly - Jan Gazda |
+-------+--------------------------------------------------------------------------------------------------------------------------------------+
| 19:50 | Lightning talks |
+-------+--------------------------------------------------------------------------------------------------------------------------------------+
| 20:00 | Free chat |
+-------+--------------------------------------------------------------------------------------------------------------------------------------+

Data Processing with Python: a Containerized, Scheduled, and Monitored Pipeline on the Google Cloud Platform
------------------------------------------------------------------------------------------------------------

About: Nancy Irisarri Méndez [2] I studied economics and astronomy and
have worked within research groups, government organizations, and
health care. My strong suit is data science and data engineering,
using Python and cloud providers as favorite tools.

Abstract
~~~~~~~~

During the talk, you will learn how to containerize a Python pipeline
for data processing and execute it as a scheduled job that sends email
messages for critical errors.

AWS Glue - the good, the bad, the ugly
--------------------------------------

About Jan Gazda [3]:

Jan is a co-founder of PyAmsterdam, Pythonista and open-source
contributor. Coming from Czech Republic he decided to bring the Python
community spirit to Amsterdam. Python is his swiss army knife but he
is not afraid of Golang as well. (But who needs types, right?)

Abstract
~~~~~~~~

AWS Glue offers Serverless ETL pipeline and workflows, while it can be
rather simple to start using it via console it quickly become non
trivial for deployment via CI/CD pipeline. Management of multiple
environments, working with the pipeline state and keeping your code
DRY is a challenge. During the talk I will walk you through guts of
AWS Glue and show my approach to more streamlined deployment.

Links
-----

[1] https://amsterdam.pyladies.com

[2] https://www.linkedin.com/in/nancyirisarrimendez

[3] https://github.com/1oglop1/

Nicolás Demarchi

Jan Gazda

Una Galyeva

PyAmsterdam

Python Software Foundation Meetup Pro Network

Gandi.net is supporting our community with our .amsterdam domain

Gandi

FareHarbor is the all-in-one booking solution

Fareharbor

Optiver

Technology

Open Source

Collaboration

New Technology

Python

Web Design

Software Development

Web Development

Computer Programming

Knowledge Sharing

Python Web Development

Open Source Python

Data Science using Python

Django

Community

[ONLINE] aggregate(PyLadies, PyAmsterdam, ETL).byebye(2020)

Online event

Share

PyAmsterdam

[ONLINE] aggregate(PyLadies, PyAmsterdam, ETL).byebye(2020)

PyAmsterdam

Details

Sponsors

Members are also interested in