Exploring New Python Package Managers & Column Level Lineage for Data Platforms

Join us for the upcoming PyData Amsterdam meetup that we host in collaboration with Digital Power.

Schedule

18.00-19.00: Walk in with drinks and food (🍕 /🍺)
19.00-19.45: Beyond Pip: Exploring New Python Package Managers
19.45-20:00: short break
20.00-20:45: Column Level Lineage for Data Platforms
20.45-21.30: Networking + drinks and bites

[Talk 1]: Beyond Pip: Exploring New Package Managers by Roy Klip
Package managers are essential for developing in Python, with pip being the most widely used one. However, over time pip has been superseded by numerous alternatives. In this talk, we will compare pip with its more modern competitors, such as Poetry, PDM, Hatch and Rye. What advantages do they bring and why should you consider them as your “one-stop-shop” for Python?

[Talk 2]: Column Level Lineage for Data Platforms by Diederik Jan Lemkes
In this talk, we will discuss how column level lineage can serve as a primer for a better data development process, data mesh, and data platform. We will zoom in on how popular tools such as dbt Cloud and SQLMesh offer column level lineage to its users.
Additionally, we will demonstrate how to extract column level lineage yourself from dbt and BigQuery query logs using SQLGlot and DuckDB.

We invite all data engineers, analytics professionals, python developers and data scientists to join us in deepening your technical expertise, learning cutting-edge tools and techniques, and networking with fellow professionals passionate about Python and data engineering.