NL dbt meetup: 3rd Edition
Details
Get ready for the 3rd dbt Meetup in the Netherlands!
This time brought to you by https://vandebron.nl/Vandebron!
Schedule:
17:30 – 🍕 Welcome.
18:00 – 🎤 Utilizing Temporal Tables in dbt Incremental Models
18:30 – 🎤 Reigniting Data Modeling: Sensible Strategies for the 2020s and Beyond
19:00 – 🎤 Building on top of dbt
19:30 –🥤 Drinks
---
🎤 Utilizing Temporal Tables in dbt Incremental Models
Daniel Herrera | Principal Developer Advocate at Teradata
This session provides an in-depth examination of the integration of temporal tables within a dbt project. We'll elucidate how temporal tables serve as an efficient method for tracking newly added or updated records, thereby enhancing the efficiency of incremental models. Additionally, we'll highlight alternative strategies, including dbt snapshots, that can achieve comparable outcomes.
Discussion Points:
-
Review of Incremental Models: Understanding incremental models and their runs.
-
Insights into Temporal Tables: Dive into the functionalities of the TRANSACTIONTIME PERIOD fields and comprehend their significance in monitoring record additions and updates.
-
Harnessing Temporal Data in DBT: An extensive analysis on how dbt models can leverage temporal markers to filter and ingest only the newly added or updated data.
-
DBT Snapshots: An exploration of snapshots as an alternative approach to temporal tables.
---
🎤 Reigniting Data Modeling: Sensible Strategies for the 2020s and Beyond
Niko Korvenlaita | CTO at reconfigured
This talk covers theoretical and practical learnings from Niko's journey to productize data modeling best practices into performant dbt code, across major data warehouses. In this talk Niko will cover long forgotten data modeling best practices, as well as design you can apply to your own dbt projects. Be prepared: This is not going to be jaffle shop but instead we’ll dive to the deep end with incrementality, temporality and event ledgers. All whilst not blowing up your compute costs. Niko will also share practical learnings on how to build agile data processes in DWH centric setup.
---
🎤 Building on top of dbt
Mats Stijlaart | Analytics Engineer at Vandebron
Pieter Custers | Tech Lead Data Analytics at Vandebron
dbt takes a central position in the data stack, but is never the start or the end of any data pipeline. In this talk Vandebron will show how they use Dagster — a data orchestration tool — and Lightdash — a self-service BI-tool — to seamlessly integrate Dbt in their stack.
Dagster and Dbt have in common that they recognize data assets as the first class citizens of a data pipeline. This common characteristic makes that they integrate very well with each other. The benefit of using Dagster is that its orchestration capabilities go beyond the data warehouse. This makes it possible to integrate dbt in a larger context, from ingestion to consumption of the data. Located at the consumption end, Lightdash is designed specifically to operate on top of dbt, and thereby lets you leverage the full potential of your data marts.
---
Join the dbt Slack community: https://community.getdbt.com/
Join the conversation in the #local-netherlands channel in dbt Slack to connect with other data practitioners locally.
To attend, please read the Required Participation Language for In-Person Events with dbt Labs: https://bit.ly/3QIJXFb