Modern, Scalable Data Pipelines - Spark vs dbt Labs
Details
Struggling to decide when to fire up a Spark cluster and when to lean on dbt’s elegant SQL models? You’re not alone! Join the Infolob Data & AI crew for a relaxed, online evening of candid stories, live demos, and open Q&A where we will:
- Demystify both tools—what they’re great at, where they stumble, and how they can play nicely together.
- Walk through three real-world architecture patterns (Spark-first, dbt-first, and hybrid) you can copy-paste into your own projects.
- Run a mini pipeline in dbt Core on Redshift: staging → transforms → tests & lineage—no slides-only talk here!
The meetup is in collaboration with Infolob Global Inc.
---------------------------------
Who should attend?
Data engineers, analytics engineers, BI developers, architects, and anyone curious about the modern ELT / lakehouse ecosystem. Whether you’re a hardened PySpark coder or just dipping your toes into dbt, you’ll leave with practical “when to use what” guidelines.