Building smarter pipelines with metadata and a dash of Fabric


Details
Remember the good ol' days of SSIS and execution frameworks? That kind of orchestration magic deserves a fresh spin in the cloud era — and no, it's not just a lift-and-shift. In this session, we'll explore how to reimagine metadata-driven execution in a truly modern, cloud-native, asynchronous way. We'll cover the quirks of async runs, how to wrangle logs, and the cloud-specific gotchas you will encounter.
But it’s not all challenges — we’ve got some new toys, too! Microsoft Fabric brings smarter, more flexible framework possibilities with less headache and way more automation. We'll build a solution from the ground up, walking through architecture, dynamic execution strategies, and the essential components to keep your pipelines humming.
Whether you are using Azure Data Factory, Synapse Pipelines, Fabric Data Factory, or even eyeing tools like dbt, this session will give you a framework that adapts across tools and keeps pace with the modern data stack.

Building smarter pipelines with metadata and a dash of Fabric