(IN-PERSON) Fabric CI/CD & Intro to Fabric Data Pipelines
Details
This is an In-Person Evening Session
Detailed information and registration can be found here :
https://dataminds.be/fabric-cicd-intro-to-fabric-data-pipelines-in-person-ae/
### Fabric CI/CD
Speaker: Oliver De Vijt
In Microsoft Fabric, deploying all items efficiently across environments requires a robust CI/CD strategy. While Fabric’s built-in deployment pipelines offer a no-code approach for basic promotion between workspaces, they lack flexibility, automation capabilities, and testing.
In this session, we’ll dive deep into Fabric CI/CD practices, leveraging Git integration, the Fabric REST APIs, and the fabric-cicd Python library to automate the deployment of Fabric items such as semantic models, notebooks, dataflows, and reports. You’ll see how to design YAML-based Azure DevOps pipelines that deploy from source control into your Fabric development, test, and production workspaces, and even include steps to run and validate your models using Tabular Editor.
By the end of this session, you’ll understand how to implement your own end-to-end CI/CD framework for Microsoft Fabric, even in Power BI Pro environments, using entirely free and open-source tools.
### Intro to Fabric (Data) Pipelines
Speakers: Koen Verbeeck
Fabric Pipelines, formerly known as Fabric Data Pipelines, is the low-code ELT (extract-load-transform) solution in Microsoft Fabric.
With this tool, you can orchestrate various activities, such as reading data from various data sources, executing Spark notebooks, running SQL statements on your warehouse and so on.
In the wider Azure Data Platform, Fabric Pipelines are a close sibling of Azure Data Factory and Synapse Pipelines.
In this session, we’ll cover the following topics:
- Intro to the various concepts of Fabric Pipelines (activities, connections, parameters, variables etc)
- What are the differences with ADF and Synapse Pipelines?
- Tips & tricks
After the session, you’ll be able to start your own data engineering journey with Fabric Pipelines in Microsoft Fabric.
Knowledge of general ETL concepts are a plus when attending this presentation.
