Unstoppable Fabric: Deep Dive into Scalable, AI-Ready Spark in Microsoft Fabric
Details
In this session, we’ll take a practical deep dive into Spark-based data engineering in Microsoft Fabric. We’ll walk through proven techniques and repeatable patterns for solving common and advanced data engineering challenges, covering advanced Spark SQL functions, effective approaches to semi-structured data, and strategies for building reliable, maintainable pipelines. We will be focusing on Fabric-specific aspects of Spark Notebooks, including table optimization.
AI-related capabilities in Fabric Spark will also be covered, including built-in and integrated functions that support text processing, enrichment, classification, and feature engineering directly within Spark workloads, along with guidance on where these functions fit.
Audience: The presentation is technical and aimed at data engineers and analytics engineers using Spark in Fabric. The session is beginner-friendly, with roughly 50% focused on advanced techniques.