Data Lake Management with Azure Synapse and Delta Lake

Please join us on 19th Jan 2023 to learn Data Lake Management with Azure Synapse and Delta Lake

What ~ Toronto Data Professionals Community (Virtual)

When ~ Thursday 19th Jan 2023

Agenda:

06:00 PM Networking and Introduction

06:15 PM Topic: Data Lake Management with Azure Synapse and Delta Lake by Ginger Grant who is a Data Platform MVP. She is an author of articles, and books at DesertIsleSQL.com

7:30 PM End

Where: Online via Microsoft team

Session Details:

Data lake management is required to ensure that the information stored can be readily analyzed. Spark Delta Lake moves the structure of a data lake closer to a database and is definitely something you are going to want to implement in Azure Synapse Analytics. In this session, you will learn how to apply Spark Delta Lake to improve data quality, query speed, and review backups of files stored in the data lake. Implementing these strategies can improve analysis capabilities as data can be analyzed more like a data warehouse, without all of the transformation and storage costs. Using Delta Lake, attendees will see how to ensure the format is known when it was added, rather than finding out years later that no one is able to determine what is in the files. As data lakes can be queried like a database, we will examine how to speed analysis with Delta Lake by indexing flat files and consolidating the data to improve query performance. Need to look at what the data looked like prior to a change being made to the data in the lake? We will look at ways to travel back in time to review the data. This session will provide the skills needed to improve your data lake management with Delta Lake making it even easier to analyze data in Azure Synapse.

Speaker Bio:
Ginger Grant is a Data Platform MVP who provides consulting services in advanced analytic solutions, including machine learning, data warehousing, and Power BI. She is an author of articles, books, and at DesertIsleSQL.com and uses her MCT to provide data platform training in topics such as Azure Synapse Analytics, Python, and Azure Machine Learning.