11th Jul 24 | East Midlands Data | Nottingham | Speaker - Simon Whiteley

___________________________________________________________________________________

MeetUp Agenda

18:00 - Arrive. Networking
18:30 - Guest Speaker Talk
19:30 - Pizza. Networking
20:30 - Event Close

___________________________________________________________________________________

An Introduction to Azure Databricks

Azure Databricks is a cloud-based platform that provides a unified environment for data engineering, data science, and analytics. It is based on Apache Spark, an open-source framework for distributed computing, and offers various features and benefits that make it a powerful and scalable solution for data-driven applications. In this talk, we will introduce the main concepts and components of Azure Databricks and show how it can help you accelerate your data projects and deliver business value.

Some of the topics that we will cover in this talk are:

• What is Azure Databricks and how does it differ from other cloud services?

• How to create and manage Azure Databricks clusters and workspaces?

• How to use Azure Databricks notebooks and tools for interactive data exploration and collaboration?

• What is Delta Lake and how does it enable reliable and performant data storage and processing?

• What is Unity Catalog and how does it provide data governance and security across your data assets?

• What are Delta Live Tables and how do they enable real-time data ingestion and transformation?

• How to use Azure Databricks workflows and pipelines to orchestrate and automate your data workflows?

• How to use Azure Databricks to run Spark streaming jobs and handle streaming data sources?

By the end of this talk, you will have a better understanding of Azure Databricks and its capabilities, and you will be able to start using it for your own data projects. You will also learn some best practices and tips for working with Azure Databricks and optimizing its performance and cost. Whether you are new to Azure Databricks or already have some experience with it, this talk will provide you with valuable insights and knowledge that you can apply to your data scenarios.

___________________________________________________________________________________

Venue Website

https://www.castlerockbrewery.co.uk/pubs/vat-and-fiddle

___________________________________________________________________________________

MeetUp Member Resources In GitHub Here:

https://github.com/EastMidlandsData

Including introduction slides and our Code of Conduct.

___________________________________________________________________________________