Sheffield Data Analytics User Group - Meeting #5

Meetup #5 at Electric Works (in front of the coach station and just up the road from the central train station).

Doors open from 5:30 to give you time to grab a drink and chat to fellow attendees. Talks running from 6 and a break for food provided by sponsors Simpsons Associates.

Speakers
Michael Flower: Building an Open Data Lakehouse using Apache Iceberg and Dremio
In this session, we will discuss the evolution of the big data landscape, to the data lakehouse concept. We will focus on how Open Data Lakehouses are developed, and how to secure, govern and augment using Dremio.

We will demonstrate using Dremio and other components of the ecosystem, including using ADLS, Apache Iceberg, MS SQL Server and MS PowerBI.

Grace O'Halloran: Another Brick in the Firewall: How to Secure your Azure Data Platform
These days, most people want their Azure Data Platforms to be deployed in a secure a network topology. As Data Engineers, we are often the ones that have the make this happen. The cloud has made it easy for us to deploy a virtual network here and a private endpoint there, but what does a good, networked data platform actually look like, and how does it work? Simple things become complex: how will my ADF Integration Runtime talk to my data sources? How do I securely access my resources to do development?
In this session we will look at some of the core network components which can be used to secure your data platform; what they are, and how to use them effectively. We will also look at some of the decisions that need to be made when moving your data platform inside a private network, which weren't a consideration previously. Some basic knowledge of what a virtual network is is required.
By the end of this session you should feel more confident in working with network components in Azure and how you can use them to secure your Data Platform.

Close at 8:30 with a chance to continue conversations at the Sheffield Tab by the train station.