Designing and Implementing Data Mesh at Your Company (Separate Registration)

Join us in Chicago or virtually! This meetup is 21+ (with pizza & beer served) and separate, advance registration is required here:
https://events.quantumblack.com/designingandimplementingdatame

Meetup RSVP's do not save your spot.

CDE members will meet in person in Chicago and we will join the Boston Data Engineering group for the presentation via Zoom.

Data Mesh is a fairly new approach to help companies do more with data, faster. It requires both organizational and technical changes to enable autonomy and self-service, treat data as a product and encourage secure collaboration.

In this session, we will discuss practical approaches you can implement today to help your company start benefiting from Data Mesh. We'll show you how to create autonomy by splitting responsibility between data producers and consumers, share datasets and make data discovery easy.

We'll show a demo with producers building an ingestion pipeline that publishes datasets to consumer accounts (data mesh domains). SQL templates will be provided for members to follow along and build on their own.

We'll present these use cases built with data mesh design patterns:

1. A multi-tenant data lake that allows data producers to share datasets with consumers outside of the organization (3rd parties).

2. A security data lake that allows different teams to publish curated logs to their local Elasticsearch clusters for analysis, and to a central data lake for retention, auditing and historical analysis.

We'll also discuss managing data contracts/schemas between producers and consumers, to enable ownership and better data quality when sharing datasets.

About the Speaker:

Roy Hasson is Head of Product at Upsolver, building the future of data development platforms. Roy previously worked at AWS as a product manager for Amazon Athena, AWS Glue and AWS Lake Formation. He was an early evangelist and practitioner of Data Mesh, working with several large companies like JPMorgan Chase, to implement Data Mesh.

Agenda:

5:00 - Networking with pizza, beer and other beverages
5:30 - Welcome & Introduction
5:40 - Boston Data Engineering "Data Mesh" presentation (via Zoom)
6:40 - Questions & Answers
6:55 - More Networking
7:15 - Meetup Ends

Location:
McKinsey & Company
Chicago, IL

This meetup is brought to you in partnership with:

QuantumBlack - The Machine Learning and AI center of innovation and excellence of McKinsey & Company. We operate at the intersection of strategy, technology and design to improve performance outcomes for companies and we bring together the brightest data scientists, engineers and designers to take on the biggest problems facing organizations.

Upsolver is building the future data development platform called SQLake. With SQLake, users write a SQL query and get a production ready, reliable and automated data pipeline, without the need to manage or scale infrastructure, build orchestration DAGs or continuously optimize data to improve query performance.
Learn about SQLake: Data Pipelines Without Manual Orchestration.

This meetup is 21+, due to beer being served.
Government-issued ID is required to attend in person.
Due to security, please register here by noon CT on February 8th to receive an email with the location details and the Zoom link.