Skip to content

Real World Data Engineering: Industry Use Case & Keynote on Data Mesh

Photo of Romain
Hosted By
Romain and Jérémi D.
Real World Data Engineering: Industry Use Case & Keynote on Data Mesh

Details

REGISTRATION IS NOW CLOSED -- WE REACHED MAXIMAL CAPACITY. THANK YOU!

Join us in Montréal! We will be serving pizza and non-alcoholic drinks. Separate, advance registration is required here:
https://events.quantumblack.com/designingandimplementingdatame

Meetup RSVP's do not save your spot. Hosts are bilingual (French & English), however the presentation and Q&A will be mainly in English.

Agenda
6:00p - Welcome with pizza and beverages
6:15p - Introduction, presentation of sponsors
6:20p - Industry Use Case: AI architecture with Databricks at a multinational manufacturing company
6:40p – Keynote (hybrid): Data Mesh - Design and implementation at your own company
7:40p - Questions & Answers
7:55p - More Networking
8:15 - Meetup Ends
(agenda subject to change)

Details about the Data Mesh Keynote
Data Mesh is a fairly new approach to help companies do more with data, faster. It requires both organizational and technical changes to enable autonomy and self-service, treat data as a product and encourage secure collaboration.

In this session, we will discuss practical approaches you can implement today to help your company start benefiting from Data Mesh. We'll show you how to create autonomy by splitting responsibility between data producers and consumers, sharing datasets, and making data discovery easy.
We'll show a demo with producers building an ingestion pipeline that publishes datasets to consumer accounts (data mesh domains). SQL templates will be provided for members to follow along and build on their own.

We'll present these use cases built with data mesh design patterns:

1. A multi-tenant data lake that allows data producers to share datasets with consumers outside of the organization (3rd parties).

2. A security data lake that allows different teams to publish curated logs to their local Elasticsearch clusters for analysis and a central data lake for retention, auditing and historical analysis.

We'll also discuss managing data contracts/schemas between producers and consumers, to enable ownership and better data quality when sharing datasets.

About the Speaker:
Roy Hasson is Head of Product at Upsolver, building the future of data development platforms. Roy previously worked at AWS as a product manager for Amazon Athena, AWS Glue and AWS Lake Formation. He was an early evangelist and practitioner of Data Mesh, working with several large companies like JPMorgan Chase, to implement Data Mesh.

Location
McKinsey & Company/QuantumBlack office, Montréal downtown. To ensure a safe event, please register here before 12p on February 8th to receive the details of the venue. There is also an option to join the Data Mesh Keynote on Zoom -- select "Virtually" in the registration link.

***

This meetup is brought to you in partnership with:

QuantumBlack - The Machine Learning and AI center of innovation and excellence of McKinsey & Company. We operate at the intersection of strategy, technology and design to improve performance outcomes for companies and we bring together the brightest data scientists, engineers and designers to take on the biggest problems facing organizations.

Upsolver is building the future data development platform called SQLake. With SQLake, users write a SQL query and get a production ready, reliable and automated data pipeline, without the need to manage or scale infrastructure, build orchestration DAGs or continuously optimize data to improve query performance.
Learn about SQLake: Data Pipelines Without Manual Orchestration.

Please register here by noon ET on February 8th to receive an email with the location details.

Photo of Montreal Data Engineering group
Montreal Data Engineering
See more events
H3B 4K4
· Montreal, QC