Efficient Data Processing and Storage with Databricks (Data Reply & Databricks)

Welcome, data enthusiasts!
We're excited to invite you to our upcoming meetup, co-organized by Data Reply and Databricks, taking place in Munich on March 12th, starting at 6:00 pm.

Join us for a deep dive into the transformative world of Databricks!

🗓 Agenda:
6:00pm - 6:30pm: Food , Drinks 🍻🥤 & Network
6:30pm - 7:15pm: Diana Duque, IT Consultant, Data Reply
7:15pm - 8:00pm: Felix Mutzl, Senior Solutions Architect, Databricks
8:00pm - 8:15pm: Meetup and Network
***

💡 Speaker 1:
Diana Duque, IT Consultant, Data Reply

Bio:
As well as taking on the challenges of data and platform development as a consultant, Diana enjoys spending time with people from different backgrounds, traveling and learning new languages.

Talk:
Secure Change Data Capture (CDC) with Databricks

Abstract:
This presentation outlines the implementation of a Data Pipeline on Databricks, utilizing Delta Live Tables and Autoloader for effective Change Data Capture (CDC). To enhance data security, we incorporated Data Pseudonymisation by leveraging Spark's inherent encryption functions to safeguard personally identifiable information (PII). The deployment process was automated through Terraform and Terragrunt. Ultimately, an API based on Lambda Functions was developed to ensure seamless access to the processed data.

🔗 Connect with Diana over LinkedIn and exchange thoughts and ideas!

-----
💡 Speaker 2:
Felix Mutzl, Senior Solutions Architect, Databricks

Bio:
When not talking about Data & AI, Felix is a proud father and explores playgrounds and skate parks in the city. He spent the last couple of years advancing data-driven and digital transformations at international manufacturing companies: hands-on, both, in code and on the shopfloor.

Talk:
Why the best data warehouse is a lakehouse?

Abstract:
The data Lakehouse brings the performance and reliability one expects from a data warehouse to the scalability and cost-effectiveness of a data lake. This architecture has been around for a while and is here to stay, so let's have a closer look at it and what happens when you throw AI into the mix.

🔗 Connect with Felix over LinkedIn and exchange thoughts and ideas!