Databricks User Group Belgium 15th Meetup (In-Person)
Details
Please note: As we’re moving to the Databricks User Group platform, we’re only accepting RSVPs there. Please register here: https://usergroups.databricks.com/e/mv2gg3/
Join us for the 15th edition of our meetup, filled with insightful sessions on Databricks, great company, and drinks & bites. As always, expect the same great format: a food & drinks reception, two sessions, and a laid-back closing drink.
📍 Location:
Datashift
Havenkant 8,
3000 Leuven,
Belgium
🚅 How to get there?
The venue is easy to reach by car or public transport. Parking Vaartkom is a 3-minute walk from the offices, and Leuven station is an 18-minute walk away.
🕡 Schedule:
- 18:00: Welcome with food & drinks
Doors open, grab a drink and a bite as we get started!
- 19:00 - 19:40: Data Contracts as Code on Azure Databricks - Ceren Morey
Data contracts define what a dataset should look like, how fresh it should be, who can access it, and what quality it must meet. The problem is that most of them live in Confluence pages and YAML files nobody reads after the first sprint. A document saying “order_id must not be null” won’t stop a null from being written.
In this session, I’ll show how to use Unity Catalog and Lakeflow Spark Declarative Pipelines to turn six contract attributes into code: schema, quality, usage policies, security, SLAs, and data description. Each one is defined once, enforced automatically, monitored continuously, and versioned in Git.
- 19:50 pm - 20:30 pm: Unlocking Sub-Second Streaming with Real-Time Mode on Databricks - Anant Pingle
Traditionally, Spark Structured Streaming has relied on micro-batch processing. This works well for ETL and analytical workloads, but introduces latency that can be limiting for applications that need to react to events immediately.
Real-Time Mode (RTM) changes that. By introducing continuous, event-driven processing, it brings end-to-end latency down to as low as 5 milliseconds for suitable workloads, while retaining the familiar Structured Streaming APIs.
In this session, we'll explore what RTM is, look under the hood at the architectural innovations that make millisecond-level streaming possible in Spark, and examine the operational use cases it unlocks, from fraud detection to real-time personalization.
Expect a live demo, architectural deep dives, and practical lessons from real-world deployments.
- 20:30 pm : Networking
🚀 Be part of our 15th meetup - RSVP now and join the community!
As we’re moving to the Databricks User Group platform, we’re only accepting RSVPs there. Please register here: https://usergroups.databricks.com/e/mv2gg3/
🔊 If you want to speak at an upcoming meetup, don't hesitate to submit your session here!
