Deep Dive into Data Lakehouse with LakeFS and Delta Lake

Join this fun LakeFS and Delta Lake meetup at Databricks HQ in SF! Meet the Vino Duraisamy and Oz Katz from the Treeverse (creators of LakeFS) as well as Scott Sandre, Delta Lake maintainer from Databricks.

Agenda

• 5:30pm - 6pm: Networking
• 6pm - 6:30pm: Building Reliable Data Lakes with Delta Lake 2.0
• 6:30pm - 7pm: lakeFS Talk
• 7pm - 7:30pm: Networking

Session 1: Building Reliable Data Lakes with Delta Lake 2.0
Speaker: Scott Sandre, Delta Lake maintainezxr, Software Engineer @ Databricks.

Delta Lake enables organizations to build Data Lakehouses, which enable data warehousing and machine learning directly on the data lake. But Delta Lake does not stop there. Today, it is one of the most comprehensive Lakehouse formats used by over 7,000 organizations, processing exabytes of data per day.

Let’s dive into the recent features of Delta Lake 2.0 and what makes the greater Delta connector ecosystem special.

Session 2: Delta Lake and lakeFS Announcement
Speakers:

• Vino Duraisamy: Developer Advocate @lakeFS
• Oz Katz: Co-founder & CTO at Treeverse

Data engineers typically need to implement custom logic in scripts to guarantee two or more data assets (tables) are updated synchronously. This logic often requires extensive rewrites or periods during which data is unavailable or not synchronized.

We will demonstrate a way to run data transformation in isolation across multiple tables, without ever creating a copy of the tables, and once completed - atomically promote all the changes to production.