Mastering Data Engineering
Details
Hi All,
We are excited to invite you to another informative Saturday morning.
Agenda:
10:00 – 10:10 DSEclub introduction
10:10 – 10:50 From Open Storage to Open Meaning: How Apache Ossie (Incubating) Completes the Open Data Lakehouse by Will Martin
11:00 – 11:30 Data Streaming at Home by Georgi Samardzhiev
11:30 – 12:00 Projects & Networking
Topic 1: The open data lakehouse has a solid data foundation thanks to Apache Iceberg and Apache Polaris: an open table format and catalog that any query engine can share without lock-in. But openness in storage doesn't mean openness in meaning. Business context, like “revenue” and “active customer”, tends to sit in downstream systems, like notebooks and BI tools. These definitions tend not to agree, and they don’t travel well between systems. That is, until Apache Ossie (Incubating) — the newly Apache-incubated open spec for semantic layers and ontologies, backed by Snowflake, Dremio, Databricks, dbt Labs, and Salesforce.
This talk will explain the current open data lakehouse stack and introduce Apache Ossie (Incubating). We’ll discuss how open source projects provide vendor-neutral options without sacrificing performance, and why shared semantics is the next open standards fight in this age of agentic analytics.
Will Martin is Dremio’s Data & AI Evangelist. Starting out with statistical analysis in particle physics, his professional journey has spanned multiple industries, including banking, shipping logistics, entertainment, healthcare, defence, and customer 360. With experience as a data engineer, solutions architect, and software developer, he has spent 15+ years collaborating with companies and organisations across EMEA and APAC, including roles at CERN, Deloitte, and Tamr.
Topic 2: Apache Kafka and Apache Iceberg as a machine for learning — and the issues that did the teaching.
A full account of a streaming Kappa platform in my homelab — Kafka, Iceberg, Bytewax, k3s, self-hosted S3 — built to learn on rather than to meet a requirement, moving four megabytes a day, and still teaching, mostly by breaking in the seams between its own parts.
Let Roman Golovnya know if you're interested in hosting the next event or presenting at future meetups. You can contact him via meetup messages or email roman.golovnya@gmail.com.