Skip to content

IN-PERSON: Apache Kafka® x Apache Iceberg x Data Engineer Things

Photo of Alice Richardson
Hosted By
Alice R.
IN-PERSON: Apache Kafka® x Apache Iceberg x Data Engineer Things

Details

IMPORTANT PLEASE RSVP @ https://www.meetup.com/data-engineer-things-seattle-meetup/events/310671201/?utm_medium=referral&utm_campaign=announce_event&utm_source=link&utm_version=v2

Agenda
6 PM - 6:20 PM - Enjoy snacks, meet your Seattle DET community
6:20 PM - 6:30 PM - A quick overview of DET
6:30 PM - 7:30 PM - Listen to industry experts on a Data Engineering topics
7:30 PM - 8 PM - Network with data enthusiasts

Speakers:
Kasun Indrasiri Gamage — Senior Product Manager @Confluent
Topic: Streaming from Kafka to Delta Lake and Iceberg Tables

Abstract: Transforming Kafka data streams into query-ready tables is far from simple. Converting high-velocity events into Delta or Iceberg tables often forces teams to build brittle, expensive ETL pipelines, while standard sink connectors struggle with essentials like schema evolution, compaction, and catalog integration. The complexity escalates when the same Kafka topic must be materialized in multiple table formats and made available across different catalogs such as Unity, Glue, or Polaris. In this session, we’ll explore why streaming into open table formats is so challenging, outline the principles of a better approach, and demonstrate how Confluent Tableflow tries to address these challenges. We’ll wrap up with a live demo showing a Kafka topic published simultaneously as Delta and Iceberg tables across multiple catalogs.

Lauren Lin — Data Engineering Manager @Disney
Topic: Building Your Data Engineering Career: Lessons from 10+ Years of Trial and Error

Abstract: Achieving career success is something we all strive for, but figuring out how to get there is often ambiguous and nonlinear. As you navigate career growth in data engineering, you'll likely wonder - what should I focus on learning now? How should I be operating differently? Do I prioritize that urgent pipeline fix or invest in foundational architecture? And eventually - do I actually want to go down the management path? While I don't have all the answers, I will share highlights from my 10+ year career as a data engineer and now manager, including stories of turning points that helped me land where I am today and the struggles I faced along the way.

We'll cover topics such as where to focus your energy as a new grad, learning how to prioritize ad hoc requests versus foundational work, delegating effectively, and navigating the decision to stay on the IC path or move to management. Whether you're early in your career or a senior engineer considering your next move, you'll walk away with practical insights for making strategic career decisions.

Photo of Seattle Apache Kafka Meetup group
Seattle Apache Kafka Meetup
See more events
Databricks Bellevue WA
500 108th Ave NE, 26th Floor · Bellevue, WA. · Bellevue, WA