Apache NiFi Meetup
Details
Unser nächstes Meetup steht an!
Liebe NiFi-Enthusiasten,
wir freuen uns sehr, euch zu unserem kommenden Apache NiFi Meetup einzuladen, eine Veranstaltung für Data-Flow-Professionals und -Enthusiasten, die die neuesten Entwicklungen und Best Practices in der Welt von NiFi entdecken möchten.
🔹 Event Details:
- Datum: 03/12/2026
- Uhrzeit: 16:30 CEST
- Ort: Online
🔹 Title: NiFi on Kubernetes: first make it boring, then make it scale
I work on the Apache NiFi operator in the Stackable Data Platform (SDP), which means NiFi clusters I will never see run on defaults we picked. Some of those defaults have stories. One had “for testing” in a comment next to it and shipped like that anyway. Another was an empty retention setting that NiFi read as “forever”, right up until startup meant scanning millions of archived files. And then there was that very optimistic readiness probe ... But it doesn't stop there, even where our job ends and NiFi starts there is havoc to be found, NiFi was written in an era before Kubernetes, ips were stable and always reachable, storage didn't "just go away" underneath your process .. all kinds of fun new scenarios to take into account.
The first half is about making NiFi 2 on Kubernetes boring: cluster state without ZooKeeper, why the first five minutes after startup matter, and how to stop a node without wrecking its own repositories.
The second half is autoscaling. Up is easy. Down means removing a node that still has FlowFiles on its disk, and the obvious Kubernetes answer is wrong in a way that took us a while to admit. I’ll show what works today, what we’re designing instead, and I’d like to hear how you do it, because I suspect nobody has a clean answer yet.
🔹Presenter: Sönke Liebau co-founded Stackable in 2020 and is its CPO. The company’s Stackable Data Platform (SDP) is an open source data platform that runs natively on Kubernetes. Sönke shapes it directly: drawing on around 15 years in the open source and big data world, he designs data architectures together with customers across numerous open source projects and feeds that hands-on experience straight into the product.
Wir freuen uns auf euch!
---
Join Our Online Apache NiFi Meetup – Get real Insights into Best Practices in the Field!
Dear NiFi Enthusiasts,
We're thrilled to invite you to our upcoming online Apache NiFi Meetup, a virtual gathering designed for data flow professionals and enthusiasts eager to explore the latest advancements and best practices in the world of NiFi.
🔹 Event Details:
- Date: 03/12/2026
- Time: 16:30 CEST
- Location: Online
🔹 Title: NiFi on Kubernetes: first make it boring, then make it scale
I work on the Apache NiFi operator in the Stackable Data Platform (SDP), which means NiFi clusters I will never see run on defaults we picked. Some of those defaults have stories. One had “for testing” in a comment next to it and shipped like that anyway. Another was an empty retention setting that NiFi read as “forever”, right up until startup meant scanning millions of archived files. And then there was that very optimistic readiness probe ... But it doesn't stop there, even where our job ends and NiFi starts there is havoc to be found, NiFi was written in an era before Kubernetes, ips were stable and always reachable, storage didn't "just go away" underneath your process .. all kinds of fun new scenarios to take into account.
The first half is about making NiFi 2 on Kubernetes boring: cluster state without ZooKeeper, why the first five minutes after startup matter, and how to stop a node without wrecking its own repositories.
The second half is autoscaling. Up is easy. Down means removing a node that still has FlowFiles on its disk, and the obvious Kubernetes answer is wrong in a way that took us a while to admit. I’ll show what works today, what we’re designing instead, and I’d like to hear how you do it, because I suspect nobody has a clean answer yet.
🔹Presenter: Sönke Liebau co-founded Stackable in 2020 and is its CPO. The company’s Stackable Data Platform (SDP) is an open source data platform that runs natively on Kubernetes. Sönke shapes it directly: drawing on around 15 years in the open source and big data world, he designs data architectures together with customers across numerous open source projects and feeds that hands-on experience straight into the product.
🔹 Special Notes: -
Don’t miss out on this opportunity to enhance your skills and broaden your understanding of Apache NiFi and get an insider view!
We look forward to seeing you online!