DoK Talks #101- Redpanda: how to build a storage engine for kubernetes

https://go.dok.community/slack
https://dok.community/

ABSTRACT OF THE TALK

How to build a stateful, transactional streaming storage engine on top of kubernetes.

KEY TAKE-AWAYS FROM THE TALK

1. Building storage engines in kubernetes is hard
2. You need tiered storage (S3 or google cloud bucket, Azure Blob) for total disaster recovery
3. You also need sound replication inside the cluster
4. You need a simple architecture so you can scale the pods easily

BIO

Alex Gallego is the founder and CEO of Vectorized, where he & the team hack on Redpanda, a modern streaming platform for mission critical workloads. Prior to Vectorized, he was a principal engineer at Akamai, as well as co-founder and CTO of Concord.io, a high performance stream processing engine built in C++ and acquired by Akamai in 2016.