Scaling the Event Stream

Come and pick the bones of a production system that has scaled from millions to billions of events a day while remaining available and durable.

We'll cover the basic problem, key requirements, architecture and trade-offs, and how different distributed technologies deal with the operational matter of scaling out as the event stream grows.

Technologies: Apache Kafka, Cassandra, Storm

Techniques: Semantic partitioning, consistent hashing.

18:30 - Chatty chatty
19:00 - Talky talky

Host: Airwallex, CBD.