13 Nov Meetup K8 with Instaclustr & Google!

Talk 1: Paul Brebner - Tech Evangelist, Instaclustr

"Scaling applications with Kubernetes, Apache Kafka and Apache Cassandra"

Apache Kafka, Apache Cassandra and Kubernetes are open source big data technologies enabling applications and business operations to scale massively and rapidly. While Kafka and Cassandra underpin the data layer of the stack providing the capability to stream, disseminate, store and retrieve data at very low latency, Kubernetes is a container orchestration technology that helps in automated application deployment and scaling of application clusters.

In this presentation, Paul will reveal how he architected a massive-scale deployment of a streaming data pipeline with Kafka and Cassandra to cater to an example anomaly detection application running on a Kubernetes cluster and generating and processing a massive amount of events.

Anomaly detection is a method used to detect unusual events in an event stream. It is widely used in a range of applications such as financial fraud detection, security, threat detection, website user analytics, sensors, IoT, system health monitoring, etc. When such applications operate at massive scale generating millions or billions of events, they impose significant computational, performance and scalability challenges to anomaly detection algorithms and data layer technologies. Paul will demonstrate the scalability, performance and cost-effectiveness of Apache Kafka, Cassandra and Kubernetes, with results from his experiments allowing the anomaly detection application to scale to 19 billion checks per day.

-----
Lightning Talk (10mins): Samuel Marks, Founder. Offscale.io
Title: Two-level schedulers and etcd decoupling (RFC)
Description: Kubernetes uses etcd for its backing store, our contributions to Apache Mesos have decoupled Apache ZooKeeper and enable additional choices between etcd and HashiCorp Consul. Mesos has a Two-Level Scheduler Architecture as opposed to Kubernetes. My team can decouple etcd and port Mesos within Kubernetes, however, it is unclear whether the community wants this. Do you? 🦀

Talk 2: Glen Messenger - Security Specialist, Cloud Google

Security and Kubernetes - the focus is typically on securing the clusters.

This talk will focus loosely on securing the workloads using native tooling and some open-source approaches. We’ll include a few live demos on using some alternative mechanisms to secure workloads (such as OPA+Gatekeeper, Falco etc) as well as an open and honest Q&A about what works… and what doesn’t.

FREE food and drinks provided!
BIG thanks to our generous sponsors INSTACLUSTR and GOOGLE!!!