Fast Data applications with the Alpakka Kafka connector

Hi Scalators,

For this event I'll be doing a test run of a talk I have scheduled for Scale by the Bay in November. Looking forward to feedback! :)

Talk: Fast Data applications with the Alpakka Kafka connector

The Alpakka Kafka connector (formerly known as reactive-kafka) is a component of the Alpakka project. It provides a diverse streaming toolkit, but sometimes it can be challenge to design these systems without a lot of experience with Akka Streams and Akka. By combining Akka Streams with Kafka using Alpakka Kafka, we can build rich domain, low latency, and stateful streaming applications with very little infrastructure.

This talk will discuss solutions to common Kafka and streaming problems such as consumer group partition rebalancing, exactly-once/transactional message delivery, stateful stages, state durability/persistence, and common production concerns like job failover and deployment.

The Alpakka project is an open source initiative to implement stream-aware, reactive, integration pipelines for Java and Scala. It is built on top of Akka Streams, and has been designed from the ground up to understand streaming natively and provide a DSL for reactive and stream-oriented programming, with built-in support for backpressure.

Speaker Bio: Sean Glover

Sean is a Senior Software Engineer on the Fast Data Platform team at Lightbend where he specializes in Apache Kafka and its ecosystem. Sean has several years experience consulting for Global 5000 companies and helping them build data streaming platforms using technologies such as Kafka, Spark, Flink, and Akka on Kubernetes. Sean enjoys building fast data platforms, reactive distributed systems, and contributing to open source projects.

Agenda

6:45 - Doors Open

7:10 - Local Scala Engineering Shops Hiring Pitch

7:20 - Organizer introduction and talk

8:00 - Mingle