2nd Meeting: Stream Processing and War Stories

Hi,

we just renamed the group from SMACK to Fast Data and would like to host the second meetup. We will attempt to host this every two months, so please do not hesitate if you have any cool talks! See you around!

SMACK stack from the trenches (Achim)

In this talk I will give an overview about the SMACK - Stack (Streaming, Mesos, Akka, Cassandra, Kafka) and tell about the experiences made with this stack and how to fine tune it for massive data. For a better understanding on how a SMACK stack might work, a demonstration showing how to stream live bus data from Los Angeles with Spark and Flink is shown.

Achim Nierbeck is general manager of the Karlsruhe codecentric AG office in Germany. He has more than 15 years experience of working in the field of Java Enterprise. In the last years he focused on working with the SMACK stack and Apache Cassandra. Achim shares his experience at conferences, meetups, and user groups.

Stream Processing Comparison (Matthias)

In this talk I will give an overview on various concepts used in data stream processing. Most of them are used for solving problems in the field of time, focussing on processing time compared to event time. The techniques shown include the Dataflow API as it was introduced by Google and the concepts of stream and table duality. But I will also come up with other problems like data lookup and deployment of streaming applications and various strategies on solving these problems. In the end I will give a brief outline on the implementation status of those strategies in the popular streaming frameworks Apache Spark Streaming, Apache Flink and Kafka Streams.

Matthias Niehoff is an IT consultant at codecentric AG in Germany, where he focuses on big data and streaming applications with Apache Cassandra and Apache Spark as well as other tools in the area of big data. Matthias shares his experience at conferences, meetups, and user groups.

As always Drinks and Pizza are on us! Please care, Please share!

Stefan