Big Data & Stream Processing with Apache Spark

Abstract:

Apache Spark (http://spark.apache.org (http://sprak.apache.org)) is the most popular Big Data framework written in Scala. I would like to introduce the ideas and fields of application of this framework and, in particular, also show practical examples by means of code.

In addition to the batch processing of large amounts of data, Spark also supports the processing of data streams - keyword fast data. I would also like to point this out, but there will also be an overview on alternatives here, i.e Apache Kafka Streams or Apache Flink (These unfortunately have mostly no native Scala API :-()

Speaker:

Matthias Niehoff ( https://twitter.com/matthiasniehoff ) is an IT consultant at codecentric AG in Germany, where he focuses on big data and streaming applications with Apache Cassandra, Apache Spark and various stream processing frameworks. He also tries not to lose sight of other tools in the area of big data. Matthias shares his experience at conferences, meetups, and user groups.

Douglas will provide pizzas & beverages.