Stream Processing and Real-time Data Pipelines (Live Coding Included)

Stream processing is a trending programming technique. It brings the big data use-cases to a real time.

Vladimír Schreiner from Hazelcast will discuss the building blocks of a stream processing pipeline as well as the new challenges it brings: dealing with infinite data, unordered and late events or fault-tolerance in a continuously running system.

To provide a hands on experience, Vladimír will show the huggers how to write full-blown streaming pipelines in less than a hundred lines of Java code for applications such as Bitcoin, Twitter sentiment analysis and real-time worldwide commercial aircraft monitoring.

An usual concern of the streaming tools is a complexity — one has to learn, setup and maintain multiple moving parts to become productive. To avoid it the speaker will use Hazelcast Jet — zero-infrastructure streaming library.

Vladimír is a product manager coming from an engineering background. Ten years of building internal software platforms and development infrastructure has made him passionate about new technology and finding ways to simplify data processing.