Robust Stream Processing with Apache Flink

Robust Stream Processing with Apache Flink

In this hands on talk and demonstration, Jamie Grier will give a very short introduction to stream processing and then dive into writing code and demonstrating the features in Apache Flink that make truly robust stream processing possible. We'll focus on correctness and robustness in stream processing.

During this live demo, he will be developing a real-time analytics application and modifying it on the fly based on the topics we're working though. He will exercise Flink's unique features, demonstrate fault-recovery, clearly explain and demonstrate why Event Time is such an important concept in robust stateful stream processing and talk about and demonstrate the features you need in a stream processor to do robust stateful stream processing in production.

He will also use a real-time analytics dashboard to visualize the results we're computing in real-time. This will allow us to easily see the effects of the code we're developing as we go along.

Some of the topics covered will be:

• Apache Flink

• Stateful Stream Processing

• Event Time vs. Processing Time

• Fault tolerance

• State management in the face of faults

• Savepoints

• Data re-processing

Speaker Bio

Jamie Grier is Director of Applications Engineering at data Artisans where he’s extremely excited to be able to help others realize the potential of Apache Flink in their own projects. Jamie has been working on stream processing for the last decade at companies such as Twitter, Gnip and Boulder Imaging. This has spanned everything from ultra-high-performance video stream processing to social media analytics.

Agenda

6:15 pm -- door opens

6:15 pm - 6:45 pm light dinner + networking

7: 15 pm -- door closed, Yelp security will not let people in after 7:15 pm.

6:45- 6:50 pm introduction

6:50 pm --- 8:00 pm talk + QA

8:00 pm -- 8:30 pm closing

8:30 pm -- event closed.