addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramlinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

Robust Stream Processing with Apache Flink - Jamie Grier (Data Artisans)

Robust Stream Processing with Apache Flink


In this hands on talk and demonstration I'll give a very short introduction to stream processing and then dive into writing code and demonstrating the features in Apache Flink that make truly robust stream processing possible.  We'll focus on correctness and robustness in stream processing.


During this live demo we'll be developing a realtime analytics application and modifying it on the fly based on the topics we're working though.  We'll exercise Flink's unique features, demonstrate fault-recovery, clearly explain and demonstrate why Event Time is such an important concept in robust stateful stream processing and talk about and demonstrate the features you need in a stream processor to do robust stateful stream processing in production.


We'll also use a realtime analytics dashboard to visualize the results we're computing in realtime.  This will allow us to easily see the effects of the code we're developing as we go along.


Some of the topics covered will be:


- Apache Flink

- Stateful Stream Processing

- Event Time vs. Processing Time

- Fault tolerance

- State management in the face of faults

- Savepoints

- Data re-processing

Bio 

Jamie Grier is Director of Applications Engineering at data Artisans where he’s extremely excited to be able to help others realize the potential of Apache Flink in their own projects.  Jamie has been working on stream processing for the last decade at companies such as Twitter, Gnip and Boulder Imaging.  This has spanned everything from ultra-high-performance video stream processing to realtime social media analytics.

Join or login to comment.

  • Habib M.

    Hi Jamie, great talk. Similar to the IoT sensor use case, can Flink with native APIs, handle and process realtime IoT based video streams/feeds. Any use case or reference examples would be really helpful. Thanks

    August 18

  • Densel S.

    July 14

  • Geoffrey C.

    Thank you Jaime for answering all questions in the talk!

    1 · July 14

  • Adam

    Perhaps YouTube!

    July 14

  • Adam

    Is the demo available somewhere online?

    July 14

  • Densel S.

    Excellent talk and demo!

    July 14

Our Sponsors

  • Cervello

    Promotions of events

  • McKinsey & Company

    Provides meeting space, pizza and drinks

  • Bloomberg

    Provides meeting space, pizza and drinks

  • Workville

    Space for Meetup

  • MapR

    Food and Beverage

  • MediaMath

    provides meeting space (auditorium 90-100 capacity), food and beverages.

  • Yodle

    offers meeting space

  • Cask Data

    Cask Data will be providing the content and the food/beverage.

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy