The Stream Processor as a Database

RSVP Details: The Yodle (http://www.yodle.com/) office has strict security. You must have your full name as it appears on your ID on your meetup account to pass beyond building security.

Please join us for an exciting evening to learn more about a new design pattern for data streaming applications, using Apache Flink and Apache Kafka from Jamie Grier who is Director of Applications Engineering at data Artisans.

Sponsors:

• Yodle (http://www.yodle.com) is hosting the event at their office.

• data Artisans (http://data-artisans.com)is sponsoring for pizza and drinks.

Schedule:

7:00 pm - 7:30 pm : Networking, pizza and drinks

7:30 pm – 8:30 pm : Talk

Talk description: We present a new design pattern for data streaming applications, using Apache Flink and Apache Kafka: Building applications directly on top of the stream processor, rather than on top of key/value databases populated by data streams.

Unlike classical setups that use stream processors or libraries to pre-process/aggregate events and update a database with the results, this setup simply gives the role of the database to the stream processor (here Apache Flink), routing queries to its workers who directly answer them from their internal state computed over the log of events (Apache Kafka).

This talk will cover both the high-level introduction to the architecture, the techniques in Flink/Kafka that make this approach possible, as well as experiences from a large scale setup and technical details.

Bio: Jamie Grier is Director of Applications Engineering at data Artisans where he’s extremely excited to be able to help others realize the potential of Apache Flink in their own projects.

Jamie has been working on stream processing for the last decade at companies such as Twitter, Gnip and Boulder Imaging. This has spanned everything from ultra-high-performance video stream processing to social media analytics.