Stream Computing (The engineer’s perspective)

It feels like every week there's a new open-source streaming platform out there. Yet, if you only look at the descriptions, performance metrics, or even the architecture, they all start to look exactly the same! In short, nothing really differentiates itself - whether it be Storm, Flink, Apex, GearPumk, Samza, KafkaStreams, AkkaStreams, or any of the other myriad technologies. So if they all look the same, how do you really pick a streaming platform to solve the problem that YOU have? This talk is about how to really compare these platforms, and it turns out that they do have their key differences, they're just not the ones you usually think about. The way that you need to compare these systems if you're building something to last, a well-engineered system, is to look at how they handle durability, availability, how easy they are to install and use, and how they deal with failures. This is a relatively accessible technical talk. Newcomers to the streaming realm are welcome!

Speaker : llya Ganelin

Capital One Data Innovation Lab

Data Engineer

Ilya is a roboticist turned data engineer. At the University of Michigan he built self-discovering robots and then worked on embedded DSP software with cell phone radios at Boeing. Today, he drives innovation at Capital One. Ilya is a contributor to the core components of Apache Spark and a PMC member of Apache Apex, learning what it takes to build a next-generation distributed computing platform. He has presented at Spark Summit, Strata, and Apache BigData as well as numerous tech meetups around the country.

Agenda

6 - 6:30 pm light dinner + networking

6:30 pm -- 6:35 pm introduction

6:35 pm -- 7:40 pm main talk + QA

7:40 pm -- 8 pm networking

8 pm -- 8 :30 pm closing

8:30 pm -- office closed