Apache Flink Meetup Berlin @SAP

We are thrilled to announce our third Apache Flink Berlin Meetup in 2017. A few days before the third edition of Flink Forward Berlin (https://berlin.flink-forward.org) kicks off, we’re organizing an evening meetup, with pretzels, beer, Mate, and the latest and greatest on Apache Flink® at our host SAP. This time we will have talks presented by data Artisans and ResearchGate. We hope you’ll join us to connect with each other ahead of the main event on September 11-13!

Program (work in progress)
6:30 pm Registration, Food & Drinks
7:00 pm Introduction by SAP
7:15 pm Migration of a realtime stats product from Storm to Flink
8:00 pm Complex Event Processing with Flink: the state of FlinkCEP
8:30 pm Mingle & Networking

Migration of a realtime stats product from Storm to Flink

By Patrick Gunia, ResearchGate (https://www.researchgate.net/)

Counting things might sound like a trivial thing to do. But counting things consistently at scale can create unique and difficult challenges. At ResearchGate we count things for different reasons. On the one hand we provide numbers to our members to give them insights about their scientific impact and reach. At the same time, we use numbers ourselves as a basis for data-driven product development. We continuously tune our statistics infrastructure to improve our platform, adapt to new business requirements or fix bugs. A milestone in this improvement process has been the strategic decision to move our stats infrastructure from Storm to Flink. This significantly reduced complexity and required resources, including decreasing the load on our database backend by more than 30%. We will discuss the challenges we’ve encountered and overcome on the way, including handling of state and the need for online and offline processing using streaming and batch processors on the same data.

Patrick Gunia is an Engineering Manager at ResearchGate where he is responsible for the statistics infrastructure and the numbers it produces for internal and external usage. His special interest are streaming related technologies and how they can be integrated into an hybrid ecosystem consisting of real-time, near-realtime, and batch use cases.

Complex Event Processing with Flink: the state of FlinkCEP

By Kostas Kloudas, data Artisans (https://data-artisans.com/)

Pattern matching over event streams is increasingly being employed in many areas including financial services and click stream analysis. Flink, as a true stream processing engine, emerges as a natural candidate for these usecases. In this talk, we will present FlinkCEP, a library for Complex Event Processing (CEP) based on Flink. At the conceptual level, we will see the different patterns the library can support, we will present the main building blocks we implemented to support them, and we will discuss possible future additions that will further enhance the coverage of the library. At the practical level, we will show how the integration of FlinkCEP with Flink allows the former to take advantage of Flink's rich ecosystem (e.g. connectors) and its stream processing capabilities, such as support for event-time processing, exactly-once state semantics, fault-tolerance, savepoints and high throughput.

Kostas Kloudas is a Flink Committer, currently working with data Artisans to make Apache Flink® the best open-source stream processing engine and your data’s best friend. Before joining data Artisans, Kostas was a postdoctoral researcher at IST in Lisbon and even before that he obtained a PhD in Computer Science from INRIA (France). He obtained his engineering diploma from NTUA in Athens and his main research focus was in cloud storage and distributed processing.