Skip to content

Flink Meetup #10 Cluster Deployment on Docker, Flink - Gelly, Community Update

Photo of Evelien Post
Hosted By
Evelien P. and 2 others
Flink Meetup #10 Cluster Deployment on Docker, Flink - Gelly, Community Update

Details

http://photos2.meetupstatic.com/photos/event/7/9/d/0/600_438691184.jpeg

Join us at the 10th Apache Flink (https://flink.apache.org/) Meetup, drinks and sandwiches sponsored by data Artisans (http://data-artisans.com/).

Talks:

  1. Flink Community Update
    By Robert Metzger

  2. Apache Flink cluster deployment on Docker using Docker-Compose
    By Romeo Kienzler

Often resource requirements on Data Processing Clusters exhibit high variation. So in this case elastic deployments reduce total cost of ownership. In this talk we will introduce the basic concepts on container isolation exemplified on Docker and explain how Apache Flink is made elastic using Docker-Compose. Finally we push the cluster to the cloud exemplified on the IBM Docker Cloud.

  1. Graph Processing with Apache Flink
    By Andra Lungu

Gelly is Flink's large-scale graph processing API which leverages Flink's efficient delta iterations to map various graph processing models (vertex-centric and gather-sum-apply) to dataflows. Gelly allows Flink users to perform end-to-end data analysis, without having to build complex pipelines and combine different systems. It can be seamlessly combined with Flink's DataSet API, which means that pre-processing, graph creation, graph analysis and post-processing can be done in the same application.

--------

Bring your data

After the talks, while having a drink, there's the opportunity to work together with Flink committers on an interesting data problem you're facing.

Please contact Kostas Tzoumas at kostas@data-
artisans.com if you're interested in taking part in this!

--------

About Robert

Robert Metzger is a PMC member at Apache Flink and co-founder and software engineer at data Artisans. Robert studied Computer Science at TU Berlin and worked at IBM Germany and at the IBM Almaden Research Center in San Jose.

About Romeo

Romeo Kienzler holds a Master Degree in Information Systems, Applied Statistics and Bioinformatics from the Swiss Federal Institute of Technology. He works for IBM Zurich as a Data Scientist and Architect.

About Andra

Andra Lungu is one of the committers behind Flink's graph processing API, Gelly. She is a student research assistant at TU-Berlin (DIMA), currently working on her master thesis, which proposes a set of operators meant to scale up computations on highly skewed graphs while minimizing the number of messages sent from one vertex to another. Andra began her first year of Master studies in Rennes, France and completed her Bachelor studies at the Technical University of Bucharest, Romania. During her university years, she interned for Adobe Systems and Endava.

---------

http://photos4.meetupstatic.com/photos/event/a/2/4/3/600_441101539.jpeg

http://photos1.meetupstatic.com/photos/event/a/1/2/0/600_438701248.jpeg

www.flinkforward.org (http://www.flink-forward.org/)

Photo of Apache Flink Meetup Berlin group
Apache Flink Meetup Berlin
See more events
Betahaus Cafe
Prinzessinnenstrasse 19-20 10969, · Berlin