Skip to content

When not to use Apache Spark? Data pipelines with vert.x + RxJava

Photo of Simon Munch-Andersen
Hosted By
Simon M.
When not to use Apache Spark? Data pipelines with vert.x + RxJava

Details

When building data pipelines needed to crunch big amount of data, you naturally look at frameworks like Apache Spark, Apache Flink or Apache Storm. In this talk we'll cover some of the learnings working with them reg operational, deployment, testing and possible issues fitting them into the infrastructure - driven by Messages and REST. We will also cover a different path to build data pipelines using vert.x + RxJava.

About the Speaker: Ralf Heyde
Ralf is working with classical BI, Data Discovery and Search on unstructured data. He worked at Zalando between Zalando 2011 - 2014 as the responsible for Search & Catalog where he built up the Search Team, introduced a Classified Approach for Search instead of full text. Since 2014, he has been working at Hubrick where he's responsible for Data Discovery (Search & Recommendation) backed up by a message driven architecture using a Realtime Stream Processing approach with vertx+rxjava

Photo of CTO Roundtable Berlin group
CTO Roundtable Berlin
See more events
Erento GmbH
Wrangelstraße 100 · Berlin