Apache Apex Double Feature: Fault Tolerance and Kafka Integration


Details
Talk #1: Fault Tolerance in Apache Apex by Thomas Weise
-
Components of an Apex application and how they are made fault tolerant
-
How native YARN support is leveraged for fault tolerance
-
How operator checkpointing works and how the user can tune it
-
Failure scenarios, recovery from failures, incremental recovery
-
Processing guarantees and which option is appropriate for your application
-
Sample topology for highly available, low latency real-time processing
Talk #2: Apache Apex/Malhar Kafka Integration by Siyuan Hua
-
Feature Overview
-
Partitioning
-
Fault-tolerance
-
What changed between Kafka 0.8 and 0.9
-
Performance
-
Demo
Profile of the speakers
-
Siyuan Hua, committer of Apache Apex
-
Thomas Weise, PPMC member of Apache Apex. A Hadoop veteran

Apache Apex Double Feature: Fault Tolerance and Kafka Integration