Apache Apex Double Feature: Fault Tolerance and Kafka Integration

Talk #1: Fault Tolerance in Apache Apex by Thomas Weise

• Components of an Apex application and how they are made fault tolerant

• How native YARN support is leveraged for fault tolerance

• How operator checkpointing works and how the user can tune it

• Failure scenarios, recovery from failures, incremental recovery

• Processing guarantees and which option is appropriate for your application

• Sample topology for highly available, low latency real-time processing

Talk #2: Apache Apex/Malhar Kafka Integration by Siyuan Hua

• Feature Overview

• Partitioning

• Fault-tolerance

• What changed between Kafka 0.8 and 0.9

• Performance

• Demo

Profile of the speakers

• Siyuan Hua, committer of Apache Apex

• Thomas Weise, PPMC member of Apache Apex. A Hadoop veteran