Apache Apex Double Feature: Fault Tolerance and Kafka Integration

Talk #1: Fault Tolerance in Apache Apex by Thomas Weise

• Components of an Apex application and how they are made fault tolerant
• How native YARN support is leveraged for fault tolerance
• How operator checkpointing works and how the user can tune it
• Failure scenarios, recovery from failures, incremental recovery
• Processing guarantees and which option is appropriate for your application
• Sample topology for highly available, low latency real-time processing

Talk #2: Apache Apex/Malhar Kafka Integration by Siyuan Hua

• Feature Overview
• Partitioning
• Fault-tolerance
• What changed between Kafka 0.8 and 0.9
• Performance
• Demo

Profile of the speakers

• Siyuan Hua, committer of Apache Apex
• Thomas Weise, PPMC member of Apache Apex. A Hadoop veteran