Skip to content

Apache Apex Double Feature: Fault Tolerance and Kafka Integration

Photo of Brendan Herger
Hosted By
Brendan H.
Apache Apex Double Feature: Fault Tolerance and Kafka Integration

Details

Talk #1: Fault Tolerance in Apache Apex by Thomas Weise

  • Components of an Apex application and how they are made fault tolerant

  • How native YARN support is leveraged for fault tolerance

  • How operator checkpointing works and how the user can tune it

  • Failure scenarios, recovery from failures, incremental recovery

  • Processing guarantees and which option is appropriate for your application

  • Sample topology for highly available, low latency real-time processing

Talk #2: Apache Apex/Malhar Kafka Integration by Siyuan Hua

  • Feature Overview

  • Partitioning

  • Fault-tolerance

  • What changed between Kafka 0.8 and 0.9

  • Performance

  • Demo

Profile of the speakers

  • Siyuan Hua, committer of Apache Apex

  • Thomas Weise, PPMC member of Apache Apex. A Hadoop veteran

Photo of Data Innovation Lab - SF group
Data Innovation Lab - SF
See more events
Capital One
201 3rd Street Floor 5 · San Francisco, CA