Monitoring Big Data Streaming Applications & Apache Apex (Hadoop) operations

Monitoring Big Data Applications: This talk will cover OpsClarity and Apache Apex (http://apex.apache.org/)

Participants get free t-shirts

Agenda

5:45 - Food & Network

6:15 - Alan Ngai; Co-Founder, CTO, OpsClarity

7:00 - Q&A

7:10 - David Yan: PMC Member of Apache Apex, Architect DataTorrent

7:40 - Food and Network

Abstract:

Talk1: OpsClarity is a performance monitoring solution for stream processing applications. In additional to providing deep component monitoring it leverages data science to proactively identify anomalies across the entire data pipeline and correlates issues across the data and app tier to identify common concerns that impact business. OpsClarity automatically discovers the entire app and data topology and is years ahead of anything else in how it leverages the rich meta-data and network dependency context captured through the topology to provide rich analysis and fastest correlated troubleshooting. This talk will additionally cover integration with Apache Apex.

Talk2: To make Apache Apex operable, DataTorrent RTS includes a component called dtGateway, which provides a comprehensive REST API to let users query for cluster and application metrics, manage application packages, monitor running applications, etc. This talk will introduce features and cover the internal dynamics of dtGateway.