Monitoring Big Data Streaming Applications & Apache Apex (Hadoop) operations

This presentation covers ways of monitoring of Big Data applications. As part monitoring we will deep dive into OpsClarity and Apache Apex.

Agenda

6:45am - Alan Ngai; Co-Founder, CTO, OpsClarity

7:30am - Q&A

7:40am - David Yan: PMC Member of Apache Apex, Architect DataTorrent

Abstract:

Talk1: OpsClarity is a performance monitoring solution for stream processing applications. In additional to providing deep component monitoring it leverages data science to proactively identify anomalies across the entire data pipeline and correlates issues across the data and app tier to identify common concerns that impact business. OpsClarity automatically discovers the entire app and data topology and is years ahead of anything else in how it leverages the rich meta-data and network dependency context captured through the topology to provide rich analysis and fastest correlated troubleshooting. This talk will additionally cover integration with Apache Apex.

Talk2: To make Apache Apex operable, DataTorrent RTS includes a component called dtGateway, which provides a comprehensive REST API to let users query for cluster and application metrics, manage application packages, monitor running applications, etc. This talk will introduce features and cover the internal dynamics of dtGateway.

Please register at: https://attendee.gotowebinar.com/register/222631688099458308

After registering, you will receive a confirmation email containing information about joining the webinar.

For deeper engagement with Apache Apex (http://apex.apache.org/)- follow ApacheApex (https://twitter.com/apacheapex), presentations (http://www.slideshare.net/ApacheApex), recordings (https://www.youtube.com/user/datatorrent), download (community (https://www.datatorrent.com/download/datatorrent-community-edition-download-meetups/), sandbox (https://www.datatorrent.com/download/datatorrent-rts-sandbox-edition-download-meetups/)), Apache Apex releases (http://apex.apache.org/downloads.html), docs (http://apex.apache.org/docs.html)

This webcast is of an Hadoop Ingest and Transform meetup event in another city (2833 Junction Ave, #200, San Jose, CA), we are webcasting it enable other Big Data Ingesters to participate. If you are interested in helping organize (hosting, presenting, community leadership) Big Data Ingestion and Transformation community, please email ingest-meetup@datatorrent.com