Real-time stream processing platform on Hadoop

Almost all companies who use Hadoop for big data processing also have real-time needs, for which they have either built a custom solution or have a separate cluster per application. DataTorrent is a platform for stream processing native to Hadoop. The platform processes incoming streams of data in real-time, all in-memory, and outputs data. We can process incoming streams at tens of millions of events/sec, with latencies in milliseconds.  We support automatic load scaling, and node outage recovery in real-time with no data loss and no human intervention. We have open sourced library of pre-defined operator and generic application templates under the project name Malhar. We provide tools with a rich interactive user interface for debugging, monitoring, charting of application data.

Presenters:

Amol Kekre (CTO - Data Torrent, Inc.)

Chetan Narsude (Engineer - Data Torrent, Inc.)

Thomas Weise (Engineer - Data Torrent, Inc.)

Sponsored by Data Torrent -  https://www.datatorrent.com/

Data Torrent will be providing Pizza and Beer. 
6:00-6:30 Networking, Pizza and Beer

6:30-7:30 Essentials of a Big Data Architecture

7:30-8:00 Questions


Join or login to comment.

  • Sokichi F.

    hi

    September 17, 2013

  • abhishekhar p.

    looking forward to it

    September 17, 2013

  • Prince

    Very much exciting to cme n share the realtime exp.

    September 3, 2013

Our Sponsors

  • InfiniteGraph

    Free download of the only fully Distributed Enterprise Graph Database

People in this
Meetup are also in:

Imagine having a community behind you

Get started Learn more
Bill

I started the group because there wasn't any other type of group like this. I've met some great folks in the group who have become close friends and have also met some amazing business owners.

Bill, started New York City Gay Craft Beer Lovers

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy