addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwchatcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscrosseditemptyheartfacebookfolderfullheartglobegmailgoogleimagesinstagramlinklocation-pinmagnifying-glassmailminusmoremuplabelShape 3 + Rectangle 1outlookpersonplusprice-ribbonImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruseryahoo

Storm, Kafka, and Hadoop - Solution Architecture pattern

As the interest in Big Data processing grows and the value proposition for Big Data because clearer, enterprises undertake efforts towards knowledge extraction from large volumes of data.  Tools such as Hadoop have been instrumental in enabling companies to quickly process large volumes of enterprise data and derive insights from mountains of historical information.  At the same time, many companies realize the importance of being able to efficiently process large volumes of new data deriving actionable intelligence in near real time as new data emerges.  With that, organizations are faced with two seemingly distinct technical challenges of processing historical data while also needing to deliver actionable intelligent from live data feeds.



  • Discuss Enterprise challenges
    • Business - Continuous insights from historical information and live data feeds
    • Technology - Platform to adapt, process, and correlate large volumes and new data streams
  • Present Reference architecture - Demo
    • Example solution that uses Hadoop, Kafka, and Storm in tandem to optimize processing
    • Architecture paradigm and key implementation details of a prototype
    • Maximize infrastructure and code reuse.
  • Share experimental results and scaling trends of a real-world application that uses above architecture

Join or login to comment.

  • Brian E.

    Hi, was there a recording made of this?

    July 22, 2013

  • Nitin k.

    Is there a recording available....

    July 16, 2013

    • Geoff G

      +1! I was not able to make it and would love to see the recording.

      July 16, 2013

  • Prasad S.

    Good exposure to building blocks for stream processing of big data. Storm is an extensible system to improvise on topology, spouts, and bolts.

    July 15, 2013

  • A former member
    A former member

    I will be attending the Hadoop meetup

    July 15, 2013

  • A former member
    A former member

    If you can record, that would be amazing. I just found out late last night that I cannot attend.

    July 15, 2013

  • Nitin k.

    If we record this session, we can forward it to attendees who could not attend.. Pl. let me know

    July 15, 2013

Our Sponsors

  • Praxio Technologies

    Big data technology and workshops.

  • Princeton ITS


  • airisDATA

    spark and scala

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy