Storm 101: Find Top Tweets in Real-Time

  • December 12, 2012 · 7:00 PM
  • This location is shown only to members

DATA: A live-coding session where you will learn how to use Storm. This event is for software developers with some background in Java programming who are interested in distributed data processing.

Storm is a distributed real-time stream processing framework open-sourced by Nathan Marz of Twitter.

We'll be using Storm to analyze a randomized 1% of the real-time Twitter firehose to identify the most retweeted tweets around the globe.

AGENDA

Pro-Talk [30 min]: Abhi will do a short presentation on Storm fundamentals.

Live Coding Tutorial [90 min]: As a group, we will work through a Storm project to filter and analyze tweets from Twitter's streaming API. We'll highlight the most popular real-time tweets across Twitter based on the number of retweets received.

REQUIREMENTS

1. Laptop with a Java development environment that includes JDK 1.6, Eclipse and Maven.

2. Twitter username/password (for authenticating with the Twitter API)

3. Knowledge of Twitter4j is helpful, but not required.

 

IMPORTANT: Due to the level of interest in Storm, this session is intended for developers who already work with large data sets and interested in exploring Storm. Future sessions will focus on other technologies/approaches for data processing and visualization.

 

 

Join or login to comment.

  • Douglas M.

    I'm well acquainted with Storm. Interested in knowing about the trending algorithm and visualization techniques.

    January 15, 2013

    • Douglas M.

      Leftronic is indeed a very interesting Dashboard as a Service, thanks for the link.

      January 15, 2013

    • Douglas M.

      Here's a very interesting blog post about an update to the trending algorithm in the user contrib section of the storm repository. http://www.michael-no...­

      January 23, 2013

  • Albert

    Is there any helpful code or downloadable presentation around?

    January 1, 2013

  • Marnie L.

    Excellent leadership, vision and content!

    December 13, 2012

  • Marnie L.

    Everyone is talking about BigData, but this meetup was designed to actually play with it and acquire skills and experience. Excellent Leadership, Vision and Presentation. I agree with Ben, "5 stars Lads"! Looking very forward to more...

    December 13, 2012

  • Hardik

    Awesome presentation, very well organized, unfortunately I could not make it, looking forward for the next meetup :) !!

    1 · December 13, 2012

  • A former member
    A former member

    Abhi setup the project very well. So we were up and running in no time. Extremely knowledgeable about Storm. Abhi was very helpful with all our doubts as well. I also liked how Dan asked questions to clarify assumptions made in the presentation.

    1 · December 13, 2012

  • Jason C.

    Great meetup, looking forward to the next one. Cheers.

    1 · December 12, 2012

  • Ben Smith L.

    High level of preparedness and organization got everybody coding quickly. Having a working Maven project on github was a great idea and very well executed. Also good job communicating the expectations and requirements ahead of time to attendees. Five stars, lads.

    1 · December 12, 2012

  • Jason H

    i'm completely rusted through on java dev, so having the maven project and prerequistes really helped. i have a good starting point to start looking at storm.

    1 · December 12, 2012

  • Hardik

    for the handson I got Eclipse Juno with Maven Integration plug-in installed on mac os 32-bit, can it handle the Storm or do I need 64bit OS? also please post if any additional goodies are required

    December 12, 2012

    • Abhinav A

      That sounds like everything you need to have ready :)

      December 12, 2012

  • Hardik

    which version of storm going to be used?

    December 12, 2012

    • Abhinav A

      We'll be working with Storm 0.8.1

      December 12, 2012

  • A former member
    A former member

    Hi Dan and Abhinav, I am guessing you are going to provide a VM image for Storm which we will deploy to or will we be using EC2?

    December 12, 2012

    • Abhinav A

      We'll be using Storm in local mode so that you can run and debug right out of Eclipse

      December 12, 2012

20 went

Our Sponsors

People in this
Meetup are also in:

Create your own Meetup Group

Get started Learn more
Rafaël

We just grab a coffee and speak French. Some people have been coming every week for months... it creates a kind of warmth to the group.

Rafaël, started French Conversation Group

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy