Thinking Distributed

  • July 14, 2013 · 10:00 AM
  • Aol

Hadoop, MapReduce, etc. are not difficult but require thinking about a problem differently. In our very first meetup, I would like to focus on introducing this new way of thinking. We will work with a simple problem of counting token frequency in search datasets.  We will first write a simple solution and then expand it into our first map-reduce program. Finally we will run our first map-reduce program using hadoop streaming.

In order to keep pace with the class, I highly recommend installation of hadoop locally on your machine. You can find instructions on how to setup hadoop on your machine over here: http://ragrawal.wordpress.com/2012/04/28/installing-hadoop-on-mac-osx-lion/

Also all the source code related to this class is available on github. Please download the code and data beforehand: https://github.com/ragrawal/meetup

 

Join or login to comment.

  • A former member
    A former member

    Great idea and session

    July 15, 2013

  • Ingo R.

    Great meetup everybody, thanks again to Ritesh for organizing it and to Saghar for the location at AOL!

    Installing Hadoop was easy thanks to Ritesh's blog post. However, I still ran into the "Unable to load realm info from SCDynamicStore" issue on OS X Mountain Lion. This thread on Stack Overflow helped fixing the issue by explicitly setting Java to 1.6: http://stackoverflow.com/a/17289918

    July 15, 2013

  • A former member
    A former member

    Thanks Ritesh and Saghar. Really enjoyed the session.

    1 · July 15, 2013

  • user 1.

    Hi Ritesh:
    Will the materials be available for those who could not attend the session?
    Thanks!

    July 14, 2013

    • Ritesh A.

      Hi . I have provided all the material and its available on meetup page.

      July 14, 2013

  • Sergey

    A+++

    July 14, 2013

  • Vishal

    Great learning experience

    July 14, 2013

  • Nirav

    Very good first session, Ritesh. Thank you Saghar for hosting the event. Looking forward to upcoming sessions & delving in solving complex big data scenario.

    1 · July 14, 2013

  • Ritesh A.

    Few people asked me about how to install hadoop on windows. I haven't tried it but the instructions over here should work: http://www.hadoopwizard.com/install-hadoop-on-windows-in-3-easy-steps-for-hortonworks-sandbox-tutorial/

    Can someone try and let me know if it works or not. Thanks

    1 · July 7, 2013

    • Meenu

      Sure, thanks!

      July 7, 2013

    • A former member
      A former member

      All - I tried the steps to download Hadoop on Windows as outlined in Ritesh's link and it worked fine. Please note that you will need to use Firefox or Chrome to fire up the HortonWorks Sandbox. IE did not work for me.

      1 · July 13, 2013

  • Juan H.

    I'd like to bring a friend, is that Ok?

    July 13, 2013

  • Saghar T.

    Folks, please change your RSVP if for any reason you're not making it tomorrow (even in the last minute). There are 90+ people on the wait list and it's not fair to see empty seats while many are waiting for one. Thank you!

    1 · July 13, 2013

  • Jayram A D.

    I am on waiting list , but would like to attend. Organizers, Do you think we will have enough space for some of us , if we drop by ? Thanks

    July 13, 2013

    • Saghar T.

      Jayram, the list is full. But there are always people who don't show up. Feel free to stop by and see if there is any spot available. However, I can't guarantee it.

      July 13, 2013

  • Surendra Y.

    Is it possible to live stream this event ? That way people in waiting list can also join remotely. Just a thought...

    1 · July 5, 2013

  • A former member
    A former member

    I am waiting for a Berkeley or S.F. location. Can the organizer please post slides?

    June 28, 2013

    • Ritesh A.

      Sure. I will post them online after the meetup.

      July 5, 2013

  • Charles

    Great to see we got a place that can accommodate the whole group. Thank you, Ritesh, Saghar! I am still on the waiting list, but I assume I can join the meeting.

    1 · June 28, 2013

  • Pandian

    Since this is my first session with this even, Hope the attendee's size will be increased and get a spot for me too. Hi Ritesh, Please do the needful. Thank you.

    June 28, 2013

  • Nivas

    Hi Ritesh, I just wanted to take a moment to thank you for doing this for everyone & also for Saghar for arranging a location where we could all fit. Looking forward to July 14th!

    2 · June 28, 2013

  • A former member
    A former member

    out of town unfortunately...

    1 · June 28, 2013

  • Nirav

    Anyone commuting from North Bay/Marin, looking for a ride share?

    June 28, 2013

  • Ritesh A.

    Hi all,

    Thanks to Saghar (from AOL). She was able to get a much bigger place to host the meetup. I have updated the location and also increased the number of spots. I am excited to see you all.

    3 · June 28, 2013

  • Sergey

    hi all, if we meet in the room for 150 peole - we all should fit in..

    1 · June 17, 2013

    • Saghar T.

      correct, if we hold it at AOL's Palo Alto office. waiting for Ritesh to get back to me. stay tuned!

      June 17, 2013

  • Anirudha K.

    How many spots are available for this meetup?

    June 17, 2013

  • Prasenjit B.

    I will try to join.
    I had wai tlisted myself-- how do I convert to "attending"

    June 17, 2013

  • Song C.

    Hi Ritesh, do we need a location for the meet up? I might be able to help think of a solution.

    June 13, 2013

    • Sergey

      how nay people can meet at that place?

      June 15, 2013

    • Saghar T.

      can fit 150+ people

      June 17, 2013

  • Pandian

    Since this is my first session with this even, Hope the attendee's size will be increased and get a spot for me too. Hi Ritesh, Please do the needful. Thank you.

    June 16, 2013

  • Mark W.

    There is 20 x more interest in this meetup than there is space for participants. Are any of the wait-listed people on this distribution sufficiently knowledgeable to lead alternate groups?

    June 16, 2013

  • Shreyas

    Looking forward to it Ritesh

    June 16, 2013

  • Shyamini V.

    So, is the first meeting going to be on July 14th? I am on wait list, but I hope I could attend the meeting.

    June 15, 2013

  • Sergey

    hey guys, 5pm or 6pm is too early i think, and its traffic jem time.. can we do it during the week at 7PM? this is the best ime for people to meet after work hours. I hope you will support this idea..

    June 15, 2013

  • Juan H.

    I'd like to bring a friend, is that Ok?

    June 15, 2013

  • Saghar T.

    Ritesh, I have reserved our auditorium at AOL office for this event. Let's fix the date, so I can confirm. What about July 10th, post 5pm?

    June 14, 2013

    • Ritesh A.

      I am planning for July 14th.

      June 14, 2013

    • Saghar T.

      Alright, I'll arrange for July 14th, 10AM. Should I email you the details? If so, I'll need your email address.

      June 15, 2013

  • vande

    i am actually looking forward to this event to learn about Hadoop, Hive and Pig.

    June 14, 2013

  • Prasenjit B.

    Will not be in town. Another date after July 6th?

    June 14, 2013

  • Pandian

    Since this is my first session with this even, Hope the attendee's size will be increased and get a spot for me too. Hi Ritesh, Please do the needful. Thank you.

    June 14, 2013

  • Nina T.

    I would like to join too, can you open for more than 5? thanks.

    June 14, 2013

  • howarddy

    So 5 attendees is the max?

    June 14, 2013

  • Sergey

    ohh, by th eway do you need a room in bay area? for how many people ?

    June 13, 2013

    • Ritesh A.

      hi Sergey, do you have suggestion for room ?

      June 13, 2013

  • Ritesh A.

    Hi All, Welcome to this group. I am excited to see that so many people are showing interest in the class. I look forward to meet all of you and together learn about big technology.

    June 13, 2013

  • Sergey

    yep,the same concern about meetup date, it's the long weekend ..

    June 13, 2013

  • Nivas

    Seems like this first meet up is of size 4? Cud u plz allow me to attend if there is any room at all. Thx

    June 13, 2013

  • Saghar T.

    It's during the long weekend, some people might miss it!

    June 13, 2013

People in this
Meetup are also in:

Create your own Meetup Group

Get started Learn more
Bill

I started the group because there wasn't any other type of group like this. I've met some great folks in the group who have become close friends and have also met some amazing business owners.

Bill, started New York City Gay Craft Beer Lovers

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy