Hadoop Hackathon : learn Map Reduce

Dear members,

our second hadoop hackathon is ON!

This time, we are co-hosting with SuperHappyDevHouse (http://superhappydevhouse.org/w/page/63764306/SuperHappyDevHouse53)

And this is going to be in the new Hacker Dojo.

In the last hackathon, the focus was to help people get hadoop up and running.  For this one, we will focus on learning Hadoop Map Reduce.

Here is the outline:
- we will learn map reduce concepts
- learn how to solve programs using mapreduce 
- write Java mapreduce program and execute it on hadoop cluster
- talk about best practices ..etc

Audience:
- developers who want to learn map reduce

 

Come Ready with:
- come with a WORKING hadoop environment.  Your choices are
1) install hadoop on your laptop
2) download a virtual machine (VM) from Cloudera / HortonWorks / WanDisco
3) or setup a hadoop cluster on EC2 for the duration of class

- if you need help setting up Hadoop, please ping me before the hackathon;  we will try to help you out

- Be comfortable programming in Java.  Have your Java development environment ready.  Either eclipse, or your favorite editor.

- come ready to learn and help others and have fun!

 

regards
Sujee Maniyam

Join or login to comment.

  • Stephen

    I tried to install Apache Hadoop natively. Not recommended. Apache is pretty nasty.

    March 20, 2013

  • Sujee M.

    missing README files for some labs are uploaded to git project: : https://github.com/markkerzner/HadoopIlluminatedSource

    March 17, 2013

  • Sujee M.

    here are a couple of photos from Sanjay & Mike (thx guys!)... if you took any photos, post them here.
    (I wanted to, but in all the bustle I forgot to :-)

    March 17, 2013

  • Preston C.

    Fantastic workshop. Very clear explanation. The billing example is the best newbie example I've seen. It made more sense to me than the classic word-count example. Sujee, thanks a million. Your book is great.

    March 16, 2013

  • Sujee M.

    March 16, 2013

  • Preston C.

    Would like to attend for the MR concepts part; don't have a laptop so won't stay for the coding part.

    March 16, 2013

  • shyamal b.

    Hi Sujee
    an you please post/send instructions for Cloudera VM?
    Thanks

    March 13, 2013

  • Nilesh

    I have hadoop 1.1.2 btw.

    March 16, 2013

  • Nilesh

    I have the hadoop environment ready but finding it difficult to find eclipse plugin for hadoop. Is that required? If yes, I need help.

    March 16, 2013

  • Ben B.

    I just discovered this hackathon and I'll be there. I have an older laptop running CentOS 6.2 on an Intel Core2 Duo P7350, its 64 bit but doesn't have Intel VT-x virtualization technology. I have a newer laptop with an Intel Core2 Duo T6570 which is 64 bit and has VT-x but its running Windows XP (I think the XP is 32 bit??). Any Hadoop that I can install on either of these (installing on the Windows machine would be easier for me at the moment)?
    Thanks

    March 15, 2013

    • craig

      I wrote these instructions for installing Cloudera's distribution on Ubuntu Linux:

      http://crodrigues.org...­

      You can change the instructions slightly to download Cloudera's distribution for Centos.

      Spending time trying to figure out how to install Hadoop on Windows is a waste of time if you are beginner. Most people start with Linux.

      But honestly, for the purpose of the hackathon tomorrow,
      you are better off borrowing a laptop from your friend that can run a 64-bit VM,
      and download one of the VM's from Cloudera:

      https://ccp.cloudera.c...­


      Otherwise, you are going to waste a lot of time at the Hackathon figuring out how to install stuff.

      March 16, 2013

  • Joanne

    I am stuck at ssh on Mac Bookpro laptop. It does not connect with localhost

    March 14, 2013

    • Minh

      Forget to say look for listening on port 22 (ssh).

      March 14, 2013

    • Sujee M.

      go to 'System Preferences' -> Sharing ; turn on 'Remote Login' (that is your ssh server for mac)

      1 · March 15, 2013

  • Minh

    I should be able to help as long people are running on Linux box. BTW, I configured/setup my box using the download from Apache website not Cloudera management.

    March 13, 2013

  • Sujee M.

    looking for volunteers to help out during the hackathon. If you are familiar with hadoop, you can help out others with getting hadoop up and running ..etc.
    please reply to send me email if you can help.
    much appreciated!
    thanks

    March 13, 2013

  • RS

    Thanks - look forward to participating!

    March 12, 2013

  • James C.

    thanks very much for this opportunity, and thanks for your offer to help setup hadoop. i can do that, but your offer is really nice. thanks and see you saturday.

    March 11, 2013

  • Vinod K.

    Will be there

    March 6, 2013

  • Sandro M.

    My wife will come with me.

    March 6, 2013

Our Sponsors

  • Oreilly

    20% Discount for Strata Conference (code UGBDG20)

People in this
Meetup are also in:

Create a Meetup Group and meet new people

Get started Learn more
Bill

I started the group because there wasn't any other type of group like this. I've met some great folks in the group who have become close friends and have also met some amazing business owners.

Bill, started New York City Gay Craft Beer Lovers

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy