addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscontroller-playcrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1light-bulblinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonprintShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

Setup Instructions for Python/Hadoop Streaming tutorial

From: user 1.
Sent on: Monday, May 7, 2012 2:02 PM

Hello LA-HUG members,

In preparation for tomorrow's meetup I'm sending out some instructions to ensure that we can get started smoothly. The focus of this talk is how to understand converting a recommendation algorithm to a mapreduce environment, rather than the specifics of running this example on Amazon (such information is already available in other tutorials online). What this means is that stepping through the python job flow will be the focus of tomorrow's discussion.

Thanks,

- Andrew Look

**must haves**

python
http://python.org/download/

numpy
http://scipy.org/Installing_SciPy
http://packages.python.org/distribute/easy_install.html (might help install numpy)
the example code
http://aws-hadoop.s3.amazonaws.com/similarity.zip
unzip similarity.zip
cd similarity/similarity
chmod +x *.py



**nice to haves**
see extended instuctions
:
http://andrewlook.com/post/22350461215/hadoop-streaming-recommendations-with-python

Thanks,
_ Andrew

 

Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy