addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramlinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

Meetup #2

MapReduce for Astronomical Applications
Eugene Fink

I will describe a distributed version of the Friends-of-Friends technique, which is an astronomical application for identifying clusters of galaxies. This version is based on a map-reduce "wrapper," which distributes a set of galaxies among multiple cores, runs a sequential Friends-of-Friends algorithm on each core, and then merges the results. It can process tens of billions of galaxies, which makes it sufficiently powerful for all modern astronomy data sets. Apache Pig
Dmitriy Ryaboy and Ashutosh Chauhan

Apache Pig implements a data processing language for analyzing large datasets using Hadoop. In this talk we will introduce Pig and go over some advanced features such as streaming, a variety of available join algorithms, and columnar storage. We will also discuss ongoing work in query plan optimization, as well as some ideas for future research directions.

Join or login to comment.

  • Michael V. Y.

    I knew from the very beginning this meetup was about something I do not regularly go to or am professionally deal with on a regular basis. I've enriched my knowledge on the subject considerably and that's definitely a plus.

    November 3, 2009

  • Paul O.

    How long should I expect this event to last?

    November 3, 2009

19 went

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy