Meetup #2

MapReduce for Astronomical Applications
Eugene Fink

I will describe a distributed version of the Friends-of-Friends technique, which is an astronomical application for identifying clusters of galaxies. This version is based on a map-reduce "wrapper," which distributes a set of galaxies among multiple cores, runs a sequential Friends-of-Friends algorithm on each core, and then merges the results. It can process tens of billions of galaxies, which makes it sufficiently powerful for all modern astronomy data sets. Apache Pig
Dmitriy Ryaboy and Ashutosh Chauhan

Apache Pig implements a data processing language for analyzing large datasets using Hadoop. In this talk we will introduce Pig and go over some advanced features such as streaming, a variety of available join algorithms, and columnar storage. We will also discuss ongoing work in query plan optimization, as well as some ideas for future research directions.

Join or login to comment.

  • Michael V. Yudelson

    I knew from the very beginning this meetup was about something I do not regularly go to or am professionally deal with on a regular basis. I've enriched my knowledge on the subject considerably and that's definitely a plus.

    November 3, 2009

  • Paul Ogilvie

    How long should I expect this event to last?

    November 3, 2009

People in this
Meetup are also in:

illustration

Sometimes the best Meetup group is the one you start

Every Meetup group started with somebody like you who wanted to get together with like-minded people

Start a Meetup Group

Log in

Not registered with us yet?

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy