Meetup #2

MapReduce for Astronomical Applications
Eugene Fink

I will describe a distributed version of the Friends-of-Friends technique, which is an astronomical application for identifying clusters of galaxies. This version is based on a map-reduce "wrapper," which distributes a set of galaxies among multiple cores, runs a sequential Friends-of-Friends algorithm on each core, and then merges the results. It can process tens of billions of galaxies, which makes it sufficiently powerful for all modern astronomy data sets. Apache Pig
Dmitriy Ryaboy and Ashutosh Chauhan

Apache Pig implements a data processing language for analyzing large datasets using Hadoop. In this talk we will introduce Pig and go over some advanced features such as streaming, a variety of available join algorithms, and columnar storage. We will also discuss ongoing work in query plan optimization, as well as some ideas for future research directions.

Join or login to comment.

  • Michael V. Y.

    I knew from the very beginning this meetup was about something I do not regularly go to or am professionally deal with on a regular basis. I've enriched my knowledge on the subject considerably and that's definitely a plus.

    November 3, 2009

  • Paul O.

    How long should I expect this event to last?

    November 3, 2009

19 went

People in this
Meetup are also in:

Create your own Meetup Group

Get started Learn more
Henry

I decided to start Reno Motorcycle Riders Group because I wanted to be part of a group of people who enjoyed my passion... I was excited and nervous. Our group has grown by leaps and bounds. I never thought it would be this big.

Henry, started Reno Motorcycle Riders

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy