Introduction to PIG

  • March 31, 2011 · 6:45 PM
  • This location is shown only to members

PIG is a platform for analyzing large data sets that consists of a high-level language for expressing data analysis programs. PIG is probably the easiest way to get started with processing data using Hadoop.

If there is enough interest in this topic I will put together a short intro and a demo of how Contextweb is planning to leverage PIG to process hundreds of gigabytes of data per day.

Speakers:

Alex Rovner - Leading the data team at contextweb. Responsible for managing hundreds of ETL jobs and terabytes of data.

Thejas Nair  - Software engineer in the Pig team at Yahoo and a committer in the Apache Pig project. He has been working on solutions for large scale distributed data processing at Yahoo for the last 8 years.

Join or login to comment.

  • A former member
    A former member

    nicely done. Concise, answered questions well, and demo's were good. Maybe pretty graphs of data extracted from pig would have made it more exciting though

    April 1, 2011

  • Igor

    Great introduction for those who is looking to jump start their PIG experience.

    April 1, 2011

  • Jonathan S.

    Pig is not for me

    April 1, 2011

  • Jay Z.

    It looks like I am going to have to pull out of this one guys. Video tape it?

    March 30, 2011

  • Jay Z.

    How long is the event scheduled to last?

    March 30, 2011

  • Joseph M.

    I am no longer bringing a +1, so an additional person can be added.
    Thanks

    March 30, 2011

  • Alex R.

    We are in talks about moving this to another room which can hold a larger audience. We are how ever in need of a sponsor in order to provide food and refreshments. If your company would like to sponsor this event, please let me know ASAP.

    March 28, 2011

  • rajasekhar y.

    Interested but this meet seems Full

    March 25, 2011

  • Otis G.

    Ah, he won't be in NYC next time around. Oh well, thanks. Please let me know if things change.

    March 9, 2011

  • Alex R.

    Would be tough since we already have 2 speakers on the PIG topic. I will try to squeeze it in next time around.

    March 9, 2011

  • Otis G.

    Alex, would it be possible to squeeze a 10 minute talk about HBaseHUT in this meetup? (see https://github.com/sematext/HBaseHUT and http://blog.sematext.com/2010/12/16/deferring-processing-updates-to-increase-hbase-write-performance/ ). HBaseHUT author (another Alex) will be in town from Minsk.

    March 8, 2011

  • Otis G.

    If this is at the non-137 Varick location, then capacity is about 40 people, I think (that's where http://www.meetup.com/NYC-Search-and-Discovery/ was hosted before)

    March 8, 2011

  • A former member
    A former member

    Let me see if I can find the email where I mentioned it to you before..

    March 3, 2011

  • Alex R.

    That would be great. What is your capacity?

    March 3, 2011

  • A former member
    A former member

    We're happy to host this at TheLadders if you're interested.

    March 3, 2011

Our Sponsors

People in this
Meetup are also in:

Create your own Meetup Group

Get started Learn more
Allison

Meetup has allowed me to meet people I wouldn't have met naturally - they're totally different than me.

Allison, started Women's Adventure Travel

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy