addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscontroller-playcrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1light-bulblinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonprintShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

Data Munging - tips and tricks for Hadoop

It can be challenging when dealing with data from multiple data sources, each having its own format type. MapReduce can be limiting when you want to process non-text data streams. In this presentation we'll talk about some of the challenges the analytics team at Knewton has faced ingesting data from multiple sources and introduce ways of writing your own Input and output formats as well as record readers and writers. We'll present real applications, introduce the KassandraMRHelper (https://github.com/Knewton/KassandraMRHelper) and talk about the advantages of creating custom input and output formats.

Giannis Neokleous (www.giann.is) is a software engineer at Knewton in the Analytics Team with experience in dealing with large distributed systems handling TBs of data. Giannis holds a masters degree from Stanford University.

Agenda:

6:30 to 7:00 PM - Networking
7:00 to 8:00 PM - Knewton Presentation
8:00 to 8:30 PM - Q&A/Networking

If your company is interested in sponsoring this event, please reach to me.

Join or login to comment.

  • Mehul S.

    Members, the video and slides for the presentation can be found here...http://lanyrd.com/2013/ny-hadoop-user-group-august-data-munging-tips-an-2/scmkmf/, thanks again to the Knewton team...

    August 15, 2013

  • Paul T.

    say where is the Video from tonight?

    August 14, 2013

  • A former member
    A former member

    It was great. Nice meeting everyone. Thanks for the presentation.

    August 15, 2013

  • Mehul S.

    Giannis, was insightful! Thanks again.

    1 · August 15, 2013

  • arry

    I got my announcement that I was allowed to attend at 6:15 pm....by then it was too late

    August 14, 2013

  • venkatanathen

    Awesome. I got the confirmation to be in by 6.15 PM. Guys, thank you for releasing RSVP, but I can't reach from my office. Thanks,
    VK

    August 14, 2013

  • A former member
    A former member

    bump on livestream..hope we get a link

    August 14, 2013

  • Vietnhi P.

    Where's that livestream?

    August 14, 2013

  • A former member
    A former member

    Moved office took all day. Ugh not done yet.

    August 14, 2013

  • A former member
    A former member

    cleared up a spot.. Are we recording this?

    August 14, 2013

  • A former member
    A former member

    I'm freeing up a spot. Will the session be recorded

    August 14, 2013

  • Vietnhi P.

    Maybe it's time to send an announcement that those who can't make it remove their RSVP :)

    August 14, 2013

  • Ankit P.

    I will not be able to make it. I will go for live streaming.

    August 13, 2013

  • glenn w.

    Can someone please tell me how the waiting list works, thanx, Denny Crane :-)

    August 8, 2013

    • Mehul S.

      Glenn, meetup.com automatically manages the wait list. When members RSVP'ed 'yes' opt out, members on the waiting list are automatically confirmed based on the order in which they joined the wait list.

      August 13, 2013

  • glenn w.

    Waiting list ? Add Glenn w. ?

    July 30, 2013

    • A former member
      A former member

      Hi Mehul, will you be able to increase the attendees list to 200 please. Will there be a chance just in case if some one is not attending.

      August 8, 2013

    • Mehul S.

      Ravi, unfortunately we cannot increase the count because of the limited capacity of the room size. But luckily like Giannis mentioned, we will be streaming the event live.

      August 13, 2013

  • Marcos Ortiz V.

    I will follow the event by the stream link. It´s a shame that I´m full of work right now.

    August 8, 2013

  • Giannis N.

    For the people who are on the waiting list, the presentation will be streamed live here: livestream.com/knerd

    August 8, 2013

  • A former member
    A former member

    I would like to attend and it really seems very interesting topic that would really like to underdtand

    August 8, 2013

  • narendra

    1

    July 28, 2013

  • prakash

    Yes

    July 26, 2013

  • stuart s.

    JAred Feldman is my guest. He is the CEO of Mashwork, a social analytics company.

    July 25, 2013

Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy