Demystifying HDFS

Abstract: Starting with the building blocks of general file systems (inodes, blocks, journaling) the talk will build up to the HDFS architecture and ultimately the cutting edge HDFS Federation. Some topics covered along the way are: NameNode/DataNode fundamentals, Image/Journal, Namespace ID/Storage ID/Block ID, Secondary NameNode, Rack Awareness, Replication, Read/Write Pipelines, Heartbeats/Communication, Balancer, Snapshots, Decommissioning, Block Scanner, etc.

Speaker: Sameer Farooqui is a Systems Architect at Hortonworks who specializes in designing custom use cases for Hadoop. Previously Mr. Farooqui was responsible for creating proof of concept prototypes using Cassandra, NoSQL and Amazon Cloud Computing at one of the big 5 consulting firms. Sameer also has five years of experience at Symantec where he deployed Veritas Clustering and Storage Foundation solutions to Fortune 500 and government clients.

Join or login to comment.

  • A former member
    A former member

    Can you upload slides to files?

    April 22, 2012

  • John Peter S.

    A lot of really good information about HDFS core, rack awareness, replication, heartbeats/communication, balancer, read/write pipelines were all neatly explained. I liked the proposed roadmap for Hadoop 2. Federation seems to need a lot more thought. Thanks Sameer and to Jason/PulsePoint for the upscale pizza.

    April 18, 2012

  • niyant

    There's a link at the bottom in the "Upcoming Events" section:­

    April 18, 2012

  • niyant

    This was one of the most technically detailed meetups I've attended.

    April 18, 2012

  • Adrian

    It was a great insight into the novice levels of Hadoop. I learned alot of preemptive things to employ before setting up a new cluster, and/or adding/removing a node.

    April 18, 2012

  • Adrian

    Anyone have the link to today's webinar.

    April 18, 2012

  • Adrian

    This was a great hadoop meet up. I wish we had more time for QA. I definitely will use the knowledge from this before I setup a new cluster, add, or remove a new node.

    April 18, 2012

  • rutvik

    could you please post the slides

    April 17, 2012

  • Brian J.

    Will this be recorded? Thanks for putting on the event!

    April 17, 2012

Our Sponsors

  • PulsePoint

    Meetup costs, Planning, Event-Hosting, Space

  • O'Reilly Media

    Discount to Strata 2014 (Code: UGNYHDP20) Food and refreshments

  • Knewton

    Event-Hosting, Space

  • PlaceIQ

    Planning, Event-Hosting, Space

People in this
Meetup are also in:

Create your own Meetup Group

Get started Learn more

Meetup has allowed me to meet people I wouldn't have met naturally - they're totally different than me.

Allison, started Women's Adventure Travel

Start your Meetup today

Act now and get 50% off.
Until February 1.

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy