Quantcast File System (QFS) -- an alternative to HDFS

Dear members
In this meetup, Silvius Rus from Quantcast will present Quantcast File System (QFS).  QFS is developed by Quantcast and used in production at peta byte scale.

6pm-630pm : food & networking
630pm - 8pm : talk

This meetup is sponsored by Samsung R&D

This is a free event.

Abstract:
This talk will describe the Quantcast File System (QFS), an alternative toHadoop¹s HDFS developed at Quantcast from the Kosmos File System (KFS) andreleased to open source in 2012.  Its main advantage is Reed-Solomonerasure coding, which saves 50% in storage costs and also pays performancedividends.  We¹ll describe the QFS architecture with emphasis onReed-Solomon, discuss implementation and operations details, and presentperformance comparisons relative to HDFS.

Bio:
Silvius Rus leads Big Data Platforms at Quantcast.  He directs, managesand participates in the development of an Internet-scale data processingsoftware stack.  Quantcast processes up to 30 petabytes of data per dayand responds in realtime to 850,000 requests per second at peak.  BeforeQuantcast he was at Google working on Gmail global load balancing,parallel memory allocation performance, server performance and C++compiler and library optimization.

Join or login to comment.

Our Sponsors

  • Oreilly

    20% Discount for Strata Conference (code UGBDG20)

People in this
Meetup are also in:

Create a Meetup Group and meet new people

Get started Learn more
Allison

Meetup has allowed me to meet people I wouldn't have met naturally - they're totally different than me.

Allison, started Women's Adventure Travel

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy