Skip to content

[ONLINE] Tom Hall On "Erasure Code with SHEC"

Photo of @reborg
Hosted By
@reborg
[ONLINE] Tom Hall On "Erasure Code with SHEC"

Details

Tommy Hall (https://twitter.com/thattommyhall) presents the paper:

"Erasure Code with Shingled Local Parity Groups for Efficient Recovery from Multiple Disk Failures" by Takeshi Miyamae, Takanori Nakao, and Kensuke Shiozawa, Fujitsu Laboratories Ltd. The paper can be downloaded here (https://www.usenix.org/node/187155).

Schedule

(See the Zoom info below)

6.30-7.00pm Grab a drink and enter the Zoom room for a friendly chat!
7.00-7.50pm Presentation
7.50-8.00pm Q&A

Abstract

Previously at PwL, I have given a talk (https://www.meetup.com/Papers-We-Love-London/events/232484664) on RAID systems and their clever use of some interesting mathematics to recover from data loss while using space more efficiently than a simplistic 'replicate the data N times' approach.

While the approach taken with RAID6 (so-called Reed-Soloman encodings) to protect from 2 failures can be generalised, moving to higher redundancy requires more work to be be done and is difficult to implement efficiently.

There is lots of work on Erasure Codes but I have chosen to focus on this paper by Miyamae, Nakao, Shiozawa from Fujitsu as it solves the problem in a neat way that allows you to tune the trade off between space efficiency, durability and recovery efficiency and has a production-ready implementation in Ceph

http://docs.ceph.com/docs/jewel/rados/operations/erasure-code/

The Speaker:
During lock-down he spends his time making plans for when we are not locked down, also: cooking things, photographing them, eating them

Location is on Zoom:
https://us02web.zoom.us/j/84284444352
Meeting ID: 842-8444-4352
Meeting Password: password will be sent separately by email to users who RSVP-ied. If you didn't get one, please message reborg on Meetup.

Meetup are captured on video and uploaded on the PWL London Youtube channel https://www.youtube.com/channel/UCEYe-1uDIkjPtuH_qhoybnA

Photo of Papers We Love - London group
Papers We Love - London
See more events