OpenStack Placement, HPC workload migration, and Ceph Erasure Coding

Details

We're back in February for another meetup, this time graciously hosted and sponsored by G-Research at their new event space (Whittington House 19-30 Alfred Place, London WC1E 7EA).

6:30pm to 7:00pm - Registration, networking, food and refreshments
7:00pm to 7:35pm - Dude, where's my VM? (Scott Solkhon and Ross Martyn, G-Research)
7:45pm to 8:20pm - Migrating Genomics Workloads from Public Cloud to an on prem HPC Cloud environment (Dave Power and Konstantinos Mouzakitis, vScaler)
8:30pm to 9:00pm - The history of error correction and detection and how it led to Ceph’s Erasure Coding Techniques (Danny Abukalam, SoftIron)

· Dude, where's my VM? - Scott Solkhon and Ross Martyn, G-Research

At G-Research we are going through a period of growth and transforming the way that we build and deploy our platforms. This talk focuses on utilising the OpenStack Placement service to schedule NVME, GPU and vGPU workloads alongside general purpose virtual machines.

· Migrating Genomics Workloads from Public Cloud to an on prem HPC Cloud environment - Dave Power and Konstantinos Mouzakitis, vScaler

A cloudy journey! We'll cover how we are using OpenStack to run a broad range of genomics workloads and how our customer has migrated from running 100% public cloud back to cloud on prem (and then burst back to public cloud again).

· The history of error correction and detection and how it led to Ceph’s Erasure Coding Techniques - Danny Abukalam, SoftIron

70 years of academic innovation in the development of error correction codes have led to the advanced erasure coding techniques that we use in Ceph. Learn more about how these came about, the different types, how they work, and how we use them in distributed storage today.

Erasure Coding is the latest in a long line of error detection and correction approaches over the last 70 years which have all had an impact on the way we approach storing and recovering data in sensible and efficient ways. I’ll give an overview of the main approaches over the years, including the parity bit, the hamming codes, RAID, reed-solomon, and how they have impacted media storage, distributed storage, and their usage in other unexpected ways. I’ll then provide an overview of erasure coding across distributed storage and specifically Ceph.