Danny Abukalam

There are a number of available tools and approaches for benchmarking S3 performance in Ceph. Benchmarking reliably and sensibly gets more challenging as you scale out storage clusters, gateways, and benchmarking drivers. In this talk I’ll go over some of the benchmarking tools we’ve used in recent months, talk about our focus around COSBench, and some of the approaches and steps we took to improve the state of COSBench for Ceph benchmarking, both in COSBench itself and with helper tools.

70 years of academic innovation in the development of error correction codes have led to the advanced erasure coding techniques that we use in Ceph. Learn more about how these came about, the different types, how they work, and how we use them in distributed storage today.

Erasure Coding is the latest in a long line of error detection and correction approaches over the last 70 years which have all had an impact on the way we approach storing and recovering data in sensible and efficient ways. I’ll give an overview of the main approaches over the years, including the parity bit, the hamming codes, RAID, reed-solomon, and how they have impacted media storage, distributed storage, and their usage in other unexpected ways. I’ll then provide an overview of erasure coding across distributed storage and specifically Ceph.