PErasure: a Parallel Cauchy Reed-Solomon Coding Library for GPUs

Xiaowen Chu, Chengjian Liu, Kai Ouyang, Ling Sing Yung, Hai Liu, Yiu-Wing Leung
Department of Computer Science, Hong Kong Baptist University, Kowloon Tong, Hong Kong
The IEEE International Conference on Communications (IEEE ICC 2015), 2015


   title={PErasure: a Parallel Cauchy Reed-Solomon Coding Library for GPUs},

   author={Chu, Xiaowen and Liu, Chengjian and Ouyang, Kai and Yung, Ling Sing and Liu, Hai and Leung, Yiu-Wing},



Download Download (PDF)   View View   Source Source   



In recent years, erasure coding has been adopted by large-scale cloud storage systems to replace data replication. With the increase of disk I/O throughput and network bandwidth, the speed of erasure coding becomes one of the key system bottlenecks. In this paper, we propose to offload the task of erasure coding to Graphics Processing Units (GPUs). Specifically, we have designed and implemented PErasure, a parallel Cauchy ReedSolomon (CRS) coding library. We compare the performance of PErasure with that of two state-of-the-art libraries: Jerasure (for CPUs) and Gibraltar (for GPUs). Our experiments show that the raw coding speed of PErasure on a $500 Nvidia GTX780 card is about 10 times faster than that of multithreaded Jerasure on a quad-core modern CPU, and 2-4 times faster than Gibraltar on the same GPU. PErasure can achieve up to 10GB/s of overall encoding speed using just a single GPU for a large storage system that can withstand up to 8 disk failures.
Rating: 2.2/5. From 6 votes.
Please wait...

* * *

* * *

* * *

HGPU group © 2010-2022 hgpu.org

All rights belong to the respective authors

Contact us: