14426

MPC: A Massively Parallel Compression Algorithm for Scientific Data

Annie Yang, Hari Mukka, Farbod Hesaaraki, Martin Burtscher
Department of Computer Science, Texas State University, San Marcos, TX 78666
IEEE Cluster Conference (Cluster’15), 2015

@article{yang2015mpc,

   title={MPC: A Massively Parallel Compression Algorithm for Scientific Data},

   author={Yang, Annie and Mukka, Hari and Hesaaraki, Farbod and Burtscher, Martin},

   year={2015}

}

Download Download (PDF)   View View   Source Source   

970

views

Due to their high peak performance and energy efficiency, massively parallel accelerators such as GPUs are quickly spreading in high-performance computing, where large amounts of floating-point data are processed, transferred, and stored. Such environments can greatly benefit from data compression if done sufficiently quickly. Unfortunately, most conventional compression algorithms are unsuitable for highly parallel execution. In fact, it is generally unknown how to design good compression algorithms for massively parallel systems. To remedy this situation, we study 138,240 lossless compression algorithms for single- and double-precision floatingpoint values that are built exclusively from easily parallelizable components. We analyze the best of these algorithms, explain why they compress well, and derive the Massively Parallel Compression (MPC) algorithm from them. This novel algorithm requires almost no internal state, achieves heretofore unreached compression ratios on several data sets, and roughly matches the best CPU-based algorithms in compression ratio while outperforming them by one to two orders of magnitude in throughput.
VN:F [1.9.22_1171]
Rating: 4.4/5 (5 votes cast)
MPC: A Massively Parallel Compression Algorithm for Scientific Data, 4.4 out of 5 based on 5 ratings

* * *

* * *

HGPU group © 2010-2017 hgpu.org

All rights belong to the respective authors

Contact us: