cuSZ(x): Optimizing Error-Bounded Lossy Compression for Scientific Data on GPUs

Jiannan Tian, Sheng Di, Xiaodong Yu, Cody Rivera, Kai Zhao, Sian Jin, Yunhe Feng, Xin Liang, Dingwen Tao, Franck Cappello
Washington State University, Pullman, WA, USA
arXiv:2105.12912 [cs.DC], (27 May 2021)


   title={cuSZ(x): Optimizing Error-Bounded Lossy Compression for Scientific Data on GPUs},

   author={Jiannan Tian and Sheng Di and Xiaodong Yu and Cody Rivera and Kai Zhao and Sian Jin and Yunhe Feng and Xin Liang and Dingwen Tao and Franck Cappello},






Error-bounded lossy compression is a critical technique for significantly reducing scientific data volumes. With ever-emerging heterogeneous HPC architecture, GPU-accelerated error-bounded compressors (such as cuSZ and cuZFP) have been developed. However, they suffer from either low performance or low compression ratios. To this end, we propose cuSZ(x) to target both high compression ratio and throughput. We identify that data sparsity and data smoothness are key factors for high compression throughput. Our key contributions in this work are fourfold: (1) We propose an efficient compression workflow to adaptively perform run-length encoding and/or variable-length encoding. (2) We derive Lorenzo reconstruction in decompression as multidimensional partial-sum computation and propose a fine-grained Lorenzo reconstruction algorithm for GPU architectures. (3) We carefully optimize each of cuSZ’s kernels by leveraging state-of-the-art CUDA parallel primitives. (4) We evaluate cuSZ(x) using seven real-world HPC application datasets on V100 and A100 GPUs. Experiments show cuSZ(x) improves the compression performance and ratios by up to 18.4x and 5.3x, respectively, over cuSZ on the tested datasets.
No votes yet.
Please wait...

* * *

* * *

HGPU group © 2010-2023 hgpu.org

All rights belong to the respective authors

Contact us: