5898

CudaDMA: Optimizing GPU Memory Bandwidth via Warp Specialization

Michael Bauer, Henry Cook, Brucek Khailany
Stanford University
International Conference on Super Computing (SC’11), 2011

@article{bauer2011cudadma,

   title={CudaDMA: Optimizing GPU Memory Bandwidth via Warp Specialization},

   author={Bauer, M. and Cook, H. and Khailany, B.},

   year={2011}

}

Download Download (PDF)   View View   Source Source   Source codes Source codes

Package:

1559

views

As the computational power of GPUs continues to scale with Moore’s Law, an increasing number of applications are becoming limited by memory bandwidth. We propose an approach for programming GPUs with tightly-coupled specialized DMA warps for performing memory transfers between on-chip and off-chip memories. Separate DMA warps improve memory bandwidth utilization by better exploiting available memory-level parallelism and by leveraging efficient inter-warp producer-consumer synchronization mechanisms. DMA warps also improve programmer productivity by decoupling the need for thread array shapes to match data layout. To illustrate the benefits of this approach, we present an extensible API, CudaDMA, that encapsulates synchronization and common sequential and strided data transfer patterns. Using CudaDMA, we demonstrate speedup of up to 1.37x on representative synthetic microbenchmarks, and 1.15x-3.2x on several kernels from scientific applications written in CUDA running on NVIDIA Fermi GPUs.
No votes yet.
Please wait...

* * *

* * *

HGPU group © 2010-2024 hgpu.org

All rights belong to the respective authors

Contact us: