Acceleration of Streamed Tensor Contraction Expressions on GPGPU-Based Clusters

Wenjing Ma, Sriram Krishnamoorthy, Oreste Villa, Karol Kowalski
Ohio State University, Columbus, OH, USA
IEEE International Conference on Cluster Computing (CLUSTER), 2010


   title={Acceleration of Streamed Tensor Contraction Expressions on GPGPU-based Clusters},

   author={Ma, W. and Krishnamoorthy, S. and Villay, O. and Kowalski, K.},

   booktitle={2010 IEEE International Conference on Cluster Computing},





Download Download (PDF)   View View   Source Source   



Tensor contractions are generalized multidimensional matrix multiplication operations that widely occur in quantum chemistry. Efficient execution of tensor contractions on GPUs requires tackling several challenges to be addressed, including index permutation and small dimension-sizes reducing thread block utilization. In this paper, we present our approach to automatically generate CUDA code to execute tensor contractions on GPUs, including management of data movement between CPU and GPU. GPU-enabled code is generated for the most expensive contractions in CCSD(T), a key coupled cluster method, and incorporated into NW Chem, a popular computational chemistry suite. We demonstrate speedup over a factor of 8.4 using one core per node and over 2.6 when utilizing the entire system using hybrid CPU+GPU solution with 2 GPUs and 5 cores. Finally, we analyze the implementation behavior on future GPU systems.
No votes yet.
Please wait...

* * *

* * *

* * *

HGPU group © 2010-2022 hgpu.org

All rights belong to the respective authors

Contact us: