Performance Upper Bound Analysis and Optimization of SGEMM on Fermi and Kepler GPUs

Junjie Lai, Andre Seznec
INRIA, France
International Symposium on Code Generation and Optimization (CGO ’13), 2013




   title={Performance Upper Bound Analysis and Optimization of SGEMM on Fermi and Kepler GPUs},

   author={Lai, Junjie and Seznec, Andr{‘e}},

   keywords={Kepler GPU; Fermi GPU; SGEMM; CUDA; Performance Upper Bound Analysis},


   affiliation={ALF – INRIA – IRISA},

   booktitle={CGO ’13 – 2013 International Symposium on Code Generation and Optimization},

   address={Shenzhen, Chine},

   audience={internationale },





Download Download (PDF)   View View   Source Source   



In this paper, we present an approach to estimate GPU applications’ performance upper bound based on algorithm analysis and assembly code level benchmarking. As an example, we analyze the potential peak performance of SGEMM (Single-precision General Matrix Multiply) on Fermi (GF110) and Kepler (GK104) GPUs. We try to answer the question of how much optimization space is left for SGEMM and why. According to our analysis, the nature of Fermi (Kepler) instruction set and the limited issue throughput of the schedulers are the main limitation factors for SGEMM to approach the theoretical peak performance. The estimated upper-bound peak performance of SGEMM is around 82.5% of the theoretical peak performance on GTX580 Fermi GPU and 57.6% on GTX680 Kepler GPU. Guided by this analysis and using the native assembly language, on average, our SGEMM implementations achieve about 5% better performance than CUBLAS in CUDA 4.1 SDK for large matrices on GTX580. The achieved performance is around 90% of the estimated upper-bound per- formance of SGEMM on GTX580. On GTX680, the best performance we achieve is around 77.3% of the estimated performance upper bound. We also describe how to use native assembly language directly in the CUDA runtime source
No votes yet.
Please wait...

* * *

* * *

HGPU group © 2010-2021 hgpu.org

All rights belong to the respective authors

Contact us: