PyCUDA: GPU Run-Time Code Generation for High-Performance Computing

Andreas Klockner,Nicolas Pinto,Yunsup Lee,Bryan Catanzaro,Paul Ivanov,Ahmed Fasih
Division of Applied Mathematics, Brown University, Providence, RI 02912
arxiv.org:0911.3456 (18 Nov 2009)


   title={PyCUDA: GPU run-time code generation for high-performance computing},

   author={Kl{\”o}ckner, A. and Pinto, N. and Lee, Y. and Catanzaro, B. and Ivanov, P. and Fasih, A.},

   journal={Arxiv preprint arXiv},




Download Download (PDF)   View View   Source Source   Source codes Source codes




High-performance scientific computing has recently seen a surge of interest in heterogeneous systems, with an emphasis on modern Graphics Processing Units (GPUs). These devices offer tremendous potential for performance and efficiency in important large-scale applications of computational science. However, exploiting this potential can be challenging, as one must adapt to the specialized and rapidly evolving computing environment currently exhibited by GPUs. One way of addressing this challenge is to embrace better techniques and develop tools tailored to their needs. This article presents one simple technique, GPU run-time code generation (RTCG), and PyCUDA, an open-source toolkit that supports this technique. In introducing PyCUDA, this article proposes the combination of a dynamic, high-level scripting language with the massive performance of a GPU as a compelling two-tiered computing platform, potentially offering significant performance and productivity advantages over conventional single-tier, static systems. It is further observed that, compared to competing techniques, the effort required to create codes using run-time code generation with PyCUDA grows more gently in response to growing needs. The concept of RTCG is simple and easily implemented using existing, robust tools. Nonetheless it is powerful enough to support (and encourage) the creation of custom application-specific tools by its users. The premise of the paper is illustrated by a wide range of examples where the technique has been applied with considerable success.
No votes yet.
Please wait...

* * *

* * *

HGPU group © 2010-2023 hgpu.org

All rights belong to the respective authors

Contact us: