Kernel Launcher: C++ Library for Optimal-Performance Portable CUDA Applications

Stijn Heldens, Ben van Werkhoven
Netherlands eScience Center
arXiv:2303.12374 [cs.DC], (22 Mar 2023)


   title={Kernel Launcher: C++ Library for Optimal-Performance Portable CUDA Applications},

   author={Stijn Heldens and Ben van Werkhoven},






Download Download (PDF)   View View   Source Source   Source codes Source codes




Graphic Processing Units (GPUs) have become ubiquitous in scientific computing. However, writing efficient GPU kernels can be challenging due to the need for careful code tuning. To automatically explore the kernel optimization space, several auto-tuning tools – like Kernel Tuner – have been proposed. Unfortunately, these existing auto-tuning tools often do not concern themselves with integration of tuning results back into applications, which puts a significant implementation and maintenance burden on application developers. In this work, we present Kernel Launcher: an easy-to-use C++ library that simplifies the creation of highly-tuned CUDA applications. With Kernel Launcher, programmers can capture kernel launches, tune the captured kernels for different setups, and integrate the tuning results back into applications using runtime compilation. To showcase the applicability of Kernel Launcher, we consider a real-world computational fluid dynamics code and tune its kernels for different GPUs, input domains, and precisions.
No votes yet.
Please wait...

Recent source codes

* * *

* * *

HGPU group © 2010-2024 hgpu.org

All rights belong to the respective authors

Contact us: