Syntix: A Profiling Based Resource Estimator for CUDA Kernels

Maria Papadaki, Yannis Sfakianakis, Christos Kozanitis, Angelos Bilas
FORTH-ICS, N. Plastira 100, V. Vouton, Heraklion 70013, Greece
Procedia Computer Science 156, 3-12, 2019


   title={Syntix: A Profiling Based Resource Estimator for CUDA Kernels},

   author={Papadaki, Maria and Sfakianakis, Yannis and Kozanitis, Christos and Bilas, Angelos},

   journal={Procedia Computer Science},






Download Download (PDF)   View View   Source Source   



Trending applications such as AI and data analytics have mandated the use of GPUs in modern datacenters for performance reasons. Current practice dictates to dedicate GPUs to applications, which limits the amount of concurrent users to the available GPUs. That use of GPUs contradicts with the policy of datacenters to oversubscribe resources and accommodate as many user applications as possible. To address this issue, providers will inevitably resort to GPU sharing. In this work we introduce Syntix, a mechanism that we deploy on GPU sharing system and 1) profiles CUDA kernels in order to learn their resource requirements in terms of threads and blocks and 2) assigns those resources to kernels in order to be efficiently collocated into streams. Syntix is able to exploit the resources that are possibly wasted from the execution of an individual kernel and save the 80% of them on average.
No votes yet.
Please wait...

Recent source codes

* * *

* * *

HGPU group © 2010-2024 hgpu.org

All rights belong to the respective authors

Contact us: