Novel Methodologies for Predictable CPU-To-GPU Command Offloading

Roberto Cavicchioli, Nicola Capodieci, Marco Solieri, Marko Bertogna
Universita di Modena e Reggio Emilia, Italy
31st Euromicro Conference on Real-Time Systems (ECRTS 2019), 2019


   title={Novel Methodologies for Predictable CPU-To-GPU Command Offloading},

   author={Cavicchioli, Roberto and Capodieci, Nicola and Solieri, Marco and Bertogna, Marko},

   booktitle={31st Euromicro Conference on Real-Time Systems (ECRTS 2019)},


   organization={Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik}


There is an increasing industrial and academic interest towards a more predictable characterization of real-time tasks on high-performance heterogeneous embedded platforms, where a host system offloads parallel workloads to an integrated accelerator, such as General Purpose-Graphic Processing Units (GP-GPUs). In this paper, we analyze an important aspect that has not yet been considered in the real-time literature, and that may significantly affect real-time performance if not properly treated, i.e., the time spent by the CPU for submitting GP-GPU operations. We will show that the impact of CPU-to-GPU kernel submissions may be indeed relevant for typical real-time workloads, and that it should be properly factored in when deriving an integrated schedulability analysis for the considered platforms. This is the case when an application is composed of many small and consecutive GPU compute/copy operations. While existing techniques mitigate this issue by batching kernel calls into a reduced number of persistent kernel invocations, in this work we present and evaluate three other approaches that are made possible by recently released versions of the NVIDIA CUDA GP-GPU API, and by Vulkan, a novel open standard GPU API that allows an improved control of GPU command submissions. We will show that this added control may significantly improve the application performance and predictability due to a substantial reduction in CPU-to-GPU driver interactions, making Vulkan an interesting candidate for becoming the state-of-the-art API for heterogeneous Real-Time systems. Our findings are evaluated on a latest generation NVIDIA Jetson AGX Xavier embedded board, executing typical workloads involving Deep Neural Networks of parameterized complexity.
Rating: 2.0/5. From 1 vote.
Please wait...

* * *

* * *

HGPU group © 2010-2021 hgpu.org

All rights belong to the respective authors

Contact us: