Reordering GPU Kernel Launches to Enable Efficient Concurrent Execution
Department of Electrical and Computer Engineering, The George Washington University, 801 22nd St NW, Washington, DC, 20052, United States
arXiv:1511.07983 [cs.DC], (25 Nov 2015)
@article{li2015reordering,
title={Reordering GPU Kernel Launches to Enable Efficient Concurrent Execution},
author={Li, Teng and Narayana, Vikram K. and El-Ghazawi, Tarek},
year={2015},
month={nov},
archivePrefix={"arXiv"},
primaryClass={cs.DC}
}
Contemporary GPUs allow concurrent execution of small computational kernels in order to prevent idling of GPU resources. Despite the potential concurrency between independent kernels, the order in which kernels are issued to the GPU will significantly influence the application performance. A technique for deriving suitable kernel launch orders is therefore presented, with the aim of reducing the total execution time. Experimental results indicate that the proposed method yields solutions that are well above the 90 percentile mark in the design space of all possible permutations of the kernel launch sequences.
November 29, 2015 by hgpu
