high performance computing on graphics processing units: hgpu.org

A emerging trend in the field of Graphics Processing Unit (GPU) computing is the harnessing of multiple devices to tackle bigger problems and increase performance. Multi-GPU execution adds new challenges to the already complex world of General Purpose computing of GPUs (GPGPU), such as the efficient GPU-aware problem decomposition, and coping with heterogeneity. To this extent, we propose the use of the Marrow algorithmic framework (ASkF) to abstract most of the details intrinsic to the programming of such platforms. To the best of our knowledge, Marrow is the first ASkF to address the implementation of task-parallel skeletons, such as Pipeline, on single and (now) multiple GPU systems. The framework transparently decomposes the problem’s domain and schedules the generated tasks among a set of, possibly, heterogeneous devices. To assess the proposal’s effectiveness, we present some initial experimental results that deliver good scalability results.