Distributed Calculations with Algorithmic Skeletons for Heterogeneous Computing Environments

Nina Herrmann, Herbert Kuchen
University of Münster, Münster, Germany
International Journal of Parallel Programming, 2023


   title={Distributed Calculations with Algorithmic Skeletons for Heterogeneous Computing Environments},

   author={Herrmann, Nina and Kuchen, Herbert},

   journal={International Journal of Parallel Programming},





Download Download (PDF)   View View   Source Source   



Contemporary HPC hardware typically provides several levels of parallelism, e.g. multiple nodes, each having multiple cores (possibly with vectorization) and accelerators. Efficiently programming such systems usually requires skills in combining several low-level frameworks such as MPI, OpenMP, and CUDA. This overburdens programmers without substantial parallel programming skills. One way to overcome this problem and to abstract from details of parallel programming is to use algorithmic skeletons. In the present paper, we evaluate the multi-node, multi-CPU and multi-GPU implementation of the most essential skeletons Map, Reduce, and Zip. Our main contribution is a discussion of the efficiency of using multiple parallelization levels and the consideration of which fine-tune settings should be offered to the user.
No votes yet.
Please wait...

* * *

* * *

HGPU group © 2010-2024 hgpu.org

All rights belong to the respective authors

Contact us: