Accelerator Aware MPI Micro-benchmarking using CUDA, OpenACC and OpenCL

Sadaf Alam, Ugo Varetto
Swiss National Supercomputing Centre, Lugano, Switzerland
PRACE, 2014


   title={Accelerator Aware MPI Micro-benchmarking using CUDA, OpenACC and OpenCL},

   author={Alam, Sadaf and Varettoa, Ugo},



Download Download (PDF)   View View   Source Source   



Recently MPI implementations have been extended to support accelerator devices, Intel Many Integrated Core (MIC) and nVidia GPU. This has been accomplished by changes to different levels of the software stacks and MPI implementations. In order to evaluate performance and scalability of accelerator aware MPI libraries, we developed portable micro-benchmarks to identify factors that influence efficiencies of primitive MPI point-to-point and collective operations. These benchmarks have been implemented in OpenACC, CUDA and OpenCL. On the Intel MIC platform, existing MPI benchmarks can be executed with appropriate mapping onto the MIC and CPU cores. Our results demonstrate that the MPI operations are highly sensitive to the memory and I/O bus configurations on the node. The current implementation of MIC on-node communication interface exhibit additional limitations on the placement of the card and data transfers over the memory bus.
No votes yet.
Please wait...

* * *

* * *

HGPU group © 2010-2021 hgpu.org

All rights belong to the respective authors

Contact us: