StreamMR: An Optimized MapReduce Framework for AMD GPUs

Marwa Elteir, Heshan Lin, Wu-chun Feng, Tom Scogland
City of Scientific Researches and Technology Applications, Egypt
17th IEEE International Conference on Parallel and Distributed Systems, 2011


   title={StreamMR: An Optimized MapReduce Framework for AMD GPUs},

   author={Elteir, M. and Lin, H. and Feng, W. and Scogland, T.},



Download Download (PDF)   View View   Source Source   



MapReduce is a programming model from Google that facilitates parallel processing on a cluster of thousands of commodity computers. The success of MapReduce in cluster environments has motivated several studies of implementing MapReduce on a graphics processing unit (GPU), but generally focusing on the NVIDIA GPU. Our investigation reveals that the design and mapping of the MapReduce framework needs to be revisited for AMD GPUs due to their notable architectural differences from NVIDIA GPUs. For instance, current state-of-the-art MapReduce implementations employ atomic operations to coordinate the execution of different threads. However, atomic operations can implicitly cause inefficient memory access, and in turn, severely impact performance. In this paper, we propose StreamMR, an OpenCL MapReduce framework optimized for AMD GPUs. With efficient atomic-free algorithms for output handling and intermediate result shufling, StreamMR is superior to atomic-based MapReduce designs and can outperform existing atomic-free MapReduce implementations by nearly five-fold on an AMD Radeon HD 5870.
No votes yet.
Please wait...

* * *

* * *

HGPU group © 2010-2021 hgpu.org

All rights belong to the respective authors

Contact us: