StreamMR: An Optimized MapReduce Framework for AMD GPUs

MapReduce is a programming model from Google that facilitates parallel processing on a cluster of thousands of commodity computers. The success of MapReduce in cluster environments has motivated several studies of implementing MapReduce on a graphics processing unit (GPU), but generally focusing on...

Full description

Saved in:
Bibliographic Details
Published in:2011 IEEE 17th International Conference on Parallel and Distributed Systems pp. 364 - 371
Main Authors: Elteir, M., Heshan Lin, Wu-chun Feng, Scogland, T.
Format: Conference Proceeding
Language:English
Published: IEEE 01.12.2011
Subjects:
AMD GPU
atomics
GPGPU
Graphics processing unit
High definition video
Instruction sets
Kernel
MapCG
MapReduce
Mars
OpenCL
Optimization
parallel computing
Programming
ISBN:1457718758, 9781457718755
ISSN:1521-9097
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:MapReduce is a programming model from Google that facilitates parallel processing on a cluster of thousands of commodity computers. The success of MapReduce in cluster environments has motivated several studies of implementing MapReduce on a graphics processing unit (GPU), but generally focusing on the NVIDIA GPU. Our investigation reveals that the design and mapping of the MapReduce framework needs to be revisited for AMD GPUs due to their notable architectural differences from NVIDIA GPUs. For instance, current state-of-the-art MapReduce implementations employ atomic operations to coordinate the execution of different threads. However, atomic operations can implicitly cause inefficient memory access, and in turn, severely impact performance. In this paper, we propose Streamer, an OpenCL MapReduce framework optimized for AMD GPUs. With efficient atomic-free algorithms for output handling and intermediate result shuffling, Stream MR is superior to atomic-based MapReduce designs and can outperform existing atomic-free MapReduce implementations by nearly five-fold on an AMD Radeon HD 5870.
ISBN:1457718758
9781457718755
ISSN:1521-9097
DOI:10.1109/ICPADS.2011.131