Integer Sum Reduction with OpenMP on an AMD MI100 GPU

Sum reduction is a primitive operation in parallel computing. Device offload support allows a user to use OpenMP directives to take advantage of a highly capable GPU. In this paper, we present the integer sum reduction annotated with the OpenMP directives and evaluate the performance impacts of tuna...

Full description

Saved in:
Bibliographic Details
Published in:2022 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW) pp. 496 - 499
Main Authors: Jin, Zheming, Vetter, Jeffrey S.
Format: Conference Proceeding
Language:English
Published: IEEE 01.05.2022
Subjects:
AMD GPU
Conferences
Distributed processing
Graphics processing units
Manuals
OpenMP target offload
Optimization
Parallel processing
Performance evaluation
Reduction
ISBN:9781665497480
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Sum reduction is a primitive operation in parallel computing. Device offload support allows a user to use OpenMP directives to take advantage of a highly capable GPU. In this paper, we present the integer sum reduction annotated with the OpenMP directives and evaluate the performance impacts of tunable parameters with the AOMP and GCC compilers on an AMD MI100 GPU. In addition, we explain the implementations of the OpenMP reduction by the compilers. Sweeping over the pruned parameter space, we find that the speedup is approximately 20 with AOMP, and the reduction performance using AOMP is approximately 11% higher than that using GCC. However, the OpenMP offload performance is approximately 30% lower compared to the performance of the reductions written with rocThrust or hipCUB.
ISBN:9781665497480
DOI:10.1109/IPDPSW55747.2022.00088