Achieving Computation-Communication Overlap with Overdecomposition on GPU Systems

The landscape of high performance computing is shifting towards a collection of multi-GPU nodes, widening the gap between on-node compute and off-node communication capabilities. Consequently, the ability to tolerate communication latencies and maximize utilization of the compute hardware are becomi...

Full description

Saved in:

Bibliographic Details
Published in:	2020 IEEE/ACM Fifth International Workshop on Extreme Scale Programming Models and Middleware (ESPM2) pp. 1 - 10
Main Authors:	Choi, Jaemin, Richards, David F., Kale, Laxmikant V.
Format:	Conference Proceeding
Language:	English
Published:	IEEE 01.11.2020
Subjects:	application program interfaces asynchronous task-based runtime Charm++ parallel programming system communication latencies computation-communication overlap compute hardware computer graphic equipment coprocessors Delays GPU computing graphics processing units Hardware high performance computing Jacobian matrices Kernel message passing modern GPU systems multiGPU nodes off-node communication capabilities on-node compute overde-composition overdecomposition parallel architectures parallel processing parallel programming Runtime Task analysis traditional CPU-based systems
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!