Towards the Dynamic Load Balancing on Heterogeneous Multi-GPU Systems

The advent of multicore systems, joined to the potential acceleration of the graphics processing units, alleviates some well known important architectural problems at the expense of a considerable increment of the programmability wall. The heterogeneity, both at architectural and programming level a...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:2012 IEEE 10th International Symposium on Parallel and Distributed Processing with Applications S. 646 - 653
Hauptverfasser: Acosta, Alejandro, Blanco, Vicente, Almeida, Francisco
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 01.07.2012
Schlagworte:
CUDA
Dynamic Load Balancing
Dynamic Programming
GPU
Graphics processing unit
Heuristic algorithms
Instruction sets
Irregular code
Iterative algorithms
Libraries
Load management
Resource Allocation Problem
Resource management
ISBN:1467316318, 9781467316316
ISSN:2158-9178
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The advent of multicore systems, joined to the potential acceleration of the graphics processing units, alleviates some well known important architectural problems at the expense of a considerable increment of the programmability wall. The heterogeneity, both at architectural and programming level at the same time, raises the programming difficulties. Adapting existing code and libraries to such systems is a fundamental problem. The performance of this code is affected by the large interdependence between the code and the parallel architecture. We have developed a dynamic load balancing library that allows parallel code to be adapted to a wide variety of heterogeneous systems. The overhead introduced by our system is minimal and the cost to the programmer negligible. This system has been applied to solve load imbalance problems appearing in homogeneous and heterogeneous multi-GPU platforms. As case studies, we consider matrix multiply and resource allocation problems, in different heterogeneous scenarios in multi-GPU systems. The unbalanced nature of these algorithms and heterogeneous systems allowed us to test the success of our load balancing approach.
ISBN:1467316318
9781467316316
ISSN:2158-9178
DOI:10.1109/ISPA.2012.96