Incremental Parallelization with Migration

We present a new methodology for developing parallel distributed programs in a series of incremental steps. The methodology takes advantage of threads that are able to migrate through the network and thus are able to follow distributed data. This allows the data to be partitioned and distributed fir...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:2012 IEEE 10th International Symposium on Parallel and Distributed Processing with Applications S. 223 - 230
Hauptverfasser: Wenhui Zhang, Lei Pan, Qinghong Shang, Bic, L. F., Dillencourt, M. B.
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 01.07.2012
Schlagworte:
Computer science
Distributed databases
feedback
incremental parallelization
Instruction sets
migration
parallel and distributed programming
pivot-computes
Processor scheduling
Synchronization
Tiles
tiling
ISBN:1467316318, 9781467316316
ISSN:2158-9178
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:We present a new methodology for developing parallel distributed programs in a series of incremental steps. The methodology takes advantage of threads that are able to migrate through the network and thus are able to follow distributed data. This allows the data to be partitioned and distributed first, which guarantees that elements that are used together in a computation are collocated on the same node. Next, the loops in the code are tiled to minimize migration among nodes. After deciding on the location at which each loop is to execute, the necessary migration and remote access statements are inserted to make the code executable. This process is repeated based on feedback obtained from the execution, which may improve the overall performance by suggesting a different data distribution or a different coarseness of tiling. We illustrate the trade-offs and the performance using a well-known application with two different data distributions.
ISBN:1467316318
9781467316316
ISSN:2158-9178
DOI:10.1109/ISPA.2012.37