Design and performance evaluation of UCX for the Tofu Interconnect D on Fugaku towards efficient multithreaded communication

The increasing trend of manycore processors makes multithreaded communication more important to avoid costly global synchronization among cores. One of the representative approaches that require multithreaded communication is the global task-based programming model. In the model, a program is divide...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:The Journal of supercomputing Jg. 80; H. 14; S. 20715 - 20742
Hauptverfasser: Watanabe, Yutaka, Tsuji, Miwako, Murai, Hitoshi, Boku, Taisuke, Sato, Mitsuhisa
Format: Journal Article
Sprache:Englisch
Veröffentlicht: New York Springer US 01.09.2024
Springer Nature B.V
Schlagworte:
Bandwidths
Benchmarks
Communication
Compilers
Computer Science
Design
High performance computing
Interpreters
Laboratories
Libraries
Message passing
Network interface cards
Network topologies
Performance evaluation
Processor Architectures
Programming Languages
Soy products
Supercomputers
Synchronism
Tofu
Tofu Interconnect D
UCX
A64FX
One-sided communication
Supercomputer Fugaku
Multithreaded communication
ISSN:0920-8542, 1573-0484
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The increasing trend of manycore processors makes multithreaded communication more important to avoid costly global synchronization among cores. One of the representative approaches that require multithreaded communication is the global task-based programming model. In the model, a program is divided into tasks, and tasks are asynchronously executed by each node, and independent thread-to-thread communications are expected. However, the Message passing interface (MPI) based approach is not efficient because of design issues. In this research, we design and implement the utofu transport layer in an abstracted communication library called Unified communication-X (UCX) for efficient remote direct memory access (RDMA) based multithreaded communication on Tofu Interconnect D. The evaluation results on Fugaku show that UCX can significantly improve the multithreaded performance over MPI, while maintaining portability between systems thanks to UCX. UCX shows about 32.8 times lower latency than Fujitsu MPI with 24 threads in the multithreaded pingpong benchmark and about 37.8 times higher update rate than Fujitsu MPI with 24 threads on 256 nodes in multithreaded GUPs benchmark.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0920-8542
1573-0484
DOI:10.1007/s11227-024-06201-x