LogSC: Model-based one-sided communication performance estimation

One-sided communication (also known as remote memory access, or RMA) in the Message Passing Interface (MPI) is a communication interface that has been introduced in MPI-2 (1997) that enables new more efficient programming models. In MPI-3, some new more flexible and efficient primitives have been in...

Full description

Saved in:
Bibliographic Details
Published in:Future generation computer systems Vol. 132; pp. 25 - 39
Main Authors: Wang, Ziheng, Chen, Heng, Dong, Xiaoshe, Cai, Weilin, Zhang, Xingjun
Format: Journal Article
Language:English
Published: Elsevier B.V 01.07.2022
Subjects:
Hybrid programming
MPI-3
One-sided communication
Parallel performance models
Performance analysis
Parallel performance models
Performance analysis
One-sided communication
Hybrid programming
MPI-3
ISSN:0167-739X, 1872-7115
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:One-sided communication (also known as remote memory access, or RMA) in the Message Passing Interface (MPI) is a communication interface that has been introduced in MPI-2 (1997) that enables new more efficient programming models. In MPI-3, some new more flexible and efficient primitives have been introduced, which makes it easier to use and more deployable. However, compared to traditional two-sided communication, little work has been performed on analyzing one-sided communication costs, which urgently requires formal analysis. The communication performance model is a formal analysis of communication and its cost. We focus on the software model, whose core idea is that the transmission can be represented as a sequence of implicit transfers and data movements. This approach is a suitable solution for concurrent communication modeling. We propose LogSC, which consists of the window cost, transmission cost, synchronization cost, and computational cost in atomic operations. In this paper, LogSC is used to model most of the operations in one-sided communication, including the put/get operation, atomic operation, and shared memory programming of MPI. We model and evaluate the parallel tests of IMB, collectives designed by combining MPI and the MPI shared memory (MPI+MPI), and the communication in the scalable universal matrix multiplication algorithm (SUMMA), which is a common matrix multiplication algorithm. Experiments show that our modeling has high accuracy, which makes up for the lack of existing models. •We present a MPI performance model named LogSC for modeling one-sided communication.•The LogSC goal is to help optimize parallel applications and parallel algorithms.•LogSC can model most operation in RMA, including put/get atomic operations, and shared memory programming.•We provide the modeling of concurrent communication, including parallel algorithms and a MPI+MPI code.
ISSN:0167-739X
1872-7115
DOI:10.1016/j.future.2022.02.004