MPI Progress For All

The progression of communication in the Message Passing Interface (MPI) is not well defined, yet it is critical for application performance, particularly in achieving effective computation and communication overlap. The opaque nature of MPI progress poses significant challenges in advancing MPI with...

Full description

Saved in:
Bibliographic Details
Published in:SC24-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis pp. 425 - 435
Main Authors: Zhou, Hui, Latham, Robert, Raffenetti, Ken, Guo, Yanfei, Thakur, Rajeev
Format: Conference Proceeding
Language:English
Published: IEEE 17.11.2024
Subjects:
Asynchronous communication
Complexity theory
Conferences
Engines
Guidelines
High performance computing
Message passing
mpi
mpi interoperability
mpi progress
mpi+x
mpich
Programming
Runtime
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract The progression of communication in the Message Passing Interface (MPI) is not well defined, yet it is critical for application performance, particularly in achieving effective computation and communication overlap. The opaque nature of MPI progress poses significant challenges in advancing MPI within modern high-performance computing practices. First, the lack of clarity hinders the development of explicit guidelines for enhancing computation and communication overlap in applications. Second, it prevents MPI from seamlessly integrating with contemporary programming paradigms, such as task-based runtimes and event-driven programming. Third, it limits the extension of MPI functionality from user space. In this paper, we examine the role of MPI progress by analyzing the implementation details of MPI messaging. We then generalize the asynchronous communication pattern and identify key factors influencing application performance. Based on this analysis, we propose a set of MPI extensions designed to enable users to construct and manage an efficient progress engine explicitly. We compare our approach to previous efforts in the field, highlighting its reduced complexity and increased effectiveness.
AbstractList The progression of communication in the Message Passing Interface (MPI) is not well defined, yet it is critical for application performance, particularly in achieving effective computation and communication overlap. The opaque nature of MPI progress poses significant challenges in advancing MPI within modern high-performance computing practices. First, the lack of clarity hinders the development of explicit guidelines for enhancing computation and communication overlap in applications. Second, it prevents MPI from seamlessly integrating with contemporary programming paradigms, such as task-based runtimes and event-driven programming. Third, it limits the extension of MPI functionality from user space. In this paper, we examine the role of MPI progress by analyzing the implementation details of MPI messaging. We then generalize the asynchronous communication pattern and identify key factors influencing application performance. Based on this analysis, we propose a set of MPI extensions designed to enable users to construct and manage an efficient progress engine explicitly. We compare our approach to previous efforts in the field, highlighting its reduced complexity and increased effectiveness.
Author Thakur, Rajeev
Zhou, Hui
Latham, Robert
Guo, Yanfei
Raffenetti, Ken
Author_xml – sequence: 1
  givenname: Hui
  surname: Zhou
  fullname: Zhou, Hui
  organization: Argonne National Laboratory,Lemont,IL,USA,60439
– sequence: 2
  givenname: Robert
  surname: Latham
  fullname: Latham, Robert
  organization: Argonne National Laboratory,Lemont,IL,USA,60439
– sequence: 3
  givenname: Ken
  surname: Raffenetti
  fullname: Raffenetti, Ken
  organization: Argonne National Laboratory,Lemont,IL,USA,60439
– sequence: 4
  givenname: Yanfei
  surname: Guo
  fullname: Guo, Yanfei
  organization: Argonne National Laboratory,Lemont,IL,USA,60439
– sequence: 5
  givenname: Rajeev
  surname: Thakur
  fullname: Thakur, Rajeev
  organization: Argonne National Laboratory,Lemont,IL,USA,60439
BookMark eNotzE9LwzAYgPEICurWmzc99Au0vn_ypslxFDcHEwdTPI6kTaVQV0m8-O0V9PTA7_Bcq_PTfIpK3SLUiODuD-2bYdJQE5CuAcDwmSpc4ywLsIhovlRFzmMAA2I1WLlSN0_7bblP83uKOZfrOZWraVqqi8FPORb_XajX9cNL-1jtnjfbdrWrPIn5qgbBJgxIXsiiUAjO-4ZcdN7o_lcb7jSLI48Ou053AqiNi6yDNR32PS_U3d93jDEeP9P44dP3EcESWLD8A6qDOOg
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/SCW63240.2024.00063
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9798350355543
EndPage 435
ExternalDocumentID 10820808
Genre orig-research
GrantInformation_xml – fundername: Office of Science
  funderid: 10.13039/100006132
– fundername: U.S. Department of Energy
  funderid: 10.13039/100000015
GroupedDBID 6IE
6IL
ACM
ALMA_UNASSIGNED_HOLDINGS
CBEJK
RIE
RIL
ID FETCH-LOGICAL-a256t-f517bf12a528152bb9aa729e9a64d2a573c43592a191cc4c501469e34b86c1dd3
IEDL.DBID RIE
ISICitedReferencesCount 3
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001451792300048&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Aug 27 01:59:34 EDT 2025
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a256t-f517bf12a528152bb9aa729e9a64d2a573c43592a191cc4c501469e34b86c1dd3
PageCount 11
ParticipantIDs ieee_primary_10820808
PublicationCentury 2000
PublicationDate 2024-Nov.-17
PublicationDateYYYYMMDD 2024-11-17
PublicationDate_xml – month: 11
  year: 2024
  text: 2024-Nov.-17
  day: 17
PublicationDecade 2020
PublicationTitle SC24-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis
PublicationTitleAbbrev SC-W
PublicationYear 2024
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssib060584085
Score 1.9122725
Snippet The progression of communication in the Message Passing Interface (MPI) is not well defined, yet it is critical for application performance, particularly in...
SourceID ieee
SourceType Publisher
StartPage 425
SubjectTerms Asynchronous communication
Complexity theory
Conferences
Engines
Guidelines
High performance computing
Message passing
mpi
mpi interoperability
mpi progress
mpi+x
mpich
Programming
Runtime
Title MPI Progress For All
URI https://ieeexplore.ieee.org/document/10820808
WOSCitedRecordID wos001451792300048&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LSwMxEA5aPHhS6Ypv9uA1us88jlJc9GBZULG3kkxmQSi7sm77-82krXrx4C3MJcyQMPNl8n3D2LVKlFHaFFwJ9ABFOME1lIZrgRmW6ACgCcMm5HSqZjNdb8jqgQuDiOHzGd7QMvTyXQdLeirzN9znK0XU3l0pxZqstT081N4jta6NslCa6NvnyRuJkSceBWakkZ2Q1uevGSohhVQH_9z8kEU_ZLy4_k4zR2wH2zEbP9WPZA1oOa66Pr5bLCL2Wt2_TB74ZsABN77SGHhTptI2aWbKTPk8aq02xhe7qI0onLfKHHw1ozPjQRVAAdQDFBrzwioBqXP5MRu1XYsnLE4dkXALgNL6Cgi0Uh4qgExsk2hrbHbKInJp_rHWsJhvvTn7w37O9ilqxLpL5QUbDf0SL9kerIb3z_4qRP4Lu72Bpw
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NSwMxEB2kCnpS6Yrf7sHr6u52N5scpVhabMuCFXsryWQWhNKWtfX3m4lb9eLBW5hLmHww8zJ5bwBuZSy1VDqLpCAHUIQVkcJcR0pQSjlZRKx8s4liPJbTqSobsrrnwhCR_3xGdzz0tXy7xA0_lbkb7uKVZGrvLrfOauha2-PDBT7W62q0hZJY3T93X1mOPHY4MGWV7JjVPn91UfFBpHf4z-mPIPih44Xld6A5hh1atKE9Kgds9Xg57C3r8GE-D-Cl9zjp9qOmxUGkXa6xjqo8KUyVpDpPpYukxiitXbpLSovMOmvRQZfPqFQ7WIWYIVcBhaJOZqTAxNrOCbQWywWdQphYpuFmiLlxORAqKR1YwCI2VayMNukZBOzSbPWlYjHbenP-h_0G9vuT0XA2HIyfLuCAV5A5eElxCa11vaEr2MOP9dt7fe134RO3sYTw
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=SC24-W%3A+Workshops+of+the+International+Conference+for+High+Performance+Computing%2C+Networking%2C+Storage+and+Analysis&rft.atitle=MPI+Progress+For+All&rft.au=Zhou%2C+Hui&rft.au=Latham%2C+Robert&rft.au=Raffenetti%2C+Ken&rft.au=Guo%2C+Yanfei&rft.date=2024-11-17&rft.pub=IEEE&rft.spage=425&rft.epage=435&rft_id=info:doi/10.1109%2FSCW63240.2024.00063&rft.externalDocID=10820808