Towards Dynamic Message Passing Protocols for Stencil-Based Communication Patterns

Halo-exchange communication patterns occur in many stencil-based HPC applications such as MiniAMR, MiniGhost, and MILC. In this pattern, each process performs a mix of inter-node and intra-node transfers. Depending on the input and processor grid size, the amount of time spent in inter-node or intra...

Full description

Saved in:
Bibliographic Details
Published in:Proceedings / IEEE International Conference on Cluster Computing pp. 1 - 12
Main Authors: Suresh, Kaushik Kandadi, Ramesh, Bharath, Kuncham, Goutham Kalikrishna Reddy, Subramoni, Hari, Panda, Dhabaleswar K. DK
Format: Conference Proceeding
Language:English
Published: IEEE 02.09.2025
Subjects:
3D-stencil
Benchmark testing
Cluster computing
dynamic protocols
Libraries
Message passing
MPI
overlap
Protocols
Runtime
Switches
Three-dimensional displays
Tuning
ISSN:2168-9253
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Halo-exchange communication patterns occur in many stencil-based HPC applications such as MiniAMR, MiniGhost, and MILC. In this pattern, each process performs a mix of inter-node and intra-node transfers. Depending on the input and processor grid size, the amount of time spent in inter-node or intra-node could dominate the total communication time. Therefore, in this work, we propose a dynamic protocol for intranode and inter-node transfers that optimizes the communication time. With the proposed designs, we show up to 48% improvements over state-of-the-art libraries in 3D stencil communication benchmarks and 28% in the MiniAMR application at a scale of 2304 processes.
AbstractList Halo-exchange communication patterns occur in many stencil-based HPC applications such as MiniAMR, MiniGhost, and MILC. In this pattern, each process performs a mix of inter-node and intra-node transfers. Depending on the input and processor grid size, the amount of time spent in inter-node or intra-node could dominate the total communication time. Therefore, in this work, we propose a dynamic protocol for intranode and inter-node transfers that optimizes the communication time. With the proposed designs, we show up to 48% improvements over state-of-the-art libraries in 3D stencil communication benchmarks and 28% in the MiniAMR application at a scale of 2304 processes.
Author Panda, Dhabaleswar K. DK
Kuncham, Goutham Kalikrishna Reddy
Ramesh, Bharath
Suresh, Kaushik Kandadi
Subramoni, Hari
Author_xml – sequence: 1
  givenname: Kaushik Kandadi
  surname: Suresh
  fullname: Suresh, Kaushik Kandadi
  email: kandadisuresh.1@osu.edu
  organization: The Ohio State University,Department of Computer Science and Engineering,Columbus,USA
– sequence: 2
  givenname: Bharath
  surname: Ramesh
  fullname: Ramesh, Bharath
  email: ramesh.113@osu.edu
  organization: The Ohio State University,Department of Computer Science and Engineering,Columbus,USA
– sequence: 3
  givenname: Goutham Kalikrishna Reddy
  surname: Kuncham
  fullname: Kuncham, Goutham Kalikrishna Reddy
  email: kuncham.2@osu.edu
  organization: The Ohio State University,Department of Computer Science and Engineering,Columbus,USA
– sequence: 4
  givenname: Hari
  surname: Subramoni
  fullname: Subramoni, Hari
  email: subramoni.1@osu.edu
  organization: The Ohio State University,Department of Computer Science and Engineering,Columbus,USA
– sequence: 5
  givenname: Dhabaleswar K. DK
  surname: Panda
  fullname: Panda, Dhabaleswar K. DK
  email: panda.2@osu.edu
  organization: The Ohio State University,Department of Computer Science and Engineering,Columbus,USA
BookMark eNo1kF1LwzAYhaMouM39Ay-C9535bJJLrfMDKo6tXo-YvhmRNpGmIvv3FtSrAwfOA8-Zo7OYIiB0TcmKUmJuqvpt16y30nDBVowwOdVUl0KRE7Q0ymjOqeSEGn2KZoyWujBM8gs0z_mDEK44KWdo26RvO7QZ3x-j7YPDL5CzPQDe2JxDPODNkMbkUpexTwPejRBd6Io7m6HFVer7rxicHUOK02IcYYj5Ep1722VY_uUCNQ_rpnoq6tfH5-q2LoLhY0Flq5XyTiihlRfEaaZaw9r30gkLnnHGvZDKe5gEmVPCgJj0WsqcFNxKvkBXv9gAAPvPIfR2OO7_L-A_0LVT2A
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/CLUSTER59342.2025.11186470
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Xplore (IEEE/IET Electronic Library - IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISBN 9798331530198
EISSN 2168-9253
EndPage 12
ExternalDocumentID 11186470
Genre orig-research
GrantInformation_xml – fundername: NSF
  grantid: 2311830,2312927,2323116,2415201,2504944
  funderid: 10.13039/100000001
GroupedDBID 6IE
6IF
6IH
6IK
6IL
6IN
AAJGR
AAWTH
ABLEC
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
IPLJI
OCL
RIE
RIL
RNS
ID FETCH-LOGICAL-i93t-15d877fc47487f40c827d92db6c4aef2323f457ffe5932c749e4118d12c543a53
IEDL.DBID RIE
IngestDate Wed Oct 15 14:21:20 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i93t-15d877fc47487f40c827d92db6c4aef2323f457ffe5932c749e4118d12c543a53
PageCount 12
ParticipantIDs ieee_primary_11186470
PublicationCentury 2000
PublicationDate 2025-Sept.-2
PublicationDateYYYYMMDD 2025-09-02
PublicationDate_xml – month: 09
  year: 2025
  text: 2025-Sept.-2
  day: 02
PublicationDecade 2020
PublicationTitle Proceedings / IEEE International Conference on Cluster Computing
PublicationTitleAbbrev CLUSTER
PublicationYear 2025
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0037306
Score 2.3020148
Snippet Halo-exchange communication patterns occur in many stencil-based HPC applications such as MiniAMR, MiniGhost, and MILC. In this pattern, each process performs...
SourceID ieee
SourceType Publisher
StartPage 1
SubjectTerms 3D-stencil
Benchmark testing
Cluster computing
dynamic protocols
Libraries
Message passing
MPI
overlap
Protocols
Runtime
Switches
Three-dimensional displays
Tuning
Title Towards Dynamic Message Passing Protocols for Stencil-Based Communication Patterns
URI https://ieeexplore.ieee.org/document/11186470
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV09T8MwELWgYmAqH0VQPuSB1W0T23G8UqgYSlXRInWrEvuMKqEUNSm_n7ObgDowsFmRLorv4txzfO8eIfdRZqwBFTEQuWVCcmDaZjkDIwwXxmbOhT6zYzWZpIuFntZk9cCFAYBQfAY9Pwxn-XZttv5XWR_XZZoIhTv0Q6WSHVmr-exyfFWTuqtoNND94fhthoBQai483yqWvcZ6T0clpJFR-58PcEI6v4Q8Ov1JNafkAIoz0m4UGWi9QM_J6zxUwZb0cSc0T1-8wsk7GiNGRkt_k2qNsS8pglU684B59cEeMJVZuscVQQvP8ynKDpmPnubDZ1arJrCV5hWLpE2VckYo3Io4MTBprKyObZ4YkYFDAMWdkMo5QNfERgkNAmdlo9hIwTPJL0irWBdwSagHS1rneZRoiZM2WvhjQRxLrvOYJ1ek4120_Nz1xVg23un-cf2aHPtAhAqt-Ia0qs0WbsmR-apW5eYuRPMbB4mg2g
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwELYQIMFUHkW88cDqtontOF4pVEWkVUWD1K1K_ECVUIqalN_P2U1AHRjYrEgXxXdx7nN8330I3QeZ0sqIgBiWa8I4NUTqLCdGMUWZ0pm1vs9sIsbjeDaTk5qs7rkwxhhffGY6bujP8vVSrd2vsi6syzhiAnboe5yxsLehazUfXgova1T3FQ16sttP3qYACbmkzDGuQt5p7LeUVHwiGbT--QhHqP1LycOTn2RzjHZMcYJajSYDrpfoKXpNfR1siR83UvN45DRO3sEYUDJYuptUS4h-iQGu4qmDzIsP8gDJTOMttghYOKZPUbZROnhK-0NS6yaQhaQVCbiOhbCKCdiMWNZTcSi0DHUeKZYZCxCKWsaFtQZcEyrBpGEwKx2EijOacXqGdotlYc4RdnBJyjwPIslh0koydzAIY05lHtLoArWdi-afm84Y88Y7l39cv0MHw3SUzJPn8csVOnRB8fVa4TXarVZrc4P21Ve1KFe3PrLfl0ekIQ
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=Proceedings+%2F+IEEE+International+Conference+on+Cluster+Computing&rft.atitle=Towards+Dynamic+Message+Passing+Protocols+for+Stencil-Based+Communication+Patterns&rft.au=Suresh%2C+Kaushik+Kandadi&rft.au=Ramesh%2C+Bharath&rft.au=Kuncham%2C+Goutham+Kalikrishna+Reddy&rft.au=Subramoni%2C+Hari&rft.date=2025-09-02&rft.pub=IEEE&rft.eissn=2168-9253&rft.spage=1&rft.epage=12&rft_id=info:doi/10.1109%2FCLUSTER59342.2025.11186470&rft.externalDocID=11186470