Exploring Approximate Communication Using Lossy Bitwise Compression on Interconnection Networks

The use of approximate communication has emerged as a promising approach for enhancing the efficiency of communication in parallel computer systems. By sending incomplete or imprecise messages, approximate communication can significantly reduce communication time. In this study, we examine applicati...

Celý popis

Uložené v:

Podrobná bibliografia
Vydané v:	IEEE access Ročník 11; s. 1
Hlavný autor:	Hu, Yao
Médium:	Journal Article
Jazyk:	English
Vydavateľské údaje:	Piscataway IEEE 01.01.2023 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Predmet:	approximate communication Communication Compression algorithms Data compression Data models Error correction Fault tolerance Floating point arithmetic Image coding Interconnection network lossy compression message passing interface (MPI) Multiprocessor interconnection Parallel computers parallel computing Parallel programming Prediction algorithms Predictive models
ISSN:	2169-3536, 2169-3536
On-line prístup:	Získať plný text
Tagy:	Pridať tag Žiadne tagy, Buďte prvý, kto otaguje tento záznam!

Abstract	The use of approximate communication has emerged as a promising approach for enhancing the efficiency of communication in parallel computer systems. By sending incomplete or imprecise messages, approximate communication can significantly reduce communication time. In this study, we examine application-level techniques for approximate communication to enable high portability on high-performance interconnection networks. Specifically, we focus on lossy compression of floating-point data, which is frequently exchanged between compute nodes in parallel applications. Our approach involves a simple application scenario where a source process compresses a communication dataset and a destination process decompresses it in an MPI parallel program. We use two bitwise procedures for compression: lossy bit-zip compression and lossless bit-mask compression. Our aim is to transmit the largest possible amount of approximate data with the least possible compression overhead. Additionally, we explore error check and correction techniques to ensure bit-flip fault tolerance for the compressed data during transmission. We implement our scheme in several communication-intensive MPI applications and demonstrate that our approximate communication approach effectively speeds up total execution time while staying within a specified quality-of-result error bound .
AbstractList	The use of approximate communication has emerged as a promising approach for enhancing the efficiency of communication in parallel computer systems. By sending incomplete or imprecise messages, approximate communication can significantly reduce communication time. In this study, we examine application-level techniques for approximate communication to enable high portability on high-performance interconnection networks. Specifically, we focus on lossy compression of floating-point data, which is frequently exchanged between compute nodes in parallel applications. Our approach involves a simple application scenario where a source process compresses a communication dataset and a destination process decompresses it in an MPI parallel program. We use two bitwise procedures for compression: lossy bit-zip compression and lossless bit-mask compression. Our aim is to transmit the largest possible amount of approximate data with the least possible compression overhead. Additionally, we explore error check and correction techniques to ensure bit-flip fault tolerance for the compressed data during transmission. We implement our scheme in several communication-intensive MPI applications and demonstrate that our approximate communication approach effectively speeds up total execution time while staying within a specified quality-of-result error bound.
Author	Hu, Yao
Author_xml	– sequence: 1 givenname: Yao orcidid: 0000-0002-6358-0570 surname: Hu fullname: Hu, Yao organization: Keio University, Hiyoshi Campus West Annex 1, 2-1-1 Hiyoshihoncho, Kohoku-ku, Yokohama, Kanagawa, Japan
BookMark	eNqFUU1rGzEQFSWFJm5-QXsw5GxHn7vao7O4rcG0hzRnodWOghxb2kgySf59td4QQi4VAg0z8-Zp3rtAZz54QOgbwUtCcHO9atv17e2SYsqWjEoiGf-EzimpmgUTrDp7F39BlyntcDmypER9jtT6ediH6Pz9fDUMMTy7g84wb8PhcPTO6OyCn9-lsb4NKb3Mb1x-cunUMURIaayXu_EZognegzlBfkN-CvEhfUWfrd4nuHx9Z-jux_pv-2ux_fNz0662C8NrkReyprbHmJiqk8IK1vRMc93JjnadrlhflaW0FqLUCQEOFtuaWGt60zU1bzCboc00tw96p4ZY1ogvKminTokQ75WO2Zk9KI5tBYWCYyw45VLj2ljcAO36rq6KijN0Nc0qejweIWW1C8foy_cVlVQW8Wo6drGpy8QiTAT7xkqwGo1RkzFqNEa9GlNQzQeUcfmkco7a7f-D_T5hHQC8YyOciEawf-HCnvc
CODEN	IAECCG
CitedBy_id	crossref_primary_10_1109_ACCESS_2023_3343436
Cites_doi	10.1109/TCOM.1978.1094144 10.1016/0021-9991(84)90143-8 10.1145/3458817.3476195 10.1145/3053688 10.1109/IPCCC47392.2019.8958720 10.1007/978-3-642-24449-0_9 10.1016/j.jocs.2020.101208 10.1109/TC.2008.131 10.1109/TVCG.2014.2346458 10.1109/TBDATA.2022.3201176 10.1002/cpe.2887 10.1109/IPDPS.2015.67 10.1109/DCC.2000.838221 10.1109/MASSP.1984.1162257 10.1109/SBAC-PAD.2014.27 10.1109/DCC.2006.35 10.5121/csit.2021.110706 10.1109/ICRC.2016.7738674 10.1109/TCAD.2008.917563 10.1145/3295500.3356193 10.1109/TVCG.2006.143 10.1109/ICSCCN.2011.6024570 10.1109/BigData.2013.6691591 10.1109/SC.2018.00033 10.1016/j.jpdc.2014.06.008 10.1109/DCC.2007.44 10.1109/BigData.2018.8622520 10.1109/ISPAN.1997.645128 10.1109/BigData52589.2021.9671954
ContentType	Journal Article
Copyright	Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023
Copyright_xml	– notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023
DBID	97E ESBDL RIA RIE AAYXX CITATION 7SC 7SP 7SR 8BQ 8FD JG9 JQ2 L7M L~C L~D DOA
DOI	10.1109/ACCESS.2023.3281834
DatabaseName	IEEE All-Society Periodicals Package (ASPP) 2005–Present IEEE Xplore Open Access Journals IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Engineered Materials Abstracts METADEX Technology Research Database Materials Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional DOAJ Directory of Open Access Journals
DatabaseTitle	CrossRef Materials Research Database Engineered Materials Abstracts Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace METADEX Computer and Information Systems Abstracts Professional
DatabaseTitleList	Materials Research Database
Database_xml	– sequence: 1 dbid: DOA name: DOAJ Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: RIE name: IEEE/IET Electronic Library url: https://ieeexplore.ieee.org/ sourceTypes: Publisher
DeliveryMethod	fulltext_linktorsrc
Discipline	Engineering
EISSN	2169-3536
EndPage	1
ExternalDocumentID	oai_doaj_org_article_40f6e53940054248a07cf09e2bdb7602 10_1109_ACCESS_2023_3281834 10141595
Genre	orig-research
GrantInformation_xml	– fundername: Japan Society for the Promotion of Science grantid: 21K11859 funderid: 10.13039/501100001691
GroupedDBID	0R~ 5VS 6IK 97E AAJGR ABAZT ABVLG ACGFS ADBBV ALMA_UNASSIGNED_HOLDINGS BCNDV BEFXN BFFAM BGNUA BKEBE BPEOZ EBS ESBDL GROUPED_DOAJ IPLJI JAVBF KQ8 M43 M~E O9- OCL OK1 RIA RIE RNS 4.4 AAYXX AGSQL CITATION EJD 7SC 7SP 7SR 8BQ 8FD JG9 JQ2 L7M L~C L~D
ID	FETCH-LOGICAL-c475t-872fd001c6b85f539d3a4ab8b2bba63d6834aa55c6b11e4ef0f71ffcdcb974903
IEDL.DBID	DOA
ISICitedReferencesCount	2
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001017313800001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	2169-3536
IngestDate	Fri Oct 03 12:51:28 EDT 2025 Sun Nov 30 03:53:29 EST 2025 Sat Nov 29 04:02:42 EST 2025 Tue Nov 18 21:08:02 EST 2025 Wed Aug 27 02:56:31 EDT 2025
IsDoiOpenAccess	true
IsOpenAccess	true
IsPeerReviewed	true
IsScholarly	true
Language	English
License	https://creativecommons.org/licenses/by-nc-nd/4.0
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c475t-872fd001c6b85f539d3a4ab8b2bba63d6834aa55c6b11e4ef0f71ffcdcb974903
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14
ORCID	0000-0002-6358-0570
OpenAccessLink	https://doaj.org/article/40f6e53940054248a07cf09e2bdb7602
PQID	2828008722
PQPubID	4845423
PageCount	1
ParticipantIDs	doaj_primary_oai_doaj_org_article_40f6e53940054248a07cf09e2bdb7602 ieee_primary_10141595 crossref_primary_10_1109_ACCESS_2023_3281834 crossref_citationtrail_10_1109_ACCESS_2023_3281834 proquest_journals_2828008722
PublicationCentury	2000
PublicationDate	2023-01-01
PublicationDateYYYYMMDD	2023-01-01
PublicationDate_xml	– month: 01 year: 2023 text: 2023-01-01 day: 01
PublicationDecade	2020
PublicationPlace	Piscataway
PublicationPlace_xml	– name: Piscataway
PublicationTitle	IEEE access
PublicationTitleAbbrev	Access
PublicationYear	2023
Publisher	IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml	– name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References	ref13 ref12 ref34 ref14 ref31 ref30 ref11 ref33 ref10 ref32 (ref38) 2023 duato (ref36) 2002 ref2 ref1 ref17 (ref35) 2023 ref19 ref18 deng (ref16) 2003 (ref8) 2023 (ref37) 2023 (ref39) 2023 ref24 ref23 ref26 ref25 ref20 tomkins (ref5) 2007 ref22 cutler (ref15) 1952 ref21 (ref6) 0 ref28 ref27 (ref40) 2023 ref29 ref7 ref9 ref4 ref3
References_xml	– ident: ref10 doi: 10.1109/TCOM.1978.1094144 – ident: ref31 doi: 10.1016/0021-9991(84)90143-8 – ident: ref23 doi: 10.1145/3458817.3476195 – ident: ref4 doi: 10.1145/3053688 – year: 2023 ident: ref38 publication-title: LU Decomposition – year: 1952 ident: ref15 publication-title: Differential quantization of communication signals – year: 2023 ident: ref37 publication-title: Matrix Multiply – ident: ref3 doi: 10.1109/IPCCC47392.2019.8958720 – year: 2023 ident: ref35 publication-title: Dijkstra's Algorithm – ident: ref34 doi: 10.1007/978-3-642-24449-0_9 – ident: ref33 doi: 10.1016/j.jocs.2020.101208 – ident: ref21 doi: 10.1109/TC.2008.131 – ident: ref18 doi: 10.1109/TVCG.2014.2346458 – ident: ref24 doi: 10.1109/TBDATA.2022.3201176 – ident: ref13 doi: 10.1002/cpe.2887 – start-page: 41 year: 2003 ident: ref16 publication-title: Speech Processing A Dynamic and Optimization-Oriented Approach – ident: ref26 doi: 10.1109/IPDPS.2015.67 – ident: ref28 doi: 10.1109/DCC.2000.838221 – ident: ref11 doi: 10.1109/MASSP.1984.1162257 – year: 2002 ident: ref36 publication-title: Interconnection Networks An Engineering Approach – ident: ref14 doi: 10.1109/SBAC-PAD.2014.27 – ident: ref19 doi: 10.1109/DCC.2006.35 – ident: ref27 doi: 10.5121/csit.2021.110706 – ident: ref1 doi: 10.1109/ICRC.2016.7738674 – year: 0 ident: ref6 – year: 2023 ident: ref40 publication-title: Scientific IEEE 754 64-Bit Double-Precision Floating-Point Datasets – ident: ref29 doi: 10.1109/TCAD.2008.917563 – ident: ref25 doi: 10.1145/3295500.3356193 – year: 2023 ident: ref8 publication-title: Cyclic Redundancy Checking – ident: ref17 doi: 10.1109/TVCG.2006.143 – ident: ref12 doi: 10.1109/ICSCCN.2011.6024570 – ident: ref30 doi: 10.1109/BigData.2013.6691591 – ident: ref2 doi: 10.1109/SC.2018.00033 – ident: ref32 doi: 10.1016/j.jpdc.2014.06.008 – ident: ref20 doi: 10.1109/DCC.2007.44 – ident: ref7 doi: 10.1109/BigData.2018.8622520 – start-page: 1 year: 2007 ident: ref5 article-title: Interconnects: A buyers point of view publication-title: Proc ACS Workshop – year: 2023 ident: ref39 publication-title: K-Means Clustering A Distributed MPI Implementation – ident: ref9 doi: 10.1109/ISPAN.1997.645128 – ident: ref22 doi: 10.1109/BigData52589.2021.9671954
SSID	ssj0000816957
Score	2.2782862
Snippet	The use of approximate communication has emerged as a promising approach for enhancing the efficiency of communication in parallel computer systems. By sending...
SourceID	doaj proquest crossref ieee
SourceType	Open Website Aggregation Database Enrichment Source Index Database Publisher
StartPage	1
SubjectTerms	approximate communication Communication Compression algorithms Data compression Data models Error correction Fault tolerance Floating point arithmetic Image coding Interconnection network lossy compression message passing interface (MPI) Multiprocessor interconnection Parallel computers parallel computing Parallel programming Prediction algorithms Predictive models
SummonAdditionalLinks	– databaseName: IEEE Electronic Library (IEL) dbid: RIE link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1BT9swFH6CigM7AAOmFdjkw45LcRw7to-lWsVhqnYAiZtlO89SJVQmWhj8e2zHVCAE0qQcosRRHH-2n_3y3vcB_KDBxZ7ieBUXD7riHReV5YFWHEPQDL3DphebkLOZurrSf0qyes6FQcQcfIajdJr_5Xc3_i65yk6Trmw0v2ITNqVs-2SttUMlKUhoIQuzUE316XgyiR8xSgLhoyaxHjX8lfXJJP1FVeXNVJzty3T3P2u2BztlIUnGPfKfYQMX-_DpBb3gAZh1gB0ZJ-rwh3lcniJ5lRNCcswA-R1r-0jO5qt_82UuUeJjFyQe2WvoU0RMToIgsz50fHkIl9NfF5PzqggqVJ5LsYozHwtdtEu-dUoE0eiusdw65Zhztm26NraQtULE-3WNES4aZB2C77yL2w5Nmy8wWNws8CsQa5VTiC5Opshb4ZXEWlgdPHa1aq0aAntuaOML23gSvbg2eddBtenRMQkdU9AZws_1Q397so2Pi58lBNdFE1N2vhChMWXgGU5DiyLrvwvOuLJU-kA1Mtc52VI2hMME54v39UgO4eS5Q5gyrJcm7U8TiR9jR-88dgzbqYq9k-YEBqvbO_wGW_5-NV_efs899gktcOsl priority: 102 providerName: IEEE
Title	Exploring Approximate Communication Using Lossy Bitwise Compression on Interconnection Networks
URI	https://ieeexplore.ieee.org/document/10141595 https://www.proquest.com/docview/2828008722 https://doaj.org/article/40f6e53940054248a07cf09e2bdb7602
Volume	11
WOSCitedRecordID	wos001017313800001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVAON databaseName: DOAJ Directory of Open Access Journals customDbUrl: eissn: 2169-3536 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0000816957 issn: 2169-3536 databaseCode: DOA dateStart: 20130101 isFulltext: true titleUrlDefault: https://www.doaj.org/ providerName: Directory of Open Access Journals – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources customDbUrl: eissn: 2169-3536 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0000816957 issn: 2169-3536 databaseCode: M~E dateStart: 20130101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1LSwMxEA4iHvQgPrFaJQePrmZ3k93k2JYWD1o8KPQWkmwCBali6-vib3fyaGkR9CIse9jNkmRmdjITJt-H0DlxGixF0wyCB5HRhrJMUUcyap0ThTXalpFsoh4O-Wgk7paovnxNWIQHjoK7osRVlgX-bkYLyhWpjSPCFrrRdRVhJEktlpKp4IN5XglWJ5ihnIirTq8HM7r0bOGXpYdAKunKUhQQ-xPFyg-_HBabwQ7aTlEi7sTR7aI1O9lDW0vYgftILqrncMfjgn-MIfa0eOXABw4FAfgGev_E3fHsfTwNLVLx6wTDFbYEjS93CScc8DDWhU8P0MOgf9-7zhJbQmZozWbg1grXwKJjKs2ZA4k1paJKc11oraqyqWDGSjEG7_Pcgi6Iq3PnTGM05BSClIdoffI0sUcIK8U1t1aDp7S0YobXNmdKOGObnFeKt1AxF5w0CUrcM1o8ypBSECGjtKWXtkzSbqGLxUfPEUnj9-Zdr5FFUw-DHR6AcchkHPIv42ihA6_Ppf5yCFgEa6H2XMEy_bNT6ZNPj9BXFMf_0fcJ2vTzids1bbQ-e3m1p2jDvM3G05ezYK5wv_3qn4VDh98A2-6o
linkProvider	Directory of Open Access Journals
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NT9wwEB0VigQcWr6qbkvBB45kcRw7sY_LqoiKZcUBJG6W7YylldBSsctH_z22Y1agikqVcogSR3H8bI89mXkP4IB6G3qK5UVYPKiCt1wUhntacPReMXQWq05sohmP5fW1usjJ6ikXBhFT8Bn242n6l9_euvvoKjuKurLB_Iol-Cg4Z7RL11q4VKKGhBJN5hYqqToaDIfhM_pRIrxfRd6jir-xP4mmP-uq_DUZJwtz8vk_67YBn_JSkgw67DfhA063YP0VweA26EWIHRlE8vCnSVigInmTFUJS1AAZhdr-IceT-eNklkrkCNkpCUfyG7oYE5PSIMi4Cx6f7cDVyc_L4WmRJRUKxxsxD3Mf822wTK62UnhRqbYy3FhpmbWmrto6tJAxQoT7ZYkBMOqb0nvXOhs2HopWX2B5ejvFr0CMkVYi2jCdIq-Fkw2WwijvsC1lbWQP2EtDa5f5xqPsxY1O-w6qdIeOjujojE4PDhcP_e7oNv5d_DgiuCgaubLThQCNzkNPc-prFEkBXnDGpaGN81Qhs61tasp6sBPhfPW-Dske7L50CJ0H9kzHHWqk8WPs2zuP7cPq6eX5SI9-jc--w1qsbuey2YXl-d09_oAV9zCfzO72Uu99Bomu7mw
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Exploring+Approximate+Communication+Using+Lossy+Bitwise+Compression+on+Interconnection+Networks&rft.jtitle=IEEE+access&rft.au=Yao+Hu&rft.date=2023-01-01&rft.pub=IEEE&rft.eissn=2169-3536&rft.volume=11&rft.spage=59238&rft.epage=59249&rft_id=info:doi/10.1109%2FACCESS.2023.3281834&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_40f6e53940054248a07cf09e2bdb7602
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2169-3536&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2169-3536&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2169-3536&client=summon