A Comprehensive Survey on Coded Distributed Computing: Fundamentals, Challenges, and Networking Applications

Distributed computing has become a common approach for large-scale computation tasks due to benefits such as high reliability, scalability, computation speed, and cost-effectiveness. However, distributed computing faces critical issues related to communication load and straggler effects. In particul...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE Communications surveys and tutorials Jg. 23; H. 3; S. 1800 - 1837
Hauptverfasser: Ng, Jer Shyuan, Lim, Wei Yang Bryan, Luong, Nguyen Cong, Xiong, Zehui, Asheralieva, Alia, Niyato, Dusit, Leung, Cyril, Miao, Chunyan
Format: Journal Article
Sprache:Englisch
Veröffentlicht: IEEE 01.01.2021
Schlagworte:
coded distributed computing
communication minimization
Distributed computing
Encoding
Internet of Things
Privacy
Resource management
Security
straggler effects mitigation
Task analysis
ISSN:2373-745X
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract Distributed computing has become a common approach for large-scale computation tasks due to benefits such as high reliability, scalability, computation speed, and cost-effectiveness. However, distributed computing faces critical issues related to communication load and straggler effects. In particular, computing nodes need to exchange intermediate results with each other in order to calculate the final result, and this significantly increases communication overheads. Furthermore, a distributed computing network may include straggling nodes that run intermittently slower. This results in a longer overall time needed to execute the computation tasks, thereby limiting the performance of distributed computing. To address these issues, coded distributed computing (CDC), i.e., a combination of coding theoretic techniques and distributed computing, has been recently proposed as a promising solution. Coding theoretic techniques have proved effective in WiFi and cellular systems to deal with channel noise. Therefore, CDC may significantly reduce communication load, alleviate the effects of stragglers, provide fault-tolerance, privacy and security. In this survey, we first introduce the fundamentals of CDC, followed by basic CDC schemes. Then, we review and analyze a number of CDC approaches proposed to reduce the communication costs, mitigate the straggler effects, and guarantee privacy and security. Furthermore, we present and discuss applications of CDC in modern computer networks. Finally, we highlight important challenges and promising research directions related to CDC.
AbstractList Distributed computing has become a common approach for large-scale computation tasks due to benefits such as high reliability, scalability, computation speed, and cost-effectiveness. However, distributed computing faces critical issues related to communication load and straggler effects. In particular, computing nodes need to exchange intermediate results with each other in order to calculate the final result, and this significantly increases communication overheads. Furthermore, a distributed computing network may include straggling nodes that run intermittently slower. This results in a longer overall time needed to execute the computation tasks, thereby limiting the performance of distributed computing. To address these issues, coded distributed computing (CDC), i.e., a combination of coding theoretic techniques and distributed computing, has been recently proposed as a promising solution. Coding theoretic techniques have proved effective in WiFi and cellular systems to deal with channel noise. Therefore, CDC may significantly reduce communication load, alleviate the effects of stragglers, provide fault-tolerance, privacy and security. In this survey, we first introduce the fundamentals of CDC, followed by basic CDC schemes. Then, we review and analyze a number of CDC approaches proposed to reduce the communication costs, mitigate the straggler effects, and guarantee privacy and security. Furthermore, we present and discuss applications of CDC in modern computer networks. Finally, we highlight important challenges and promising research directions related to CDC.
Author Xiong, Zehui
Asheralieva, Alia
Ng, Jer Shyuan
Miao, Chunyan
Luong, Nguyen Cong
Niyato, Dusit
Leung, Cyril
Lim, Wei Yang Bryan
Author_xml – sequence: 1
  givenname: Jer Shyuan
  orcidid: 0000-0003-2772-8977
  surname: Ng
  fullname: Ng, Jer Shyuan
  email: s190068@e.ntu.edu.sg
  organization: Alibaba Group and Alibaba-NTU Joint Research Institute, Nanyang Technological University, Singapore
– sequence: 2
  givenname: Wei Yang Bryan
  orcidid: 0000-0003-2150-5561
  surname: Lim
  fullname: Lim, Wei Yang Bryan
  email: limw0201@e.ntu.edu.sg
  organization: Alibaba Group and Alibaba-NTU Joint Research Institute, Nanyang Technological University, Singapore
– sequence: 3
  givenname: Nguyen Cong
  orcidid: 0000-0002-4299-3456
  surname: Luong
  fullname: Luong, Nguyen Cong
  email: luong.nguyencong@phenikaa-uni.edu.vn
  organization: Faculty of Computer Science and PHENIKAA Research and Technology Institute, PHENIKAA University, Hanoi, Vietnam
– sequence: 4
  givenname: Zehui
  orcidid: 0000-0002-4440-941X
  surname: Xiong
  fullname: Xiong, Zehui
  email: zehui_xiong@sutd.edu.sg
  organization: Pillar of Information Systems Technology and Design, Singapore University of Technology Design, Singapore
– sequence: 5
  givenname: Alia
  orcidid: 0000-0002-4430-5928
  surname: Asheralieva
  fullname: Asheralieva, Alia
  email: aasheralieva@gmail.com
  organization: Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, China
– sequence: 6
  givenname: Dusit
  orcidid: 0000-0002-7442-7416
  surname: Niyato
  fullname: Niyato, Dusit
  email: dniyato@ntu.edu.sg
  organization: School of Computer Science and Engineering, Nanyang Technological University, Singapore
– sequence: 7
  givenname: Cyril
  orcidid: 0000-0001-9911-2069
  surname: Leung
  fullname: Leung, Cyril
  email: cleung@ece.ubc.ca
  organization: Department of Electrical and Computer Engineering and Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY), The University of British Columbia, Vancouver, BC, Canada
– sequence: 8
  givenname: Chunyan
  orcidid: 0000-0002-0300-3448
  surname: Miao
  fullname: Miao, Chunyan
  email: ascymiao@ntu.edu.sg
  organization: Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY) and the School of Computer Science and Engineering, Nanyang Technological University, Singapore
BookMark eNotjN9OwjAcRhujiYC-gN70ARz272i9IxPUBOUCTLwjHf0VqqNbtg7D21ujV-fLyck3ROehDoDQDSVjSom-L5avq_WYEUbHnGiaK3GGBoxPeDYR8uMSDbvukxDBhCYDVE1xUR-aFvYQOn8EvOrbI5xwHZK3YPGj72Lryz6m_Vv20YfdA573wZoDhGiq7g4Xe1NVEHaQtgkWv0H8rtuvVOJp01R-a6KvQ3eFLlzq4fqfI_Q-n62L52yxfHoppotsy7SMmVC2VNzpkilnDJTMWSeEAUlKIq1LFmwClVQJzbVR2nEtRW6Uyy0vLR-h279fDwCbpvUH0542WuRcMMl_AL-EWlI
CitedBy_id crossref_primary_10_1109_JIOT_2022_3143229
crossref_primary_10_1109_JIOT_2022_3173912
crossref_primary_10_1109_TSP_2022_3185905
crossref_primary_10_1109_ACCESS_2024_3385230
crossref_primary_10_1108_JKM_06_2024_0687
crossref_primary_10_1109_TCOMM_2023_3326499
crossref_primary_10_1109_TIT_2024_3423710
crossref_primary_10_1186_s13677_025_00757_6
crossref_primary_10_1109_TIT_2025_3556384
crossref_primary_10_1109_TIV_2023_3290369
crossref_primary_10_3390_electronics13224403
crossref_primary_10_1109_TDSC_2025_3532850
crossref_primary_10_1109_TWC_2022_3187427
crossref_primary_10_1109_TMC_2022_3178949
crossref_primary_10_1109_JSYST_2023_3277194
crossref_primary_10_1109_IOTM_001_2300247
crossref_primary_10_1109_TWC_2024_3357857
crossref_primary_10_1016_j_jksuci_2024_102073
crossref_primary_10_1109_TIT_2024_3382257
crossref_primary_10_1109_TNET_2024_3372698
crossref_primary_10_1109_TVT_2024_3493105
crossref_primary_10_1016_j_comnet_2025_111381
crossref_primary_10_4018_IJAEIS_388736
crossref_primary_10_1109_TASC_2022_3153764
crossref_primary_10_1109_TCOMM_2023_3238373
crossref_primary_10_1109_TIFS_2025_3543123
crossref_primary_10_1109_TIT_2024_3510293
crossref_primary_10_1016_j_comnet_2025_111140
crossref_primary_10_1109_MBITS_2024_3362289
crossref_primary_10_1007_s11432_024_4408_1
crossref_primary_10_1109_TIT_2024_3392685
crossref_primary_10_1016_j_comnet_2025_111426
crossref_primary_10_1109_TIT_2024_3420222
crossref_primary_10_1007_s11227_025_07262_2
crossref_primary_10_1145_3766543
crossref_primary_10_1109_TWC_2022_3213256
crossref_primary_10_1002_dac_70146
crossref_primary_10_1109_TCOMM_2023_3275194
crossref_primary_10_1109_TC_2023_3262922
crossref_primary_10_1109_TIFS_2024_3450288
crossref_primary_10_1016_j_comnet_2022_108820
crossref_primary_10_1109_LCOMM_2021_3125800
crossref_primary_10_1109_TVT_2023_3289942
crossref_primary_10_1109_TVT_2024_3395893
crossref_primary_10_1109_TCOMM_2024_3377715
crossref_primary_10_1109_TIT_2025_3528083
crossref_primary_10_1109_TVT_2024_3409554
crossref_primary_10_1109_TVT_2022_3204839
crossref_primary_10_1109_TIT_2024_3373128
crossref_primary_10_1109_TMC_2022_3172117
crossref_primary_10_1109_TWC_2024_3453403
ContentType Journal Article
DBID 97E
RIA
RIE
DOI 10.1109/COMST.2021.3091684
DatabaseName IEEE Xplore (IEEE)
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 2373-745X
EndPage 1837
ExternalDocumentID 9463425
Genre orig-research
GrantInformation_xml – fundername: Alibaba Group through Alibaba Innovative Research (AIR) Program and Alibaba-NTU Singapore Joint Research Institute (JRI)
– fundername: Singapore University of Technology and Design; SUTD
  grantid: SRG-ISTD-2021-165
  funderid: 10.13039/501100007040
– fundername: Singapore Energy Market Authority (EMA), Energy Resilience
  grantid: NRF2017EWT-EP003-04
  funderid: 10.13039/501100001447
– fundername: Singapore Ministry of Education (MOE) Tier 1
  grantid: RG16/20
– fundername: WASP/NTU
  grantid: M4082187 (4080)
GroupedDBID 0R~
29I
2WC
4.4
5GY
5VS
6IK
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFO
ACIWK
AENEX
AETIX
AGQYO
AGSQL
AHBIQ
AIBXA
AKJIK
AKQYR
ALLEH
ALMA_UNASSIGNED_HOLDINGS
ATWAV
AZLTO
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
EBS
EJD
HZ~
IES
IFIPE
IFJZH
IPLJI
JAVBF
LAI
O9-
OCL
P2P
RIA
RIE
RNS
ID FETCH-LOGICAL-c295t-48db83f9b28faaeb2fdf44ae50b05df28feddf215184939a89f39546a8f6d3bd3
IEDL.DBID RIE
ISICitedReferencesCount 79
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000688449200013&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Aug 27 02:27:37 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 3
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c295t-48db83f9b28faaeb2fdf44ae50b05df28feddf215184939a89f39546a8f6d3bd3
ORCID 0000-0002-4430-5928
0000-0002-0300-3448
0000-0002-4440-941X
0000-0003-2772-8977
0000-0003-2150-5561
0000-0002-7442-7416
0000-0001-9911-2069
0000-0002-4299-3456
PageCount 38
ParticipantIDs ieee_primary_9463425
PublicationCentury 2000
PublicationDate 2021-01-01
PublicationDateYYYYMMDD 2021-01-01
PublicationDate_xml – month: 01
  year: 2021
  text: 2021-01-01
  day: 01
PublicationDecade 2020
PublicationTitle IEEE Communications surveys and tutorials
PublicationTitleAbbrev COMST
PublicationYear 2021
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0042490
Score 2.618968
SecondaryResourceType review_article
Snippet Distributed computing has become a common approach for large-scale computation tasks due to benefits such as high reliability, scalability, computation speed,...
SourceID ieee
SourceType Publisher
StartPage 1800
SubjectTerms coded distributed computing
communication minimization
Distributed computing
Encoding
Internet of Things
Privacy
Resource management
Security
straggler effects mitigation
Task analysis
Title A Comprehensive Survey on Coded Distributed Computing: Fundamentals, Challenges, and Networking Applications
URI https://ieeexplore.ieee.org/document/9463425
Volume 23
WOSCitedRecordID wos000688449200013&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwED61FQMMvAriLQ-MTWtiJ7HZqkLFQkFqkbpVdmwLJJRW6UPi33OOW-jAwpTTKVYkX-y7s---D-DWGBEbrWXklNMRzzIaKZrYyLteKTVnItcV2UQ2GIjxWL7WoPXTC2OtrYrPbNuL1V2-meZLf1TWkTxl-I_VoZ5laejV2uy6HNMIummKobLTe3kejjD9i-_aDF1iWqGX_tKnVN6jf_C_7x7C_jpKJN1g1iOo2eIY9rawA5vw2SV-LZf2PZSgk-GyXNkvMi1Qb6whDx4S17NZoRy4G3DcPen71o-A6D9vkd6GSwVlVRgyCFXh-Cbpbl1tn8Bb_3HUe4rW1AlRHstkEXFhtGBO6lg4pTB7dsZxrmxCNU2MQ601-EB3L7hkUgnpmEx4qoRLDdOGnUKjmBb2DEga46ZmhTAYh3PKlE6ki5XOhaFaYrB5Dk0_Y5NZQMeYrCfr4m_1Jex6o4RDjCtoLMqlvYadfLX4mJc3lUm_Abe-pTA
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LSwMxEB5qFdSDb_FtDh67bdxkt4m3Ui0V2yq0Qm8l2SQoyFa2D_DfO9lttQcvnnYYNixkNpmZZOb7AG6MEaHRWgZOOR3wep0GikY28K5XSs2ZSHRONlHv9cRwKF9KUPnphbHW5sVnturF_C7fjJOZPyqrSR4z_MfWYD3iPKRFt9Zy3-WYSNBlWwyVteZztz_ABDC8rTJ0inGOX_pLoJL7j9bu_768BzuLOJE0CsPuQ8mmB7C9gh54CB8N4ldzZt-KInTSn2Vz-0XGKeqNNeTeg-J6PiuUC_YGHHdHWr75o8D0n1RIc8mmgrJKDekVdeH4JmmsXG4fwWvrYdBsBwvyhCAJZTQNuDBaMCd1KJxSmD874zhXNqKaRsah1hp8oMMXXDKphHRMRjxWwsWGacOOoZyOU3sCJA5xW7NCGIzEOWVKR9KFSifCUC0x3DyFQz9jo88CH2O0mKyzv9XXsNkedDujzmPv6Ry2vIGKI40LKE-zmb2EjWQ-fZ9kV7l5vwF7gKh3
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Comprehensive+Survey+on+Coded+Distributed+Computing%3A+Fundamentals%2C+Challenges%2C+and+Networking+Applications&rft.jtitle=IEEE+Communications+surveys+and+tutorials&rft.au=Ng%2C+Jer+Shyuan&rft.au=Lim%2C+Wei+Yang+Bryan&rft.au=Luong%2C+Nguyen+Cong&rft.au=Xiong%2C+Zehui&rft.date=2021-01-01&rft.pub=IEEE&rft.eissn=2373-745X&rft.volume=23&rft.issue=3&rft.spage=1800&rft.epage=1837&rft_id=info:doi/10.1109%2FCOMST.2021.3091684&rft.externalDocID=9463425