A Comprehensive Survey on Coded Distributed Computing: Fundamentals, Challenges, and Networking Applications

Distributed computing has become a common approach for large-scale computation tasks due to benefits such as high reliability, scalability, computation speed, and cost-effectiveness. However, distributed computing faces critical issues related to communication load and straggler effects. In particul...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:IEEE Communications surveys and tutorials Ročník 23; číslo 3; s. 1800 - 1837
Hlavní autoři: Ng, Jer Shyuan, Lim, Wei Yang Bryan, Luong, Nguyen Cong, Xiong, Zehui, Asheralieva, Alia, Niyato, Dusit, Leung, Cyril, Miao, Chunyan
Médium: Journal Article
Jazyk:angličtina
Vydáno: IEEE 01.01.2021
Témata:
coded distributed computing
communication minimization
Distributed computing
Encoding
Internet of Things
Privacy
Resource management
Security
straggler effects mitigation
Task analysis
ISSN:2373-745X
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Distributed computing has become a common approach for large-scale computation tasks due to benefits such as high reliability, scalability, computation speed, and cost-effectiveness. However, distributed computing faces critical issues related to communication load and straggler effects. In particular, computing nodes need to exchange intermediate results with each other in order to calculate the final result, and this significantly increases communication overheads. Furthermore, a distributed computing network may include straggling nodes that run intermittently slower. This results in a longer overall time needed to execute the computation tasks, thereby limiting the performance of distributed computing. To address these issues, coded distributed computing (CDC), i.e., a combination of coding theoretic techniques and distributed computing, has been recently proposed as a promising solution. Coding theoretic techniques have proved effective in WiFi and cellular systems to deal with channel noise. Therefore, CDC may significantly reduce communication load, alleviate the effects of stragglers, provide fault-tolerance, privacy and security. In this survey, we first introduce the fundamentals of CDC, followed by basic CDC schemes. Then, we review and analyze a number of CDC approaches proposed to reduce the communication costs, mitigate the straggler effects, and guarantee privacy and security. Furthermore, we present and discuss applications of CDC in modern computer networks. Finally, we highlight important challenges and promising research directions related to CDC.
ISSN:2373-745X
DOI:10.1109/COMST.2021.3091684