Group-Wise Coding for Coded Distributed Computing Systems with Group Heterogeneity and Communication Delay

In distributed computing, coding techniques are shown to be an effective solution for mitigating the impact of stragglers. However, previous research on coding has predominantly focused on homogeneous worker environments, overlooking the fact that real-world systems often consist of heterogeneous wo...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:International Conference on Ubiquitous and Future Networks (Online) s. 454 - 459
Hlavní autori: Ardakani, Maryam Haghighi, Ardakani, Masoud, Tellambura, Chintha
Médium: Konferenčný príspevok..
Jazyk:English
Vydavateľské údaje: IEEE 02.07.2024
Predmet:
Codes
Decoding
Delays
Distributed computing
Encoding
Resource management
ISSN:2165-8536
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:In distributed computing, coding techniques are shown to be an effective solution for mitigating the impact of stragglers. However, previous research on coding has predominantly focused on homogeneous worker environments, overlooking the fact that real-world systems often consist of heterogeneous workers with varying computing and communication capabilities. Specifically, uniform load allocation, without considering worker heterogeneity, can result in substantial latency losses. In this paper, we propose a load allocation strategy designed for distributed systems with group heterogeneity, where workers in the same group have similar computing and communication capabilities, but workers of different groups do not. By exploring group-wise MDS codes, we determine the optimal code dimension and optimal computation loads for individual groups. Our proposed approach demonstrates comparable computation times to existing methods, while exhibiting the advantage of much shorter encoding and decoding times.
ISSN:2165-8536
DOI:10.1109/ICUFN61752.2024.10625058