Group-Wise Coding for Coded Distributed Computing Systems with Group Heterogeneity and Communication Delay

In distributed computing, coding techniques are shown to be an effective solution for mitigating the impact of stragglers. However, previous research on coding has predominantly focused on homogeneous worker environments, overlooking the fact that real-world systems often consist of heterogeneous wo...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:International Conference on Ubiquitous and Future Networks (Online) s. 454 - 459
Hlavní autoři: Ardakani, Maryam Haghighi, Ardakani, Masoud, Tellambura, Chintha
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 02.07.2024
Témata:
Codes
Decoding
Delays
Distributed computing
Encoding
Resource management
ISSN:2165-8536
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:In distributed computing, coding techniques are shown to be an effective solution for mitigating the impact of stragglers. However, previous research on coding has predominantly focused on homogeneous worker environments, overlooking the fact that real-world systems often consist of heterogeneous workers with varying computing and communication capabilities. Specifically, uniform load allocation, without considering worker heterogeneity, can result in substantial latency losses. In this paper, we propose a load allocation strategy designed for distributed systems with group heterogeneity, where workers in the same group have similar computing and communication capabilities, but workers of different groups do not. By exploring group-wise MDS codes, we determine the optimal code dimension and optimal computation loads for individual groups. Our proposed approach demonstrates comparable computation times to existing methods, while exhibiting the advantage of much shorter encoding and decoding times.
ISSN:2165-8536
DOI:10.1109/ICUFN61752.2024.10625058