Group-Wise Coding for Coded Distributed Computing Systems with Group Heterogeneity and Communication Delay

In distributed computing, coding techniques are shown to be an effective solution for mitigating the impact of stragglers. However, previous research on coding has predominantly focused on homogeneous worker environments, overlooking the fact that real-world systems often consist of heterogeneous wo...

Full description

Saved in:
Bibliographic Details
Published in:International Conference on Ubiquitous and Future Networks (Online) pp. 454 - 459
Main Authors: Ardakani, Maryam Haghighi, Ardakani, Masoud, Tellambura, Chintha
Format: Conference Proceeding
Language:English
Published: IEEE 02.07.2024
Subjects:
Codes
Decoding
Delays
Distributed computing
Encoding
Resource management
ISSN:2165-8536
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In distributed computing, coding techniques are shown to be an effective solution for mitigating the impact of stragglers. However, previous research on coding has predominantly focused on homogeneous worker environments, overlooking the fact that real-world systems often consist of heterogeneous workers with varying computing and communication capabilities. Specifically, uniform load allocation, without considering worker heterogeneity, can result in substantial latency losses. In this paper, we propose a load allocation strategy designed for distributed systems with group heterogeneity, where workers in the same group have similar computing and communication capabilities, but workers of different groups do not. By exploring group-wise MDS codes, we determine the optimal code dimension and optimal computation loads for individual groups. Our proposed approach demonstrates comparable computation times to existing methods, while exhibiting the advantage of much shorter encoding and decoding times.
ISSN:2165-8536
DOI:10.1109/ICUFN61752.2024.10625058