Fault tolerance in distributed systems using deep learning approaches.

Uloženo v:
Podrobná bibliografie
Název: Fault tolerance in distributed systems using deep learning approaches.
Autoři: Assiri, Basem, Sheneamer, Abdullah
Zdroj: PLoS ONE; 1/7/2025, Vol. 20 Issue 1, p1-24, 24p
Témata: FAULT tolerance (Engineering), SYSTEM failures, INTERNET of things, BLOCKCHAINS, DEEP learning, CLASSIFICATION
Abstrakt: Recently, distributed systems have become the backbone of technological development. It serves as the foundation for new trends technologies such as blockchain, the internet of things and others. A distributed system provides fault tolerance and decentralization, where a fault in any component does not result in a whole system failure. In addition, deep learning model enables processing data to find patterns, which helps in classification, regression, prediction, and clustering. This work employs deep learning to handle faults within distributed systems in three scenarios. Firstly, a faulty processor may not be able to produce the right output. Therefore, deep learning model uses the inputs and outputs of other processors to find patterns and produces the proper output of the faulty processor. Secondly, if a faulty possessor corrupts its inputs as well, then the deep learning model learns from the inputs and the outputs of successful processors and produces the proper output of the faulty processor, even with corrupted inputs. Thirdly, for unrelated data, in which the patterns of the input of the faulty processors differ from the patterns of the inputs of successful ones. In this case, the model is able to discover the new pattern and to be labeled as unknown. In the experiments, we use deep learning models like VGG16, VGG19, AlexNet LSTM and ResNet34, to investigate the performance of the deep learning in the three mentioned scenarios. For unstructured datasets, the accuracy of the models is affected by the size of the faulty data. The accuracy of all models lies between 60% when the size of the faulty data is 90%, and 96%, when the size of the faulty data is 90%. The structured datasets are not significantly affected by the portion of the faulty data and the accuracy reaches 99%. [ABSTRACT FROM AUTHOR]
Copyright of PLoS ONE is the property of Public Library of Science and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Databáze: Complementary Index
Popis
Abstrakt:Recently, distributed systems have become the backbone of technological development. It serves as the foundation for new trends technologies such as blockchain, the internet of things and others. A distributed system provides fault tolerance and decentralization, where a fault in any component does not result in a whole system failure. In addition, deep learning model enables processing data to find patterns, which helps in classification, regression, prediction, and clustering. This work employs deep learning to handle faults within distributed systems in three scenarios. Firstly, a faulty processor may not be able to produce the right output. Therefore, deep learning model uses the inputs and outputs of other processors to find patterns and produces the proper output of the faulty processor. Secondly, if a faulty possessor corrupts its inputs as well, then the deep learning model learns from the inputs and the outputs of successful processors and produces the proper output of the faulty processor, even with corrupted inputs. Thirdly, for unrelated data, in which the patterns of the input of the faulty processors differ from the patterns of the inputs of successful ones. In this case, the model is able to discover the new pattern and to be labeled as unknown. In the experiments, we use deep learning models like VGG16, VGG19, AlexNet LSTM and ResNet34, to investigate the performance of the deep learning in the three mentioned scenarios. For unstructured datasets, the accuracy of the models is affected by the size of the faulty data. The accuracy of all models lies between 60% when the size of the faulty data is 90%, and 96%, when the size of the faulty data is 90%. The structured datasets are not significantly affected by the portion of the faulty data and the accuracy reaches 99%. [ABSTRACT FROM AUTHOR]
ISSN:19326203
DOI:10.1371/journal.pone.0310657