Privacy-Preserving Federated Learning With Resource-Adaptive Compression for Edge Devices

Federated learning (FL) has gained widespread attention as a distributed machine learning (ML) technique that offers data protection when training on local devices. Unlike conventional centralized training in traditional ML, FL incorporates privacy and security measures as it does not share raw data...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:IEEE internet of things journal Ročník 11; číslo 8; s. 13180 - 13198
Hlavní autoři: Hidayat, Muhammad Ayat, Nakamura, Yugo, Arakawa, Yutaka
Médium: Journal Article
Jazyk:angličtina
Vydáno: Piscataway IEEE 15.04.2024
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Témata:
Adaptation models
Blockchain
Compression ratio
Compressive sensing
Computational modeling
Cryptography
Devices
Differential privacy
Federated learning
federated learning (FL)
Human activity recognition
Machine learning
Privacy
privacy-preserving
resource-adaptive
Security
Servers
State of the art
weight-pruning
ISSN:2327-4662, 2327-4662
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Federated learning (FL) has gained widespread attention as a distributed machine learning (ML) technique that offers data protection when training on local devices. Unlike conventional centralized training in traditional ML, FL incorporates privacy and security measures as it does not share raw data between the client and server, thereby safeguarding potentially sensitive information. However, there are still vulnerabilities in the FL field, and commonly used approaches, such as encryption and blockchain technologies, often result in significant computational and communication costs, making them impractical for devices with restricted resources. To tackle this challenge, we present a privacy-preserving FL system specifically designed for resource-constrained devices, leveraging compressive sensing and differential privacy (DP) techniques. We implemented the weight-pruning-based compressive sensing method with an adaptive compression ratio based on resource availability. In addition, we employ DP to introduce noise to the gradient before sending it to a central server for aggregation, thereby protecting the gradient's privacy. Evaluation results demonstrate that our proposed method achieves slightly better accuracy when compared to state-of-the-art methods like DP-federated averaging, DP-FedOpt, and adaptive Gaussian clipping-DP (AGC-DP) for the MNIST, Fashion-MNIST, and Human Activity Recognition data sets. Furthermore, our approach achieves this higher accuracy with a lower total communication cost and training time than the current state-of-the-art methods. Moreover, we comprehensively evaluate our method's resilience against poisoning attacks, revealing its better resistance than existing state-of-the-art approaches.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:2327-4662
2327-4662
DOI:10.1109/JIOT.2023.3347552