Federated learning based on asynchronous and adjusted client training

Machine learning in small-scale unmanned aerial vehicle (UAV) deployment fails to accomplish complex missions of swarm intelligence. Federated learning (FL) tackles it by being able to handle large-scale learning, while keeping data private. The client data distribution involved in FL is often non-i...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Physical communication Ročník 61; s. 102164
Hlavní autoři: Dai, Mingjun, Zhao, Yinglin, Yuan, Jialong, Kianoush, Sanaz, Savazzi, Stefano, Li, Bingchun
Médium: Journal Article
Jazyk:angličtina
Vydáno: Elsevier B.V 01.12.2023
Témata:
Asynchronous algorithm
Client training adjustment
Federated learning
Imbalance
Non-IID
Client training adjustment
Federated learning
Imbalance
Asynchronous algorithm
Non-IID
ISSN:1874-4907, 1876-3219
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Machine learning in small-scale unmanned aerial vehicle (UAV) deployment fails to accomplish complex missions of swarm intelligence. Federated learning (FL) tackles it by being able to handle large-scale learning, while keeping data private. The client data distribution involved in FL is often non-independent and identically distributed (Non-IID) and the amount of data is unbalanced. This may seriously affect the model’s convergence speed, and may even lead to nonconvergence. To tackle the above problems, we propose a new asynchronous FL scheme that combines adjusting client training. The scheme determines the weight of aggregation based on the staleness of client model parameters and the amount of data owned by the client, and dynamically adjusts the local training of each client using average training loss. Experiments on public datasets verify the effectiveness of our method, which can alleviate the impact of data Non-IID and data imbalance in asynchronous FL and accelerate the training of FL.
ISSN:1874-4907
1876-3219
DOI:10.1016/j.phycom.2023.102164