Multiple Parallel Federated Learning via Over-the-Air Computation

This paper investigates multiple parallel federated learning in cellular networks, where a base station schedules several FL tasks in parallel and each task has a group of devices involved. To reduce the communication overhead, over-the-air computation is introduced by utilizing the superposition pr...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:IEEE open journal of the Communications Society Ročník 3; s. 1252 - 1264
Hlavní autori: Shi, Gaoxin, Guo, Shuaishuai, Ye, Jia, Saeed, Nasir, Dang, Shuping
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: New York IEEE 2022
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Predmet:
Cellular communication
Collaborative work
Computation
Computational modeling
Convergence
Decoupling
Device selection
Federated learning
Greedy algorithms
Impact analysis
multiple access channel
Optimization
over-the-air computation
Performance evaluation
Radio equipment
receiver combiner
Receivers
Servers
Superposition (mathematics)
Task analysis
Task scheduling
ISSN:2644-125X, 2644-125X
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:This paper investigates multiple parallel federated learning in cellular networks, where a base station schedules several FL tasks in parallel and each task has a group of devices involved. To reduce the communication overhead, over-the-air computation is introduced by utilizing the superposition property of multiple access channels (MAC) to accomplish the aggregation step. Since all devices use the same radio resource to transfer their local updates to the BS, in order to separate the received signals of different tasks, we use the zero-forcing receiver combiner to mitigate the mutual interference across different groups. Besides, we analyze the impact of receiver combiner and device selection on the convergence of our multiple parallel FL framework. Also, we formulate an optimization problem that jointly considers receiver combiner vector design and device selection for improving FL performance. We address the problem by decoupling it into two sub-problems and solve them alternatively, adopting successive convex approximation (SCA) to derive the receiver combiner vector, and then solve the device scheduling problem with a greedy algorithm. Simulation results demonstrate that the proposed framework can effectively solve the straggler issue in FL and achieve a near-optimal performance on all tasks.
Bibliografia:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:2644-125X
2644-125X
DOI:10.1109/OJCOMS.2022.3194821