Distributed Adaptive Learning Under Communication Constraints

We consider a network of agents that must solve an online optimization problem from continual observation of streaming data. To this end, the agents implement a distributed cooperative strategy where each agent is allowed to perform local exchange of information with its neighbors. In order to cope...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:IEEE open journal of signal processing Ročník 5; s. 1 - 37
Hlavní autoři: Carpentiero, Marco, Matta, Vincenzo, Sayed, Ali H.
Médium: Journal Article
Jazyk:angličtina
Vydáno: New York IEEE 01.01.2024
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Témata:
adaptation and learning
Adaptive learning
Communication
Computer aided instruction
Convergence
Convexity
Cost function
Data compression
diffusion strategies
Distance learning
Distributed optimization
Exchanging
Learning
Network topologies
Operators (mathematics)
Quantization (signal)
Signal processing algorithms
Stochastic processes
stochastic quantizers
ISSN:2644-1322, 2644-1322
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:We consider a network of agents that must solve an online optimization problem from continual observation of streaming data. To this end, the agents implement a distributed cooperative strategy where each agent is allowed to perform local exchange of information with its neighbors. In order to cope with communication constraints, the exchanged information must be compressed to reduce the communication load. We propose a distributed diffusion strategy nicknamed as ACTC (Adapt-Compress-Then-Combine), which implements the following three operations: adaptation, where each agent performs an individual stochastic-gradient update; compression, which leverages a recently introduced class of stochastic compression operators; and combination, where each agent combines the compressed updates received from its neighbors. The main elements of novelty of this work are as follows: i) adaptive strategies, where constant (as opposed to diminishing) step-sizes are critical to infuse the agents with the ability of responding in real time to nonstationary variations in the observed model; ii) directed, i.e., non-symmetric combination policies, which allow us to enhance the role played by the network topology in the learning performance; iii) global strong convexity, a condition under which the individual agents might feature even non-convex cost functions. Under this demanding setting, we establish that the iterates of the ACTC strategy fluctuate around the exact global optimizer with a mean-square-deviation on the order of the step-size, achieving remarkable savings of communication resources. Comparison against up-to-date learning strategies with compressed data highlights the benefits of the proposed solution.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:2644-1322
2644-1322
DOI:10.1109/OJSP.2023.3344052