A divide-and-conquer algorithm for distributed optimization on networks

In this paper, we consider networks with topologies described by some connected undirected graph G=(V,E) and with some agents (fusion centers) equipped with processing power and local peer-to-peer communication, and optimization problem minx⁡{F(x)=∑i∈Vfi(x)} with local objective functions fi dependi...

Full description

Saved in:

Bibliographic Details
Published in:	Applied and computational harmonic analysis Vol. 70; p. 101623
Main Authors:	Emirov, Nazar, Song, Guohui, Sun, Qiyu
Format:	Journal Article
Language:	English
Published:	Elsevier Inc 01.05.2024
Subjects:	Distributed optimization Divide-and-conquer algorithm Graph signal processing Graph signal processing Distributed optimization Divide-and-conquer algorithm
ISSN:	1063-5203, 1096-603X
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	In this paper, we consider networks with topologies described by some connected undirected graph G=(V,E) and with some agents (fusion centers) equipped with processing power and local peer-to-peer communication, and optimization problem minx⁡{F(x)=∑i∈Vfi(x)} with local objective functions fi depending only on neighboring variables of the vertex i∈V. We introduce a divide-and-conquer algorithm to solve the above optimization problem in a distributed and decentralized manner. The proposed divide-and-conquer algorithm has exponential convergence, its computational cost is almost linear with respect to the size of the network, and it can be fully implemented at fusion centers of the network. In addition, our numerical demonstrations indicate that the proposed divide-and-conquer algorithm has superior performance than popular decentralized optimization methods in solving the least squares problem, both with and without the ℓ1 penalty, and exhibits great performance on networks equipped with asynchronous local peer-to-peer communication.
ISSN:	1063-5203 1096-603X
DOI:	10.1016/j.acha.2023.101623