An Improved Convergence Analysis for Decentralized Online Stochastic Non-Convex Optimization

In this paper, we study decentralized online stochastic non-convex optimization over a network of nodes. Integrating a technique called gradient tracking in decentralized stochastic gradient descent, we show that the resulting algorithm, GT-DSGD , enjoys certain desirable characteristics towards min...

Full description

Saved in:

Bibliographic Details
Published in:	IEEE transactions on signal processing Vol. 69; pp. 1842 - 1858
Main Authors:	Xin, Ran, Khan, Usman A., Kar, Soummya
Format:	Journal Article
Language:	English
Published:	New York IEEE 2021 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:	Algorithms Asymptotic properties Computational geometry Convergence Convex analysis Convexity Decentralized optimization Linear programming multi-agent systems non-convex problems Optimization Signal processing algorithms Steady-state stochastic gradient methods Stochastic processes Transient analysis
ISSN:	1053-587X, 1941-0476
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!