Suchergebnisse - "decentralized stochastic algorithm"

Push-SAGA: A Decentralized Stochastic Algorithm With Variance Reduction Over Directed Graphs von Qureshi, Muhammad I., Xin, Ran, Kar, Soummya, Khan, Usman A.

“… In this letter, we propose Push-SAGA, a decentralized stochastic first-order method for finite-sum minimization over a directed network of nodes. Push-SAGA …”
Volltext

A Decentralized Stochastic Algorithm for Coupled Composite Optimization With Linear Convergence von Lu, Qingguo, Liao, Xiaofeng, Deng, Shaojiang, Li, Huaqing

“… Then, a novel decentralized stochastic algorithm, named VR-DPPD, is proposed, which combines the variance-reduction technique of SAGA …”
Volltext

A Computation-Efficient Decentralized Algorithm for Composite Constrained Optimization von Lu, Qingguo, Liao, Xiaofeng, Li, Huaqing, Huang, Tingwen

“… This paper focuses on solving the problem of composite constrained convex optimization with a sum of smooth convex functions and non-smooth regularization …”
Volltext

Push-SAGA: A decentralized stochastic algorithm with variance reduction over directed graphs von Qureshi, Muhammad I, Xin, Ran, Kar, Soummya, Khan, Usman A

“… In this paper, we propose Push-SAGA, a decentralized stochastic first-order method for finite-sum minimization over a directed network of nodes. Push-SAGA …”
Volltext

PMGT-VR: a Decentralized Proximal-gradient Algorithmic Framework with Variance Reduction von Ye, Haishan, Xiong, Wei, Zhang, Tong

“… To the best of our knowledge, PMGT-VR is the first linearly convergent decentralized stochastic algorithm that can solve decentralized composite optimization problems …”
Volltext

Decentralized Stochastic Non-Convex Optimization over Weakly Connected Time-Varying Digraphs von Lu, Songtao, Wu, Chai Wah

“… By leveraging the perturbed push sum protocol and gradient tracking techniques, we propose a decentralized stochastic algorithm that is able to converge to the first-order stationary points of non …”
Volltext

PMGT-VR: A decentralized proximal-gradient algorithmic framework with variance reduction von Ye, Haishan, Xiong, Wei, Zhang, Tong

“… This paper considers the decentralized composite optimization problem. We propose a novel decentralized variance-reduction proximal-gradient algorithmic …”
Volltext

Improving the Sample and Communication Complexity for Decentralized Non-Convex Optimization: A Joint Gradient Estimation and Tracking Approach von Sun, Haoran, Lu, Songtao, Hong, Mingyi

“… non-convex problems, such as training deep neural networks. In this work, we propose a decentralized stochastic algorithm to deal with certain smooth non-convex problems where there are …”
Volltext

A near-optimal algorithm for network-constrained averaging with noisy links von Noorshams, Nima, Wainwright, Martin J

“… We propose a two-phase decentralized stochastic algorithm, and we use stochastic approximation methods to analyze how the number of iterations required to achieve mean-squared error d scales …”
Volltext

Dual-Free Stochastic Decentralized Optimization with Variance Reduction von Hendrikx, Hadrien, Bach, Francis, Massoulié, Laurent

“… Yet, existing decentralized stochastic algorithms either do not obtain the full speedup allowed by stochastic updates, or require oracles that are more expensive than regular gradients …”
Volltext

Understanding the Influence of Digraphs on Decentralized Optimization: Effective Metrics, Lower Bound, and Optimal Algorithm von Liang, Liyuan, Huang, Xinmeng, Xin, Ran, Yuan, Kun

“… the influence of column-stochastic mixing matrices on decentralized stochastic algorithms. With these two metrics, we clarify, for the first time, how the directed network …”
Volltext