Communication-efficient ADMM-based distributed algorithms for sparse training

In large-scale distributed machine learning (DML), the synchronization efficiency of the distributed algorithm becomes a critical factor that affects the training time of machine learning models as the computing scale increases. To address this challenge, we propose a novel algorithm called Grouped...

Full description

Bibliographic Details

Published in:	Neurocomputing (Amsterdam) Vol. 550; p. 126456
Main Authors:	Wang, Guozheng, Lei, Yongmei, Qiu, Yongwen, Lou, Lingfei, Li, Yixin
Format:	Journal Article
Language:	English
Published:	Elsevier B.V 14.09.2023
Subjects:	ADMM Grouped Sparse AllReduce Synchronization algorithm Two-dimensional torus topology Two-dimensional torus topology Synchronization algorithm Grouped Sparse AllReduce ADMM
ISSN:	0925-2312, 1872-8286
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!