2D-THA-ADMM: communication efficient distributed ADMM algorithm framework based on two-dimensional torus hierarchical AllReduce

Model synchronization refers to the communication process involved in large-scale distributed machine learning tasks. As the cluster scales up, the synchronization of model parameters becomes a challenging task that has to be coordinated among thousands of workers. Firstly, this study proposes a h i...

Celý popis

Podrobná bibliografie

Vydáno v:	International journal of machine learning and cybernetics Ročník 15; číslo 2; s. 207 - 226
Hlavní autoři:	Wang, Guozheng, Lei, Yongmei, Zhang, Zeyu, Peng, Cunlu
Médium:	Journal Article
Jazyk:	angličtina
Vydáno:	Berlin/Heidelberg Springer Berlin Heidelberg 01.02.2024
Témata:	Artificial Intelligence Complex Systems Computational Intelligence Control Engineering Mechatronics Original Article Pattern Recognition Robotics Systems Biology Hierarchical AllReduce Two-dimensional torus Synchronization algorithm ADMM
ISSN:	1868-8071, 1868-808X
On-line přístup:	Získat plný text
Tagy:	Přidat tag Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!