AdapCC: Making Collective Communication in Distributed Machine Learning Adaptive

As deep learning (DL) models continue to grow in size, there is a pressing need for distributed model learning using a large number of devices (e.g., G PU s) and servers. Collective communication among devices/servers (for gradient synchronization, intermediate data exchange, etc.) introduces signif...

Celý popis

Podrobná bibliografia

Vydané v:	Proceedings of the International Conference on Distributed Computing Systems s. 25 - 35
Hlavní autori:	Zhao, Xiaoyang, Zhang, Zhe, Wu, Chuan
Médium:	Konferenčný príspevok..
Jazyk:	English
Vydavateľské údaje:	IEEE 23.07.2024
Predmet:	collective communication distributed training Graphics processing units Libraries Performance evaluation Pressing Rendering (computer graphics) Throughput Training
ISSN:	2575-8411
On-line prístup:	Získať plný text
Tagy:	Pridať tag Žiadne tagy, Buďte prvý, kto otaguje tento záznam!