PRT: An Efficient Pipeline Reuse Technology for Large Models Training

The rapid evolution of large models and the widespread application of extensive datasets have made the cost of training increasingly prohibitive. While pipeline model parallelism makes it possible to train large models, existing pipeline techniques find it difficult to reduce bubble time due to thei...

Celý popis

Podrobná bibliografia

Vydané v:	Proceedings / IEEE International Conference on Cluster Computing s. 1 - 11
Hlavní autori:	Ji, Zeyu, Zhai, Banghao, Zhang, Zhonghao, Chu, Qi, Liu, Bin
Médium:	Konferenčný príspevok..
Jazyk:	English
Vydavateľské údaje:	IEEE 02.09.2025
Predmet:	Bidirectional control Computational modeling Distributed training Encoding Memory management Parallel processing Pipeline Model Parallelism Pipeline Reuse Technology Pipelines Resource management Servers Throughput Training
ISSN:	2168-9253
On-line prístup:	Získať plný text
Tagy:	Pridať tag Žiadne tagy, Buďte prvý, kto otaguje tento záznam!