An Efficient Training Accelerator for Transformers With Hardware-Algorithm Co-Optimization

Transformers have achieved significant success in deep learning, and training Transformers efficiently on resource-constrained platforms has been attracting continuous attention for domain adaptions and privacy concerns. However, deploying Transformers training on these platforms is still challengin...

Celý popis

Uloženo v:

Podrobná bibliografie
Vydáno v:	IEEE transactions on very large scale integration (VLSI) systems Ročník 31; číslo 11; s. 1788 - 1801
Hlavní autoři:	Shao, Haikuo, Lu, Jinming, Wang, Meiqi, Wang, Zhongfeng
Médium:	Journal Article
Jazyk:	angličtina
Vydáno:	New York IEEE 01.11.2023 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Témata:	Algorithm-hardware codesign Algorithms Computational modeling Computer architecture Computer memory Data models Energy efficiency general matrix multiplication (GEMM) Hardware Memory management nonlinear function Optimization Platforms Task analysis Technology assessment Training training accelerator Transformer Transformers
ISSN:	1063-8210, 1557-9999
On-line přístup:	Získat plný text
Tagy:	Přidat tag Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!

Buďte první, kdo okomentuje tento záznam!