Accelerating Framework of Transformer by Hardware Design and Model Compression Co-Optimization

State-of-the-art Transformer-based models, with gigantic parameters, are difficult to be accommodated on resource constrained embedded devices. Moreover, with the development of technology, more and more embedded devices are available to run a Transformer model. For a Transformer model with differen...

Full description

Bibliographic Details

Published in:	Digest of technical papers - IEEE/ACM International Conference on Computer-Aided Design pp. 1 - 9
Main Authors:	Qi, Panjie, Sha, Edwin Hsing-Mean, Zhuge, Qingfeng, Peng, Hongwu, Huang, Shaoyi, Kong, Zhenglun, Song, Yuhong, Li, Bingbing
Format:	Conference Proceeding
Language:	English
Published:	IEEE 01.11.2021
Subjects:	component Computational modeling Design automation Field programmable gate arrays formatting Graphics processing units Hardware insert Sparse matrices style styling Transformers
ISSN:	1558-2434
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!