An Empirical Study on Adaptive Inference for Pretrained Language Model

Adaptive inference has been proven to improve bidirectional encoder representations from transformers (BERT)'s inference speed with minimal loss of accuracy. However, current work only focuses on the BERT model and lacks exploration of other pretrained language models (PLMs). Therefore, this ar...

Full description

Saved in:

Bibliographic Details
Published in:	IEEE transaction on neural networks and learning systems Vol. 34; no. 8; pp. 4321 - 4331
Main Authors:	Liu, Weijie, Zhao, Xin, Zhao, Zhe, Ju, Qi, Yang, Xuefeng, Lu, Wei
Format:	Journal Article
Language:	English
Published:	United States IEEE 01.08.2023 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:	Acceleration Adaptation models Adaptive inference Benchmarks bidirectional encoder representations from transformers (BERT) Bit error rate Coders Computational modeling distillation FastPLM Inference Inference mechanisms Labels Language Mathematical models pretrained language model (PLM) Task analysis Transformers
ISSN:	2162-237X, 2162-2388, 2162-2388
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!