Approximate Softmax Functions for Energy-Efficient Deep Neural Networks

Approximate computing has emerged as a new paradigm that provides power-efficient and high-performance arithmetic designs by relaxing the stringent requirement of accuracy. Nonlinear functions (such as softmax , rectified linear unit ( ReLU ), Tanh , and Sigmoid ) are extensively used in deep neural...

Full description

Saved in:

Bibliographic Details
Published in:	IEEE transactions on very large scale integration (VLSI) systems Vol. 31; no. 1; pp. 1 - 13
Main Authors:	Chen, Ke, Gao, Yue, Waris, Haroon, Liu, Weiqiang, Lombardi, Fabrizio
Format:	Journal Article
Language:	English
Published:	New York IEEE 01.01.2023 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:	Accuracy Adders Approximate computing Artificial neural networks Circuit design Complexity Deep neural network (DNN) Dividers Energy dissipation field-programmable gate array (FPGA) implementation Hardware Hybrid structures Linear functions Logic gates Lookup tables Mathematical analysis Neural networks nonlinear function Power management softmax layer Table lookup Taylor series
ISSN:	1063-8210, 1557-9999
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!