A Fully Probabilistic Model for Sigmoid Approximation and Its Hardware- Efficient Implementation

The sigmoid function is a representative activation function in shallow neural networks. Its hardware realization is challenging due to the complex exponential and reciprocal operations. Existing studies applied piecewise models to approximate sigmoid function and employed numerical methods or non-u...

Full description

Saved in:

Bibliographic Details
Published in:	IEEE transactions on circuits and systems. I, Regular papers Vol. 71; no. 8; pp. 3775 - 3786
Main Authors:	Lu, Wenhao, Lu, Minshan, Zhang, Xiangfen, Lu, Zhongzhiguang, Sun, Miao, Dong, Boyi, Shu, Zhou
Format:	Journal Article
Language:	English
Published:	New York IEEE 01.08.2024 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:	Approximation Artificial neural networks ASIC implementation Complexity Computational modeling FPGA implementation Hardware hardware efficiency Integrated circuit modeling Localization method Neural networks Numerical methods Numerical models Optimization Probabilistic logic Probabilistic models probabilistic-based method Probability theory Random variables sigmoid activation function Statistical analysis Theorems
ISSN:	1549-8328, 1558-0806
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!