Itao: a new iterative thresholding algorithm based optimizer for deep neural networks

In this paper, we propose a new iterative thresholding algorithm based optimizer (Itao) for deep neural networks. It is a first-order gradient-based algorithm with Tikhonov regularization for stochastic objective functions. It is fast and straightforward to implement. It acts on the parameters and t...

Full description

Saved in:

Bibliographic Details
Published in:	IEEE access Vol. 10; p. 1
Main Authors:	Merrouchi, M., Atifi, K., Skittou, M., T.Gadi
Format:	Journal Article
Language:	English
Published:	Piscataway IEEE 2022 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:	Algorithms Artificial neural networks Back propagation Back propagation networks Deep learning Inverse problems Iterative algorithms Iterative methods Iterative thresholding algorithm based optimizer (Itao) Linear programming Machine learning Mathematical models Neural networks Optimization optimizer algorithm Parameters Regularization Robustness (mathematics) Training
ISSN:	2169-3536, 2169-3536
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!