Itao: a new iterative thresholding algorithm based optimizer for deep neural networks

In this paper, we propose a new iterative thresholding algorithm based optimizer (Itao) for deep neural networks. It is a first-order gradient-based algorithm with Tikhonov regularization for stochastic objective functions. It is fast and straightforward to implement. It acts on the parameters and t...

Celý popis

Uložené v:

Podrobná bibliografia
Vydané v:	IEEE access Ročník 10; s. 1
Hlavní autori:	Merrouchi, M., Atifi, K., Skittou, M., T.Gadi
Médium:	Journal Article
Jazyk:	English
Vydavateľské údaje:	Piscataway IEEE 2022 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Predmet:	Algorithms Artificial neural networks Back propagation Back propagation networks Deep learning Inverse problems Iterative algorithms Iterative methods Iterative thresholding algorithm based optimizer (Itao) Linear programming Machine learning Mathematical models Neural networks Optimization optimizer algorithm Parameters Regularization Robustness (mathematics) Training
ISSN:	2169-3536, 2169-3536
On-line prístup:	Získať plný text
Tagy:	Pridať tag Žiadne tagy, Buďte prvý, kto otaguje tento záznam!

Buďte prvý, kto okomentuje tento záznam!