On the convergence and improvement of stochastic normalized gradient descent

Non-convex models, like deep neural networks, have been widely used in machine learning applications. Training non-convex models is a difficult task owing to the saddle points of models. Recently, stochastic normalized gradient descent (SNGD), which updates the model parameter by a normalized gradie...

Celý popis

Podrobná bibliografia

Vydané v:	Science China. Information sciences Ročník 64; číslo 3; s. 132103
Hlavní autori:	Zhao, Shen-Yi, Xie, Yin-Peng, Li, Wu-Jun
Médium:	Journal Article
Jazyk:	English
Vydavateľské údaje:	Beijing Science China Press 01.03.2021 Springer Nature B.V
Predmet:	Artificial neural networks Computer Science Convergence Information Systems and Communication Service Iterative methods Machine learning Neural networks Performance enhancement Research Paper Saddle points stochastic normalized gradient descent non-convex problems computation complexity
ISSN:	1674-733X, 1869-1919
On-line prístup:	Získať plný text
Tagy:	Pridať tag Žiadne tagy, Buďte prvý, kto otaguje tento záznam!