On the convergence and improvement of stochastic normalized gradient descent

Non-convex models, like deep neural networks, have been widely used in machine learning applications. Training non-convex models is a difficult task owing to the saddle points of models. Recently, stochastic normalized gradient descent (SNGD), which updates the model parameter by a normalized gradie...

Celý popis

Podrobná bibliografie

Vydáno v:	Science China. Information sciences Ročník 64; číslo 3; s. 132103
Hlavní autoři:	Zhao, Shen-Yi, Xie, Yin-Peng, Li, Wu-Jun
Médium:	Journal Article
Jazyk:	angličtina
Vydáno:	Beijing Science China Press 01.03.2021 Springer Nature B.V
Témata:	Artificial neural networks Computer Science Convergence Information Systems and Communication Service Iterative methods Machine learning Neural networks Performance enhancement Research Paper Saddle points stochastic normalized gradient descent non-convex problems computation complexity
ISSN:	1674-733X, 1869-1919
On-line přístup:	Získat plný text
Tagy:	Přidat tag Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!