Research on a learning rate with energy index in deep learning

The stochastic gradient descent algorithm (SGD) is the main optimization solution in deep learning. The performance of SGD depends critically on how learning rates are tuned over time. In this paper, we propose a novel energy index based optimization method (EIOM) to automatically adjust the learnin...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	Neural networks Jg. 110; S. 225 - 231
Hauptverfasser:	Zhao, Huizhen, Liu, Fuxian, Zhang, Han, Liang, Zhibing
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	United States Elsevier Ltd 01.02.2019
Schlagworte:	Convolutional neural network Deep learning Energy index Learning rate Stochastic gradient algorithm Deep learning Energy index Stochastic gradient algorithm Convolutional neural network Learning rate
ISSN:	0893-6080, 1879-2782, 1879-2782
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!