Research on a learning rate with energy index in deep learning

The stochastic gradient descent algorithm (SGD) is the main optimization solution in deep learning. The performance of SGD depends critically on how learning rates are tuned over time. In this paper, we propose a novel energy index based optimization method (EIOM) to automatically adjust the learnin...

Full description

Bibliographic Details

Published in:	Neural networks Vol. 110; pp. 225 - 231
Main Authors:	Zhao, Huizhen, Liu, Fuxian, Zhang, Han, Liang, Zhibing
Format:	Journal Article
Language:	English
Published:	United States Elsevier Ltd 01.02.2019
Subjects:	Convolutional neural network Deep learning Energy index Learning rate Stochastic gradient algorithm Deep learning Energy index Stochastic gradient algorithm Convolutional neural network Learning rate
ISSN:	0893-6080, 1879-2782, 1879-2782
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!