A non-monotone trust-region method with noisy oracles and additional sampling

In this work, we introduce a novel stochastic second-order method, within the framework of a non-monotone trust-region approach, for solving the unconstrained, nonlinear, and non-convex optimization problems arising in the training of deep neural networks. The proposed algorithm makes use of subsamp...

Full description

Saved in:

Bibliographic Details
Published in:	Computational optimization and applications Vol. 89; no. 1; pp. 247 - 278
Main Authors:	Krejić, Nataša, Krklec Jerinkić, Nataša, Martínez, Ángeles, Yousefi, Mahsa
Format:	Journal Article
Language:	English
Published:	New York Springer US 01.09.2024 Springer Nature B.V
Subjects:	Adaptive algorithms Adaptive sampling Algorithms Approximation Artificial neural networks Convergence Convex and Discrete Geometry Convexity Error analysis Image classification Management Science Mathematics Mathematics and Statistics Neural networks Operations Research Operations Research/Decision Theory Optimization Sample size State-of-the-art reviews Statistics 90C53 90C30 65K05 Adaptive sampling Second-order methods Deep neural networks training 90C06 90C90 Stochastic optimization Non-monotone trust-region Quasi-Newton
ISSN:	0926-6003, 1573-2894
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!