Improving the backpropagation algorithm with consequentialism weight updates over mini-batches

Normalized least mean squares (NLMS) and affine projection algorithm (APA) are two successful algorithms that improve the stability of least mean squares (LMS) by reducing the necessity to change the learning rate during the training process. In this paper, we extend them to multi-layer neural netwo...

Full description

Saved in:

Bibliographic Details
Published in:	Neurocomputing (Amsterdam) Vol. 461; pp. 86 - 98
Main Authors:	Paeedeh, Naeem, Ghiasi-Shirazi, Kamaledin
Format:	Journal Article
Language:	English
Published:	Elsevier B.V 21.10.2021
Subjects:	Adaptive filters APA Backpropagation LMS NLMS SGD NLMS Backpropagation SGD APA LMS Adaptive filters
ISSN:	0925-2312, 1872-8286
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!