Improving the backpropagation algorithm with consequentialism weight updates over mini-batches

Normalized least mean squares (NLMS) and affine projection algorithm (APA) are two successful algorithms that improve the stability of least mean squares (LMS) by reducing the necessity to change the learning rate during the training process. In this paper, we extend them to multi-layer neural netwo...

Celý popis

Podrobná bibliografia

Vydané v:	Neurocomputing (Amsterdam) Ročník 461; s. 86 - 98
Hlavní autori:	Paeedeh, Naeem, Ghiasi-Shirazi, Kamaledin
Médium:	Journal Article
Jazyk:	English
Vydavateľské údaje:	Elsevier B.V 21.10.2021
Predmet:	Adaptive filters APA Backpropagation LMS NLMS SGD NLMS Backpropagation SGD APA LMS Adaptive filters
ISSN:	0925-2312, 1872-8286
On-line prístup:	Získať plný text
Tagy:	Pridať tag Žiadne tagy, Buďte prvý, kto otaguje tento záznam!