An Efficient and Effective Second-Order Training Algorithm for LSTM-Based Adaptive Learning

We study adaptive (or online) nonlinear regression with Long-Short-Term-Memory (LSTM) based networks, i.e., LSTM-based adaptive learning. In this context, we introduce an efficient Extended Kalman filter (EKF) based second-order training algorithm. Our algorithm is truly online, i.e., it does not as...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	IEEE transactions on signal processing Jg. 69; S. 2541 - 2554
Hauptverfasser:	Vural, N. Mert, Ergut, Salih, Kozat, Suleyman S.
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	New York IEEE 2021 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:	Adaptation models Adaptive algorithms Adaptive learning Adaptive systems Algorithms Approximation algorithms Extended Kalman filter Kalman filtering long short term memory (LSTM) Machine learning MLR-DEEP online learning Prediction algorithms regression Signal processing algorithms stochastic gradient descent (SGD) EDICS Category: MLR-SLER Training truly online
ISSN:	1053-587X, 1941-0476
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Schreiben Sie den ersten Kommentar!