An Efficient and Effective Second-Order Training Algorithm for LSTM-Based Adaptive Learning

We study adaptive (or online) nonlinear regression with Long-Short-Term-Memory (LSTM) based networks, i.e., LSTM-based adaptive learning. In this context, we introduce an efficient Extended Kalman filter (EKF) based second-order training algorithm. Our algorithm is truly online, i.e., it does not as...

Full description

Saved in:

Bibliographic Details
Published in:	IEEE transactions on signal processing Vol. 69; pp. 2541 - 2554
Main Authors:	Vural, N. Mert, Ergut, Salih, Kozat, Suleyman S.
Format:	Journal Article
Language:	English
Published:	New York IEEE 2021 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:	Adaptation models Adaptive algorithms Adaptive learning Adaptive systems Algorithms Approximation algorithms Extended Kalman filter Kalman filtering long short term memory (LSTM) Machine learning MLR-DEEP online learning Prediction algorithms regression Signal processing algorithms stochastic gradient descent (SGD) EDICS Category: MLR-SLER Training truly online
ISSN:	1053-587X, 1941-0476
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!