Stochastic gradient based extreme learning machines for stable online learning of advanced combustion engines

We propose and develop SG-ELM, a stable online learning algorithm based on stochastic gradients and Extreme Learning Machines (ELM). We propose SG-ELM particularly for systems that are required to be stable during learning; i.e., the estimated model parameters remain bounded during learning. We use...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Neurocomputing (Amsterdam) Ročník 177; číslo C; s. 304 - 316
Hlavní autori: Janakiraman, Vijay Manikandan, Nguyen, XuanLong, Assanis, Dennis
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: Netherlands Elsevier B.V 12.02.2016
Elsevier
Predmet:
ISSN:0925-2312, 1872-8286
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:We propose and develop SG-ELM, a stable online learning algorithm based on stochastic gradients and Extreme Learning Machines (ELM). We propose SG-ELM particularly for systems that are required to be stable during learning; i.e., the estimated model parameters remain bounded during learning. We use a Lyapunov approach to prove both asymptotic stability of estimation error and boundedness in the model parameters suitable for identification of nonlinear dynamic systems. Using the Lyapunov approach, we determine an upper bound for the learning rate of SG-ELM. The SG-ELM algorithm not only guarantees a stable learning but also reduces the computational demand compared to the recursive least squares based OS-ELM algorithm (Liang et al., 2006). In order to demonstrate the working of SG-ELM on a real-world problem, an advanced combustion engine identification is considered. The algorithm is applied to two case studies: An online regression learning for system identification of a Homogeneous Charge Compression Ignition (HCCI) Engine and an online classification learning (with class imbalance) for identifying the dynamic operating envelope. The case studies demonstrate that the accuracy of the proposed SG-ELM is comparable to that of the OS-ELM approach but adds stability and a reduction in computational effort.
Bibliografia:USDOE
EE0003533
ISSN:0925-2312
1872-8286
DOI:10.1016/j.neucom.2015.11.024