Value iteration and adaptive optimal output regulation with assured convergence rate

In this paper, we investigate the learning-based adaptive optimal output regulation problem with convergence rate requirement for disturbed linear continuous-time systems. An adaptive optimal control approach is proposed based on reinforcement learning and adaptive dynamic programming to learn the o...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Control engineering practice Ročník 121; s. 105042
Hlavní autori: Jiang, Yi, Gao, Weinan, Na, Jing, Zhang, Di, Hämäläinen, Timo T., Stojanovic, Vladimir, Lewis, Frank L.
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: Elsevier Ltd 01.04.2022
Predmet:
Adaptive dynamic programming
Assured convergence rate
Optimal output regulation
Reinforcement learning
Value iteration
Value iteration
Adaptive dynamic programming
Optimal output regulation
Reinforcement learning
Assured convergence rate
ISSN:0967-0661, 1873-6939
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:In this paper, we investigate the learning-based adaptive optimal output regulation problem with convergence rate requirement for disturbed linear continuous-time systems. An adaptive optimal control approach is proposed based on reinforcement learning and adaptive dynamic programming to learn the optimal regulator with assured convergence rate. The above-mentioned problem is successfully solved by tackling a static optimization problem to find the optimal solution to the regulator equations, and a dynamic and constrained optimization problem to obtain the optimal feedback control gain. Without requiring on the accurate system dynamics or a stabilizing feedback control gain, a novel online value iteration algorithm is proposed, which can learn both the optimal feedback control gain and the corresponding feedforward control gain using measurable data. Moreover, the output of the closed-loop system is guaranteed to converge faster or equal to a predefined convergence rate set by user. Finally, the numerical analysis on a LCL coupled inverter-based distributed generation system shows that the proposed approach can achieve desired disturbance rejection and tracking performance.
ISSN:0967-0661
1873-6939
DOI:10.1016/j.conengprac.2021.105042