Value iteration and adaptive optimal output regulation with assured convergence rate

In this paper, we investigate the learning-based adaptive optimal output regulation problem with convergence rate requirement for disturbed linear continuous-time systems. An adaptive optimal control approach is proposed based on reinforcement learning and adaptive dynamic programming to learn the o...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Control engineering practice Jg. 121; S. 105042
Hauptverfasser: Jiang, Yi, Gao, Weinan, Na, Jing, Zhang, Di, Hämäläinen, Timo T., Stojanovic, Vladimir, Lewis, Frank L.
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Elsevier Ltd 01.04.2022
Schlagworte:
Adaptive dynamic programming
Assured convergence rate
Optimal output regulation
Reinforcement learning
Value iteration
Value iteration
Adaptive dynamic programming
Optimal output regulation
Reinforcement learning
Assured convergence rate
ISSN:0967-0661, 1873-6939
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:In this paper, we investigate the learning-based adaptive optimal output regulation problem with convergence rate requirement for disturbed linear continuous-time systems. An adaptive optimal control approach is proposed based on reinforcement learning and adaptive dynamic programming to learn the optimal regulator with assured convergence rate. The above-mentioned problem is successfully solved by tackling a static optimization problem to find the optimal solution to the regulator equations, and a dynamic and constrained optimization problem to obtain the optimal feedback control gain. Without requiring on the accurate system dynamics or a stabilizing feedback control gain, a novel online value iteration algorithm is proposed, which can learn both the optimal feedback control gain and the corresponding feedforward control gain using measurable data. Moreover, the output of the closed-loop system is guaranteed to converge faster or equal to a predefined convergence rate set by user. Finally, the numerical analysis on a LCL coupled inverter-based distributed generation system shows that the proposed approach can achieve desired disturbance rejection and tracking performance.
ISSN:0967-0661
1873-6939
DOI:10.1016/j.conengprac.2021.105042