Approximate dynamic programming for continuous-time linear quadratic regulator problems: relaxation of known input-coupling matrix assumption

This study proposes an approximate dynamic programming (ADP) scheme which solves approximately the continuous-time (CT) infinite horizon, linear quadratic (LQ) optimal control problems (OCPs) online for CT linear time-invariant (LTI) systems whose model is not exactly given a priori. In order to rel...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:IET control theory & applications Ročník 6; číslo 13; s. 2063 - 2075
Hlavní autori: Lee, J.Y., Park, J.B., Choi, Y.H.
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: Stevenage Institution of Engineering and Technology 01.09.2012
John Wiley & Sons, Inc
Predmet:
Applied sciences
Approximation
Computer science; control theory; systems
Control theory. Systems
Exact sciences and technology
Optimal control
Linear time invariant system
LQ control
dynamic control
Continuous time
Infinite horizon
Dynamic programming
Dynamical system
Adaptive control
Modeling
ISSN:1751-8644, 1751-8652
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:This study proposes an approximate dynamic programming (ADP) scheme which solves approximately the continuous-time (CT) infinite horizon, linear quadratic (LQ) optimal control problems (OCPs) online for CT linear time-invariant (LTI) systems whose model is not exactly given a priori. In order to relax the assumption of the perfectly known input-coupling matrix, a cheap OCP consisting of a dynamic controller and a modified quadratic performance index is formulated from the conventional LQ OCP. Then, the CT ADP technique based on policy iteration is embedded in the controller as an adaptive element for iteratively solving this cheap OCP in online fashion. By solving the cheap OCP, the near-optimal solution of the original LQ OCP can be obtained, which is proven in this study. The proposed scheme guarantees the stability and convergence to a near-optimal solution, and does not require the knowledge regarding system dynamics during the iterations. Finally, the simulation results are provided to verify the applicability and effectiveness of the proposed control scheme. [PUBLICATION ABSTRACT]
Bibliografia:SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 14
ObjectType-Article-2
content type line 23
ISSN:1751-8644
1751-8652
DOI:10.1049/iet-cta.2010.0521