An Adaptive Dynamic Programming Scheme for Nonlinear Optimal Control With Unknown Dynamics and Its Application to Turbofan Engines

In this article, a novel adaptive dynamic programming (ADP) approach is proposed for the optimal control problem of nonlinear continuous control systems with unknown dynamics. First, an alternating iteration algorithm based on Hamilton-Jacobi-Bellman equation is proposed for the optimal control of k...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on industrial informatics Jg. 17; H. 1; S. 367 - 376
Hauptverfasser: Sun, Tao, Sun, Xi-Ming
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Piscataway IEEE 01.01.2021
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:
Adaptive control
Adaptive dynamic programming (ADP)
Algorithms
Approximation
Approximation algorithms
Basis functions
Convergence
convergence analysis
Dynamic models
Dynamic programming
Dynamical systems
Feedback control
Fuel control
global asymptotic stability
Hamilton–Jacobi–Bellman (HJB) equation
Heuristic algorithms
Iterative algorithms
Iterative methods
Mathematical model
Nonlinear control
Nonlinear dynamical systems
Nonlinear dynamics
nonlinear optimal control
Nonlinear systems
Optimal control
Tracking control
Turbofan engines
ISSN:1551-3203, 1941-0050
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract In this article, a novel adaptive dynamic programming (ADP) approach is proposed for the optimal control problem of nonlinear continuous control systems with unknown dynamics. First, an alternating iteration algorithm based on Hamilton-Jacobi-Bellman equation is proposed for the optimal control of known nonlinear control systems. Then, the convergence results of the alternating iteration algorithm are obtained by using mathematical induction and monotone bounded convergence theorem. Moreover, the global asymptotic stability of the nonlinear closed-loop system is proved. Second, based on the scheme of alternating iteration algorithm, an ADP algorithm for the optimal control problem with unknown nonlinear dynamic model is developed by using the basis function approximation method and Newton-Leibniz formula, which can update the control strategy online by utilizing input and output information of the system. In addition, the convergence analysis of the proposed ADP algorithm is derived. Finally, the feasibility of the established results is verified by two examples, and the ADP method is applied to the optimal tracking fuel control problem of turbofan engines.
AbstractList In this article, a novel adaptive dynamic programming (ADP) approach is proposed for the optimal control problem of nonlinear continuous control systems with unknown dynamics. First, an alternating iteration algorithm based on Hamilton-Jacobi-Bellman equation is proposed for the optimal control of known nonlinear control systems. Then, the convergence results of the alternating iteration algorithm are obtained by using mathematical induction and monotone bounded convergence theorem. Moreover, the global asymptotic stability of the nonlinear closed-loop system is proved. Second, based on the scheme of alternating iteration algorithm, an ADP algorithm for the optimal control problem with unknown nonlinear dynamic model is developed by using the basis function approximation method and Newton-Leibniz formula, which can update the control strategy online by utilizing input and output information of the system. In addition, the convergence analysis of the proposed ADP algorithm is derived. Finally, the feasibility of the established results is verified by two examples, and the ADP method is applied to the optimal tracking fuel control problem of turbofan engines.
Author Sun, Xi-Ming
Sun, Tao
Author_xml – sequence: 1
  givenname: Tao
  orcidid: 0000-0002-6618-1081
  surname: Sun
  fullname: Sun, Tao
  email: 719627969@mail.dlut.edu.cn
  organization: Key Laboratory of Intelligent Control and Optimization for Industrial Equipment of Ministry of Education, Dalian University of Technology, Dalian, China
– sequence: 2
  givenname: Xi-Ming
  orcidid: 0000-0002-1883-3495
  surname: Sun
  fullname: Sun, Xi-Ming
  email: sunxm@dlut.edu.cn
  organization: Key Laboratory of Intelligent Control and Optimization for Industrial Equipment of Ministry of Education, Dalian University of Technology, Dalian, China
BookMark eNp9kL1v2zAQxYkiAZqvvUAXAp3lHElRJEfDTVIDRhMgDjIKlEQ5TCVSJekEXvuXh6ndDh063QH33ru73yk6ct4ZhD4RmBEC6nK9XM4oUJhRJZQQ6gM6IaokBQCHo9xzTgpGgX1EpzE-AzABTJ2gX3OH552ekn0x-OvO6dG2-C74TdDjaN0G37dPZjS49wF_926wzuiAb7N-1ANeeJeCH_CjTU_4wf1w_tX9SYlYuw4vU8TzaRpsq5P1DieP19vQ-F47fOU2OS6eo-NeD9FcHOoZeri-Wi--Favbm-VivipaqkgqqkaXnDdMC97Svqm4aIihTBINQmrZUdpo6BqRO86qynSStSCl1KwCLvPnZ-jLPncK_ufWxFQ_-21weWVNSy5FyZmqsqraq9rgYwymr1ubft-egrZDTaB-511n3vU77_rAOxvhH-MUMqSw-5_l895ijTF_5QpYCXn6Bn3DjaI
CODEN ITIICH
CitedBy_id crossref_primary_10_1109_TII_2021_3138794
crossref_primary_10_1109_TSMC_2025_3549599
crossref_primary_10_1109_TIM_2025_3590842
crossref_primary_10_1109_TII_2024_3396514
crossref_primary_10_1109_TII_2021_3116084
crossref_primary_10_1002_rnc_7083
crossref_primary_10_1007_s10489_024_05980_3
crossref_primary_10_1109_TIM_2024_3470251
crossref_primary_10_1016_j_neucom_2024_128665
crossref_primary_10_1016_j_automatica_2023_111261
crossref_primary_10_1016_j_energy_2024_133095
crossref_primary_10_1109_TMECH_2021_3082636
crossref_primary_10_1109_ACCESS_2022_3161056
crossref_primary_10_1002_rnc_6418
crossref_primary_10_1007_s12555_020_0809_7
crossref_primary_10_1002_oca_3280
crossref_primary_10_1109_TIE_2023_3292873
crossref_primary_10_1016_j_jfranklin_2023_06_011
crossref_primary_10_1016_j_jfranklin_2021_08_014
crossref_primary_10_1016_j_sysconle_2023_105653
crossref_primary_10_1049_cth2_12563
crossref_primary_10_1002_asjc_2830
crossref_primary_10_1007_s11075_022_01425_5
crossref_primary_10_1016_j_eswa_2024_123280
crossref_primary_10_1016_j_ins_2024_121542
crossref_primary_10_1109_TII_2024_3369714
crossref_primary_10_1109_TIM_2023_3273661
crossref_primary_10_1016_j_neucom_2022_07_072
crossref_primary_10_1109_TII_2021_3138893
crossref_primary_10_1109_TIE_2024_3426038
crossref_primary_10_1016_j_neunet_2023_08_044
crossref_primary_10_1109_TII_2023_3333933
crossref_primary_10_1109_TCYB_2024_3404624
crossref_primary_10_3390_act14090420
crossref_primary_10_1002_asjc_2509
crossref_primary_10_1007_s42401_025_00351_3
crossref_primary_10_1177_01423312211039641
crossref_primary_10_1109_JAS_2023_123759
crossref_primary_10_1155_2022_6512906
crossref_primary_10_1016_j_epsr_2023_109563
crossref_primary_10_1016_j_isatra_2023_07_023
crossref_primary_10_1109_JIOT_2024_3488723
crossref_primary_10_1016_j_isatra_2024_02_028
crossref_primary_10_1016_j_energy_2024_132924
crossref_primary_10_1109_TSMC_2023_3302656
crossref_primary_10_1109_TIM_2025_3550613
crossref_primary_10_1109_JIOT_2023_3234582
crossref_primary_10_1016_j_ast_2025_110210
crossref_primary_10_1049_cth2_12661
crossref_primary_10_1049_cth2_12545
crossref_primary_10_1177_1461348420979480
Cites_doi 10.1016/j.nahs.2017.04.001
10.1016/S1570-579X(06)80010-8
10.1109/TNNLS.2013.2294968
10.1016/S1874-1029(13)60031-2
10.1109/TII.2018.2868473
10.1016/j.automatica.2018.11.036
10.1109/TIE.2017.2674581
10.1016/j.neucom.2015.08.120
10.1016/j.automatica.2012.06.096
10.1057/jors.1979.93
10.1109/TNN.2011.2147797
10.1109/TIE.2014.2388198
10.1016/j.automatica.2010.02.018
10.1109/TNN.2010.2076370
10.1016/j.neucom.2012.01.025
10.1109/TCYB.2015.2492242
10.1109/TIE.2017.2650872
10.1109/TAC.2015.2414811
10.23919/ACC.1989.4790360
10.1109/TIE.2017.2782205
10.1016/j.ejcon.2013.05.017
10.1016/j.nahs.2018.05.006
10.1007/s00521-012-1238-1
10.1126/science.153.3731.34
10.1109/TAC.1968.1098829
10.1109/TNNLS.2014.2305841
10.1109/TAC.2016.2548662
10.1109/TII.2018.2884214
10.1109/TII.2018.2850001
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/TII.2020.2979779
DatabaseName IEEE Xplore (IEEE)
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Xplore
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
DatabaseTitleList
Technology Research Database
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Xplore
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 1941-0050
EndPage 376
ExternalDocumentID 10_1109_TII_2020_2979779
9034079
Genre orig-research
GrantInformation_xml – fundername: National Natural Science Foundation of China
  grantid: 61890920; 61890921
  funderid: 10.13039/501100001809
– fundername: National Key R&D Program of China
  grantid: 2018YFB1700102
GroupedDBID 0R~
29I
4.4
5GY
5VS
6IK
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFS
ACIWK
AENEX
AETIX
AGQYO
AGSQL
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
DU5
EBS
EJD
HZ~
IFIPE
IPLJI
JAVBF
LAI
M43
O9-
OCL
P2P
RIA
RIE
RNS
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c291t-6ba455b3a75c2fb657b1e2381a078a8d22ba0db78d25366ed83c0888a36058203
IEDL.DBID RIE
ISICitedReferencesCount 58
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000587719200034&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1551-3203
IngestDate Mon Jun 30 10:09:17 EDT 2025
Sat Nov 29 04:16:52 EST 2025
Tue Nov 18 22:35:26 EST 2025
Wed Aug 27 02:29:46 EDT 2025
IsPeerReviewed false
IsScholarly true
Issue 1
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c291t-6ba455b3a75c2fb657b1e2381a078a8d22ba0db78d25366ed83c0888a36058203
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0002-1883-3495
0000-0002-6618-1081
PQID 2458745396
PQPubID 85507
PageCount 10
ParticipantIDs proquest_journals_2458745396
ieee_primary_9034079
crossref_citationtrail_10_1109_TII_2020_2979779
crossref_primary_10_1109_TII_2020_2979779
PublicationCentury 2000
PublicationDate 2021-Jan.
2021-1-00
20210101
PublicationDateYYYYMMDD 2021-01-01
PublicationDate_xml – month: 01
  year: 2021
  text: 2021-Jan.
PublicationDecade 2020
PublicationPlace Piscataway
PublicationPlace_xml – name: Piscataway
PublicationTitle IEEE transactions on industrial informatics
PublicationTitleAbbrev TII
PublicationYear 2021
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref12
fu (ref15) 2011; 22
ref14
ref31
ref30
ref11
ref2
ref1
werbos (ref10) 1968; 11
ref17
ref16
ref19
johnsonbaugh (ref32) 2012
ref18
bertsekas (ref6) 1995; 1
ref24
ref23
ref26
ref25
ref20
ref22
ref21
ref28
ref27
ref29
ref8
ref7
ref9
ref4
ref3
ref5
References_xml – ident: ref3
  doi: 10.1016/j.nahs.2017.04.001
– ident: ref31
  doi: 10.1016/S1570-579X(06)80010-8
– volume: 11
  year: 1968
  ident: ref10
  article-title: Elements of intelligence
  publication-title: Cybernetica
– ident: ref28
  doi: 10.1109/TNNLS.2013.2294968
– ident: ref9
  doi: 10.1016/S1874-1029(13)60031-2
– ident: ref22
  doi: 10.1109/TII.2018.2868473
– ident: ref4
  doi: 10.1016/j.automatica.2018.11.036
– ident: ref13
  doi: 10.1109/TIE.2017.2674581
– ident: ref25
  doi: 10.1016/j.neucom.2015.08.120
– ident: ref16
  doi: 10.1016/j.automatica.2012.06.096
– ident: ref8
  doi: 10.1057/jors.1979.93
– volume: 22
  start-page: 1133
  year: 2011
  ident: ref15
  article-title: Adaptive learning and control for MIMO system based on adaptive dynamic programming
  publication-title: IEEE Trans Neural Netw
  doi: 10.1109/TNN.2011.2147797
– ident: ref14
  doi: 10.1109/TIE.2014.2388198
– ident: ref29
  doi: 10.1016/j.automatica.2010.02.018
– ident: ref11
  doi: 10.1109/TNN.2010.2076370
– ident: ref27
  doi: 10.1016/j.neucom.2012.01.025
– ident: ref12
  doi: 10.1109/TCYB.2015.2492242
– ident: ref20
  doi: 10.1109/TIE.2017.2650872
– ident: ref19
  doi: 10.1109/TAC.2015.2414811
– ident: ref17
  doi: 10.23919/ACC.1989.4790360
– ident: ref24
  doi: 10.1109/TIE.2017.2782205
– ident: ref1
  doi: 10.1016/j.ejcon.2013.05.017
– ident: ref5
  doi: 10.1016/j.nahs.2018.05.006
– ident: ref26
  doi: 10.1007/s00521-012-1238-1
– year: 2012
  ident: ref32
  publication-title: Foundations of Mathematical Analysis
– ident: ref7
  doi: 10.1126/science.153.3731.34
– volume: 1
  year: 1995
  ident: ref6
  publication-title: Dynamic Programming and Optimal Control
– ident: ref30
  doi: 10.1109/TAC.1968.1098829
– ident: ref18
  doi: 10.1109/TNNLS.2014.2305841
– ident: ref2
  doi: 10.1109/TAC.2016.2548662
– ident: ref21
  doi: 10.1109/TII.2018.2884214
– ident: ref23
  doi: 10.1109/TII.2018.2850001
SSID ssj0037039
Score 2.5080454
Snippet In this article, a novel adaptive dynamic programming (ADP) approach is proposed for the optimal control problem of nonlinear continuous control systems with...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 367
SubjectTerms Adaptive control
Adaptive dynamic programming (ADP)
Algorithms
Approximation
Approximation algorithms
Basis functions
Convergence
convergence analysis
Dynamic models
Dynamic programming
Dynamical systems
Feedback control
Fuel control
global asymptotic stability
Hamilton–Jacobi–Bellman (HJB) equation
Heuristic algorithms
Iterative algorithms
Iterative methods
Mathematical model
Nonlinear control
Nonlinear dynamical systems
Nonlinear dynamics
nonlinear optimal control
Nonlinear systems
Optimal control
Tracking control
Turbofan engines
Title An Adaptive Dynamic Programming Scheme for Nonlinear Optimal Control With Unknown Dynamics and Its Application to Turbofan Engines
URI https://ieeexplore.ieee.org/document/9034079
https://www.proquest.com/docview/2458745396
Volume 17
WOSCitedRecordID wos000587719200034&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIEE
  databaseName: IEEE Xplore
  customDbUrl:
  eissn: 1941-0050
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0037039
  issn: 1551-3203
  databaseCode: RIE
  dateStart: 20050101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1Lb9swDCbaooftsEe7Ydm6gYddCsyNLFm2dQy6Fc0lLbAU7c3QK1iBxSliZz-gv7yUbGcdNgzoTQeKEPzJJCVSHwE-qzIzcuFcQrFonmRpyRKthErIE-oyc-RRbBabTRSzWXlzoy534Mv2LYz3Phaf-ZMwjLl8t7KbcFU2VkzQ-UPtwm5R5N1brcHqCtq5KnKjyjQRnIkhJcnUeD6d0kGQsxOuCgp31B8uKPZU-csQR-9y9vJp63oFL_ooEicd7K9hx9cH8PwRt-Ah3E9qnDh9F8wZfu36zuNlV421JAn8TnAtPVLQirOOL0Ov8YLkl6T5tKtgx-vb9gde1eHmrR60NKhrh9O2wcnv7De2K5xv1uRTdY3dQpo3cHX2bX56nvQNFxLLVdomudGZlEboQlq-MLksTOqDT9cUSOjScW40c6agkRR57l0pLFmpUouQXKWP_hb26lXt3wE6w7wgbXZhA2m7MKJQ3kquObOpF9kIxgMGle3ZyENTjJ9VPJUwVRFqVUCt6lEbwfF2xl3HxPEf2cOA0lauB2gERwPMVf-rNhXPZKD8Fyp__-9ZH-AZD4Us8d7lCPba9cZ_hH37q71t1p_iLnwA_qHZ6Q
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1Lb9QwEB6VggQceLWoCwXmwAWJdB07TuLjqlB1RVkqsRW9RX6tqMRmq022P4BfzthJFhAIiZsP45GVz5kZe8bfALxWZWbkwrmEYtE8ydKSJVoJlZAn1GXmyKPYLDabKGaz8vJSne_A2-1bGO99LD7zR2EYc_luZTfhqmysmKDzh7oFt0PnrP611mB3Be1dFdlRZZoIzsSQlGRqPJ9O6SjI2RFXBQU86jcnFLuq_GGKo385efh_K3sED_o4Eicd8I9hx9dP4P4v7IJ78H1S48Tp62DQ8F3XeR7Pu3qsJUngZwJs6ZHCVpx1jBl6jZ9Ifkmaj7sadvxy1X7FizrcvdWDlgZ17XDaNjj5mf_GdoXzzZq8qq6xW0izDxcn7-fHp0nfciGxXKVtkhudSWmELqTlC5PLwqQ-eHVNoYQuHedGM2cKGkmR596VwpKdKrUI6VX66E9ht17V_gDQGeYFabMLG2jbhRGF8lZyzZlNvchGMB4wqGzPRx7aYnyr4rmEqYpQqwJqVY_aCN5sZ1x3XBz_kN0LKG3leoBGcDjAXPU_a1PxTAbSf6HyZ3-f9Qruns4_nlVn09mH53CPh7KWeAtzCLvteuNfwB17014165dxR_4Af1jdMg
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=An+Adaptive+Dynamic+Programming+Scheme+for+Nonlinear+Optimal+Control+With+Unknown+Dynamics+and+Its+Application+to+Turbofan+Engines&rft.jtitle=IEEE+transactions+on+industrial+informatics&rft.au=Sun%2C+Tao&rft.au=Sun%2C+Xi-Ming&rft.date=2021-01-01&rft.issn=1551-3203&rft.eissn=1941-0050&rft.volume=17&rft.issue=1&rft.spage=367&rft.epage=376&rft_id=info:doi/10.1109%2FTII.2020.2979779&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_TII_2020_2979779
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1551-3203&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1551-3203&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1551-3203&client=summon