Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming

An intelligent-optimal control scheme for unknown nonaffine nonlinear discrete-time systems with discount factor in the cost function is developed in this paper. The iterative adaptive dynamic programming algorithm is introduced to solve the optimal control problem with convergence analysis. Then, t...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	Automatica (Oxford) Jg. 48; H. 8; S. 1825 - 1832
Hauptverfasser:	Wang, Ding, Liu, Derong, Wei, Qinglai, Zhao, Dongbin, Jin, Ning
Format:	Journal Article
Sprache:	Englisch
Veröffentlicht:	Kidlington Elsevier Ltd 01.08.2012 Elsevier
Schlagworte:	Adaptive control systems Adaptive critic designs Adaptive dynamic programming Algorithmics. Computability. Computer arithmetics Applied sciences Approximate dynamic programming Computer science; control theory; systems Computer simulation Control system synthesis Control systems Control theory. Systems Cost function Dynamical systems Exact sciences and technology Globalized dual heuristic programming Intelligent control Neural network Nonlinear dynamics Nonlinearity Optimal control Theoretical computing Adaptive dynamic programming Globalized dual heuristic programming Optimal control Approximate dynamic programming Neural network Adaptive critic designs Intelligent control Control system analysis Adaptive algorithm Adaptive system Control program Non linear control Iterative method Fork join problem Adaptive method Heuristic programming Efficiency Cost function Dynamic programming Optimal control (mathematics) Generic programming Numerical convergence Non linear system Cost control Discrete time
ISSN:	0005-1098, 1873-2836
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Abstract	An intelligent-optimal control scheme for unknown nonaffine nonlinear discrete-time systems with discount factor in the cost function is developed in this paper. The iterative adaptive dynamic programming algorithm is introduced to solve the optimal control problem with convergence analysis. Then, the implementation of the iterative algorithm via globalized dual heuristic programming technique is presented by using three neural networks, which will approximate at each iteration the cost function, the control law, and the unknown nonlinear system, respectively. In addition, two simulation examples are provided to verify the effectiveness of the developed optimal control approach.
AbstractList	An intelligent-optimal control scheme for unknown nonaffine nonlinear discrete-time systems with discount factor in the cost function is developed in this paper. The iterative adaptive dynamic programming algorithm is introduced to solve the optimal control problem with convergence analysis. Then, the implementation of the iterative algorithm via globalized dual heuristic programming technique is presented by using three neural networks, which will approximate at each iteration the cost function, the control law, and the unknown nonlinear system, respectively. In addition, two simulation examples are provided to verify the effectiveness of the developed optimal control approach.
Author	Wei, Qinglai Jin, Ning Wang, Ding Liu, Derong Zhao, Dongbin
Author_xml	– sequence: 1 givenname: Ding surname: Wang fullname: Wang, Ding email: ding.wang@ia.ac.cn organization: State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR China – sequence: 2 givenname: Derong surname: Liu fullname: Liu, Derong email: derong.liu@ia.ac.cn organization: State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR China – sequence: 3 givenname: Qinglai surname: Wei fullname: Wei, Qinglai email: qinglai.wei@ia.ac.cn organization: State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR China – sequence: 4 givenname: Dongbin surname: Zhao fullname: Zhao, Dongbin email: dongbin.zhao@ia.ac.cn organization: State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR China – sequence: 5 givenname: Ning surname: Jin fullname: Jin, Ning email: njin@uic.edu organization: Department of Electrical and Computer Engineering, University of Illinois, Chicago, IL 60607, USA
BackLink	http://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=26212128$$DView record in Pascal Francis
BookMark	eNqNkcFrHCEUxiWkkE3S_8FLoZeZPp2dWedSaEPTBgK5NGd5q8_gdka36qbsf1-HDS3k0uLhKf7e9_T7Ltl5iIEY4wJaAWL4sGvxUOKMxRtsJQjZQt_CejxjK6E2XSNVN5yzFQD0jYBRXbDLnHf1uBZKrtjuYV_8jBM3MZQUJx4dP4QfIf4KvE5C53ygZTfViolbn02iQk3tIp6PudCc-RYzWR4DR4tV75m4PQacveH7FJ8SzrMPT9fsjcMp09uXesUeb798v_nW3D98vbv5dN-YTonSdKBQCrUewPZu43BLYjsKMdQPdARmxIEkqLUdFRKO0Bm3QTsagwbMct1dsfcn3Tr754Fy0XN9NE0TBoqHrAUoKcUg-k1F372gmA1OLmEwPut9qpako5aDFHWpyqkTZ1LMOZH7gwjQSwx6p__GoJcYNPS6xlBbP75qNb5UbLEb_fQ_Ap9PAlQ9e_aUdDaegiHrE5mibfT_FvkN3hqvzQ
CODEN	ATCAA9
CitedBy_id	crossref_primary_10_1016_j_ast_2019_105537 crossref_primary_10_1016_j_neunet_2021_08_025 crossref_primary_10_1002_rnc_4843 crossref_primary_10_1007_s10462_023_10497_1 crossref_primary_10_1016_j_engappai_2021_104508 crossref_primary_10_1016_j_automatica_2020_109222 crossref_primary_10_1109_TNNLS_2023_3245630 crossref_primary_10_1016_j_neucom_2015_06_053 crossref_primary_10_1049_cth2_12619 crossref_primary_10_1109_TCYB_2019_2939424 crossref_primary_10_1109_TNNLS_2020_3046614 crossref_primary_10_1016_j_asoc_2021_107153 crossref_primary_10_1109_TCYB_2022_3233593 crossref_primary_10_1109_TAES_2025_3551681 crossref_primary_10_1109_TSMC_2020_3003224 crossref_primary_10_1109_TCSI_2025_3548900 crossref_primary_10_1002_oca_2477 crossref_primary_10_1002_acs_3097 crossref_primary_10_1016_j_automatica_2017_03_022 crossref_primary_10_1007_s00500_014_1534_z crossref_primary_10_1155_2014_628798 crossref_primary_10_1109_TIV_2022_3233592 crossref_primary_10_1155_2017_1895897 crossref_primary_10_1016_j_neucom_2017_09_020 crossref_primary_10_1109_TSMC_2017_2777472 crossref_primary_10_1080_00207179_2015_1060362 crossref_primary_10_1109_TAC_2015_2508741 crossref_primary_10_1109_TNNLS_2022_3143527 crossref_primary_10_1080_00207179_2017_1381763 crossref_primary_10_1016_j_arcontrol_2019_01_003 crossref_primary_10_1109_TCYB_2016_2548941 crossref_primary_10_1007_s00521_019_04372_w crossref_primary_10_1109_TSMC_2022_3201671 crossref_primary_10_1016_j_neucom_2014_08_046 crossref_primary_10_1002_rnc_6372 crossref_primary_10_1007_s11633_015_0893_y crossref_primary_10_1109_TNNLS_2015_2402203 crossref_primary_10_1080_00207721_2025_2515227 crossref_primary_10_1109_TIE_2018_2880728 crossref_primary_10_1109_TNNLS_2021_3135405 crossref_primary_10_1016_j_isatra_2018_01_014 crossref_primary_10_2514_1_G001154 crossref_primary_10_1016_j_automatica_2016_08_004 crossref_primary_10_1109_TSMC_2022_3146284 crossref_primary_10_1016_j_neucom_2019_05_026 crossref_primary_10_1109_TIE_2019_2914571 crossref_primary_10_1016_j_automatica_2014_10_056 crossref_primary_10_1109_TNNLS_2023_3245980 crossref_primary_10_1002_oca_2259 crossref_primary_10_1016_j_engappai_2024_108284 crossref_primary_10_1007_s00521_018_3537_7 crossref_primary_10_1016_j_automatica_2014_10_047 crossref_primary_10_1049_iet_cta_2015_0977 crossref_primary_10_1002_rnc_4860 crossref_primary_10_1016_j_engappai_2023_106242 crossref_primary_10_1016_j_engappai_2023_106240 crossref_primary_10_1109_TNNLS_2014_2329942 crossref_primary_10_1016_j_ins_2016_05_034 crossref_primary_10_1109_ACCESS_2019_2917141 crossref_primary_10_1109_ACCESS_2020_3043806 crossref_primary_10_1016_j_amc_2019_124568 crossref_primary_10_1088_1674_1056_27_1_010203 crossref_primary_10_1016_j_ins_2022_07_181 crossref_primary_10_1007_s12555_018_0551_6 crossref_primary_10_1016_j_neucom_2016_06_020 crossref_primary_10_1016_j_neucom_2017_12_007 crossref_primary_10_1016_j_neucom_2018_04_018 crossref_primary_10_1109_TNNLS_2015_2401334 crossref_primary_10_1007_s00500_013_1124_5 crossref_primary_10_1016_j_jfranklin_2019_07_022 crossref_primary_10_1109_TASE_2025_3548101 crossref_primary_10_1109_TCYB_2025_3530951 crossref_primary_10_1016_j_neucom_2017_03_047 crossref_primary_10_1109_TNNLS_2013_2283574 crossref_primary_10_1155_2023_8288527 crossref_primary_10_1007_s11071_025_11134_y crossref_primary_10_1007_s12555_023_0727_6 crossref_primary_10_3390_e25020299 crossref_primary_10_1109_TNNLS_2015_2460258 crossref_primary_10_1016_j_jfranklin_2021_06_011 crossref_primary_10_1002_acs_2485 crossref_primary_10_1002_oca_2313 crossref_primary_10_1007_s11071_017_3778_5 crossref_primary_10_1109_TSMC_2016_2592682 crossref_primary_10_1007_s00500_013_1112_9 crossref_primary_10_1007_s12555_023_0460_1 crossref_primary_10_1016_j_asoc_2022_108796 crossref_primary_10_1016_j_cherd_2019_04_011 crossref_primary_10_1016_j_neucom_2017_03_053 crossref_primary_10_1109_TSMC_2018_2863708 crossref_primary_10_1002_aic_16689 crossref_primary_10_1155_2020_3561807 crossref_primary_10_1016_j_engappai_2021_104443 crossref_primary_10_1016_j_automatica_2023_111128 crossref_primary_10_1109_TII_2017_2761852 crossref_primary_10_1109_TNNLS_2015_2490698 crossref_primary_10_1109_TNNLS_2021_3055761 crossref_primary_10_1155_2017_5476415 crossref_primary_10_1007_s12555_020_0812_z crossref_primary_10_1002_rnc_6569 crossref_primary_10_1109_TSMC_2018_2868510 crossref_primary_10_1016_j_neucom_2023_126502 crossref_primary_10_1109_TASE_2013_2296206 crossref_primary_10_1002_rnc_6213 crossref_primary_10_1109_TCYB_2021_3140104 crossref_primary_10_1007_s10462_019_09778_5 crossref_primary_10_1016_j_neucom_2020_06_106 crossref_primary_10_1016_j_neucom_2015_08_017 crossref_primary_10_1177_09544070221145468 crossref_primary_10_1016_j_jfranklin_2018_06_031 crossref_primary_10_1016_j_automatica_2016_05_003 crossref_primary_10_1109_TFUZZ_2019_2935693 crossref_primary_10_1109_TNNLS_2013_2271454 crossref_primary_10_1109_TASE_2014_2348991 crossref_primary_10_1109_TNNLS_2018_2808203 crossref_primary_10_3389_fphy_2023_1231313 crossref_primary_10_1109_TNNLS_2016_2516948 crossref_primary_10_1109_TCYB_2020_3027344 crossref_primary_10_1016_j_sysconle_2020_104847 crossref_primary_10_1002_rnc_5419 crossref_primary_10_1080_21642583_2019_1566800 crossref_primary_10_1016_S1874_1029_13_60070_1 crossref_primary_10_1109_TSMC_2017_2690665 crossref_primary_10_1002_asjc_2243 crossref_primary_10_1080_00207721_2022_2085343 crossref_primary_10_1109_TCYB_2019_2921057 crossref_primary_10_1016_j_ifacol_2020_12_2071 crossref_primary_10_1016_j_neucom_2024_128418 crossref_primary_10_1109_TAC_2016_2550518 crossref_primary_10_1016_j_neucom_2017_01_076 crossref_primary_10_1016_j_neucom_2017_12_045 crossref_primary_10_3390_math11092113 crossref_primary_10_1109_TNNLS_2018_2803726 crossref_primary_10_1007_s10462_017_9548_4 crossref_primary_10_1109_TITS_2016_2597279 crossref_primary_10_1080_00207179_2019_1648874 crossref_primary_10_1109_TMECH_2023_3336070 crossref_primary_10_1016_j_knosys_2022_108284 crossref_primary_10_1002_acs_3494 crossref_primary_10_1109_TCYB_2022_3175650 crossref_primary_10_1155_2015_760459 crossref_primary_10_1002_oca_2868 crossref_primary_10_1049_iet_cta_2015_0798 crossref_primary_10_1007_s00500_013_1111_x crossref_primary_10_1016_j_neucom_2016_06_059 crossref_primary_10_1109_TNNLS_2018_2803059 crossref_primary_10_1002_rnc_6984 crossref_primary_10_1109_TFUZZ_2015_2505327 crossref_primary_10_1109_TSMC_2020_2981478 crossref_primary_10_1109_TFUZZ_2019_2949554 crossref_primary_10_1016_j_neucom_2023_127042 crossref_primary_10_1049_iet_cta_2013_0889 crossref_primary_10_1016_j_neunet_2017_05_013 crossref_primary_10_1007_s12555_018_0904_1 crossref_primary_10_1109_ACCESS_2020_2975391 crossref_primary_10_1109_TASE_2025_3539772 crossref_primary_10_1109_TNNLS_2015_2411673 crossref_primary_10_1080_00207179_2013_848292 crossref_primary_10_1109_TSMC_2016_2562502 crossref_primary_10_1109_TNNLS_2018_2844165 crossref_primary_10_1016_j_neucom_2020_04_095 crossref_primary_10_1109_TII_2019_2912018 crossref_primary_10_4018_ijsda_2014070106 crossref_primary_10_1109_TSMC_2013_2295351 crossref_primary_10_1016_j_neucom_2018_05_111 crossref_primary_10_1109_TNNLS_2015_2399020 crossref_primary_10_1109_TSMC_2020_3042876 crossref_primary_10_1109_TAES_2024_3485012 crossref_primary_10_1080_00207179_2013_863432 crossref_primary_10_1109_TCYB_2014_2357896 crossref_primary_10_1016_j_ins_2017_05_005 crossref_primary_10_1002_acs_3397 crossref_primary_10_1002_oca_2893 crossref_primary_10_1109_TNNLS_2015_2424971 crossref_primary_10_1109_TCYB_2016_2623859 crossref_primary_10_1109_TSMC_2025_3539349 crossref_primary_10_1109_ACCESS_2022_3210136 crossref_primary_10_1109_ACCESS_2020_3022893 crossref_primary_10_1016_j_neucom_2015_07_017 crossref_primary_10_1109_TASE_2013_2280974 crossref_primary_10_1109_TNNLS_2014_2371046 crossref_primary_10_1109_TNNLS_2018_2806347 crossref_primary_10_1109_TETCI_2018_2863747 crossref_primary_10_1109_JAS_2022_105692 crossref_primary_10_1109_TAC_2016_2620379 crossref_primary_10_1109_TNNLS_2022_3164727 crossref_primary_10_1109_TCYB_2014_2314612 crossref_primary_10_1016_j_jfranklin_2014_11_008 crossref_primary_10_1016_j_isatra_2021_10_017 crossref_primary_10_1016_j_neucom_2018_06_020 crossref_primary_10_1080_00207721_2019_1599463 crossref_primary_10_1109_TNNLS_2016_2561300 crossref_primary_10_1109_TSMC_2015_2492941 crossref_primary_10_1109_TII_2021_3106402 crossref_primary_10_1016_j_automatica_2013_12_009 crossref_primary_10_1109_TNNLS_2014_2320744 crossref_primary_10_1016_j_automatica_2014_08_023 crossref_primary_10_1155_2021_2952115 crossref_primary_10_1109_TSMC_2016_2642118 crossref_primary_10_1002_asjc_2276 crossref_primary_10_1109_TNNLS_2016_2541020 crossref_primary_10_1007_s00500_017_2526_6 crossref_primary_10_1016_j_neucom_2015_06_003 crossref_primary_10_1109_TSMC_2016_2563982 crossref_primary_10_2514_1_G004928 crossref_primary_10_1002_oca_2832 crossref_primary_10_1016_j_neucom_2018_06_011 crossref_primary_10_1002_rnc_5729 crossref_primary_10_1016_j_ins_2020_11_057 crossref_primary_10_1109_TSMC_2023_3247466 crossref_primary_10_1109_TCYB_2021_3107801 crossref_primary_10_1109_TCYB_2017_2752845 crossref_primary_10_1016_j_neucom_2018_08_092 crossref_primary_10_1109_TASE_2014_2303139 crossref_primary_10_1109_TNNLS_2016_2585520 crossref_primary_10_1016_j_ejcon_2020_03_001 crossref_primary_10_1016_j_neunet_2021_05_027 crossref_primary_10_1016_j_automatica_2015_06_001 crossref_primary_10_1016_j_neucom_2013_09_069 crossref_primary_10_1109_TNNLS_2013_2281663 crossref_primary_10_1155_2022_9686060 crossref_primary_10_1109_TNNLS_2022_3183020 crossref_primary_10_3390_app10207073 crossref_primary_10_1109_TCYB_2017_2653800 crossref_primary_10_1109_TNNLS_2023_3243631 crossref_primary_10_1016_j_ins_2014_05_050 crossref_primary_10_1109_TAC_2019_2926167 crossref_primary_10_1109_TCYB_2018_2889679 crossref_primary_10_1002_rnc_70006 crossref_primary_10_1109_TCYB_2017_2712188 crossref_primary_10_1016_j_amc_2019_124821 crossref_primary_10_3390_math10244701 crossref_primary_10_1002_rnc_7021 crossref_primary_10_1109_TNNLS_2018_2805689 crossref_primary_10_1109_TNNLS_2021_3136939 crossref_primary_10_1109_LCSYS_2019_2919439 crossref_primary_10_1109_TII_2017_2771256 crossref_primary_10_3390_s24175462 crossref_primary_10_1016_j_neucom_2017_05_030 crossref_primary_10_1080_00207721_2016_1188177 crossref_primary_10_1016_j_neunet_2014_03_008 crossref_primary_10_1109_TNNLS_2014_2305841 crossref_primary_10_1177_09544100211041224 crossref_primary_10_1109_TCYB_2020_2982168 crossref_primary_10_1016_j_conengprac_2017_12_011 crossref_primary_10_1002_oca_3020 crossref_primary_10_1016_j_neucom_2013_03_038 crossref_primary_10_1109_TASE_2014_2300532 crossref_primary_10_1049_iet_cta_2016_1279 crossref_primary_10_1002_oca_3028 crossref_primary_10_1016_j_neucom_2014_01_060 crossref_primary_10_1109_TNNLS_2024_3392237 crossref_primary_10_1016_j_cor_2023_106422 crossref_primary_10_1109_TIE_2020_3001840 crossref_primary_10_1109_TNNLS_2020_3042589 crossref_primary_10_1080_00207179_2022_2137852 crossref_primary_10_1002_rnc_7256 crossref_primary_10_1007_s10462_021_10118_9 crossref_primary_10_1016_j_neunet_2022_07_019 crossref_primary_10_1016_j_ejcon_2013_05_015
Cites_doi	10.1109/TNN.2009.2027233 10.1016/j.sysconle.2003.08.006 10.1109/TSMCB.2008.924139 10.1109/TNN.2002.1000146 10.1016/j.automatica.2010.02.018 10.1109/TSMCB.2008.926599 10.1016/j.neunet.2009.06.014 10.1007/BF00992698 10.1016/j.neunet.2009.03.008 10.1109/TSMCB.2008.926614 10.1109/MCAS.2009.933854 10.1016/j.automatica.2010.10.033 10.1109/72.914523 10.1109/TNN.2008.2003295 10.1109/TASE.2005.844122 10.2514/3.21715 10.1109/TSMCC.2002.801727 10.1109/MCI.2009.932261 10.1016/j.automatica.2004.11.034 10.1109/9.855550 10.1016/S0005-1098(97)00128-3 10.1016/j.neunet.2009.03.012 10.1109/72.623201 10.1109/PESW.2000.849974
ContentType	Journal Article
Copyright	2012 Elsevier Ltd 2015 INIST-CNRS
Copyright_xml	– notice: 2012 Elsevier Ltd – notice: 2015 INIST-CNRS
DBID	AAYXX CITATION IQODW 7SC 7SP 8FD JQ2 L7M L~C L~D
DOI	10.1016/j.automatica.2012.05.049
DatabaseName	CrossRef Pascal-Francis Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional
DatabaseTitle	CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional
DatabaseTitleList	Technology Research Database
DeliveryMethod	fulltext_linktorsrc
Discipline	Engineering Applied Sciences
EISSN	1873-2836
EndPage	1832
ExternalDocumentID	26212128 10_1016_j_automatica_2012_05_049 S0005109812002221
GrantInformation_xml	– fundername: National Natural Science Foundation of China grantid: 60874043; 60904037; 60921061; 61034002 – fundername: Beijing Natural Science Foundation grantid: 4102061
GroupedDBID	--K --M -~X .DC .~1 0R~ 1B1 1~. 1~5 23N 3R3 4.4 457 4G. 5GY 5VS 6TJ 7-5 71M 8P~ 9JN 9JO AAAKF AAAKG AABNK AACTN AAEDT AAEDW AAIAV AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AARIN AAXUO ABDEX ABFNM ABFRF ABJNI ABMAC ABUCO ABXDB ABYKQ ACBEA ACDAQ ACGFO ACGFS ACNNM ACRLP ADBBV ADEZE ADIYS ADMUD ADTZH AEBSH AECPX AEFWE AEKER AENEX AFFNX AFKWA AFTJW AGHFR AGUBO AGYEJ AHHHB AHJVU AHPGS AI. AIEXJ AIKHN AITUG AJBFU AJOXV ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ APLSM ASPBG AVWKF AXJTR AZFZN BJAXD BKOJK BLXMC CS3 EBS EFJIC EFLBG EJD EO8 EO9 EP2 EP3 F5P FDB FEDTE FGOYB FIRID FNPLU FYGXN G-2 G-Q GBLVA HAMUX HLZ HVGLF HZ~ H~9 IHE J1W JJJVA K-O KOM LG9 LY7 M41 MO0 N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. Q38 R2- RIG ROL RPZ RXW SBC SDF SDG SDP SES SET SEW SPC SPCBC SSB SSD SST SSZ T5K T9H TAE TN5 VH1 WH7 WUQ X6Y XFK XPP ZMT ~G- 77I 9DU AATTM AAXKI AAYWO AAYXX ABUFD ABWVN ACLOT ACRPL ACVFH ADCNI ADNMO AEIPS AEUPX AFJKZ AFPUW AGQPQ AIGII AIIUN AKBMS AKRWK AKYEP ANKPU APXCP CITATION EFKBS ~HD AFXIZ AGCQF AGRNS BNPGV IQODW SSH 7SC 7SP 8FD JQ2 L7M L~C L~D
ID	FETCH-LOGICAL-c381t-308a218460d5f7fabe1b91160053e0c9a6e2084d98aea903cf7ad9ccac0c0c9a3
ISICitedReferencesCount	345
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000307688200040&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	0005-1098
IngestDate	Thu Oct 02 10:51:14 EDT 2025 Mon Jul 21 09:16:45 EDT 2025 Sat Nov 29 01:49:17 EST 2025 Tue Nov 18 22:29:55 EST 2025 Fri Feb 23 02:14:11 EST 2024
IsPeerReviewed	true
IsScholarly	true
Issue	8
Keywords	Adaptive dynamic programming Globalized dual heuristic programming Optimal control Approximate dynamic programming Neural network Adaptive critic designs Intelligent control Control system analysis Adaptive algorithm Adaptive system Control program Non linear control Iterative method Fork join problem Adaptive method Heuristic programming Efficiency Cost function Dynamic programming Optimal control (mathematics) Generic programming Numerical convergence Non linear system Cost control Discrete time
Language	English
License	https://www.elsevier.com/tdm/userlicense/1.0 CC BY 4.0
LinkModel	OpenURL
MergedId	FETCHMERGED-LOGICAL-c381t-308a218460d5f7fabe1b91160053e0c9a6e2084d98aea903cf7ad9ccac0c0c9a3
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23
PQID	1082216157
PQPubID	23500
PageCount	8
ParticipantIDs	proquest_miscellaneous_1082216157 pascalfrancis_primary_26212128 crossref_primary_10_1016_j_automatica_2012_05_049 crossref_citationtrail_10_1016_j_automatica_2012_05_049 elsevier_sciencedirect_doi_10_1016_j_automatica_2012_05_049
PublicationCentury	2000
PublicationDate	2012-08-01
PublicationDateYYYYMMDD	2012-08-01
PublicationDate_xml	– month: 08 year: 2012 text: 2012-08-01 day: 01
PublicationDecade	2010
PublicationPlace	Kidlington
PublicationPlace_xml	– name: Kidlington
PublicationTitle	Automatica (Oxford)
PublicationYear	2012
Publisher	Elsevier Ltd Elsevier
Publisher_xml	– name: Elsevier Ltd – name: Elsevier
References	Balakrishnan, Biega (br000015) 1996; 19 Werbos (br000125) 2008; 38 Si, Wang (br000085) 2001; 12 Bertsekas, Tsitsiklis (br000035) 1996 (pp. 291–294). Vrabie, Lewis (br000105) 2009; 22 Yen, Delima (br000135) 2005; 2 Chen, Edgar, Manousiouthakis (br000040) 2004; 51 Venayagamoorthy, Harley, Wunsch (br000095) 2002; 13 Abu-Khalaf, Lewis (br000005) 2005; 41 Lewis, Vrabie (br000060) 2009; 9 (pp. 1417–1424). Vamvoudakis, Lewis (br000090) 2010; 46 Zhang, Wei, Liu (br000145) 2011; 47 Dierks, Thumati, Jagannathan (br000045) 2009; 22 Werbos (br000120) 1992 Jagannathan, He (br000055) 2008; 19 Zhang, Luo, Liu (br000140) 2009; 20 Primbs, Nevistic, Doyle (br000075) 2000; 45 Watkins, Dayan (br000115) 1992; 8 Beard, Saridis, Wen (br000025) 1997; 33 Liu, D., & Jin, N. (2008). Venayagamoorthy, G. K., Wunsch, D. C., & Harley, R. G. (2000). Adaptive critic based neurocontroller for turbogenerators with global dual heuristic programming. In Al-Tamimi, Lewis, Abu-Khalaf (br000010) 2008; 38 adaptive dynamic programming for discrete-time systems. In Werbos (br000130) 2009; 22 Balakrishnan, Ding, Lewis (br000020) 2008; 38 Murray, Cox, Lendaris, Saeks (br000070) 2002; 32 Prokhorov, Wunsch (br000080) 1997; 8 Bellman (br000030) 1957 Jagannathan (br000050) 2006 Wang, Zhang, Liu (br000110) 2009; 4 Jagannathan (10.1016/j.automatica.2012.05.049_br000050) 2006 Lewis (10.1016/j.automatica.2012.05.049_br000060) 2009; 9 Primbs (10.1016/j.automatica.2012.05.049_br000075) 2000; 45 Zhang (10.1016/j.automatica.2012.05.049_br000145) 2011; 47 Si (10.1016/j.automatica.2012.05.049_br000085) 2001; 12 Wang (10.1016/j.automatica.2012.05.049_br000110) 2009; 4 Yen (10.1016/j.automatica.2012.05.049_br000135) 2005; 2 Jagannathan (10.1016/j.automatica.2012.05.049_br000055) 2008; 19 Al-Tamimi (10.1016/j.automatica.2012.05.049_br000010) 2008; 38 Balakrishnan (10.1016/j.automatica.2012.05.049_br000020) 2008; 38 Bertsekas (10.1016/j.automatica.2012.05.049_br000035) 1996 Werbos (10.1016/j.automatica.2012.05.049_br000125) 2008; 38 Vamvoudakis (10.1016/j.automatica.2012.05.049_br000090) 2010; 46 Werbos (10.1016/j.automatica.2012.05.049_br000130) 2009; 22 Werbos (10.1016/j.automatica.2012.05.049_br000120) 1992 Dierks (10.1016/j.automatica.2012.05.049_br000045) 2009; 22 10.1016/j.automatica.2012.05.049_br000100 Abu-Khalaf (10.1016/j.automatica.2012.05.049_br000005) 2005; 41 Zhang (10.1016/j.automatica.2012.05.049_br000140) 2009; 20 10.1016/j.automatica.2012.05.049_br000065 Prokhorov (10.1016/j.automatica.2012.05.049_br000080) 1997; 8 Watkins (10.1016/j.automatica.2012.05.049_br000115) 1992; 8 Vrabie (10.1016/j.automatica.2012.05.049_br000105) 2009; 22 Beard (10.1016/j.automatica.2012.05.049_br000025) 1997; 33 Bellman (10.1016/j.automatica.2012.05.049_br000030) 1957 Chen (10.1016/j.automatica.2012.05.049_br000040) 2004; 51 Balakrishnan (10.1016/j.automatica.2012.05.049_br000015) 1996; 19 Murray (10.1016/j.automatica.2012.05.049_br000070) 2002; 32 Venayagamoorthy (10.1016/j.automatica.2012.05.049_br000095) 2002; 13
References_xml	– year: 1957 ident: br000030 article-title: Dynamic programming – reference: (pp. 1417–1424). – year: 2006 ident: br000050 article-title: Neural network control of nonlinear discrete-time systems – volume: 19 start-page: 2073 year: 2008 end-page: 2087 ident: br000055 article-title: Neural-network-based state feedback control of a nonlinear discrete-time system in nonstrict feedback form publication-title: IEEE Transactions on Neural Networks – volume: 46 start-page: 878 year: 2010 end-page: 888 ident: br000090 article-title: Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem publication-title: Automatica – volume: 9 start-page: 32 year: 2009 end-page: 50 ident: br000060 article-title: Reinforcement learning and adaptive dynamic programming for feedback control publication-title: IEEE Circuits and Systems Magazine – reference: Liu, D., & Jin, N. (2008). – volume: 38 start-page: 913 year: 2008 end-page: 917 ident: br000020 article-title: Issues on stability of ADP feedback controllers for dynamic systems publication-title: IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics – year: 1996 ident: br000035 article-title: Neuro-dynamic programming – volume: 13 start-page: 764 year: 2002 end-page: 773 ident: br000095 article-title: Comparison of heuristic dynamic programming and dual heuristic programming adaptive critics for neurocontrol of a turbogenerator publication-title: IEEE Transactions on Neural Networks – volume: 45 start-page: 898 year: 2000 end-page: 909 ident: br000075 article-title: A receding horizon generalization of pointwise min-norm controllers publication-title: IEEE Transactions on Automatic Control – volume: 22 start-page: 851 year: 2009 end-page: 860 ident: br000045 article-title: Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence publication-title: Neural Networks – volume: 20 start-page: 1490 year: 2009 end-page: 1503 ident: br000140 article-title: Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints publication-title: IEEE Transactions on Neural Networks – volume: 47 start-page: 207 year: 2011 end-page: 214 ident: br000145 article-title: An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games publication-title: Automatica – volume: 2 start-page: 121 year: 2005 end-page: 131 ident: br000135 article-title: Improving the performance of globalized dual heuristic programming for fault tolerant control through an online learning supervisor publication-title: IEEE Transactions on Automation Science and Engineering – volume: 38 start-page: 898 year: 2008 end-page: 900 ident: br000125 article-title: ADP: the key direction for future research in intelligent control and understanding brain intelligence publication-title: IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics – reference: -adaptive dynamic programming for discrete-time systems. In – volume: 19 start-page: 893 year: 1996 end-page: 898 ident: br000015 article-title: Adaptive-critic based neural networks for aircraft optimal control publication-title: Journal of Guidance, Control, and Dynamics – volume: 51 start-page: 259 year: 2004 end-page: 268 ident: br000040 article-title: On infinite-time nonlinear quadratic optimal control publication-title: Systems & Control Letters – reference: Venayagamoorthy, G. K., Wunsch, D. C., & Harley, R. G. (2000). Adaptive critic based neurocontroller for turbogenerators with global dual heuristic programming. In – volume: 22 start-page: 200 year: 2009 end-page: 212 ident: br000130 article-title: Intelligence in the brain: a theory of how it works and how to build it publication-title: Neural Networks – volume: 8 start-page: 279 year: 1992 end-page: 292 ident: br000115 article-title: -learning publication-title: Machine Learning – volume: 12 start-page: 264 year: 2001 end-page: 276 ident: br000085 article-title: On-line learning control by association and reinforcement publication-title: IEEE Transactions on Neural Networks – volume: 38 start-page: 943 year: 2008 end-page: 949 ident: br000010 article-title: Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof publication-title: IEEE Transactions on Systems, Man, and Cybernetics Part B: Cybernetics – year: 1992 ident: br000120 article-title: Approximate dynamic programming for real-time control and neural modeling publication-title: Handbook of intelligent control: neural, fuzzy, and adaptive approaches – volume: 33 start-page: 2159 year: 1997 end-page: 2177 ident: br000025 article-title: Galerkin approximation of the generalized Hamilton–Jacobi–Bellman equation publication-title: Automatica – volume: 22 start-page: 237 year: 2009 end-page: 246 ident: br000105 article-title: Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems publication-title: Neural Networks – volume: 41 start-page: 779 year: 2005 end-page: 791 ident: br000005 article-title: Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach publication-title: Automatica – volume: 32 start-page: 140 year: 2002 end-page: 153 ident: br000070 article-title: Adaptive dynamic programming publication-title: IEEE Transactions on Systems, Man, and Cybernetics Part C: Applications and Reviews – volume: 4 start-page: 39 year: 2009 end-page: 47 ident: br000110 article-title: Adaptive dynamic programming: an introduction publication-title: IEEE Computational Intelligence Magazine – reference: (pp. 291–294). – volume: 8 start-page: 997 year: 1997 end-page: 1007 ident: br000080 article-title: Adaptive critic designs publication-title: IEEE Transactions on Neural Networks – volume: 20 start-page: 1490 issue: 9 year: 2009 ident: 10.1016/j.automatica.2012.05.049_br000140 article-title: Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints publication-title: IEEE Transactions on Neural Networks doi: 10.1109/TNN.2009.2027233 – volume: 51 start-page: 259 issue: 3–4 year: 2004 ident: 10.1016/j.automatica.2012.05.049_br000040 article-title: On infinite-time nonlinear quadratic optimal control publication-title: Systems & Control Letters doi: 10.1016/j.sysconle.2003.08.006 – volume: 38 start-page: 898 issue: 4 year: 2008 ident: 10.1016/j.automatica.2012.05.049_br000125 article-title: ADP: the key direction for future research in intelligent control and understanding brain intelligence publication-title: IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics doi: 10.1109/TSMCB.2008.924139 – year: 1996 ident: 10.1016/j.automatica.2012.05.049_br000035 – volume: 13 start-page: 764 issue: 3 year: 2002 ident: 10.1016/j.automatica.2012.05.049_br000095 article-title: Comparison of heuristic dynamic programming and dual heuristic programming adaptive critics for neurocontrol of a turbogenerator publication-title: IEEE Transactions on Neural Networks doi: 10.1109/TNN.2002.1000146 – year: 2006 ident: 10.1016/j.automatica.2012.05.049_br000050 – volume: 46 start-page: 878 issue: 5 year: 2010 ident: 10.1016/j.automatica.2012.05.049_br000090 article-title: Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem publication-title: Automatica doi: 10.1016/j.automatica.2010.02.018 – volume: 38 start-page: 913 issue: 4 year: 2008 ident: 10.1016/j.automatica.2012.05.049_br000020 article-title: Issues on stability of ADP feedback controllers for dynamic systems publication-title: IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics doi: 10.1109/TSMCB.2008.926599 – volume: 22 start-page: 851 issue: 5–6 year: 2009 ident: 10.1016/j.automatica.2012.05.049_br000045 article-title: Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence publication-title: Neural Networks doi: 10.1016/j.neunet.2009.06.014 – volume: 8 start-page: 279 issue: 3–4 year: 1992 ident: 10.1016/j.automatica.2012.05.049_br000115 article-title: Q-learning publication-title: Machine Learning doi: 10.1007/BF00992698 – volume: 22 start-page: 237 issue: 3 year: 2009 ident: 10.1016/j.automatica.2012.05.049_br000105 article-title: Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems publication-title: Neural Networks doi: 10.1016/j.neunet.2009.03.008 – volume: 38 start-page: 943 issue: 4 year: 2008 ident: 10.1016/j.automatica.2012.05.049_br000010 article-title: Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof publication-title: IEEE Transactions on Systems, Man, and Cybernetics Part B: Cybernetics doi: 10.1109/TSMCB.2008.926614 – volume: 9 start-page: 32 issue: 3 year: 2009 ident: 10.1016/j.automatica.2012.05.049_br000060 article-title: Reinforcement learning and adaptive dynamic programming for feedback control publication-title: IEEE Circuits and Systems Magazine doi: 10.1109/MCAS.2009.933854 – volume: 47 start-page: 207 issue: 1 year: 2011 ident: 10.1016/j.automatica.2012.05.049_br000145 article-title: An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games publication-title: Automatica doi: 10.1016/j.automatica.2010.10.033 – volume: 12 start-page: 264 issue: 2 year: 2001 ident: 10.1016/j.automatica.2012.05.049_br000085 article-title: On-line learning control by association and reinforcement publication-title: IEEE Transactions on Neural Networks doi: 10.1109/72.914523 – volume: 19 start-page: 2073 issue: 12 year: 2008 ident: 10.1016/j.automatica.2012.05.049_br000055 article-title: Neural-network-based state feedback control of a nonlinear discrete-time system in nonstrict feedback form publication-title: IEEE Transactions on Neural Networks doi: 10.1109/TNN.2008.2003295 – ident: 10.1016/j.automatica.2012.05.049_br000065 – volume: 2 start-page: 121 issue: 2 year: 2005 ident: 10.1016/j.automatica.2012.05.049_br000135 article-title: Improving the performance of globalized dual heuristic programming for fault tolerant control through an online learning supervisor publication-title: IEEE Transactions on Automation Science and Engineering doi: 10.1109/TASE.2005.844122 – volume: 19 start-page: 893 issue: 4 year: 1996 ident: 10.1016/j.automatica.2012.05.049_br000015 article-title: Adaptive-critic based neural networks for aircraft optimal control publication-title: Journal of Guidance, Control, and Dynamics doi: 10.2514/3.21715 – volume: 32 start-page: 140 issue: 2 year: 2002 ident: 10.1016/j.automatica.2012.05.049_br000070 article-title: Adaptive dynamic programming publication-title: IEEE Transactions on Systems, Man, and Cybernetics Part C: Applications and Reviews doi: 10.1109/TSMCC.2002.801727 – year: 1957 ident: 10.1016/j.automatica.2012.05.049_br000030 – volume: 4 start-page: 39 issue: 2 year: 2009 ident: 10.1016/j.automatica.2012.05.049_br000110 article-title: Adaptive dynamic programming: an introduction publication-title: IEEE Computational Intelligence Magazine doi: 10.1109/MCI.2009.932261 – volume: 41 start-page: 779 issue: 5 year: 2005 ident: 10.1016/j.automatica.2012.05.049_br000005 article-title: Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach publication-title: Automatica doi: 10.1016/j.automatica.2004.11.034 – volume: 45 start-page: 898 issue: 5 year: 2000 ident: 10.1016/j.automatica.2012.05.049_br000075 article-title: A receding horizon generalization of pointwise min-norm controllers publication-title: IEEE Transactions on Automatic Control doi: 10.1109/9.855550 – volume: 33 start-page: 2159 issue: 12 year: 1997 ident: 10.1016/j.automatica.2012.05.049_br000025 article-title: Galerkin approximation of the generalized Hamilton–Jacobi–Bellman equation publication-title: Automatica doi: 10.1016/S0005-1098(97)00128-3 – volume: 22 start-page: 200 issue: 3 year: 2009 ident: 10.1016/j.automatica.2012.05.049_br000130 article-title: Intelligence in the brain: a theory of how it works and how to build it publication-title: Neural Networks doi: 10.1016/j.neunet.2009.03.012 – volume: 8 start-page: 997 issue: 5 year: 1997 ident: 10.1016/j.automatica.2012.05.049_br000080 article-title: Adaptive critic designs publication-title: IEEE Transactions on Neural Networks doi: 10.1109/72.623201 – ident: 10.1016/j.automatica.2012.05.049_br000100 doi: 10.1109/PESW.2000.849974 – year: 1992 ident: 10.1016/j.automatica.2012.05.049_br000120 article-title: Approximate dynamic programming for real-time control and neural modeling
SSID	ssj0004182
Score	2.5521672
Snippet	An intelligent-optimal control scheme for unknown nonaffine nonlinear discrete-time systems with discount factor in the cost function is developed in this...
SourceID	proquest pascalfrancis crossref elsevier
SourceType	Aggregation Database Index Database Enrichment Source Publisher
StartPage	1825
SubjectTerms	Adaptive control systems Adaptive critic designs Adaptive dynamic programming Algorithmics. Computability. Computer arithmetics Applied sciences Approximate dynamic programming Computer science; control theory; systems Computer simulation Control system synthesis Control systems Control theory. Systems Cost function Dynamical systems Exact sciences and technology Globalized dual heuristic programming Intelligent control Neural network Nonlinear dynamics Nonlinearity Optimal control Theoretical computing
Title	Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming
URI	https://dx.doi.org/10.1016/j.automatica.2012.05.049 https://www.proquest.com/docview/1082216157
Volume	48
WOSCitedRecordID	wos000307688200040&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 customDbUrl: eissn: 1873-2836 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0004182 issn: 0005-1098 databaseCode: AIEXJ dateStart: 19950101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3fb9MwELZKxwMIIX6KDpiMhHiZIiVp0tjiaYJOgKYOpE7rm-UkNmq1JV2bTP0b-Ku5i-00FUMqD7xElVs3Te_z-fP5_B0h72HOUSqNI08pnWMJs8DjMsk9FTKfyTDTQSSbYhPJZMJmM_691_vlzsLcXiVFwTYbvvyvpoY2MDYenf0Hc7dfCg3wGowOVzA7XPcy_Dk4getG9cMkoQMbrAsMnRXHsNSXWiOvLIxChlzhDg0Qx0p5WGXeCjuvj3Fyy3EjQeZy2WQX5aZ0vUvounZTnlOwrauyUX-VjYDpxuTMt1GGSxuW_uy6YQ7QvDYeb1VuGy9Vk17wY47FReadsHZp6H7xM7Va4TZUgTkfzIUqnPtF2VNTdtq534h1YMY6vhRWPnFnXkbfc6fPN-GHBWb82AfFjL2wEWQ1cqi7MtuTc3F6cXYmpuPZ9MPyxsMKZLhTb8ux3CMHYRJz1icHJ1_Hs2_bU7YBM9rz9iFsXpjJFrz75n8jO4-Wcg1DUJvaKX_QgIbbTJ-Qx3ZRQk8MmJ6SniqekYcdqcrnZGFhRS2saKmphRVtYUVbWNEdWFELK9rAipYFdbCiFla0A6sX5OJ0PP30xbN1OrwM-F7lDXFUB0Bk_TzWiZapClKYQ0fo4JWfcTlSoc-inDOpJPeHmU5kzsF1ZH6Gbw9fkj78PvWKUB7oKEw5S1OgljqI2YhpIPS5DmMVBRkfkMT9oSKzIvZYS-VKuGzFhdiaQqAphB8LMMWABG3PpRFy2aPPR2czYQmpIZoCsLdH76MdM7e3DUfAF4EXDsg7Z3cBTh136mShynqNqr1hiGux5HCPz7wmD7aj7Q3pV6tavSX3s9tqvl4dWRj_BgBLy24
linkProvider	Elsevier
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Optimal+control+of+unknown+nonaffine+nonlinear+discrete-time+systems+based+on+adaptive+dynamic+programming&rft.jtitle=Automatica+%28Oxford%29&rft.au=Wang%2C+Ding&rft.au=Liu%2C+Derong&rft.au=Wei%2C+Qinglai&rft.au=Zhao%2C+Dongbin&rft.date=2012-08-01&rft.issn=0005-1098&rft.volume=48&rft.issue=8&rft.spage=1825&rft.epage=1832&rft_id=info:doi/10.1016%2Fj.automatica.2012.05.049&rft.externalDBID=NO_FULL_TEXT
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0005-1098&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0005-1098&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0005-1098&client=summon