Nonzero-sum games using actor-critic neural networks: A dynamic event-triggered adaptive dynamic programming

This paper mainly investigates the nonzero-sum games of nonlinear systems with unmatched uncertainty by using actor-critic neural networks. To handle the unmatched components, an auxiliary system with a modified value function is constructed, which transforms the robust stabilization issue into the...

Full description

Saved in:
Bibliographic Details
Published in:Information sciences Vol. 662; p. 120236
Main Authors: Shen, Hao, Li, Ziwei, Wang, Jing, Cao, Jinde
Format: Journal Article
Language:English
Published: Elsevier Inc 01.03.2024
Subjects:
ISSN:0020-0255, 1872-6291
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract This paper mainly investigates the nonzero-sum games of nonlinear systems with unmatched uncertainty by using actor-critic neural networks. To handle the unmatched components, an auxiliary system with a modified value function is constructed, which transforms the robust stabilization issue into the optimal control issue. Then, a novel dynamic event-triggering condition is designed to further save bandwidth via introducing a dynamic variable. In addition, the actor-critic algorithm is employed in adaptive dynamic programming to achieve Nash equilibrium, which is tuned together with the control policy. By constructing appropriate Lyapunov functions, a criterion is established to ensure that the considered system is uniformly ultimately bounded. Finally, the effectiveness of the developed strategy is demonstrated by an example.
AbstractList This paper mainly investigates the nonzero-sum games of nonlinear systems with unmatched uncertainty by using actor-critic neural networks. To handle the unmatched components, an auxiliary system with a modified value function is constructed, which transforms the robust stabilization issue into the optimal control issue. Then, a novel dynamic event-triggering condition is designed to further save bandwidth via introducing a dynamic variable. In addition, the actor-critic algorithm is employed in adaptive dynamic programming to achieve Nash equilibrium, which is tuned together with the control policy. By constructing appropriate Lyapunov functions, a criterion is established to ensure that the considered system is uniformly ultimately bounded. Finally, the effectiveness of the developed strategy is demonstrated by an example.
ArticleNumber 120236
Author Cao, Jinde
Shen, Hao
Li, Ziwei
Wang, Jing
Author_xml – sequence: 1
  givenname: Hao
  orcidid: 0000-0001-7024-6573
  surname: Shen
  fullname: Shen, Hao
  email: haoshen@ahut.edu.cn
  organization: Anhui Provincial Key Laboratory of Power Electronics and Motion Control and School of Electrical and Information Engineering, Anhui University of Technology, Ma'anshan 243002, China
– sequence: 2
  givenname: Ziwei
  surname: Li
  fullname: Li, Ziwei
  email: ziweilim27@gmail.com
  organization: Anhui Provincial Key Laboratory of Power Electronics and Motion Control and School of Electrical and Information Engineering, Anhui University of Technology, Ma'anshan 243002, China
– sequence: 3
  givenname: Jing
  surname: Wang
  fullname: Wang, Jing
  email: jingwang08@126.com
  organization: Anhui Provincial Key Laboratory of Power Electronics and Motion Control and School of Electrical and Information Engineering, Anhui University of Technology, Ma'anshan 243002, China
– sequence: 4
  givenname: Jinde
  surname: Cao
  fullname: Cao, Jinde
  email: jdcao@seu.edu.cn
  organization: The School of Mathematics, Southeast University, Nanjing 210096, China
BookMark eNp9kLtOAzEQRS0UJJLAB9DtD2ywvQ9voIoiXhKCBmrLGc-uHHbtyHaCwtfjKIiCIs3cYu4Zac6EjKyzSMg1ozNGWX2znhkbZpzycsbSLOozMmaN4HnN52xExpRymlNeVRdkEsKaUlqKuh6T_tXZb_QuD9sh69SAIdsGY7tMQXQ-B2-igczi1qs-Rfxy_jPcZotM760a0gp3aGMevek69KgzpdUmmh3-FTbedV4NQzp6Sc5b1Qe8-s0p-Xi4f18-5S9vj8_LxUsOfC5i3tRYQaGAgkIuuCpaqHSz4kpTVgpdFbqqoWzrVQGac9GwElSqAxcgmlLwYkrE8S54F4LHVoKJKhpno1eml4zKgzS5lkmaPEiTR2mJZP_IjTeD8vuTzN2RwfTSzqCXAQxaQG08QpTamRP0D-D-ia4
CitedBy_id crossref_primary_10_1002_rnc_70178
crossref_primary_10_1016_j_ins_2025_122432
crossref_primary_10_1016_j_cnsns_2025_108937
crossref_primary_10_1016_j_ins_2025_122453
crossref_primary_10_1016_j_ins_2025_122651
crossref_primary_10_1016_j_ins_2025_122117
crossref_primary_10_1016_j_neucom_2025_131203
crossref_primary_10_1002_oca_70011
crossref_primary_10_1016_j_chaos_2025_116459
crossref_primary_10_1016_j_neucom_2025_129673
crossref_primary_10_1016_j_amc_2025_129716
crossref_primary_10_1016_j_oceaneng_2024_118251
Cites_doi 10.1109/TNNLS.2013.2281663
10.1016/j.neunet.2012.02.005
10.1109/TSMCC.2002.801727
10.1016/j.neucom.2019.07.029
10.1016/j.ins.2014.05.050
10.1109/TNNLS.2021.3107607
10.1016/j.ins.2009.01.002
10.1109/TSMC.2023.3257871
10.1109/TII.2021.3116084
10.1109/72.914523
10.1109/TNNLS.2016.2614002
10.1016/j.ins.2019.05.071
10.1016/j.ins.2018.06.022
10.3934/mbe.2023376
10.1109/TSMC.2018.2852810
10.1109/TNNLS.2021.3071545
10.1016/j.ins.2023.02.081
10.1016/0020-0255(78)90011-7
10.1109/TNNLS.2020.3009015
10.1016/j.ins.2020.08.022
10.1109/TNNLS.2018.2869896
10.1109/TCYB.2020.3004493
10.1016/j.ins.2013.12.050
10.1016/j.jfranklin.2022.06.043
10.1109/TAC.2014.2366855
10.1109/72.701174
10.1109/TNNLS.2021.3057438
10.1016/j.ins.2010.12.014
10.1109/JAS.2021.1003838
10.1109/TSMC.2018.2853089
10.1016/j.neunet.2020.01.016
10.1016/j.automatica.2010.02.018
10.1007/s11063-023-11189-1
10.1016/j.automatica.2012.09.019
10.1002/rnc.6550
10.1016/j.automatica.2008.08.017
10.1109/TAC.2007.910724
10.1016/j.neunet.2017.11.022
10.1109/TFUZZ.2019.2896544
10.1016/j.neunet.2022.04.013
10.1016/j.ins.2016.05.034
ContentType Journal Article
Copyright 2024 Elsevier Inc.
Copyright_xml – notice: 2024 Elsevier Inc.
DBID AAYXX
CITATION
DOI 10.1016/j.ins.2024.120236
DatabaseName CrossRef
DatabaseTitle CrossRef
DatabaseTitleList
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
Library & Information Science
EISSN 1872-6291
ExternalDocumentID 10_1016_j_ins_2024_120236
S002002552400149X
GrantInformation_xml – fundername: National Natural Science Foundation of China
  grantid: 62273006; 62173001
  funderid: https://doi.org/10.13039/501100001809
– fundername: Engineering Research Center of Biofilm Water Purification and Utilization Technology of Ministry of Education
  grantid: BWPU2023ZY02
– fundername: Natural Science Foundation for Excellent Young Scholars of Higher Education Institutions of Anhui Province
  grantid: 2022AH030049
– fundername: Natural Science Foundation for Distinguished Young Scholars of Higher Education Institutions of Anhui Province
  grantid: 2022AH020034
– fundername: University Synergy Innovation Program of Anhui Province
  grantid: GXXT-2023-020
GroupedDBID --K
--M
--Z
-~X
.DC
.~1
0R~
1B1
1OL
1RT
1~.
1~5
29I
4.4
457
4G.
5GY
5VS
7-5
71M
8P~
9JN
9JO
AAAKF
AAAKG
AABNK
AACTN
AAEDT
AAEDW
AAIAV
AAIKJ
AAKOC
AALRI
AAOAW
AAQFI
AAQXK
AARIN
AAXUO
AAYFN
ABAOU
ABBOA
ABEFU
ABFNM
ABJNI
ABMAC
ABTAH
ABUCO
ABXDB
ABYKQ
ACAZW
ACDAQ
ACGFS
ACNNM
ACRLP
ACZNC
ADBBV
ADEZE
ADGUI
ADJOM
ADMUD
ADTZH
AEBSH
AECPX
AEKER
AENEX
AFFNX
AFKWA
AFTJW
AGHFR
AGUBO
AGYEJ
AHHHB
AHJVU
AHZHX
AIALX
AIEXJ
AIGVJ
AIKHN
AITUG
AJBFU
AJOXV
ALMA_UNASSIGNED_HOLDINGS
AMFUW
AMRAJ
AOUOD
APLSM
ARUGR
ASPBG
AVWKF
AXJTR
AZFZN
BJAXD
BKOJK
BLXMC
CS3
DU5
EBS
EFJIC
EFLBG
EJD
EO8
EO9
EP2
EP3
F5P
FDB
FEDTE
FGOYB
FIRID
FNPLU
FYGXN
G-Q
GBLVA
GBOLZ
HAMUX
HLZ
HVGLF
HZ~
H~9
IHE
J1W
JJJVA
KOM
LG9
LY1
M41
MHUIS
MO0
MS~
N9A
O-L
O9-
OAUVE
OZT
P-8
P-9
P2P
PC.
Q38
R2-
RIG
ROL
RPZ
SBC
SDF
SDG
SDP
SDS
SES
SEW
SPC
SPCBC
SSB
SSD
SST
SSV
SSW
SSZ
T5K
TN5
TWZ
UHS
WH7
WUQ
XPP
YYP
ZMT
ZY4
~02
~G-
77I
9DU
AATTM
AAXKI
AAYWO
AAYXX
ABWVN
ACLOT
ACRPL
ACVFH
ADCNI
ADNMO
ADVLN
AEIPS
AEUPX
AFJKZ
AFPUW
AGQPQ
AIGII
AIIUN
AKBMS
AKRWK
AKYEP
ANKPU
APXCP
CITATION
EFKBS
~HD
ID FETCH-LOGICAL-c297t-86e5c3ac0cae272a3fc5d8b2ad0147d53d56c4f6b3cd227814ca3acc27c784723
ISICitedReferencesCount 13
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001179524900001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 0020-0255
IngestDate Sat Nov 29 06:57:01 EST 2025
Tue Nov 18 22:12:03 EST 2025
Sat Feb 24 15:50:00 EST 2024
IsPeerReviewed true
IsScholarly true
Keywords Nonzero-sum games
Actor-critic neural networks
Adaptive dynamic programming
Dynamic event-triggered mechanism
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c297t-86e5c3ac0cae272a3fc5d8b2ad0147d53d56c4f6b3cd227814ca3acc27c784723
ORCID 0000-0001-7024-6573
ParticipantIDs crossref_citationtrail_10_1016_j_ins_2024_120236
crossref_primary_10_1016_j_ins_2024_120236
elsevier_sciencedirect_doi_10_1016_j_ins_2024_120236
PublicationCentury 2000
PublicationDate March 2024
2024-03-00
PublicationDateYYYYMMDD 2024-03-01
PublicationDate_xml – month: 03
  year: 2024
  text: March 2024
PublicationDecade 2020
PublicationTitle Information sciences
PublicationYear 2024
Publisher Elsevier Inc
Publisher_xml – name: Elsevier Inc
References Djordjevic, Tao, Song, He, Gao, Stojanović (br0050) 2023; 20
Xue, Luo, Liu (br0350) 2020; 50
Vamvoudakis, Lewis (br0240) 2010; 46
Wang, Li, Liu, Mu (br0280) 2016; 366
Wan, Wei, Zhang, Wu (br0260) 2022
Su, Zhang, Liang, Mu (br0220) 2019; 368
Zhang, Su, Zhang, Luo (br0410) 2019; 27
Wan, Yang, Zhang, Wu (br0270) 2022
Zhang, Zhao, Wang (br0420) 2018; 29
Liu, Wei (br0090) 2014; 25
Zhang, Zhao, Liu, Alippi, Zhang (br0430) 2023; 33
Murray, Cox, Lendaris, Saeks (br0140) 2002; 32
Lu, Xu, Herrera-Viedma, Han (br0110) 2021; 547
Yang, He, Wei, Luo (br0400) 2018; 463
Narayanan, Sahoo, Jagannathan, George (br0150) 2019; 30
Song, Wu, Song, Stojanovic (br0210) 2023; 55
He, Wen, Stojanovic, Liu, Luan (br0070) 2022; 359
Vrabie, Pastravanu, Abu-Khalaf, Lewis (br0250) 2009; 45
Tong, Li, Shi (br0230) 2009; 179
Razzaghi (br0170) 1978; 16
Zhong, He, Prokhorov (br0450) 2013
Aliev, Pedrycz, Guirimov, Aliev, Ilhan, Babagil, Mammadli (br0010) 2011; 181
Liu, Sun, Si, Guo, Mei (br0100) 2012; 32
Yang, He (br0390) 2020; 50
Shi, Yin, Liu, Zhang (br0190) 2014; 265
Wei, Wang, Zhong, Wu (br0330) 2021; 8
Xue, Luo, Liu, Gao (br0370) 2022; 152
Bhasin, Kamalapurkar, Johnson, Vamvoudakis, Lewis, Dixon (br0030) 2013; 49
Chen, Chen (br0040) 2007; 52
Li, Wang, Zhao, Qiao (br0080) 2023; 631
Wang, Wei, Liu (br0310) 2020; 506
Xue, Luo, Liu (br0360) 2021; 32
Ballesteros, Chairez, Poznyak (br0020) 2020; 125
Zhao, Sun, Wang, Chen (br0440) 2022; 33
Pedrycz (br0160) 1998; 9
Wang, Liu, Li, Ma (br0290) 2014; 282
Mu, Wang, Qiu (br0130) 2022; 52
Shen, Hu, Wang, Cao, Qian (br0180) 2023; 34
Wang, Wu, Shen, Cao, Rutkowski (br0300) 2023; 53
Mu, Wang, Ni (br0120) 2022; 33
Werbos (br0340) 1977; 22
Si, Wang (br0200) 2001; 12
Girard (br0060) 2015; 60
Yang, He (br0380) 2018; 99
Wei, Lu, Zhou, Cheng, Wang (br0320) 2021; 18
Wei (10.1016/j.ins.2024.120236_br0320) 2021; 18
Xue (10.1016/j.ins.2024.120236_br0370) 2022; 152
Zhong (10.1016/j.ins.2024.120236_br0450) 2013
Liu (10.1016/j.ins.2024.120236_br0100) 2012; 32
Yang (10.1016/j.ins.2024.120236_br0380) 2018; 99
Zhang (10.1016/j.ins.2024.120236_br0420) 2018; 29
Wang (10.1016/j.ins.2024.120236_br0290) 2014; 282
Narayanan (10.1016/j.ins.2024.120236_br0150) 2019; 30
Bhasin (10.1016/j.ins.2024.120236_br0030) 2013; 49
Wan (10.1016/j.ins.2024.120236_br0270)
Yang (10.1016/j.ins.2024.120236_br0390) 2020; 50
Wan (10.1016/j.ins.2024.120236_br0260)
Ballesteros (10.1016/j.ins.2024.120236_br0020) 2020; 125
Su (10.1016/j.ins.2024.120236_br0220) 2019; 368
Xue (10.1016/j.ins.2024.120236_br0350) 2020; 50
Murray (10.1016/j.ins.2024.120236_br0140) 2002; 32
Zhao (10.1016/j.ins.2024.120236_br0440) 2022; 33
Zhang (10.1016/j.ins.2024.120236_br0410) 2019; 27
Zhang (10.1016/j.ins.2024.120236_br0430) 2023; 33
Li (10.1016/j.ins.2024.120236_br0080) 2023; 631
Yang (10.1016/j.ins.2024.120236_br0400) 2018; 463
Shi (10.1016/j.ins.2024.120236_br0190) 2014; 265
Aliev (10.1016/j.ins.2024.120236_br0010) 2011; 181
Xue (10.1016/j.ins.2024.120236_br0360) 2021; 32
Wang (10.1016/j.ins.2024.120236_br0310) 2020; 506
Pedrycz (10.1016/j.ins.2024.120236_br0160) 1998; 9
Mu (10.1016/j.ins.2024.120236_br0120) 2022; 33
Vamvoudakis (10.1016/j.ins.2024.120236_br0240) 2010; 46
Tong (10.1016/j.ins.2024.120236_br0230) 2009; 179
Vrabie (10.1016/j.ins.2024.120236_br0250) 2009; 45
Djordjevic (10.1016/j.ins.2024.120236_br0050) 2023; 20
Shen (10.1016/j.ins.2024.120236_br0180) 2023; 34
Chen (10.1016/j.ins.2024.120236_br0040) 2007; 52
Mu (10.1016/j.ins.2024.120236_br0130) 2022; 52
Song (10.1016/j.ins.2024.120236_br0210) 2023; 55
Wang (10.1016/j.ins.2024.120236_br0280) 2016; 366
Wang (10.1016/j.ins.2024.120236_br0300) 2023; 53
Si (10.1016/j.ins.2024.120236_br0200) 2001; 12
Razzaghi (10.1016/j.ins.2024.120236_br0170) 1978; 16
Girard (10.1016/j.ins.2024.120236_br0060) 2015; 60
He (10.1016/j.ins.2024.120236_br0070) 2022; 359
Lu (10.1016/j.ins.2024.120236_br0110) 2021; 547
Liu (10.1016/j.ins.2024.120236_br0090) 2014; 25
Werbos (10.1016/j.ins.2024.120236_br0340) 1977; 22
Wei (10.1016/j.ins.2024.120236_br0330) 2021; 8
References_xml – volume: 52
  start-page: 2365
  year: 2007
  end-page: 2369
  ident: br0040
  article-title: Robust nonlinear observer for Lipschitz nonlinear systems subject to disturbances
  publication-title: IEEE Trans. Autom. Control
– volume: 53
  start-page: 4934
  year: 2023
  end-page: 4943
  ident: br0300
  article-title: A decentralized learning control scheme for constrained nonlinear interconnected systems based on dynamic event-triggered mechanism
  publication-title: IEEE Trans. Syst. Man Cybern. Syst.
– volume: 34
  start-page: 2682
  year: 2023
  end-page: 2692
  ident: br0180
  article-title: Non-fragile
  publication-title: IEEE Trans. Neural Netw. Learn. Syst.
– start-page: 1
  year: 2013
  end-page: 8
  ident: br0450
  article-title: Robust controller design of continuous-time nonlinear system using neural network
  publication-title: Proc. Int. Joint Conf. Neural Netw
– volume: 60
  start-page: 1992
  year: 2015
  end-page: 1997
  ident: br0060
  article-title: Dynamic triggering mechanisms for event-triggered control
  publication-title: IEEE Trans. Autom. Control
– volume: 29
  start-page: 37
  year: 2018
  end-page: 50
  ident: br0420
  article-title: Event-based robust control for uncertain nonlinear systems using adaptive dynamic programming
  publication-title: IEEE Trans. Neural Netw. Learn. Syst.
– volume: 50
  start-page: 3189
  year: 2020
  end-page: 3199
  ident: br0350
  article-title: Event-triggered adaptive dynamic programming for zero-sum game of partially unknown continuous-time nonlinear systems
  publication-title: IEEE Trans. Syst. Man Cybern. Syst.
– volume: 181
  start-page: 1591
  year: 2011
  end-page: 1608
  ident: br0010
  article-title: Type-2 fuzzy neural networks with fuzzy clustering and differential evolution optimization
  publication-title: Inf. Sci.
– volume: 50
  start-page: 3145
  year: 2020
  end-page: 3157
  ident: br0390
  article-title: Event-triggered robust stabilization of nonlinear input-constrained systems using single network adaptive critic designs
  publication-title: IEEE Trans. Syst. Man Cybern. Syst.
– volume: 20
  start-page: 8561
  year: 2023
  end-page: 8582
  ident: br0050
  article-title: Data-driven control of hydraulic servo actuator: an event-triggered adaptive dynamic programming approach
  publication-title: Math. Biosci. Eng.
– volume: 33
  start-page: 3086
  year: 2023
  end-page: 3106
  ident: br0430
  article-title: Event-triggered robust control for multi-player nonzero-sum games with input constraints and mismatched uncertainties
  publication-title: Int. J. Robust Nonlinear Control
– volume: 12
  start-page: 264
  year: 2001
  end-page: 276
  ident: br0200
  article-title: Online learning control by association and reinforcement
  publication-title: IEEE Trans. Neural Netw.
– volume: 506
  start-page: 457
  year: 2020
  end-page: 470
  ident: br0310
  article-title: Event-triggered adaptive dynamic programming for discrete-time multi-player games
  publication-title: Inf. Sci.
– volume: 265
  start-page: 123
  year: 2014
  end-page: 138
  ident: br0190
  article-title: Robust control on saturated Markov jump systems with missing information
  publication-title: Inf. Sci.
– volume: 33
  start-page: 1905
  year: 2022
  end-page: 1913
  ident: br0440
  article-title: Event-triggered ADP for nonzero-sum games of unknown nonlinear systems
  publication-title: IEEE Trans. Neural Netw. Learn. Syst.
– volume: 366
  start-page: 121
  year: 2016
  end-page: 133
  ident: br0280
  article-title: Data-based robust optimal control of continuous-time affine nonlinear systems with matched uncertainties
  publication-title: Inf. Sci.
– volume: 99
  start-page: 19
  year: 2018
  end-page: 30
  ident: br0380
  article-title: Self-learning robust optimal control for continuous-time nonlinear systems with mismatched disturbances
  publication-title: Neural Netw.
– volume: 125
  start-page: 153
  year: 2020
  end-page: 164
  ident: br0020
  article-title: Robust min–max optimal control design for systems with uncertain models: a neural dynamic programming approach
  publication-title: Neural Netw.
– volume: 46
  start-page: 878
  year: 2010
  end-page: 888
  ident: br0240
  article-title: Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problem
  publication-title: Automatica
– volume: 9
  start-page: 601
  year: 1998
  end-page: 612
  ident: br0160
  article-title: Conditional fuzzy clustering in the design of radial basis function neural networks
  publication-title: IEEE Trans. Neural Netw.
– volume: 547
  start-page: 910
  year: 2021
  end-page: 930
  ident: br0110
  article-title: Consensus of large-scale group decision making in social network: the minimum cost model based on robust optimization
  publication-title: Inf. Sci.
– volume: 16
  start-page: 61
  year: 1978
  end-page: 73
  ident: br0170
  article-title: Solution of the matrix Riccati equation in optimal control
  publication-title: Inf. Sci.
– year: 2022
  ident: br0260
  article-title: Networked output-feedback MPC: a bounded dynamic variable and time-varying threshold-dependent event-based approach
– volume: 32
  start-page: 140
  year: 2002
  end-page: 153
  ident: br0140
  article-title: Adaptive dynamic programming
  publication-title: IEEE Trans. Syst. Man Cybern., Part C, Appl. Rev.
– volume: 463
  start-page: 307
  year: 2018
  end-page: 322
  ident: br0400
  article-title: Reinforcement learning for robust adaptive control of partially unknown nonlinear systems subject to unmatched uncertainties
  publication-title: Inf. Sci.
– volume: 55
  start-page: 8997
  year: 2023
  end-page: 9018
  ident: br0210
  article-title: Switching-like event-triggered state estimation for reaction-diffusion neural networks against DoS attacks
  publication-title: Neural Process. Lett.
– volume: 359
  start-page: 6939
  year: 2022
  end-page: 6957
  ident: br0070
  article-title: Finite-time control of discrete-time semi-Markov jump linear systems: a self-triggered MPC approach
  publication-title: J. Franklin Inst.
– volume: 8
  start-page: 423
  year: 2021
  end-page: 431
  ident: br0330
  article-title: Consensus control of leader-following multi-agent systems in directed topology with heterogeneous disturbances
  publication-title: IEEE/CAA J. Autom. Sin.
– volume: 22
  start-page: 25
  year: 1977
  end-page: 38
  ident: br0340
  article-title: Advanced forecasting methods for global crisis warning and models of intelligence
  publication-title: Gen. Syst. Yearbook
– volume: 49
  start-page: 82
  year: 2013
  end-page: 92
  ident: br0030
  article-title: A novel actor–critic–identifier architecture for approximate optimal control of uncertain nonlinear systems
  publication-title: Automatica
– volume: 33
  start-page: 4437
  year: 2022
  end-page: 4450
  ident: br0120
  article-title: Adaptive learning and sampled-control for nonlinear game systems using dynamic event-triggering strategy
  publication-title: IEEE Trans. Neural Netw. Learn. Syst.
– volume: 368
  start-page: 84
  year: 2019
  end-page: 98
  ident: br0220
  article-title: Online event-triggered adaptive critic design for non-zero-sum games of partially unknown networked systems
  publication-title: Neurocomputing
– volume: 152
  start-page: 212
  year: 2022
  end-page: 223
  ident: br0370
  article-title: Event-triggered integral reinforcement learning for nonzero-sum games with asymmetric input saturation
  publication-title: Neural Netw.
– volume: 27
  start-page: 2202
  year: 2019
  end-page: 2214
  ident: br0410
  article-title: Event-triggered adaptive dynamic programming for non-zero-sum games of unknown nonlinear systems via generalized fuzzy hyperbolic models
  publication-title: IEEE Trans. Fuzzy Syst.
– volume: 18
  start-page: 3926
  year: 2021
  end-page: 3935
  ident: br0320
  article-title: Event triggered near optimal control of discrete-time constrained nonlinear systems with application to a boiler turbine system
  publication-title: IEEE Trans. Ind. Inform.
– volume: 32
  start-page: 2939
  year: 2021
  end-page: 2951
  ident: br0360
  article-title: Event-triggered adaptive dynamic programming for unmatched uncertain nonlinear continuous-time systems
  publication-title: IEEE Trans. Neural Netw. Learn. Syst.
– volume: 30
  start-page: 1512
  year: 2019
  end-page: 1522
  ident: br0150
  article-title: Approximate optimal distributed control of nonlinear interconnected systems using event-triggered nonzero-sum games
  publication-title: IEEE Trans. Neural Netw. Learn. Syst.
– volume: 25
  start-page: 621
  year: 2014
  end-page: 634
  ident: br0090
  article-title: Policy iteration adaptive dynamic programming algorithm for discrete-time nonlinear systems
  publication-title: IEEE Trans. Neural Netw. Learn. Syst.
– volume: 52
  start-page: 2200
  year: 2022
  end-page: 2213
  ident: br0130
  article-title: Dynamic event-triggering neural learning control for partially unknown nonlinear systems
  publication-title: IEEE Trans. Cybern.
– volume: 179
  start-page: 1319
  year: 2009
  end-page: 1332
  ident: br0230
  article-title: Fuzzy adaptive backstepping robust control for SISO nonlinear system with dynamic uncertainties
  publication-title: Inf. Sci.
– year: 2022
  ident: br0270
  article-title: Hybrid adjusting variables-dependent event-based finite-time state estimation for two-time-scale Markov jump complex networks
– volume: 45
  start-page: 477
  year: 2009
  end-page: 484
  ident: br0250
  article-title: Adaptive optimal control for continuous-time linear systems based on policy iteration
  publication-title: Automatica
– volume: 282
  start-page: 167
  year: 2014
  end-page: 179
  ident: br0290
  article-title: Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming
  publication-title: Inf. Sci.
– volume: 32
  start-page: 229
  year: 2012
  end-page: 235
  ident: br0100
  article-title: A boundedness result for the direct heuristic dynamic programming
  publication-title: Neural Netw.
– volume: 631
  start-page: 412
  year: 2023
  end-page: 428
  ident: br0080
  article-title: Event-triggered constrained neural critic control of nonlinear continuous-time multiplayer nonzero-sum games
  publication-title: Inf. Sci.
– volume: 25
  start-page: 621
  issue: 3
  year: 2014
  ident: 10.1016/j.ins.2024.120236_br0090
  article-title: Policy iteration adaptive dynamic programming algorithm for discrete-time nonlinear systems
  publication-title: IEEE Trans. Neural Netw. Learn. Syst.
  doi: 10.1109/TNNLS.2013.2281663
– volume: 32
  start-page: 229
  year: 2012
  ident: 10.1016/j.ins.2024.120236_br0100
  article-title: A boundedness result for the direct heuristic dynamic programming
  publication-title: Neural Netw.
  doi: 10.1016/j.neunet.2012.02.005
– volume: 32
  start-page: 140
  issue: 2
  year: 2002
  ident: 10.1016/j.ins.2024.120236_br0140
  article-title: Adaptive dynamic programming
  publication-title: IEEE Trans. Syst. Man Cybern., Part C, Appl. Rev.
  doi: 10.1109/TSMCC.2002.801727
– volume: 368
  start-page: 84
  year: 2019
  ident: 10.1016/j.ins.2024.120236_br0220
  article-title: Online event-triggered adaptive critic design for non-zero-sum games of partially unknown networked systems
  publication-title: Neurocomputing
  doi: 10.1016/j.neucom.2019.07.029
– volume: 282
  start-page: 167
  year: 2014
  ident: 10.1016/j.ins.2024.120236_br0290
  article-title: Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming
  publication-title: Inf. Sci.
  doi: 10.1016/j.ins.2014.05.050
– volume: 34
  start-page: 2682
  issue: 5
  year: 2023
  ident: 10.1016/j.ins.2024.120236_br0180
  article-title: Non-fragile H∞ synchronization for Markov jump singularly perturbed coupled neural networks subject to double-layer switching regulation
  publication-title: IEEE Trans. Neural Netw. Learn. Syst.
  doi: 10.1109/TNNLS.2021.3107607
– volume: 179
  start-page: 1319
  issue: 9
  year: 2009
  ident: 10.1016/j.ins.2024.120236_br0230
  article-title: Fuzzy adaptive backstepping robust control for SISO nonlinear system with dynamic uncertainties
  publication-title: Inf. Sci.
  doi: 10.1016/j.ins.2009.01.002
– volume: 53
  start-page: 4934
  issue: 8
  year: 2023
  ident: 10.1016/j.ins.2024.120236_br0300
  article-title: A decentralized learning control scheme for constrained nonlinear interconnected systems based on dynamic event-triggered mechanism
  publication-title: IEEE Trans. Syst. Man Cybern. Syst.
  doi: 10.1109/TSMC.2023.3257871
– volume: 18
  start-page: 3926
  issue: 6
  year: 2021
  ident: 10.1016/j.ins.2024.120236_br0320
  article-title: Event triggered near optimal control of discrete-time constrained nonlinear systems with application to a boiler turbine system
  publication-title: IEEE Trans. Ind. Inform.
  doi: 10.1109/TII.2021.3116084
– volume: 12
  start-page: 264
  issue: 2
  year: 2001
  ident: 10.1016/j.ins.2024.120236_br0200
  article-title: Online learning control by association and reinforcement
  publication-title: IEEE Trans. Neural Netw.
  doi: 10.1109/72.914523
– volume: 29
  start-page: 37
  issue: 1
  year: 2018
  ident: 10.1016/j.ins.2024.120236_br0420
  article-title: Event-based robust control for uncertain nonlinear systems using adaptive dynamic programming
  publication-title: IEEE Trans. Neural Netw. Learn. Syst.
  doi: 10.1109/TNNLS.2016.2614002
– start-page: 1
  year: 2013
  ident: 10.1016/j.ins.2024.120236_br0450
  article-title: Robust controller design of continuous-time nonlinear system using neural network
– ident: 10.1016/j.ins.2024.120236_br0270
– volume: 506
  start-page: 457
  year: 2020
  ident: 10.1016/j.ins.2024.120236_br0310
  article-title: Event-triggered adaptive dynamic programming for discrete-time multi-player games
  publication-title: Inf. Sci.
  doi: 10.1016/j.ins.2019.05.071
– volume: 463
  start-page: 307
  year: 2018
  ident: 10.1016/j.ins.2024.120236_br0400
  article-title: Reinforcement learning for robust adaptive control of partially unknown nonlinear systems subject to unmatched uncertainties
  publication-title: Inf. Sci.
  doi: 10.1016/j.ins.2018.06.022
– volume: 20
  start-page: 8561
  issue: 5
  year: 2023
  ident: 10.1016/j.ins.2024.120236_br0050
  article-title: Data-driven control of hydraulic servo actuator: an event-triggered adaptive dynamic programming approach
  publication-title: Math. Biosci. Eng.
  doi: 10.3934/mbe.2023376
– volume: 50
  start-page: 3189
  issue: 9
  year: 2020
  ident: 10.1016/j.ins.2024.120236_br0350
  article-title: Event-triggered adaptive dynamic programming for zero-sum game of partially unknown continuous-time nonlinear systems
  publication-title: IEEE Trans. Syst. Man Cybern. Syst.
  doi: 10.1109/TSMC.2018.2852810
– volume: 33
  start-page: 1905
  issue: 5
  year: 2022
  ident: 10.1016/j.ins.2024.120236_br0440
  article-title: Event-triggered ADP for nonzero-sum games of unknown nonlinear systems
  publication-title: IEEE Trans. Neural Netw. Learn. Syst.
  doi: 10.1109/TNNLS.2021.3071545
– volume: 22
  start-page: 25
  year: 1977
  ident: 10.1016/j.ins.2024.120236_br0340
  article-title: Advanced forecasting methods for global crisis warning and models of intelligence
  publication-title: Gen. Syst. Yearbook
– volume: 631
  start-page: 412
  year: 2023
  ident: 10.1016/j.ins.2024.120236_br0080
  article-title: Event-triggered constrained neural critic control of nonlinear continuous-time multiplayer nonzero-sum games
  publication-title: Inf. Sci.
  doi: 10.1016/j.ins.2023.02.081
– volume: 16
  start-page: 61
  issue: 1
  year: 1978
  ident: 10.1016/j.ins.2024.120236_br0170
  article-title: Solution of the matrix Riccati equation in optimal control
  publication-title: Inf. Sci.
  doi: 10.1016/0020-0255(78)90011-7
– volume: 32
  start-page: 2939
  issue: 7
  year: 2021
  ident: 10.1016/j.ins.2024.120236_br0360
  article-title: Event-triggered adaptive dynamic programming for unmatched uncertain nonlinear continuous-time systems
  publication-title: IEEE Trans. Neural Netw. Learn. Syst.
  doi: 10.1109/TNNLS.2020.3009015
– volume: 547
  start-page: 910
  year: 2021
  ident: 10.1016/j.ins.2024.120236_br0110
  article-title: Consensus of large-scale group decision making in social network: the minimum cost model based on robust optimization
  publication-title: Inf. Sci.
  doi: 10.1016/j.ins.2020.08.022
– volume: 30
  start-page: 1512
  issue: 5
  year: 2019
  ident: 10.1016/j.ins.2024.120236_br0150
  article-title: Approximate optimal distributed control of nonlinear interconnected systems using event-triggered nonzero-sum games
  publication-title: IEEE Trans. Neural Netw. Learn. Syst.
  doi: 10.1109/TNNLS.2018.2869896
– volume: 52
  start-page: 2200
  issue: 4
  year: 2022
  ident: 10.1016/j.ins.2024.120236_br0130
  article-title: Dynamic event-triggering neural learning control for partially unknown nonlinear systems
  publication-title: IEEE Trans. Cybern.
  doi: 10.1109/TCYB.2020.3004493
– volume: 265
  start-page: 123
  year: 2014
  ident: 10.1016/j.ins.2024.120236_br0190
  article-title: Robust control on saturated Markov jump systems with missing information
  publication-title: Inf. Sci.
  doi: 10.1016/j.ins.2013.12.050
– volume: 359
  start-page: 6939
  issue: 13
  year: 2022
  ident: 10.1016/j.ins.2024.120236_br0070
  article-title: Finite-time control of discrete-time semi-Markov jump linear systems: a self-triggered MPC approach
  publication-title: J. Franklin Inst.
  doi: 10.1016/j.jfranklin.2022.06.043
– volume: 60
  start-page: 1992
  issue: 7
  year: 2015
  ident: 10.1016/j.ins.2024.120236_br0060
  article-title: Dynamic triggering mechanisms for event-triggered control
  publication-title: IEEE Trans. Autom. Control
  doi: 10.1109/TAC.2014.2366855
– volume: 9
  start-page: 601
  issue: 4
  year: 1998
  ident: 10.1016/j.ins.2024.120236_br0160
  article-title: Conditional fuzzy clustering in the design of radial basis function neural networks
  publication-title: IEEE Trans. Neural Netw.
  doi: 10.1109/72.701174
– volume: 33
  start-page: 4437
  issue: 9
  year: 2022
  ident: 10.1016/j.ins.2024.120236_br0120
  article-title: Adaptive learning and sampled-control for nonlinear game systems using dynamic event-triggering strategy
  publication-title: IEEE Trans. Neural Netw. Learn. Syst.
  doi: 10.1109/TNNLS.2021.3057438
– volume: 181
  start-page: 1591
  issue: 9
  year: 2011
  ident: 10.1016/j.ins.2024.120236_br0010
  article-title: Type-2 fuzzy neural networks with fuzzy clustering and differential evolution optimization
  publication-title: Inf. Sci.
  doi: 10.1016/j.ins.2010.12.014
– volume: 8
  start-page: 423
  issue: 2
  year: 2021
  ident: 10.1016/j.ins.2024.120236_br0330
  article-title: Consensus control of leader-following multi-agent systems in directed topology with heterogeneous disturbances
  publication-title: IEEE/CAA J. Autom. Sin.
  doi: 10.1109/JAS.2021.1003838
– volume: 50
  start-page: 3145
  issue: 9
  year: 2020
  ident: 10.1016/j.ins.2024.120236_br0390
  article-title: Event-triggered robust stabilization of nonlinear input-constrained systems using single network adaptive critic designs
  publication-title: IEEE Trans. Syst. Man Cybern. Syst.
  doi: 10.1109/TSMC.2018.2853089
– volume: 125
  start-page: 153
  year: 2020
  ident: 10.1016/j.ins.2024.120236_br0020
  article-title: Robust min–max optimal control design for systems with uncertain models: a neural dynamic programming approach
  publication-title: Neural Netw.
  doi: 10.1016/j.neunet.2020.01.016
– ident: 10.1016/j.ins.2024.120236_br0260
– volume: 46
  start-page: 878
  issue: 5
  year: 2010
  ident: 10.1016/j.ins.2024.120236_br0240
  article-title: Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problem
  publication-title: Automatica
  doi: 10.1016/j.automatica.2010.02.018
– volume: 55
  start-page: 8997
  issue: 7
  year: 2023
  ident: 10.1016/j.ins.2024.120236_br0210
  article-title: Switching-like event-triggered state estimation for reaction-diffusion neural networks against DoS attacks
  publication-title: Neural Process. Lett.
  doi: 10.1007/s11063-023-11189-1
– volume: 49
  start-page: 82
  issue: 1
  year: 2013
  ident: 10.1016/j.ins.2024.120236_br0030
  article-title: A novel actor–critic–identifier architecture for approximate optimal control of uncertain nonlinear systems
  publication-title: Automatica
  doi: 10.1016/j.automatica.2012.09.019
– volume: 33
  start-page: 3086
  issue: 5
  year: 2023
  ident: 10.1016/j.ins.2024.120236_br0430
  article-title: Event-triggered robust control for multi-player nonzero-sum games with input constraints and mismatched uncertainties
  publication-title: Int. J. Robust Nonlinear Control
  doi: 10.1002/rnc.6550
– volume: 45
  start-page: 477
  issue: 2
  year: 2009
  ident: 10.1016/j.ins.2024.120236_br0250
  article-title: Adaptive optimal control for continuous-time linear systems based on policy iteration
  publication-title: Automatica
  doi: 10.1016/j.automatica.2008.08.017
– volume: 52
  start-page: 2365
  issue: 12
  year: 2007
  ident: 10.1016/j.ins.2024.120236_br0040
  article-title: Robust nonlinear observer for Lipschitz nonlinear systems subject to disturbances
  publication-title: IEEE Trans. Autom. Control
  doi: 10.1109/TAC.2007.910724
– volume: 99
  start-page: 19
  year: 2018
  ident: 10.1016/j.ins.2024.120236_br0380
  article-title: Self-learning robust optimal control for continuous-time nonlinear systems with mismatched disturbances
  publication-title: Neural Netw.
  doi: 10.1016/j.neunet.2017.11.022
– volume: 27
  start-page: 2202
  issue: 11
  year: 2019
  ident: 10.1016/j.ins.2024.120236_br0410
  article-title: Event-triggered adaptive dynamic programming for non-zero-sum games of unknown nonlinear systems via generalized fuzzy hyperbolic models
  publication-title: IEEE Trans. Fuzzy Syst.
  doi: 10.1109/TFUZZ.2019.2896544
– volume: 152
  start-page: 212
  year: 2022
  ident: 10.1016/j.ins.2024.120236_br0370
  article-title: Event-triggered integral reinforcement learning for nonzero-sum games with asymmetric input saturation
  publication-title: Neural Netw.
  doi: 10.1016/j.neunet.2022.04.013
– volume: 366
  start-page: 121
  year: 2016
  ident: 10.1016/j.ins.2024.120236_br0280
  article-title: Data-based robust optimal control of continuous-time affine nonlinear systems with matched uncertainties
  publication-title: Inf. Sci.
  doi: 10.1016/j.ins.2016.05.034
SSID ssj0004766
Score 2.4935722
Snippet This paper mainly investigates the nonzero-sum games of nonlinear systems with unmatched uncertainty by using actor-critic neural networks. To handle the...
SourceID crossref
elsevier
SourceType Enrichment Source
Index Database
Publisher
StartPage 120236
SubjectTerms Actor-critic neural networks
Adaptive dynamic programming
Dynamic event-triggered mechanism
Nonzero-sum games
Title Nonzero-sum games using actor-critic neural networks: A dynamic event-triggered adaptive dynamic programming
URI https://dx.doi.org/10.1016/j.ins.2024.120236
Volume 662
WOSCitedRecordID wos001179524900001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVESC
  databaseName: ScienceDirect database
  customDbUrl:
  eissn: 1872-6291
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0004766
  issn: 0020-0255
  databaseCode: AIEXJ
  dateStart: 19950101
  isFulltext: true
  titleUrlDefault: https://www.sciencedirect.com
  providerName: Elsevier
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1Lb9NAEF6FlgMcEBQQLRTtAXHAWpSsH2tzi1BR4RAhUaSIi7We3VSJgh2laaj665l92SZqET1wsaLVeG1lPs_O7H4zQ8gbPdPA07xiGlTFElAxK6CYMQy2BOSZLEAr22xCTCb5dFp8HQy2IRdmuxR1nV9dFav_qmocQ2Wb1Nk7qLudFAfwNyodr6h2vP6T4idNfa3XDcNnRueGAxtd2v0A21iHgW1tEJkylqic2pHAL1x-unLd6SNb1IltMG4_N508I6nkyjKMgoAndf0My94i0OHbVMjIr6ytx_7NZ4GcyqblAFkiwY_5Lz3vtvU9QTjMbE9HGj-kdH-PgicdSavNGRgyE7307W7mzbCznCPTxz270ai7_YUFRiKmvjpP3neyfxbQ3lnYWrphYLItSpyiNFOUbop7ZJ-LtEBruD_-fDL90mXUCnfKHd47nIdbZuDOe9zs0fS8lLPH5JEPL-jYweIJGej6gDzsFZ08IMc-VYW-pT2FUW_kn5JlD0DUAohaANE-gKgDEA0A-kDH1KOD7sCHBvi0Aj34PCPfP52cfTxlvicHA16IDcsznUIsYQhSc8FlPINU5RWXCmNtodJYpRkks6yKQZks61ECEsWBCxDoCPH4Odmrm1q_IDTPlKziKqlG5qgXV06daDWsEj3K0PHMhodkGP7XEnzBetM3ZVneqs9D8q69ZeWqtfxNOAnKKv1H4dzIEoF3-21Hd3nGS_Kg-x5ekb3N-lIfk_uw3cwv1q896n4DKlGjXA
linkProvider Elsevier
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Nonzero-sum+games+using+actor-critic+neural+networks%3A+A+dynamic+event-triggered+adaptive+dynamic+programming&rft.jtitle=Information+sciences&rft.au=Shen%2C+Hao&rft.au=Li%2C+Ziwei&rft.au=Wang%2C+Jing&rft.au=Cao%2C+Jinde&rft.date=2024-03-01&rft.issn=0020-0255&rft.volume=662&rft.spage=120236&rft_id=info:doi/10.1016%2Fj.ins.2024.120236&rft.externalDBID=n%2Fa&rft.externalDocID=10_1016_j_ins_2024_120236
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0020-0255&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0020-0255&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0020-0255&client=summon