A Pursuit Strategy for Multi-Agent Pursuit-Evasion Game via Multi-Agent Deep Deterministic Policy Gradient Algorithm

This paper studies a classical pursuit-evasion problem. The pursuer attempts to capture the faster evader in a bounded area. The velocity of evader is 1.2 times as fast as the pursuers'. All of them have adaptive strategies. We use game theory to model the multi-agent pursuit-evasion game and p...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Proceedings of ... IEEE International Conference on Unmanned Systems (Online) S. 418 - 423
Hauptverfasser: Ye, Jianfeng, Wang, Qing, Ma, Bei, Wu, Yongbao, Xue, Lei
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 28.10.2022
Schlagworte:
Adaptation models
adaptive strategy
Convergence
Games
MADDPG
multi-agent
Nash equilibrium
Neural networks
Training
ISSN:2771-7372
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract This paper studies a classical pursuit-evasion problem. The pursuer attempts to capture the faster evader in a bounded area. The velocity of evader is 1.2 times as fast as the pursuers'. All of them have adaptive strategies. We use game theory to model the multi-agent pursuit-evasion game and prove that the game model has Nash equilibrium. Then, we modify the multi-agent deep deterministic policy gradient (MADDPG) algorithm for seeking the Nash equilibrium. The simulation examples are given to illustrate the effectiveness of the designed method.
AbstractList This paper studies a classical pursuit-evasion problem. The pursuer attempts to capture the faster evader in a bounded area. The velocity of evader is 1.2 times as fast as the pursuers'. All of them have adaptive strategies. We use game theory to model the multi-agent pursuit-evasion game and prove that the game model has Nash equilibrium. Then, we modify the multi-agent deep deterministic policy gradient (MADDPG) algorithm for seeking the Nash equilibrium. The simulation examples are given to illustrate the effectiveness of the designed method.
Author Xue, Lei
Wu, Yongbao
Wang, Qing
Ye, Jianfeng
Ma, Bei
Author_xml – sequence: 1
  givenname: Jianfeng
  surname: Ye
  fullname: Ye, Jianfeng
  email: yjfsomebody@163.com
  organization: School of Automation, Southeast University,Key Laboratory of Measurement and Control of Complex Systems of Engineering, Ministry of Education,Nanjing,China
– sequence: 2
  givenname: Qing
  surname: Wang
  fullname: Wang, Qing
  email: 220204773@seu.edu.cn
  organization: SEU-Monash Joint Graduate school, Southeast University,Nanjing,China
– sequence: 3
  givenname: Bei
  surname: Ma
  fullname: Ma, Bei
  email: 220211907@seu.edu.cn
  organization: School of Automation, Southeast University,Key Laboratory of Measurement and Control of Complex Systems of Engineering, Ministry of Education,Nanjing,China
– sequence: 4
  givenname: Yongbao
  surname: Wu
  fullname: Wu, Yongbao
  email: yongbaowu199211@163.com
  organization: School of Automation, Southeast University,Key Laboratory of Measurement and Control of Complex Systems of Engineering, Ministry of Education,Nanjing,China
– sequence: 5
  givenname: Lei
  surname: Xue
  fullname: Xue, Lei
  email: leixue@seu.edu.cn
  organization: School of Automation, Southeast University,Key Laboratory of Measurement and Control of Complex Systems of Engineering, Ministry of Education,Nanjing,China
BookMark eNpVkMtKw0AYhUdRsNY-gSDzAolzydyWodZYqFiorstkMqm_5FImk0Lf3op14eaczcfH4dyiq67vPEIPlKSUEvO4nH9shBCUp4wwlhqjpeb6As2M0lRKkelMCH2JJkwpmiiu2A2aDcMXIYQzklGtJijmeD2GYYSINzHY6HdHXPcBv45NhCTf-S7-AcniYAfoO1zY1uMD2H_Qk_f7U0QfWuhgiODwum_AHXERbAU_SN7s-gDxs71D17VtBj879xRtnhfv85dk9VYs5_kqgUzLxDNLaFnVmWLEUMetlaKsmNPktN0awSVltFRVVatal8xqI1zmpKmE4co5PkX3v1bw3m_3AVobjtvzS_wbv7NfKg
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/ICUS55513.2022.9986838
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL) - NZ
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISBN 9781665484558
166548456X
1665484551
9781665484565
EISSN 2771-7372
EndPage 423
ExternalDocumentID 9986838
Genre orig-research
GrantInformation_xml – fundername: Natural Science Foundation of Jiangsu Province
  grantid: BK20202006
  funderid: 10.13039/501100004608
– fundername: Fundamental Research Funds for the Central Universities
  funderid: 10.13039/501100012226
– fundername: Southeast University
  funderid: 10.13039/501100008081
– fundername: National Natural Science Foundation of China
  grantid: 62273094,62203114
  funderid: 10.13039/501100001809
GroupedDBID 6IE
6IF
6IL
6IN
AAWTH
ABLEC
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
OCL
RIE
RIL
ID FETCH-LOGICAL-i486-e2a01bdf472091c3aa65bd2c80041a9536121b7ddf7f8b2a895c4c69d5937cc3
IEDL.DBID RIE
IngestDate Wed Aug 27 02:27:30 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i486-e2a01bdf472091c3aa65bd2c80041a9536121b7ddf7f8b2a895c4c69d5937cc3
PageCount 6
ParticipantIDs ieee_primary_9986838
PublicationCentury 2000
PublicationDate 2022-Oct.-28
PublicationDateYYYYMMDD 2022-10-28
PublicationDate_xml – month: 10
  year: 2022
  text: 2022-Oct.-28
  day: 28
PublicationDecade 2020
PublicationTitle Proceedings of ... IEEE International Conference on Unmanned Systems (Online)
PublicationTitleAbbrev ICUS
PublicationYear 2022
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0003204187
Score 2.1987998
Snippet This paper studies a classical pursuit-evasion problem. The pursuer attempts to capture the faster evader in a bounded area. The velocity of evader is 1.2...
SourceID ieee
SourceType Publisher
StartPage 418
SubjectTerms Adaptation models
adaptive strategy
Convergence
Games
MADDPG
multi-agent
Nash equilibrium
Neural networks
Training
Title A Pursuit Strategy for Multi-Agent Pursuit-Evasion Game via Multi-Agent Deep Deterministic Policy Gradient Algorithm
URI https://ieeexplore.ieee.org/document/9986838
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LSwMxEA5t8aAXH634JgePbrvJZndnj6Xa6qUUqtBbyVMX7IO6LfjvTbJrteDFSwghIZAQZr7JfN8gdKtDwYzRLABiLEDh2j6pJIqCDEjE4tiEVCpfbCIdDmEyyUY1dLflwmitffKZbruu_8tXC7l2obKOhQYJRFBH9TRNSq7WNp4S0ZARSCsSMAmzzlPvZRy7-iUWBVLarhbvVFHxRqR_-L_tj1Drh42HR1s7c4xqen6CDn4JCTZR0cUjC_vXeYErudlPbL1R7Om1QdfRp74nBNZ3dhEyPOAzjTc535l0r_XSNmWKjNdwxqVyMB6sfHJYgbvvr4tVXrzNWmjcf3juPQZVPYUgZ5AEmvKQCGVYSq2TICPOk1goKsFpbnH3jUsoEalSJjUgKIcslkwmmYqtCyNldIoa88VcnyHMCRjlwBsXgoGiIDkRLARhLZ8gsTlHTXd602UpmDGtDu7i7-FLtO8uyBkECleoUazW-hrtyU2Rf6xu_C1_AV5Rqfs
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1bS8MwGA1zCuqLl028mwcf7dakaZs-DnUXnGOwCXsbuWrBXajdwH9vktXpwBdfSigphITyfefLd84B4Fb5nGitiEeRNgCFKfNLRUHgJRQFJAy1j4V0ZhNxr0dHo6RfAndrLoxSyjWfqZodurt8ORMLWyqrG2gQ0YBugW3rnFWwtdYVlQD7BNG4oAEjP6l37l8GoXUwMTgQ41rx-YaPigsjzYP_LeAQVH_4eLC_jjRHoKSmx2D_l5RgBeQN2DfAf5HmsBCc_YQmH4WOYOs1LIHqe4JnsmdbI4MtNlFwmbKNSQ9Kzc1j1STjVJzhSjsYtjLXHpbDxvvrLEvzt0kVDJqPw_u2VzgqeCmhkacw8xGXmsTYpAkiYCwKucSCWtUtZi9yEUY8llLHmnLMaBIKIqJEhiaJESI4AeXpbKpOAWSIamnhG-OcUImpYIgTn3IT-zgK9Rmo2N0bz1eSGeNi487_fn0DdtvD5-642-k9XYA9e1g2PGB6Ccp5tlBXYEcs8_Qju3Yn_gVlAa1E
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=Proceedings+of+...+IEEE+International+Conference+on+Unmanned+Systems+%28Online%29&rft.atitle=A+Pursuit+Strategy+for+Multi-Agent+Pursuit-Evasion+Game+via+Multi-Agent+Deep+Deterministic+Policy+Gradient+Algorithm&rft.au=Ye%2C+Jianfeng&rft.au=Wang%2C+Qing&rft.au=Ma%2C+Bei&rft.au=Wu%2C+Yongbao&rft.date=2022-10-28&rft.pub=IEEE&rft.eissn=2771-7372&rft.spage=418&rft.epage=423&rft_id=info:doi/10.1109%2FICUS55513.2022.9986838&rft.externalDocID=9986838