Density Control of Interacting Agent Systems
In this article, we consider the problem of controlling the group behavior of a large number of dynamic systems that are constantly interacting with each other. These systems are assumed to have identical dynamics (e.g., flocks of birds, UAV swarms) and their group behavior can be modeled by a distr...
Uložené v:
| Vydané v: | IEEE transactions on automatic control Ročník 69; číslo 1; s. 246 - 260 |
|---|---|
| Hlavný autor: | |
| Médium: | Journal Article |
| Jazyk: | English |
| Vydavateľské údaje: |
New York
IEEE
01.01.2024
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Predmet: | |
| ISSN: | 0018-9286, 1558-2523 |
| On-line prístup: | Získať plný text |
| Tagy: |
Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
|
| Abstract | In this article, we consider the problem of controlling the group behavior of a large number of dynamic systems that are constantly interacting with each other. These systems are assumed to have identical dynamics (e.g., flocks of birds, UAV swarms) and their group behavior can be modeled by a distribution. Thus, this problem can be viewed as an optimal control problem over the space of distributions. We propose a novel algorithm to compute a feedback control strategy so that, when adopted by the agents, the distribution of them would be transformed from an initial one to a target one over a finite-time window. Our method is built on the optimal transport theory but differs significantly from existing work in this area in that our method models the interactions among agents explicitly. From an algorithmic point of view, our algorithm is based on the generalized proximal gradient descent algorithm and has a convergence guarantee with a sublinear rate. We further extend our framework to account for the scenarios where the agents are from multiple species. In the linear quadratic setting, the solution is characterized by a system of coupled Riccati equations, which can be solved in closed form. Finally, several numerical examples are presented to illustrate our framework. |
|---|---|
| AbstractList | In this article, we consider the problem of controlling the group behavior of a large number of dynamic systems that are constantly interacting with each other. These systems are assumed to have identical dynamics (e.g., flocks of birds, UAV swarms) and their group behavior can be modeled by a distribution. Thus, this problem can be viewed as an optimal control problem over the space of distributions. We propose a novel algorithm to compute a feedback control strategy so that, when adopted by the agents, the distribution of them would be transformed from an initial one to a target one over a finite-time window. Our method is built on the optimal transport theory but differs significantly from existing work in this area in that our method models the interactions among agents explicitly. From an algorithmic point of view, our algorithm is based on the generalized proximal gradient descent algorithm and has a convergence guarantee with a sublinear rate. We further extend our framework to account for the scenarios where the agents are from multiple species. In the linear quadratic setting, the solution is characterized by a system of coupled Riccati equations, which can be solved in closed form. Finally, several numerical examples are presented to illustrate our framework. |
| Author | Chen, Yongxin |
| Author_xml | – sequence: 1 givenname: Yongxin orcidid: 0000-0002-1459-6365 surname: Chen fullname: Chen, Yongxin email: yongchen@gatech.edu organization: School of Aerospace Engineering, Georgia Institute of Technology, Atlanta, GA, USA |
| BookMark | eNp9kL1PAjEYhxuDiYDuDg6XuHrYb3ojOVFJSBzEuen13iNHoMW2DPz3lsBgHJzevMnveT-eERo47wChe4InhODqeTWrJxRTNmF0SiiVV2hIhFAlFZQN0BBjosqKKnmDRjFucis5J0P09AIu9ulY1N6l4LeF74qFSxCMTb1bF7M1uFR8HmOCXbxF153ZRri71DH6ep2v6vdy-fG2qGfL0tKKprLtZMsqjrm0Sja8EUwAKKlUpbixxDZYtY2w0IKlVrSVMUA7iQ1kiAnasjF6PM_dB_99gJj0xh-Cyys1rfBUcEamKqfwOWWDjzFAp_eh35lw1ATrkxOdneiTE31xkhH5B7F9Mqk__W767X_gwxnsAeDXHpLj-ZQfup1vQw |
| CODEN | IETAA9 |
| CitedBy_id | crossref_primary_10_1109_LCSYS_2025_3581859 crossref_primary_10_1109_ACCESS_2024_3465220 |
| Cites_doi | 10.1137/1.9781611974997 10.1109/ACC.2015.7170905 10.1016/j.jfa.2011.11.026 10.1007/s002110050002 10.1080/02331930008844513 10.1146/annurev-control-070220-100858 10.1088/1748-3190/ab49a4 10.1109/LRA.2019.2901546 10.1109/TAC.2015.2457791 10.1109/TAC.2016.2602103 10.1109/LCSYS.2020.3039008 10.1007/s00440-004-0340-4 10.2514/3.21374 10.1007/s11537-007-0657-8 10.1007/s00440-020-00977-8 10.1007/s11721-012-0075-2 10.1137/20M1339982 10.1007/s10957-015-0803-z 10.1016/0024-3795(89)90490-4 10.1109/TIT.2021.3077465 10.1080/00207178708933880 10.1109/TRO.2018.2857475 10.1007/978-1-4614-8508-7 10.1007/978-1-4684-0302-2 10.1109/CDC.2018.8619816 10.1109/TAES.2002.1145739 10.1109/ACC.2016.7526817 10.1007/BF00532864 10.1214/aoms/1177703591 10.1016/S0167-6377(02)00231-6 10.1287/moor.18.4.846 10.1109/TAC.2018.2791362 10.1137/050631264 10.4310/CIS.2006.v6.n3.a5 10.1137/20M1320195 10.1137/19M1249461 10.1007/BF01442404 10.1109/TAC.2015.2457784 10.1007/BFb0086180 10.2307/1970151 10.1007/BF00939948 10.1007/s10957-018-1365-7 10.1051/m2an/2015020 10.1090/gsm/058 10.1109/TRO.2022.3175404 10.1016/j.automatica.2018.01.029 10.1109/TAC.2020.3002971 10.5802/afst.1546 10.1016/0304-4149(87)90184-0 10.1007/978-1-4612-6380-7 10.3934/dcds.2014.34.1533 10.1073/pnas.56.6.1907 10.2514/6.2018-0611 |
| ContentType | Journal Article |
| Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024 |
| Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024 |
| DBID | 97E RIA RIE AAYXX CITATION 7SC 7SP 7TB 8FD FR3 JQ2 L7M L~C L~D |
| DOI | 10.1109/TAC.2023.3271226 |
| DatabaseName | IEEE All-Society Periodicals Package (ASPP) 2005–Present IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Mechanical & Transportation Engineering Abstracts Technology Research Database Engineering Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional |
| DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Mechanical & Transportation Engineering Abstracts Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Engineering Research Database Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional |
| DatabaseTitleList | Technology Research Database |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISSN | 1558-2523 |
| EndPage | 260 |
| ExternalDocumentID | 10_1109_TAC_2023_3271226 10111078 |
| Genre | orig-research |
| GrantInformation_xml | – fundername: National Science Foundation grantid: 2206576; 1942523; 2008513 funderid: 10.13039/501100008982 |
| GroupedDBID | -~X .DC 0R~ 29I 3EH 4.4 5GY 5VS 6IK 97E AAJGR AARMG AASAJ AAWTH ABAZT ABQJQ ABVLG ACGFO ACGFS ACIWK ACNCT AENEX AETIX AGQYO AGSQL AHBIQ AI. AIBXA AKJIK AKQYR ALLEH ALMA_UNASSIGNED_HOLDINGS ASUFR ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 EBS EJD F5P HZ~ H~9 IAAWW IBMZZ ICLAB IDIHD IFIPE IFJZH IPLJI JAVBF LAI M43 MS~ O9- OCL P2P RIA RIE RNS TAE TN5 VH1 VJK ~02 AAYXX CITATION 7SC 7SP 7TB 8FD FR3 JQ2 L7M L~C L~D |
| ID | FETCH-LOGICAL-c292t-df6d394046c86b4b535ee8688984ac1cb08db5cedec2c5d9aae2f60ae394352d3 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 6 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001163003600027&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0018-9286 |
| IngestDate | Mon Jun 30 08:04:50 EDT 2025 Sat Nov 29 05:41:08 EST 2025 Tue Nov 18 22:10:31 EST 2025 Wed Aug 27 02:11:18 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Language | English |
| License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html https://doi.org/10.15223/policy-029 https://doi.org/10.15223/policy-037 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c292t-df6d394046c86b4b535ee8688984ac1cb08db5cedec2c5d9aae2f60ae394352d3 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| ORCID | 0000-0002-1459-6365 |
| PQID | 2907543178 |
| PQPubID | 85475 |
| PageCount | 15 |
| ParticipantIDs | ieee_primary_10111078 proquest_journals_2907543178 crossref_citationtrail_10_1109_TAC_2023_3271226 crossref_primary_10_1109_TAC_2023_3271226 |
| PublicationCentury | 2000 |
| PublicationDate | 2024-Jan. 2024-1-00 20240101 |
| PublicationDateYYYYMMDD | 2024-01-01 |
| PublicationDate_xml | – month: 01 year: 2024 text: 2024-Jan. |
| PublicationDecade | 2020 |
| PublicationPlace | New York |
| PublicationPlace_xml | – name: New York |
| PublicationTitle | IEEE transactions on automatic control |
| PublicationTitleAbbrev | TAC |
| PublicationYear | 2024 |
| Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| References | ref13 ref12 ref15 ref59 ref14 Schrdinger (ref36) 1931; IX ref53 ref52 ref11 ref55 ref10 ref54 Schrdinger (ref37) 1932; 2 ref17 ref16 ref19 ref18 Cuturi (ref51) 2013 ref50 ref46 ref45 ref48 ref47 ref42 ref41 ref44 ref43 Fortet (ref39) 1940; 83 ref49 ref8 ref7 ref9 ref3 ref6 ref5 Ambrosio (ref35) 2006 ref40 ref34 ref31 ref30 ref33 ref32 ref2 ref1 Lee (ref60) 1967 ref38 Koller (ref56) 2009 Huang (ref4) 2006; 6 ref24 ref26 ref25 ref20 Yedidia (ref57) 2003; 8 ref63 ref22 ref21 ref28 ref27 ref29 Zheng (ref23) 2020 Li (ref58) 2017 ref62 ref61 |
| References_xml | – ident: ref29 doi: 10.1137/1.9781611974997 – ident: ref45 doi: 10.1109/ACC.2015.7170905 – ident: ref49 doi: 10.1016/j.jfa.2011.11.026 – ident: ref34 doi: 10.1007/s002110050002 – ident: ref53 doi: 10.1080/02331930008844513 – ident: ref59 doi: 10.1146/annurev-control-070220-100858 – ident: ref20 doi: 10.1088/1748-3190/ab49a4 – ident: ref7 doi: 10.1109/LRA.2019.2901546 – ident: ref15 doi: 10.1109/TAC.2015.2457791 – ident: ref33 doi: 10.1109/TAC.2016.2602103 – ident: ref21 doi: 10.1109/LCSYS.2020.3039008 – ident: ref47 doi: 10.1007/s00440-004-0340-4 – ident: ref5 doi: 10.2514/3.21374 – ident: ref30 doi: 10.1007/s11537-007-0657-8 – ident: ref24 doi: 10.1007/s00440-020-00977-8 – ident: ref1 doi: 10.1007/s11721-012-0075-2 – ident: ref12 doi: 10.1137/20M1339982 – ident: ref42 doi: 10.1007/s10957-015-0803-z – ident: ref52 doi: 10.1016/0024-3795(89)90490-4 – ident: ref27 doi: 10.1109/TIT.2021.3077465 – volume: IX start-page: 144 year: 1931 ident: ref36 article-title: ber die umkehrung der naturgesetze publication-title: Sitzungsberichte der Preuss Akad Wissen. Phys. Math. Klasse, Sonderausgabe – ident: ref13 doi: 10.1080/00207178708933880 – volume: 8 start-page: 236 volume-title: Exploring Artif. Intell. New Millennium year: 2003 ident: ref57 article-title: Understanding belief propagation and its generalizations – ident: ref2 doi: 10.1109/TRO.2018.2857475 – ident: ref31 doi: 10.1007/978-1-4614-8508-7 – ident: ref44 doi: 10.1007/978-1-4684-0302-2 – ident: ref19 doi: 10.1109/CDC.2018.8619816 – ident: ref8 doi: 10.1109/TAES.2002.1145739 – ident: ref16 doi: 10.1109/ACC.2016.7526817 – ident: ref41 doi: 10.1007/BF00532864 – ident: ref50 doi: 10.1214/aoms/1177703591 – ident: ref28 doi: 10.1016/S0167-6377(02)00231-6 – ident: ref54 doi: 10.1287/moor.18.4.846 – volume-title: Probabilistic Graphical Models: Principles and Techniques year: 2009 ident: ref56 – volume: 83 start-page: 83 issue: 9 year: 1940 ident: ref39 article-title: Rsolution dun systme dquations de M. Schrdinger publication-title: J. Math. Pures Appl. – start-page: 2111 volume-title: Proc. Int. Conf. Mach. Learn. year: 2017 ident: ref58 article-title: Convergence analysis of proximal gradient with momentum for nonconvex optimization – ident: ref17 doi: 10.1109/TAC.2018.2791362 – year: 2020 ident: ref23 article-title: Deployment of robotic swarms via density feedback control – ident: ref48 doi: 10.1137/050631264 – volume: 6 start-page: 221 issue: 3 year: 2006 ident: ref4 article-title: Large population stochastic dynamic games: Closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle publication-title: Commun. Inf. Syst. doi: 10.4310/CIS.2006.v6.n3.a5 – volume-title: Gradient Flows: In Metric Spaces and in the Space of Probability Measures year: 2006 ident: ref35 – ident: ref26 doi: 10.1137/20M1320195 – ident: ref32 doi: 10.1137/19M1249461 – ident: ref43 doi: 10.1007/BF01442404 – ident: ref14 doi: 10.1109/TAC.2015.2457784 – ident: ref38 doi: 10.1007/BFb0086180 – ident: ref40 doi: 10.2307/1970151 – ident: ref55 doi: 10.1007/BF00939948 – ident: ref63 doi: 10.1007/s10957-018-1365-7 – ident: ref25 doi: 10.1051/m2an/2015020 – start-page: 2292 volume-title: Proc. Adv. Neural Inf. Process. Syst. year: 2013 ident: ref51 article-title: Sinkhorn distances: Lightspeed computation of optimal transport – ident: ref10 doi: 10.1090/gsm/058 – ident: ref9 doi: 10.1109/TRO.2022.3175404 – ident: ref18 doi: 10.1016/j.automatica.2018.01.029 – volume-title: Foundations of Optimal Control Theory year: 1967 ident: ref60 – ident: ref22 doi: 10.1109/TAC.2020.3002971 – ident: ref46 doi: 10.5802/afst.1546 – ident: ref62 doi: 10.1016/0304-4149(87)90184-0 – ident: ref61 doi: 10.1007/978-1-4612-6380-7 – ident: ref11 doi: 10.3934/dcds.2014.34.1533 – ident: ref3 doi: 10.1073/pnas.56.6.1907 – ident: ref6 doi: 10.2514/6.2018-0611 – volume: 2 start-page: 269 issue: 4 volume-title: Annales de linstitut Henri Poincar year: 1932 ident: ref37 article-title: Sur la thorie relativiste de llectron et linterprtation de la mcanique quantique |
| SSID | ssj0016441 |
| Score | 2.5237975 |
| Snippet | In this article, we consider the problem of controlling the group behavior of a large number of dynamic systems that are constantly interacting with each... |
| SourceID | proquest crossref ieee |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 246 |
| SubjectTerms | Algorithm design and theory Algorithms Decentralized control Distributional control Dynamical systems Feedback control Group dynamics Mathematical models Multi-agent systems Optimal control optimal transport Riccati equation Transport theory |
| Title | Density Control of Interacting Agent Systems |
| URI | https://ieeexplore.ieee.org/document/10111078 https://www.proquest.com/docview/2907543178 |
| Volume | 69 |
| WOSCitedRecordID | wos001163003600027&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) customDbUrl: eissn: 1558-2523 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0016441 issn: 0018-9286 databaseCode: RIE dateStart: 19630101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3NS8MwFH_o8KAHPydOp_TgRbBbm6ZNchzT4Wl4mLBbSZNXEWSTrRP8781LuzEQBW895IXyXl5e3ucP4DYxRZRFtggTKxOCMNOhilCEzpRhrDNuhSk92IQYj-V0qp6bZnXfC4OIvvgMe_Tpc_l2blYUKnMaHpO7IndhV4isbtbapAzIsNfXrtNgJjc5yUj1J4Nhj2DCewkTMaM5Cls2yIOq_LiJvXkZHf3zx47hsHlHBoNa8Cewg7NTONiaLngG9w9UnF59BcO6HD2Yl4EPAFIvw-w1GFBXVdCMLG_Dy-hxMnwKG3CE0DDFqtCWmSVUc54ZmRW8SJMUUWZSKsm1iZ0IpC1SgxYNM6lVWiMrs0ijI3KPLpucQ2s2n-EFBJxbp9oiRpVYXrgdLBOahtYYnmqjZQf6a3blppkcTgAW77n3ICKVOwbnxOC8YXAH7jYUH_XUjD_WtomhW-tqXnaguxZJ3ujVMmfOl6fufSEvfyG7gn23O6-jJF1oVYsVXsOe-azelosbf2S-AfJXvC0 |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3NS8MwFH_oFNSDnxOnU3vwItitTdM2OY7pmDiHhwneQpqkIsgmWyf435uXdmMgCt56yGvLe3l5eZ8_gKtIZUES6MyPNIsQwkz6PDCpb02ZCWVCdapyBzaRDofs5YU_Vc3qrhfGGOOKz0wLH10uX0_UHENlVsNDdFfYOmwgdFbVrrVMGqBpLw9eq8OELbOSAW-POt0WAoW3IpKGBCcprFghB6vy4yx2Bqa3989f24fd6ibpdUrRH8CaGR_Czsp8wSO4ucXy9OLL65YF6d4k91wIELsZxq9eB_uqvGpoeR2ee3ejbt-v4BF8RTgpfJ0nGnHNaaJYktEsjmJjWMIYZ1Sq0AqB6SxWRhtFVKy5lIbkSSCNJbLXLh0dQ208GZsT8CjVVrnT0PBI08y-QZNU4tgaRWOpJGtAe8EuoarZ4Qhh8S6cDxFwYRkskMGiYnADrpcUH-XcjD_W1pGhK-tKXjaguRCJqDRrJoj15rF_P2Wnv5BdwlZ_9DgQg_vhwxls2y_RMmbShFoxnZtz2FSfxdtseuG2zzfww792 |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Density+Control+of+Interacting+Agent+Systems&rft.jtitle=IEEE+transactions+on+automatic+control&rft.au=Chen%2C+Yongxin&rft.date=2024-01-01&rft.issn=0018-9286&rft.eissn=1558-2523&rft.volume=69&rft.issue=1&rft.spage=246&rft.epage=260&rft_id=info:doi/10.1109%2FTAC.2023.3271226&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_TAC_2023_3271226 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0018-9286&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0018-9286&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0018-9286&client=summon |