A novel data-driven model-free synchronization protocol for discrete-time multi-agent systems via TD3 based algorithm

System modeling is a complex and time-consuming task in engineering, and traditional model-based or observer-based methods are unable to deal situations when the system models are unknown or affected by elements such as temperature. As a result, it is critical to build model-free methods capable of...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Knowledge-based systems Ročník 287
Hlavní autori: Liu, Zhongxin, Li, Ye, Lan, Ge, Chen, Zengqiang
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: Elsevier B.V 05.03.2024
Predmet:
ISSN:0950-7051, 1872-7409
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:System modeling is a complex and time-consuming task in engineering, and traditional model-based or observer-based methods are unable to deal situations when the system models are unknown or affected by elements such as temperature. As a result, it is critical to build model-free methods capable of iterative learning and real-time updating. In this paper, a data-driven, model-free TD3-based algorithm is proposed. The neural network is used to address the issue of dimensional explosion in the state and action space. Besides, each agent can set a variable number of neighbors via virtual neighbor technology, giving the connection topology more flexibility. What is more, the proposed controller is only constructed based on the consensus error, which can quickly realize synchronization while consuming the least amount of energy. Finally, proofs and some simulation examples are given to verify the efficiency of our algorithm.
ISSN:0950-7051
1872-7409
DOI:10.1016/j.knosys.2024.111430