Multi-UAV Autonomous Obstacle Avoidance Based on Reinforcement Learning

Obstacle avoidance is a necessary behaviour to ensure the safety of UAV. In this paper, aiming at the problem of autonomous learning and obstacle avoidance of multiple UAVs in the multi-obstacle map environment, an obstacle avoidance method of UAVs based on an improved reward deep Q learning network...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Chinese Control Conference s. 8657 - 8661
Hlavní autoři: Li, Zheng, Li, Jinna, Wang, Yanhui
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: Technical Committee on Control Theory, Chinese Association of Automation 24.07.2023
Témata:
Adaptation models
Autonomous aerial vehicles
Decision making
DQN
Improved reward evaluation strategy
Multi-UAV obstacle avoidance algorithm
Neural networks
Q-learning
Simulation
Solid modeling
ISSN:1934-1768
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Obstacle avoidance is a necessary behaviour to ensure the safety of UAV. In this paper, aiming at the problem of autonomous learning and obstacle avoidance of multiple UAVs in the multi-obstacle map environment, an obstacle avoidance method of UAVs based on an improved reward deep Q learning network is proposed. According to the dynamics model of UAV, the three-dimensional dynamic equation is established, and the combination of pitch angle and heading angle constructs the action space of UAV. a new reward evaluation method, which adaptively adjusts the weight of the reward according to the distance between the UAV and the obstacle, is developed thus improving the performance of the UAV. Thus, the obstacle avoidance performance of multiple UAVs in unknown environment can be effectively improved. Finally, by comparing the traditional deep Q learning network, the simulation results show that the algorithm in this paper is reasonable, and UAVs can successfully achieve obstacle avoidance in unknown environment.
ISSN:1934-1768
DOI:10.23919/CCC58697.2023.10240772