Multi-UAV Autonomous Obstacle Avoidance Based on Reinforcement Learning

Obstacle avoidance is a necessary behaviour to ensure the safety of UAV. In this paper, aiming at the problem of autonomous learning and obstacle avoidance of multiple UAVs in the multi-obstacle map environment, an obstacle avoidance method of UAVs based on an improved reward deep Q learning network...

Full description

Saved in:
Bibliographic Details
Published in:Chinese Control Conference pp. 8657 - 8661
Main Authors: Li, Zheng, Li, Jinna, Wang, Yanhui
Format: Conference Proceeding
Language:English
Published: Technical Committee on Control Theory, Chinese Association of Automation 24.07.2023
Subjects:
Adaptation models
Autonomous aerial vehicles
Decision making
DQN
Improved reward evaluation strategy
Multi-UAV obstacle avoidance algorithm
Neural networks
Q-learning
Simulation
Solid modeling
ISSN:1934-1768
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Obstacle avoidance is a necessary behaviour to ensure the safety of UAV. In this paper, aiming at the problem of autonomous learning and obstacle avoidance of multiple UAVs in the multi-obstacle map environment, an obstacle avoidance method of UAVs based on an improved reward deep Q learning network is proposed. According to the dynamics model of UAV, the three-dimensional dynamic equation is established, and the combination of pitch angle and heading angle constructs the action space of UAV. a new reward evaluation method, which adaptively adjusts the weight of the reward according to the distance between the UAV and the obstacle, is developed thus improving the performance of the UAV. Thus, the obstacle avoidance performance of multiple UAVs in unknown environment can be effectively improved. Finally, by comparing the traditional deep Q learning network, the simulation results show that the algorithm in this paper is reasonable, and UAVs can successfully achieve obstacle avoidance in unknown environment.
ISSN:1934-1768
DOI:10.23919/CCC58697.2023.10240772