Autonomous Obstacle Avoidance and Target Tracking of UAV Based on Deep Reinforcement Learning

When using deep reinforcement learning algorithm to complete Unmanned Aerial Vehicle (UAV) autonomous obstacle avoidance and target tracking tasks, there are often some problems such as slow convergence speed and low success rate. Therefore, this paper proposes a new deep reinforcement learning algo...

Full description

Saved in:
Bibliographic Details
Published in:Journal of intelligent & robotic systems Vol. 104; no. 4; p. 60
Main Authors: Xu, Guoqiang, Jiang, Weilai, Wang, Zhaolei, Wang, Yaonan
Format: Journal Article
Language:English
Published: Dordrecht Springer Netherlands 01.04.2022
Springer
Springer Nature B.V
Subjects:
Algorithms
Analysis
Artificial Intelligence
Control
Convergence
Data mining
Deep learning
Drone aircraft
Electrical Engineering
Engineering
label V
Machine learning
Mechanical Engineering
Mechatronics
Obstacle avoidance
Pools
Regular Paper
Robotics
Topical collection on Robotics Vision and Intelligent Control
Tracking
Unmanned aerial vehicles
Unmanned Aerial Vehicle (UAV)
Autonomous obstacle avoidance
Deep reinforcement learning
Target tracking
Continuous control
ISSN:0921-0296, 1573-0409
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:When using deep reinforcement learning algorithm to complete Unmanned Aerial Vehicle (UAV) autonomous obstacle avoidance and target tracking tasks, there are often some problems such as slow convergence speed and low success rate. Therefore, this paper proposes a new deep reinforcement learning algorithm, namely Multiple Pools Twin Delay Deep Deterministic Policy Gradient (MPTD3) algorithm. Firstly, the state space and action space of UAV are established as continuous models, which is closer to engineering practice than discrete models. Then, multiple experience pools mechanism and gradient truncation are designed to improve the convergence of the algorithm. Furthermore, the generalization ability of the algorithm is obtained by giving UAV environmental perception ability. Experimental results verify the effectiveness of the proposed method.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0921-0296
1573-0409
DOI:10.1007/s10846-022-01601-8