Inverse Reinforcement Learning-Based Fire-Control Command Calculation of an Unmanned Autonomous Helicopter Using Swarm Intelligence Demonstration
Saved in:
| Title: | Inverse Reinforcement Learning-Based Fire-Control Command Calculation of an Unmanned Autonomous Helicopter Using Swarm Intelligence Demonstration |
|---|---|
| Authors: | Haojie Zhu, Mou Chen, Zengliang Han, Mihai Lungu |
| Source: | Aerospace, Vol 10, Iss 3, p 309 (2023) |
| Publisher Information: | MDPI AG |
| Publication Year: | 2023 |
| Collection: | Directory of Open Access Journals: DOAJ Articles |
| Subject Terms: | UAH, IPSO, IRL, fire-control command, swarm intelligence, Motor vehicles. Aeronautics. Astronautics, TL1-4050 |
| Description: | This paper concerns the fire-control command calculation (FCCC) of an unmanned autonomous helicopter (UAH). It determines the final effect of the UAH attack. Although many different FCCC methods have been proposed for finding optimal or near-optimal fire-control execution processes, most are either slow in calculational speed or low in attack precision. This paper proposes a novel inverse reinforcement learning (IRL) FCCC method to calculate the fire-control commands in real time without losing precision by considering wind disturbance. First, the adaptive step velocity-verlet iterative algorithm-based ballistic determination method is proposed for calculation of the impact point of the unguided projectile under wind disturbance. In addition, a swarm intelligence demonstration (SID) model is proposed to demonstrate teaching; this model is based on an improved particle swarm optimization (IPSO) algorithm. Benefiting from the global optimization capability of the IPSO algorithm, the SID model often leads to an exact solution. Furthermore, a reward function neural network (RFNN) is trained according to the SID model, and a reinforcement learning (RL) model using RFNN is used to generate the fire-control commands in real time. Finally, the simulation results verify the feasibility and effectiveness of the proposed FCCC method. |
| Document Type: | article in journal/newspaper |
| Language: | English |
| Relation: | https://www.mdpi.com/2226-4310/10/3/309; https://doaj.org/toc/2226-4310; https://doaj.org/article/684280d4bdc74b3a99768903f3fce1ea |
| DOI: | 10.3390/aerospace10030309 |
| Availability: | https://doi.org/10.3390/aerospace10030309 https://doaj.org/article/684280d4bdc74b3a99768903f3fce1ea |
| Accession Number: | edsbas.6230CB08 |
| Database: | BASE |
Nájsť tento článok vo Web of Science | Abstract: | This paper concerns the fire-control command calculation (FCCC) of an unmanned autonomous helicopter (UAH). It determines the final effect of the UAH attack. Although many different FCCC methods have been proposed for finding optimal or near-optimal fire-control execution processes, most are either slow in calculational speed or low in attack precision. This paper proposes a novel inverse reinforcement learning (IRL) FCCC method to calculate the fire-control commands in real time without losing precision by considering wind disturbance. First, the adaptive step velocity-verlet iterative algorithm-based ballistic determination method is proposed for calculation of the impact point of the unguided projectile under wind disturbance. In addition, a swarm intelligence demonstration (SID) model is proposed to demonstrate teaching; this model is based on an improved particle swarm optimization (IPSO) algorithm. Benefiting from the global optimization capability of the IPSO algorithm, the SID model often leads to an exact solution. Furthermore, a reward function neural network (RFNN) is trained according to the SID model, and a reinforcement learning (RL) model using RFNN is used to generate the fire-control commands in real time. Finally, the simulation results verify the feasibility and effectiveness of the proposed FCCC method. |
|---|---|
| DOI: | 10.3390/aerospace10030309 |