Online Optimal Control of Robotic Systems with Single Critic NN-Based Reinforcement Learning

This paper suggests an online solution for the optimal tracking control of robotic systems based on a single critic neural network (NN)-based reinforcement learning (RL) method. To this end, we rewrite the robotic system model as a state-space form, which will facilitate the realization of optimal t...

Full description

Saved in:
Bibliographic Details
Published in:Complexity (New York, N.Y.) Vol. 2021; no. 1
Main Authors: Long, Xiaoyi, He, Zheng, Wang, Zhongyuan
Format: Journal Article
Language:English
Published: Hoboken Hindawi 2021
John Wiley & Sons, Inc
Wiley
Subjects:
Adaptive control
Algorithms
Design
Distance learning
Dynamic programming
Machine learning
Neural networks
Optimal control
Robot control
Robotics
Tracking control
Tracking errors
ISSN:1076-2787, 1099-0526
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper suggests an online solution for the optimal tracking control of robotic systems based on a single critic neural network (NN)-based reinforcement learning (RL) method. To this end, we rewrite the robotic system model as a state-space form, which will facilitate the realization of optimal tracking control synthesis. To maintain the tracking response, a steady-state control is designed, and then an adaptive optimal tracking control is used to ensure that the tracking error can achieve convergence in an optimal sense. To solve the obtained optimal control via the framework of adaptive dynamic programming (ADP), the command trajectory to be tracked and the modified tracking Hamilton-Jacobi-Bellman (HJB) are all formulated. An online RL algorithm is the developed to address the HJB equation using a critic NN with online learning algorithm. Simulation results are given to verify the effectiveness of the proposed method.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1076-2787
1099-0526
DOI:10.1155/2021/8839391