Adaptive Prescribed-Time Optimal Control for Flexible-Joint Robots via Reinforcement Learning

This article proposes a prescribed-time fuzzy optimal control approach for flexible-joint (FJ) robot systems utilizing the reinforcement learning (RL) strategy. The uniqueness of this method lies in its ability to ensure optimal tracking performance for n-link flexible joint robots within the prescr...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on systems, man, and cybernetics. Systems Vol. 55; no. 4; pp. 2633 - 2643
Main Authors: Xie, Shiyu, Sun, Wei, Sun, Yougang, Su, Shun-Feng
Format: Journal Article
Language:English
Published: IEEE 01.04.2025
Subjects:
Actor-critic structure
Backstepping
flexible-joint (FJ) robots
fuzzy logic systems (FLSs)
MIMO
Optimal control
Performance analysis
prescribed-time optimal control
Process control
Program processors
Reinforcement learning
reinforcement learning (RL)
Robots
ISSN:2168-2216, 2168-2232
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This article proposes a prescribed-time fuzzy optimal control approach for flexible-joint (FJ) robot systems utilizing the reinforcement learning (RL) strategy. The uniqueness of this method lies in its ability to ensure optimal tracking performance for n-link flexible joint robots within the prescribed-time frame, while the actor and critic fuzzy logic system effectively approximate the optimal cost and evaluates system performance. First, the optimal controllers with the auxiliary compensation term are constructed by utilizing the online approximation of the modified performance index function and RL actor-critic structure. The designed controller can deal with unknown structure impacts and avoid model identification. Besides, in designing the prescribed-time scale function, the introduced constant term not only prevents singularity but also allows flexible setting of constraint regions. The proposed scheme is theoretically verified to satisfy the Bellman optimality principle and ensure the tracking error converges to the desired zone within the prescribed time. Finally, the practicability of the designed control scheme is further demonstrated by the 2-link FJ robot simulation example.
ISSN:2168-2216
2168-2232
DOI:10.1109/TSMC.2024.3524448