Critic-only adaptive dynamic programming algorithms’ applications to the secure control of cyber–physical systems

Industrial cyber–physical systems generally suffer from the malicious attacks and unmatched perturbation, and thus the security issue is always the core research topic in the related fields. This paper proposes a novel intelligent secure control scheme, which integrates optimal control theory, zero-...

Full description

Saved in:
Bibliographic Details
Published in:ISA transactions Vol. 104; pp. 138 - 144
Main Authors: Jiang, He, Zhang, Huaguang, Xie, Xiangpeng
Format: Journal Article
Language:English
Published: United States Elsevier Ltd 01.09.2020
Subjects:
Adaptive dynamic programming
Cyber–physical systems
Neural networks
Reinforcement learning
Cyber–physical systems
Adaptive dynamic programming
Neural networks
Reinforcement learning
ISSN:0019-0578, 1879-2022, 1879-2022
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Industrial cyber–physical systems generally suffer from the malicious attacks and unmatched perturbation, and thus the security issue is always the core research topic in the related fields. This paper proposes a novel intelligent secure control scheme, which integrates optimal control theory, zero-sum game theory, reinforcement learning and neural networks. First, the secure control problem of the compromised system is converted into the zero-sum game issue of the nominal auxiliary system, and then both policy-iteration-based and value-iteration-based adaptive dynamic programming methods are introduced to solve the Hamilton–Jacobi–Isaacs equations. The proposed secure control scheme can mitigate the effects of actuator attacks and unmatched perturbation, and stabilize the compromised cyber–physical systems by tuning the system performance parameters, which is proved through the Lyapunov stability theory. Finally, the proposed approach is applied to the Quanser helicopter to verify the effectiveness. •Secure control problems are converted into zero-sum game issues.•Two mainstream ADP methods are introduced to solve HJI equations.•Tuning conditions of secure control parameters are derived.•The proposed control scheme is tested on the Quanser helicopter.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:0019-0578
1879-2022
1879-2022
DOI:10.1016/j.isatra.2019.02.012