Optimal balancing control of bipedal robots using reinforcement learning

The balance control a bipedal robot in the presence of external disturbances is still a challenge. In this paper, a novel optimal ankle stiffness regulation for humanoid robot balancing problem is proposed. The presented techniques are developed based on the integral reinforcement learning (IRL) alg...

Full description

Saved in:
Bibliographic Details
Published in:2016 12th World Congress on Intelligent Control and Automation (WCICA) pp. 2186 - 2191
Main Authors: Fang Peng, Lijia Ding, Zhijun Li, Chenguang Yang, Chun-Yi Su
Format: Conference Proceeding
Language:English
Published: IEEE 01.06.2016
Subjects:
Cost function
Impedance
Mathematical model
Riccati equations
Robot kinematics
Torque
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The balance control a bipedal robot in the presence of external disturbances is still a challenge. In this paper, a novel optimal ankle stiffness regulation for humanoid robot balancing problem is proposed. The presented techniques are developed based on the integral reinforcement learning (IRL) algorithm, which is designed for unknown continuous-time systems using only partial knowledge of the system dynamics. A linear mathematical model of an inverted pendulum model (IPM) is employed to study robot balance, and optimization is achieved by using linear quadratic regulator (LQR). Because the internal system dynamics is nonlinear and time-varying, IRL algorithm is proposed to solve the algebraic Riccati equation online without knowledge of the internal system dynamics. Nonlinear stiffness stabilizer based on both IRL and the fixed stiffness are studied in the simulation, the comparative results demonstrate the superior balance ability of the proposed method. In addition, dynamics changing is also discussed in the simulation to test robustness of the proposed method.
DOI:10.1109/WCICA.2016.7578463