Modeling and reinforcement learning-based locomotion control for a humanoid robot with kinematic loop closures

Humanoid robots are complex multibody systems, and modeling and locomotion control for them are challenging tasks. In this paper, a rigid multibody model is first built for a home-made humanoid robot with kinematic loop closures. The inverse kinematics solutions based on geometric relationships are...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Multibody system dynamics Ročník 65; číslo 2; s. 239 - 265
Hlavní autoři: Tang, Lingling, Liang, Dingkun, Gao, Guang, Wang, Xin, Xie, Anhuan
Médium: Journal Article
Jazyk:angličtina
Vydáno: Dordrecht Springer Netherlands 01.10.2025
Springer Nature B.V
Témata:
Automotive Engineering
Control
Deep learning
Dynamical Systems
Electrical Engineering
Engineering
Feet
Gait
Humanoid
Inverse kinematics
Kinematics
Locomotion
Mechanical Engineering
Modelling
Multibody systems
Optimization
Robot control
Robot dynamics
Symmetry
Tracking
Vibration
Whole-body coordination
Locomotion control
Inverse kinematics
Gait symmetry
Reinforcement learning
Humanoid robot
ISSN:1384-5640, 1573-272X
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Humanoid robots are complex multibody systems, and modeling and locomotion control for them are challenging tasks. In this paper, a rigid multibody model is first built for a home-made humanoid robot with kinematic loop closures. The inverse kinematics solutions based on geometric relationships are then presented for the parallel mechanisms of the knee and ankle joints, and contact detection procedures for foot–ground interactions on flat terrain and collisions between legs are simplified. Based on the above modeling work, a deep reinforcement learning (RL)-based strategy is presented for locomotion control. The reward function in the RL environment is well designed, where the foot periodic cycle penalty is implemented based on the complementary conditions of foot velocity and foot–ground interaction force. A new method is proposed to encourage the symmetric gait by penalizing the differences in the mean values and standard deviations between left and right joint angles, and the whole-body coordination is realized by tracking a pair of reference trajectories of the shoulder pitch degrees of freedom (DoFs). Finally, to verify the effectiveness of the proposed RL-based locomotion control strategy, we present several training cases, each with a separate RL agent, and the goals of foot periodic cycle with a frequency of 2 Hz, gait symmetry, forward speed up to 10 km/h, whole-body coordinated gait, and time-varying velocity command tracking are successfully achieved.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1384-5640
1573-272X
DOI:10.1007/s11044-024-10035-z