Control method of robotic arm integrating PID feedforward compensation and SAC algorithm

To solve the problems of response lag and limited generalization of a single algorithm in traditional control methods for robotic arm trajectory tracking, a hierarchical control architecture is proposed. The upper layer adopts a soft actor critic algorithm optimized by multi actor critics to generat...

Full description

Saved in:
Bibliographic Details
Published in:Engineering Research Express Vol. 7; no. 4; pp. 45532 - 45545
Main Authors: Yu, Shuang, Chen, Wei, Li, Jian, Zhou, Xin
Format: Journal Article
Language:English
Published: IOP Publishing 31.12.2025
Subjects:
ISSN:2631-8695, 2631-8695
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract To solve the problems of response lag and limited generalization of a single algorithm in traditional control methods for robotic arm trajectory tracking, a hierarchical control architecture is proposed. The upper layer adopts a soft actor critic algorithm optimized by multi actor critics to generate robust trajectories. The lower layer achieves precise tracking through the sparrow search algorithm proportional integral derivative feedforward compensation controller. The results show that the improved soft actor critic algorithm achieves average reward values of 1165 and 1087 in obstacle free scenes, with success rates of 88.65% and 83.54%, respectively, which are superior to other compared algorithms. Meanwhile, the root mean square error of the algorithm in different scenarios is only 0.18 rad s−1 and 0.24 rad s−1, respectively, and the single trajectory time is only 0.68 s and 0.77 s, achieving high-precision and high-efficiency robust trajectory generation. In addition, the sparrow search algorithm proportional integral derivative feedforward compensation controller has the highest degree of joint angle tracking coincidence, and its Z-axis contact force fluctuates around the expected value, with a lower fluctuation range than other methods, ranging from 6.78 N-7.36 N in scenario 1 and 6.52 N-8.13 N in scenario 2. This architecture achieves the synergy of global optimization and precise tracking, suitable for 3–6 axis serial industrial robotic arms, providing important reference for high-precision trajectory tracking of multi degree of freedom robotic arms.
AbstractList To solve the problems of response lag and limited generalization of a single algorithm in traditional control methods for robotic arm trajectory tracking, a hierarchical control architecture is proposed. The upper layer adopts a soft actor critic algorithm optimized by multi actor critics to generate robust trajectories. The lower layer achieves precise tracking through the sparrow search algorithm proportional integral derivative feedforward compensation controller. The results show that the improved soft actor critic algorithm achieves average reward values of 1165 and 1087 in obstacle free scenes, with success rates of 88.65% and 83.54%, respectively, which are superior to other compared algorithms. Meanwhile, the root mean square error of the algorithm in different scenarios is only 0.18 rad s −1 and 0.24 rad s −1 , respectively, and the single trajectory time is only 0.68 s and 0.77 s, achieving high-precision and high-efficiency robust trajectory generation. In addition, the sparrow search algorithm proportional integral derivative feedforward compensation controller has the highest degree of joint angle tracking coincidence, and its Z -axis contact force fluctuates around the expected value, with a lower fluctuation range than other methods, ranging from 6.78 N-7.36 N in scenario 1 and 6.52 N-8.13 N in scenario 2. This architecture achieves the synergy of global optimization and precise tracking, suitable for 3–6 axis serial industrial robotic arms, providing important reference for high-precision trajectory tracking of multi degree of freedom robotic arms.
To solve the problems of response lag and limited generalization of a single algorithm in traditional control methods for robotic arm trajectory tracking, a hierarchical control architecture is proposed. The upper layer adopts a soft actor critic algorithm optimized by multi actor critics to generate robust trajectories. The lower layer achieves precise tracking through the sparrow search algorithm proportional integral derivative feedforward compensation controller. The results show that the improved soft actor critic algorithm achieves average reward values of 1165 and 1087 in obstacle free scenes, with success rates of 88.65% and 83.54%, respectively, which are superior to other compared algorithms. Meanwhile, the root mean square error of the algorithm in different scenarios is only 0.18 rad s−1 and 0.24 rad s−1, respectively, and the single trajectory time is only 0.68 s and 0.77 s, achieving high-precision and high-efficiency robust trajectory generation. In addition, the sparrow search algorithm proportional integral derivative feedforward compensation controller has the highest degree of joint angle tracking coincidence, and its Z-axis contact force fluctuates around the expected value, with a lower fluctuation range than other methods, ranging from 6.78 N-7.36 N in scenario 1 and 6.52 N-8.13 N in scenario 2. This architecture achieves the synergy of global optimization and precise tracking, suitable for 3–6 axis serial industrial robotic arms, providing important reference for high-precision trajectory tracking of multi degree of freedom robotic arms.
Author Chen, Wei
Zhou, Xin
Yu, Shuang
Li, Jian
Author_xml – sequence: 1
  givenname: Shuang
  orcidid: 0009-0008-8718-1508
  surname: Yu
  fullname: Yu, Shuang
  organization: Suzhou Vocational Institute of Industrial Technology School of Intelligent Equipment, Suzhou 215000, People’s Republic of China
– sequence: 2
  givenname: Wei
  surname: Chen
  fullname: Chen, Wei
  organization: Jiangsu University of Science and Technology School of Automation, Zhenjiang 212100, People’s Republic of China
– sequence: 3
  givenname: Jian
  surname: Li
  fullname: Li, Jian
  organization: Leader Harmonious Drive System Co., Ltd, Suzhou 215000, People’s Republic of China
– sequence: 4
  givenname: Xin
  surname: Zhou
  fullname: Zhou, Xin
  organization: Suzhou Vocational Institute of Industrial Technology School of Intelligent Equipment, Suzhou 215000, People’s Republic of China
BookMark eNp1UE1LAzEUDFLBWnv3mB_g2iS7SXePZf0qFBRU8Bbe5qNd6eaVbET89-5SES-e3uPNzGNmzskkYHCEXHJ2zVlZLoTKeVaqSi7AMW_LEzL9PU3-7Gdk3vdtwwqluFry5ZS81RhSxD3tXNqhpehpxAZTayjEjrYhuW2E1IYtfVrfUO-c9Rg_IVpqsDu40A8gBgrB0udVTWG_xdimXXdBTj3sezf_mTPyenf7Uj9km8f7db3aZEbkMmWV4U0JhYScccfksmSGGS8M98Ln3oBsmJAKrBVVUTjDBgKAaGTVFLlRzuUzwo5_TcS-j87rQ2w7iF-aMz2Wo8f0ekyvj-UMkqujpMWDfsePGAaD_9O_AQKMaSg
CODEN ERENBL
Cites_doi 10.25130/tjes.30.4.6
10.1063/5.0162246
10.1007/s10489-024-05293-5
10.12785/ijcds/160178
10.3390/automation5030014
10.54327/set2025/v5.I1.188
10.1109/TPWRS.2024.3403715
10.1109/TIE.2024.3357875
10.1177/1687814020913667
10.1080/23080477.2023.2270668
10.1109/TASE.2022.3213730
10.1177/09596518241229741
10.18196/jrc.v4i1.16990
10.1109/JAS.2022.105869
10.1002/oca.2962
10.1177/10775463231209394
10.47852/bonviewJDSIS3202837
10.1609/aaai.v36i7.20732
10.1017/S026357472100093X
10.1109/TCYB.2023.3240502
10.1109/LRA.2024.3396023
10.17798/bitlisfen.1370223
10.18196/jrc.V3i2.13906
10.1080/02533839.2024.2383566
ContentType Journal Article
Copyright 2025 IOP Publishing Ltd. All rights, including for text and data mining, AI training, and similar technologies, are reserved.
Copyright_xml – notice: 2025 IOP Publishing Ltd. All rights, including for text and data mining, AI training, and similar technologies, are reserved.
DBID AAYXX
CITATION
DOI 10.1088/2631-8695/ae0fd8
DatabaseName CrossRef
DatabaseTitle CrossRef
DatabaseTitleList CrossRef

DeliveryMethod fulltext_linktorsrc
EISSN 2631-8695
ExternalDocumentID 10_1088_2631_8695_ae0fd8
erxae0fd8
GrantInformation_xml – fundername: Major Project of Basic Science (Natural Science) Research in Higher Education Institutions of Jiangsu Province
  grantid: 22KJA460008
– fundername: visiting and Research Training Project for Teachers of Higher Vocational Colleges in Jiangsu Province
  grantid: 2024GRFX042
– fundername: the Sixth “333 High level Talent Training Project” of Jiangsu Province
GroupedDBID ABJNI
ALMA_UNASSIGNED_HOLDINGS
AAYXX
CITATION
ID FETCH-LOGICAL-c235t-9c1b8a45a301e05780c0cf2c1f2f3fca5b0256add2944ec0780aa2b59b43c6ee3
IEDL.DBID O3W
ISICitedReferencesCount 0
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001594165500001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 2631-8695
IngestDate Sat Oct 25 04:48:48 EDT 2025
Sat Oct 18 23:06:05 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 4
Language English
License This article is available under the terms of the IOP-Standard License.
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c235t-9c1b8a45a301e05780c0cf2c1f2f3fca5b0256add2944ec0780aa2b59b43c6ee3
Notes ERX-112010.R1
ORCID 0009-0008-8718-1508
PageCount 14
ParticipantIDs crossref_primary_10_1088_2631_8695_ae0fd8
iop_journals_10_1088_2631_8695_ae0fd8
PublicationCentury 2000
PublicationDate 2025-12-31
PublicationDateYYYYMMDD 2025-12-31
PublicationDate_xml – month: 12
  year: 2025
  text: 2025-12-31
  day: 31
PublicationDecade 2020
PublicationTitle Engineering Research Express
PublicationTitleAbbrev ERX
PublicationTitleAlternate Eng. Res. Express
PublicationYear 2025
Publisher IOP Publishing
Publisher_xml – name: IOP Publishing
References Lyu (erxae0fd8bib17) 2022; 36
Parvaresh (erxae0fd8bib5) 2022; 40
Belalia (erxae0fd8bib8) 2024; 16
Müftü (erxae0fd8bib14) 2024; 13
Chotikunnan (erxae0fd8bib12) 2023; 4
Bensafia (erxae0fd8bib15) 2025; 5
Ding (erxae0fd8bib24) 2023; 94
Yang (erxae0fd8bib1) 2024; 71
Zhen (erxae0fd8bib9) 2024; 30
Lu (erxae0fd8bib11) 2020; 12
Shatnan (erxae0fd8bib20) 2023; 30
Chinthamu (erxae0fd8bib23) 2023; 1
Chorasiya (erxae0fd8bib21) 2024; 12
Alizadeh (erxae0fd8bib10) 2024; 238
Yang (erxae0fd8bib18) 2024; 9
Nian (erxae0fd8bib16) 2024; 54
Tan (erxae0fd8bib2) 2022; 9
Xu (erxae0fd8bib3) 2022; 20
Xu (erxae0fd8bib19) 2024; 40
Eltayeb (erxae0fd8bib13) 2024; 5
Abdullah-Al-Noman (erxae0fd8bib4) 2022; 3
Yadav (erxae0fd8bib6) 2024; 47
Rangi (erxae0fd8bib22) 2023; 44
Gao (erxae0fd8bib7) 2023; 53
References_xml – volume: 30
  start-page: 46
  year: 2023
  ident: erxae0fd8bib20
  article-title: Optimal fuzzy-FOPID, fuzzy-PID control schemes for trajectory tracking of 3DOF robot manipulator
  publication-title: Tikrit Journal of Engineering Sciences
  doi: 10.25130/tjes.30.4.6
– volume: 94
  year: 2023
  ident: erxae0fd8bib24
  article-title: A survey on the mechanical design for piezo-actuated compliant micro-positioning stages
  publication-title: Rev. Sci. Instrum.
  doi: 10.1063/5.0162246
– volume: 54
  start-page: 3279
  year: 2024
  ident: erxae0fd8bib16
  article-title: Large-scale UAV swarm confrontation based on hierarchical attention actor-critic algorithm
  publication-title: Applied Intelligence
  doi: 10.1007/s10489-024-05293-5
– volume: 16
  start-page: 1067
  year: 2024
  ident: erxae0fd8bib8
  article-title: Trajectory tracking of a robot arm using images sequences
  publication-title: International Journal of Computing and Digital Systems
  doi: 10.12785/ijcds/160178
– volume: 5
  start-page: 230
  year: 2024
  ident: erxae0fd8bib13
  article-title: Comparative analysis: fractional pid vs. pid controllers for robotic arm using genetic algorithm optimization
  publication-title: Automation
  doi: 10.3390/automation5030014
– volume: 5
  start-page: 116
  year: 2025
  ident: erxae0fd8bib15
  article-title: Reducing the delay time and tracking trajectory of the robot SCARA using the fractional PID controller
  publication-title: Science, Engineering and Technology
  doi: 10.54327/set2025/v5.I1.188
– volume: 40
  start-page: 505
  year: 2024
  ident: erxae0fd8bib19
  article-title: Deep multi-task multi-agent reinforcement learning based joint bidding and pricing strategy of price-maker load serving entity
  publication-title: IEEE Transactions on Power System
  doi: 10.1109/TPWRS.2024.3403715
– volume: 71
  start-page: 13083
  year: 2024
  ident: erxae0fd8bib1
  article-title: Time-delay sliding mode control for trajectory tracking of robot manipulators
  publication-title: IEEE Trans. Ind. Electron.
  doi: 10.1109/TIE.2024.3357875
– volume: 12
  start-page: 1687814020913667
  year: 2020
  ident: erxae0fd8bib11
  article-title: Minimum-jerk trajectory planning pertaining to a translational 3-degree-of-freedom parallel manipulator through piecewise quintic polynomials interpolation
  publication-title: Advances in Mechanical Engineering
  doi: 10.1177/1687814020913667
– volume: 12
  start-page: 74
  year: 2024
  ident: erxae0fd8bib21
  article-title: GWO-and SSA-Tuned PID control for frequency regulation in multi-area power network integrated with plug-in electric vehicle
  publication-title: Smart Science
  doi: 10.1080/23080477.2023.2270668
– volume: 20
  start-page: 2280
  year: 2022
  ident: erxae0fd8bib3
  article-title: A learning-based object tracking strategy using visual sensors and intelligent robot arm
  publication-title: IEEE Trans. Autom. Sci. Eng.
  doi: 10.1109/TASE.2022.3213730
– volume: 238
  start-page: 1285
  year: 2024
  ident: erxae0fd8bib10
  article-title: Robust trajectory tracking of a 3-DOF robotic arm using a super-twisting fast finite time non-singular terminal sliding mode control in the presence of perturbations
  publication-title: Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering
  doi: 10.1177/09596518241229741
– volume: 4
  start-page: 23
  year: 2023
  ident: erxae0fd8bib12
  article-title: Dual design PID controller for robotic manipulator application
  publication-title: Journal of Robotics and Control
  doi: 10.18196/jrc.v4i1.16990
– volume: 9
  start-page: 1778
  year: 2022
  ident: erxae0fd8bib2
  article-title: A new noise-tolerant dual-neural-network scheme for robust kinematic control of robotic arms with unknown models.
  publication-title: IEEE/CAA Journal of Automatica Sinica
  doi: 10.1109/JAS.2022.105869
– volume: 44
  start-page: 1972
  year: 2023
  ident: erxae0fd8bib22
  article-title: SSA-optimized cascade optimal-PIDN controller for multi-area power system with RFB under deregulated environment
  publication-title: Optimal Control Applications and Methods
  doi: 10.1002/oca.2962
– volume: 30
  start-page: 4351
  year: 2024
  ident: erxae0fd8bib9
  article-title: Robust trajectory tracking control design for the robotic arm with uncertainty and experimental validation
  publication-title: J. Vib. Control
  doi: 10.1177/10775463231209394
– volume: 1
  start-page: 83
  year: 2023
  ident: erxae0fd8bib23
  article-title: Data science and applications
  publication-title: Journal of Data Science and Intelligent Systems
  doi: 10.47852/bonviewJDSIS3202837
– volume: 36
  start-page: 7655
  year: 2022
  ident: erxae0fd8bib17
  article-title: Efficient continuous control with double actors and regularized critics
  publication-title: Proceedings of the AAAI Conference on Artificial Intelligence
  doi: 10.1609/aaai.v36i7.20732
– volume: 40
  start-page: 1098
  year: 2022
  ident: erxae0fd8bib5
  article-title: Dynamics and path tracking of continuum robotic arms using data-driven identification tools
  publication-title: Robotica
  doi: 10.1017/S026357472100093X
– volume: 53
  start-page: 7957
  year: 2023
  ident: erxae0fd8bib7
  article-title: Trajectory tracking of variable centroid objects based on fusion of vision and force perception
  publication-title: IEEE Transactions on Cybernetics
  doi: 10.1109/TCYB.2023.3240502
– volume: 9
  start-page: 5559
  year: 2024
  ident: erxae0fd8bib18
  article-title: Actor-hybrid-attention-critic for multi-logistic robots path planning
  publication-title: IEEE Robotics and Automation Letters
  doi: 10.1109/LRA.2024.3396023
– volume: 13
  start-page: 192
  year: 2024
  ident: erxae0fd8bib14
  article-title: Design and implementation of an optimized PID controller for two-limb robot arm control
  publication-title: Bitlis Eren Üniversitesi Fen Bilimleri Dergisi
  doi: 10.17798/bitlisfen.1370223
– volume: 3
  start-page: 180
  year: 2022
  ident: erxae0fd8bib4
  article-title: Computer vision-based robotic arm for object color, shape, and size detection
  publication-title: Journal of Robotics and Control
  doi: 10.18196/jrc.V3i2.13906
– volume: 47
  start-page: 830
  year: 2024
  ident: erxae0fd8bib6
  article-title: Trajectory control and optimization of PID controller parameters for dual-arms with a single-link underwater robot manipulator
  publication-title: J. Chin. Inst. Eng.
  doi: 10.1080/02533839.2024.2383566
SSID ssib046616717
ssib037096498
ssib052001916
Score 2.3134143
Snippet To solve the problems of response lag and limited generalization of a single algorithm in traditional control methods for robotic arm trajectory tracking, a...
SourceID crossref
iop
SourceType Index Database
Publisher
StartPage 45532
SubjectTerms feedforward compensation
PID
robotic arm control
SAC
sparrow optimization algorithm
Title Control method of robotic arm integrating PID feedforward compensation and SAC algorithm
URI https://iopscience.iop.org/article/10.1088/2631-8695/ae0fd8
Volume 7
WOSCitedRecordID wos001594165500001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIOP
  databaseName: Institute of Physics Open Access Journal Titles
  customDbUrl:
  eissn: 2631-8695
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssib037096498
  issn: 2631-8695
  databaseCode: O3W
  dateStart: 20190711
  isFulltext: true
  titleUrlDefault: http://iopscience.iop.org/
  providerName: IOP Publishing
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV07T8MwELbawsDCQ4AoL3mAgSE0sZ3EEVNVqGAplQDRLbIdGyq1SZUGfj_nPKBIICGxZThF1pc7f9_pLncInYXahJB2uA7XnnZYlNj6bhI5iSs50ZKR0BPlsolwNOKTSTRuoavPf2GyRX31X8JjNSi4grBuiOM9ElDP4UHk94R2TcLbaI1yoHFw5nv63DgTDUGcs69cggERBSu5ix03BLlKU7r86cXfqKoNx1lhnuHWv868jTZrwYn7lekOaul0F00GVYc6rhZI48zgPJMZmGCRz3EzQwJoDY_vrrEBigNxaxtsse1Bh9S3_KBYpAl-6A-wmL1k-bR4ne-hp-HN4-DWqXcsOIpQv3Ai5UkumC8g0DVoN-4qVxmiPEMMNUr40ooiuARJxJhWIChcIYj0I8moCrSm-6iTZqk-QBgiOaQCFIgKgfJoIkEqejIhRlAK6AdddNHAGS-qURpxWQLnPLb4xBafuMKni84ByriOp-Wvdod_tDtCG8Qu7i0nNB6jTpG_6RO0rt6L6TI_LR3nA-Q6wXk
linkProvider IOP Publishing
linkToPdf http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3PS8MwFA5uinjxByrOnznowUNdm6Rtehybw6HMgYq7lSRNdODa0VX_fl_aDicoCN56eJTwJS_ve7yX7yF0HmoTQtrhOlx72mFRYuu7SeQkruRES0ZCT5TDJsLhkI_H0aiec1q-hclm9dV_BZ-VUHAFYd0Qx9skoJ7Dg8hvC-2ahLdniWmgVatTYo_1PX1eHCgaAkFnX_kEg2AULOUvVnII8pVF-fKnn38LVw1Y0lL06W_9e93baLMmnrhTme-gFZ3uonG36lTH1SBpnBmcZzIDEyzyKV5oSUB4w6NBDxsIdUBybaMttr3okAKXG4tFmuCHTheLt5csnxSv0z301L9-7N449awFRxHqF06kPMkF8wU4vAYOx13lKkOUZ4ihRglfWnIElyGJGNMKiIUrBJF-JBlVgdZ0HzXTLNUHCINHh1QAE1EhhD6aSKCMnkyIEZTCDgQtdLmANJ5VkhpxWQrnPLYYxRajuMKohS4Azrj2q_mvdod_tDtD66NeP74bDG-P0Aaxs3xL0cZj1Czyd32C1tRHMZnnp-U5-gSYgcbh
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Control+method+of+robotic+arm+integrating+PID+feedforward+compensation+and+SAC+algorithm&rft.jtitle=Engineering+Research+Express&rft.au=Yu%2C+Shuang&rft.au=Chen%2C+Wei&rft.au=Li%2C+Jian&rft.au=Zhou%2C+Xin&rft.date=2025-12-31&rft.pub=IOP+Publishing&rft.eissn=2631-8695&rft.volume=7&rft.issue=4&rft_id=info:doi/10.1088%2F2631-8695%2Fae0fd8&rft.externalDocID=erxae0fd8
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2631-8695&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2631-8695&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2631-8695&client=summon