A Unified MPC Framework for Whole-Body Dynamic Locomotion and Manipulation

In this letter, we propose a whole-body planning framework that unifies dynamic locomotion and manipulation tasks by formulating a single multi-contact optimal control problem. We model the hybrid nature of a generic multi-limbed mobile manipulator as a switched system, and introduce a set of constr...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE robotics and automation letters Jg. 6; H. 3; S. 4688 - 4695
Hauptverfasser: Sleiman, Jean-Pierre, Farshidian, Farbod, Minniti, Maria Vittoria, Hutter, Marco
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Piscataway IEEE 01.07.2021
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:
ISSN:2377-3766, 2377-3766
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract In this letter, we propose a whole-body planning framework that unifies dynamic locomotion and manipulation tasks by formulating a single multi-contact optimal control problem. We model the hybrid nature of a generic multi-limbed mobile manipulator as a switched system, and introduce a set of constraints that can encode any pre-defined gait sequence or manipulation schedule in the formulation. Since the system is designed to actively manipulate its environment, the equations of motion are composed by augmenting the robot's centroidal dynamics with the manipulated-object dynamics. This allows us to describe any high-level task in the same cost/constraint function. The resulting planning framework could be solved on the robot's onboard computer in real-time within a model predictive control scheme. This is demonstrated in a set of real hardware experiments done in free-motion, such as base or end-effector pose tracking, and while pushing/pulling a heavy resistive door. Robustness against model mismatches and external disturbances is also verified during these test cases.
AbstractList In this letter, we propose a whole-body planning framework that unifies dynamic locomotion and manipulation tasks by formulating a single multi-contact optimal control problem. We model the hybrid nature of a generic multi-limbed mobile manipulator as a switched system, and introduce a set of constraints that can encode any pre-defined gait sequence or manipulation schedule in the formulation. Since the system is designed to actively manipulate its environment, the equations of motion are composed by augmenting the robot's centroidal dynamics with the manipulated-object dynamics. This allows us to describe any high-level task in the same cost/constraint function. The resulting planning framework could be solved on the robot's onboard computer in real-time within a model predictive control scheme. This is demonstrated in a set of real hardware experiments done in free-motion, such as base or end-effector pose tracking, and while pushing/pulling a heavy resistive door. Robustness against model mismatches and external disturbances is also verified during these test cases.
Author Sleiman, Jean-Pierre
Minniti, Maria Vittoria
Hutter, Marco
Farshidian, Farbod
Author_xml – sequence: 1
  givenname: Jean-Pierre
  orcidid: 0000-0002-9935-8787
  surname: Sleiman
  fullname: Sleiman, Jean-Pierre
  email: jsleiman@ethz.ch
  organization: Robotic Systems Lab, ETH Zurich, Zurich, Switzerland
– sequence: 2
  givenname: Farbod
  orcidid: 0000-0001-8269-6272
  surname: Farshidian
  fullname: Farshidian, Farbod
  email: farshidian@mavt.ethz.ch
  organization: Robotic Systems Lab, ETH Zurich, Zurich, Switzerland
– sequence: 3
  givenname: Maria Vittoria
  orcidid: 0000-0001-7272-0937
  surname: Minniti
  fullname: Minniti, Maria Vittoria
  email: mariavittoria.minniti@mavt.ethz.ch
  organization: Robotic Systems Lab, ETH Zurich, Zurich, Switzerland
– sequence: 4
  givenname: Marco
  orcidid: 0000-0002-4285-4990
  surname: Hutter
  fullname: Hutter, Marco
  email: mahutter@ethz.ch
  organization: Robotic Systems Lab, ETH Zurich, Zurich, Switzerland
BookMark eNp9kE1LAzEQhoNUsNbeBS8Bz1uTTDfZHGu1flBRxOIxZLNZTN1NanaL9N-7tUXEg6cMmfeZGZ5j1PPBW4ROKRlRSuTF_HkyYoTRERCeSZIdoD4DIRIQnPd-1Udo2DRLQghNmQCZ9tH9BC-8K50t8MPTFM-iru1niO-4DBG_voXKJpeh2OCrjde1M3geTKhD64LH2neM9m61rvT24wQdlrpq7HD_DtBidv0yvU3mjzd308k8MSBlm-SajHOdGwAjpaV5RklBrBgTWlILghgpSmCyyDRlUkjObdemMoNcGOBcwwCd7-auYvhY26ZVy7COvlupWEoBMkkh7VJ8lzIxNE20pTKu_b6zjdpVihK1Vac6dWqrTu3VdSD5A66iq3Xc_Iec7RBnrf2JS8gEZRS-AC_peUw
CODEN IRALC6
CitedBy_id crossref_primary_10_1016_j_robot_2023_104411
crossref_primary_10_1109_LRA_2024_3475052
crossref_primary_10_1002_aisy_202500242
crossref_primary_10_1109_TIE_2022_3212397
crossref_primary_10_1007_s12555_023_0299_5
crossref_primary_10_1109_TRO_2022_3186804
crossref_primary_10_1109_TRO_2023_3275384
crossref_primary_10_1109_TIE_2023_3299041
crossref_primary_10_1177_02783649241312698
crossref_primary_10_1109_TRO_2024_3351554
crossref_primary_10_1109_LRA_2023_3264758
crossref_primary_10_1134_S1064230724700710
crossref_primary_10_1002_advs_202309058
crossref_primary_10_1109_LRA_2025_3551230
crossref_primary_10_1109_LRA_2022_3143567
crossref_primary_10_1109_LRA_2023_3335777
crossref_primary_10_1007_s12555_022_0287_1
crossref_primary_10_1109_MCS_2022_3187542
crossref_primary_10_3390_robotics13040059
crossref_primary_10_3390_s24186070
crossref_primary_10_1126_scirobotics_ade9548
crossref_primary_10_1007_s42235_023_00468_1
crossref_primary_10_1016_j_robot_2023_104468
crossref_primary_10_1109_TRO_2023_3284346
crossref_primary_10_1126_scirobotics_adg5014
crossref_primary_10_1109_LRA_2022_3187262
crossref_primary_10_1109_LRA_2022_3189166
crossref_primary_10_1002_rob_22526
crossref_primary_10_1109_TRO_2024_3359531
crossref_primary_10_1109_TRO_2024_3435423
crossref_primary_10_1007_s10846_025_02249_w
crossref_primary_10_1109_LRA_2024_3524902
crossref_primary_10_1080_01691864_2023_2168134
crossref_primary_10_1109_TRO_2025_3595674
crossref_primary_10_1002_aisy_202300172
crossref_primary_10_1109_LRA_2024_3448131
crossref_primary_10_3390_machines10110975
crossref_primary_10_1109_LRA_2024_3455944
crossref_primary_10_1016_j_autcon_2022_104634
crossref_primary_10_1017_S0263574723000371
crossref_primary_10_3390_math13010154
crossref_primary_10_7746_jkros_2025_20_1_112
crossref_primary_10_1007_s10514_023_10146_0
crossref_primary_10_1177_09544062251348298
crossref_primary_10_1007_s10015_022_00799_y
crossref_primary_10_1109_LRA_2025_3598620
crossref_primary_10_1109_TETCI_2022_3146387
crossref_primary_10_1109_LRA_2024_3486211
crossref_primary_10_1109_LRA_2025_3594984
crossref_primary_10_1007_s11071_024_09445_7
crossref_primary_10_1126_scirobotics_adu3922
crossref_primary_10_1109_TRO_2023_3324580
crossref_primary_10_1109_ACCESS_2024_3360479
crossref_primary_10_1109_TRO_2022_3228390
crossref_primary_10_1016_j_robot_2023_104431
crossref_primary_10_1109_TMECH_2024_3446840
crossref_primary_10_1109_TRO_2025_3554411
crossref_primary_10_1109_TASE_2024_3412111
crossref_primary_10_1016_j_ifacol_2024_09_057
crossref_primary_10_1016_j_inffus_2025_103337
crossref_primary_10_1109_TRO_2023_3302239
crossref_primary_10_1109_TRO_2024_3410408
crossref_primary_10_3390_mi12101189
crossref_primary_10_3390_s22031292
crossref_primary_10_3390_machines10121222
crossref_primary_10_1016_j_birob_2021_100029
crossref_primary_10_3390_robotics13120171
crossref_primary_10_1186_s10033_024_01040_6
crossref_primary_10_1109_LRA_2024_3455907
crossref_primary_10_1007_s42235_024_00589_1
crossref_primary_10_1016_j_jfranklin_2022_12_015
crossref_primary_10_1109_LRA_2025_3577875
crossref_primary_10_34133_cbsystems_0203
crossref_primary_10_1016_j_isatra_2024_01_020
crossref_primary_10_3390_act11110304
crossref_primary_10_1007_s10846_023_01866_7
crossref_primary_10_3389_frobt_2024_1442813
Cites_doi 10.1109/JRA.1987.1087068
10.1109/TRO.2011.2142450
10.1109/IROS.2018.8594448
10.1109/IROS.2017.8206174
10.1109/LRA.2018.2798285
10.1109/ACC.2005.1469949
10.1177/0278364914521306
10.1109/IROS40897.2019.8968251
10.1109/SII.2019.8700380
10.1109/LRA.2019.2908502
10.1109/ICRA40945.2020.9196673
10.1109/HUMANOIDS.2016.7803330
10.1109/LRA.2018.2800124
10.1109/ICRA40945.2020.9197312
10.1109/HUMANOIDS.2017.8246930
10.1109/ICRA.2014.6907230
10.1137/S0363012902400713
10.1117/12.919939
10.1109/ICRA.2019.8794273
10.1007/978-3-642-36279-8_32
10.1109/IROS.2015.7353843
10.1109/HUMANOIDS.2015.7363428
10.1109/ICRA48506.2021.9560795
10.1109/HUMANOIDS.2014.7041375
10.1109/ICRA.2017.7989016
10.1007/s10514-013-9341-4
10.1109/TSMCA.2004.832811
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/LRA.2021.3068908
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
DatabaseTitleList Technology Research Database

Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 2377-3766
EndPage 4695
ExternalDocumentID 10_1109_LRA_2021_3068908
9387121
Genre orig-research
GrantInformation_xml – fundername: National Centre of Competence in Research Digital Fabrication
– fundername: TenneT
– fundername: National Centre of Competence in Research Robotics
  funderid: 10.13039/501100011021
– fundername: Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung; Swiss National Science Foundation
  funderid: 10.13039/501100001711
GroupedDBID 0R~
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFS
AGQYO
AGSQL
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
EBS
EJD
IFIPE
IPLJI
JAVBF
KQ8
M43
M~E
O9-
OCL
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c399t-ba04babc33c99e1b810d0e7401f1e370c97f329d8a1297966ed0e1983b7c366a3
IEDL.DBID RIE
ISICitedReferencesCount 148
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000640765600033&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 2377-3766
IngestDate Mon Jun 30 05:30:37 EDT 2025
Tue Nov 18 21:33:22 EST 2025
Sat Nov 29 06:03:11 EST 2025
Wed Aug 27 02:30:25 EDT 2025
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 3
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c399t-ba04babc33c99e1b810d0e7401f1e370c97f329d8a1297966ed0e1983b7c366a3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0002-9935-8787
0000-0002-4285-4990
0000-0001-8269-6272
0000-0001-7272-0937
OpenAccessLink http://hdl.handle.net/20.500.11850/476411
PQID 2513389135
PQPubID 4437225
PageCount 8
ParticipantIDs crossref_primary_10_1109_LRA_2021_3068908
proquest_journals_2513389135
ieee_primary_9387121
crossref_citationtrail_10_1109_LRA_2021_3068908
PublicationCentury 2000
PublicationDate 2021-07-01
PublicationDateYYYYMMDD 2021-07-01
PublicationDate_xml – month: 07
  year: 2021
  text: 2021-07-01
  day: 01
PublicationDecade 2020
PublicationPlace Piscataway
PublicationPlace_xml – name: Piscataway
PublicationTitle IEEE robotics and automation letters
PublicationTitleAbbrev LRA
PublicationYear 2021
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref12
ref15
ref14
ref31
carpentier (ref30) 2015
jacobson (ref25) 1970
ref11
ref10
ref2
ref1
ref17
ref16
ref19
ref18
bell (ref32) 2019
ref24
ref23
ref26
ref20
ref22
ref21
nocedal (ref29) 2006
ref8
ref7
sleiman (ref28) 2021
ref9
ref4
ref3
ref6
ref5
wieber (ref27) 2006
References_xml – ident: ref1
  doi: 10.1109/JRA.1987.1087068
– ident: ref2
  doi: 10.1109/TRO.2011.2142450
– ident: ref13
  doi: 10.1109/IROS.2018.8594448
– ident: ref11
  doi: 10.1109/IROS.2017.8206174
– ident: ref15
  doi: 10.1109/LRA.2018.2798285
– year: 2019
  ident: ref32
  article-title: CppAD: A package for C algorithmic differentiation
– ident: ref24
  doi: 10.1109/ACC.2005.1469949
– start-page: 614
  year: 2015
  ident: ref30
  article-title: Pinocchio: Fast forward and inverse dynamics for poly-articulated systems
– ident: ref3
  doi: 10.1177/0278364914521306
– year: 1970
  ident: ref25
  article-title: Differential Dynamic Programming
  publication-title: (ser Modern Analytic and Computational Methods in Science and Mathematics)
– ident: ref19
  doi: 10.1109/IROS40897.2019.8968251
– ident: ref31
  doi: 10.1109/SII.2019.8700380
– ident: ref6
  doi: 10.1109/LRA.2019.2908502
– ident: ref10
  doi: 10.1109/ICRA40945.2020.9196673
– start-page: 411
  year: 2006
  ident: ref27
  publication-title: Holonomy and Nonholonomy in the Dynamics of Articulated Motion
– ident: ref5
  doi: 10.1109/HUMANOIDS.2016.7803330
– ident: ref7
  doi: 10.1109/LRA.2018.2800124
– ident: ref14
  doi: 10.1109/ICRA40945.2020.9197312
– ident: ref21
  doi: 10.1109/HUMANOIDS.2017.8246930
– ident: ref4
  doi: 10.1109/ICRA.2014.6907230
– ident: ref26
  doi: 10.1137/S0363012902400713
– year: 2006
  ident: ref29
  publication-title: Numerical Optimization
– ident: ref22
  doi: 10.1117/12.919939
– ident: ref23
  doi: 10.1109/ICRA.2019.8794273
– ident: ref9
  doi: 10.1007/978-3-642-36279-8_32
– ident: ref8
  doi: 10.1109/IROS.2015.7353843
– ident: ref18
  doi: 10.1109/HUMANOIDS.2015.7363428
– year: 2021
  ident: ref28
  article-title: Constraint handling in continuous-time ddp-based model predictive control
  doi: 10.1109/ICRA48506.2021.9560795
– ident: ref16
  doi: 10.1109/HUMANOIDS.2014.7041375
– ident: ref20
  doi: 10.1109/ICRA.2017.7989016
– ident: ref17
  doi: 10.1007/s10514-013-9341-4
– ident: ref12
  doi: 10.1109/TSMCA.2004.832811
SSID ssj0001527395
Score 2.6001532
Snippet In this letter, we propose a whole-body planning framework that unifies dynamic locomotion and manipulation tasks by formulating a single multi-contact optimal...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 4688
SubjectTerms Airborne/spaceborne computers
Dynamics
End effectors
Equations of motion
Gait
Legged robots
Locomotion
Manipulator dynamics
Mathematical model
mobile manipulation
Model testing
multi-contact whole-body motion planning and control
Optimal control
optimization and optimal control
Predictive control
Robot dynamics
Robot kinematics
Robots
Schedules
Task analysis
Title A Unified MPC Framework for Whole-Body Dynamic Locomotion and Manipulation
URI https://ieeexplore.ieee.org/document/9387121
https://www.proquest.com/docview/2513389135
Volume 6
WOSCitedRecordID wos000640765600033&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIEE
  databaseName: IEEE Electronic Library (IEL)
  customDbUrl:
  eissn: 2377-3766
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001527395
  issn: 2377-3766
  databaseCode: RIE
  dateStart: 20160101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 2377-3766
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001527395
  issn: 2377-3766
  databaseCode: M~E
  dateStart: 20160101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3NS8MwFH9sw4Me_JridI4cvAh2S5t2SY5zbohsY4jibiVJUxhIK_sQvPi3m_RjDhTBWyF5obyX9v2S9_EDuCIxZpIH0tGKUsdnPHZYICPHgHGmsYxdX2eWHtHJhM1mfFqBm00tjNY6Sz7TbfuYxfKjVK3tVVmHEwPvbdV4ldJuXqv1fZ9iO4nxoIxEYt4ZPfbM-c9z2wYVM275I7c8T0al8uP_mzmV4cH_XucQ9gvwiHq5tY-gopNj2NtqKViHhx4yMDI2wBKNp300LHOvkAGn6MWS4Tq3afSB7nImejRKVZoz-SCRGBmRzEtGrxN4Hg6e-vdOwZfgKAMzVo4U2JdCKkIU59qVzMUR1pZyL3Y1oVhxGhOPR0wYJ0_NOUebYZczIqki3a4gp1BL0kSfAfJUpM2iZtRnvuC-9IIYSyp9JnDc5aIBnVKXoSqaiVtOi9cwO1RgHhrth1b7YaH9BlxvJN7yRhp_zK1bbW_mFYpuQLM0V1h8acvQswQ1NtYanP8udQG7du08xbYJtdVirS9hR72v5stFC6rjz0Er20pfHJnFrA
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1bS8MwFD6MKagP3qY4r3nwRbBb2qRr8jinw0s3hkzcW0nSFAbSypyC_96klzlQBN8KyWnLOWnPl5zLB3BOEswk96WjVRA4lPHEYb6MHQPGmcYycanOLR0GwyGbTPioBpeLWhitdZ58plv2Mo_lx5l6t0dlbU4MvLdV4ys-pR4uqrW-T1RsLzHuV7FIzNvhY9fsAD23ZXAx45ZBcsn35GQqP_7AuVvpb_3vhbZhs4SPqFvYewdqOt2FjaWmgg247yIDJBMDLdFg1EP9KvsKGXiKni0drnOVxZ_ouuCiR2GmsoLLB4nUyIh0WnF67cFT_2bcu3VKxgRHGaAxd6TAVAqpCFGca1cyF8dYW9K9xNUkwIoHCfF4zIRx84HZ6Wgz7HJGZKBIpyPIPtTTLNUHgDwVa3NTM0oZFZxKz0-wDCRlAicdLprQrnQZqbKduGW1eInybQXmkdF-ZLUfldpvwsVC4rVopfHH3IbV9mJeqegmHFfmispv7S3yLEWNjbb6h79LncHa7XgQRuHd8OEI1u1zioTbY6jPZ-_6BFbVx3z6NjvNF9QX4T_Hwg
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Unified+MPC+Framework+for+Whole-Body+Dynamic+Locomotion+and+Manipulation&rft.jtitle=IEEE+robotics+and+automation+letters&rft.au=Sleiman%2C+Jean-Pierre&rft.au=Farshidian%2C+Farbod&rft.au=Minniti%2C+Maria+Vittoria&rft.au=Hutter%2C+Marco&rft.date=2021-07-01&rft.issn=2377-3766&rft.eissn=2377-3766&rft.volume=6&rft.issue=3&rft.spage=4688&rft.epage=4695&rft_id=info:doi/10.1109%2FLRA.2021.3068908&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_LRA_2021_3068908
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2377-3766&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2377-3766&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2377-3766&client=summon