Neuromuscular Interfacing for Advancing Kinesthetic and Teleoperated Programming by Demonstration of Collaborative Robots

This study addresses the challenges of Programming by Demonstration (PbD) in the context of collaborative robots, focusing on the need to provide additional degrees of programming without hindering the user's ability to demonstrate trajectories. The study proposes the use of a wearable human-ro...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:IEEE transactions on haptics Ročník 18; číslo 1; s. 45 - 57
Hlavní autori: Meattini, Roberto, Ameri, Armando, Bernardini, Alessandra, Gonzalez-Huarte, Javier, Ibarguren, Aitor, Melchiorri, Claudio, Palli, Gianluca
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: United States IEEE 01.01.2025
Predmet:
Adult
advanced human-robot interfaces
Collaborative robots
Electromyography
Feedback, Sensory - physiology
Female
Grippers
Human-robot interaction
Humans
Jacobian matrices
Kinesthesis - physiology
Male
Motors
Muscle, Skeletal - physiology
Neuromuscular
Programming
Programming by demonstration
Robot kinematics
robotic wiring
Robotics - instrumentation
Trajectory
User-Computer Interface
Wearable devices
Wearable Electronic Devices
Young Adult
ISSN:1939-1412, 2329-4051, 2329-4051
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Abstract This study addresses the challenges of Programming by Demonstration (PbD) in the context of collaborative robots, focusing on the need to provide additional degrees of programming without hindering the user's ability to demonstrate trajectories. The study proposes the use of a wearable human-robot interface based on surface Electromyography (sEMG) to measure the forearm's muscle co-contraction level, enabling additional programming inputs through hand stiffening level modulations without interfering with voluntary movements. Vibrotactile feedback enhances the operator's understanding of the additional programming inputs during PbD tasks. The proposed approach is demonstrated through experiments involving a collaborative robot performing an industrial wiring task. The results showcase the effectiveness and intuitiveness of the interface, allowing simultaneous programming of robot compliance and gripper grasping. The framework, applicable to both teleoperation and kinesthetic teaching, demonstrated effectively in an industrial wiring task with a 100% success rate over the group of subjects. Furthermore, the presence of vibortactile feedback showed an average decrease of programming errors of 33%, and statistical analyses confirmed the subjects' ability to correctly modulate co-contraction levels. This innovative framework augments programming by demonstration by integrating neuromuscular interfacing and introducing structured programming logics, providing an intuitive human-robot interaction for programming both gripper and compliance in teleoperation and kinesthetic teaching.
AbstractList This study addresses the challenges of Programming by Demonstration (PbD) in the context of collaborative robots, focusing on the need to provide additional degrees of programming without hindering the user's ability to demonstrate trajectories. The study proposes the use of a wearable human-robot interface based on surface Electromyography (sEMG) to measure the forearm's muscle co-contraction level, enabling additional programming inputs through hand stiffening level modulations without interfering with voluntary movements. Vibrotactile feedback enhances the operator's understanding of the additional programming inputs during PbD tasks. The proposed approach is demonstrated through experiments involving a collaborative robot performing an industrial wiring task. The results showcase the effectiveness and intuitiveness of the interface, allowing simultaneous programming of robot compliance and gripper grasping. The framework, applicable to both teleoperation and kinesthetic teaching, demonstrated effectively in an industrial wiring task with a 100% success rate over the group of subjects. Furthermore, the presence of vibortactile feedback showed an average decrease of programming errors of 33%, and statistical analyses confirmed the subjects' ability to correctly modulate co-contraction levels. This innovative framework augments programming by demonstration by integrating neuromuscular interfacing and introducing structured programming logics, providing an intuitive human-robot interaction for programming both gripper and compliance in teleoperation and kinesthetic teaching.
This study addresses the challenges of Programming by Demonstration (PbD) in the context of collaborative robots, focusing on the need to provide additional degrees of programming without hindering the user's ability to demonstrate trajectories. The study proposes the use of a wearable human-robot interface based on surface Electromyography (sEMG) to measure the forearm's muscle co-contraction level, enabling additional programming inputs through hand stiffening level modulations without interfering with voluntary movements. Vibrotactile feedback enhances the operator's understanding of the additional programming inputs during PbD tasks. The proposed approach is demonstrated through experiments involving a collaborative robot performing an industrial wiring task. The results showcase the effectiveness and intuitiveness of the interface, allowing simultaneous programming of robot compliance and gripper grasping. The framework, applicable to both teleoperation and kinesthetic teaching, demonstrated effectively in an industrial wiring task with a 100% success rate over the group of subjects. Furthermore, the presence of vibortactile feedback showed an average decrease of programming errors of 33%, and statistical analyses confirmed the subjects' ability to correctly modulate co-contraction levels. This innovative framework augments programming by demonstration by integrating neuromuscular interfacing and introducing structured programming logics, providing an intuitive human-robot interaction for programming both gripper and compliance in teleoperation and kinesthetic teaching.This study addresses the challenges of Programming by Demonstration (PbD) in the context of collaborative robots, focusing on the need to provide additional degrees of programming without hindering the user's ability to demonstrate trajectories. The study proposes the use of a wearable human-robot interface based on surface Electromyography (sEMG) to measure the forearm's muscle co-contraction level, enabling additional programming inputs through hand stiffening level modulations without interfering with voluntary movements. Vibrotactile feedback enhances the operator's understanding of the additional programming inputs during PbD tasks. The proposed approach is demonstrated through experiments involving a collaborative robot performing an industrial wiring task. The results showcase the effectiveness and intuitiveness of the interface, allowing simultaneous programming of robot compliance and gripper grasping. The framework, applicable to both teleoperation and kinesthetic teaching, demonstrated effectively in an industrial wiring task with a 100% success rate over the group of subjects. Furthermore, the presence of vibortactile feedback showed an average decrease of programming errors of 33%, and statistical analyses confirmed the subjects' ability to correctly modulate co-contraction levels. This innovative framework augments programming by demonstration by integrating neuromuscular interfacing and introducing structured programming logics, providing an intuitive human-robot interaction for programming both gripper and compliance in teleoperation and kinesthetic teaching.
Author Meattini, Roberto
Palli, Gianluca
Bernardini, Alessandra
Ibarguren, Aitor
Ameri, Armando
Gonzalez-Huarte, Javier
Melchiorri, Claudio
Author_xml – sequence: 1
  givenname: Roberto
  orcidid: 0000-0003-0085-915X
  surname: Meattini
  fullname: Meattini, Roberto
  email: roberto.meattini@unibo.it
  organization: Department of Electrical, Electronic and Information Engineering "Guglielmo Marconi,", University of Bologna, Bologna, Italy
– sequence: 2
  givenname: Armando
  surname: Ameri
  fullname: Ameri, Armando
  organization: Department of Electrical, Electronic and Information Engineering "Guglielmo Marconi,", University of Bologna, Bologna, Italy
– sequence: 3
  givenname: Alessandra
  orcidid: 0009-0006-6784-2298
  surname: Bernardini
  fullname: Bernardini, Alessandra
  organization: Department of Electrical, Electronic and Information Engineering "Guglielmo Marconi,", University of Bologna, Bologna, Italy
– sequence: 4
  givenname: Javier
  orcidid: 0000-0001-8315-6120
  surname: Gonzalez-Huarte
  fullname: Gonzalez-Huarte, Javier
  organization: TECNALIA, Basque Research and Technology Alliance (BRTA), Donostia-San Sebastián, Spain
– sequence: 5
  givenname: Aitor
  orcidid: 0000-0002-1601-3645
  surname: Ibarguren
  fullname: Ibarguren, Aitor
  email: aitor.ibarguren@tecnalia.com
  organization: TECNALIA, Basque Research and Technology Alliance (BRTA), Donostia-San Sebastián, Spain
– sequence: 6
  givenname: Claudio
  orcidid: 0000-0002-8475-6782
  surname: Melchiorri
  fullname: Melchiorri, Claudio
  organization: Department of Electrical, Electronic and Information Engineering "Guglielmo Marconi,", University of Bologna, Bologna, Italy
– sequence: 7
  givenname: Gianluca
  orcidid: 0000-0001-9457-4643
  surname: Palli
  fullname: Palli, Gianluca
  organization: Department of Electrical, Electronic and Information Engineering "Guglielmo Marconi,", University of Bologna, Bologna, Italy
BackLink https://www.ncbi.nlm.nih.gov/pubmed/39437283$$D View this record in MEDLINE/PubMed
BookMark eNpNkctP3DAQxi1EVRbonUNV-dhLFr8Sx0e0lIdApaqWc-THmAYl9tZOkPa_J2EXxGk0M79vNDPfMToMMQBCZ5QsKSXqfP1ws2SEiSUXteCSH6AF40wVgpT0EC2o4qqggrIjdJzzMyEVk0p8RUdcTTSr-QJtf8OYYj9mO3Y64dswQPLatuEJ-5jwhXvR4S27awPk4R8MrcU6OLyGDuIGkh7A4T8pPiXd9zNotvgS-hjyMPXaGHD0eBW7Tps4F14A_40mDvkUffG6y_BtH0_Q49Wv9eqmuH-4vl1d3BeW13IoWElMxWsojTXU-pp7U3nvROUtlaV1hlaKVbUslddKKa284wwkZ5WC0jnKT9DP3dxNiv_H6Yamb7OFaaEAccwNp1RJRqWY0R97dDQ9uGaT2l6nbfP-rgkgO8CmmHMC_4FQ0syONJMjzexIs3dkknzfSVoA-IRLVkkh-StRnolW
CODEN ITHEBX
Cites_doi 10.1007/s10514-011-9234-3
10.1109/TRO.2023.3258669
10.1155/2018/8658791
10.1109/HRI.2016.7451753
10.1007/978-3-642-41610-1_27-1
10.1109/LRA.2018.2805105
10.1126/science.126.3287.1345
10.1109/IROS.2013.6696620
10.1109/ICRA40945.2020.9196904
10.1007/978-3-540-30301-5_60
10.1109/ICRA.2015.7139387
10.1098/rstb.2002.1258
10.1016/j.jelekin.2008.05.007
10.1109/LRA.2021.3092269
10.1109/TCPMT.2018.2799987
10.1109/ROBOT.2008.4543616
10.1109/TBME.1968.4502576
10.1109/TMECH.2018.2817589
10.1016/j.ifacol.2023.01.125
ContentType Journal Article
DBID 97E
RIA
RIE
AAYXX
CITATION
CGR
CUY
CVF
ECM
EIF
NPM
7X8
DOI 10.1109/TOH.2024.3484373
DatabaseName IEEE Xplore (IEEE)
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Xplore
CrossRef
Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
MEDLINE - Academic
DatabaseTitle CrossRef
MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
MEDLINE - Academic
DatabaseTitleList
MEDLINE - Academic
MEDLINE
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: RIE
  name: IEEE Xplore
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
– sequence: 3
  dbid: 7X8
  name: MEDLINE - Academic
  url: https://search.proquest.com/medline
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISSN 2329-4051
EndPage 57
ExternalDocumentID 39437283
10_1109_TOH_2024_3484373
10726747
Genre orig-research
Journal Article
GrantInformation_xml – fundername: European Commission's Horizon 2020 Programme with the Project REMODEL
  grantid: 870133
– fundername: MUR with the Project "Sustainable Mobility Center"
  grantid: CN00000023-CUP; J33C22001120001
GroupedDBID 0R~
29I
4.4
5GY
5VS
6IK
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACIWK
AENEX
AETIX
AGQYO
AGSQL
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
EBS
EJD
F5P
HZ~
IEDLZ
IFIPE
IPLJI
JAVBF
M43
O9-
OCL
PQQKQ
RIA
RIE
RNI
RNS
RZB
AAYXX
CITATION
CGR
CUY
CVF
ECM
EIF
NPM
RIG
7X8
ID FETCH-LOGICAL-c387t-250b638e5bcb1cf83fb6ffd46fc175cdb169268759fa999a9fd32e73269e5dd13
IEDL.DBID RIE
ISICitedReferencesCount 2
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001449685500003&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1939-1412
2329-4051
IngestDate Sun Nov 09 13:22:22 EST 2025
Fri May 30 10:59:47 EDT 2025
Sat Nov 29 07:49:24 EST 2025
Wed Aug 27 01:37:10 EDT 2025
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 1
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c387t-250b638e5bcb1cf83fb6ffd46fc175cdb169268759fa999a9fd32e73269e5dd13
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ORCID 0009-0006-6784-2298
0000-0003-0085-915X
0000-0002-8475-6782
0000-0001-9457-4643
0000-0001-8315-6120
0000-0002-1601-3645
OpenAccessLink https://hdl.handle.net/11585/1008105
PMID 39437283
PQID 3119721741
PQPubID 23479
PageCount 13
ParticipantIDs ieee_primary_10726747
crossref_primary_10_1109_TOH_2024_3484373
pubmed_primary_39437283
proquest_miscellaneous_3119721741
PublicationCentury 2000
PublicationDate 2025-01-01
PublicationDateYYYYMMDD 2025-01-01
PublicationDate_xml – month: 01
  year: 2025
  text: 2025-01-01
  day: 01
PublicationDecade 2020
PublicationPlace United States
PublicationPlace_xml – name: United States
PublicationTitle IEEE transactions on haptics
PublicationTitleAbbrev TOH
PublicationTitleAlternate IEEE Trans Haptics
PublicationYear 2025
Publisher IEEE
Publisher_xml – name: IEEE
References ref13
ref12
ref15
(ref23) 2023
ref14
ref20
ref22
ref10
Siciliano (ref16) 2010
ref2
ref1
Wu (ref11) 2018
ref17
ref19
ref18
ref8
ref7
ref9
ref4
ref3
ref6
ref5
References_xml – ident: ref3
  doi: 10.1007/s10514-011-9234-3
– ident: ref15
  doi: 10.1109/TRO.2023.3258669
– volume-title: Math. Problems Eng.
  year: 2018
  ident: ref11
  article-title: Human-robot interaction and demonstration learning mode based on electromyogram signal and variable impedance control
  doi: 10.1155/2018/8658791
– ident: ref7
  doi: 10.1109/HRI.2016.7451753
– ident: ref5
  doi: 10.1007/978-3-642-41610-1_27-1
– ident: ref6
  doi: 10.1109/LRA.2018.2805105
– year: 2023
  ident: ref23
  article-title: Remodel project
– ident: ref18
  doi: 10.1126/science.126.3287.1345
– ident: ref9
  doi: 10.1109/IROS.2013.6696620
– ident: ref10
  doi: 10.1109/ICRA40945.2020.9196904
– ident: ref1
  doi: 10.1007/978-3-540-30301-5_60
– ident: ref8
  doi: 10.1109/ICRA.2015.7139387
– ident: ref2
  doi: 10.1098/rstb.2002.1258
– volume-title: Robotics: Modelling, Planning and Control
  year: 2010
  ident: ref16
– ident: ref17
  doi: 10.1016/j.jelekin.2008.05.007
– ident: ref13
  doi: 10.1109/LRA.2021.3092269
– ident: ref20
  doi: 10.1109/TCPMT.2018.2799987
– ident: ref22
  article-title: ROS WSG50 driver
– ident: ref4
  doi: 10.1109/ROBOT.2008.4543616
– ident: ref19
  doi: 10.1109/TBME.1968.4502576
– ident: ref12
  doi: 10.1109/TMECH.2018.2817589
– ident: ref14
  doi: 10.1016/j.ifacol.2023.01.125
SSID ssj0062794
Score 2.3574038
Snippet This study addresses the challenges of Programming by Demonstration (PbD) in the context of collaborative robots, focusing on the need to provide additional...
SourceID proquest
pubmed
crossref
ieee
SourceType Aggregation Database
Index Database
Publisher
StartPage 45
SubjectTerms Adult
advanced human-robot interfaces
Collaborative robots
Electromyography
Feedback, Sensory - physiology
Female
Grippers
Human-robot interaction
Humans
Jacobian matrices
Kinesthesis - physiology
Male
Motors
Muscle, Skeletal - physiology
Neuromuscular
Programming
Programming by demonstration
Robot kinematics
robotic wiring
Robotics - instrumentation
Trajectory
User-Computer Interface
Wearable devices
Wearable Electronic Devices
Young Adult
Title Neuromuscular Interfacing for Advancing Kinesthetic and Teleoperated Programming by Demonstration of Collaborative Robots
URI https://ieeexplore.ieee.org/document/10726747
https://www.ncbi.nlm.nih.gov/pubmed/39437283
https://www.proquest.com/docview/3119721741
Volume 18
WOSCitedRecordID wos001449685500003&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIEE
  databaseName: IEEE Xplore
  customDbUrl:
  eissn: 2329-4051
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0062794
  issn: 1939-1412
  databaseCode: RIE
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LS8QwEB5URLz4fqwvInjxUN00bR5H8YGgqMgKeytpHuBh28XdFfz3TtLWx8GDtxaSUDIznW8yk_kATpzrc20Vxial50noPpIo5mliMi4xgKaa68haci8eHuRwqJ7ay-rxLoxzLhafubPwGHP5tjazcFSGFi5Sjvh3HuaFEM1lre63y1Oh2hSySmhG0y4n2Vfng8dbjATT7IxlMrTyWYYlpkLCSrJf7ijyq_wNNaPLuVn958euwUqLLclFowzrMOeqDVjteBtIa8ab8BE7coxmTQ0qiYeCXht0YgQhLIlEy_HtLtTEI0LE9YiuLBmgj6rHoQ2zs-SpqewahYHlB7lyowA1G4UitSeX3xr27shzXdbTyRa83FwPLm-TloIhMUyKaYIAqUQLdXlpSmq8ZL7k3tuMe4O4w9iScpVyjHmU1wg1tfKWpU4gJlQut5aybVio6srtApEIHLXNJTXGZlpwrXLFEd-rPBdWCd-D004SxbjptFHECKWvChRgEQRYtALswVbY8B_jmr3uwXEnuwLNJOQ-dOXq2aRgkV8Nwy_ag51GqF-zO13Y-2PVfVhOA-tvPHg5gIXp28wdwqJ5n75O3o5QF4fyKOriJ7Tg20Q
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3JTsQwDLXYBHNhX4Y1SFw4FCZNmzZHxKJBDANCg8StSrNIHKZFzCLx9zhpy3LgwK2VkqiK7fo5dvwATozpcKkFxia55YHrPhIIZmmgIp5iAE0ll561pJf0--nLi3isL6v7uzDGGF98Zs7co8_l61JN3FEZWngScsS_szAfR1FIq-tazY-Xh4mok8gioBENm6xkR5wPHroYC4bRGYtS18ynBYtMuJRVyn45JM-w8jfY9E7nZuWfn7sKyzW6JBeVOqzBjCnWYaVhbiC1IW_Ah-_JMZxUVajEHwtaqdCNEQSxxFMt-7c7VxWPGBHXI7LQZIBeqnxzjZiNJo9VbdfQDcw_yJUZOrBZqRQpLbn81rGpIU9lXo5Hm_B8cz247AY1CUOgWJqMA4RIOdqoiXOVU2VTZnNurY64VYg8lM4pFyHHqEdYiWBTCqtZaBJEhcLEWlO2BXNFWZgdIClCR6njlCqlI5lwKWLBEeGLOE60SGwbThtJZG9Vr43MxygdkaEAMyfArBZgGzbdhv8YV-11G44b2WVoKC77IQtTTkYZ8wxrGIDRNmxXQv2a3ejC7h-rHsFSd3Dfy3q3_bs9aIWOA9gfw-zD3Ph9Yg5gQU3Hr6P3Q6-RnxZ23aM
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Neuromuscular+Interfacing+for+Advancing+Kinesthetic+and+Teleoperated+Programming+by+Demonstration+of+Collaborative+Robots&rft.jtitle=IEEE+transactions+on+haptics&rft.au=Meattini%2C+Roberto&rft.au=Ameri%2C+Armando&rft.au=Bernardini%2C+Alessandra&rft.au=Gonzalez-Huarte%2C+Javier&rft.date=2025-01-01&rft.issn=2329-4051&rft.eissn=2329-4051&rft.volume=18&rft.issue=1&rft.spage=45&rft_id=info:doi/10.1109%2FTOH.2024.3484373&rft.externalDBID=NO_FULL_TEXT
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1939-1412&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1939-1412&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1939-1412&client=summon