Non-Contact Tactile Perception for Hybrid-Active Gripper

This letter presents a novel approach to object recognition using a reconfigurable gripper with multiple time-of-flight (ToF) sensors attached to the fingers and palm, introducing the concept of noncontact tactile perception. This approach aims to promote aproprioceptive sense in the gripper workspa...

Full description

Saved in:
Bibliographic Details
Published in:IEEE robotics and automation letters Vol. 8; no. 5; pp. 3047 - 3054
Main Authors: Pereira, Jonathas H. M., Joventino, Carlos F., Fabro, Joao A., de Oliveira, Andre S.
Format: Journal Article
Language:English
Published: Piscataway IEEE 01.05.2023
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
Cameras
Experimentation
Fingers
Grippers
manipulation planning
Object detection
Object recognition
Palm
perception for grasping and manipulation
Reconfiguration
segmentation and categorization
Sensors
Space perception
Tactile discrimination
Task analysis
Topology
ISSN:2377-3766, 2377-3766
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract This letter presents a novel approach to object recognition using a reconfigurable gripper with multiple time-of-flight (ToF) sensors attached to the fingers and palm, introducing the concept of noncontact tactile perception. This approach aims to promote aproprioceptive sense in the gripper workspace, allowing object prediction in manipulation tasks. The Hybrid-Active (H-A) gripper can adapt its topology to achieve different object reading points to generate a reliable object estimation. Non-contact tactile perception uses ToF sensors and gripper reconfiguration degrees-of-freedom for 3D perception and surface estimation of the pick-up object. This method is based on five ToF sensors in the palm that identify the distance and adjust the gripper to the center of the object through its capability to manage the manipulator. The H-A gripper also has twelve sensors distributed over its three fingers: four sensors on each finger, two on the distal phalanx, and two on the middle phalanx. Fingers have a rotational mobility of 180<inline-formula><tex-math notation="LaTeX">^\circ</tex-math></inline-formula>, allowing the sensing of all faces of the object at different angles for the three-dimensional reconstruction. The proposed approach was evaluated in four experiments that analyzed the influence of resolution, object complexity, finger tilt, and angular sampling over 13 objects with different complexities. The experimentation set allows the overall evaluation of non-contact tactile perception and the specification of its performance parameters.
AbstractList This letter presents a novel approach to object recognition using a reconfigurable gripper with multiple time-of-flight (ToF) sensors attached to the fingers and palm, introducing the concept of noncontact tactile perception. This approach aims to promote aproprioceptive sense in the gripper workspace, allowing object prediction in manipulation tasks. The Hybrid-Active (H-A) gripper can adapt its topology to achieve different object reading points to generate a reliable object estimation. Non-contact tactile perception uses ToF sensors and gripper reconfiguration degrees-of-freedom for 3D perception and surface estimation of the pick-up object. This method is based on five ToF sensors in the palm that identify the distance and adjust the gripper to the center of the object through its capability to manage the manipulator. The H-A gripper also has twelve sensors distributed over its three fingers: four sensors on each finger, two on the distal phalanx, and two on the middle phalanx. Fingers have a rotational mobility of 180[Formula Omitted], allowing the sensing of all faces of the object at different angles for the three-dimensional reconstruction. The proposed approach was evaluated in four experiments that analyzed the influence of resolution, object complexity, finger tilt, and angular sampling over 13 objects with different complexities. The experimentation set allows the overall evaluation of non-contact tactile perception and the specification of its performance parameters.
This letter presents a novel approach to object recognition using a reconfigurable gripper with multiple time-of-flight (ToF) sensors attached to the fingers and palm, introducing the concept of noncontact tactile perception. This approach aims to promote aproprioceptive sense in the gripper workspace, allowing object prediction in manipulation tasks. The Hybrid-Active (H-A) gripper can adapt its topology to achieve different object reading points to generate a reliable object estimation. Non-contact tactile perception uses ToF sensors and gripper reconfiguration degrees-of-freedom for 3D perception and surface estimation of the pick-up object. This method is based on five ToF sensors in the palm that identify the distance and adjust the gripper to the center of the object through its capability to manage the manipulator. The H-A gripper also has twelve sensors distributed over its three fingers: four sensors on each finger, two on the distal phalanx, and two on the middle phalanx. Fingers have a rotational mobility of 180<inline-formula><tex-math notation="LaTeX">^\circ</tex-math></inline-formula>, allowing the sensing of all faces of the object at different angles for the three-dimensional reconstruction. The proposed approach was evaluated in four experiments that analyzed the influence of resolution, object complexity, finger tilt, and angular sampling over 13 objects with different complexities. The experimentation set allows the overall evaluation of non-contact tactile perception and the specification of its performance parameters.
Author Joventino, Carlos F.
Pereira, Jonathas H. M.
de Oliveira, Andre S.
Fabro, Joao A.
Author_xml – sequence: 1
  givenname: Jonathas H. M.
  orcidid: 0000-0002-0285-1277
  surname: Pereira
  fullname: Pereira, Jonathas H. M.
  email: jonathashmp@ifsp.edu.br
  organization: Federal Institute of São Paulo (IFSP), Registro, Brazil
– sequence: 2
  givenname: Carlos F.
  orcidid: 0000-0001-9694-2059
  surname: Joventino
  fullname: Joventino, Carlos F.
  email: jcarlosfernando@ifsp.edu.br
  organization: Federal Institute of São Paulo (IFSP), Registro, Brazil
– sequence: 3
  givenname: Joao A.
  orcidid: 0000-0001-8975-0323
  surname: Fabro
  fullname: Fabro, Joao A.
  email: fabro@utfpr.edu.br
  organization: Universidade Tecnológica do Paraná (UTFPR), Curitiba, Brazil
– sequence: 4
  givenname: Andre S.
  orcidid: 0000-0002-8295-366X
  surname: de Oliveira
  fullname: de Oliveira, Andre S.
  email: andreoliveira@utfpr.edu.br
  organization: Universidade Tecnológica do Paraná (UTFPR), Curitiba, Brazil
BookMark eNpNkM1LAzEQxYNUsNbePXhY8Lw13x_HUrQtFBWp55BNZmFL3azZrdD_3pT20MvMwLw3j_ndo1EbW0DokeAZIdi8bL7mM4opmzEqOZHyBo0pU6pkSsrR1XyHpn2_wxgTQRUzYoz0e2zLRWwH54dim0uzh-ITkoduaGJb1DEVq2OVmlDO8_IPimVqug7SA7qt3b6H6aVP0Pfb63axKjcfy_Vivik95WIoHRPBc869CaqCkJMJ18F5EWhFndJG18FUAhsBmBjpgvaSVtwEVwesq5pN0PP5bpfi7wH6we7iIbU50lJljOYyv5xV-KzyKfZ9gtp2qflx6WgJtidENiOyJ0T2gihbns6WBgCu5Nhgwwj7B7a0YuE
CODEN IRALC6
Cites_doi 10.1109/IROS45743.2020.9341080
10.1109/LRA.2021.3072855
10.1016/j.compag.2020.105694
10.1126/scirobotics.abc8134
10.1109/RoboSoft51838.2021.9479341
10.1177/1729881420948727
10.1109/ICRA.2015.7139373
10.1007/978-3-030-33950-0_33
10.1016/j.robot.2010.01.003
10.1109/ACCESS.2021.3086802
10.1109/TMECH.2021.3110277
10.1109/LRA.2020.2982059
10.1109/iros.2018.8593572
10.1109/TRO.2021.3076563
10.1177/02783649211048929
10.1109/LRA.2018.2852779
10.1109/SCORED.2015.7449312
10.1109/JSEN.2020.2995395
10.1016/j.sna.2021.113121
10.3390/s18030692
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/LRA.2023.3264166
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
DatabaseTitleList Technology Research Database
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 2377-3766
EndPage 3054
ExternalDocumentID 10_1109_LRA_2023_3264166
10090931
Genre orig-research
GroupedDBID 0R~
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFS
AGQYO
AGSQL
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
EBS
EJD
IFIPE
IPLJI
JAVBF
KQ8
M43
M~E
O9-
OCL
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c245t-a35dc444c9d7bed001148dac5d2b2a7898fd9b5095e0196ad8c62b49dafd08bf3
IEDL.DBID RIE
ISICitedReferencesCount 1
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000970626200016&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 2377-3766
IngestDate Sun Nov 30 05:23:50 EST 2025
Sat Nov 29 06:03:23 EST 2025
Wed Aug 27 02:29:09 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 5
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c245t-a35dc444c9d7bed001148dac5d2b2a7898fd9b5095e0196ad8c62b49dafd08bf3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0002-8295-366X
0000-0001-9694-2059
0000-0002-0285-1277
0000-0001-8975-0323
PQID 2799846264
PQPubID 4437225
PageCount 8
ParticipantIDs crossref_primary_10_1109_LRA_2023_3264166
proquest_journals_2799846264
ieee_primary_10090931
PublicationCentury 2000
PublicationDate 2023-05-01
PublicationDateYYYYMMDD 2023-05-01
PublicationDate_xml – month: 05
  year: 2023
  text: 2023-05-01
  day: 01
PublicationDecade 2020
PublicationPlace Piscataway
PublicationPlace_xml – name: Piscataway
PublicationTitle IEEE robotics and automation letters
PublicationTitleAbbrev LRA
PublicationYear 2023
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref12
ref15
ref14
ref20
Pereira (ref22) 2022
ref11
ref10
ref21
ref2
ref1
ref17
ref16
ref19
ref18
ref8
ref7
ref9
ref4
ref6
ref5
Kulecki (ref3) 2021; 48
References_xml – ident: ref18
  doi: 10.1109/IROS45743.2020.9341080
– ident: ref17
  doi: 10.1109/LRA.2021.3072855
– ident: ref1
  doi: 10.1016/j.compag.2020.105694
– volume: 48
  start-page: 688
  issue: 5
  year: 2021
  ident: ref3
  article-title: Practical aspects of detection and grasping objects by a mobile manipulating robot
  publication-title: Ind. Robot
– ident: ref5
  doi: 10.1126/scirobotics.abc8134
– ident: ref14
  doi: 10.1109/RoboSoft51838.2021.9479341
– ident: ref9
  doi: 10.1177/1729881420948727
– ident: ref20
  doi: 10.1109/ICRA.2015.7139373
– year: 2022
  ident: ref22
  article-title: Simulation of scan objects - non contact tactile perception for hybrid grippers
– ident: ref10
  doi: 10.1007/978-3-030-33950-0_33
– ident: ref7
  doi: 10.1016/j.robot.2010.01.003
– ident: ref11
  doi: 10.1109/ACCESS.2021.3086802
– ident: ref15
  doi: 10.1109/TMECH.2021.3110277
– ident: ref16
  doi: 10.1109/LRA.2020.2982059
– ident: ref21
  doi: 10.1109/iros.2018.8593572
– ident: ref12
  doi: 10.1109/TRO.2021.3076563
– ident: ref13
  doi: 10.1177/02783649211048929
– ident: ref8
  doi: 10.1109/LRA.2018.2852779
– ident: ref19
  doi: 10.1109/SCORED.2015.7449312
– ident: ref2
  doi: 10.1109/JSEN.2020.2995395
– ident: ref4
  doi: 10.1016/j.sna.2021.113121
– ident: ref6
  doi: 10.3390/s18030692
SSID ssj0001527395
Score 2.2251554
Snippet This letter presents a novel approach to object recognition using a reconfigurable gripper with multiple time-of-flight (ToF) sensors attached to the fingers...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Index Database
Publisher
StartPage 3047
SubjectTerms Cameras
Experimentation
Fingers
Grippers
manipulation planning
Object detection
Object recognition
Palm
perception for grasping and manipulation
Reconfiguration
segmentation and categorization
Sensors
Space perception
Tactile discrimination
Task analysis
Topology
Title Non-Contact Tactile Perception for Hybrid-Active Gripper
URI https://ieeexplore.ieee.org/document/10090931
https://www.proquest.com/docview/2799846264
Volume 8
WOSCitedRecordID wos000970626200016&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIEE
  databaseName: IEEE Electronic Library (IEL)
  customDbUrl:
  eissn: 2377-3766
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001527395
  issn: 2377-3766
  databaseCode: RIE
  dateStart: 20160101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 2377-3766
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001527395
  issn: 2377-3766
  databaseCode: M~E
  dateStart: 20160101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwED7RigEGnkUUSpWBhcElOE5ijxVq6VCqChWpW3R-REJCadUHEgu_HdtJoQgxsGVwIutz7vydfd8dwDVD1EpIZU1ccsKSPCaIXBCT5Ggnnugk9ys9TEcjPp2KcSVW91oYY4xPPjMd9-jv8vVMrd1RmbXwUNgI3AY7tTRNSrHW94GKKyUm4s1VZChuh0_djusO3rEUxfKO5MfW43up_HLAflfpH_5zPkdwUNHHoFuu9zHsmOIE9reKCp4CH80K4opOoVoFE6dbeDXB-Ct_JbAsNRi8O6EW6XpnFzxYxzE3iwY893uT-wGp-iMQRVm8IhjFWjHGlNCpNNrrYrlGFWsqKaZc8FwLaRlBbFwVHNRcJVQyoTHXIZd5dAb1YlaYcwhCjKjgaIRhklF6J02OEdJEKGnHomrCzQa6bF6Wwch8-BCKzMKcOZizCuYmNBxUW-NKlJrQ2oCdVYayzGhq4z1moyp28cdrl7Dnvl4mGbagvlqszRXsqrfVy3LRhtrjR6_t_4RP8PSzBA
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3PS8MwFA4yBfXgz4nTqT148ZBZ07RNjkOcE2sZMmG38PKjIMg2tk7wvzdJO52IB289pDR86Xv5XvK-9xC6pABacamsiUuGaVLEGIBxbJIC7MQTnRR-pbM0z9loxAe1WN1rYYwxPvnMdNyjv8vXE7VwR2XWwkNuI3Ab7KzHlJKwkmt9H6m4YmI8Xl5Ghvw6e-52XH_wjiUplnkkPzYf303llwv2-0pv958z2kM7NYEMutWK76M1Mz5A2ytlBQ8Ryydj7MpOgSqDoVMuvJlg8JXBElieGvQ_nFQLd727C-6t65iaWRO99O6Gt31cd0jAitC4xBDFWlFKFdepNNorY5kGFWsiCaSMs0JzaTlBbFwdHNBMJURSrqHQIZNFdIQa48nYHKMghIhwBoYbKikhN9IUEAFJuJJ2LKgWulpCJ6ZVIQzhA4iQCwuzcDCLGuYWajqoVsZVKLVQewm2qE1lLkhqIz5q4yp68sdrF2izP3zKRPaQP56iLfelKuWwjRrlbGHO0IZ6L1_ns3P_P3wCMIa1Gg
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Non-Contact+Tactile+Perception+for+Hybrid-Active+Gripper&rft.jtitle=IEEE+robotics+and+automation+letters&rft.au=Pereira%2C+Jonathas+H.+M.&rft.au=Joventino%2C+Carlos+F.&rft.au=Fabro%2C+Jo%C3%A3o+A.&rft.au=de+Oliveira%2C+Andr%C3%A9+S.&rft.date=2023-05-01&rft.issn=2377-3766&rft.eissn=2377-3766&rft.volume=8&rft.issue=5&rft.spage=3047&rft.epage=3054&rft_id=info:doi/10.1109%2FLRA.2023.3264166&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_LRA_2023_3264166
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2377-3766&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2377-3766&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2377-3766&client=summon