Multimodal Bin Picking System with Compliant Tactile Sensor Arrays for Flexible Part Handling

This paper presents a robot control architecture comprised of tactile and vision sensors incorporated into an off-the-shelf bin picking system. The proposed architecture facilitates flexible and reliable handling of objects and materials by employing a tactile grasp validation system and in-hand obj...

Full description

Saved in:
Bibliographic Details
Published in:Proceedings - IEEE International Conference on Robotics and Automation pp. 2824 - 2830
Main Authors: Muller, Veit, Elkmann, Norbert
Format: Conference Proceeding
Language:English
Published: IEEE 01.05.2019
Subjects:
Grasping
Grippers
Monitoring
Pose estimation
Sensor arrays
Tactile sensors
ISSN:2577-087X
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract This paper presents a robot control architecture comprised of tactile and vision sensors incorporated into an off-the-shelf bin picking system. The proposed architecture facilitates flexible and reliable handling of objects and materials by employing a tactile grasp validation system and in-hand object monitoring. Two industrial grippers, specifically a magnetic gripper and a flexible vacuum gripper, are equipped with a compliant custom tactile sensor array. The algorithms used are for each specific gripper and respective sensor, however are transferrable to other grippers as well. The tactile sensing augments vision-based picking approaches, thus supporting in-hand object recognition [1] that is particularly useful for hard-to-recognize objects such as objects with transparent or shiny surfaces. Algorithms for tactile-based object pose estimation in the gripper and for grasp monitoring, including grasp validation, complete the approach.
AbstractList This paper presents a robot control architecture comprised of tactile and vision sensors incorporated into an off-the-shelf bin picking system. The proposed architecture facilitates flexible and reliable handling of objects and materials by employing a tactile grasp validation system and in-hand object monitoring. Two industrial grippers, specifically a magnetic gripper and a flexible vacuum gripper, are equipped with a compliant custom tactile sensor array. The algorithms used are for each specific gripper and respective sensor, however are transferrable to other grippers as well. The tactile sensing augments vision-based picking approaches, thus supporting in-hand object recognition [1] that is particularly useful for hard-to-recognize objects such as objects with transparent or shiny surfaces. Algorithms for tactile-based object pose estimation in the gripper and for grasp monitoring, including grasp validation, complete the approach.
Author Elkmann, Norbert
Muller, Veit
Author_xml – sequence: 1
  givenname: Veit
  surname: Muller
  fullname: Muller, Veit
  email: veit.mueller@iff.fraunhofer.de
  organization: Both authors are with the Fraunhofer Institute for Factory Operation and Automation IFF, Magdeburg, 30106
– sequence: 2
  givenname: Norbert
  surname: Elkmann
  fullname: Elkmann, Norbert
  organization: Both authors are with the Fraunhofer Institute for Factory Operation and Automation IFF, Magdeburg, 30106
BookMark eNotkN9KwzAcRqMouM09gHiTF2jNL1nz53IW5wYTh5vgjYykSTWapqONzL29A3f1HThwLr4huohtdAjdAMkBiLpblC_TnBJQuRSKqYKcobESEgomOSdUkHM0oIUQGZHi7QoN-_6LEMIY5wP0_vQTkm9aqwO-9xGvfPXt4wdeH_rkGrz36ROXbbMLXseEN7pKPji8drFvOzztOn3ocX3EWXC_3hzVSncJz3W04Zi5Rpe1Dr0bn3aEXmcPm3KeLZ8fF-V0mXkQRcokmxgBYCSHSQW2tqa2wIQVQhcMLHWiMNaBlsaAqg0FymVNHKMTpzipgI3Q7X_XO-e2u843ujtsT2-wP1BlVeM
ContentType Conference Proceeding
DBID 6IE
6IH
CBEJK
RIE
RIO
DOI 10.1109/ICRA.2019.8793950
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan (POP) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP) 1998-present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Xplore
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISBN 9781538660270
153866027X
EISSN 2577-087X
EndPage 2830
ExternalDocumentID 8793950
Genre orig-research
GroupedDBID 29O
6IE
6IF
6IH
6IK
6IL
6IM
6IN
AAJGR
AAWTH
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
IJVOP
IPLJI
OCL
RIE
RIL
RIO
RNS
ID FETCH-LOGICAL-i175t-834b711b8614c1dfdbfd137d77a531d2e75bde1a8bb19fb21268f0e324e960c13
IEDL.DBID RIE
ISICitedReferencesCount 3
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000494942302017&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Aug 27 02:49:26 EDT 2025
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i175t-834b711b8614c1dfdbfd137d77a531d2e75bde1a8bb19fb21268f0e324e960c13
PageCount 7
ParticipantIDs ieee_primary_8793950
PublicationCentury 2000
PublicationDate 2019-May
PublicationDateYYYYMMDD 2019-05-01
PublicationDate_xml – month: 05
  year: 2019
  text: 2019-May
PublicationDecade 2010
PublicationTitle Proceedings - IEEE International Conference on Robotics and Automation
PublicationTitleAbbrev ICRA
PublicationYear 2019
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0003366
Score 1.706492
Snippet This paper presents a robot control architecture comprised of tactile and vision sensors incorporated into an off-the-shelf bin picking system. The proposed...
SourceID ieee
SourceType Publisher
StartPage 2824
SubjectTerms Grasping
Grippers
Monitoring
Pose estimation
Sensor arrays
Tactile sensors
Title Multimodal Bin Picking System with Compliant Tactile Sensor Arrays for Flexible Part Handling
URI https://ieeexplore.ieee.org/document/8793950
WOSCitedRecordID wos000494942302017&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LS8NAEF5q8aAXH634Zg8eje0m6T6OtVgqSAlaoRcpu9lZCNSkpK3gv3c2KVXBi7eQsAnMzma-mZ3vW0JuQuswpeYqkNr1gpjHNjBS9nDhSal0ykHUIklPYjyW06lKGuR2y4UBgKr5DO78ZbWXb4t07UtlHYnOpHyCviMEr7la279uFHG-2bVkXdV5HDz3feMWekI96NfpKVXwGB7877OHpP3NwqPJNr4ckQbkx2T_h4Bgi7xV_Nn3wuo5vc9ymmSpL33TWoec-iIrHVRN42hAOvEkhjnQF0xdi5L2y1J_LimiVjr0spgGHyXoSXTklRfwNW3yOnyYDEbB5sCEIEMUsApkFBvBmJEYc1NmnTXOskhYITQuNRuC6BkLTEtjmHIGoxaXrguIqQATmZRFJ6SZFzmcEgpcO0RmYRp6_ZhYaa0BoZo13Egbq-4ZaXlDzRa1JsZsY6Pzv29fkD0_F3Wj4CVprso1XJHd9GOVLcvraiK_AFS2oBk
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3dS8MwED-GCuqLH5v4bR58tK7pR5o8zuHYcI6iE_YiI2lSKMxWuk3wv_fSjqngi2-lJS1cLr3fXe73C8C1p1NMqZlwuExDJ2CBdhTnIS48zoVMmIlqkaRhNBrxyUTEDbhZc2GMMVXzmbm1l9Vevi6SpS2VtTk6k7AJ-mYYBJ5bs7XW_13fZ2y1b0ld0R50nzq2dQt9oR726_yUKnz09v734X1offPwSLyOMAfQMPkh7P6QEGzCa8WgfSu0nJG7LCdxltjiN6mVyIkts5Ju1TaOJiRjS2OYGfKMyWtRkk5Zys85QdxKelYYU-GjGH2J9K32Ar6mBS-9-3G376yOTHAyxAELh_uBiihVHKNuQnWqVaqpH-kokrjYtGeiUGlDJVeKilRh3GI8dQ2iKoOpTEL9I9jIi9wcAzFMpojNvMSzCjKBkFIaBGtaMcV1INwTaFpDTd9rVYzpykanf9--gu3--HE4HQ5GD2ewY-elbhs8h41FuTQXsJV8LLJ5eVlN6hfVo6Ng
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=Proceedings+-+IEEE+International+Conference+on+Robotics+and+Automation&rft.atitle=Multimodal+Bin+Picking+System+with+Compliant+Tactile+Sensor+Arrays+for+Flexible+Part+Handling&rft.au=Muller%2C+Veit&rft.au=Elkmann%2C+Norbert&rft.date=2019-05-01&rft.pub=IEEE&rft.eissn=2577-087X&rft.spage=2824&rft.epage=2830&rft_id=info:doi/10.1109%2FICRA.2019.8793950&rft.externalDocID=8793950