Improving the Reliability of Pick-and-Place With Aerial Vehicles Through Fault-Tolerant Software and a Custom Magnetic End-Effector

Aerial manipulation is an emerging field in robotics with various potential applications such as transport and delivery, agriculture, and, infrastructure inspection. To deploy aerial vehicles in the real world, the safety and reliability of these systems is paramount. Motivated by the need for safet...

Full description

Saved in:
Bibliographic Details
Published in:IEEE robotics and automation letters Vol. 6; no. 4; pp. 7501 - 7508
Main Authors: Garimella, Gowtham, Sheckells, Matthew, Kim, Soowon, Baraban, Gabriel, Kobilarov, Marin
Format: Journal Article
Language:English
Published: Piscataway IEEE 01.10.2021
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
Bias
Contact force
Distribution centers
End effectors
factory automation
Failure modes
Fault tolerance
Hardware
Infrastructure
Inspection
Manipulators
Planning
Reliability
Robotics
Safety
scheduling and coordination
Software
software architecture for robotic and automation
Software reliability
Task analysis
Trajectory
ISSN:2377-3766, 2377-3766
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Aerial manipulation is an emerging field in robotics with various potential applications such as transport and delivery, agriculture, and, infrastructure inspection. To deploy aerial vehicles in the real world, the safety and reliability of these systems is paramount. Motivated by the need for safety and reliability, this work proposes a software framework that has built-in robustness to algorithmic failures and hardware faults. The framework allows users to build complex applications while reasoning about faults that can happen at different stages of an aerial manipulation task and specifying fallback actions to return to normal operating mode. The aerial manipulator is further endowed with a magnetic gripper that can handle positional errors arising from perception and control uncertainties. We also introduce a bias estimator for measuring the contact forces and sensor bias. We demonstrate how the estimator can be used to detect either completion or failures across several tasks. We demonstrate the reliability of the proposed framework on two tasks: package sorting task (e.g. as might be used in a distribution center) and sensor placement task (for infrastructure inspection). We show different failure modes that can occur and how our aerial manipulation system recovers from them.
AbstractList Aerial manipulation is an emerging field in robotics with various potential applications such as transport and delivery, agriculture, and, infrastructure inspection. To deploy aerial vehicles in the real world, the safety and reliability of these systems is paramount. Motivated by the need for safety and reliability, this work proposes a software framework that has built-in robustness to algorithmic failures and hardware faults. The framework allows users to build complex applications while reasoning about faults that can happen at different stages of an aerial manipulation task and specifying fallback actions to return to normal operating mode. The aerial manipulator is further endowed with a magnetic gripper that can handle positional errors arising from perception and control uncertainties. We also introduce a bias estimator for measuring the contact forces and sensor bias. We demonstrate how the estimator can be used to detect either completion or failures across several tasks. We demonstrate the reliability of the proposed framework on two tasks: package sorting task (e.g. as might be used in a distribution center) and sensor placement task (for infrastructure inspection). We show different failure modes that can occur and how our aerial manipulation system recovers from them.
Author Sheckells, Matthew
Baraban, Gabriel
Garimella, Gowtham
Kim, Soowon
Kobilarov, Marin
Author_xml – sequence: 1
  givenname: Gowtham
  orcidid: 0000-0003-4115-800X
  surname: Garimella
  fullname: Garimella, Gowtham
  email: marin@jhu.edu
  organization: Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, U.S
– sequence: 2
  givenname: Matthew
  orcidid: 0000-0002-9066-2897
  surname: Sheckells
  fullname: Sheckells, Matthew
  email: garimella.gowtham74@gmail.com
  organization: Department of Computer Science, Johns Hopkins University, Baltimore, MD, U.S
– sequence: 3
  givenname: Soowon
  orcidid: 0000-0002-5437-8602
  surname: Kim
  fullname: Kim, Soowon
  email: mshecke1@jhu.edu
  organization: Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, U.S
– sequence: 4
  givenname: Gabriel
  orcidid: 0000-0003-1095-7415
  surname: Baraban
  fullname: Baraban, Gabriel
  email: soowk311@gmail.com
  organization: Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, USA
– sequence: 5
  givenname: Marin
  surname: Kobilarov
  fullname: Kobilarov, Marin
  email: gbaraba1@jhu.edu
  organization: Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, USA
BookMark eNp9kMFr2zAUh0VpYV2X-6AXwc5OZcmSrGMISVvIWEnT7mhk-SlWpliZLHf0vH-8Dilj7LDTe4ff93u87yM670IHCH3OyTTPibpZrWdTSmg-ZUSxUhRn6JIyKTMmhTj_a_-AJn2_I4TknEqm-CX6fb8_xPDiui1OLeA1eKdr5116xcHiB2d-ZLprsgevDeDvLrV4BtFpj5-hdcZDjzdtDMO2xUs9-JRtgoeou4Qfg02_dAQ84ljj-dCnsMdf9baD5AxejKULa8GkED-hC6t9D5P3eYWelovN_C5bfbu9n89WmaEqTxkowS0zprSE07rgtCx4IWqpRa1A2oJJykmT18TyhhNRF6ZhsqktNABcUsOu0JdT7_jxzwH6VO3CELvxZEW5IIoKWZRjSpxSJoa-j2Ar45JOLnQpauernFRH59XovDo6r96djyD5BzxEt9fx9X_I9QlxAPAnrgpRKsbZG1Q4jvU
CODEN IRALC6
CitedBy_id crossref_primary_10_1109_ACCESS_2024_3435689
crossref_primary_10_1108_IR_07_2022_0184
crossref_primary_10_1002_rob_22564
crossref_primary_10_3390_app13020822
crossref_primary_10_1109_ACCESS_2025_3604842
crossref_primary_10_1007_s00202_023_02236_0
crossref_primary_10_1007_s11370_024_00535_4
crossref_primary_10_1007_s41745_024_00457_1
crossref_primary_10_1002_rob_22231
crossref_primary_10_3390_aerospace12090764
Cites_doi 10.23919/ACC45564.2020.9147517
10.1109/ICRA.2017.7989692
10.1177/1729881420921622
10.1109/ECMR.2017.8098676
10.1109/ICRA40945.2020.9197394
10.1109/TRO.2017.2750693
10.1109/LRA.2018.2808541
10.15607/RSS.2019.XV.019
10.1109/LRA.2018.2807486
10.1109/ICRA.2015.7139850
10.1109/ICRA.2011.5980477
10.1109/ICRA.2013.6630954
10.1109/MED.2015.7158852
10.1109/ICRA.2017.7989675
10.1109/CDC.2010.5717652
10.1109/IROS.2016.7759655
10.15607/RSS.2020.XVI.046
10.1109/LRA.2020.2972870
10.1007/s10514-010-9205-0
10.1109/ACCESS.2020.2993101
10.1115/1.4038975
10.1109/IROS.2011.6048786
10.1109/ACCESS.2018.2833160
10.1109/ICCE.2018.8326268
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/LRA.2021.3093864
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005-present
IEEE All-Society Periodicals Package (ASPP) 1998-Present
IEEE Electronic Library Online
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
DatabaseTitleList
Technology Research Database
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 2377-3766
EndPage 7508
ExternalDocumentID 10_1109_LRA_2021_3093864
9468935
Genre orig-research
GrantInformation_xml – fundername: NSF award
  grantid: 1925189
GroupedDBID 0R~
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFS
AGQYO
AGSQL
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
EBS
EJD
IFIPE
IPLJI
JAVBF
KQ8
M43
M~E
O9-
OCL
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c291t-e965f3cc8f052b45284546b7a6b9e7f437250d1b0f5d506b4cd37dbfedee572c3
IEDL.DBID RIE
ISICitedReferencesCount 17
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000684691400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 2377-3766
IngestDate Mon Jun 30 14:36:16 EDT 2025
Sat Nov 29 06:03:12 EST 2025
Tue Nov 18 19:41:45 EST 2025
Wed Aug 27 02:39:26 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 4
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c291t-e965f3cc8f052b45284546b7a6b9e7f437250d1b0f5d506b4cd37dbfedee572c3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-4115-800X
0000-0002-9066-2897
0000-0003-1095-7415
0000-0002-5437-8602
PQID 2560926748
PQPubID 4437225
PageCount 8
ParticipantIDs crossref_citationtrail_10_1109_LRA_2021_3093864
proquest_journals_2560926748
ieee_primary_9468935
crossref_primary_10_1109_LRA_2021_3093864
PublicationCentury 2000
PublicationDate 2021-10-01
PublicationDateYYYYMMDD 2021-10-01
PublicationDate_xml – month: 10
  year: 2021
  text: 2021-10-01
  day: 01
PublicationDecade 2020
PublicationPlace Piscataway
PublicationPlace_xml – name: Piscataway
PublicationTitle IEEE robotics and automation letters
PublicationTitleAbbrev LRA
PublicationYear 2021
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref12
ref15
lima (ref3) 2020
ref11
(ref5) 2017
ref10
ref2
ref17
ref16
ref19
ref18
chaikalis (ref14) 0
ref24
ref23
ref26
amazon (ref1) 2017
ref25
ref20
ref22
ref21
(ref30) 2017
ref28
ref27
ref29
ref8
ref7
ref9
(ref4) 0
ref6
References_xml – ident: ref27
  doi: 10.23919/ACC45564.2020.9147517
– ident: ref26
  doi: 10.1109/ICRA.2017.7989692
– ident: ref23
  doi: 10.1177/1729881420921622
– ident: ref19
  doi: 10.1109/ECMR.2017.8098676
– ident: ref16
  doi: 10.1109/ICRA40945.2020.9197394
– ident: ref22
  doi: 10.1109/TRO.2017.2750693
– ident: ref6
  doi: 10.1109/LRA.2018.2808541
– ident: ref13
  doi: 10.15607/RSS.2019.XV.019
– ident: ref20
  doi: 10.1109/LRA.2018.2807486
– year: 2017
  ident: ref30
  publication-title: Alvar
– ident: ref25
  doi: 10.1109/ICRA.2015.7139850
– start-page: 498
  year: 0
  ident: ref14
  article-title: Adaptive control approaches for an unmanned aerial manipulation system
  publication-title: Proc Int Conf Unmanned Aircr Syst
– ident: ref9
  doi: 10.1109/ICRA.2011.5980477
– year: 2020
  ident: ref3
  article-title: Vision based target interception using aerial manipulation
– ident: ref29
  doi: 10.1109/ICRA.2013.6630954
– year: 2017
  ident: ref1
  article-title: Prime air
– year: 2017
  ident: ref5
  publication-title: AeRoArms
– ident: ref7
  doi: 10.1109/MED.2015.7158852
– year: 0
  ident: ref4
– ident: ref18
  doi: 10.1109/ICRA.2017.7989675
– ident: ref24
  doi: 10.1109/CDC.2010.5717652
– ident: ref10
  doi: 10.1109/IROS.2016.7759655
– ident: ref15
  doi: 10.15607/RSS.2020.XVI.046
– ident: ref17
  doi: 10.1109/LRA.2020.2972870
– ident: ref2
  doi: 10.1007/s10514-010-9205-0
– ident: ref12
  doi: 10.1109/ACCESS.2020.2993101
– ident: ref8
  doi: 10.1115/1.4038975
– ident: ref28
  doi: 10.1109/IROS.2011.6048786
– ident: ref11
  doi: 10.1109/ACCESS.2018.2833160
– ident: ref21
  doi: 10.1109/ICCE.2018.8326268
SSID ssj0001527395
Score 2.309388
Snippet Aerial manipulation is an emerging field in robotics with various potential applications such as transport and delivery, agriculture, and, infrastructure...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 7501
SubjectTerms Bias
Contact force
Distribution centers
End effectors
factory automation
Failure modes
Fault tolerance
Hardware
Infrastructure
Inspection
Manipulators
Planning
Reliability
Robotics
Safety
scheduling and coordination
Software
software architecture for robotic and automation
Software reliability
Task analysis
Trajectory
Title Improving the Reliability of Pick-and-Place With Aerial Vehicles Through Fault-Tolerant Software and a Custom Magnetic End-Effector
URI https://ieeexplore.ieee.org/document/9468935
https://www.proquest.com/docview/2560926748
Volume 6
WOSCitedRecordID wos000684691400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIEE
  databaseName: IEEE Electronic Library (IEL)
  customDbUrl:
  eissn: 2377-3766
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001527395
  issn: 2377-3766
  databaseCode: RIE
  dateStart: 20160101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 2377-3766
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001527395
  issn: 2377-3766
  databaseCode: M~E
  dateStart: 20160101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LbxMxEB41FQc48CqIlFLNgQsSbvbldXyMqkQcaBVBgN5Wfoxp1LCL0k0RFy78cWzvJoBASNz24LFW-uyZ8bw-gOeUa07Wa79cpoYVnBOTrsxYqpU3RzZQMiaRbEKcn48vLuR8D17uemGIKBaf0Un4jLl825hNCJWNZFF688oHMBBCdL1aP-MpYZKY5NtMZCJHr99M_PsvS09Csm9cFr9Znkil8of-jUZldu__fuc-3O2dR5x0aD-APaofwp1fRgoewPddlAC9a4eh4ribxP0VG4fzpbliqrZsHqLn-GHZXuIknkF8T5exQg4XHXMPztRm1bJFsyJvzlp86_X1F7Um9OKo8HTjvcZPeKY-1qENEqd-024ScrN-BO9m08XpK9YTLTCTybRlJEvucmPGLuGZLrg3WbwotVClliRcSO3xxKY6cdzypNSFsbmw2pEl4iIz-WPYr5uangAaW3gHIMuUk3khhVIpN8qJ1OOvQ1fuEEZbECrTTyEPZBirKr5GEll52KoAW9XDNoQXO4nP3QSOf6w9CDDt1vUIDeFoi3PVX9HrKvh6MgtcK4d_l3oKt8PeXeXeEey36w09g1vmpl1er49hcPZtehzP4A-MG9qR
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3Nb9MwFH8aAwk48LWhFTbwgQsSXhPHTupjNa0aoqsqKLBb5I9nVtElqEtBnPePz3bSwgRC4paDnUT6Pb_3_L5-AK8w0wKt136ZTA3lQiCVLmc01cqbIxsoGZNINlFMJoOzMzndgjebXhhEjMVneBgeYy7f1mYVQmV9yXNvXsUtuC04Z2nbrfUrohJmiUmxzkUmsj9-P_Q3QJYehnTfIOc3bE8kU_lDA0ezMnr4fz_0CB507iMZtng_hi2snsD934YK7sDVJk5AvHNHQs1xO4v7J6kdmc7NV6oqS6chfk4-z5tzMoxSSD7heayRI7OWu4eM1GrR0Fm9QG_QGvLBa-wfaonEbyeKHK2833hBTtWXKjRCkmP_0nYWcr3chY-j49nRCe2oFqhhMm0oyly4zJiBSwTTXHijJXiuC5VriYULyT2R2FQnTliR5JobmxVWO7SIomAmewrbVV3hHhBjuXcBGFNOZlwWSqXCKFekXgJ06MvtQX8NQmm6OeSBDmNRxvtIIksPWxlgKzvYevB6s-NbO4PjH2t3AkybdR1CPdhf41x2h_SyDN6eZIFt5dnfd72Euyez03E5fjt59xzuhe-0dXz7sN0sV3gAd8z3Zn65fBEl8RriQ9yn
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Improving+the+Reliability+of+Pick-and-Place+With+Aerial+Vehicles+Through+Fault-Tolerant+Software+and+a+Custom+Magnetic+End-Effector&rft.jtitle=IEEE+robotics+and+automation+letters&rft.au=Garimella%2C+Gowtham&rft.au=Sheckells%2C+Matthew&rft.au=Kim%2C+Soowon&rft.au=Baraban%2C+Gabriel&rft.date=2021-10-01&rft.issn=2377-3766&rft.eissn=2377-3766&rft.volume=6&rft.issue=4&rft.spage=7501&rft.epage=7508&rft_id=info:doi/10.1109%2FLRA.2021.3093864&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_LRA_2021_3093864
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2377-3766&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2377-3766&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2377-3766&client=summon