Robot behavior debugger for non-expert users in convenience stores using behavior trees

As the problematic consequence of an aging society, with increasing labor shortage, there is a need for service robots to efficiently support the works in many places such as convenience stores. However, it is difficult to program a robot behavior and meet the needs of the shop staff (i.e. non-exper...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Advanced robotics Jg. 36; H. 17-18; S. 951 - 966
Hauptverfasser: Tulathum, Pattaraporn, Usawalertkamol, Bunyapon, Garcia Ricardez, Gustavo Alfonso, Takamatsu, Jun, Ogasawara, Tsukasa, Matsumoto, Kenichi
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Taylor & Francis 17.09.2022
Schlagworte:
debugging system
end-user robot programming
Future Convenience Store Challenge
Human-Robot Interaction (HRI)
non-expert users
ISSN:0169-1864, 1568-5535
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract As the problematic consequence of an aging society, with increasing labor shortage, there is a need for service robots to efficiently support the works in many places such as convenience stores. However, it is difficult to program a robot behavior and meet the needs of the shop staff (i.e. non-expert users who lack of knowledge and experience in robot programming). Hence, there is the need for a system to help non-expert users to identify and fix the issues within the robot behaviors. This paper proposes a Behavior Tree-based robot behavior creation system for non-expert users with four debugging features and a simulator. Non-expert users can use drag-and-drop composition to create the robot behavior program. Moreover, our debugger allows non-expert users to use breakpoints, log node status, monitor node execution, show robot status variables, and also can visually verify the robot behaviors via a simulator. We evaluate the effectiveness of our debugging system with 14 non-expert users by asking them to solve three tasks (i.e. creating and fixing Behavior Trees) from the given convenience store scenario. The experimental results show that more than 70% of non-expert users can utilize our debugging features to finish all the tasks. Additionally, our system usability has a high marginal level from the subjects' perspective according to the System Usability Scale (SUS).
AbstractList As the problematic consequence of an aging society, with increasing labor shortage, there is a need for service robots to efficiently support the works in many places such as convenience stores. However, it is difficult to program a robot behavior and meet the needs of the shop staff (i.e. non-expert users who lack of knowledge and experience in robot programming). Hence, there is the need for a system to help non-expert users to identify and fix the issues within the robot behaviors. This paper proposes a Behavior Tree-based robot behavior creation system for non-expert users with four debugging features and a simulator. Non-expert users can use drag-and-drop composition to create the robot behavior program. Moreover, our debugger allows non-expert users to use breakpoints, log node status, monitor node execution, show robot status variables, and also can visually verify the robot behaviors via a simulator. We evaluate the effectiveness of our debugging system with 14 non-expert users by asking them to solve three tasks (i.e. creating and fixing Behavior Trees) from the given convenience store scenario. The experimental results show that more than 70% of non-expert users can utilize our debugging features to finish all the tasks. Additionally, our system usability has a high marginal level from the subjects' perspective according to the System Usability Scale (SUS).
Author Garcia Ricardez, Gustavo Alfonso
Tulathum, Pattaraporn
Ogasawara, Tsukasa
Takamatsu, Jun
Matsumoto, Kenichi
Usawalertkamol, Bunyapon
Author_xml – sequence: 1
  givenname: Pattaraporn
  orcidid: 0000-0003-2687-3881
  surname: Tulathum
  fullname: Tulathum, Pattaraporn
  email: tulathum.pattaraporn.ti8@is.naist.jp
  organization: Nara Institute of Science and Technology
– sequence: 2
  givenname: Bunyapon
  orcidid: 0000-0002-3181-7713
  surname: Usawalertkamol
  fullname: Usawalertkamol, Bunyapon
  organization: Nara Institute of Science and Technology
– sequence: 3
  givenname: Gustavo Alfonso
  orcidid: 0000-0001-6518-577X
  surname: Garcia Ricardez
  fullname: Garcia Ricardez, Gustavo Alfonso
  organization: College of Information Science and Engineering, Ritsumeikan University
– sequence: 4
  givenname: Jun
  orcidid: 0000-0001-7457-2878
  surname: Takamatsu
  fullname: Takamatsu, Jun
  organization: Microsoft
– sequence: 5
  givenname: Tsukasa
  orcidid: 0000-0001-9767-6039
  surname: Ogasawara
  fullname: Ogasawara, Tsukasa
  organization: Nara Institute of Science and Technology
– sequence: 6
  givenname: Kenichi
  orcidid: 0000-0002-7418-9323
  surname: Matsumoto
  fullname: Matsumoto, Kenichi
  organization: Nara Institute of Science and Technology
BookMark eNqFkN1KAzEQRoNUsFYfQdgX2JpkN9mIN0rxDwqCKF6GJDupkW1SkrTat3eXVgQv9GoY5jvfwDlGIx88IHRG8JRggc8x4RdE8HpKMaVTSgirCD9AY8K4KBmr2AiNh0w5hI7QcUrvGGNRV80YvT4FHXKh4U1tXIhFC3q9WEAsbL_0f0r4XEHMxTpBTIXzhQl-A96BN1CkHCKk_ub84qciR4B0gg6t6hKc7ucEvdzePM_uy_nj3cPsel4aWuNcMssbsMLgVmBaWWO0qDW1VLU1FaZtmtZwxRvLiGK1wcrUXIu2AcF1rQzoaoIud70mhpQiWGlcVtkFn6NynSRYDo7ktyM5OJJ7Rz3NftGr6JYqbv_lrnac872npfoIsWtlVtsuRBuVNy7J6u-KLyXeglw
CitedBy_id crossref_primary_10_1145_3661146
crossref_primary_10_1017_S0263574725101720
Cites_doi 10.1080/01691864.2019.1663608
10.1145/3180155.3180175
10.1109/SER-IP52554.2021.00014
10.1201/9780429489105
10.1109/MS.2006.105
10.1145/1810295.1810351
10.1080/10447310802205776
10.1109/SII52469.2022.9708606
10.1016/j.scico.2020.102534
10.1109/ICRA.2017.7989070
10.1007/s11219-015-9294-2
10.1145/2696454.2696463
10.1109/IROS.2018.8594127
10.1093/biomet/61.1.165
10.1109/IROS.2012.6385871
10.1145/3341221
10.1109/IROS.2017.8206598
10.1109/HRI53351.2022.9889392
10.1109/TSE.2010.111
10.1109/ICRA.2014.6907656
10.1080/02642069.2019.1672666
10.1109/SII.2017.8279277
ContentType Journal Article
Copyright 2022 Informa UK Limited, trading as Taylor & Francis Group and The Robotics Society of Japan 2022
Copyright_xml – notice: 2022 Informa UK Limited, trading as Taylor & Francis Group and The Robotics Society of Japan 2022
DBID AAYXX
CITATION
DOI 10.1080/01691864.2022.2115316
DatabaseName CrossRef
DatabaseTitle CrossRef
DatabaseTitleList
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 1568-5535
EndPage 966
ExternalDocumentID 10_1080_01691864_2022_2115316
2115316
Genre Research Article
GroupedDBID -~X
.QJ
0BK
0R~
23M
30N
4.4
5GY
AAENE
AAGDL
AAHIA
AAJMT
AALDU
AAMIU
AAPUL
AAQRR
ABCCY
ABDBF
ABFIM
ABJNI
ABLIJ
ABPAQ
ABPEM
ABTAI
ABXUL
ABXYU
ACGFS
ACTIO
ACUHS
ADCVX
ADGTB
ADMLS
AEISY
AENEX
AEOZL
AEPSL
AEVUW
AEYOC
AFRVT
AGDLA
AGMYJ
AHDZW
AIJEM
AIYEW
AKBVH
AKOOK
ALMA_UNASSIGNED_HOLDINGS
ALQZU
AMFWP
AQRUH
AQTUD
AVBZW
AWYRJ
BLEHA
CCCUG
CS3
DGEBU
DKSSO
EAP
EBS
EMK
EPL
EST
ESX
E~A
E~B
F5P
GTTXZ
H13
HF~
HZ~
H~P
I-F
IPNFZ
J.P
KYCEM
LJTGL
M4Z
NX~
O9-
P2P
RIG
RNANH
ROSJB
RTWRZ
S-T
SNACF
TASJS
TBQAZ
TDBHL
TEN
TFL
TFT
TFW
TTHFI
TUROJ
TUS
UT5
ZGOLN
~S~
AAYXX
CITATION
ID FETCH-LOGICAL-c240t-5f67ef8c0d8023fccb84b2f2ad428cd77dc6a67f51a54c0ac46b8d7e86b4aceb3
IEDL.DBID TFW
ISICitedReferencesCount 4
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000857361500001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 0169-1864
IngestDate Sat Nov 29 02:28:43 EST 2025
Tue Nov 18 21:36:21 EST 2025
Mon Oct 20 23:47:36 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 17-18
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c240t-5f67ef8c0d8023fccb84b2f2ad428cd77dc6a67f51a54c0ac46b8d7e86b4aceb3
ORCID 0000-0003-2687-3881
0000-0002-3181-7713
0000-0001-7457-2878
0000-0002-7418-9323
0000-0001-6518-577X
0000-0001-9767-6039
PageCount 16
ParticipantIDs crossref_primary_10_1080_01691864_2022_2115316
crossref_citationtrail_10_1080_01691864_2022_2115316
informaworld_taylorfrancis_310_1080_01691864_2022_2115316
PublicationCentury 2000
PublicationDate 09/17/2022
2022-09-17
PublicationDateYYYYMMDD 2022-09-17
PublicationDate_xml – month: 09
  year: 2022
  text: 09/17/2022
  day: 17
PublicationDecade 2020
PublicationTitle Advanced robotics
PublicationYear 2022
Publisher Taylor & Francis
Publisher_xml – name: Taylor & Francis
References CIT0010
CIT0012
CIT0011
Shibata S. (CIT0001) 2019
Wada K. (CIT0002) 2017
CIT0014
CIT0013
CIT0016
CIT0015
CIT0018
CIT0017
CIT0019
CIT0021
Barnes DJ (CIT0020) 2006
CIT0023
Brook J. (CIT0025) 1996
Bangor A (CIT0027) 2009; 4
CIT0022
CIT0003
CIT0024
CIT0005
CIT0004
CIT0026
CIT0007
CIT0006
CIT0028
CIT0009
CIT0008
References_xml – ident: CIT0003
  doi: 10.1080/01691864.2019.1663608
– volume: 4
  start-page: 114
  issue: 3
  year: 2009
  ident: CIT0027
  publication-title: J Usability Stud
– ident: CIT0007
  doi: 10.1145/3180155.3180175
– ident: CIT0008
  doi: 10.1109/SER-IP52554.2021.00014
– ident: CIT0023
  doi: 10.1201/9780429489105
– ident: CIT0006
  doi: 10.1109/MS.2006.105
– ident: CIT0024
  doi: 10.1145/1810295.1810351
– ident: CIT0026
  doi: 10.1080/10447310802205776
– ident: CIT0004
  doi: 10.1109/SII52469.2022.9708606
– ident: CIT0016
  doi: 10.1016/j.scico.2020.102534
– ident: CIT0013
  doi: 10.1109/ICRA.2017.7989070
– ident: CIT0009
  doi: 10.1007/s11219-015-9294-2
– ident: CIT0010
  doi: 10.1145/2696454.2696463
– ident: CIT0014
  doi: 10.1109/IROS.2018.8594127
– ident: CIT0028
  doi: 10.1093/biomet/61.1.165
– volume-title: Usability Evaluation In: Industry
  year: 1996
  ident: CIT0025
– volume-title: In: Proceedings of 2022 IEEE/SICE International Symposium on System Integration (SII 2017)
  year: 2017
  ident: CIT0002
– ident: CIT0017
  doi: 10.1109/IROS.2012.6385871
– ident: CIT0015
  doi: 10.1145/3341221
– ident: CIT0018
  doi: 10.1109/IROS.2017.8206598
– volume-title: Leiden Asia Centre
  year: 2019
  ident: CIT0001
– volume-title: Objects first with java: a practical introduction using BlueJ
  year: 2006
  ident: CIT0020
– ident: CIT0021
  doi: 10.1109/HRI53351.2022.9889392
– ident: CIT0022
  doi: 10.1109/TSE.2010.111
– ident: CIT0005
– ident: CIT0019
  doi: 10.1109/ICRA.2014.6907656
– ident: CIT0011
  doi: 10.1080/02642069.2019.1672666
– ident: CIT0012
  doi: 10.1109/SII.2017.8279277
SSID ssj0008437
Score 2.3284023
Snippet As the problematic consequence of an aging society, with increasing labor shortage, there is a need for service robots to efficiently support the works in many...
SourceID crossref
informaworld
SourceType Enrichment Source
Index Database
Publisher
StartPage 951
SubjectTerms debugging system
end-user robot programming
Future Convenience Store Challenge
Human-Robot Interaction (HRI)
non-expert users
Title Robot behavior debugger for non-expert users in convenience stores using behavior trees
URI https://www.tandfonline.com/doi/abs/10.1080/01691864.2022.2115316
Volume 36
WOSCitedRecordID wos000857361500001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAWR
  databaseName: Taylor & Francis Online Journals
  customDbUrl:
  eissn: 1568-5535
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0008437
  issn: 0169-1864
  databaseCode: TFW
  dateStart: 19860101
  isFulltext: true
  titleUrlDefault: https://www.tandfonline.com
  providerName: Taylor & Francis
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1LT8MwDI7QxAEOvBHjpRy4dqxdmmRHhJg4oAmhoe1WJXY6TUIdWjt-P3EfYzsABzj2YCtynDh2P39m7EZhhEIiBsKBT1BE3A36cex9GbVFixD2RNko_KSGQz2Z9J9rNGFewyoph04roojyrqbDbWzeIOJuiUAk1JIqIlHU8RmM9yMi3fahn47maDBe3cVaVKyZXiIgkaaH5zstG9Fpg7t0LeoM9v9hvQdsr35y8rvKRw7ZlsuO2O4aEeExG7_M7bzgTc8-R2eX06lbcL8yns2zoBwEUHAqaeR8lvEKrF5eC5zwlS7nhKCffqmgv935CXsdPIzuH4N65EIAPrQXQZxK5VINXSRiuBTAamGjNDLo0xRApRCkkSqNQxML6BoQ0mpUTksrDPjE_JS1_KrcGeNRjP4x4vPcXohCG-mVOiPKjk2wYHSbicbUCdR85DQW4y0JG9rS2m4J2S2p7dZmnZXYe0XI8ZtAf30fk6KshKTV2JKk96Ps-R9kL9gOfRK2JFSXrFUslu6KbcNHMcsX16WbfgLU_OO-
linkProvider Taylor & Francis
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1LT8MwDLZgIAEH3ojxzIFrx9qlSXZEiGmIsQMa2m5VXp0moQ6tHb-fuI-xHYADnCtHluva-Vz7M8ANN4GhzBiPWu0ACg2bXjsMnS8boYwy2m_RfFC4x_t9MRq1l2dhsK0SMXRcEEXksRo_bixGVy1xt8gg4guGJZEgaDgI4xyJrcNG6HIt8ucPOsNFNBa04M10Ih7KVFM83x2zkp9W2EuX8k5n7z803ofd8tZJ7go3OYA1mxzCzhIX4REMX6ZqmpFqbJ8Yq-bjsZ0RpxpJpomX7wLICFY1UjJJSNGvnkcGgi2WNiXYRD_-OgJ_eKfH8Np5GNx3vXLrgqddds-8MGbcxkI3DXLDxVorQVUQB9I4pKIN50YzyXgc-jKkuik1ZUoYbgVTVGqHzU-g5rSyp0CC0Lj7iIO6Ld9QIZk71EqaD21qpaWoA61sHemSkhw3Y7xFfsVcWtotQrtFpd3q0FiIvRecHL8JtJdfZJTlxZC42FwStX6UPfuD7DVsdQfPvaj32H86h218hK0mPr-AWjab20vY1B_ZJJ1d5T77CVHB5-g
linkToPdf http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV07T8MwELagIAQDb0R5emBNaVLHdkcERCCqqkJF7RbZPruqhNKqSfn92HmUdgAGmKPPsi4X353z3XcI3TAIgFAAj2hlCxQSNr12GFpfBi5BgvJbJG8U7rBulw-H7V7JJkxLWqWroU0hFJGf1e7jnoKpGHG3TkDE59TdiARBw1Yw1o_oOtqwqTN1Tt6PBovDmJNCNtNCPIepmni-W2YlPK2Ily6FnWjvHza8j3bLnBPfFU5ygNZ0coh2lpQIj9DgdSInGa6a9jFoOR-N9AzbneFkknj5JIAMuzuNFI8TXLDV83MBO4KlTrGj0I--lnC_u9Nj9BY99u-fvHLmgqdsbM-80FCmDVdNcMpwRinJiQxMIMDWKQoYA0UFZSb0RUhUUyhCJQemOZVEKFuZn6Ca3ZU-RTgIwWYjttBt-UC4oHZRLUjesqmkEryOSGXqWJWC5G4uxnvsV7qlpd1iZ7e4tFsdNRawaaHI8Rugvfwe4yy_CjHF3JK49SP27A_Ya7TVe4jiznP35RxtuyeOZ-KzC1TLZnN9iTbVRzZOZ1e5x34Coyrmmg
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Robot+behavior+debugger+for+non-expert+users+in+convenience+stores+using+behavior+trees&rft.jtitle=Advanced+robotics&rft.au=Tulathum%2C+Pattaraporn&rft.au=Usawalertkamol%2C+Bunyapon&rft.au=Garcia+Ricardez%2C+Gustavo+Alfonso&rft.au=Takamatsu%2C+Jun&rft.date=2022-09-17&rft.pub=Taylor+%26+Francis&rft.issn=0169-1864&rft.eissn=1568-5535&rft.volume=36&rft.issue=17-18&rft.spage=951&rft.epage=966&rft_id=info:doi/10.1080%2F01691864.2022.2115316&rft.externalDocID=2115316
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0169-1864&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0169-1864&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0169-1864&client=summon