Towards Reproducible Language-Based HRI Experiments: Open-Sourcing a Generalized Experiment Project
We are witnessing increasing calls for reproducibility and replicability in HRI studies to improve reliability and confidence in empirical findings. One solution to facilitate this is using a robot platform that researchers frequently use, making it easier to replicate studies to verify results. In...
Uloženo v:
| Vydáno v: | 2024 19th ACM/IEEE International Conference on Human-Robot Interaction (HRI) s. 949 - 953 |
|---|---|
| Hlavní autoři: | , , |
| Médium: | Konferenční příspěvek |
| Jazyk: | angličtina |
| Vydáno: |
ACM
11.03.2024
|
| Témata: | |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | We are witnessing increasing calls for reproducibility and replicability in HRI studies to improve reliability and confidence in empirical findings. One solution to facilitate this is using a robot platform that researchers frequently use, making it easier to replicate studies to verify results. In this work, we focus on a popular, affordable, and rich-in-functionality robot platform, NAO/Pepper, and contribute a generalized experiment project specifically for conducting language-based HRI experiments where a robot instructs a human for a task, including objective data collection.Specifically, we first describe a concrete workflow from an existing experiment and how it is generalized. We then evaluate the generalized project with a case study to show how adopters can quickly adapt to their specific experiment needs. This work provides inspiration for HRI researchers to not only provide their experiment code as supplementary material but also generalize them to benefit other researchers to advance empirical research in HRI. The generalized Choregraphe project with documentation, demo, and usage notes is available under MIT license on GitHub at https://github.com/TheRARELab/langex. We welcome questions by posting GitHub issues and pull requests to share adapted packages.CCS CONCEPTS* Human-centered computing → Systems and tools for interaction design; * Computer systems organization → Robotics. |
|---|---|
| AbstractList | We are witnessing increasing calls for reproducibility and replicability in HRI studies to improve reliability and confidence in empirical findings. One solution to facilitate this is using a robot platform that researchers frequently use, making it easier to replicate studies to verify results. In this work, we focus on a popular, affordable, and rich-in-functionality robot platform, NAO/Pepper, and contribute a generalized experiment project specifically for conducting language-based HRI experiments where a robot instructs a human for a task, including objective data collection.Specifically, we first describe a concrete workflow from an existing experiment and how it is generalized. We then evaluate the generalized project with a case study to show how adopters can quickly adapt to their specific experiment needs. This work provides inspiration for HRI researchers to not only provide their experiment code as supplementary material but also generalize them to benefit other researchers to advance empirical research in HRI. The generalized Choregraphe project with documentation, demo, and usage notes is available under MIT license on GitHub at https://github.com/TheRARELab/langex. We welcome questions by posting GitHub issues and pull requests to share adapted packages.CCS CONCEPTS* Human-centered computing → Systems and tools for interaction design; * Computer systems organization → Robotics. |
| Author | Han, Zhao Tijani, Uthman Wang, Hong |
| Author_xml | – sequence: 1 givenname: Uthman surname: Tijani fullname: Tijani, Uthman email: uthmantijani@usf.edu organization: University of South Florida,Tampa,Florida,USA – sequence: 2 givenname: Hong surname: Wang fullname: Wang, Hong email: hongw@usf.edu organization: University of South Florida,Tampa,Florida,USA – sequence: 3 givenname: Zhao surname: Han fullname: Han, Zhao email: zhaohan@usf.edu organization: University of South Florida,Tampa,Florida,USA |
| BookMark | eNpFkMtKA0EURFtQUGPWblz0D0y8nX6705AXBCIxrsOd7jthJPYMPQk-vt4BBRdFbQ6Hoq7ZeWoSMXYrYCSE0vfSCPDWjqSRVjl5xobeeqcALMjxWF-yYdfVJWjlBSjtrljYNh-YY8c31OYmnkJdHoivMO1PuKfiCTuKfLFZ8ulnS7l-p3TsHvi6pVS8NKcc6rTnyOeUKOOh_u7hf5A_5-aNwvGGXVR46Gj41wP2OptuJ4titZ4vJ4-rAsfKHYugTWVstAo9lUgVREMBpOmjglaqUlAKsiY6V2qnesQK9ICgKuEhSjlgd7_emoh2bT8C89dOgOlPcSB_AMtaVqc |
| ContentType | Conference Proceeding |
| DBID | 6IE 6IL CBEJK RIE RIL |
| DOI | 10.1145/3610977.3637483 |
| DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Xplore POP ALL IEEE Xplore All Conference Proceedings IEEE Electronic Library (IEL) IEEE Proceedings Order Plans (POP All) 1998-Present |
| DatabaseTitleList | |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| EISBN | 9798400703225 |
| EndPage | 953 |
| ExternalDocumentID | 10661080 |
| Genre | orig-research |
| GroupedDBID | 6IE 6IL ACM ALMA_UNASSIGNED_HOLDINGS APO CBEJK LHSKQ RIE RIL |
| ID | FETCH-LOGICAL-a248t-c56f67d74a9ebaef0d6ec036c034c544f40b1e76d88b584bae71a90a04f190d33 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 0 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001239977500109&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| IngestDate | Tue May 06 03:31:43 EDT 2025 |
| IsPeerReviewed | false |
| IsScholarly | false |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-a248t-c56f67d74a9ebaef0d6ec036c034c544f40b1e76d88b584bae71a90a04f190d33 |
| PageCount | 5 |
| ParticipantIDs | ieee_primary_10661080 |
| PublicationCentury | 2000 |
| PublicationDate | 2024-March-11 |
| PublicationDateYYYYMMDD | 2024-03-11 |
| PublicationDate_xml | – month: 03 year: 2024 text: 2024-March-11 day: 11 |
| PublicationDecade | 2020 |
| PublicationTitle | 2024 19th ACM/IEEE International Conference on Human-Robot Interaction (HRI) |
| PublicationTitleAbbrev | HRI |
| PublicationYear | 2024 |
| Publisher | ACM |
| Publisher_xml | – name: ACM |
| SSID | ssib054910458 |
| Score | 1.8630794 |
| Snippet | We are witnessing increasing calls for reproducibility and replicability in HRI studies to improve reliability and confidence in empirical findings. One... |
| SourceID | ieee |
| SourceType | Publisher |
| StartPage | 949 |
| SubjectTerms | Choregraphe Codes experiment design Human computer interaction Human-robot interaction language-capable robots Licenses Open science Organizations Reliability replicability reproducibility Reproducibility of results user studies |
| Title | Towards Reproducible Language-Based HRI Experiments: Open-Sourcing a Generalized Experiment Project |
| URI | https://ieeexplore.ieee.org/document/10661080 |
| WOSCitedRecordID | wos001239977500109&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NSwMxEA22ePCkYsVvcvCamt3NbhKPSksFKUUr9FbyMYGCtNIPD_31TtJtiwcPHhaWZdhANrvv7WTeG0LuSx506TiwoBQwkXP8DuYZsAKULq0IuK58ajYh-301GulBLVZPWhgASMVn0I6naS_fz9wqpsrwDUc0QYrTIA0pq41Ya7t48D8ni5t-tX1PJsqHIlqJS9kuquixUvzqn5Lgo3v8z4FPSGsvxKODHcSckgOYnhE3TKWuC4rkOfm1Tuwn0Nc68cieEJc87b290M7OvX_xSGPlCHuPqXq8EzW09puerDF4HxhHi5mZFvnodobPPVb3SmAmF2rJXFmFSnopjAZrIHBfgUN0wkO4UogguM1AVl4pi5wDQ2RmNDdcBKQEvijOSXM6m8IFoTpYH7TQPKioOgVlFAiuwJTcATf2krTiDI2_NnYY4-3kXP1x_Zoc5cgEYuFWlt2Q5nK-glty6L6Xk8X8Lj3EH0PRnyw |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NSwMxEA1aBT2pWPHbHLymZneT3cSjYmmxlqIVeivZZAIFaaUfHvz1TtJtiwcPHhaWZUhgkt03O5n3hpBbyb2WlgPzSgETKcfvYJoAy0BpWQqP-8rFZhNFt6sGA92ryOqRCwMAsfgMGuE2nuW7iV2EVBm-4YgmGOJskx0pcNwlXWu1ffBPJwnHfpWATyLkXRbExIuikeVBZSX71UElAkjz4J9TH5L6hopHe2uQOSJbMD4mth-LXWcUw-eo2DoqP4B2qtQje0BkcrT12qZPa_3-2T0NtSPsLSTrcSRqaKU4PfpG441hmC3kZurkvfnUf2yxqlsCM6lQc2Zl7vPCFcJoKA147nKwiE94CYvu8oKXCRS5U6rEqANNisRobrjwGBS4LDshtfFkDKeEal86r4XmXgXeKSijQHAFRnIL3JRnpB48NPxcCmIMV845_-P5Ddlr9V86w067-3xB9lOMC0IZV5Jcktp8uoArsmu_5qPZ9Dou6A-4yqJz |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2024+19th+ACM%2FIEEE+International+Conference+on+Human-Robot+Interaction+%28HRI%29&rft.atitle=Towards+Reproducible+Language-Based+HRI+Experiments%3A+Open-Sourcing+a+Generalized+Experiment+Project&rft.au=Tijani%2C+Uthman&rft.au=Wang%2C+Hong&rft.au=Han%2C+Zhao&rft.date=2024-03-11&rft.pub=ACM&rft.spage=949&rft.epage=953&rft_id=info:doi/10.1145%2F3610977.3637483&rft.externalDocID=10661080 |