Talking with robots about objects a system-level evaluation in HRI
We present the design process, realization and evaluation of a robot system for nteractive object learning. The system-oriented evaluation, in particular, addresses an open problem for the evaluation of systems, where overall user satisfaction depends not only on the performance of the parts, but al...
Uložené v:
| Vydané v: | 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI) s. 479 - 486 |
|---|---|
| Hlavní autori: | , , , |
| Médium: | Konferenčný príspevok.. |
| Jazyk: | English |
| Vydavateľské údaje: |
New York, NY, USA
ACM
05.03.2012
IEEE |
| Edícia: | ACM Conferences |
| Predmet: | |
| ISBN: | 145031063X, 9781450310635 |
| ISSN: | 2167-2121 |
| On-line prístup: | Získať plný text |
| Tagy: |
Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
|
| Shrnutí: | We present the design process, realization and evaluation of a robot system for nteractive object learning. The system-oriented evaluation, in particular, addresses an open problem for the evaluation of systems, where overall user satisfaction depends not only on the performance of the parts, but also on their combination, and on user behavior. Based on the PARADISE method known from spoken dialog systems, we have defined and applied internal and external metrics for fine-grained and largely automatable identification of such relationships. Through evaluation with n=28 subjects, indicator functions explaining up to 55% of variation in several satisfaction metrics were found. Furthermore, we demonstrate that the system's interaction style reduces the need for instruction and successfully recovers partial failures. |
|---|---|
| ISBN: | 145031063X 9781450310635 |
| ISSN: | 2167-2121 |
| DOI: | 10.1145/2157689.2157841 |

