Speech and Gesture Emphasis Effects For Robotic and Human Communicators - a Direct Comparison

Emphasis, by means of either pitch accents or beat gestures (rhythmic co-verbal gestures with no semantic meaning), has been shown to serve two main purposes in human communication: syntactic disambiguation and salience. To use beat gestures in this role, interlocutors must be able to integrate them...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Hri '15: ACM/IEEE International Conference on Human-Robot Interaction USB Stick s. 255 - 262
Hlavní autori: Bremner, Paul, Leonards, Ute
Médium: Konferenčný príspevok..
Jazyk:English
Vydavateľské údaje: ACM 01.03.2015
Predmet:
Gestures
Human-robot interaction
Humanoid robots
Robot kinematics
Robot sensing systems
Semantics
Syntactics
Timing
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:Emphasis, by means of either pitch accents or beat gestures (rhythmic co-verbal gestures with no semantic meaning), has been shown to serve two main purposes in human communication: syntactic disambiguation and salience. To use beat gestures in this role, interlocutors must be able to integrate them with the speech they accompany. Whether such integration is possible when the multi-modal communication information is produced by a humanoid robot, and whether it is as efficient as for human communicators, are questions that need to be answered to further understanding of the efficacy of humanoid robots for naturalistic human-like communication. Here, we present an experiment which, using a fully within subjects design, shows that there is a marked difference in speech and gesture integration between human and robot communicators, being significantly less effective for the robot. In contrast to beat gestures, the effects of speech emphasis are the same whether that speech is played through a robot or as part of a video of a human. Thus, while integration of speech emphasis and verbal information do occur for robot communicators, integration of non-informative beat gestures and verbal information does not, despite comparable timing and motion profiles to human gestures.
DOI:10.1145/2696454.2696496