Visual cues-based anticipation for percussionist-robot interaction

Visual cues-based anticipation is a fundamental aspect of human-human interaction, and it plays an especially important role in the time demanding medium of group performance. In this work we explore the importance of visual gesture anticipation in music performance involving human and robot. We stu...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI) s. 117 - 118
Hlavní autori: Cicconet, Marcelo, Bretan, Mason, Weinberg, Gil
Médium: Konferenčný príspevok..
Jazyk:English
Vydavateľské údaje: New York, NY, USA ACM 05.03.2012
IEEE
Edícia:ACM Conferences
Predmet:
Acceleration
Action-Anticipation
Applied computing > Arts and humanities > Sound and music computing
Humans
Musician-Robot Interaction
Robot kinematics
Synchronization
USA Councils
Visualization
action-anticipation
musician-robot interaction
ISBN:145031063X, 9781450310635
ISSN:2167-2121
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:Visual cues-based anticipation is a fundamental aspect of human-human interaction, and it plays an especially important role in the time demanding medium of group performance. In this work we explore the importance of visual gesture anticipation in music performance involving human and robot. We study the case in which a human percussionist is playing a four-piece percussion set, and a robot musician is playing either the marimba, or a three-piece percussion set. Computer Vision is used to embed anticipation in the robotic response to the human gestures. We developed two algorithms for anticipation, predicting the strike location about 10 mili-seconds or about 100 mili-seconds before it occurs. Using the second algorithm, we show that the robot outperforms, on average, a group of human subjects, in synchronizing its gesture with a reference strike. We also show that, in the tested group of users, having some time in advance is important for a human to synchronize the strike with a reference player, but, from a certain time, that good influence stops increasing.
ISBN:145031063X
9781450310635
ISSN:2167-2121
DOI:10.1145/2157689.2157713