Visual cues-based anticipation for percussionist-robot interaction

Visual cues-based anticipation is a fundamental aspect of human-human interaction, and it plays an especially important role in the time demanding medium of group performance. In this work we explore the importance of visual gesture anticipation in music performance involving human and robot. We stu...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI) s. 117 - 118
Hlavní autoři: Cicconet, Marcelo, Bretan, Mason, Weinberg, Gil
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: New York, NY, USA ACM 05.03.2012
IEEE
Edice:ACM Conferences
Témata:
Acceleration
Action-Anticipation
Applied computing > Arts and humanities > Sound and music computing
Humans
Musician-Robot Interaction
Robot kinematics
Synchronization
USA Councils
Visualization
action-anticipation
musician-robot interaction
ISBN:145031063X, 9781450310635
ISSN:2167-2121
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Visual cues-based anticipation is a fundamental aspect of human-human interaction, and it plays an especially important role in the time demanding medium of group performance. In this work we explore the importance of visual gesture anticipation in music performance involving human and robot. We study the case in which a human percussionist is playing a four-piece percussion set, and a robot musician is playing either the marimba, or a three-piece percussion set. Computer Vision is used to embed anticipation in the robotic response to the human gestures. We developed two algorithms for anticipation, predicting the strike location about 10 mili-seconds or about 100 mili-seconds before it occurs. Using the second algorithm, we show that the robot outperforms, on average, a group of human subjects, in synchronizing its gesture with a reference strike. We also show that, in the tested group of users, having some time in advance is important for a human to synchronize the strike with a reference player, but, from a certain time, that good influence stops increasing.
ISBN:145031063X
9781450310635
ISSN:2167-2121
DOI:10.1145/2157689.2157713