Visual cues-based anticipation for percussionist-robot interaction

Visual cues-based anticipation is a fundamental aspect of human-human interaction, and it plays an especially important role in the time demanding medium of group performance. In this work we explore the importance of visual gesture anticipation in music performance involving human and robot. We stu...

Full description

Saved in:
Bibliographic Details
Published in:2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI) pp. 117 - 118
Main Authors: Cicconet, Marcelo, Bretan, Mason, Weinberg, Gil
Format: Conference Proceeding
Language:English
Published: New York, NY, USA ACM 05.03.2012
IEEE
Series:ACM Conferences
Subjects:
Acceleration
Action-Anticipation
Applied computing > Arts and humanities > Sound and music computing
Humans
Musician-Robot Interaction
Robot kinematics
Synchronization
USA Councils
Visualization
action-anticipation
musician-robot interaction
ISBN:145031063X, 9781450310635
ISSN:2167-2121
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Visual cues-based anticipation is a fundamental aspect of human-human interaction, and it plays an especially important role in the time demanding medium of group performance. In this work we explore the importance of visual gesture anticipation in music performance involving human and robot. We study the case in which a human percussionist is playing a four-piece percussion set, and a robot musician is playing either the marimba, or a three-piece percussion set. Computer Vision is used to embed anticipation in the robotic response to the human gestures. We developed two algorithms for anticipation, predicting the strike location about 10 mili-seconds or about 100 mili-seconds before it occurs. Using the second algorithm, we show that the robot outperforms, on average, a group of human subjects, in synchronizing its gesture with a reference strike. We also show that, in the tested group of users, having some time in advance is important for a human to synchronize the strike with a reference player, but, from a certain time, that good influence stops increasing.
AbstractList Visual cues-based anticipation is a fundamental aspect of human-human interaction, and it plays an especially important role in the time demanding medium of group performance. In this work we explore the importance of visual gesture anticipation in music performance involving human and robot. We study the case in which a human percussionist is playing a four-piece percussion set, and a robot musician is playing either the marimba, or a three-piece percussion set. Computer Vision is used to embed anticipation in the robotic response to the human gestures. We developed two algorithms for anticipation, predicting the strike location about 10 mili-seconds or about 100 mili-seconds before it occurs. Using the second algorithm, we show that the robot outperforms, on average, a group of human subjects, in synchronizing its gesture with a reference strike. We also show that, in the tested group of users, having some time in advance is important for a human to synchronize the strike with a reference player, but, from a certain time, that good influence stops increasing.
Author Weinberg, Gil
Cicconet, Marcelo
Bretan, Mason
Author_xml – sequence: 1
  givenname: Marcelo
  surname: Cicconet
  fullname: Cicconet, Marcelo
  email: cicconet@gmail.com
  organization: Georgia Tech, Atlanta, GA, USA
– sequence: 2
  givenname: Mason
  surname: Bretan
  fullname: Bretan, Mason
  email: masonbretan@gmail.com
  organization: Georgia Tech, Atlanta, GA, USA
– sequence: 3
  givenname: Gil
  surname: Weinberg
  fullname: Weinberg, Gil
  email: gilw@gatech.edu
  organization: Georgia Tech, Atlanta, GA, USA
BookMark eNqNkL1PwzAQxY0oErR0ZmDJyJLi80ecjlDxJVViqRCbdXbOkqFNKjsd-O9J1A6M3PL03vvphjdlk7ZribEb4AsApe8FaFPVy8WoBuQZmw4pl8Ar-Xn-10zYlYDKlAIEXLJ5zl-ccxjPyCv2-BHzAbeFP1AuHWZqCmz76OMe-9i1RehSsafkDzkPNua-TJ3r-iK2PSX0I3PNLgJuM81POmOb56fN6rVcv7-8rR7WJQpl-hK0BKEdGhMaX_EQhhgcLBsKTqA3QaOu0WmvlCMCrgXJGrkJvglCeTljt8e3kYjsPsUdph9bCbVUtRzau2OLfmdd131nC9yOS9nTUva01IAu_olalyIF-QuJCmgL
ContentType Conference Proceeding
Copyright 2012 Authors
Copyright_xml – notice: 2012 Authors
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1145/2157689.2157713
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList

Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Xplore
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISBN 145031063X
9781450310635
EndPage 118
ExternalDocumentID 6249483
Genre orig-research
GroupedDBID 6IE
6IF
6IK
6IL
6IN
AAJGR
ACM
ADPZR
ALMA_UNASSIGNED_HOLDINGS
APO
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
GUFHI
IEGSK
IERZE
OCL
RIE
RIL
AAWTH
ABLEC
ADZIZ
CHZPO
ID FETCH-LOGICAL-a247t-153125ba77fdc60ffa241b19defb2ac7f5a58ab5c44bee1052e38a07fcdf24c3
IEDL.DBID RIE
ISBN 145031063X
9781450310635
ISICitedReferencesCount 5
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000393315300020&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 2167-2121
IngestDate Wed Aug 27 04:37:05 EDT 2025
Wed Jan 31 06:43:27 EST 2024
Wed Jan 31 06:43:26 EST 2024
IsPeerReviewed false
IsScholarly false
Keywords action-anticipation
musician-robot interaction
Language English
LinkModel DirectLink
MeetingName HRI'12: International Conference on Human-Robot Interaction
MergedId FETCHMERGED-LOGICAL-a247t-153125ba77fdc60ffa241b19defb2ac7f5a58ab5c44bee1052e38a07fcdf24c3
PageCount 2
ParticipantIDs ieee_primary_6249483
acm_books_10_1145_2157689_2157713
acm_books_10_1145_2157689_2157713_brief
PublicationCentury 2000
PublicationDate 20120305
2012-March
PublicationDateYYYYMMDD 2012-03-05
2012-03-01
PublicationDate_xml – month: 03
  year: 2012
  text: 20120305
  day: 05
PublicationDecade 2010
PublicationPlace New York, NY, USA
PublicationPlace_xml – name: New York, NY, USA
PublicationSeriesTitle ACM Conferences
PublicationTitle 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
PublicationTitleAbbrev HRI
PublicationYear 2012
Publisher ACM
IEEE
Publisher_xml – name: ACM
– name: IEEE
SSID ssj0001111173
ssj0003204102
Score 1.521693
Snippet Visual cues-based anticipation is a fundamental aspect of human-human interaction, and it plays an especially important role in the time demanding medium of...
SourceID ieee
acm
SourceType Publisher
StartPage 117
SubjectTerms Acceleration
Action-Anticipation
Applied computing -- Arts and humanities -- Sound and music computing
Humans
Musician-Robot Interaction
Robot kinematics
Synchronization
USA Councils
Visualization
Title Visual cues-based anticipation for percussionist-robot interaction
URI https://ieeexplore.ieee.org/document/6249483
WOSCitedRecordID wos000393315300020&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LS8NAEB7a4kEvPlqxvoggeDFts49sclUsHqT0UKS3sLvZhYK2JU38_c5uYqsgiLkkM-whfAn7ze7OfANwixExk64HoBEsD1kqo1CZlIRW4XIIFxQ8t_5Lv4jJJJnP02kL7re1MMYYn3xmBu7Rn-XnK125rbJhTJyYCW1DW4i4rtXa7ae4q6FiZ1MyYpFPOSRO2htn6MjXdXGnhRnT-ZfcU2PzRvYHHUNkQQzC04G7C9_3QOr3H91XPPmMD__32kfQ21XxBdMtPx1DyyxP4OCbAGEXHl4Xm0q-BRrJIXSElgeI9DbPOsCINlibQlcuV9Zp7IbFSq3KwIlMFHVJRA9m46fZ43PYdFUIJWGiDHGKw6BGSSFsruORteiOVJTmxioitbBc8kQqrhlTxmD4RQxN5EhYnVvCND2FznK1NGcQ6CT1GbIqIjg4YYpSQblGIzZxylgfbhC4zK0WNlldAM2zBtysAbcPd3-OyVSxMLYPXQdttq5VOLIG1fPf3Rewj6ENqbPFLqFTFpW5gj39US42xbX_dT4BHTq3xA
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3fS8MwED7mFNQXf0xx_qwg-GK3NU2a9lVxTJxjD0P2VpI0gYFuo1v9-72kdVMQxL60d-ShfC35LsnddwA3GBFTYXsAak4znyYi8KVOiG8kLodwQcEy4750nw8G8XicDGtwt6qF0Vq75DPdso_uLD-bqcJulbUjYsVMwg3YZJSSTlmttd5RsVdFxtYOSYcGLumQWHFvnKMDV9nFrBpmFI6_BJ8qm1XCP-hoIw9iGJ607J27zgdCvf_ov-Lop7v3vxffh6N1HZ83XDHUAdT09BB2v0kQNuD-dbIoxJunkB58S2mZh1ivMq09jGm9uc5VYbNlrcqun8_kbOlZmYm8LIo4glH3cfTQ86u-Cr4glC99nOQwrJGCc5OpqGMMugMZJJk2kgjFDRMsFpIpSqXWGIARHcaiw43KDKEqPIb6dDbVJ-CpOHE5sjIgODimMgx5yBQakY4SSptwjcCldr2wSMsSaJZW4KYVuE24_XNMKvOJNk1oWGjTeanDkVaonv7uvoLt3uiln_afBs9nsIOBDilzx86hvswLfQFb6mM5WeSX7jf6BOQ6uws
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=Proceedings+of+the+seventh+annual+ACM%2FIEEE+international+conference+on+Human-Robot+Interaction&rft.atitle=Visual+cues-based+anticipation+for+percussionist-robot+interaction&rft.au=Cicconet%2C+Marcelo&rft.au=Bretan%2C+Mason&rft.au=Weinberg%2C+Gil&rft.series=ACM+Conferences&rft.date=2012-03-05&rft.pub=ACM&rft.isbn=145031063X&rft.spage=117&rft.epage=118&rft_id=info:doi/10.1145%2F2157689.2157713
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2167-2121&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2167-2121&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2167-2121&client=summon