A Virtual Reality Musical Instrument Integrated with a Remote Playing Robot System

Music education and performance are often constrained by geo-graphical limitations. To evaluate the effectiveness of remote music performance, we designed a virtual reality musical instrument system with a remote playing robot. The system comprises a virtual Irish tin whistle playing system and a re...

Full description

Saved in:
Bibliographic Details
Published in:2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) pp. 777 - 778
Main Authors: Zhu, Zhonghao, Nai, Weizhi, Wang, Xin, Liu, Yue
Format: Conference Proceeding
Language:English
Published: IEEE 16.03.2024
Subjects:
Applied computing-Arts and humanities-Sound and music computing
Applied computing-Education-Distance learning
Education
Human-centered computing-Human computer interaction (HCI)-Interaction paradigms-Virtual reality
Instruments
Mechanical sensors
Music
Three-dimensional displays
Tin
Virtual reality
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Music education and performance are often constrained by geo-graphical limitations. To evaluate the effectiveness of remote music performance, we designed a virtual reality musical instrument system with a remote playing robot. The system comprises a virtual Irish tin whistle playing system and a remote playing robot system. In the virtual playing system, sensors capture the performer's gestures, translate them into corresponding tin whistle playing commands and produce the music. The playing robot is constructed with mechanical hands, and a data transmission module is programmed to facilitate communication between the virtual playing system and the robot, enabling remote simulated performances.
DOI:10.1109/VRW62533.2024.00185