Heart fire for online live-streamed concerts: a pilot study of a smartwatch-based musician-listener interaction system

Online live-streaming has become an essential segment of the music industry in the post-COVID- era. However, methods to enhance interaction between musicians and listeners at online concerts are yet to be adequately researched. In this pilot study, we propose Heart Fire, a system to promote musician...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Frontiers in Computer Science Ročník 5
Hlavní autoři: Wang, Tianyi, Okada, Shima
Médium: Journal Article
Jazyk:angličtina
japonština
Vydáno: Frontiers Media SA 09.10.2023
Frontiers Media S.A
Témata:
ISSN:2624-9898, 2624-9898
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Online live-streaming has become an essential segment of the music industry in the post-COVID- era. However, methods to enhance interaction between musicians and listeners at online concerts are yet to be adequately researched. In this pilot study, we propose Heart Fire, a system to promote musician-listener interaction that visualizes the listeners' mental states using a smartwatch-based architecture. Accordingly, the listeners' heart rates are first measured using a Galaxy smartwatch and then processed into a real-time animation of a burning flame, whose intensity is dependent on the heart rate, using Azure Kinect and TouchDesigner. The feasibility of the proposed system was confirmed using an experiment involving ten subjects. Each subject selected two types of music-cheerful and relaxing. The BPM and energy of each song were measured, and each subject's heart rate was monitored. Subsequently, each subject was asked to answer a questionnaire about the emotions they experienced. The results demonstrated that the proposed system is capable of visualizing audience response to music in real time.
ISSN:2624-9898
2624-9898
DOI:10.3389/fcomp.2023.1150348