Heart fire for online live-streamed concerts: a pilot study of a smartwatch-based musician-listener interaction system
Online live-streaming has become an essential segment of the music industry in the post-COVID- era. However, methods to enhance interaction between musicians and listeners at online concerts are yet to be adequately researched. In this pilot study, we propose Heart Fire, a system to promote musician...
Saved in:
| Published in: | Frontiers in Computer Science Vol. 5 |
|---|---|
| Main Authors: | , |
| Format: | Journal Article |
| Language: | English Japanese |
| Published: |
Frontiers Media SA
09.10.2023
Frontiers Media S.A |
| Subjects: | |
| ISSN: | 2624-9898, 2624-9898 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | Online live-streaming has become an essential segment of the music industry in the post-COVID- era. However, methods to enhance interaction between musicians and listeners at online concerts are yet to be adequately researched. In this pilot study, we propose Heart Fire, a system to promote musician-listener interaction that visualizes the listeners' mental states using a smartwatch-based architecture. Accordingly, the listeners' heart rates are first measured using a Galaxy smartwatch and then processed into a real-time animation of a burning flame, whose intensity is dependent on the heart rate, using Azure Kinect and TouchDesigner. The feasibility of the proposed system was confirmed using an experiment involving ten subjects. Each subject selected two types of music-cheerful and relaxing. The BPM and energy of each song were measured, and each subject's heart rate was monitored. Subsequently, each subject was asked to answer a questionnaire about the emotions they experienced. The results demonstrated that the proposed system is capable of visualizing audience response to music in real time. |
|---|---|
| ISSN: | 2624-9898 2624-9898 |
| DOI: | 10.3389/fcomp.2023.1150348 |