Behaviourally-based Synthesis of Scene-aware Footstep Sound

This paper proposes a behaviourally-based scene-aware (BBSA) footstep sound synthesis method for congruent interaction in virtual environments. Most existing methods focus on how to simulate timbre of footstep sound appropriately, but ignore the impact of user behaviour and virtual scenes on footste...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) s. 1021 - 1022
Hlavní autori: Cheng, Haonan, Wang, Zhaoye, Huang, Hengyan, Cai, Juanjuan, Ye, Long
Médium: Konferenčný príspevok..
Jazyk:English
Vydavateľské údaje: IEEE 01.03.2023
Predmet:
Applied computing-Arts and humanities-Sound and music computing
Codes
Conferences
Human-centered computing-Human computer interaction-Interaction techniques-Auditory feedback
Real-time systems
Three-dimensional displays
Timbre
User interfaces
Virtual environments
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:This paper proposes a behaviourally-based scene-aware (BBSA) footstep sound synthesis method for congruent interaction in virtual environments. Most existing methods focus on how to simulate timbre of footstep sound appropriately, but ignore the impact of user behaviour and virtual scenes on footstep sound, which reduces the sense of immersion and presence. To tackle this issue, we classify common user behaviours and design a set of mapping functions between different behaviours and footsteps. To further enhance user immersion, we propose a ray-casting based scene aware sound synthesis method, which allows to synthesize corresponding footstep sounds in real time for indoor and outdoor scenes with different material surfaces. User studies demonstrate that our proposed BBSA method achieves a higher level of immersion and presence. The complete project code is available: https://github.com/OlyMarco/Behaviourally-based-Synthesis-of-Scene-aware-Footstep-Sound-Demo-.
DOI:10.1109/VRW58643.2023.00356