Behaviourally-based Synthesis of Scene-aware Footstep Sound

This paper proposes a behaviourally-based scene-aware (BBSA) footstep sound synthesis method for congruent interaction in virtual environments. Most existing methods focus on how to simulate timbre of footstep sound appropriately, but ignore the impact of user behaviour and virtual scenes on footste...

Full description

Saved in:

Bibliographic Details
Published in:	2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) pp. 1021 - 1022
Main Authors:	Cheng, Haonan, Wang, Zhaoye, Huang, Hengyan, Cai, Juanjuan, Ye, Long
Format:	Conference Proceeding
Language:	English
Published:	IEEE 01.03.2023
Subjects:	Applied computing-Arts and humanities-Sound and music computing Codes Conferences Human-centered computing-Human computer interaction-Interaction techniques-Auditory feedback Real-time systems Three-dimensional displays Timbre User interfaces Virtual environments
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	This paper proposes a behaviourally-based scene-aware (BBSA) footstep sound synthesis method for congruent interaction in virtual environments. Most existing methods focus on how to simulate timbre of footstep sound appropriately, but ignore the impact of user behaviour and virtual scenes on footstep sound, which reduces the sense of immersion and presence. To tackle this issue, we classify common user behaviours and design a set of mapping functions between different behaviours and footsteps. To further enhance user immersion, we propose a ray-casting based scene aware sound synthesis method, which allows to synthesize corresponding footstep sounds in real time for indoor and outdoor scenes with different material surfaces. User studies demonstrate that our proposed BBSA method achieves a higher level of immersion and presence. The complete project code is available: https://github.com/OlyMarco/Behaviourally-based-Synthesis-of-Scene-aware-Footstep-Sound-Demo-.
DOI:	10.1109/VRW58643.2023.00356