Conversational dynamics in social virtual reality: A large-scale, longitudinal study of speech acts and nonverbal behavior

This study explores verbal interactions in social virtual reality (VR). We developed the Virtual Reality Interaction Dynamics Scheme (VRIDS), which includes 10 speech acts (e.g., questioning, opinions, disagreements) by integrating existing speech frameworks with new constructs from our data. Analyz...

Full description

Saved in:
Bibliographic Details
Published in:Computers in human behavior Vol. 170; p. 108691
Main Authors: Santoso, Monique, Wang, Portia, Han, Eugy, Bailenson, Jeremy N.
Format: Journal Article
Language:English
Published: Elsevier Ltd 01.09.2025
Subjects:
Behavioral dynamics
Context
Nonverbal communication
Social virtual reality
Speech acts
Speech acts
Context
Social virtual reality
Nonverbal communication
Behavioral dynamics
ISSN:0747-5632
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This study explores verbal interactions in social virtual reality (VR). We developed the Virtual Reality Interaction Dynamics Scheme (VRIDS), which includes 10 speech acts (e.g., questioning, opinions, disagreements) by integrating existing speech frameworks with new constructs from our data. Analyzing speech from 109 participants in a metaverse classroom over four weeks, we coded 9738 discourse units. VRIDS introduced new constructs like context-dependent commentary on virtual objects, which increased as users became more familiar with the technology over time. Idea sharing also increased over time, indicating enhanced collaboration. We identified attractor and repeller states through speech act sequences and an “echoing” strategy. Additionally, we examined the link between nonverbal behavior and speech acts; head and hand movements increased during questioning and context-dependent commentary but decreased during disagreements. Our database includes transcripts, speech acts, and nonverbal data. Future work will train large language models to recognize speech acts in VR. •We coded over 9000 speech acts into 10 categories to study interaction patterns in social VR.•Speech act sequences showed attractor-repellor states and revealed an "echoing" strategy in social VR interactions.•Head and hand movements increased with questions and comments but decreased during disagreements in social VR.
ISSN:0747-5632
DOI:10.1016/j.chb.2025.108691