Conversational dynamics in social virtual reality: A large-scale, longitudinal study of speech acts and nonverbal behavior

This study explores verbal interactions in social virtual reality (VR). We developed the Virtual Reality Interaction Dynamics Scheme (VRIDS), which includes 10 speech acts (e.g., questioning, opinions, disagreements) by integrating existing speech frameworks with new constructs from our data. Analyz...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Computers in human behavior Ročník 170; s. 108691
Hlavní autoři: Santoso, Monique, Wang, Portia, Han, Eugy, Bailenson, Jeremy N.
Médium: Journal Article
Jazyk:angličtina
Vydáno: Elsevier Ltd 01.09.2025
Témata:
Behavioral dynamics
Context
Nonverbal communication
Social virtual reality
Speech acts
Speech acts
Context
Social virtual reality
Nonverbal communication
Behavioral dynamics
ISSN:0747-5632
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:This study explores verbal interactions in social virtual reality (VR). We developed the Virtual Reality Interaction Dynamics Scheme (VRIDS), which includes 10 speech acts (e.g., questioning, opinions, disagreements) by integrating existing speech frameworks with new constructs from our data. Analyzing speech from 109 participants in a metaverse classroom over four weeks, we coded 9738 discourse units. VRIDS introduced new constructs like context-dependent commentary on virtual objects, which increased as users became more familiar with the technology over time. Idea sharing also increased over time, indicating enhanced collaboration. We identified attractor and repeller states through speech act sequences and an “echoing” strategy. Additionally, we examined the link between nonverbal behavior and speech acts; head and hand movements increased during questioning and context-dependent commentary but decreased during disagreements. Our database includes transcripts, speech acts, and nonverbal data. Future work will train large language models to recognize speech acts in VR. •We coded over 9000 speech acts into 10 categories to study interaction patterns in social VR.•Speech act sequences showed attractor-repellor states and revealed an "echoing" strategy in social VR interactions.•Head and hand movements increased with questions and comments but decreased during disagreements in social VR.
ISSN:0747-5632
DOI:10.1016/j.chb.2025.108691