A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality

Over the years, the various mediums available for storytelling have progressively expanded, from spoken to written word, then to film, and now to Virtual Reality (VR) and Augmented Reality (AR). In 2016, the cutting-edge Head-Mounted Display (HMD) AR Microsoft HoloLens was released. However, though...

Full description

Saved in:
Bibliographic Details
Published in:Multimedia tools and applications Vol. 81; no. 4; pp. 5795 - 5826
Main Authors: Jin, Yunshui, Ma, Minhua, Zhu, Yongning
Format: Journal Article
Language:English
Published: New York Springer US 01.02.2022
Springer Nature B.V
Subjects:
Augmented reality
Computer Communication Networks
Computer Science
Data Structures and Information Theory
Graphical user interface
Helmet mounted displays
Multimedia Information Systems
Special Purpose and Application-Based Systems
User experience
User interface
Virtual reality
Augmented Reality (AR)
Natural User Interface (NUI)
Interactive narrative
Game experience
Presence
Head Mounted Display (HMD)
HoloLens
Narrative engagement
ISSN:1380-7501, 1573-7721
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Over the years, the various mediums available for storytelling have progressively expanded, from spoken to written word, then to film, and now to Virtual Reality (VR) and Augmented Reality (AR). In 2016, the cutting-edge Head-Mounted Display (HMD) AR Microsoft HoloLens was released. However, though it has been several years, the quality of the user experience with narration using HMD-based AR technology has been rarely discussed. The present study explored interactive narrative in HMD-based AR regarding different user interfaces and their influence on users’ presence, narrative engagement and reflection. Inspired by an existing exhibition at the National Holocaust Centre and Museum in the U.K., a HoloLens narrative application, entitled The AR Journey, was developed by the authors using two different interaction methods, Natural User Interface (NUI) and Graphical User Interface (GUI), which were used to perform an empirical study. As revealed from the results of the between-subject design experiment, NUI exhibited statistically significant advantages in creating presence for users without 3D Role Playing Game (RPG) experience, and GUI was superior in creating presence and increasing narrative engagement for users with 3D RPG experience. As indicated by the results of the interviews, the overall narrative experience in HMD-based AR was acceptable, and the branching narrative design was engaging. However, HoloLens hardware issues, as well as virtuality and reality mismatch, adversely affected user experience. Design guidelines were proposed according to the qualitative results.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
ISSN:1380-7501
1573-7721
DOI:10.1007/s11042-021-11723-0