Guidelines for the Development of Immersive Virtual Reality Software for Cognitive Neuroscience and Neuropsychology: The Development of Virtual Reality Everyday Assessment Lab (VR-EAL), a Neuropsychological Test Battery in Immersive Virtual Reality

Virtual reality (VR) head-mounted displays (HMD) appear to be effective research tools, which may address the problem of ecological validity in neuropsychological testing. However, their widespread implementation is hindered by VR induced symptoms and effects (VRISE) and the lack of skills in VR sof...

Full description

Saved in:
Bibliographic Details
Published in:Frontiers in computer science (Lausanne) Vol. 1; pp. 1 - 24
Main Authors: Kourtesis, Panagiotis, Korre, Danai, Collina, Simona, Doumas, Leonidas A. A., MacPherson, Sarah E.
Format: Journal Article
Language:English
Published: Lausanne: Frontiers Media SA 14.01.2020
Frontiers Media S.A
Subjects:
ISSN:2624-9898, 2624-9898
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Virtual reality (VR) head-mounted displays (HMD) appear to be effective research tools, which may address the problem of ecological validity in neuropsychological testing. However, their widespread implementation is hindered by VR induced symptoms and effects (VRISE) and the lack of skills in VR software development. This study offers guidelines for the development of VR software in cognitive neuroscience and neuropsychology, by describing and discussing the stages of the development of Virtual Reality Everyday Assessment Lab (VR-EAL), the first neuropsychological battery in immersive VR. Techniques for evaluating cognitive functions within a realistic storyline are discussed. The utility of various assets in Unity, software development kits, and other software are described so that cognitive scientists can overcome challenges pertinent to VRISE and the quality of the VR software. In addition, this pilot study attempts to evaluate VR-EAL in accordance with the necessary criteria for VR software for research purposes. The VR neuroscience questionnaire (VRNQ; Kourtesis et al., 2019b) was implemented to appraise the quality of the three versions of VR-EAL in terms of user experience, game mechanics, in-game assistance, and VRISE. Twenty-five participants aged between 20 and 45 years with 12–16 years of full-time education evaluated various versions of VR-EAL. The final version of VR-EAL achieved high scores in every sub-score of the VRNQ and exceeded its parsimonious cut-offs. It also appeared to have better in-game assistance and game mechanics, while its improved graphics substantially increased the quality of the user experience and almost eradicated VRISE. The results substantially support the feasibility of the development of effective VR research and clinical software without the presence of VRISE during a 60-min VR session.
AbstractList Virtual reality (VR) head-mounted displays (HMD) appear to be effective research tools, which may address the problem of ecological validity in neuropsychological testing. However, their widespread implementation is hindered by VR induced symptoms and effects (VRISE) and the lack of skills in VR software development. This study offers guidelines for the development of VR software in cognitive neuroscience and neuropsychology, by describing and discussing the stages of the development of Virtual Reality Everyday Assessment Lab (VR-EAL), the first neuropsychological battery in immersive VR. Techniques for evaluating cognitive functions within a realistic storyline are discussed. The utility of various assets in Unity, software development kits, and other software are described so that cognitive scientists can overcome challenges pertinent to VRISE and the quality of the VR software. In addition, this pilot study attempts to evaluate VR-EAL in accordance with the necessary criteria for VR software for research purposes. The VR neuroscience questionnaire (VRNQ; Kourtesis et al., 2019b) was implemented to appraise the quality of the three versions of VR-EAL in terms of user experience, game mechanics, in-game assistance, and VRISE. Twenty-five participants aged between 20 and 45 years with 12–16 years of full-time education evaluated various versions of VR-EAL. The final version of VR-EAL achieved high scores in every sub-score of the VRNQ and exceeded its parsimonious cut-offs. It also appeared to have better in-game assistance and game mechanics, while its improved graphics substantially increased the quality of the user experience and almost eradicated VRISE. The results substantially support the feasibility of the development of effective VR research and clinical software without the presence of VRISE during a 60-min VR session.
Author Kourtesis, Panagiotis
Doumas, Leonidas A. A.
MacPherson, Sarah E.
Korre, Danai
Collina, Simona
Author_xml – sequence: 1
  givenname: Panagiotis
  surname: Kourtesis
  fullname: Kourtesis, Panagiotis
– sequence: 2
  givenname: Danai
  surname: Korre
  fullname: Korre, Danai
– sequence: 3
  givenname: Simona
  surname: Collina
  fullname: Collina, Simona
– sequence: 4
  givenname: Leonidas A. A.
  surname: Doumas
  fullname: Doumas, Leonidas A. A.
– sequence: 5
  givenname: Sarah E.
  surname: MacPherson
  fullname: MacPherson, Sarah E.
BackLink https://inria.hal.science/hal-03472844$$DView record in HAL
BookMark eNp1ks9v0zAYhiM0JMbYnaOPTCLFv5I43EpXtkoRSKPsGn1xvrSekriy3aL85xxJU4SgaCdbn97nsaXvfR1d9LbHKHrL6EwIlX9otO12M05ZPqOUMv4iuuQpl3GucnXx1_1VdO390xjhCWOJyi6jn3d7U2NrevSksY6ELZJbPGBrdx32gdiGrLoOnTcHJI_GhT205AGhNWEg32wTfoDDiVzYTW_CMfYF9856bbDXSKCvT4OdH_TWtnYzfCTr_185dy8P6IYaBjL3Hr2fYgVU5N3jQ7ycFzfvCZx5jR7xNfpAPkEII01M__zn30QvG2g9Xv8-r6Lvn5frxX1cfL1bLeZFrIVKQiyqTOdVIjNaC4lVgowrzqSiElFzzKpUshqg0VJKJSshmEoUo7JJK0W5aMRVtDp5awtP5c6ZDtxQWjDlNLBuU4ILRrdYjmsCTvOUacWkTiDnmDSUQ4ai1ghidN2cXFto_1Hdz4vyOKNCZlxJeWBjlp6yetyFd9j8ARgtj6Upp9KUx9KUU2lGJD1DtAkQjO2DA9M-D_4CBjvOkg
CitedBy_id crossref_primary_10_3390_psychiatryint6010031
crossref_primary_10_3390_app142110010
crossref_primary_10_1017_S1355617720000764
crossref_primary_10_3390_technologies13080342
crossref_primary_10_1038_s41598_021_93960_9
crossref_primary_10_3390_ijerph20054150
crossref_primary_10_3390_healthcare9101390
crossref_primary_10_7759_cureus_56724
crossref_primary_10_1109_TVCG_2024_3372101
crossref_primary_10_1080_09658211_2021_1904996
crossref_primary_10_3389_fpsyg_2023_1233346
crossref_primary_10_3389_fpsyg_2021_683870
crossref_primary_10_3389_fnagi_2021_756891
crossref_primary_10_1007_s00426_022_01770_z
crossref_primary_10_1007_s11065_023_09586_3
crossref_primary_10_3390_bs13040336
crossref_primary_10_1109_TIM_2023_3292964
crossref_primary_10_3390_app10228172
crossref_primary_10_1145_3664635
crossref_primary_10_3389_fcomp_2022_952996
crossref_primary_10_3758_s13428_022_01990_6
crossref_primary_10_3390_app14104163
crossref_primary_10_3389_fpsyg_2021_640341
crossref_primary_10_1016_j_wneu_2021_05_118
crossref_primary_10_3389_fcomp_2022_927161
crossref_primary_10_3389_fnins_2021_693468
crossref_primary_10_3389_fpsyg_2023_1161932
crossref_primary_10_1016_j_entcom_2025_101013
crossref_primary_10_3389_frvir_2023_1138240
crossref_primary_10_1080_13803395_2021_2021645
crossref_primary_10_3389_frvir_2025_1555111
crossref_primary_10_1080_23279095_2023_2174438
crossref_primary_10_3389_frvir_2021_706653
crossref_primary_10_1007_s12553_024_00935_7
crossref_primary_10_3390_encyclopedia5010008
crossref_primary_10_2196_16724
crossref_primary_10_1080_09602011_2021_2008983
crossref_primary_10_1109_TVCG_2023_3247062
crossref_primary_10_3390_mti8110098
crossref_primary_10_1371_journal_pone_0275119
crossref_primary_10_3390_mti9080076
crossref_primary_10_1002_cav_70059
crossref_primary_10_1177_10525629231225735
crossref_primary_10_3390_mti8010003
crossref_primary_10_1038_s41598_022_07090_x
crossref_primary_10_1080_09602011_2020_1862679
crossref_primary_10_1145_3457950
crossref_primary_10_3390_s24113546
crossref_primary_10_3389_fpsyg_2022_882165
crossref_primary_10_3389_frvir_2021_693399
crossref_primary_10_3389_fpsyg_2022_958458
Cites_doi 10.1007/978-3-319-10368-6_9
10.1111/bjop.12290
10.1162/PRES_a_00226
10.1017/BrImp.2014.14
10.3758/s13423-017-1323-7
10.1016/j.autneu.2016.10.003
10.1038/s41593-018-0210-5
10.1037/0278-7393.29.3.347
10.1016/j.physbeh.2018.04.007
10.1109/SeGAH.2017.7939283
10.1201/b17360-28
10.1201/b17360-7
10.3389/neuro.11.010.2008
10.1016/j.displa.2007.09.005
10.1111/j.1540-5915.2010.00292.x
10.1089/g4h.2017.0114
10.1126/science.3045969
10.1016/j.tics.2014.11.001
10.1111/bjop.12305
10.14464/awic.v3i0.241
10.1016/j.displa.2016.11.001
10.3389/fnhum.2019.00417
10.1023/B:NERV.0000009483.91468.fb
10.1146/annurev-statistics-031017-100307
10.1017/S1355617798466037
10.1162/pres.16.4.337
10.1109/MRA.2012.2192811
10.1007/s10055-015-0274-4
10.1038/nrn3122
10.1145/3057039.3057079
10.1080/09602010343000183
10.1080/09602011.2014.881746
10.3389/fnhum.2015.00660
10.3389/fpsyg.2017.01125
10.1080/13854046.2017.1337932
10.1145/3284398.3284431
10.3758/s13428-011-0168-7
10.1145/3059009.3059013
10.1016/j.ijpsycho.2008.11.008
10.1177/1094428109355485
10.1016/j.yebeh.2013.11.014
10.1016/j.cag.2018.10.006
10.2352/ISSN.2470-1173.2016.4.ERVR-413
10.1098/rstb.2009.0138
10.4135/9781452225913
10.1016/B978-0-12-809324-5.21049-3
10.1016/j.jneumeth.2006.11.017
10.1089/109493101750527042
10.1016/j.physbeh.2015.08.043
10.1145/3102071.3102082
10.3758/s13423-017-1343-3
10.1145/2967934.2968105
10.1093/arclin/acw049
10.1145/2792790
10.1145/3084873.3084900
10.1080/17405629.2016.1259614
10.1002/acp.775
10.1080/09602010802469074
10.3389/fnhum.2019.00342
10.1080/21622965.2013.821652
10.1093/arclin/15.3.185
10.1145/1778765.1778829
10.1017/CBO9781139005036
10.1037/0278-7393.33.4.734
10.3389/fpsyg.2017.00862
10.1177/0963721410386677
10.1093/acrefore/9780190236557.013.381
10.1080/713755570
10.1109/VR.2018.8446194
ContentType Journal Article
Copyright Distributed under a Creative Commons Attribution 4.0 International License
Copyright_xml – notice: Distributed under a Creative Commons Attribution 4.0 International License
DBID AAYXX
CITATION
1XC
VOOES
DOA
DOI 10.3389/fcomp.2019.00012
DatabaseName CrossRef
Hyper Article en Ligne (HAL)
Hyper Article en Ligne (HAL) (Open Access)
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
DatabaseTitleList

Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Open Access Full Text
  url: https://www.doaj.org/
  sourceTypes: Open Website
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
Psychology
EISSN 2624-9898
EndPage 24
ExternalDocumentID oai_doaj_org_article_262a20961c814c5a92e5f02a7e3dcea3
oai:HAL:hal-03472844v1
10_3389_fcomp_2019_00012
GroupedDBID 9T4
AAFWJ
AAYXX
AFPKN
ALMA_UNASSIGNED_HOLDINGS
CITATION
GROUPED_DOAJ
M~E
OK1
1XC
VOOES
ID FETCH-LOGICAL-c385t-3b7c9b5470d34eb5e128214804eec2e7b641daafc44484b331858104f6b8023f3
IEDL.DBID DOA
ISICitedReferencesCount 58
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000705940200001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 2624-9898
IngestDate Fri Oct 03 12:53:06 EDT 2025
Tue Oct 14 20:38:40 EDT 2025
Tue Nov 18 21:10:26 EST 2025
Sat Nov 29 02:11:55 EST 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Keywords cybersickness
episodic memory
virtual reality
prospective memory
neuropsychology
attention
everyday functioning
executive function
Language English
License Distributed under a Creative Commons Attribution 4.0 International License: http://creativecommons.org/licenses/by/4.0
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c385t-3b7c9b5470d34eb5e128214804eec2e7b641daafc44484b331858104f6b8023f3
ORCID 0000-0002-2914-1064
0000-0001-8676-6514
OpenAccessLink https://doaj.org/article/262a20961c814c5a92e5f02a7e3dcea3
PageCount 24
ParticipantIDs doaj_primary_oai_doaj_org_article_262a20961c814c5a92e5f02a7e3dcea3
hal_primary_oai_HAL_hal_03472844v1
crossref_primary_10_3389_fcomp_2019_00012
crossref_citationtrail_10_3389_fcomp_2019_00012
PublicationCentury 2000
PublicationDate 2020-01-14
PublicationDateYYYYMMDD 2020-01-14
PublicationDate_xml – month: 01
  year: 2020
  text: 2020-01-14
  day: 14
PublicationDecade 2020
PublicationTitle Frontiers in computer science (Lausanne)
PublicationYear 2020
Publisher Lausanne: Frontiers Media SA
Frontiers Media S.A
Publisher_xml – name: Lausanne: Frontiers Media SA
– name: Frontiers Media S.A
References Lavoué (B39) 2015
Brade (B6) 2018
Gonzalez-Franco (B23) 2017; 8
Kobayashi (B33) 2015; 24
Kourtesis (B35); 13
B26
Burgess (B8) 1998; 4
Vorländer (B76) 2014
Wilson (B81) 2005
Jerald (B31) 2015
Rumiński (B62) 2015; 19
Held (B27) 2018; 5
Palmisano (B49) 2017; 46
Nalivaiko (B48) 2015; 151
Jansari (B29) 2014; 15
Canty (B9) 2014; 24
Seyama (B64) 2007; 16
Slater (B68) 2018; 109
Wilson (B82) 1998; 8
Bohil (B3) 2011; 12
McDaniel (B44) 2000; 14
Wells (B79) 2010; 41
Frommel (B20) 2017
Higginson (B28) 2000; 15
Kriegeskorte (B37) 2018; 21
Zaidi (B83) 2018
Borrego (B4) 2018; 7
Sharples (B65) 2008; 29
Parsons (B51) 2015; 9
McDaniel (B45) 2007
Korre (B34) 2019
Chaytor (B12) 2003; 13
Parsons (B52) 2018; 32
Brennesholtz (B7) 2018
Rosenberg (B61) 2015; 4
Anderson (B1) 2017; 2
Stevens (B73) 2017; 8
Peirce (B54) 2009; 2
Kourtesis (B36); 13
Grewe (B24) 2014; 31
Wilson (B80) 2008
Sherman (B66) 2018
Marsman (B42) 2017; 14
Culpepper (B14) 2011; 14
Rand (B57) 2009; 19
Revelle (B58) 2011
Gehrke (B22) 2018
Peirce (B53) 2007; 162
Jerald (B32) 2017
Chandra (B11) 2012; 27
de França (B15) 2017
Rizzo (B59) 2004; 14
Makeig (B41) 2009; 73
(B30) 2017
Sejnowski (B63) 1988; 241
Figueiredo (B19) 2018; 77
Wagenmakers (B77); 25
Slater (B69) 2010; 29
Caputo (B10) 2017
Slater (B67) 2009; 364
Dickson (B16) 2017
Pan (B50) 2018; 109
Toschi (B74) 2017; 202
Maister (B40) 2015; 19
Mlinac (B46) 2016; 31
Viirre (B75) 2014
Farrell (B18) 2010; 19
Sportillo (B72) 2017
Porcino (B56) 2017
Smith (B71) 2007; 33
Mathôt (B43) 2012; 44
Smith (B70) 2003; 29
Phillips (B55) 2008
Gavgani (B21) 2018; 191
LaViola (B38) 2017
Robertson (B60) 1994
Mori (B47) 2012; 19
Wagenmakers (B78); 25
Cox (B13) 2011
Gromala (B25) 2016; 2016
Arafat (B2) 2018
Bozgeyikli (B5) 2016
Elkind (B17) 2001; 4
References_xml – start-page: 243
  volume-title: Visual Signal Quality Assessment
  year: 2015
  ident: B39
  article-title: Quality assessment in computer graphics
  doi: 10.1007/978-3-319-10368-6_9
– volume: 109
  start-page: 395
  year: 2018
  ident: B50
  article-title: Why and how to use virtual reality to study human social interaction: the challenges of exploring a new research landscape
  publication-title: Br. J. Psychol.
  doi: 10.1111/bjop.12290
– volume: 24
  start-page: 163
  year: 2015
  ident: B33
  article-title: The effects of spatialized sounds on the sense of presence in auditory virtual environments: a psychological and physiological study
  publication-title: Presence
  doi: 10.1162/PRES_a_00226
– volume: 15
  start-page: 71
  year: 2014
  ident: B29
  article-title: Ecological assessment of executive functions: a new virtual reality paradigm
  publication-title: Brain Imp.
  doi: 10.1017/BrImp.2014.14
– volume: 25
  start-page: 58
  ident: B77
  article-title: Bayesian inference for psychology. Part II: example applications with JASP
  publication-title: Psychon. Bull. Rev.
  doi: 10.3758/s13423-017-1323-7
– volume: 202
  start-page: 108
  year: 2017
  ident: B74
  article-title: Motion sickness increases functional connectivity between visual motion and nausea-associated brain regions
  publication-title: Auton. Neurosci.
  doi: 10.1016/j.autneu.2016.10.003
– volume: 27
  start-page: 178
  year: 2012
  ident: B11
  article-title: A comparison of objective-C and C#: implementing Cbox class
  publication-title: J. Comput. Sci. Coll.
– volume: 21
  start-page: 1148
  year: 2018
  ident: B37
  article-title: Cognitive computational neuroscience
  publication-title: Nat. Neurosci.
  doi: 10.1038/s41593-018-0210-5
– volume: 29
  start-page: 347
  year: 2003
  ident: B70
  article-title: The cost of remembering to remember in event-based prospective memory: investigating the capacity demands of delayed intention performance
  publication-title: Journal of Experimental Psychology: Learning, Memory, and Cognition
  doi: 10.1037/0278-7393.29.3.347
– volume: 191
  start-page: 56
  year: 2018
  ident: B21
  article-title: Cybersickness-related changes in brain hemodynamics: a pilot study comparing transcranial Doppler and near-infrared spectroscopy assessments during a virtual ride on a roller coaster
  publication-title: Physiol. Behav.
  doi: 10.1016/j.physbeh.2018.04.007
– start-page: 1
  volume-title: Serious Games and Applications for Health (SeGAH), 2017 IEEE 5th International Conference on
  year: 2017
  ident: B56
  article-title: Minimizing cyber sickness in head mounted display systems: design guidelines and applications
  doi: 10.1109/SeGAH.2017.7939283
– start-page: 527
  volume-title: Handbook of Virtual Environments
  year: 2014
  ident: B75
  article-title: Direct effects of virtual environments on users
  doi: 10.1201/b17360-28
– start-page: 107
  volume-title: Handbook of Virtual Environments
  year: 2014
  ident: B76
  article-title: Virtual auditory displays
  doi: 10.1201/b17360-7
– volume: 2
  start-page: 10
  year: 2009
  ident: B54
  article-title: Generating stimuli for neuroscience using PsychoPy
  publication-title: Front. Neuroinf.
  doi: 10.3389/neuro.11.010.2008
– volume: 29
  start-page: 58
  year: 2008
  ident: B65
  article-title: Virtual reality induced symptoms and effects (VRISE): comparison of head mounted display (HMD), desktop and projection display systems
  publication-title: Displays
  doi: 10.1016/j.displa.2007.09.005
– volume: 41
  start-page: 813
  year: 2010
  ident: B79
  article-title: The effect of perceived novelty on the adoption of information technology innovations: a risk/reward perspective
  publication-title: Dec. Sci.
  doi: 10.1111/j.1540-5915.2010.00292.x
– volume: 7
  start-page: 151
  year: 2018
  ident: B4
  article-title: Comparison of oculus rift and HTC vive: feasibility for virtual reality-based exploration, navigation, exergaming, and rehabilitation
  publication-title: Games Health J.
  doi: 10.1089/g4h.2017.0114
– volume-title: 3D User Interfaces: Theory and Practice
  year: 2017
  ident: B38
– volume: 241
  start-page: 1299
  year: 1988
  ident: B63
  article-title: Computational neuroscience
  publication-title: Science
  doi: 10.1126/science.3045969
– volume: 19
  start-page: 6
  year: 2015
  ident: B40
  article-title: Changing bodies changes minds: owning another body affects social cognition
  publication-title: Trends Cogn. Sci.
  doi: 10.1016/j.tics.2014.11.001
– start-page: 3
  volume-title: International Conference on Applied Human Factors and Ergonomics
  year: 2017
  ident: B10
  article-title: A preventive ergonomic approach based on virtual and immersive reality
– volume: 109
  start-page: 431
  year: 2018
  ident: B68
  article-title: Immersion and the illusion of presence in virtual reality
  publication-title: Br. J. Psychol.
  doi: 10.1111/bjop.12305
– start-page: 161
  volume-title: Prospective Memory: Cognitive, Neuroscience, Developmental, and Applied Perspectives
  year: 2008
  ident: B55
  article-title: Adult aging and prospective memory: the importance of ecological validity
– volume-title: An Overview of the Psych Package
  year: 2011
  ident: B58
– volume-title: AW&I Conference
  year: 2018
  ident: B6
  article-title: Using virtual prototyping technologies to evaluate human-machine-interaction concepts
  doi: 10.14464/awic.v3i0.241
– volume: 46
  start-page: 1
  year: 2017
  ident: B49
  article-title: Vection and cybersickness generated by head-and-display motion in the Oculus Rift
  publication-title: Displays
  doi: 10.1016/j.displa.2016.11.001
– volume: 13
  start-page: 417
  ident: B36
  article-title: Validation of the virtual reality neuroscience questionnaire: maximum duration of immersive virtual reality sessions without the presence of pertinent adverse symptomatology
  publication-title: Front. Hum. Neurosci.
  doi: 10.3389/fnhum.2019.00417
– volume-title: The Cambridge Prospective Memory Test: CAMPROMPT
  year: 2005
  ident: B81
– volume: 13
  start-page: 181
  year: 2003
  ident: B12
  article-title: The ecological validity of neuropsychological tests: a review of the literature on everyday cognitive skills
  publication-title: Neuropsychol. Rev.
  doi: 10.1023/B:NERV.0000009483.91468.fb
– volume: 5
  start-page: 393
  year: 2018
  ident: B27
  article-title: On p-values and Bayes factors
  publication-title: Ann. Rev. Stat. Appl.
  doi: 10.1146/annurev-statistics-031017-100307
– volume: 4
  start-page: 547
  year: 1998
  ident: B8
  article-title: The ecological validity of tests of executive function
  publication-title: J. Int. Neuropsychol. Soc.
  doi: 10.1017/S1355617798466037
– volume: 16
  start-page: 337
  year: 2007
  ident: B64
  article-title: The uncanny valley: effect of realism on the impression of artificial human faces
  publication-title: Presence
  doi: 10.1162/pres.16.4.337
– volume: 19
  start-page: 98
  year: 2012
  ident: B47
  article-title: The uncanny valley [from the field]
  publication-title: IEEE Robot. Automat. Mag.
  doi: 10.1109/MRA.2012.2192811
– start-page: 293
  volume-title: German Conference on Spatial Cognition
  year: 2018
  ident: B22
  article-title: The invisible maze task (IMT): interactive exploration of sparse virtual environments to investigate action-driven formation of spatial representations
– volume: 19
  start-page: 223
  year: 2015
  ident: B62
  article-title: An experimental study of spatial sound usefulness in searching and navigating through AR environments
  publication-title: Virt. Real.
  doi: 10.1007/s10055-015-0274-4
– volume: 12
  start-page: 752
  year: 2011
  ident: B3
  article-title: Virtual reality in neuroscience research and therapy
  publication-title: Nat. Rev. Neurosci.
  doi: 10.1038/nrn3122
– start-page: 6
  volume-title: Proceedings of the 9th International Conference on Computer and Automation Engineering
  year: 2017
  ident: B72
  article-title: An immersive Virtual Reality system for semi-autonomous driving simulation: a comparison between realistic and 6-DoF controller-based interaction
  doi: 10.1145/3057039.3057079
– volume: 14
  start-page: 207
  year: 2004
  ident: B59
  article-title: Analysis of assets for virtual reality applications in neuropsychology
  publication-title: Neuropsychol. Rehab.
  doi: 10.1080/09602010343000183
– volume: 24
  start-page: 238
  year: 2014
  ident: B9
  article-title: Evaluation of a virtual reality prospective memory task for use with individuals with severe traumatic brain injury
  publication-title: Neuropsychol. Rehab.
  doi: 10.1080/09602011.2014.881746
– volume: 9
  start-page: 660
  year: 2015
  ident: B51
  article-title: Virtual reality for enhanced ecological validity and experimental control in the clinical, affective and social neurosciences
  publication-title: Front. Hum. Neurosci.
  doi: 10.3389/fnhum.2015.00660
– volume-title: The Rivermead Behavioural Memory Test
  year: 2008
  ident: B80
– volume: 8
  start-page: 1125
  year: 2017
  ident: B23
  article-title: Model of illusions and virtual reality
  publication-title: Front. Psychol.
  doi: 10.3389/fpsyg.2017.01125
– volume: 32
  start-page: 16
  year: 2018
  ident: B52
  article-title: Practice parameters facilitating adoption of advanced technologies for enhancing neuropsychological assessment paradigms
  publication-title: Clin. Neuropsychol.
  doi: 10.1080/13854046.2017.1337932
– start-page: 13
  volume-title: Proceedings of the 16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
  year: 2018
  ident: B83
  article-title: Conceptual framework for the usability evaluation of gamified virtual reality environment for non-gamers
  doi: 10.1145/3284398.3284431
– volume: 44
  start-page: 314
  year: 2012
  ident: B43
  article-title: OpenSesame: an open-source, graphical experiment builder for the social sciences
  publication-title: Behav. Res. Methods
  doi: 10.3758/s13428-011-0168-7
– volume-title: JASP (Version 0.8.1.2)
  year: 2017
  ident: B30
– start-page: 70
  volume-title: Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education
  year: 2017
  ident: B16
  article-title: An experience-based comparison of unity and unreal for a stand-alone 3D game development course
  doi: 10.1145/3059009.3059013
– volume: 73
  start-page: 95
  year: 2009
  ident: B41
  article-title: Linking brain, mind and behavior
  publication-title: Int. J. Psychophysiol.
  doi: 10.1016/j.ijpsycho.2008.11.008
– volume-title: The Test of Everyday Attention (TEA)
  year: 1994
  ident: B60
– volume: 14
  start-page: 735
  year: 2011
  ident: B14
  article-title: R is for revolution: a cutting-edge, free, open source statistical package
  publication-title: Org. Res. Methods
  doi: 10.1177/1094428109355485
– volume: 31
  start-page: 57
  year: 2014
  ident: B24
  article-title: Real-life memory and spatial navigation in patients with focal epilepsy: ecological validity of a virtual reality supermarket task
  publication-title: Epilepsy Behav.
  doi: 10.1016/j.yebeh.2013.11.014
– volume: 77
  start-page: 108
  year: 2018
  ident: B19
  article-title: A comparative evaluation of direct hand and wand interactions on consumer devices
  publication-title: Comput. Graphics
  doi: 10.1016/j.cag.2018.10.006
– volume: 2016
  start-page: 1
  year: 2016
  ident: B25
  article-title: Mobius floe: an immersive virtual reality game for pain distraction
  publication-title: Electr. Imaging
  doi: 10.2352/ISSN.2470-1173.2016.4.ERVR-413
– volume: 364
  start-page: 3549
  year: 2009
  ident: B67
  article-title: Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments
  publication-title: Philos. Trans. R. Soc. B
  doi: 10.1098/rstb.2009.0138
– volume-title: Prospective Memory: An Overview and Synthesis of an Emerging Field.
  year: 2007
  ident: B45
  doi: 10.4135/9781452225913
– volume: 2
  start-page: 451
  year: 2017
  ident: B1
  article-title: Remembering to remember: an examination of the cognitive processes underlying prospective memory
  publication-title: Learn. Mem.
  doi: 10.1016/B978-0-12-809324-5.21049-3
– volume: 162
  start-page: 8
  year: 2007
  ident: B53
  article-title: PsychoPy–psychophysics software in Python
  publication-title: J. Neurosci. Methods
  doi: 10.1016/j.jneumeth.2006.11.017
– volume-title: Understanding Virtual Reality: Interface, Application, and Design
  year: 2018
  ident: B66
– volume: 4
  start-page: 489
  year: 2001
  ident: B17
  article-title: A simulated reality scenario compared with the computerized Wisconsin card sorting test: an analysis of preliminary results
  publication-title: CyberPsychol. Behav.
  doi: 10.1089/109493101750527042
– volume: 151
  start-page: 583
  year: 2015
  ident: B48
  article-title: Cybersickness provoked by head-mounted display affects cutaneous vascular tone, heart rate and reaction time
  publication-title: Physiol. Behav.
  doi: 10.1016/j.physbeh.2015.08.043
– start-page: 30
  volume-title: Proceedings of the 12th International Conference on the Foundations of Digital Games
  year: 2017
  ident: B20
  article-title: Effects of controller-based locomotion on player experience in a virtual reality exploration game
  doi: 10.1145/3102071.3102082
– start-page: 1
  volume-title: SID Symposium Digest of Technical Papers
  year: 2018
  ident: B7
  article-title: 3-1: invited paper: vr standards and guidelines
– volume: 25
  start-page: 35
  ident: B78
  article-title: Bayesian inference for psychology. Part I: theoretical advantages and practical ramifications
  publication-title: Psychon. Bull. Rev.
  doi: 10.3758/s13423-017-1343-3
– start-page: 205
  volume-title: Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play
  year: 2016
  ident: B5
  article-title: Point and teleport locomotion technique for virtual reality
  doi: 10.1145/2967934.2968105
– start-page: 52
  volume-title: International Conference on Applied Human Factors and Ergonomics
  year: 2017
  ident: B15
  article-title: Review of virtual reality technology: an ergonomic approach and current challenges
– volume: 31
  start-page: 506
  year: 2016
  ident: B46
  article-title: Assessment of activities of daily living, self-care, and independence
  publication-title: Arch. Clin. Neuropsychol.
  doi: 10.1093/arclin/acw049
– volume-title: The VR Book: Human-Centered Design for Virtual Reality
  year: 2015
  ident: B31
  doi: 10.1145/2792790
– start-page: 19
  volume-title: ACM SIGGRAPH 2017 Courses
  year: 2017
  ident: B32
  article-title: VR interactions
  doi: 10.1145/3084873.3084900
– volume: 14
  start-page: 545
  year: 2017
  ident: B42
  article-title: Bayesian benefits with JASP
  publication-title: Euro. J. Dev. Psychol.
  doi: 10.1080/17405629.2016.1259614
– volume: 14
  start-page: S127
  year: 2000
  ident: B44
  article-title: Strategic and automatic processes in prospective memory retrieval: a multiprocess framework
  publication-title: Appl. Cogn. Psychol.
  doi: 10.1002/acp.775
– volume: 19
  start-page: 583
  year: 2009
  ident: B57
  article-title: Validation of the Virtual MET as an assessment tool for executive functions
  publication-title: Neuropsychol. Rehab.
  doi: 10.1080/09602010802469074
– volume-title: Usability evaluation of spoken humanoid embodied conversational agents in mobile serious games
  year: 2019
  ident: B34
– volume: 13
  start-page: 342
  ident: B35
  article-title: Technological competence is a precondition for effective implementation of virtual reality head mounted displays in human neuroscience: a technological review and meta-analysis
  publication-title: Front. Hum. Neurosci.
  doi: 10.3389/fnhum.2019.00342
– volume: 4
  start-page: 148
  year: 2015
  ident: B61
  article-title: The associations between executive functions' capacities, performance process skills, and dimensions of participation in activities of daily life among children of elementary school age
  publication-title: Appl. Neuropsychol.
  doi: 10.1080/21622965.2013.821652
– volume: 15
  start-page: 185
  year: 2000
  ident: B28
  article-title: The ecological validity of clinical tests of memory and attention in multiple sclerosis
  publication-title: Arch. Clin. Neuropsychol.
  doi: 10.1093/arclin/15.3.185
– volume: 29
  start-page: 92
  year: 2010
  ident: B69
  article-title: Simulating virtual environments within virtual environments as the basis for a psychophysics of presence
  publication-title: ACM Trans. Graphics
  doi: 10.1145/1778765.1778829
– volume-title: Principles of Applied Statistics
  year: 2011
  ident: B13
  doi: 10.1017/CBO9781139005036
– volume: 33
  start-page: 734
  year: 2007
  ident: B71
  article-title: The cost of event-based prospective memory: Salient target events
  publication-title: J. Exp. Psychol.
  doi: 10.1037/0278-7393.33.4.734
– volume: 8
  start-page: 862
  year: 2017
  ident: B73
  article-title: Replicability and reproducibility in comparative psychology
  publication-title: Front. Psychol.
  doi: 10.3389/fpsyg.2017.00862
– volume: 19
  start-page: 329
  year: 2010
  ident: B18
  article-title: Computational models as aids to better reasoning in psychology
  publication-title: Curr. Dir. Psychol. Sci.
  doi: 10.1177/0963721410386677
– ident: B26
  doi: 10.1093/acrefore/9780190236557.013.381
– volume: 8
  start-page: 213
  year: 1998
  ident: B82
  article-title: The development of an ecologically valid test for assessing patients with a dysexecutive syndrome
  publication-title: Neuropsychol. Rehab.
  doi: 10.1080/713755570
– start-page: 1
  volume-title: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)
  year: 2018
  ident: B2
  article-title: Cybersickness-provoking virtual reality alters brain signals of persons with multiple sclerosis
  doi: 10.1109/VR.2018.8446194
SSID ssj0002511587
Score 2.4397357
Snippet Virtual reality (VR) head-mounted displays (HMD) appear to be effective research tools, which may address the problem of ecological validity in...
SourceID doaj
hal
crossref
SourceType Open Website
Open Access Repository
Enrichment Source
Index Database
StartPage 1
SubjectTerms Cognitive science
Computer Science
cybersickness
episodic memory
executive function
Human-Computer Interaction
neuropsychology
Neuroscience
prospective memory
Psychology
virtual reality
Title Guidelines for the Development of Immersive Virtual Reality Software for Cognitive Neuroscience and Neuropsychology: The Development of Virtual Reality Everyday Assessment Lab (VR-EAL), a Neuropsychological Test Battery in Immersive Virtual Reality
URI https://inria.hal.science/hal-03472844
https://doaj.org/article/262a20961c814c5a92e5f02a7e3dcea3
Volume 1
WOSCitedRecordID wos000705940200001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAON
  databaseName: DOAJ Open Access Full Text
  customDbUrl:
  eissn: 2624-9898
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0002511587
  issn: 2624-9898
  databaseCode: DOA
  dateStart: 20190101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 2624-9898
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0002511587
  issn: 2624-9898
  databaseCode: M~E
  dateStart: 20190101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1LbxMxELZQxYELb0SgoBHiQCVW2bW9sZdbqFKKFCJUQtXbyk8RCW2rkLbKhd_NkRnvbkiLgAuXPVh-aWfs-cYef8PYS40o1aEhzQQ3LpPaFZkNPmZG6Zx7LqMX6aHwVM1m-uSk-riV6otiwlp64PbHDfmIG055SZwupCtNxUMZc25UEN4Fk3g-c1VtOVO0BxNwLrVq7yXRC6uGkUK0KZSL-Cnzgl-xQ4muH63Ll_40NVmXg7vsdgcLYdxO5x67EZr77E6fcgG6FfiA_Xh3TrxUFKsOCDcB4Rtsxf3AaYT36SgaNzE4XizpdQgchQS24RNuuZdmGVLL_T5uCGa_KC0DmMa3BWf9zrh-A_PfR7ne9wSXxNqbNYw3VJ8wNRZeHR9lk_F07zWYa_2SdsAcjRK0HJ9rWDR_nvxD9vlgMt8_zLrkDZkTulxlwipX2VKq3AsZbBnQEHL0vXIZguNB2ZEsvDHRSXQQpRX0ilujbxhHljjponjEdprTJjxmUEXrtBcqVsRaake21JUOXiNyjSJ4M2DDXpS165jNKcHG1xo9HBJ-nYRfk_Dby_YB29u0OGtZPf5S9y1px6Ye8XGnAtTSutPS-l9aOmAvULeu9HE4ntZUlgupECPIi-LJ_xjpKbvF6UggL7JC7rKd1fI8PGM33cVq8W35PK0S_H74PvkJj5gdhA
linkProvider Directory of Open Access Journals
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Guidelines+for+the+Development+of+Immersive+Virtual+Reality+Software+for+Cognitive+Neuroscience+and+Neuropsychology%3A+The+Development+of+Virtual+Reality+Everyday+Assessment+Lab+%28VR-EAL%29%2C+a+Neuropsychological+Test+Battery+in+Immersive+Virtual+Reality&rft.jtitle=Frontiers+in+computer+science+%28Lausanne%29&rft.au=Kourtesis%2C+Panagiotis&rft.au=Korre%2C+Danai&rft.au=Collina%2C+Simona&rft.au=Doumas%2C+Leonidas+A.+A.&rft.date=2020-01-14&rft.issn=2624-9898&rft.eissn=2624-9898&rft.volume=1&rft_id=info:doi/10.3389%2Ffcomp.2019.00012&rft.externalDBID=n%2Fa&rft.externalDocID=10_3389_fcomp_2019_00012
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2624-9898&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2624-9898&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2624-9898&client=summon