UX Evaluation with Standardized Questionnaires in Ubiquitous Computing and Ambient Intelligence: A Systematic Literature Review

Background. Standardized questionnaires are well-known, reliable, and inexpensive instruments to evaluate user experience (UX). Although the structure, content, and application procedure of the three most recognized questionnaires (AttrakDiff, UEQ, and meCUE) are known, there is no systematic litera...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Advances in human-computer interaction Ročník 2021; s. 1 - 22
Hlavní autori: Díaz-Oreiro, Ignacio, López, Gustavo, Quesada, Luis, Guerrero, Luis A.
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: New York Hindawi 2021
John Wiley & Sons, Inc
Wiley
Predmet:
ISSN:1687-5893, 1687-5907
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Abstract Background. Standardized questionnaires are well-known, reliable, and inexpensive instruments to evaluate user experience (UX). Although the structure, content, and application procedure of the three most recognized questionnaires (AttrakDiff, UEQ, and meCUE) are known, there is no systematic literature review (SLR) that classifies how these questionnaires have been used in primary studies reported academically. This SLR seeks to answer five research questions (RQs), starting with identifying the uses of each questionnaire over the years and by geographic region (RQ1) and the median number of participants per study (how many participants is considered enough when evaluating UX?) (RQ2). This work also aims to establish whether these questionnaires are combined with other evaluation instruments and with which complementary instruments are they used more frequently (RQ3). In addition, this review intends to determine how the three questionnaires have been applied in the fields of ubiquitous computing and ambient intelligence (RQ4) and also in studies that incorporate nontraditional interfaces, such as haptic, gesture, or speech interfaces, to name a few (RQ5). Methods. A systematic literature review was conducted starting from 946 studies retrieved from four digital databases. The main inclusion criteria being the study describes a primary study reported academically, where the standardized questionnaire is used as a UX evaluation instrument in its original and complete form. In the first phase, 189 studies were discarded by screening the title, abstract, and keyword list. In the second phase, 757 studies were full-text reviewed, and 209 were discarded due to the inclusion/exclusion criteria. The 548 resulting studies were analyzed in detail. Results. AttrakDiff is the questionnaire that counts the most uses since 2006, when the first studies appeared. However, since 2017, UEQ has far surpassed AttrakDiff in uses per year. The contribution of meCUE is still minimal. Europe is the region with the most extended use, followed by Asia. Within Europe, Germany greatly exceeds the rest of countries (RQ1). The median number of participants per study is 20, considering the aggregated data from the three questionnaires. However, this median rises to 30 participants in journal studies while it stays in 20 in conference studies (RQ2). Almost 4 in 10 studies apply the questionnaire as the only evaluation instrument. The remaining studies used between one and five complementary instruments, among which the System Usability Scale (SUS) stands out (RQ3). About 1 in 4 studies analyzed belong to ubiquitous computing and ambient intelligence fields, in which UEQ increases the percentage of uses when compared to its general percentage, particularly in topics such as IoT and wearable interfaces. However, AttrakDiff remains the predominant questionnaire for studies in smart cities and homes and in-vehicle information systems (RQ4). Around 1 in 3 studies include nontraditional interfaces, being virtual reality and gesture interfaces the most numerous. Percentages of UEQ and meCUE uses in these studies are higher than their respective global percentages, particularly in studies using virtual reality and eye tracking interfaces. AttrakDiff maintains its overall percentage in studies with tangible and gesture interfaces and exceeds it in studies with nontraditional visual interfaces, such as displays in windshields or motorcycle helmets (RQ5).
AbstractList Background. Standardized questionnaires are well-known, reliable, and inexpensive instruments to evaluate user experience (UX). Although the structure, content, and application procedure of the three most recognized questionnaires (AttrakDiff, UEQ, and meCUE) are known, there is no systematic literature review (SLR) that classifies how these questionnaires have been used in primary studies reported academically. This SLR seeks to answer five research questions (RQs), starting with identifying the uses of each questionnaire over the years and by geographic region (RQ1) and the median number of participants per study (how many participants is considered enough when evaluating UX?) (RQ2). This work also aims to establish whether these questionnaires are combined with other evaluation instruments and with which complementary instruments are they used more frequently (RQ3). In addition, this review intends to determine how the three questionnaires have been applied in the fields of ubiquitous computing and ambient intelligence (RQ4) and also in studies that incorporate nontraditional interfaces, such as haptic, gesture, or speech interfaces, to name a few (RQ5). Methods. A systematic literature review was conducted starting from 946 studies retrieved from four digital databases. The main inclusion criteria being the study describes a primary study reported academically, where the standardized questionnaire is used as a UX evaluation instrument in its original and complete form. In the first phase, 189 studies were discarded by screening the title, abstract, and keyword list. In the second phase, 757 studies were full-text reviewed, and 209 were discarded due to the inclusion/exclusion criteria. The 548 resulting studies were analyzed in detail. Results. AttrakDiff is the questionnaire that counts the most uses since 2006, when the first studies appeared. However, since 2017, UEQ has far surpassed AttrakDiff in uses per year. The contribution of meCUE is still minimal. Europe is the region with the most extended use, followed by Asia. Within Europe, Germany greatly exceeds the rest of countries (RQ1). The median number of participants per study is 20, considering the aggregated data from the three questionnaires. However, this median rises to 30 participants in journal studies while it stays in 20 in conference studies (RQ2). Almost 4 in 10 studies apply the questionnaire as the only evaluation instrument. The remaining studies used between one and five complementary instruments, among which the System Usability Scale (SUS) stands out (RQ3). About 1 in 4 studies analyzed belong to ubiquitous computing and ambient intelligence fields, in which UEQ increases the percentage of uses when compared to its general percentage, particularly in topics such as IoT and wearable interfaces. However, AttrakDiff remains the predominant questionnaire for studies in smart cities and homes and in-vehicle information systems (RQ4). Around 1 in 3 studies include nontraditional interfaces, being virtual reality and gesture interfaces the most numerous. Percentages of UEQ and meCUE uses in these studies are higher than their respective global percentages, particularly in studies using virtual reality and eye tracking interfaces. AttrakDiff maintains its overall percentage in studies with tangible and gesture interfaces and exceeds it in studies with nontraditional visual interfaces, such as displays in windshields or motorcycle helmets (RQ5).
Audience Academic
Author Díaz-Oreiro, Ignacio
Quesada, Luis
Guerrero, Luis A.
López, Gustavo
Author_xml – sequence: 1
  givenname: Ignacio
  orcidid: 0000-0002-4760-8705
  surname: Díaz-Oreiro
  fullname: Díaz-Oreiro, Ignacio
  organization: Information and Communication Technologies Research CenterUniversity of Costa RicaSan José 11501-2060Costa Ricaucr.ac.cr
– sequence: 2
  givenname: Gustavo
  orcidid: 0000-0003-0510-8857
  surname: López
  fullname: López, Gustavo
  organization: Information and Communication Technologies Research CenterUniversity of Costa RicaSan José 11501-2060Costa Ricaucr.ac.cr
– sequence: 3
  givenname: Luis
  orcidid: 0000-0002-5612-0699
  surname: Quesada
  fullname: Quesada, Luis
  organization: School of Computer Science and InformaticsUniversity of Costa RicaSan José 11501-2060Costa Ricaucr.ac.cr
– sequence: 4
  givenname: Luis A.
  orcidid: 0000-0003-3989-979X
  surname: Guerrero
  fullname: Guerrero, Luis A.
  organization: School of Computer Science and InformaticsUniversity of Costa RicaSan José 11501-2060Costa Ricaucr.ac.cr
BookMark eNqNkkFvEzEQhVeoSLSFGz_AEicEadf22uvlFkUFIkVCNFTiZnntcepo401tb0O58NdxmgINgoJ8sGW_98149I6KA997KIrnuDzBmLFTUhJ8yhgWNSGPikPMRT1iTVkf_DiLhj4pjmJcliWvCGaHxbeLz-jsWnWDSq73aOPSJZon5Y0Kxn0Fgz4OELdPXrkAETmPLlp3NbjUDxFN-tV6SM4vUHag8ap14BOa-gRd5xbgNbxBYzS_iQlWuYBGM5cgqDQEQOdw7WDztHhsVRfh2d1-XFy8Pfs0eT-afXg3nYxnI80ZTSNqOBNVReq2bg0nWBhMQTCjDNSc5r8zwW1Lqqamum6sUJpVRGDS1EAVtpYeF9Md1_RqKdfBrVS4kb1y8vaiDwupQu6wA2msFZwxq3ipq7YFQVutBRCDLQNaVpn1Ysdah_5qOx657Ifgc_uSMFI3Ik9X_FItVIY6b_sUlF65qOWYN7wpK8H4wypR0ZoSsWWd_EGVl4GV0zkE1uX7Pez_Ge5VeLlnyJoEX9JCDTHK6fx8H_5P7T3u651Whz7GAPbn7HEpt6GV29DKu9BmOflNrl26jWbu33V_M73amS5dzu3GPVziOzlj-e4
CitedBy_id crossref_primary_10_1007_s12650_024_01012_x
crossref_primary_10_1080_10919392_2024_2398882
crossref_primary_10_3389_fcomp_2024_1368860
crossref_primary_10_1016_j_scico_2025_103319
crossref_primary_10_1016_j_ijhcs_2024_103312
crossref_primary_10_1080_10447318_2025_2489753
crossref_primary_10_1016_j_trpro_2025_03_070
crossref_primary_10_2196_66582
crossref_primary_10_3390_ijerph182111507
crossref_primary_10_3390_s22124538
crossref_primary_10_1016_j_iot_2025_101649
crossref_primary_10_3390_technologies9020041
crossref_primary_10_1007_s10209_025_01226_2
crossref_primary_10_1145_3710980
crossref_primary_10_1109_RITA_2024_3466171
Cites_doi 10.1145/3121283.3121288
10.1016/j.tele.2004.11.001
10.1038/scientificamerican0991-94
10.3233/AIS-180508
10.1007/978-1-4419-1428-6
10.1007/978-3-540-89350-9_6
10.1007/978-3-319-58634-2_37
10.1007/978-3-319-21380-4_57
10.1109/ACCESS.2018.2817022
10.1037/h0055737
10.1207/S15327590IJHC1304_07
10.1007/1-4020-2967-5_4
10.1080/00207590701396674
10.1007/978-3-319-07668-3_37
10.1109/TVCG.2013.31
10.21307/ijssis-2017-283
10.1007/0-387-22991-4_1
10.1007/b138670
10.1016/j.chb.2014.10.048
10.1016/j.ijhcs.2018.08.008
ContentType Journal Article
Copyright Copyright © 2021 Ignacio Díaz-Oreiro et al.
COPYRIGHT 2021 John Wiley & Sons, Inc.
Copyright © 2021 Ignacio Díaz-Oreiro et al. This is an open access article distributed under the Creative Commons Attribution License (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. https://creativecommons.org/licenses/by/4.0
Copyright_xml – notice: Copyright © 2021 Ignacio Díaz-Oreiro et al.
– notice: COPYRIGHT 2021 John Wiley & Sons, Inc.
– notice: Copyright © 2021 Ignacio Díaz-Oreiro et al. This is an open access article distributed under the Creative Commons Attribution License (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. https://creativecommons.org/licenses/by/4.0
DBID RHU
RHW
RHX
AAYXX
CITATION
ISR
3V.
7QO
7SC
7TK
7XB
8AL
8FD
8FE
8FG
8FH
8FK
ABUWG
AFKRA
ARAPS
AZQEC
BBNVY
BENPR
BGLVJ
BHPHI
CCPQU
CWDGH
DWQXO
FR3
GNUQQ
HCIFZ
JQ2
K7-
L7M
LK8
L~C
L~D
M0N
M7P
P5Z
P62
P64
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PSYQQ
Q9U
DOA
DOI 10.1155/2021/5518722
DatabaseName Hindawi Publishing Complete
Hindawi Publishing Subscription Journals
Hindawi Publishing Open Access
CrossRef
Gale In Context: Science
ProQuest Central (Corporate)
Biotechnology Research Abstracts
Computer and Information Systems Abstracts
Neurosciences Abstracts
ProQuest Central (purchase pre-March 2016)
Computing Database (Alumni Edition)
Technology Research Database
ProQuest SciTech Collection
ProQuest Technology Collection
ProQuest Natural Science Journals
ProQuest Central (Alumni) (purchase pre-March 2016)
ProQuest Central (Alumni)
ProQuest Central
Advanced Technologies & Computer Science Collection
ProQuest Central Essentials
Biological Science Collection
ProQuest Central
Technology Collection
Natural Science Collection
ProQuest One Community College
Middle East & Africa Database
ProQuest Central
Engineering Research Database
ProQuest Central Student
SciTech Premium Collection
ProQuest Computer Science Collection
Computer Science Database
Advanced Technologies Database with Aerospace
Biological Sciences
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
Computing Database
Biological Science Database
Advanced Technologies & Aerospace Database
ProQuest Advanced Technologies & Aerospace Collection
Biotechnology and BioEngineering Abstracts
Proquest Central Premium
ProQuest One Academic
Publicly Available Content Database
ProQuest One Academic Middle East (New)
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Applied & Life Sciences
ProQuest One Academic (retired)
ProQuest One Academic UKI Edition
ProQuest One Psychology
ProQuest Central Basic
DOAJ (Directory of Open Access Journals)
DatabaseTitle CrossRef
Publicly Available Content Database
ProQuest One Psychology
Computer Science Database
ProQuest Central Student
Technology Collection
Technology Research Database
Computer and Information Systems Abstracts – Academic
ProQuest One Academic Middle East (New)
ProQuest Advanced Technologies & Aerospace Collection
ProQuest Central Essentials
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
ProQuest Central (Alumni Edition)
SciTech Premium Collection
ProQuest One Community College
ProQuest Natural Science Collection
ProQuest Central
ProQuest One Applied & Life Sciences
Middle East & Africa Database
Biotechnology Research Abstracts
Natural Science Collection
ProQuest Central Korea
Biological Science Collection
ProQuest Central (New)
Advanced Technologies Database with Aerospace
Advanced Technologies & Aerospace Collection
ProQuest Computing
ProQuest Biological Science Collection
ProQuest Central Basic
ProQuest Computing (Alumni Edition)
ProQuest One Academic Eastern Edition
ProQuest Technology Collection
Biological Science Database
ProQuest SciTech Collection
Neurosciences Abstracts
Biotechnology and BioEngineering Abstracts
Computer and Information Systems Abstracts Professional
Advanced Technologies & Aerospace Database
ProQuest One Academic UKI Edition
Engineering Research Database
ProQuest One Academic
ProQuest One Academic (New)
ProQuest Central (Alumni)
DatabaseTitleList
Publicly Available Content Database

CrossRef


Database_xml – sequence: 1
  dbid: RHX
  name: Hindawi Publishing Open Access
  url: http://www.hindawi.com/journals/
  sourceTypes: Publisher
– sequence: 2
  dbid: DOA
  name: DOAJ Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
– sequence: 3
  dbid: PIMPY
  name: Publicly Available Content Database
  url: http://search.proquest.com/publiccontent
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISSN 1687-5907
Editor Chirico, Alice
Editor_xml – sequence: 1
  givenname: Alice
  surname: Chirico
  fullname: Chirico, Alice
EndPage 22
ExternalDocumentID oai_doaj_org_article_dff8655fa60c4bbe83bcc8e2d1f5e304
A696904856
A684373288
10_1155_2021_5518722
GeographicLocations Germany
GeographicLocations_xml – name: Germany
GrantInformation_xml – fundername: ECCI and CITIC at the University of Costa Rica
  grantid: 834-B4-412; 326-B9-107
GroupedDBID .4S
.DC
188
2WC
3V.
5VS
8FE
8FG
8FH
8R4
8R5
AAFWJ
AAJEY
AAKPC
ABIVO
ABUWG
ACIWK
ACM
ACPRK
ADBBV
AFKRA
AFPKN
AFRAH
AINHJ
ALMA_UNASSIGNED_HOLDINGS
ARAPS
ARCSS
AZQEC
BBNVY
BCNDV
BENPR
BGLVJ
BHPHI
BPHCQ
CCPQU
CS3
CWDGH
DWQXO
E3Z
EDO
GNUQQ
GROUPED_DOAJ
GX1
HCIFZ
IAO
ICD
IPY
ISR
ITC
K6V
K7-
KQ8
LK8
M0N
M7P
M~E
OK1
P2P
P62
PIMPY
PQQKQ
PROAC
PSYQQ
Q2X
RHU
RHW
RHX
RNS
TR2
TUS
0R~
24P
AAMMB
AAYXX
ACCMX
ADMLS
AEFGJ
AFFHD
AGXDD
AIDQK
AIDYY
ALUQN
CITATION
H13
OVT
PHGZM
PHGZT
PQGLB
7QO
7SC
7TK
7XB
8AL
8FD
8FK
FR3
JQ2
L7M
L~C
L~D
P64
PKEHL
PQEST
PQUKI
Q9U
ID FETCH-LOGICAL-c653t-3d6584427b7bd6218d13e85dade763155586fb24973c79f8ac54281297e3a1ff3
IEDL.DBID K7-
ISICitedReferencesCount 24
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000665045500001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1687-5893
IngestDate Fri Oct 03 12:45:21 EDT 2025
Fri Jul 25 12:20:15 EDT 2025
Tue Nov 11 10:56:47 EST 2025
Tue Nov 04 18:16:21 EST 2025
Tue Nov 04 18:15:41 EST 2025
Thu Nov 13 16:09:14 EST 2025
Thu Nov 13 16:09:13 EST 2025
Tue Nov 18 22:42:52 EST 2025
Sat Nov 29 05:37:57 EST 2025
Sun Jun 02 18:54:50 EDT 2024
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Language English
License This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
https://creativecommons.org/licenses/by/4.0
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c653t-3d6584427b7bd6218d13e85dade763155586fb24973c79f8ac54281297e3a1ff3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
content type line 14
ObjectType-Literature Review-2
ObjectType-Feature-3
ORCID 0000-0003-0510-8857
0000-0003-3989-979X
0000-0002-4760-8705
0000-0002-5612-0699
OpenAccessLink https://www.proquest.com/docview/2527980068?pq-origsite=%requestingapplication%
PQID 2527980068
PQPubID 237352
PageCount 22
ParticipantIDs doaj_primary_oai_doaj_org_article_dff8655fa60c4bbe83bcc8e2d1f5e304
proquest_journals_2527980068
gale_infotracmisc_A696904856
gale_infotracmisc_A684373288
gale_infotracacademiconefile_A696904856
gale_infotracacademiconefile_A684373288
gale_incontextgauss_ISR_A696904856
gale_incontextgauss_ISR_A684373288
crossref_primary_10_1155_2021_5518722
crossref_citationtrail_10_1155_2021_5518722
hindawi_primary_10_1155_2021_5518722
PublicationCentury 2000
PublicationDate 2021-00-00
PublicationDateYYYYMMDD 2021-01-01
PublicationDate_xml – year: 2021
  text: 2021-00-00
PublicationDecade 2020
PublicationPlace New York
PublicationPlace_xml – name: New York
PublicationTitle Advances in human-computer interaction
PublicationYear 2021
Publisher Hindawi
John Wiley & Sons, Inc
Wiley
Publisher_xml – name: Hindawi
– name: John Wiley & Sons, Inc
– name: Wiley
References M. Hassenzahl (19)
M. Minge (21) 2013; 9
F. Karray (34) 2008; 1
R. A. Likert (17) 1932
M. Minge (37) 2017
M. Bick (33) 2008
W. Weber (29) 2005
K. Pollmann (40)
J. C. Augusto (30) 2008
M. A. Ali (42) 2018; 6
D. Wallach (3)
A. C. Ten (16)
M. Thüring (24) 2007; 42
S. Gebhardt (43)
C. L. B. Maia (15) 2016
C. Lallemand (4) 2015; 43
P. Remagnino (28) 2005
V. Roto (5)
P. Kortum (35) 2008
E. Law (6)
Y. Forster (13)
M. Mõttus (41)
M. Friedewald (32) 2005; 22
ISO (7) 2010
C. Lallemand (11)
E. C. Osgood (18) 1952; 49
M. Seel (25) 2012
C. Lallemand (9) 2018
I. Wagner (39)
C. Rohrer (8) 2014
G. Gronier (10) 2015
M. Minge (38)
M. Schrepp (1)
M. Hassenzahl (22) 2001; 13
K. Ducatel (27) 2001
J. Baumgartner (12) 2019; 122
M. Weiser (26) 1991; 265
A. Liberati (36) 2009; 62
M. Gams (31) 2019; 11
M. Hassenzahl (23) 2003
S. Gebhardt (44) 2013; 19
20
A. P. O. S. Vermeeren (2)
J. Klammer (14) 2018
References_xml – ident: 11
  article-title: How could an intranet be like a friend to me?
  doi: 10.1145/3121283.3121288
– volume: 22
  start-page: 221
  issue: 3
  year: 2005
  ident: 32
  article-title: Perspectives of ambient intelligence in the home environment
  publication-title: Telematics and Informatics
  doi: 10.1016/j.tele.2004.11.001
– volume: 265
  start-page: 94
  issue: 3
  year: 1991
  ident: 26
  article-title: The computer for the 21 st century
  publication-title: Scientific American
  doi: 10.1038/scientificamerican0991-94
– volume: 11
  start-page: 71
  issue: 1
  year: 2019
  ident: 31
  article-title: Artificial intelligence and ambient intelligence
  publication-title: Journal of Ambient Intelligence and Smart Environments
  doi: 10.3233/AIS-180508
– volume-title: HCI beyond GUI: Design for Haptic, Speech, Olfactory and Other Nontraditional Interfaces
  year: 2008
  ident: 35
– start-page: 521
  ident: 2
  article-title: User experience evaluation methods
– volume-title: ISO DIS 9241-210:2010 Ergonomics of Human-System Interaction
  year: 2010
  ident: 7
– volume: 9
  start-page: 89
  year: 2013
  ident: 21
  article-title: meCUE – ein modularer fragebogen zur erfassung des nutzungserlebens [meCUE - a modular questionnaire for capturing the user experience]
  publication-title: Mensch und Computer
– volume-title: Ubiquitous Computing. In Encyclopedia of the Sciences of Learning
  year: 2012
  ident: 25
  doi: 10.1007/978-1-4419-1428-6
– ident: 20
  doi: 10.1007/978-3-540-89350-9_6
– start-page: 1249
  ident: 41
  article-title: Aesthetic categories of interaction: aesthetic perceptions on smartphone and computer
– ident: 3
  article-title: The UX metrics table: a missing artifact
  doi: 10.1007/978-3-319-58634-2_37
– volume-title: Design, User Experience, and Usability: Users, Contexts and Case Studies
  year: 2018
  ident: 14
– ident: 39
  article-title: The gods play dice together: the influence of social elements of gamification on seniors’ user experience
  doi: 10.1007/978-3-319-21380-4_57
– start-page: 509
  ident: 40
  article-title: Design. Can we distinguish pragmatic from hedonic user experience qualities with implicit measures?
– ident: 5
  article-title: User experience white paper: bringing clarity to the concept of user experience
– volume-title: Méthodes de design UX. 30 méthodes fondamentales pour concevoir des expériences optimales
  year: 2018
  ident: 9
– volume-title: Technique for the Measurement of Attitude
  year: 1932
  ident: 17
– volume: 6
  start-page: 15587
  year: 2018
  ident: 42
  article-title: Data-Driven knowledge acquisition system: an end-to-end knowledge engineering process for generating production rules
  publication-title: IEEE Access
  doi: 10.1109/ACCESS.2018.2817022
– start-page: 451
  ident: 38
  article-title: The MeCUE questionnaire (2.0): meeting five basic requirements for lean and standardized UX assessment
– volume-title: Mesurer la formation de la première impression d’une interface à l’aide du test des 5 secondes; Huitième Colloque de Psychologie Ergonomique (EPIQUE)
  year: 2015
  ident: 10
– volume-title: Scenarios for Ambient Intelligence in 2010. IST Advisory Group Final Report
  year: 2001
  ident: 27
– start-page: 278
  ident: 13
  article-title: How usability can save the day - methodological considerations for making automated driving a success story
– volume: 49
  start-page: 197
  year: 1952
  ident: 18
  article-title: The Nature and measurement of meaning
  publication-title: Psychological Bulletin
  doi: 10.1037/h0055737
– volume: 13
  start-page: 481
  year: 2001
  ident: 22
  article-title: The effect of perceived hedonic quality on product appealingness
  publication-title: International Journal of Human-Computer Interaction
  doi: 10.1207/S15327590IJHC1304_07
– start-page: 1
  volume-title: Funology : From Usability to Enjoyment
  year: 2003
  ident: 23
  article-title: The thing and I: understanding the relationship between user and product
  doi: 10.1007/1-4020-2967-5_4
– volume: 42
  start-page: 253
  issue: 4
  year: 2007
  ident: 24
  article-title: Usability, aesthetics and emotions in human-technologyinteraction
  publication-title: International Journal of Psychology
  doi: 10.1080/00207590701396674
– start-page: 31
  ident: 43
  article-title: An evaluation of a smart-phone-based menu system for immersive virtual environments
– start-page: 115
  volume-title: The meCUE Questionnaire: A Modular Tool for Measuring User Experience
  year: 2017
  ident: 37
– start-page: 492
  ident: 16
  article-title: A systematic review of user experience evaluation methods in information driven websites
– volume: 62
  start-page: e1
  year: 2009
  ident: 36
  article-title: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions
  publication-title: Explanation and Elaboration
– volume-title: Handbook on Information Technologies for Education and Training. International Handbooks on Information Systems
  year: 2008
  ident: 33
  article-title: Ambient intelligence and ubiquitous computing
– ident: 1
  article-title: Applying the user experience questionnaire (UEQ) in different evaluation scenarios
  doi: 10.1007/978-3-319-07668-3_37
– volume-title: A Systematic Review about User Experience Evaluation. In Design, User Experience, and Usability: Design Thinking and Methods
  year: 2016
  ident: 15
– volume: 19
  start-page: 644
  year: 2013
  ident: 44
  article-title: Extended pie menus for immersive virtual environments
  publication-title: IEEE Transactions on Visualization and Computer Graphics
  doi: 10.1109/TVCG.2013.31
– volume: 1
  start-page: 137
  year: 2008
  ident: 34
  article-title: Human-computer interaction: overview on state of the art
  publication-title: International Journal on Smart Sensing and Intelligent Systems
  doi: 10.21307/ijssis-2017-283
– volume-title: Ambient Intelligence
  year: 2005
  ident: 28
  article-title: Ambient Intelligence. a gentle introduction
  doi: 10.1007/0-387-22991-4_1
– volume-title: Ambient Intelligence
  year: 2005
  ident: 29
  doi: 10.1007/b138670
– year: 2014
  ident: 8
  article-title: When to use which user-experience research methods
– volume: 43
  start-page: 35
  year: 2015
  ident: 4
  article-title: User experience: a concept without consensus? Exploring practi-tioners’ perspectives through an international survey
  publication-title: Computers in Human Behavior
  doi: 10.1016/j.chb.2014.10.048
– start-page: 187
  ident: 19
  article-title: Ein Fragebogen zur messung wahrgenommener hedonischer und pragmatischer qualität
– volume: 122
  start-page: 78
  year: 2019
  ident: 12
  article-title: No need to read: developing a pictorial single-item scale for measuring perceived usability
  publication-title: International Journal of Human-Computer Studies
  doi: 10.1016/j.ijhcs.2018.08.008
– ident: 6
  article-title: Towards a shared definition of user experience
– volume-title: Software and Data Technologies. ICSOFT 2006. Communications in Computer and Information Science
  year: 2008
  ident: 30
  article-title: Ambient intelligence: basic concepts and applications
SSID ssj0064215
Score 2.3773944
SecondaryResourceType review_article
Snippet Background. Standardized questionnaires are well-known, reliable, and inexpensive instruments to evaluate user experience (UX). Although the structure,...
SourceID doaj
proquest
gale
crossref
hindawi
SourceType Open Website
Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 1
SubjectTerms Ambient intelligence
Analysis
Computer applications
Criteria
Evaluation
Eye movements
Information systems
Intelligence
Interfaces
Literature reviews
Motorcycles
Perceptions
Protective equipment
Questionnaires
Semantics
Surveys
Systematic review
Ubiquitous computing
Usability
User experience
User interfaces
Virtual reality
Windshields
SummonAdditionalLinks – databaseName: DOAJ (Directory of Open Access Journals)
  dbid: DOA
  link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1Lb9QwELZQBRIXylNsWZCFijigqMSOHYfbglpRqaoQy0p7s_ykkSCFZhckLvx1ZhIn7YrHXrgmYycZz9PxfEPIvucsOJCjTMXKYwszltlgYxaB2so8FMF2OLMn5empWi6rd1dafeGZsB4euGfcgY8RayejkS9dYW1Q3DqnAvN5FIH3SKAQ9QzJVG-DsXoTDy_mElRIgEsejrwLgdl-foA4ZCVjG86ow-wfLfONM8yJv9e_2ejO8RzdJrdSxEhn_ZveIddCc5fsDt0YaFLOe-TnYkkPR-xuihusdJ42CuofwdNubxNuNQbMXEvrhi5s_XUNKr1uaT8f-DEKI-jss8U6SXp8BbDzFZ3R-Yj7TE9GPGba_1-4TxZHhx_evM1Se4XMScFXGfcYfRSstKX1Ely9z3lQwhsfwOjkCAQmo4X0rOSurKIyTkCuAvFBGbjJY-QPyE5z3oSHhEppYoCxzEE0WeXeulhUzhq4XhhRmQl5MfBZu4Q9ji0wPukuBxFC46rotCoT8myk_tJjbvyF7jUu2UiDSNndBZAfneRHb5OfCXmKC64RC6PBwzYfzbpt9fH8vZ5JhcBPTKl_ElWyAjMo5IQ8T0TxHD7OmVTgACxCjK2N6bZRXs453aAE3XcbE_3x9uXo_STFW_g4HURcJwvWaiZYWSmsINr7H2x-RG7iI_vNqynZWV2sw2Ny3X1b1e3Fk055fwEi-Ebf
  priority: 102
  providerName: Directory of Open Access Journals
– databaseName: Hindawi Publishing Open Access
  dbid: RHX
  link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3daxQxEA9aFHzxWzw9JUjFB1nsZjfZxLdTWlooRXoe3FvIZ13QrXbvFHzxX3dmN7v1rFofN5kMbOYrk2R-IWTbFyw40KNMRuXxCTOW2WBjFoHaijyUwXY4s4fV0ZFcLtW7BJLUXjzCh2iH6Xn-CoHDKga-9qrkqLzH-8vB4WKpJt5UzAXYC4f4O9xv_23sRuTpAPpHN3z9AybA3-oLDrmLMnu3yc20PKSzXp53yJXQ3CW3hqcXaLLEe-THYkl3R6BuirupdJ52BervwdNuIxO6GgM-raV1Qxe2_rIG-123tOcHQYvCCDr7ZLEokh78gs75ms7ofAR5pocj-DLtDxPuk8Xe7vu3-1l6SyFzgherrPC41ChZZSvrBcR1nxdBcm98AA-TI-qXiBZysapwlYrSOA6JCSwGqlCYPMbiAdlqTpvwkFAhTAwwljlYOqrcWxdL5ayB9tJwZSbk5TDP2iWgcXzv4qPuEg7ONUpFJ6lMyPOR-nMPsPEXujcospEGYbG7BlAVnaxM-xix0DYaseNKa4MsrHMyMJ9HHoqdckKeocA1Al80eLPmxKzbVh_Mj_VMSER5YlL-k0gJBT6Piwl5kYjiKfycM6maAaYIAbU22F1Gec5zukEJhu42GP2x-3z0dtLiS-ZxOqi4Tu6q1YyzSkksF3r0f1wekxv42e9FTcnW6mwdnpBr7uuqbs-edub5EzvYMoU
  priority: 102
  providerName: Hindawi Publishing
Title UX Evaluation with Standardized Questionnaires in Ubiquitous Computing and Ambient Intelligence: A Systematic Literature Review
URI https://dx.doi.org/10.1155/2021/5518722
https://www.proquest.com/docview/2527980068
https://doaj.org/article/dff8655fa60c4bbe83bcc8e2d1f5e304
Volume 2021
WOSCitedRecordID wos000665045500001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAON
  databaseName: DOAJ Directory of Open Access Journals
  customDbUrl:
  eissn: 1687-5907
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0064215
  issn: 1687-5893
  databaseCode: DOA
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVPQU
  databaseName: Advanced Technologies & Aerospace Database
  customDbUrl:
  eissn: 1687-5907
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0064215
  issn: 1687-5893
  databaseCode: P5Z
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: https://search.proquest.com/hightechjournals
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Biological Science Database
  customDbUrl:
  eissn: 1687-5907
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0064215
  issn: 1687-5893
  databaseCode: M7P
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/biologicalscijournals
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Computer Science Database
  customDbUrl:
  eissn: 1687-5907
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0064215
  issn: 1687-5893
  databaseCode: K7-
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/compscijour
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Middle East & Africa Database (ProQuest)
  customDbUrl:
  eissn: 1687-5907
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0064215
  issn: 1687-5893
  databaseCode: CWDGH
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: https://search.proquest.com/middleeastafrica
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: ProQuest Central
  customDbUrl:
  eissn: 1687-5907
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0064215
  issn: 1687-5893
  databaseCode: BENPR
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: https://www.proquest.com/central
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Publicly Available Content Database
  customDbUrl:
  eissn: 1687-5907
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0064215
  issn: 1687-5893
  databaseCode: PIMPY
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/publiccontent
  providerName: ProQuest
– providerCode: PRVWIB
  databaseName: Wiley Online Library Open Access
  customDbUrl:
  eissn: 1687-5907
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0064215
  issn: 1687-5893
  databaseCode: 24P
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: https://authorservices.wiley.com/open-science/open-access/browse-journals.html
  providerName: Wiley-Blackwell
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1Lb9NAEF5BCxIXyqsiEKIVKuKArNZrrx9cUIpSNaJEVkKkwMXaZ7EEThsnIHHhrzPjrB0ioD1wsWTv7Crxznw7O579hpADHTCjQI-8xKYaS5gxTxppPQvSMvJNaGTNM3sWj0bJbJZmLuBWubTKBhNroNZzhTHyQ8ZZnCZ4ouHNxaWHVaPw66oroXGT7PqM-ajn72KvQWI8w4kpjH4EhsRhYW4S3znHPb9_iGxkMWNbS1LN3N_i8-3PuDP-XvyB1PXyc7L3vz_8HrnrHE_aX2vKfXLDlA_IXlPUgTobf0h-Tmd00FKAU4zT0omLNxQ_jKZ1iBSaSgFoWdGipFNZXK4AGVYVXY8HyyGFHrT_VeJxSzr8jffzNe3TSUsfTc9aWme6_kzxiExPBh_ennquSoOnIh4svUCjExOyWMZSR-AxaD8wCddCG8AuH_nEIithlxcHKk5tIhSHLQ-4GbEJhG9tsE92ynlpHhMaRcIa6MsUOKWpr6WyYaqkgOeh4KnokFfNROXKUZhjJY0veb2V4TzHac3dtHbIi1b6Yk3d8Q-5Y5zzVgYJt-sH88V57uw319biEV4roiMVSmmSQCqVGKZ9y01wFHbIc9SYHCk1SszZORerqsqHk3HejxLkj2JJcqVQGqWApjzqkJdOyM7hzynhzknAK0Kqrq3hrpPcjNndkgQIUVsD_bV50_vAmcE177HbGEDugLDKN9r_5Ormp-QODraObnXJznKxMs_ILfVtWVSLHtk9Hoyyca8OmfRqK-9hmm4G14x_gvZs-D77CHfj09kvNcBaaQ
linkProvider ProQuest
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Lb9NAEF6VFgQXylMEAqxQCwdktV577TUSh9AHiRoiRBo1N-N9lUjgtHFCBRf-Eb-RGWftEAHtqQeu3tmRvJ6Zb3e88w0hGzpgRoEdecImGluYMU8aaT0L0jLyTWhkyTPbjXs9MRwm71fIz6oWBq9VVjGxDNR6rDBHvsU4ixOBFQ3uBuWB-XYG57PidWcXPuYmY_t7hzttz7UQ8FTEg6kXaETYkMUyljoCONN-YATXmTbgWD6SXUVWwhEkDlScWJEpDvtxwMDYBJlvbQB6n5-cetilCv_mupYdV8iaiBIBHrW2c7T7tl3FfqwaxUuTfgSuy2ErUF215xyzDP4W8p_FjC2BYNkroEaEa5_wLH42-gMbSsDbX__fluoWuem21rQ194XbZMXkd8h61baCuih2l_wYDOleTXJOMRNN-y6jMvpuNC2TwDCUZ4AHBR3ldCBHpzOIfbOCzvUB4FOYQVtfJBaU0s5vzKavaIv2a4Js2q2Jq-n8R8w9MriUlblPVvNxbh4QGkWZNTCXKdh2J76WyoaJkhk8DzOeZA3ysjKMVDmSduwV8jktD2ucp2hGqTOjBtmspU_m5CT_kHuDNlbLIKV4-WA8OU5dhEq1tVikbLNoW4VSGhFIpYRh2rfcBNthgzxDC02RNCTHW0nH2awo0k7_Q9qKBDJkMSHOFUqiBPCCRw3ywgnZMbycylwlCCwRkpEtqbtIcqGzuSQJQVItKfrr8GL2hnO7C9axWTlc6kJ9kS687eH5w0_J9fbhu27a7fQOHpEbqHiey2uS1elkZh6Tq-rrdFRMnrioQsnHy3bYX2F1r3U
linkToPdf http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Lb9NAEF6V8hAXylMEAqxQKw7ISr32-oGEUKCNiBJFFSFSb1vvq0QCp40TKrjwv_h1zNhrhwhoTz1w9c6O5PXMfLvjnW8I2dYBMwrsyEtsqrGFGfOkkdazIC0j34RGljyzw3g0Sg4P04MN8rOuhcFrlXVMLAO1ninMkXcYZ3GaYEVDx7prEQd7vTcnpx52kMI_rXU7jcpEBubbGRzfitf9PfjWO4z19j--e--5DgOeiniw8AKNAByyWMZSR4B22g9MwnWmDfidj1xYkZVwQokDFac2yRSH7TpAZGyCzLc2AL1XyFVAYY4-Noi9GgWwfhSvT_oRODGHTUF96Z5zzDf4HWRCixlbg8Oya0CDDdc_4an8bPoHSpTQ19v6nxftNrnlNty0W3nIHbJh8rtkq25mQV1su0d-TA7pfkN9TjE_TccuzzL9bjQtU8MwlGeAEgWd5nQip6dLiIjLglb6YBtAYQbtfpFYZkr7v_GdvqJdOm5os-mwobOm1e-Z-2RyKcvwgGzms9w8JDSKMmtgLlOwGU99LZUNUyUzeB5mPM1a5GVtJEI56nbsIPJZlEc4zgWalHAm1SI7jfRJRVnyD7m3aG-NDBKNlw9m82Ph4pbQ1mLpss2iXRVKaZJAKpUYpn3LTbAbtshztFaBVCI52tdxtiwK0R9_EN0oQd4sliTnCqVRCijCoxZ54YTsDF5OZa4-BJYIKcrW1F0kudLZXpOE0KnWFP11eDV727ngBevYrp1POAAoxMrzHp0__IzcAJcUw_5o8JjcRL1Vgq9NNhfzpXlCrqmvi2kxf1qGF0qOLts1fwFf87ak
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=UX+Evaluation+with+Standardized+Questionnaires+in+Ubiquitous+Computing+and+Ambient+Intelligence%3A+A+Systematic+Literature+Review&rft.jtitle=Advances+in+human-computer+interaction&rft.au=D%C3%ADaz-Oreiro%2C+Ignacio&rft.au=L%C3%B3pez%2C+Gustavo&rft.au=Quesada%2C+Luis&rft.au=Guerrero%2C+Luis+A&rft.date=2021&rft.pub=John+Wiley+%26+Sons%2C+Inc&rft.issn=1687-5893&rft.eissn=1687-5907&rft.volume=2021&rft_id=info:doi/10.1155%2F2021%2F5518722&rft.externalDBID=HAS_PDF_LINK
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1687-5893&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1687-5893&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1687-5893&client=summon