Effective Use of Likert Scales in Visualization Evaluations: A Systematic Review

Likert scales are often used in visualization evaluations to produce quantitative estimates of subjective attributes, such as ease of use or aesthetic appeal. However, the methods used to collect, analyze, and visualize data collected with Likert scales are inconsistent among evaluations in visualiz...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Computer graphics forum Ročník 41; číslo 3; s. 43 - 55
Hlavní autoři: South, Laura, Saffo, David, Vitek, Olga, Dunne, Cody, Borkin, Michelle A.
Médium: Journal Article
Jazyk:angličtina
Vydáno: Oxford Blackwell Publishing Ltd 01.06.2022
Témata:
ISSN:0167-7055, 1467-8659
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Abstract Likert scales are often used in visualization evaluations to produce quantitative estimates of subjective attributes, such as ease of use or aesthetic appeal. However, the methods used to collect, analyze, and visualize data collected with Likert scales are inconsistent among evaluations in visualization papers. In this paper, we examine the use of Likert scales as a tool for measuring subjective response in a systematic review of 134 visualization evaluations published between 2009 and 2019. We find that papers with both objective and subjective measures do not hold the same reporting and analysis standards for both aspects of their evaluation, producing less rigorous work for the subjective qualities measured by Likert scales. Additionally, we demonstrate that many papers are inconsistent in their interpretations of Likert data as discrete or continuous and may even sacrifice statistical power by applying nonparametric tests unnecessarily. Finally, we identify instances where key details about Likert item construction with the potential to bias participant responses are omitted from evaluation methodology reporting, inhibiting the feasibility and reliability of future replication studies. We summarize recommendations from other fields for best practices with Likert data in visualization evaluations, based on the results of our survey. A full copy of this paper and all supplementary material are available at https://osf.io/exbz8/.
AbstractList Likert scales are often used in visualization evaluations to produce quantitative estimates of subjective attributes, such as ease of use or aesthetic appeal. However, the methods used to collect, analyze, and visualize data collected with Likert scales are inconsistent among evaluations in visualization papers. In this paper, we examine the use of Likert scales as a tool for measuring subjective response in a systematic review of 134 visualization evaluations published between 2009 and 2019. We find that papers with both objective and subjective measures do not hold the same reporting and analysis standards for both aspects of their evaluation, producing less rigorous work for the subjective qualities measured by Likert scales. Additionally, we demonstrate that many papers are inconsistent in their interpretations of Likert data as discrete or continuous and may even sacrifice statistical power by applying nonparametric tests unnecessarily. Finally, we identify instances where key details about Likert item construction with the potential to bias participant responses are omitted from evaluation methodology reporting, inhibiting the feasibility and reliability of future replication studies. We summarize recommendations from other fields for best practices with Likert data in visualization evaluations, based on the results of our survey. A full copy of this paper and all supplementary material are available at https://osf.io/exbz8/.
Likert scales are often used in visualization evaluations to produce quantitative estimates of subjective attributes, such as ease of use or aesthetic appeal. However, the methods used to collect, analyze, and visualize data collected with Likert scales are inconsistent among evaluations in visualization papers. In this paper, we examine the use of Likert scales as a tool for measuring subjective response in a systematic review of 134 visualization evaluations published between 2009 and 2019. We find that papers with both objective and subjective measures do not hold the same reporting and analysis standards for both aspects of their evaluation, producing less rigorous work for the subjective qualities measured by Likert scales. Additionally, we demonstrate that many papers are inconsistent in their interpretations of Likert data as discrete or continuous and may even sacrifice statistical power by applying nonparametric tests unnecessarily. Finally, we identify instances where key details about Likert item construction with the potential to bias participant responses are omitted from evaluation methodology reporting, inhibiting the feasibility and reliability of future replication studies. We summarize recommendations from other fields for best practices with Likert data in visualization evaluations, based on the results of our survey. A full copy of this paper and all supplementary material are available at https://osf.io/exbz8/ .
Author Saffo, David
Vitek, Olga
Borkin, Michelle A.
South, Laura
Dunne, Cody
Author_xml – sequence: 1
  givenname: Laura
  orcidid: 0000-0003-4444-6314
  surname: South
  fullname: South, Laura
  organization: Northeastern University
– sequence: 2
  givenname: David
  orcidid: 0000-0001-9515-048X
  surname: Saffo
  fullname: Saffo, David
  organization: Northeastern University
– sequence: 3
  givenname: Olga
  orcidid: 0000-0003-1728-1104
  surname: Vitek
  fullname: Vitek, Olga
  organization: Northeastern University
– sequence: 4
  givenname: Cody
  orcidid: 0000-0002-1609-9776
  surname: Dunne
  fullname: Dunne, Cody
  organization: Northeastern University
– sequence: 5
  givenname: Michelle A.
  orcidid: 0000-0002-8016-355X
  surname: Borkin
  fullname: Borkin, Michelle A.
  organization: Northeastern University
BookMark eNp9kEFPAjEQhRuDiYAe_AdNPHlY6Oy2u9QbIYAmJBoRr03pTk1x2cV2geCvdwVPJjqXmUm-9ybzOqRVViUScg2sB031zZvtARcxnJE28DSLBqmQLdJm0MwZE-KCdEJYMcZ4loo2eRpbi6Z2O6SLgLSydObe0dd0bnSBgbqSvrqw1YX71LWrSjre6WJ7HMMdHdL5IdS4bnZDn3HncH9Jzq0uAl799C5ZTMYvo_to9jh9GA1nkYllBlEWax0zg6lEyHieJrlIGeDSGiNzsDDgSwsmFiJhSQLccMlSy5lOIJdW6yzpkpuT78ZXH1sMtVpVW182J1WcMSYlTwbQULcnyvgqBI9Wbbxba39QwNR3YKoJTB0Da9j-L9a4-vhp7bUr_lPsXYGHv63VaDo5Kb4Abth9Sg
CitedBy_id crossref_primary_10_3390_vetsci10050367
crossref_primary_10_1109_TVCG_2024_3456340
crossref_primary_10_1145_3701207
crossref_primary_10_1080_23311886_2023_2186578
crossref_primary_10_1371_journal_pdig_0000706
crossref_primary_10_1108_JGOSS_05_2024_0038
crossref_primary_10_1177_03611981241231967
crossref_primary_10_1097_NNE_0000000000001853
crossref_primary_10_1007_s11528_024_01014_4
crossref_primary_10_1016_j_procs_2024_03_082
crossref_primary_10_18203_2394_6040_ijcmph20252455
crossref_primary_10_1016_j_trip_2025_101630
crossref_primary_10_1145_3696002
crossref_primary_10_36290_csf_2025_002
crossref_primary_10_1093_heapro_daae186
crossref_primary_10_3390_bioengineering11101036
crossref_primary_10_1016_j_tele_2025_102239
crossref_primary_10_3390_electronics13234682
crossref_primary_10_1007_s42979_025_03863_z
crossref_primary_10_1016_j_jclepro_2025_145782
crossref_primary_10_1007_s44155_024_00059_3
crossref_primary_10_1109_ACCESS_2024_3446238
crossref_primary_10_1111_rec_13803
crossref_primary_10_33131_24222208_403
crossref_primary_10_1108_IJOEM_03_2024_0411
crossref_primary_10_1108_SASBE_09_2022_0200
crossref_primary_10_1155_2023_2516746
crossref_primary_10_3390_land14050932
crossref_primary_10_1111_csp2_70141
crossref_primary_10_3390_vetsci10030200
crossref_primary_10_4102_sajim_v27i1_1999
crossref_primary_10_56294_saludcyt20251792
crossref_primary_10_1109_TVCG_2024_3456318
crossref_primary_10_1016_j_radi_2022_10_010
crossref_primary_10_1007_s10668_023_03526_0
crossref_primary_10_3390_educsci15070855
crossref_primary_10_3390_smartcities8020046
crossref_primary_10_1080_27658511_2024_2321686
crossref_primary_10_1109_ACCESS_2025_3593429
crossref_primary_10_1088_1741_2552_ad2290
crossref_primary_10_1016_j_jcrc_2024_154986
crossref_primary_10_1016_j_nexus_2025_100440
crossref_primary_10_1016_j_apergo_2024_104338
crossref_primary_10_3390_su17030912
crossref_primary_10_1177_21582440241295501
crossref_primary_10_1002_nop2_70296
crossref_primary_10_3390_su17031179
crossref_primary_10_1080_10871209_2025_2505580
crossref_primary_10_3390_su17083404
crossref_primary_10_1093_jamia_ocaf034
crossref_primary_10_1080_07481756_2025_2499964
crossref_primary_10_1007_s12650_025_01069_2
crossref_primary_10_1177_09610006231222624
crossref_primary_10_1038_s41598_025_85903_5
crossref_primary_10_1109_TPAMI_2024_3398998
crossref_primary_10_3389_fpubh_2022_1039450
crossref_primary_10_3389_feduc_2024_1447357
crossref_primary_10_1007_s40868_025_00171_2
crossref_primary_10_1109_TVCG_2024_3456377
crossref_primary_10_1109_TVCG_2023_3326590
crossref_primary_10_3390_su16041574
crossref_primary_10_1093_police_paad029
crossref_primary_10_1109_TVCG_2024_3402834
crossref_primary_10_3390_su15032191
crossref_primary_10_1038_s41598_024_53364_x
crossref_primary_10_1136_bmjpo_2023_002398
crossref_primary_10_1007_s40670_025_02420_w
crossref_primary_10_1109_TVCG_2023_3292391
crossref_primary_10_2478_eurodl_2025_0004
crossref_primary_10_3390_smartcities8050152
Cites_doi 10.3758/BF03193146
10.1145/2207676.2208557
10.1007/s10459-010-9222-y
10.1016/j.ijresmar.2010.02.004
10.1109/TVCG.2011.193
10.1177/0013164404268674
10.1109/TVCG.2015.2467962
10.1109/TVCG.2016.2598594
10.1109/TVCG.2018.2841385
10.1109/TVCG.2018.2864889
10.2307/2333709
10.1109/TVCG.2014.2346682
10.1186/1741-7015-8-17
10.1109/TVCG.2014.2346352
10.1109/TVCG.2019.2934208
10.1109/BELIV.2018.8634392
10.1109/TVCG.2014.2346445
10.1109/TVCG.2016.2598603
10.2307/2685679
10.1016/j.cptl.2015.08.001
10.1109/TVCG.2016.2598828
10.1109/TVCG.2016.2598867
10.1109/VAST.2010.5652885
10.1109/TVCG.2015.2467202
10.1109/VAST.2009.5332595
10.1109/TVCG.2014.2346406
10.3102/00028312006004515
10.1109/TVCG.2016.2598826
10.1109/TVCG.2013.240
10.1109/TVCG.2018.2864899
10.1145/3290607.3310432
10.1145/1753326.1753686
10.1007/978-3-319-19425-7_2
10.1109/TVCG.2011.160
10.1109/TVCG.2018.2834923
10.1109/TVCG.2013.126
10.1109/TVCG.2018.2865193
10.1109/TVCG.2012.255
10.1109/TVCG.2019.2934803
10.1016/j.jesp.2018.08.009
10.1109/TVCG.2018.2865142
10.1109/TVCG.2018.2865020
10.1109/TVCG.2018.2865192
10.1109/TVCG.2015.2467752
10.1109/VAST.2010.5652880
10.1111/j.1365-2929.2004.02012.x
10.1086/269282
10.1109/TVCG.2016.2598958
10.1109/TVCG.2014.2346291
10.1109/TVCG.2018.2864526
10.1109/TVCG.2011.279
10.1109/TVCG.2012.225
10.1109/TVCG.2015.2467035
10.1109/TVCG.2015.2467322
10.1145/3360311
10.1016/S0166-4115(08)62386-9
10.1109/TVCG.2015.2467271
10.1109/BELIV.2018.8634420
10.1109/BELIV51497.2020.00013
10.5334/irsp.181
10.1080/13645570802648077
10.1145/2858036.2858498
10.1109/TVCG.2013.197
10.1126/science.103.2684.677
10.1111/1365-2664.13571
10.1109/TVCG.2016.2599217
10.1109/TVCG.2017.2744138
10.1145/3173574.3173715
10.1145/2993901.2993909
10.1111/j.1365-2923.2008.03172.x
10.1109/TVCG.2016.2598466
10.5032/jae.1994.04031
10.1016/S0025-326X(01)00097-2
10.1080/10447319309526075
10.1002/pfi.21727
ContentType Journal Article
Copyright 2022 The Author(s) Computer Graphics Forum © 2022 The Eurographics Association and John Wiley & Sons Ltd. Published by John Wiley & Sons Ltd.
2022 The Eurographics Association and John Wiley & Sons Ltd.
Copyright_xml – notice: 2022 The Author(s) Computer Graphics Forum © 2022 The Eurographics Association and John Wiley & Sons Ltd. Published by John Wiley & Sons Ltd.
– notice: 2022 The Eurographics Association and John Wiley & Sons Ltd.
DBID AAYXX
CITATION
7SC
8FD
JQ2
L7M
L~C
L~D
DOI 10.1111/cgf.14521
DatabaseName CrossRef
Computer and Information Systems Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Computer and Information Systems Abstracts
Technology Research Database
Computer and Information Systems Abstracts – Academic
Advanced Technologies Database with Aerospace
ProQuest Computer Science Collection
Computer and Information Systems Abstracts Professional
DatabaseTitleList
CrossRef
Computer and Information Systems Abstracts
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 1467-8659
EndPage 55
ExternalDocumentID 10_1111_cgf_14521
CGF14521
Genre article
GrantInformation_xml – fundername: National Science Foundation Graduate Research Fellowship Program
  funderid: DGE1451070
GroupedDBID .3N
.4S
.DC
.GA
.Y3
05W
0R~
10A
15B
1OB
1OC
29F
31~
33P
3SF
4.4
50Y
50Z
51W
51X
52M
52N
52O
52P
52S
52T
52U
52W
52X
5GY
5HH
5LA
5VS
66C
6J9
702
7PT
8-0
8-1
8-3
8-4
8-5
8UM
8VB
930
A03
AAESR
AAEVG
AAHHS
AAHQN
AAMNL
AANHP
AANLZ
AAONW
AASGY
AAXRX
AAYCA
AAZKR
ABCQN
ABCUV
ABDBF
ABDPE
ABEML
ABPVW
ACAHQ
ACBWZ
ACCFJ
ACCZN
ACFBH
ACGFS
ACPOU
ACRPL
ACSCC
ACUHS
ACXBN
ACXQS
ACYXJ
ADBBV
ADEOM
ADIZJ
ADKYN
ADMGS
ADNMO
ADOZA
ADXAS
ADZMN
ADZOD
AEEZP
AEGXH
AEIGN
AEIMD
AEMOZ
AENEX
AEQDE
AEUQT
AEUYR
AFBPY
AFEBI
AFFNX
AFFPM
AFGKR
AFPWT
AFWVQ
AFZJQ
AHBTC
AHEFC
AHQJS
AITYG
AIURR
AIWBW
AJBDE
AJXKR
AKVCP
ALAGY
ALMA_UNASSIGNED_HOLDINGS
ALUQN
ALVPJ
AMBMR
AMYDB
ARCSS
ASPBG
ATUGU
AUFTA
AVWKF
AZBYB
AZFZN
AZVAB
BAFTC
BDRZF
BFHJK
BHBCM
BMNLL
BMXJE
BNHUX
BROTX
BRXPI
BY8
CAG
COF
CS3
CWDTD
D-E
D-F
DCZOG
DPXWK
DR2
DRFUL
DRSTM
DU5
EAD
EAP
EBA
EBO
EBR
EBS
EBU
EDO
EJD
EMK
EST
ESX
F00
F01
F04
F5P
FEDTE
FZ0
G-S
G.N
GODZA
H.T
H.X
HF~
HGLYW
HVGLF
HZI
HZ~
I-F
IHE
IX1
J0M
K1G
K48
LATKE
LC2
LC3
LEEKS
LH4
LITHE
LOXES
LP6
LP7
LUTES
LW6
LYRES
MEWTI
MK4
MRFUL
MRSTM
MSFUL
MSSTM
MXFUL
MXSTM
N04
N05
N9A
NF~
O66
O9-
OIG
P2W
P2X
P4D
PALCI
PQQKQ
Q.N
Q11
QB0
QWB
R.K
RDJ
RIWAO
RJQFR
ROL
RX1
SAMSI
SUPJJ
TH9
TN5
TUS
UB1
V8K
W8V
W99
WBKPD
WIH
WIK
WOHZO
WQJ
WRC
WXSBR
WYISQ
WZISG
XG1
ZL0
ZZTAW
~IA
~IF
~WT
AAMMB
AAYXX
ADMLS
AEFGJ
AEYWJ
AGHNM
AGQPQ
AGXDD
AGYGG
AIDQK
AIDYY
AIQQE
CITATION
O8X
7SC
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c2971-72aa20ce69e174d63d5601ebfcc9d1f184bf1c255303314c4906f40a31d9faa73
IEDL.DBID DRFUL
ISICitedReferencesCount 84
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000842261500006&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 0167-7055
IngestDate Fri Jul 25 04:36:42 EDT 2025
Sat Nov 29 03:41:21 EST 2025
Tue Nov 18 21:08:36 EST 2025
Wed Jan 22 16:25:06 EST 2025
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 3
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c2971-72aa20ce69e174d63d5601ebfcc9d1f184bf1c255303314c4906f40a31d9faa73
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-4444-6314
0000-0002-1609-9776
0000-0001-9515-048X
0000-0003-1728-1104
0000-0002-8016-355X
PQID 2700994381
PQPubID 30877
PageCount 13
ParticipantIDs proquest_journals_2700994381
crossref_primary_10_1111_cgf_14521
crossref_citationtrail_10_1111_cgf_14521
wiley_primary_10_1111_cgf_14521_CGF14521
PublicationCentury 2000
PublicationDate June 2022
2022-06-00
20220601
PublicationDateYYYYMMDD 2022-06-01
PublicationDate_xml – month: 06
  year: 2022
  text: June 2022
PublicationDecade 2020
PublicationPlace Oxford
PublicationPlace_xml – name: Oxford
PublicationTitle Computer graphics forum
PublicationYear 2022
Publisher Blackwell Publishing Ltd
Publisher_xml – name: Blackwell Publishing Ltd
References 2007; 39
1957; 11
1965; 52
2004; 64
2010; 15
2010; 13
2020; 63
1991; 55
2013; 20
1932
2020; 57
2012; 18
2011; 17
2013; 5
1996; 189
2011; 18
1993; 5
2014; 20
2013; 19
2010; 27
2004; 38
2019; 26
1969; 6
2002; 44
1994; 35
2018; 31
2010; 8
1988
2018; 79
2012
2011
2010
2015; 11
2017; 24
2009
1946; 103
2003
2015; 7
2018; 25
1999
2020
2015; 22
2017; 56
2019
2018
2016
2015
2008; 42
2016; 23
e_1_2_9_52_2
e_1_2_9_73_2
e_1_2_9_50_2
e_1_2_9_71_2
e_1_2_9_10_2
e_1_2_9_33_2
e_1_2_9_56_2
e_1_2_9_77_2
e_1_2_9_12_2
e_1_2_9_31_2
e_1_2_9_54_2
e_1_2_9_75_2
e_1_2_9_90_2
Krekhov A. (e_1_2_9_45_2) 2019; 26
e_1_2_9_14_2
e_1_2_9_16_2
e_1_2_9_35_2
e_1_2_9_58_2
e_1_2_9_18_2
e_1_2_9_79_2
e_1_2_9_39_2
e_1_2_9_41_2
e_1_2_9_62_2
e_1_2_9_87_2
e_1_2_9_60_2
e_1_2_9_89_2
e_1_2_9_20_2
e_1_2_9_66_2
e_1_2_9_83_2
e_1_2_9_22_2
e_1_2_9_43_2
e_1_2_9_64_2
e_1_2_9_85_2
Hornbæk K. (e_1_2_9_37_2) 2013; 5
e_1_2_9_6_2
e_1_2_9_4_2
e_1_2_9_81_2
e_1_2_9_2_2
Eulzer P. (e_1_2_9_27_2) 2019; 26
e_1_2_9_8_2
e_1_2_9_24_2
e_1_2_9_49_2
e_1_2_9_26_2
e_1_2_9_47_2
e_1_2_9_68_2
e_1_2_9_28_2
e_1_2_9_74_2
e_1_2_9_30_2
e_1_2_9_72_2
e_1_2_9_78_2
e_1_2_9_34_2
e_1_2_9_55_2
e_1_2_9_76_2
e_1_2_9_11_2
e_1_2_9_32_2
e_1_2_9_53_2
e_1_2_9_91_2
e_1_2_9_13_2
e_1_2_9_38_2
Roster C. A. (e_1_2_9_70_2) 2015; 11
e_1_2_9_15_2
e_1_2_9_36_2
e_1_2_9_57_2
e_1_2_9_17_2
e_1_2_9_19_2
e_1_2_9_40_2
e_1_2_9_63_2
e_1_2_9_86_2
e_1_2_9_61_2
e_1_2_9_88_2
e_1_2_9_21_2
e_1_2_9_44_2
e_1_2_9_67_2
e_1_2_9_82_2
e_1_2_9_23_2
e_1_2_9_42_2
e_1_2_9_65_2
e_1_2_9_84_2
e_1_2_9_7_2
Meyer M. (e_1_2_9_59_2) 2019; 26
e_1_2_9_80_2
e_1_2_9_9_2
e_1_2_9_25_2
e_1_2_9_48_2
Lekschas F. (e_1_2_9_51_2) 2019; 26
Brooke J. (e_1_2_9_5_2) 1996; 189
Ahn Y. (e_1_2_9_3_2) 2019; 26
e_1_2_9_46_2
e_1_2_9_69_2
e_1_2_9_29_2
References_xml – volume: 18
  start-page: 2729
  issue: 12
  year: 2012
  end-page: 2738
  article-title: Relex: Visualization for actively changing overlay network specifications
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– start-page: 28
  year: 2018
  end-page: 36
– start-page: 114
  year: 1999
  end-page: 123
– start-page: 1
  year: 2018
  end-page: 12
– volume: 11
  issue: 1
  year: 2015
  article-title: Exploring slider vs. categorical response formats in web‐based surveys
  publication-title: Journal of Research Practice
– volume: 26
  start-page: 321
  issue: 1
  year: 2019
  end-page: 331
  article-title: Evaluating perceptual bias during geometric scaling of scatterplots
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 22
  start-page: 419
  issue: 1
  year: 2015
  end-page: 428
  article-title: Sketching designs using the five design‐sheet methodology
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 64
  start-page: 956
  issue: 6
  year: 2004
  end-page: 972
  article-title: Impact of the number of response categories and anchor labels on coefficient alpha and test‐retest reliability
  publication-title: Educational and Psychological Measurement
– volume: 103
  start-page: 677
  issue: 2684
  year: 1946
  end-page: 680
  article-title: On the theory of scales of measurement
  publication-title: Science
– volume: 25
  start-page: 903
  issue: 1
  year: 2018
  end-page: 913
  article-title: In pursuit of error: A survey of uncertainty visualization evaluation
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 5
  start-page: 383
  issue: 4
  year: 1993
  end-page: 392
  article-title: Multipoint scales: Mean and median differences and observed significance levels
  publication-title: International Journal of Human‐Computer Interaction
– volume: 26
  start-page: 1086
  issue: 1
  year: 2019
  end-page: 1095
  article-title: Fairsight: Visual analytics for fairness in decision making
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 25
  start-page: 2443
  issue: 7
  year: 2018
  end-page: 2457
  article-title: Popup‐plots: Warping temporal data visualization
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 25
  start-page: 693
  issue: 1
  year: 2018
  end-page: 703
  article-title: Origin‐destination flow maps in immersive environments
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 26
  start-page: 87
  issue: 1
  year: 2019
  end-page: 97
  article-title: Criteria for rigor in visualization design study
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– start-page: 162
  year: 2016
  end-page: 168
– volume: 11
  start-page: 13
  issue: 3
  year: 1957
  end-page: 19
  article-title: Nonparametric statistics
  publication-title: The American Statistician
– volume: 23
  start-page: 61
  issue: 1
  year: 2016
  end-page: 70
  article-title: Squares: Supporting interactive performance analysis for multiclass classifiers
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 55
  start-page: 570
  issue: 4
  year: 1991
  end-page: 582
  article-title: Rating scales numeric values may change the meaning of scale labels
  publication-title: Public Opinion Quarterly
– year: 2018
– volume: 26
  start-page: 611
  issue: 1
  year: 2019
  end-page: 621
  article-title: Pattern‐driven navigation in 2d multi‐scale visualizations with scalable insets
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 13
  start-page: 17
  issue: 1
  year: 2010
  end-page: 27
  article-title: Four layouts and a finding: the effects of changes in the order of the verbal labels and numerical values on Likert‐type scales
  publication-title: International Journal of Social Research Methodology
– start-page: 1058
  year: 2011
  end-page: 1066
– volume: 52
  start-page: 591
  issue: 3/4
  year: 1965
  end-page: 611
  article-title: An analysis of variance test for normality (complete samples)
  publication-title: Biometrika
– volume: 27
  start-page: 236
  issue: 3
  year: 2010
  end-page: 247
  article-title: The effect of rating scale format on response styles: The number of response categories and response category labels
  publication-title: International Journal of Research in Marketing
– volume: 23
  start-page: 801
  issue: 1
  year: 2016
  end-page: 810
  article-title: Visualization and extraction of carvings for heritage conservation
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 6
  start-page: 515
  issue: 4
  year: 1969
  end-page: 527
  article-title: The effect of limitations on the number of criterion score values on the significance level of the f‐test
  publication-title: American Educational Research Journal
– volume: 22
  start-page: 569
  issue: 1
  year: 2015
  end-page: 578
  article-title: Off the radar: Comparative evaluation of radial visualization solutions for composite indicators
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 57
  start-page: 842
  issue: 4
  year: 2020
  end-page: 847
  article-title: Exploratory and confirmatory research in the open science era
  publication-title: Journal of Applied Ecology
– volume: 18
  start-page: 2659
  issue: 12
  year: 2012
  end-page: 2668
  article-title: Exploring flow, factors, and outcomes of temporal event sequences with the outflow visualization
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 18
  start-page: 1520
  issue: 9
  year: 2011
  end-page: 1536
  article-title: Empirical studies in information visualization: Seven scenarios
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 15
  start-page: 625
  issue: 5
  year: 2010
  end-page: 632
  article-title: Likert scales, levels of measurement and the “laws” of statistics
  publication-title: Advances in health sciences education
– volume: 23
  start-page: 401
  issue: 1
  year: 2016
  end-page: 410
  article-title: Evaluation of graph sampling: A visualization perspective
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 7
  start-page: 836
  issue: 6
  year: 2015
  end-page: 850
  article-title: How to analyze Likert and other rating scale data
  publication-title: Currents in Pharmacy Teaching and Learning
– volume: 23
  start-page: 741
  issue: 1
  year: 2016
  end-page: 750
  article-title: Pelvis: Atlas‐based surgical planning for oncological pelvic surgery
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 22
  start-page: 926
  issue: 1
  year: 2015
  end-page: 934
  article-title: Effectiveness of structured textures on dynamically changing terrain‐like surfaces
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 56
  start-page: 15
  issue: 10
  year: 2017
  end-page: 23
  article-title: Evidence‐based survey design: The use of a midpoint on the likert scale
  publication-title: Performance Improvement
– volume: 19
  start-page: 2818
  issue: 12
  year: 2013
  end-page: 2827
  article-title: A systematic review on the practice of evaluating visualization
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 23
  start-page: 471
  issue: 1
  year: 2016
  end-page: 480
  article-title: The attraction effect in information visualization
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– year: 2015
– start-page: 179
  year: 2010
  end-page: 186
– volume: 189
  start-page: 4
  issue: 194
  year: 1996
  end-page: 7
  article-title: Sus‐A quick and dirty usability scale
  publication-title: Usability Evaluation in Industry
– volume: 25
  start-page: 12
  issue: 1
  year: 2018
  end-page: 21
  article-title: Evaluating multi‐dimensional visualizations for understanding fuzzy clusters
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 25
  start-page: 630
  issue: 1
  year: 2018
  end-page: 640
  article-title: Glanceable visualization: Studies of data comparison performance on smartwatches
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 42
  start-page: 1150
  issue: 12
  year: 2008
  end-page: 1152
  article-title: Resolving the 50‐year debate around using and misusing Likert scales
  publication-title: Medical education
– volume: 17
  start-page: 2469
  issue: 12
  year: 2011
  end-page: 2478
  article-title: A study on dual‐scale data charts
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– start-page: 48
  year: 2020
  end-page: 54
– volume: 20
  start-page: 2456
  issue: 12
  year: 2014
  end-page: 2465
  article-title: Attractive flicker—guiding attention in dynamic narrative visualizations
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 35
  start-page: 4
  issue: 4
  year: 1994
  article-title: Analyzing data measured by individual Likert‐type items
  publication-title: Journal of agricultural education
– volume: 20
  start-page: 391
  issue: 3
  year: 2013
  end-page: 403
  article-title: An evaluation of depth enhancing perceptual cues for vascular volume visualization in neurosurgery
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 38
  start-page: 1217
  issue: 12
  year: 2004
  end-page: 1218
  article-title: Likert scales: How to (ab) use them?
  publication-title: Medical education
– year: 2003
– volume: 25
  start-page: 882
  issue: 1
  year: 2018
  end-page: 891
  article-title: Visualizing uncertain tropical cyclone predictions using representative samples from ensembles of forecast tracks
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 17
  start-page: 2440
  issue: 12
  year: 2011
  end-page: 2448
  article-title: Evaluation of traditional, orthogonal, and radial tree diagrams by an eye tracking study
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 25
  start-page: 427
  issue: 1
  year: 2018
  end-page: 437
  article-title: Duet: Helping data analysis novices conduct pairwise comparisons by minimal specification
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– start-page: 27
  year: 2009
  end-page: 34
– volume: 39
  start-page: 175
  issue: 2
  year: 2007
  end-page: 191
  article-title: G∗ power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences
  publication-title: Behavior research methods
– start-page: 981
  year: 2016
  end-page: 992
– volume: 20
  start-page: 2506
  issue: 12
  year: 2014
  end-page: 2515
  article-title: Combined visualization of wall thickness and wall shear stress for the evaluation of aneurysms
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 25
  start-page: 2404
  issue: 7
  year: 2018
  end-page: 2418
  article-title: Classification of blood flow patterns in cerebral aneurysms
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 23
  start-page: 21
  issue: 1
  year: 2016
  end-page: 30
  article-title: Visualizing dimension coverage to support exploratory analysis
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– start-page: 102
  year: 2018
  end-page: 107
– start-page: 1
  year: 2019
  end-page: 11
– volume: 23
  start-page: 881
  issue: 1
  year: 2016
  end-page: 890
  article-title: Hybrid tactile/tangible interaction for 3d data exploration
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 24
  start-page: 584
  issue: 1
  year: 2017
  end-page: 594
  article-title: Priming and anchoring effects in visualization
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 22
  start-page: 539
  issue: 1
  year: 2015
  end-page: 548
  article-title: Visual encodings of temporal uncertainty: A comparative user study
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– year: 1932
– volume: 19
  start-page: 2189
  issue: 12
  year: 2013
  end-page: 2197
  article-title: Supporting awareness through collaborative brushing and linking of tabular data
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 26
  start-page: 547
  issue: 1
  year: 2019
  end-page: 557
  article-title: Deadeye visualization revisited: Investigation of preattentiveness and applicability in virtual environments
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 22
  start-page: 886
  issue: 1
  year: 2015
  end-page: 895
  article-title: Cast: Effective and efficient user interaction for context‐aware selection in 3d particle clouds
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 44
  start-page: 85
  issue: 1
  year: 2002
  end-page: 87
  article-title: Statistical power of non‐parametric tests: A quick guide for designing sampling strategies
  publication-title: Marine pollution bulletin
– start-page: 139
  year: 1988
  end-page: 183
– volume: 63
  start-page: 70
  issue: 8
  year: 2020
  end-page: 79
  article-title: Threats of a replication crisis in empirical computer science
  publication-title: Communications of the ACM
– volume: 20
  start-page: 2092
  issue: 12
  year: 2014
  end-page: 2101
  article-title: ivisdesigner: Expressive interactive design of information visualizations
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– start-page: 155
  year: 2010
  end-page: 162
– start-page: 1105
  year: 2012
  end-page: 1114
– volume: 20
  start-page: 2339
  issue: 12
  year: 2014
  end-page: 2348
  article-title: TenniVis: Visualization for tennis match analysis
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 25
  start-page: 769
  issue: 1
  year: 2018
  end-page: 778
  article-title: istory‐line: Effective convergence to hand‐drawn storylines
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 26
  start-page: 971
  issue: 1
  year: 2019
  end-page: 980
  article-title: Temporal views of flattened mitral valve geometries
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 23
  start-page: 541
  issue: 1
  year: 2016
  end-page: 550
  article-title: Towards unambiguous edge bundling: Investigating confluent drawings for network visualization
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 22
  start-page: 330
  issue: 1
  year: 2015
  end-page: 338
  article-title: Schemelens: A content‐aware vector‐based fisheye technique for navigating large systems diagrams
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 31
  issue: 1
  year: 2018
  article-title: A practical primer to power analysis for simple experimental designs
  publication-title: International Review of Social Psychology
– volume: 5
  start-page: 299
  issue: 4
  year: 2013
  end-page: 373
  article-title: Some whys and hows of experiments in human–computer interaction
  publication-title: Foundations and Trends in Human‐Computer Interaction
– volume: 26
  start-page: 536
  issue: 1
  year: 2019
  end-page: 546
  article-title: There is no spoon: Evaluating performance, space use, and presence with expert domain users in immersive analytics
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– volume: 79
  start-page: 328
  year: 2018
  end-page: 348
  article-title: Analyzing ordinal data with metric models: What could possibly go wrong?
  publication-title: Journal of Experimental Social Psychology
– start-page: 2391
  year: 2010
  end-page: 2394
– volume: 8
  start-page: 1
  issue: 1
  year: 2010
  end-page: 7
  article-title: Current sample size conventions: flaws, harms, and alternatives
  publication-title: BMC medicine
– volume: 20
  start-page: 1783
  issue: 12
  year: 2014
  end-page: 1792
  article-title: Decisionflow: Visual analytics for high‐dimensional temporal event sequence data
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– ident: e_1_2_9_29_2
  doi: 10.3758/BF03193146
– ident: e_1_2_9_50_2
  doi: 10.1145/2207676.2208557
– ident: e_1_2_9_2_2
– ident: e_1_2_9_63_2
  doi: 10.1007/s10459-010-9222-y
– ident: e_1_2_9_83_2
  doi: 10.1016/j.ijresmar.2010.02.004
– ident: e_1_2_9_11_2
  doi: 10.1109/TVCG.2011.193
– ident: e_1_2_9_84_2
  doi: 10.1177/0013164404268674
– ident: e_1_2_9_13_2
  doi: 10.1109/TVCG.2015.2467962
– ident: e_1_2_9_25_2
  doi: 10.1109/TVCG.2016.2598594
– ident: e_1_2_9_72_2
  doi: 10.1109/TVCG.2018.2841385
– ident: e_1_2_9_38_2
  doi: 10.1109/TVCG.2018.2864889
– ident: e_1_2_9_79_2
  doi: 10.2307/2333709
– ident: e_1_2_9_32_2
  doi: 10.1109/TVCG.2014.2346682
– ident: e_1_2_9_6_2
  doi: 10.1186/1741-7015-8-17
– ident: e_1_2_9_86_2
  doi: 10.1109/TVCG.2014.2346352
– ident: e_1_2_9_87_2
  doi: 10.1109/TVCG.2019.2934208
– ident: e_1_2_9_76_2
– ident: e_1_2_9_67_2
– ident: e_1_2_9_46_2
  doi: 10.1109/BELIV.2018.8634392
– ident: e_1_2_9_65_2
  doi: 10.1109/TVCG.2014.2346445
– ident: e_1_2_9_58_2
  doi: 10.1109/TVCG.2016.2598603
– ident: e_1_2_9_73_2
  doi: 10.2307/2685679
– ident: e_1_2_9_34_2
  doi: 10.1016/j.cptl.2015.08.001
– ident: e_1_2_9_66_2
  doi: 10.1109/TVCG.2016.2598828
– ident: e_1_2_9_82_2
  doi: 10.1109/TVCG.2016.2598867
– ident: e_1_2_9_15_2
  doi: 10.1109/VAST.2010.5652885
– ident: e_1_2_9_90_2
  doi: 10.1109/TVCG.2015.2467202
– ident: e_1_2_9_88_2
  doi: 10.1109/VAST.2009.5332595
– ident: e_1_2_9_31_2
  doi: 10.1109/TVCG.2014.2346406
– ident: e_1_2_9_36_2
  doi: 10.3102/00028312006004515
– volume: 5
  start-page: 299
  issue: 4
  year: 2013
  ident: e_1_2_9_37_2
  article-title: Some whys and hows of experiments in human–computer interaction
  publication-title: Foundations and Trends in Human‐Computer Interaction
– ident: e_1_2_9_75_2
  doi: 10.1109/TVCG.2016.2598826
– ident: e_1_2_9_48_2
  doi: 10.1109/TVCG.2013.240
– ident: e_1_2_9_80_2
  doi: 10.1109/TVCG.2018.2864899
– ident: e_1_2_9_9_2
  doi: 10.1145/3290607.3310432
– ident: e_1_2_9_47_2
  doi: 10.1145/1753326.1753686
– ident: e_1_2_9_33_2
  doi: 10.1007/978-3-319-19425-7_2
– ident: e_1_2_9_41_2
  doi: 10.1109/TVCG.2011.160
– volume: 11
  issue: 1
  year: 2015
  ident: e_1_2_9_70_2
  article-title: Exploring slider vs. categorical response formats in web‐based surveys
  publication-title: Journal of Research Practice
– ident: e_1_2_9_60_2
  doi: 10.1109/TVCG.2018.2834923
– ident: e_1_2_9_43_2
  doi: 10.1109/TVCG.2013.126
– ident: e_1_2_9_26_2
– ident: e_1_2_9_57_2
  doi: 10.1109/TVCG.2018.2865193
– ident: e_1_2_9_71_2
  doi: 10.1109/TVCG.2012.255
– ident: e_1_2_9_8_2
  doi: 10.1109/TVCG.2019.2934803
– volume: 26
  start-page: 547
  issue: 1
  year: 2019
  ident: e_1_2_9_45_2
  article-title: Deadeye visualization revisited: Investigation of preattentiveness and applicability in virtual environments
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– ident: e_1_2_9_56_2
  doi: 10.1016/j.jesp.2018.08.009
– ident: e_1_2_9_7_2
  doi: 10.1109/TVCG.2018.2865142
– ident: e_1_2_9_91_2
  doi: 10.1109/TVCG.2018.2865020
– ident: e_1_2_9_89_2
  doi: 10.1109/TVCG.2018.2865192
– ident: e_1_2_9_30_2
  doi: 10.1109/TVCG.2015.2467752
– ident: e_1_2_9_42_2
  doi: 10.1109/VAST.2010.5652880
– ident: e_1_2_9_44_2
  doi: 10.1111/j.1365-2929.2004.02012.x
– ident: e_1_2_9_74_2
  doi: 10.1086/269282
– ident: e_1_2_9_12_2
  doi: 10.1109/TVCG.2016.2598958
– volume: 26
  start-page: 971
  issue: 1
  year: 2019
  ident: e_1_2_9_27_2
  article-title: Temporal views of flattened mitral valve geometries
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– ident: e_1_2_9_69_2
  doi: 10.1109/TVCG.2014.2346291
– ident: e_1_2_9_53_2
  doi: 10.1109/TVCG.2018.2864526
– ident: e_1_2_9_52_2
  doi: 10.1109/TVCG.2011.279
– ident: e_1_2_9_85_2
  doi: 10.1109/TVCG.2012.225
– ident: e_1_2_9_21_2
  doi: 10.1109/TVCG.2015.2467035
– ident: e_1_2_9_4_2
  doi: 10.1109/TVCG.2015.2467322
– ident: e_1_2_9_17_2
  doi: 10.1145/3360311
– ident: e_1_2_9_28_2
– ident: e_1_2_9_39_2
  doi: 10.1016/S0166-4115(08)62386-9
– ident: e_1_2_9_68_2
  doi: 10.1109/TVCG.2015.2467271
– ident: e_1_2_9_18_2
  doi: 10.1109/BELIV.2018.8634420
– ident: e_1_2_9_20_2
– ident: e_1_2_9_22_2
  doi: 10.1109/BELIV51497.2020.00013
– ident: e_1_2_9_64_2
  doi: 10.5334/irsp.181
– ident: e_1_2_9_35_2
  doi: 10.1080/13645570802648077
– ident: e_1_2_9_14_2
  doi: 10.1145/2858036.2858498
– ident: e_1_2_9_40_2
  doi: 10.1109/TVCG.2013.197
– ident: e_1_2_9_77_2
  doi: 10.1126/science.103.2684.677
– ident: e_1_2_9_55_2
– volume: 26
  start-page: 87
  issue: 1
  year: 2019
  ident: e_1_2_9_59_2
  article-title: Criteria for rigor in visualization design study
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– ident: e_1_2_9_62_2
  doi: 10.1111/1365-2664.13571
– ident: e_1_2_9_10_2
  doi: 10.1109/TVCG.2016.2599217
– ident: e_1_2_9_81_2
  doi: 10.1109/TVCG.2017.2744138
– ident: e_1_2_9_19_2
  doi: 10.1145/3173574.3173715
– ident: e_1_2_9_49_2
  doi: 10.1145/2993901.2993909
– ident: e_1_2_9_23_2
  doi: 10.1111/j.1365-2923.2008.03172.x
– ident: e_1_2_9_78_2
  doi: 10.1109/TVCG.2016.2598466
– volume: 189
  start-page: 4
  issue: 194
  year: 1996
  ident: e_1_2_9_5_2
  article-title: Sus‐A quick and dirty usability scale
  publication-title: Usability Evaluation in Industry
– ident: e_1_2_9_16_2
  doi: 10.5032/jae.1994.04031
– ident: e_1_2_9_61_2
  doi: 10.1016/S0025-326X(01)00097-2
– ident: e_1_2_9_54_2
  doi: 10.1080/10447319309526075
– volume: 26
  start-page: 1086
  issue: 1
  year: 2019
  ident: e_1_2_9_3_2
  article-title: Fairsight: Visual analytics for fairness in decision making
  publication-title: IEEE Transactions on Visualization and Computer Graphics
– ident: e_1_2_9_24_2
  doi: 10.1002/pfi.21727
– volume: 26
  start-page: 611
  issue: 1
  year: 2019
  ident: e_1_2_9_51_2
  article-title: Pattern‐driven navigation in 2d multi‐scale visualizations with scalable insets
  publication-title: IEEE Transactions on Visualization and Computer Graphics
SSID ssj0004765
Score 2.614152
Snippet Likert scales are often used in visualization evaluations to produce quantitative estimates of subjective attributes, such as ease of use or aesthetic appeal....
SourceID proquest
crossref
wiley
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 43
SubjectTerms Best practice
CCS Concepts
Empirical studies in visualization
Evaluation
Human‐centered computing → Visualization design and evaluation methods
Reliability analysis
Systematic review
Visualization
Title Effective Use of Likert Scales in Visualization Evaluations: A Systematic Review
URI https://onlinelibrary.wiley.com/doi/abs/10.1111%2Fcgf.14521
https://www.proquest.com/docview/2700994381
Volume 41
WOSCitedRecordID wos000842261500006&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVWIB
  databaseName: Wiley Online Library - Journals
  customDbUrl:
  eissn: 1467-8659
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0004765
  issn: 0167-7055
  databaseCode: DRFUL
  dateStart: 19970101
  isFulltext: true
  titleUrlDefault: https://onlinelibrary.wiley.com
  providerName: Wiley-Blackwell
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3NS8MwFH-MzYMe_BanU4J48FJok_Qjehpz1cMYw7mxW0nTRArSyTr9-0365QQFwVsPr2l5H8l7SX6_B3BtM-G5Scx1mUqlRUWQWCx2YitxpWcSDg8XKP75yB-Pg8WCTVpwV2NhSn6IZsPNREYxX5sA53G-EeTiRekwdw2IvIO139I2dO6fwtnoCxbpe25N7W1IYypiIXORp3n5-3L0lWNuZqrFUhPu_esn92G3yjBRv3SJA2jJ7BB2NngHj2BSchbriQ7NcomWCo1SA95BU20xmaM0Q_M0N3DLEqSJhg0neH6L-mja0D-j8mzhGGbh8HnwaFWtFSyBme9YPuYc20J6TOqSJPFIYiozGSshWOIoXfbFyhHY9BQixKGCMttT1ObESZji3Ccn0M6WmTwFpFyJHWVLwjihtlKBHlUZ2kk30MURcbtwU2s4EhXvuGl_8RrV9YdWUlQoqQtXjehbSbbxk1CvNlNUxVsemeNzxgxdmf5cYZDfB4gGD2HxcPZ30XPYxgb3UGy_9KC9Xr3LC9gSH-s0X11WjvcJKrHZiA
linkProvider Wiley-Blackwell
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3dS8MwED_GJqgPfovTqUF88KXQNk3biC9jbk6sY7gP9lbaNJGCdLJO_36Tfm2CguBbH65pyd0ld5f8fgdwrVNmkygMZJpqcc1ibqTR0Ai1iHBbBRy2maH4p54zGLizGR3W4K7EwuT8EFXBTXlGtl4rB1cF6TUvZ69C-jlRKPKGJc2I1KFx_9KbeCtcpGOTkttbscYUzELqJk_18vf9aBVkroeq2V7T2_3fX-7BThFjonZuFPtQ48kBbK8xDx7CMGctlksdmqQczQXyYgXfQSOpM56iOEHTOFWAyxymiboVK3h6i9poVBFAo_x04Qgmve6409eK5goaM6ljaI4ZBKbOuE25TEoiG0cqN-OhYIxGhpCJXygMZqquQhgbFrOobgtLD7ARUREEDj6GejJP-AkgQbhpCJ1jGmBLF8KVowpFPElcmR5h0oSbcop9VjCPqwYYb36ZgchJ8rNJasJVJfqe0238JNQq9eQXHpf66gCdUkVYJj-XaeT3AfzOQy97OP276CVs9sfPnu89Dp7OYMtUKIisGNOC-nLxwc9hg30u43RxUVjhFz6Q3Xg
linkToPdf http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1bS8MwFA5jE9EH7-J0ahAffCm0TZM24svYrIplDOfG3kqbixSkG-v095v0tgkKgm99OE1LTr7knCTfdwC4NikjmMeRSlMdYTjM4waNrdjgWBAdcBA7Z_FPAncw8KZTOmyAu4oLU-hD1BtuGhn5fK0BLuZcrqGcvUmFc6xZ5C0HU6Jg2eq_-ONgxYt0Ca60vbVqTKkspG_y1C9_X49WQeZ6qJqvNf7u__5yD-yUMSbsFoNiHzREegC215QHD8GwUC1WUx0cZwLOJAwSTd-BI-UzkcEkhZMk04TLgqYJ72tV8OwWduGoFoCGxenCERj796-9R6MsrmAwm7qW4dpRZJtMECpUUsIJ4jo3E7FkjHJLqsQvlhazdVUhhCyHOdQk0jEjZHEqo8hFx6CZzlJxAqDEwrakKRCNkGNK6alWpRaexJ5KjxBug5uqi0NWKo_rAhjvYZWBqE4K805qg6vadF7Ibfxk1Kn8FJaIy0J9gE6pFixTn8s98nsDYe_Bzx9O_256CTaHfT8MngbPZ2DL1iSIfC-mA5rLxYc4Bxvsc5lki4tyEH4B-13c8w
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Effective+Use+of+Likert+Scales+in+Visualization+Evaluations%3A+A+Systematic+Review&rft.jtitle=Computer+graphics+forum&rft.au=South%2C+Laura&rft.au=Saffo%2C+David&rft.au=Vitek%2C+Olga&rft.au=Dunne%2C+Cody&rft.date=2022-06-01&rft.issn=0167-7055&rft.eissn=1467-8659&rft.volume=41&rft.issue=3&rft.spage=43&rft.epage=55&rft_id=info:doi/10.1111%2Fcgf.14521&rft.externalDBID=10.1111%252Fcgf.14521&rft.externalDocID=CGF14521
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0167-7055&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0167-7055&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0167-7055&client=summon