Presentation and response timing accuracy in Adobe Flash and HTML5/JavaScript Web experiments

Web-based research is becoming ubiquitous in the behavioral sciences, facilitated by convenient, readily available participant pools and relatively straightforward ways of running experiments: most recently, through the development of the HTML5 standard. Although in most studies participants give un...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Behavior research methods Ročník 47; číslo 2; s. 309 - 327
Hlavní autori: Reimers, Stian, Stewart, Neil
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: New York Springer US 01.06.2015
Springer Nature B.V
Predmet:
ISSN:1554-3528, 1554-351X, 1554-3528
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Abstract Web-based research is becoming ubiquitous in the behavioral sciences, facilitated by convenient, readily available participant pools and relatively straightforward ways of running experiments: most recently, through the development of the HTML5 standard. Although in most studies participants give untimed responses, there is a growing interest in being able to record response times online. Existing data on the accuracy and cross-machine variability of online timing measures are limited, and generally they have compared behavioral data gathered on the Web with similar data gathered in the lab. For this article, we took a more direct approach, examining two ways of running experiments online—Adobe Flash and HTML5 with CSS3 and JavaScript—across 19 different computer systems. We used specialist hardware to measure stimulus display durations and to generate precise response times to visual stimuli in order to assess measurement accuracy, examining effects of duration, browser, and system-to-system variability (such as across different Windows versions), as well as effects of processing power and graphics capability. We found that (a) Flash and JavaScript’s presentation and response time measurement accuracy are similar; (b) within-system variability is generally small, even in low-powered machines under high load; (c) the variability of measured response times across systems is somewhat larger; and (d) browser type and system hardware appear to have relatively small effects on measured response times. Modeling of the effects of this technical variability suggests that for most within- and between-subjects experiments, Flash and JavaScript can both be used to accurately detect differences in response times across conditions. Concerns are, however, noted about using some correlational or longitudinal designs online.
AbstractList Web-based research is becoming ubiquitous in the behavioral sciences, facilitated by convenient, readily available participant pools and relatively straightforward ways of running experiments: most recently, through the development of the HTML5 standard. Although in most studies participants give untimed responses, there is a growing interest in being able to record response times online. Existing data on the accuracy and cross-machine variability of online timing measures are limited, and generally they have compared behavioral data gathered on the Web with similar data gathered in the lab. For this article, we took a more direct approach, examining two ways of running experiments online -- Adobe Flash and HTML5 with CSS3 and JavaScript -- across 19 different computer systems. We used specialist hardware to measure stimulus display durations and to generate precise response times to visual stimuli in order to assess measurement accuracy, examining effects of duration, browser, and system-to-system variability (such as across different Windows versions), as well as effects of processing power and graphics capability. We found that (a) Flash and JavaScript's presentation and response time measurement accuracy are similar; (b) within-system variability is generally small, even in low-powered machines under high load; (c) the variability of measured response times across systems is somewhat larger; and (d) browser type and system hardware appear to have relatively small effects on measured response times. Modeling of the effects of this technical variability suggests that for most within- and between-subjects experiments, Flash and JavaScript can both be used to accurately detect differences in response times across conditions. Concerns are, however, noted about using some correlational or longitudinal designs online.
Web-based research is becoming ubiquitous in the behavioral sciences, facilitated by convenient, readily available participant pools and relatively straightforward ways of running experiments: most recently, through the development of the HTML5 standard. Although in most studies participants give untimed responses, there is a growing interest in being able to record response times online. Existing data on the accuracy and cross-machine variability of online timing measures are limited, and generally they have compared behavioral data gathered on the Web with similar data gathered in the lab. For this article, we took a more direct approach, examining two ways of running experiments online-Adobe Flash and HTML5 with CSS3 and JavaScript-across 19 different computer systems. We used specialist hardware to measure stimulus display durations and to generate precise response times to visual stimuli in order to assess measurement accuracy, examining effects of duration, browser, and system-to-system variability (such as across different Windows versions), as well as effects of processing power and graphics capability. We found that (a) Flash and JavaScript's presentation and response time measurement accuracy are similar; (b) within-system variability is generally small, even in low-powered machines under high load; (c) the variability of measured response times across systems is somewhat larger; and (d) browser type and system hardware appear to have relatively small effects on measured response times. Modeling of the effects of this technical variability suggests that for most within- and between-subjects experiments, Flash and JavaScript can both be used to accurately detect differences in response times across conditions. Concerns are, however, noted about using some correlational or longitudinal designs online.Web-based research is becoming ubiquitous in the behavioral sciences, facilitated by convenient, readily available participant pools and relatively straightforward ways of running experiments: most recently, through the development of the HTML5 standard. Although in most studies participants give untimed responses, there is a growing interest in being able to record response times online. Existing data on the accuracy and cross-machine variability of online timing measures are limited, and generally they have compared behavioral data gathered on the Web with similar data gathered in the lab. For this article, we took a more direct approach, examining two ways of running experiments online-Adobe Flash and HTML5 with CSS3 and JavaScript-across 19 different computer systems. We used specialist hardware to measure stimulus display durations and to generate precise response times to visual stimuli in order to assess measurement accuracy, examining effects of duration, browser, and system-to-system variability (such as across different Windows versions), as well as effects of processing power and graphics capability. We found that (a) Flash and JavaScript's presentation and response time measurement accuracy are similar; (b) within-system variability is generally small, even in low-powered machines under high load; (c) the variability of measured response times across systems is somewhat larger; and (d) browser type and system hardware appear to have relatively small effects on measured response times. Modeling of the effects of this technical variability suggests that for most within- and between-subjects experiments, Flash and JavaScript can both be used to accurately detect differences in response times across conditions. Concerns are, however, noted about using some correlational or longitudinal designs online.
Author Stewart, Neil
Reimers, Stian
Author_xml – sequence: 1
  givenname: Stian
  surname: Reimers
  fullname: Reimers, Stian
  email: stian.reimers@city.ac.uk
  organization: Department of Psychology, City University London
– sequence: 2
  givenname: Neil
  surname: Stewart
  fullname: Stewart, Neil
  organization: Department of Psychology, University of Warwick
BackLink https://www.ncbi.nlm.nih.gov/pubmed/24903687$$D View this record in MEDLINE/PubMed
BookMark eNp9kU1rFTEYhYNU7If-ADcScONmbD4nmY1Qim2VKwpWXEnIzbxzmzI3GZOZYv99M04r14KukpDnnJw35xDthRgAoZeUvOVK6uNMuWC6IlRURCha0SfogEopKi6Z3tvZ76PDnK8J4ZpR8QztM9EQXmt1gH58SZAhjHb0MWAbWlzOQwwZ8Oi3PmywdW5K1t1iH_BJG9eAz3qbr36zF5efVvL4o72xX13yw4i_wxrDrwGS3xbT_Bw97Wyf4cX9eoS-nb2_PL2oVp_PP5yerCpX83qsnCXSES7aBpSQSnbAytbyGiQDxWXXSg6OK13zFihtG0saViZxhEDXOsqP0LvFd5jWW2hdeTvZ3gwlhk23Jlpv_r4J_sps4o0RgqlasmLw5t4gxZ8T5NFsfXbQ9zZAnLKhtSZKNFrpgr5-hF7HKYUy3kxJQbmsZ8NXu4n-RHn4-QKoBXAp5pygM84vLZSAvjeUmLljs3RsSsdm7tjMw9JHygfz_2nYosmFDRtIO6H_KboDsdi42Q
CitedBy_id crossref_primary_10_3389_fpsyg_2020_01839
crossref_primary_10_1007_s10683_017_9528_1
crossref_primary_10_3758_s13428_020_01501_5
crossref_primary_10_1080_13854046_2018_1535662
crossref_primary_10_1525_collabra_255
crossref_primary_10_1016_j_schres_2018_06_065
crossref_primary_10_1016_j_applanim_2018_04_015
crossref_primary_10_1016_j_drugpo_2025_104753
crossref_primary_10_1097_FBP_0000000000000508
crossref_primary_10_1016_j_actpsy_2019_102942
crossref_primary_10_3758_s13423_018_1555_1
crossref_primary_10_3758_s13428_016_0783_4
crossref_primary_10_1080_13803395_2021_1982867
crossref_primary_10_1016_j_tics_2017_06_007
crossref_primary_10_1016_j_ijforecast_2022_11_003
crossref_primary_10_1371_journal_pone_0118715
crossref_primary_10_3758_s13428_015_0701_1
crossref_primary_10_1017_S136672892510028X
crossref_primary_10_1038_s41598_019_57204_1
crossref_primary_10_1177_19485506211044061
crossref_primary_10_3390_psych2030012
crossref_primary_10_3758_s13423_021_02006_8
crossref_primary_10_1007_s10919_019_00327_w
crossref_primary_10_1027_1618_3169_a000545
crossref_primary_10_1080_17470218_2016_1206130
crossref_primary_10_3758_s13428_018_1066_z
crossref_primary_10_1016_j_drugalcdep_2017_07_038
crossref_primary_10_1371_journal_pone_0235249
crossref_primary_10_3758_s13428_022_01835_2
crossref_primary_10_3758_s13428_019_01283_5
crossref_primary_10_3758_s13428_015_0677_x
crossref_primary_10_1016_j_system_2023_103094
crossref_primary_10_3389_fnbeh_2022_946263
crossref_primary_10_3389_fpsyg_2019_02529
crossref_primary_10_1007_s12207_023_09495_z
crossref_primary_10_1007_s00426_024_02065_1
crossref_primary_10_1007_s11199_023_01411_8
crossref_primary_10_3758_s13428_015_0678_9
crossref_primary_10_3758_s13428_018_1155_z
crossref_primary_10_1093_arclin_acab073
crossref_primary_10_3389_fpsyg_2021_734877
crossref_primary_10_1016_j_cognition_2017_11_002
crossref_primary_10_1016_j_jml_2020_104188
crossref_primary_10_1027_2151_2604_a000475
crossref_primary_10_1027_1864_1105_a000312
crossref_primary_10_3758_s13428_021_01768_2
crossref_primary_10_1016_j_actpsy_2023_103944
crossref_primary_10_1177_0018720818787126
crossref_primary_10_1007_s11031_022_09953_2
crossref_primary_10_3758_s13428_021_01742_y
crossref_primary_10_1007_s00426_023_01870_4
crossref_primary_10_3758_s13428_016_0758_5
crossref_primary_10_1080_23743603_2017_1298356
crossref_primary_10_1016_j_cogpsych_2017_08_003
crossref_primary_10_1098_rsos_210550
crossref_primary_10_1177_2381468320914307
crossref_primary_10_3758_s13428_019_01237_x
crossref_primary_10_1007_s10608_016_9777_x
crossref_primary_10_1016_j_rmal_2023_100045
crossref_primary_10_3389_fneur_2025_1558493
crossref_primary_10_3758_s13428_019_01272_8
crossref_primary_10_1371_journal_pone_0109812
crossref_primary_10_1016_j_rmal_2025_100247
crossref_primary_10_3758_s13428_020_01445_w
crossref_primary_10_3758_s13428_018_1036_5
crossref_primary_10_3758_s13428_022_01885_6
crossref_primary_10_3390_fi13100245
crossref_primary_10_1371_journal_pone_0231152
crossref_primary_10_3758_s13428_018_1126_4
crossref_primary_10_1002_acp_3759
crossref_primary_10_3758_s13428_024_02533_x
crossref_primary_10_1016_j_socec_2018_05_006
crossref_primary_10_1080_20445911_2022_2089153
crossref_primary_10_7717_peerj_8339
crossref_primary_10_1007_s00426_022_01650_6
crossref_primary_10_3389_fpsyg_2024_1451309
crossref_primary_10_1109_TG_2019_2905230
crossref_primary_10_3758_s13428_020_01395_3
crossref_primary_10_1177_17470218211031158
crossref_primary_10_1038_srep32689
crossref_primary_10_3758_s13428_016_0824_z
crossref_primary_10_1016_j_ijhcs_2021_102661
crossref_primary_10_1016_j_cortex_2024_11_019
crossref_primary_10_3390_brainsci12081061
crossref_primary_10_3758_s13428_015_0632_x
crossref_primary_10_3758_s13428_019_01293_3
crossref_primary_10_7717_peerj_9414
crossref_primary_10_1080_23273798_2025_2533864
crossref_primary_10_1038_s41598_025_93061_x
crossref_primary_10_3758_s13428_021_01559_9
crossref_primary_10_3390_brainsci10040251
crossref_primary_10_1016_j_jml_2015_06_002
crossref_primary_10_7717_peerj_1058
crossref_primary_10_3389_fpsyg_2021_710663
crossref_primary_10_3758_s13428_019_01321_2
crossref_primary_10_3758_s13428_016_0776_3
Cites_doi 10.1177/0894439311415604
10.3758/BRM.40.4.1170
10.1016/B978-012099980-4/50004-6
10.1016/B978-012099980-4/50002-2
10.1177/0956797611405681
10.3758/BF03193004
10.3758/s13428-011-0069-9
10.1007/s10508-006-9143-2
10.3758/s13428-013-0345-y
10.3758/BF03202553
10.3758/BF03195449
10.3758/BRM.41.1.12
10.1017/S1930297500003995
10.1037/0012-1649.41.4.661
10.3758/BF03195575
10.3758/BRM.42.1.205
10.1371/journal.pone.0057410
10.1371/journal.pone.0076564
10.3758/s13428-011-0124-6
10.3758/s13428-013-0365-7
10.1371/journal.pone.0067769
10.3758/s13415-013-0166-6
10.1287/mnsc.2013.1853
ContentType Journal Article
Copyright The Author(s) 2014
Copyright Springer Science & Business Media Jun 2015
Copyright_xml – notice: The Author(s) 2014
– notice: Copyright Springer Science & Business Media Jun 2015
DBID C6C
AAYXX
CITATION
CGR
CUY
CVF
ECM
EIF
NPM
4T-
7TK
K9.
7X8
5PM
DOI 10.3758/s13428-014-0471-1
DatabaseName Springer Nature OA Free Journals
CrossRef
Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
Docstoc
Neurosciences Abstracts
ProQuest Health & Medical Complete (Alumni)
MEDLINE - Academic
PubMed Central (Full Participant titles)
DatabaseTitle CrossRef
MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
ProQuest Health & Medical Complete (Alumni)
Neurosciences Abstracts
Docstoc
MEDLINE - Academic
DatabaseTitleList ProQuest Health & Medical Complete (Alumni)

MEDLINE
MEDLINE - Academic

Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: 7X8
  name: MEDLINE - Academic
  url: https://search.proquest.com/medline
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Psychology
EISSN 1554-3528
EndPage 327
ExternalDocumentID PMC4427652
3703733841
24903687
10_3758_s13428_014_0471_1
Genre Research Support, Non-U.S. Gov't
Journal Article
Feature
GroupedDBID ---
-55
-5G
-BR
-DZ
-EM
-ET
-~C
-~X
0-V
06D
0R~
0VY
199
1N0
203
23N
2J2
2JN
2JY
2KG
2KM
2LR
2VQ
30V
3V.
4.4
406
408
40E
53G
5GY
7X7
875
88E
8AO
8FI
8FJ
8G5
8TC
8UJ
95.
96X
AAAVM
AABHQ
AACDK
AAHNG
AAIAL
AAJBT
AAJKR
AAKPC
AANZL
AARTL
AASML
AATNV
AATVU
AAUYE
AAWCG
AAYIU
AAYQN
AAYTO
AAYZH
AAZMS
ABAKF
ABDZT
ABECU
ABFTV
ABHLI
ABIVO
ABJNI
ABJOX
ABJUD
ABKCH
ABMQK
ABNWP
ABPLI
ABPPZ
ABQBU
ABQSL
ABSXP
ABTEG
ABTHY
ABTKH
ABTMW
ABUWG
ABXPI
ACAOD
ACBXY
ACDTI
ACGFS
ACHQT
ACHSB
ACHXU
ACIWK
ACKIV
ACKNC
ACMDZ
ACMLO
ACNCT
ACOKC
ACPIV
ACPRK
ACZOJ
ADBBV
ADHHG
ADHIR
ADINQ
ADKNI
ADKPE
ADURQ
ADYFF
ADZKW
AEBTG
AEFQL
AEGAL
AEGNC
AEJHL
AEJRE
AEKMD
AEMSY
AEOHA
AEPYU
AESKC
AETCA
AEVLU
AEXYK
AFBBN
AFFNX
AFKRA
AFQWF
AFRAH
AFWTZ
AFZKB
AGAYW
AGDGC
AGJBK
AGMZJ
AGQEE
AGQMX
AGRTI
AGWIL
AGWZB
AGYKE
AHAVH
AHBYD
AHMBA
AHSBF
AHYZX
AIAKS
AIGIU
AIIXL
AILAN
AITGF
AJBLW
AJRNO
AJZVZ
ALIPV
ALMA_UNASSIGNED_HOLDINGS
ALSLI
AMKLP
AMXSW
AMYLF
AMYQR
AOCGG
ARALO
ARMRJ
ASPBG
AVWKF
AXYYD
AYQZM
AZFZN
AZQEC
B-.
BAWUL
BENPR
BGNMA
BPHCQ
BVXVI
C1A
C6C
CAG
CCPQU
COF
CSCUP
DDRTE
DIK
DNIVK
DPUIP
DWQXO
E3Z
EBD
EBLON
EBS
EIOEI
EJD
EMOBN
ESBYG
F5P
FEDTE
FERAY
FFXSO
FIGPU
FINBP
FNLPD
FRRFC
FSGXE
FYUFA
GGCAI
GGRSB
GJIRD
GNUQQ
GNWQR
GQ3
GQ6
GQ7
GUQSH
H13
HF~
HMCUK
HMJXF
HRMNR
HVGLF
HZ~
H~9
IAO
IHR
IKXTQ
INH
IPY
IRVIT
ITC
ITM
IWAJR
J-C
JBSCW
JZLTJ
KOV
LLZTM
M1P
M2M
M2O
M2R
M4Y
MVM
N2Q
N9A
NB0
NPVJJ
NQJWS
NU0
O9-
O93
O9G
O9J
OHT
OK1
P2P
P9L
PADUT
PF-
PQQKQ
PROAC
PSQYO
PSYQQ
PT4
R9I
RIG
ROL
RPV
RSV
S16
S1Z
S27
S3B
SBS
SBU
SCLPG
SHX
SISQX
SJYHP
SNE
SNPRN
SNX
SOHCF
SOJ
SPISZ
SRMVM
SSLCW
SSXJD
STPWE
SV3
SZN
T13
TN5
TR2
TSG
TUC
TUS
U2A
U9L
UG4
UKHRP
UOJIU
UPT
UTJUX
UZXMN
VFIZW
VXZ
W48
WH7
WK8
XJT
XOL
XSW
Z7R
Z7S
Z7W
Z81
Z83
Z88
Z8N
Z92
ZMTXR
ZOVNA
ZUP
AAPKM
AAYXX
ABBRH
ABDBE
ABFSG
ABRTQ
ACSTC
ADHKG
AEZWR
AFDZB
AFFHD
AFHIU
AFOHR
AGQPQ
AHPBZ
AHWEU
AIXLP
ATHPR
AYFIA
CITATION
PHGZM
PHGZT
PJZUB
PPXIY
PRQQA
CGR
CUY
CVF
ECM
EIF
NPM
4T-
7TK
K9.
7X8
5PM
ID FETCH-LOGICAL-c636t-ca05c034d9e74575fe2d9ea36e52e735fd53ec37863de11d9a092214c00efdc13
IEDL.DBID RSV
ISICitedReferencesCount 114
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000357610200001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1554-3528
1554-351X
IngestDate Tue Nov 04 01:58:19 EST 2025
Thu Oct 02 05:29:23 EDT 2025
Mon Nov 24 02:42:18 EST 2025
Mon Jul 21 06:01:23 EDT 2025
Tue Nov 18 22:34:19 EST 2025
Sat Nov 29 02:18:04 EST 2025
Fri Feb 21 02:36:56 EST 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 2
Keywords Reaction time
Internet
Response time
Web
Display
Language English
License Open Access This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c636t-ca05c034d9e74575fe2d9ea36e52e735fd53ec37863de11d9a092214c00efdc13
Notes SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 14
ObjectType-Article-1
ObjectType-Feature-2
content type line 23
OpenAccessLink https://link.springer.com/10.3758/s13428-014-0471-1
PMID 24903687
PQID 1685413562
PQPubID 976348
PageCount 19
ParticipantIDs pubmedcentral_primary_oai_pubmedcentral_nih_gov_4427652
proquest_miscellaneous_1680749878
proquest_journals_1685413562
pubmed_primary_24903687
crossref_citationtrail_10_3758_s13428_014_0471_1
crossref_primary_10_3758_s13428_014_0471_1
springer_journals_10_3758_s13428_014_0471_1
PublicationCentury 2000
PublicationDate 2015-06-01
PublicationDateYYYYMMDD 2015-06-01
PublicationDate_xml – month: 06
  year: 2015
  text: 2015-06-01
  day: 01
PublicationDecade 2010
PublicationPlace New York
PublicationPlace_xml – name: New York
– name: United States
PublicationTitle Behavior research methods
PublicationTitleAbbrev Behav Res
PublicationTitleAlternate Behav Res Methods
PublicationYear 2015
Publisher Springer US
Springer Nature B.V
Publisher_xml – name: Springer US
– name: Springer Nature B.V
References CR18
CR15
CR14
CR13
CR10
Reimers, Stewart (CR19) 2007; 39
Birnbaum, Birnbaum (CR1) 2000
CR4
CR3
CR6
Reimers (CR17) 2009; 4
CR5
CR8
CR9
CR26
CR25
Kassam, Morewedge, Gilbert, Wilson (CR7) 2011; 22
CR24
CR23
CR22
CR21
Neath, Earle, Hallett, Surprenant (CR12) 2011; 43
Brand, Bradley (CR2) 2012; 30
Musch, Reips, Birnbaum (CR11) 2000
Reimers, Stewart (CR20) 2008; 40
Reimers (CR16) 2007; 36
MH Birnbaum (471_CR1) 2000
471_CR9
J Musch (471_CR11) 2000
471_CR8
471_CR5
471_CR14
471_CR4
471_CR13
471_CR6
471_CR18
471_CR3
471_CR15
S Reimers (471_CR16) 2007; 36
471_CR21
S Reimers (471_CR17) 2009; 4
A Brand (471_CR2) 2012; 30
I Neath (471_CR12) 2011; 43
S Reimers (471_CR20) 2008; 40
471_CR25
S Reimers (471_CR19) 2007; 39
471_CR24
471_CR23
471_CR22
471_CR26
471_CR10
KS Kassam (471_CR7) 2011; 22
23516406 - PLoS One. 2013;8(3):e57410
17958146 - Behav Res Methods. 2007 Aug;39(3):365-70
12834085 - Behav Res Methods Instrum Comput. 2003 May;35(2):276-84
17380377 - Arch Sex Behav. 2007 Apr;36(2):147-61
12109018 - Behav Res Methods Instrum Comput. 2002 May;34(2):234-40
23670340 - Behav Res Methods. 2014 Mar;46(1):95-111
21515740 - Psychol Sci. 2011 May;22(5):602-6
24146890 - PLoS One. 2013;8(10):e76564
23805326 - PLoS One. 2013 Jun 21;8(6):e67769
21416303 - Behav Res Methods. 2011 Jun;43(2):353-62
23640111 - Cogn Affect Behav Neurosci. 2013 Sep;13(3):598-614
21717266 - Behav Res Methods. 2012 Mar;44(1):1-23
15354695 - Behav Res Methods Instrum Comput. 2004 May;36(2):291-303
19182118 - Behav Res Methods. 2009 Feb;41(1):1-12
20160300 - Behav Res Methods. 2010 Feb;42(1):205-11
16060812 - Dev Psychol. 2005 Jul;41(4):661-71
19001409 - Behav Res Methods. 2008 Nov;40(4):1170-6
23835650 - Behav Res Methods. 2014 Mar;46(1):112-30
References_xml – ident: CR22
– volume: 30
  start-page: 350
  year: 2012
  end-page: 357
  ident: CR2
  article-title: Assessing the effects of technical variance on the statistical outcomes of web experiments measuring response times
  publication-title: Social Science Computer Review
  doi: 10.1177/0894439311415604
– ident: CR18
– ident: CR4
– ident: CR14
– ident: CR10
– volume: 40
  start-page: 1170
  year: 2008
  end-page: 1176
  ident: CR20
  article-title: Using Adobe Flash Lite on mobile phones for psychological research: Reaction time measurement reliability and interdevice variability
  publication-title: Behavior Research Methods
  doi: 10.3758/BRM.40.4.1170
– ident: CR6
– start-page: 61
  year: 2000
  end-page: 88
  ident: CR11
  article-title: A brief history of Web experimenting
  publication-title: Psychological experiments on the Internet
  doi: 10.1016/B978-012099980-4/50004-6
– start-page: 3
  year: 2000
  end-page: 34
  ident: CR1
  article-title: Decision making in the lab and on the Web
  publication-title: Psychological experiments on the Internet
  doi: 10.1016/B978-012099980-4/50002-2
– ident: CR8
– ident: CR25
– volume: 22
  start-page: 602
  year: 2011
  end-page: 606
  ident: CR7
  article-title: Winners love winning and losers love money
  publication-title: Psychological Science
  doi: 10.1177/0956797611405681
– volume: 4
  start-page: 461
  year: 2009
  end-page: 466
  ident: CR17
  article-title: A paycheck half-empty or half-full? Framing, fairness and progressive taxation
  publication-title: Judgment and Decision Making
– ident: CR23
– ident: CR21
– volume: 39
  start-page: 365
  year: 2007
  end-page: 370
  ident: CR19
  article-title: Adobe Flash as a medium for online experimentation: A test of reaction time measurement capabilities
  publication-title: Behavior Research Methods
  doi: 10.3758/BF03193004
– ident: CR3
– ident: CR15
– ident: CR13
– ident: CR9
– volume: 43
  start-page: 353
  year: 2011
  end-page: 362
  ident: CR12
  article-title: Response time accuracy in Apple Macintosh computers
  publication-title: Behavior Research Methods
  doi: 10.3758/s13428-011-0069-9
– ident: CR5
– volume: 36
  start-page: 147
  year: 2007
  end-page: 161
  ident: CR16
  article-title: The BBC Internet study: General methodology
  publication-title: Archives of Sexual Behavior
  doi: 10.1007/s10508-006-9143-2
– ident: CR26
– ident: CR24
– volume: 39
  start-page: 365
  year: 2007
  ident: 471_CR19
  publication-title: Behavior Research Methods
  doi: 10.3758/BF03193004
– ident: 471_CR24
  doi: 10.3758/s13428-013-0345-y
– ident: 471_CR14
  doi: 10.3758/BF03202553
– volume: 40
  start-page: 1170
  year: 2008
  ident: 471_CR20
  publication-title: Behavior Research Methods
  doi: 10.3758/BRM.40.4.1170
– volume: 22
  start-page: 602
  year: 2011
  ident: 471_CR7
  publication-title: Psychological Science
  doi: 10.1177/0956797611405681
– ident: 471_CR21
  doi: 10.3758/BF03195449
– ident: 471_CR8
  doi: 10.3758/BRM.41.1.12
– volume: 4
  start-page: 461
  year: 2009
  ident: 471_CR17
  publication-title: Judgment and Decision Making
  doi: 10.1017/S1930297500003995
– ident: 471_CR18
  doi: 10.1037/0012-1649.41.4.661
– volume: 30
  start-page: 350
  year: 2012
  ident: 471_CR2
  publication-title: Social Science Computer Review
  doi: 10.1177/0894439311415604
– ident: 471_CR13
  doi: 10.3758/BF03195575
– ident: 471_CR6
  doi: 10.3758/BRM.42.1.205
– ident: 471_CR22
– start-page: 3
  volume-title: Psychological experiments on the Internet
  year: 2000
  ident: 471_CR1
  doi: 10.1016/B978-012099980-4/50002-2
– ident: 471_CR5
  doi: 10.1371/journal.pone.0057410
– ident: 471_CR9
  doi: 10.1371/journal.pone.0076564
– ident: 471_CR10
  doi: 10.3758/s13428-011-0124-6
– ident: 471_CR26
– ident: 471_CR3
– volume: 36
  start-page: 147
  year: 2007
  ident: 471_CR16
  publication-title: Archives of Sexual Behavior
  doi: 10.1007/s10508-006-9143-2
– volume: 43
  start-page: 353
  year: 2011
  ident: 471_CR12
  publication-title: Behavior Research Methods
  doi: 10.3758/s13428-011-0069-9
– start-page: 61
  volume-title: Psychological experiments on the Internet
  year: 2000
  ident: 471_CR11
  doi: 10.1016/B978-012099980-4/50004-6
– ident: 471_CR4
  doi: 10.3758/s13428-013-0365-7
– ident: 471_CR23
  doi: 10.1371/journal.pone.0067769
– ident: 471_CR15
  doi: 10.3758/s13415-013-0166-6
– ident: 471_CR25
  doi: 10.1287/mnsc.2013.1853
– reference: 15354695 - Behav Res Methods Instrum Comput. 2004 May;36(2):291-303
– reference: 19001409 - Behav Res Methods. 2008 Nov;40(4):1170-6
– reference: 23670340 - Behav Res Methods. 2014 Mar;46(1):95-111
– reference: 21515740 - Psychol Sci. 2011 May;22(5):602-6
– reference: 12834085 - Behav Res Methods Instrum Comput. 2003 May;35(2):276-84
– reference: 19182118 - Behav Res Methods. 2009 Feb;41(1):1-12
– reference: 16060812 - Dev Psychol. 2005 Jul;41(4):661-71
– reference: 12109018 - Behav Res Methods Instrum Comput. 2002 May;34(2):234-40
– reference: 21416303 - Behav Res Methods. 2011 Jun;43(2):353-62
– reference: 23805326 - PLoS One. 2013 Jun 21;8(6):e67769
– reference: 21717266 - Behav Res Methods. 2012 Mar;44(1):1-23
– reference: 17380377 - Arch Sex Behav. 2007 Apr;36(2):147-61
– reference: 23835650 - Behav Res Methods. 2014 Mar;46(1):112-30
– reference: 24146890 - PLoS One. 2013;8(10):e76564
– reference: 20160300 - Behav Res Methods. 2010 Feb;42(1):205-11
– reference: 17958146 - Behav Res Methods. 2007 Aug;39(3):365-70
– reference: 23516406 - PLoS One. 2013;8(3):e57410
– reference: 23640111 - Cogn Affect Behav Neurosci. 2013 Sep;13(3):598-614
SSID ssj0038214
Score 2.4766474
Snippet Web-based research is becoming ubiquitous in the behavioral sciences, facilitated by convenient, readily available participant pools and relatively...
SourceID pubmedcentral
proquest
pubmed
crossref
springer
SourceType Open Access Repository
Aggregation Database
Index Database
Enrichment Source
Publisher
StartPage 309
SubjectTerms Accuracy
Adult
Behavioral Research - methods
Behavioral Research - standards
Behavioral Science and Psychology
Behavioral sciences
Behavioral Sciences - methods
Cognitive Psychology
Computer graphics
Crowdsourcing - methods
Data
Data Display - standards
Dimensional Measurement Accuracy
Experiments
Humans
Hypertext
Internet
Java
Machinery
Measurement
Measures
Psychology
Reaction Time
Stimuli
Stimulus
Variability
Visual stimuli
Title Presentation and response timing accuracy in Adobe Flash and HTML5/JavaScript Web experiments
URI https://link.springer.com/article/10.3758/s13428-014-0471-1
https://www.ncbi.nlm.nih.gov/pubmed/24903687
https://www.proquest.com/docview/1685413562
https://www.proquest.com/docview/1680749878
https://pubmed.ncbi.nlm.nih.gov/PMC4427652
Volume 47
WOSCitedRecordID wos000357610200001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAVX
  databaseName: Springer Journals New Starts & Take-Overs Collection
  customDbUrl:
  eissn: 1554-3528
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0038214
  issn: 1554-3528
  databaseCode: RSV
  dateStart: 20050201
  isFulltext: true
  titleUrlDefault: https://link.springer.com/search?facet-content-type=%22Journal%22
  providerName: Springer Nature
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3daxQxEB-0-tAXrd-rbYngk7J0s_l-LKVHES3FVr0XWbLZxB7IntzeFfrfO9mv9loV9G0hE5JMJjO_7ExmAN54Z52U2qSUBZPyMuCZQ8OaShHiXwYTlLdtsQl1fKynU3PSv-Nuhmj3wSXZaup4r0RQu9dQxmM2ZRoDJxRN8cpzD62djvUaPp1-GdQv0znlnfvy993WDdAtVHk7OPKGh7Q1PJOH_zXlLXjQ40yy3wnGI7jj68ewOaq7yyfw7eTq5VFNbF2RRRcv68kylvr6Tqxzq4V1l2RWk_1qXnoyQax93tIenX38IPbe2wt72uod8tWX5KpcQPMUPk8Ozw6O0r7YQuokk8vU2Uy4jPHKeMURwwWf46dl0ovcKyZCJZh3TGnJKk9pZWxmcmS1yzIfKkfZM9io57V_AcSw0mnJNQs855UrrawUAkGh0V6iBgkJZMMOFK7PRB4LYvwo8EYSGVd0jCuQcUVkXEETeDt2-dml4fgb8fawrUV_IpuCSi3QYCPcS-D12IxnKTpIbO3nq5YGEZXRSifwvJOCcTS8pqKx1yoBtSYfI0HM073eUs_O23zdnOe4fhz33SAl16b1p0W8_CfqV7CJSE50MWzbsLFcrPwO3HcXy1mz2IW7aqp322PyC1QgDUE
linkProvider Springer Nature
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3daxQxEA9SBfvit3W1agSflKWbzfdjkR5V61Fs1b5IyObDHsie3N4V-t872a_2rAr6tpAJSSaZmd9sJjMIvQzOOiGUzgmNOmdVBJkDw5oLHtNfBh1lsG2xCTmdqpMTfdi_426GaPfhSrLV1MmvBFC70xDKUjZlkgInJMnB5bnOwGClhPkfjz4P6peqkrDu-vL33dYN0BVUeTU48pcb0tbwTG7_15TvoFs9zsS73cG4i66F-h7aHNXd-X309fDi5VGNbe3xoouXDXiZSn19w9a51cK6czyr8a6fVwFPAGuftrT7xx8O-M47e2aPWr2Dv4QKX5QLaB6gT5O94zf7eV9sIXeCimXubMFdQZnXQTLAcDGU8GmpCLwMkvLoOQ2OSiWoD4R4bQtdAqtdUYToHaEP0UY9r8MjhDWtnBJM0chK5l1lhZcABLkCewkaJGaoGHbAuD4TeSqI8d2AR5IYZzrGGWCcSYwzJEOvxi4_ujQcfyPeHrbV9BLZGCIUB4MNcC9DL8ZmkKV0QWLrMF-1NICotJIqQ1vdKRhHAzcVjL2SGZJr52MkSHm611vq2Wmbr5uxEtYP474eTsmlaf1pEY__ifo5upn23Ry8nb5_gjYB1fEunm0bbSwXq_AU3XBny1mzeNYKy0-iHA89
linkToPdf http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3raxQxEA9SRfrF92Nr1Qh-UpbbbLJ5fCzqUbUeB63aL7Jk87AHJVdu9wr9753sq55VQfy2kAlJJjOZX3YmMwi9dEYbzqVKCfUqZZUHnQPDmvLCx78Mygun22ITYjaTx8dq3tc5rYdo98El2b1piFmaQjM5sz6qOAWAO6kJZTGzMolBFIKkcP25zmIcfbyuH34ZjmIqc8I6V-bvu20aoysI82qg5C_e0tYITW__9_TvoFs9_sR7ncDcRddcuIe2x2Pw4j76Nr98kRSwDhavujhah5tYAuw71sasV9pc4EXAe3ZZOTwFDH7S0u4ffTooJh_0uT5szyP81VX4soxA_QB9nr47erOf9kUYUsMpb1Kjs8JklFnlBANs510On5pyV-RO0MLbgjpDheTUOkKs0pnKge0my5y3htCHaCssg3uMsKKVkZxJ6lnOrKk0twIAYiHBjsLJ4hOUDbtRmj5DeSyUcVrCTSUyruwYVwLjysi4kiTo1djlrEvP8Tfi3WGLy15T65JwWYAhBxiYoBdjM-hYdJzo4JbrlgaQlpJCJuhRJxHjaHB9BRAgRYLEhqyMBDF_92ZLWJy0ebwZy2H9MO7rQWJ-mtafFrHzT9TP0c3522l58H728QnaBrBXdGFuu2irWa3dU3TDnDeLevWs1ZsfvHgYIQ
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Presentation+and+response+timing+accuracy+in+Adobe+Flash+and+HTML5%2FJavaScript+Web+experiments&rft.jtitle=Behavior+research+methods&rft.au=Reimers%2C+Stian&rft.au=Stewart%2C+Neil&rft.date=2015-06-01&rft.eissn=1554-3528&rft.volume=47&rft.issue=2&rft.spage=309&rft_id=info:doi/10.3758%2Fs13428-014-0471-1&rft_id=info%3Apmid%2F24903687&rft.externalDocID=24903687
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1554-3528&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1554-3528&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1554-3528&client=summon