Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA

With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:PloS one Ročník 18; číslo 3; s. e0279720
Hlavní autoři: Douglas, Benjamin D., Ewell, Patrick J., Brauer, Markus
Médium: Journal Article
Jazyk:angličtina
Vydáno: United States Public Library of Science 14.03.2023
Public Library of Science (PLoS)
Témata:
ISSN:1932-6203, 1932-6203
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Abstract With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated by the percentage of participants who meaningfully respond to the researcher’s question (high quality) versus those who only contribute noise (low quality). We found that compared to MTurk, Qualtrics, or an undergraduate student sample (i.e., SONA), participants on Prolific and CloudResearch were more likely to pass various attention checks, provide meaningful answers, follow instructions, remember previously presented information, have a unique IP address and geolocation, and work slowly enough to be able to read all the items. We divided the samples into high- and low-quality respondents and computed the cost we paid per high-quality respondent. Prolific ($1.90) and CloudResearch ($2.00) were cheaper than MTurk ($4.36) and Qualtrics ($8.17). SONA cost $0.00, yet took the longest to collect the data.
AbstractList With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated by the percentage of participants who meaningfully respond to the researcher’s question (high quality) versus those who only contribute noise (low quality). We found that compared to MTurk, Qualtrics, or an undergraduate student sample (i.e., SONA), participants on Prolific and CloudResearch were more likely to pass various attention checks, provide meaningful answers, follow instructions, remember previously presented information, have a unique IP address and geolocation, and work slowly enough to be able to read all the items. We divided the samples into high- and low-quality respondents and computed the cost we paid per high-quality respondent. Prolific ($1.90) and CloudResearch ($2.00) were cheaper than MTurk ($4.36) and Qualtrics ($8.17). SONA cost $0.00, yet took the longest to collect the data.
With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated by the percentage of participants who meaningfully respond to the researcher's question (high quality) versus those who only contribute noise (low quality). We found that compared to MTurk, Qualtrics, or an undergraduate student sample (i.e., SONA), participants on Prolific and CloudResearch were more likely to pass various attention checks, provide meaningful answers, follow instructions, remember previously presented information, have a unique IP address and geolocation, and work slowly enough to be able to read all the items. We divided the samples into high- and low-quality respondents and computed the cost we paid per high-quality respondent. Prolific ($1.90) and CloudResearch ($2.00) were cheaper than MTurk ($4.36) and Qualtrics ($8.17). SONA cost $0.00, yet took the longest to collect the data.With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated by the percentage of participants who meaningfully respond to the researcher's question (high quality) versus those who only contribute noise (low quality). We found that compared to MTurk, Qualtrics, or an undergraduate student sample (i.e., SONA), participants on Prolific and CloudResearch were more likely to pass various attention checks, provide meaningful answers, follow instructions, remember previously presented information, have a unique IP address and geolocation, and work slowly enough to be able to read all the items. We divided the samples into high- and low-quality respondents and computed the cost we paid per high-quality respondent. Prolific ($1.90) and CloudResearch ($2.00) were cheaper than MTurk ($4.36) and Qualtrics ($8.17). SONA cost $0.00, yet took the longest to collect the data.
Audience Academic
Author Douglas, Benjamin D.
Ewell, Patrick J.
Brauer, Markus
AuthorAffiliation Kent State University, UNITED STATES
2 Department of Psychology, Kenyon College, Gambier, Ohio, United States of America
1 Department of Psychology, University of Wisconsin–Madison, Madison, Wisconsin, United States of America
AuthorAffiliation_xml – name: 1 Department of Psychology, University of Wisconsin–Madison, Madison, Wisconsin, United States of America
– name: Kent State University, UNITED STATES
– name: 2 Department of Psychology, Kenyon College, Gambier, Ohio, United States of America
Author_xml – sequence: 1
  givenname: Benjamin D.
  surname: Douglas
  fullname: Douglas, Benjamin D.
– sequence: 2
  givenname: Patrick J.
  surname: Ewell
  fullname: Ewell, Patrick J.
– sequence: 3
  givenname: Markus
  orcidid: 0000-0003-4395-2282
  surname: Brauer
  fullname: Brauer, Markus
BackLink https://www.ncbi.nlm.nih.gov/pubmed/36917576$$D View this record in MEDLINE/PubMed
BookMark eNqNk9tuEzEQhlcIRA_wBggsISGQkuDDrr3uDarCqVKh0BZuLa_Xmzg4dmp7KX17HLJFTVUh5Iu1Zr__98xoZq-477zTRfEEwQkiDL1e-D44aSerHJ5AzDjD8F6xizjBY4ohuX_jvlPsxbiAsCI1pQ-LHUI5YhWju8XlW5kkuOilNekKGAe8s8ZpMO-X0o1j3yy0ShEEHbUMan4Apn65ksFE7yJodLrU2oFP5334MQJfgremM2oEptb37emgGYGv2T4Fo-IISNeCs5PPh4-KB520UT8evvvFt_fvzqcfx8cnH46mh8djxSqexrLUuO0Y7Wrc0KrjDaOkYjVsEcFKasQpUjUra0Qa1iDMNGOo4qhTLdOcI0n2i2cb35X1UQw9iwKzmrKsq6pMHG2I1suFWAWzlOFKeGnEn4APMyFDMspqwUqmFCEEyhKWvIINgZTTFpesoxhJnr3eDK_1zVK3SrsUpN0y3f7jzFzM_E-BIESk5mV2eDk4BH_R65jE0kSlrZVO-36TeI0wZuvEn99C7y5voGYyV2Bc5_PDam0qDlmJMKooXic-uYPKp9VLo_KEdSbHtwSvtgSZSfpXmsk-RnF0dvr_7Mn3bfbFDXau8-DMo7d9MnngtsGnN1v9t8fXo52Bgw2ggo8x6E4ok-TaJ5dmbG65WO_RddPEeo_EsEdZXN4SX_v_U_Yb1NIfjg
CitedBy_id crossref_primary_10_1177_13684302241305368
crossref_primary_10_1016_j_chiabu_2024_106938
crossref_primary_10_1016_j_appet_2023_106596
crossref_primary_10_1002_hrm_70014
crossref_primary_10_1016_j_appet_2024_107848
crossref_primary_10_1108_IJEBR_11_2023_1188
crossref_primary_10_1177_23794607241311793
crossref_primary_10_1177_20503245231191400
crossref_primary_10_1016_j_appet_2024_107608
crossref_primary_10_1080_00224499_2024_2371951
crossref_primary_10_1098_rsos_231711
crossref_primary_10_1108_IJCHM_10_2023_1578
crossref_primary_10_1177_00207640251345028
crossref_primary_10_3390_ijerph22071072
crossref_primary_10_1016_j_techsoc_2024_102586
crossref_primary_10_1016_j_jpsychires_2025_01_021
crossref_primary_10_1017_XPS_2024_10
crossref_primary_10_1016_j_ergon_2024_103595
crossref_primary_10_1145_3716394
crossref_primary_10_1016_j_euroecorev_2024_104778
crossref_primary_10_1108_JKM_01_2025_0061
crossref_primary_10_2196_60862
crossref_primary_10_1080_0163853X_2025_2478800
crossref_primary_10_1016_j_chbr_2025_100682
crossref_primary_10_1016_j_jenvp_2024_102278
crossref_primary_10_1027_1015_5759_a000818
crossref_primary_10_1111_jocd_16465
crossref_primary_10_1002_eat_24290
crossref_primary_10_1080_19419899_2025_2465989
crossref_primary_10_1108_JHTI_01_2024_0012
crossref_primary_10_1177_21677026241306048
crossref_primary_10_1016_j_socec_2025_102399
crossref_primary_10_1002_jsc_2680
crossref_primary_10_1007_s11199_024_01507_9
crossref_primary_10_1007_s12119_025_10343_2
crossref_primary_10_1016_j_accinf_2024_100696
crossref_primary_10_1093_jcmc_zmae023
crossref_primary_10_1002_osp4_70041
crossref_primary_10_1016_j_chbah_2024_100093
crossref_primary_10_1177_10776990251359660
crossref_primary_10_1177_20597991251333345
crossref_primary_10_1111_pops_70037
crossref_primary_10_1177_10963480251336155
crossref_primary_10_1186_s40337_024_00964_7
crossref_primary_10_1016_j_appet_2024_107821
crossref_primary_10_1177_13591053241247376
crossref_primary_10_1080_00207543_2025_2543961
crossref_primary_10_1080_1359432X_2025_2458343
crossref_primary_10_1093_pnasnexus_pgae506
crossref_primary_10_2139_ssrn_4546369
crossref_primary_10_3389_feduc_2025_1595648
crossref_primary_10_1017_bpp_2024_8
crossref_primary_10_1038_s41598_024_57582_1
crossref_primary_10_1111_jpim_12774
crossref_primary_10_1108_JPBM_07_2023_4588
crossref_primary_10_1123_ijsc_2024_0205
crossref_primary_10_1080_09585192_2025_2542772
crossref_primary_10_1044_2023_JSLHR_22_00617
crossref_primary_10_3389_fcomm_2023_1256452
crossref_primary_10_1002_cpp_70085
crossref_primary_10_1080_03075079_2024_2323571
crossref_primary_10_1177_10731911241273352
crossref_primary_10_1002_aur_70039
crossref_primary_10_1371_journal_pone_0329404
crossref_primary_10_1007_s10669_025_10004_7
crossref_primary_10_1111_pops_70024
crossref_primary_10_1111_wej_12987
crossref_primary_10_1016_j_poetic_2025_102043
crossref_primary_10_1177_00220426231187284
crossref_primary_10_1108_JAOC_06_2024_0196
crossref_primary_10_1007_s11031_024_10091_0
crossref_primary_10_1108_JCM_10_2024_7298
crossref_primary_10_1080_07481187_2024_2349933
crossref_primary_10_1007_s12529_023_10255_1
crossref_primary_10_1080_27703371_2025_2490128
crossref_primary_10_2196_58409
crossref_primary_10_1080_0144929X_2024_2433037
crossref_primary_10_1111_spol_13118
crossref_primary_10_3758_s13428_024_02489_y
crossref_primary_10_1016_j_resplu_2025_100919
crossref_primary_10_1177_0034673X241304733
crossref_primary_10_1080_00913367_2024_2393708
crossref_primary_10_1111_spc3_12923
crossref_primary_10_1016_j_trc_2023_104391
crossref_primary_10_1080_02650487_2024_2377503
crossref_primary_10_1080_15309576_2025_2560620
crossref_primary_10_1080_17457289_2025_2474423
crossref_primary_10_1007_s00146_025_02378_8
crossref_primary_10_1016_j_csi_2025_103982
crossref_primary_10_1016_j_paid_2025_113367
crossref_primary_10_1080_0144929X_2025_2547922
crossref_primary_10_1287_orsc_2020_14640
crossref_primary_10_1016_j_pursup_2024_100922
crossref_primary_10_1080_10508422_2024_2341639
crossref_primary_10_1016_j_appet_2025_107926
crossref_primary_10_1038_s41562_025_02194_6
crossref_primary_10_1177_02654075241302240
crossref_primary_10_1016_j_jesp_2024_104632
crossref_primary_10_1016_j_jretconser_2025_104500
crossref_primary_10_1111_1911_3838_12411
crossref_primary_10_1016_j_joep_2024_102776
crossref_primary_10_1080_08989621_2025_2457100
crossref_primary_10_1080_15377938_2023_2207171
crossref_primary_10_1016_j_econlet_2025_112509
crossref_primary_10_1177_19485506241228469
crossref_primary_10_1080_15325024_2024_2362695
crossref_primary_10_1016_j_spinee_2025_05_005
crossref_primary_10_1002_joe_22293
crossref_primary_10_1016_j_spc_2024_03_009
crossref_primary_10_1108_IJM_11_2024_0773
crossref_primary_10_1177_10591478241266524
crossref_primary_10_1016_j_eatbeh_2025_101978
crossref_primary_10_1007_s41347_025_00543_w
crossref_primary_10_1016_j_ijhm_2025_104157
crossref_primary_10_1080_15378020_2024_2303534
crossref_primary_10_1016_j_jbef_2025_101040
crossref_primary_10_1016_j_actpsy_2024_104377
crossref_primary_10_1080_01490400_2025_2545317
crossref_primary_10_1080_23774657_2025_2542952
crossref_primary_10_1080_13825585_2023_2282223
crossref_primary_10_1038_s44220_025_00385_8
crossref_primary_10_1111_fare_13190
crossref_primary_10_1016_j_jogn_2025_06_004
crossref_primary_10_3390_admsci15040127
crossref_primary_10_1089_fpsam_2023_0204
crossref_primary_10_1016_j_pmedr_2025_103179
crossref_primary_10_1371_journal_pone_0325196
crossref_primary_10_1140_epjds_s13688_025_00558_6
crossref_primary_10_1002_mar_22220
crossref_primary_10_1016_j_paid_2025_113103
crossref_primary_10_1007_s43681_024_00603_6
crossref_primary_10_1007_s10826_024_02996_8
crossref_primary_10_1016_j_jbef_2024_100905
crossref_primary_10_1177_01461672251339690
crossref_primary_10_1177_10659129251321434
crossref_primary_10_2196_66083
crossref_primary_10_1177_01461672231203123
crossref_primary_10_1371_journal_pone_0327370
crossref_primary_10_1145_3707649
crossref_primary_10_1016_j_chb_2024_108427
crossref_primary_10_1038_s43856_023_00379_6
crossref_primary_10_1155_hbe2_8808655
crossref_primary_10_1016_j_cognition_2025_106063
crossref_primary_10_1111_1911_3846_12936
crossref_primary_10_1080_14681994_2024_2332622
crossref_primary_10_1186_s40795_025_01051_z
crossref_primary_10_1016_j_chb_2023_108025
crossref_primary_10_1080_03050629_2025_2495697
crossref_primary_10_1007_s12144_024_07218_4
crossref_primary_10_1093_jamia_ocad198
crossref_primary_10_3390_bs15091196
crossref_primary_10_1002_icd_2525
crossref_primary_10_1111_jsr_14276
crossref_primary_10_1007_s10869_024_09992_1
crossref_primary_10_1016_j_clae_2025_102387
crossref_primary_10_3390_su16156393
crossref_primary_10_1038_s41598_023_46048_5
crossref_primary_10_1145_3710946
crossref_primary_10_1371_journal_pone_0294739
crossref_primary_10_1016_j_techfore_2025_124219
crossref_primary_10_1016_j_techsoc_2025_102903
crossref_primary_10_1038_s41598_025_98221_7
crossref_primary_10_1098_rsos_250361
crossref_primary_10_1111_tops_70022
crossref_primary_10_1177_10755470241232352
crossref_primary_10_1080_10510974_2024_2353393
crossref_primary_10_2196_62828
crossref_primary_10_1016_j_ejtd_2025_100533
crossref_primary_10_1016_j_chb_2023_108017
crossref_primary_10_1016_j_socec_2025_102371
crossref_primary_10_1080_02650487_2025_2510062
crossref_primary_10_1007_s12144_024_06575_4
crossref_primary_10_1007_s12671_024_02356_z
crossref_primary_10_1016_j_isci_2025_113006
crossref_primary_10_1017_S0143814X24000266
crossref_primary_10_1080_00952990_2023_2300398
crossref_primary_10_17645_mac_9550
crossref_primary_10_1017_S175504832510014X
crossref_primary_10_1111_ijcs_13094
crossref_primary_10_1080_00223891_2024_2411557
crossref_primary_10_1371_journal_pone_0305364
crossref_primary_10_1002_pra2_1146
crossref_primary_10_1016_j_bodyim_2025_101901
crossref_primary_10_3390_multimedia1010004
crossref_primary_10_62347_OAHP6281
crossref_primary_10_1080_26895269_2025_2478497
crossref_primary_10_2478_remav_2024_0038
crossref_primary_10_1177_00223433241233960
crossref_primary_10_1177_02750740241268263
crossref_primary_10_1080_00218499_2025_2537503
crossref_primary_10_1016_j_chb_2024_108460
crossref_primary_10_2196_65356
crossref_primary_10_1111_bjc_12525
crossref_primary_10_1016_j_rmal_2025_100235
crossref_primary_10_1097_GOX_0000000000005736
crossref_primary_10_1038_s41598_025_01043_w
crossref_primary_10_1016_j_jclepro_2024_143300
crossref_primary_10_1080_08824096_2023_2209713
crossref_primary_10_1080_17440572_2024_2423918
crossref_primary_10_1080_00224499_2025_2507881
crossref_primary_10_1111_bjhp_12786
crossref_primary_10_1080_10447318_2024_2423125
crossref_primary_10_1080_13215906_2025_2463650
crossref_primary_10_1080_10696679_2024_2385374
crossref_primary_10_1016_j_foodqual_2024_105194
crossref_primary_10_1080_07418825_2024_2361719
crossref_primary_10_1145_3677077
crossref_primary_10_1002_ajpa_70104
crossref_primary_10_1007_s10805_024_09541_8
crossref_primary_10_1109_TSE_2024_3437355
crossref_primary_10_3389_forgp_2025_1580957
crossref_primary_10_1108_CBTH_01_2024_0001
crossref_primary_10_1016_j_parkreldis_2024_107183
crossref_primary_10_1080_10447318_2025_2495847
crossref_primary_10_3390_languages10020025
crossref_primary_10_1016_j_paid_2024_112690
crossref_primary_10_1080_21568316_2024_2443187
crossref_primary_10_1007_s12144_024_06828_2
crossref_primary_10_1080_08934215_2025_2504875
crossref_primary_10_1109_TVCG_2024_3520219
crossref_primary_10_1080_10852352_2025_2547441
crossref_primary_10_1080_10410236_2025_2524434
crossref_primary_10_1007_s12144_024_07242_4
crossref_primary_10_1093_oxfclm_kgae021
crossref_primary_10_3390_su16062540
crossref_primary_10_1007_s10964_023_01867_7
crossref_primary_10_1080_1062726X_2025_2501552
crossref_primary_10_1177_21677026251349809
crossref_primary_10_1177_03616843231215373
crossref_primary_10_3390_su17125606
crossref_primary_10_1007_s10826_024_02808_z
crossref_primary_10_1016_j_jretconser_2025_104326
crossref_primary_10_1089_aut_2023_0119
crossref_primary_10_1111_pere_12539
crossref_primary_10_2139_ssrn_4709548
crossref_primary_10_1073_pnas_2418821122
crossref_primary_10_1017_rep_2025_10011
crossref_primary_10_1080_00207543_2025_2508918
crossref_primary_10_1080_03050629_2025_2478145
crossref_primary_10_1007_s11109_023_09905_7
crossref_primary_10_1108_MRR_12_2023_0908
crossref_primary_10_1089_aut_2023_0134
crossref_primary_10_1177_21674795251346506
crossref_primary_10_2196_70926
crossref_primary_10_1016_j_paid_2024_112684
crossref_primary_10_1017_psy_2025_10041
crossref_primary_10_1521_soco_2025_43_1_17
crossref_primary_10_1007_s10672_023_09483_0
crossref_primary_10_1080_07421222_2024_2340829
crossref_primary_10_1080_10463283_2025_2489867
crossref_primary_10_1080_10510974_2025_2515032
crossref_primary_10_1016_j_cogpsych_2025_101735
crossref_primary_10_1007_s00426_025_02136_x
crossref_primary_10_1017_XPS_2025_10018
crossref_primary_10_4018_IRMJ_386593
crossref_primary_10_1093_pnasnexus_pgaf062
crossref_primary_10_1108_BL_08_2024_0130
crossref_primary_10_1007_s12144_024_06347_0
crossref_primary_10_1007_s12207_024_09520_9
crossref_primary_10_1371_journal_pone_0293810
crossref_primary_10_1080_1461670X_2025_2559020
crossref_primary_10_1027_0227_5910_a001020
crossref_primary_10_1016_j_trf_2025_03_003
crossref_primary_10_1080_10826084_2024_2392517
crossref_primary_10_1007_s10869_025_10039_2
crossref_primary_10_1016_j_ecresq_2024_10_001
crossref_primary_10_1080_02791072_2024_2312980
crossref_primary_10_1080_2050571X_2025_2501774
crossref_primary_10_1016_j_trip_2025_101545
crossref_primary_10_1177_14999013251366447
crossref_primary_10_1016_j_ijhm_2025_104204
crossref_primary_10_1080_13683500_2024_2402563
crossref_primary_10_1177_23294884241248133
crossref_primary_10_3389_fpsyg_2023_1166960
crossref_primary_10_2196_66496
crossref_primary_10_1007_s40653_025_00721_1
crossref_primary_10_1108_JOSM_06_2024_0275
crossref_primary_10_1111_pere_12516
crossref_primary_10_1016_j_tmp_2025_101392
crossref_primary_10_3389_fpsyt_2025_1595502
crossref_primary_10_1093_pnasnexus_pgaf197
crossref_primary_10_2139_ssrn_4846170
crossref_primary_10_1038_s41467_024_50966_x
crossref_primary_10_1007_s10834_024_09988_2
crossref_primary_10_1177_00491241251327130
crossref_primary_10_1108_INTR_08_2022_0635
crossref_primary_10_1111_capa_70003
crossref_primary_10_1521_soco_2024_42_6_522
crossref_primary_10_1111_jsr_14337
crossref_primary_10_1016_j_ijhm_2025_104307
crossref_primary_10_1177_23780231251325087
crossref_primary_10_1007_s41542_024_00218_7
crossref_primary_10_1177_10776990241287159
crossref_primary_10_1111_joms_13121
crossref_primary_10_1177_02654075241312690
crossref_primary_10_1016_j_vaccine_2024_126198
crossref_primary_10_3758_s13414_024_02893_8
crossref_primary_10_1016_j_cedpsych_2024_102294
crossref_primary_10_1016_j_jpsychires_2025_01_041
crossref_primary_10_1038_s41562_024_02062_9
crossref_primary_10_1111_bjc_12552
crossref_primary_10_1177_16094069251321256
crossref_primary_10_3389_frai_2023_1249322
crossref_primary_10_1016_j_ijinfomgt_2025_102957
crossref_primary_10_3390_antibiotics13070657
crossref_primary_10_1026_1616_3443_a000804
crossref_primary_10_3758_s13428_024_02452_x
crossref_primary_10_1108_EJM_08_2023_0664
crossref_primary_10_2196_45411
crossref_primary_10_1177_23294906241301354
crossref_primary_10_3390_ejihpe15090178
crossref_primary_10_1007_s12144_024_07120_z
crossref_primary_10_1177_01902725241268455
crossref_primary_10_3390_ejihpe15090170
crossref_primary_10_1080_1553118X_2025_2471527
crossref_primary_10_1002_bdm_70007
crossref_primary_10_1111_socf_13055
crossref_primary_10_1080_13683500_2024_2378611
crossref_primary_10_1108_JHTT_11_2023_0348
crossref_primary_10_1007_s10615_024_00967_6
crossref_primary_10_1016_j_jbusres_2024_115127
crossref_primary_10_1080_07317115_2024_2399588
crossref_primary_10_3389_fnhum_2023_1228365
crossref_primary_10_1007_s10508_024_03009_x
crossref_primary_10_1007_s10902_025_00914_3
crossref_primary_10_1080_19419899_2024_2372468
crossref_primary_10_3390_children12030342
crossref_primary_10_1016_j_appet_2024_107288
crossref_primary_10_1002_aps_1899
crossref_primary_10_1177_00207640241296055
crossref_primary_10_1080_00913367_2024_2438002
crossref_primary_10_1177_15554120251376073
crossref_primary_10_2196_63343
crossref_primary_10_1080_10646175_2025_2530461
crossref_primary_10_1186_s40834_025_00380_5
crossref_primary_10_1177_20597991251329754
crossref_primary_10_1007_s13412_025_01026_3
crossref_primary_10_1016_j_jretconser_2025_104268
crossref_primary_10_1016_j_ssresearch_2025_103193
crossref_primary_10_1177_10659129241265703
crossref_primary_10_1016_j_jpsychires_2025_05_043
crossref_primary_10_2196_73382
crossref_primary_10_3168_jds_2024_25603
crossref_primary_10_1007_s11145_025_10641_z
crossref_primary_10_1080_10410236_2023_2301201
crossref_primary_10_1016_j_visres_2025_108610
crossref_primary_10_1177_01461672251313831
crossref_primary_10_1002_bdm_70040
crossref_primary_10_1038_s41598_024_58300_7
crossref_primary_10_1093_pnasnexus_pgaf150
crossref_primary_10_1007_s12144_023_04927_0
crossref_primary_10_1109_TAFFC_2024_3428704
crossref_primary_10_1016_j_paid_2023_112482
crossref_primary_10_1145_3725529
crossref_primary_10_1108_JPBM_04_2023_4452
crossref_primary_10_1080_01442872_2024_2323673
crossref_primary_10_1080_01924036_2024_2440359
crossref_primary_10_3389_fpsyt_2024_1459827
crossref_primary_10_1108_JSBED_10_2023_0468
crossref_primary_10_1016_j_jhtm_2024_03_011
crossref_primary_10_1093_abm_kaad054
crossref_primary_10_1016_j_jretconser_2025_104254
crossref_primary_10_1016_j_jretconser_2025_104496
crossref_primary_10_1098_rsos_231046
crossref_primary_10_1098_rsos_231045
crossref_primary_10_1186_s40479_024_00259_y
crossref_primary_10_1111_jbl_12405
crossref_primary_10_1177_20563051251348922
crossref_primary_10_3390_su16125010
crossref_primary_10_1002_mar_21944
crossref_primary_10_1080_00952990_2025_2504152
crossref_primary_10_1111_puar_13823
crossref_primary_10_1371_journal_pone_0321592
crossref_primary_10_1002_ab_70041
crossref_primary_10_1080_09515089_2024_2354432
crossref_primary_10_1111_jmwh_13758
crossref_primary_10_1177_23294884251329160
crossref_primary_10_1016_j_bodyim_2025_101893
crossref_primary_10_1111_1745_9125_70006
crossref_primary_10_3390_ijerph22010011
crossref_primary_10_1177_10731911251333664
crossref_primary_10_1080_09537325_2024_2405137
crossref_primary_10_1177_03057356241239336
crossref_primary_10_21697_sp_2025_25_1_02
crossref_primary_10_1016_j_rssm_2024_100935
crossref_primary_10_1007_s12369_025_01306_6
crossref_primary_10_3389_fpsyg_2025_1448153
crossref_primary_10_1007_s11089_025_01212_8
crossref_primary_10_1080_13501763_2024_2326189
crossref_primary_10_2196_67923
crossref_primary_10_1080_09273948_2024_2423870
crossref_primary_10_3389_fpsyt_2025_1576406
crossref_primary_10_1016_j_learninstruc_2024_101921
crossref_primary_10_1016_j_cofs_2025_101307
crossref_primary_10_1016_j_ijchp_2025_100611
crossref_primary_10_1016_j_pubrev_2025_102569
crossref_primary_10_1017_S1743923X24000321
crossref_primary_10_1080_17439760_2024_2433045
crossref_primary_10_1016_j_paid_2024_112964
crossref_primary_10_1111_1468_5973_12620
crossref_primary_10_1287_msom_2020_0373
crossref_primary_10_1016_j_foodqual_2025_105507
crossref_primary_10_1080_10447318_2025_2556233
crossref_primary_10_1093_lpr_mgae010
crossref_primary_10_3389_frobt_2025_1436674
crossref_primary_10_1371_journal_pone_0322212
crossref_primary_10_1007_s10608_024_10563_0
crossref_primary_10_1080_10696679_2025_2452843
crossref_primary_10_1007_s12144_024_05877_x
crossref_primary_10_1016_j_bodyim_2025_101897
crossref_primary_10_1108_SBM_11_2023_0138
crossref_primary_10_1111_1748_8583_12567
crossref_primary_10_1093_asj_sjaf075
crossref_primary_10_1080_10538712_2024_2314287
crossref_primary_10_1093_abm_kaaf018
crossref_primary_10_1080_10530789_2025_2485684
crossref_primary_10_1093_pnasnexus_pgae250
crossref_primary_10_1016_j_paid_2024_112794
crossref_primary_10_1111_opo_13447
crossref_primary_10_1371_journal_pone_0296489
crossref_primary_10_1007_s12599_025_00963_1
crossref_primary_10_1177_30497841251317293
crossref_primary_10_1146_annurev_soc_083024_070113
crossref_primary_10_1016_j_chbah_2024_100108
crossref_primary_10_1089_trgh_2024_0203
crossref_primary_10_1007_s12144_025_08448_w
crossref_primary_10_1111_bjhp_12753
crossref_primary_10_1177_08997640251343049
crossref_primary_10_1287_mnsc_2021_01010
crossref_primary_10_1177_01461672241290390
crossref_primary_10_33423_jmdc_v18i3_7323
crossref_primary_10_1080_00224499_2024_2352555
crossref_primary_10_1007_s00146_024_02081_0
crossref_primary_10_1007_s10608_024_10551_4
crossref_primary_10_1080_09588221_2025_2497498
crossref_primary_10_1016_j_chb_2025_108763
crossref_primary_10_1080_09585192_2025_2492867
crossref_primary_10_1177_19401612241308697
crossref_primary_10_1038_s41541_024_00951_8
crossref_primary_10_1080_13811118_2025_2513020
crossref_primary_10_1038_s41598_024_76934_5
crossref_primary_10_1177_07342829241313089
crossref_primary_10_1073_pnas_2311825121
crossref_primary_10_1108_MF_12_2024_0919
crossref_primary_10_1080_0144929X_2024_2325023
crossref_primary_10_1007_s10608_025_10580_7
crossref_primary_10_1016_j_jad_2023_12_036
crossref_primary_10_1177_10711813241262033
crossref_primary_10_1177_00076503241255691
crossref_primary_10_1016_j_visres_2025_108640
crossref_primary_10_2139_ssrn_3813891
crossref_primary_10_1177_14999013251372626
crossref_primary_10_1016_j_learninstruc_2025_102179
crossref_primary_10_2166_wh_2024_074
crossref_primary_10_1177_10775595241240755
crossref_primary_10_1136_bmjopen_2024_093803
crossref_primary_10_1177_0272989X241275645
crossref_primary_10_1016_j_jbusvent_2025_106538
crossref_primary_10_1177_25152459251336127
crossref_primary_10_1016_j_appet_2025_108235
crossref_primary_10_1080_00223891_2023_2298887
crossref_primary_10_1111_1745_9125_12364
crossref_primary_10_1371_journal_pone_0307443
crossref_primary_10_1007_s10508_024_03053_7
crossref_primary_10_1108_JFMM_03_2023_0063
crossref_primary_10_1108_IJRDM_11_2024_0600
crossref_primary_10_3390_su151914560
crossref_primary_10_1080_08934215_2025_2519253
crossref_primary_10_1111_epi_18624
crossref_primary_10_1007_s10551_025_06083_w
crossref_primary_10_1016_j_ijinfomgt_2024_102821
crossref_primary_10_1016_j_abrep_2024_100551
crossref_primary_10_1111_acer_70058
crossref_primary_10_1016_j_puhe_2025_01_012
crossref_primary_10_1111_joop_12487
crossref_primary_10_1016_j_scaman_2025_101434
crossref_primary_10_1093_geronb_gbae080
crossref_primary_10_1016_j_geb_2025_04_013
crossref_primary_10_1016_j_bodyim_2025_101860
crossref_primary_10_1186_s40163_024_00240_8
crossref_primary_10_1080_23311975_2025_2451125
crossref_primary_10_1111_bjhp_12765
crossref_primary_10_1080_09658211_2024_2383311
crossref_primary_10_1016_j_jpain_2024_104583
crossref_primary_10_1145_3677058
crossref_primary_10_1177_26338076231174639
crossref_primary_10_1016_j_asw_2025_100937
crossref_primary_10_1080_15332640_2024_2367243
crossref_primary_10_1093_jpepsy_jsaf077
crossref_primary_10_1007_s11127_025_01271_8
crossref_primary_10_1177_10717641231202738
crossref_primary_10_1017_dsj_2024_51
crossref_primary_10_1108_JHTI_01_2025_0126
crossref_primary_10_1016_j_intell_2025_101930
crossref_primary_10_1038_s41562_024_02023_2
crossref_primary_10_1080_13527266_2025_2560399
crossref_primary_10_1016_j_addbeh_2025_108453
crossref_primary_10_1108_JHTI_05_2024_0449
crossref_primary_10_1016_j_pubrev_2024_102536
crossref_primary_10_1177_19401612251342679
crossref_primary_10_1016_j_appet_2025_107969
crossref_primary_10_1093_pnasnexus_pgae217
crossref_primary_10_1177_17470218241310440
crossref_primary_10_2139_ssrn_5252772
crossref_primary_10_3758_s13421_025_01719_8
crossref_primary_10_1016_j_jad_2024_01_133
crossref_primary_10_1108_JSM_02_2023_0060
crossref_primary_10_1177_23294965251374636
crossref_primary_10_1108_EJM_07_2024_0572
crossref_primary_10_1016_j_peh_2025_100353
crossref_primary_10_1002_mde_70003
crossref_primary_10_1111_jasp_13021
crossref_primary_10_1177_10659129241275458
crossref_primary_10_1186_s13229_025_00643_7
crossref_primary_10_1098_rsos_241001
crossref_primary_10_1177_09636625241246084
crossref_primary_10_1017_jlc_2024_6
crossref_primary_10_1177_21674795251323193
crossref_primary_10_3389_fpsyg_2025_1535727
crossref_primary_10_3389_feduc_2024_1360848
crossref_primary_10_1017_S1468109924000227
crossref_primary_10_1007_s10584_024_03826_y
crossref_primary_10_1016_j_giq_2023_101906
crossref_primary_10_1080_08870446_2025_2552228
crossref_primary_10_1080_08870446_2025_2552227
crossref_primary_10_1080_00223891_2024_2405536
crossref_primary_10_1080_21639159_2024_2397586
crossref_primary_10_1111_bjop_70030
crossref_primary_10_1177_20552076241311066
crossref_primary_10_1080_19368623_2025_2484282
crossref_primary_10_1177_00220426241252336
crossref_primary_10_1016_j_appet_2025_107981
crossref_primary_10_1111_aphw_12536
crossref_primary_10_1111_jomf_70000
crossref_primary_10_1177_00472875241230008
crossref_primary_10_1016_j_foodqual_2023_104969
crossref_primary_10_1007_s10639_025_13492_x
crossref_primary_10_1016_j_trf_2024_12_021
crossref_primary_10_3390_bs15081094
crossref_primary_10_1017_jmo_2025_10021
crossref_primary_10_1016_j_jad_2025_119857
crossref_primary_10_1017_jmo_2025_10024
crossref_primary_10_1093_applin_amae048
crossref_primary_10_1093_pubmed_fdaf051
crossref_primary_10_1038_s41598_025_19246_6
crossref_primary_10_1007_s42761_024_00290_w
crossref_primary_10_3389_frobt_2023_1277635
crossref_primary_10_1016_j_learninstruc_2024_102065
crossref_primary_10_1080_00918369_2024_2320242
crossref_primary_10_1016_j_econlet_2024_111944
crossref_primary_10_1038_s44271_025_00186_w
crossref_primary_10_1007_s12207_025_09539_6
crossref_primary_10_1093_iwc_iwae049
crossref_primary_10_1080_01463373_2024_2432379
crossref_primary_10_1002_jocb_1519
crossref_primary_10_1111_jpr_12599
crossref_primary_10_1177_03063070241258806
crossref_primary_10_1080_10447318_2025_2477739
crossref_primary_10_1093_police_paae115
crossref_primary_10_1080_0144929X_2025_2483788
crossref_primary_10_1080_16066359_2025_2486964
crossref_primary_10_1080_0267257X_2024_2312197
crossref_primary_10_1080_08838151_2025_2487679
crossref_primary_10_1177_0734371X251316597
crossref_primary_10_1016_j_appet_2024_107670
crossref_primary_10_1027_2151_2604_a000573
crossref_primary_10_1186_s40536_024_00205_y
crossref_primary_10_1002_hec_4810
crossref_primary_10_1016_j_jhtm_2025_02_002
crossref_primary_10_1002_jts_23018
crossref_primary_10_1038_s41598_025_92907_8
crossref_primary_10_1007_s44202_025_00363_2
crossref_primary_10_1080_08874417_2023_2277751
crossref_primary_10_1177_10591478241310221
crossref_primary_10_3758_s13428_025_02797_x
crossref_primary_10_1007_s11031_025_10140_2
crossref_primary_10_1177_10659129231197207
crossref_primary_10_1016_j_xjmad_2024_100057
crossref_primary_10_1093_workar_waae016
crossref_primary_10_1016_j_paid_2024_112956
crossref_primary_10_1093_pnasnexus_pgae413
crossref_primary_10_1177_1179173X251338447
crossref_primary_10_1089_wound_2024_0035
crossref_primary_10_1016_j_indmarman_2024_07_008
crossref_primary_10_1007_s13164_024_00726_z
crossref_primary_10_1080_10410236_2024_2348236
crossref_primary_10_1177_14648849251333597
crossref_primary_10_1016_j_foohum_2024_100485
crossref_primary_10_3846_ijspm_2024_21456
crossref_primary_10_1016_j_ijintrel_2024_102004
crossref_primary_10_1016_j_ssaho_2025_101520
crossref_primary_10_1108_IJOA_03_2025_5354
crossref_primary_10_1016_j_ijhm_2024_103756
crossref_primary_10_1027_1015_5759_a000855
crossref_primary_10_1007_s10899_023_10261_8
crossref_primary_10_1371_journal_pone_0320570
crossref_primary_10_1080_23311908_2024_2359827
crossref_primary_10_1080_10967494_2025_2557875
crossref_primary_10_1111_risa_70112
crossref_primary_10_1080_13548506_2025_2546588
crossref_primary_10_1038_s41598_025_12607_1
crossref_primary_10_1007_s41347_024_00411_z
crossref_primary_10_1007_s12103_025_09841_8
crossref_primary_10_1108_CCIJ_11_2024_0204
crossref_primary_10_1073_pnas_2412015122
crossref_primary_10_1177_20438087241288532
crossref_primary_10_1080_08934215_2024_2424535
crossref_primary_10_1007_s11764_023_01488_w
crossref_primary_10_1111_ssqu_70027
crossref_primary_10_1016_j_xnsj_2025_100588
crossref_primary_10_1177_10659129241303449
crossref_primary_10_1016_j_lindif_2025_102683
crossref_primary_10_1027_2157_3891_a000129
crossref_primary_10_1016_j_pubrev_2024_102517
crossref_primary_10_3389_fpubh_2024_1508261
crossref_primary_10_1177_00110000241301110
crossref_primary_10_1080_08974438_2024_2411550
crossref_primary_10_1016_j_amepre_2024_09_009
crossref_primary_10_1016_j_jvb_2024_103987
crossref_primary_10_3758_s13428_024_02557_3
crossref_primary_10_1177_00323217241309962
crossref_primary_10_1111_bjso_12900
crossref_primary_10_1016_j_jbef_2024_100995
crossref_primary_10_1016_j_jad_2025_119660
crossref_primary_10_1080_19419899_2024_2403002
crossref_primary_10_1007_s10508_024_03046_6
crossref_primary_10_1016_j_paid_2023_112502
crossref_primary_10_1093_ntr_ntae138
crossref_primary_10_1111_psj_12575
crossref_primary_10_1177_17456916241242734
crossref_primary_10_2139_ssrn_5112507
crossref_primary_10_1111_bjop_70016
crossref_primary_10_1016_j_jadohealth_2025_01_006
crossref_primary_10_1007_s10551_025_05986_y
crossref_primary_10_1080_10447318_2025_2560522
crossref_primary_10_3390_ijerph20146345
crossref_primary_10_1177_08862605241270031
Cites_doi 10.1016/j.chb.2014.11.004
10.1177/1948550619875149
10.1093/poq/nfr020
10.1016/j.jesp.2017.01.006
10.1177/1948550617703168
10.1093/jssam/smz041
10.1016/j.jbusres.2015.12.002
10.1177/1094428120947794
10.1371/journal.pone.0157732
10.1177/2053168018822174
10.1007/s10869-011-9231-8
10.1007/s10869-020-09707-2
10.1016/j.jrp.2019.103849
10.1037/a0038510
10.1037/met0000267
10.3758/s13428-014-0483-x
10.3758/s13428-021-01588-4
10.29115/SP-2020-0015
10.1016/j.jrp.2005.08.007
10.1080/00913367.2016.1269304
10.2196/resprot.8071
10.1093/poq/nfn050
10.1017/iop.2015.24
10.1177/1525822X15603149
10.1093/poq/nfy038
10.1177/1745691617706516
10.1177/1745691610393980
10.1207/s15324818ame1802_2
10.1037/abn0000479
10.1016/j.chb.2018.02.005
10.3758/s13428-019-01273-7
10.1016/j.paid.2019.02.015
10.3389/fpsyg.2018.00998
ContentType Journal Article
Copyright Copyright: © 2023 Douglas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
COPYRIGHT 2023 Public Library of Science
2023 Douglas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
2023 Douglas et al 2023 Douglas et al
2023 Douglas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Copyright_xml – notice: Copyright: © 2023 Douglas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
– notice: COPYRIGHT 2023 Public Library of Science
– notice: 2023 Douglas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
– notice: 2023 Douglas et al 2023 Douglas et al
– notice: 2023 Douglas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
DBID AAYXX
CITATION
CGR
CUY
CVF
ECM
EIF
NPM
IOV
ISR
3V.
7QG
7QL
7QO
7RV
7SN
7SS
7T5
7TG
7TM
7U9
7X2
7X7
7XB
88E
8AO
8C1
8FD
8FE
8FG
8FH
8FI
8FJ
8FK
ABJCF
ABUWG
AEUYN
AFKRA
ARAPS
ATCPS
AZQEC
BBNVY
BENPR
BGLVJ
BHPHI
C1K
CCPQU
D1I
DWQXO
FR3
FYUFA
GHDGH
GNUQQ
H94
HCIFZ
K9.
KB.
KB0
KL.
L6V
LK8
M0K
M0S
M1P
M7N
M7P
M7S
NAPCQ
P5Z
P62
P64
PATMY
PDBOC
PHGZM
PHGZT
PIMPY
PJZUB
PKEHL
PPXIY
PQEST
PQGLB
PQQKQ
PQUKI
PTHSS
PYCSY
RC3
7X8
5PM
DOA
DOI 10.1371/journal.pone.0279720
DatabaseName CrossRef
Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
Gale In Context: Opposing Viewpoints
Gale In Context: Science
ProQuest Central (Corporate)
Animal Behavior Abstracts
Bacteriology Abstracts (Microbiology B)
Biotechnology Research Abstracts
Nursing & Allied Health Database
Ecology Abstracts
Entomology Abstracts (Full archive)
Immunology Abstracts
Meteorological & Geoastrophysical Abstracts
Nucleic Acids Abstracts
Virology and AIDS Abstracts
Agricultural Science Collection
Health & Medical Collection
ProQuest Central (purchase pre-March 2016)
Medical Database (Alumni Edition)
ProQuest Pharma Collection
Public Health Database
Technology Research Database
ProQuest SciTech Collection
ProQuest Technology Collection
ProQuest Natural Science Collection
ProQuest Hospital Collection
Hospital Premium Collection (Alumni Edition)
ProQuest Central (Alumni) (purchase pre-March 2016)
Materials Science & Engineering Collection
ProQuest Central (Alumni)
One Sustainability
ProQuest Central UK/Ireland
Advanced Technologies & Computer Science Collection
Agricultural & Environmental Science Collection
ProQuest Central Essentials - QC
ProQuest : Biological Science Collection journals [unlimited simultaneous users]
ProQuest Central
Technology collection
Natural Science Collection
Environmental Sciences and Pollution Management
ProQuest One Community College
ProQuest Materials Science Collection
ProQuest Central
Engineering Research Database
Health Research Premium Collection (UHCL Subscription)
Health Research Premium Collection (Alumni)
ProQuest Central Student
AIDS and Cancer Research Abstracts
SciTech Premium Collection
ProQuest Health & Medical Complete (Alumni)
Materials Science Database
Nursing & Allied Health Database (Alumni Edition)
Meteorological & Geoastrophysical Abstracts - Academic
ProQuest Engineering Collection
Biological Sciences
Agricultural Science Database
ProQuest Health & Medical Collection
PML(ProQuest Medical Library)
Algology Mycology and Protozoology Abstracts (Microbiology C)
Biological Science Database
Engineering Database
Nursing & Allied Health Premium
Advanced Technologies & Aerospace Database
ProQuest Advanced Technologies & Aerospace Collection
Biotechnology and BioEngineering Abstracts
Environmental Science Database
Materials Science Collection
Proquest Central Premium
ProQuest One Academic
Publicly Available Content Database
ProQuest Health & Medical Research Collection
ProQuest One Academic Middle East (New)
ProQuest One Health & Nursing
ProQuest One Academic Eastern Edition (DO NOT USE)
One Applied & Life Sciences
ProQuest One Academic (retired)
ProQuest One Academic UKI Edition
Engineering Collection
Environmental Science Collection
Genetics Abstracts
MEDLINE - Academic
PubMed Central (Full Participant titles)
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
Agricultural Science Database
Publicly Available Content Database
ProQuest Central Student
ProQuest Advanced Technologies & Aerospace Collection
ProQuest Central Essentials
Nucleic Acids Abstracts
SciTech Premium Collection
Environmental Sciences and Pollution Management
ProQuest One Applied & Life Sciences
ProQuest One Sustainability
Health Research Premium Collection
Meteorological & Geoastrophysical Abstracts
Natural Science Collection
Health & Medical Research Collection
Biological Science Collection
ProQuest Central (New)
ProQuest Medical Library (Alumni)
Engineering Collection
Advanced Technologies & Aerospace Collection
Engineering Database
Virology and AIDS Abstracts
ProQuest Biological Science Collection
ProQuest One Academic Eastern Edition
Agricultural Science Collection
ProQuest Hospital Collection
ProQuest Technology Collection
Health Research Premium Collection (Alumni)
Biological Science Database
Ecology Abstracts
ProQuest Hospital Collection (Alumni)
Biotechnology and BioEngineering Abstracts
Environmental Science Collection
Entomology Abstracts
Nursing & Allied Health Premium
ProQuest Health & Medical Complete
ProQuest One Academic UKI Edition
Environmental Science Database
ProQuest Nursing & Allied Health Source (Alumni)
Engineering Research Database
ProQuest One Academic
Meteorological & Geoastrophysical Abstracts - Academic
ProQuest One Academic (New)
Technology Collection
Technology Research Database
ProQuest One Academic Middle East (New)
Materials Science Collection
ProQuest Health & Medical Complete (Alumni)
ProQuest Central (Alumni Edition)
ProQuest One Community College
ProQuest One Health & Nursing
ProQuest Natural Science Collection
ProQuest Pharma Collection
ProQuest Central
ProQuest Health & Medical Research Collection
Genetics Abstracts
ProQuest Engineering Collection
Biotechnology Research Abstracts
Health and Medicine Complete (Alumni Edition)
ProQuest Central Korea
Bacteriology Abstracts (Microbiology B)
Algology Mycology and Protozoology Abstracts (Microbiology C)
Agricultural & Environmental Science Collection
AIDS and Cancer Research Abstracts
Materials Science Database
ProQuest Materials Science Collection
ProQuest Public Health
ProQuest Nursing & Allied Health Source
ProQuest SciTech Collection
Advanced Technologies & Aerospace Database
ProQuest Medical Library
Animal Behavior Abstracts
Materials Science & Engineering Collection
Immunology Abstracts
ProQuest Central (Alumni)
MEDLINE - Academic
DatabaseTitleList
MEDLINE

Agricultural Science Database
CrossRef

MEDLINE - Academic


Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ - Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
– sequence: 2
  dbid: NPM
  name: PubMed
  url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 3
  dbid: PIMPY
  name: ProQuest Publicly Available Content Database
  url: http://search.proquest.com/publiccontent
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Sciences (General)
DocumentTitleAlternate Data quality in online human-subjects research
EISSN 1932-6203
ExternalDocumentID 2786774855
oai_doaj_org_article_747cc3330a404950b30696d247f621a9
PMC10013894
A741215629
36917576
10_1371_journal_pone_0279720
Genre Research Support, Non-U.S. Gov't
Journal Article
Comparative Study
GeographicLocations United States
United States--US
GeographicLocations_xml – name: United States
– name: United States--US
GrantInformation_xml – fundername: ;
GroupedDBID ---
123
29O
2WC
53G
5VS
7RV
7X2
7X7
7XC
88E
8AO
8C1
8CJ
8FE
8FG
8FH
8FI
8FJ
A8Z
AAFWJ
AAUCC
AAWOE
AAYXX
ABDBF
ABIVO
ABJCF
ABUWG
ACCTH
ACGFO
ACIHN
ACIWK
ACPRK
ACUHS
ADBBV
AEAQA
AENEX
AEUYN
AFFHD
AFKRA
AFPKN
AFRAH
AHMBA
ALMA_UNASSIGNED_HOLDINGS
AOIJS
APEBS
ARAPS
ATCPS
BAIFH
BAWUL
BBNVY
BBTPI
BCNDV
BENPR
BGLVJ
BHPHI
BKEYQ
BPHCQ
BVXVI
BWKFM
CCPQU
CITATION
CS3
D1I
D1J
D1K
DIK
DU5
E3Z
EAP
EAS
EBD
EMOBN
ESX
EX3
F5P
FPL
FYUFA
GROUPED_DOAJ
GX1
HCIFZ
HH5
HMCUK
HYE
IAO
IEA
IGS
IHR
IHW
INH
INR
IOV
IPY
ISE
ISR
ITC
K6-
KB.
KQ8
L6V
LK5
LK8
M0K
M1P
M48
M7P
M7R
M7S
M~E
NAPCQ
O5R
O5S
OK1
OVT
P2P
P62
PATMY
PDBOC
PHGZM
PHGZT
PIMPY
PJZUB
PPXIY
PQGLB
PQQKQ
PROAC
PSQYO
PTHSS
PV9
PYCSY
RNS
RPM
RZL
SV3
TR2
UKHRP
WOQ
WOW
~02
~KM
ADRAZ
ALIPV
CGR
CUY
CVF
ECM
EIF
IPNFZ
NPM
RIG
BBORY
3V.
7QG
7QL
7QO
7SN
7SS
7T5
7TG
7TM
7U9
7XB
8FD
8FK
AZQEC
C1K
DWQXO
ESTFP
FR3
GNUQQ
H94
K9.
KL.
M7N
P64
PKEHL
PQEST
PQUKI
RC3
7X8
PUEGO
5PM
AAPBV
ABPTK
N95
ID FETCH-LOGICAL-c759t-a4e2df76f82b65f9b7635780d132cae1961c874813b7b127e771591fcd7e991a3
IEDL.DBID P5Z
ISICitedReferencesCount 781
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000952287100012&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1932-6203
IngestDate Sun May 07 16:28:27 EDT 2023
Fri Oct 03 12:43:26 EDT 2025
Tue Nov 04 02:07:17 EST 2025
Fri Sep 05 10:53:45 EDT 2025
Tue Oct 07 09:16:39 EDT 2025
Sat Nov 29 13:09:10 EST 2025
Sat Nov 29 10:11:00 EST 2025
Wed Nov 26 11:30:09 EST 2025
Wed Nov 26 11:37:02 EST 2025
Thu May 22 21:19:37 EDT 2025
Sat Aug 02 01:41:12 EDT 2025
Sat Nov 29 02:58:38 EST 2025
Tue Nov 18 22:20:59 EST 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 3
Language English
License Copyright: © 2023 Douglas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Creative Commons Attribution License
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c759t-a4e2df76f82b65f9b7635780d132cae1961c874813b7b127e771591fcd7e991a3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ObjectType-Article-2
ObjectType-Feature-1
content type line 23
Competing Interests: The authors have declared that no competing interests exist.
ORCID 0000-0003-4395-2282
OpenAccessLink https://www.proquest.com/docview/2786774855?pq-origsite=%requestingapplication%
PMID 36917576
PQID 2786774855
PQPubID 1436336
PageCount e0279720
ParticipantIDs plos_journals_2786774855
doaj_primary_oai_doaj_org_article_747cc3330a404950b30696d247f621a9
pubmedcentral_primary_oai_pubmedcentral_nih_gov_10013894
proquest_miscellaneous_2786812275
proquest_journals_2786774855
gale_infotracmisc_A741215629
gale_infotracacademiconefile_A741215629
gale_incontextgauss_ISR_A741215629
gale_incontextgauss_IOV_A741215629
gale_healthsolutions_A741215629
pubmed_primary_36917576
crossref_citationtrail_10_1371_journal_pone_0279720
crossref_primary_10_1371_journal_pone_0279720
PublicationCentury 2000
PublicationDate 2023-03-14
PublicationDateYYYYMMDD 2023-03-14
PublicationDate_xml – month: 03
  year: 2023
  text: 2023-03-14
  day: 14
PublicationDecade 2020
PublicationPlace United States
PublicationPlace_xml – name: United States
– name: San Francisco
– name: San Francisco, CA USA
PublicationTitle PloS one
PublicationTitleAlternate PLoS One
PublicationYear 2023
Publisher Public Library of Science
Public Library of Science (PLoS)
Publisher_xml – name: Public Library of Science
– name: Public Library of Science (PLoS)
References M Chmielewski (pone.0279720.ref002) 2020; 11
LR Goldberg (pone.0279720.ref038) 2006; 40
R Brotherton (pone.0279720.ref041) 2013; 279
C Antoun (pone.0279720.ref045) 2016; 28
B MacInnis (pone.0279720.ref008) 2018; 82
DS Yeager (pone.0279720.ref009) 2011; 75
PG Curran (pone.0279720.ref029) 2019; 82
NA Bowling (pone.0279720.ref026) 2021; 24
AA Arechar (pone.0279720.ref022) 2021; 53
H Aguinis (pone.0279720.ref034); 47
P Eyal (pone.0279720.ref007) 2021
J Chandler (pone.0279720.ref020) 2019; 51
JL Huang (pone.0279720.ref039) 2012; 27
DJ Hauser (pone.0279720.ref028) 2018; 9
BD Douglas (pone.0279720.ref040) 2021; 26
A Coppock (pone.0279720.ref024) 2019; 6
SL Wise (pone.0279720.ref030) 2005; 18
L Litman (pone.0279720.ref016) 2015; 47
EA Necka (pone.0279720.ref017) 2016; 11
PT Costa (pone.0279720.ref037) 1992
J Kees (pone.0279720.ref014) 2017; 46
J Ternovski (pone.0279720.ref023) 2022; 2
JL Huang (pone.0279720.ref004) 2021; 36
J Chandler (pone.0279720.ref005) 2020; 129
B Zhang (pone.0279720.ref044) 2020; 13
JL Ibarra (pone.0279720.ref021) 2018; 7
S. Holm (pone.0279720.ref043) 1979
SM Smith (pone.0279720.ref015) 2016; 69
N. Roulin (pone.0279720.ref013) 2015; 8
IP Kan (pone.0279720.ref018) 2018; 83
N. Malhotra (pone.0279720.ref031) 2008; 72
C Zhang (pone.0279720.ref032) 2014; 8
C Kennedy (pone.0279720.ref011) 2020
D Wood (pone.0279720.ref033) 2017; 8
C Cornesse (pone.0279720.ref010) 2020; 8
MD Buhrmester (pone.0279720.ref012) 2011; 6
MD Buhrmester (pone.0279720.ref001) 2018; 13
L Litman (pone.0279720.ref025) 2021
pone.0279720.ref042
SV Rouse (pone.0279720.ref035) 2015; 43
E Peer (pone.0279720.ref019) 2017; 70
G Eisele (pone.0279720.ref046) 2022; 29
DJ Hauser (pone.0279720.ref027) 2016; 10
LR Goldberg (pone.0279720.ref036) 1999; 7
AJ Barends (pone.0279720.ref006) 2019; 143
JL Huang (pone.0279720.ref003) 2015; 100
References_xml – volume: 43
  start-page: 304
  year: 2015
  ident: pone.0279720.ref035
  article-title: A reliability analysis of Mechanical Turk data
  publication-title: Comput Human Behav
  doi: 10.1016/j.chb.2014.11.004
– start-page: 65
  year: 1979
  ident: pone.0279720.ref043
  article-title: A simple sequentially rejective multiple test procedure
  publication-title: Scand Stat Theory Appl
– volume: 11
  start-page: 464
  year: 2020
  ident: pone.0279720.ref002
  article-title: An MTurk crisis? Shifts in data quality and the impact on study results
  publication-title: Soc Psychol Personal Sci
  doi: 10.1177/1948550619875149
– volume: 75
  start-page: 709
  year: 2011
  ident: pone.0279720.ref009
  article-title: Comparing the accuracy of RDD telephone surveys and internet surveys conducted with probability and non-probability samples
  publication-title: Public Opin Q
  doi: 10.1093/poq/nfr020
– volume: 70
  start-page: 153
  year: 2017
  ident: pone.0279720.ref019
  article-title: Beyond the Turk: Alternative platforms for crowdsourcing behavioral research
  publication-title: J Exp Soc Psychol
  doi: 10.1016/j.jesp.2017.01.006
– volume: 8
  start-page: 454
  year: 2017
  ident: pone.0279720.ref033
  article-title: Response speed and response consistency as mutually validating indicators of data quality in online samples
  publication-title: Soc Psychol Personal Sci
  doi: 10.1177/1948550617703168
– volume: 8
  start-page: 4
  year: 2020
  ident: pone.0279720.ref010
  article-title: A review of conceptual approaches and empirical evidence on probability and nonprobability sample survey research
  publication-title: Journal of Survey Statistics and Methodology
  doi: 10.1093/jssam/smz041
– volume: 69
  start-page: 3139
  year: 2016
  ident: pone.0279720.ref015
  article-title: A multi-group analysis of online survey respondent data quality: Comparing a regular USA consumer panel to MTurk samples
  publication-title: J Bus Res
  doi: 10.1016/j.jbusres.2015.12.002
– volume: 24
  start-page: 718
  year: 2021
  ident: pone.0279720.ref026
  article-title: Will the questions ever end? Person-level increases in careless responding during questionnaire completion
  publication-title: Organ Res Methods
  doi: 10.1177/1094428120947794
– ident: pone.0279720.ref042
– volume: 11
  start-page: e0157732
  year: 2016
  ident: pone.0279720.ref017
  article-title: Measuring the prevalence of problematic respondent behaviors among MTurk, campus, and community participants
  publication-title: PloS one
  doi: 10.1371/journal.pone.0157732
– volume: 2
  start-page: 1
  year: 2022
  ident: pone.0279720.ref023
  article-title: A Note on Increases in Inattentive Online Survey-Takers Since 2020. Journal of Quantitative Description
  publication-title: Digital Media
– volume: 6
  start-page: 1
  year: 2019
  ident: pone.0279720.ref024
  article-title: Validating the demographic, political, psychological, and experimental results obtained from a new source of online survey respondents
  publication-title: Res Politics
  doi: 10.1177/2053168018822174
– year: 2020
  ident: pone.0279720.ref011
  article-title: Assessing the Risks to Online Polls from Bogus Respondents
  publication-title: Internet]. Pew Research Center
– year: 1992
  ident: pone.0279720.ref037
– volume: 27
  start-page: 99
  year: 2012
  ident: pone.0279720.ref039
  article-title: Detecting and deterring insufficient effort responding to surveys
  publication-title: J Bus Psychol
  doi: 10.1007/s10869-011-9231-8
– volume: 8
  start-page: 127
  year: 2014
  ident: pone.0279720.ref032
  article-title: Speeding in web surveys: The tendency to answer very fast and its association with straightlining
  publication-title: Surv Res Methods
– volume: 36
  start-page: 807
  year: 2021
  ident: pone.0279720.ref004
  article-title: Insufficient effort responding as a potential confound between survey measures and objective tests
  publication-title: J Bus and Psychol
  doi: 10.1007/s10869-020-09707-2
– volume: 82
  start-page: 103849
  year: 2019
  ident: pone.0279720.ref029
  article-title: I’m paid biweekly, just not by leprechauns: Evaluating valid-but-incorrect response rates to attention check items
  publication-title: J Res Pers
  doi: 10.1016/j.jrp.2019.103849
– volume: 100
  start-page: 828
  year: 2015
  ident: pone.0279720.ref003
  article-title: Insufficient effort responding: examining an insidious confound in survey data
  publication-title: J Appl Psychol
  doi: 10.1037/a0038510
– start-page: 1
  year: 2021
  ident: pone.0279720.ref007
  article-title: Data quality of platforms and panels for online behavioral research
  publication-title: Bev Res Methods
– volume: 47
  start-page: 823
  ident: pone.0279720.ref034
  article-title: MTurk research: Review and recommendations.
  publication-title: J Manag.
– volume: 26
  start-page: 61
  year: 2021
  ident: pone.0279720.ref040
  article-title: Some researchers wear yellow pants, but even fewer participants read consent forms: Exploring and improving consent form reading in human subjects research
  publication-title: Psychol Methods
  doi: 10.1037/met0000267
– volume: 47
  start-page: 519
  year: 2015
  ident: pone.0279720.ref016
  article-title: The relationship between motivation, monetary compensation, and data quality among US-and India-based workers on Mechanical Turk
  publication-title: Behav Res Methods
  doi: 10.3758/s13428-014-0483-x
– volume: 53
  start-page: 2591
  year: 2021
  ident: pone.0279720.ref022
  article-title: Turking in the time of COVID
  publication-title: Behav Res Methods
  doi: 10.3758/s13428-021-01588-4
– volume: 13
  start-page: 1
  year: 2020
  ident: pone.0279720.ref044
  article-title: Collecting online survey data: A comparison of data quality among a commercial panel & MTurk.
  publication-title: Surv. Pract
  doi: 10.29115/SP-2020-0015
– volume: 40
  start-page: 84
  year: 2006
  ident: pone.0279720.ref038
  article-title: The international personality item pool and the future of public-domain personality measures.
  publication-title: J Res Pers
  doi: 10.1016/j.jrp.2005.08.007
– volume: 46
  start-page: 141
  year: 2017
  ident: pone.0279720.ref014
  article-title: An analysis of data quality: Professional panels, student subject pools, and Amazon’s Mechanical Turk
  publication-title: J Advert
  doi: 10.1080/00913367.2016.1269304
– volume: 7
  start-page: e101
  year: 2018
  ident: pone.0279720.ref021
  article-title: Comparison of online survey recruitment platforms for hard-to-reach pregnant smoking populations: Feasibility study
  publication-title: JMIR Res Protoc
  doi: 10.2196/resprot.8071
– volume: 72
  start-page: 914
  year: 2008
  ident: pone.0279720.ref031
  article-title: Completion time and response order effects in web surveys
  publication-title: Public Opin Q
  doi: 10.1093/poq/nfn050
– volume: 7
  start-page: 7
  year: 1999
  ident: pone.0279720.ref036
  article-title: A broad-bandwidth, public domain, personality inventory measuring the lower-level facets of several five-factor models
  publication-title: Personality psychology in Europe
– volume: 8
  start-page: 190
  year: 2015
  ident: pone.0279720.ref013
  article-title: Don’t throw the baby out with the bathwater: Comparing data quality of crowdsourcing, online panels, and student samples
  publication-title: Ind Organ Psychol
  doi: 10.1017/iop.2015.24
– year: 2021
  ident: pone.0279720.ref025
  article-title: Reply to MTurk, Prolific or panels? Choosing the right audience for online research
  publication-title: Choosing the right audience for online research
– volume: 28
  start-page: 231
  year: 2016
  ident: pone.0279720.ref045
  article-title: Comparisons of online recruitment strategies for convenience samples: Craigslist, Google AdWords, Facebook, and Amazon Mechanical Turk
  publication-title: Field Methods
  doi: 10.1177/1525822X15603149
– volume: 82
  start-page: 707
  year: 2018
  ident: pone.0279720.ref008
  article-title: The accuracy of measurements with probability and nonprobability survey samples: Replication and extension
  publication-title: Public Opin Q
  doi: 10.1093/poq/nfy038
– volume: 13
  start-page: 149
  year: 2018
  ident: pone.0279720.ref001
  article-title: An evaluation of Amazon’s Mechanical Turk, its rapid rise, and its effective use
  publication-title: Perspect Psychol Sci
  doi: 10.1177/1745691617706516
– volume: 6
  start-page: 3
  year: 2011
  ident: pone.0279720.ref012
  article-title: Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality, data?
  publication-title: Perspect Psychol Sci
  doi: 10.1177/1745691610393980
– volume: 18
  start-page: 163
  year: 2005
  ident: pone.0279720.ref030
  article-title: Response time effort: A new measure of examinee motivation in computer-based tests.
  publication-title: Appl Meas Educ
  doi: 10.1207/s15324818ame1802_2
– volume: 10
  start-page: 195
  year: 2016
  ident: pone.0279720.ref027
  article-title: Prior exposure to instructional manipulation checks does not attenuate survey context effects driven by satisficing or gricean norms
  publication-title: MDA.
– volume: 129
  start-page: 49
  year: 2020
  ident: pone.0279720.ref005
  article-title: Participant carelessness and fraud: Consequences for clinical research and potential solutions
  publication-title: J Abnorm Psychol
  doi: 10.1037/abn0000479
– volume: 279
  year: 2013
  ident: pone.0279720.ref041
  article-title: Measuring belief in conspiracy theories: The generic conspiracist beliefs scale.
  publication-title: Front Psychol
– volume: 83
  start-page: 243
  year: 2018
  ident: pone.0279720.ref018
  article-title: Do imposters threaten data quality? An examination of worker misrepresentation and downstream consequences in Amazon’s Mechanical Turk workforce.
  publication-title: Comput Human Behav
  doi: 10.1016/j.chb.2018.02.005
– volume: 29
  start-page: 136
  year: 2022
  ident: pone.0279720.ref046
  article-title: The effects of sampling frequency and questionnaire length on perceived burden, compliance, and careless responding in experience sampling data in a student population.
  publication-title: ASMNT
– volume: 51
  start-page: 2022
  year: 2019
  ident: pone.0279720.ref020
  article-title: Online panels in social science research: Expanding sampling methods beyond Mechanical Turk
  publication-title: Behav Res Methods
  doi: 10.3758/s13428-019-01273-7
– volume: 143
  start-page: 84
  year: 2019
  ident: pone.0279720.ref006
  article-title: Noncompliant responding: Comparing exclusion criteria in MTurk personality research to improve data quality
  publication-title: Pers Individ Dif
  doi: 10.1016/j.paid.2019.02.015
– volume: 9
  start-page: 998
  year: 2018
  ident: pone.0279720.ref028
  article-title: Are manipulation checks necessary?.
  publication-title: Front Psychol
  doi: 10.3389/fpsyg.2018.00998
SSID ssj0053866
Score 2.7586527
Snippet With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and...
SourceID plos
doaj
pubmedcentral
proquest
gale
pubmed
crossref
SourceType Open Website
Open Access Repository
Aggregation Database
Index Database
Enrichment Source
StartPage e0279720
SubjectTerms Biology and Life Sciences
Coronaviruses
COVID-19
Data Accuracy
Data collection
Data entry
Demographics
Humans
Medical research
Online health care information services
Pandemics
People and places
Personality
Polls & surveys
Population
Quality management
Research and Analysis Methods
Research Subjects
Researchers
Social Sciences
Surveys and Questionnaires
SummonAdditionalLinks – databaseName: DOAJ Directory of Open Access Journals
  dbid: DOA
  link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3fb9MwELZQxQMviPFrhQEGIQFSs8VJaie8lcIED3QTG2hvke04rKJKqqYB8d9zZztRgyaNB17rL1F6Pp-_S87fEfIyCnkqpFEBT3UZJEyzQJnSBAq2XiYLDXtgaJtNiMUivbjITndafWFNmJMHdoY7ArqrdQxZt0yAzE5DBRw340WUiJJHTNqje8B6umTKxWBYxZz7g3KxYEd-Xg7XdWUOIRHLBPb33tmIrF5_H5VH61XdXEU5_66c3NmKju-Q255D0pl79j1yw1R3yZ5fpQ197aWk39wjv97LraTu4ORvuqyoE8agtjNf0LQK38I01Cv-XL6l874tYUN9CRf9fN5ufkzoKfb3KZd6Querui26kr0JRRkO1PlvJlRWBT07Wczuk6_HH87nHwPfaiHQYpptA5mYqCgFL9NI8WmZKatTl4YFJKtaGlimTKciSVmshGKRMEIAD2KlLoQBhinjB2RUgXH3CZU8jrkoQ43SRkaFUkIQAR5vhd9DJcck7uyea69Dju0wVrn9uCYgH3FmzHG2cj9bYxL0V62dDsc1-Hc4pT0WVbTtD-Bbufet_DrfGpNn6BC5O5Lax4J8BjQMqBKPAPHCIlBJo8JSne-ybZr808m3fwCdfRmAXnlQWYM5tPTHI-A_oULXAHkwQEI80IPhfXTfzipNHgnULEQRILiyc-mrh5_3w3hTLL-rTN06DDDBSADmoVsBvWVjDhk_ZK1jkg7WxsD0w5FqeWmFzJn7Tp48-h-T9ZjcioCAYn0gSw7IaLtpzRNyU__cLpvNUxse_gAW7mc9
  priority: 102
  providerName: Directory of Open Access Journals
– databaseName: Public Library of Science (PLoS) Journals Open Access
  dbid: FPL
  link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3fb9MwELZQ4YEXYPxatwEGIQFSM2I7tRPeSqECCbqKDbQ3y3YcVlElVdOA-O85J04g0ybgtf5cpRff-bv6_B1CT2nIY6GsDnhssiAihgTaZjbQsPUSlRrYA8O62YSYz-PT02TxO1E8d4LPBHnpbXq4LnJ7CElUIiik6Fcp49yVcM0WH9rIC77Lub8ed9nM3vZTq_R3sXiwXhXlRUTzfL3kHxvQ7Ob_PvotdMNTTTxp1sYOumLz22jHO3OJn3vF6Rd30I83aqtwc7_yJ17muNHPwHUDv6CstPuzpsReGOjsFZ523QtL7Cu98MeTavNthBeuDVC2NCM8XRVV2lb2jbBT63DtAMoRVnmKj4_mk7vo8-ztyfRd4DsyBEaMk22gIkvTTPAsppqPs0TXcnZxmEJOa5QFbyYmFlFMmBaaUGGFALpEMpMKC0RUsXtokIMxdhFWnDEustA4BSSrQ6Ug1gDdr_XhQ62GiLUvShovV-66ZqxkfQYnIG1pzCiddaW37hAF3ax1I9fxF_xrtwY6rBPbrj-A1yi970rIuIxhjIUqgnxqHGpIsxKe0khknBKVDNEjt4Jkc3O1CxlyAmwNGBWngHhSI5zgRu4qer6qqizl-6Mv_wA6_tQDPfOgrABzGOVvUcBvckJePeRBDwlhw_SGd916b61SSiqctKHTCoKZrQ9cPPy4G3Zf6qr0cltUDQYIIxWAud-4TGdZxhNgqoIPUdxzpp7p-yP58qzWOyfNcXq0d_kj76PrFNinKw4k0QEabDeVfYCume_bZbl5WEeJX_QdZZE
  priority: 102
  providerName: Public Library of Science
Title Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA
URI https://www.ncbi.nlm.nih.gov/pubmed/36917576
https://www.proquest.com/docview/2786774855
https://www.proquest.com/docview/2786812275
https://pubmed.ncbi.nlm.nih.gov/PMC10013894
https://doaj.org/article/747cc3330a404950b30696d247f621a9
http://dx.doi.org/10.1371/journal.pone.0279720
Volume 18
WOSCitedRecordID wos000952287100012&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAON
  databaseName: DOAJ - Directory of Open Access Journals
  customDbUrl:
  eissn: 1932-6203
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0053866
  issn: 1932-6203
  databaseCode: DOA
  dateStart: 20060101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 1932-6203
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0053866
  issn: 1932-6203
  databaseCode: M~E
  dateStart: 20060101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
– providerCode: PRVPQU
  databaseName: Advanced Technologies & Aerospace Database
  customDbUrl:
  eissn: 1932-6203
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0053866
  issn: 1932-6203
  databaseCode: P5Z
  dateStart: 20061201
  isFulltext: true
  titleUrlDefault: https://search.proquest.com/hightechjournals
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Agricultural Science Database
  customDbUrl:
  eissn: 1932-6203
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0053866
  issn: 1932-6203
  databaseCode: M0K
  dateStart: 20061201
  isFulltext: true
  titleUrlDefault: https://search.proquest.com/agriculturejournals
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Biological Science Database
  customDbUrl:
  eissn: 1932-6203
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0053866
  issn: 1932-6203
  databaseCode: M7P
  dateStart: 20061201
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/biologicalscijournals
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Engineering Database
  customDbUrl:
  eissn: 1932-6203
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0053866
  issn: 1932-6203
  databaseCode: M7S
  dateStart: 20061201
  isFulltext: true
  titleUrlDefault: http://search.proquest.com
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Environmental Science Database
  customDbUrl:
  eissn: 1932-6203
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0053866
  issn: 1932-6203
  databaseCode: PATMY
  dateStart: 20061201
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/environmentalscience
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Health & Medical Collection
  customDbUrl:
  eissn: 1932-6203
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0053866
  issn: 1932-6203
  databaseCode: 7X7
  dateStart: 20061201
  isFulltext: true
  titleUrlDefault: https://search.proquest.com/healthcomplete
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Materials Science Database
  customDbUrl:
  eissn: 1932-6203
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0053866
  issn: 1932-6203
  databaseCode: KB.
  dateStart: 20061201
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/materialsscijournals
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Nursing & Allied Health Database
  customDbUrl:
  eissn: 1932-6203
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0053866
  issn: 1932-6203
  databaseCode: 7RV
  dateStart: 20061201
  isFulltext: true
  titleUrlDefault: https://search.proquest.com/nahs
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: ProQuest Central
  customDbUrl:
  eissn: 1932-6203
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0053866
  issn: 1932-6203
  databaseCode: BENPR
  dateStart: 20061201
  isFulltext: true
  titleUrlDefault: https://www.proquest.com/central
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: ProQuest Publicly Available Content Database
  customDbUrl:
  eissn: 1932-6203
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0053866
  issn: 1932-6203
  databaseCode: PIMPY
  dateStart: 20061201
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/publiccontent
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Public Health Database
  customDbUrl:
  eissn: 1932-6203
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0053866
  issn: 1932-6203
  databaseCode: 8C1
  dateStart: 20061201
  isFulltext: true
  titleUrlDefault: https://search.proquest.com/publichealth
  providerName: ProQuest
– providerCode: PRVATS
  databaseName: Public Library of Science (PLoS) Journals Open Access
  customDbUrl:
  eissn: 1932-6203
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0053866
  issn: 1932-6203
  databaseCode: FPL
  dateStart: 20060101
  isFulltext: true
  titleUrlDefault: http://www.plos.org/publications/
  providerName: Public Library of Science
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3db9MwELdYxwMvwPhaYRSDkACp6fLR2gkvqC2rmEa7qPtQ4SVynGSrqJLStCD-e-4cJyxoAiRe7iE-V7V9d76zz78j5KVtMpeLODSYKxOja0nLCOMkNkLYei0RSdgDTVVsgk8m7mzm-frALddplaVNVIY6yiSeke_bHJHXEMrk3fKrgVWj8HZVl9DYItuIkoCK6fc-l5YYdJkx_VzO4da-Xp3OMkvjDoRjHscq31e2I4XaX9nmxnKR5dc5nr_nT17ZkEZ3_ncod8lt7YrSfiE7O-RGnN4jO1rZc_paI1K_uU--vxdrQYv3lz_oPKUFvgZVBf6MfBPiYU5ONXDQ5Vs6rKob5lRngtHx6Wb1pU19LBOUzGWbDhfZJioz_9oU0TywXEDepiKN6MnxpP-AnI0OTocfDF2xwZC8560N0Y3tKOEsce2Q9RIvVHB3rhlBzCtFDNpuSRdGbjkhDy2bx5yDO2UlMuIxOKrCeUgaKazOLqGCOQ7jiSkRISkOTSHAFkE4oPDjzVA0iVMuXCA1nDlW1VgE6o6OQ1hTTGOAyx3o5W4So-q1LOA8_sI_QJmoeBGMW33IVheB1u0AIjIpHccxRRfirZ4ZQhjmscju8oTZlvCa5BlKVFC8bK1MStAHbw6kltnA8UJxICBHihk_F2KT58Hh8fk_MJ1Ma0yvNFOSwXRIoV9ZwJgQ6KvGuVfjBLMia827KP_lrOTBL6mFnqVcX9_8vGrGH8UsvjTONgUPOJQ2B55HhQpVM-swDzxZzprErSlXberrLen8UuGhW8V1e_fxn__XE3LLBg8VEwit7h5prFeb-Cm5Kb-t5_mqRbb49BzpjCvqAnWHVotsDw4m_rSlDmuAjvyPQI8GHaBj8wgp9xU9aSnrAz38w7H_6Sf3AYQD
linkProvider ProQuest
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Lb9NAEF6VgAQXoLwaKHRBIECKW3vt7NpICIWUqlXbtKIB5WbW63UbEdkhTqj6p_iNzNhrU6MKuPTANfvZjsfztGe_IeQ5s7kvpI4s7qvE8hzlWJFOtBVB6HVkrCAG2sWwCTEY-KNRcLhEflR7YbCtsvKJhaOOM4XvyDeYQOY1pDJ5N_1m4dQo_LpajdAo1WJXn51CyZa_3dmE5_uCsa0Pw_62ZaYKWEp0g7klPc3iRPDEZxHvJkFUULL5dgx1mZIaNNJRPlzIcSMROUxoISDkO4mKhYZkSrpw3ivkKvhxgS1kYlQXeOA7ODfb81zhbBhtWJ9mqV6H8i8QOFX8XPgrpgTUsaA1nWT5RYnu7_2a5wLg1q3_TXS3yU2TatNeaRvLZEmnd8iycWY5fWUYt1_fJaebci5pub_0jI5TWvKH0GKAoZUvInxZlVNDjHTyhvbr6Y05NZ1udH-4mH3t0EMcg5SMVYf2J9kirjobOxTZSnAcQt6hMo3p0cGgd498uhQB3CetFLRhhVDJXZeLxFbIAKUjW0rwtVDuFPz4diTbxK0UJVSGrh2nhkzC4hukgLKtFGOI6hUa9WoTqz5qWtKV_AX_HnWwxiLZePFDNjsOje8KoeJUynVdW3pQT3btCMrMgMfMEwlnjgzaZA01OCx37tYuM-xBtgoZJWeAeFYgkHAkxY6mY7nI83Dn4PM_gI4-NkAvDSjJQBxKml0kcE9IZNZArjaQ4DZVY3kF7a2SSh7-shI4srKji5ef1st4UuxSTHW2KDGQMDMBmAelydaSdXkAmbrgbeI3jLkh-uZKOj4p-N6dsp3Ae_jn_7VGrm8P9_fCvZ3B7iNyg0E2js2SjrdKWvPZQj8m19T3-TifPSm8FiVfLtvWfwJjw9Ko
linkToPdf http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Lb9NAEF6VgBAXoLwaKHRBIECKG7-yayMhFBIiokIa0YIqLma9XrcRkR3imKp_jV_HjL02NaqASw9cs2M7Hs_Tnv0-Qh7bJvO4UKHBPBkbriUtI1SxMkJIvZaIJORAsyCb4JOJd3DgT9fIj2ovDI5VVjGxCNRRKvEdedfmiLyGUCbdWI9FTIejV4tvBjJI4ZfWik6jNJEddXIM7Vv2cjyEZ_3Etkdv9gdvDc0wYEje81eGcJUdxZzFnh2yXuyHBTybZ0bQo0mhwDot6cFFLSfkoWVzxTmkfyuWEVdQWAkHznuBXOTQY2LjN-19rrIAxBHG9FY9h1tdbRnbizRR29AK-hwZxk-lwoIxoM4LrcU8zc4qen-f3TyVDEfX_mc1XidXdQlO-6XPrJM1ldwg6zrIZfSZRuJ-fpMcD8VK0HLf6QmdJbTEFaEFsaGR5SG-xMqoBkw6ekEHNatjRvUEHH2_ny-_dugU6ZHimezQwTzNo2risUMRxQRpErIOFUlE93Yn_Vvk47ko4DZpJWAZG4QK5jiMx6ZEZCgVmkJADIY2qMDNN0PRJk5lNIHUMO7IJjIPim-THNq5Uo0BmlqgTa1NjPqoRQlj8hf512iPtSyCkBc_pMvDQMe0ADpRKR3HMYULfWbPDKH99FlkuzxmtiX8NtlCaw7KHb11KA36UMVCpclskHhUSCAQSYK2eCjyLAvGu5_-QWjvQ0PoqRaKU1CHFHp3CdwTApw1JDcbkhBOZWN5A32v0koW_PIYOLLyqbOXH9bLeFKcXkxUmpcyUEjbHGTulO5ba9ZhPlTwnLWJ13DshuqbK8nsqMCBt8oxA_fun__XFrkMLh68G0927pErNhTpOENpuZuktVrm6j65JL-vZtnyQRHAKPly3q7-E0cv25s
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Data+quality+in+online+human-subjects+research%3A+Comparisons+between+MTurk%2C+Prolific%2C+CloudResearch%2C+Qualtrics%2C+and+SONA&rft.jtitle=PloS+one&rft.au=Douglas%2C+Benjamin+D&rft.au=Ewell%2C+Patrick+J&rft.au=Brauer%2C+Markus&rft.date=2023-03-14&rft.pub=Public+Library+of+Science&rft.issn=1932-6203&rft.eissn=1932-6203&rft.volume=18&rft.issue=3&rft.spage=e0279720&rft_id=info:doi/10.1371%2Fjournal.pone.0279720&rft.externalDocID=A741215629
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1932-6203&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1932-6203&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1932-6203&client=summon