Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA

With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated...

Full description

Saved in:

Bibliographic Details
Published in:	PloS one Vol. 18; no. 3; p. e0279720
Main Authors:	Douglas, Benjamin D., Ewell, Patrick J., Brauer, Markus
Format:	Journal Article
Language:	English
Published:	United States Public Library of Science 14.03.2023 Public Library of Science (PLoS)
Subjects:	Biology and Life Sciences Coronaviruses COVID-19 Data Accuracy Data collection Data entry Demographics Humans Medical research Online health care information services Pandemics People and places Personality Polls & surveys Population Quality management Research and Analysis Methods Research Subjects Researchers Social Sciences Surveys and Questionnaires United States United States > US
ISSN:	1932-6203, 1932-6203
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Abstract	With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated by the percentage of participants who meaningfully respond to the researcher’s question (high quality) versus those who only contribute noise (low quality). We found that compared to MTurk, Qualtrics, or an undergraduate student sample (i.e., SONA), participants on Prolific and CloudResearch were more likely to pass various attention checks, provide meaningful answers, follow instructions, remember previously presented information, have a unique IP address and geolocation, and work slowly enough to be able to read all the items. We divided the samples into high- and low-quality respondents and computed the cost we paid per high-quality respondent. Prolific ($1.90) and CloudResearch ($2.00) were cheaper than MTurk ($4.36) and Qualtrics ($8.17). SONA cost $0.00, yet took the longest to collect the data.
AbstractList	With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated by the percentage of participants who meaningfully respond to the researcher’s question (high quality) versus those who only contribute noise (low quality). We found that compared to MTurk, Qualtrics, or an undergraduate student sample (i.e., SONA), participants on Prolific and CloudResearch were more likely to pass various attention checks, provide meaningful answers, follow instructions, remember previously presented information, have a unique IP address and geolocation, and work slowly enough to be able to read all the items. We divided the samples into high- and low-quality respondents and computed the cost we paid per high-quality respondent. Prolific ($1.90) and CloudResearch ($2.00) were cheaper than MTurk ($4.36) and Qualtrics ($8.17). SONA cost $0.00, yet took the longest to collect the data. With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated by the percentage of participants who meaningfully respond to the researcher's question (high quality) versus those who only contribute noise (low quality). We found that compared to MTurk, Qualtrics, or an undergraduate student sample (i.e., SONA), participants on Prolific and CloudResearch were more likely to pass various attention checks, provide meaningful answers, follow instructions, remember previously presented information, have a unique IP address and geolocation, and work slowly enough to be able to read all the items. We divided the samples into high- and low-quality respondents and computed the cost we paid per high-quality respondent. Prolific ($1.90) and CloudResearch ($2.00) were cheaper than MTurk ($4.36) and Qualtrics ($8.17). SONA cost $0.00, yet took the longest to collect the data.With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and non-human respondents (bots). We compared the quality of the data collected through five commonly used platforms. Data quality was indicated by the percentage of participants who meaningfully respond to the researcher's question (high quality) versus those who only contribute noise (low quality). We found that compared to MTurk, Qualtrics, or an undergraduate student sample (i.e., SONA), participants on Prolific and CloudResearch were more likely to pass various attention checks, provide meaningful answers, follow instructions, remember previously presented information, have a unique IP address and geolocation, and work slowly enough to be able to read all the items. We divided the samples into high- and low-quality respondents and computed the cost we paid per high-quality respondent. Prolific ($1.90) and CloudResearch ($2.00) were cheaper than MTurk ($4.36) and Qualtrics ($8.17). SONA cost $0.00, yet took the longest to collect the data.
Audience	Academic
Author	Douglas, Benjamin D. Ewell, Patrick J. Brauer, Markus
AuthorAffiliation	Kent State University, UNITED STATES 2 Department of Psychology, Kenyon College, Gambier, Ohio, United States of America 1 Department of Psychology, University of Wisconsin–Madison, Madison, Wisconsin, United States of America
AuthorAffiliation_xml	– name: 1 Department of Psychology, University of Wisconsin–Madison, Madison, Wisconsin, United States of America – name: Kent State University, UNITED STATES – name: 2 Department of Psychology, Kenyon College, Gambier, Ohio, United States of America
Author_xml	– sequence: 1 givenname: Benjamin D. surname: Douglas fullname: Douglas, Benjamin D. – sequence: 2 givenname: Patrick J. surname: Ewell fullname: Ewell, Patrick J. – sequence: 3 givenname: Markus orcidid: 0000-0003-4395-2282 surname: Brauer fullname: Brauer, Markus
BackLink	https://www.ncbi.nlm.nih.gov/pubmed/36917576$$D View this record in MEDLINE/PubMed
BookMark	eNqNk9tuEzEQhlcIRA_wBggsISGQkuDDrr3uDarCqVKh0BZuLa_Xmzg4dmp7KX17HLJFTVUh5Iu1Zr__98xoZq-477zTRfEEwQkiDL1e-D44aSerHJ5AzDjD8F6xizjBY4ohuX_jvlPsxbiAsCI1pQ-LHUI5YhWju8XlW5kkuOilNekKGAe8s8ZpMO-X0o1j3yy0ShEEHbUMan4Apn65ksFE7yJodLrU2oFP5334MQJfgremM2oEptb37emgGYGv2T4Fo-IISNeCs5PPh4-KB520UT8evvvFt_fvzqcfx8cnH46mh8djxSqexrLUuO0Y7Wrc0KrjDaOkYjVsEcFKasQpUjUra0Qa1iDMNGOo4qhTLdOcI0n2i2cb35X1UQw9iwKzmrKsq6pMHG2I1suFWAWzlOFKeGnEn4APMyFDMspqwUqmFCEEyhKWvIINgZTTFpesoxhJnr3eDK_1zVK3SrsUpN0y3f7jzFzM_E-BIESk5mV2eDk4BH_R65jE0kSlrZVO-36TeI0wZuvEn99C7y5voGYyV2Bc5_PDam0qDlmJMKooXic-uYPKp9VLo_KEdSbHtwSvtgSZSfpXmsk-RnF0dvr_7Mn3bfbFDXau8-DMo7d9MnngtsGnN1v9t8fXo52Bgw2ggo8x6E4ok-TaJ5dmbG65WO_RddPEeo_EsEdZXN4SX_v_U_Yb1NIfjg
CitedBy_id	crossref_primary_10_1177_13684302241305368 crossref_primary_10_1016_j_chiabu_2024_106938 crossref_primary_10_1016_j_appet_2023_106596 crossref_primary_10_1002_hrm_70014 crossref_primary_10_1016_j_appet_2024_107848 crossref_primary_10_1108_IJEBR_11_2023_1188 crossref_primary_10_1177_23794607241311793 crossref_primary_10_1177_20503245231191400 crossref_primary_10_1016_j_appet_2024_107608 crossref_primary_10_1080_00224499_2024_2371951 crossref_primary_10_1098_rsos_231711 crossref_primary_10_1108_IJCHM_10_2023_1578 crossref_primary_10_1177_00207640251345028 crossref_primary_10_3390_ijerph22071072 crossref_primary_10_1016_j_techsoc_2024_102586 crossref_primary_10_1016_j_jpsychires_2025_01_021 crossref_primary_10_1017_XPS_2024_10 crossref_primary_10_1016_j_ergon_2024_103595 crossref_primary_10_1145_3716394 crossref_primary_10_1016_j_euroecorev_2024_104778 crossref_primary_10_1108_JKM_01_2025_0061 crossref_primary_10_2196_60862 crossref_primary_10_1080_0163853X_2025_2478800 crossref_primary_10_1016_j_chbr_2025_100682 crossref_primary_10_1016_j_jenvp_2024_102278 crossref_primary_10_1027_1015_5759_a000818 crossref_primary_10_1111_jocd_16465 crossref_primary_10_1002_eat_24290 crossref_primary_10_1080_19419899_2025_2465989 crossref_primary_10_1108_JHTI_01_2024_0012 crossref_primary_10_1177_21677026241306048 crossref_primary_10_1016_j_socec_2025_102399 crossref_primary_10_1002_jsc_2680 crossref_primary_10_1007_s11199_024_01507_9 crossref_primary_10_1007_s12119_025_10343_2 crossref_primary_10_1016_j_accinf_2024_100696 crossref_primary_10_1093_jcmc_zmae023 crossref_primary_10_1002_osp4_70041 crossref_primary_10_1016_j_chbah_2024_100093 crossref_primary_10_1177_10776990251359660 crossref_primary_10_1177_20597991251333345 crossref_primary_10_1111_pops_70037 crossref_primary_10_1177_10963480251336155 crossref_primary_10_1186_s40337_024_00964_7 crossref_primary_10_1016_j_appet_2024_107821 crossref_primary_10_1177_13591053241247376 crossref_primary_10_1080_00207543_2025_2543961 crossref_primary_10_1080_1359432X_2025_2458343 crossref_primary_10_1093_pnasnexus_pgae506 crossref_primary_10_2139_ssrn_4546369 crossref_primary_10_3389_feduc_2025_1595648 crossref_primary_10_1017_bpp_2024_8 crossref_primary_10_1038_s41598_024_57582_1 crossref_primary_10_1111_jpim_12774 crossref_primary_10_1108_JPBM_07_2023_4588 crossref_primary_10_1123_ijsc_2024_0205 crossref_primary_10_1080_09585192_2025_2542772 crossref_primary_10_1044_2023_JSLHR_22_00617 crossref_primary_10_3389_fcomm_2023_1256452 crossref_primary_10_1002_cpp_70085 crossref_primary_10_1080_03075079_2024_2323571 crossref_primary_10_1177_10731911241273352 crossref_primary_10_1002_aur_70039 crossref_primary_10_1371_journal_pone_0329404 crossref_primary_10_1007_s10669_025_10004_7 crossref_primary_10_1111_pops_70024 crossref_primary_10_1111_wej_12987 crossref_primary_10_1016_j_poetic_2025_102043 crossref_primary_10_1177_00220426231187284 crossref_primary_10_1108_JAOC_06_2024_0196 crossref_primary_10_1007_s11031_024_10091_0 crossref_primary_10_1108_JCM_10_2024_7298 crossref_primary_10_1080_07481187_2024_2349933 crossref_primary_10_1007_s12529_023_10255_1 crossref_primary_10_1080_27703371_2025_2490128 crossref_primary_10_2196_58409 crossref_primary_10_1080_0144929X_2024_2433037 crossref_primary_10_1111_spol_13118 crossref_primary_10_3758_s13428_024_02489_y crossref_primary_10_1016_j_resplu_2025_100919 crossref_primary_10_1177_0034673X241304733 crossref_primary_10_1080_00913367_2024_2393708 crossref_primary_10_1111_spc3_12923 crossref_primary_10_1016_j_trc_2023_104391 crossref_primary_10_1080_02650487_2024_2377503 crossref_primary_10_1080_15309576_2025_2560620 crossref_primary_10_1080_17457289_2025_2474423 crossref_primary_10_1007_s00146_025_02378_8 crossref_primary_10_1016_j_csi_2025_103982 crossref_primary_10_1016_j_paid_2025_113367 crossref_primary_10_1080_0144929X_2025_2547922 crossref_primary_10_1287_orsc_2020_14640 crossref_primary_10_1016_j_pursup_2024_100922 crossref_primary_10_1080_10508422_2024_2341639 crossref_primary_10_1016_j_appet_2025_107926 crossref_primary_10_1038_s41562_025_02194_6 crossref_primary_10_1177_02654075241302240 crossref_primary_10_1016_j_jesp_2024_104632 crossref_primary_10_1016_j_jretconser_2025_104500 crossref_primary_10_1111_1911_3838_12411 crossref_primary_10_1016_j_joep_2024_102776 crossref_primary_10_1080_08989621_2025_2457100 crossref_primary_10_1080_15377938_2023_2207171 crossref_primary_10_1016_j_econlet_2025_112509 crossref_primary_10_1177_19485506241228469 crossref_primary_10_1080_15325024_2024_2362695 crossref_primary_10_1016_j_spinee_2025_05_005 crossref_primary_10_1002_joe_22293 crossref_primary_10_1016_j_spc_2024_03_009 crossref_primary_10_1108_IJM_11_2024_0773 crossref_primary_10_1177_10591478241266524 crossref_primary_10_1016_j_eatbeh_2025_101978 crossref_primary_10_1007_s41347_025_00543_w crossref_primary_10_1016_j_ijhm_2025_104157 crossref_primary_10_1080_15378020_2024_2303534 crossref_primary_10_1016_j_jbef_2025_101040 crossref_primary_10_1016_j_actpsy_2024_104377 crossref_primary_10_1080_01490400_2025_2545317 crossref_primary_10_1080_23774657_2025_2542952 crossref_primary_10_1080_13825585_2023_2282223 crossref_primary_10_1038_s44220_025_00385_8 crossref_primary_10_1111_fare_13190 crossref_primary_10_1016_j_jogn_2025_06_004 crossref_primary_10_3390_admsci15040127 crossref_primary_10_1089_fpsam_2023_0204 crossref_primary_10_1016_j_pmedr_2025_103179 crossref_primary_10_1371_journal_pone_0325196 crossref_primary_10_1140_epjds_s13688_025_00558_6 crossref_primary_10_1002_mar_22220 crossref_primary_10_1016_j_paid_2025_113103 crossref_primary_10_1007_s43681_024_00603_6 crossref_primary_10_1007_s10826_024_02996_8 crossref_primary_10_1016_j_jbef_2024_100905 crossref_primary_10_1177_01461672251339690 crossref_primary_10_1177_10659129251321434 crossref_primary_10_2196_66083 crossref_primary_10_1177_01461672231203123 crossref_primary_10_1371_journal_pone_0327370 crossref_primary_10_1145_3707649 crossref_primary_10_1016_j_chb_2024_108427 crossref_primary_10_1038_s43856_023_00379_6 crossref_primary_10_1155_hbe2_8808655 crossref_primary_10_1016_j_cognition_2025_106063 crossref_primary_10_1111_1911_3846_12936 crossref_primary_10_1080_14681994_2024_2332622 crossref_primary_10_1186_s40795_025_01051_z crossref_primary_10_1016_j_chb_2023_108025 crossref_primary_10_1080_03050629_2025_2495697 crossref_primary_10_1007_s12144_024_07218_4 crossref_primary_10_1093_jamia_ocad198 crossref_primary_10_3390_bs15091196 crossref_primary_10_1002_icd_2525 crossref_primary_10_1111_jsr_14276 crossref_primary_10_1007_s10869_024_09992_1 crossref_primary_10_1016_j_clae_2025_102387 crossref_primary_10_3390_su16156393 crossref_primary_10_1038_s41598_023_46048_5 crossref_primary_10_1145_3710946 crossref_primary_10_1371_journal_pone_0294739 crossref_primary_10_1016_j_techfore_2025_124219 crossref_primary_10_1016_j_techsoc_2025_102903 crossref_primary_10_1038_s41598_025_98221_7 crossref_primary_10_1098_rsos_250361 crossref_primary_10_1111_tops_70022 crossref_primary_10_1177_10755470241232352 crossref_primary_10_1080_10510974_2024_2353393 crossref_primary_10_2196_62828 crossref_primary_10_1016_j_ejtd_2025_100533 crossref_primary_10_1016_j_chb_2023_108017 crossref_primary_10_1016_j_socec_2025_102371 crossref_primary_10_1080_02650487_2025_2510062 crossref_primary_10_1007_s12144_024_06575_4 crossref_primary_10_1007_s12671_024_02356_z crossref_primary_10_1016_j_isci_2025_113006 crossref_primary_10_1017_S0143814X24000266 crossref_primary_10_1080_00952990_2023_2300398 crossref_primary_10_17645_mac_9550 crossref_primary_10_1017_S175504832510014X crossref_primary_10_1111_ijcs_13094 crossref_primary_10_1080_00223891_2024_2411557 crossref_primary_10_1371_journal_pone_0305364 crossref_primary_10_1002_pra2_1146 crossref_primary_10_1016_j_bodyim_2025_101901 crossref_primary_10_3390_multimedia1010004 crossref_primary_10_62347_OAHP6281 crossref_primary_10_1080_26895269_2025_2478497 crossref_primary_10_2478_remav_2024_0038 crossref_primary_10_1177_00223433241233960 crossref_primary_10_1177_02750740241268263 crossref_primary_10_1080_00218499_2025_2537503 crossref_primary_10_1016_j_chb_2024_108460 crossref_primary_10_2196_65356 crossref_primary_10_1111_bjc_12525 crossref_primary_10_1016_j_rmal_2025_100235 crossref_primary_10_1097_GOX_0000000000005736 crossref_primary_10_1038_s41598_025_01043_w crossref_primary_10_1016_j_jclepro_2024_143300 crossref_primary_10_1080_08824096_2023_2209713 crossref_primary_10_1080_17440572_2024_2423918 crossref_primary_10_1080_00224499_2025_2507881 crossref_primary_10_1111_bjhp_12786 crossref_primary_10_1080_10447318_2024_2423125 crossref_primary_10_1080_13215906_2025_2463650 crossref_primary_10_1080_10696679_2024_2385374 crossref_primary_10_1016_j_foodqual_2024_105194 crossref_primary_10_1080_07418825_2024_2361719 crossref_primary_10_1145_3677077 crossref_primary_10_1002_ajpa_70104 crossref_primary_10_1007_s10805_024_09541_8 crossref_primary_10_1109_TSE_2024_3437355 crossref_primary_10_3389_forgp_2025_1580957 crossref_primary_10_1108_CBTH_01_2024_0001 crossref_primary_10_1016_j_parkreldis_2024_107183 crossref_primary_10_1080_10447318_2025_2495847 crossref_primary_10_3390_languages10020025 crossref_primary_10_1016_j_paid_2024_112690 crossref_primary_10_1080_21568316_2024_2443187 crossref_primary_10_1007_s12144_024_06828_2 crossref_primary_10_1080_08934215_2025_2504875 crossref_primary_10_1109_TVCG_2024_3520219 crossref_primary_10_1080_10852352_2025_2547441 crossref_primary_10_1080_10410236_2025_2524434 crossref_primary_10_1007_s12144_024_07242_4 crossref_primary_10_1093_oxfclm_kgae021 crossref_primary_10_3390_su16062540 crossref_primary_10_1007_s10964_023_01867_7 crossref_primary_10_1080_1062726X_2025_2501552 crossref_primary_10_1177_21677026251349809 crossref_primary_10_1177_03616843231215373 crossref_primary_10_3390_su17125606 crossref_primary_10_1007_s10826_024_02808_z crossref_primary_10_1016_j_jretconser_2025_104326 crossref_primary_10_1089_aut_2023_0119 crossref_primary_10_1111_pere_12539 crossref_primary_10_2139_ssrn_4709548 crossref_primary_10_1073_pnas_2418821122 crossref_primary_10_1017_rep_2025_10011 crossref_primary_10_1080_00207543_2025_2508918 crossref_primary_10_1080_03050629_2025_2478145 crossref_primary_10_1007_s11109_023_09905_7 crossref_primary_10_1108_MRR_12_2023_0908 crossref_primary_10_1089_aut_2023_0134 crossref_primary_10_1177_21674795251346506 crossref_primary_10_2196_70926 crossref_primary_10_1016_j_paid_2024_112684 crossref_primary_10_1017_psy_2025_10041 crossref_primary_10_1521_soco_2025_43_1_17 crossref_primary_10_1007_s10672_023_09483_0 crossref_primary_10_1080_07421222_2024_2340829 crossref_primary_10_1080_10463283_2025_2489867 crossref_primary_10_1080_10510974_2025_2515032 crossref_primary_10_1016_j_cogpsych_2025_101735 crossref_primary_10_1007_s00426_025_02136_x crossref_primary_10_1017_XPS_2025_10018 crossref_primary_10_4018_IRMJ_386593 crossref_primary_10_1093_pnasnexus_pgaf062 crossref_primary_10_1108_BL_08_2024_0130 crossref_primary_10_1007_s12144_024_06347_0 crossref_primary_10_1007_s12207_024_09520_9 crossref_primary_10_1371_journal_pone_0293810 crossref_primary_10_1080_1461670X_2025_2559020 crossref_primary_10_1027_0227_5910_a001020 crossref_primary_10_1016_j_trf_2025_03_003 crossref_primary_10_1080_10826084_2024_2392517 crossref_primary_10_1007_s10869_025_10039_2 crossref_primary_10_1016_j_ecresq_2024_10_001 crossref_primary_10_1080_02791072_2024_2312980 crossref_primary_10_1080_2050571X_2025_2501774 crossref_primary_10_1016_j_trip_2025_101545 crossref_primary_10_1177_14999013251366447 crossref_primary_10_1016_j_ijhm_2025_104204 crossref_primary_10_1080_13683500_2024_2402563 crossref_primary_10_1177_23294884241248133 crossref_primary_10_3389_fpsyg_2023_1166960 crossref_primary_10_2196_66496 crossref_primary_10_1007_s40653_025_00721_1 crossref_primary_10_1108_JOSM_06_2024_0275 crossref_primary_10_1111_pere_12516 crossref_primary_10_1016_j_tmp_2025_101392 crossref_primary_10_3389_fpsyt_2025_1595502 crossref_primary_10_1093_pnasnexus_pgaf197 crossref_primary_10_2139_ssrn_4846170 crossref_primary_10_1038_s41467_024_50966_x crossref_primary_10_1007_s10834_024_09988_2 crossref_primary_10_1177_00491241251327130 crossref_primary_10_1108_INTR_08_2022_0635 crossref_primary_10_1111_capa_70003 crossref_primary_10_1521_soco_2024_42_6_522 crossref_primary_10_1111_jsr_14337 crossref_primary_10_1016_j_ijhm_2025_104307 crossref_primary_10_1177_23780231251325087 crossref_primary_10_1007_s41542_024_00218_7 crossref_primary_10_1177_10776990241287159 crossref_primary_10_1111_joms_13121 crossref_primary_10_1177_02654075241312690 crossref_primary_10_1016_j_vaccine_2024_126198 crossref_primary_10_3758_s13414_024_02893_8 crossref_primary_10_1016_j_cedpsych_2024_102294 crossref_primary_10_1016_j_jpsychires_2025_01_041 crossref_primary_10_1038_s41562_024_02062_9 crossref_primary_10_1111_bjc_12552 crossref_primary_10_1177_16094069251321256 crossref_primary_10_3389_frai_2023_1249322 crossref_primary_10_1016_j_ijinfomgt_2025_102957 crossref_primary_10_3390_antibiotics13070657 crossref_primary_10_1026_1616_3443_a000804 crossref_primary_10_3758_s13428_024_02452_x crossref_primary_10_1108_EJM_08_2023_0664 crossref_primary_10_2196_45411 crossref_primary_10_1177_23294906241301354 crossref_primary_10_3390_ejihpe15090178 crossref_primary_10_1007_s12144_024_07120_z crossref_primary_10_1177_01902725241268455 crossref_primary_10_3390_ejihpe15090170 crossref_primary_10_1080_1553118X_2025_2471527 crossref_primary_10_1002_bdm_70007 crossref_primary_10_1111_socf_13055 crossref_primary_10_1080_13683500_2024_2378611 crossref_primary_10_1108_JHTT_11_2023_0348 crossref_primary_10_1007_s10615_024_00967_6 crossref_primary_10_1016_j_jbusres_2024_115127 crossref_primary_10_1080_07317115_2024_2399588 crossref_primary_10_3389_fnhum_2023_1228365 crossref_primary_10_1007_s10508_024_03009_x crossref_primary_10_1007_s10902_025_00914_3 crossref_primary_10_1080_19419899_2024_2372468 crossref_primary_10_3390_children12030342 crossref_primary_10_1016_j_appet_2024_107288 crossref_primary_10_1002_aps_1899 crossref_primary_10_1177_00207640241296055 crossref_primary_10_1080_00913367_2024_2438002 crossref_primary_10_1177_15554120251376073 crossref_primary_10_2196_63343 crossref_primary_10_1080_10646175_2025_2530461 crossref_primary_10_1186_s40834_025_00380_5 crossref_primary_10_1177_20597991251329754 crossref_primary_10_1007_s13412_025_01026_3 crossref_primary_10_1016_j_jretconser_2025_104268 crossref_primary_10_1016_j_ssresearch_2025_103193 crossref_primary_10_1177_10659129241265703 crossref_primary_10_1016_j_jpsychires_2025_05_043 crossref_primary_10_2196_73382 crossref_primary_10_3168_jds_2024_25603 crossref_primary_10_1007_s11145_025_10641_z crossref_primary_10_1080_10410236_2023_2301201 crossref_primary_10_1016_j_visres_2025_108610 crossref_primary_10_1177_01461672251313831 crossref_primary_10_1002_bdm_70040 crossref_primary_10_1038_s41598_024_58300_7 crossref_primary_10_1093_pnasnexus_pgaf150 crossref_primary_10_1007_s12144_023_04927_0 crossref_primary_10_1109_TAFFC_2024_3428704 crossref_primary_10_1016_j_paid_2023_112482 crossref_primary_10_1145_3725529 crossref_primary_10_1108_JPBM_04_2023_4452 crossref_primary_10_1080_01442872_2024_2323673 crossref_primary_10_1080_01924036_2024_2440359 crossref_primary_10_3389_fpsyt_2024_1459827 crossref_primary_10_1108_JSBED_10_2023_0468 crossref_primary_10_1016_j_jhtm_2024_03_011 crossref_primary_10_1093_abm_kaad054 crossref_primary_10_1016_j_jretconser_2025_104254 crossref_primary_10_1016_j_jretconser_2025_104496 crossref_primary_10_1098_rsos_231046 crossref_primary_10_1098_rsos_231045 crossref_primary_10_1186_s40479_024_00259_y crossref_primary_10_1111_jbl_12405 crossref_primary_10_1177_20563051251348922 crossref_primary_10_3390_su16125010 crossref_primary_10_1002_mar_21944 crossref_primary_10_1080_00952990_2025_2504152 crossref_primary_10_1111_puar_13823 crossref_primary_10_1371_journal_pone_0321592 crossref_primary_10_1002_ab_70041 crossref_primary_10_1080_09515089_2024_2354432 crossref_primary_10_1111_jmwh_13758 crossref_primary_10_1177_23294884251329160 crossref_primary_10_1016_j_bodyim_2025_101893 crossref_primary_10_1111_1745_9125_70006 crossref_primary_10_3390_ijerph22010011 crossref_primary_10_1177_10731911251333664 crossref_primary_10_1080_09537325_2024_2405137 crossref_primary_10_1177_03057356241239336 crossref_primary_10_21697_sp_2025_25_1_02 crossref_primary_10_1016_j_rssm_2024_100935 crossref_primary_10_1007_s12369_025_01306_6 crossref_primary_10_3389_fpsyg_2025_1448153 crossref_primary_10_1007_s11089_025_01212_8 crossref_primary_10_1080_13501763_2024_2326189 crossref_primary_10_2196_67923 crossref_primary_10_1080_09273948_2024_2423870 crossref_primary_10_3389_fpsyt_2025_1576406 crossref_primary_10_1016_j_learninstruc_2024_101921 crossref_primary_10_1016_j_cofs_2025_101307 crossref_primary_10_1016_j_ijchp_2025_100611 crossref_primary_10_1016_j_pubrev_2025_102569 crossref_primary_10_1017_S1743923X24000321 crossref_primary_10_1080_17439760_2024_2433045 crossref_primary_10_1016_j_paid_2024_112964 crossref_primary_10_1111_1468_5973_12620 crossref_primary_10_1287_msom_2020_0373 crossref_primary_10_1016_j_foodqual_2025_105507 crossref_primary_10_1080_10447318_2025_2556233 crossref_primary_10_1093_lpr_mgae010 crossref_primary_10_3389_frobt_2025_1436674 crossref_primary_10_1371_journal_pone_0322212 crossref_primary_10_1007_s10608_024_10563_0 crossref_primary_10_1080_10696679_2025_2452843 crossref_primary_10_1007_s12144_024_05877_x crossref_primary_10_1016_j_bodyim_2025_101897 crossref_primary_10_1108_SBM_11_2023_0138 crossref_primary_10_1111_1748_8583_12567 crossref_primary_10_1093_asj_sjaf075 crossref_primary_10_1080_10538712_2024_2314287 crossref_primary_10_1093_abm_kaaf018 crossref_primary_10_1080_10530789_2025_2485684 crossref_primary_10_1093_pnasnexus_pgae250 crossref_primary_10_1016_j_paid_2024_112794 crossref_primary_10_1111_opo_13447 crossref_primary_10_1371_journal_pone_0296489 crossref_primary_10_1007_s12599_025_00963_1 crossref_primary_10_1177_30497841251317293 crossref_primary_10_1146_annurev_soc_083024_070113 crossref_primary_10_1016_j_chbah_2024_100108 crossref_primary_10_1089_trgh_2024_0203 crossref_primary_10_1007_s12144_025_08448_w crossref_primary_10_1111_bjhp_12753 crossref_primary_10_1177_08997640251343049 crossref_primary_10_1287_mnsc_2021_01010 crossref_primary_10_1177_01461672241290390 crossref_primary_10_33423_jmdc_v18i3_7323 crossref_primary_10_1080_00224499_2024_2352555 crossref_primary_10_1007_s00146_024_02081_0 crossref_primary_10_1007_s10608_024_10551_4 crossref_primary_10_1080_09588221_2025_2497498 crossref_primary_10_1016_j_chb_2025_108763 crossref_primary_10_1080_09585192_2025_2492867 crossref_primary_10_1177_19401612241308697 crossref_primary_10_1038_s41541_024_00951_8 crossref_primary_10_1080_13811118_2025_2513020 crossref_primary_10_1038_s41598_024_76934_5 crossref_primary_10_1177_07342829241313089 crossref_primary_10_1073_pnas_2311825121 crossref_primary_10_1108_MF_12_2024_0919 crossref_primary_10_1080_0144929X_2024_2325023 crossref_primary_10_1007_s10608_025_10580_7 crossref_primary_10_1016_j_jad_2023_12_036 crossref_primary_10_1177_10711813241262033 crossref_primary_10_1177_00076503241255691 crossref_primary_10_1016_j_visres_2025_108640 crossref_primary_10_2139_ssrn_3813891 crossref_primary_10_1177_14999013251372626 crossref_primary_10_1016_j_learninstruc_2025_102179 crossref_primary_10_2166_wh_2024_074 crossref_primary_10_1177_10775595241240755 crossref_primary_10_1136_bmjopen_2024_093803 crossref_primary_10_1177_0272989X241275645 crossref_primary_10_1016_j_jbusvent_2025_106538 crossref_primary_10_1177_25152459251336127 crossref_primary_10_1016_j_appet_2025_108235 crossref_primary_10_1080_00223891_2023_2298887 crossref_primary_10_1111_1745_9125_12364 crossref_primary_10_1371_journal_pone_0307443 crossref_primary_10_1007_s10508_024_03053_7 crossref_primary_10_1108_JFMM_03_2023_0063 crossref_primary_10_1108_IJRDM_11_2024_0600 crossref_primary_10_3390_su151914560 crossref_primary_10_1080_08934215_2025_2519253 crossref_primary_10_1111_epi_18624 crossref_primary_10_1007_s10551_025_06083_w crossref_primary_10_1016_j_ijinfomgt_2024_102821 crossref_primary_10_1016_j_abrep_2024_100551 crossref_primary_10_1111_acer_70058 crossref_primary_10_1016_j_puhe_2025_01_012 crossref_primary_10_1111_joop_12487 crossref_primary_10_1016_j_scaman_2025_101434 crossref_primary_10_1093_geronb_gbae080 crossref_primary_10_1016_j_geb_2025_04_013 crossref_primary_10_1016_j_bodyim_2025_101860 crossref_primary_10_1186_s40163_024_00240_8 crossref_primary_10_1080_23311975_2025_2451125 crossref_primary_10_1111_bjhp_12765 crossref_primary_10_1080_09658211_2024_2383311 crossref_primary_10_1016_j_jpain_2024_104583 crossref_primary_10_1145_3677058 crossref_primary_10_1177_26338076231174639 crossref_primary_10_1016_j_asw_2025_100937 crossref_primary_10_1080_15332640_2024_2367243 crossref_primary_10_1093_jpepsy_jsaf077 crossref_primary_10_1007_s11127_025_01271_8 crossref_primary_10_1177_10717641231202738 crossref_primary_10_1017_dsj_2024_51 crossref_primary_10_1108_JHTI_01_2025_0126 crossref_primary_10_1016_j_intell_2025_101930 crossref_primary_10_1038_s41562_024_02023_2 crossref_primary_10_1080_13527266_2025_2560399 crossref_primary_10_1016_j_addbeh_2025_108453 crossref_primary_10_1108_JHTI_05_2024_0449 crossref_primary_10_1016_j_pubrev_2024_102536 crossref_primary_10_1177_19401612251342679 crossref_primary_10_1016_j_appet_2025_107969 crossref_primary_10_1093_pnasnexus_pgae217 crossref_primary_10_1177_17470218241310440 crossref_primary_10_2139_ssrn_5252772 crossref_primary_10_3758_s13421_025_01719_8 crossref_primary_10_1016_j_jad_2024_01_133 crossref_primary_10_1108_JSM_02_2023_0060 crossref_primary_10_1177_23294965251374636 crossref_primary_10_1108_EJM_07_2024_0572 crossref_primary_10_1016_j_peh_2025_100353 crossref_primary_10_1002_mde_70003 crossref_primary_10_1111_jasp_13021 crossref_primary_10_1177_10659129241275458 crossref_primary_10_1186_s13229_025_00643_7 crossref_primary_10_1098_rsos_241001 crossref_primary_10_1177_09636625241246084 crossref_primary_10_1017_jlc_2024_6 crossref_primary_10_1177_21674795251323193 crossref_primary_10_3389_fpsyg_2025_1535727 crossref_primary_10_3389_feduc_2024_1360848 crossref_primary_10_1017_S1468109924000227 crossref_primary_10_1007_s10584_024_03826_y crossref_primary_10_1016_j_giq_2023_101906 crossref_primary_10_1080_08870446_2025_2552228 crossref_primary_10_1080_08870446_2025_2552227 crossref_primary_10_1080_00223891_2024_2405536 crossref_primary_10_1080_21639159_2024_2397586 crossref_primary_10_1111_bjop_70030 crossref_primary_10_1177_20552076241311066 crossref_primary_10_1080_19368623_2025_2484282 crossref_primary_10_1177_00220426241252336 crossref_primary_10_1016_j_appet_2025_107981 crossref_primary_10_1111_aphw_12536 crossref_primary_10_1111_jomf_70000 crossref_primary_10_1177_00472875241230008 crossref_primary_10_1016_j_foodqual_2023_104969 crossref_primary_10_1007_s10639_025_13492_x crossref_primary_10_1016_j_trf_2024_12_021 crossref_primary_10_3390_bs15081094 crossref_primary_10_1017_jmo_2025_10021 crossref_primary_10_1016_j_jad_2025_119857 crossref_primary_10_1017_jmo_2025_10024 crossref_primary_10_1093_applin_amae048 crossref_primary_10_1093_pubmed_fdaf051 crossref_primary_10_1038_s41598_025_19246_6 crossref_primary_10_1007_s42761_024_00290_w crossref_primary_10_3389_frobt_2023_1277635 crossref_primary_10_1016_j_learninstruc_2024_102065 crossref_primary_10_1080_00918369_2024_2320242 crossref_primary_10_1016_j_econlet_2024_111944 crossref_primary_10_1038_s44271_025_00186_w crossref_primary_10_1007_s12207_025_09539_6 crossref_primary_10_1093_iwc_iwae049 crossref_primary_10_1080_01463373_2024_2432379 crossref_primary_10_1002_jocb_1519 crossref_primary_10_1111_jpr_12599 crossref_primary_10_1177_03063070241258806 crossref_primary_10_1080_10447318_2025_2477739 crossref_primary_10_1093_police_paae115 crossref_primary_10_1080_0144929X_2025_2483788 crossref_primary_10_1080_16066359_2025_2486964 crossref_primary_10_1080_0267257X_2024_2312197 crossref_primary_10_1080_08838151_2025_2487679 crossref_primary_10_1177_0734371X251316597 crossref_primary_10_1016_j_appet_2024_107670 crossref_primary_10_1027_2151_2604_a000573 crossref_primary_10_1186_s40536_024_00205_y crossref_primary_10_1002_hec_4810 crossref_primary_10_1016_j_jhtm_2025_02_002 crossref_primary_10_1002_jts_23018 crossref_primary_10_1038_s41598_025_92907_8 crossref_primary_10_1007_s44202_025_00363_2 crossref_primary_10_1080_08874417_2023_2277751 crossref_primary_10_1177_10591478241310221 crossref_primary_10_3758_s13428_025_02797_x crossref_primary_10_1007_s11031_025_10140_2 crossref_primary_10_1177_10659129231197207 crossref_primary_10_1016_j_xjmad_2024_100057 crossref_primary_10_1093_workar_waae016 crossref_primary_10_1016_j_paid_2024_112956 crossref_primary_10_1093_pnasnexus_pgae413 crossref_primary_10_1177_1179173X251338447 crossref_primary_10_1089_wound_2024_0035 crossref_primary_10_1016_j_indmarman_2024_07_008 crossref_primary_10_1007_s13164_024_00726_z crossref_primary_10_1080_10410236_2024_2348236 crossref_primary_10_1177_14648849251333597 crossref_primary_10_1016_j_foohum_2024_100485 crossref_primary_10_3846_ijspm_2024_21456 crossref_primary_10_1016_j_ijintrel_2024_102004 crossref_primary_10_1016_j_ssaho_2025_101520 crossref_primary_10_1108_IJOA_03_2025_5354 crossref_primary_10_1016_j_ijhm_2024_103756 crossref_primary_10_1027_1015_5759_a000855 crossref_primary_10_1007_s10899_023_10261_8 crossref_primary_10_1371_journal_pone_0320570 crossref_primary_10_1080_23311908_2024_2359827 crossref_primary_10_1080_10967494_2025_2557875 crossref_primary_10_1111_risa_70112 crossref_primary_10_1080_13548506_2025_2546588 crossref_primary_10_1038_s41598_025_12607_1 crossref_primary_10_1007_s41347_024_00411_z crossref_primary_10_1007_s12103_025_09841_8 crossref_primary_10_1108_CCIJ_11_2024_0204 crossref_primary_10_1073_pnas_2412015122 crossref_primary_10_1177_20438087241288532 crossref_primary_10_1080_08934215_2024_2424535 crossref_primary_10_1007_s11764_023_01488_w crossref_primary_10_1111_ssqu_70027 crossref_primary_10_1016_j_xnsj_2025_100588 crossref_primary_10_1177_10659129241303449 crossref_primary_10_1016_j_lindif_2025_102683 crossref_primary_10_1027_2157_3891_a000129 crossref_primary_10_1016_j_pubrev_2024_102517 crossref_primary_10_3389_fpubh_2024_1508261 crossref_primary_10_1177_00110000241301110 crossref_primary_10_1080_08974438_2024_2411550 crossref_primary_10_1016_j_amepre_2024_09_009 crossref_primary_10_1016_j_jvb_2024_103987 crossref_primary_10_3758_s13428_024_02557_3 crossref_primary_10_1177_00323217241309962 crossref_primary_10_1111_bjso_12900 crossref_primary_10_1016_j_jbef_2024_100995 crossref_primary_10_1016_j_jad_2025_119660 crossref_primary_10_1080_19419899_2024_2403002 crossref_primary_10_1007_s10508_024_03046_6 crossref_primary_10_1016_j_paid_2023_112502 crossref_primary_10_1093_ntr_ntae138 crossref_primary_10_1111_psj_12575 crossref_primary_10_1177_17456916241242734 crossref_primary_10_2139_ssrn_5112507 crossref_primary_10_1111_bjop_70016 crossref_primary_10_1016_j_jadohealth_2025_01_006 crossref_primary_10_1007_s10551_025_05986_y crossref_primary_10_1080_10447318_2025_2560522 crossref_primary_10_3390_ijerph20146345 crossref_primary_10_1177_08862605241270031
Cites_doi	10.1016/j.chb.2014.11.004 10.1177/1948550619875149 10.1093/poq/nfr020 10.1016/j.jesp.2017.01.006 10.1177/1948550617703168 10.1093/jssam/smz041 10.1016/j.jbusres.2015.12.002 10.1177/1094428120947794 10.1371/journal.pone.0157732 10.1177/2053168018822174 10.1007/s10869-011-9231-8 10.1007/s10869-020-09707-2 10.1016/j.jrp.2019.103849 10.1037/a0038510 10.1037/met0000267 10.3758/s13428-014-0483-x 10.3758/s13428-021-01588-4 10.29115/SP-2020-0015 10.1016/j.jrp.2005.08.007 10.1080/00913367.2016.1269304 10.2196/resprot.8071 10.1093/poq/nfn050 10.1017/iop.2015.24 10.1177/1525822X15603149 10.1093/poq/nfy038 10.1177/1745691617706516 10.1177/1745691610393980 10.1207/s15324818ame1802_2 10.1037/abn0000479 10.1016/j.chb.2018.02.005 10.3758/s13428-019-01273-7 10.1016/j.paid.2019.02.015 10.3389/fpsyg.2018.00998
ContentType	Journal Article
Copyright	Copyright: © 2023 Douglas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. COPYRIGHT 2023 Public Library of Science 2023 Douglas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. 2023 Douglas et al 2023 Douglas et al 2023 Douglas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Copyright_xml	– notice: Copyright: © 2023 Douglas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. – notice: COPYRIGHT 2023 Public Library of Science – notice: 2023 Douglas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. – notice: 2023 Douglas et al 2023 Douglas et al – notice: 2023 Douglas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
DBID	AAYXX CITATION CGR CUY CVF ECM EIF NPM IOV ISR 3V. 7QG 7QL 7QO 7RV 7SN 7SS 7T5 7TG 7TM 7U9 7X2 7X7 7XB 88E 8AO 8C1 8FD 8FE 8FG 8FH 8FI 8FJ 8FK ABJCF ABUWG AEUYN AFKRA ARAPS ATCPS AZQEC BBNVY BENPR BGLVJ BHPHI C1K CCPQU D1I DWQXO FR3 FYUFA GHDGH GNUQQ H94 HCIFZ K9. KB. KB0 KL. L6V LK8 M0K M0S M1P M7N M7P M7S NAPCQ P5Z P62 P64 PATMY PDBOC PHGZM PHGZT PIMPY PJZUB PKEHL PPXIY PQEST PQGLB PQQKQ PQUKI PTHSS PYCSY RC3 7X8 5PM DOA
DOI	10.1371/journal.pone.0279720
DatabaseName	CrossRef Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed Gale In Context: Opposing Viewpoints Gale In Context: Science ProQuest Central (Corporate) Animal Behavior Abstracts Bacteriology Abstracts (Microbiology B) Biotechnology Research Abstracts ProQuest Nursing & Allied Health Database Ecology Abstracts Entomology Abstracts (Full archive) Immunology Abstracts Meteorological & Geoastrophysical Abstracts Nucleic Acids Abstracts Virology and AIDS Abstracts Agricultural Science Collection Health & Medical Collection ProQuest Central (purchase pre-March 2016) Medical Database (Alumni Edition) ProQuest Pharma Collection ProQuest Public Health Database Technology Research Database ProQuest SciTech Collection ProQuest Technology Collection ProQuest Natural Science Collection ProQuest Hospital Collection Hospital Premium Collection (Alumni Edition) ProQuest Central (Alumni) (purchase pre-March 2016) Materials Science & Engineering Collection ProQuest Central (Alumni) ProQuest One Sustainability (subscription) ProQuest Central UK/Ireland Advanced Technologies & Computer Science Collection Agricultural & Environmental Science Collection ProQuest Central Essentials Biological Science Database ProQuest Central Technology Collection Natural Science Collection Environmental Sciences and Pollution Management ProQuest One ProQuest Materials Science Collection ProQuest Central Engineering Research Database Health Research Premium Collection Health Research Premium Collection (Alumni) ProQuest Central Student AIDS and Cancer Research Abstracts SciTech Premium Collection ProQuest Health & Medical Complete (Alumni) Materials Science Database Nursing & Allied Health Database (Alumni Edition) Meteorological & Geoastrophysical Abstracts - Academic ProQuest Engineering Collection Biological Sciences Agricultural Science Database Health & Medical Collection (Alumni) Medical Database Algology Mycology and Protozoology Abstracts (Microbiology C) Biological Science Database Engineering Database Nursing & Allied Health Premium Advanced Technologies & Aerospace Database ProQuest Advanced Technologies & Aerospace Collection Biotechnology and BioEngineering Abstracts Environmental Science Database Materials Science Collection ProQuest Central Premium ProQuest One Academic (New) Publicly Available Content Database ProQuest Health & Medical Research Collection ProQuest One Academic Middle East (New) ProQuest One Health & Nursing ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Applied & Life Sciences ProQuest One Academic (retired) ProQuest One Academic UKI Edition Engineering Collection (ProQuest) Environmental Science Collection (ProQuest) Genetics Abstracts MEDLINE - Academic PubMed Central (Full Participant titles) DOAJ Open Access Full Text
DatabaseTitle	CrossRef MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) Agricultural Science Database Publicly Available Content Database ProQuest Central Student ProQuest Advanced Technologies & Aerospace Collection ProQuest Central Essentials Nucleic Acids Abstracts SciTech Premium Collection Environmental Sciences and Pollution Management ProQuest One Applied & Life Sciences ProQuest One Sustainability Health Research Premium Collection Meteorological & Geoastrophysical Abstracts Natural Science Collection Health & Medical Research Collection Biological Science Collection ProQuest Central (New) ProQuest Medical Library (Alumni) Engineering Collection Advanced Technologies & Aerospace Collection Engineering Database Virology and AIDS Abstracts ProQuest Biological Science Collection ProQuest One Academic Eastern Edition Agricultural Science Collection ProQuest Hospital Collection ProQuest Technology Collection Health Research Premium Collection (Alumni) Biological Science Database Ecology Abstracts ProQuest Hospital Collection (Alumni) Biotechnology and BioEngineering Abstracts Environmental Science Collection Entomology Abstracts Nursing & Allied Health Premium ProQuest Health & Medical Complete ProQuest One Academic UKI Edition Environmental Science Database ProQuest Nursing & Allied Health Source (Alumni) Engineering Research Database ProQuest One Academic Meteorological & Geoastrophysical Abstracts - Academic ProQuest One Academic (New) Technology Collection Technology Research Database ProQuest One Academic Middle East (New) Materials Science Collection ProQuest Health & Medical Complete (Alumni) ProQuest Central (Alumni Edition) ProQuest One Community College ProQuest One Health & Nursing ProQuest Natural Science Collection ProQuest Pharma Collection ProQuest Central ProQuest Health & Medical Research Collection Genetics Abstracts ProQuest Engineering Collection Biotechnology Research Abstracts Health and Medicine Complete (Alumni Edition) ProQuest Central Korea Bacteriology Abstracts (Microbiology B) Algology Mycology and Protozoology Abstracts (Microbiology C) Agricultural & Environmental Science Collection AIDS and Cancer Research Abstracts Materials Science Database ProQuest Materials Science Collection ProQuest Public Health ProQuest Nursing & Allied Health Source ProQuest SciTech Collection Advanced Technologies & Aerospace Database ProQuest Medical Library Animal Behavior Abstracts Materials Science & Engineering Collection Immunology Abstracts ProQuest Central (Alumni) MEDLINE - Academic
DatabaseTitleList	MEDLINE Agricultural Science Database CrossRef MEDLINE - Academic
Database_xml	– sequence: 1 dbid: DOA name: DOAJ Open Access Full Text url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 3 dbid: PIMPY name: ProQuest Publicly Available Content url: http://search.proquest.com/publiccontent sourceTypes: Aggregation Database
DeliveryMethod	fulltext_linktorsrc
Discipline	Sciences (General)
DocumentTitleAlternate	Data quality in online human-subjects research
EISSN	1932-6203
ExternalDocumentID	2786774855 oai_doaj_org_article_747cc3330a404950b30696d247f621a9 PMC10013894 A741215629 36917576 10_1371_journal_pone_0279720
Genre	Research Support, Non-U.S. Gov't Journal Article Comparative Study
GeographicLocations	United States United States--US
GeographicLocations_xml	– name: United States – name: United States--US
GrantInformation_xml	– fundername: ;
GroupedDBID	--- 123 29O 2WC 53G 5VS 7RV 7X2 7X7 7XC 88E 8AO 8C1 8CJ 8FE 8FG 8FH 8FI 8FJ A8Z AAFWJ AAUCC AAWOE AAYXX ABDBF ABIVO ABJCF ABUWG ACCTH ACGFO ACIHN ACIWK ACPRK ACUHS ADBBV AEAQA AENEX AEUYN AFFHD AFKRA AFPKN AFRAH AHMBA ALMA_UNASSIGNED_HOLDINGS AOIJS APEBS ARAPS ATCPS BAIFH BAWUL BBNVY BBTPI BCNDV BENPR BGLVJ BHPHI BKEYQ BPHCQ BVXVI BWKFM CCPQU CITATION CS3 D1I D1J D1K DIK DU5 E3Z EAP EAS EBD EMOBN ESX EX3 F5P FPL FYUFA GROUPED_DOAJ GX1 HCIFZ HH5 HMCUK HYE IAO IEA IGS IHR IHW INH INR IOV IPY ISE ISR ITC K6- KB. KQ8 L6V LK5 LK8 M0K M1P M48 M7P M7R M7S M~E NAPCQ O5R O5S OK1 OVT P2P P62 PATMY PDBOC PHGZM PHGZT PIMPY PJZUB PPXIY PQGLB PQQKQ PROAC PSQYO PTHSS PV9 PYCSY RNS RPM RZL SV3 TR2 UKHRP WOQ WOW ~02 ~KM ADRAZ ALIPV CGR CUY CVF ECM EIF IPNFZ NPM RIG BBORY 3V. 7QG 7QL 7QO 7SN 7SS 7T5 7TG 7TM 7U9 7XB 8FD 8FK AZQEC C1K DWQXO ESTFP FR3 GNUQQ H94 K9. KL. M7N P64 PKEHL PQEST PQUKI RC3 7X8 PUEGO 5PM AAPBV ABPTK N95
ID	FETCH-LOGICAL-c759t-a4e2df76f82b65f9b7635780d132cae1961c874813b7b127e771591fcd7e991a3
IEDL.DBID	P5Z
ISICitedReferencesCount	781
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000952287100012&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	1932-6203
IngestDate	Sun May 07 16:28:27 EDT 2023 Fri Oct 03 12:43:26 EDT 2025 Tue Nov 04 02:07:17 EST 2025 Fri Sep 05 10:53:45 EDT 2025 Tue Oct 07 09:16:39 EDT 2025 Sat Nov 29 13:09:10 EST 2025 Sat Nov 29 10:11:00 EST 2025 Wed Nov 26 11:30:09 EST 2025 Wed Nov 26 11:37:02 EST 2025 Thu May 22 21:19:37 EDT 2025 Sat Aug 02 01:41:12 EDT 2025 Sat Nov 29 02:58:38 EST 2025 Tue Nov 18 22:20:59 EST 2025
IsDoiOpenAccess	true
IsOpenAccess	true
IsPeerReviewed	true
IsScholarly	true
Issue	3
Language	English
License	Copyright: © 2023 Douglas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Creative Commons Attribution License
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c759t-a4e2df76f82b65f9b7635780d132cae1961c874813b7b127e771591fcd7e991a3
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 ObjectType-Article-2 ObjectType-Feature-1 content type line 23 Competing Interests: The authors have declared that no competing interests exist.
ORCID	0000-0003-4395-2282
OpenAccessLink	https://www.proquest.com/docview/2786774855?pq-origsite=%requestingapplication%
PMID	36917576
PQID	2786774855
PQPubID	1436336
PageCount	e0279720
ParticipantIDs	plos_journals_2786774855 doaj_primary_oai_doaj_org_article_747cc3330a404950b30696d247f621a9 pubmedcentral_primary_oai_pubmedcentral_nih_gov_10013894 proquest_miscellaneous_2786812275 proquest_journals_2786774855 gale_infotracmisc_A741215629 gale_infotracacademiconefile_A741215629 gale_incontextgauss_ISR_A741215629 gale_incontextgauss_IOV_A741215629 gale_healthsolutions_A741215629 pubmed_primary_36917576 crossref_citationtrail_10_1371_journal_pone_0279720 crossref_primary_10_1371_journal_pone_0279720
PublicationCentury	2000
PublicationDate	2023-03-14
PublicationDateYYYYMMDD	2023-03-14
PublicationDate_xml	– month: 03 year: 2023 text: 2023-03-14 day: 14
PublicationDecade	2020
PublicationPlace	United States
PublicationPlace_xml	– name: United States – name: San Francisco – name: San Francisco, CA USA
PublicationTitle	PloS one
PublicationTitleAlternate	PLoS One
PublicationYear	2023
Publisher	Public Library of Science Public Library of Science (PLoS)
Publisher_xml	– name: Public Library of Science – name: Public Library of Science (PLoS)
References	M Chmielewski (pone.0279720.ref002) 2020; 11 LR Goldberg (pone.0279720.ref038) 2006; 40 R Brotherton (pone.0279720.ref041) 2013; 279 C Antoun (pone.0279720.ref045) 2016; 28 B MacInnis (pone.0279720.ref008) 2018; 82 DS Yeager (pone.0279720.ref009) 2011; 75 PG Curran (pone.0279720.ref029) 2019; 82 NA Bowling (pone.0279720.ref026) 2021; 24 AA Arechar (pone.0279720.ref022) 2021; 53 H Aguinis (pone.0279720.ref034); 47 P Eyal (pone.0279720.ref007) 2021 J Chandler (pone.0279720.ref020) 2019; 51 JL Huang (pone.0279720.ref039) 2012; 27 DJ Hauser (pone.0279720.ref028) 2018; 9 BD Douglas (pone.0279720.ref040) 2021; 26 A Coppock (pone.0279720.ref024) 2019; 6 SL Wise (pone.0279720.ref030) 2005; 18 L Litman (pone.0279720.ref016) 2015; 47 EA Necka (pone.0279720.ref017) 2016; 11 PT Costa (pone.0279720.ref037) 1992 J Kees (pone.0279720.ref014) 2017; 46 J Ternovski (pone.0279720.ref023) 2022; 2 JL Huang (pone.0279720.ref004) 2021; 36 J Chandler (pone.0279720.ref005) 2020; 129 B Zhang (pone.0279720.ref044) 2020; 13 JL Ibarra (pone.0279720.ref021) 2018; 7 S. Holm (pone.0279720.ref043) 1979 SM Smith (pone.0279720.ref015) 2016; 69 N. Roulin (pone.0279720.ref013) 2015; 8 IP Kan (pone.0279720.ref018) 2018; 83 N. Malhotra (pone.0279720.ref031) 2008; 72 C Zhang (pone.0279720.ref032) 2014; 8 C Kennedy (pone.0279720.ref011) 2020 D Wood (pone.0279720.ref033) 2017; 8 C Cornesse (pone.0279720.ref010) 2020; 8 MD Buhrmester (pone.0279720.ref012) 2011; 6 MD Buhrmester (pone.0279720.ref001) 2018; 13 L Litman (pone.0279720.ref025) 2021 pone.0279720.ref042 SV Rouse (pone.0279720.ref035) 2015; 43 E Peer (pone.0279720.ref019) 2017; 70 G Eisele (pone.0279720.ref046) 2022; 29 DJ Hauser (pone.0279720.ref027) 2016; 10 LR Goldberg (pone.0279720.ref036) 1999; 7 AJ Barends (pone.0279720.ref006) 2019; 143 JL Huang (pone.0279720.ref003) 2015; 100
References_xml	– volume: 43 start-page: 304 year: 2015 ident: pone.0279720.ref035 article-title: A reliability analysis of Mechanical Turk data publication-title: Comput Human Behav doi: 10.1016/j.chb.2014.11.004 – start-page: 65 year: 1979 ident: pone.0279720.ref043 article-title: A simple sequentially rejective multiple test procedure publication-title: Scand Stat Theory Appl – volume: 11 start-page: 464 year: 2020 ident: pone.0279720.ref002 article-title: An MTurk crisis? Shifts in data quality and the impact on study results publication-title: Soc Psychol Personal Sci doi: 10.1177/1948550619875149 – volume: 75 start-page: 709 year: 2011 ident: pone.0279720.ref009 article-title: Comparing the accuracy of RDD telephone surveys and internet surveys conducted with probability and non-probability samples publication-title: Public Opin Q doi: 10.1093/poq/nfr020 – volume: 70 start-page: 153 year: 2017 ident: pone.0279720.ref019 article-title: Beyond the Turk: Alternative platforms for crowdsourcing behavioral research publication-title: J Exp Soc Psychol doi: 10.1016/j.jesp.2017.01.006 – volume: 8 start-page: 454 year: 2017 ident: pone.0279720.ref033 article-title: Response speed and response consistency as mutually validating indicators of data quality in online samples publication-title: Soc Psychol Personal Sci doi: 10.1177/1948550617703168 – volume: 8 start-page: 4 year: 2020 ident: pone.0279720.ref010 article-title: A review of conceptual approaches and empirical evidence on probability and nonprobability sample survey research publication-title: Journal of Survey Statistics and Methodology doi: 10.1093/jssam/smz041 – volume: 69 start-page: 3139 year: 2016 ident: pone.0279720.ref015 article-title: A multi-group analysis of online survey respondent data quality: Comparing a regular USA consumer panel to MTurk samples publication-title: J Bus Res doi: 10.1016/j.jbusres.2015.12.002 – volume: 24 start-page: 718 year: 2021 ident: pone.0279720.ref026 article-title: Will the questions ever end? Person-level increases in careless responding during questionnaire completion publication-title: Organ Res Methods doi: 10.1177/1094428120947794 – ident: pone.0279720.ref042 – volume: 11 start-page: e0157732 year: 2016 ident: pone.0279720.ref017 article-title: Measuring the prevalence of problematic respondent behaviors among MTurk, campus, and community participants publication-title: PloS one doi: 10.1371/journal.pone.0157732 – volume: 2 start-page: 1 year: 2022 ident: pone.0279720.ref023 article-title: A Note on Increases in Inattentive Online Survey-Takers Since 2020. Journal of Quantitative Description publication-title: Digital Media – volume: 6 start-page: 1 year: 2019 ident: pone.0279720.ref024 article-title: Validating the demographic, political, psychological, and experimental results obtained from a new source of online survey respondents publication-title: Res Politics doi: 10.1177/2053168018822174 – year: 2020 ident: pone.0279720.ref011 article-title: Assessing the Risks to Online Polls from Bogus Respondents publication-title: Internet]. Pew Research Center – year: 1992 ident: pone.0279720.ref037 – volume: 27 start-page: 99 year: 2012 ident: pone.0279720.ref039 article-title: Detecting and deterring insufficient effort responding to surveys publication-title: J Bus Psychol doi: 10.1007/s10869-011-9231-8 – volume: 8 start-page: 127 year: 2014 ident: pone.0279720.ref032 article-title: Speeding in web surveys: The tendency to answer very fast and its association with straightlining publication-title: Surv Res Methods – volume: 36 start-page: 807 year: 2021 ident: pone.0279720.ref004 article-title: Insufficient effort responding as a potential confound between survey measures and objective tests publication-title: J Bus and Psychol doi: 10.1007/s10869-020-09707-2 – volume: 82 start-page: 103849 year: 2019 ident: pone.0279720.ref029 article-title: I’m paid biweekly, just not by leprechauns: Evaluating valid-but-incorrect response rates to attention check items publication-title: J Res Pers doi: 10.1016/j.jrp.2019.103849 – volume: 100 start-page: 828 year: 2015 ident: pone.0279720.ref003 article-title: Insufficient effort responding: examining an insidious confound in survey data publication-title: J Appl Psychol doi: 10.1037/a0038510 – start-page: 1 year: 2021 ident: pone.0279720.ref007 article-title: Data quality of platforms and panels for online behavioral research publication-title: Bev Res Methods – volume: 47 start-page: 823 ident: pone.0279720.ref034 article-title: MTurk research: Review and recommendations. publication-title: J Manag. – volume: 26 start-page: 61 year: 2021 ident: pone.0279720.ref040 article-title: Some researchers wear yellow pants, but even fewer participants read consent forms: Exploring and improving consent form reading in human subjects research publication-title: Psychol Methods doi: 10.1037/met0000267 – volume: 47 start-page: 519 year: 2015 ident: pone.0279720.ref016 article-title: The relationship between motivation, monetary compensation, and data quality among US-and India-based workers on Mechanical Turk publication-title: Behav Res Methods doi: 10.3758/s13428-014-0483-x – volume: 53 start-page: 2591 year: 2021 ident: pone.0279720.ref022 article-title: Turking in the time of COVID publication-title: Behav Res Methods doi: 10.3758/s13428-021-01588-4 – volume: 13 start-page: 1 year: 2020 ident: pone.0279720.ref044 article-title: Collecting online survey data: A comparison of data quality among a commercial panel & MTurk. publication-title: Surv. Pract doi: 10.29115/SP-2020-0015 – volume: 40 start-page: 84 year: 2006 ident: pone.0279720.ref038 article-title: The international personality item pool and the future of public-domain personality measures. publication-title: J Res Pers doi: 10.1016/j.jrp.2005.08.007 – volume: 46 start-page: 141 year: 2017 ident: pone.0279720.ref014 article-title: An analysis of data quality: Professional panels, student subject pools, and Amazon’s Mechanical Turk publication-title: J Advert doi: 10.1080/00913367.2016.1269304 – volume: 7 start-page: e101 year: 2018 ident: pone.0279720.ref021 article-title: Comparison of online survey recruitment platforms for hard-to-reach pregnant smoking populations: Feasibility study publication-title: JMIR Res Protoc doi: 10.2196/resprot.8071 – volume: 72 start-page: 914 year: 2008 ident: pone.0279720.ref031 article-title: Completion time and response order effects in web surveys publication-title: Public Opin Q doi: 10.1093/poq/nfn050 – volume: 7 start-page: 7 year: 1999 ident: pone.0279720.ref036 article-title: A broad-bandwidth, public domain, personality inventory measuring the lower-level facets of several five-factor models publication-title: Personality psychology in Europe – volume: 8 start-page: 190 year: 2015 ident: pone.0279720.ref013 article-title: Don’t throw the baby out with the bathwater: Comparing data quality of crowdsourcing, online panels, and student samples publication-title: Ind Organ Psychol doi: 10.1017/iop.2015.24 – year: 2021 ident: pone.0279720.ref025 article-title: Reply to MTurk, Prolific or panels? Choosing the right audience for online research publication-title: Choosing the right audience for online research – volume: 28 start-page: 231 year: 2016 ident: pone.0279720.ref045 article-title: Comparisons of online recruitment strategies for convenience samples: Craigslist, Google AdWords, Facebook, and Amazon Mechanical Turk publication-title: Field Methods doi: 10.1177/1525822X15603149 – volume: 82 start-page: 707 year: 2018 ident: pone.0279720.ref008 article-title: The accuracy of measurements with probability and nonprobability survey samples: Replication and extension publication-title: Public Opin Q doi: 10.1093/poq/nfy038 – volume: 13 start-page: 149 year: 2018 ident: pone.0279720.ref001 article-title: An evaluation of Amazon’s Mechanical Turk, its rapid rise, and its effective use publication-title: Perspect Psychol Sci doi: 10.1177/1745691617706516 – volume: 6 start-page: 3 year: 2011 ident: pone.0279720.ref012 article-title: Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality, data? publication-title: Perspect Psychol Sci doi: 10.1177/1745691610393980 – volume: 18 start-page: 163 year: 2005 ident: pone.0279720.ref030 article-title: Response time effort: A new measure of examinee motivation in computer-based tests. publication-title: Appl Meas Educ doi: 10.1207/s15324818ame1802_2 – volume: 10 start-page: 195 year: 2016 ident: pone.0279720.ref027 article-title: Prior exposure to instructional manipulation checks does not attenuate survey context effects driven by satisficing or gricean norms publication-title: MDA. – volume: 129 start-page: 49 year: 2020 ident: pone.0279720.ref005 article-title: Participant carelessness and fraud: Consequences for clinical research and potential solutions publication-title: J Abnorm Psychol doi: 10.1037/abn0000479 – volume: 279 year: 2013 ident: pone.0279720.ref041 article-title: Measuring belief in conspiracy theories: The generic conspiracist beliefs scale. publication-title: Front Psychol – volume: 83 start-page: 243 year: 2018 ident: pone.0279720.ref018 article-title: Do imposters threaten data quality? An examination of worker misrepresentation and downstream consequences in Amazon’s Mechanical Turk workforce. publication-title: Comput Human Behav doi: 10.1016/j.chb.2018.02.005 – volume: 29 start-page: 136 year: 2022 ident: pone.0279720.ref046 article-title: The effects of sampling frequency and questionnaire length on perceived burden, compliance, and careless responding in experience sampling data in a student population. publication-title: ASMNT – volume: 51 start-page: 2022 year: 2019 ident: pone.0279720.ref020 article-title: Online panels in social science research: Expanding sampling methods beyond Mechanical Turk publication-title: Behav Res Methods doi: 10.3758/s13428-019-01273-7 – volume: 143 start-page: 84 year: 2019 ident: pone.0279720.ref006 article-title: Noncompliant responding: Comparing exclusion criteria in MTurk personality research to improve data quality publication-title: Pers Individ Dif doi: 10.1016/j.paid.2019.02.015 – volume: 9 start-page: 998 year: 2018 ident: pone.0279720.ref028 article-title: Are manipulation checks necessary?. publication-title: Front Psychol doi: 10.3389/fpsyg.2018.00998
SSID	ssj0053866
Score	2.7586527
Snippet	With the proliferation of online data collection in human-subjects research, concerns have been raised over the presence of inattentive survey participants and...
SourceID	plos doaj pubmedcentral proquest gale pubmed crossref
SourceType	Open Website Open Access Repository Aggregation Database Index Database Enrichment Source
StartPage	e0279720
SubjectTerms	Biology and Life Sciences Coronaviruses COVID-19 Data Accuracy Data collection Data entry Demographics Humans Medical research Online health care information services Pandemics People and places Personality Polls & surveys Population Quality management Research and Analysis Methods Research Subjects Researchers Social Sciences Surveys and Questionnaires
SummonAdditionalLinks	– databaseName: DOAJ Open Access Full Text dbid: DOA link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3fb9MwELZQxQMviI0fK2xgEBIgNVuTOLHNWylMIEE3sTHtLbKdmFVUadU0IP577mInatCk8cBr_SVK787Od_H5O0JessRqiIUCPMDHAUu4CaRNkkBEvJCxUkI1SkwXn_lsJi4v5elWqy-sCXPywM5wR0B3jYkh61YMyGwy1sBxZZpHjNs0ClVzdA9YT5tMuTUYZnGa-oNyMQ-PvF8OV8uyOIRETHLs7731Imr0-rtVebBaLKvrKOfflZNbr6Lje-Su55B04p59h9wqyl2y42dpRV97Kek398mv92qjqDs4-ZvOS-qEMWjTmS-oao1fYSrqFX-u3tJp15awor6Ei345r9c_RvQU-_vYuRnR6WJZ523J3oiiDAfq_Fcjqsqcnp3MJg_It-MP59OPgW-1EBieyE2gWBHllqdWRDpNrNSNTp0Y55CsGlXANA2N4EyEseY6BD9yDjwotCYHl8pQxQ_JoATj7hEqWCyYxO1FqVmirUx4xBS3cWFzYXM9JHFr98x4HXJsh7HIms01DvmIM2OG3sq8t4Yk6K5aOR2OG_Dv0KUdFlW0mx8gtjIfW9lNsTUkzzAgMncktVsLsgnQMKBKaQSIFw0ClTRKLNX5ruqqyj6dXPwD6OxrD_TKg-wSzGGUPx4B_wkVunrI_R4S1gPTG97D8G2tUmURR81CFAGCK9uQvn74eTeMN8Xyu7JY1g4DTDDigHnkZkBn2TiFjB-y1iERvbnRM31_pJxfNULmodsnZ4__h7OekDsREFCsDwzZPhls1nVxQG6bn5t5tX7aLA9_AILkZu4 priority: 102 providerName: Directory of Open Access Journals – databaseName: Public Library of Science (PLoS) Journals Open Access dbid: FPL link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1bb9MwFLZQ4YEXYNxWGGAQEiA1o7EdX3grhQqk0VVsTHuLHCdmFVVSNQ2If89x4gQybQJe689Vem45pz7-DkLPWWQTsIUMNCDGAYuECZSNokASkSmqtdQ1E9PJgZjP5empWvwuFM-d4FMRvvYy3V8XebYPRZQSBEr0q4Ry7lq4ZouDNvKC73Lur8ddtrP3-qlZ-rtYPFivivKiRPN8v-QfL6DZzf999Fvohk818aSxjR10Jctvox3vzCV-6RmnX91BP97prcbN_cqfeJnjhj8D1wP8grJK3J81JfbEQGdv8LSbXlhi3-mFPx1Xm28jvHBjgOzSjPB0VVRp29k3wo6tw40DKEdY5yk-OpxP7qIvs_fH0w-Bn8gQGBGpbaBZRlIruJUk4ZFVSU1nJ8cp1LRGZ-DNoZGCyZAmIglB3UJAuhRak4LmVajpPTTIQRi7CEtGJVPuFFIlLEqsigRhWlia2VTaNBki2ioqNp6u3E3NWMX1GZyAsqURY-ykG3vpDlHQ7Vo3dB1_wb91NtBhHdl2_QGoMfa-G0PFZQyldKwZ1FPROIEyS_GUMGE5CbUaoifOguLm5moXMuIJZGuQUXECiGc1whFu5K6j56uuyjL-eHjyD6Cjzz3QCw-yBYjDaH-LAn6TI_LqIfd6SAgbpre86-y9lUoZE-GoDR1XEOxsfeDi5afdsvtS16WXZ0XVYCBhJAIw9xuX6SRLuYJMVfAhkj1n6om-v5Ivz2q-87A5TmcPLn_kh-g6gezTNQeGbA8Ntpsqe4Sume_bZbl5XEeJX0tGZUI priority: 102 providerName: Public Library of Science
Title	Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA
URI	https://www.ncbi.nlm.nih.gov/pubmed/36917576 https://www.proquest.com/docview/2786774855 https://www.proquest.com/docview/2786812275 https://pubmed.ncbi.nlm.nih.gov/PMC10013894 https://doaj.org/article/747cc3330a404950b30696d247f621a9 http://dx.doi.org/10.1371/journal.pone.0279720
Volume	18
WOSCitedRecordID	wos000952287100012&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVAON databaseName: DOAJ Open Access Full Text customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: DOA dateStart: 20060101 isFulltext: true titleUrlDefault: https://www.doaj.org/ providerName: Directory of Open Access Journals – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: M~E dateStart: 20060101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre – providerCode: PRVPQU databaseName: Agriculture Science Database customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: M0K dateStart: 20061201 isFulltext: true titleUrlDefault: https://search.proquest.com/agriculturejournals providerName: ProQuest – providerCode: PRVPQU databaseName: Biological Science Database customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: M7P dateStart: 20061201 isFulltext: true titleUrlDefault: http://search.proquest.com/biologicalscijournals providerName: ProQuest – providerCode: PRVPQU databaseName: Engineering Database customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: M7S dateStart: 20061201 isFulltext: true titleUrlDefault: http://search.proquest.com providerName: ProQuest – providerCode: PRVPQU databaseName: Environmental Science Database customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: PATMY dateStart: 20061201 isFulltext: true titleUrlDefault: http://search.proquest.com/environmentalscience providerName: ProQuest – providerCode: PRVPQU databaseName: Health & Medical Collection customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: 7X7 dateStart: 20061201 isFulltext: true titleUrlDefault: https://search.proquest.com/healthcomplete providerName: ProQuest – providerCode: PRVPQU databaseName: Materials Science Database customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: KB. dateStart: 20061201 isFulltext: true titleUrlDefault: http://search.proquest.com/materialsscijournals providerName: ProQuest – providerCode: PRVPQU databaseName: Nursing & Allied Health Database customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: 7RV dateStart: 20061201 isFulltext: true titleUrlDefault: https://search.proquest.com/nahs providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest advanced technologies & aerospace journals customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: P5Z dateStart: 20061201 isFulltext: true titleUrlDefault: https://search.proquest.com/hightechjournals providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest Central customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: BENPR dateStart: 20061201 isFulltext: true titleUrlDefault: https://www.proquest.com/central providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest Public Health Database customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: 8C1 dateStart: 20061201 isFulltext: true titleUrlDefault: https://search.proquest.com/publichealth providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest Publicly Available Content customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: PIMPY dateStart: 20061201 isFulltext: true titleUrlDefault: http://search.proquest.com/publiccontent providerName: ProQuest – providerCode: PRVATS databaseName: Public Library of Science (PLoS) Journals Open Access customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: FPL dateStart: 20060101 isFulltext: true titleUrlDefault: http://www.plos.org/publications/ providerName: Public Library of Science
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3db9MwELfYxgMvwPhaYRSDkACp2ZpPx7ygtqxi2tpF26gGL5HjxFvFlJSmBfHfc-e4YUETIPFyD_Glqn0fubPPvyPkpeerBHQhAwmwruX5TFpc-b4VOizjrhCh0EhMk0M2HodnZzwyG26lKatc-UTtqNNC4h75rsMQeQ2hTN7NvlrYNQpPV00LjTWygSgJaJiR_3nlicGWg8Bcl3OZvWukszMr8mwH0jHOsMv3lc-RRu2vffP67LIorws8f6-fvPJBGt7536ncJbdNKEp7le5skhtZfo9sGmMv6WuDSP3mPvn-XiwEre5f_qDTnFb4GlQ3-LPKZYKbOSU1wEEXb-mg7m5YUlMJRkeny_mXDo2wTZCayg4dXBbLdFX516GI5oHtAsoOFXlKT47GvQfk43DvdPDBMh0bLMl8vrCElzmpYoEKnSTwFU803F3YTSHnlSIDa7dlCDO33YQlNqgDYxBO2UqmoBncFu5Dsp6DdLYIDT039DieUvLE8xPFfeZ4gik3U2mo0qRF3JXgYmngzLGrxmWsz-gYpDXVMsYo7tiIu0Ws-q1ZBefxF_4-6kTNi2Dc-kExP4-NbceQkUnpum5XeJBv-d0E0jAepI7HVODYgrfIM9SouLrZWruUuAfRHGht4ADHC82BgBw5Vvyci2VZxvtHk39gOjluML0yTKqA5ZDC3LKAOSHQV4Nzu8EJbkU2hrdQ_1erUsa_tBbeXOn19cPP62H8Uaziy7NiWfFAQOkw4HlUmVC9sm7AIZJlQYuEDeNqLH1zJJ9eaDx0uzpu9x7_-X89IbcciFCxgND2tsn6Yr7MnpKb8ttiWs7bZI0dT5CeMU1DoOHAbpON_t44Om7rzRqgw-gQ6EF_B-ioe4CURZqetLX3gTei_VH06ScZuoO0
linkProvider	ProQuest
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V3db9MwELdGQYIXYHytMJhBIEBqtubTMRJCpWNata2btjL1LThOvFVUSWkapv1T_I3cJU5Y0AS87IHX-pfUudyd7-Lz7wh56bgqBF2I4Q2wruG4TBpcua7hWyzmthC-KJiYjnfZcOiPx_xgifyozsJgWWXlEwtHHaUSv5FvWAyZ15DK5MPsm4Fdo3B3tWqhUarFTnx-Bilb9n6wCe_3lWVtfRr1tw3dVcCQzOULQzixFSnmKd8KPVfxsKBk87sR5GVSxKCRpvThj0w7ZKEJU2YMlnxTyQhmz01hw32vkevgxxmWkLFxneCB7_A8fTzPZuaG1ob1WZrE65D-cYZdxS8sf0WXgHotaM2maXZZoPt7veaFBXDrzv8murvktg61aa-0jWWyFCf3yLJ2Zhl9oxm3394nZ5tiIWh5vvScThJa8ofQooGhkeUhfqzKqCZGOn1H-3X3xozqSje6N8rnXzv0ANsgqYns0P40zaOqsrFDka0E2yFkHSqSiB7tD3sPyOcrEcBD0kpAG1YI9R3bdzjuwvLQcUPFXWY5gik7VpGvorBN7EpRAqnp2rFryDQo9iAZpG2lGANUr0CrV5sY9VWzkq7kL_iPqIM1FsnGix_S-UmgfVcAGaeUtm13hQP5pNsNIc3kXmQ5THmWKXibrKEGB-XJ3dplBj2IViGi9CxAvCgQSDiSYEXTicizLBjsH_8D6OiwAXqtQSoFcUihT5HAMyGRWQO52kCC25SN4RW0t0oqWfDLSuDKyo4uH35eD-NNsUoxidO8xEDAbDHAPCpNtpas7XGI1JnXJn7DmBuib44kk9OC790sywmcx3-e1xq5uT3a2w12B8OdJ-SWBdE4FkuazippLeZ5_JTckN8Xk2z-rPBalHy5alv_CblR0lk
linkToPdf	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Lb9NAEF6VgBAXoLwaKHRBIECKm_i5XiSEQkJF1JJGtFQVF7Nee9uIyA5xTNW_xq9jxl6bGlXApQeu3vFr_M3sjHf2G0KeOq4KAQsxfAHWMxyXSYMr1zV8i8XcFsIXBRPTwQ4bj_3DQz5ZIT-qvTBYVln5xMJRR6nEf-RdiyHzGlKZdJUui5gMt97MvxnYQQpXWqt2GiVEtuPTE0jfstejIXzrZ5a19W5_8N7QHQYMyVy-NIQTW5FinvKt0HMVDwt6Nr8XQY4mRQzoNKUPNzXtkIUmPD5jMP2bSkbwJtwUNlz3ErnMIMfExG_ifq5mAfAjnqe36tnM7GpkbM7TJN6EVJAz7DB-ZiosOgbU80JrPkuz84Le32s3z0yGWzf-ZzXeJNd1CE77pc2skpU4uUVWtZPL6AvNxP3yNjkZiqWg5b7TUzpNaMkrQovGhkaWh_gTK6OaMOn4FR3UXR0zqivg6If9fPG1QyfYHklNZYcOZmkeVRWPHYosJtgmIetQkUR0b3fcv0M-XYgC7pJWAshYI9R3bN_huDrLQ8cNFXeZ5Qim7FhFvorCNrEr0ARS07hjN5FZUKxNMkjnSjUGCLVAQ61NjPqseUlj8hf5t4jHWhZJyIsD6eIo0D4tgExUStu2e8KBPNPthZB-ci-yHKY8yxS8TTYQzUG5o7d2pUEfoliIND0LJJ4UEkhEkiAWj0SeZcFo9-AfhPY-NoSeayGVgjqk0LtL4J2Q4Kwhud6QBHcqG8NraHuVVrLgl8XAmZVNnT_8uB7Gi2L1YhKneSkDgbTFQOZeab61Zm2PQwTPvDbxG4bdUH1zJJkeFzzwZllm4Nz_83NtkKtg4sHOaLz9gFyzIEjHGkrTWSet5SKPH5Ir8vtymi0eFQ6Mki8Xbeo_AYg820w
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Data+quality+in+online+human-subjects+research%3A+Comparisons+between+MTurk%2C+Prolific%2C+CloudResearch%2C+Qualtrics%2C+and+SONA&rft.jtitle=PloS+one&rft.au=Douglas%2C+Benjamin+D&rft.au=Ewell%2C+Patrick+J&rft.au=Brauer%2C+Markus&rft.date=2023-03-14&rft.pub=Public+Library+of+Science&rft.issn=1932-6203&rft.eissn=1932-6203&rft.volume=18&rft.issue=3&rft.spage=e0279720&rft_id=info:doi/10.1371%2Fjournal.pone.0279720&rft.externalDBID=n%2Fa&rft.externalDocID=A741215629
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1932-6203&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1932-6203&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1932-6203&client=summon