Data quality of platforms and panels for online behavioral research

We examine key aspects of data quality for online behavioral research between selected platforms (Amazon Mechanical Turk, CloudResearch, and Prolific) and panels (Qualtrics and Dynata). To identify the key aspects of data quality, we first engaged with the behavioral research community to discover w...

Celý popis

Uloženo v:

Podrobná bibliografie
Vydáno v:	Behavior research methods Ročník 54; číslo 4; s. 1643 - 1662
Hlavní autoři:	Peer, Eyal, Rothschild, David, Gordon, Andrew, Evernden, Zak, Damer, Ekaterina
Médium:	Journal Article
Jazyk:	angličtina
Vydáno:	New York Springer US 01.08.2022 Springer Nature B.V
Témata:	Attention Behavior Behavioral Science and Psychology Cognitive Psychology Community research Comprehension Data quality Dishonesty Filters Honesty Internet Psychology Ratings & rankings Reliability Online research Honesty Attention Prolific Data quality Amazon mechanical turk Comprehension Reliability
ISSN:	1554-3528, 1554-351X, 1554-3528
On-line přístup:	Získat plný text
Tagy:	Přidat tag Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!

Abstract	We examine key aspects of data quality for online behavioral research between selected platforms (Amazon Mechanical Turk, CloudResearch, and Prolific) and panels (Qualtrics and Dynata). To identify the key aspects of data quality, we first engaged with the behavioral research community to discover which aspects are most critical to researchers and found that these include attention, comprehension, honesty, and reliability. We then explored differences in these data quality aspects in two studies ( N ~ 4000), with or without data quality filters (approval ratings). We found considerable differences between the sites, especially in comprehension, attention, and dishonesty. In Study 1 (without filters), we found that only Prolific provided high data quality on all measures. In Study 2 (with filters), we found high data quality among CloudResearch and Prolific. MTurk showed alarmingly low data quality even with data quality filters. We also found that while reputation (approval rating) did not predict data quality, frequency and purpose of usage did, especially on MTurk: the lowest data quality came from MTurk participants who report using the site as their main source of income but spend few hours on it per week. We provide a framework for future investigation into the ever-changing nature of data quality in online research, and how the evolving set of platforms and panels performs on these key aspects.
AbstractList	We examine key aspects of data quality for online behavioral research between selected platforms (Amazon Mechanical Turk, CloudResearch, and Prolific) and panels (Qualtrics and Dynata). To identify the key aspects of data quality, we first engaged with the behavioral research community to discover which aspects are most critical to researchers and found that these include attention, comprehension, honesty, and reliability. We then explored differences in these data quality aspects in two studies (N ~ 4000), with or without data quality filters (approval ratings). We found considerable differences between the sites, especially in comprehension, attention, and dishonesty. In Study 1 (without filters), we found that only Prolific provided high data quality on all measures. In Study 2 (with filters), we found high data quality among CloudResearch and Prolific. MTurk showed alarmingly low data quality even with data quality filters. We also found that while reputation (approval rating) did not predict data quality, frequency and purpose of usage did, especially on MTurk: the lowest data quality came from MTurk participants who report using the site as their main source of income but spend few hours on it per week. We provide a framework for future investigation into the ever-changing nature of data quality in online research, and how the evolving set of platforms and panels performs on these key aspects. We examine key aspects of data quality for online behavioral research between selected platforms (Amazon Mechanical Turk, CloudResearch, and Prolific) and panels (Qualtrics and Dynata). To identify the key aspects of data quality, we first engaged with the behavioral research community to discover which aspects are most critical to researchers and found that these include attention, comprehension, honesty, and reliability. We then explored differences in these data quality aspects in two studies ( N ~ 4000), with or without data quality filters (approval ratings). We found considerable differences between the sites, especially in comprehension, attention, and dishonesty. In Study 1 (without filters), we found that only Prolific provided high data quality on all measures. In Study 2 (with filters), we found high data quality among CloudResearch and Prolific. MTurk showed alarmingly low data quality even with data quality filters. We also found that while reputation (approval rating) did not predict data quality, frequency and purpose of usage did, especially on MTurk: the lowest data quality came from MTurk participants who report using the site as their main source of income but spend few hours on it per week. We provide a framework for future investigation into the ever-changing nature of data quality in online research, and how the evolving set of platforms and panels performs on these key aspects. We examine key aspects of data quality for online behavioral research between selected platforms (Amazon Mechanical Turk, CloudResearch, and Prolific) and panels (Qualtrics and Dynata). To identify the key aspects of data quality, we first engaged with the behavioral research community to discover which aspects are most critical to researchers and found that these include attention, comprehension, honesty, and reliability. We then explored differences in these data quality aspects in two studies (N ~ 4000), with or without data quality filters (approval ratings). We found considerable differences between the sites, especially in comprehension, attention, and dishonesty. In Study 1 (without filters), we found that only Prolific provided high data quality on all measures. In Study 2 (with filters), we found high data quality among CloudResearch and Prolific. MTurk showed alarmingly low data quality even with data quality filters. We also found that while reputation (approval rating) did not predict data quality, frequency and purpose of usage did, especially on MTurk: the lowest data quality came from MTurk participants who report using the site as their main source of income but spend few hours on it per week. We provide a framework for future investigation into the ever-changing nature of data quality in online research, and how the evolving set of platforms and panels performs on these key aspects.We examine key aspects of data quality for online behavioral research between selected platforms (Amazon Mechanical Turk, CloudResearch, and Prolific) and panels (Qualtrics and Dynata). To identify the key aspects of data quality, we first engaged with the behavioral research community to discover which aspects are most critical to researchers and found that these include attention, comprehension, honesty, and reliability. We then explored differences in these data quality aspects in two studies (N ~ 4000), with or without data quality filters (approval ratings). We found considerable differences between the sites, especially in comprehension, attention, and dishonesty. In Study 1 (without filters), we found that only Prolific provided high data quality on all measures. In Study 2 (with filters), we found high data quality among CloudResearch and Prolific. MTurk showed alarmingly low data quality even with data quality filters. We also found that while reputation (approval rating) did not predict data quality, frequency and purpose of usage did, especially on MTurk: the lowest data quality came from MTurk participants who report using the site as their main source of income but spend few hours on it per week. We provide a framework for future investigation into the ever-changing nature of data quality in online research, and how the evolving set of platforms and panels performs on these key aspects.
Author	Damer, Ekaterina Rothschild, David Peer, Eyal Gordon, Andrew Evernden, Zak
Author_xml	– sequence: 1 givenname: Eyal surname: Peer fullname: Peer, Eyal email: eyal.peer@mail.huji.ac.il organization: Federmann School of Public Policy, The Hebrew University of Jerusalem – sequence: 2 givenname: David surname: Rothschild fullname: Rothschild, David organization: Microsoft Research – sequence: 3 givenname: Andrew surname: Gordon fullname: Gordon, Andrew organization: Prolific Inc – sequence: 4 givenname: Zak surname: Evernden fullname: Evernden, Zak organization: Prolific Inc – sequence: 5 givenname: Ekaterina surname: Damer fullname: Damer, Ekaterina organization: Prolific Inc
BackLink	https://www.ncbi.nlm.nih.gov/pubmed/34590289$$D View this record in MEDLINE/PubMed
BookMark	eNp9UctOHDEQtCIiXuEHcogs5ZLLJH7OeC6Rok0gkZC4kLPVM9Nmjbz2Ys8g8feYLCSEAye33FWlqq4jshdTRELec_ZZdtp8KVwqYRomeMN426tGviGHXOs6aGH2ns0H5KiUa8akEVztkwOpdM-E6Q_J6jvMQG8WCH6-o8nRbYDZpbwpFOJEtxAxFFo_aIrBR6QDruHWpwyBZiwIeVy_I28dhIInj-8x-X3643L1szm_OPu1-nbejC3nc9Mr1krk4FirsZsAXK_50LuOd3pgg9Q4tYohd2zCmkmKaZBCTKoHLZ00KI_J153udhk2OI0Y52rDbrPfQL6zCbz9fxP92l6lW2uUYTVxFfj0KJDTzYJlthtfRgyhpkxLsUJ3hmvWtapCP76AXqclxxrPio7Vw0oheUV9eO7or5Wn-1aA2QHGnErJ6OzoZ5h9ejDog-XMPlRpd1XaGtv-qdLKShUvqE_qr5LkjlQqOF5h_mf7FdY9soGwhg
CitedBy_id	crossref_primary_10_3389_fresc_2025_1541059 crossref_primary_10_1016_j_chiabu_2024_106938 crossref_primary_10_2196_35797 crossref_primary_10_1080_00223891_2024_2429489 crossref_primary_10_1002_hrm_70014 crossref_primary_10_1007_s13178_024_00982_9 crossref_primary_10_2196_58432 crossref_primary_10_1016_j_jbusvent_2023_106318 crossref_primary_10_1177_23794607241311793 crossref_primary_10_3390_rel13090872 crossref_primary_10_1007_s42844_023_00089_x crossref_primary_10_1027_1618_3169_a000617 crossref_primary_10_1080_10696679_2024_2360215 crossref_primary_10_1177_13684302221128230 crossref_primary_10_1177_20503245231191400 crossref_primary_10_2196_71765 crossref_primary_10_1108_EDI_11_2022_0305 crossref_primary_10_1111_peps_12688 crossref_primary_10_3758_s13428_025_02745_9 crossref_primary_10_1017_XPS_2024_10 crossref_primary_10_1177_20563051251337352 crossref_primary_10_1080_14413523_2024_2404722 crossref_primary_10_1177_00472875241312178 crossref_primary_10_1177_09567976241249183 crossref_primary_10_1080_1062726X_2024_2437775 crossref_primary_10_1371_journal_pone_0292372 crossref_primary_10_1177_08901171251348111 crossref_primary_10_1016_j_ergon_2024_103595 crossref_primary_10_1080_07347332_2024_2337043 crossref_primary_10_2196_60862 crossref_primary_10_1177_09567976221097499 crossref_primary_10_1016_j_concog_2025_103901 crossref_primary_10_1080_00014788_2025_2521488 crossref_primary_10_1080_14719037_2023_2245841 crossref_primary_10_1111_jocd_16465 crossref_primary_10_1177_01979183221142779 crossref_primary_10_1002_eat_24290 crossref_primary_10_3758_s13428_022_01835_2 crossref_primary_10_1007_s11199_024_01507_9 crossref_primary_10_1080_03637751_2025_2525824 crossref_primary_10_2196_45482 crossref_primary_10_1007_s12103_023_09733_9 crossref_primary_10_1145_3674884 crossref_primary_10_1177_00207640251323345 crossref_primary_10_1007_s12207_023_09471_7 crossref_primary_10_1016_j_mser_2025_101050 crossref_primary_10_1177_14614448231197640 crossref_primary_10_1080_10410236_2024_2427957 crossref_primary_10_1177_20597991251333345 crossref_primary_10_1080_09515089_2023_2299755 crossref_primary_10_1007_s00213_025_06871_2 crossref_primary_10_1111_jomf_12959 crossref_primary_10_1026_0932_4089_a000452 crossref_primary_10_1016_j_jml_2023_104472 crossref_primary_10_1177_13591053241247376 crossref_primary_10_1007_s44202_024_00258_8 crossref_primary_10_1002_jeab_4233 crossref_primary_10_1080_08853134_2023_2252610 crossref_primary_10_1080_15504263_2023_2225373 crossref_primary_10_1080_21548455_2025_2516268 crossref_primary_10_1007_s10899_024_10339_x crossref_primary_10_1007_s11292_022_09546_6 crossref_primary_10_1080_00223891_2023_2279564 crossref_primary_10_3389_fdgth_2022_954069 crossref_primary_10_1177_14614448231215486 crossref_primary_10_1080_09585192_2025_2542772 crossref_primary_10_1080_00087041_2024_2335605 crossref_primary_10_1111_1911_3846_12979 crossref_primary_10_1371_journal_pone_0329404 crossref_primary_10_1016_j_wocn_2025_101401 crossref_primary_10_1007_s10669_025_10004_7 crossref_primary_10_1080_10826084_2024_2434011 crossref_primary_10_16995_labphon_8778 crossref_primary_10_1111_isj_12482 crossref_primary_10_1080_10926771_2025_2548449 crossref_primary_10_1162_opmi_a_00127 crossref_primary_10_1007_s12529_023_10255_1 crossref_primary_10_1111_asap_12346 crossref_primary_10_2196_58409 crossref_primary_10_1213_XAA_0000000000002045 crossref_primary_10_1080_15332969_2025_2537540 crossref_primary_10_1007_s12144_025_07819_7 crossref_primary_10_1080_10447318_2025_2532710 crossref_primary_10_4054_DemRes_2024_51_25 crossref_primary_10_1038_s41562_023_01686_7 crossref_primary_10_3727_108354224X17059673670361 crossref_primary_10_1016_j_chbah_2024_100079 crossref_primary_10_1111_jpim_12786 crossref_primary_10_1016_j_actpsy_2024_104670 crossref_primary_10_1007_s41542_024_00179_x crossref_primary_10_1177_0034673X241304733 crossref_primary_10_3758_s13428_025_02757_5 crossref_primary_10_1038_s41562_024_01834_7 crossref_primary_10_1080_10510974_2024_2344404 crossref_primary_10_2196_48977 crossref_primary_10_1016_j_appet_2023_107002 crossref_primary_10_1108_JPBM_03_2022_3899 crossref_primary_10_1007_s40732_023_00566_w crossref_primary_10_1038_s43247_024_01944_0 crossref_primary_10_1177_10659129251319298 crossref_primary_10_1080_08941920_2025_2466158 crossref_primary_10_1111_ijsa_12440 crossref_primary_10_1177_01902725231189258 crossref_primary_10_1016_j_appet_2024_107407 crossref_primary_10_1080_10584609_2024_2312867 crossref_primary_10_1108_EJM_01_2023_0009 crossref_primary_10_1287_orsc_2020_14640 crossref_primary_10_1080_10508422_2024_2341639 crossref_primary_10_1016_j_tourman_2024_104998 crossref_primary_10_1016_j_socscimed_2023_116000 crossref_primary_10_1080_00224499_2023_2216201 crossref_primary_10_1177_14777509231211666 crossref_primary_10_1038_s41562_025_02194_6 crossref_primary_10_1016_j_jesp_2024_104632 crossref_primary_10_1093_ijpor_edae034 crossref_primary_10_1038_s41598_023_33148_5 crossref_primary_10_1016_j_econlet_2025_112509 crossref_primary_10_1287_isre_2021_0253 crossref_primary_10_3389_fpsyt_2025_1556411 crossref_primary_10_1177_01461672241238420 crossref_primary_10_1016_j_joep_2024_102775 crossref_primary_10_1097_BPO_0000000000002805 crossref_primary_10_1007_s10608_024_10502_z crossref_primary_10_1057_s41599_025_05114_1 crossref_primary_10_1080_09515070_2025_2451317 crossref_primary_10_1080_1478601X_2025_2531760 crossref_primary_10_1089_aut_2023_0198 crossref_primary_10_1016_j_jbvi_2024_e00503 crossref_primary_10_1016_j_paid_2025_113378 crossref_primary_10_1080_15283488_2024_2437030 crossref_primary_10_1007_s10460_024_10585_0 crossref_primary_10_1111_1475_6765_12743 crossref_primary_10_1093_qje_qjae001 crossref_primary_10_3389_fpsyg_2023_1151626 crossref_primary_10_1177_01461672241226560 crossref_primary_10_1016_j_ijhm_2025_104157 crossref_primary_10_1371_journal_pone_0277286 crossref_primary_10_1007_s10508_024_02951_0 crossref_primary_10_3390_bs15010007 crossref_primary_10_1016_j_actpsy_2024_104377 crossref_primary_10_1080_02699931_2025_2541766 crossref_primary_10_1080_1528008X_2022_2141945 crossref_primary_10_1080_13825585_2023_2282223 crossref_primary_10_1177_23294965241240784 crossref_primary_10_1038_s44220_025_00385_8 crossref_primary_10_1111_fare_13190 crossref_primary_10_1016_j_compedu_2025_105410 crossref_primary_10_1080_0960085X_2023_2270456 crossref_primary_10_3758_s13428_022_01912_6 crossref_primary_10_1089_fpsam_2023_0204 crossref_primary_10_1007_s11002_023_09679_2 crossref_primary_10_1080_21548455_2023_2285743 crossref_primary_10_1016_j_ipm_2024_103792 crossref_primary_10_1108_JFC_12_2023_0314 crossref_primary_10_5093_jwop2024a9 crossref_primary_10_1002_ijop_13094 crossref_primary_10_1007_s43681_024_00603_6 crossref_primary_10_1016_j_jcrimjus_2023_102045 crossref_primary_10_1016_j_tourman_2024_104972 crossref_primary_10_1109_TVCG_2023_3251950 crossref_primary_10_1007_s10826_024_02996_8 crossref_primary_10_1177_02654075251377184 crossref_primary_10_1007_s10804_024_09482_x crossref_primary_10_1016_j_chbr_2025_100753 crossref_primary_10_1016_j_rmal_2025_100255 crossref_primary_10_1080_23311886_2025_2549482 crossref_primary_10_1016_j_jrp_2024_104539 crossref_primary_10_1002_job_2768 crossref_primary_10_1016_j_paid_2025_113230 crossref_primary_10_1080_03050629_2025_2495697 crossref_primary_10_1177_17470218231172908 crossref_primary_10_3758_s13428_023_02302_2 crossref_primary_10_3389_fdgth_2023_1125926 crossref_primary_10_1093_jamia_ocad198 crossref_primary_10_3390_bs15091196 crossref_primary_10_1002_acp_3997 crossref_primary_10_1111_jsr_14276 crossref_primary_10_1007_s10869_024_09992_1 crossref_primary_10_1027_1618_3169_a000644 crossref_primary_10_1177_00938548241297690 crossref_primary_10_1177_14747049231161075 crossref_primary_10_1038_s41598_023_46048_5 crossref_primary_10_1177_00846724241309923 crossref_primary_10_1016_j_jik_2025_100701 crossref_primary_10_1177_10690727231194786 crossref_primary_10_1007_s10603_022_09531_6 crossref_primary_10_1016_j_hitech_2024_100512 crossref_primary_10_1016_j_cognition_2025_106078 crossref_primary_10_3389_fpos_2023_1040644 crossref_primary_10_1098_rsos_250361 crossref_primary_10_1177_10755470241232352 crossref_primary_10_1016_j_chb_2023_108019 crossref_primary_10_1080_0144929X_2024_2351195 crossref_primary_10_1080_13811118_2025_2542576 crossref_primary_10_1177_02654075241302846 crossref_primary_10_1080_0144929X_2025_2485394 crossref_primary_10_1007_s10551_022_05128_8 crossref_primary_10_3390_jintelligence11090171 crossref_primary_10_1287_mnsc_2023_02567 crossref_primary_10_3390_app12178621 crossref_primary_10_1111_fare_12981 crossref_primary_10_1177_01461672231203471 crossref_primary_10_1017_S0003055423000345 crossref_primary_10_1080_00952990_2023_2300398 crossref_primary_10_1177_0272989X231197646 crossref_primary_10_1073_pnas_2217551120 crossref_primary_10_1093_isq_sqae105 crossref_primary_10_1108_EJM_03_2022_0191 crossref_primary_10_1016_j_bodyim_2025_101901 crossref_primary_10_1016_j_brat_2025_104788 crossref_primary_10_1016_j_chbr_2025_100730 crossref_primary_10_1177_17470218231220912 crossref_primary_10_1016_j_jesp_2025_104832 crossref_primary_10_3390_mti7030032 crossref_primary_10_1080_10810730_2023_2183284 crossref_primary_10_1145_3686923 crossref_primary_10_1016_j_jenvp_2025_102618 crossref_primary_10_1177_10949968251322513 crossref_primary_10_1017_S1366728923000421 crossref_primary_10_1016_j_jbusvent_2024_106421 crossref_primary_10_3389_fpsyg_2025_1467174 crossref_primary_10_1016_j_jbusres_2025_115201 crossref_primary_10_1097_GOX_0000000000005736 crossref_primary_10_1088_2515_7620_ad14a2 crossref_primary_10_1161_CIRCOUTCOMES_124_011069 crossref_primary_10_1177_07388942221111069 crossref_primary_10_3390_healthcare11030354 crossref_primary_10_3389_fsoc_2024_1368594 crossref_primary_10_1080_07418825_2024_2361719 crossref_primary_10_3389_forgp_2025_1580957 crossref_primary_10_1080_14775085_2025_2492579 crossref_primary_10_1002_hrm_22225 crossref_primary_10_1093_fpa_oraf008 crossref_primary_10_3390_languages10020025 crossref_primary_10_1080_17439760_2023_2239785 crossref_primary_10_1108_IJLM_04_2024_0245 crossref_primary_10_1007_s43039_023_00082_3 crossref_primary_10_1111_jssr_12947 crossref_primary_10_1136_bmjopen_2022_064963 crossref_primary_10_1027_1618_3169_a000558 crossref_primary_10_1108_ITP_08_2023_0831 crossref_primary_10_1177_02761467221125915 crossref_primary_10_1016_j_tele_2023_101952 crossref_primary_10_1007_s12144_024_07242_4 crossref_primary_10_3390_su16062540 crossref_primary_10_1007_s11846_024_00748_y crossref_primary_10_1007_s10826_024_02808_z crossref_primary_10_1016_j_jretconser_2025_104326 crossref_primary_10_1093_jogss_ogac024 crossref_primary_10_1038_s41598_024_63687_4 crossref_primary_10_3758_s13428_023_02321_z crossref_primary_10_1080_00207543_2025_2508918 crossref_primary_10_1080_03050629_2025_2478145 crossref_primary_10_1002_jocb_621 crossref_primary_10_1027_1618_3169_a000562 crossref_primary_10_1111_ijsa_12458 crossref_primary_10_1145_3637301 crossref_primary_10_2139_ssrn_5127515 crossref_primary_10_2478_zireb_2024_0030 crossref_primary_10_1108_IHR_04_2024_0022 crossref_primary_10_1177_08862605231200212 crossref_primary_10_2196_63032 crossref_primary_10_1177_00139165251340179 crossref_primary_10_1177_0192513X241237601 crossref_primary_10_1007_s11113_023_09842_7 crossref_primary_10_1177_00220426251315110 crossref_primary_10_1177_10775587231172064 crossref_primary_10_1086_737242 crossref_primary_10_1007_s11031_022_09931_8 crossref_primary_10_1007_s40732_024_00613_0 crossref_primary_10_1080_15213269_2024_2401526 crossref_primary_10_1108_IJOEM_03_2023_0389 crossref_primary_10_1177_10731911231200866 crossref_primary_10_1016_j_cose_2024_103940 crossref_primary_10_1093_pnasnexus_pgaf062 crossref_primary_10_1126_science_adh2586 crossref_primary_10_1007_s12144_024_06347_0 crossref_primary_10_3389_fnbeh_2022_1046097 crossref_primary_10_1257_aer_20240022 crossref_primary_10_18559_ebr_2023_2_744 crossref_primary_10_1007_s00403_024_03349_7 crossref_primary_10_1017_jdm_2024_26 crossref_primary_10_1080_10447318_2023_2258634 crossref_primary_10_1111_ijcs_70093 crossref_primary_10_1177_09567976231180578 crossref_primary_10_1177_14999013251366447 crossref_primary_10_1007_s11199_025_01594_2 crossref_primary_10_1080_13683500_2024_2402563 crossref_primary_10_1177_23294884241248133 crossref_primary_10_3389_fpsyg_2023_1166960 crossref_primary_10_1080_02699931_2024_2385691 crossref_primary_10_1016_j_bodyim_2024_101706 crossref_primary_10_1007_s10508_023_02560_3 crossref_primary_10_1080_13523260_2023_2216112 crossref_primary_10_1177_14713012251356733 crossref_primary_10_1038_s41562_023_01540_w crossref_primary_10_1002_cb_2501 crossref_primary_10_1016_j_bushor_2024_09_003 crossref_primary_10_1111_1911_3846_13053 crossref_primary_10_1007_s10670_024_00844_1 crossref_primary_10_1016_j_ijhm_2025_104307 crossref_primary_10_1080_1068316X_2022_2115494 crossref_primary_10_1371_journal_pone_0317842 crossref_primary_10_1080_10508422_2024_2325411 crossref_primary_10_1186_s12889_023_17585_5 crossref_primary_10_1111_apps_12568 crossref_primary_10_1016_j_ijhcs_2024_103441 crossref_primary_10_1002_acp_4219 crossref_primary_10_1177_08902070251319818 crossref_primary_10_1016_j_socscimed_2024_116937 crossref_primary_10_1002_aepp_13521 crossref_primary_10_1016_j_jpsychires_2025_01_041 crossref_primary_10_1080_10941665_2025_2486022 crossref_primary_10_3390_su141912461 crossref_primary_10_1038_s41562_024_02062_9 crossref_primary_10_1089_jayao_2023_0175 crossref_primary_10_1177_08862605221111411 crossref_primary_10_1177_16094069251321256 crossref_primary_10_1080_10720162_2025_2558629 crossref_primary_10_1108_JMP_08_2023_0432 crossref_primary_10_1177_21533687241258772 crossref_primary_10_1108_MEQ_08_2024_0363 crossref_primary_10_1016_j_ijhcs_2023_103040 crossref_primary_10_1177_27533743231201864 crossref_primary_10_3389_frai_2023_1249322 crossref_primary_10_1177_10963480251361953 crossref_primary_10_1108_EJM_12_2022_0853 crossref_primary_10_1177_10776990251362834 crossref_primary_10_2196_45411 crossref_primary_10_1177_23294906241301354 crossref_primary_10_3389_fnins_2022_879583 crossref_primary_10_1108_ITP_02_2023_0134 crossref_primary_10_1016_j_bodyim_2023_08_002 crossref_primary_10_1177_19485506221129160 crossref_primary_10_3389_fpsyg_2024_1211272 crossref_primary_10_1007_s12144_024_05866_0 crossref_primary_10_1016_j_jad_2024_07_066 crossref_primary_10_3758_s13428_022_01966_6 crossref_primary_10_1080_10447318_2024_2327178 crossref_primary_10_1111_jomf_12929 crossref_primary_10_1177_10596011241310272 crossref_primary_10_1016_j_socscimed_2024_116806 crossref_primary_10_1038_s41597_023_01947_0 crossref_primary_10_1097_BPO_0000000000002989 crossref_primary_10_1002_mar_21882 crossref_primary_10_1111_socf_13055 crossref_primary_10_1080_13683500_2024_2378611 crossref_primary_10_1007_s00187_025_00391_y crossref_primary_10_1177_00472875251353805 crossref_primary_10_1177_00332941241265958 crossref_primary_10_1108_JHTT_11_2023_0348 crossref_primary_10_1016_j_jad_2023_04_142 crossref_primary_10_1007_s11199_024_01499_6 crossref_primary_10_1007_s13178_023_00841_z crossref_primary_10_1016_j_jbusres_2025_115307 crossref_primary_10_1007_s41542_023_00164_w crossref_primary_10_1038_s41562_024_02009_0 crossref_primary_10_1080_09658211_2025_2551232 crossref_primary_10_1016_j_ijhm_2024_104037 crossref_primary_10_1017_langcog_2023_9 crossref_primary_10_1177_17456916241234328 crossref_primary_10_3389_fnhum_2023_1228365 crossref_primary_10_1016_j_bodyim_2024_101837 crossref_primary_10_1007_s10508_024_03009_x crossref_primary_10_1177_25152459241231581 crossref_primary_10_1007_s10648_023_09779_5 crossref_primary_10_1089_thy_2023_0479 crossref_primary_10_1108_ITP_03_2024_0324 crossref_primary_10_1016_j_watres_2024_121254 crossref_primary_10_1016_j_jretconser_2023_103612 crossref_primary_10_1080_0092623X_2023_2269915 crossref_primary_10_1080_09669582_2024_2306545 crossref_primary_10_3390_sexes4010013 crossref_primary_10_1016_j_cose_2024_103741 crossref_primary_10_1177_20597991251329754 crossref_primary_10_1177_00472875241266617 crossref_primary_10_1073_pnas_2306281121 crossref_primary_10_1080_13506285_2024_2335585 crossref_primary_10_1080_13683500_2024_2410935 crossref_primary_10_1016_j_ssresearch_2025_103193 crossref_primary_10_1177_10659129241265703 crossref_primary_10_1371_journal_pone_0277894 crossref_primary_10_1016_j_aos_2023_101511 crossref_primary_10_1016_j_appet_2024_107282 crossref_primary_10_1007_s11145_025_10641_z crossref_primary_10_1038_s41598_024_81047_0 crossref_primary_10_1038_s41598_024_58300_7 crossref_primary_10_1080_16066359_2023_2195171 crossref_primary_10_1007_s40615_024_02149_z crossref_primary_10_1080_09669582_2024_2342982 crossref_primary_10_1007_s11024_022_09477_6 crossref_primary_10_1080_01442872_2024_2323673 crossref_primary_10_1371_journal_pone_0286597 crossref_primary_10_1177_20552076231152164 crossref_primary_10_2196_60184 crossref_primary_10_1080_19434472_2022_2127834 crossref_primary_10_1080_00223891_2022_2052302 crossref_primary_10_1038_s41562_022_01485_6 crossref_primary_10_1108_MIP_08_2023_0391 crossref_primary_10_3758_s13423_024_02512_5 crossref_primary_10_3758_s13421_023_01442_2 crossref_primary_10_1177_10422587251371486 crossref_primary_10_1186_s40479_024_00259_y crossref_primary_10_1111_jbl_12405 crossref_primary_10_1080_10410236_2024_2361582 crossref_primary_10_1111_jomf_13049 crossref_primary_10_1177_20563051251348922 crossref_primary_10_3390_su16125010 crossref_primary_10_1080_09515089_2024_2354432 crossref_primary_10_1016_j_bodyim_2023_03_015 crossref_primary_10_1080_15378020_2024_2365010 crossref_primary_10_1007_s11109_022_09851_w crossref_primary_10_1080_23322039_2024_2431543 crossref_primary_10_1108_EDI_12_2022_0334 crossref_primary_10_1177_10776990241297167 crossref_primary_10_1016_j_appet_2022_106415 crossref_primary_10_1038_s41562_022_01496_3 crossref_primary_10_1177_09732586231190267 crossref_primary_10_1016_j_ijhm_2025_104302 crossref_primary_10_1108_IJPDLM_02_2024_0082 crossref_primary_10_1186_s12889_023_15640_9 crossref_primary_10_1016_j_jretconser_2024_104080 crossref_primary_10_1016_j_rssm_2024_100935 crossref_primary_10_1177_10911421251335100 crossref_primary_10_1007_s11747_022_00891_6 crossref_primary_10_1016_j_psychres_2025_116706 crossref_primary_10_7717_peerj_cs_1136 crossref_primary_10_1016_j_jad_2024_01_197 crossref_primary_10_1097_BPO_0000000000003105 crossref_primary_10_1186_s40359_024_02142_5 crossref_primary_10_1007_s12369_025_01306_6 crossref_primary_10_1017_jdm_2025_10 crossref_primary_10_1007_s11606_022_07764_2 crossref_primary_10_1017_jdm_2024_42 crossref_primary_10_1108_IMR_03_2022_0070 crossref_primary_10_2196_67923 crossref_primary_10_1016_j_jbusres_2022_05_055 crossref_primary_10_1177_00220426231205797 crossref_primary_10_3390_ijerph20095664 crossref_primary_10_1080_1062726X_2022_2149533 crossref_primary_10_1002_bdm_2337 crossref_primary_10_1016_j_cofs_2025_101307 crossref_primary_10_1016_j_appet_2025_108303 crossref_primary_10_18332_tid_169739 crossref_primary_10_1080_08853134_2024_2415081 crossref_primary_10_1016_j_foodqual_2025_105507 crossref_primary_10_3389_frobt_2025_1436674 crossref_primary_10_1016_j_addbeh_2022_107473 crossref_primary_10_1038_s44271_025_00234_5 crossref_primary_10_1080_10696679_2025_2452843 crossref_primary_10_1080_0163853X_2023_2197692 crossref_primary_10_1016_j_jclepro_2022_135555 crossref_primary_10_1093_asj_sjaf075 crossref_primary_10_1177_00472875241311550 crossref_primary_10_1016_j_appet_2023_107097 crossref_primary_10_1007_s10803_024_06687_7 crossref_primary_10_1177_00472875251354844 crossref_primary_10_1017_S000712342200076X crossref_primary_10_1111_joop_12454 crossref_primary_10_1146_annurev_soc_083024_070113 crossref_primary_10_1177_23727322241274745 crossref_primary_10_1089_trgh_2024_0203 crossref_primary_10_1080_0361073X_2022_2145163 crossref_primary_10_2147_CCID_S429120 crossref_primary_10_3758_s13428_024_02515_z crossref_primary_10_1016_j_bodyim_2024_101786 crossref_primary_10_1016_j_chb_2023_107959 crossref_primary_10_1098_rsos_221385 crossref_primary_10_3102_00028312251315740 crossref_primary_10_1080_02678373_2024_2364594 crossref_primary_10_1287_isre_2020_0084 crossref_primary_10_1177_00104140241252095 crossref_primary_10_1007_s10608_024_10551_4 crossref_primary_10_1080_09588221_2025_2497498 crossref_primary_10_1086_730763 crossref_primary_10_1080_09585192_2025_2492867 crossref_primary_10_1177_19401612241308697 crossref_primary_10_1177_08874034231211259 crossref_primary_10_1002_cb_2223 crossref_primary_10_1038_s41541_024_00951_8 crossref_primary_10_3390_children12081070 crossref_primary_10_1177_00111287241268298 crossref_primary_10_1016_j_foodqual_2024_105420 crossref_primary_10_3758_s13428_025_02618_1 crossref_primary_10_1007_s10270_023_01147_9 crossref_primary_10_1016_j_paid_2024_112666 crossref_primary_10_1080_15305058_2025_2554212 crossref_primary_10_1111_jasp_13062 crossref_primary_10_1007_s43681_023_00385_3 crossref_primary_10_1002_bse_3569 crossref_primary_10_1108_JFBM_01_2025_0032 crossref_primary_10_1016_j_jenvp_2023_102134 crossref_primary_10_1038_s41598_024_76934_5 crossref_primary_10_1177_10731911231225200 crossref_primary_10_1038_s41598_024_58924_9 crossref_primary_10_1080_0144929X_2024_2325023 crossref_primary_10_1057_s41599_023_01763_2 crossref_primary_10_1108_SCM_05_2024_0310 crossref_primary_10_1177_13623613221132109 crossref_primary_10_1111_emre_70023 crossref_primary_10_1093_emph_eoad032 crossref_primary_10_1177_25152459251336127 crossref_primary_10_1080_00223891_2023_2298887 crossref_primary_10_1080_10510974_2025_2499161 crossref_primary_10_1108_APJML_09_2023_0939 crossref_primary_10_1007_s10508_024_03053_7 crossref_primary_10_1016_j_jenvp_2023_102143 crossref_primary_10_1007_s12525_024_00735_x crossref_primary_10_1007_s10815_025_03539_w crossref_primary_10_1038_s44271_024_00076_7 crossref_primary_10_12688_f1000research_111280_1 crossref_primary_10_1108_JSM_07_2024_0332 crossref_primary_10_1177_00472875251365878 crossref_primary_10_1177_10755470241280986 crossref_primary_10_1186_s13229_025_00651_7 crossref_primary_10_1007_s11031_024_10087_w crossref_primary_10_1002_mhs2_70020 crossref_primary_10_3758_s13428_025_02760_w crossref_primary_10_1016_j_annals_2023_103714 crossref_primary_10_1093_iwc_iwae002 crossref_primary_10_1007_s12144_025_08436_0 crossref_primary_10_1093_geronb_gbae080 crossref_primary_10_1287_mnsc_2023_02792 crossref_primary_10_1016_j_paid_2024_112889 crossref_primary_10_1111_pere_12472 crossref_primary_10_1186_s40163_024_00240_8 crossref_primary_10_1093_iwc_iwad039 crossref_primary_10_1002_acp_4164 crossref_primary_10_1111_jsr_13623 crossref_primary_10_1080_23311975_2025_2451125 crossref_primary_10_1126_sciadv_adv7864 crossref_primary_10_1515_ip_2022_5002 crossref_primary_10_1111_1467_8551_12765 crossref_primary_10_1007_s10896_025_00878_1 crossref_primary_10_1111_joms_13188 crossref_primary_10_1016_j_asw_2025_100937 crossref_primary_10_1093_ej_ueae019 crossref_primary_10_1016_j_foodpol_2023_102420 crossref_primary_10_1080_07418825_2024_2347644 crossref_primary_10_1017_dsj_2024_51 crossref_primary_10_1007_s00426_024_02022_y crossref_primary_10_1016_j_jvb_2023_103896 crossref_primary_10_1007_s12144_024_05752_9 crossref_primary_10_1016_j_addbeh_2025_108453 crossref_primary_10_1186_s40594_024_00519_x crossref_primary_10_1007_s12119_023_10156_1 crossref_primary_10_1093_poq_nfad032 crossref_primary_10_1177_19401612251342679 crossref_primary_10_1177_20539517221080678 crossref_primary_10_1007_s12144_023_05335_0 crossref_primary_10_1371_journal_pone_0302892 crossref_primary_10_1093_poq_nfad037 crossref_primary_10_1016_j_jbusres_2024_114984 crossref_primary_10_1007_s11135_024_01973_z crossref_primary_10_1038_s41598_025_03984_8 crossref_primary_10_1073_pnas_2213709120 crossref_primary_10_1093_qje_qjae030 crossref_primary_10_1177_21582440251375922 crossref_primary_10_1007_s10668_023_04121_z crossref_primary_10_1080_23251042_2024_2369739 crossref_primary_10_1177_10659129241268818 crossref_primary_10_1108_EJM_07_2024_0572 crossref_primary_10_3758_s13428_023_02152_y crossref_primary_10_1093_jcr_ucaf022 crossref_primary_10_1007_s10772_023_10027_y crossref_primary_10_1016_j_compedu_2023_104925 crossref_primary_10_1111_jasp_13021 crossref_primary_10_1177_10659129241275458 crossref_primary_10_1186_s13229_025_00643_7 crossref_primary_10_3389_fcomp_2025_1405436 crossref_primary_10_1177_20552076241290964 crossref_primary_10_1007_s11166_025_09462_w crossref_primary_10_1016_j_paid_2023_112525 crossref_primary_10_1016_j_jbusres_2023_114350 crossref_primary_10_3390_tourhosp6030127 crossref_primary_10_1093_schbul_sbae138 crossref_primary_10_1108_JMP_04_2021_0240 crossref_primary_10_1111_lsq_12487 crossref_primary_10_3389_feduc_2024_1360848 crossref_primary_10_3758_s13428_024_02433_0 crossref_primary_10_1007_s40881_021_00114_8 crossref_primary_10_1080_10548408_2025_2497959 crossref_primary_10_1007_s12599_024_00869_4 crossref_primary_10_1016_j_giq_2023_101906 crossref_primary_10_53703_001c_124011 crossref_primary_10_1007_s11205_024_03372_1 crossref_primary_10_1007_s10648_023_09738_0 crossref_primary_10_1038_s41598_024_75595_8 crossref_primary_10_1061_NHREFO_NHENG_2461 crossref_primary_10_1080_16184742_2024_2329157 crossref_primary_10_1080_13032917_2022_2119593 crossref_primary_10_1177_20552076241311066 crossref_primary_10_1177_00472875241230008 crossref_primary_10_1111_pbaf_12354 crossref_primary_10_1007_s12103_022_09698_1 crossref_primary_10_1007_s10639_025_13492_x crossref_primary_10_1016_j_paid_2023_112418 crossref_primary_10_1016_j_trf_2024_12_021 crossref_primary_10_1007_s10649_025_10387_z crossref_primary_10_1017_jmo_2025_10024 crossref_primary_10_1093_applin_amae048 crossref_primary_10_1177_00332941241233209 crossref_primary_10_1177_14707853251355679 crossref_primary_10_1080_10447318_2023_2223823 crossref_primary_10_1177_00811750241312226 crossref_primary_10_3758_s13428_024_02533_x crossref_primary_10_1016_j_chb_2023_107899 crossref_primary_10_1080_00380253_2024_2347917 crossref_primary_10_1073_pnas_2413443122 crossref_primary_10_1080_00918369_2024_2320242 crossref_primary_10_1007_s11257_024_09412_2 crossref_primary_10_1016_j_rasd_2023_102146 crossref_primary_10_3389_fpubh_2023_1191882 crossref_primary_10_1007_s12207_025_09539_6 crossref_primary_10_1027_1015_5759_a000878 crossref_primary_10_1016_j_tourman_2024_105116 crossref_primary_10_1016_j_jenvp_2023_102070 crossref_primary_10_1007_s40615_025_02644_x crossref_primary_10_2196_70483 crossref_primary_10_1017_bca_2025_11 crossref_primary_10_1017_langcog_2024_77 crossref_primary_10_1016_j_socec_2025_102336 crossref_primary_10_1080_16066359_2025_2486964 crossref_primary_10_1093_qje_qjae020 crossref_primary_10_1108_JOSM_12_2021_0464 crossref_primary_10_1177_00332941221142002 crossref_primary_10_1108_INTR_04_2023_0282 crossref_primary_10_1016_j_tbs_2024_100859 crossref_primary_10_1007_s41449_025_00481_6 crossref_primary_10_1016_j_learninstruc_2024_102054 crossref_primary_10_1093_jcmc_zmac026 crossref_primary_10_1080_14479338_2023_2215740 crossref_primary_10_1002_job_2820 crossref_primary_10_1515_cog_2023_0127 crossref_primary_10_1038_s41598_025_92907_8 crossref_primary_10_3389_fcomm_2022_1017362 crossref_primary_10_1027_1015_5759_a000841 crossref_primary_10_5465_amj_2021_1197 crossref_primary_10_1002_icd_2459 crossref_primary_10_1016_j_xjmad_2024_100057 crossref_primary_10_1007_s10508_023_02733_0 crossref_primary_10_1108_APJML_11_2024_1701 crossref_primary_10_1007_s13164_024_00726_z crossref_primary_10_1080_10410236_2024_2348236 crossref_primary_10_1007_s10458_024_09649_6 crossref_primary_10_1177_14648849251333597 crossref_primary_10_1080_00380253_2025_2480228 crossref_primary_10_1016_j_ijintrel_2024_102004 crossref_primary_10_1016_j_csi_2024_103971 crossref_primary_10_1016_j_xkme_2023_100788 crossref_primary_10_1080_10696679_2025_2537664 crossref_primary_10_1111_jmft_70072 crossref_primary_10_1080_00223891_2023_2206896 crossref_primary_10_1080_23311908_2024_2359827 crossref_primary_10_1007_s10899_023_10272_5 crossref_primary_10_1057_s41599_024_04016_y crossref_primary_10_1016_j_paid_2024_112706 crossref_primary_10_1177_0261927X231171688 crossref_primary_10_1007_s11135_023_01733_5 crossref_primary_10_1027_2157_3891_a000101 crossref_primary_10_1080_14459795_2025_2488868 crossref_primary_10_1002_pop4_70018 crossref_primary_10_1007_s41347_024_00411_z crossref_primary_10_1016_j_jesp_2023_104529 crossref_primary_10_1016_j_tele_2023_102084 crossref_primary_10_1177_10434631231193599 crossref_primary_10_1007_s11747_022_00868_5 crossref_primary_10_1038_s41562_022_01517_1 crossref_primary_10_1002_mar_22189 crossref_primary_10_1044_2023_JSLHR_22_00268 crossref_primary_10_1080_00071005_2023_2210653 crossref_primary_10_1177_20438087241288532 crossref_primary_10_1016_j_joep_2024_102715 crossref_primary_10_1002_acp_3920 crossref_primary_10_1177_26320770251351957 crossref_primary_10_1093_workar_waaf007 crossref_primary_10_1007_s10882_024_09958_4 crossref_primary_10_1007_s11764_023_01488_w crossref_primary_10_1007_s10676_023_09708_8 crossref_primary_10_3389_fpsyg_2023_1170855 crossref_primary_10_3390_cli11060125 crossref_primary_10_2105_AJPH_2024_307875 crossref_primary_10_1177_0272989X221107907 crossref_primary_10_1016_j_indmarman_2025_01_013 crossref_primary_10_1093_heapro_daae204 crossref_primary_10_1016_j_compedu_2024_105080 crossref_primary_10_1016_j_jebo_2025_107039 crossref_primary_10_1371_journal_pone_0319233 crossref_primary_10_1007_s10869_022_09862_8 crossref_primary_10_1016_j_landurbplan_2024_105272 crossref_primary_10_1007_s10803_025_06786_z crossref_primary_10_1016_j_jvb_2024_103987 crossref_primary_10_1177_20531680231180357 crossref_primary_10_1177_00323217241309962 crossref_primary_10_1007_s11573_022_01120_w crossref_primary_10_1007_s40558_025_00313_7 crossref_primary_10_1016_j_jbvi_2023_e00381 crossref_primary_10_2196_41747 crossref_primary_10_1016_j_jbef_2024_100994 crossref_primary_10_1108_JHTH_01_2025_0017 crossref_primary_10_1007_s12529_023_10212_y crossref_primary_10_1177_00302228231221268 crossref_primary_10_2196_68092 crossref_primary_10_1111_asap_12415 crossref_primary_10_1177_17456916241242734 crossref_primary_10_1016_j_bushor_2024_11_004 crossref_primary_10_1007_s10551_025_05986_y crossref_primary_10_1177_13591053241238126 crossref_primary_10_1016_j_obhdp_2024_104388 crossref_primary_10_1016_j_jbusres_2024_114716 crossref_primary_10_1016_j_socec_2023_102057 crossref_primary_10_1177_00472875241288852 crossref_primary_10_1177_08862605241270031 crossref_primary_10_1016_j_trf_2024_06_003
Cites_doi	10.1177/1948550617698203 10.1177/0894439319848726 10.1016/j.chb.2017.08.038 10.1002/job.1962 10.1111/ajps.12081 10.1002/9781118763520.ch10 10.1038/nature11467 10.1002/bdm.1753 10.1177/0894439317752406 10.1017/S1930297500002205 10.1093/poq/nfy038 10.1007/s10869-016-9458-5 10.1177/0149206318811569 10.1016/j.paid.2014.11.017 10.1177/1745691610393980 10.1093/poq/nfr020 10.1177/0956797615585115 10.1037/1082-989X.8.2.206 10.1016/j.jesp.2017.01.006 10.1093/jcr/ucx047 10.1037/t13084-000 10.1509/jmkr.45.6.633 10.3758/s13428-013-0365-7 10.3758/s13428-013-0434-y 10.1177/1745691617706516 10.3758/s13428-011-0081-0 10.1037/bul0000174 10.2139/ssrn.3775075 10.1016/j.ijforecast.2014.06.001 10.3389/fpsyg.2017.01359 10.1016/j.jesp.2009.03.009 10.1007/s10940-019-09436-7 10.3758/s13428-019-01273-7 10.1207/s15327752jpa4803_13
ContentType	Journal Article
Copyright	The Psychonomic Society, Inc. 2021 2021. The Psychonomic Society, Inc. Copyright Springer Nature B.V. 2022
Copyright_xml	– notice: The Psychonomic Society, Inc. 2021 – notice: 2021. The Psychonomic Society, Inc. – notice: Copyright Springer Nature B.V. 2022
DBID	AAYXX CITATION NPM 4T- 7TK K9. 7X8 5PM
DOI	10.3758/s13428-021-01694-3
DatabaseName	CrossRef PubMed Docstoc Neurosciences Abstracts ProQuest Health & Medical Complete (Alumni) MEDLINE - Academic PubMed Central (Full Participant titles)
DatabaseTitle	CrossRef PubMed ProQuest Health & Medical Complete (Alumni) Neurosciences Abstracts Docstoc MEDLINE - Academic
DatabaseTitleList	ProQuest Health & Medical Complete (Alumni) PubMed MEDLINE - Academic
Database_xml	– sequence: 1 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database
DeliveryMethod	fulltext_linktorsrc
Discipline	Psychology
EISSN	1554-3528
EndPage	1662
ExternalDocumentID	PMC8480459 34590289 10_3758_s13428_021_01694_3
Genre	Journal Article
GroupedDBID	--- -DZ -ET -~X 0-V 06D 0R~ 0VY 199 1N0 203 23N 2J2 2JN 2JY 2KG 2KM 2LR 2VQ 30V 4.4 406 408 40E 53G 5GY 7X7 875 88E 8AO 8FI 8FJ 8G5 8TC 8UJ 95. 96X AAAVM AABHQ AACDK AAHNG AAIAL AAJBT AAJKR AAKPC AANZL AAPKM AARTL AASML AATNV AATVU AAUYE AAWCG AAYIU AAYQN AAYTO AAYZH AAZMS ABAKF ABBRH ABDBE ABDZT ABECU ABFSG ABFTV ABHLI ABIVO ABJNI ABJOX ABJUD ABKCH ABMQK ABNWP ABPLI ABPPZ ABQBU ABQSL ABRTQ ABSXP ABTEG ABTHY ABTKH ABTMW ABUWG ABXPI ACAOD ACBXY ACDTI ACGFS ACHQT ACHSB ACHXU ACIWK ACKIV ACKNC ACMDZ ACMLO ACNCT ACOKC ACPIV ACPRK ACSTC ACZOJ ADBBV ADHHG ADHIR ADHKG ADKNI ADKPE ADURQ ADYFF ADZKW AEBTG AEFQL AEGAL AEGNC AEJHL AEJRE AEKMD AEMSY AEOHA AEPYU AESKC AETCA AEVLU AEXYK AEZWR AFBBN AFDZB AFFNX AFHIU AFKRA AFOHR AFQWF AFRAH AFWTZ AFZKB AGAYW AGDGC AGJBK AGMZJ AGQEE AGQMX AGQPQ AGRTI AGWIL AGWZB AGYKE AHAVH AHBYD AHMBA AHPBZ AHSBF AHWEU AHYZX AIAKS AIGIU AIIXL AILAN AITGF AIXLP AJBLW AJRNO AJZVZ ALIPV ALMA_UNASSIGNED_HOLDINGS ALSLI AMKLP AMXSW AMYLF AMYQR AOCGG ARALO ARMRJ ASPBG ATHPR AVWKF AXYYD AYFIA AYQZM AZFZN AZQEC B-. BAWUL BENPR BGNMA BPHCQ BVXVI C1A CAG CCPQU COF CSCUP DDRTE DIK DNIVK DPUIP DWQXO E3Z EBD EBLON EBS EIOEI EJD EMOBN ESBYG F5P FEDTE FERAY FFXSO FIGPU FINBP FNLPD FRRFC FSGXE FYUFA GGCAI GGRSB GJIRD GNUQQ GNWQR GQ7 GUQSH H13 HF~ HMCUK HMJXF HRMNR HVGLF HZ~ H~9 IAO IHR IKXTQ INH IPY IRVIT ITC ITM IWAJR J-C JBSCW JZLTJ KOV LLZTM M1P M2M M2O M2R M4Y MVM N2Q N9A NB0 NPVJJ NQJWS NU0 O9- O93 O9G O9J OHT OK1 P2P P9L PADUT PF- PHGZM PHGZT PJZUB PPXIY PQQKQ PROAC PRQQA PSQYO PSYQQ PT4 R9I ROL RPV RSV S16 S1Z S27 S3B SBS SBU SCLPG SHX SISQX SJYHP SNE SNPRN SNX SOHCF SOJ SPISZ SRMVM SSLCW SSXJD STPWE SV3 SZN T13 TN5 TR2 TSG TUC TUS U2A U9L UG4 UKHRP UOJIU UPT UTJUX UZXMN VFIZW W48 WH7 WK8 XJT XOL XSW ZMTXR ZOVNA ZUP AAYXX CITATION NPM 4T- 7TK K9. 7X8 5PM
ID	FETCH-LOGICAL-c611t-94063e1af065e7daaf951b9f7175b0b35ed640e1f0de02132db322d49a53f38e3
IEDL.DBID	RSV
ISICitedReferencesCount	1045
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000701375800002&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	1554-3528 1554-351X
IngestDate	Tue Nov 04 01:59:00 EST 2025 Thu Sep 04 15:51:20 EDT 2025 Sat Nov 15 05:53:32 EST 2025 Thu Apr 03 07:04:32 EDT 2025 Sat Nov 29 02:18:10 EST 2025 Tue Nov 18 21:30:06 EST 2025 Mon Jul 21 06:08:02 EDT 2025
IsDoiOpenAccess	true
IsOpenAccess	true
IsPeerReviewed	true
IsScholarly	true
Issue	4
Keywords	Online research Honesty Attention Prolific Data quality Amazon mechanical turk Comprehension Reliability
Language	English
License	2021. The Psychonomic Society, Inc. This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c611t-94063e1af065e7daaf951b9f7175b0b35ed640e1f0de02132db322d49a53f38e3
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 content type line 23
OpenAccessLink	https://pubmed.ncbi.nlm.nih.gov/PMC8480459
PMID	34590289
PQID	2701553231
PQPubID	976348
PageCount	20
ParticipantIDs	pubmedcentral_primary_oai_pubmedcentral_nih_gov_8480459 proquest_miscellaneous_2578150764 proquest_journals_2701553231 pubmed_primary_34590289 crossref_citationtrail_10_3758_s13428_021_01694_3 crossref_primary_10_3758_s13428_021_01694_3 springer_journals_10_3758_s13428_021_01694_3
PublicationCentury	2000
PublicationDate	2022-08-01
PublicationDateYYYYMMDD	2022-08-01
PublicationDate_xml	– month: 08 year: 2022 text: 2022-08-01 day: 01
PublicationDecade	2020
PublicationPlace	New York
PublicationPlace_xml	– name: New York – name: United States
PublicationTitle	Behavior research methods
PublicationTitleAbbrev	Behav Res
PublicationTitleAlternate	Behav Res Methods
PublicationYear	2022
Publisher	Springer US Springer Nature B.V
Publisher_xml	– name: Springer US – name: Springer Nature B.V
References	W Wang (1694_CR34) 2015; 31 AS Göritz (1694_CR17) 2021; 39 1694_CR19 JJ Chandler (1694_CR7) 2017; 8 JK Goodman (1694_CR16) 2013; 26 1694_CR18 KA Thomas (1694_CR32) 2017; 77 AJ Berinsky (1694_CR2) 2014; 58 J Chandler (1694_CR9) 2015; 26 E Peer (1694_CR27) 2014; 46 JT Cacioppo (1694_CR6) 1984; 48 Y Kim (1694_CR21) 2019; 37 J Feitosa (1694_CR13) 2015; 75 DM Oppenheimer (1694_CR25) 2009; 45 M Buhrmester (1694_CR4) 2016; 6 1694_CR3 JK Goodman (1694_CR15) 2017; 44 G Paolacci (1694_CR26) 2010; 5 1694_CR33 N Mazar (1694_CR24) 2008; 45 MD Buhrmester (1694_CR5) 2018; 13 JH Cheung (1694_CR11) 2017; 32 J Chandler (1694_CR8) 2014; 46 TS Behrend (1694_CR1) 2011; 43 JA DeSimone (1694_CR12) 2015; 36 FL Schmidt (1694_CR31) 2003; 8 MG Keith (1694_CR20) 2017; 8 CO Porter (1694_CR29) 2019; 45 J Chandler (1694_CR10) 2019; 51 B MacInnis (1694_CR23) 2018; 82 DS Yeager (1694_CR35) 2011; 75 1694_CR22 P Gerlach (1694_CR14) 2019; 145 E Peer (1694_CR28) 2017; 70 DG Rand (1694_CR30) 2012; 489
References_xml	– volume: 8 start-page: 500 issue: 5 year: 2017 ident: 1694_CR7 publication-title: Social Psychological and Personality Science doi: 10.1177/1948550617698203 – volume: 39 start-page: 84 issue: 1 year: 2021 ident: 1694_CR17 publication-title: Social Science Computer Review doi: 10.1177/0894439319848726 – volume: 77 start-page: 184 year: 2017 ident: 1694_CR32 publication-title: Computers in Human Behavior doi: 10.1016/j.chb.2017.08.038 – volume: 36 start-page: 171 issue: 2 year: 2015 ident: 1694_CR12 publication-title: Journal of Organizational Behavior doi: 10.1002/job.1962 – volume: 58 start-page: 739 issue: 3 year: 2014 ident: 1694_CR2 publication-title: American Journal of Political Science doi: 10.1111/ajps.12081 – ident: 1694_CR18 doi: 10.1002/9781118763520.ch10 – volume: 489 start-page: 427 issue: 7416 year: 2012 ident: 1694_CR30 publication-title: Nature doi: 10.1038/nature11467 – volume: 26 start-page: 213 issue: 3 year: 2013 ident: 1694_CR16 publication-title: Journal of Behavioral Decision Making doi: 10.1002/bdm.1753 – volume: 37 start-page: 214 issue: 2 year: 2019 ident: 1694_CR21 publication-title: Social Science Computer Review doi: 10.1177/0894439317752406 – volume: 5 start-page: 411 issue: 5 year: 2010 ident: 1694_CR26 publication-title: Judgment and Decision Making doi: 10.1017/S1930297500002205 – volume: 82 start-page: 707 issue: 4 year: 2018 ident: 1694_CR23 publication-title: Public Opinion Quarterly doi: 10.1093/poq/nfy038 – volume: 32 start-page: 347 issue: 4 year: 2017 ident: 1694_CR11 publication-title: Journal of Business and Psychology doi: 10.1007/s10869-016-9458-5 – volume: 45 start-page: 319 issue: 1 year: 2019 ident: 1694_CR29 publication-title: Journal of Management doi: 10.1177/0149206318811569 – volume: 75 start-page: 47 year: 2015 ident: 1694_CR13 publication-title: Personality and Individual Differences doi: 10.1016/j.paid.2014.11.017 – volume: 6 start-page: 3 issue: 1 year: 2016 ident: 1694_CR4 publication-title: Perspectives on Psychological Science doi: 10.1177/1745691610393980 – volume: 75 start-page: 709 issue: 4 year: 2011 ident: 1694_CR35 publication-title: Public Opinion Quarterly doi: 10.1093/poq/nfr020 – volume: 26 start-page: 1131 issue: 7 year: 2015 ident: 1694_CR9 publication-title: Psychological Science doi: 10.1177/0956797615585115 – volume: 8 start-page: 206 issue: 2 year: 2003 ident: 1694_CR31 publication-title: Psychological Methods doi: 10.1037/1082-989X.8.2.206 – volume: 70 start-page: 153 year: 2017 ident: 1694_CR28 publication-title: Journal of Experimental Social Psychology doi: 10.1016/j.jesp.2017.01.006 – volume: 44 start-page: 196 issue: 1 year: 2017 ident: 1694_CR15 publication-title: Journal of Consumer Research doi: 10.1093/jcr/ucx047 – ident: 1694_CR3 doi: 10.1037/t13084-000 – ident: 1694_CR19 – volume: 45 start-page: 633 issue: 6 year: 2008 ident: 1694_CR24 publication-title: Journal of Marketing Research doi: 10.1509/jmkr.45.6.633 – volume: 46 start-page: 112 issue: 1 year: 2014 ident: 1694_CR8 publication-title: Behavior Research Methods doi: 10.3758/s13428-013-0365-7 – volume: 46 start-page: 1023 issue: 4 year: 2014 ident: 1694_CR27 publication-title: Behavior Research Methods doi: 10.3758/s13428-013-0434-y – volume: 13 start-page: 149 issue: 2 year: 2018 ident: 1694_CR5 publication-title: Perspectives on Psychological Science doi: 10.1177/1745691617706516 – volume: 43 start-page: 800 issue: 3 year: 2011 ident: 1694_CR1 publication-title: Behavior Research Methods doi: 10.3758/s13428-011-0081-0 – volume: 145 start-page: 1 issue: 1 year: 2019 ident: 1694_CR14 publication-title: Psychological Bulletin doi: 10.1037/bul0000174 – ident: 1694_CR22 doi: 10.2139/ssrn.3775075 – volume: 31 start-page: 980 issue: 3 year: 2015 ident: 1694_CR34 publication-title: International Journal of Forecasting doi: 10.1016/j.ijforecast.2014.06.001 – volume: 8 start-page: 1359 year: 2017 ident: 1694_CR20 publication-title: Frontiers in Psychology doi: 10.3389/fpsyg.2017.01359 – volume: 45 start-page: 867 issue: 4 year: 2009 ident: 1694_CR25 publication-title: Journal of Experimental Social Psychology doi: 10.1016/j.jesp.2009.03.009 – ident: 1694_CR33 doi: 10.1007/s10940-019-09436-7 – volume: 51 start-page: 2022 issue: 5 year: 2019 ident: 1694_CR10 publication-title: Behavior Research Methods doi: 10.3758/s13428-019-01273-7 – volume: 48 start-page: 306 issue: 3 year: 1984 ident: 1694_CR6 publication-title: Journal of Personality Assessment doi: 10.1207/s15327752jpa4803_13
SSID	ssj0038214
Score	2.7452679
Snippet	We examine key aspects of data quality for online behavioral research between selected platforms (Amazon Mechanical Turk, CloudResearch, and Prolific) and...
SourceID	pubmedcentral proquest pubmed crossref springer
SourceType	Open Access Repository Aggregation Database Index Database Enrichment Source Publisher
StartPage	1643
SubjectTerms	Attention Behavior Behavioral Science and Psychology Cognitive Psychology Community research Comprehension Data quality Dishonesty Filters Honesty Internet Psychology Ratings & rankings Reliability
Title	Data quality of platforms and panels for online behavioral research
URI	https://link.springer.com/article/10.3758/s13428-021-01694-3 https://www.ncbi.nlm.nih.gov/pubmed/34590289 https://www.proquest.com/docview/2701553231 https://www.proquest.com/docview/2578150764 https://pubmed.ncbi.nlm.nih.gov/PMC8480459
Volume	54
WOSCitedRecordID	wos000701375800002&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVAVX databaseName: SpringerLINK Contemporary 1997-Present customDbUrl: eissn: 1554-3528 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0038214 issn: 1554-3528 databaseCode: RSV dateStart: 20050201 isFulltext: true titleUrlDefault: https://link.springer.com/search?facet-content-type=%22Journal%22 providerName: Springer Nature
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LS8QwEB509eDF96O6SgRvWtw2aZMeRV08ifhibyVtE3Zh6YrtCvvvnaQPWWUFPbadkHQyj29IZgbgTDChOcqJGwSZcFEofDcKtXI1SpCSXKcpz2yzCX5_LwaD6KFOCiua2-7NkaS11CauRFB7WXiUmWrKvgl_w4i5dBlW0N0Jo46PT6-N_aXC91iVHrNg3LwL-oErf16P_HZGal1Pf-N_i96E9RpqkqtKNrZgSeXbsNZavNkOXN_IUpIqr3JGJpq8jWVpUGxBZJ4RNBToOQm-IFVBDfKV1E_qKkHDXXjp3z5f37l1VwU3DT2vdCN04VR5UiP4UDyTUiPISiKNcV2Q9BIaqCxkPeXpXqZw3dTPElT6jEUyoJoKRfegk09ydQAkwnhRJlLoVDGWSi_h1MeRiOmUwqfEAa9hdJzWJcdN54txjKGH4U9c8SfGeWLLn5g6cN6OeasKbvxK3W32L66Vr4h9brshIXJ14LT9jGpjzkKQc5Mp0qClMlg4ZA7sV9vdTkeZrWkTOcDnBKElMCW557_ko6EtzY2ijxgZR1404vC1rMV_cfg38iNY800Shr2G2IVO-T5Vx7CafpSj4v0ElvlAnFiV-AQ-EAaR
linkProvider	Springer Nature
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1ZS8QwEB50FdwX76OeEXzT4rZJr0fxQFEX8cK3kLYJLizdZVuF_fdO0kNWUdDHthOSTub4hmRmAA5CFqoA5cT2vDS0UShcO_KVtBVKkBSBSpIgNc0mgm43fHmJ7qqksLy-7V4fSRpLreNKBLXHuUOZrqbs6vDXj5hNp2GGocfSF_nuH55r-0tD12FleswP4yZd0Ddc-f165JczUuN6Lhb-t-hFmK-gJjkpZWMJpmS2DO3G4o1X4PRMFIKUeZVjMlBk2BeFRrE5EVlK0FCg5yT4gpQFNchnUj-pqgS9rsLTxfnj6aVddVWwE99xCjtCF06lIxSCDxmkQigEWXGkMK7z4k5MPZn6rCMd1Uklrpu6aYxKn7JIeFTRUNI1aGWDTG4AiTBeFLEIVSIZS4QTB9TFkYjppMSn2AKnZjRPqpLjuvNFn2PoofnDS_5wnIcb_nBqwWEzZlgW3PiVerveP14pX87dwHRDQuRqwX7zGdVGn4Ug5wZvSIOWSmNhn1mwXm53Mx1lpqZNZEEwIQgNgS7JPfkl672a0two-oiRceRRLQ6fy_r5Lzb_Rr4Hc5ePtzf85qp7vQVtVydkmCuJ29AqRm9yB2aT96KXj3aNYnwAZGQIjQ
linkToPdf	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1ZS8QwEB50FfHF-6iuGsE3LW6b9HoUdVGURfBg30LaJChId3Gr4L93kh66ygriY9uENJOZyTck8w3AQcxiHaGeuEEgYxeVwneTUCtXowYpEeksi6QtNhH1enG_n9x8yeK3t93rI8kyp8GwNOXF8VBqY-IUAe7xyKPMMCv7JhQOE-bSaZhhpmiQiddvH2pfTGPfY2WqzIR-49vRD4z586rkt_NSuw11F_8_gSVYqCAoOSl1ZhmmVL4C840nfF-F0zNRCFLmW76TgSbDZ1EYdDsiIpcEHQjuqARfkJJog3wm-5OKPehxDe6753enF25VbcHNQs8r3AS3dqo8oRGUqEgKoRF8pYnGeC9IOykNlAxZR3m6IxX-N_Vlis5AskQEVNNY0XVo5YNcbQJJMI4UqYh1phjLhJdG1MeeiPWUwqfUAa8WOs8qKnJTEeOZY0hi5MNL-XAch1v5cOrAYdNnWBJx_Nq6Xa8lr4xyxP3IVklCROvAfvMZzcmckaDkBq_YBj2Ywcghc2CjXPpmOMos103iQDSmFE0DQ9U9_iV_erSU3WgSiJ2x51GtGp-_NXkWW39rvgdzN2ddfn3Zu9qGed_kadibim1oFS-vagdms7fiafSya23kA9GtEXE
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Data+quality+of+platforms+and+panels+for+online+behavioral+research&rft.jtitle=Behavior+research+methods&rft.au=Peer%2C+Eyal&rft.au=Rothschild%2C+David&rft.au=Gordon%2C+Andrew&rft.au=Evernden%2C+Zak&rft.date=2022-08-01&rft.issn=1554-3528&rft.eissn=1554-3528&rft.volume=54&rft.issue=4&rft.spage=1643&rft.epage=1662&rft_id=info:doi/10.3758%2Fs13428-021-01694-3&rft.externalDBID=n%2Fa&rft.externalDocID=10_3758_s13428_021_01694_3
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1554-3528&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1554-3528&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1554-3528&client=summon