Lack of group-to-individual generalizability is a threat to human subjects research
Only for ergodic processes will inferences based on group-level data generalize to individual experience or behavior. Because human social and psychological processes typically have an individually variable and time-varying nature, they are unlikely to be ergodic. In this paper, six studies with a r...
Gespeichert in:
| Veröffentlicht in: | Proceedings of the National Academy of Sciences - PNAS Jg. 115; H. 27; S. E6106 |
|---|---|
| Hauptverfasser: | , , |
| Format: | Journal Article |
| Sprache: | Englisch |
| Veröffentlicht: |
United States
03.07.2018
|
| Schlagworte: | |
| ISSN: | 1091-6490, 1091-6490 |
| Online-Zugang: | Weitere Angaben |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Abstract | Only for ergodic processes will inferences based on group-level data generalize to individual experience or behavior. Because human social and psychological processes typically have an individually variable and time-varying nature, they are unlikely to be ergodic. In this paper, six studies with a repeated-measure design were used for symmetric comparisons of interindividual and intraindividual variation. Our results delineate the potential scope and impact of nonergodic data in human subjects research. Analyses across six samples (with 87-94 participants and an equal number of assessments per participant) showed some degree of agreement in central tendency estimates (mean) between groups and individuals across constructs and data collection paradigms. However, the variance around the expected value was two to four times larger within individuals than within groups. This suggests that literatures in social and medical sciences may overestimate the accuracy of aggregated statistical estimates. This observation could have serious consequences for how we understand the consistency between group and individual correlations, and the generalizability of conclusions between domains. Researchers should explicitly test for equivalence of processes at the individual and group level across the social and medical sciences. |
|---|---|
| AbstractList | Only for ergodic processes will inferences based on group-level data generalize to individual experience or behavior. Because human social and psychological processes typically have an individually variable and time-varying nature, they are unlikely to be ergodic. In this paper, six studies with a repeated-measure design were used for symmetric comparisons of interindividual and intraindividual variation. Our results delineate the potential scope and impact of nonergodic data in human subjects research. Analyses across six samples (with 87-94 participants and an equal number of assessments per participant) showed some degree of agreement in central tendency estimates (mean) between groups and individuals across constructs and data collection paradigms. However, the variance around the expected value was two to four times larger within individuals than within groups. This suggests that literatures in social and medical sciences may overestimate the accuracy of aggregated statistical estimates. This observation could have serious consequences for how we understand the consistency between group and individual correlations, and the generalizability of conclusions between domains. Researchers should explicitly test for equivalence of processes at the individual and group level across the social and medical sciences.Only for ergodic processes will inferences based on group-level data generalize to individual experience or behavior. Because human social and psychological processes typically have an individually variable and time-varying nature, they are unlikely to be ergodic. In this paper, six studies with a repeated-measure design were used for symmetric comparisons of interindividual and intraindividual variation. Our results delineate the potential scope and impact of nonergodic data in human subjects research. Analyses across six samples (with 87-94 participants and an equal number of assessments per participant) showed some degree of agreement in central tendency estimates (mean) between groups and individuals across constructs and data collection paradigms. However, the variance around the expected value was two to four times larger within individuals than within groups. This suggests that literatures in social and medical sciences may overestimate the accuracy of aggregated statistical estimates. This observation could have serious consequences for how we understand the consistency between group and individual correlations, and the generalizability of conclusions between domains. Researchers should explicitly test for equivalence of processes at the individual and group level across the social and medical sciences. Only for ergodic processes will inferences based on group-level data generalize to individual experience or behavior. Because human social and psychological processes typically have an individually variable and time-varying nature, they are unlikely to be ergodic. In this paper, six studies with a repeated-measure design were used for symmetric comparisons of interindividual and intraindividual variation. Our results delineate the potential scope and impact of nonergodic data in human subjects research. Analyses across six samples (with 87-94 participants and an equal number of assessments per participant) showed some degree of agreement in central tendency estimates (mean) between groups and individuals across constructs and data collection paradigms. However, the variance around the expected value was two to four times larger within individuals than within groups. This suggests that literatures in social and medical sciences may overestimate the accuracy of aggregated statistical estimates. This observation could have serious consequences for how we understand the consistency between group and individual correlations, and the generalizability of conclusions between domains. Researchers should explicitly test for equivalence of processes at the individual and group level across the social and medical sciences. |
| Author | Fisher, Aaron J Medaglia, John D Jeronimus, Bertus F |
| Author_xml | – sequence: 1 givenname: Aaron J surname: Fisher fullname: Fisher, Aaron J email: afisher@berkeley.edu organization: Department of Psychology, University of California, Berkeley, CA 94720; afisher@berkeley.edu – sequence: 2 givenname: John D surname: Medaglia fullname: Medaglia, John D organization: Department of Neurology, University of Pennsylvania, Philadelphia, PA 19104 – sequence: 3 givenname: Bertus F orcidid: 0000-0003-2826-4537 surname: Jeronimus fullname: Jeronimus, Bertus F organization: Department of Developmental Psychology, Faculty of Behavioural and Social Sciences, Groningen University, 9712 TS Groningen, The Netherlands |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/29915059$$D View this record in MEDLINE/PubMed |
| BookMark | eNpNkDtPwzAUhS1URB8wsyGPLCm-jh3XI6p4SZUYgDm6cW5alzyKnSCVXw8VRWI55wyfzvBN2ajtWmLsEsQchElvdi3GORgAaxYA-oRNQFhIMmXF6N8es2mMWyGE1QtxxsbSWtBC2wl7WaF7513F16EbdknfJb4t_acvB6z5mloKWPsvLHzt-z33kSPvN4Gw533HN0ODLY9DsSXXRx4oEga3OWenFdaRLo49Y2_3d6_Lx2T1_PC0vF0lTmVCJ0qhA4MZGKkzwlLZtDIiTYUrUhKydGQItMyEAZkB0iGVcKoCQ-WiMnLGrn9_d6H7GCj2eeOjo7rGlroh5lLoHzPKwgG9OqJD0VCZ74JvMOzzPxHyGwbIYWY |
| CitedBy_id | crossref_primary_10_1007_s11031_022_09962_1 crossref_primary_10_1523_JNEUROSCI_1091_24_2025 crossref_primary_10_3389_fpsyt_2020_552343 crossref_primary_10_3102_0002831219876935 crossref_primary_10_1080_01973533_2023_2267258 crossref_primary_10_3389_fpsyg_2021_626292 crossref_primary_10_1007_s10015_025_01024_2 crossref_primary_10_3390_jintelligence8010003 crossref_primary_10_1038_s41573_018_0009_9 crossref_primary_10_1177_21677026211068873 crossref_primary_10_3758_s13415_024_01216_6 crossref_primary_10_1177_21677026221129279 crossref_primary_10_1080_1463922X_2021_1921310 crossref_primary_10_1038_s41586_022_05118_w crossref_primary_10_3389_fpsyt_2021_719490 crossref_primary_10_3758_s13428_020_01438_9 crossref_primary_10_1080_00273171_2020_1743630 crossref_primary_10_1002_ejsp_2921 crossref_primary_10_1038_s44271_025_00318_2 crossref_primary_10_1111_psyp_13523 crossref_primary_10_1016_S2215_0366_25_00003_3 crossref_primary_10_1002_eat_24170 crossref_primary_10_1016_j_brat_2025_104704 crossref_primary_10_1080_14763141_2021_1960419 crossref_primary_10_1080_17461391_2021_2002420 crossref_primary_10_1038_s41393_022_00751_8 crossref_primary_10_3389_fpsyg_2024_1451251 crossref_primary_10_1038_s41598_018_34138_8 crossref_primary_10_3389_fpsyg_2020_01092 crossref_primary_10_1109_JTEHM_2022_3228483 crossref_primary_10_1038_s41598_021_99034_0 crossref_primary_10_3389_fpsyt_2020_609585 crossref_primary_10_1016_j_paid_2019_109784 crossref_primary_10_1007_s10902_020_00287_9 crossref_primary_10_1016_j_copsyc_2021_01_004 crossref_primary_10_1038_s41598_023_28345_1 crossref_primary_10_1016_j_imu_2021_100596 crossref_primary_10_1016_j_brat_2020_103596 crossref_primary_10_1016_j_brat_2023_104365 crossref_primary_10_1016_j_yhbeh_2024_105542 crossref_primary_10_1038_s41562_025_02171_z crossref_primary_10_1186_s12889_023_15031_0 crossref_primary_10_1111_sltb_12920 crossref_primary_10_1007_s12671_021_01668_8 crossref_primary_10_1093_abm_kaaa018 crossref_primary_10_1007_s40279_018_1030_1 crossref_primary_10_1016_j_bpsc_2020_02_010 crossref_primary_10_1002_jts_22857 crossref_primary_10_1017_S0034412525000198 crossref_primary_10_1080_17437199_2023_2233592 crossref_primary_10_1007_s11136_021_02957_4 crossref_primary_10_1111_psyp_14758 crossref_primary_10_1371_journal_pone_0293683 crossref_primary_10_1080_10705511_2024_2429544 crossref_primary_10_1016_j_jcbs_2019_07_001 crossref_primary_10_1016_j_cbpra_2021_11_004 crossref_primary_10_1111_psyp_14630 crossref_primary_10_3390_philosophies6020046 crossref_primary_10_1007_s10964_022_01578_5 crossref_primary_10_1080_21642850_2019_1646136 crossref_primary_10_1016_j_brat_2024_104551 crossref_primary_10_1111_sltb_12933 crossref_primary_10_1080_17437199_2024_2400977 crossref_primary_10_1111_spc3_12922 crossref_primary_10_1093_cercor_bhab316 crossref_primary_10_1080_00140139_2020_1811400 crossref_primary_10_1080_17437199_2025_2471792 crossref_primary_10_1017_S1352465819000304 crossref_primary_10_1186_s12916_020_01742_3 crossref_primary_10_1017_S0033291720001002 crossref_primary_10_1093_pm_pnaa473 crossref_primary_10_1146_annurev_clinpsy_081219_092850 crossref_primary_10_1016_j_brat_2019_01_005 crossref_primary_10_1097_j_pain_0000000000003574 crossref_primary_10_1016_j_ijintrel_2025_102240 crossref_primary_10_1016_j_jbiomech_2019_07_017 crossref_primary_10_1016_j_jogn_2020_12_006 crossref_primary_10_7554_eLife_78717 crossref_primary_10_1097_j_pain_0000000000003573 crossref_primary_10_1177_08902070251316915 crossref_primary_10_1038_s41598_023_38090_0 crossref_primary_10_1177_0145445518796202 crossref_primary_10_1002_eat_24097 crossref_primary_10_1111_add_16173 crossref_primary_10_3389_fendo_2019_00664 crossref_primary_10_1016_j_copsyc_2024_101946 crossref_primary_10_1016_j_tics_2023_05_006 crossref_primary_10_1016_j_janxdis_2020_102267 crossref_primary_10_1016_j_janxdis_2021_102446 crossref_primary_10_1016_j_brat_2024_104574 crossref_primary_10_2196_30915 crossref_primary_10_52734_NQME5457 crossref_primary_10_1016_j_jcbs_2021_05_005 crossref_primary_10_3390_su142013304 crossref_primary_10_1016_j_measurement_2024_114643 crossref_primary_10_1080_13218719_2020_1767712 crossref_primary_10_1007_s11065_021_09485_5 crossref_primary_10_1016_j_jclinepi_2019_05_001 crossref_primary_10_1038_s41598_022_14901_8 crossref_primary_10_3390_educsci15060728 crossref_primary_10_1016_j_neuroimage_2020_116678 crossref_primary_10_1080_13811118_2021_2022551 crossref_primary_10_1016_j_dcn_2024_101406 crossref_primary_10_1016_j_neuron_2024_12_008 crossref_primary_10_3758_s13428_023_02326_8 crossref_primary_10_1007_s10608_022_10347_4 crossref_primary_10_1016_j_psyneuen_2024_107265 crossref_primary_10_1111_eip_12891 crossref_primary_10_1016_j_physa_2023_128651 crossref_primary_10_1038_s41598_023_30803_9 crossref_primary_10_1111_jopy_12590 crossref_primary_10_1080_02640414_2024_2361598 crossref_primary_10_1016_j_neubiorev_2021_02_017 crossref_primary_10_1371_journal_pbio_3002797 crossref_primary_10_3389_fnsys_2021_675127 crossref_primary_10_2196_14424 crossref_primary_10_1080_14767430_2025_2503620 crossref_primary_10_1038_s41598_025_02368_2 crossref_primary_10_1017_S1754470X22000484 crossref_primary_10_1080_14763141_2022_2067075 crossref_primary_10_3389_fendo_2025_1529791 crossref_primary_10_1161_STROKEAHA_123_043164 crossref_primary_10_1007_s10865_020_00137_2 crossref_primary_10_1111_desc_13238 crossref_primary_10_1016_j_jbiomech_2021_110686 crossref_primary_10_1111_chso_12362 crossref_primary_10_1002_erv_3121 crossref_primary_10_1093_cercor_bhaa393 crossref_primary_10_3390_nu15071756 crossref_primary_10_1186_s12916_020_01740_5 crossref_primary_10_1080_17437199_2022_2112258 crossref_primary_10_1038_s41598_024_52163_8 crossref_primary_10_1177_17456916231190824 crossref_primary_10_1177_17456916231226308 crossref_primary_10_1177_01461672231203471 crossref_primary_10_1016_j_comppsych_2021_152226 crossref_primary_10_1136_bmjebm_2025_114167 crossref_primary_10_3758_s13428_025_02727_x crossref_primary_10_3389_fpsyt_2020_539777 crossref_primary_10_1017_S0033291722002161 crossref_primary_10_1038_s41598_023_45184_2 crossref_primary_10_3389_fpsyg_2018_02696 crossref_primary_10_3390_s23020966 crossref_primary_10_3233_JAD_210304 crossref_primary_10_1177_2167702619865969 crossref_primary_10_1007_s10608_024_10486_w crossref_primary_10_3389_fpsyg_2021_623970 crossref_primary_10_3390_s20123572 crossref_primary_10_1016_j_neuroimage_2022_118937 crossref_primary_10_1080_10508422_2025_2456714 crossref_primary_10_1016_j_jcte_2020_100219 crossref_primary_10_1162_jocn_a_01696 crossref_primary_10_1007_s00406_021_01282_8 crossref_primary_10_1186_s41687_020_00254_1 crossref_primary_10_1016_j_jbiomech_2023_111877 crossref_primary_10_1016_S1470_2045_21_00693_8 crossref_primary_10_1080_17482798_2024_2402272 crossref_primary_10_1177_08902070251358117 crossref_primary_10_1162_netn_a_00306 crossref_primary_10_1093_aje_kwae013 crossref_primary_10_1177_08902070211043023 crossref_primary_10_1016_j_jcbs_2021_12_002 crossref_primary_10_1192_j_eurpsy_2022_19 crossref_primary_10_1007_s11165_021_09997_3 crossref_primary_10_1080_00273171_2021_1896353 crossref_primary_10_1007_s10608_022_10323_y crossref_primary_10_1007_s11409_022_09305_y crossref_primary_10_3389_fnhum_2021_711279 crossref_primary_10_1002_per_2311 crossref_primary_10_1080_1047840X_2020_1853461 crossref_primary_10_1002_capr_12295 crossref_primary_10_1016_j_jad_2020_09_029 crossref_primary_10_1007_s10608_023_10350_3 crossref_primary_10_1111_jora_12618 crossref_primary_10_1080_21642850_2023_2167719 crossref_primary_10_1080_00224499_2021_1948491 crossref_primary_10_1002_da_23093 crossref_primary_10_1016_j_foodqual_2024_105175 crossref_primary_10_1016_j_chaos_2022_112568 crossref_primary_10_3389_fpsyt_2022_827406 crossref_primary_10_1002_per_2266 crossref_primary_10_1111_jsr_14467 crossref_primary_10_1016_j_apergo_2023_104161 crossref_primary_10_1002_cpp_3062 crossref_primary_10_1002_eat_24235 crossref_primary_10_1016_j_jadohealth_2021_09_033 crossref_primary_10_1111_pcn_13096 crossref_primary_10_1038_s41380_020_00884_3 crossref_primary_10_1111_jcpp_14060 crossref_primary_10_1177_09593543221131511 crossref_primary_10_1177_2167702618805513 crossref_primary_10_1007_s12671_023_02113_8 crossref_primary_10_1016_j_janxdis_2019_102144 crossref_primary_10_1111_jora_12871 crossref_primary_10_3390_app11041450 crossref_primary_10_1177_17456916231187324 crossref_primary_10_3390_brainsci15010037 crossref_primary_10_1016_j_isci_2024_109977 crossref_primary_10_1038_s41598_020_59490_6 crossref_primary_10_1080_00273171_2023_2229310 crossref_primary_10_1080_17439760_2022_2093785 crossref_primary_10_1177_21677026231196121 crossref_primary_10_3389_fpsyg_2020_02262 crossref_primary_10_1080_17437199_2022_2146598 crossref_primary_10_3389_fnbeh_2020_587152 crossref_primary_10_3390_ijerph19127131 crossref_primary_10_1002_ijop_13133 crossref_primary_10_1038_s41585_019_0210_6 crossref_primary_10_1016_j_jad_2024_05_139 crossref_primary_10_1080_10503307_2023_2297994 crossref_primary_10_1515_lingvan_2020_0026 crossref_primary_10_1007_s10459_025_10453_4 crossref_primary_10_3389_fams_2020_00009 crossref_primary_10_1007_s11136_023_03413_1 crossref_primary_10_1007_s11257_021_09313_8 crossref_primary_10_1177_2167702619859336 crossref_primary_10_1371_journal_pone_0236715 crossref_primary_10_1016_j_neubiorev_2025_106024 crossref_primary_10_1177_08902070241278020 crossref_primary_10_1002_jclp_23366 crossref_primary_10_1016_j_ijpsycho_2019_05_006 crossref_primary_10_1093_cercor_bhad527 crossref_primary_10_1111_sltb_12841 crossref_primary_10_1002_ejp_4781 crossref_primary_10_1016_j_cobeha_2025_101574 crossref_primary_10_1111_eip_13343 crossref_primary_10_1016_j_healthplace_2023_102972 crossref_primary_10_1080_0092623X_2021_1912868 crossref_primary_10_3389_fdgth_2022_964582 crossref_primary_10_1177_2167702620979775 crossref_primary_10_1016_j_jad_2019_08_060 crossref_primary_10_1177_1745691619895057 crossref_primary_10_1371_journal_pone_0306749 crossref_primary_10_1002_ejsc_70031 crossref_primary_10_1016_j_cogsys_2023_101199 crossref_primary_10_1016_j_neuroimage_2019_03_053 crossref_primary_10_1096_fj_202101628R crossref_primary_10_1016_j_jcrc_2020_10_006 crossref_primary_10_1017_S0033291723001368 crossref_primary_10_1007_s40279_019_01081_1 crossref_primary_10_1002_per_2239 crossref_primary_10_1177_21677026241301056 crossref_primary_10_1073_pnas_2411930122 crossref_primary_10_1016_j_sleep_2025_02_040 crossref_primary_10_1038_s44271_024_00062_z crossref_primary_10_1002_jaba_832 crossref_primary_10_1186_s12916_020_01662_2 crossref_primary_10_1080_17437199_2021_1987953 crossref_primary_10_1007_s42978_023_00240_1 crossref_primary_10_1177_1073191119873714 crossref_primary_10_1016_j_biopsych_2022_10_009 crossref_primary_10_1080_10503307_2024_2382429 crossref_primary_10_1111_tops_12501 crossref_primary_10_1093_tbm_ibaa026 crossref_primary_10_1038_s44159_022_00029_z crossref_primary_10_32872_cpe_11699 crossref_primary_10_1177_09593543221127985 crossref_primary_10_1093_schbul_sbac128 crossref_primary_10_1111_pere_12399 crossref_primary_10_1073_pnas_1818675116 crossref_primary_10_3389_fpsyg_2025_1622431 crossref_primary_10_1080_09602011_2023_2181191 crossref_primary_10_1177_2050157921993896 crossref_primary_10_1001_jama_2020_15648 crossref_primary_10_1007_s10111_020_00641_0 crossref_primary_10_1073_pnas_1818033116 crossref_primary_10_1111_bjet_13452 crossref_primary_10_1080_10503307_2022_2073289 crossref_primary_10_1016_j_csbj_2023_06_009 crossref_primary_10_1016_j_psyneuen_2023_106394 crossref_primary_10_1080_00273171_2025_2454901 crossref_primary_10_1002_wps_20805 crossref_primary_10_1038_s41598_024_58598_3 crossref_primary_10_1007_s40473_020_00215_4 crossref_primary_10_1002_per_2174 crossref_primary_10_1080_17439760_2021_2016912 crossref_primary_10_1177_01632787211067533 crossref_primary_10_2196_16105 crossref_primary_10_3389_fpsyg_2019_01635 crossref_primary_10_1177_21677026211017839 crossref_primary_10_1007_s10902_025_00876_6 crossref_primary_10_1080_10503307_2019_1676932 crossref_primary_10_1016_j_bpsc_2023_03_011 crossref_primary_10_4102_phcfm_v15i1_3680 crossref_primary_10_1177_21677026221101379 crossref_primary_10_1080_13552600_2024_2423677 crossref_primary_10_1080_15374416_2019_1666400 crossref_primary_10_3390_clockssleep2010003 crossref_primary_10_1016_j_copsyc_2019_07_041 crossref_primary_10_1073_pnas_1820221116 crossref_primary_10_1177_1073191120939161 crossref_primary_10_1192_bjp_2019_245 crossref_primary_10_1111_spc3_70058 crossref_primary_10_3390_jcm11102757 crossref_primary_10_1016_j_psc_2024_02_001 crossref_primary_10_1027_1016_9040_a000471 crossref_primary_10_1016_j_jcbs_2023_05_006 crossref_primary_10_1080_2372966X_2021_1919923 crossref_primary_10_3390_s22208016 crossref_primary_10_3390_nu15183967 crossref_primary_10_1016_j_neuroimage_2022_119666 crossref_primary_10_1007_s11031_021_09898_y crossref_primary_10_3389_fpsyg_2020_594675 crossref_primary_10_1162_netn_a_00387 crossref_primary_10_1177_09567976221093307 crossref_primary_10_1016_j_neuroimage_2021_118139 crossref_primary_10_3390_jcm13226727 crossref_primary_10_1126_science_adg8538 crossref_primary_10_1177_08897077231202836 crossref_primary_10_7554_eLife_70899 crossref_primary_10_1080_00223891_2019_1591426 crossref_primary_10_1016_j_beproc_2021_104448 crossref_primary_10_1080_10503307_2020_1805133 crossref_primary_10_1080_15213269_2022_2156886 crossref_primary_10_1002_mpr_1945 crossref_primary_10_1177_10790632221139165 crossref_primary_10_1177_10892680221093013 crossref_primary_10_1002_per_2278 crossref_primary_10_1016_j_jpsychores_2023_111195 crossref_primary_10_1016_j_tine_2024_100223 crossref_primary_10_1515_sjpain_2022_0157 crossref_primary_10_1080_10407413_2018_1554368 crossref_primary_10_1080_1612197X_2024_2344108 crossref_primary_10_1177_07334648251362020 crossref_primary_10_2196_50136 crossref_primary_10_3758_s13428_023_02298_9 crossref_primary_10_2196_10828 crossref_primary_10_32872_cpe_12419 crossref_primary_10_1080_17439760_2023_2169631 crossref_primary_10_1007_s11145_019_09962_7 crossref_primary_10_1016_j_beth_2022_08_005 crossref_primary_10_1016_j_apergo_2022_103763 crossref_primary_10_1016_j_jrp_2023_104428 crossref_primary_10_1016_j_bbi_2023_06_002 crossref_primary_10_3758_s13415_021_00922_9 crossref_primary_10_1007_s44202_022_00027_5 crossref_primary_10_1016_j_biopsych_2022_01_008 crossref_primary_10_1177_2167702618818433 crossref_primary_10_1007_s10608_020_10153_w crossref_primary_10_1007_s11121_024_01733_3 crossref_primary_10_1186_s12888_020_02674_1 crossref_primary_10_1080_00273171_2022_2128020 crossref_primary_10_1016_j_neuroimage_2018_09_057 crossref_primary_10_1016_j_brat_2022_104221 crossref_primary_10_1186_s12916_020_01727_2 crossref_primary_10_2196_44986 crossref_primary_10_1093_cercor_bhad348 crossref_primary_10_1038_s41598_019_39931_7 crossref_primary_10_1016_j_beth_2023_11_004 crossref_primary_10_3389_fcvm_2025_1527271 crossref_primary_10_1080_14740338_2019_1632832 crossref_primary_10_1111_bjop_12358 crossref_primary_10_1002_wps_20609 crossref_primary_10_1007_s10803_025_06780_5 crossref_primary_10_1016_j_jad_2021_10_034 crossref_primary_10_1177_01461672211043385 crossref_primary_10_1016_j_conctc_2022_101028 crossref_primary_10_1080_15374416_2020_1833337 crossref_primary_10_1007_s00106_025_01586_4 crossref_primary_10_3758_s13428_021_01701_7 crossref_primary_10_1093_schizbullopen_sgab047 crossref_primary_10_1111_bjhp_12744 crossref_primary_10_1016_j_dcn_2018_10_001 crossref_primary_10_1177_10596011241285662 crossref_primary_10_1007_s10608_024_10487_9 crossref_primary_10_1371_journal_pone_0217150 crossref_primary_10_1016_j_newideapsych_2022_100978 crossref_primary_10_1371_journal_pone_0207239 crossref_primary_10_1027_1015_5759_a000580 crossref_primary_10_1016_j_addbeh_2022_107381 crossref_primary_10_1016_j_tig_2020_01_004 crossref_primary_10_3758_s13414_023_02770_w crossref_primary_10_1016_j_jad_2021_08_064 crossref_primary_10_1002_eat_23882 crossref_primary_10_1016_j_janxdis_2022_102658 crossref_primary_10_1016_j_jpsychores_2021_110527 crossref_primary_10_1016_j_chb_2023_107977 crossref_primary_10_1093_cercor_bhae458 crossref_primary_10_1093_socpro_spaa030 crossref_primary_10_1016_j_csda_2024_108105 crossref_primary_10_1073_pnas_1820222116 crossref_primary_10_1016_j_jad_2019_04_005 crossref_primary_10_1177_00220221241230959 crossref_primary_10_1007_s11229_022_03517_0 crossref_primary_10_1080_15298868_2023_2246672 crossref_primary_10_1159_000541667 crossref_primary_10_1136_bmjopen_2024_089319 crossref_primary_10_1016_j_beth_2019_02_002 crossref_primary_10_1007_s40614_023_00388_9 crossref_primary_10_1192_bjo_2019_11 crossref_primary_10_1016_j_brat_2018_10_005 crossref_primary_10_1016_j_beth_2021_05_003 crossref_primary_10_1016_j_brat_2021_104012 crossref_primary_10_1016_j_schres_2021_11_018 crossref_primary_10_1080_20008066_2023_2179799 crossref_primary_10_2196_19201 crossref_primary_10_1016_j_brat_2021_104013 crossref_primary_10_1016_j_janxdis_2023_102822 crossref_primary_10_1177_0963721419869005 crossref_primary_10_1177_08902070211007666 crossref_primary_10_1016_j_jneumeth_2021_109138 crossref_primary_10_1002_ejp_2091 crossref_primary_10_1016_j_neuroimage_2025_121349 crossref_primary_10_1016_j_bbih_2025_100977 crossref_primary_10_1109_TNNLS_2022_3213581 crossref_primary_10_1186_s40345_022_00258_4 crossref_primary_10_1016_j_jdin_2024_07_015 crossref_primary_10_1007_s10608_025_10575_4 crossref_primary_10_1111_jopy_12924 crossref_primary_10_1016_j_brat_2023_104424 crossref_primary_10_1111_jopy_12805 crossref_primary_10_1080_15374416_2023_2286595 crossref_primary_10_1016_j_jpsychores_2020_110191 crossref_primary_10_1097_j_pain_0000000000001479 crossref_primary_10_1016_j_tics_2023_10_005 crossref_primary_10_1080_00273171_2024_2336178 crossref_primary_10_1177_08902070241301633 crossref_primary_10_1016_j_neuroimage_2023_120503 crossref_primary_10_1080_02699931_2022_2089871 crossref_primary_10_1016_j_jcbs_2024_100794 crossref_primary_10_1016_j_neubiorev_2023_105259 crossref_primary_10_1080_16506073_2023_2300369 crossref_primary_10_1016_j_neubiorev_2023_105137 crossref_primary_10_3389_fpsyt_2020_00175 crossref_primary_10_2196_14328 crossref_primary_10_1002_jad_12326 crossref_primary_10_1080_1750984X_2022_2039749 crossref_primary_10_1371_journal_pone_0251787 crossref_primary_10_1017_ehs_2021_44 crossref_primary_10_1192_j_eurpsy_2021_2217 crossref_primary_10_1017_S0954579422001493 crossref_primary_10_1016_j_neuroscience_2020_12_024 crossref_primary_10_1177_09593543211011663 crossref_primary_10_1177_21677026211002500 crossref_primary_10_1007_s10865_021_00247_5 crossref_primary_10_1007_s10488_024_01363_5 crossref_primary_10_1093_ageing_afae130 crossref_primary_10_3390_bs11050077 crossref_primary_10_1186_s12916_021_02179_y crossref_primary_10_1177_17456916211033284 crossref_primary_10_5964_meth_10863 crossref_primary_10_1016_j_jrp_2020_104055 crossref_primary_10_1057_s41599_021_00894_8 crossref_primary_10_3389_fpsyg_2025_1553028 crossref_primary_10_1016_j_jad_2022_05_019 crossref_primary_10_1038_s41598_021_04262_z crossref_primary_10_1007_s11336_020_09697_3 crossref_primary_10_1080_10503307_2023_2254467 crossref_primary_10_1093_pm_pnab265 crossref_primary_10_1017_S2045796020000153 crossref_primary_10_1177_20438087231152848 crossref_primary_10_1016_j_jpsychores_2020_110296 crossref_primary_10_1007_s12144_021_01668_w crossref_primary_10_1016_j_jpsychores_2020_110172 crossref_primary_10_1016_j_jpsychores_2020_110293 crossref_primary_10_1080_13642537_2021_1923049 crossref_primary_10_1186_s40359_023_01197_0 crossref_primary_10_1080_15402002_2025_2499136 crossref_primary_10_1352_1934_9556_59_5_369 crossref_primary_10_32872_cpe_10075 crossref_primary_10_1016_j_copsyc_2021_10_002 crossref_primary_10_1111_jpr_12595 crossref_primary_10_1080_09658211_2019_1679837 crossref_primary_10_1111_jcpp_13101 crossref_primary_10_1016_j_xjmad_2023_100043 crossref_primary_10_1016_j_brat_2020_103731 crossref_primary_10_2196_13253 crossref_primary_10_1016_j_jesp_2021_104182 crossref_primary_10_7705_biomedica_6946 crossref_primary_10_1093_beheco_arab113 crossref_primary_10_1007_s11682_020_00313_7 crossref_primary_10_1016_j_jad_2020_04_004 crossref_primary_10_1177_00221678251328088 crossref_primary_10_1007_s42761_022_00178_7 crossref_primary_10_1038_s41576_021_00348_6 crossref_primary_10_1016_j_abrep_2022_100443 crossref_primary_10_1016_j_cedpsych_2020_101857 crossref_primary_10_1016_j_jcbs_2022_05_006 crossref_primary_10_1177_2045125320932452 crossref_primary_10_3389_fpsyg_2020_564083 crossref_primary_10_1002_jeab_868 crossref_primary_10_1007_s10964_022_01679_1 crossref_primary_10_1007_s10802_020_00765_x crossref_primary_10_1111_jopy_12843 crossref_primary_10_1016_j_brat_2023_104462 crossref_primary_10_1016_j_socscimed_2024_117331 crossref_primary_10_1007_s11136_021_03008_8 crossref_primary_10_1016_j_paid_2019_04_018 crossref_primary_10_1016_j_jcbs_2025_100875 crossref_primary_10_2196_41513 crossref_primary_10_1016_j_jesp_2018_08_004 crossref_primary_10_1146_annurev_psych_020223_124335 crossref_primary_10_1016_j_erap_2023_100890 crossref_primary_10_1016_j_bbi_2023_08_018 crossref_primary_10_1027_1016_9040_a000555 crossref_primary_10_1080_00273171_2022_2155930 crossref_primary_10_4054_DemRes_2022_47_24 crossref_primary_10_1017_S0033291720000422 crossref_primary_10_1093_schbul_sbac038 crossref_primary_10_1038_s41398_024_02781_7 crossref_primary_10_1016_j_evolhumbehav_2019_05_007 crossref_primary_10_1016_j_cognition_2024_105781 crossref_primary_10_1016_j_schres_2020_05_019 crossref_primary_10_1177_00343552251355355 crossref_primary_10_3390_ijerph191710468 crossref_primary_10_1002_icd_2478 crossref_primary_10_3389_fpsyg_2021_799418 crossref_primary_10_1093_sleep_zsaa174 crossref_primary_10_1017_S0033291721001616 crossref_primary_10_1038_s41537_020_00115_2 crossref_primary_10_1111_cogs_13474 crossref_primary_10_1002_hbm_26587 crossref_primary_10_1177_09593543211008236 crossref_primary_10_1016_j_neuroimage_2022_119589 crossref_primary_10_1177_10731911221113563 crossref_primary_10_1111_cpsp_12288 crossref_primary_10_1186_s12902_019_0365_4 crossref_primary_10_1080_23311983_2024_2442818 crossref_primary_10_1016_j_nic_2019_09_003 crossref_primary_10_1176_appi_ajp_2019_19050521 crossref_primary_10_1002_wps_21086 crossref_primary_10_1080_20008198_2021_1956802 crossref_primary_10_1038_s41598_023_50960_1 crossref_primary_10_1080_13607863_2025_2514066 crossref_primary_10_1080_10503307_2018_1563312 crossref_primary_10_3389_fpsyt_2021_598317 crossref_primary_10_1016_j_neubiorev_2023_105237 crossref_primary_10_1016_j_cobeha_2018_09_003 crossref_primary_10_1007_s11031_020_09822_w crossref_primary_10_1111_jcpp_13545 crossref_primary_10_1007_s10862_020_09836_1 crossref_primary_10_1007_s11031_020_09844_4 crossref_primary_10_1080_00273171_2022_2135089 crossref_primary_10_1177_15586898231187527 crossref_primary_10_1186_s13034_025_00937_x crossref_primary_10_1080_10826084_2023_2257312 crossref_primary_10_1111_bjet_13309 crossref_primary_10_1002_jclp_22957 crossref_primary_10_1038_s41598_019_57220_1 crossref_primary_10_1111_psyp_13583 crossref_primary_10_7717_peerj_9290 crossref_primary_10_1177_14705958231155014 crossref_primary_10_1016_j_brat_2022_104155 crossref_primary_10_3389_fpsyt_2023_1179811 crossref_primary_10_1002_jts_22491 crossref_primary_10_1080_00273171_2025_2522733 crossref_primary_10_3389_fpsyg_2020_00782 crossref_primary_10_1177_21677026231205262 crossref_primary_10_1016_j_chiabu_2024_107117 crossref_primary_10_3389_fcomp_2021_774949 crossref_primary_10_1038_s44159_024_00369_y crossref_primary_10_1111_sltb_13025 |
| ContentType | Journal Article |
| DBID | CGR CUY CVF ECM EIF NPM 7X8 |
| DOI | 10.1073/pnas.1711978115 |
| DatabaseName | Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed MEDLINE - Academic |
| DatabaseTitle | MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) MEDLINE - Academic |
| DatabaseTitleList | MEDLINE - Academic MEDLINE |
| Database_xml | – sequence: 1 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database |
| DeliveryMethod | no_fulltext_linktorsrc |
| Discipline | Sciences (General) |
| EISSN | 1091-6490 |
| ExternalDocumentID | 29915059 |
| Genre | Randomized Controlled Trial Journal Article Research Support, N.I.H., Extramural |
| GroupedDBID | --- -DZ -~X .55 0R~ 123 29P 2AX 2FS 2WC 4.4 53G 5RE 5VS 85S AACGO AAFWJ AANCE ABBHK ABOCM ABPLY ABPPZ ABTLG ABXSQ ABZEH ACGOD ACHIC ACIWK ACNCT ACPRK ADQXQ ADULT AENEX AEUPB AEXZC AFFNX AFOSN AFRAH ALMA_UNASSIGNED_HOLDINGS AQVQM BKOMP CGR CS3 CUY CVF D0L DCCCD DIK DU5 E3Z EBS ECM EIF EJD F5P FRP GX1 H13 HH5 HYE IPSME JAAYA JBMMH JENOY JHFFW JKQEH JLS JLXEF JPM JSG JST KQ8 L7B LU7 N9A NPM N~3 O9- OK1 PNE PQQKQ R.V RHI RNA RNS RPM RXW SA0 SJN TAE TN5 UKR W8F WH7 WOQ WOW X7M XSW Y6R YBH YKV YSK ZCA ~02 ~KM 7X8 |
| ID | FETCH-LOGICAL-c4605-44ac17a617256ead493f70330cb3e02dce7e1526071261ae126140c4f17ed8f72 |
| IEDL.DBID | 7X8 |
| ISSN | 1091-6490 |
| IngestDate | Fri Sep 05 07:37:53 EDT 2025 Thu Apr 03 07:09:15 EDT 2025 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 27 |
| Keywords | generalizability idiographic science replicability ecological fallacy research methodology |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c4605-44ac17a617256ead493f70330cb3e02dce7e1526071261ae126140c4f17ed8f72 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 ObjectType-Undefined-3 |
| ORCID | 0000-0003-2826-4537 |
| OpenAccessLink | https://www.pnas.org/content/pnas/115/27/E6106.full.pdf |
| PMID | 29915059 |
| PQID | 2057114917 |
| PQPubID | 23479 |
| ParticipantIDs | proquest_miscellaneous_2057114917 pubmed_primary_29915059 |
| PublicationCentury | 2000 |
| PublicationDate | 2018-07-03 |
| PublicationDateYYYYMMDD | 2018-07-03 |
| PublicationDate_xml | – month: 07 year: 2018 text: 2018-07-03 day: 03 |
| PublicationDecade | 2010 |
| PublicationPlace | United States |
| PublicationPlace_xml | – name: United States |
| PublicationTitle | Proceedings of the National Academy of Sciences - PNAS |
| PublicationTitleAlternate | Proc Natl Acad Sci U S A |
| PublicationYear | 2018 |
| References | 30872469 - Proc Natl Acad Sci U S A. 2019 Apr 2;116(14):6540-6541. doi: 10.1073/pnas.1818675116 30872468 - Proc Natl Acad Sci U S A. 2019 Apr 2;116(14):6542-6543. doi: 10.1073/pnas.1820221116 30890639 - Proc Natl Acad Sci U S A. 2019 Apr 2;116(14):6546-6547. doi: 10.1073/pnas.1820222116 30890640 - Proc Natl Acad Sci U S A. 2019 Apr 2;116(14):6544-6545. doi: 10.1073/pnas.1818033116 |
| References_xml | – reference: 30890640 - Proc Natl Acad Sci U S A. 2019 Apr 2;116(14):6544-6545. doi: 10.1073/pnas.1818033116 – reference: 30872468 - Proc Natl Acad Sci U S A. 2019 Apr 2;116(14):6542-6543. doi: 10.1073/pnas.1820221116 – reference: 30872469 - Proc Natl Acad Sci U S A. 2019 Apr 2;116(14):6540-6541. doi: 10.1073/pnas.1818675116 – reference: 30890639 - Proc Natl Acad Sci U S A. 2019 Apr 2;116(14):6546-6547. doi: 10.1073/pnas.1820222116 |
| SSID | ssj0009580 |
| Score | 2.7025657 |
| Snippet | Only for ergodic processes will inferences based on group-level data generalize to individual experience or behavior. Because human social and psychological... |
| SourceID | proquest pubmed |
| SourceType | Aggregation Database Index Database |
| StartPage | E6106 |
| SubjectTerms | Anxiety Disorders - therapy Bipolar Disorder - therapy Female Humans Male Psychotherapy, Group |
| Title | Lack of group-to-individual generalizability is a threat to human subjects research |
| URI | https://www.ncbi.nlm.nih.gov/pubmed/29915059 https://www.proquest.com/docview/2057114917 |
| Volume | 115 |
| hasFullText | |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LS8QwEA7qevCirs_1RQQPeoimTdukJxFx8bAuCz7Y25KmibsI7Wq6gv_eSZtVL4LgJacWwjCZ-Sbf5BuEThJJ0zBhmog8DUkkwY0l4FbiODWT5UnOavb8qcf7fTEcpgN_4WZ9W-U8JtaBOi-VuyOHIj3mgN2huricvhI3Ncqxq36ExiJqMYAyzqv5UPwQ3RWNGkEakCRK6Vzah7OLaSHtecAdiSaCIP4dX9Z5prv23x2uo1WPMPFV4xJttKCLDdT2Z9jiUy80fbaJ7ntSveDS4PppB6lKMvl6noWfm89c05drn_3AE4slrsYOZOKqxPVwP2xnmbvIsdiLBo230GP35uH6lvghC0Q5SpREkVQBlw7IxAm4VZQyA1GAUZUxTcNcaa4hxzsZOii2pHZrRFVkAq5zYXi4jZaKstC7CPNMSGbAAkYryHlKSrCFpDQzeRyrhHbQ8dxwI3Bix0zIQpczO_o2XQftNNYfTRu1jRHkSwCtcbr3h7_30QoAGlG307ID1DJwhPUhWlbv1cS-HdXeAWt_cPcJL-3Dng |
| linkProvider | ProQuest |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Lack+of+group-to-individual+generalizability+is+a+threat+to+human+subjects+research&rft.jtitle=Proceedings+of+the+National+Academy+of+Sciences+-+PNAS&rft.au=Fisher%2C+Aaron+J&rft.au=Medaglia%2C+John+D&rft.au=Jeronimus%2C+Bertus+F&rft.date=2018-07-03&rft.eissn=1091-6490&rft.volume=115&rft.issue=27&rft.spage=E6106&rft_id=info:doi/10.1073%2Fpnas.1711978115&rft_id=info%3Apmid%2F29915059&rft_id=info%3Apmid%2F29915059&rft.externalDocID=29915059 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1091-6490&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1091-6490&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1091-6490&client=summon |