Strong claims and weak evidence: reassessing the predictive validity of the IAT
The authors reanalyzed data from 2 influential studies-A. R. McConnell and J. M. Leibold and J. C. Ziegert and P. J. Hanges-that explore links between implicit bias and discriminatory behavior and that have been invoked to support strong claims about the predictive validity of the Implicit Associati...
Saved in:
| Published in: | Journal of applied psychology Vol. 94; no. 3; p. 567 |
|---|---|
| Main Authors: | , , , , , |
| Format: | Journal Article |
| Language: | English |
| Published: |
United States
01.05.2009
|
| Subjects: | |
| ISSN: | 0021-9010 |
| Online Access: | Get more information |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | The authors reanalyzed data from 2 influential studies-A. R. McConnell and J. M. Leibold and J. C. Ziegert and P. J. Hanges-that explore links between implicit bias and discriminatory behavior and that have been invoked to support strong claims about the predictive validity of the Implicit Association Test. In both of these studies, the inclusion of race Implicit Association Test scores in regression models reduced prediction errors by only tiny amounts, and Implicit Association Test scores did not permit prediction of individual-level behaviors. Furthermore, the results were not robust when the impact of rater reliability, statistical specifications, and/or outliers were taken into account, and reanalysis of A. R. McConnell & J. M. Leibold (2001) revealed a pattern of behavior consistent with a pro-Black behavioral bias, rather than the anti-Black bias suggested in the original study. |
|---|---|
| AbstractList | The authors reanalyzed data from 2 influential studies-A. R. McConnell and J. M. Leibold and J. C. Ziegert and P. J. Hanges-that explore links between implicit bias and discriminatory behavior and that have been invoked to support strong claims about the predictive validity of the Implicit Association Test. In both of these studies, the inclusion of race Implicit Association Test scores in regression models reduced prediction errors by only tiny amounts, and Implicit Association Test scores did not permit prediction of individual-level behaviors. Furthermore, the results were not robust when the impact of rater reliability, statistical specifications, and/or outliers were taken into account, and reanalysis of A. R. McConnell & J. M. Leibold (2001) revealed a pattern of behavior consistent with a pro-Black behavioral bias, rather than the anti-Black bias suggested in the original study.The authors reanalyzed data from 2 influential studies-A. R. McConnell and J. M. Leibold and J. C. Ziegert and P. J. Hanges-that explore links between implicit bias and discriminatory behavior and that have been invoked to support strong claims about the predictive validity of the Implicit Association Test. In both of these studies, the inclusion of race Implicit Association Test scores in regression models reduced prediction errors by only tiny amounts, and Implicit Association Test scores did not permit prediction of individual-level behaviors. Furthermore, the results were not robust when the impact of rater reliability, statistical specifications, and/or outliers were taken into account, and reanalysis of A. R. McConnell & J. M. Leibold (2001) revealed a pattern of behavior consistent with a pro-Black behavioral bias, rather than the anti-Black bias suggested in the original study. The authors reanalyzed data from 2 influential studies-A. R. McConnell and J. M. Leibold and J. C. Ziegert and P. J. Hanges-that explore links between implicit bias and discriminatory behavior and that have been invoked to support strong claims about the predictive validity of the Implicit Association Test. In both of these studies, the inclusion of race Implicit Association Test scores in regression models reduced prediction errors by only tiny amounts, and Implicit Association Test scores did not permit prediction of individual-level behaviors. Furthermore, the results were not robust when the impact of rater reliability, statistical specifications, and/or outliers were taken into account, and reanalysis of A. R. McConnell & J. M. Leibold (2001) revealed a pattern of behavior consistent with a pro-Black behavioral bias, rather than the anti-Black bias suggested in the original study. |
| Author | Jaccard, James Tetlock, Philip E Mellers, Barbara Mitchell, Gregory Blanton, Hart Klick, Jonathan |
| Author_xml | – sequence: 1 givenname: Hart surname: Blanton fullname: Blanton, Hart organization: Department of Psychology, Texas A&M University, USA – sequence: 2 givenname: James surname: Jaccard fullname: Jaccard, James – sequence: 3 givenname: Jonathan surname: Klick fullname: Klick, Jonathan – sequence: 4 givenname: Barbara surname: Mellers fullname: Mellers, Barbara – sequence: 5 givenname: Gregory surname: Mitchell fullname: Mitchell, Gregory – sequence: 6 givenname: Philip E surname: Tetlock fullname: Tetlock, Philip E |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/19449998$$D View this record in MEDLINE/PubMed |
| BookMark | eNo1kLtOwzAYRj0U0QtIPAHyxBbwNbHZqopCpUodKHPk2L_BkBtxEtS3p0CZvuEcneGbo0nd1IDQFSW3lPDszhBCRZrKCZoRwmiiCSVTNI_x_QdwTc7RlGohtNZqhnbPfdfUr9iWJlQRm9rhLzAfGMbgoLZwjzswMUKM4Wj1b4DbDlywfRgBj6YMLvQH3PhftFnuL9CZN2WEy9Mu0Mv6Yb96Sra7x81quU2MTFmfWM65A1pI4pyySqXEKPBWSGc9kdwba1kG3DHGubCFt8qLzBVSFZkWjmZsgW7-um3XfA4Q-7wK0UJZmhqaIeZpxiRLOT-K1ydxKCpweduFynSH_P8C9g2qSVy7 |
| CitedBy_id | crossref_primary_10_1080_19317611_2014_957795 crossref_primary_10_3390_appliedmath5030114 crossref_primary_10_1371_journal_pone_0083915 crossref_primary_10_7717_peerj_18900 crossref_primary_10_1002_hfm_20264 crossref_primary_10_1080_09515089_2017_1363881 crossref_primary_10_1080_1047840X_2022_2106762 crossref_primary_10_1016_j_jacr_2020_06_028 crossref_primary_10_1093_scan_nsab106 crossref_primary_10_1080_01434632_2023_2226647 crossref_primary_10_1111_j_1751_2409_2011_01037_x crossref_primary_10_1080_17437199_2014_959728 crossref_primary_10_1016_j_eatbeh_2021_101498 crossref_primary_10_1177_1065912920911100 crossref_primary_10_1016_j_jmp_2016_11_001 crossref_primary_10_1111_jasp_12724 crossref_primary_10_1609_aimag_v40i3_2866 crossref_primary_10_1027_1618_3169_a000051 crossref_primary_10_1177_01492063241237225 crossref_primary_10_1080_2194587X_2020_1781657 crossref_primary_10_1016_j_socscimed_2018_03_018 crossref_primary_10_1016_j_actpsy_2025_104746 crossref_primary_10_1016_j_ssresearch_2022_102775 crossref_primary_10_1016_j_tate_2022_103826 crossref_primary_10_1017_nps_2021_79 crossref_primary_10_1016_j_socnet_2025_05_006 crossref_primary_10_3389_fphy_2022_879171 crossref_primary_10_63466_jci05010003 crossref_primary_10_3390_informatics8010014 crossref_primary_10_1080_10410236_2018_1481709 crossref_primary_10_3390_informatics9020030 crossref_primary_10_1111_cpsp_12312 crossref_primary_10_1093_isagsq_ksac021 crossref_primary_10_1080_1047840X_2022_2106753 crossref_primary_10_1016_j_jesp_2009_10_011 crossref_primary_10_1007_s11406_017_9877_1 crossref_primary_10_1177_2372732220983840 crossref_primary_10_1080_01973533_2023_2251636 crossref_primary_10_1111_sjop_12288 crossref_primary_10_1515_sem_2017_0138 crossref_primary_10_1016_j_newideapsych_2021_100879 crossref_primary_10_1515_sem_2015_0109 crossref_primary_10_1177_1745691620904080 crossref_primary_10_1287_mnsc_2021_4035 crossref_primary_10_3389_fpsyg_2023_1197298 crossref_primary_10_1177_15248380231174695 crossref_primary_10_3390_e21121195 crossref_primary_10_1016_j_lingua_2020_103027 crossref_primary_10_1093_qje_qjz008 crossref_primary_10_1186_s12913_023_09261_6 crossref_primary_10_3389_fphar_2021_633565 crossref_primary_10_1007_s12144_024_06994_3 crossref_primary_10_1080_16066359_2022_2123474 crossref_primary_10_1177_1088868314544693 crossref_primary_10_2139_ssrn_5221211 crossref_primary_10_1016_j_im_2018_10_009 crossref_primary_10_1002_mar_20630 crossref_primary_10_1097_CORR_0000000000002905 crossref_primary_10_1007_s12160_012_9443_9 crossref_primary_10_1080_20445911_2025_2499192 crossref_primary_10_1371_journal_pone_0198094 crossref_primary_10_1177_1094428112442750 crossref_primary_10_1371_journal_pone_0190640 crossref_primary_10_1007_s11199_012_0154_2 crossref_primary_10_1080_00131946_2023_2280640 crossref_primary_10_1177_27550311231167366 crossref_primary_10_1002_wcs_1602 crossref_primary_10_1016_j_jesp_2015_10_003 crossref_primary_10_1146_annurev_soc_33_040406_131632 crossref_primary_10_1027_2151_2604_a000335 crossref_primary_10_1177_0261927X17718349 crossref_primary_10_1515_ijsl_2019_2051 crossref_primary_10_1080_00224545_2020_1779640 crossref_primary_10_1111_jasp_12317 crossref_primary_10_3390_e25091323 crossref_primary_10_1016_j_appet_2023_107098 crossref_primary_10_1371_journal_pone_0242189 crossref_primary_10_1371_journal_pone_0226938 crossref_primary_10_1016_j_neuropsychologia_2025_109068 crossref_primary_10_1017_S0140525X21000017 crossref_primary_10_1080_15213269_2015_1008102 crossref_primary_10_1016_j_dhjo_2021_101150 crossref_primary_10_1007_s11406_020_00263_w crossref_primary_10_3390_e22111227 crossref_primary_10_1111_j_1464_0597_2012_00487_x crossref_primary_10_1111_pops_12967 crossref_primary_10_1136_bmjopen_2023_081723 crossref_primary_10_3390_e24091308 crossref_primary_10_5334_spo_77 crossref_primary_10_1007_s40596_020_01370_2 crossref_primary_10_1016_j_schres_2010_07_021 crossref_primary_10_1080_1047840X_2020_1722600 crossref_primary_10_1146_annurev_clinpsy_121208_131444 crossref_primary_10_1017_cts_2021_834 crossref_primary_10_1016_j_peh_2014_08_003 crossref_primary_10_5465_amr_34_4_zok586 crossref_primary_10_1007_s10699_019_09632_5 crossref_primary_10_3389_fphy_2023_1150796 crossref_primary_10_1007_s12160_009_9118_3 crossref_primary_10_1177_08862605221123300 crossref_primary_10_1007_s11245_025_10213_4 crossref_primary_10_5210_bsi_v24i0_5496 crossref_primary_10_1111_apps_12166 crossref_primary_10_2466_07_09_17_PR0_111_5_424_442 crossref_primary_10_3758_s13428_024_02594_y crossref_primary_10_1371_journal_pone_0234032 crossref_primary_10_1093_infdis_jiz214 crossref_primary_10_1108_ET_12_2024_0568 crossref_primary_10_3102_0002831216682223 crossref_primary_10_3390_soc10040082 crossref_primary_10_1080_19488289_2015_1123203 crossref_primary_10_1177_0146167214536928 crossref_primary_10_1080_08927936_2018_1434045 crossref_primary_10_1108_BFJ_09_2018_0588 crossref_primary_10_1002_job_2834 crossref_primary_10_1016_j_jesp_2012_06_003 crossref_primary_10_1017_S1049096520000505 crossref_primary_10_1093_heapol_czaa190 crossref_primary_10_1257_aer_20191184 crossref_primary_10_1007_s10578_021_01269_5 crossref_primary_10_1177_0261927X241287189 crossref_primary_10_1016_j_ijhcs_2024_103443 crossref_primary_10_1109_ACCESS_2024_3521279 crossref_primary_10_1038_s41562_021_01280_9 crossref_primary_10_1146_annurev_lawsocsci_111622_063213 crossref_primary_10_1016_j_jesp_2022_104331 crossref_primary_10_1177_0033294118776928 crossref_primary_10_1177_01461672231171256 crossref_primary_10_1177_1094428112470848 crossref_primary_10_1177_0013916518808571 crossref_primary_10_1080_10967494_2018_1471013 crossref_primary_10_3390_knowledge4030019 crossref_primary_10_1080_15564886_2021_1925796 crossref_primary_10_1177_10892680241289574 crossref_primary_10_3389_fpsyg_2020_01068 crossref_primary_10_1002_ijop_12439 crossref_primary_10_1097_CORR_0000000000002933 crossref_primary_10_1016_j_socscimed_2017_05_009 crossref_primary_10_1177_1745691616659391 crossref_primary_10_3390_nu16193373 crossref_primary_10_1080_15309576_2018_1526093 crossref_primary_10_1007_s11199_023_01381_x crossref_primary_10_1521_bumc_2016_80_3_255 crossref_primary_10_3390_bs8090079 crossref_primary_10_1111_ijmr_12003 crossref_primary_10_1002_berj_4096 crossref_primary_10_1080_1047840X_2017_1373550 crossref_primary_10_1097_SLA_0000000000006604 crossref_primary_10_1080_00224545_2023_2195992 crossref_primary_10_1371_journal_pone_0077552 crossref_primary_10_1016_j_hrmr_2012_12_004 crossref_primary_10_1257_aer_20181805 |
| ContentType | Journal Article |
| Copyright | (c) 2009 APA, all rights reserved. |
| Copyright_xml | – notice: (c) 2009 APA, all rights reserved. |
| DBID | CGR CUY CVF ECM EIF NPM 7X8 |
| DOI | 10.1037/a0014665 |
| DatabaseName | Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed MEDLINE - Academic |
| DatabaseTitle | MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) MEDLINE - Academic |
| DatabaseTitleList | MEDLINE - Academic MEDLINE |
| Database_xml | – sequence: 1 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database |
| DeliveryMethod | no_fulltext_linktorsrc |
| Discipline | Psychology |
| ExternalDocumentID | 19449998 |
| Genre | Comment Journal Article |
| GroupedDBID | --- --Z -DZ -ET -~X .-4 ..I .GJ 0R~ 186 1CY 1OL 29J 2KS 354 3EH 41~ 53G 5GY 5RE 5VS 6TJ 7RZ 85S 8VB 9M8 AAAHA AAIKC AAMNW AAWTL ABCQX ABDPE ABIVO ABNCP ABPPZ ABVOZ ACCUC ACGFO ACHQT ACNCT ACPQG ACTDY ADMHG ADXHL AEHFB AEMOZ AETEA AFFNX AHQJS AI. AIDAL AKVCP ALEEW ALMA_UNASSIGNED_HOLDINGS ASUFR AWKKM AZXWR CGNQK CGR CS3 CUY CVF DU5 EBR EBU ECM EIF EMK EPA F5P FTD HVGLF HZ~ H~9 ISO K1G L7B LPU LW5 MVM NHB NPM O9- OHT OMK OPA OVD P-O P2P PHGZM PHGZT PQQKQ QWB QZG ROL RXW SES SKT SPA TAE TEORI TH9 TN5 TWZ U5U UBC UHB UHS ULE UPT VH1 WH7 XJT XOL XZL YK4 YQT YR5 YYP YYQ YZZ ZCA ZCG ZGI ZHY ZL0 ZPI ZXP ZY4 ~A~ 3KI 7X8 ABUFD AFFHD |
| ID | FETCH-LOGICAL-a562t-c333de1b50dd8c8860a8efc45dcf053facc27e3d22334cbfc8f47db58b794d172 |
| IEDL.DBID | 7X8 |
| ISICitedReferencesCount | 204 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000265954700001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0021-9010 |
| IngestDate | Sun Nov 09 09:39:04 EST 2025 Mon Jul 21 05:34:51 EDT 2025 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 3 |
| Language | English |
| License | (c) 2009 APA, all rights reserved. |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-a562t-c333de1b50dd8c8860a8efc45dcf053facc27e3d22334cbfc8f47db58b794d172 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 ObjectType-Commentary-3 content type line 23 |
| OpenAccessLink | https://papers.ssrn.com/sol3/Delivery.cfm/SSRN_ID2571017_code711466.pdf?abstractid=2559156&mirid=1 |
| PMID | 19449998 |
| PQID | 67252633 |
| PQPubID | 23479 |
| ParticipantIDs | proquest_miscellaneous_67252633 pubmed_primary_19449998 |
| PublicationCentury | 2000 |
| PublicationDate | 2009-May 20090501 |
| PublicationDateYYYYMMDD | 2009-05-01 |
| PublicationDate_xml | – month: 05 year: 2009 text: 2009-May |
| PublicationDecade | 2000 |
| PublicationPlace | United States |
| PublicationPlace_xml | – name: United States |
| PublicationTitle | Journal of applied psychology |
| PublicationTitleAlternate | J Appl Psychol |
| PublicationYear | 2009 |
| References | 15910149 - J Appl Psychol. 2005 May;90(3):553-62 |
| References_xml | – reference: 15910149 - J Appl Psychol. 2005 May;90(3):553-62 |
| SSID | ssj0014390 |
| Score | 2.434366 |
| Snippet | The authors reanalyzed data from 2 influential studies-A. R. McConnell and J. M. Leibold and J. C. Ziegert and P. J. Hanges-that explore links between implicit... |
| SourceID | proquest pubmed |
| SourceType | Aggregation Database Index Database |
| StartPage | 567 |
| SubjectTerms | Adult African Continental Ancestry Group - psychology Bias European Continental Ancestry Group - psychology Female Humans Interpersonal Relations Job Application Judgment Male Nonverbal Communication Observer Variation Prejudice Psychometrics - statistics & numerical data Race Relations Reproducibility of Results Unconscious (Psychology) Word Association Tests - statistics & numerical data |
| Title | Strong claims and weak evidence: reassessing the predictive validity of the IAT |
| URI | https://www.ncbi.nlm.nih.gov/pubmed/19449998 https://www.proquest.com/docview/67252633 |
| Volume | 94 |
| WOSCitedRecordID | wos000265954700001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LSwMxEB6q9dCL70d95uB16Xazm82KIEUUBa0FK_S2JJNEirpb26r47032oSfx4GUvYSEMM_N9yTeTATgWTPFEUuFZMPLtAUUKT6DpelIlRggWmAiLRuGbuN_no1EyaMBp3QvjyirrnFgkapWjuyPvsDiIAkbp2eTVczOjnLZaDdBYgCa1RMb5dDz60RAs1JYNKFURQv30LI07wi0zFv1OKwt4uVz538ZWYbmilaRX-sEaNHS2Dq3v7Pa5AXf37tL7keCzGL_MiMgU-dDiiehqrOgJceXpTgG2YEYsLSSTqRNxXDok1h3HyvJ1kpti6bo33ISHy4vh-ZVXTVPwhOU4cw8ppUp3ZeQrxZFz5guuDYaRQmMj0QjEINZUWb5AQ5QGuQljJSMubcgqy3O2YDHLM70DBH3lJw7642LQbyBYl3OkhnOZoI-mDUe1qVLrrU6CEJnO32Zpbaw2bJfWTifloxppNwnd4Yvv_vnvHrRKScdVHe5D09g41QewhO_z8Wx6WDiB_fYHt1_z5L3A |
| linkProvider | ProQuest |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Strong+claims+and+weak+evidence%3A+reassessing+the+predictive+validity+of+the+IAT&rft.jtitle=Journal+of+applied+psychology&rft.au=Blanton%2C+Hart&rft.au=Jaccard%2C+James&rft.au=Klick%2C+Jonathan&rft.au=Mellers%2C+Barbara&rft.date=2009-05-01&rft.issn=0021-9010&rft.volume=94&rft.issue=3&rft.spage=567&rft_id=info:doi/10.1037%2Fa0014665&rft_id=info%3Apmid%2F19449998&rft_id=info%3Apmid%2F19449998&rft.externalDocID=19449998 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0021-9010&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0021-9010&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0021-9010&client=summon |