An external stability audit framework to test the validity of personality prediction in AI hiring

Automated hiring systems are among the fastest-developing of all high-stakes AI systems. Among these are algorithmic personality tests that use insights from psychometric testing, and promise to surface personality traits indicative of future success based on job seekers’ resumes or social media pro...

Celý popis

Uloženo v:

Podrobná bibliografie
Vydáno v:	Data mining and knowledge discovery Ročník 36; číslo 6; s. 2153 - 2193
Hlavní autoři:	Rhea, Alene K., Markey, Kelsey, D’Arinzo, Lauren, Schellmann, Hilke, Sloane, Mona, Squires, Paul, Arif Khan, Falaah, Stoyanovich, Julia
Médium:	Journal Article
Jazyk:	angličtina
Vydáno:	New York Springer US 01.11.2022 Springer Nature B.V
Témata:	Algorithms Artificial Intelligence Audits Chemistry and Earth Sciences Computer Science Data Mining and Knowledge Discovery Information Storage and Retrieval Personality Personality tests Personality traits Physics Psychological tests Quantitative psychology Reliability aspects Special Issue on Bias and Fairness Stability Statistics for Engineering Validity Hiring Validity Personality Stability Reliability Algorithm Audit
ISSN:	1384-5810, 1573-756X
On-line přístup:	Získat plný text
Tagy:	Přidat tag Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!

Abstract	Automated hiring systems are among the fastest-developing of all high-stakes AI systems. Among these are algorithmic personality tests that use insights from psychometric testing, and promise to surface personality traits indicative of future success based on job seekers’ resumes or social media profiles. We interrogate the validity of such systems using stability of the outputs they produce, noting that reliability is a necessary, but not a sufficient, condition for validity. Crucially, rather than challenging or affirming the assumptions made in psychometric testing — that personality is a meaningful and measurable construct, and that personality traits are indicative of future success on the job — we frame our audit methodology around testing the underlying assumptions made by the vendors of the algorithmic personality tests themselves. Our main contribution is the development of a socio-technical framework for auditing the stability of algorithmic systems. This contribution is supplemented with an open-source software library that implements the technical components of the audit, and can be used to conduct similar stability audits of algorithmic systems. We instantiate our framework with the audit of two real-world personality prediction systems, namely, Humantic AI and Crystal. The application of our audit framework demonstrates that both these systems show substantial instability with respect to key facets of measurement, and hence cannot be considered valid testing instruments.
AbstractList	Automated hiring systems are among the fastest-developing of all high-stakes AI systems. Among these are algorithmic personality tests that use insights from psychometric testing, and promise to surface personality traits indicative of future success based on job seekers’ resumes or social media profiles. We interrogate the validity of such systems using stability of the outputs they produce, noting that reliability is a necessary, but not a sufficient, condition for validity. Crucially, rather than challenging or affirming the assumptions made in psychometric testing — that personality is a meaningful and measurable construct, and that personality traits are indicative of future success on the job — we frame our audit methodology around testing the underlying assumptions made by the vendors of the algorithmic personality tests themselves. Our main contribution is the development of a socio-technical framework for auditing the stability of algorithmic systems. This contribution is supplemented with an open-source software library that implements the technical components of the audit, and can be used to conduct similar stability audits of algorithmic systems. We instantiate our framework with the audit of two real-world personality prediction systems, namely, Humantic AI and Crystal. The application of our audit framework demonstrates that both these systems show substantial instability with respect to key facets of measurement, and hence cannot be considered valid testing instruments. Automated hiring systems are among the fastest-developing of all high-stakes AI systems. Among these are algorithmic personality tests that use insights from psychometric testing, and promise to surface personality traits indicative of future success based on job seekers' resumes or social media profiles. We interrogate the validity of such systems using stability of the outputs they produce, noting that reliability is a necessary, but not a sufficient, condition for validity. Crucially, rather than challenging or affirming the assumptions made in psychometric testing - that personality is a meaningful and measurable construct, and that personality traits are indicative of future success on the job - we frame our audit methodology around testing the underlying assumptions made by the vendors of the algorithmic personality tests themselves. Our main contribution is the development of a socio-technical framework for auditing the stability of algorithmic systems. This contribution is supplemented with an open-source software library that implements the technical components of the audit, and can be used to conduct similar stability audits of algorithmic systems. We instantiate our framework with the audit of two real-world personality prediction systems, namely, Humantic AI and Crystal. The application of our audit framework demonstrates that both these systems show substantial instability with respect to key facets of measurement, and hence cannot be considered valid testing instruments.Automated hiring systems are among the fastest-developing of all high-stakes AI systems. Among these are algorithmic personality tests that use insights from psychometric testing, and promise to surface personality traits indicative of future success based on job seekers' resumes or social media profiles. We interrogate the validity of such systems using stability of the outputs they produce, noting that reliability is a necessary, but not a sufficient, condition for validity. Crucially, rather than challenging or affirming the assumptions made in psychometric testing - that personality is a meaningful and measurable construct, and that personality traits are indicative of future success on the job - we frame our audit methodology around testing the underlying assumptions made by the vendors of the algorithmic personality tests themselves. Our main contribution is the development of a socio-technical framework for auditing the stability of algorithmic systems. This contribution is supplemented with an open-source software library that implements the technical components of the audit, and can be used to conduct similar stability audits of algorithmic systems. We instantiate our framework with the audit of two real-world personality prediction systems, namely, Humantic AI and Crystal. The application of our audit framework demonstrates that both these systems show substantial instability with respect to key facets of measurement, and hence cannot be considered valid testing instruments.
Author	Markey, Kelsey Sloane, Mona Schellmann, Hilke Rhea, Alene K. D’Arinzo, Lauren Arif Khan, Falaah Squires, Paul Stoyanovich, Julia
Author_xml	– sequence: 1 givenname: Alene K. orcidid: 0000-0001-5284-2064 surname: Rhea fullname: Rhea, Alene K. organization: Center for Data Science, New York University, Center for Responsible AI, Tandon School of Engineering, New York University – sequence: 2 givenname: Kelsey orcidid: 0000-0003-1151-2952 surname: Markey fullname: Markey, Kelsey organization: Center for Data Science, New York University, Center for Responsible AI, Tandon School of Engineering, New York University – sequence: 3 givenname: Lauren orcidid: 0000-0001-6452-9032 surname: D’Arinzo fullname: D’Arinzo, Lauren organization: Center for Data Science, New York University, Center for Responsible AI, Tandon School of Engineering, New York University, The MITRE Corporation – sequence: 4 givenname: Hilke surname: Schellmann fullname: Schellmann, Hilke organization: Arthur L. Carter Journalism Institute, New York University – sequence: 5 givenname: Mona orcidid: 0000-0003-1049-2267 surname: Sloane fullname: Sloane, Mona organization: Center for Responsible AI, Tandon School of Engineering, New York University – sequence: 6 givenname: Paul surname: Squires fullname: Squires, Paul organization: Department of Psychology, Arts & Science, New York University – sequence: 7 givenname: Falaah orcidid: 0000-0002-4678-5929 surname: Arif Khan fullname: Arif Khan, Falaah organization: Center for Data Science, New York University, Center for Responsible AI, Tandon School of Engineering, New York University – sequence: 8 givenname: Julia orcidid: 0000-0002-1587-0450 surname: Stoyanovich fullname: Stoyanovich, Julia email: stoyanovich@nyu.edu organization: Center for Data Science, New York University, Center for Responsible AI, Tandon School of Engineering, New York University, Computer Science & Engineering, Tandon School of Engineering
BackLink	https://www.ncbi.nlm.nih.gov/pubmed/36161238$$D View this record in MEDLINE/PubMed
BookMark	eNp9kUtv3CAUhVGVqHm0f6CLCqmbbNxejA14U2kUpWmkSN2kUneIwdcZUg-4gNPm3xdnkj6yyAoQ3zk6954jsueDR0LeMHjPAOSHxEAwVUFdVwBKsApekEPWSl7JVnzbK3eumqpVDA7IUUo3ANDWHF6SAy6YYDVXh8SsPMVfGaM3I03ZrN3o8h01c-8yHaLZ4s8Qv9McaMaUad4gvTWj6xcoDHTCmEKRLs8pYu9sdsFT5-nqgm5cdP76FdkfzJjw9cN5TL5-Ors6_Vxdfjm_OF1dVraRTa5MySn7rl-jkAxwzYRoFOOMd0IqqWyLXWNhsFa2NWsb5GLgbdc3A5dFaBg_Jh93vtO83mJv0edoRj1FtzXxTgfj9P8_3m30dbjVXaN4I1QxOHkwiOHHXKbVW5csjqPxGOaka8mU4C0wWdB3T9CbMC8rXCguOg61EIV6-2-iP1Eet18AtQNsDClFHLR12SwbLAHdqBnopWi9K1qXovV90RqKtH4ifXR_VsR3ojQtzWD8G_sZ1W_F57qt
CitedBy_id	crossref_primary_10_1007_s40797_025_00322_9 crossref_primary_10_1007_s00146_023_01783_1 crossref_primary_10_1145_3696457 crossref_primary_10_1016_j_chbr_2025_100777 crossref_primary_10_1016_j_compbiomed_2025_110154 crossref_primary_10_1177_20539517241235872 crossref_primary_10_1016_j_ijforecast_2024_08_001 crossref_primary_10_3389_fpsyg_2023_1219865
Cites_doi	10.1145/3449148 10.1111/j.1744-6570.2007.00089.x 10.1037/hop0000081 10.1515/popets-2015-0007 10.1108/IJCED-12-2016-0023 10.1145/3274417 10.1007/BF00993473 10.1007/s41055-017-0020-6 10.1111/j.1745-3984.1976.tb00003.x 10.1017/iop.2016.6 10.1007/s40685-020-00134-w 10.1177/2053951720983865 10.1177/009102600803700107 10.1037/0021-9010.85.6.869 10.1007/s11023-020-09517-8 10.1016/j.envsoft.2020.104954 10.1145/3419764 10.1080/02701367.1993.10608821 10.1023/A:1022941331649 10.1016/j.patter.2021.100425 10.1093/aje/kwy250 10.1037/1082-989X.8.2.206 10.3917/hori.005.0017 10.1007/s11948-021-00319-4 10.1016/j.ecolind.2016.04.014 10.1038/d41586-020-01812-9 10.1007/s13524-012-0151-7 10.1017/iop.2015.40 10.1037/0021-9010.75.5.581 10.1145/3351095.3372873 10.1145/3442188.3445935 10.1111/j.2517-6161.1995.tb02031.x 10.1145/3375627.3375812 10.2139/ssrn.3518482 10.1145/3287560.3287572 10.1016/j.futures.2019.06.008 10.4324/9781315755649-29 10.4135/9781412985642 10.1111/j.1744-6570.1965.tb00273.x 10.1111/j.1744-6570.1984.tb00519.x 10.1145/2998181.2998327 10.1145/3442188.3445928 10.2139/ssrn.3927300 10.1145/3461702.3462602 10.2139/ssrn.3723046 10.1109/SP.2018.00014 10.1037/e686432011-001 10.1145/3351095.3372828 10.1145/3173574.3174225
ContentType	Journal Article
Copyright	The Author(s) 2022 The Author(s) 2022. The Author(s) 2022. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Copyright_xml	– notice: The Author(s) 2022 – notice: The Author(s) 2022. – notice: The Author(s) 2022. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
DBID	C6C AAYXX CITATION NPM 3V. 7SC 7WY 7WZ 7XB 87Z 8AL 8AO 8FD 8FE 8FG 8FK 8FL 8G5 ABUWG AFKRA ARAPS AZQEC BENPR BEZIV BGLVJ CCPQU DWQXO FRNLG F~G GNUQQ GUQSH HCIFZ JQ2 K60 K6~ K7- L.- L7M L~C L~D M0C M0N M2O MBDVC P5Z P62 PHGZM PHGZT PKEHL PQBIZ PQBZA PQEST PQGLB PQQKQ PQUKI Q9U 7X8 5PM
DOI	10.1007/s10618-022-00861-0
DatabaseName	Springer Nature OA Free Journals CrossRef PubMed ProQuest Central (Corporate) Computer and Information Systems Abstracts ABI/INFORM Collection ABI/INFORM Global (PDF only) ProQuest Central (purchase pre-March 2016) ABI/INFORM Collection Computing Database (Alumni Edition) ProQuest Pharma Collection Technology Research Database ProQuest SciTech Collection ProQuest Technology Collection ProQuest Central (Alumni) (purchase pre-March 2016) ABI/INFORM Collection (Alumni) Research Library ProQuest Central (Alumni) ProQuest Central UK/Ireland ProQuest Advanced Technologies & Computer Science Collection ProQuest Central Essentials ProQuest One Academic Business Premium Collection Technology collection ProQuest One Community College ProQuest Central Business Premium Collection (Alumni) ABI/INFORM Global (Corporate) ProQuest Central Student Research Library Prep SciTech Premium Collection ProQuest Computer Science Collection ProQuest Business Collection (Alumni Edition) ProQuest Business Collection ProQuest Computer Science Database ABI/INFORM Professional Advanced Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional ABI/INFORM Global Computing Database Research Library (Proquest) Research Library (Corporate) Advanced Technologies & Aerospace Database ProQuest Advanced Technologies & Aerospace Collection ProQuest Central Premium ProQuest One Academic ProQuest One Academic Middle East (New) ProQuest One Business (UW System Shared) ProQuest One Business (Alumni) ProQuest One Academic Eastern Edition (DO NOT USE) One Applied & Life Sciences ProQuest One Academic (retired) ProQuest One Academic UKI Edition ProQuest Central Basic MEDLINE - Academic PubMed Central (Full Participant titles)
DatabaseTitle	CrossRef PubMed ABI/INFORM Global (Corporate) ProQuest Business Collection (Alumni Edition) ProQuest One Business Research Library Prep Computer Science Database ProQuest Central Student Technology Collection Technology Research Database Computer and Information Systems Abstracts – Academic ProQuest One Academic Middle East (New) ProQuest Advanced Technologies & Aerospace Collection ProQuest Central Essentials ProQuest Computer Science Collection Computer and Information Systems Abstracts ProQuest Central (Alumni Edition) SciTech Premium Collection ProQuest One Community College Research Library (Alumni Edition) ProQuest Pharma Collection ABI/INFORM Complete ProQuest Central ABI/INFORM Professional Advanced ProQuest One Applied & Life Sciences ProQuest Central Korea ProQuest Research Library ProQuest Central (New) Advanced Technologies Database with Aerospace ABI/INFORM Complete (Alumni Edition) Advanced Technologies & Aerospace Collection Business Premium Collection ABI/INFORM Global ProQuest Computing ABI/INFORM Global (Alumni Edition) ProQuest Central Basic ProQuest Computing (Alumni Edition) ProQuest One Academic Eastern Edition ProQuest Technology Collection ProQuest SciTech Collection ProQuest Business Collection Computer and Information Systems Abstracts Professional Advanced Technologies & Aerospace Database ProQuest One Academic UKI Edition ProQuest One Business (Alumni) ProQuest One Academic ProQuest One Academic (New) ProQuest Central (Alumni) Business Premium Collection (Alumni) MEDLINE - Academic
DatabaseTitleList	ABI/INFORM Global (Corporate) MEDLINE - Academic CrossRef PubMed
Database_xml	– sequence: 1 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: BENPR name: ProQuest One Academic url: https://www.proquest.com/central sourceTypes: Aggregation Database
DeliveryMethod	fulltext_linktorsrc
Discipline	Physics Computer Science
EISSN	1573-756X
EndPage	2193
ExternalDocumentID	PMC9483468 36161238 10_1007_s10618_022_00861_0
Genre	Journal Article
GrantInformation_xml	– fundername: National Science Foundation grantid: 1916505 funderid: http://dx.doi.org/10.13039/100000001 – fundername: NYU Center for the Humanities Digital Humanities Seed Grant – fundername: National Science Foundation grantid: 1934464; 1922658 funderid: http://dx.doi.org/10.13039/100000001 – fundername: Underwriters Laboratories grantid: CASMI seed grant funderid: http://dx.doi.org/10.13039/100018295 – fundername: ; – fundername: ; grantid: 1934464; 1922658 – fundername: ; grantid: CASMI seed grant – fundername: ; grantid: 1916505
GroupedDBID	-59 -5G -BR -EM -Y2 -~C .4S .86 .DC .VR 06D 0R~ 0VY 199 1N0 1SB 203 29F 2J2 2JN 2JY 2KG 2KM 2LR 2P1 2VQ 2~H 30V 3V. 4.4 406 408 409 40D 40E 5GY 5VS 67Z 6NX 78A 7WY 8AO 8FE 8FG 8FL 8G5 8TC 8UJ 95- 95. 95~ 96X AABHQ AACDK AAHNG AAIAL AAJBT AAJKR AANZL AARHV AARTL AASML AATNV AATVU AAUYE AAWCG AAYIU AAYQN AAYTO AAYZH ABAKF ABBBX ABBXA ABDZT ABECU ABFTD ABFTV ABHLI ABHQN ABJNI ABJOX ABKCH ABKTR ABMNI ABMQK ABNWP ABQBU ABQSL ABSXP ABTEG ABTHY ABTKH ABTMW ABULA ABUWG ABWNU ABXPI ACAOD ACBXY ACDTI ACGFS ACHSB ACHXU ACKNC ACMDZ ACMLO ACOKC ACOMO ACPIV ACSNA ACZOJ ADHHG ADHIR ADINQ ADKNI ADKPE ADRFC ADTPH ADURQ ADYFF ADZKW AEBTG AEFQL AEGAL AEGNC AEJHL AEJRE AEKMD AEMSY AENEX AEOHA AEPYU AESKC AETLH AEVLU AEXYK AFBBN AFGCZ AFKRA AFLOW AFQWF AFWTZ AFZKB AGAYW AGDGC AGGDS AGJBK AGMZJ AGQEE AGQMX AGRTI AGWIL AGWZB AGYKE AHAVH AHBYD AHKAY AHSBF AHYZX AIAKS AIGIU AIIXL AILAN AITGF AJBLW AJRNO AJZVZ ALMA_UNASSIGNED_HOLDINGS ALWAN AMKLP AMXSW AMYLF AMYQR AOCGG ARAPS ARCSS ARMRJ ASPBG AVWKF AXYYD AYJHY AZFZN AZQEC B-. BA0 BDATZ BENPR BEZIV BGLVJ BGNMA BPHCQ BSONS C6C CAG CCPQU COF CS3 CSCUP DDRTE DL5 DNIVK DPUIP DU5 DWQXO EBLON EBS EDO EIOEI EJD ESBYG F5P FEDTE FERAY FFXSO FIGPU FINBP FNLPD FRNLG FRRFC FSGXE FWDCC GGCAI GGRSB GJIRD GNUQQ GNWQR GQ6 GQ7 GQ8 GROUPED_ABI_INFORM_COMPLETE GUQSH GXS H13 HCIFZ HF~ HG5 HG6 HMJXF HQYDN HRMNR HVGLF HZ~ I-F I09 IHE IJ- IKXTQ ITM IWAJR IXC IZIGR IZQ I~X J-C J0Z J9A JBSCW JCJTX JZLTJ K60 K6V K6~ K7- KDC KOV LAK LLZTM M0C M0N M2O M4Y MA- N2Q NB0 NPVJJ NQJWS NU0 O9- O93 O9J OAM OVD P2P P62 P9O PF0 PQBIZ PQBZA PQQKQ PROAC PT4 PT5 Q2X QOS R89 R9I RNI RNS ROL RPX RSV RZC RZE RZK S16 S1Z S27 S3B SAP SCO SDH SHX SISQX SJYHP SNE SNPRN SNX SOHCF SOJ SPISZ SRMVM SSLCW STPWE SZN T13 TEORI TSG TSK TSV TUC TUS U2A UG4 UOJIU UTJUX UZXMN VC2 VFIZW W23 W48 WK8 YLTOR Z45 Z7R Z7S Z7W Z7X Z7Y Z7Z Z81 Z83 Z88 ZMTXR AAPKM AAYXX ABBRH ABDBE ABFSG ABRTQ ACSTC ADHKG ADKFA AEZWR AFDZB AFFHD AFHIU AFOHR AGQPQ AHPBZ AHWEU AIXLP AMVHM ATHPR AYFIA CITATION PHGZM PHGZT PQGLB NPM 7SC 7XB 8AL 8FD 8FK JQ2 L.- L7M L~C L~D MBDVC PKEHL PQEST PQUKI Q9U 7X8 PUEGO 5PM
ID	FETCH-LOGICAL-c474t-a5817d9dbe6710eb166481313967878c5e94c0fcc752154e36f359d4f37817a13
IEDL.DBID	K7-
ISICitedReferencesCount	12
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000854864900003&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	1384-5810
IngestDate	Tue Nov 04 02:06:59 EST 2025 Fri Sep 05 12:54:59 EDT 2025 Wed Nov 26 14:52:36 EST 2025 Mon Jul 21 06:07:56 EDT 2025 Tue Nov 18 21:31:31 EST 2025 Sat Nov 29 01:44:27 EST 2025 Fri Feb 21 02:44:35 EST 2025
IsDoiOpenAccess	true
IsOpenAccess	true
IsPeerReviewed	true
IsScholarly	true
Issue	6
Keywords	Hiring Validity Personality Stability Reliability Algorithm Audit
Language	English
License	The Author(s) 2022. Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c474t-a5817d9dbe6710eb166481313967878c5e94c0fcc752154e36f359d4f37817a13
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 content type line 23 Responsible editor: Toon Calders.
ORCID	0000-0001-6452-9032 0000-0001-5284-2064 0000-0002-1587-0450 0000-0003-1151-2952 0000-0003-1049-2267 0000-0002-4678-5929
OpenAccessLink	https://link.springer.com/10.1007/s10618-022-00861-0
PMID	36161238
PQID	2736930266
PQPubID	43030
PageCount	41
ParticipantIDs	pubmedcentral_primary_oai_pubmedcentral_nih_gov_9483468 proquest_miscellaneous_2718635017 proquest_journals_2736930266 pubmed_primary_36161238 crossref_citationtrail_10_1007_s10618_022_00861_0 crossref_primary_10_1007_s10618_022_00861_0 springer_journals_10_1007_s10618_022_00861_0
PublicationCentury	2000
PublicationDate	2022-11-01
PublicationDateYYYYMMDD	2022-11-01
PublicationDate_xml	– month: 11 year: 2022 text: 2022-11-01 day: 01
PublicationDecade	2020
PublicationPlace	New York
PublicationPlace_xml	– name: New York – name: United States
PublicationTitle	Data mining and knowledge discovery
PublicationTitleAbbrev	Data Min Knowl Disc
PublicationTitleAlternate	Data Min Knowl Discov
PublicationYear	2022
Publisher	Springer US Springer Nature B.V
Publisher_xml	– name: Springer US – name: Springer Nature B.V
References	Hough, Eaton, Dunnette, Kamp, McCloy (CR29) 1990; 75 Bogen, Rieke (CR8) 2018 Kim (CR32) 2017; 58 CR39 CR38 CR36 CR35 CR76 CR75 CR74 Galli, Giampietro, Goldfinger, Lazarus, Lin, Saltelli, Wackernagel, Müller (CR22) 2016; 69 CR73 CR72 Sloane, Moss, Chowdhury (CR65) 2022; 3 Kelly-Lyth (CR31) 2020 Saltelli, Bammer, Bruno, Charters, Di Fiore, Didier, Nelson Espeland, Kay, Lo Piano, Mayo, Pielke, Portaluri, Porter, Puy, Rafols, Ravetz, Reinert, Sarewitz, Stark, Stirling, van der Sluijs, Vineis (CR53) 2020; 582 VanderWeele, Mathur (CR71) 2019; 188 Datta, Tschantz, Datta (CR16) 2015; 2015 Hurtz, Donovan (CR30) 2000; 85 Lussier (CR37) 2018; 21 Scroggins, Thomas, Morris (CR61) 2008; 37 Koshiyama, Kazim, Treleaven, Rai, Szpruch, Pavey, Ahamat, Leutner, Goebel, Knight, Adams, Hitrova, Barnett, Nachev, Barber, Chamorro-Premuzic, Klemmer, Gregorovic, Khan, Lomas (CR34) 2021 Barocas, Selbst (CR4) 2016; 671 CR49 CR48 CR47 Benjamini, Hochberg (CR6) 1995; 57 CR46 CR44 CR42 Blau, Brummund, Liu (CR7) 2013; 50 Mökander, Morley, Taddeo, Floridi (CR43) 2021; 27 Nunnally, Bernstein (CR45) 1994 Robertson, Jiang, Joseph, Friedland, Lazer, Wilson (CR52) 2018; 2 Araujo, Saltelli, Schnepf (CR2) 2017; 19 CR19 Shneiderman (CR63) 2020; 10 CR17 Turney (CR70) 1995; 20 Bendick (CR5) 2007; 5 CR15 CR59 CR14 CR57 CR12 CR56 CR55 CR10 Cardinet, Tourneur, Allal (CR11) 1976; 13 CR51 Morgeson, Campion, Dipboye, Hollenbeck, Murphy, Schmitt (CR40) 2007; 60 Emre (CR18) 2018 Bandy (CR3) 2021; 5 Brown, Davidovic, Hasan (CR9) 2021; 8 Morrow, Jackson (CR41) 1993; 64 CR28 CR27 Guzzo, Fink, King, Tonidandel, Landis (CR25) 2015; 8 Ajunwa (CR1) 2021; 34 CR69 CR24 CR68 Chamorro-Premuzic, Winsborough, Sherman, Hogan (CR13) 2016; 9 Hagendorff (CR26) 2020; 30 CR67 CR66 CR21 Köchling, Wehner (CR33) 2020; 13 CR20 CR64 Goodstein, Lanyon (CR23) 1999; 13 CR62 Saltelli, Lo Piano (CR54) 2017; 1 CR60 Razavi, Jakeman, Saltelli, Prieur, Iooss, Borgonovo, Plischke, Lo Piano, Iwanaga, Becker, Tarantola, Guillaume, Jakeman, Gupta, Melillo, Rabitti, Chabridon, Duan, Sun, Smith, Sheikholeslami, Hosseini, Asadzadeh, Puy, Kucherenko, Maier (CR50) 2021; 137 Schmidt, Le, Ilies (CR58) 2003; 8 B Shneiderman (861_CR63) 2020; 10 P Turney (861_CR70) 1995; 20 RE Robertson (861_CR52) 2018; 2 861_CR27 Y Benjamini (861_CR6) 1995; 57 861_CR28 LM Hough (861_CR29) 1990; 75 861_CR76 A Köchling (861_CR33) 2020; 13 861_CR74 T Chamorro-Premuzic (861_CR13) 2016; 9 861_CR75 861_CR36 GM Hurtz (861_CR30) 2000; 85 861_CR35 S Razavi (861_CR50) 2021; 137 A Kelly-Lyth (861_CR31) 2020 FD Blau (861_CR7) 2013; 50 861_CR72 861_CR73 A Galli (861_CR22) 2016; 69 PT Kim (861_CR32) 2017; 58 FP Morgeson (861_CR40) 2007; 60 M Bogen (861_CR8) 2018 861_CR38 LD Goodstein (861_CR23) 1999; 13 861_CR39 861_CR44 861_CR42 861_CR47 861_CR48 A Koshiyama (861_CR34) 2021 K Lussier (861_CR37) 2018; 21 861_CR46 A Saltelli (861_CR53) 2020; 582 A Saltelli (861_CR54) 2017; 1 TJ VanderWeele (861_CR71) 2019; 188 861_CR49 M Bendick (861_CR5) 2007; 5 FL Schmidt (861_CR58) 2003; 8 J Bandy (861_CR3) 2021; 5 861_CR10 J Mökander (861_CR43) 2021; 27 861_CR55 WA Scroggins (861_CR61) 2008; 37 861_CR14 861_CR15 861_CR59 S Barocas (861_CR4) 2016; 671 J Cardinet (861_CR11) 1976; 13 861_CR12 861_CR56 861_CR57 L Araujo (861_CR2) 2017; 19 JR Morrow (861_CR41) 1993; 64 JC Nunnally (861_CR45) 1994 I Ajunwa (861_CR1) 2021; 34 T Hagendorff (861_CR26) 2020; 30 861_CR51 S Brown (861_CR9) 2021; 8 M Emre (861_CR18) 2018 M Sloane (861_CR65) 2022; 3 861_CR19 A Datta (861_CR16) 2015; 2015 861_CR17 861_CR21 861_CR66 861_CR20 861_CR64 861_CR69 861_CR67 861_CR24 861_CR68 RA Guzzo (861_CR25) 2015; 8 861_CR62 861_CR60
References_xml	– volume: 5 start-page: 1 issue: CSCW1 year: 2021 end-page: 34 ident: CR3 article-title: Problematic machine behavior: A systematic literature review of algorithm audits publication-title: Proc. ACM Hum. Comput. Interact. doi: 10.1145/3449148 – volume: 60 start-page: 683 issue: 3 year: 2007 end-page: 729 ident: CR40 article-title: Reconsidering the use of personality tests in personnel selection contexts publication-title: Pers Psychol doi: 10.1111/j.1744-6570.2007.00089.x – volume: 21 start-page: 79 issue: 2 year: 2018 ident: CR37 article-title: Temperamental workers: Psychology, business, and the Humm-Wadsworth Temperament Scale in interwar America publication-title: Hist Psychol doi: 10.1037/hop0000081 – ident: CR49 – ident: CR68 – ident: CR74 – ident: CR39 – year: 2021 ident: CR34 publication-title: Towards Algorithm Auditing: A Survey on Managing Legal, Ethical and Technological Risks of AI – ident: CR51 – ident: CR12 – volume: 2015 start-page: 92 issue: 1 year: 2015 end-page: 112 ident: CR16 article-title: Automated Experiments on Ad Privacy Settings: A Tale of Opacity, Choice, and Discrimination publication-title: Proc Privacy Enhancing Technol doi: 10.1515/popets-2015-0007 – volume: 19 start-page: 20 issue: 1 year: 2017 end-page: 34 ident: CR2 article-title: Do PISA data justify PISA-based education policy? publication-title: Inter J Comparative Educ Dev doi: 10.1108/IJCED-12-2016-0023 – ident: CR35 – volume: 2 start-page: 1 issue: CSCW year: 2018 end-page: 22 ident: CR52 article-title: Auditing Partisan Audience Bias within Google Search publication-title: Proc ACM Human-Comput Interaction doi: 10.1145/3274417 – ident: CR42 – year: 2018 ident: CR8 publication-title: Help Wanted: An Exploration of Hiring Algorithms – ident: CR21 – ident: CR46 – ident: CR19 – volume: 20 start-page: 23 issue: 1–2 year: 1995 end-page: 33 ident: CR70 article-title: Technical note: Bias and the quantification of stability publication-title: Mach Learn doi: 10.1007/BF00993473 – volume: 671 start-page: 671 issue: 104 year: 2016 end-page: 732 ident: CR4 article-title: Big Data’s Disparate Impact publication-title: Calif Law Rev – volume: 1 start-page: 173 issue: 2 year: 2017 end-page: 179 ident: CR54 article-title: Problematic Quantifications: a Critical Appraisal of Scenario Making for a Global Sustainable Food Production publication-title: Food Ethics doi: 10.1007/s41055-017-0020-6 – ident: CR67 – ident: CR75 – volume: 13 start-page: 119 issue: 2 year: 1976 end-page: 135 ident: CR11 article-title: The Symmetry of Generalizability Theory: Applications to Educational Measurement publication-title: J Educ Meas doi: 10.1111/j.1745-3984.1976.tb00003.x – ident: CR15 – volume: 9 start-page: 621 issue: 3 year: 2016 end-page: 640 ident: CR13 article-title: New Talent Signals: Shiny New Objects or a Brave New World? publication-title: Ind Organ Psychol doi: 10.1017/iop.2016.6 – volume: 58 start-page: 81 year: 2017 ident: CR32 article-title: Data-Driven Discrimination at Work publication-title: William & Mary Law – volume: 13 start-page: 795 issue: 3 year: 2020 end-page: 848 ident: CR33 article-title: Discriminated by an algorithm: A systematic review of discrimination and fairness by algorithmic decision-making in the context of hr recruitment and hr development publication-title: Bus Res doi: 10.1007/s40685-020-00134-w – volume: 8 start-page: 1 issue: 1 year: 2021 end-page: 8 ident: CR9 article-title: The algorithm audit: Scoring the algorithms that score us publication-title: Big Data Soc doi: 10.1177/2053951720983865 – ident: CR57 – ident: CR60 – ident: CR36 – volume: 37 start-page: 99 issue: 1 year: 2008 end-page: 109 ident: CR61 article-title: Psychological Testing in Personnel Selection, Part I: A Century of Psychological Testing publication-title: Public Personnel Manag doi: 10.1177/009102600803700107 – volume: 85 start-page: 869 issue: 6 year: 2000 end-page: 879 ident: CR30 article-title: Personality and job performance: The Big Five revisited publication-title: J Appl Psychol doi: 10.1037/0021-9010.85.6.869 – ident: CR64 – volume: 30 start-page: 99 issue: 1 year: 2020 end-page: 120 ident: CR26 article-title: The Ethics of AI Ethics: An Evaluation of Guidelines publication-title: Mind Mach doi: 10.1007/s11023-020-09517-8 – volume: 137 year: 2021 ident: CR50 article-title: The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support publication-title: Environ Model Software doi: 10.1016/j.envsoft.2020.104954 – volume: 10 start-page: 1 issue: 4 year: 2020 end-page: 31 ident: CR63 article-title: Bridging the Gap Between Ethics and Practice: Guidelines for Reliable, Safe, and Trustworthy Human-centered AI Systems publication-title: ACM Trans Interactive Intell Syst doi: 10.1145/3419764 – volume: 64 start-page: 352 issue: 3 year: 1993 end-page: 355 ident: CR41 article-title: How Significant is Your Reliability? publication-title: Res Q Exerc Sport doi: 10.1080/02701367.1993.10608821 – ident: CR66 – volume: 13 start-page: 32 issue: 3 year: 1999 ident: CR23 article-title: Applications of Personality Assessment to the Workplace: A Review publication-title: J Bus Psychol doi: 10.1023/A:1022941331649 – ident: CR47 – volume: 3 issue: 2 year: 2022 ident: CR65 article-title: A silicon valley love triangle: Hiring algorithms, pseudo-science, and the quest for auditability publication-title: Patterns doi: 10.1016/j.patter.2021.100425 – ident: CR72 – volume: 57 start-page: 289 issue: 1 year: 1995 end-page: 300 ident: CR6 article-title: Controlling the false discovery rate: A practical and powerful approach to multiple testing publication-title: J Roy Stat Soc: Ser B (Methodol) – ident: CR14 – volume: 34 start-page: 80 issue: 2 year: 2021 ident: CR1 article-title: An Auditing Imperative for Automated Hiring Systems publication-title: Harvard J Law & Tech – year: 2020 ident: CR31 publication-title: Challenging Biased Hiring Algorithms. SSRN Scholarly Paper ID 3744248 – volume: 188 start-page: 617 issue: 3 year: 2019 end-page: 618 ident: CR71 article-title: Some desirable properties of the Bonferroni correction: Is the Bonferroni correction really so bad? publication-title: Am J Epidemiol doi: 10.1093/aje/kwy250 – ident: CR10 – ident: CR56 – volume: 8 start-page: 206 issue: 2 year: 2003 ident: CR58 article-title: Beyond alpha: An empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual-differences constructs publication-title: Psychol Methods doi: 10.1037/1082-989X.8.2.206 – ident: CR27 – year: 1994 ident: CR45 publication-title: Psychometric Theory – volume: 5 start-page: 17 issue: 3 year: 2007 end-page: 39 ident: CR5 article-title: Situation Testing for Employment Discrimination in the United States of America publication-title: Horizons strategiques doi: 10.3917/hori.005.0017 – ident: CR69 – ident: CR44 – volume: 27 start-page: 44 issue: 4 year: 2021 ident: CR43 article-title: Ethics-Based Auditing of Automated Decision-Making Systems: Nature, Scope, and Limitations publication-title: Sci Eng Ethics doi: 10.1007/s11948-021-00319-4 – volume: 69 start-page: 224 year: 2016 end-page: 232 ident: CR22 article-title: Questioning the Ecological Footprint publication-title: Ecol Ind doi: 10.1016/j.ecolind.2016.04.014 – ident: CR48 – ident: CR73 – ident: CR38 – ident: CR17 – year: 2018 ident: CR18 publication-title: The Personality Brokers: The Strange History of Myers-Briggs and the Birth of Personality Testing – volume: 582 start-page: 482 issue: 7813 year: 2020 end-page: 484 ident: CR53 article-title: Five ways to ensure that models serve society: a manifesto publication-title: Nature doi: 10.1038/d41586-020-01812-9 – volume: 50 start-page: 471 issue: 2 year: 2013 end-page: 494 ident: CR7 article-title: Trends in Occupational Segregation by Gender 1970–2009: Adjusting for the Impact of Changes in the Occupational Coding System publication-title: Demography doi: 10.1007/s13524-012-0151-7 – volume: 8 start-page: 491 issue: 4 year: 2015 end-page: 508 ident: CR25 article-title: Big Data Recommendations for Industrial-Organizational Psychology publication-title: Ind Organ Psychol doi: 10.1017/iop.2015.40 – ident: CR55 – ident: CR59 – ident: CR76 – volume: 75 start-page: 581 issue: 5 year: 1990 end-page: 595 ident: CR29 article-title: Criterion-related validities of personality constructs and the effect of response distortion on those validities publication-title: J Appl Psychol doi: 10.1037/0021-9010.75.5.581 – ident: CR28 – ident: CR62 – ident: CR24 – ident: CR20 – ident: 861_CR49 doi: 10.1145/3351095.3372873 – ident: 861_CR39 doi: 10.1145/3442188.3445935 – volume: 58 start-page: 81 year: 2017 ident: 861_CR32 publication-title: William & Mary Law – volume: 57 start-page: 289 issue: 1 year: 1995 ident: 861_CR6 publication-title: J Roy Stat Soc: Ser B (Methodol) doi: 10.1111/j.2517-6161.1995.tb02031.x – ident: 861_CR62 doi: 10.1145/3375627.3375812 – ident: 861_CR21 doi: 10.2139/ssrn.3518482 – ident: 861_CR46 – ident: 861_CR17 doi: 10.1145/3287560.3287572 – volume: 8 start-page: 206 issue: 2 year: 2003 ident: 861_CR58 publication-title: Psychol Methods doi: 10.1037/1082-989X.8.2.206 – ident: 861_CR74 – ident: 861_CR69 – ident: 861_CR55 – volume: 75 start-page: 581 issue: 5 year: 1990 ident: 861_CR29 publication-title: J Appl Psychol doi: 10.1037/0021-9010.75.5.581 – volume: 671 start-page: 671 issue: 104 year: 2016 ident: 861_CR4 publication-title: Calif Law Rev – ident: 861_CR51 – volume: 3 issue: 2 year: 2022 ident: 861_CR65 publication-title: Patterns doi: 10.1016/j.patter.2021.100425 – volume: 19 start-page: 20 issue: 1 year: 2017 ident: 861_CR2 publication-title: Inter J Comparative Educ Dev doi: 10.1108/IJCED-12-2016-0023 – ident: 861_CR10 – ident: 861_CR36 doi: 10.1016/j.futures.2019.06.008 – volume-title: Help Wanted: An Exploration of Hiring Algorithms year: 2018 ident: 861_CR8 – volume-title: The Personality Brokers: The Strange History of Myers-Briggs and the Birth of Personality Testing year: 2018 ident: 861_CR18 – volume: 85 start-page: 869 issue: 6 year: 2000 ident: 861_CR30 publication-title: J Appl Psychol doi: 10.1037/0021-9010.85.6.869 – volume: 10 start-page: 1 issue: 4 year: 2020 ident: 861_CR63 publication-title: ACM Trans Interactive Intell Syst doi: 10.1145/3419764 – ident: 861_CR20 – ident: 861_CR42 doi: 10.4324/9781315755649-29 – ident: 861_CR12 doi: 10.4135/9781412985642 – volume: 8 start-page: 1 issue: 1 year: 2021 ident: 861_CR9 publication-title: Big Data Soc doi: 10.1177/2053951720983865 – ident: 861_CR24 doi: 10.1111/j.1744-6570.1965.tb00273.x – volume: 137 year: 2021 ident: 861_CR50 publication-title: Environ Model Software doi: 10.1016/j.envsoft.2020.104954 – volume: 188 start-page: 617 issue: 3 year: 2019 ident: 861_CR71 publication-title: Am J Epidemiol doi: 10.1093/aje/kwy250 – ident: 861_CR56 – ident: 861_CR59 doi: 10.1111/j.1744-6570.1984.tb00519.x – volume: 13 start-page: 119 issue: 2 year: 1976 ident: 861_CR11 publication-title: J Educ Meas doi: 10.1111/j.1745-3984.1976.tb00003.x – volume: 30 start-page: 99 issue: 1 year: 2020 ident: 861_CR26 publication-title: Mind Mach doi: 10.1007/s11023-020-09517-8 – ident: 861_CR27 doi: 10.1145/2998181.2998327 – volume: 2 start-page: 1 issue: CSCW year: 2018 ident: 861_CR52 publication-title: Proc ACM Human-Comput Interaction doi: 10.1145/3274417 – ident: 861_CR38 – volume: 37 start-page: 99 issue: 1 year: 2008 ident: 861_CR61 publication-title: Public Personnel Manag doi: 10.1177/009102600803700107 – volume: 20 start-page: 23 issue: 1–2 year: 1995 ident: 861_CR70 publication-title: Mach Learn doi: 10.1007/BF00993473 – volume: 50 start-page: 471 issue: 2 year: 2013 ident: 861_CR7 publication-title: Demography doi: 10.1007/s13524-012-0151-7 – ident: 861_CR67 – volume: 5 start-page: 1 issue: CSCW1 year: 2021 ident: 861_CR3 publication-title: Proc. ACM Hum. Comput. Interact. doi: 10.1145/3449148 – volume: 64 start-page: 352 issue: 3 year: 1993 ident: 861_CR41 publication-title: Res Q Exerc Sport doi: 10.1080/02701367.1993.10608821 – ident: 861_CR44 – volume-title: Towards Algorithm Auditing: A Survey on Managing Legal, Ethical and Technological Risks of AI year: 2021 ident: 861_CR34 – volume: 34 start-page: 80 issue: 2 year: 2021 ident: 861_CR1 publication-title: Harvard J Law & Tech – ident: 861_CR75 doi: 10.1145/3442188.3445928 – ident: 861_CR72 – ident: 861_CR66 doi: 10.2139/ssrn.3927300 – ident: 861_CR68 doi: 10.1145/3461702.3462602 – ident: 861_CR76 – volume: 8 start-page: 491 issue: 4 year: 2015 ident: 861_CR25 publication-title: Ind Organ Psychol doi: 10.1017/iop.2015.40 – ident: 861_CR57 – ident: 861_CR15 – ident: 861_CR35 doi: 10.2139/ssrn.3723046 – ident: 861_CR19 – volume: 1 start-page: 173 issue: 2 year: 2017 ident: 861_CR54 publication-title: Food Ethics doi: 10.1007/s41055-017-0020-6 – volume: 69 start-page: 224 year: 2016 ident: 861_CR22 publication-title: Ecol Ind doi: 10.1016/j.ecolind.2016.04.014 – volume: 5 start-page: 17 issue: 3 year: 2007 ident: 861_CR5 publication-title: Horizons strategiques doi: 10.3917/hori.005.0017 – volume: 13 start-page: 795 issue: 3 year: 2020 ident: 861_CR33 publication-title: Bus Res doi: 10.1007/s40685-020-00134-w – volume: 2015 start-page: 92 issue: 1 year: 2015 ident: 861_CR16 publication-title: Proc Privacy Enhancing Technol doi: 10.1515/popets-2015-0007 – volume: 27 start-page: 44 issue: 4 year: 2021 ident: 861_CR43 publication-title: Sci Eng Ethics doi: 10.1007/s11948-021-00319-4 – volume: 9 start-page: 621 issue: 3 year: 2016 ident: 861_CR13 publication-title: Ind Organ Psychol doi: 10.1017/iop.2016.6 – volume: 60 start-page: 683 issue: 3 year: 2007 ident: 861_CR40 publication-title: Pers Psychol doi: 10.1111/j.1744-6570.2007.00089.x – ident: 861_CR73 doi: 10.1109/SP.2018.00014 – ident: 861_CR64 – ident: 861_CR60 – ident: 861_CR28 doi: 10.1037/e686432011-001 – volume: 21 start-page: 79 issue: 2 year: 2018 ident: 861_CR37 publication-title: Hist Psychol doi: 10.1037/hop0000081 – ident: 861_CR47 – volume: 13 start-page: 32 issue: 3 year: 1999 ident: 861_CR23 publication-title: J Bus Psychol doi: 10.1023/A:1022941331649 – volume-title: Psychometric Theory year: 1994 ident: 861_CR45 – volume: 582 start-page: 482 issue: 7813 year: 2020 ident: 861_CR53 publication-title: Nature doi: 10.1038/d41586-020-01812-9 – ident: 861_CR48 doi: 10.1145/3351095.3372828 – volume-title: Challenging Biased Hiring Algorithms. SSRN Scholarly Paper ID 3744248 year: 2020 ident: 861_CR31 – ident: 861_CR14 doi: 10.1145/3173574.3174225
SSID	ssj0005230
Score	2.417256
Snippet	Automated hiring systems are among the fastest-developing of all high-stakes AI systems. Among these are algorithmic personality tests that use insights from...
SourceID	pubmedcentral proquest pubmed crossref springer
SourceType	Open Access Repository Aggregation Database Index Database Enrichment Source Publisher
StartPage	2153
SubjectTerms	Algorithms Artificial Intelligence Audits Chemistry and Earth Sciences Computer Science Data Mining and Knowledge Discovery Information Storage and Retrieval Personality Personality tests Personality traits Physics Psychological tests Quantitative psychology Reliability aspects Special Issue on Bias and Fairness Stability Statistics for Engineering Validity
SummonAdditionalLinks	– databaseName: SpringerLINK Contemporary 1997-Present dbid: RSV link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1ZS8NAEB48wRfvI16s4JsGmmab3X0souhLES98C8lmFwOSljYV_PfObJPWWhWUPO5sssfMzreZC-A0aRjVFOQ9hXdln1vci1RzPAxR23DRTNKgmbpiE6LTkc_P6rYKChvU3u61SdKd1J-C3aJA-uR9TjgcL8HzsIjqTpI43t0_fXLsCEexwZL7LRk0qlCZ798xrY5mMOasq-QXe6lTQ1dr_5vAOqxWsJO1R3yyAXOm2IS1uqQDqyR8E5adR6gebEHSLlidIpohhHROtO8soSgOZmuXLlZ2GYLVkiGOZMi0eUZEXct6E5DPen2yBhEHsLxg7Rv2ktPAt-Hx6vLh4tqv6jH4uHu89BNcTZGpLDUR4hI85KOIyyBEDIkaT0jdMorrhtVaICZocRNGNmypjNtQYMckCHdgoegWZg-YNUqkQlmXXV8nBh88aZQVktss1ZkHQb0tsa6SlVPNjNd4kmaZVjPG1YzdasYND87GfXqjVB2_Uh_Wux1XYjuIEctRaUgELR6cjJtR4MiKkhSmOySaQEZkjhUe7I6YY_y5MAoonY30QEyxzZiAknlPtxT5i0vqreivboQ9z2vmmQzr51ns_438AFaaxH8ulvIQFsr-0BzBkn4r80H_2InRB0WXFe8 priority: 102 providerName: Springer Nature
Title	An external stability audit framework to test the validity of personality prediction in AI hiring
URI	https://link.springer.com/article/10.1007/s10618-022-00861-0 https://www.ncbi.nlm.nih.gov/pubmed/36161238 https://www.proquest.com/docview/2736930266 https://www.proquest.com/docview/2718635017 https://pubmed.ncbi.nlm.nih.gov/PMC9483468
Volume	36
WOSCitedRecordID	wos000854864900003&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVAVX databaseName: SpringerLINK Contemporary 1997-Present customDbUrl: eissn: 1573-756X dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0005230 issn: 1384-5810 databaseCode: RSV dateStart: 19970301 isFulltext: true titleUrlDefault: https://link.springer.com/search?facet-content-type=%22Journal%22 providerName: Springer Nature
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1Lb9QwEB7RlgMXyrOklJWRuEFEnDixfUJL1QqEWFbltXCJEsdWI6Fk2U0r8e-ZyTq7LBW9oEhzia3EmfHMF88L4FkRWR1Lip7Cf-VQOORFaQQqQ7Q2QsZFyeOybzYhJxM1m-mpP3Bb-rDKQSf2irpqDZ2Rv0QzS1370J68mv8MqWsUeVd9C40d2ONxzEnO38nwjxCPZJUlrESYKh75pBmfOpdxFVIsO6F6_KXeNkxX0ObVoMm_PKe9QTrd_9-l3IHbHoqy8Up27sIN29yD_aHNA_O7_j4U44YNxaIZgsk-nPYXKyifg7khuIt1LUPY2jFElAzFt65oUOvYfAP32XxBfiGSBVY3bPyWnde0uAfw-fTk0_Gb0HdmCJGPogsL_Jqy0lVpM0QoqO6zTCieIJpE2yeVSa0WJnLGSEQHqbBJ5pJUV8IlEicWPHkIu03b2EfAnNWylNr1dfZNYfFCnaOdVMJVpakC4ANbcuPLllP3jB_5puAysTJHVuY9K_MogOfrOfNV0Y5rRx8NbMr9Bl7mGx4F8HR9G7ce-VOKxrYXNIarjByzMoCDlXCsH5dknArbqADkltisB1BZ7-07TX3el_fWdL6b4cwXg4BtXuvfqzi8fhWP4VZMwt5nUR7Bbre4sE_gprns6uViBDvy6zeiMzWCvdcnk-nZqN9KSN9Hx0TjD0in6XekZx-__AbT8iRB
linkProvider	ProQuest
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Lb9QwEB6VggQXyruBAkaCE0TNwxvbB4RWhaqrlhWHIvUWEsdWI6Fku5uC-qf4jcw48S5LRW89oBxtJ3H8zSvzAnhdREYlgqKn0FYOucWzKDVHZojShoukKOOkdM0mxHQqT07Ulw345XNhKKzS80THqKtW0z_yXRSz1LUP5cmH2VlIXaPIu-pbaPSwODQXP9FkW7yffMTzfZMk-5-O9w7CoatAiO_Au7AYyVhUqipNhtIVWVWWcRmnqAkh3xZSj4ziOrJaC5RsI27SzKYjVXGbClxYxCne9wbc5BzJgUIFo70_QkrSPitZ8hCfEg1JOkOqXhbLkGLnyYpAE35dEF7Sbi8Haf7lqXUCcH_rf_t09-DuoGqzcU8b92HDNA9gy7exYANXewjFuGG-GDZDZdmFC1-wgvJVmPXBa6xrGarlHUONmSF51hVNai2brcwZNpuT34uwzuqGjSfstKaP-Qi-XstGH8Nm0zZmG5g1SpRCWddHQBcGL-SpygrJbVXqKoDYwyDXQ1l26g7yPV8VlCbo5Aid3EEnjwJ4u1wz64uSXDl7x8MiHxjUIl9hIoBXy2FkLeQvKhrTntOcWGbkeBYBPOnBuHxcmsVUuEcGINZgupxAZcvXR5r61JUvV_T_OsOV7zygV6_17108vXoXL-H2wfHno_xoMj18BncSIjSXMboDm9383DyHW_pHVy_mLxzJMvh23UD_DajkdoY
linkToPdf	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V3Nb9MwFH8aAyEujK9BYICR4ATRmsSJ7QNCFaOiKqp2AGm3kDi2Fgklpc1A-9f463jPiVvKxG47oBxtJ3H8e195XwAvi5FRsaDoKbSVQ27xLErNkRmitOEiLsooLl2zCTGfy5MTdbwDv3wuDIVVep7oGHXVavpHfohilrr2oTw5tENYxPHR5N3ie0gdpMjT6ttp9BCZmfOfaL6t3k6P8KxfxfHkw-f3H8Ohw0CI78O7sEhlJCpVlSZDSYtsK8u4jBLUipCHC6lTo7geWa0FSrmUmySzSaoqbhOBC4sowfteg-sohVOisZkI_wgvSfoMZclDfMpoSNgZ0vaySIYUR08WBZrz20LxgqZ7MWDzL6-tE4aTvf_5M96B24MKzsY9zdyFHdPcgz3f3oIN3O4-FOOG-SLZDJVoF0Z8zgrKY2HWB7WxrmWorncMNWmGZFtXNKm1bLExc9hiSf4wogFWN2w8Zac1fdgH8OVKNroPu03bmEfArFGiFMq6_gK6MHghr1VWSG6rUlcBRB4SuR7KtVPXkG_5ptA0wShHGOUORvkogNfrNYu-WMmlsw88RPKBca3yDT4CeLEeRpZDfqSiMe0ZzYlkRg5pEcDDHpjrxyVZRAV9ZABiC7LrCVTOfHukqU9dWXNF_7UzXPnGg3vzWv_exePLd_EcbiK-80_T-ewJ3IqJ5lwi6QHsdssz8xRu6B9dvVo-c9TL4OtV4_w3sPN_LA
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=An+external+stability+audit+framework+to+test+the+validity+of+personality+prediction+in+AI+hiring&rft.jtitle=Data+mining+and+knowledge+discovery&rft.au=Rhea%2C+Alene+K&rft.au=Markey%2C+Kelsey&rft.au=D%E2%80%99Arinzo%2C+Lauren&rft.au=Schellmann%2C+Hilke&rft.date=2022-11-01&rft.pub=Springer+Nature+B.V&rft.issn=1384-5810&rft.eissn=1573-756X&rft.volume=36&rft.issue=6&rft.spage=2153&rft.epage=2193&rft_id=info:doi/10.1007%2Fs10618-022-00861-0&rft.externalDBID=HAS_PDF_LINK
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1384-5810&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1384-5810&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1384-5810&client=summon