A technological construction of society: Comparing GPT‐4 and human respondents for occupational evaluation in the UK
Despite initial research about the biases and perceptions of large language models (LLMs), we lack evidence on how LLMs evaluate occupations, especially in comparison to human evaluators. In this paper, we present a systematic comparison of occupational evaluations by GPT‐4 with those from an in‐dep...
Uložené v:
| Vydané v: | British journal of industrial relations Ročník 63; číslo 1; s. 180 - 208 |
|---|---|
| Hlavní autori: | , , |
| Médium: | Journal Article |
| Jazyk: | English |
| Vydavateľské údaje: |
London
Blackwell Publishing Ltd
01.03.2025
|
| Predmet: | |
| ISSN: | 0007-1080, 1467-8543 |
| On-line prístup: | Získať plný text |
| Tagy: |
Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
|
| Abstract | Despite initial research about the biases and perceptions of large language models (LLMs), we lack evidence on how LLMs evaluate occupations, especially in comparison to human evaluators. In this paper, we present a systematic comparison of occupational evaluations by GPT‐4 with those from an in‐depth, high‐quality and recent human respondents survey in the UK. Covering the full ISCO‐08 occupational landscape, with 580 occupations and two distinct metrics (prestige and social value), our findings indicate that GPT‐4 and human scores are highly correlated across all ISCO‐08 major groups. At the same time, GPT‐4 substantially under‐ or overestimates the occupational prestige and social value of many occupations, particularly for emerging digital and stigmatized or illicit occupations. Our analyses show both the potential and risk of using LLM‐generated data for sociological and occupational research. We also discuss the policy implications of our findings for the integration of LLM tools into the world of work. |
|---|---|
| AbstractList | Despite initial research about the biases and perceptions of large language models (LLMs), we lack evidence on how LLMs evaluate occupations, especially in comparison to human evaluators. In this paper, we present a systematic comparison of occupational evaluations by GPT‐4 with those from an in‐depth, high‐quality and recent human respondents survey in the UK. Covering the full ISCO‐08 occupational landscape, with 580 occupations and two distinct metrics (prestige and social value), our findings indicate that GPT‐4 and human scores are highly correlated across all ISCO‐08 major groups. At the same time, GPT‐4 substantially under‐ or overestimates the occupational prestige and social value of many occupations, particularly for emerging digital and stigmatized or illicit occupations. Our analyses show both the potential and risk of using LLM‐generated data for sociological and occupational research. We also discuss the policy implications of our findings for the integration of LLM tools into the world of work. |
| Author | Lutz, Christoph Newlands, Gemma Gmyrek, Paweł |
| Author_xml | – sequence: 1 givenname: Paweł surname: Gmyrek fullname: Gmyrek, Paweł organization: International Labour Organization (ILO) – sequence: 2 givenname: Christoph orcidid: 0000-0003-4389-6006 surname: Lutz fullname: Lutz, Christoph email: christoph.lutz@bi.no organization: Nordic Centre for Internet and Society, BI Norwegian Business School – sequence: 3 givenname: Gemma surname: Newlands fullname: Newlands, Gemma organization: University of Oxford |
| BookMark | eNp9kM1KAzEUhYNUsK1ufIKAO2FqMs38uatFa7WgSF2HzJ1MmzJNxiRT6c5H8Bl9EqetKxHv5t4L3zkcTg91tNESoXNKBrSdq3yl7ICGKSNHqEtZnARpxIYd1CWEJAElKTlBPedW7RtFadZFmxH2EpbaVGahQFQYjHbeNuCV0diU2BlQ0m-v8disa2GVXuDJ8_zr45NhoQu8bNZCYytdbXQhtXe4NBYbgKYWO4vWUW5E1ewfrDT2S4lfH0_RcSkqJ89-dh_N727n4_tg9jSZjkezAFiYkAByEZYMChGxLMnz9sxjEqVFLEpBMkgYSdNMZBIYBUpyGpUSIhGKBIqskDDso4uDbW3NWyOd5yvT2DaU40Mah3EcpZS1FDlQYI1zVpYclN8H9laoilPCd-XyXbl8X24rufwlqa1aC7v9G6YH-F1VcvsPyW8epi8HzTdJCJAV |
| CitedBy_id | crossref_primary_10_1016_j_technovation_2025_103304 crossref_primary_10_1109_MTS_2024_3505618 |
| Cites_doi | 10.1177/09500170231155783 10.1086/428687 10.1177/20539517211016026 10.31235/osf.io/57tzm 10.1145/3531146.3533088 10.1016/j.jbusres.2024.114716 10.1016/j.tics.2023.04.008 10.21203/rs.3.rs-3296728/v1 10.1086/438078 10.1037/0021-9010.85.5.799 10.1007/s11023‐021‐09568‐5 10.1007/s13347-023-00606-x 10.1177/0003122418761857 10.1126/science.adg7879 10.1111/irel.12227 10.1002/mar.21982 10.1016/j.techsoc.2023.102372 10.1177/0950017013519845 10.1093/esr/jch033 10.1177/0731121418803325 10.1007/s12186-020-09243-3 10.1111/1467-9531.271028 10.2307/587210 10.18653/v1/2023.bea-1.34 10.1111/soin.12466 10.1111/j.1533-8525.1976.tb02154.x 10.1007/s13347-023-00621-y 10.1016/j.rssm.2024.100935 10.1111/bjir.12805 10.1016/j.jbvi.2019.e00118 10.1086/227553 10.1007/s43681-022-00148-6 10.1177/0730888420949596 10.1007/s11023-020-09548-1 10.18778/1733-8077.17.3.01 10.1177/09500170231175771 10.1007/978-1-349-03345-4 10.31234/osf.io/5b26t 10.1016/j.rssm.2017.10.001 10.1177/20539517221142824 10.2307/587306 10.1111/j.1467-8543.1970.tb00575.x 10.1177/089124392006003003 10.1177/0003122420966324 10.1016/j.rssm.2019.100456 10.1017/pan.2023.2 10.1177/000312240707200402 10.1080/00224545.1934.9921615 10.1007/s11135-010-9369-x 10.1080/13511610.2017.1282309 10.1525/9780520333970 10.1007/s00146‐023‐01725‐x 10.1111/bjir.12728 10.1177/2053951720919776 10.1515/pjbr-2021-0029 10.1080/01621459.1933.10503237 10.17705/1cais.05221 10.2307/3341608 10.1093/sf/soz145 10.1177/0003122418773353 10.31234/osf.io/4zdx9 10.1007/s44206-023-00054-2 10.1007/s00146‐023‐01710‐4 10.1177/0730888419860880 10.1016/j.ijhm.2020.102772 10.2139/ssrn.4430515 10.1177/09500170221117415 10.1177/0730888485012001002 10.1080/14759551.2019.1656632 10.1177/030631289019003001 10.1145/3544548.3580688 10.1177/0003122416671743 10.1177/20539517211020332 10.1177/09500170211015067 10.1002/poi3.238 10.31235/osf.io/ct4vz 10.1111/j.1533-8525.1994.tb00408.x 10.1111/socf.12762 10.1111/j.1467-8543.2011.00884.x 10.54394/FVNQ9406 10.1177/0730888408329222 10.1016/j.jbef.2017.12.004 10.1515/9780773576681 10.1093/acprof:oso/9780199213375.003.0008 10.1111/1468-4446.12941 10.2139/ssrn.4548937 10.1177/0730888410383367 10.1038/d41586-023-00056-7 10.1177/0730888417726119 |
| ContentType | Journal Article |
| Copyright | 2024 The Author(s). published by John Wiley & Sons Ltd. 2024. This article is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
| Copyright_xml | – notice: 2024 The Author(s). published by John Wiley & Sons Ltd. – notice: 2024. This article is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
| DBID | 24P AAYXX CITATION 7TQ 7U4 8BJ BHHNA DHY DON DWI FQK JBE WZK |
| DOI | 10.1111/bjir.12840 |
| DatabaseName | Wiley-Blackwell Open Access Titles CrossRef PAIS Index Sociological Abstracts (pre-2017) International Bibliography of the Social Sciences (IBSS) Sociological Abstracts PAIS International PAIS International (Ovid) Sociological Abstracts International Bibliography of the Social Sciences International Bibliography of the Social Sciences Sociological Abstracts (Ovid) |
| DatabaseTitle | CrossRef Sociological Abstracts (pre-2017) International Bibliography of the Social Sciences (IBSS) Sociological Abstracts PAIS International |
| DatabaseTitleList | CrossRef Sociological Abstracts (pre-2017) |
| Database_xml | – sequence: 1 dbid: 24P name: Wiley Open Access (UHCL Subscription) url: https://authorservices.wiley.com/open-science/open-access/browse-journals.html sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Economics |
| EISSN | 1467-8543 |
| EndPage | 208 |
| ExternalDocumentID | 10_1111_bjir_12840 BJIR12840 |
| Genre | article |
| GeographicLocations | United Kingdom--UK |
| GeographicLocations_xml | – name: United Kingdom--UK |
| GrantInformation_xml | – fundername: Norges Forskningsråd |
| GroupedDBID | --Z -~X .3N .GA .Y3 05W 07C 0R~ 10A 1OB 1OC 1XV 23N 24P 31~ 33P 3EH 3O- 4.4 50Y 50Z 51W 51Y 52M 52O 52Q 52S 52T 52U 52W 5GY 5HH 5LA 5VS 66C 6J9 6P2 702 7PT 8-0 8-1 8-3 8-4 8-5 8UM 8VB 930 A04 AABNI AABXT AAESR AAHHS AAHQN AAMNL AANHP AAONW AAOUF AASGY AAVTF AAXRX AAYCA AAYJJ AAZKR ABCQN ABCUV ABEML ABFSI ABJNI ABLJU ABPVW ABSOO ABTAH ACAHQ ACBKW ACBWZ ACCFJ ACCZN ACFBH ACGFS ACHQT ACPOU ACRPL ACSCC ACXQS ACYXJ ADBBV ADEMA ADEOM ADIZJ ADKYN ADMGS ADMHG ADMLS ADNMO ADXAS ADZMN ADZOD AEEZP AEGXH AEIGN AEIMD AEMOZ AEQDE AEUQT AEUYR AFBPY AFEBI AFFNX AFFPM AFGKR AFKFF AFPWT AFWVQ AFZJQ AHBTC AHQJS AIFKG AIURR AIWBW AJBDE AKVCP ALAGY ALMA_UNASSIGNED_HOLDINGS ALUQN ALVPJ AMBMR AMYDB ASPBG ASTYK AVWKF AZBYB AZFZN AZVAB BAFTC BDRZF BFHJK BKOMP BMKGK BMXJE BNVMJ BQESF BROTX BRXPI BY8 C2- CAG COF CS3 D-C D-D DCZOG DPXWK DR2 DRFUL DRSSH DU5 E.L EBA EBE EBO EBR EBS EBU EJD EMK F00 F01 FEDTE G-S G.N G50 GODZA HGLYW HVGLF HZI HZ~ H~9 IHE IX1 J0M K1G K48 LATKE LC2 LC4 LEEKS LH4 LITHE LOXES LP6 LP7 LPU LUTES LW6 LYRES MEWTI MK4 MRFUL MRSSH MSFUL MSSSH MXFUL MXSSH N04 N06 N9A NF~ O66 OIG P2W P2Y P4C PALCI PQQKQ Q.N Q11 QB0 QWB R.K RIWAO RJQFR ROL RX1 SAMSI SUPJJ TAE TH9 TN5 U5U UB1 UPT V8K W8V W99 WBKPD WEBCB WH7 WIH WII WOHZO WQZ WRC WSUWO WXSBR XG1 ZL0 ZY4 ZZTAW ~IA ~WP AAMMB AAYXX ABBNM ABUFD ADXHL AEFGJ AETEA AEYWJ AGHNM AGQPQ AGXDD AIDQK AIDYY AIQQE CITATION O8X 7TQ 7U4 8BJ BHHNA DHY DON DWI FQK JBE WZK |
| ID | FETCH-LOGICAL-c4270-cba2f4cda5497bbf4cb6058d6afa09c740889a9ec41c10b15fec5a2a7cd9dec3 |
| IEDL.DBID | 24P |
| ISICitedReferencesCount | 4 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001290225800001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0007-1080 |
| IngestDate | Fri Nov 07 23:52:12 EST 2025 Tue Nov 18 22:16:57 EST 2025 Sat Nov 29 06:21:44 EST 2025 Mon Feb 03 09:41:16 EST 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Language | English |
| License | Attribution |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c4270-cba2f4cda5497bbf4cb6058d6afa09c740889a9ec41c10b15fec5a2a7cd9dec3 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| ORCID | 0000-0003-4389-6006 |
| OpenAccessLink | https://onlinelibrary.wiley.com/doi/abs/10.1111%2Fbjir.12840 |
| PQID | 3162665814 |
| PQPubID | 36197 |
| PageCount | 29 |
| ParticipantIDs | proquest_journals_3162665814 crossref_citationtrail_10_1111_bjir_12840 crossref_primary_10_1111_bjir_12840 wiley_primary_10_1111_bjir_12840_BJIR12840 |
| PublicationCentury | 2000 |
| PublicationDate | March 2025 |
| PublicationDateYYYYMMDD | 2025-03-01 |
| PublicationDate_xml | – month: 03 year: 2025 text: March 2025 |
| PublicationDecade | 2020 |
| PublicationPlace | London |
| PublicationPlace_xml | – name: London |
| PublicationTitle | British journal of industrial relations |
| PublicationYear | 2025 |
| Publisher | Blackwell Publishing Ltd |
| Publisher_xml | – name: Blackwell Publishing Ltd |
| References | 2023; 75 1970; 8 2004; 20 2023; 36 2017; 82 2023; 37 2019; 11 2022; 73 2017; 44 2000; 85 2019; 58 1974 2023b 2020; 13 2007; 72 2023a 2018; 83 2023; 2 2020; 99 2023; 3 2024 2014; 28 2024b; 180 2024; 38 1978 1933; 28 1977 2021; 36 1992; 6 2020; 7 2023a; 31 2017; 30 2021; 31 2014; 4 2019; 62 2023; 27 2013; 51 2022; 36 2023; 379 1994; 35 2024b 2024a 2023; 613 1985; 12 1950; 1 2021; 8 2021; 48 2023; 52 2024a; 91 2000; 25 2022; 92 2020; 85 2005; 111 2023; 15 2009 2008 1953; 4 2007 1997; 27 2011; 38 2021; 93 1934; 5 2023; 61 2021; 13 2009; 36 2017; 52 2018; 17 1925; 33 2021; 12 2023 2020; 30 2022 2019; 46 2020; 70 2021; 17 1982; 87 2022; 9 2020; 26 2018 2011; 45 1976; 17 1989; 19 e_1_2_11_70_1 e_1_2_11_93_1 e_1_2_11_32_1 e_1_2_11_55_1 e_1_2_11_78_1 e_1_2_11_36_1 e_1_2_11_51_1 e_1_2_11_74_1 e_1_2_11_13_1 e_1_2_11_29_1 e_1_2_11_106_1 e_1_2_11_48_1 e_1_2_11_102_1 e_1_2_11_81_1 e_1_2_11_20_1 e_1_2_11_66_1 e_1_2_11_47_1 e_1_2_11_89_1 e_1_2_11_24_1 e_1_2_11_62_1 e_1_2_11_8_1 e_1_2_11_85_1 e_1_2_11_17_1 e_1_2_11_59_1 Treiman D.J. (e_1_2_11_97_1) 1977 e_1_2_11_50_1 e_1_2_11_92_1 e_1_2_11_31_1 e_1_2_11_77_1 e_1_2_11_58_1 e_1_2_11_35_1 e_1_2_11_73_1 e_1_2_11_12_1 e_1_2_11_54_1 e_1_2_11_96_1 e_1_2_11_103_1 e_1_2_11_28_1 e_1_2_11_5_1 Goldthorpe J.H. (e_1_2_11_43_1) 1974 Graeber D. (e_1_2_11_46_1) 2018 e_1_2_11_61_1 e_1_2_11_80_1 e_1_2_11_69_1 e_1_2_11_88_1 e_1_2_11_107_1 e_1_2_11_9_1 e_1_2_11_23_1 e_1_2_11_42_1 e_1_2_11_65_1 e_1_2_11_84_1 e_1_2_11_16_1 e_1_2_11_39_1 e_1_2_11_72_1 e_1_2_11_91_1 e_1_2_11_30_1 e_1_2_11_57_1 e_1_2_11_99_1 e_1_2_11_34_1 e_1_2_11_53_1 e_1_2_11_76_1 e_1_2_11_95_1 e_1_2_11_11_1 e_1_2_11_6_1 e_1_2_11_104_1 e_1_2_11_27_1 e_1_2_11_2_1 e_1_2_11_100_1 e_1_2_11_83_1 e_1_2_11_60_1 e_1_2_11_45_1 e_1_2_11_68_1 e_1_2_11_41_1 e_1_2_11_87_1 e_1_2_11_108_1 e_1_2_11_22_1 e_1_2_11_64_1 e_1_2_11_15_1 e_1_2_11_38_1 e_1_2_11_19_1 e_1_2_11_94_1 e_1_2_11_71_1 Alkaissi H. (e_1_2_11_4_1) 2023; 15 e_1_2_11_90_1 e_1_2_11_10_1 e_1_2_11_56_1 e_1_2_11_79_1 e_1_2_11_14_1 e_1_2_11_52_1 e_1_2_11_98_1 e_1_2_11_33_1 e_1_2_11_75_1 e_1_2_11_7_1 e_1_2_11_105_1 e_1_2_11_26_1 e_1_2_11_3_1 e_1_2_11_49_1 e_1_2_11_101_1 Salvagno M. (e_1_2_11_86_1) 2023; 27 e_1_2_11_82_1 e_1_2_11_21_1 e_1_2_11_44_1 e_1_2_11_67_1 e_1_2_11_25_1 e_1_2_11_40_1 e_1_2_11_63_1 e_1_2_11_18_1 e_1_2_11_37_1 |
| References_xml | – volume: 91 year: 2024a article-title: Occupational prestige and occupational social value in the United Kingdom: New indices for the modern British economy publication-title: Research in Social Stratification and Mobility – volume: 31 start-page: 337 issue: 3 year: 2023a end-page: 351 article-title: Out of one, many: using language models to simulate human samples publication-title: Political Analysis – start-page: 11737 year: 2023 end-page: 11762 article-title: From pretraining data to language models to downstream tasks – year: 2009 – volume: 33 start-page: 16 issue: 1 year: 1925 end-page: 27 article-title: The social status of occupations: a problem in vocational guidance publication-title: The School Review – volume: 17 start-page: 22 year: 2018 end-page: 27 article-title: Prolific.ac—a subject pool for online experiments publication-title: Journal of Behavioral and Experimental Finance – volume: 26 start-page: 405 issue: 5‐6 year: 2020 end-page: 424 article-title: When the main job tasks are perceived to be ‘irrelevant’ in the workplace: the internal uselessness of corporate social responsibility work in Japan publication-title: Culture and Organization – volume: 48 start-page: 207 issue: 2 year: 2021 end-page: 242 article-title: Choosing bad jobs: the use of nonstandard work as a commitment device publication-title: Work and Occupations – volume: 25 start-page: 441 issue: 4 year: 2000 end-page: 470 article-title: Too much money off other people's backs’: status in late modern societies publication-title: Canadian Journal of Sociology – volume: 45 start-page: 623 year: 2011 end-page: 639 article-title: The conceptualisation and measurement of occupational hierarchies: a review, a proposal and some illustrative analyses publication-title: Quality & Quantity – volume: 8 issue: 1 year: 2021 article-title: Lifting the curtain: Strategic visibility of human labour in AI‐as‐a‐Service publication-title: Big Data & Society – volume: 13 start-page: 134 issue: 1 year: 2021 end-page: 155 article-title: Social media, web, and panel surveys: using non‐probability samples in social and policy research publication-title: Policy & Internet – volume: 613 start-page: 423 issue: 7944 year: 2023 article-title: Abstracts written by ChatGPT fool scientists publication-title: Nature – volume: 1 start-page: 31 issue: 1 year: 1950 end-page: 55 article-title: Social grading of occupations publication-title: The British Journal of Sociology – start-page: 414 year: 2023 end-page: 428 article-title: Generating better items for cognitive assessments using large language models – volume: 35 start-page: 215 issue: 2 year: 1994 end-page: 245 article-title: The meaning of occupational prestige scores: a social psychological analysis and interpretation publication-title: The Sociological Quarterly – year: 2024 – start-page: 1 year: 2023 end-page: 19 article-title: Evaluating large language models in generating synthetic HCI research data: a case study – volume: 36 start-page: 1 issue: 2 year: 2023 end-page: 24 article-title: In conversation with artificial intelligence: aligning language models with human values publication-title: Philosophy & Technology – volume: 83 start-page: 243 issue: 2 year: 2018 end-page: 277 article-title: The structure of deference: modeling occupational status using affect control theory publication-title: American Sociological Review – volume: 8 issue: 2 year: 2021 article-title: Algorithmic management in a work context publication-title: Big Data & Society – start-page: 1 year: 2023 end-page: 11 article-title: ChatGPT: deconstructing the debate and moving it forward publication-title: AI & Society – start-page: 214 year: 2022 end-page: 229 article-title: Taxonomy of risks posed by language models – year: 2018 – volume: 9 issue: 2 year: 2022 article-title: Artificial intelligence, human intelligence and hybrid intelligence based on mutual augmentation publication-title: Big Data & Society – volume: 85 start-page: 1084 issue: 6 year: 2020 end-page: 1116 article-title: The variability of occupational attainment: how prestige trajectories diversified within birth cohorts over the twentieth century publication-title: American Sociological Review – volume: 82 start-page: 32 issue: 1 year: 2017 end-page: 58 article-title: A position with a view: educational status and the construction of the occupational hierarchy publication-title: American Sociological Review – volume: 3 start-page: 53 issue: 1 year: 2023 end-page: 64 article-title: GPT‐3 and InstructGPT: technological dystopianism, utopianism, and ‘contextual’ perspectives in AI ethics and industry publication-title: AI and Ethics – volume: 62 start-page: 325 issue: 3 year: 2019 end-page: 345 article-title: The relationship between college major prestige/status and post‐baccalaureate outcomes publication-title: Sociological Perspectives – volume: 12 start-page: 23 issue: 1 year: 1985 end-page: 39 article-title: Components of occupational prestige evaluations publication-title: Work and Occupations – volume: 15 issue: 2 year: 2023 article-title: Artificial hallucinations in ChatGPT: implications in scientific writing publication-title: Cureus – volume: 52 start-page: 518 year: 2023 end-page: 537 article-title: Algorithmic management: Its implications for information systems research publication-title: Communications of the Association for Information Systems – year: 2024a article-title: Developing an occupational prestige scale using large language models publication-title: SocArXiv – volume: 180 year: 2024b article-title: Mapping the prestige and social value of occupations in the digital economy publication-title: Journal of Business Research – volume: 44 start-page: 376 issue: 4 year: 2017 end-page: 423 article-title: Working algorithms: software automation and the future of work publication-title: Work and Occupations – volume: 73 start-page: 536 issue: 3 year: 2022 end-page: 553 article-title: Social stratification in meaningful work: occupational class disparities in the United Kingdom publication-title: The British Journal of Sociology – volume: 92 start-page: 647 issue: 2 year: 2022 end-page: 673 article-title: Constructing the racial hierarchy of labor: the role of race in occupational prestige judgments publication-title: Sociological Inquiry – volume: 6 start-page: 376 issue: 3 year: 1992 end-page: 392 article-title: Gender and race effects on occupational prestige, segregation, and earnings publication-title: Gender & Society – volume: 52 start-page: 26 year: 2017 end-page: 35 article-title: Landing a job, sinking a career? The trade‐off between occupational downgrading and quick reemployment according to unemployed jobseekers’ career stage and job prospects publication-title: Research in Social Stratification and Mobility – volume: 12 start-page: 423 issue: 1 year: 2021 end-page: 436 article-title: Overtrusting robots: setting a research agenda to mitigate overtrust in automation publication-title: Paladyn, Journal of Behavioral Robotics – volume: 5 start-page: 435 issue: 4 year: 1934 end-page: 466 article-title: The occupational attitudes of college men publication-title: The Journal of Social Psychology – year: 2008 – volume: 58 start-page: 3 issue: 1 year: 2019 end-page: 16 article-title: Socially useless jobs publication-title: Industrial Relations – volume: 83 start-page: 567 issue: 3 year: 2018 end-page: 595 article-title: The cultural‐cognitive mapping of scientific professions publication-title: American Sociological Review – volume: 7 issue: 1 year: 2020 article-title: The trainer, the verifier, the imitator: three ways in which human platform workers support artificial intelligence publication-title: Big Data & Society – year: 2023b – volume: 99 start-page: 31 issue: 1 year: 2020 end-page: 58 article-title: The segregation premium: how gender shapes the symbolic valuation process of occupational prestige judgments publication-title: Social Forces – volume: 36 start-page: 15 issue: 1 year: 2023 article-title: AI as agency without intelligence: on ChatGPT, large language models, and other generative models publication-title: Philosophy & Technology – start-page: 1 year: 2023 end-page: 3 article-title: AI language models cannot replace human research participants publication-title: AI & Society – volume: 36 start-page: 1395 year: 2021 end-page: 1418 article-title: The heterarchy of occupational status: evidence for diverse logics of prestige in the United States publication-title: Sociological Forum – volume: 20 start-page: 383 issue: 5 year: 2004 end-page: 401 article-title: Is there a status order in contemporary British society? Evidence from the occupational structure of friendship publication-title: European Sociological Review – volume: 27 start-page: 597 issue: 7 year: 2023 end-page: 600 article-title: Can AI language models replace human participants? publication-title: Trends in Cognitive Sciences – volume: 30 start-page: 204 issue: 2 year: 2017 end-page: 222 article-title: Can digital skills raise occupational prestige among ethnic minorities? publication-title: Innovation: The European Journal of Social Science Research – volume: 13 start-page: 369 issue: 3 year: 2020 end-page: 388 article-title: The challenge of occupational prestige for occupational identities: comparing bricklaying and automation technology apprentices in Switzerland publication-title: Vocations and Learning – volume: 51 start-page: 104 issue: 1 year: 2013 end-page: 123 article-title: The financial costs of caring in the British labour market: is there a wage penalty for workers in caring occupations? publication-title: British Journal of Industrial Relations – volume: 38 start-page: 242 issue: 1 year: 2024 end-page: 261 article-title: Gender composition and the symbolic value of occupations publication-title: Work, Employment and Society – start-page: 233 year: 2007 end-page: 276 – volume: 38 start-page: 3 issue: 1 year: 2011 end-page: 36 article-title: Occupational and organizational commitment in different occupational contexts: the case of South Korea publication-title: Work and Occupations – volume: 8 start-page: 100 issue: 1 year: 1970 end-page: 104 article-title: Occupational values and stereotypes in a group of engineers publication-title: British Journal of Industrial Relations – volume: 19 start-page: 387 issue: 3 year: 1989 end-page: 420 article-title: Institutional ecology, ‘translations’ and boundary objects: amateurs and professionals in Berkeley's Museum of Vertebrate Zoology, 1907–39 publication-title: Social Studies of Science – volume: 46 start-page: 441 issue: 4 year: 2019 end-page: 469 article-title: The polarization myth: occupational upgrading in Germany, Spain, Sweden, and the UK, 1992–2015 publication-title: Work and Occupations – volume: 27 start-page: 177 issue: 1 year: 1997 end-page: 298 article-title: Socioeconomic indexes for occupations: a review, update, and critique publication-title: Sociological Methodology – volume: 93 year: 2021 article-title: Stigma and dirty work: in‐group and out‐group perceptions of essential service workers during COVID‐19 publication-title: International Journal of Hospitality Management – volume: 28 start-page: 481 issue: 3 year: 2014 end-page: 494 article-title: Using occupation‐based social classifications publication-title: Work, Employment and Society – volume: 111 start-page: 90 issue: 1 year: 2005 end-page: 140 article-title: The institutional logic of occupational prestige ranking: reconceptualization and reanalyses publication-title: American Journal of Sociology – volume: 85 start-page: 799 issue: 5 year: 2000 end-page: 811 article-title: A meta‐analytic review of occupational commitment: relations with person‐ and work‐related variables publication-title: Journal of Applied Psychology – volume: 4 start-page: 181 issue: 2 year: 1953 end-page: 188 article-title: The social grading of occupations in Australia publication-title: The British Journal of Sociology – volume: 17 start-page: 90 issue: 1 year: 1976 end-page: 108 article-title: The occupational prestige structure: a multidimensional scaling approach publication-title: Sociological Quarterly – volume: 4 year: 2014 – year: 2023a – volume: 37 start-page: 1123 issue: 5 year: 2023 end-page: 1146 article-title: ‘Bullshit’ after all? Why people consider their jobs socially useless publication-title: Work, Employment and Society – volume: 31 start-page: 471 issue: 4 year: 2021 end-page: 486 article-title: Language and intelligence publication-title: Minds and Machines – volume: 17 start-page: 6 issue: 3 year: 2021 end-page: 33 article-title: Temporary employment, permanent stigma? Perceptions of temporary agency workers across low‐ and high‐skilled jobs publication-title: Qualitative Sociology Review – volume: 61 start-page: 674 issue: 3 year: 2023 end-page: 696 article-title: The mythology of ‘big data’ as a source of corporate power publication-title: British Journal of Industrial Relations – year: 1977 – volume: 11 year: 2019 article-title: Labor of love? The influence of work‐conditions among self‐employed and work stress publication-title: Journal of Business Venturing Insights – volume: 72 start-page: 512 issue: 4 year: 2007 end-page: 532 article-title: Class and status: the conceptual distinction and Its empirical relevance publication-title: American Sociological Review – volume: 2 start-page: 26 issue: 2 year: 2023 article-title: How accurate are GPT‐3's hypotheses about social science phenomena? publication-title: Digital Society – volume: 30 start-page: 681 year: 2020 end-page: 694 article-title: GPT‐3: its nature, scope, limits, and consequences publication-title: Minds and Machines – volume: 75 year: 2023 article-title: Generative AI: here to stay, but for good? publication-title: Technology in Society – start-page: 1 year: 2023 end-page: 26 article-title: Technological change, tasks and class inequality in Europe publication-title: Work, Employment and Society – volume: 36 start-page: 816 issue: 5 year: 2022 end-page: 840 article-title: Alienation is not ‘bullshit’: an empirical critique of Graeber's theory of BS jobs publication-title: Work, Employment and Society – volume: 28 start-page: 377 issue: 184 year: 1933 end-page: 387 article-title: A social‐economic grouping of the gainful workers of the United States publication-title: Journal of the American Statistical Association – year: 2023 – year: 1974 – volume: 36 start-page: 26 issue: 1 year: 2009 end-page: 55 article-title: The good, the bad, and the ordinary: work identities in ‘good’ and ‘bad’ jobs in the United Kingdom publication-title: Work and Occupations – year: 1978 – volume: 27 start-page: 1 issue: 1 year: 2023 end-page: 5 article-title: Can artificial intelligence help for scientific writing? publication-title: Critical Care – year: 2024b article-title: What do large language models ‘think’ determines occupational prestige? publication-title: SocArXiv – volume: 379 start-page: 313 issue: 6630 year: 2023 end-page: 313 article-title: ChatGPT is fun, but not an author publication-title: Science – volume: 70 year: 2020 article-title: Occupations, workplaces or jobs? An exploration of stratification contexts using administrative data publication-title: Research in Social Stratification and Mobility – volume: 87 start-page: 1011 issue: 5 year: 1982 end-page: 1031 article-title: A liberal theory of prestige publication-title: American Journal of Sociology – ident: e_1_2_11_41_1 doi: 10.1177/09500170231155783 – ident: e_1_2_11_108_1 doi: 10.1086/428687 – ident: e_1_2_11_74_1 doi: 10.1177/20539517211016026 – ident: e_1_2_11_103_1 – ident: e_1_2_11_27_1 doi: 10.31235/osf.io/57tzm – ident: e_1_2_11_104_1 doi: 10.1145/3531146.3533088 – ident: e_1_2_11_76_1 doi: 10.1016/j.jbusres.2024.114716 – ident: e_1_2_11_28_1 doi: 10.1016/j.tics.2023.04.008 – ident: e_1_2_11_85_1 doi: 10.21203/rs.3.rs-3296728/v1 – ident: e_1_2_11_22_1 doi: 10.1086/438078 – ident: e_1_2_11_64_1 doi: 10.1037/0021-9010.85.5.799 – ident: e_1_2_11_73_1 doi: 10.1007/s11023‐021‐09568‐5 – ident: e_1_2_11_54_1 – ident: e_1_2_11_58_1 doi: 10.1007/s13347-023-00606-x – ident: e_1_2_11_39_1 doi: 10.1177/0003122418761857 – ident: e_1_2_11_96_1 doi: 10.1126/science.adg7879 – ident: e_1_2_11_31_1 doi: 10.1111/irel.12227 – ident: e_1_2_11_87_1 doi: 10.1002/mar.21982 – ident: e_1_2_11_94_1 doi: 10.1016/j.techsoc.2023.102372 – ident: e_1_2_11_62_1 doi: 10.1177/0950017013519845 – ident: e_1_2_11_18_1 doi: 10.1093/esr/jch033 – ident: e_1_2_11_81_1 doi: 10.1177/0731121418803325 – ident: e_1_2_11_30_1 doi: 10.1007/s12186-020-09243-3 – ident: e_1_2_11_50_1 doi: 10.1111/1467-9531.271028 – volume-title: Bullshit jobs: a theory year: 2018 ident: e_1_2_11_46_1 – ident: e_1_2_11_95_1 doi: 10.2307/587210 – ident: e_1_2_11_63_1 doi: 10.18653/v1/2023.bea-1.34 – ident: e_1_2_11_101_1 doi: 10.1111/soin.12466 – volume-title: Occupational prestige in comparative perspective year: 1977 ident: e_1_2_11_97_1 – ident: e_1_2_11_47_1 doi: 10.1111/j.1533-8525.1976.tb02154.x – volume: 27 start-page: 1 issue: 1 year: 2023 ident: e_1_2_11_86_1 article-title: Can artificial intelligence help for scientific writing? publication-title: Critical Care – ident: e_1_2_11_37_1 doi: 10.1007/s13347-023-00621-y – ident: e_1_2_11_75_1 doi: 10.1016/j.rssm.2024.100935 – ident: e_1_2_11_25_1 doi: 10.1111/bjir.12805 – ident: e_1_2_11_106_1 doi: 10.1016/j.jbvi.2019.e00118 – ident: e_1_2_11_51_1 doi: 10.1086/227553 – ident: e_1_2_11_35_1 – ident: e_1_2_11_17_1 doi: 10.1007/s43681-022-00148-6 – ident: e_1_2_11_3_1 doi: 10.1177/0730888420949596 – ident: e_1_2_11_36_1 doi: 10.1007/s11023-020-09548-1 – ident: e_1_2_11_16_1 doi: 10.18778/1733-8077.17.3.01 – ident: e_1_2_11_29_1 – ident: e_1_2_11_102_1 doi: 10.1177/09500170231175771 – ident: e_1_2_11_23_1 doi: 10.1007/978-1-349-03345-4 – ident: e_1_2_11_9_1 doi: 10.31234/osf.io/5b26t – ident: e_1_2_11_12_1 doi: 10.1016/j.rssm.2017.10.001 – ident: e_1_2_11_7_1 – ident: e_1_2_11_55_1 doi: 10.1177/20539517221142824 – ident: e_1_2_11_48_1 doi: 10.2307/587306 – ident: e_1_2_11_21_1 doi: 10.1111/j.1467-8543.1970.tb00575.x – ident: e_1_2_11_107_1 doi: 10.1177/089124392006003003 – ident: e_1_2_11_66_1 doi: 10.1177/0003122420966324 – ident: e_1_2_11_10_1 doi: 10.1016/j.rssm.2019.100456 – ident: e_1_2_11_6_1 doi: 10.1017/pan.2023.2 – ident: e_1_2_11_19_1 doi: 10.1177/000312240707200402 – ident: e_1_2_11_83_1 – ident: e_1_2_11_5_1 doi: 10.1080/00224545.1934.9921615 – volume-title: The social grading of occupations: a new approach and scale year: 1974 ident: e_1_2_11_43_1 – ident: e_1_2_11_13_1 doi: 10.1007/s11135-010-9369-x – ident: e_1_2_11_67_1 doi: 10.1080/13511610.2017.1282309 – ident: e_1_2_11_44_1 doi: 10.1525/9780520333970 – ident: e_1_2_11_49_1 doi: 10.1007/s00146‐023‐01725‐x – ident: e_1_2_11_70_1 doi: 10.1111/bjir.12728 – ident: e_1_2_11_98_1 doi: 10.1177/2053951720919776 – ident: e_1_2_11_8_1 doi: 10.1515/pjbr-2021-0029 – ident: e_1_2_11_32_1 doi: 10.1080/01621459.1933.10503237 – ident: e_1_2_11_79_1 – ident: e_1_2_11_15_1 doi: 10.17705/1cais.05221 – ident: e_1_2_11_78_1 doi: 10.2307/3341608 – ident: e_1_2_11_99_1 doi: 10.1093/sf/soz145 – ident: e_1_2_11_40_1 doi: 10.1177/0003122418773353 – ident: e_1_2_11_24_1 doi: 10.31234/osf.io/4zdx9 – ident: e_1_2_11_84_1 doi: 10.1007/s44206-023-00054-2 – ident: e_1_2_11_33_1 – ident: e_1_2_11_20_1 doi: 10.1007/s00146‐023‐01710‐4 – ident: e_1_2_11_77_1 doi: 10.1177/0730888419860880 – ident: e_1_2_11_72_1 doi: 10.1016/j.ijhm.2020.102772 – ident: e_1_2_11_14_1 doi: 10.2139/ssrn.4430515 – ident: e_1_2_11_61_1 doi: 10.1177/09500170221117415 – ident: e_1_2_11_2_1 doi: 10.1177/0730888485012001002 – volume: 15 issue: 2 year: 2023 ident: e_1_2_11_4_1 article-title: Artificial hallucinations in ChatGPT: implications in scientific writing publication-title: Cureus – ident: e_1_2_11_38_1 doi: 10.1080/14759551.2019.1656632 – ident: e_1_2_11_93_1 doi: 10.1177/030631289019003001 – ident: e_1_2_11_52_1 doi: 10.1145/3544548.3580688 – ident: e_1_2_11_88_1 – ident: e_1_2_11_82_1 – ident: e_1_2_11_68_1 doi: 10.1177/0003122416671743 – ident: e_1_2_11_56_1 doi: 10.1177/20539517211020332 – ident: e_1_2_11_92_1 doi: 10.1177/09500170211015067 – ident: e_1_2_11_65_1 doi: 10.1002/poi3.238 – ident: e_1_2_11_26_1 doi: 10.31235/osf.io/ct4vz – ident: e_1_2_11_69_1 doi: 10.1111/j.1533-8525.1994.tb00408.x – ident: e_1_2_11_100_1 doi: 10.1111/socf.12762 – ident: e_1_2_11_11_1 doi: 10.1111/j.1467-8543.2011.00884.x – ident: e_1_2_11_42_1 doi: 10.54394/FVNQ9406 – ident: e_1_2_11_89_1 doi: 10.1177/0730888408329222 – ident: e_1_2_11_80_1 doi: 10.1016/j.jbef.2017.12.004 – ident: e_1_2_11_45_1 doi: 10.1515/9780773576681 – ident: e_1_2_11_71_1 doi: 10.1093/acprof:oso/9780199213375.003.0008 – ident: e_1_2_11_105_1 doi: 10.1111/1468-4446.12941 – ident: e_1_2_11_53_1 – ident: e_1_2_11_57_1 doi: 10.2139/ssrn.4548937 – ident: e_1_2_11_60_1 doi: 10.1177/0730888410383367 – ident: e_1_2_11_91_1 – ident: e_1_2_11_34_1 doi: 10.1038/d41586-023-00056-7 – ident: e_1_2_11_59_1 – ident: e_1_2_11_90_1 doi: 10.1177/0730888417726119 |
| SSID | ssj0005589 |
| Score | 2.4198592 |
| Snippet | Despite initial research about the biases and perceptions of large language models (LLMs), we lack evidence on how LLMs evaluate occupations, especially in... |
| SourceID | proquest crossref wiley |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 180 |
| SubjectTerms | Chatbots Humans Language modeling Large language models Occupational prestige Occupations Prestige Program evaluation Respondents Sociological research Stigma |
| Title | A technological construction of society: Comparing GPT‐4 and human respondents for occupational evaluation in the UK |
| URI | https://onlinelibrary.wiley.com/doi/abs/10.1111%2Fbjir.12840 https://www.proquest.com/docview/3162665814 |
| Volume | 63 |
| WOSCitedRecordID | wos001290225800001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVWIB databaseName: Wiley Online Library Full Collection 2020 customDbUrl: eissn: 1467-8543 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0005589 issn: 0007-1080 databaseCode: DRFUL dateStart: 19970101 isFulltext: true titleUrlDefault: https://onlinelibrary.wiley.com providerName: Wiley-Blackwell |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LS8NAEB6KCnrxLdZHGdCLQqRJNk0iXnzVVymltNBb2FekIqk0pWd_gr_RX-LuJmkqiCDe9jAJYWdn9pvNt98AHIcNwSgRsSVjBd-I5otTBZQtIbjjcyIdlunMtvx2OxgMwk4FLoq7MJk-xOzATUeGydc6wClL54KcvQzHZzq7qoJ90bbdQDducEinJHh4QQ5-fUsz6XJxUs3jKZ_9vh2VGHMeqZqtprn2v49ch9UcYuJltiY2oCKTTVgubiCnWzC9xElxoq59hHxU6sjiKMY0o3Ke43XWpTB5xrtO7_P9gyBNBJq-fjg27Fp9zzdFhXxxNKdXjKWIOA4TVCAT-0_b0Gve9q7vrbz_gsWJ49ctzqgTEy6oqiF9xtSQ6Z-ookFjWg-5TzRFioaSE5vbdWZ7seQedajPRSgkd3dgIRklcheQU9f13DpjoSSEeiIQXqyyW0ipAhCM2FU4KbwQ8VybXLfIeI2KGkVPZGQmsgpHM9u3TJHjR6uDwplRHpVp5NqqfFOQyyZVODVu--UN0dXjQ9eM9v5ivA8rjm4RbGhqB7CgvCcPYYlPJ8N0XDMrtAaLN91mv_UFNHHuOQ |
| linkProvider | Wiley-Blackwell |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LS8NAEF6kCvXiW6xWHdCLQiSPTdN4q8Xa2lqKROgt7CtSkUSa0rM_wd_oL3F3kzQVRBBve9iEsLMz883m228QOvcbnBLMI0NEEr5hxRcnEigbnDPbY1jYNNOZHXjDYXM89kc5N0fdhcn0IRYHbsozdLxWDq4OpJe8nL5MplcqvMqKfRXLNKO2uY1HJcPDbebo1zMUlS5XJ1VEnvLZ7_moBJnLUFXnms7mP79yC23kIBNa2a7YRisi3kHV4g5yuovmLZgVZ-rKSsCSUkkWkgjSjMx5De2sT2H8DHej4PP9AwOJOejOfjDV_Fp10zcFiX0hWVIshlJGHCYxSJgJT_09FHRug3bXyDswGAzbnmkwSuwIM05kFelRKodU_UblDRIR02ceViQp4guGLWaZ1HIjwVxiE49xnwvm7KNKnMTiAAEjjuM6JqW-wJi4vMndSMY3nxAJISi2auiiMEPIcnVy1STjNSyqFLWQoV7IGjpbzH3LNDl-nFUvrBnmfpmGjiULOAm6LFxDl9puv7whvLnvPerR4V8mn6JqN3gYhIPesH-E1m3VMFiT1uqoIi0pjtEam88m6fREb9cv4qDwhA |
| linkToPdf | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LS8NAEB6kFfXiW6xWHdCLQqRJNk3jrbZWa0sppYK3sK9IRdLSlJ79Cf5Gf4m7eTQVRBBve5iEsLMz-83m228ALryqYJSIwJCBgm9E88WpAsqGENxyOZEWS3Rmu26vV3t-9vopN0ffhUn0IRYHbjoy4nytA1xORLAU5ex1NL3W6VVV7EWiu8gUoNgctJ66OcfDqaX41zU0mS7VJ9VUnvzp7ztSDjOXwWq827S2_vmd27CZwkysJ-tiB1ZkuAvr2S3kaA_mdZxlp-raT8jHuZYsjgOMEjrnDTaSToXhC973h5_vHwRpKDDu7YfTmGGr7_pGqNAvjpc0izEXEsdRiApo4lNnH4atu2HjwUh7MBicWG7F4IxaAeGCqjrSZUwNmf6RKqo0oBWPu0TTpKgnOTG5WWGmE0juUIu6XHhCcvsACuE4lIeAnNq2Y1cY8yQh1BE14QQqw3mUKhDBiFmCy8wNPk_1yXWbjDc_q1P0RPrxRJbgfGE7SVQ5frQqZ97008iMfNtUJZyCXSYpwVXst1_e4N8-tgfx6Ogvxmew1m-2_G671zmGDUt3DI5Za2UoKEfKE1jl89komp6m6_UL5J3xmg |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+technological+construction+of+society%3A+Comparing+GPT%E2%80%904+and+human+respondents+for+occupational+evaluation+in+the+UK&rft.jtitle=British+journal+of+industrial+relations&rft.au=Gmyrek%2C+Pawe%C5%82&rft.au=Lutz%2C+Christoph&rft.au=Newlands%2C+Gemma&rft.date=2025-03-01&rft.pub=Blackwell+Publishing+Ltd&rft.issn=0007-1080&rft.eissn=1467-8543&rft.volume=63&rft.issue=1&rft.spage=180&rft.epage=208&rft_id=info:doi/10.1111%2Fbjir.12840&rft.externalDBID=NO_FULL_TEXT |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0007-1080&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0007-1080&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0007-1080&client=summon |