Finding “similar” universities using ChatGPT for institutional benchmarking: A large‐scale comparison of European universities
The study objective was to evaluate the efficacy of ChatGPT in identifying “similar” institutions for benchmarking the research performance of a university. Benchmarking is deemed a promising approach to compare “similar with similar” as a better alternative to rankings (comparing “different” univer...
Gespeichert in:
| Veröffentlicht in: | Journal of the Association for Information Science and Technology Jg. 76; H. 9; S. 1174 - 1187 |
|---|---|
| Hauptverfasser: | , , |
| Format: | Journal Article |
| Sprache: | Englisch |
| Veröffentlicht: |
Hoboken, USA
John Wiley & Sons, Inc
01.09.2025
|
| ISSN: | 2330-1635, 2330-1643 |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Abstract | The study objective was to evaluate the efficacy of ChatGPT in identifying “similar” institutions for benchmarking the research performance of a university. Benchmarking is deemed a promising approach to compare “similar with similar” as a better alternative to rankings (comparing “different” universities). Current approaches either focus on a limited number of “quantitative” dimensions or are too complex for most users. We conducted large‐scale testing by tasking ChatGPT with identifying the most similar European universities in terms of research performance, utilizing the European Tertiary Education Register data. We tested whether the peers suggested by ChatGPT were similar to the focal university on size, research intensity, and subject composition. Additionally, we evaluated whether providing more specific instructions improved the results. The findings offer a nuanced perspective on the potential and risks of using ChatGPT to identify peer institutions for benchmarking. On one hand, solely using ChatGPT would replicate the visibility biases associated with university rankings, thereby undermining the rationale for benchmarking. On the other hand, relying on semantic associations might capture dimensions of university similarity that are relevant and difficult to capture through quantitative methods. We finally reflected on the broader implications for scholars in higher education and science studies research. |
|---|---|
| AbstractList | The study objective was to evaluate the efficacy of ChatGPT in identifying “similar” institutions for benchmarking the research performance of a university. Benchmarking is deemed a promising approach to compare “similar with similar” as a better alternative to rankings (comparing “different” universities). Current approaches either focus on a limited number of “quantitative” dimensions or are too complex for most users. We conducted large‐scale testing by tasking ChatGPT with identifying the most similar European universities in terms of research performance, utilizing the European Tertiary Education Register data. We tested whether the peers suggested by ChatGPT were similar to the focal university on size, research intensity, and subject composition. Additionally, we evaluated whether providing more specific instructions improved the results. The findings offer a nuanced perspective on the potential and risks of using ChatGPT to identify peer institutions for benchmarking. On one hand, solely using ChatGPT would replicate the visibility biases associated with university rankings, thereby undermining the rationale for benchmarking. On the other hand, relying on semantic associations might capture dimensions of university similarity that are relevant and difficult to capture through quantitative methods. We finally reflected on the broader implications for scholars in higher education and science studies research. |
| Author | Lepori, Benedetto Bornmann, Lutz Gay, Mario |
| Author_xml | – sequence: 1 givenname: Benedetto orcidid: 0000-0002-4178-4687 surname: Lepori fullname: Lepori, Benedetto email: blepori@usi.ch organization: Università della Svizzera italiana – sequence: 2 givenname: Lutz orcidid: 0000-0003-0810-7091 surname: Bornmann fullname: Bornmann, Lutz organization: Administrative Headquarters of the Max Planck Society – sequence: 3 givenname: Mario orcidid: 0000-0003-0151-9587 surname: Gay fullname: Gay, Mario organization: Università della Svizzera italiana |
| BookMark | eNp1kMFOAjEQhhuDiYgcfINePSy0Xbq79UYIIAmJJuJ5M93tQnVpSbur4caBB_AB9OV4EhcxJh48zRy-_5_Jd4laxhqF0DUlPUoI64PXPcYJJWeozcKQBDQahK3fPeQXqOv9MyENIhLOaBvtJ9rk2izxYffh9VqX4A67T1wb_aqc15VWHtf-CIxWUE0fFriwDmvjK13VlbYGSiyVyVZrcC8NdouHuOlYqsPu3WdQKpzZ9Qac9tZgW-Bx7exGgflz4QqdF1B61f2ZHfQ0GS9Gd8H8fjobDedBxrggQRxJkTGhQl6wWCpBkyhheQwRByEpkwKiQRIDF4JTKfMkjhilsZCRCAuAXIUddHPqzZz13qki3TjdPL5NKUmPBtPGYPptsGH7J_ZNl2r7P5gOH2enxBd5S3lz |
| Cites_doi | 10.4337/9781788974981.00025 10.1007/s10734-015-9894-6 10.1609/aaai.v39i24.34714 10.1371/journal.pone.0223415 10.1007/978-94-007-1116-7_1 10.3390/educsci13070692 10.2478/jdis-2024-0013 10.59350/gygeh-nv475 10.1016/j.inffus.2023.101861 10.1080/03075079.2021.1968368 10.1162/coli_a_00502 10.1080/08989621.2023.2185514 10.1002/asi.22923 10.1007/s11192-024-04939-y 10.1038/s41597-023-02353-2 10.1080/21568235.2022.2094817 10.1145/3597307 10.1007/s11192-024-05176-z 10.1007/s11192-012-0672-2 10.7759/cureus.39238 10.1016/j.tics.2024.01.011 10.1016/j.iotcps.2023.04.003 10.1016/j.ejor.2015.02.005 10.1177/000312240907400104 10.1007/978-94-007-3005-2 10.5210/fm.v28i11.13346 10.1007/s11192-008-0214-0 10.30935/cedtech/13605 10.1002/(SICI)1097-4571(1999)50:2<115::AID-ASI3>3.0.CO;2-J 10.1145/3641289 10.1007/s11192-022-04413-7 10.1007/s11192-024-05039-7 10.1162/qss_a_00273 10.1016/j.joi.2016.04.006 10.1007/s11192-023-04882-4 10.1007/s11192-018-2666-1 10.1007/s11024-010-9143-1 10.1002/asi.22708 10.1007/s10439-023-03272-4 10.1007/s11023-022-09602-0 10.1093/reseval/rvv021 |
| ContentType | Journal Article |
| Copyright | 2025 Association for Information Science and Technology. |
| Copyright_xml | – notice: 2025 Association for Information Science and Technology. |
| DBID | AAYXX CITATION |
| DOI | 10.1002/asi.25010 |
| DatabaseName | CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | CrossRef |
| DeliveryMethod | fulltext_linktorsrc |
| EISSN | 2330-1643 |
| EndPage | 1187 |
| ExternalDocumentID | 10_1002_asi_25010 ASI25010 |
| Genre | article |
| GroupedDBID | .4I 0R~ 1OB 1OC 33P 3SF 52U 5VS AAESR AAEVG AAHQN AAMMB AAMNL AANHP AANLZ AAONW AASGY AAWJA AAWTL AAXRX AAYCA AAZKR ABCUV ABJNI ABLJU ACAHQ ACBWZ ACCZN ACFBH ACGFS ACHQT ACPOU ACRPL ACXBN ACXQS ACYXJ ADBBV ADEOM ADIZJ ADKYN ADMGS ADMLS ADNMO ADOZA ADXAS ADZMN AEFGJ AEIGN AEIMD AENEX AEUYR AEYWJ AFBPY AFFPM AFGKR AFKRA AFWVQ AFZJQ AGHNM AGQPQ AGXDD AGYGG AHBTC AHQJS AIDQK AIDYY AIMQZ AITYG AIURR AJXKR AKVCP ALAGY ALMA_UNASSIGNED_HOLDINGS ALUQN ALVPJ AMBMR AMYDB ATUGU AUFTA AZFZN AZVAB BDRZF BGLVJ BHBCM BMNLL BMXJE BNHUX BPHCQ BRXPI BY8 CCPQU D-F DCZOG DRFUL DRSTM EBO EBS EBU EJD ELW F00 F01 F04 G-S G.N GODZA HGLYW I-F K60 K6~ K7- LATKE LEEKS LH4 LIQON LITHE LOXES LUTES LW6 LYRES MEWTI MK~ ML~ MRFUL MRSTM MSFUL MSSTM MXFUL MXSTM NF~ O66 O9- P2W PHGZM PHGZT PMKZF PQBIZ PQBZA PQEDU PQGLB PQQKQ PROAC PRQQA PUEGO QB0 ROL SUPJJ TH9 WBKPD WIH WIK WOHZO WXSBR WYISQ WZISG AAYXX AFFHD CITATION |
| ID | FETCH-LOGICAL-c2590-76b9c29e35f27be918682d7a65a9b12b9a6487a59951bbd87621179b693faade3 |
| IEDL.DBID | DRFUL |
| ISICitedReferencesCount | 0 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001478782100001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 2330-1635 |
| IngestDate | Sat Nov 29 07:14:14 EST 2025 Mon Sep 01 09:23:01 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 9 |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c2590-76b9c29e35f27be918682d7a65a9b12b9a6487a59951bbd87621179b693faade3 |
| ORCID | 0000-0003-0151-9587 0000-0002-4178-4687 0000-0003-0810-7091 |
| PageCount | 14 |
| ParticipantIDs | crossref_primary_10_1002_asi_25010 wiley_primary_10_1002_asi_25010_ASI25010 |
| PublicationCentury | 2000 |
| PublicationDate | September 2025 2025-09-00 |
| PublicationDateYYYYMMDD | 2025-09-01 |
| PublicationDate_xml | – month: 09 year: 2025 text: September 2025 |
| PublicationDecade | 2020 |
| PublicationPlace | Hoboken, USA |
| PublicationPlace_xml | – name: Hoboken, USA |
| PublicationTitle | Journal of the Association for Information Science and Technology |
| PublicationYear | 2025 |
| Publisher | John Wiley & Sons, Inc |
| Publisher_xml | – name: John Wiley & Sons, Inc |
| References | 2023; 31 2023; 10 2023; 51 2023; 13 2023; 99 2023; 4 2012 2011 2023; 15 2024; 129 2015; 244 2013; 64 2019; 14 2016; 10 2024; 50 2022; 47 2016; 71 2008; 74 2024 2023; 3 2024; 15 2015; 24 2012; 93 2009; 74 2010; 48 2023 2023; 28 2022 2021 2024; 9 2018; 115 2022; 12 2017 2022; 32 2013 1999; 50 2008; 20 2024; 28 2022; 127 2012; 63 Tang L. (e_1_2_9_46_1) 2023 e_1_2_9_31_1 e_1_2_9_52_1 e_1_2_9_50_1 e_1_2_9_10_1 e_1_2_9_35_1 Li M. (e_1_2_9_33_1) 2023 e_1_2_9_14_1 e_1_2_9_39_1 Shieh E. (e_1_2_9_43_1) 2024 e_1_2_9_16_1 e_1_2_9_37_1 e_1_2_9_58_1 e_1_2_9_18_1 e_1_2_9_41_1 e_1_2_9_20_1 e_1_2_9_45_1 e_1_2_9_24_1 e_1_2_9_8_1 e_1_2_9_4_1 e_1_2_9_2_1 e_1_2_9_26_1 e_1_2_9_49_1 e_1_2_9_28_1 e_1_2_9_47_1 e_1_2_9_30_1 e_1_2_9_53_1 Gonen H. (e_1_2_9_19_1) 2024 e_1_2_9_51_1 Bogetoft P. (e_1_2_9_6_1) 2013 e_1_2_9_11_1 e_1_2_9_34_1 e_1_2_9_57_1 e_1_2_9_13_1 e_1_2_9_32_1 e_1_2_9_55_1 Wang X. (e_1_2_9_56_1) 2022 e_1_2_9_15_1 e_1_2_9_36_1 Hazelkorn E. (e_1_2_9_22_1) 2022 Sahlgren M. (e_1_2_9_38_1) 2008; 20 Saparov A. (e_1_2_9_40_1) 2022 e_1_2_9_42_1 e_1_2_9_21_1 e_1_2_9_23_1 e_1_2_9_44_1 e_1_2_9_7_1 Wang F. (e_1_2_9_54_1) 2024 e_1_2_9_5_1 e_1_2_9_3_1 Chen H. (e_1_2_9_12_1) 2023 Gao J. (e_1_2_9_17_1) 2023 e_1_2_9_9_1 e_1_2_9_25_1 e_1_2_9_27_1 e_1_2_9_48_1 e_1_2_9_29_1 |
| References_xml | – volume: 15 start-page: 1 issue: 2 year: 2023 end-page: 21 article-title: Biases in large language models: Origins, inventory, and discussion publication-title: ACM Journal of Data and Information Quality – year: 2011 – year: 2023 article-title: A GPT‐based approach for Scientometric analysis: Exploring the landscape of artificial intelligence research publication-title: arXiv – volume: 31 start-page: 1244 issue: 8 year: 2023 end-page: 1246 article-title: Using ChatGPT to conduct a literature review publication-title: Accountability in Research – year: 2024 article-title: Does liking yellow imply driving a school bus? Semantic leakage in language models publication-title: arXiv – volume: 4 start-page: 800 issue: 4 year: 2023 end-page: 819 article-title: Measuring university size: A comparison of academic personnel versus scientific talent pool data publication-title: Quantitative Science Studies – year: 2023 article-title: Is chatgpt a good causal reasoner? A comprehensive evaluation publication-title: arXiv – volume: 74 start-page: 63 issue: 1 year: 2009 end-page: 82 article-title: The discipline of rankings: Tight coupling and organizational change publication-title: American Sociological Review – volume: 14 issue: 10 year: 2019 article-title: Scientific output scales with resources. A comparison of US and European universities publication-title: PLoS One – volume: 127 start-page: 7557 issue: 12 year: 2022 end-page: 7574 article-title: Identifying benchmark units for research management and evaluation publication-title: Scientometrics – volume: 12 start-page: 373 issue: sup1 year: 2022 end-page: 390 article-title: Opportunities and challenges for international institutional data comparisons publication-title: European Journal of Higher Education – year: 2024 – start-page: 197 year: 2021 end-page: 209 – volume: 15 issue: 5 year: 2023 article-title: High rates of fabricated and inaccurate references in ChatGPT‐generated medical content publication-title: Cureus – volume: 63 start-page: 2419 issue: 12 year: 2012 end-page: 2432 article-title: The Leiden ranking 2011/2012: Data collection, indicators, and interpretation publication-title: Journal of the American Society for Information Science and Technology – volume: 99 year: 2023 article-title: ChatGPT: Jack of all trades, master of none publication-title: Information Fusion – volume: 28 start-page: 517 issue: 6 year: 2024 end-page: 540 article-title: Dissociating language and thought in large language models publication-title: Trends in Cognitive Sciences – year: 2023 article-title: Potential societal biases of ChatGPT in higher education: A scoping review publication-title: arXiv – volume: 129 start-page: 3593 year: 2024 end-page: 3598 article-title: The use of ChatGPT to find similar institutions for institutional benchmarking publication-title: Scientometrics – year: 2022 article-title: Self‐consistency improves chain of thought reasoning in language models publication-title: arXiv – volume: 129 start-page: 7161 year: 2024 end-page: 7165 article-title: The use of ChatGPT for identifying disruptive papers in science: A first exploration publication-title: Scientometrics – volume: 13 issue: 7 year: 2023 article-title: Shaping the future of education: Exploring the potential and consequences of AI and ChatGPT in educational settings publication-title: Education in Science – volume: 24 start-page: 369 issue: 4 year: 2015 end-page: 379 article-title: Measuring institutional diversity across higher education systems publication-title: Research Evaluation – year: 2022 article-title: Language models are greedy reasoners: A systematic formal analysis of chain‐of‐thought publication-title: arXiv – year: 2023 article-title: Large knowledge models: Perspectives and challenges publication-title: arXiv – year: 2022 – volume: 93 start-page: 351 issue: 2 year: 2012 end-page: 371 article-title: Reference classes: A tool for benchmarking universities' research publication-title: Scientometrics – volume: 48 start-page: 73 issue: 1 year: 2010 end-page: 99 article-title: Patterns of subject mix of higher education institutions: A first empirical analysis from the AQUAMETH database publication-title: Minerva – volume: 50 start-page: 237 issue: 1 year: 2024 end-page: 291 article-title: Can large language models transform computational social science? publication-title: Computational Linguistics – volume: 28 issue: 11 year: 2023 article-title: Should chatGPT be biased? Challenges and risks of bias in large language models publication-title: First Monday – volume: 3 start-page: 121 year: 2023 end-page: 154 article-title: ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope publication-title: Internet of Things and Cyber‐Physical Systems – volume: 64 start-page: 2310 issue: 11 year: 2013 end-page: 2316 article-title: Do universities or research institutions with a specific subject profile have an advantage or a disadvantage in institutional rankings? A latent class analysis with data from the SCImago ranking publication-title: Journal of the American Society for Information Science and Technology – volume: 129 start-page: 2469 year: 2024 end-page: 2487 article-title: Can ChatGPT be used to predict citation counts, readership, and social media interaction? An exploration among 2222 scientific abstracts publication-title: Scientometrics – year: 2024 article-title: Laissez‐faire harms: Algorithmic biases in generative language models publication-title: arXiv – volume: 244 start-page: 918 issue: 3 year: 2015 end-page: 930 article-title: Rankings and university performance: A conditional multidimensional approach publication-title: European Journal of Operational Research – volume: 20 start-page: 33 year: 2008 end-page: 53 article-title: The distributional hypothesis publication-title: Italian Journal of Linguistics – volume: 47 start-page: 1827 issue: 9 year: 2022 end-page: 1843 article-title: The heterogeneity of European higher education institutions: A configurational approach publication-title: Studies in Higher Education – year: 2024 article-title: InfuserKI: Enhancing large language models with knowledge graphs via infuser‐guided knowledge integration publication-title: arXiv – volume: 115 start-page: 585 issue: 1 year: 2018 end-page: 606 article-title: University rankings: What do they really show? publication-title: Scientometrics – volume: 10 issue: 1 year: 2023 article-title: The European Tertiary Education Register, the reference dataset on European Higher Education Institutions publication-title: Scientific Data – volume: 15 issue: 4 year: 2023 article-title: Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature publication-title: Contemporary Educational Technology – volume: 15 start-page: 1 issue: 3 year: 2024 end-page: 45 article-title: A survey on evaluation of large language models publication-title: ACM Transactions on Intelligent Systems and Technology – year: 2012 – volume: 74 start-page: 223 issue: 2 year: 2008 end-page: 236 article-title: A structural analysis of publication profiles for the classification of European research institutes publication-title: Scientometrics – volume: 71 start-page: 163 year: 2016 end-page: 180 article-title: The iconography of universities as institutional narratives publication-title: Higher Education – volume: 32 start-page: 341 issue: 2 year: 2022 end-page: 364 article-title: Playing games with AIs: The limits of GPT‐3 and similar large language models publication-title: Minds and Machines – volume: 51 start-page: 2629 issue: 12 year: 2023 end-page: 2633 article-title: Prompt engineering with ChatGPT: a guide for academic writers publication-title: Annals of biomedical engineering – volume: 50 start-page: 115 issue: 2 year: 1999 end-page: 131 article-title: Combining mapping and citation analysis for evaluative bibliometric purposes: A bibliometric study publication-title: Journal of the American Society for Information Science – volume: 9 start-page: 1 issue: 2 year: 2024 end-page: 21 article-title: Can ChatGPT evaluate research quality? publication-title: Journal of Data and Information Science – volume: 129 start-page: 713 issue: 1 year: 2024 end-page: 718 article-title: Can we identify prominent scholars using ChatGPT? publication-title: Scientometrics – year: 2017 – volume: 10 start-page: 646 issue: 2 year: 2016 end-page: 651 article-title: A farewell to the MNCS and like size‐independent indicators publication-title: Journal of Informetrics – year: 2013 – ident: e_1_2_9_41_1 doi: 10.4337/9781788974981.00025 – ident: e_1_2_9_15_1 doi: 10.1007/s10734-015-9894-6 – year: 2022 ident: e_1_2_9_56_1 article-title: Self‐consistency improves chain of thought reasoning in language models publication-title: arXiv – ident: e_1_2_9_3_1 – year: 2022 ident: e_1_2_9_40_1 article-title: Language models are greedy reasoners: A systematic formal analysis of chain‐of‐thought publication-title: arXiv – ident: e_1_2_9_47_1 doi: 10.1609/aaai.v39i24.34714 – ident: e_1_2_9_30_1 doi: 10.1371/journal.pone.0223415 – ident: e_1_2_9_44_1 doi: 10.1007/978-94-007-1116-7_1 – ident: e_1_2_9_4_1 – volume-title: Research handbook on university rankings. Theory, methodology, influence and impact year: 2022 ident: e_1_2_9_22_1 – volume: 20 start-page: 33 year: 2008 ident: e_1_2_9_38_1 article-title: The distributional hypothesis publication-title: Italian Journal of Linguistics – ident: e_1_2_9_20_1 doi: 10.3390/educsci13070692 – ident: e_1_2_9_48_1 doi: 10.2478/jdis-2024-0013 – ident: e_1_2_9_50_1 doi: 10.59350/gygeh-nv475 – ident: e_1_2_9_26_1 doi: 10.1016/j.inffus.2023.101861 – year: 2023 ident: e_1_2_9_17_1 article-title: Is chatgpt a good causal reasoner? A comprehensive evaluation publication-title: arXiv – year: 2024 ident: e_1_2_9_19_1 article-title: Does liking yellow imply driving a school bus? Semantic leakage in language models publication-title: arXiv – ident: e_1_2_9_27_1 doi: 10.1080/03075079.2021.1968368 – ident: e_1_2_9_57_1 – ident: e_1_2_9_58_1 doi: 10.1162/coli_a_00502 – ident: e_1_2_9_21_1 doi: 10.1080/08989621.2023.2185514 – ident: e_1_2_9_7_1 doi: 10.1002/asi.22923 – ident: e_1_2_9_14_1 doi: 10.1007/s11192-024-04939-y – ident: e_1_2_9_31_1 doi: 10.1038/s41597-023-02353-2 – ident: e_1_2_9_28_1 doi: 10.1080/21568235.2022.2094817 – ident: e_1_2_9_35_1 doi: 10.1145/3597307 – ident: e_1_2_9_9_1 doi: 10.1007/s11192-024-05176-z – ident: e_1_2_9_10_1 doi: 10.1007/s11192-012-0672-2 – ident: e_1_2_9_5_1 doi: 10.7759/cureus.39238 – ident: e_1_2_9_34_1 doi: 10.1016/j.tics.2024.01.011 – ident: e_1_2_9_37_1 doi: 10.1016/j.iotcps.2023.04.003 – ident: e_1_2_9_13_1 doi: 10.1016/j.ejor.2015.02.005 – ident: e_1_2_9_42_1 doi: 10.1177/000312240907400104 – year: 2023 ident: e_1_2_9_33_1 article-title: Potential societal biases of ChatGPT in higher education: A scoping review publication-title: arXiv – ident: e_1_2_9_51_1 doi: 10.1007/978-94-007-3005-2 – ident: e_1_2_9_16_1 doi: 10.5210/fm.v28i11.13346 – ident: e_1_2_9_49_1 doi: 10.1007/s11192-008-0214-0 – ident: e_1_2_9_24_1 doi: 10.30935/cedtech/13605 – ident: e_1_2_9_36_1 doi: 10.1002/(SICI)1097-4571(1999)50:2<115::AID-ASI3>3.0.CO;2-J – ident: e_1_2_9_11_1 doi: 10.1145/3641289 – ident: e_1_2_9_55_1 doi: 10.1007/s11192-022-04413-7 – year: 2023 ident: e_1_2_9_12_1 article-title: Large knowledge models: Perspectives and challenges publication-title: arXiv – ident: e_1_2_9_8_1 doi: 10.1007/s11192-024-05039-7 – volume-title: Performance benchmarking: Measuring and managing performance year: 2013 ident: e_1_2_9_6_1 – year: 2024 ident: e_1_2_9_43_1 article-title: Laissez‐faire harms: Algorithmic biases in generative language models publication-title: arXiv – ident: e_1_2_9_29_1 doi: 10.1162/qss_a_00273 – ident: e_1_2_9_2_1 doi: 10.1016/j.joi.2016.04.006 – ident: e_1_2_9_39_1 doi: 10.1007/s11192-023-04882-4 – year: 2023 ident: e_1_2_9_46_1 article-title: A GPT‐based approach for Scientometric analysis: Exploring the landscape of artificial intelligence research publication-title: arXiv – ident: e_1_2_9_25_1 doi: 10.1007/s11192-018-2666-1 – ident: e_1_2_9_32_1 doi: 10.1007/s11024-010-9143-1 – ident: e_1_2_9_52_1 doi: 10.1002/asi.22708 – year: 2024 ident: e_1_2_9_54_1 article-title: InfuserKI: Enhancing large language models with knowledge graphs via infuser‐guided knowledge integration publication-title: arXiv – ident: e_1_2_9_18_1 doi: 10.1007/s10439-023-03272-4 – ident: e_1_2_9_45_1 doi: 10.1007/s11023-022-09602-0 – ident: e_1_2_9_23_1 doi: 10.1093/reseval/rvv021 – ident: e_1_2_9_53_1 |
| SSID | ssj0001098521 |
| Score | 2.4683387 |
| Snippet | The study objective was to evaluate the efficacy of ChatGPT in identifying “similar” institutions for benchmarking the research performance of a university.... |
| SourceID | crossref wiley |
| SourceType | Index Database Publisher |
| StartPage | 1174 |
| Title | Finding “similar” universities using ChatGPT for institutional benchmarking: A large‐scale comparison of European universities |
| URI | https://onlinelibrary.wiley.com/doi/abs/10.1002%2Fasi.25010 |
| Volume | 76 |
| WOSCitedRecordID | wos001478782100001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVWIB databaseName: Wiley Online Library Full Collection 2020 customDbUrl: eissn: 2330-1643 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001098521 issn: 2330-1635 databaseCode: DRFUL dateStart: 20140101 isFulltext: true titleUrlDefault: https://onlinelibrary.wiley.com providerName: Wiley-Blackwell |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3NSgMxEA6l9eDFH1SsfwTx4GXtbvY3eirVqiClaAu9LZNs1i7YVrqt5x58AB9AX65PYpLdbe1BELztIUvCZCbzzTDzDUJnxAsiy-GOEURmZDjAbSOITSHNXTV0cR5YPuhhE36rFfR6tF1CV0UvTMYPsUi4KcvQ77UycGBpbUkaCmlyIf23aq-qEKm3ThlVrh-b3YdlisWkgas7r4iM2g2JPNyCW8gktcX_Kx7pJ0LVLqa5-a_DbaGNHFnieqYK26gkhjvovZnothU8n32mySCRcex89oWnRTmGjJOxKn1_xo0-TG7bHSxBLE7yCgKdJsRMKnJ_ADqpfonr-EUVj89nH6m8XoH5YpAhHsW4SO6v7LCLus2bTuPOyAcvGFxGQ6bhe4xyQoXtxsRngipKfRL54LlAmUUYBU_GOaC4yizGIvWgKmY55lE7BoiEvYfKw9FQ7CMsAaCQoA5iz2UOuBBQkwFnJgB17CiCKjothB--ZvwaYcakTEIpxFALsYrOtbB_XxHWn-71x8Hflx6idaKG-eqCsSNUnoyn4hit8bdJko5PcmX6BpRc0iU |
| linkProvider | Wiley-Blackwell |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LTwIxEG4ImOjFR9SIz8Z48LK6dJ81XgiKEJEQhYTbZtrtyiYChodnDv4Af4D-OX6JbZcFOZiYeNtDN93MzrTffJn5BqEz4vphwea24YdmaNjALcOPTCHDXTV0ce4XPNDDJrx63W-3aSODrtNemEQfYk64qcjQ57UKcEVIXy5UQ2EYX8gLXPVX5WzpRk4W5W4ey63agmMxqe_o1isi03ZDQg8nFRcyyeX8_aUr6SdE1XdMeeN_X7eJ1mfYEhcTZ9hCGdHbRu_lWDeu4Onkcxh3Y5nJTidfeJwWZMhMGavi92dc6sDortHEEsbieFZDoIlCzKQrd7qgafUrXMQvqnx8OvkYyh8sMJ-PMsT9CKf0_tIOO6hVvm2WKsZs9ILBZT5kGp7LKCdUWE5EPCaoEtUnoQeuA5QVCKPgykwHlFpZgbFQHalKW4651IoAQmHtomyv3xN7CEsIKCSsg8h1mA0O-NRkwJkJQG0rDCGPTlPrB6-JwkaQaCmTQBox0EbMo3Nt7d9XBMWnqn7Y__vSE7RaaT7Uglq1fn-A1oga7avLxw5RdjQYiyO0wt9G8XBwPPOsbyM-1hU |
| linkToPdf | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LSwMxEA7FinjxgYpvg3jwsnY3-4x4KdXVYilFK3hbJo-1C1qlD889-AP8Afrn-ktM0t1qD4LgbQ9ZEiYzmW-GmW8QOiJBJByPe1YkbGF5wF0rSm2pzF03dHEeOSGYYRNhsxnd39NWCZ0VvTATfohpwk1bhnmvtYHLF5FWvllDoZ-dKAeu-6vKnk8DZZbl85v4rvGdY7Fp5JvWK6LCdktBD78gF7JJZfr_jEv6CVGNj4mX_3e6FbSUY0tcnSjDKirJ7hp6izPTuILHo49-9pSpSHY8-sTDoiBDRcpYF78_4FoHBpetNlYwFmd5DYFJFGKmVLnzBCatfoqr-FGXj49H7311wRLz6ShD_JziIr0_s8M6uosv2rUrKx-9YHEVD9lWGDDKCZWun5KQSapJ9YkIIfCBMocwCoGKdECzlTmMCf2kam45FlA3BRDS3UBz3eeu3ERYQUCpYB2kgc888CGiNgPObADquULAFjospJ-8TBg2kgmXMkmUEBMjxC10bKT9-4qkels3H9t_X3qAFlrncdKoN6930CLRk31N9dgumhv0hnIPzfPXQdbv7eeK9QXt4NWQ |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Finding+%E2%80%9Csimilar%E2%80%9D+universities+using+ChatGPT+for+institutional+benchmarking%3A+A+large%E2%80%90scale+comparison+of+European+universities&rft.jtitle=Journal+of+the+Association+for+Information+Science+and+Technology&rft.au=Lepori%2C+Benedetto&rft.au=Bornmann%2C+Lutz&rft.au=Gay%2C+Mario&rft.date=2025-09-01&rft.issn=2330-1635&rft.eissn=2330-1643&rft.volume=76&rft.issue=9&rft.spage=1174&rft.epage=1187&rft_id=info:doi/10.1002%2Fasi.25010&rft.externalDBID=n%2Fa&rft.externalDocID=10_1002_asi_25010 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2330-1635&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2330-1635&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2330-1635&client=summon |