University rankings: A review of methodological flaws

University rankings have gradually become an issue for concern in the academic community worldwide. Several mechanisms with different methodologies have been developed to rank the universities appropriately. However, some ranking tools have notable issues, especially with the indicators adopted. Som...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Issues in educational research Ročník 30; číslo 1; s. 79 - 96
Hlavní autori: Fauzi, Muhammad Ashraf, Tan, Christine Nya-Ling, Daud, Mahyuddin, Awalludin, Muhammad Mukhtar Noor
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: Perth Western Australian Institute for Educational Research Inc 01.01.2020
Predmet:
ISSN:1837-6290, 0313-7155, 1837-6290
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Abstract University rankings have gradually become an issue for concern in the academic community worldwide. Several mechanisms with different methodologies have been developed to rank the universities appropriately. However, some ranking tools have notable issues, especially with the indicators adopted. Some are based merely on research performance, whilst others have focused solely on specific fields, such as science and technology - which could have deprived those in the arts and social sciences. This paper uses a narrative review to highlight a number of inconsistencies in the methodologies applied to rank universities. Five main ranking tools commonly applied to the world's universities are reviewed, namely 'Quacquarelli Symonds' (QS), 'Times Higher Education' (THE), 'Academic Ranking of World Universities' (ARWU), 'Leiden University' ranking and 'Webometrics' ranking. We found that several flaws in the rankings caused inconsistencies in university placings in different rankings. Suggestions for integrating multiple criteria and indicators for better ranking exercises are proposed.
AbstractList University rankings have gradually become an issue for concern in the academic community worldwide. Several mechanisms with different methodologies have been developed to rank the universities appropriately. However, some ranking tools have notable issues, especially with the indicators adopted. Some are based merely on research performance, whilst others have focused solely on specific fields, such as science and technology -- which could have deprived those in the arts and social sciences. This paper uses a narrative review to highlight a number of inconsistencies in the methodologies applied to rank universities. Five main ranking tools commonly applied to the world's universities are reviewed, namely "Quacquarelli Symonds" (QS), "Times Higher Education" (THE), "Academic Ranking of World Universities" (ARWU), "Leiden University" ranking and "Webometrics" ranking. We found that several flaws in the rankings caused inconsistencies in university placings in different rankings. Suggestions for integrating multiple criteria and indicators for better ranking exercises are proposed.
Audience Higher Education
Postsecondary Education
Author Mahyuddin Daud
Muhammad Ashraf Fauzi
Christine Nya-Ling Tan
Muhammad Mukhtar Noor Awalludin
Author_xml – sequence: 1
  fullname: Fauzi, Muhammad Ashraf
– sequence: 2
  fullname: Tan, Christine Nya-Ling
– sequence: 3
  fullname: Daud, Mahyuddin
– sequence: 4
  fullname: Awalludin, Muhammad Mukhtar Noor
BackLink http://eric.ed.gov/ERICWebPortal/detail?accno=EJ1243528$$DView record in ERIC
BookMark eNqlj0FrAjEQhZdioWr7EwoLPS8k2d2YeBOxtSL0Us8hZicauybbJCr--4q21FJ6kJ5mmPfeNzOdpGWdhaukjVneyyjhqHXW3ySdEFYIEVQw1E7KmTVb8MHEfeqlfTN2EfrpIPWwNbBLnU7XEJeucrVbGCXrVNdyF26Tay3rAHeftZvMHkevw3E2fXl6Hg6mGZQExYwqSlWlGSZIlXjOCEUFBgpI5hwx3Mu5LHQFvKCVLmklC8SpRJJwqPC8ICzvJg8nbuPd-wZCFCu38fawUpCcY04ZQ_Tguj-5wBslGm_W0u_FaIJJkZdHSv-k-7WJQrm6BhWNs2ElYxAYiTzHVBioZSMFYmWPUYIZ4Zyg8hCenIUPDh1FAOnVUhir3XHq_EJUznyjvoTfsPHlsL_u-oEC0_wDNbkc9deLH04uwuY
ContentType Journal Article
Copyright 2020. This work is licensed under http://creativecommons.org/licenses/by-nd/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Copyright_xml – notice: 2020. This work is licensed under http://creativecommons.org/licenses/by-nd/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
DBID 7SW
BJH
BNH
BNI
BNJ
BNO
ERI
PET
REK
WWN
0-V
3V.
7XB
88B
8FK
ABUWG
AFKRA
AHOVV
ALSLI
AZQEC
BENPR
CCPQU
CJNVE
DWQXO
GNUQQ
M0P
PHGZM
PHGZT
PIMPY
PKEHL
PQEDU
PQEST
PQQKQ
PQUKI
Q9U
DatabaseName ERIC
ERIC (Ovid)
ERIC
ERIC
ERIC (Legacy Platform)
ERIC( SilverPlatter )
ERIC
ERIC PlusText (Legacy Platform)
Education Resources Information Center (ERIC)
ERIC
ProQuest Social Sciences Premium Collection【Remote access available】
ProQuest Central (Corporate)
ProQuest Central (purchase pre-March 2016)
Education Database (Alumni)
ProQuest Central (Alumni) (purchase pre-March 2016)
ProQuest Central (Alumni)
ProQuest Central UK/Ireland
Education Research Index
Social Science Premium Collection
ProQuest Central Essentials - QC
ProQuest Central
ProQuest One Community College
Education Collection
ProQuest Central
ProQuest Central Student
Education Database
ProQuest Central Premium
ProQuest One Academic (New)
Publicly Available Content Database
ProQuest One Academic Middle East (New)
ProQuest One Education
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Academic (retired)
ProQuest One Academic UKI Edition
ProQuest Central Basic
DatabaseTitle ERIC
Publicly Available Content Database
ProQuest One Education
Social Science Premium Collection
Education Collection
ProQuest Central Student
ProQuest One Academic Middle East (New)
ProQuest Central Basic
ProQuest Education Journals
ProQuest Central Essentials
ProQuest One Academic Eastern Edition
ProQuest Central (Alumni Edition)
ProQuest One Community College
ProQuest Central
ProQuest Social Sciences Premium Collection
ProQuest One Academic UKI Edition
ProQuest Central Korea
ProQuest Central (New)
ProQuest One Academic
ProQuest Education Journals (Alumni Edition)
ProQuest One Academic (New)
ProQuest Central (Alumni)
DatabaseTitleList ERIC
Publicly Available Content Database



Database_xml – sequence: 1
  dbid: PIMPY
  name: Publicly Available Content Database
  url: http://search.proquest.com/publiccontent
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Education
EISSN 1837-6290
ERIC EJ1243528
EndPage 96
ExternalDocumentID EJ1243528
10.3316/ielapa.085786218299205
Genre Journal Article
GroupedDBID -W8
.GO
29J
2WC
5GY
5VS
AAHSB
ABUWG
ACGFO
ADBBV
ADMHG
AEGXH
AFKRA
AIAGR
ALMA_UNASSIGNED_HOLDINGS
ALSLI
AZQEC
BCNDV
BENPR
CJNVE
E3Z
EBS
EDJ
EJD
GROUPED_DOAJ
KAE
KAS
KEL
KPA
KPS
KQ8
M0P
OK1
OVT
P2P
PIMPY
QF4
QM7
QN7
RNS
TR2
XSB
7SW
AFFHD
BJH
BNH
BNI
BNJ
BNO
C1A
CCPQU
DWQXO
ERI
GNUQQ
PET
PHGZM
PHGZT
PQEDU
REK
WWN
0-V
3V.
7XB
8FK
AHOVV
PKEHL
PQEST
PQQKQ
PQUKI
Q9U
ID FETCH-LOGICAL-e520t-6c66cdf8120c51b826041e6e0a39081739a4fde946df56da4096a0a29ed1b4283
IEDL.DBID BENPR
ISICitedReferencesCount 59
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000513686500006&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1837-6290
0313-7155
IngestDate Fri Jul 25 09:15:53 EDT 2025
Tue Dec 02 16:53:44 EST 2025
Tue Sep 23 20:07:50 EDT 2025
Wed Sep 24 03:58:57 EDT 2025
Wed Sep 24 03:08:32 EDT 2025
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 1
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-e520t-6c66cdf8120c51b826041e6e0a39081739a4fde946df56da4096a0a29ed1b4283
Notes Issues in Educational Research, Vol. 30, No. 1, Feb 2020: 79-96
IER2.jpg
ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
OpenAccessLink https://www.proquest.com/docview/2391968806?pq-origsite=%requestingapplication%
PQID 2391968806
PQPubID 4676719
PageCount 18
ParticipantIDs rmit_apaft_search_informit_org_doi_10_3316_ielapa_085786218299205
proquest_journals_2391968806
eric_primary_EJ1243528
rmit_aeipt_search_informit_org_doi_10_3316_ielapa_085786218299205
rmit_apaft_search_informit_org_doi_10_3316_informit_085786218299205
rmit_collectionsjats_10_3316_ielapa_085786218299205
rmit_aeipt_search_informit_org_doi_10_3316_informit_085786218299205
PublicationCentury 2000
PublicationDate 2020-01-01
PublicationDateYYYYMMDD 2020-01-01
PublicationDate_xml – month: 01
  year: 2020
  text: 2020-01-01
  day: 01
PublicationDecade 2020
PublicationPlace Perth
PublicationPlace_xml – name: Perth
PublicationTitle Issues in educational research
PublicationYear 2020
Publisher Western Australian Institute for Educational Research Inc
Publisher_xml – name: Western Australian Institute for Educational Research Inc
SSID ssj0020480
Score 2.3928685
Snippet University rankings have gradually become an issue for concern in the academic community worldwide. Several mechanisms with different methodologies have been...
SourceID proquest
eric
rmit
SourceType Aggregation Database
Index Database
Publisher
StartPage 79
SubjectTerms Colleges & universities
Comparative Analysis
Comparative Education
Education
Education, Higher
Educational Indicators
Educational Quality
Evaluation Criteria
Evaluation Methods
Institutional Characteristics
Institutional Evaluation
Methodology
Periodicals
Problems
Quality control
Ratings & rankings
Ratings and rankings
Reputation
Social aspects
Students
Universities
Universities and colleges
Webometrics
Title University rankings: A review of methodological flaws
URI https://search.informit.org/documentSummary;dn=085786218299205;res=IELHSS
https://search.informit.org/documentSummary;res=IELAPA;dn=085786218299205
http://eric.ed.gov/ERICWebPortal/detail?accno=EJ1243528
https://www.proquest.com/docview/2391968806
Volume 30
WOSCitedRecordID wos000513686500006&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAON
  databaseName: DOAJ Directory of Open Access Journals
  customDbUrl:
  eissn: 1837-6290
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0020480
  issn: 1837-6290
  databaseCode: DOA
  dateStart: 20080101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LT9wwEB7RhUMvbSmgbktRDr1aJLFjr3upKFpEq7KKKpDgZDmxjajQ7nYT6N_vTOItrRCPissevIkzmnge32QeAB9Gygflfc6cE5KJUAlmVSEZl04pXeFdrpta8k1NJqPTU13GgFsT0yqXOrFT1G5WU4x8N-caDwueNvlp_pPR1Cj6uhpHaDyDVepUJgaw-nk8Kb__gVxUMd2X6nCmMqrn-zermdzJvyrnO6Ny8PKp5LyCF9GdTPb6978OK376miYxx6yNDShuMi8Sms9OgfGPyV7Sl6wks5D0M6SXOjAJl_ZXswknB-Pj_UMWRyUwX-Rpy2QtZe0CWuu0LrIKMUMqMi99arlGo6-4tiI4r4V0oZDOIqqTNrW59i6rqOfaFgyms6l_A4nVvEbDlgWvKqFrQRfxLIwQSI5qLtQQtoiFZt53wzDjr-giUI-YIWwvWWWiIDTmhk9DoKPbGutRGZpejk3fHRZXZ4tzg0rcICbhPJPmwl-is2Co_z5iLgRBWudpMYT9_9lj-cetXSIlcxueTMnj9riTEt4tk8x3mXfT5odtmwee_fZ-Rr-D5zkFBbo40TYM2sWVfw9r9XV70Sx2ooTsdMEH_D1KS1wrvxyVZ78BuasePQ
linkProvider ProQuest
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1JT9wwFH6iQ6WeoBvqINr60B6tJrFjx5VQhSiIgWE0ByrRk-vENqJCM8MkFPGn-I19zgJUiC5CHHrN8uLkrZ_zFoB3mXReOpdQa7mg3OecGpkKyoSVUuV4l62nlgzlaJQdHqrxAlx2tTAhrbKzibWhttMi7JF_SJhCYUFpE59mpzRMjQp_V7sRGo1Y7LmLc4Rs5frgM_L3fZJsbx1s7tB2qgB1aRJVVBRCFNajY4uKNM4xvI547ISLDML_LJZMGe6tU1xYnwprEAAJE5lEORvnoT0Z0n0EixyFPevB4niwP_56BfFChXZTGsSojEP94K9Z1CF8vVGpXzux7eX_7fWfwlIbLpONRr6fwYKbPA-TptuslBeQXmeWkDB_Pmz8fyQbpCnJIVNPmhnZnY0n_sScly_hy4OsegV6k-nEvQJiFCvQccfeyZyrgoeLWOwzBMpZwbjsw0pgmZ413T701i6GQKEHTh_WOtboVtFLfc2XPgTVrLRxaOx1wxHddL_Fo9P5kUYnpRFzMRYLfexOMBjSYb4AYkoEeUolUdqHzX-h0Z24RaVdycz4e6_k72jcuRJWHw42rc4snJTfTVX-4dmrv__Qb-HJzsH-UA8Ho7016FXzM_caHhc_quNy_qZVSALfHloJfgI1DnQ9
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=University+Rankings%3A+A+Review+of+Methodological+Flaws&rft.jtitle=Issues+in+educational+research&rft.au=Fauzi%2C+Muhammad+Ashraf&rft.au=Tan%2C+Christine+Nya-Ling&rft.au=Daud%2C+Mahyuddin&rft.au=Awalludin%2C+Muhammad+Mukhtar+Noor&rft.date=2020-01-01&rft.pub=Western+Australian+Institute+for+Educational+Research+Inc&rft.issn=1837-6290&rft.volume=30&rft.issue=1&rft.spage=79&rft.externalDocID=EJ1243528
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1837-6290&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1837-6290&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1837-6290&client=summon