Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories

Citations are increasingly used as performance indicators in research policy and within the research system. Usually, citations are assumed to reflect the impact of the research or its quality. What is the justification for these assumptions and how do citations relate to research quality? These and...

Celý popis

Uložené v:

Podrobná bibliografia
Vydané v:	SAGE open Ročník 9; číslo 1
Hlavní autori:	Aksnes, Dag W., Langfeldt, Liv, Wouters, Paul
Médium:	Journal Article
Jazyk:	English
Vydavateľské údaje:	Los Angeles, CA SAGE Publications 01.01.2019 SAGE PUBLICATIONS, INC SAGE Publishing
Predmet:	Basic Skills Bibliometrics Chief executive officers Citations Citations (References) Creativity Evaluation Criteria Evaluation research Justification Law Enforcement Performance indicators Quality Scientific Research Scientometrics Validity evaluation research quality citations metrics indicators bibliometrics
ISSN:	2158-2440, 2158-2440
On-line prístup:	Získať plný text
Tagy:	Pridať tag Žiadne tagy, Buďte prvý, kto otaguje tento záznam!

Abstract	Citations are increasingly used as performance indicators in research policy and within the research system. Usually, citations are assumed to reflect the impact of the research or its quality. What is the justification for these assumptions and how do citations relate to research quality? These and similar issues have been addressed through several decades of scientometric research. This article provides an overview of some of the main issues at stake, including theories of citation and the interpretation and validity of citations as performance measures. Research quality is a multidimensional concept, where plausibility/soundness, originality, scientific value, and societal value commonly are perceived as key characteristics. The article investigates how citations may relate to these various research quality dimensions. It is argued that citations reflect aspects related to scientific impact and relevance, although with important limitations. On the contrary, there is no evidence that citations reflect other key dimensions of research quality. Hence, an increased use of citation indicators in research evaluation and funding may imply less attention to these other research quality dimensions, such as solidity/plausibility, originality, and societal value.
AbstractList	Citations are increasingly used as performance indicators in research policy and within the research system. Usually, citations are assumed to reflect the impact of the research or its quality. What is the justification for these assumptions and how do citations relate to research quality? These and similar issues have been addressed through several decades of scientometric research. This article provides an overview of some of the main issues at stake, including theories of citation and the interpretation and validity of citations as performance measures. Research quality is a multidimensional concept, where plausibility/soundness, originality, scientific value, and societal value commonly are perceived as key characteristics. The article investigates how citations may relate to these various research quality dimensions. It is argued that citations reflect aspects related to scientific impact and relevance, although with important limitations. On the contrary, there is no evidence that citations reflect other key dimensions of research quality. Hence, an increased use of citation indicators in research evaluation and funding may imply less attention to these other research quality dimensions, such as solidity/plausibility, originality, and societal value.
Author	Wouters, Paul Aksnes, Dag W. Langfeldt, Liv
Author_xml	– sequence: 1 givenname: Dag W. orcidid: 0000-0002-1519-195X surname: Aksnes fullname: Aksnes, Dag W. email: Dag.W.Aksnes@nifu.no – sequence: 2 givenname: Liv surname: Langfeldt fullname: Langfeldt, Liv – sequence: 3 givenname: Paul surname: Wouters fullname: Wouters, Paul
BackLink	http://eric.ed.gov/ERICWebPortal/detail?accno=EJ1210859$$DView record in ERIC
BookMark	eNp9UV1LHDEUDWJBa33vixDwtdPmayaJb3ax7RZBFPucJpk7mmWdbJOsxX_frGNVBM1LLueec-6B8x5tj3EEhD5S8plSKb8w2iomBKFaMd3KdgvtbqBmg20_m3fQfs4LUl9LWiHYLvo9C8WWEMf8Cf8f8Xzsg7clpgrasccXkMEmf43P13YZyt0RPh7x2S2k2wB_cRzwV5uDx7M4eliVfK-5vIaYAuQP6N1glxn2H_499OvbyeXsR3N69n0-Oz5tvOC6NHrgTnvtvLCcDK7TgnfSKxAV7IB75XXNL70jjqieSa-1JdJJ8JY7BpLvofnk20e7MKsUbmy6M9EGcw_EdGVsKsEvwVDFOsc6zfu2F51mmjOleu3UwISVPVSvw8lrleKfNeRiFnGdxhrfME651EQLWlkHEwtS8I8XT35SRolqdd2Tae9TzDnB8MihxGxqMy9rq5LuhcQ_dFKSDcu3hM0kzPYKntK-yv8HY1emlA
CitedBy_id	crossref_primary_10_1108_JD_03_2025_0075 crossref_primary_10_1007_s13762_023_04916_7 crossref_primary_10_1093_reseval_rvaa032 crossref_primary_10_1080_09737766_2020_1776651 crossref_primary_10_1016_j_jopan_2024_12_003 crossref_primary_10_3390_ani10071194 crossref_primary_10_1016_j_seares_2023_102386 crossref_primary_10_1007_s10639_024_12801_0 crossref_primary_10_36490_journal_jps_com_v8i2_871 crossref_primary_10_1093_scipol_scab069 crossref_primary_10_1108_IJIS_08_2022_0145 crossref_primary_10_1016_j_joi_2025_101666 crossref_primary_10_1016_j_ribaf_2020_101287 crossref_primary_10_1177_21582440241299614 crossref_primary_10_22282_tojras_1654828 crossref_primary_10_7759_cureus_67950 crossref_primary_10_1016_j_wneu_2021_06_074 crossref_primary_10_3390_su152316386 crossref_primary_10_1108_GKMC_07_2023_0259 crossref_primary_10_3390_su15097609 crossref_primary_10_1016_j_marpolbul_2020_111690 crossref_primary_10_1016_j_compedu_2022_104701 crossref_primary_10_1093_asj_sjac137 crossref_primary_10_3390_rs14174285 crossref_primary_10_1093_asjof_ojae045 crossref_primary_10_1007_s12061_022_09449_z crossref_primary_10_1016_j_worlddev_2021_105729 crossref_primary_10_1080_24711616_2024_2416184 crossref_primary_10_1108_IJPPM_02_2021_0063 crossref_primary_10_26833_ijeg_1544048 crossref_primary_10_1080_1360080X_2020_1730536 crossref_primary_10_1016_j_joi_2024_101489 crossref_primary_10_1016_j_joi_2025_101659 crossref_primary_10_1111_jems_12571 crossref_primary_10_1093_aesa_saaa052 crossref_primary_10_21603_2308_4057_2025_1_629 crossref_primary_10_1007_s11192_021_04158_9 crossref_primary_10_1111_poms_13847 crossref_primary_10_1177_15563316221115723 crossref_primary_10_1007_s42535_023_00699_x crossref_primary_10_1108_BIJ_07_2024_0638 crossref_primary_10_1177_10556656241285812 crossref_primary_10_1108_TRC_09_2024_0050 crossref_primary_10_1007_s11192_021_03894_2 crossref_primary_10_3390_admsci14070156 crossref_primary_10_1080_08989621_2025_2521083 crossref_primary_10_1108_JRIT_01_2024_0016 crossref_primary_10_3389_frma_2021_768428 crossref_primary_10_1177_09610006211063201 crossref_primary_10_1007_s11625_023_01335_y crossref_primary_10_1016_j_avsg_2024_05_028 crossref_primary_10_1108_GKMC_03_2024_0159 crossref_primary_10_1016_j_ribaf_2023_101900 crossref_primary_10_1051_e3sconf_202459301002 crossref_primary_10_1002_cam4_7336 crossref_primary_10_1007_s11192_024_05154_5 crossref_primary_10_1177_21582440241310953 crossref_primary_10_14267_GIKOF_2023_03 crossref_primary_10_17163_alt_v19n2_2024_03 crossref_primary_10_1007_s00146_022_01459_2 crossref_primary_10_1007_s40368_021_00676_5 crossref_primary_10_1007_s11192_025_05272_8 crossref_primary_10_29333_ejgm_11839 crossref_primary_10_1136_bmjopen_2024_091143 crossref_primary_10_1108_JD_01_2021_0010 crossref_primary_10_3390_su16156356 crossref_primary_10_1057_s41264_023_00231_x crossref_primary_10_3389_fonc_2024_1422213 crossref_primary_10_1016_j_crad_2022_07_003 crossref_primary_10_1002_bsd2_70149 crossref_primary_10_1038_s43247_021_00310_8 crossref_primary_10_3390_ani12162058 crossref_primary_10_1007_s11618_024_01265_0 crossref_primary_10_1016_j_respol_2025_105193 crossref_primary_10_1061_JOEEDU_EEENG_7074 crossref_primary_10_1186_s12874_023_02037_w crossref_primary_10_1007_s11192_022_04385_8 crossref_primary_10_4274_ejbh_galenos_2022_2022_3_8 crossref_primary_10_1371_journal_pone_0259453 crossref_primary_10_1080_00330124_2021_1878907 crossref_primary_10_3390_buildings15173196 crossref_primary_10_5194_soil_9_117_2023 crossref_primary_10_1007_s11192_025_05318_x crossref_primary_10_1177_14705931231202430 crossref_primary_10_1016_j_respol_2023_104829 crossref_primary_10_1177_02666669251325463 crossref_primary_10_1007_s11739_022_02939_5 crossref_primary_10_1080_1350178X_2025_2529168 crossref_primary_10_15549_jeecar_v8i4_676 crossref_primary_10_1016_j_envdev_2021_100674 crossref_primary_10_1016_j_urology_2020_10_073 crossref_primary_10_5435_JAAOSGlobal_D_20_00187 crossref_primary_10_3389_fpsyg_2022_1021517 crossref_primary_10_37989_gumussagbil_1608135 crossref_primary_10_1177_21582440221082127 crossref_primary_10_1007_s10805_025_09631_1 crossref_primary_10_1007_s43465_025_01555_7 crossref_primary_10_1177_21582440241251998 crossref_primary_10_5435_JAAOS_D_22_00604 crossref_primary_10_7717_peerj_cs_1752 crossref_primary_10_1007_s11192_020_03633_z crossref_primary_10_3390_s21165408 crossref_primary_10_1016_j_rgmxen_2020_10_008 crossref_primary_10_1080_02508281_2020_1862980 crossref_primary_10_3390_polym14132642 crossref_primary_10_1007_s11192_024_05056_6 crossref_primary_10_1016_j_futures_2024_103329 crossref_primary_10_1371_journal_pone_0293663 crossref_primary_10_1017_S1047951122001780 crossref_primary_10_3390_educsci13020190 crossref_primary_10_1215_00703370_10714127 crossref_primary_10_1108_JSTPM_05_2022_0089 crossref_primary_10_1007_s11192_022_04383_w crossref_primary_10_1051_e3sconf_202564002006 crossref_primary_10_7717_peerj_10927 crossref_primary_10_1007_s11135_023_01665_0 crossref_primary_10_1098_rsos_231521 crossref_primary_10_1002_dac_70014 crossref_primary_10_1016_j_injury_2024_111458 crossref_primary_10_1016_j_joi_2020_101043 crossref_primary_10_1111_jan_16562 crossref_primary_10_17645_pag_v8i2_2575 crossref_primary_10_1108_GKMC_10_2023_0365 crossref_primary_10_1016_j_respol_2022_104538 crossref_primary_10_1080_23311886_2025_2549479 crossref_primary_10_1177_01622439211027648 crossref_primary_10_3390_info13110546 crossref_primary_10_1590_0102_311x00197820 crossref_primary_10_1007_s11292_019_09388_9 crossref_primary_10_15407_visn2019_09_081 crossref_primary_10_1007_s11135_025_02218_3 crossref_primary_10_1016_j_joi_2025_101641 crossref_primary_10_1111_cts_13067 crossref_primary_10_1016_j_sftr_2025_100667 crossref_primary_10_1080_09737766_2021_2017763 crossref_primary_10_3390_sports12100276 crossref_primary_10_1002_adhm_202002222 crossref_primary_10_1007_s11192_022_04372_z crossref_primary_10_1007_s42532_021_00081_8 crossref_primary_10_3390_healthcare10030555 crossref_primary_10_1016_j_neucir_2025_500656 crossref_primary_10_59521_EF52BB6324BD7035 crossref_primary_10_1108_LHT_01_2022_0012 crossref_primary_10_1371_journal_pone_0257340 crossref_primary_10_1016_j_jss_2023_111616 crossref_primary_10_3389_fgene_2024_1467404 crossref_primary_10_3390_ijerph192416549 crossref_primary_10_1017_ehs_2023_6 crossref_primary_10_1007_s00266_023_03752_x crossref_primary_10_1089_tmj_2023_0704 crossref_primary_10_1108_IDD_01_2024_0001 crossref_primary_10_3389_frma_2022_812312 crossref_primary_10_3390_educsci11110730 crossref_primary_10_1108_VJIKMS_03_2024_0085 crossref_primary_10_1371_journal_pone_0290018 crossref_primary_10_1007_s11192_019_03184_y crossref_primary_10_1016_j_joi_2024_101588 crossref_primary_10_3145_epi_2023_may_20 crossref_primary_10_1016_j_heliyon_2024_e39806 crossref_primary_10_3928_01477447_20220719_09 crossref_primary_10_1016_j_procs_2023_10_114 crossref_primary_10_1108_JD_12_2021_0240 crossref_primary_10_1136_bmjopen_2024_096645 crossref_primary_10_1177_01632787211040859 crossref_primary_10_1007_s10653_022_01353_2 crossref_primary_10_5814_j_issn_1674_764x_2023_06_011 crossref_primary_10_1007_s11192_024_05089_x crossref_primary_10_3389_fpsyg_2022_862042 crossref_primary_10_1186_s13643_024_02557_6 crossref_primary_10_1016_j_jbusres_2024_115151 crossref_primary_10_1108_DLP_07_2023_0059 crossref_primary_10_1016_j_dsx_2021_05_033 crossref_primary_10_1108_GKMC_12_2023_0500 crossref_primary_10_1111_hequ_12438 crossref_primary_10_1371_journal_pone_0311493 crossref_primary_10_1002_pra2_1025 crossref_primary_10_1016_j_joi_2020_101094 crossref_primary_10_1136_bmjph_2024_001607 crossref_primary_10_3389_feduc_2025_1619897 crossref_primary_10_1016_j_jinteco_2025_104123 crossref_primary_10_3233_JAD_191281 crossref_primary_10_1017_S0958344023000137 crossref_primary_10_1177_21582440251320538 crossref_primary_10_2147_JPR_S372303 crossref_primary_10_1016_j_digbus_2025_100145 crossref_primary_10_1080_00336297_2023_2237150 crossref_primary_10_1016_j_ijporl_2023_111638 crossref_primary_10_1080_0305764X_2025_2494019 crossref_primary_10_1093_scipol_scae045 crossref_primary_10_1177_10439862231170972 crossref_primary_10_1162_dint_a_00213 crossref_primary_10_1177_10439862231170971 crossref_primary_10_1016_j_gloepi_2025_100192 crossref_primary_10_1016_j_jclepro_2022_134600 crossref_primary_10_1016_j_respol_2024_104974 crossref_primary_10_1108_IJEM_05_2023_0235 crossref_primary_10_1002_nau_24710 crossref_primary_10_1177_0363546520903703 crossref_primary_10_1089_rej_2023_0003 crossref_primary_10_3390_ijms24032048 crossref_primary_10_1177_0734242X241257655 crossref_primary_10_1177_1069397120910982 crossref_primary_10_1016_j_asmr_2021_09_013 crossref_primary_10_1016_j_ecofro_2024_11_007 crossref_primary_10_1080_09544828_2021_1928024 crossref_primary_10_3389_fonc_2022_908487 crossref_primary_10_3989_redc_2021_2_1753 crossref_primary_10_1016_j_jbusres_2022_113624 crossref_primary_10_38159_ehass_2025665 crossref_primary_10_1016_j_jopan_2025_01_017 crossref_primary_10_1016_j_socscimed_2024_116737 crossref_primary_10_1111_anae_15869 crossref_primary_10_1016_j_conbuildmat_2024_135609 crossref_primary_10_1016_j_joi_2021_101159 crossref_primary_10_1016_j_jmgm_2022_108313 crossref_primary_10_1044_2024_AJSLP_24_00321 crossref_primary_10_1080_23808985_2023_2201601 crossref_primary_10_1016_j_joi_2021_101155 crossref_primary_10_1016_j_jopan_2024_09_017 crossref_primary_10_3390_su13020791 crossref_primary_10_1007_s10755_024_09746_0 crossref_primary_10_3390_su141711048 crossref_primary_10_3390_ijerph20031932 crossref_primary_10_1111_edt_12884 crossref_primary_10_1093_reseval_rvad018 crossref_primary_10_22201_iibi_24488321xe_2024_99_58857 crossref_primary_10_3389_fsoc_2025_1502700 crossref_primary_10_3390_bdcc7010012 crossref_primary_10_2478_jdis_2025_0016 crossref_primary_10_1007_s11229_022_03515_2 crossref_primary_10_1177_10439862231175088 crossref_primary_10_1007_s11135_023_01806_5 crossref_primary_10_1016_j_dsx_2023_102898 crossref_primary_10_1016_j_iot_2024_101370 crossref_primary_10_1007_s11192_021_04199_0 crossref_primary_10_3389_frma_2020_628703 crossref_primary_10_3389_fsurg_2022_811023 crossref_primary_10_1016_j_jclinepi_2022_10_004 crossref_primary_10_15561_physcult_2025_0104 crossref_primary_10_1093_reseval_rvz025 crossref_primary_10_20473_rlj_V11_I1_2025_201_214 crossref_primary_10_1016_j_joi_2025_101714 crossref_primary_10_1016_j_joi_2024_101540 crossref_primary_10_1080_00779954_2022_2156382 crossref_primary_10_3390_info15100626 crossref_primary_10_3145_epi_2022_jul_11 crossref_primary_10_1002_asi_70020 crossref_primary_10_1080_2331186X_2025_2457907 crossref_primary_10_1097_JS9_0000000000001022 crossref_primary_10_3748_wjg_v29_i20_3203 crossref_primary_10_1080_14616734_2024_2377733 crossref_primary_10_1007_s11192_022_04303_y crossref_primary_10_1007_s10462_023_10657_3 crossref_primary_10_1007_s42058_024_00163_y crossref_primary_10_1007_s10792_022_02600_2 crossref_primary_10_3390_agronomy15081897 crossref_primary_10_1016_j_ssci_2022_105897 crossref_primary_10_1177_10422587251364809 crossref_primary_10_18267_j_aip_281 crossref_primary_10_1007_s11192_024_05040_0 crossref_primary_10_1016_j_coche_2021_100758 crossref_primary_10_1016_j_joi_2024_101610 crossref_primary_10_1007_s10067_021_05901_6 crossref_primary_10_3390_jrfm17080352 crossref_primary_10_1016_j_forsciint_2024_112066 crossref_primary_10_1007_s12144_021_01947_6 crossref_primary_10_1016_j_hazadv_2025_100630 crossref_primary_10_1016_j_joi_2019_100982 crossref_primary_10_4103_ijcm_ijcm_395_24 crossref_primary_10_1371_journal_pone_0253129 crossref_primary_10_1016_j_dsx_2022_102578 crossref_primary_10_2478_jdis_2025_0030 crossref_primary_10_1007_s11192_022_04567_4 crossref_primary_10_1016_j_joi_2023_101468 crossref_primary_10_1093_scipol_scae004 crossref_primary_10_1080_1091367X_2024_2341849 crossref_primary_10_1109_MCOMSTD_0001_2100080 crossref_primary_10_1111_ejed_12695 crossref_primary_10_3389_fpsyg_2020_643027 crossref_primary_10_1093_reseval_rvab043 crossref_primary_10_1093_reseval_rvac012 crossref_primary_10_3389_fspor_2025_1590858 crossref_primary_10_1007_s11192_024_04939_y crossref_primary_10_1093_reseval_rvac016 crossref_primary_10_1080_00063657_2023_2239553 crossref_primary_10_1016_j_chb_2024_108155 crossref_primary_10_1080_10410236_2022_2163108 crossref_primary_10_1093_jae_ejab008 crossref_primary_10_1007_s11229_023_04342_9 crossref_primary_10_1093_cje_bead001 crossref_primary_10_1016_j_neucie_2025_500656 crossref_primary_10_1590_0001_3765202520240726 crossref_primary_10_1007_s11192_022_04281_1 crossref_primary_10_1080_08820538_2022_2112851 crossref_primary_10_1016_j_joi_2023_101432 crossref_primary_10_1080_0194262X_2023_2242430 crossref_primary_10_3390_insects12020174 crossref_primary_10_1017_S0272263124000743 crossref_primary_10_1016_j_joi_2021_101196 crossref_primary_10_1177_11786302241252733 crossref_primary_10_1007_s11227_025_07230_w crossref_primary_10_1080_19436149_2022_2052466 crossref_primary_10_1007_s11292_024_09618_9 crossref_primary_10_3389_frma_2022_846822 crossref_primary_10_4185_RLCS_2023_1897 crossref_primary_10_1097_SCS_0000000000009108 crossref_primary_10_1371_journal_pone_0313268 crossref_primary_10_1007_s00417_022_05790_8 crossref_primary_10_1001_jamanetworkopen_2021_44742 crossref_primary_10_1111_emre_12495 crossref_primary_10_1109_ACCESS_2023_3309416 crossref_primary_10_29333_ejecs_2030 crossref_primary_10_1016_j_ipm_2022_103252 crossref_primary_10_1073_pnas_2427157122 crossref_primary_10_1177_00494755211050530 crossref_primary_10_3390_buildings13102456 crossref_primary_10_1016_j_foodres_2019_108932 crossref_primary_10_1177_21582440211068491 crossref_primary_10_1007_s11192_021_04163_y crossref_primary_10_1186_s13690_024_01420_3 crossref_primary_10_3390_su142214753 crossref_primary_10_3390_jfb13040210 crossref_primary_10_1007_s11192_022_04300_1 crossref_primary_10_1080_0194262X_2022_2151061 crossref_primary_10_3390_publications11010005 crossref_primary_10_1007_s13132_025_02676_y crossref_primary_10_1002_sd_2166 crossref_primary_10_3390_su15097281 crossref_primary_10_52673_18570461_21_2_61_01 crossref_primary_10_7759_cureus_85946 crossref_primary_10_1128_spectrum_00135_23 crossref_primary_10_1007_s12217_024_10124_w crossref_primary_10_1108_AAAJ_06_2024_7133 crossref_primary_10_1007_s11192_024_05105_0 crossref_primary_10_1162_qss_a_00174 crossref_primary_10_1007_s10462_022_10249_7 crossref_primary_10_1007_s10098_023_02686_x crossref_primary_10_1155_2021_6637516 crossref_primary_10_1080_10632921_2025_2501527 crossref_primary_10_1111_1467_8462_12415 crossref_primary_10_1007_s11192_022_04421_7 crossref_primary_10_3390_su13042038 crossref_primary_10_1016_j_ypmed_2022_107335 crossref_primary_10_1080_2000656X_2020_1858842 crossref_primary_10_3390_world2010008 crossref_primary_10_1016_j_clwas_2025_100292 crossref_primary_10_1007_s00799_022_00326_1 crossref_primary_10_1162_qss_a_00280 crossref_primary_10_1016_j_arthro_2020_09_015 crossref_primary_10_1093_pubmed_fdad039 crossref_primary_10_1371_journal_pone_0320148 crossref_primary_10_1002_rev3_3479 crossref_primary_10_1111_wre_12583 crossref_primary_10_1162_qss_a_00283 crossref_primary_10_1140_epjds_s13688_024_00453_6 crossref_primary_10_1007_s11192_020_03827_5 crossref_primary_10_3390_healthcare13091067 crossref_primary_10_1016_j_jaim_2024_101078 crossref_primary_10_1124_pharmrev_124_000951 crossref_primary_10_3389_frma_2022_850333 crossref_primary_10_3390_su142013074 crossref_primary_10_1080_14783363_2020_1847638 crossref_primary_10_3390_app14177660 crossref_primary_10_4081_jlimnol_2021_2042 crossref_primary_10_1007_s10844_022_00698_5 crossref_primary_10_1016_j_heliyon_2024_e39315 crossref_primary_10_1007_s11024_024_09534_2 crossref_primary_10_1038_s41593_020_0658_y crossref_primary_10_1002_rev3_3486 crossref_primary_10_1016_j_arth_2023_05_085 crossref_primary_10_3389_feduc_2025_1597121 crossref_primary_10_1007_s11192_025_05268_4 crossref_primary_10_1007_s43465_025_01528_w crossref_primary_10_1162_qss_a_00159 crossref_primary_10_7759_cureus_31048 crossref_primary_10_1007_s43621_025_01540_y crossref_primary_10_1108_ER_07_2024_0377 crossref_primary_10_1007_s11192_021_04173_w crossref_primary_10_1111_ceo_14109 crossref_primary_10_1257_aer_20211811 crossref_primary_10_3390_ijms21155576 crossref_primary_10_1080_10758216_2024_2386995 crossref_primary_10_1177_09610006221106178 crossref_primary_10_1093_reseval_rvae054 crossref_primary_10_1073_pnas_2322462121 crossref_primary_10_1108_AJIM_11_2023_532 crossref_primary_10_1080_00131911_2021_1984214 crossref_primary_10_1016_j_ecolind_2023_110968 crossref_primary_10_1007_s11192_021_04217_1 crossref_primary_10_3390_publications9010012 crossref_primary_10_1111_soc4_13189 crossref_primary_10_3390_publications13020029 crossref_primary_10_1007_s11192_021_04160_1 crossref_primary_10_1002_bse_70198 crossref_primary_10_1016_j_imr_2025_101181 crossref_primary_10_1002_jor_25588 crossref_primary_10_1016_j_rser_2025_115454 crossref_primary_10_1016_j_joi_2022_101337 crossref_primary_10_1080_08098131_2025_2525566 crossref_primary_10_2478_bhk_2023_0008 crossref_primary_10_1080_21645515_2024_2424611 crossref_primary_10_2478_jdis_2024_0032 crossref_primary_10_1007_s11192_020_03388_7 crossref_primary_10_4000_13k0e crossref_primary_10_1093_reseval_rvae045 crossref_primary_10_1111_1467_8454_12263 crossref_primary_10_1016_j_jval_2020_01_012 crossref_primary_10_1111_beer_12513 crossref_primary_10_3389_frma_2023_1215401 crossref_primary_10_31893_multirev_2025206 crossref_primary_10_1108_IDD_07_2024_0112 crossref_primary_10_1177_21582440211009191 crossref_primary_10_3390_w16071017 crossref_primary_10_3389_fsurg_2022_845946 crossref_primary_10_1108_GKMC_07_2024_0458 crossref_primary_10_3389_fneur_2024_1343303 crossref_primary_10_1177_01655515231151411 crossref_primary_10_1097_SLA_0000000000003633 crossref_primary_10_1177_21582440251356017 crossref_primary_10_1093_reseval_rvae038 crossref_primary_10_1134_S2079086424600875 crossref_primary_10_1007_s10669_025_10010_9 crossref_primary_10_1162_qss_a_00089 crossref_primary_10_1007_s00283_021_10146_x crossref_primary_10_1108_JHTI_01_2025_0104 crossref_primary_10_58768_joinntt_1636695 crossref_primary_10_1007_s11192_025_05421_z crossref_primary_10_1016_j_seps_2023_101668 crossref_primary_10_3389_fmed_2025_1573512 crossref_primary_10_1177_08912416231190911 crossref_primary_10_1186_s41073_023_00137_1 crossref_primary_10_1007_s11192_025_05237_x crossref_primary_10_1016_j_techfore_2021_121347 crossref_primary_10_1177_25152459251351287 crossref_primary_10_1108_VJIKMS_10_2022_0339 crossref_primary_10_1002_asi_24810 crossref_primary_10_1016_j_tbs_2022_08_012 crossref_primary_10_1038_s44183_023_00020_y crossref_primary_10_1002_asi_24939 crossref_primary_10_3390_su132011516 crossref_primary_10_3389_fimmu_2022_1096806 crossref_primary_10_3389_fmed_2024_1452227 crossref_primary_10_12944_CWE_16_3_26 crossref_primary_10_1111_jnu_12827 crossref_primary_10_3390_su16198670 crossref_primary_10_1016_j_ecss_2025_109184 crossref_primary_10_1097_MD_0000000000037459 crossref_primary_10_2139_ssrn_3802541 crossref_primary_10_1109_ACCESS_2022_3161639 crossref_primary_10_1371_journal_pone_0255604 crossref_primary_10_3390_publications11020032 crossref_primary_10_1002_eat_23774 crossref_primary_10_1007_s11024_020_09419_0 crossref_primary_10_1007_s11192_025_05311_4 crossref_primary_10_3390_plants12233947 crossref_primary_10_1016_j_system_2025_103832 crossref_primary_10_1093_reseval_rvae018 crossref_primary_10_3917_ecofi_143_0123 crossref_primary_10_1016_j_heliyon_2024_e33940 crossref_primary_10_1177_21582440251335473 crossref_primary_10_1007_s11192_024_05004_4 crossref_primary_10_1186_s13321_022_00617_4 crossref_primary_10_1186_s41239_024_00452_7 crossref_primary_10_1016_j_placenta_2021_07_003 crossref_primary_10_1073_pnas_2312468120 crossref_primary_10_1093_trstmh_trab161 crossref_primary_10_1108_AJIM_11_2024_0927 crossref_primary_10_1080_2331186X_2024_2415740 crossref_primary_10_1007_s00187_019_00287_8 crossref_primary_10_1016_j_omega_2024_103226 crossref_primary_10_1007_s11192_024_05080_6 crossref_primary_10_2478_scr_2023_0003 crossref_primary_10_1108_JD_01_2022_0022 crossref_primary_10_1108_JD_10_2023_0201 crossref_primary_10_1108_GKMC_06_2024_0362 crossref_primary_10_1177_01655515211006588 crossref_primary_10_1057_s41307_022_00294_w crossref_primary_10_3390_app12168275 crossref_primary_10_3390_publications12040030 crossref_primary_10_3390_publications12040035 crossref_primary_10_1016_j_heliyon_2022_e09510 crossref_primary_10_1371_journal_pone_0253847 crossref_primary_10_3390_f15030513 crossref_primary_10_1016_j_wneu_2021_07_039 crossref_primary_10_1051_e3sconf_202450101017 crossref_primary_10_1108_JD_02_2022_0039 crossref_primary_10_1038_s41598_025_95264_8 crossref_primary_10_1093_icc_dtae027 crossref_primary_10_1108_MD_05_2022_0698 crossref_primary_10_3390_w17030322 crossref_primary_10_1080_09593969_2020_1833961 crossref_primary_10_1007_s11192_020_03649_5 crossref_primary_10_1177_20539517231180577 crossref_primary_10_3389_fneur_2024_1466186 crossref_primary_10_1007_s11192_022_04486_4 crossref_primary_10_1016_j_wneu_2022_01_108 crossref_primary_10_1007_s10098_024_03096_3 crossref_primary_10_1097_TP_0000000000004224 crossref_primary_10_1108_JD_06_2020_0093 crossref_primary_10_1108_OIR_01_2021_0029 crossref_primary_10_1162_qss_a_00322 crossref_primary_10_1111_myc_13803 crossref_primary_10_3758_s13423_025_02727_0 crossref_primary_10_1089_bio_2023_0112 crossref_primary_10_1007_s11135_022_01480_z crossref_primary_10_1051_bioconf_20237501001 crossref_primary_10_1016_j_ipm_2025_104123 crossref_primary_10_2196_34051 crossref_primary_10_1080_13698249_2023_2185377 crossref_primary_10_30935_mjosbr_10805 crossref_primary_10_1007_s13412_024_00928_y crossref_primary_10_1017_S0272263125100909 crossref_primary_10_1080_09593985_2022_2073927 crossref_primary_10_1051_shsconf_202214901010 crossref_primary_10_1007_s11192_020_03419_3 crossref_primary_10_3389_fpsyg_2020_01941 crossref_primary_10_1007_s11192_022_04509_0 crossref_primary_10_1002_leap_1571 crossref_primary_10_1002_leap_1572 crossref_primary_10_7759_cureus_21762 crossref_primary_10_1007_s11192_024_04977_6 crossref_primary_10_1097_SCS_0000000000007804 crossref_primary_10_7759_cureus_33978 crossref_primary_10_1016_j_pec_2023_107887 crossref_primary_10_1108_JIMA_11_2022_0302 crossref_primary_10_1002_er_6907 crossref_primary_10_3389_fonc_2023_1197168 crossref_primary_10_1016_j_aimed_2025_100506 crossref_primary_10_3390_healthcare11091267 crossref_primary_10_1016_j_ssci_2023_106198 crossref_primary_10_1098_rsos_220334 crossref_primary_10_1891_JBSW_20221130_16 crossref_primary_10_62186_001c_129134 crossref_primary_10_1002_asi_24754 crossref_primary_10_1016_j_ejwf_2023_05_003 crossref_primary_10_31482_mmsl_2023_043 crossref_primary_10_1007_s10805_024_09539_2 crossref_primary_10_1108_GKMC_12_2023_0493 crossref_primary_10_3390_ijerph19148845 crossref_primary_10_3389_fmed_2024_1492396 crossref_primary_10_47909_ijsmc_38 crossref_primary_10_1145_3726531 crossref_primary_10_1140_epjds_s13688_023_00439_w crossref_primary_10_1097_MD_0000000000030328 crossref_primary_10_12688_f1000research_22390_2 crossref_primary_10_3389_frma_2020_569268 crossref_primary_10_1007_s11192_024_05103_2 crossref_primary_10_1016_j_ejim_2022_08_014 crossref_primary_10_1108_BFJ_10_2024_1114 crossref_primary_10_1162_qss_a_00130 crossref_primary_10_3389_feduc_2025_1557964 crossref_primary_10_1016_j_jbusres_2023_114432 crossref_primary_10_1080_21645515_2024_2426869 crossref_primary_10_1007_s00520_023_07645_2 crossref_primary_10_1007_s11192_023_04867_3 crossref_primary_10_1007_s40200_023_01199_0 crossref_primary_10_1016_j_dendro_2024_126202 crossref_primary_10_1108_JMH_05_2023_0047 crossref_primary_10_3390_ijms23031562 crossref_primary_10_1080_10548408_2025_2495572 crossref_primary_10_1016_j_resconrec_2021_105461 crossref_primary_10_1080_23311886_2024_2306715 crossref_primary_10_4103_ijpvm_ijpvm_162_24 crossref_primary_10_2174_0929867328666211108110731 crossref_primary_10_1016_j_techfore_2023_122634 crossref_primary_10_1162_qss_a_00241 crossref_primary_10_48119_toleho_878332 crossref_primary_10_1002_jcv2_12235 crossref_primary_10_1162_qss_a_00119 crossref_primary_10_4103_njcp_njcp_1592_21 crossref_primary_10_3389_fpsyg_2024_1427478 crossref_primary_10_1108_JAAR_10_2024_0392 crossref_primary_10_1016_j_entcom_2023_100613 crossref_primary_10_1007_s11192_020_03417_5 crossref_primary_10_1162_qss_a_00117 crossref_primary_10_1111_jne_13430 crossref_primary_10_1007_s11301_024_00455_8 crossref_primary_10_1108_QRJ_06_2023_0091 crossref_primary_10_3390_su15021035 crossref_primary_10_3390_ijerph18073370 crossref_primary_10_1002_asi_24767 crossref_primary_10_1002_gch2_202200009 crossref_primary_10_1007_s11192_022_04409_3 crossref_primary_10_1021_acs_jchemed_4c01120 crossref_primary_10_1177_08295735211045548 crossref_primary_10_12688_f1000research_140810_2 crossref_primary_10_12688_f1000research_140810_1 crossref_primary_10_12688_f1000research_141422_1 crossref_primary_10_1016_j_ijedudev_2024_103075 crossref_primary_10_1142_S1094406024500070 crossref_primary_10_3389_fmed_2025_1606786
Cites_doi	10.1148/radiol.09090626 10.1002/aris.2007.1440410120 10.1111/j.1464-5491.2005.01753.x 10.1016/S0021-9258(19)52451-6 10.1016/j.joi.2016.04.006 10.1016/j.joi.2010.02.003 10.7551/mitpress/9445.003.0006 10.1016/j.ipm.2010.09.005 10.1038/520429a 10.1371/journal.pbio.1001675 10.1093/reseval/rvs019 10.1007/s11192-011-0354-5 10.1007/BF02017249 10.1108/EUM0000000007207 10.1016/S0140-6736(94)91755-8 10.1038/sj.bjc.6604405 10.1177/016555150002600607 10.1007/BF02129602 10.1371/journal.pone.0134164 10.1007/BF01101453 10.1080/03075070903348404 10.3389/fpsyg.2015.01152 10.1007/s11192-014-1499-9 10.1108/eb026920 10.1016/j.joi.2010.08.001 10.1371/journal.pmed.0020124 10.1093/reseval/rvs001 10.1007/s11192-016-2150-8 10.1007/BF02129604 10.1007/BF02019306 10.1016/j.joi.2010.10.009 10.4135/9781473978782 10.1086/683652 10.1002/asi.22784 10.1016/0048-7333(83)90005-7 10.1007/s11192-016-2056-5 10.1016/j.joi.2016.02.007 10.1007/s11192-005-0007-7 10.1093/scipol/scu083 10.1007/bf02458496 10.1002/(SICI)1097-4571(199710)48:10<962::AID-ASI13>3.0.CO;2-X 10.3109/17453679809000920 10.1016/j.joi.2011.02.001 10.1242/dmm.012955 10.1002/asi.21018 10.1016/s0048-7333(99)00040-2 10.1007/BF02017065 10.1007/BF02461121 10.1093/rev/3.3.151 10.1556/Scient.67.2006.3.10 10.4159/9780674054158 10.1038/514550a 10.1515/jdis-2017-0002 10.1093/reseval/rvv038 10.3152/095820211x13118583635756 10.1073/pnas.1212247109 10.1002/asi.20609 10.1002/asi.23505 10.1007/BF02016664 10.1002/(SICI)1097-4571(198909)40:5<342::AID-ASI7>3.0.CO;2-U 10.1007/s11192-012-0913-4 10.1093/oso/9780195323573.001.0001 10.1177/030631277700700112 10.1007/1-4020-2755-9_2 10.1002/asi.22803 10.3152/147154404781776563 10.1007/BF02129599 10.1007/s11192-009-0035-9 10.1038/embor.2012.99 10.1371/journal.pone.0005738 10.1007/s11192-016-1895-4 10.1016/j.joi.2009.04.001 10.1371/journal.pbio.1002542 10.1038/415731a 10.1002/asi.23009 10.1016/0048-7333(89)90016-4 10.1177/030631277800800305 10.1007/s11024-015-9274-5 10.1111/j.1398-9995.1997.tb00175.x 10.1073/pnas.0507655102 10.1007/s11192-016-1929-y 10.1016/j.respol.2009.02.001 10.1002/aris.2011.1440450112 10.1002/asi.22775 10.1007/978-3-319-09785-5_16 10.1108/00220411311295360 10.3152/095820211x13118583635693 10.1126/science.159.3810.56 10.3152/147154403781776645 10.1371/journal.pone.0068258 10.1007/s11192-011-0352-7 10.1007/BF02017064 10.1136/bmj.320.7242.1107 10.1007/s11192-015-1798-9 10.1093/reseval/rvt008 10.1007/s11192-009-0411-5 10.1177/0193841x14524957 10.1016/S0048-7333(98)00026-2 10.1108/00220410810844150 10.1007/BF02461120 10.1007/s00296-011-2276-1 10.3389/fpsyg.2017.00523 10.1016/0968-0004(89)90163-1 10.1093/reseval/rvv008 10.1126/science.149.3683.510 10.1073/pnas.1502280112 10.1023/a:1014243832084 10.1002/asi.21256 10.1016/j.respol.2015.11.009 10.1016/j.joi.2013.04.001 10.1533/9781780630250 10.1007/bf02163625 10.1007/978-1-349-07408-2_5
ContentType	Journal Article
Copyright	The Author(s) 2019 The Author(s) 2019. This work is licensed under the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Copyright_xml	– notice: The Author(s) 2019 – notice: The Author(s) 2019. This work is licensed under the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
DBID	AFRWT AAYXX CITATION 7SW BJH BNH BNI BNJ BNO ERI PET REK WWN 0-V 3V. 7XB 88J 8FK ABUWG AFKRA ALSLI AZQEC BENPR CCPQU DWQXO GNUQQ M2R PHGZM PHGZT PIMPY PKEHL POGQB PQEDU PQEST PQQKQ PQUKI PRINS PRQQA Q9U DOA
DOI	10.1177/2158244019829575
DatabaseName	Sage Journals GOLD Open Access 2024 CrossRef ERIC ERIC (Ovid) ERIC ERIC ERIC (Legacy Platform) ERIC( SilverPlatter ) ERIC ERIC PlusText (Legacy Platform) Education Resources Information Center (ERIC) ERIC ProQuest Social Sciences Premium Collection ProQuest Central (Corporate) ProQuest Central (purchase pre-March 2016) Social Science Database (Alumni Edition) ProQuest Central (Alumni) (purchase pre-March 2016) ProQuest Central (Alumni Edition) ProQuest Central UK/Ireland Social Science Premium Collection ProQuest Central Essentials ProQuest Central ProQuest One Community College ProQuest Central Korea ProQuest Central Student Social Science Database ProQuest Central Premium ProQuest One Academic (New) Publicly Available Content Database (ProQuest) ProQuest One Academic Middle East (New) ProQuest Sociology & Social Sciences Collection ProQuest One Education ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Academic (retired) ProQuest One Academic UKI Edition ProQuest Central China ProQuest One Social Sciences ProQuest Central Basic DOAJ Directory of Open Access Journals
DatabaseTitle	CrossRef ERIC Publicly Available Content Database ProQuest One Education Social Science Premium Collection ProQuest Sociology & Social Sciences Collection ProQuest One Social Sciences ProQuest Central Student ProQuest One Academic Middle East (New) ProQuest Central Basic ProQuest Central Essentials ProQuest One Academic Eastern Edition ProQuest Social Science Journals (Alumni Edition) ProQuest Central (Alumni Edition) ProQuest One Community College Sociology & Social Sciences Collection ProQuest Central China ProQuest Central ProQuest Social Science Journals ProQuest Social Sciences Premium Collection ProQuest One Academic UKI Edition ProQuest Central Korea ProQuest Central (New) ProQuest One Academic ProQuest One Academic (New) ProQuest Central (Alumni)
DatabaseTitleList	Publicly Available Content Database CrossRef ERIC
Database_xml	– sequence: 1 dbid: DOA name: DOAJ Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: PIMPY name: ProQuest Publicly Available Content Database url: http://search.proquest.com/publiccontent sourceTypes: Aggregation Database
DeliveryMethod	fulltext_linktorsrc
Discipline	Social Sciences (General)
EISSN	2158-2440
ERIC	EJ1210859
ExternalDocumentID	oai_doaj_org_article_1826b2693d5d469293288d9b8f24a7de EJ1210859 10_1177_2158244019829575 10.1177_2158244019829575
GrantInformation_xml	– fundername: Norges Forskningsråd grantid: 256223 funderid: https://doi.org/10.13039/501100005416
GroupedDBID	0-V 01A 0R~ 54M 5VS 5WV AAFWJ AAJPV AASGM AAUIH ABAWP ABDBF ABOPQ ABOWD ABQXT ABUWG ACCJX ACGFO ACGFS ACROE ADBBV ADOGD AEGGN AEONT AEUHG AEVXP AEWDL AFCOW AFKRA AFKRG AFPKN AFRWT AGUGZ AHHCN AJUZI ALMA_UNASSIGNED_HOLDINGS ALNCK ALSLI ALZUE ARALO ARBYP ARYUH ATKJL AUTPY AZFZN AZQEC BCNDV BDZRT BENPR BMVBW BPHCQ CCPQU DWQXO EBS EF0 EJD GNUQQ GROUPED_DOAJ GROUPED_SAGE_PREMIER_JOURNAL_COLLECTION H13 HVGLF IPNFZ J8X KQ8 M2R M~E O9- OK1 PHGZM PHGZT PIMPY PQQKQ RIG RNS ROL S01 SAUOL SCDPB SCNPE SFC SJN Y4B AAYXX ACHEB AFFHD CITATION PQEDU PRQQA 7SW AGMQJ BJH BNH BNI BNJ BNO ERI PET REK WWN 3V. 7XB 8FK PKEHL POGQB PQEST PQUKI PRINS Q9U
ID	FETCH-LOGICAL-c439t-9f3b9c9bc4a30fb694367c8e49c96e3c8c94407cb0b08d27c99a07b7eca3b2e73
IEDL.DBID	BENPR
ISICitedReferencesCount	702
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000458649200001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	2158-2440
IngestDate	Tue Oct 14 19:08:01 EDT 2025 Sat Nov 15 00:11:34 EST 2025 Tue Dec 02 16:45:24 EST 2025 Sat Nov 29 08:12:43 EST 2025 Tue Nov 18 21:13:33 EST 2025 Tue Jun 17 22:28:32 EDT 2025
IsDoiOpenAccess	true
IsOpenAccess	true
IsPeerReviewed	true
IsScholarly	true
Issue	1
Keywords	evaluation research quality citations metrics indicators bibliometrics
Language	English
License	This article is distributed under the terms of the Creative Commons Attribution 4.0 License (http://www.creativecommons.org/licenses/by/4.0/) which permits any use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access pages (https://us.sagepub.com/en-us/nam/open-access-at-sage).
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c439t-9f3b9c9bc4a30fb694367c8e49c96e3c8c94407cb0b08d27c99a07b7eca3b2e73
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14
ORCID	0000-0002-1519-195X
OpenAccessLink	https://www.proquest.com/docview/2313790941?pq-origsite=%requestingapplication%
PQID	2313790941
PQPubID	4451069
PageCount	17
ParticipantIDs	doaj_primary_oai_doaj_org_article_1826b2693d5d469293288d9b8f24a7de proquest_journals_2313790941 eric_primary_EJ1210859 crossref_primary_10_1177_2158244019829575 crossref_citationtrail_10_1177_2158244019829575 sage_journals_10_1177_2158244019829575
PublicationCentury	2000
PublicationDate	2019-01-01
PublicationDateYYYYMMDD	2019-01-01
PublicationDate_xml	– month: 01 year: 2019 text: 2019-01-01 day: 01
PublicationDecade	2010
PublicationPlace	Los Angeles, CA
PublicationPlace_xml	– name: Los Angeles, CA – name: Thousand Oaks
PublicationTitle	SAGE open
PublicationYear	2019
Publisher	SAGE Publications SAGE PUBLICATIONS, INC SAGE Publishing
Publisher_xml	– name: SAGE Publications – name: SAGE PUBLICATIONS, INC – name: SAGE Publishing
References	Voos, Dagaev 1976; 1 Harzing, Alakangas 2016; 106 Waltman, van Eck 2013; 96 Hornbostel, Bohmer, Klingsporn, Neufeld, von Ins 2009; 79 van Raan 1993; 3 van Raan 2017; 2 Aksnes 2003; 12 de Rijcke, Wouters, Rushforth, Franssen, Hammarfelt 2016; 25 Bornmann 2013; 64 Rushforth, de Rijcke 2015; 53 Meyer 2000; 29 Willett 2013; 69 Waltman, van Eck, van Leeuwen, Visser, van Raan 2011; 87 Amsterdamska, Leydesdorff 1989; 15 Gulbrandsen 2000 Lee, Sugimoto, Zhang, Cronin 2013; 64 Warner 2000; 26 Hanney, Home, Frame, Grant, Green, Buxton 2006; 23 Garfield 1997; 48 Camacho-Minano, Nunez-Nickel 2009; 60 Bornmann 2012; 13 Seglen 1997; 52 Luukkonen 2012; 21 Cabezas-Clavijo, Robinson-Garcia, Escabias, Jimenez-Contreras 2013; 8 Hemlin 1991 Moed 2002; 415 Hirsch 2005; 102 Winnink, Tijssen, van Raan 2016; 67 Lowry, Rosebrough, Farr, Randal 1951; 193 Martensson, Fors, Wallin, Zander, Nilsson 2016; 45 MacRoberts, MacRoberts 1989; 40 Thornley, Watkinson, Nicholas, Volentine, Jamali, Herman, Tenopir 2015; 20 Van Noorden, Maher, Nuzzo 2014; 514 Gingras, Wallace 2010; 82 Liu 1993; 49 le Pair 1995; 20 Hug, Ochsner, Daniel 2013; 22 Opthof, Leydesdorff 2010; 4 Langfeldt, Benner, Sivertsen, Kristiansen, Aksnes, Borlaug, Pelkonen 2015; 42 Eyre-Walker, Stoletzki 2013; 11 Marx, Bornmann 2015; 102 Hellqvist 2010; 61 Polanyi 1962; 1 Ancaiani, Anfossi, Barbara, Benedetto, Blasi, Carletti, Sileoni 2015; 24 Martin 2011; 20 Fang, Steen, Casadevall 2012; 109 Levitt, Thelwall 2011; 47 Nicolaisen 2007; 41 Oppenheim 1997; 53 Martin 1996; 36 Durieux, Gevenois 2010; 255 Leydesdorff 1989; 18 Grant, Cottrell, Cluzeau, Fawcett 2000 Bornmann, Daniel 2007; 58 Gilbert 1977; 7 Luukkonen 1997; 38 Waltman, van Eck, van Leeuwen, Visser, van Raan 2011; 5 Catalini, Lacetera, Oettl 2015; 112 van Raan 1996; 36 Lewison, Sullivan 2008; 98 Leydesdorff, Wouters, Bornmann 2016; 109 Lariviere, Gingras 2011; 5 Small 1978; 8 Cagan 2013; 6 Cozzens 1989; 15 Wouters 1999; 44 Ioannidis 2005; 2 Ioannidis, Boyack, Wouters 2016; 14 Weingart 2004; 62 Seglen 1998; 69 Bazeley 2010; 35 Ossenblok, Engels, Sivertsen 2012; 21 Waltman 2016; 10 Aksnes, Rip 2009; 38 Garfield 1979; 1 Donovan, Hanney 2011; 20 Abramo, D’Angelo 2016; 10 Waltman, van Eck, Wouters 2013; 7 Carlsson 2009; 64 Wagner, Horlings, Whetsell, Mattsson, Nordqvist 2015; 10 Waltman, Schreiber 2013; 64 Alonso, Cabrerizo, Herrera-Viedma, Herrera 2009; 3 Bornmann, Mutz 2011; 5 Rinia, van Leeuwen, van Vuren, van Raan 1998; 27 Bornmann, Daniel 2008; 64 MacRoberts, MacRoberts 1996; 36 Merton 1968; 159 Piro, Sivertsen 2016; 109 Garfield, Welljams-Dorof 1992; 13 Schubert, Glänzel, Braun 1987; 12 Luukkonen 1990 Rip 1997; 38 Osterloh, Frey 2015; 39 Abramo, D’Angelo 2011; 87 Lee 2015; 82 Pedersen, Kjekshus, Berg, Haghfelt, Faergeman, Thorgeirsson, Grundstrom 1994; 344 Hicks, Wouters, Waltman, de Rijcke, Rafols 2015; 520 Martin, Irvine 1983; 12 Price 1965; 149 Baccini, De Nicolao 2016; 108 Schubert, Braun 1986; 9 Smith 1981; 30 Jones, Hanney 2016; 107 van Raan 2006; 67 Bornmann, Marx, Gasparyan, Kitas 2012; 32 Aksnes, Taxt 2004; 13 Glaser, Laudel 2001; 52 Seglen 1989; 14 Bornmann 2011; 45 bibr84-2158244019829575 bibr76-2158244019829575 bibr125-2158244019829575 bibr33-2158244019829575 bibr25-2158244019829575 Biagioli M. (bibr13-2158244019829575) bibr109-2158244019829575 bibr17-2158244019829575 bibr141-2158244019829575 bibr100-2158244019829575 bibr2-2158244019829575 bibr51-2158244019829575 bibr94-2158244019829575 bibr107-2158244019829575 bibr68-2158244019829575 bibr133-2158244019829575 bibr131-2158244019829575 bibr78-2158244019829575 bibr123-2158244019829575 bibr99-2158244019829575 bibr102-2158244019829575 bibr15-2158244019829575 bibr86-2158244019829575 bibr96-2158244019829575 bibr105-2158244019829575 bibr10-2158244019829575 bibr23-2158244019829575 Cole S (bibr29-2158244019829575) 2000 bibr31-2158244019829575 bibr110-2158244019829575 le Pair C (bibr71-2158244019829575) 1995; 20 bibr89-2158244019829575 Cole J. R. (bibr27-2158244019829575) 1973 bibr46-2158244019829575 bibr97-2158244019829575 bibr63-2158244019829575 bibr20-2158244019829575 bibr38-2158244019829575 bibr62-2158244019829575 bibr54-2158244019829575 bibr47-2158244019829575 bibr88-2158244019829575 bibr21-2158244019829575 bibr111-2158244019829575 Chubin D. E. (bibr26-2158244019829575) 1990 Luukkonen T. (bibr80-2158244019829575) 1997 bibr137-2158244019829575 bibr12-2158244019829575 bibr103-2158244019829575 bibr129-2158244019829575 bibr90-2158244019829575 bibr19-2158244019829575 Pedersen T. R. (bibr101-2158244019829575) 1994; 344 Garfield E. (bibr41-2158244019829575) 1977; 1 bibr35-2158244019829575 bibr106-2158244019829575 bibr6-2158244019829575 bibr82-2158244019829575 bibr130-2158244019829575 bibr43-2158244019829575 bibr9-2158244019829575 bibr40-2158244019829575 Garfield E. (bibr42-2158244019829575) 1979 bibr69-2158244019829575 bibr66-2158244019829575 Carlsson H. (bibr24-2158244019829575) 2009; 64 bibr74-2158244019829575 Traag V. (bibr118-2158244019829575) 2018 bibr114-2158244019829575 bibr3-2158244019829575 bibr93-2158244019829575 bibr108-2158244019829575 bibr67-2158244019829575 bibr134-2158244019829575 bibr75-2158244019829575 bibr126-2158244019829575 bibr77-2158244019829575 bibr124-2158244019829575 Cole S. (bibr28-2158244019829575) 1992 bibr34-2158244019829575 Thornley C. (bibr117-2158244019829575) 2015; 20 bibr85-2158244019829575 Wouters P. (bibr145-2158244019829575) bibr16-2158244019829575 Dymond L. H. (bibr36-2158244019829575) 2015 bibr59-2158244019829575 bibr142-2158244019829575 bibr52-2158244019829575 bibr60-2158244019829575 Luukkonen T. (bibr79-2158244019829575) 1990 Aksnes D. W. (bibr4-2158244019829575) 2005 bibr65-2158244019829575 bibr136-2158244019829575 bibr49-2158244019829575 van Raan A. F. J (bibr122-2158244019829575) 2000 bibr73-2158244019829575 bibr128-2158244019829575 bibr39-2158244019829575 bibr83-2158244019829575 bibr91-2158244019829575 bibr5-2158244019829575 Moed H. F. (bibr95-2158244019829575) 2005 bibr44-2158244019829575 bibr70-2158244019829575 bibr18-2158244019829575 bibr57-2158244019829575 bibr112-2158244019829575 bibr104-2158244019829575 bibr120-2158244019829575 bibr139-2158244019829575 bibr11-2158244019829575 Gulbrandsen J. M. (bibr50-2158244019829575) 2000 Holden G. (bibr58-2158244019829575) 2005 bibr8-2158244019829575 bibr113-2158244019829575 Smith L. C. (bibr116-2158244019829575) 1981; 30 bibr64-2158244019829575 Wouters P. (bibr144-2158244019829575) 2014 bibr37-2158244019829575 bibr121-2158244019829575 bibr146-2158244019829575 bibr98-2158244019829575 bibr81-2158244019829575 bibr7-2158244019829575 bibr72-2158244019829575 Voos H. (bibr127-2158244019829575) 1976; 1 bibr14-2158244019829575 Hemlin S. (bibr55-2158244019829575) 1991 bibr1-2158244019829575 bibr22-2158244019829575 bibr30-2158244019829575 bibr119-2158244019829575 Small H. G. (bibr115-2158244019829575) 1982; 3 bibr56-2158244019829575 bibr143-2158244019829575 bibr45-2158244019829575 bibr53-2158244019829575 bibr132-2158244019829575 bibr135-2158244019829575 Cronin B. (bibr32-2158244019829575) 1984 Merton R. K. (bibr92-2158244019829575) 1979 bibr140-2158244019829575 bibr61-2158244019829575 Welljams-Dorof A. (bibr138-2158244019829575) 1997 bibr48-2158244019829575 bibr87-2158244019829575
References_xml	– volume: 107 start-page: 975 year: 2016 end-page: 1003 article-title: Tracing the indirect societal impacts of biomedical research: Development and piloting of a technique based on citations publication-title: Scientometrics – volume: 12 start-page: 159 year: 2003 end-page: 170 article-title: Characteristics of highly cited papers publication-title: Research Evaluation – year: 2000 article-title: Evaluating “payback” on biomedical research from papers cited in clinical guidelines: Applied bibliometric study publication-title: British Medical Journal, 320 – volume: 64 start-page: 217 year: 2013 end-page: 233 article-title: What is societal impact of research and how can it be assessed? A literature survey publication-title: Journal of the American Society for Information Science and Technology – volume: 14 start-page: 326 year: 1989 end-page: 327 article-title: From bad to worse: Evaluation by journal impact publication-title: Trends in Biochemical Sciences – volume: 64 start-page: 372 year: 2013 end-page: 379 article-title: On the calculation of percentile-based bibliometric indicators publication-title: Journal of the American Society for Information Science and Technology – volume: 193 start-page: 265 year: 1951 end-page: 275 article-title: Protein measurement with the Folin phenol reagent publication-title: Journal of Biological Chemistry – volume: 32 start-page: 1861 year: 2012 end-page: 1867 article-title: Diversity, value and limitations of the journal impact factor and alternative metrics publication-title: Rheumatology International – volume: 61 start-page: 310 year: 2010 end-page: 318 article-title: Referencing in the humanities and its implications for citation analysis publication-title: Journal of the American Society for Information Science and Technology – volume: 67 start-page: 491 year: 2006 end-page: 502 article-title: Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups publication-title: Scientometrics – volume: 64 start-page: 82 issue: 4 year: 2009 end-page: 88 article-title: Allocation of research funds using bibliometric indicators—Asset and challenge to Swedish higher education sector publication-title: InfoTrend – volume: 8 issue: 6 year: 2013 article-title: Reviewers’ ratings and bibliometric indicators: Hand in hand when assessing over research proposals? publication-title: PLoS ONE – volume: 7 start-page: 113 year: 1977 end-page: 122 article-title: Referencing as persuasion publication-title: Social Studies of Science – volume: 11 issue: 10 year: 2013 article-title: The assessment of science: The relative merits of post-publication review, the impact factor, and the number of citations publication-title: PLoS Biology – volume: 36 start-page: 397 year: 1996 end-page: 420 article-title: Advanced bibliometric methods as quantitative core of peer review based evaluation and foresight exercises publication-title: Scientometrics – volume: 108 start-page: 1651 year: 2016 end-page: 1671 article-title: Do they agree? Bibliometric evaluation versus informed peer review in the Italian research assessment exercise publication-title: Scientometrics – year: 1991 publication-title: Quality in science: Researchers’ conceptions and judgments – volume: 98 start-page: 1944 year: 2008 end-page: 1950 article-title: The impact of cancer research: How publications influence UK cancer clinical guidelines publication-title: British Journal of Cancer – volume: 21 start-page: 48 year: 2012 end-page: 60 article-title: Conservatism and risk-taking in peer review: Emerging ERC practices publication-title: Research Evaluation – volume: 415 start-page: 731 year: 2002 end-page: 732 article-title: The impact-factors debate: The ISI’s uses and limits publication-title: Nature – volume: 30 start-page: 83 year: 1981 end-page: 106 article-title: Citation analysis publication-title: Library Trends – volume: 36 start-page: 343 year: 1996 end-page: 362 article-title: The use of multiple indicators in the assessment of basic research publication-title: Scientometrics – volume: 62 start-page: 117 year: 2004 end-page: 131 article-title: Impact of bibliometrics upon the science system: Inadvertent consequences? publication-title: Scientometrics – volume: 60 start-page: 754 year: 2009 end-page: 777 article-title: The multilayered nature of reference selection publication-title: Journal of the American Society for Information Science and Technology – volume: 24 start-page: 242 year: 2015 end-page: 255 article-title: Evaluating scientific research in Italy: The 2004-10 research evaluation exercise publication-title: Research Evaluation – volume: 109 start-page: 2129 year: 2016 end-page: 2150 article-title: Professional and citizen bibliometrics: Complementarities and ambivalences in the development and use of indicators—A state-of-the-art report publication-title: Scientometrics – volume: 52 start-page: 411 year: 2001 end-page: 434 article-title: Integrating scientometric indicators into sociological studies: Methodical and methodological problems publication-title: Scientometrics – volume: 1 start-page: 19 issue: 6 year: 1976 end-page: 21 article-title: Are all citations equal? Or, did we op. cit. your idem? publication-title: The Journal of Academic Librarianship – volume: 3 start-page: 151 year: 1993 end-page: 166 article-title: Advanced bibliometric methods to assess research performance and scientific development: Basic principles and recent practical applications publication-title: Research Evaluation – volume: 38 start-page: 7 year: 1997 end-page: 26 article-title: Qualitative conditions of scientometrics: The new challenges publication-title: Scientometrics – volume: 6 start-page: 869 year: 2013 end-page: 870 article-title: The San Francisco Declaration on Research Assessment publication-title: Disease Models & Mechanisms – volume: 35 start-page: 889 year: 2010 end-page: 903 article-title: Conceptualising research performance publication-title: Studies in Higher Education – volume: 58 start-page: 1381 year: 2007 end-page: 1385 article-title: What do we know about the h index? publication-title: Journal of the American Society for Information Science and Technology – volume: 3 start-page: 273 year: 2009 end-page: 289 article-title: h-Index: A review focused in its variants, computation and standardization for different scientific fields publication-title: Journal of Informetrics – volume: 49 start-page: 370 year: 1993 end-page: 408 article-title: Progress in documentation the complexities of citation practice: A review of citation studies publication-title: Journal of Documentation – volume: 12 start-page: 61 year: 1983 end-page: 90 article-title: Assessing basic research: Some partial indicators of scientific progress in radio astronomy publication-title: Research Policy – volume: 102 start-page: 16569 year: 2005 end-page: 16572 article-title: An index to quantify an individual’s scientific research output publication-title: Proceedings of the National Academy of Sciences of the United States of America – volume: 36 start-page: 435 year: 1996 end-page: 444 article-title: Problems of citation analysis publication-title: Scientometrics – volume: 1 start-page: 359 year: 1979 end-page: 375 article-title: Is citation analysis a legitimate evaluation tool? publication-title: Scientometrics – volume: 23 start-page: 176 year: 2006 end-page: 184 article-title: Identifying the impact of diabetes research publication-title: Diabetic Medicine – volume: 96 start-page: 699 year: 2013 end-page: 716 article-title: Source normalized indicators of citation impact: An overview of different approaches and an empirical comparison publication-title: Scientometrics – volume: 149 start-page: 510 year: 1965 end-page: 515 article-title: Networks of scientific papers publication-title: Science – volume: 21 start-page: 280 year: 2012 end-page: 290 article-title: The representation of the social sciences and humanities in the Web of Science—A comparison of publication patterns and incentive structures in Flanders and Norway (2005-9) publication-title: Research Evaluation – volume: 44 start-page: 561 year: 1999 end-page: 580 article-title: Beyond the Holy Grail: From citation theory to indicator theories publication-title: Scientometrics – volume: 20 start-page: 247 year: 2011 end-page: 254 article-title: The research excellence framework and the “impact agenda”: Are we creating a Frankenstein monster? publication-title: Research Evaluation – volume: 106 start-page: 787 year: 2016 end-page: 804 article-title: Google Scholar, Scopus and the Web of Science: A longitudinal and cross-disciplinary comparison publication-title: Scientometrics – volume: 13 start-page: 673 year: 2012 end-page: 676 article-title: Measuring the societal impact of research publication-title: EMBO Reports – volume: 39 start-page: 102 year: 2015 end-page: 129 article-title: Ranking games publication-title: Evaluation Review – volume: 159 start-page: 56 year: 1968 end-page: 63 article-title: The Matthew effect in science publication-title: Science – volume: 13 start-page: 117 year: 1992 end-page: 135 article-title: Of Nobel class: A citation perspective on high impact research authors publication-title: Theoretical Medicine – volume: 47 start-page: 300 year: 2011 end-page: 308 article-title: A combined bibliometric indicator to predict article impact publication-title: Information Processing & Management – volume: 29 start-page: 409 year: 2000 end-page: 434 article-title: Does science push technology? Patents citing scientific literature publication-title: Research Policy – volume: 53 start-page: 117 year: 2015 end-page: 139 article-title: Accounting for impact? The journal impact factor and the making of biomedical research in the Netherlands publication-title: Minerva – volume: 40 start-page: 342 year: 1989 end-page: 349 article-title: Problems of citation analysis: A critical review publication-title: Journal of the American Society for Information Science – volume: 52 start-page: 1050 year: 1997 end-page: 1056 article-title: Citations and journal impact factors: Questionable indicators of research quality publication-title: Allergy – volume: 48 start-page: 962 year: 1997 end-page: 963 article-title: Validation of citation analysis publication-title: Journal of the American Society for Information Science – volume: 53 start-page: 477 year: 1997 end-page: 487 article-title: The correlation between citation counts and the 1992 research assessment exercise ratings for British research in genetics, anatomy and archaeology publication-title: Journal of Documentation – year: 1990 publication-title: Citations in the rhetorical, reward, and communication systems of science – volume: 87 start-page: 467 year: 2011 end-page: 481 article-title: Towards a new crown indicator: An empirical analysis publication-title: Scientometrics – volume: 12 start-page: 267 year: 1987 end-page: 292 article-title: World flash on basic research: Subject field characteristic citation scores and scales for assessing research performance publication-title: Scientometrics – volume: 45 start-page: 199 year: 2011 end-page: 245 article-title: Scientific peer review publication-title: Annual Review of Information Science and Technology – volume: 13 start-page: 33 year: 2004 end-page: 41 article-title: Peer reviews and bibliometric indicators: A comparative study at a Norwegian university publication-title: Research Evaluation – volume: 20 start-page: 16 issue: 4 year: 1995 end-page: 24 article-title: Formal evaluation methods: Their utility and limitations publication-title: International Forum on Information and Documentation – volume: 15 start-page: 437 year: 1989 end-page: 447 article-title: What do citations count? The rhetoric-first model publication-title: Scientometrics – volume: 20 start-page: 181 year: 2011 end-page: 183 article-title: The “payback framework” explained publication-title: Research Evaluation – volume: 9 start-page: 281 year: 1986 end-page: 291 article-title: Relative indicators and relational charts for comparative assessment of publication output and citation impact publication-title: Scientometrics – volume: 2 start-page: 696 year: 2005 end-page: 701 article-title: Why most published research findings are false publication-title: PLoS Medicine – volume: 514 start-page: 550 year: 2014 end-page: 553 article-title: The top 100 papers publication-title: Nature – volume: 67 start-page: 1210 year: 2016 end-page: 1223 article-title: Theory-changing breakthroughs in science: The impact of research teamwork on scientific discoveries publication-title: Journal of the Association for Information Science and Technology – volume: 344 start-page: 1383 year: 1994 end-page: 1389 article-title: Randomised trial of cholesterol lowering in 4444 patients with coronary heart disease: The Scandinavian Simvastatin Survival Study (4S) publication-title: The Lancet – volume: 69 start-page: 145 year: 2013 end-page: 156 article-title: Readers’ perceptions of authors’ citation behaviour publication-title: Journal of Documentation – volume: 27 start-page: 95 year: 1998 end-page: 107 article-title: Comparative analysis of a set of bibliometric indicators and central peer review criteria: Evaluation of condensed matter physics in the Netherlands publication-title: Research Policy – volume: 7 start-page: 635 year: 2013 end-page: 641 article-title: Counting publications and citations: Is more always better? publication-title: Journal of Informetrics – volume: 20 start-page: 1 issue: 3 year: 2015 end-page: 17 article-title: The role of trust and authority in the citation behaviour of researchers publication-title: Information Research: An International Electronic Journal – volume: 5 start-page: 37 year: 2011 end-page: 47 article-title: Towards a new crown indicator: Some theoretical considerations publication-title: Journal of Informetrics – volume: 22 start-page: 369 year: 2013 end-page: 383 article-title: Criteria for assessing research quality in the humanities: A Delphi study among scholars of English literature, German literature and art history publication-title: Research Evaluation – volume: 45 start-page: 593 year: 2016 end-page: 603 article-title: Evaluating research: A multidisciplinary approach to assessing research practice and quality publication-title: Research Policy – volume: 10 start-page: 646 year: 2016 end-page: 651 article-title: A farewell to the MNCS and like size-independent indicators publication-title: Journal of Informetrics – volume: 26 start-page: 453 year: 2000 end-page: 460 article-title: A critical review of the application of citation studies to the research assessment exercises publication-title: Journal of Information Science – volume: 4 start-page: 423 year: 2010 end-page: 430 article-title: Caveats for the journal and field normalizations in the CWTS (“Leiden”) evaluations of research performance publication-title: Journal of Informetrics – volume: 102 start-page: 1823 year: 2015 end-page: 1827 article-title: On the causes of subject-specific citation rates in Web of Science publication-title: Scientometrics – volume: 82 start-page: 1272 year: 2015 end-page: 1283 article-title: Commensuration bias in peer review publication-title: Philosophy of Science – volume: 25 start-page: 161 year: 2016 end-page: 169 article-title: Evaluation practices and effects of indicator use—A literature review publication-title: Research Evaluation – volume: 5 start-page: 392 year: 2011 end-page: 399 article-title: Averages of ratios vs. ratios of averages: An empirical analysis of four levels of aggregation publication-title: Journal of Informetrics – volume: 41 start-page: 609 year: 2007 end-page: 641 article-title: Citation analysis publication-title: Annual Review of Information Science and Technology – volume: 10 start-page: 365 year: 2016 end-page: 391 article-title: A review of the literature on citation impact indicators publication-title: Journal of Informetrics – volume: 82 start-page: 401 year: 2010 end-page: 412 article-title: Why it has become more difficult to predict Nobel Prize winners: A bibliometric analysis of nominees and winners of the chemistry and physics prizes (1901-2007) publication-title: Scientometrics – volume: 69 start-page: 224 year: 1998 end-page: 229 article-title: Citation rates and journal impact factors are not suitable for evaluation of research publication-title: Acta Orthopaedica Scandinavica – year: 2000 publication-title: Research quality and organisational factors: An investigation of the relationship – volume: 64 start-page: 45 year: 2008 end-page: 80 article-title: What do citation counts measure? A review of studies on citing behavior publication-title: Journal of Documentation – volume: 64 start-page: 2 year: 2013 end-page: 17 article-title: Bias in peer review publication-title: Journal of the American Society for Information Science and Technology – volume: 109 start-page: 17028 year: 2012 end-page: 17033 article-title: Misconduct accounts for the majority of retracted scientific publications publication-title: Proceedings of the National Academy of Sciences of the United States of America – volume: 5 start-page: 228 year: 2011 end-page: 230 article-title: Further steps towards an ideal method of measuring citation performance: The avoidance of citation (ratio) averages in field-normalization publication-title: Journal of Informetrics – volume: 112 start-page: 13823 year: 2015 end-page: 13826 article-title: The incidence and role of negative citations in science publication-title: Proceedings of the National Academy of Sciences of the United States of America – volume: 1 start-page: 54 year: 1962 end-page: 73 article-title: The republic of science: Its political and economic theory publication-title: Minerva – volume: 18 start-page: 209 year: 1989 end-page: 223 article-title: Words and co-words as indicators of intellectual organization publication-title: Research Policy – volume: 520 start-page: 429 year: 2015 end-page: 431 article-title: Bibliometrics: The Leiden Manifesto for research metrics publication-title: Nature – volume: 255 start-page: 342 year: 2010 end-page: 351 article-title: Bibliometric indicators: Quality measurements of scientific publication publication-title: Radiology – volume: 79 start-page: 171 year: 2009 end-page: 190 article-title: Funding of young scientist and scientific excellence publication-title: Scientometrics – volume: 38 start-page: 27 year: 1997 end-page: 37 article-title: Why has Latour’s theory of citations been ignored by the bibliometric community? Discussion of sociological interpretations of citation analysis publication-title: Scientometrics – volume: 10 issue: 7 year: 2015 article-title: Do Nobel laureates create prize-winning networks? An analysis of collaborative research in physiology or medicine publication-title: PLoS ONE – volume: 8 start-page: 327 year: 1978 end-page: 340 article-title: Cited documents as concept symbols publication-title: Social Studies of Science – volume: 38 start-page: 895 year: 2009 end-page: 905 article-title: Researchers’ perceptions of citations publication-title: Research Policy – volume: 2 start-page: 13 year: 2017 end-page: 50 article-title: Patent citations analysis and its value in research evaluation: A review and a new approach to map technology-relevant research publication-title: Journal of Data and Information Science – volume: 14 issue: 9 year: 2016 article-title: Citation metrics: A primer on how (not) to normalize publication-title: PLoS Biology – volume: 15 start-page: 449 year: 1989 end-page: 471 article-title: Citations: Indicators of significance? publication-title: Scientometrics – volume: 87 start-page: 499 year: 2011 end-page: 514 article-title: Evaluating research: From informed peer review to bibliometrics publication-title: Scientometrics – volume: 42 start-page: 661 year: 2015 end-page: 675 article-title: Excellence and growth dynamics: A comparative study of the Matthew effect publication-title: Science and Public Policy – volume: 109 start-page: 2263 year: 2016 end-page: 2278 article-title: How can differences in international university rankings be explained? publication-title: Scientometrics – ident: bibr35-2158244019829575 doi: 10.1148/radiol.09090626 – volume: 30 start-page: 83 year: 1981 ident: bibr116-2158244019829575 publication-title: Library Trends – start-page: 115 volume-title: Evaluating science and scientists: An East-West dialogue on research evaluation in post-communist Europe year: 1997 ident: bibr80-2158244019829575 – ident: bibr96-2158244019829575 doi: 10.1002/aris.2007.1440410120 – ident: bibr51-2158244019829575 doi: 10.1111/j.1464-5491.2005.01753.x – ident: bibr78-2158244019829575 doi: 10.1016/S0021-9258(19)52451-6 – ident: bibr2-2158244019829575 doi: 10.1016/j.joi.2016.04.006 – year: 2000 ident: bibr50-2158244019829575 publication-title: Research quality and organisational factors: An investigation of the relationship – ident: bibr98-2158244019829575 doi: 10.1016/j.joi.2010.02.003 – volume: 1 start-page: 19 issue: 6 year: 1976 ident: bibr127-2158244019829575 publication-title: The Journal of Academic Librarianship – start-page: 47 volume-title: Beyond bibliometrics: Harnessing multidimensional indicators of scholarly performance year: 2014 ident: bibr144-2158244019829575 doi: 10.7551/mitpress/9445.003.0006 – ident: bibr72-2158244019829575 doi: 10.1016/j.ipm.2010.09.005 – ident: bibr56-2158244019829575 doi: 10.1038/520429a – volume-title: Systematic analysis of agreement between metrics and peer review in the UK REF year: 2018 ident: bibr118-2158244019829575 – ident: bibr38-2158244019829575 doi: 10.1371/journal.pbio.1001675 – ident: bibr99-2158244019829575 doi: 10.1093/reseval/rvs019 – ident: bibr132-2158244019829575 doi: 10.1007/s11192-011-0354-5 – volume-title: Citation indexing—Its theory and application in science, technology and humanities year: 1979 ident: bibr42-2158244019829575 – year: 1990 ident: bibr79-2158244019829575 publication-title: Citations in the rhetorical, reward, and communication systems of science – ident: bibr109-2158244019829575 doi: 10.1007/BF02017249 – volume: 1 start-page: 84 volume-title: Essay of an information scientist year: 1977 ident: bibr41-2158244019829575 – ident: bibr97-2158244019829575 doi: 10.1108/EUM0000000007207 – volume: 344 start-page: 1383 year: 1994 ident: bibr101-2158244019829575 publication-title: The Lancet doi: 10.1016/S0140-6736(94)91755-8 – volume-title: The citation process: The role and significance of citations in scientific communication year: 1984 ident: bibr32-2158244019829575 – ident: bibr73-2158244019829575 doi: 10.1038/sj.bjc.6604405 – ident: bibr135-2158244019829575 doi: 10.1177/016555150002600607 – ident: bibr121-2158244019829575 doi: 10.1007/BF02129602 – ident: bibr128-2158244019829575 doi: 10.1371/journal.pone.0134164 – ident: bibr103-2158244019829575 doi: 10.1007/BF01101453 – ident: bibr12-2158244019829575 doi: 10.1080/03075070903348404 – ident: bibr37-2158244019829575 doi: 10.3389/fpsyg.2015.01152 – volume-title: Citation analysis in research evaluation year: 2005 ident: bibr95-2158244019829575 – ident: bibr90-2158244019829575 doi: 10.1007/s11192-014-1499-9 – ident: bibr77-2158244019829575 doi: 10.1108/eb026920 – volume-title: Citation indexing—Its theory and application in science, technology, and humanities year: 1979 ident: bibr92-2158244019829575 – ident: bibr133-2158244019829575 doi: 10.1016/j.joi.2010.08.001 – ident: bibr61-2158244019829575 doi: 10.1371/journal.pmed.0020124 – ident: bibr82-2158244019829575 doi: 10.1093/reseval/rvs001 – ident: bibr75-2158244019829575 doi: 10.1007/s11192-016-2150-8 – ident: bibr84-2158244019829575 doi: 10.1007/BF02129604 – ident: bibr43-2158244019829575 doi: 10.1007/BF02019306 – ident: bibr20-2158244019829575 doi: 10.1016/j.joi.2010.10.009 – ident: bibr140-2158244019829575 doi: 10.4135/9781473978782 – ident: bibr69-2158244019829575 doi: 10.1086/683652 – ident: bibr70-2158244019829575 doi: 10.1002/asi.22784 – ident: bibr88-2158244019829575 doi: 10.1016/0048-7333(83)90005-7 – ident: bibr102-2158244019829575 doi: 10.1007/s11192-016-2056-5 – ident: bibr129-2158244019829575 doi: 10.1016/j.joi.2016.02.007 – ident: bibr136-2158244019829575 doi: 10.1007/s11192-005-0007-7 – ident: bibr65-2158244019829575 doi: 10.1093/scipol/scu083 – ident: bibr142-2158244019829575 doi: 10.1007/bf02458496 – ident: bibr44-2158244019829575 doi: 10.1002/(SICI)1097-4571(199710)48:10<962::AID-ASI13>3.0.CO;2-X – ident: bibr113-2158244019829575 doi: 10.3109/17453679809000920 – ident: bibr67-2158244019829575 doi: 10.1016/j.joi.2011.02.001 – ident: bibr22-2158244019829575 doi: 10.1242/dmm.012955 – ident: bibr143-2158244019829575 – ident: bibr23-2158244019829575 doi: 10.1002/asi.21018 – ident: bibr93-2158244019829575 doi: 10.1016/s0048-7333(99)00040-2 – ident: bibr8-2158244019829575 doi: 10.1007/BF02017065 – ident: bibr81-2158244019829575 doi: 10.1007/BF02461121 – ident: bibr120-2158244019829575 doi: 10.1093/rev/3.3.151 – ident: bibr124-2158244019829575 doi: 10.1556/Scient.67.2006.3.10 – ident: bibr64-2158244019829575 doi: 10.4159/9780674054158 – ident: bibr119-2158244019829575 doi: 10.1038/514550a – ident: bibr125-2158244019829575 doi: 10.1515/jdis-2017-0002 – ident: bibr30-2158244019829575 – ident: bibr66-2158244019829575 – ident: bibr33-2158244019829575 doi: 10.1093/reseval/rvv038 – ident: bibr34-2158244019829575 doi: 10.3152/095820211x13118583635756 – ident: bibr40-2158244019829575 doi: 10.1073/pnas.1212247109 – volume: 20 start-page: 16 issue: 4 year: 1995 ident: bibr71-2158244019829575 publication-title: International Forum on Information and Documentation – ident: bibr17-2158244019829575 doi: 10.1002/asi.20609 – ident: bibr141-2158244019829575 doi: 10.1002/asi.23505 – volume-title: A recent history of recognized economic thought—Contributions of the Nobel laureates to economic science year: 2015 ident: bibr36-2158244019829575 – ident: bibr110-2158244019829575 doi: 10.1007/BF02016664 – ident: bibr83-2158244019829575 doi: 10.1002/(SICI)1097-4571(198909)40:5<342::AID-ASI7>3.0.CO;2-U – ident: bibr131-2158244019829575 doi: 10.1007/s11192-012-0913-4 – ident: bibr76-2158244019829575 doi: 10.1093/oso/9780195323573.001.0001 – volume-title: Citations and their use as indicators in science policy: Studies of validity and applicability issues with a particular focus on highly cited papers year: 2005 ident: bibr4-2158244019829575 – ident: bibr46-2158244019829575 doi: 10.1177/030631277700700112 – start-page: 67 volume-title: Bibliometrics in social work year: 2005 ident: bibr58-2158244019829575 – ident: bibr123-2158244019829575 doi: 10.1007/1-4020-2755-9_2 – ident: bibr16-2158244019829575 doi: 10.1002/asi.22803 – ident: bibr6-2158244019829575 doi: 10.3152/147154404781776563 – volume: 20 start-page: 1 issue: 3 year: 2015 ident: bibr117-2158244019829575 publication-title: Information Research: An International Electronic Journal – ident: bibr86-2158244019829575 doi: 10.1007/BF02129599 – ident: bibr47-2158244019829575 doi: 10.1007/s11192-009-0035-9 – ident: bibr15-2158244019829575 doi: 10.1038/embor.2012.99 – ident: bibr39-2158244019829575 doi: 10.1371/journal.pone.0005738 – ident: bibr63-2158244019829575 doi: 10.1007/s11192-016-1895-4 – ident: bibr7-2158244019829575 doi: 10.1016/j.joi.2009.04.001 – start-page: 301 volume-title: The web of knowledge: A Festschrift in honor of Eugene Garfield year: 2000 ident: bibr122-2158244019829575 – ident: bibr62-2158244019829575 doi: 10.1371/journal.pbio.1002542 – ident: bibr94-2158244019829575 doi: 10.1038/415731a – ident: bibr11-2158244019829575 doi: 10.1002/asi.23009 – ident: bibr74-2158244019829575 doi: 10.1016/0048-7333(89)90016-4 – ident: bibr114-2158244019829575 doi: 10.1177/030631277800800305 – ident: bibr108-2158244019829575 doi: 10.1007/s11024-015-9274-5 – volume-title: Peerless science: Peer review and U.S. science policy year: 1990 ident: bibr26-2158244019829575 – ident: bibr112-2158244019829575 doi: 10.1111/j.1398-9995.1997.tb00175.x – ident: bibr146-2158244019829575 – ident: bibr57-2158244019829575 doi: 10.1073/pnas.0507655102 – ident: bibr10-2158244019829575 doi: 10.1007/s11192-016-1929-y – ident: bibr5-2158244019829575 doi: 10.1016/j.respol.2009.02.001 – ident: bibr14-2158244019829575 doi: 10.1002/aris.2011.1440450112 – start-page: 202 volume-title: Evaluating science and scientists: An East-West dialogue on research evaluation in post-communist Europe year: 1997 ident: bibr138-2158244019829575 – ident: bibr130-2158244019829575 doi: 10.1002/asi.22775 – ident: bibr137-2158244019829575 doi: 10.1007/978-3-319-09785-5_16 – ident: bibr105-2158244019829575 – ident: bibr139-2158244019829575 doi: 10.1108/00220411311295360 – volume-title: Social stratification in science year: 1973 ident: bibr27-2158244019829575 – ident: bibr87-2158244019829575 doi: 10.3152/095820211x13118583635693 – ident: bibr91-2158244019829575 doi: 10.1126/science.159.3810.56 – ident: bibr3-2158244019829575 doi: 10.3152/147154403781776645 – ident: bibr21-2158244019829575 doi: 10.1371/journal.pone.0068258 – ident: bibr1-2158244019829575 doi: 10.1007/s11192-011-0352-7 – ident: bibr31-2158244019829575 doi: 10.1007/BF02017064 – year: 1991 ident: bibr55-2158244019829575 publication-title: Quality in science: Researchers’ conceptions and judgments – volume: 3 start-page: 287 volume-title: Progress in communication sciences year: 1982 ident: bibr115-2158244019829575 – start-page: 109 volume-title: The web of knowledge: A Festschrift in honor of Eugene Garfield year: 2000 ident: bibr29-2158244019829575 – volume-title: Handbook of science policy studies ident: bibr145-2158244019829575 – volume-title: Making science: Between nature and society year: 1992 ident: bibr28-2158244019829575 – ident: bibr49-2158244019829575 doi: 10.1136/bmj.320.7242.1107 – ident: bibr52-2158244019829575 doi: 10.1007/s11192-015-1798-9 – ident: bibr60-2158244019829575 doi: 10.1093/reseval/rvt008 – ident: bibr59-2158244019829575 doi: 10.1007/s11192-009-0411-5 – ident: bibr100-2158244019829575 doi: 10.1177/0193841x14524957 – ident: bibr106-2158244019829575 doi: 10.1016/S0048-7333(98)00026-2 – ident: bibr18-2158244019829575 doi: 10.1108/00220410810844150 – ident: bibr107-2158244019829575 doi: 10.1007/BF02461120 – ident: bibr19-2158244019829575 doi: 10.1007/s00296-011-2276-1 – ident: bibr89-2158244019829575 doi: 10.3389/fpsyg.2017.00523 – ident: bibr111-2158244019829575 doi: 10.1016/0968-0004(89)90163-1 – ident: bibr9-2158244019829575 doi: 10.1093/reseval/rvv008 – volume: 64 start-page: 82 issue: 4 year: 2009 ident: bibr24-2158244019829575 publication-title: InfoTrend – ident: bibr104-2158244019829575 doi: 10.1126/science.149.3683.510 – ident: bibr25-2158244019829575 doi: 10.1073/pnas.1502280112 – ident: bibr48-2158244019829575 doi: 10.1023/a:1014243832084 – ident: bibr54-2158244019829575 doi: 10.1002/asi.21256 – ident: bibr85-2158244019829575 doi: 10.1016/j.respol.2015.11.009 – ident: bibr134-2158244019829575 doi: 10.1016/j.joi.2013.04.001 – ident: bibr126-2158244019829575 doi: 10.1533/9781780630250 – volume-title: Gaming Metrics. Beyond Publish or Perish: Metrics and the new Ecologies of Academic Misconduct ident: bibr13-2158244019829575 – ident: bibr45-2158244019829575 doi: 10.1007/bf02163625 – ident: bibr68-2158244019829575 doi: 10.1007/978-1-349-07408-2_5 – ident: bibr53-2158244019829575
SSID	ssj0000505442
Score	2.626037
Snippet	Citations are increasingly used as performance indicators in research policy and within the research system. Usually, citations are assumed to reflect the...
SourceID	doaj proquest eric crossref sage
SourceType	Open Website Aggregation Database Index Database Enrichment Source Publisher
SubjectTerms	Basic Skills Bibliometrics Chief executive officers Citations Citations (References) Creativity Evaluation Criteria Evaluation research Justification Law Enforcement Performance indicators Quality Scientific Research Scientometrics Validity
SummonAdditionalLinks	– databaseName: DOAJ Directory of Open Access Journals dbid: DOA link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3PS8MwFH6IePAi_sTqlBxEFFbWNW3SeNuGoh7Ug8JutUkTEKQTOxX_e1-adI6BevFW0iSkeS9532tevgdwhGJlSjObgBhdFGvxQgT1LIxRV_rUREwY0ySb4Dc32Xgs7uZSfdmYMEcP7CauZ_GvjJmgZVqiK4fWCbsphcxMnBS81Hb3RdQz50w5Vm-EIkn8fS7ZQ9OWoSlDRJPFIrVhhXN2qKHrX4x4tlBzLrqrMTgX67DmkSIZuBFuwJKuNiFw12mJX5I1OfG80adb8DjyfNt1l7SP5KqyBzE2pU6XFFVJ2kg74sgzPs_IoCK373bH0B9kYsiwQLmRkbvNWDdtmvv76FFvw8PF-f3oMvQJFEKFsz4NhaFSKCFVUtDISCYSyrjKdIKFTFOVKYEzwpWMZJSVMVdCFBGXXKuCylhzugPL1aTSu0AihY5FZCjCM5qkhZasTGlBERzG2I00AfTa6cyV_0Sb5OI573tC8UUBBHA6a_HimDV-qTu0EprVs5zYTQFqSu41Jf9LUwLYsfKddXJ-bcnTslQE0GklnvsVXOeIeykX6Pz2Azi2WvD96qdR7v3HKPdhFTGZcH95OrA8fX3TB7Ci3qdP9etho-VfmE32iQ priority: 102 providerName: Directory of Open Access Journals
Title	Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories
URI	https://journals.sagepub.com/doi/full/10.1177/2158244019829575 http://eric.ed.gov/ERICWebPortal/detail?accno=EJ1210859 https://www.proquest.com/docview/2313790941 https://doaj.org/article/1826b2693d5d469293288d9b8f24a7de
Volume	9
WOSCitedRecordID	wos000458649200001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVAON databaseName: DOAJ Directory of Open Access Journals customDbUrl: eissn: 2158-2440 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0000505442 issn: 2158-2440 databaseCode: DOA dateStart: 20110101 isFulltext: true titleUrlDefault: https://www.doaj.org/ providerName: Directory of Open Access Journals – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources customDbUrl: eissn: 2158-2440 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0000505442 issn: 2158-2440 databaseCode: M~E dateStart: 20110101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre – providerCode: PRVPQU databaseName: ProQuest Central customDbUrl: eissn: 2158-2440 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0000505442 issn: 2158-2440 databaseCode: BENPR dateStart: 20180101 isFulltext: true titleUrlDefault: https://www.proquest.com/central providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest Publicly Available Content Database customDbUrl: eissn: 2158-2440 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0000505442 issn: 2158-2440 databaseCode: PIMPY dateStart: 20180101 isFulltext: true titleUrlDefault: http://search.proquest.com/publiccontent providerName: ProQuest – providerCode: PRVPQU databaseName: Social Science Database customDbUrl: eissn: 2158-2440 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0000505442 issn: 2158-2440 databaseCode: M2R dateStart: 20180101 isFulltext: true titleUrlDefault: https://search.proquest.com/socscijournals providerName: ProQuest
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3fb9MwED5BywMvbPyYCBuTHxBi0qKmtmPHvKC16sSQVioE0ngKseMgJJSOpgzx33OXOO00aXvhJbISx0pyZ99358t3AK9QrMp5RQWI0UUhixcjqFcxR10ZiypRpqraYhN6Ps8uLswiBNyakFbZr4ntQl0uHcXIR4hDhDbojIzfXf6KqWoU7a6GEhr3YUhMZXIAw8lsvvi0ibJQnTYp-XZ_coQmLkOThsgm4yal9MJr9qil7b-Z-UyQ81qWV2t4Tnf-95F34VGAnOyk05HHcM_XTyDq_stlYW437E0goD56Ct-mgbi7OWZ9k53VtKNDtXmOWVGXrE_ZYx0Lx9-37KRmH69o6fF_2LJikwIVgE273yKb9p6WCABd82fw5XT2efo-DpUYYofiW8emEtY4Y50sRFJZZaRQ2mVe4knlhcucwU-qnU1skpVcO2OKRFvtXSEs91rswaBe1v45sMShh5JUAnGekGnhrSpTUQhEmRyHsVUEo14euQuvSNUyfubjwEx-U4IRHG3uuOwoOu7oOyERb_oRuXZ7Yrn6noe5mpPLZbkyokxLqRA_CtTc0tis4rLQpY9gjxRkM8jsA7GwZamJ4KBXhDwsBU2-1YIIXpMabS_d9pQv7h5nHx4ibDNdIOgABuvVb_8SHrir9Y9mdRimwGEbXcDjOcf2cHF2vvj6D6lxCmY
linkProvider	ProQuest
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1NT9wwEB3RpVJ76TdqWtr60FZFItpsnDg2EqpgC2ILbPdAJTiF2HEQEsrSzRbEn-I3MpM4uwip3Dj0FuXDSuLnmTf2eB7AZ-xWYawgAWIMUcjj-UjqhR8iVnq8CIQqilpsIhkO5eGhGi3AdbsXhtIqW5tYG-p8bGiOvIs8hCcKg5He9_M_PqlG0epqK6HRwGLXXl1iyFatD35g_34Jw-2tg_6O71QFfIOvMvVVwbUySpso40GhhYq4SIy0EZ4UlhtpVIRRjtGBDmQeJkapLEh0Yk3GdWgTju0-gsUIwS47sDga7I-OZrM6pAuHV-broV10qRJdKDIpGaqY0hlv-b9aJuBupjVR3FtZZbWj237-v_2iF_DMUWq20YyBl7Bgy1fgNfuOmbNdFfvmCmyvvIbjvitMXq2y9pANSlqxIu2hVZaVOWtTEllTZeRqjW2U7NcFmVZ7ycYF28wQ4KzfbPus6mfqQgentnoDvx_kg5egU45L-xZYYDACCwqOPJZHcWa1yGOecWTRITajCw-6bf-nxn0iqYGcpT1Xef0uYjxYmT1x3pQguefeTYLU7D4qHl6fGE9OUmeLUgopdSgUz-M8EsiPOY7MXGlZhFGW5NaDJQLkrJGtn1RlTsbKg-UWeKkzdVU6R50HXwm280v_est397fzCZ7sHOzvpXuD4e57eIoUVTWTXsvQmU7-2g_w2FxMT6vJRzf8GBw_NJxvANa7ZQ0
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Citations%2C+Citation+Indicators%2C+and+Research+Quality%3A+An+Overview+of+Basic+Concepts+and+Theories&rft.jtitle=SAGE+open&rft.au=Aksnes%2C+Dag+W&rft.au=Langfeldt+Liv&rft.au=Wouters%2C+Paul&rft.date=2019-01-01&rft.pub=SAGE+PUBLICATIONS%2C+INC&rft.eissn=2158-2440&rft.volume=9&rft.issue=1&rft_id=info:doi/10.1177%2F2158244019829575
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2158-2440&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2158-2440&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2158-2440&client=summon