Fragments of peer review: A quantitative analysis of the literature (1969-2015)

This paper examines research on peer review between 1969 and 2015 by looking at records indexed from the Scopus database. Although it is often argued that peer review has been poorly investigated, we found that the number of publications in this field doubled from 2005. A half of this work was index...

Full description

Saved in:

Bibliographic Details
Published in:	PloS one Vol. 13; no. 2; p. e0193148
Main Authors:	Grimaldo, Francisco, Marušić, Ana, Squazzoni, Flaminio
Format:	Journal Article
Language:	English
Published:	United States Public Library of Science 21.02.2018 Public Library of Science (PLoS)
Subjects:	Abstracting and Indexing - history Abstracting and Indexing - methods Analysis Animals Authoring Citation analysis Cocitation Collaboration Computer and Information Sciences Data Mining - history Data Mining - methods Databases, Bibliographic Documents Fragmentation History, 20th Century History, 21st Century Humans Knowledge management Literature Literature reviews Network analysis Peer review Peer Review - methods People and Places Publishing Quantitative analysis Research and Analysis Methods Research projects Reviews Science Policy Scientometrics Studies Systematic review Trends United Kingdom > UK
ISSN:	1932-6203, 1932-6203
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Abstract	This paper examines research on peer review between 1969 and 2015 by looking at records indexed from the Scopus database. Although it is often argued that peer review has been poorly investigated, we found that the number of publications in this field doubled from 2005. A half of this work was indexed as research articles, a third as editorial notes and literature reviews and the rest were book chapters or letters. We identified the most prolific and influential scholars, the most cited publications and the most important journals in the field. Co-authorship network analysis showed that research on peer review is fragmented, with the largest group of co-authors including only 2.1% of the whole community. Co-citation network analysis indicated a fragmented structure also in terms of knowledge. This shows that despite its central role in research, peer review has been examined only through small-scale research projects. Our findings would suggest that there is need to encourage collaboration and knowledge sharing across different research communities.
AbstractList	This paper examines research on peer review between 1969 and 2015 by looking at records indexed from the Scopus database. Although it is often argued that peer review has been poorly investigated, we found that the number of publications in this field doubled from 2005. A half of this work was indexed as research articles, a third as editorial notes and literature reviews and the rest were book chapters or letters. We identified the most prolific and influential scholars, the most cited publications and the most important journals in the field. Co-authorship network analysis showed that research on peer review is fragmented, with the largest group of co-authors including only 2.1% of the whole community. Co-citation network analysis indicated a fragmented structure also in terms of knowledge. This shows that despite its central role in research, peer review has been examined only through small-scale research projects. Our findings would suggest that there is need to encourage collaboration and knowledge sharing across different research communities. This paper examines research on peer review between 1969 and 2015 by looking at records indexed from the Scopus database. Although it is often argued that peer review has been poorly investigated, we found that the number of publications in this field doubled from 2005. A half of this work was indexed as research articles, a third as editorial notes and literature reviews and the rest were book chapters or letters. We identified the most prolific and influential scholars, the most cited publications and the most important journals in the field. Co-authorship network analysis showed that research on peer review is fragmented, with the largest group of co-authors including only 2.1% of the whole community. Co-citation network analysis indicated a fragmented structure also in terms of knowledge. This shows that despite its central role in research, peer review has been examined only through small-scale research projects. Our findings would suggest that there is need to encourage collaboration and knowledge sharing across different research communities.This paper examines research on peer review between 1969 and 2015 by looking at records indexed from the Scopus database. Although it is often argued that peer review has been poorly investigated, we found that the number of publications in this field doubled from 2005. A half of this work was indexed as research articles, a third as editorial notes and literature reviews and the rest were book chapters or letters. We identified the most prolific and influential scholars, the most cited publications and the most important journals in the field. Co-authorship network analysis showed that research on peer review is fragmented, with the largest group of co-authors including only 2.1% of the whole community. Co-citation network analysis indicated a fragmented structure also in terms of knowledge. This shows that despite its central role in research, peer review has been examined only through small-scale research projects. Our findings would suggest that there is need to encourage collaboration and knowledge sharing across different research communities.
Audience	Academic
Author	Marušić, Ana Squazzoni, Flaminio Grimaldo, Francisco
AuthorAffiliation	Max Planck Society, GERMANY 3 Department of Economics and Management, University of Brescia, Brescia, Lombardy, Italy 1 Department of Computer Science, University of Valencia, Burjassot, Valencian Community, Spain 2 Department of Research in Biomedicine and Health, University of Split, Split, Split-Dalmatia, Croatia
AuthorAffiliation_xml	– name: 1 Department of Computer Science, University of Valencia, Burjassot, Valencian Community, Spain – name: 2 Department of Research in Biomedicine and Health, University of Split, Split, Split-Dalmatia, Croatia – name: Max Planck Society, GERMANY – name: 3 Department of Economics and Management, University of Brescia, Brescia, Lombardy, Italy
Author_xml	– sequence: 1 givenname: Francisco surname: Grimaldo fullname: Grimaldo, Francisco – sequence: 2 givenname: Ana surname: Marušić fullname: Marušić, Ana – sequence: 3 givenname: Flaminio orcidid: 0000-0002-6503-6077 surname: Squazzoni fullname: Squazzoni, Flaminio
BackLink	https://www.ncbi.nlm.nih.gov/pubmed/29466467$$D View this record in MEDLINE/PubMed
BookMark	eNqNk11r2zAUhs3oWD-2fzA2w2C0F8lk2ZKsXgxCWbdAIbCvW3EsS4mCY6WSnK3_fkrijLiUMXQhcfyc9_i8nHOenLS2VUnyOkPjLGfZh6XtXAvNeB3DY5TxPCvKZ8lZfOARxSg_OXqfJufeLxEieUnpi-QU84LSgrKzZHbrYL5SbfCp1elaKZc6tTHq13U6Se87aIMJEMxGpRCLPXiz48JCpY0JykHonEovM075CKOMXL1MnmtovHrV3xfJj9tP32--jO5mn6c3k7uRpByHEeOV5nXBgDKoZYUxZ6yqCa1KnJFSK6mhknXGco2AYuBZJQuOWVVWimqJ6_wiebvXXTfWi94LLzBCDHFGCYrEdE_UFpZi7cwK3IOwYMQuYN1cgAtGNkpoDMCAcFAUF1mdl0gDKsuCEE04VTRqfeyrddVK1TL65aAZiA6_tGYh5nYjSOwnJyQKXPYCzt53ygexMl6qpoFW2W7_3wWmlG7Rd4_Qp7vrqTnEBkyrbawrt6JiQnBZ4KIkeaTGT1Dx1GplZBwcbWJ8kHA1SIhMUL_DHDrvxfTb1_9nZz-H7PsjdqGgCQtvmy4Y2_oh-ObY6b8WHyY2Atd7QDrrvVNayN2E2q3xphEZEtv1OJgmtush-vWIycWj5IP-P9P-AFvkEas
CitedBy_id	crossref_primary_10_1136_bmj_p1992 crossref_primary_10_2139_ssrn_4211833 crossref_primary_10_1186_s41073_020_00092_1 crossref_primary_10_1007_s10115_025_02435_0 crossref_primary_10_1007_s11192_023_04915_y crossref_primary_10_1080_07294360_2024_2445575 crossref_primary_10_1177_0162243919862868 crossref_primary_10_1093_scipol_scad089 crossref_primary_10_1038_d41586_020_00500_y crossref_primary_10_1016_j_joi_2022_101316 crossref_primary_10_1001_jama_2023_17607 crossref_primary_10_15626_pfs26_0203_03 crossref_primary_10_1093_femsle_fny204 crossref_primary_10_1080_08989621_2020_1822170 crossref_primary_10_1007_s10755_024_09703_x crossref_primary_10_1016_j_joi_2019_03_018 crossref_primary_10_1007_s11192_019_03205_w crossref_primary_10_1162_qss_a_00195 crossref_primary_10_1093_scipol_scac027 crossref_primary_10_3390_publications11020032 crossref_primary_10_1038_s41467_018_08250_2 crossref_primary_10_1016_j_joi_2022_101289 crossref_primary_10_7717_peerj_11999 crossref_primary_10_1136_bmjoq_2020_001286 crossref_primary_10_1002_leap_1638 crossref_primary_10_7554_eLife_53249
Cites_doi	10.3389/fnins.2015.00169 10.1038/532306a 10.3389/fpsyg.2015.01706 10.3389/fncom.2011.00056 10.1073/pnas.0307625100 10.5688/ajpe7810176 10.1126/science.342.6154.60 10.1038/srep01069 10.1007/s11192-017-2522-8 10.1016/S0167-7799(02)01985-6 10.1007/s11192-011-0429-3 10.1038/546352a 10.18564/jasss.1821 10.1177/014107680609900414 10.1186/s12916-016-0631-5 10.1002/aris.2011.1440450112 10.1038/535031a 10.1017/CBO9780511815478 10.1002/asi.22784 10.1126/science.341.6152.1331
ContentType	Journal Article
Copyright	COPYRIGHT 2018 Public Library of Science 2018 Grimaldo et al. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. 2018 Grimaldo et al 2018 Grimaldo et al
Copyright_xml	– notice: COPYRIGHT 2018 Public Library of Science – notice: 2018 Grimaldo et al. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. – notice: 2018 Grimaldo et al 2018 Grimaldo et al
DBID	AAYXX CITATION CGR CUY CVF ECM EIF NPM IOV ISR 3V. 7QG 7QL 7QO 7RV 7SN 7SS 7T5 7TG 7TM 7U9 7X2 7X7 7XB 88E 8AO 8C1 8FD 8FE 8FG 8FH 8FI 8FJ 8FK ABJCF ABUWG AEUYN AFKRA ARAPS ATCPS AZQEC BBNVY BENPR BGLVJ BHPHI C1K CCPQU D1I DWQXO FR3 FYUFA GHDGH GNUQQ H94 HCIFZ K9. KB. KB0 KL. L6V LK8 M0K M0S M1P M7N M7P M7S NAPCQ P5Z P62 P64 PATMY PDBOC PHGZM PHGZT PIMPY PJZUB PKEHL PPXIY PQEST PQGLB PQQKQ PQUKI PRINS PTHSS PYCSY RC3 7X8 5PM DOA
DOI	10.1371/journal.pone.0193148
DatabaseName	CrossRef Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed Gale In Context: Opposing Viewpoints Gale In Context: Science ProQuest Central (Corporate) Animal Behavior Abstracts Bacteriology Abstracts (Microbiology B) Biotechnology Research Abstracts Nursing & Allied Health Database Ecology Abstracts Entomology Abstracts (Full archive) Immunology Abstracts Meteorological & Geoastrophysical Abstracts Nucleic Acids Abstracts Virology and AIDS Abstracts Agricultural Science Collection Health & Medical Collection ProQuest Central (purchase pre-March 2016) Medical Database (Alumni Edition) ProQuest Pharma Collection Public Health Database Technology Research Database ProQuest SciTech Collection ProQuest Technology Collection ProQuest Natural Science Collection ProQuest Hospital Collection Hospital Premium Collection (Alumni Edition) ProQuest Central (Alumni) (purchase pre-March 2016) Materials Science & Engineering Collection ProQuest Central (Alumni) ProQuest One Sustainability ProQuest Central UK/Ireland Advanced Technologies & Computer Science Collection Agricultural & Environmental Science Collection ProQuest Central Essentials - QC Biological Science Collection ProQuest Central ProQuest Technology Collection Natural Science Collection Environmental Sciences and Pollution Management ProQuest One ProQuest Materials Science Collection ProQuest Central Engineering Research Database Health Research Premium Collection Health Research Premium Collection (Alumni) ProQuest Central Student AIDS and Cancer Research Abstracts SciTech Premium Collection ProQuest Health & Medical Complete (Alumni) Materials Science Database Nursing & Allied Health Database (Alumni Edition) Meteorological & Geoastrophysical Abstracts - Academic ProQuest Engineering Collection ProQuest Biological Science Collection Agricultural Science Database ProQuest Health & Medical Collection Medical Database Algology Mycology and Protozoology Abstracts (Microbiology C) Biological Science Database Engineering Database Nursing & Allied Health Premium Advanced Technologies & Aerospace Database ProQuest Advanced Technologies & Aerospace Collection Biotechnology and BioEngineering Abstracts Environmental Science Database Materials Science Collection Proquest Central Premium ProQuest One Academic (New) Publicly Available Content Database ProQuest Health & Medical Research Collection ProQuest One Academic Middle East (New) ProQuest One Health & Nursing ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Applied & Life Sciences ProQuest One Academic (retired) ProQuest One Academic UKI Edition ProQuest Central China Engineering Collection Environmental Science Collection Genetics Abstracts MEDLINE - Academic PubMed Central (Full Participant titles) DOAJ Directory of Open Access Journals
DatabaseTitle	CrossRef MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) Agricultural Science Database Publicly Available Content Database ProQuest Central Student ProQuest Advanced Technologies & Aerospace Collection ProQuest Central Essentials Nucleic Acids Abstracts SciTech Premium Collection ProQuest Central China Environmental Sciences and Pollution Management ProQuest One Applied & Life Sciences ProQuest One Sustainability Health Research Premium Collection Meteorological & Geoastrophysical Abstracts Natural Science Collection Health & Medical Research Collection Biological Science Collection ProQuest Central (New) ProQuest Medical Library (Alumni) Engineering Collection Advanced Technologies & Aerospace Collection Engineering Database Virology and AIDS Abstracts ProQuest Biological Science Collection ProQuest One Academic Eastern Edition Agricultural Science Collection ProQuest Hospital Collection ProQuest Technology Collection Health Research Premium Collection (Alumni) Biological Science Database Ecology Abstracts ProQuest Hospital Collection (Alumni) Biotechnology and BioEngineering Abstracts Environmental Science Collection Entomology Abstracts Nursing & Allied Health Premium ProQuest Health & Medical Complete ProQuest One Academic UKI Edition Environmental Science Database ProQuest Nursing & Allied Health Source (Alumni) Engineering Research Database ProQuest One Academic Meteorological & Geoastrophysical Abstracts - Academic ProQuest One Academic (New) Technology Collection Technology Research Database ProQuest One Academic Middle East (New) Materials Science Collection ProQuest Health & Medical Complete (Alumni) ProQuest Central (Alumni Edition) ProQuest One Community College ProQuest One Health & Nursing ProQuest Natural Science Collection ProQuest Pharma Collection ProQuest Central ProQuest Health & Medical Research Collection Genetics Abstracts ProQuest Engineering Collection Biotechnology Research Abstracts Health and Medicine Complete (Alumni Edition) ProQuest Central Korea Bacteriology Abstracts (Microbiology B) Algology Mycology and Protozoology Abstracts (Microbiology C) Agricultural & Environmental Science Collection AIDS and Cancer Research Abstracts Materials Science Database ProQuest Materials Science Collection ProQuest Public Health ProQuest Nursing & Allied Health Source ProQuest SciTech Collection Advanced Technologies & Aerospace Database ProQuest Medical Library Animal Behavior Abstracts Materials Science & Engineering Collection Immunology Abstracts ProQuest Central (Alumni) MEDLINE - Academic
DatabaseTitleList	MEDLINE MEDLINE - Academic Agricultural Science Database
Database_xml	– sequence: 1 dbid: DOA name: DOAJ Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 3 dbid: PIMPY name: ProQuest Publicly Available Content Database url: http://search.proquest.com/publiccontent sourceTypes: Aggregation Database
DeliveryMethod	fulltext_linktorsrc
Discipline	Sciences (General)
DocumentTitleAlternate	Fragments of peer review: A quantitative analysis of the literature (1969-2015)
EISSN	1932-6203
ExternalDocumentID	2007097650 oai_doaj_org_article_f2aa7a59ae6241d380fa088455f596e6 PMC5821355 A528424853 29466467 10_1371_journal_pone_0193148
Genre	Historical Article Research Support, Non-U.S. Gov't Journal Article
GeographicLocations	United Kingdom--UK
GeographicLocations_xml	– name: United Kingdom--UK
GrantInformation_xml	– fundername: ; grantid: TIN2015-66972-C5-5-R
GroupedDBID	--- 123 29O 2WC 53G 5VS 7RV 7X2 7X7 7XC 88E 8AO 8C1 8CJ 8FE 8FG 8FH 8FI 8FJ A8Z AAFWJ AAUCC AAWOE AAYXX ABDBF ABIVO ABJCF ABUWG ACCTH ACGFO ACIHN ACIWK ACPRK ACUHS ADBBV ADRAZ AEAQA AENEX AEUYN AFFHD AFKRA AFPKN AFRAH AHMBA ALMA_UNASSIGNED_HOLDINGS AOIJS APEBS ARAPS ATCPS BAIFH BAWUL BBNVY BBTPI BCNDV BENPR BGLVJ BHPHI BKEYQ BPHCQ BVXVI BWKFM CCPQU CITATION CS3 D1I D1J D1K DIK DU5 E3Z EAP EAS EBD EMOBN ESX EX3 F5P FPL FYUFA GROUPED_DOAJ GX1 HCIFZ HH5 HMCUK HYE IAO IEA IGS IHR IHW INH INR IOV IPY ISE ISR ITC K6- KB. KQ8 L6V LK5 LK8 M0K M1P M48 M7P M7R M7S M~E NAPCQ O5R O5S OK1 OVT P2P P62 PATMY PDBOC PHGZM PHGZT PIMPY PJZUB PPXIY PQGLB PQQKQ PROAC PSQYO PTHSS PV9 PYCSY RNS RPM RZL SV3 TR2 UKHRP WOQ WOW ~02 ~KM ALIPV BBORY CGR CUY CVF ECM EIF IPNFZ NPM RIG 3V. 7QG 7QL 7QO 7SN 7SS 7T5 7TG 7TM 7U9 7XB 8FD 8FK AZQEC C1K DWQXO ESTFP FR3 GNUQQ H94 K9. KL. M7N P64 PKEHL PQEST PQUKI PRINS RC3 7X8 PUEGO 5PM - 02 AAPBV ABPTK ADACO BBAFP KM
ID	FETCH-LOGICAL-c692t-79bf9d47a67adcb22977bd56b82158fecfabcd173f0a62a91bc4927b8be6fc2d3
IEDL.DBID	DOA
ISICitedReferencesCount	25
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000425604300090&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	1932-6203
IngestDate	Fri Nov 26 17:13:33 EST 2021 Fri Oct 03 12:52:14 EDT 2025 Tue Nov 04 02:01:25 EST 2025 Mon Sep 08 02:35:48 EDT 2025 Tue Oct 07 08:02:48 EDT 2025 Sat Nov 29 13:15:24 EST 2025 Sat Nov 29 10:04:48 EST 2025 Wed Nov 26 10:06:30 EST 2025 Wed Nov 26 10:27:26 EST 2025 Thu May 22 21:16:02 EDT 2025 Thu Apr 03 07:07:19 EDT 2025 Sat Nov 29 05:30:08 EST 2025 Tue Nov 18 21:53:49 EST 2025
IsDoiOpenAccess	true
IsOpenAccess	true
IsPeerReviewed	true
IsScholarly	true
Issue	2
Language	English
License	This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Creative Commons Attribution License
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c692t-79bf9d47a67adcb22977bd56b82158fecfabcd173f0a62a91bc4927b8be6fc2d3
Notes	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 content type line 23 Competing Interests: The authors have declared that no competing interests exist.
ORCID	0000-0002-6503-6077
OpenAccessLink	https://doaj.org/article/f2aa7a59ae6241d380fa088455f596e6
PMID	29466467
PQID	2007097650
PQPubID	1436336
PageCount	e0193148
ParticipantIDs	plos_journals_2007097650 doaj_primary_oai_doaj_org_article_f2aa7a59ae6241d380fa088455f596e6 pubmedcentral_primary_oai_pubmedcentral_nih_gov_5821355 proquest_miscellaneous_2007426665 proquest_journals_2007097650 gale_infotracmisc_A528424853 gale_infotracacademiconefile_A528424853 gale_incontextgauss_ISR_A528424853 gale_incontextgauss_IOV_A528424853 gale_healthsolutions_A528424853 pubmed_primary_29466467 crossref_citationtrail_10_1371_journal_pone_0193148 crossref_primary_10_1371_journal_pone_0193148
PublicationCentury	2000
PublicationDate	2018-02-21
PublicationDateYYYYMMDD	2018-02-21
PublicationDate_xml	– month: 02 year: 2018 text: 2018-02-21 day: 21
PublicationDecade	2010
PublicationPlace	United States
PublicationPlace_xml	– name: United States – name: San Francisco – name: San Francisco, CA USA
PublicationTitle	PloS one
PublicationTitleAlternate	PLoS One
PublicationYear	2018
Publisher	Public Library of Science Public Library of Science (PLoS)
Publisher_xml	– name: Public Library of Science – name: Public Library of Science (PLoS)
References	CJ Lee (ref7) 2013; 64 R Smith (ref11) 2006; 99 F Squazzoni (ref1) 2011; 14 S Wasserman (ref28) 1994 K Börner (ref24) 2004; 101 M Malički (ref10) 2014; 311 J Couzin-Frankel (ref8) 2013; 341 R Spier (ref14) 2002; 20 R Walker (ref5) 2015; 9 F Squazzoni (ref22) 2017; 546 J Bohannon (ref6) 2013; 342 N David (ref4) 2015; 28 THP Gould (ref13) 2013 MEJ Newman (ref23) 2004; 101 R Bruce (ref19) 2016; 14 R Drummond (ref21) 2016; 535 K Börner (ref25) 2011; 89 V Batagelj (ref18) 2017; 113 A Csiszar (ref15) 2016; 532 ref9 S Cowley (ref17) 2015; 6 JD Bowman (ref3) 2014; 78 A Birukou (ref12) 2011; 5 M Lamont (ref16) 2009 X Sun (ref27) 2013; 3 L Bornmann (ref2) 2011; 45 H Jonas (ref26) 2017; 20 CJ Lee (ref20) 2017; 357
References_xml	– volume: 28 start-page: 1 issue: 1 year: 2015 ident: ref4 article-title: Peer review: still king in the digital era publication-title: Learned Publishing – volume: 20 issue: 1 year: 2017 ident: ref26 article-title: Recent development of Social Simulation as reflected in JASSS between 2008 and 2014: A Citation and Co-Citation Analysis publication-title: J Artif Soc Soc Simul – volume: 9 start-page: 169 year: 2015 ident: ref5 article-title: Emerging trends in peer review—A survey publication-title: Front Neurosci doi: 10.3389/fnins.2015.00169 – volume: 532 start-page: 306 issue: 7599 year: 2016 ident: ref15 article-title: Troubled from the start publication-title: Nature doi: 10.1038/532306a – volume: 6 start-page: 1706 year: 2015 ident: ref17 article-title: How peer review constraints cognition: On the frontline in the knowledge sector publication-title: Front Psychol doi: 10.3389/fpsyg.2015.01706 – volume: 5 start-page: 56 year: 2011 ident: ref12 article-title: Alternatives to peer review: novel approaches for research evaluation publication-title: Front Comput Neurosci doi: 10.3389/fncom.2011.00056 – ident: ref9 – volume: 101 start-page: 5266 year: 2004 ident: ref24 article-title: The simultaneous evolution of author and paper networks publication-title: PNAS doi: 10.1073/pnas.0307625100 – volume: 311 start-page: 1065 issue: 10 year: 2014 ident: ref10 article-title: Study design, publication outcome, and funding of research presented at international congresses on peer review and biomedical publication – volume: 78 start-page: 176 issue: 10 year: 2014 ident: ref3 article-title: Predatory publishing, questionable peer review, and fraudulent conferences publication-title: Am J Pharm EducV doi: 10.5688/ajpe7810176 – volume: 342 start-page: 60 year: 2013 ident: ref6 article-title: Who’s afraid of peer review? publication-title: Science doi: 10.1126/science.342.6154.60 – volume: 3 start-page: 1069 issue: 1 year: 2013 ident: ref27 article-title: Social dynamics in science publication-title: Nature Scientific Reports doi: 10.1038/srep01069 – volume: 113 start-page: 503 issue: 1 year: 2017 ident: ref18 article-title: The emergence of a field: A network analysis of research on peer review publication-title: Scientometrics doi: 10.1007/s11192-017-2522-8 – volume: 20 start-page: 357 issue: 8 year: 2002 ident: ref14 article-title: The history of the peer review process publication-title: TRENDS in Biotechnology doi: 10.1016/S0167-7799(02)01985-6 – volume: 89 start-page: 347 issue: 1 year: 2011 ident: ref25 article-title: Modeling science: studying the structure and dynamics of science publication-title: Scientometrics doi: 10.1007/s11192-011-0429-3 – year: 2013 ident: ref13 article-title: Do we still need peer review? An argument for change – volume: 546 start-page: 352 issue: 7658 year: 2017 ident: ref22 article-title: Publishing: Journals could share peer-review data publication-title: Nature doi: 10.1038/546352a – volume: 101 start-page: 5200 issue: Supplement 1 year: 2004 ident: ref23 article-title: Coauthorship networks and patterns of scientific collaboration – year: 2009 ident: ref16 article-title: How professors think. Inside the curious world of academic judgment – volume: 14 start-page: 3 issue: 4 year: 2011 ident: ref1 article-title: Social simulation that ‘peers into peer review’ publication-title: J Artif Soc Soc Simul doi: 10.18564/jasss.1821 – volume: 99 start-page: 178 issue: 4 year: 2006 ident: ref11 article-title: Peer review: a flawed process at the heart of science and journals publication-title: JRSM doi: 10.1177/014107680609900414 – volume: 14 start-page: 85 issue: 1 year: 2016 ident: ref19 article-title: Impact of interventions to improve the quality of peer review of biomedical journals: a systematic review and meta-analysis publication-title: BMC Med doi: 10.1186/s12916-016-0631-5 – volume: 45 start-page: 197 issue: 1 year: 2011 ident: ref2 article-title: Scientific peer review publication-title: Annual Review of Information Science and Technology doi: 10.1002/aris.2011.1440450112 – volume: 535 start-page: 31 issue: 7610 year: 2016 ident: ref21 article-title: Let’s make peer review scientific publication-title: Nature doi: 10.1038/535031a – year: 1994 ident: ref28 article-title: Social Network Analysis: Methods and Applications doi: 10.1017/CBO9780511815478 – volume: 64 start-page: 2 issue: 1 year: 2013 ident: ref7 article-title: Bias in peer review publication-title: J Am Soc Inf Sci Technol doi: 10.1002/asi.22784 – volume: 341 start-page: 1331 issue: 6142 year: 2013 ident: ref8 article-title: Secretive and subjective, peer review proves resistant to study publication-title: Science doi: 10.1126/science.341.6152.1331 – volume: 357 start-page: 257 issue: 6348 year: 2017 ident: ref20 article-title: Scientific Publishing. Promote scientific integrity via journal peer review data publication-title: Science
SSID	ssj0053866
Score	2.4089
SecondaryResourceType	review_article
Snippet	This paper examines research on peer review between 1969 and 2015 by looking at records indexed from the Scopus database. Although it is often argued that peer...
SourceID	plos doaj pubmedcentral proquest gale pubmed crossref
SourceType	Open Website Open Access Repository Aggregation Database Index Database Enrichment Source
StartPage	e0193148
SubjectTerms	Abstracting and Indexing - history Abstracting and Indexing - methods Analysis Animals Authoring Citation analysis Cocitation Collaboration Computer and Information Sciences Data Mining - history Data Mining - methods Databases, Bibliographic Documents Fragmentation History, 20th Century History, 21st Century Humans Knowledge management Literature Literature reviews Network analysis Peer review Peer Review - methods People and Places Publishing Quantitative analysis Research and Analysis Methods Research projects Reviews Science Policy Scientometrics Studies Systematic review Trends
SummonAdditionalLinks	– databaseName: Nursing & Allied Health Database dbid: 7RV link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1Lb9QwELZg4cAFKK8GChiERHtIm5fthAtaEBVcWlSg6i2aOPZSaZVsN7v8fmYcb2hQBUjcVvGXaDMvT2zPN4y9MgCxhFSGVa4hzIrK4i9lQpHFBoSsk1Rb12xCHR3lZ2fFZ7_g1vljlZuY6AJ13WpaIz-gNbUI504RvV1chNQ1inZXfQuN6-xGTLkx2rM6Od1EYvRlKX25XKriA6-d_UXbmH1MbdKYuv5cmo4ca_8QmyeLedtdlXj-fn7y0oR0eOd_X-Uuu-1TUT7tbWeLXTPNPbblnb3ju56Reu8-O8b0duZq4Xhr-cKYJe9LXt7wKb9YQ-Mq1TBucvAcJ4TD1JLPB9ZmvksUOegusdh7wL4dfvj6_mPoOzGEWhbJKlSow6LOFEgFta6SBLPGqhayyjFjyK3RFipdxyq1EcgEirjSWZGoKq-MtDqp04ds0qDUtxkHWVCb9UIZQ3t2iMwhrpWKVJ3JCHTA0o1CSu1pyqlbxrx0e28KP1d68ZSkxtKrMWDhcNeip-n4C_4d6XrAEsm2u9AuZ6X32dImAApEAUZinlOneWQBg3ImhBWFNDJgz8lSyr5idQgV5VTgnE9UcWnAXjoEEW00dJJnBuuuKz8dn_4D6MvJCPTag2yL4tDgqyfwnYjAa4TcGSExXOjR8DbZ9UYqXfnLGvHOjb1ePfxiGKaH0um8xrTrHkOZnhQBe9S7xiDZxDUwkCpgauQ0I9GPR5rz747nnGq4MR1-_Oe_9YTdQtPNHc1AvMMmq-XaPGU39Y_Vebd85gLCTyjMahA priority: 102 providerName: ProQuest – databaseName: Public Library of Science (PLoS) Journals Open Access dbid: FPL link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1Nb9QwELVg4cAFKF9NKWAQEu0hJXFiO-a2IFYgobbiS71FE8culVbJdrPL72fseAOpWgG3Vfy8Ssae8bPseUPISwOQCshEXBUa4lxVFn9JE_M8NcBFzTJtfbEJeXhYnJyo498bxQsn-JlMXwebHizaxhwgIcmQwF8nN1gmhNtszY4_bSIv-q4QIT3uqp6j5cer9A-xeLKYt91lRPPifck_FqDZnf999bvkdqCadNrPjS1yzTT3yFZw5o7uBcXp_fvkCOnrqc91o62lC2OWtE9peUOn9HwNjc9Ew7hIIWiYOBxSRzofVJnpnpPAQXdI-f4D8m32_uu7D3GotBBrodgqljhGqs4lCAm1rhhDVljVXFQFMoLCGm2h0nUqM5uAYKDSSueKyaqojLCa1dlDMmnwI7cJBaFcGXUljXFncogsIK2lTGSdiwR0RLLNAJQ6yJC7ahjz0p-tSdyO9OYpndXKYLWIxEOvRS_D8Rf8Wze2A9aJaPsHODxl8MnSMgAJXIERyGPqrEgsYNDNObdcCSMi8szNjLLPSB1CQTnluKY7KbgsIi88wglpNO6mzimsu678ePT9H0BfPo9ArwLItmgODSE7Ar_JCXSNkLsjJIYDPWredvN4Y5XO1RmVCZJOnmDPzdy-vPn50Oz-1N2-a0y77jGOyQkekUe9KwyWZb5AgZARkSMnGZl-3NKc_fA65i5HG-nuztVv_JjcwmlbeAmBdJdMVsu1eUJu6p-rs2751Dv_L5NeWE8 priority: 102 providerName: Public Library of Science
Title	Fragments of peer review: A quantitative analysis of the literature (1969-2015)
URI	https://www.ncbi.nlm.nih.gov/pubmed/29466467 https://www.proquest.com/docview/2007097650 https://www.proquest.com/docview/2007426665 https://pubmed.ncbi.nlm.nih.gov/PMC5821355 https://doaj.org/article/f2aa7a59ae6241d380fa088455f596e6 http://dx.doi.org/10.1371/journal.pone.0193148
Volume	13
WOSCitedRecordID	wos000425604300090&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVAON databaseName: DOAJ Directory of Open Access Journals customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: DOA dateStart: 20060101 isFulltext: true titleUrlDefault: https://www.doaj.org/ providerName: Directory of Open Access Journals – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: M~E dateStart: 20060101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre – providerCode: PRVPQU databaseName: Advanced Technologies & Aerospace Database customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: P5Z dateStart: 20061201 isFulltext: true titleUrlDefault: https://search.proquest.com/hightechjournals providerName: ProQuest – providerCode: PRVPQU databaseName: Agricultural Science Database customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: M0K dateStart: 20061201 isFulltext: true titleUrlDefault: https://search.proquest.com/agriculturejournals providerName: ProQuest – providerCode: PRVPQU databaseName: Biological Science Database (ProQuest) customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: M7P dateStart: 20061201 isFulltext: true titleUrlDefault: http://search.proquest.com/biologicalscijournals providerName: ProQuest – providerCode: PRVPQU databaseName: Engineering Database customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: M7S dateStart: 20061201 isFulltext: true titleUrlDefault: http://search.proquest.com providerName: ProQuest – providerCode: PRVPQU databaseName: Environmental Science Database customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: PATMY dateStart: 20061201 isFulltext: true titleUrlDefault: http://search.proquest.com/environmentalscience providerName: ProQuest – providerCode: PRVPQU databaseName: Health & Medical Collection customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: 7X7 dateStart: 20061201 isFulltext: true titleUrlDefault: https://search.proquest.com/healthcomplete providerName: ProQuest – providerCode: PRVPQU databaseName: Materials Science Database customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: KB. dateStart: 20061201 isFulltext: true titleUrlDefault: http://search.proquest.com/materialsscijournals providerName: ProQuest – providerCode: PRVPQU databaseName: Nursing & Allied Health Database customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: 7RV dateStart: 20061201 isFulltext: true titleUrlDefault: https://search.proquest.com/nahs providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest Central customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: BENPR dateStart: 20061201 isFulltext: true titleUrlDefault: https://www.proquest.com/central providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest Publicly Available Content Database customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: PIMPY dateStart: 20061201 isFulltext: true titleUrlDefault: http://search.proquest.com/publiccontent providerName: ProQuest – providerCode: PRVPQU databaseName: Public Health Database customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: 8C1 dateStart: 20061201 isFulltext: true titleUrlDefault: https://search.proquest.com/publichealth providerName: ProQuest – providerCode: PRVATS databaseName: Public Library of Science (PLoS) Journals Open Access customDbUrl: eissn: 1932-6203 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0053866 issn: 1932-6203 databaseCode: FPL dateStart: 20060101 isFulltext: true titleUrlDefault: http://www.plos.org/publications/ providerName: Public Library of Science
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3Nb9MwFLegcOCCGF8LjGIQEtshXb5sJ9zaaRPTWBd1MBUukeM4Y1KVlqbl7-c9x40aNGkcuDxV8c9R-j7sF8Xv9wj5oKX0uQy5m8dKulGSl_BLaJdFvpaMF0GoStNsQozH8XSapFutvvBMWEMP3CjusAykFJIlUnPYbIow9koJkRExVrKEa0O27Ylk8zLVrMEQxZzbQrlQ-IfWLoPFvNIDSGpCH_v9bG1Ehq-_XZV7i9m8vi3l_Pvk5NZWdPKEPLY5JB02z75D7unqKdmxUVrTfUslffCMXEBeem2K2Oi8pAutl7SpVflEh_TXWlamxAwWPCotOQniICeks5Zume4jtw34uc8OnpNvJ8dfjz67toWCq3gSrFwByk-KSEguZKHyIIB0Ly8Yz2PY6uNSq1LmqvBFWHqSBzLxcxUlgcjjXPNSBUX4gvQqUNouoZIn2B89EVrjxzZAxtIvhPBEEXFPKoeEG31myvKLY5uLWWY-mgl4z2jUk6EVMmsFh7jtrEXDr3EHfoSmarHIjm0ugM9k1meyu3zGIW_R0FlTatrGeDZksFkjx1vokPcGgQwZFR7BuZbrus5OL67-AXQ56YA-WlA5B3Uoacse4D8h81YHuddBQpyrzvAuuuVGKzU2EBUeZJPMg5kbV719-F07jDfFY3WVnq8bDKZonDnkZePZrWYD03mAC4eIjs93VN8dqW5-GoJyLL6GPPbV_7DVa_IIHDw2LAL-Humtlmv9hjxUv1c39bJP7ovJFcqpMDIGGR_5ffJgdDxOJ32zKoA8Sb-APBsNQJ57ZyhFauQlyJT9gBnp6Xn6_Q8quGha
linkProvider	Directory of Open Access Journals
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1bb5RAFJ7U1URf1HrrarVoNLYPtDAwM2BizHppumndNlpN4wsOw7A22cB22dX4p_yNnjMMWEyjvvTBN8J8EDic2zBzvkPIYy2lz2XA3TRS0g3jNIcjoV0W-loyntFA5abZhBiNoqOj-GCJ_GhqYXBbZeMTjaPOSoX_yLfwn5oHsZN5L6YnLnaNwtXVpoVGrRa7-vs3mLJVz4ev4fs-oXT7zeGrHdd2FXAVj-ncFfA8cRYKyYXMVEopZEBpxngaQfSLcq1ymarMF0HuSU5l7KcqjKlIo1TzXNEsgPteIBfDkHpoRQfsU-P5wXdwbsvzAuFvWW3YnJaF3oRUKvCxy9Cp8Ge6BLSxoDedlNVZie7v-zVPBcDta_-b6K6TqzbVdga1bSyTJV3cIMvWmVXOumXc3rhJ9iF9H5taP6fMnanWM6cu6XnmDJyThSxMJR7EBUdaDhfEQersTFpWamcdKYDAHfhs4xb5cC4vdpv0CvjKK8SRPMY28rHQGtckARlJPxPCE1nIPan6JGgUIFGWhh27gUwSs7YoYDpWiydBtUms2vSJ2141rWlI_oJ_ibrVYpFE3JwoZ-PE-qQkp1IKyWKpOeRxWRB5uYSgEzKWs5hr3idrqJlJXZHbusJkwCCnQSq8oE8eGQQSiRS4U2ksF1WVDPc__gPo_bsO6KkF5SWIQ0lbHQLvhARlHeRqBwnuUHWGV9COGqlUyS_thysb-zh7-GE7jDfF3YeFLhc1BjNZzvrkTm2KrWSpadDARZ-IjpF2RN8dKY6_GB53rFGHdP_unx9rjVzeOXy7l-wNR7v3yBVQ48hQKvirpDefLfR9ckl9nR9XswfGGTnk83mb8E_6eMo8
linkToPdf	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1bb9MwFLZGQYgXYNwWGCwgENtD1lztBAmhwqiohrqKAZp4CY5jl0lV0jUtiL_Gr-McxwkLmoCXPfAWxV-i5OTcHPt8h5DHknOP8oA6WSy4EyaZgiMmnSj0JI9o7gdC6WYTbDyOj46SyRr50dTC4LbKxidqR52XAv-R9_GfmguxM3L7ymyLmOwNX8xPHOwghSutTTuNWkX25fdvMH2rno_24Fs_8f3h6_ev3jimw4AjaOIvHQbPluQh45TxXGS-D9lQlkc0iyESxkoKxTOReyxQLqc-T7xMhInPsjiTVAk_D-C-F8hFBnNM3E44iT41UQD8CKWmVC9gXt9oxu68LOQupFWBhx2HToVC3TGgjQu9-ayszkp6f9-7eSoYDq_9z2K8Tq6aFNwe1DazTtZkcYOsGydX2duGiXvnJjmAtH6qawDtUtlzKRd2XerzzB7YJyte6Ao9iBc2N9wuiIOU2p61bNX2NlIDgZvwop1b5MO5vNht0ivgi28Qm4OK4BorkxLXKgEZcy9nzGV5SF0uLBI0ypAKQ8-OXUJmqV5zZDBNq8WTogqlRoUs4rRXzWt6kr_gX6KetVgkF9cnysU0Nb4qVT7njEcJlxTyuzyIXcUhGIVRpKKESmqRLdTStK7UbV1kOogg10GKvMAijzQCCUYK1LEpX1VVOjr4-A-gw3cd0FMDUiWIQ3BTNQLvhMRlHeRmBwluUnSGN9CmGqlU6S9LgCsbWzl7-GE7jDfFXYmFLFc1BjNcGlnkTm2WrWR93biBMouwjsF2RN8dKY6_aH53rF2HacDdPz_WFrkMlpu-HY3375EroMWxZlrwNklvuVjJ--SS-Lo8rhYPtF-yyefztuCfL5bTBg
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Fragments+of+peer+review%3A+A+quantitative+analysis+of+the+literature+%281969-2015%29&rft.jtitle=PloS+one&rft.au=Grimaldo%2C+Francisco&rft.au=Maru%C5%A1i%C4%87%2C+Ana&rft.au=Squazzoni%2C+Flaminio&rft.date=2018-02-21&rft.issn=1932-6203&rft.eissn=1932-6203&rft.volume=13&rft.issue=2&rft.spage=e0193148&rft_id=info:doi/10.1371%2Fjournal.pone.0193148&rft.externalDBID=n%2Fa&rft.externalDocID=10_1371_journal_pone_0193148
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1932-6203&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1932-6203&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1932-6203&client=summon