Automation of systematic literature reviews: A systematic literature review
Systematic Literature Review (SLR) studies aim to identify relevant primary papers, extract the required data, analyze, and synthesize results to gain further and broader insight into the investigated domain. Multiple SLR studies have been conducted in several domains, such as software engineering,...
Uloženo v:
| Vydáno v: | Information and software technology Ročník 136; s. 106589 |
|---|---|
| Hlavní autoři: | , , |
| Médium: | Journal Article |
| Jazyk: | angličtina |
| Vydáno: |
Elsevier B.V
01.08.2021
|
| Témata: | |
| ISSN: | 0950-5849, 1873-6025 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | Systematic Literature Review (SLR) studies aim to identify relevant primary papers, extract the required data, analyze, and synthesize results to gain further and broader insight into the investigated domain. Multiple SLR studies have been conducted in several domains, such as software engineering, medicine, and pharmacy. Conducting an SLR is a time-consuming, laborious, and costly effort. As such, several researchers developed different techniques to automate the SLR process. However, a systematic overview of the current state-of-the-art in SLR automation seems to be lacking.
This study aims to collect and synthesize the studies that focus on the automation of SLR to pave the way for further research.
A systematic literature review is conducted on published primary studies on the automation of SLR studies, in which 41 primary studies have been analyzed.
This SLR identifies the objectives of automation studies, application domains, automated steps of the SLR, automation techniques, and challenges and solution directions.
According to our study, the leading automated step is the Selection of Primary Studies. Although many studies have provided automation approaches for systematic literature reviews, no study has been found to apply automation techniques in the planning and reporting phase. Further research is needed to support the automation of the other activities of the SLR process. |
|---|---|
| AbstractList | Systematic Literature Review (SLR) studies aim to identify relevant primary papers, extract the required data, analyze, and synthesize results to gain further and broader insight into the investigated domain. Multiple SLR studies have been conducted in several domains, such as software engineering, medicine, and pharmacy. Conducting an SLR is a time-consuming, laborious, and costly effort. As such, several researchers developed different techniques to automate the SLR process. However, a systematic overview of the current state-of-the-art in SLR automation seems to be lacking.
This study aims to collect and synthesize the studies that focus on the automation of SLR to pave the way for further research.
A systematic literature review is conducted on published primary studies on the automation of SLR studies, in which 41 primary studies have been analyzed.
This SLR identifies the objectives of automation studies, application domains, automated steps of the SLR, automation techniques, and challenges and solution directions.
According to our study, the leading automated step is the Selection of Primary Studies. Although many studies have provided automation approaches for systematic literature reviews, no study has been found to apply automation techniques in the planning and reporting phase. Further research is needed to support the automation of the other activities of the SLR process. |
| ArticleNumber | 106589 |
| Author | van Dinter, Raymon Catal, Cagatay Tekinerdogan, Bedir |
| Author_xml | – sequence: 1 givenname: Raymon surname: van Dinter fullname: van Dinter, Raymon email: raymon.vandinter@wur.nl organization: Information Technology Group, Wageningen University & Research, Wageningen, Netherlands – sequence: 2 givenname: Bedir surname: Tekinerdogan fullname: Tekinerdogan, Bedir email: bedir.tekinerdogan@wur.nl organization: Information Technology Group, Wageningen University & Research, Wageningen, Netherlands – sequence: 3 givenname: Cagatay surname: Catal fullname: Catal, Cagatay email: ccatal@qu.edu.qa organization: Department of Computer Science and Engineering, Qatar University, Doha, Qatar |
| BookMark | eNqFkMFKAzEQhoNUsK2-gYd9ga0zySbd9CCUolUseNFzSLMJpLQbSVKlb--u68lDPQ0zzDfM_03IqA2tJeQWYYaA4m43861Lwc0oUOxGgtfygoyxnrNSAOUjMgbJoeR1Ja_IJKUdAM6BwZi8LI85HHT2oS2CK9IpZdu3ptj7bKPOx2iLaD-9_UqLYnl24ZpcOr1P9ua3Tsn748Pb6qncvK6fV8tNaRiIXBpqNKKut1R3v2mGFddbxxpHhau44CARjKyaLVqsKUgzb5ypqOS1QCeQsSmphrsmhpSideoj-oOOJ4WgeiFqpwYhqheiBiEdtviDGZ9_kueo_f4_-H6AbResCxtVMt62xjY-WpNVE_z5A9-jwYHL |
| CitedBy_id | crossref_primary_10_3390_jtaer20020126 crossref_primary_10_1016_j_compbiomed_2025_110464 crossref_primary_10_1016_j_ipm_2022_103255 crossref_primary_10_1109_ACCESS_2022_3143534 crossref_primary_10_1080_08993408_2022_2039504 crossref_primary_10_1007_s41669_024_00476_9 crossref_primary_10_1371_journal_pone_0304317 crossref_primary_10_3390_su17146333 crossref_primary_10_1002_bse_70038 crossref_primary_10_1016_j_futures_2025_103651 crossref_primary_10_1108_BFJ_09_2021_1075 crossref_primary_10_3390_jrfm14050228 crossref_primary_10_1016_j_csi_2025_104073 crossref_primary_10_1016_j_knosys_2025_114344 crossref_primary_10_32604_cmes_2025_059152 crossref_primary_10_3390_su162410836 crossref_primary_10_1088_1742_6596_2866_1_012106 crossref_primary_10_1016_j_ecoinf_2024_102819 crossref_primary_10_1145_3715964 crossref_primary_10_3390_su15075932 crossref_primary_10_1007_s13593_024_00945_9 crossref_primary_10_1057_s41599_025_04484_w crossref_primary_10_1016_j_autcon_2025_106346 crossref_primary_10_1371_journal_pone_0329349 crossref_primary_10_1515_cclm_2023_0333 crossref_primary_10_1007_s00210_025_04139_2 crossref_primary_10_1063_5_0238090 crossref_primary_10_1016_j_artmed_2024_102989 crossref_primary_10_3390_sci7030124 crossref_primary_10_1016_j_cities_2024_105169 crossref_primary_10_1002_ece3_70994 crossref_primary_10_1016_j_procs_2024_02_014 crossref_primary_10_3390_s25020464 crossref_primary_10_14324_LRE_22_1_40 crossref_primary_10_1016_j_watres_2025_124530 crossref_primary_10_3390_bdcc8090110 crossref_primary_10_1002_sd_70081 crossref_primary_10_1007_s11105_023_01373_x crossref_primary_10_3390_su162310333 crossref_primary_10_3390_app15126477 crossref_primary_10_23887_ijerr_v8i1_85334 crossref_primary_10_3390_app13095682 crossref_primary_10_3390_math12111754 crossref_primary_10_1016_j_asoc_2021_107765 crossref_primary_10_1016_j_cola_2024_101287 crossref_primary_10_3390_en17215443 crossref_primary_10_1016_j_infsof_2022_107008 crossref_primary_10_1016_j_cie_2024_110691 crossref_primary_10_1080_09603123_2025_2533354 crossref_primary_10_2196_39736 crossref_primary_10_1093_toxsci_kfad134 crossref_primary_10_1038_s41746_025_01648_5 crossref_primary_10_3390_su162410816 crossref_primary_10_1111_ijcs_70036 crossref_primary_10_1002_asi_24851 crossref_primary_10_1108_QEA_08_2024_0075 crossref_primary_10_1186_s12874_025_02631_0 crossref_primary_10_1080_2331186X_2025_2471645 crossref_primary_10_1080_24750158_2022_2087954 crossref_primary_10_1365_s40702_022_00909_1 crossref_primary_10_1109_ACCESS_2023_3326101 crossref_primary_10_20473_jeba_V35I12025_184_202 crossref_primary_10_23887_ijerr_v8i1_85349 crossref_primary_10_3934_aci_2023003 crossref_primary_10_1080_09537325_2025_2489133 crossref_primary_10_1007_s13272_025_00818_1 crossref_primary_10_3390_info16050378 crossref_primary_10_1080_15700763_2024_2424524 crossref_primary_10_1145_3745019 crossref_primary_10_3390_su17093863 crossref_primary_10_1016_j_imavis_2025_105738 crossref_primary_10_28978_nesciences_1569144 crossref_primary_10_1007_s12530_023_09494_0 crossref_primary_10_47909_ijsmc_52 crossref_primary_10_1002_cesm_70046 crossref_primary_10_1080_20932685_2023_2268669 crossref_primary_10_1016_j_nbt_2023_11_005 crossref_primary_10_1080_0194262X_2025_2512475 crossref_primary_10_3390_buildings14092731 crossref_primary_10_1007_s12652_023_04530_y crossref_primary_10_1016_j_procs_2023_08_149 crossref_primary_10_3390_electronics12040800 crossref_primary_10_1145_3712003 crossref_primary_10_3390_su15043480 crossref_primary_10_1186_s13643_024_02592_3 crossref_primary_10_1016_j_technovation_2023_102903 crossref_primary_10_1177_02683962211048201 crossref_primary_10_1016_j_bcra_2025_100347 crossref_primary_10_1016_j_heliyon_2022_e11256 crossref_primary_10_1016_j_procs_2025_04_122 crossref_primary_10_1080_13600869_2025_2497630 crossref_primary_10_3390_w16131899 crossref_primary_10_1093_iwc_iwaf001 crossref_primary_10_1186_s13643_023_02421_z crossref_primary_10_1007_s10567_025_00519_5 crossref_primary_10_3390_app14167155 crossref_primary_10_1038_s41586_024_07146_0 crossref_primary_10_56984_8ZG7D19WQJ2 crossref_primary_10_3390_admsci15060194 crossref_primary_10_1016_j_jdent_2025_105877 crossref_primary_10_1038_s41598_024_76174_7 crossref_primary_10_1108_JRF_07_2024_0210 crossref_primary_10_3390_admsci15060195 crossref_primary_10_1002_widm_1569 crossref_primary_10_1007_s41060_025_00777_0 crossref_primary_10_3390_app14093842 crossref_primary_10_1002_sys_21799 crossref_primary_10_1093_reseval_rvaf016 crossref_primary_10_1016_j_jclepro_2023_137741 crossref_primary_10_1007_s13744_025_01268_4 crossref_primary_10_1109_ACCESS_2025_3570736 crossref_primary_10_56294_saludcyt20251864 crossref_primary_10_1136_bmjhci_2021_100363 crossref_primary_10_1016_j_infsof_2025_107757 crossref_primary_10_1016_j_iswa_2023_200193 crossref_primary_10_1007_s11069_024_07064_4 crossref_primary_10_1145_3762198 crossref_primary_10_1186_s13750_025_00360_x crossref_primary_10_1007_s42452_023_05608_0 crossref_primary_10_1088_1748_3190_ac9208 crossref_primary_10_1007_s10796_023_10432_3 crossref_primary_10_1016_j_softx_2025_102198 crossref_primary_10_1007_s43621_025_01591_1 crossref_primary_10_1155_2023_6660983 crossref_primary_10_1108_IMR_09_2022_390 crossref_primary_10_3390_electronics14173404 crossref_primary_10_3390_s22134734 crossref_primary_10_1080_23311886_2024_2376309 crossref_primary_10_1007_s12525_025_00754_2 crossref_primary_10_1109_ACCESS_2022_3148206 crossref_primary_10_1016_j_rineng_2025_104743 crossref_primary_10_1007_s13165_023_00440_7 crossref_primary_10_1016_j_is_2023_102231 crossref_primary_10_1007_s11367_024_02332_8 crossref_primary_10_1007_s10462_024_10844_w crossref_primary_10_1007_s44163_023_00065_5 crossref_primary_10_1016_j_aei_2024_102773 crossref_primary_10_1016_j_jpowsour_2024_234674 crossref_primary_10_1109_MTS_2025_3558666 crossref_primary_10_1155_2022_6933523 crossref_primary_10_7717_peerj_cs_2384 crossref_primary_10_1080_23311975_2024_2422564 crossref_primary_10_1007_s10844_022_00772_y crossref_primary_10_1111_beer_12789 crossref_primary_10_21105_joss_07616 crossref_primary_10_1186_s40359_025_02576_5 crossref_primary_10_1016_j_envdev_2024_101019 crossref_primary_10_3390_su15064917 crossref_primary_10_1007_s43621_025_01480_7 crossref_primary_10_1002_csr_3137 crossref_primary_10_1016_j_aei_2022_101774 crossref_primary_10_1289_EHP15389 crossref_primary_10_1177_22779779241227654 crossref_primary_10_3390_app13127054 crossref_primary_10_3390_jcs8040131 crossref_primary_10_1007_s00607_023_01181_x crossref_primary_10_1002_bsd2_303 crossref_primary_10_1007_s10869_023_09890_y |
| Cites_doi | 10.1186/2046-4053-4-5 10.1016/j.jbi.2014.06.005 10.1016/j.jclinepi.2004.11.024 10.1186/s13643-019-1074-9 10.1186/s13643-018-0724-7 10.1016/j.eswa.2013.08.047 10.1002/jrsm.27 10.1136/pmj.78.925.695 10.1016/j.artmed.2010.10.005 10.1007/s11219-017-9386-2 10.1016/j.infsof.2010.05.003 10.1016/j.jbi.2016.10.014 10.1186/1471-2105-11-492 10.1016/j.jbi.2017.06.018 10.1016/j.jbi.2015.05.004 10.1016/j.jbi.2016.03.026 10.1016/j.jclinepi.2008.10.016 10.1186/1471-2105-11-55 10.1016/j.jbi.2019.103202 10.1016/j.jbi.2013.10.005 10.1197/jamia.M1929 10.1016/j.ajp.2011.03.003 10.1080/01421590220145707 10.1109/TNB.2016.2565481 10.1016/j.mex.2020.100831 10.1007/s10796-015-9589-7 10.1002/jrsm.1335 10.1016/j.compag.2018.12.044 10.1186/2046-4053-3-74 10.1186/s13643-018-0740-7 10.1016/j.jbi.2016.06.001 10.1197/jamia.M3162 10.1186/s13643-019-0942-7 10.1371/journal.pmed.1001603 10.1002/jrsm.1317 10.1016/j.infsof.2012.04.003 10.1186/s13643-016-0315-4 10.1016/j.envint.2019.105228 10.1016/j.artmed.2012.05.002 10.1186/s13643-015-0066-7 10.1109/ACCESS.2020.2983656 10.7326/0003-4819-147-4-200708210-00179 10.1016/j.jclinepi.2020.01.008 10.1186/s13643-019-1062-0 10.1016/j.jbi.2015.09.003 10.1002/aris.1440370103 |
| ContentType | Journal Article |
| Copyright | 2021 Elsevier B.V. |
| Copyright_xml | – notice: 2021 Elsevier B.V. |
| DBID | AAYXX CITATION |
| DOI | 10.1016/j.infsof.2021.106589 |
| DatabaseName | CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Business |
| EISSN | 1873-6025 |
| ExternalDocumentID | 10_1016_j_infsof_2021_106589 S0950584921000690 |
| GroupedDBID | --K --M -~X .DC .~1 0R~ 1B1 1~. 1~5 29I 4.4 457 4G. 5GY 5VS 7-5 71M 77K 8P~ 9JN AABNK AACTN AAEDT AAEDW AAIAV AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AAXUO AAYFN AAYOK ABBOA ABFNM ABFRF ABJNI ABMAC ABTAH ABXDB ABYKQ ACDAQ ACGFO ACGFS ACGOD ACNNM ACRLP ACZNC ADBBV ADEZE ADJOM ADMUD AEBSH AEFWE AEKER AENEX AFKWA AFTJW AGHFR AGUBO AGYEJ AHHHB AHZHX AIALX AIEXJ AIKHN AITUG AJBFU AJOXV ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ AOUOD ASPBG AVWKF AXJTR AZFZN BKOJK BKOMP BLXMC CS3 DU5 EBS EFJIC EFLBG EJD EO8 EO9 EP2 EP3 FDB FEDTE FGOYB FIRID FNPLU FYGXN G-Q G8K GBLVA GBOLZ HLZ HVGLF HZ~ IHE J1W KOM LG9 M41 MO0 MS~ N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. PQQKQ Q38 R2- RIG ROL RPZ SBC SDF SDG SDP SES SEW SPC SPCBC SSV SSZ T5K TWZ UHS UNMZH WH7 WUQ XFK ZY4 ~G- 77I 9DU AATTM AAXKI AAYWO AAYXX ABDPE ABWVN ACLOT ACRPL ACVFH ADCNI ADNMO AEIPS AEUPX AFJKZ AFPUW AGQPQ AIGII AIIUN AKBMS AKRWK AKYEP ANKPU APXCP CITATION EFKBS ~HD |
| ID | FETCH-LOGICAL-c306t-c2ca11a8b2a025a3145abf3df26f45650910c94db1e18209c7dfc4295861f6133 |
| ISICitedReferencesCount | 191 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000655363900011&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0950-5849 |
| IngestDate | Tue Nov 18 21:31:44 EST 2025 Sat Nov 29 07:09:26 EST 2025 Fri Feb 23 02:42:37 EST 2024 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | Text mining Automation Natural language processing Review Machine learning Systematic literature review (SLR) |
| Language | English |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c306t-c2ca11a8b2a025a3145abf3df26f45650910c94db1e18209c7dfc4295861f6133 |
| ParticipantIDs | crossref_primary_10_1016_j_infsof_2021_106589 crossref_citationtrail_10_1016_j_infsof_2021_106589 elsevier_sciencedirect_doi_10_1016_j_infsof_2021_106589 |
| PublicationCentury | 2000 |
| PublicationDate | August 2021 2021-08-00 |
| PublicationDateYYYYMMDD | 2021-08-01 |
| PublicationDate_xml | – month: 08 year: 2021 text: August 2021 |
| PublicationDecade | 2020 |
| PublicationTitle | Information and software technology |
| PublicationYear | 2021 |
| Publisher | Elsevier B.V |
| Publisher_xml | – name: Elsevier B.V |
| References | Cohen, Ambert, McDonagh (bib0052) 2009; 16 Ali, Babar, Chen, Stol (bib0031) 2010; 52 Elsevier (bib0070) 2020 Minaee (bib0090) 2019 Frunza, Inkpen, Matwin (bib0051) 2010 Elsevier, Content & features, in, n.d. Olorisade, Quincey, Brereton, Andras (bib0020) 2016 Ouhbi, Kamoune, Frikh, Zemmouri, Behja (bib0037) 2016 Karami, Lundy, Webb, Dwivedi (bib0065) 2020; 8 Bui, Del Fiol, Jonnalagadda (bib0035) 2016; 61 Karimi, Zobel, Pohl, Scholer (bib0075) 2009 Dieste, Padua (bib0084) 2007 van Altena, Spijker, Olabarriaga (bib0029) 2019; 10 Mergel, Silveira, Silva (bib0039) 2015 Zdravevski, Lameski, Trajkovik, Chorbev, Goleva, Pombo, Garcia (bib0050) 2019 Tsafnat, Glasziou, Karystianis, Coiera (bib0071) 2018; 7 Chowdhury (bib0010) 2003; 37 Tummers, Kassahun, Tekinerdogan (bib0032) 2019; 157 Davydova (bib0085) 2018 Riaz, Sulayman, Salleh, Mendes (bib0073) 2010 Bartholomew (bib0011) 2002; 78 Felizardo, Salleh, Martins, Mendes, MacDonell, Maldonado (bib0068) 2011 Frunza, Inkpen, Matwin, Klement, O’Blenis (bib0092) 2011; 51 Gurbuz, Tekinerdogan (bib0005) 2018; 26 Miwa, Thomas, O’Mara-Eves, Ananiadou (bib0060) 2014; 51 Bekhuis, Demner-Fushman (bib0061) 2012; 55 Timsina, Liu, El-Gayar (bib0043) 2016; 18 Aliyu, Iqbal, James (bib0062) 2018 Reeves, Koppel, Barr, Freeth, Hammick (bib0076) 2002; 24 Jaspers, De Troyer, Aerts (bib0025) 2018; 15 Dyba, Dingsoyr, Hanssen (bib0072) 2007 Clark, Glasziou, Del Mar, Bannach-Brown, Stehlik, Scott (bib0030) 2020; 121 Bannach-Brown, Przybyła, Thomas, Rice, Ananiadou, Liao, Macleod (bib0058) 2019; 8 Bui, Jonnalagadda, Del Fiol (bib0049) 2015; 57 Wallace, Kuiper, Sharma, Zhu, Marshall (bib0056) 2016; 17 Cohen, Johnson, Verspoor, Roeder, Hunter (bib0083) 2010; 11 Mutuvi (bib0091) 2019 Feng, Chiam, Lo (bib0018) 2017 Felizardo, Andery, Paulovich, Minghim, Maldonado (bib0013) 2012; 54 Marshall (bib0006) 2016 Jones, Remmington, Williamson, Ashby, Smyth (bib0082) 2005; 58 Office (bib0003) 2007 PubMed, About, in, n.d. Elamin, Flynn, Bassler, Briel, Alonso-Coello, Karanicolas, Guyatt, Malaga, Furukawa, Kunz (bib0080) 2009; 62 Scells, Zuccon, Koopman, Clark (bib0045) 2020 Kontonatsios, Spencer, Matthew, Korkontzelos (bib0066) 2020 Scells, Zuccon, Koopman (bib0046) 2019 Kana (bib0088) 2019 Kim, Choi (bib0044) 2014; 47 Bui, Del Fiol, Hurdle, Jonnalagadda (bib0034) 2016; 64 Olorisade, Brereton, Andras (bib0063) 2019; 94 Paynter, Bañez, Berliner, Erinoff, Lege-Matsuura, Potter, Uhl, Methods (bib0023) 2016 Dias, Mansur, Myczkowski, Marcolin (bib0069) 2011; 4 Sellak, Ouhbi, Frikh (bib0067) 2015 Malheiros, Hohn, Pinho, Mendonca, Maldonado (bib0016) 2007 O’Connor, Tsafnat, Thomas, Glasziou, Gilbert, Hutton (bib0026) 2019; 8 Cohen, Hersh, Peterson, Yen (bib0033) 2006; 13 Biolchini, Mian, Natali, Travassos (bib0074) 2005; 679 Balatsko (bib0087) 2019 Elliott, Turner, Clavisi, Thomas, Higgins, Mavergames, Gruen (bib0007) 2014; 11 Tsafnat, Glasziou, Choong, Dunn, Galgani, Coiera (bib0021) 2014; 3 Wallace, Small, Brodley, Trikalinos (bib0042) 2010 Blake, Lucic (bib0047) 2015; 56 Kitchenham, Charters (bib0004) 2007 O’Mara-Eves, Thomas, McNaught, Miwa, Ananiadou (bib0012) 2015; 4 Michelson, Reuter (bib0027) 2019; 16 Weißer, Saßmannshausen, Ohrndorf, Burggräf, Wagner (bib0036) 2020; 7 Almeida, Meurs, Kosseim, Tsang (bib0053) 2016; 15 Rúbio, Gulo (bib0055) 2016 Tomassetti, Rizzo, Vetro, Ardito, Torchiano, Morisio (bib0057) 2011 Thomas, McNaught, Ananiadou (bib0017) 2011; 2 Beller, Clark, Tsafnat, Adams, Diehl, Lund, Ouzzani, Thayer, Thomas, Turner (bib0019) 2018; 7 González-Toral, Freire, Gualán, Saquicela (bib0040) 2019 Felizardo, Nakagawa, MacDonell, Maldonado (bib0014) 2014 Shemilt, Khan, Park, Thomas (bib0078) 2016; 5 Gøtzsche, Hróbjartsson, Marić, Tendal (bib0081) 2007; 298 Cawley, Beardslee, Beverly, Hotchkiss, Kirrane, Sams, Varghese, Wignall, Cowden (bib0059) 2020; 134 Marshall, Wallace (bib0028) 2019; 8 Langlois, Nie, Thomas, Hong, Pluye (bib0054) 2018; 9 Kitchenham (bib0079) 2004; 33 Ros, Bjarnason, Runeson (bib0038) 2017 Jonnalagadda, Goyal, Huffman (bib0008) 2015; 4 Wallace, Trikalinos, Lau, Brodley, Schmid (bib0022) 2010; 11 Kontonatsios, Brockmeier, Przybyła, McNaught, Mu, Goulermas, Ananiadou (bib0041) 2017; 72 Felizardo, Riaz, Sulayman, Mendes, MacDonell, Maldonado (bib0015) 2011 Hashimoto, Kontonatsios, Miwa, Ananiadou (bib0064) 2016; 62 Shojania, Sampson, Ansari, Ji, Doucette, Moher (bib0009) 2007; 147 García Adeva, Pikatza Atxa, Ubeda Carrillo, Ansuategi Zengotitabengoa (bib0048) 2014; 41 (bib0089) 2019 Verma (bib0086) 2014 Shakeel, Krüger, Nostitz-Wallwitz, Lausberger, Durand, Saake, Leich (bib0024) 2018 McGowan, Sampson (bib0077) 2005; 93 Wallace (10.1016/j.infsof.2021.106589_bib0022) 2010; 11 Bekhuis (10.1016/j.infsof.2021.106589_bib0061) 2012; 55 Aliyu (10.1016/j.infsof.2021.106589_bib0062) 2018 Zdravevski (10.1016/j.infsof.2021.106589_bib0050) 2019 (10.1016/j.infsof.2021.106589_bib0089) 2019 Gurbuz (10.1016/j.infsof.2021.106589_bib0005) 2018; 26 Marshall (10.1016/j.infsof.2021.106589_bib0028) 2019; 8 Langlois (10.1016/j.infsof.2021.106589_bib0054) 2018; 9 Tsafnat (10.1016/j.infsof.2021.106589_bib0071) 2018; 7 Minaee (10.1016/j.infsof.2021.106589_bib0090) 2019 Olorisade (10.1016/j.infsof.2021.106589_bib0020) 2016 Jaspers (10.1016/j.infsof.2021.106589_bib0025) 2018; 15 Bannach-Brown (10.1016/j.infsof.2021.106589_bib0058) 2019; 8 Reeves (10.1016/j.infsof.2021.106589_bib0076) 2002; 24 Ali (10.1016/j.infsof.2021.106589_bib0031) 2010; 52 O’Connor (10.1016/j.infsof.2021.106589_bib0026) 2019; 8 Tummers (10.1016/j.infsof.2021.106589_bib0032) 2019; 157 Sellak (10.1016/j.infsof.2021.106589_bib0067) 2015 Malheiros (10.1016/j.infsof.2021.106589_bib0016) 2007 Timsina (10.1016/j.infsof.2021.106589_bib0043) 2016; 18 Felizardo (10.1016/j.infsof.2021.106589_bib0068) 2011 Shemilt (10.1016/j.infsof.2021.106589_bib0078) 2016; 5 Felizardo (10.1016/j.infsof.2021.106589_bib0015) 2011 Hashimoto (10.1016/j.infsof.2021.106589_bib0064) 2016; 62 Kitchenham (10.1016/j.infsof.2021.106589_bib0079) 2004; 33 Rúbio (10.1016/j.infsof.2021.106589_bib0055) 2016 10.1016/j.infsof.2021.106589_bib0001 10.1016/j.infsof.2021.106589_bib0002 Olorisade (10.1016/j.infsof.2021.106589_bib0063) 2019; 94 Jonnalagadda (10.1016/j.infsof.2021.106589_bib0008) 2015; 4 Scells (10.1016/j.infsof.2021.106589_bib0045) 2020 Shakeel (10.1016/j.infsof.2021.106589_bib0024) 2018 Wallace (10.1016/j.infsof.2021.106589_bib0042) 2010 Michelson (10.1016/j.infsof.2021.106589_bib0027) 2019; 16 Weißer (10.1016/j.infsof.2021.106589_bib0036) 2020; 7 Ouhbi (10.1016/j.infsof.2021.106589_bib0037) 2016 Elamin (10.1016/j.infsof.2021.106589_bib0080) 2009; 62 Cohen (10.1016/j.infsof.2021.106589_bib0033) 2006; 13 Marshall (10.1016/j.infsof.2021.106589_bib0006) 2016 Dieste (10.1016/j.infsof.2021.106589_bib0084) 2007 McGowan (10.1016/j.infsof.2021.106589_bib0077) 2005; 93 Mergel (10.1016/j.infsof.2021.106589_bib0039) 2015 Bui (10.1016/j.infsof.2021.106589_bib0035) 2016; 61 Bui (10.1016/j.infsof.2021.106589_bib0049) 2015; 57 Felizardo (10.1016/j.infsof.2021.106589_bib0014) 2014 Kim (10.1016/j.infsof.2021.106589_bib0044) 2014; 47 Verma (10.1016/j.infsof.2021.106589_bib0086) 2014 Scells (10.1016/j.infsof.2021.106589_bib0046) 2019 Elsevier (10.1016/j.infsof.2021.106589_bib0070) 2020 Feng (10.1016/j.infsof.2021.106589_bib0018) 2017 van Altena (10.1016/j.infsof.2021.106589_bib0029) 2019; 10 Kontonatsios (10.1016/j.infsof.2021.106589_bib0041) 2017; 72 Tsafnat (10.1016/j.infsof.2021.106589_bib0021) 2014; 3 González-Toral (10.1016/j.infsof.2021.106589_bib0040) 2019 Balatsko (10.1016/j.infsof.2021.106589_bib0087) 2019 Frunza (10.1016/j.infsof.2021.106589_bib0051) 2010 Tomassetti (10.1016/j.infsof.2021.106589_bib0057) 2011 Shojania (10.1016/j.infsof.2021.106589_bib0009) 2007; 147 García Adeva (10.1016/j.infsof.2021.106589_bib0048) 2014; 41 Kana (10.1016/j.infsof.2021.106589_bib0088) 2019 Cohen (10.1016/j.infsof.2021.106589_bib0052) 2009; 16 Wallace (10.1016/j.infsof.2021.106589_bib0056) 2016; 17 Felizardo (10.1016/j.infsof.2021.106589_bib0013) 2012; 54 Bui (10.1016/j.infsof.2021.106589_bib0034) 2016; 64 Almeida (10.1016/j.infsof.2021.106589_bib0053) 2016; 15 Kontonatsios (10.1016/j.infsof.2021.106589_bib0066) 2020 Mutuvi (10.1016/j.infsof.2021.106589_bib0091) 2019 Kitchenham (10.1016/j.infsof.2021.106589_bib0004) 2007 Clark (10.1016/j.infsof.2021.106589_bib0030) 2020; 121 Cawley (10.1016/j.infsof.2021.106589_bib0059) 2020; 134 Office (10.1016/j.infsof.2021.106589_bib0003) 2007 Elliott (10.1016/j.infsof.2021.106589_bib0007) 2014; 11 Davydova (10.1016/j.infsof.2021.106589_bib0085) 2018 Frunza (10.1016/j.infsof.2021.106589_bib0092) 2011; 51 Thomas (10.1016/j.infsof.2021.106589_bib0017) 2011; 2 Biolchini (10.1016/j.infsof.2021.106589_bib0074) 2005; 679 Dias (10.1016/j.infsof.2021.106589_bib0069) 2011; 4 O’Mara-Eves (10.1016/j.infsof.2021.106589_bib0012) 2015; 4 Karimi (10.1016/j.infsof.2021.106589_bib0075) 2009 Chowdhury (10.1016/j.infsof.2021.106589_bib0010) 2003; 37 Karami (10.1016/j.infsof.2021.106589_bib0065) 2020; 8 Jones (10.1016/j.infsof.2021.106589_bib0082) 2005; 58 Cohen (10.1016/j.infsof.2021.106589_bib0083) 2010; 11 Miwa (10.1016/j.infsof.2021.106589_bib0060) 2014; 51 Ros (10.1016/j.infsof.2021.106589_bib0038) 2017 Dyba (10.1016/j.infsof.2021.106589_bib0072) 2007 Paynter (10.1016/j.infsof.2021.106589_bib0023) 2016 Riaz (10.1016/j.infsof.2021.106589_bib0073) 2010 Gøtzsche (10.1016/j.infsof.2021.106589_bib0081) 2007; 298 Bartholomew (10.1016/j.infsof.2021.106589_bib0011) 2002; 78 Beller (10.1016/j.infsof.2021.106589_bib0019) 2018; 7 Blake (10.1016/j.infsof.2021.106589_bib0047) 2015; 56 |
| References_xml | – start-page: 1 year: 2019 end-page: 10 ident: bib0040 article-title: A ranking-based approach for supporting the initial selection of primary studies in a systematic literature review publication-title: 2019 XLV Latin American Computing Conference (CLEI) – volume: 15 start-page: 354 year: 2016 end-page: 361 ident: bib0053 article-title: Data sampling and supervised learning for HIV literature screening publication-title: IEEE Trans. Nanobiosci. – volume: 11 year: 2014 ident: bib0007 article-title: Living systematic reviews: an emerging opportunity to narrow the evidence-practice gap publication-title: PLoS Med. – volume: 94 year: 2019 ident: bib0063 article-title: The use of bibliography enriched features for automatic citation screening publication-title: J. Biomed. Inform. – start-page: 31 year: 2011 end-page: 35 ident: bib0057 article-title: Linked data approach for selection process automation in systematic reviews publication-title: 15th Annual Conference on Evaluation & Assessment in Software Engineering (EASE 2011) – volume: 58 start-page: 741 year: 2005 end-page: 742 ident: bib0082 article-title: High prevalence but low impact of data extraction and reporting errors were found in Cochrane systematic reviews publication-title: J. Clin. Epidemiol. – volume: 18 start-page: 237 year: 2016 end-page: 252 ident: bib0043 article-title: Advanced analytics for the automation of medical systematic reviews publication-title: Inf. Syst. Front. – volume: 26 start-page: 1327 year: 2018 end-page: 1372 ident: bib0005 article-title: Model-based testing for software safety: a systematic mapping study publication-title: Softw. Qual. J. – volume: 4 start-page: 78 year: 2015 ident: bib0008 article-title: Automating data extraction in systematic reviews: a systematic review publication-title: Syst. Rev. – volume: 16 start-page: 690 year: 2009 end-page: 704 ident: bib0052 article-title: Cross-topic learning for work prioritization in systematic review creation and update publication-title: J. Am. Med. Inform. Assoc. – start-page: 41 year: 2017 end-page: 50 ident: bib0018 article-title: Text-mining techniques and tools for systematic literature reviews: a systematic literature review publication-title: 2017 24th Asia-Pacific Software Engineering Conference (APSEC) – start-page: 1646 year: 2019 end-page: 1656 ident: bib0046 article-title: Automatic Boolean query refinement for systematic review literature search publication-title: The World Wide Web Conference – reference: Elsevier, Content & features, in, n.d. – volume: 7 start-page: 64 year: 2018 ident: bib0071 article-title: Automated screening of research studies for systematic reviews using study characteristics publication-title: Syst. Rev. – volume: 55 start-page: 197 year: 2012 end-page: 207 ident: bib0061 article-title: Screening nonrandomized studies for medical systematic reviews: a comparative study of classifiers publication-title: Artif. Intell. Med. – volume: 64 start-page: 265 year: 2016 end-page: 272 ident: bib0034 article-title: Extractive text summarization system to aid data extraction from full text in systematic review development publication-title: J. Biomed. Inform. – year: 2007 ident: bib0003 article-title: Why Researchers Should Care About Patents – volume: 4 start-page: 5 year: 2015 ident: bib0012 article-title: Using text mining for study identification in systematic reviews: a systematic review of current approaches publication-title: Syst. Rev. – volume: 52 start-page: 871 year: 2010 end-page: 887 ident: bib0031 article-title: A systematic review of comparative evidence of aspect-oriented programming publication-title: Inf. Softw. Technol. – volume: 16 year: 2019 ident: bib0027 article-title: The significant cost of systematic reviews and meta-analyses: a call for greater involvement of machine learning to assess the promise of clinical trials publication-title: Contemp. Clin. Trials Commun. – reference: PubMed, About, in, n.d. – volume: 2 start-page: 1 year: 2011 end-page: 14 ident: bib0017 article-title: Applications of text mining within systematic reviews publication-title: Res. Synth. Methods – volume: 37 start-page: 51 year: 2003 end-page: 89 ident: bib0010 article-title: Natural language processing publication-title: Annu. Rev. Inf. Sci. Technol. – start-page: 1071 year: 2020 end-page: 1081 ident: bib0045 article-title: Automatic Boolean query formulation for systematic review literature search publication-title: Proceedings of The Web Conference 2020 – year: 2014 ident: bib0086 article-title: Text Preprocessing for NLP (Natural Language Processing), Beginners to Master – year: 2019 ident: bib0087 article-title: Text Preprocessing Steps and Universal Pipeline – volume: 7 year: 2020 ident: bib0036 article-title: A clustering approach for topic filtering within systematic literature reviews publication-title: MethodsX – volume: 24 start-page: 358 year: 2002 end-page: 363 ident: bib0076 article-title: Twelve tips for undertaking a systematic review publication-title: Med. Teach. – volume: 298 start-page: 430 year: 2007 end-page: 437 ident: bib0081 article-title: Data extraction errors in meta-analyses that use standardized mean differences publication-title: JAMA – volume: 11 start-page: 1 year: 2010 end-page: 11 ident: bib0022 article-title: Semi-automated screening of biomedical citations for systematic reviews publication-title: BMC Bioinformatics – volume: 8 start-page: 67698 year: 2020 end-page: 67717 ident: bib0065 article-title: Twitter and research: a systematic literature review through text mining publication-title: IEEE Access – start-page: 118 year: 2017 end-page: 127 ident: bib0038 article-title: A machine learning approach for semi-automated search and selection in literature studies publication-title: Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering – start-page: 225 year: 2007 end-page: 234 ident: bib0072 article-title: Applying systematic reviews to diverse study types: an experience report publication-title: First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007) – year: 2007 ident: bib0004 article-title: Guidelines For Performing Systematic Literature Reviews in Software Engineering – start-page: 1 year: 2016 end-page: 6 ident: bib0055 article-title: Enhancing academic literature review through relevance recommendation: using bibliometric and text-based features for classification publication-title: in: 2016 11th Iberian Conference on Information Systems and Technologies (CISTI) – volume: 78 start-page: 695 year: 2002 end-page: 696 ident: bib0011 article-title: James Lind’s treatise of the scurvy (1753) publication-title: Postgrad. Med. J. – start-page: 174 year: 2011 end-page: 183 ident: bib0015 article-title: Analysing the use of graphs to represent the results of systematic reviews in software engineering publication-title: 2011 25th Brazilian Symposium on Software Engineering – volume: 679 start-page: 45 year: 2005 ident: bib0074 publication-title: Systematic Review in Software Engineering – volume: 3 start-page: 74 year: 2014 ident: bib0021 article-title: Systematic review automation technologies publication-title: Syst. Rev. – start-page: 89 year: 2009 end-page: 92 ident: bib0075 article-title: The challenge of high recall in biomedical systematic search publication-title: Proceedings of the Third International Workshop on Data and Text Mining in Bioinformatics – year: 2018 ident: bib0085 article-title: Text Preprocessing in Python: Steps, Tools, and Examples – year: 2016 ident: bib0006 article-title: Tool Support for Systematic Reviews in Software Engineering – start-page: 264 year: 2018 end-page: 271 ident: bib0062 article-title: The canonical model of structure for data extraction in systematic reviews of scientific research articles publication-title: 2018 Fifth International Conference on Social Networks Analysis, Management and Security (SNAMS) – volume: 56 start-page: 42 year: 2015 end-page: 56 ident: bib0047 article-title: Automatic endpoint detection to support the systematic review process publication-title: J. Biomed. Inform. – volume: 8 start-page: 163 year: 2019 ident: bib0028 article-title: Toward systematic review automation: a practical guide to using machine learning tools in research synthesis publication-title: Syst. Rev. – volume: 62 start-page: 59 year: 2016 end-page: 65 ident: bib0064 article-title: Topic detection using paragraph vectors to support active learning in systematic reviews publication-title: J. Biomed. Inform. – year: 2020 ident: bib0070 article-title: Year Impact Factor & Ranking – start-page: 215 year: 2007 end-page: 224 ident: bib0084 article-title: Developing search strategies for detecting relevant experiments for systematic reviews publication-title: First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007) – volume: 15 year: 2018 ident: bib0025 publication-title: Machine Learning Techniques For the Automation of Literature Reviews and Systematic Reviews in EFSA – volume: 62 start-page: 506 year: 2009 end-page: 510 ident: bib0080 article-title: Choice of data extraction tools for systematic reviews depends on resources and review complexity publication-title: J. Clin. Epidemiol. – volume: 11 start-page: 492 year: 2010 ident: bib0083 article-title: The structural and content aspects of abstracts versus bodies of full text journal articles are different publication-title: BMC Bioinform. – start-page: 106 year: 2016 end-page: 114 ident: bib0037 article-title: A hybrid feature selection rule measure and its application to systematic review publication-title: Proceedings of the 18th International Conference on Information Integration and Web-based Applications and Services – volume: 5 start-page: 140 year: 2016 ident: bib0078 article-title: Use of cost-effectiveness analysis to compare the efficiency of study identification methods in systematic reviews publication-title: Syst. Rev. – start-page: 303 year: 2010 end-page: 311 ident: bib0051 article-title: Building systematic reviews using automatic text classification techniques publication-title: Proceedings of the 23rd International Conference on Computational Linguistics: Posters – year: 2019 ident: bib0089 article-title: Machine Learning Tasks in ML.NET – year: 2020 ident: bib0066 article-title: Using a neural network-based feature extraction method to facilitate citation screening for systematic reviews publication-title: Expert Syst. Appl. – volume: 57 start-page: 436 year: 2015 end-page: 445 ident: bib0049 article-title: Automatically finding relevant citations for clinical guideline development publication-title: J. Biomed. Inform. – start-page: 77 year: 2011 end-page: 86 ident: bib0068 article-title: Using visual text mining to support the study selection activity in systematic literature reviews publication-title: 2011 International Symposium on Empirical Software Engineering and Measurement – volume: 51 start-page: 242 year: 2014 end-page: 253 ident: bib0060 article-title: Reducing systematic review workload through certainty-based screening publication-title: J. Biomed. Inform. – year: 2019 ident: bib0091 article-title: Introduction to Machine Learning Model Evaluation – year: 2016 ident: bib0023 article-title: An exploration of the use of text-mining software in systematic reviews publication-title: EPC Methods: an Exploration of the Use of Text-Mining Software in Systematic Reviews – volume: 54 start-page: 1079 year: 2012 end-page: 1091 ident: bib0013 article-title: A visual analysis approach to validate the selection review of primary studies in systematic reviews publication-title: Inf. Softw. Technol. – start-page: 1 year: 2010 end-page: 10 ident: bib0073 article-title: Experiences conducting systematic reviews from novices’ perspective publication-title: 14th International Conference on Evaluation and Assessment in Software Engineering (EASE) – start-page: 173 year: 2010 end-page: 182 ident: bib0042 article-title: Active learning for biomedical citation screening publication-title: Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining – volume: 157 start-page: 189 year: 2019 end-page: 204 ident: bib0032 article-title: Obstacles and features of farm management information systems: a systematic literature review publication-title: Comput. Electron. Agric. – year: 2019 ident: bib0090 article-title: 20 Popular Machine Learning Metrics. Part 1: Classification & Regression Evaluation Metrics – volume: 41 start-page: 1498 year: 2014 end-page: 1508 ident: bib0048 article-title: Automatic text classification to support systematic reviews in medicine publication-title: Expert Syst. Appl. – year: 2014 ident: bib0014 article-title: A visual analysis approach to update systematic reviews publication-title: Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering – volume: 121 start-page: 81 year: 2020 end-page: 90 ident: bib0030 article-title: A full systematic review was completed in 2 weeks using automation tools: a case study publication-title: J. Clin. Epidemiol. – volume: 93 start-page: 74 year: 2005 ident: bib0077 article-title: Systematic reviews need systematic searchers publication-title: J. Med. Libr. Assoc. – start-page: 245 year: 2007 end-page: 254 ident: bib0016 article-title: A visual text mining approach for systematic reviews publication-title: First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007) – volume: 9 start-page: 587 year: 2018 end-page: 601 ident: bib0054 article-title: Discriminating between empirical studies and nonempirical works using automated text classification publication-title: Res. Synth. Methods – start-page: 20 year: 2018 end-page: 27 ident: bib0024 article-title: Automated) literature analysis: threats and experiences publication-title: Proceedings of the International Workshop on Software Engineering for Science – volume: 17 start-page: 4572 year: 2016 end-page: 4596 ident: bib0056 article-title: Extracting PICO sentences from clinical trial reports using supervised distant supervision publication-title: J. Mach. Learn. Res. – year: 2019 ident: bib0088 article-title: Representing Text in Natural Language Processing – volume: 147 start-page: 224 year: 2007 end-page: 233 ident: bib0009 article-title: How quickly do systematic reviews go out of date? A survival analysis publication-title: Ann. Intern. Med. – volume: 4 start-page: 107 year: 2011 end-page: 112 ident: bib0069 article-title: Whole field tendencies in transcranial magnetic stimulation: a systematic review with data and text mining publication-title: Asian J. Psychiatr. – volume: 72 start-page: 67 year: 2017 end-page: 76 ident: bib0041 article-title: A semi-supervised approach using label propagation to support citation screening publication-title: J. Biomed. Inform. – start-page: 1594 year: 2015 end-page: 1601 ident: bib0039 article-title: A method to support search string building in systematic literature reviews through visual text mining publication-title: Proceedings of the 30th Annual ACM Symposium on Applied Computing – year: 2016 ident: bib0020 article-title: A critical analysis of studies that address the use of text mining for citation screening in systematic reviews publication-title: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering – volume: 8 start-page: 143 year: 2019 ident: bib0026 article-title: A question of trust: can we build an evidence base to gain trust in systematic review automation technologies? publication-title: Syst. Rev. – volume: 13 start-page: 206 year: 2006 end-page: 219 ident: bib0033 article-title: Reducing workload in systematic review preparation using automated citation classification publication-title: J. Am. Med. Inform. Assoc. – volume: 7 start-page: 77 year: 2018 ident: bib0019 article-title: Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR) publication-title: Syst. Rev. – start-page: 1 year: 2019 end-page: 18 ident: bib0050 article-title: Automation in systematic, scoping and rapid reviews by an NLP toolkit: a case study in enhanced living environments publication-title: Enhanced Living Environments – volume: 134 year: 2020 ident: bib0059 article-title: Novel text analytics approach to identify relevant literature for human health risk assessments: a pilot study with health effects of in utero exposures publication-title: Environ. Int. – volume: 10 start-page: 72 year: 2019 end-page: 82 ident: bib0029 article-title: Usage of automation tools in systematic reviews publication-title: Res. Synth. Methods – volume: 33 start-page: 1 year: 2004 end-page: 26 ident: bib0079 publication-title: Procedures for Performing Systematic Reviews – year: 2015 ident: bib0067 article-title: Using rule-based classifiers in systematic reviews: a semantic class association rules approach publication-title: Proceedings of the 17th International Conference on Information Integration and Web-based Applications & Services – volume: 8 start-page: 1 year: 2019 end-page: 12 ident: bib0058 article-title: Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error publication-title: Syst. Rev. – volume: 61 start-page: 141 year: 2016 end-page: 148 ident: bib0035 article-title: PDF text classification to leverage information extraction from publication reports publication-title: J. Biomed. Inform. – volume: 51 start-page: 17 year: 2011 end-page: 25 ident: bib0092 article-title: Exploiting the systematic review protocol for classification of medical abstracts publication-title: Artif. Intell. Med. – volume: 47 start-page: 153 year: 2014 end-page: 159 ident: bib0044 article-title: An SVM-based high-quality article classifier for systematic reviews publication-title: J. Biomed. Inform. – volume: 4 start-page: 5 year: 2015 ident: 10.1016/j.infsof.2021.106589_bib0012 article-title: Using text mining for study identification in systematic reviews: a systematic review of current approaches publication-title: Syst. Rev. doi: 10.1186/2046-4053-4-5 – start-page: 245 year: 2007 ident: 10.1016/j.infsof.2021.106589_bib0016 article-title: A visual text mining approach for systematic reviews – start-page: 1646 year: 2019 ident: 10.1016/j.infsof.2021.106589_bib0046 article-title: Automatic Boolean query refinement for systematic review literature search – volume: 51 start-page: 242 year: 2014 ident: 10.1016/j.infsof.2021.106589_bib0060 article-title: Reducing systematic review workload through certainty-based screening publication-title: J. Biomed. Inform. doi: 10.1016/j.jbi.2014.06.005 – volume: 679 start-page: 45 year: 2005 ident: 10.1016/j.infsof.2021.106589_bib0074 – volume: 58 start-page: 741 year: 2005 ident: 10.1016/j.infsof.2021.106589_bib0082 article-title: High prevalence but low impact of data extraction and reporting errors were found in Cochrane systematic reviews publication-title: J. Clin. Epidemiol. doi: 10.1016/j.jclinepi.2004.11.024 – volume: 8 start-page: 163 year: 2019 ident: 10.1016/j.infsof.2021.106589_bib0028 article-title: Toward systematic review automation: a practical guide to using machine learning tools in research synthesis publication-title: Syst. Rev. doi: 10.1186/s13643-019-1074-9 – volume: 7 start-page: 64 year: 2018 ident: 10.1016/j.infsof.2021.106589_bib0071 article-title: Automated screening of research studies for systematic reviews using study characteristics publication-title: Syst. Rev. doi: 10.1186/s13643-018-0724-7 – year: 2020 ident: 10.1016/j.infsof.2021.106589_bib0070 – start-page: 1594 year: 2015 ident: 10.1016/j.infsof.2021.106589_bib0039 article-title: A method to support search string building in systematic literature reviews through visual text mining – volume: 41 start-page: 1498 year: 2014 ident: 10.1016/j.infsof.2021.106589_bib0048 article-title: Automatic text classification to support systematic reviews in medicine publication-title: Expert Syst. Appl. doi: 10.1016/j.eswa.2013.08.047 – volume: 17 start-page: 4572 year: 2016 ident: 10.1016/j.infsof.2021.106589_bib0056 article-title: Extracting PICO sentences from clinical trial reports using supervised distant supervision publication-title: J. Mach. Learn. Res. – start-page: 106 year: 2016 ident: 10.1016/j.infsof.2021.106589_bib0037 article-title: A hybrid feature selection rule measure and its application to systematic review – volume: 2 start-page: 1 year: 2011 ident: 10.1016/j.infsof.2021.106589_bib0017 article-title: Applications of text mining within systematic reviews publication-title: Res. Synth. Methods doi: 10.1002/jrsm.27 – start-page: 215 year: 2007 ident: 10.1016/j.infsof.2021.106589_bib0084 article-title: Developing search strategies for detecting relevant experiments for systematic reviews – volume: 78 start-page: 695 year: 2002 ident: 10.1016/j.infsof.2021.106589_bib0011 article-title: James Lind’s treatise of the scurvy (1753) publication-title: Postgrad. Med. J. doi: 10.1136/pmj.78.925.695 – start-page: 31 year: 2011 ident: 10.1016/j.infsof.2021.106589_bib0057 article-title: Linked data approach for selection process automation in systematic reviews – volume: 51 start-page: 17 year: 2011 ident: 10.1016/j.infsof.2021.106589_bib0092 article-title: Exploiting the systematic review protocol for classification of medical abstracts publication-title: Artif. Intell. Med. doi: 10.1016/j.artmed.2010.10.005 – start-page: 118 year: 2017 ident: 10.1016/j.infsof.2021.106589_bib0038 article-title: A machine learning approach for semi-automated search and selection in literature studies – volume: 26 start-page: 1327 year: 2018 ident: 10.1016/j.infsof.2021.106589_bib0005 article-title: Model-based testing for software safety: a systematic mapping study publication-title: Softw. Qual. J. doi: 10.1007/s11219-017-9386-2 – volume: 52 start-page: 871 year: 2010 ident: 10.1016/j.infsof.2021.106589_bib0031 article-title: A systematic review of comparative evidence of aspect-oriented programming publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2010.05.003 – volume: 64 start-page: 265 year: 2016 ident: 10.1016/j.infsof.2021.106589_bib0034 article-title: Extractive text summarization system to aid data extraction from full text in systematic review development publication-title: J. Biomed. Inform. doi: 10.1016/j.jbi.2016.10.014 – volume: 11 start-page: 492 year: 2010 ident: 10.1016/j.infsof.2021.106589_bib0083 article-title: The structural and content aspects of abstracts versus bodies of full text journal articles are different publication-title: BMC Bioinform. doi: 10.1186/1471-2105-11-492 – year: 2019 ident: 10.1016/j.infsof.2021.106589_bib0089 – year: 2018 ident: 10.1016/j.infsof.2021.106589_bib0085 – ident: 10.1016/j.infsof.2021.106589_bib0001 – volume: 72 start-page: 67 year: 2017 ident: 10.1016/j.infsof.2021.106589_bib0041 article-title: A semi-supervised approach using label propagation to support citation screening publication-title: J. Biomed. Inform. doi: 10.1016/j.jbi.2017.06.018 – volume: 56 start-page: 42 year: 2015 ident: 10.1016/j.infsof.2021.106589_bib0047 article-title: Automatic endpoint detection to support the systematic review process publication-title: J. Biomed. Inform. doi: 10.1016/j.jbi.2015.05.004 – start-page: 303 year: 2010 ident: 10.1016/j.infsof.2021.106589_bib0051 article-title: Building systematic reviews using automatic text classification techniques – year: 2016 ident: 10.1016/j.infsof.2021.106589_bib0020 article-title: A critical analysis of studies that address the use of text mining for citation screening in systematic reviews – start-page: 20 year: 2018 ident: 10.1016/j.infsof.2021.106589_bib0024 article-title: Automated) literature analysis: threats and experiences – volume: 61 start-page: 141 year: 2016 ident: 10.1016/j.infsof.2021.106589_bib0035 article-title: PDF text classification to leverage information extraction from publication reports publication-title: J. Biomed. Inform. doi: 10.1016/j.jbi.2016.03.026 – start-page: 1 year: 2019 ident: 10.1016/j.infsof.2021.106589_bib0040 article-title: A ranking-based approach for supporting the initial selection of primary studies in a systematic literature review – start-page: 173 year: 2010 ident: 10.1016/j.infsof.2021.106589_bib0042 article-title: Active learning for biomedical citation screening – volume: 298 start-page: 430 year: 2007 ident: 10.1016/j.infsof.2021.106589_bib0081 article-title: Data extraction errors in meta-analyses that use standardized mean differences publication-title: JAMA – start-page: 1 year: 2010 ident: 10.1016/j.infsof.2021.106589_bib0073 article-title: Experiences conducting systematic reviews from novices’ perspective – volume: 62 start-page: 506 year: 2009 ident: 10.1016/j.infsof.2021.106589_bib0080 article-title: Choice of data extraction tools for systematic reviews depends on resources and review complexity publication-title: J. Clin. Epidemiol. doi: 10.1016/j.jclinepi.2008.10.016 – volume: 15 year: 2018 ident: 10.1016/j.infsof.2021.106589_bib0025 – start-page: 77 year: 2011 ident: 10.1016/j.infsof.2021.106589_bib0068 article-title: Using visual text mining to support the study selection activity in systematic literature reviews – volume: 11 start-page: 1 year: 2010 ident: 10.1016/j.infsof.2021.106589_bib0022 article-title: Semi-automated screening of biomedical citations for systematic reviews publication-title: BMC Bioinformatics doi: 10.1186/1471-2105-11-55 – volume: 16 year: 2019 ident: 10.1016/j.infsof.2021.106589_bib0027 article-title: The significant cost of systematic reviews and meta-analyses: a call for greater involvement of machine learning to assess the promise of clinical trials publication-title: Contemp. Clin. Trials Commun. – volume: 94 year: 2019 ident: 10.1016/j.infsof.2021.106589_bib0063 article-title: The use of bibliography enriched features for automatic citation screening publication-title: J. Biomed. Inform. doi: 10.1016/j.jbi.2019.103202 – volume: 47 start-page: 153 year: 2014 ident: 10.1016/j.infsof.2021.106589_bib0044 article-title: An SVM-based high-quality article classifier for systematic reviews publication-title: J. Biomed. Inform. doi: 10.1016/j.jbi.2013.10.005 – volume: 13 start-page: 206 year: 2006 ident: 10.1016/j.infsof.2021.106589_bib0033 article-title: Reducing workload in systematic review preparation using automated citation classification publication-title: J. Am. Med. Inform. Assoc. doi: 10.1197/jamia.M1929 – start-page: 1 year: 2019 ident: 10.1016/j.infsof.2021.106589_bib0050 article-title: Automation in systematic, scoping and rapid reviews by an NLP toolkit: a case study in enhanced living environments – volume: 4 start-page: 107 year: 2011 ident: 10.1016/j.infsof.2021.106589_bib0069 article-title: Whole field tendencies in transcranial magnetic stimulation: a systematic review with data and text mining publication-title: Asian J. Psychiatr. doi: 10.1016/j.ajp.2011.03.003 – volume: 24 start-page: 358 year: 2002 ident: 10.1016/j.infsof.2021.106589_bib0076 article-title: Twelve tips for undertaking a systematic review publication-title: Med. Teach. doi: 10.1080/01421590220145707 – ident: 10.1016/j.infsof.2021.106589_bib0002 – volume: 15 start-page: 354 year: 2016 ident: 10.1016/j.infsof.2021.106589_bib0053 article-title: Data sampling and supervised learning for HIV literature screening publication-title: IEEE Trans. Nanobiosci. doi: 10.1109/TNB.2016.2565481 – volume: 7 year: 2020 ident: 10.1016/j.infsof.2021.106589_bib0036 article-title: A clustering approach for topic filtering within systematic literature reviews publication-title: MethodsX doi: 10.1016/j.mex.2020.100831 – volume: 18 start-page: 237 year: 2016 ident: 10.1016/j.infsof.2021.106589_bib0043 article-title: Advanced analytics for the automation of medical systematic reviews publication-title: Inf. Syst. Front. doi: 10.1007/s10796-015-9589-7 – year: 2015 ident: 10.1016/j.infsof.2021.106589_bib0067 article-title: Using rule-based classifiers in systematic reviews: a semantic class association rules approach – volume: 10 start-page: 72 year: 2019 ident: 10.1016/j.infsof.2021.106589_bib0029 article-title: Usage of automation tools in systematic reviews publication-title: Res. Synth. Methods doi: 10.1002/jrsm.1335 – volume: 157 start-page: 189 year: 2019 ident: 10.1016/j.infsof.2021.106589_bib0032 article-title: Obstacles and features of farm management information systems: a systematic literature review publication-title: Comput. Electron. Agric. doi: 10.1016/j.compag.2018.12.044 – year: 2014 ident: 10.1016/j.infsof.2021.106589_bib0014 article-title: A visual analysis approach to update systematic reviews – volume: 3 start-page: 74 year: 2014 ident: 10.1016/j.infsof.2021.106589_bib0021 article-title: Systematic review automation technologies publication-title: Syst. Rev. doi: 10.1186/2046-4053-3-74 – volume: 33 start-page: 1 year: 2004 ident: 10.1016/j.infsof.2021.106589_bib0079 – volume: 7 start-page: 77 year: 2018 ident: 10.1016/j.infsof.2021.106589_bib0019 article-title: Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR) publication-title: Syst. Rev. doi: 10.1186/s13643-018-0740-7 – volume: 62 start-page: 59 year: 2016 ident: 10.1016/j.infsof.2021.106589_bib0064 article-title: Topic detection using paragraph vectors to support active learning in systematic reviews publication-title: J. Biomed. Inform. doi: 10.1016/j.jbi.2016.06.001 – year: 2007 ident: 10.1016/j.infsof.2021.106589_bib0003 – start-page: 174 year: 2011 ident: 10.1016/j.infsof.2021.106589_bib0015 article-title: Analysing the use of graphs to represent the results of systematic reviews in software engineering – start-page: 89 year: 2009 ident: 10.1016/j.infsof.2021.106589_bib0075 article-title: The challenge of high recall in biomedical systematic search – volume: 16 start-page: 690 year: 2009 ident: 10.1016/j.infsof.2021.106589_bib0052 article-title: Cross-topic learning for work prioritization in systematic review creation and update publication-title: J. Am. Med. Inform. Assoc. doi: 10.1197/jamia.M3162 – year: 2016 ident: 10.1016/j.infsof.2021.106589_bib0023 article-title: An exploration of the use of text-mining software in systematic reviews – volume: 8 start-page: 1 year: 2019 ident: 10.1016/j.infsof.2021.106589_bib0058 article-title: Machine learning algorithms for systematic review: reducing workload in a preclinical review of animal studies and reducing human screening error publication-title: Syst. Rev. doi: 10.1186/s13643-019-0942-7 – year: 2019 ident: 10.1016/j.infsof.2021.106589_bib0090 – volume: 11 year: 2014 ident: 10.1016/j.infsof.2021.106589_bib0007 article-title: Living systematic reviews: an emerging opportunity to narrow the evidence-practice gap publication-title: PLoS Med. doi: 10.1371/journal.pmed.1001603 – year: 2016 ident: 10.1016/j.infsof.2021.106589_bib0006 – volume: 9 start-page: 587 year: 2018 ident: 10.1016/j.infsof.2021.106589_bib0054 article-title: Discriminating between empirical studies and nonempirical works using automated text classification publication-title: Res. Synth. Methods doi: 10.1002/jrsm.1317 – volume: 54 start-page: 1079 year: 2012 ident: 10.1016/j.infsof.2021.106589_bib0013 article-title: A visual analysis approach to validate the selection review of primary studies in systematic reviews publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2012.04.003 – volume: 93 start-page: 74 year: 2005 ident: 10.1016/j.infsof.2021.106589_bib0077 article-title: Systematic reviews need systematic searchers publication-title: J. Med. Libr. Assoc. – start-page: 41 year: 2017 ident: 10.1016/j.infsof.2021.106589_bib0018 article-title: Text-mining techniques and tools for systematic literature reviews: a systematic literature review – volume: 5 start-page: 140 year: 2016 ident: 10.1016/j.infsof.2021.106589_bib0078 article-title: Use of cost-effectiveness analysis to compare the efficiency of study identification methods in systematic reviews publication-title: Syst. Rev. doi: 10.1186/s13643-016-0315-4 – start-page: 264 year: 2018 ident: 10.1016/j.infsof.2021.106589_bib0062 article-title: The canonical model of structure for data extraction in systematic reviews of scientific research articles – year: 2019 ident: 10.1016/j.infsof.2021.106589_bib0091 – volume: 134 year: 2020 ident: 10.1016/j.infsof.2021.106589_bib0059 article-title: Novel text analytics approach to identify relevant literature for human health risk assessments: a pilot study with health effects of in utero exposures publication-title: Environ. Int. doi: 10.1016/j.envint.2019.105228 – volume: 55 start-page: 197 year: 2012 ident: 10.1016/j.infsof.2021.106589_bib0061 article-title: Screening nonrandomized studies for medical systematic reviews: a comparative study of classifiers publication-title: Artif. Intell. Med. doi: 10.1016/j.artmed.2012.05.002 – year: 2019 ident: 10.1016/j.infsof.2021.106589_bib0087 – year: 2007 ident: 10.1016/j.infsof.2021.106589_bib0004 – volume: 4 start-page: 78 year: 2015 ident: 10.1016/j.infsof.2021.106589_bib0008 article-title: Automating data extraction in systematic reviews: a systematic review publication-title: Syst. Rev. doi: 10.1186/s13643-015-0066-7 – year: 2020 ident: 10.1016/j.infsof.2021.106589_bib0066 article-title: Using a neural network-based feature extraction method to facilitate citation screening for systematic reviews publication-title: Expert Syst. Appl. – start-page: 1 year: 2016 ident: 10.1016/j.infsof.2021.106589_bib0055 article-title: Enhancing academic literature review through relevance recommendation: using bibliometric and text-based features for classification – start-page: 1071 year: 2020 ident: 10.1016/j.infsof.2021.106589_bib0045 article-title: Automatic Boolean query formulation for systematic review literature search – volume: 8 start-page: 67698 year: 2020 ident: 10.1016/j.infsof.2021.106589_bib0065 article-title: Twitter and research: a systematic literature review through text mining publication-title: IEEE Access doi: 10.1109/ACCESS.2020.2983656 – volume: 147 start-page: 224 year: 2007 ident: 10.1016/j.infsof.2021.106589_bib0009 article-title: How quickly do systematic reviews go out of date? A survival analysis publication-title: Ann. Intern. Med. doi: 10.7326/0003-4819-147-4-200708210-00179 – volume: 121 start-page: 81 year: 2020 ident: 10.1016/j.infsof.2021.106589_bib0030 article-title: A full systematic review was completed in 2 weeks using automation tools: a case study publication-title: J. Clin. Epidemiol. doi: 10.1016/j.jclinepi.2020.01.008 – start-page: 225 year: 2007 ident: 10.1016/j.infsof.2021.106589_bib0072 article-title: Applying systematic reviews to diverse study types: an experience report – year: 2014 ident: 10.1016/j.infsof.2021.106589_bib0086 – volume: 8 start-page: 143 year: 2019 ident: 10.1016/j.infsof.2021.106589_bib0026 article-title: A question of trust: can we build an evidence base to gain trust in systematic review automation technologies? publication-title: Syst. Rev. doi: 10.1186/s13643-019-1062-0 – volume: 57 start-page: 436 year: 2015 ident: 10.1016/j.infsof.2021.106589_bib0049 article-title: Automatically finding relevant citations for clinical guideline development publication-title: J. Biomed. Inform. doi: 10.1016/j.jbi.2015.09.003 – volume: 37 start-page: 51 year: 2003 ident: 10.1016/j.infsof.2021.106589_bib0010 article-title: Natural language processing publication-title: Annu. Rev. Inf. Sci. Technol. doi: 10.1002/aris.1440370103 – year: 2019 ident: 10.1016/j.infsof.2021.106589_bib0088 |
| SSID | ssj0017030 |
| Score | 2.6763918 |
| SecondaryResourceType | review_article |
| Snippet | Systematic Literature Review (SLR) studies aim to identify relevant primary papers, extract the required data, analyze, and synthesize results to gain further... |
| SourceID | crossref elsevier |
| SourceType | Enrichment Source Index Database Publisher |
| StartPage | 106589 |
| SubjectTerms | Automation Machine learning Natural language processing Review Systematic literature review (SLR) Text mining |
| Title | Automation of systematic literature reviews: A systematic literature review |
| URI | https://dx.doi.org/10.1016/j.infsof.2021.106589 |
| Volume | 136 |
| WOSCitedRecordID | wos000655363900011&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 customDbUrl: eissn: 1873-6025 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0017030 issn: 0950-5849 databaseCode: AIEXJ dateStart: 19950101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3JTsMwELWgRYgLYhVlUw5cU2VzE3MrBcQiVRyK1FvkOHFFaZOqTVn-nnHtLNCq0AOXKIocZ3mTyfP4zRihi8jFIbWjQLe4wXWg1BS-OUZ0bgSuRa0wMDGdLTbhtttet0ue1FTMZLacgBvH3scHGf0r1HAMwBapsyvAnXcKB2AfQIctwA7bPwHfnKbJMCeCpUrNg7yCskpYmci09GVNytxVZS6lmYB5Ah78XQjH0rnwvEiKuhaVKKR6m34Oi9n-TvQqEg7DpCdjr1fw-8wVwi0RTZJClB7sfpaDEpaZS-KK6KKhA7ch3xytXXaVpiA_ZKEXlwGFvhh6wKPUxQXqRfPvRbN__MxyiWGmXuv7shdf9OLLXtZR1XIxASdYbd7fdB_yaSfh_mRxRnn3Wa7lTBA4fzeLuUyJn3R20LYaWGhNaRC7aC2K99Bmltewjx4Lu9ASrhWgawXomrKLS625tMEBer696bTudLWShs5gSJjqzGLUNKkXWBQ4LrVNB9OA2yG3GlxQekEaGXHgy4xEQX_C3JAzYCrYa5gcCJ99iCpxEkdHSDMIjCk8zIwGcx3CsMc4xpFBGXacsMFwDdnZO_GZKjMvVjsZ-MsQqSE9P2sky6z80t7NXrevqKKkgD7Y0NIzj1e80gnaKgz8FFXS8TQ6QxvsLX2ZjM-VAX0BshKPjg |
| linkProvider | Elsevier |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Automation+of+systematic+literature+reviews%3A+A+systematic+literature+review&rft.jtitle=Information+and+software+technology&rft.au=van+Dinter%2C+Raymon&rft.au=Tekinerdogan%2C+Bedir&rft.au=Catal%2C+Cagatay&rft.date=2021-08-01&rft.issn=0950-5849&rft.volume=136&rft.spage=106589&rft_id=info:doi/10.1016%2Fj.infsof.2021.106589&rft.externalDBID=n%2Fa&rft.externalDocID=10_1016_j_infsof_2021_106589 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0950-5849&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0950-5849&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0950-5849&client=summon |