On the performance of hybrid search strategies for systematic literature reviews in software engineering

When conducting a Systematic Literature Review (SLR), researchers usually face the challenge of designing a search strategy that appropriately balances result quality and review effort. Using digital library (or database) searches or snowballing alone may not be enough to achieve high-quality result...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Information and software technology Ročník 123; s. 106294
Hlavní autori: Mourão, Erica, Pimentel, João Felipe, Murta, Leonardo, Kalinowski, Marcos, Mendes, Emilia, Wohlin, Claes
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: Elsevier B.V 01.07.2020
Predmet:
Database Search
Database searches
Database systems
Digital libraries
Hybrid search strategies
Hybrid strategies
Information retrieval
Iterative methods
Precision and recall
Search engines
Search strategies
Search Strategy
Snowballing
Software Engineering
Software quality
Systematic literature review
Systematic literature review (SLR)
Snowballing
Software Engineering
Database Search
Systematic literature review
Search Strategy
ISSN:0950-5849, 1873-6025, 1873-6025
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:When conducting a Systematic Literature Review (SLR), researchers usually face the challenge of designing a search strategy that appropriately balances result quality and review effort. Using digital library (or database) searches or snowballing alone may not be enough to achieve high-quality results. On the other hand, using both digital library searches and snowballing together may increase the overall review effort. The goal of this research is to propose and evaluate hybrid search strategies that selectively combine database searches with snowballing. We propose four hybrid search strategies combining database searches in digital libraries with iterative, parallel, or sequential backward and forward snowballing. We simulated the strategies over three existing SLRs in SE that adopted both database searches and snowballing. We compared the outcome of digital library searches, snowballing, and hybrid strategies using precision, recall, and F-measure to investigate the performance of each strategy. Our results show that, for the analyzed SLRs, combining database searches from the Scopus digital library with parallel or sequential snowballing achieved the most appropriate balance of precision and recall. We put forward that, depending on the goals of the SLR and the available resources, using a hybrid search strategy involving a representative digital library and parallel or sequential snowballing tends to represent an appropriate alternative to be used when searching for evidence in SLRs.
ISSN:0950-5849
1873-6025
1873-6025
DOI:10.1016/j.infsof.2020.106294