A systematic literature review of techniques and metrics to reduce the cost of mutation testing

•Comprehensive classifications for cost reduction goals and cost reduction techniques.•Overview of all selected studies grouped by cost reduction goal.•Characterization of metrics used to measure cost reduction.•Summary, analysis and discussion about cost savings and test effectiveness.•Recommendati...

Full description

Saved in:

Bibliographic Details
Published in:	The Journal of systems and software Vol. 157; p. 110388
Main Authors:	Pizzoleto, Alessandro Viola, Ferrari, Fabiano Cutigi, Offutt, Jeff, Fernandes, Leo, Ribeiro, Márcio
Format:	Journal Article
Language:	English
Published:	Elsevier Inc 01.11.2019
Subjects:	Cost reduction Mutation analysis Mutation testing Systematic review Systematic review Mutation analysis Mutation testing Cost reduction
ISSN:	0164-1212, 1873-1228
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Abstract	•Comprehensive classifications for cost reduction goals and cost reduction techniques.•Overview of all selected studies grouped by cost reduction goal.•Characterization of metrics used to measure cost reduction.•Summary, analysis and discussion about cost savings and test effectiveness.•Recommendations for future research. Historically, researchers have proposed and applied many techniques to reduce the cost of mutation testing. It has become difficult to find all techniques and to understand the cost-benefit tradeoffs among them, which is critical to transitioning this technology to practice. This paper extends a prior workshop paper to summarize and analyze the current knowledge about reducing the cost of mutation testing through a systematic literature review. We selected 175 peer-reviewed studies, from which 153 present either original or updated contributions. Our analysis resulted in six main goals for cost reduction and 21 techniques. In the last decade, a growing number of studies explored techniques such as selective mutation, evolutionary algorithms, control-flow analysis, and higher-order mutation. Furthermore, we characterized 18 metrics, with particular interest in the number of mutants to be executed, test cases required, equivalent mutants generated and detected, and mutant execution speedup. We found that cost reduction for mutation is increasingly becoming interdisciplinary, often combining multiple techniques. Additionally, measurements vary even for studies that use the same techniques. Researchers can use our results to find more detailed information about particular techniques, and to design comparable and reproducible experiments.
AbstractList	•Comprehensive classifications for cost reduction goals and cost reduction techniques.•Overview of all selected studies grouped by cost reduction goal.•Characterization of metrics used to measure cost reduction.•Summary, analysis and discussion about cost savings and test effectiveness.•Recommendations for future research. Historically, researchers have proposed and applied many techniques to reduce the cost of mutation testing. It has become difficult to find all techniques and to understand the cost-benefit tradeoffs among them, which is critical to transitioning this technology to practice. This paper extends a prior workshop paper to summarize and analyze the current knowledge about reducing the cost of mutation testing through a systematic literature review. We selected 175 peer-reviewed studies, from which 153 present either original or updated contributions. Our analysis resulted in six main goals for cost reduction and 21 techniques. In the last decade, a growing number of studies explored techniques such as selective mutation, evolutionary algorithms, control-flow analysis, and higher-order mutation. Furthermore, we characterized 18 metrics, with particular interest in the number of mutants to be executed, test cases required, equivalent mutants generated and detected, and mutant execution speedup. We found that cost reduction for mutation is increasingly becoming interdisciplinary, often combining multiple techniques. Additionally, measurements vary even for studies that use the same techniques. Researchers can use our results to find more detailed information about particular techniques, and to design comparable and reproducible experiments.
ArticleNumber	110388
Author	Pizzoleto, Alessandro Viola Ferrari, Fabiano Cutigi Offutt, Jeff Fernandes, Leo Ribeiro, Márcio
Author_xml	– sequence: 1 givenname: Alessandro Viola surname: Pizzoleto fullname: Pizzoleto, Alessandro Viola email: alessandro.pizzoleto@ufscar.br organization: Computing Department, Federal University of São Carlos—São Carlos, SP, Brazil – sequence: 2 givenname: Fabiano Cutigi orcidid: 0000-0002-7339-8529 surname: Ferrari fullname: Ferrari, Fabiano Cutigi email: fcferrari@ufscar.br organization: Computing Department, Federal University of São Carlos—São Carlos, SP, Brazil – sequence: 3 givenname: Jeff surname: Offutt fullname: Offutt, Jeff email: offutt@gmu.edu organization: Department of Computer Science, George Mason University—Fairfax, VA, USA – sequence: 4 givenname: Leo orcidid: 0000-0001-9090-2232 surname: Fernandes fullname: Fernandes, Leo email: leonardo.oliveira@ifal.edu.br organization: Informatics Coordination, Federal Institute of Alagoas—Maceió, AL, Brazil – sequence: 5 givenname: Márcio surname: Ribeiro fullname: Ribeiro, Márcio email: marcio@ic.ufal.br organization: Computing Institute, Federal University of Alagoas—Maceió, AL, Brazil
BookMark	eNp9kM1OwzAQhC1UJNrCA3DzCySsncSJxamq-JMqcYGz5Tpr6qhJwHZAfXtclROHnnY1mm-0OwsyG8YBCbllkDNg4q7LuxByDkzmUCcJLsicNXWRMc6bGZknT5l2xq_IIoQOAGoOfE7UioZDiNjr6Azdu4hex8kj9fjt8IeOlkY0u8F9TRioHlraY_TOBBrH5GkngzTukJoxxKO5n2JKGodEheiGj2tyafU-4M3fXJL3x4e39XO2eX16Wa82meGyjpnUtmRNUTCBAqARVjYo6hqMsC3XZSVByEo2hSiFtpJXWFa2tFJX21ZuJW-LJWGnXOPHEDxa9eldr_1BMVDHhlSnUkPq2JCCOkmQmPofY9zp-ui1258l708kppdST14F43Aw2DqPJqp2dGfoX3fSg9Y
CitedBy_id	crossref_primary_10_1016_j_infsof_2020_106496 crossref_primary_10_1002_stvr_1772 crossref_primary_10_1016_j_infsof_2023_107307 crossref_primary_10_1016_j_infsof_2020_106317 crossref_primary_10_1007_s10664_021_10047_9 crossref_primary_10_1109_TSE_2020_3002496 crossref_primary_10_1007_s10639_024_13228_3 crossref_primary_10_1145_3654677 crossref_primary_10_1016_j_scico_2020_102418 crossref_primary_10_1016_j_jss_2022_111399 crossref_primary_10_1002_stvr_1905 crossref_primary_10_1016_j_jss_2024_112247 crossref_primary_10_1002_stvr_1802 crossref_primary_10_7717_peerj_cs_293 crossref_primary_10_1145_3643756 crossref_primary_10_1002_stvr_1801 crossref_primary_10_1109_TSE_2023_3272309 crossref_primary_10_1002_stvr_1784 crossref_primary_10_1145_3725528 crossref_primary_10_1145_3510417 crossref_primary_10_1016_j_infsof_2021_106620 crossref_primary_10_1016_j_infsof_2020_106426 crossref_primary_10_3390_info13070327 crossref_primary_10_1016_j_jss_2025_112571 crossref_primary_10_1002_cae_22657 crossref_primary_10_3390_app13031710 crossref_primary_10_1109_TSE_2024_3377378 crossref_primary_10_1016_j_jss_2024_112332 crossref_primary_10_1007_s10791_025_09525_1 crossref_primary_10_1016_j_infsof_2022_107080 crossref_primary_10_1109_TSE_2024_3359969 crossref_primary_10_3390_sym11091145 crossref_primary_10_1007_s10664_022_10177_8 crossref_primary_10_1109_TSE_2021_3111169
Cites_doi	10.1002/stvr.226 10.1016/S0164-1212(96)00154-9 10.1109/TSE.1982.235571 10.1002/stvr.1630 10.1109/TSE.2012.39 10.1109/TSE.2010.28 10.1016/0164-1212(94)00098-0 10.1002/(SICI)1097-024X(199902)29:2<167::AID-SPE225>3.0.CO;2-V 10.1016/j.infsof.2011.03.009 10.1016/j.infsof.2016.01.017 10.1016/0164-1212(93)90005-I 10.1002/stvr.442 10.1093/comjnl/bxw076 10.15439/2017F375 10.1007/s10664-013-9299-z 10.1016/j.scico.2014.05.012 10.1002/stvr.313 10.4018/jncr.2012070102 10.1109/TR.2017.2705662 10.1109/32.286422 10.1016/j.infsof.2006.06.009 10.1109/TSE.1977.231145 10.1109/TSE.2013.44 10.1016/j.jss.2016.01.007 10.1145/151257.151258 10.1002/stvr.1480 10.1109/TSE.2014.2360690 10.1016/j.infsof.2011.12.001 10.1007/978-0-387-34848-3_40 10.1109/MS.2010.79 10.1109/TSE.2011.93 10.1002/stvr.1473 10.1002/(SICI)1099-1689(199912)9:4<233::AID-STVR191>3.0.CO;2-3 10.1002/(SICI)1099-1689(199912)9:4<205::AID-STVR186>3.0.CO;2-X 10.1145/227607.227610 10.1016/bs.adcom.2018.03.015 10.1109/TSE.2006.92 10.1002/stvr.1561 10.1016/j.jss.2012.08.024 10.1002/stvr.1469 10.1002/stvr.1529 10.1002/stvr.392 10.1016/j.infsof.2015.07.009 10.1109/32.92910 10.1007/s11219-011-9142-y 10.1016/j.infsof.2016.02.006 10.1016/j.scico.2013.02.011 10.1109/TSE.2010.62 10.1002/stvr.4370040303 10.1002/stvr.1471 10.19153/cleiej.15.1.2 10.1109/ACCESS.2017.2678200 10.1002/stvr.308 10.1016/j.infsof.2012.02.004 10.1002/(SICI)1099-1689(199709)7:3<165::AID-STVR143>3.0.CO;2-U 10.1002/stvr.4370040104 10.1109/32.90444 10.1142/S021819400200113X 10.1109/C-M.1978.218136 10.1016/j.infsof.2011.03.008 10.1002/stvr.242 10.1016/j.infsof.2016.07.002 10.1016/0950-5849(90)90053-T 10.1007/BF00625279
ContentType	Journal Article
Copyright	2019 Elsevier Inc.
Copyright_xml	– notice: 2019 Elsevier Inc.
DBID	AAYXX CITATION
DOI	10.1016/j.jss.2019.07.100
DatabaseName	CrossRef
DatabaseTitle	CrossRef
DatabaseTitleList
DeliveryMethod	fulltext_linktorsrc
Discipline	Computer Science
EISSN	1873-1228
ExternalDocumentID	10_1016_j_jss_2019_07_100 S0164121219301554
GroupedDBID	--K --M -~X .DC .~1 0R~ 1B1 1~. 1~5 29L 4.4 457 4G. 5GY 5VS 7-5 71M 8P~ 9JN 9M8 AABNK AACTN AAEDT AAEDW AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AAXUO AAYFN AAYOK ABBOA ABEFU ABFNM ABFRF ABFSI ABJNI ABMAC ABTAH ABXDB ABYKQ ACDAQ ACGFO ACGFS ACGOD ACNNM ACRLP ACZNC ADBBV ADEZE ADHUB ADJOM ADMUD AEBSH AEFWE AEKER AENEX AFKWA AFTJW AGHFR AGUBO AGYEJ AHHHB AHZHX AI. AIALX AIEXJ AIKHN AITUG AJBFU AJOXV ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ AOUOD ASPBG AVWKF AXJTR AZFZN BKOJK BKOMP BLXMC CS3 DU5 E.L EBS EFJIC EFLBG EJD EO8 EO9 EP2 EP3 FDB FEDTE FGOYB FIRID FNPLU FYGXN G-Q G8K GBLVA GBOLZ HLZ HVGLF HZ~ IHE J1W KOM LG9 M41 MO0 MS~ N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. PQQKQ Q38 R2- RIG RNS ROL RPZ RXW SBC SDF SDG SDP SES SEW SPC SPCBC SSV SSZ T5K TAE TN5 TWZ UHS UNMZH VH1 WUQ XPP ZMT ZY4 ~G- 9DU AATTM AAXKI AAYWO AAYXX ABDPE ABWVN ACLOT ACRPL ACVFH ADCNI ADNMO AEIPS AEUPX AFJKZ AFPUW AGQPQ AIGII AIIUN AKBMS AKRWK AKYEP ANKPU APXCP CITATION EFKBS ~HD
ID	FETCH-LOGICAL-c297t-9af4183316e60086f98e6770c6fd2a4590695983646af925e45f4f9a5bd9b92d3
ISICitedReferencesCount	68
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000488137500004&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	0164-1212
IngestDate	Sat Nov 29 07:24:36 EST 2025 Tue Nov 18 22:40:09 EST 2025 Fri Feb 23 02:32:34 EST 2024
IsPeerReviewed	true
IsScholarly	true
Keywords	Systematic review Mutation analysis Mutation testing Cost reduction
Language	English
LinkModel	OpenURL
MergedId	FETCHMERGED-LOGICAL-c297t-9af4183316e60086f98e6770c6fd2a4590695983646af925e45f4f9a5bd9b92d3
ORCID	0000-0001-9090-2232 0000-0002-7339-8529
ParticipantIDs	crossref_primary_10_1016_j_jss_2019_07_100 crossref_citationtrail_10_1016_j_jss_2019_07_100 elsevier_sciencedirect_doi_10_1016_j_jss_2019_07_100
PublicationCentury	2000
PublicationDate	November 2019 2019-11-00
PublicationDateYYYYMMDD	2019-11-01
PublicationDate_xml	– month: 11 year: 2019 text: November 2019
PublicationDecade	2010
PublicationTitle	The Journal of systems and software
PublicationYear	2019
Publisher	Elsevier Inc
Publisher_xml	– name: Elsevier Inc
References	Tuya, Suárez-Cabal, de la Riva (bib0178) 2007; 49 Fleyshgakker, Weiss (bib0057) 1994 Kurtz, Ammann, Offutt, Delamaro, Kurtz, Gökçe (bib0108) 2016 Patel, Hierons (bib0154) 2016 Kim, Ma, Kwon (bib0096) 2012; 23 Derezińska, Hałas (bib0043) 2015 Oliveira, Camilo-Junior, Vincenzi (bib0140) 2013 Gopinath, Mathis, Zeller (bib0068) 2018 Gligoric, Zhang, Pereira, Pokam (bib0064) 2013 Bluemke, Kulesza (bib0020) 2014 Silva, Souza, Souza (bib0173) 2017; 81 Offutt, Lee (bib0133) 1994; 20 Li, West, Escalona, Durelli (bib0111) 2015 Derezińska, Rudnik (bib0044) 2012 Zhu, Panichella, Zaidman (bib0201) 2017 Durelli, Offutt, Delamaro (bib0052) 2012 Petrović, Ivanković, Kurtz, Ammann, Just (bib0157) 2018 Kintis, Papadakis, Malevris (bib0102) 2012 Inozemtseva, Hemmati, Holmes (bib0079) 2013 Delgado-Pérez, Medina-Bulo, Palomo-Lozano, García-Domínguez, Domínguez-Jiménez (bib0032) 2017 Li, Praphamontripong, Offutt (bib0110) 2009 Madeyski, Orzeszyna, Torkar, Józala (bib0117) 2014; 40 Ferrari, Pizzoleto, Offutt (bib0054) 2018 Al-Hajjaji, Krüger, Benduhn, Leich, Saake (bib0007) 2017 Offutt, Lee, Rothermel, Untch, Zapf (bib0131) 1996; 5 Biolchini, Mian, Natali, Travassos (bib0018) 2005 Wohlin (bib0188) 2014 Offutt, Pan (bib0135) 1996 Andrews, Briand, Labiche (bib0011) 2005 McMinn, Kapfhammer, Wright (bib0125) 2016 Frankl, Weiss, Hu (bib0058) 1997; 38 Mathur, Wong (bib0123) 1994; 4 Schuler, Zeller (bib0170) 2013; 23 Kaminski, Ammann (bib0091) 2009 Zhang, Gligoric, Marinov, Khurshid (bib0196) 2013 Zhu, Panichella, Zaidman (bib0202) 2018 Just, Schweiggert (bib0090) 2015; 25 Wong, Mathur (bib0190) 1995; 31 Domínguez-Jiménez, Estero-Botaro, Medina-Bulo (bib0051) 2009 Anbalagan, Xie (bib0010) 2008 Iida, Takada (bib0078) 2017 Patrick, Oriol, Clark (bib0155) 2012 Delamaro, Deng, Durelli, Li, Offutt (bib0028) 2014 Untch, Harrold, Offutt (bib0181) 1997 Zhang, Hou, Hu, Xie, Mei (bib0197) 2010 Gopinath, Ahmed, Alipour, Jensen, Groce (bib0065) 2017; 66 Ferrari, Pizzoleto, Offutt, Fernandes, Ribeiro (bib0055) 2018 Polo, Reales (bib0159) 2010; 27 Ferrari, Rashid, Maldonado (bib0056) 2013; 78 Papadakis, Le Traon (bib0145) 2013 McMinn, Wright, McCurdy, Kapfhammer (bib0126) 2018 DeMillo, Krauser, Mathur (bib0035) 1991 Offutt, Lee (bib0132) 1991 Papadakis, Malevris, Kallia (bib0152) 2010 Papadakis, Malevris (bib0147) 2010 Domínguez-Jiménez, Estero-Botaro, García-Domínguez, Medina-Bulo (bib0050) 2011; 53 Liu, Gao, Shan, Liu, Zhang, Sun (bib0113) 2006 MacDonell, Shepperd, Kitchenham, Mendes (bib0116) 2010; 36 Zhang, Marinov, Khurshid (bib0198) 2013 Bieman, Ghosh, Alexander (bib0017) 2001 Kaminski, Ammann (bib0092) 2011; 21 Reales, Polo (bib0164) 2014; 25 Kintis, Papadakis, Jia, Malevris, Le Traon, Harman (bib0100) 2017; 44 Steimann, Thies (bib0175) 2010 Jia, Harman (bib0082) 2011; 37 Bluemke, Kulesza (bib0021) 2014 Bluemke, Kulesza (bib0019) 2013 Kintis, Papadakis, Malevris (bib0103) 2015; 25 Kintis, Malevris (bib0099) 2015; 68 Papadakis, Malevris (bib0148) 2010 Choi, Mathur (bib0027) 1993; 20 Aichernig, Auer, Jöbstl, Korošec, Krenn, Schlick, Schmidt (bib0004) 2014 Hamlet (bib0069) 1977; 3 Papadakis, Kintis, Zhang, Jia, Le Traon, Harman (bib0144) 2019; 112 Offutt, Jin, Pan (bib0130) 1999; 29 DeMillo, Offutt (bib0037) 1991; 17 Hierons, Harman, Danicic (bib0074) 1999; 9 Offutt, Ma, Kwon (bib0134) 2006 Hu, Li, Offutt (bib0077) 2011 Krauser, Mathur, Rego (bib0107) 1991; 17 Delgado-Pérez, Medina-Bulo, Merayo (bib0031) 2017 Kintis, Malevris (bib0098) 2014 Offutt, Untch (bib0139) 2000 Fraser, Zeller (bib0061) 2012; 38 Papadakis, Malevris (bib0149) 2011 Delgado-Pérez, Medina-Bulo, Segura, García-Domínguez, Juan (bib0033) 2017 Derezińska (bib0042) 2016 Henard, Papadakis, Le Traon (bib0072) 2014 Reales, Polo (bib0162) 2012 Sun, Xue, Liu, Zhang (bib0177) 2017; 81 Kintis, Papadakis, Malevris (bib0101) 2010 Parsai, Murgia, Demeyer (bib0153) 2016 Do, Rothermel (bib0048) 2006; 32 Kintis, Malevris (bib0097) 2013 Belli, Beyazıt (bib0016) 2015; 41 Mathur, Wong (bib0122) 1993 Just, Ernst, Fraser (bib0084) 2014 Kaminski, Ammann, Offutt (bib0093) 2011 Baudry, Fleurey, Jézéquel, Le Traon (bib0015) 2005; 15 Bogacki, Walter (bib0023) 2006 Praphamontripong, Offutt (bib0160) 2017 Kitchenham, Dybå, Jørgensen (bib0105) 2004 Sahinoğlu, Spafford (bib0167) 1990 Papadakis, Malevris (bib0146) 2009 Schuler, Dallmeier, Zeller (bib0168) 2009 Petrović, Ivanković (bib0156) 2018 DeMillo, Lipton, Sayward (bib0036) 1978; 11 Just, Kapfhammer, Schweiggert (bib0087) 2012 Budd, Angluin (bib0024) 1982; 8 Vincenzi, Nakagawa, Maldonado, Delamaro, Romero (bib0184) 2002; 12 Nobre, Vergilio, Pozo (bib0128) 2012 Reales, Polo, Alemán (bib0165) 2013; 39 Fernandes, Ribeiro, Carvalho, Gheyi, Mongiovi, Santos, Cavalcanti, Ferrari, Maldonado (bib0053) 2017 Untch (bib0179) 1992 Lacerda, Ferrari (bib0109) 2014 Kaminski, Praphamontripong, Ammann, Offutt (bib0095) 2011; 53 Cachia, Micallef, Colombo (bib0025) 2013 Marshall, Hedley, Riddell, Hennell (bib0119) 1990; 32 Abuljadayel, Wedyan (bib0001) 2018; 10 Papadakis, Delamaro, Le Traon (bib0142) 2014 Aichernig, Jöbstl, Kegele (bib0006) 2013 Barbosa, Maldonado, Vincenzi (bib0013) 2001; 11 Just, Jalali, Inozemtseva, Ernst, Holmes, Fraser (bib0085) 2014 Woodward, Halewood (bib0192) 1988 DeMillo, Offutt (bib0038) 1993; 2 Delamaro, Deng, Li, Durelli, Offutt (bib0029) 2014 Wright, Kapfhammer, McMinn (bib0194) 2014 Just, Kurtz, Ammann (bib0089) 2017 Kaminski, Ammann, Offutt (bib0094) 2013; 86 Kitchenham (bib0104) 2004 Derezińska (bib0041) 2013 Adamopoulos, Harman, Hierons (bib0003) 2004 Wright, Kapfhammer, McMinn (bib0193) 2013 Ji, Chen, Xu, Zhao (bib0081) 2009 Polo, Piattini, García-Rodríguez (bib0158) 2009; 19 Acree, Budd, DeMillo, Lipton, Sayward (bib0002) 1979 Howden (bib0076) 1982; 8 Delamaro, Offutt, Ammann (bib0030) 2014 Fraser, Zeller (bib0060) 2010 Zhang, Marinov, Zhang, Khurshid (bib0199) 2012 Harman, Hierons, Danicic (bib0070) 2000 Ma, Kim (bib0114) 2016; 115 Bogacki, Walter (bib0022) 2006 Just (bib0083) 2014 Harman, Jia, Reales, Polo (bib0071) 2014 Gopinath, Jensen, Groce (bib0067) 2016 Siami-Namin, Andrews, Murdoch (bib0172) 2008 Krauser, Mathur, Rego (bib0106) 1988 Wong, Mathur, Maldonado (bib0191) 1995 Untch, Offutt, Harrold (bib0182) 1993 Quyen, Tung, Hanh, Binh (bib0161) 2016 Zhang, Wangi, Zhang, Hao, Zang, Cheng, Zhang (bib0195) 2016 Derezińska, Rudnik (bib0045) 2017 Aichernig, Jöbstl (bib0005) 2012 Vincenzi, Maldonado, Barbosa, Delamaro (bib0183) 2001; 11 Holling, Banescu, Probst, Petrovska, Pretschner (bib0075) 2016 Reales, Polo (bib0163) 2013; 23 Weiss, Fleyshgakker (bib0187) 1993 Delgado-Pérez, Segura, Medina-Bulo (bib0034) 2017; 27 Denisov, Pankevich (bib0040) 2018 Offutt, Craft (bib0129) 1994; 4 Lima, Guizzo, Vergilio, Silva, Filho, Ehrenfried (bib0112) 2016 Offutt, Rothermel, Zapf (bib0138) 1993 Papadakis, Jia, Harman, Le Traon (bib0143) 2015 Papadakis, Malevris (bib0151) 2012; 54 Wedyan, Ghosh (bib0186) 2012 Devroey, Perrouin, Papadakis, Legay, Schobbens, Heymans (bib0046) 2016 Siami-Namin, Andrews (bib0171) 2006 Ammann, Delamaro, Offutt (bib0009) 2014 Fraser, Arcuri (bib0059) 2015; 20 Domínguez-Jiménez, Estero-Botaro, García-Domínguez, Medina-Bulo (bib0049) 2009 Mresa, Bottaci (bib0127) 1999; 9 Gligoric, Jagannath, Marinov (bib0063) 2010 Just, Kapfhammer, Schweiggert (bib0088) 2012 Offutt, Pargas, Fichter, Khambekar (bib0137) 1992 Wang, Xiong, Shi, Zhang, Hao (bib0185) 2017 Mathur (bib0120) 1991 Chen, Zhang (bib0026) 2018 Devroey, Perrouin, Papadakis, Legay, Schobbens, Heymans (bib0047) 2017 Untch (bib0180) 2009 Gligoric, Jagannath, Luo, Marinov (bib0062) 2012; 23 Deng, Offutt, Li (bib0039) 2013 Reuling, Bürdek, Rotärmel, Lochau, Kelter (bib0166) 2015 Zhang, Xie, Zhang, Tillmann, de Halleux, Mei (bib0200) 2010 Just, Kapfhammer, Schweiggert (bib0086) 2011 Wong, Maldonado, Delamaro, Mathur (bib0189) 1994 Matnei Filho, Vergilio (bib0124) 2015 Ma, Offutt, Kwon (bib0115) 2005; 15 Sun, Pan, Wang, Liu, Zhang (bib0176) 2017; 60 Sridharan, Siami-Namin (bib0174) 2010 Ayari, Bouktif, Antoniol (bib0012) 2007 Schuler, Zeller (bib0169) 2010 Gopinath, Alipour, Ahmed, Jensen, Groce (bib0066) 2016 Jackson, Woodward (bib0080) 2000 Offutt, Pan (bib0136) 1997; 7 Bashir, Nadeem (bib0014) 2017; 5 Mathur (bib0121) 2007 Alexander, Bieman, Ghosh, Ji (bib0008) 2002 Papadakis, Malevris (bib0150) 2011; 19 Hernandes, Zamboni, Fabbri, Di Thommazo (bib0073) 2012; 15 Omar, Ghosh (bib0141) 2012 Marcozzi, Bardin, Kosmatov, Papadakis, Prevosto, Correnson (bib0118) 2018 Krauser (10.1016/j.jss.2019.07.100_bib0107) 1991; 17 Offutt (10.1016/j.jss.2019.07.100_bib0131) 1996; 5 Untch (10.1016/j.jss.2019.07.100_bib0179) 1992 Kim (10.1016/j.jss.2019.07.100_bib0096) 2012; 23 Papadakis (10.1016/j.jss.2019.07.100_bib0147) 2010 Domínguez-Jiménez (10.1016/j.jss.2019.07.100_bib0051) 2009 Just (10.1016/j.jss.2019.07.100_bib0088) 2012 Vincenzi (10.1016/j.jss.2019.07.100_bib0183) 2001; 11 Bluemke (10.1016/j.jss.2019.07.100_bib0021) 2014 Zhang (10.1016/j.jss.2019.07.100_bib0195) 2016 Derezińska (10.1016/j.jss.2019.07.100_bib0042) 2016 Zhang (10.1016/j.jss.2019.07.100_bib0200) 2010 Steimann (10.1016/j.jss.2019.07.100_bib0175) 2010 Papadakis (10.1016/j.jss.2019.07.100_bib0151) 2012; 54 Marshall (10.1016/j.jss.2019.07.100_bib0119) 1990; 32 Schuler (10.1016/j.jss.2019.07.100_bib0170) 2013; 23 Delgado-Pérez (10.1016/j.jss.2019.07.100_bib0033) 2017 Henard (10.1016/j.jss.2019.07.100_bib0072) 2014 Gopinath (10.1016/j.jss.2019.07.100_bib0066) 2016 Quyen (10.1016/j.jss.2019.07.100_bib0161) 2016 Just (10.1016/j.jss.2019.07.100_bib0090) 2015; 25 Abuljadayel (10.1016/j.jss.2019.07.100_bib0001) 2018; 10 Offutt (10.1016/j.jss.2019.07.100_bib0129) 1994; 4 Jackson (10.1016/j.jss.2019.07.100_bib0080) 2000 Sridharan (10.1016/j.jss.2019.07.100_bib0174) 2010 Bieman (10.1016/j.jss.2019.07.100_bib0017) 2001 Weiss (10.1016/j.jss.2019.07.100_bib0187) 1993 Offutt (10.1016/j.jss.2019.07.100_bib0135) 1996 Kitchenham (10.1016/j.jss.2019.07.100_bib0104) 2004 Fraser (10.1016/j.jss.2019.07.100_bib0059) 2015; 20 Mathur (10.1016/j.jss.2019.07.100_bib0122) 1993 DeMillo (10.1016/j.jss.2019.07.100_bib0037) 1991; 17 Bogacki (10.1016/j.jss.2019.07.100_bib0023) 2006 Ji (10.1016/j.jss.2019.07.100_bib0081) 2009 Kaminski (10.1016/j.jss.2019.07.100_bib0091) 2009 Hamlet (10.1016/j.jss.2019.07.100_bib0069) 1977; 3 Kintis (10.1016/j.jss.2019.07.100_bib0099) 2015; 68 Oliveira (10.1016/j.jss.2019.07.100_bib0140) 2013 Domínguez-Jiménez (10.1016/j.jss.2019.07.100_bib0049) 2009 Wohlin (10.1016/j.jss.2019.07.100_bib0188) 2014 Reales (10.1016/j.jss.2019.07.100_bib0163) 2013; 23 Tuya (10.1016/j.jss.2019.07.100_bib0178) 2007; 49 Al-Hajjaji (10.1016/j.jss.2019.07.100_bib0007) 2017 Siami-Namin (10.1016/j.jss.2019.07.100_bib0172) 2008 Durelli (10.1016/j.jss.2019.07.100_bib0052) 2012 Patrick (10.1016/j.jss.2019.07.100_bib0155) 2012 Bluemke (10.1016/j.jss.2019.07.100_bib0020) 2014 Kintis (10.1016/j.jss.2019.07.100_bib0098) 2014 Gligoric (10.1016/j.jss.2019.07.100_bib0064) 2013 Ma (10.1016/j.jss.2019.07.100_bib0115) 2005; 15 Sun (10.1016/j.jss.2019.07.100_bib0176) 2017; 60 Mathur (10.1016/j.jss.2019.07.100_bib0121) 2007 Untch (10.1016/j.jss.2019.07.100_bib0182) 1993 Wright (10.1016/j.jss.2019.07.100_bib0193) 2013 Papadakis (10.1016/j.jss.2019.07.100_bib0146) 2009 Delgado-Pérez (10.1016/j.jss.2019.07.100_bib0032) 2017 Papadakis (10.1016/j.jss.2019.07.100_bib0144) 2019; 112 Gopinath (10.1016/j.jss.2019.07.100_bib0068) 2018 Wong (10.1016/j.jss.2019.07.100_bib0191) 1995 Schuler (10.1016/j.jss.2019.07.100_bib0168) 2009 Marcozzi (10.1016/j.jss.2019.07.100_bib0118) 2018 Offutt (10.1016/j.jss.2019.07.100_bib0136) 1997; 7 Wedyan (10.1016/j.jss.2019.07.100_bib0186) 2012 Patel (10.1016/j.jss.2019.07.100_bib0154) 2016 Zhang (10.1016/j.jss.2019.07.100_bib0199) 2012 Just (10.1016/j.jss.2019.07.100_bib0084) 2014 Sun (10.1016/j.jss.2019.07.100_bib0177) 2017; 81 Mathur (10.1016/j.jss.2019.07.100_bib0120) 1991 Gligoric (10.1016/j.jss.2019.07.100_bib0062) 2012; 23 Reales (10.1016/j.jss.2019.07.100_bib0162) 2012 Adamopoulos (10.1016/j.jss.2019.07.100_sbref0003) 2004 Bogacki (10.1016/j.jss.2019.07.100_bib0022) 2006 Jia (10.1016/j.jss.2019.07.100_bib0082) 2011; 37 Devroey (10.1016/j.jss.2019.07.100_bib0046) 2016 Zhang (10.1016/j.jss.2019.07.100_bib0196) 2013 Fleyshgakker (10.1016/j.jss.2019.07.100_bib0057) 1994 Andrews (10.1016/j.jss.2019.07.100_bib0011) 2005 Delamaro (10.1016/j.jss.2019.07.100_bib0030) 2014 DeMillo (10.1016/j.jss.2019.07.100_bib0036) 1978; 11 Offutt (10.1016/j.jss.2019.07.100_bib0133) 1994; 20 Reales (10.1016/j.jss.2019.07.100_bib0164) 2014; 25 Just (10.1016/j.jss.2019.07.100_bib0083) 2014 Hu (10.1016/j.jss.2019.07.100_bib0077) 2011 Offutt (10.1016/j.jss.2019.07.100_bib0138) 1993 Devroey (10.1016/j.jss.2019.07.100_bib0047) 2017 Papadakis (10.1016/j.jss.2019.07.100_bib0142) 2014 Bluemke (10.1016/j.jss.2019.07.100_bib0019) 2013 Choi (10.1016/j.jss.2019.07.100_bib0027) 1993; 20 Hernandes (10.1016/j.jss.2019.07.100_bib0073) 2012; 15 Vincenzi (10.1016/j.jss.2019.07.100_bib0184) 2002; 12 Schuler (10.1016/j.jss.2019.07.100_bib0169) 2010 Omar (10.1016/j.jss.2019.07.100_bib0141) 2012 Lacerda (10.1016/j.jss.2019.07.100_bib0109) 2014 Frankl (10.1016/j.jss.2019.07.100_bib0058) 1997; 38 Papadakis (10.1016/j.jss.2019.07.100_bib0150) 2011; 19 DeMillo (10.1016/j.jss.2019.07.100_bib0038) 1993; 2 Zhang (10.1016/j.jss.2019.07.100_bib0197) 2010 Gopinath (10.1016/j.jss.2019.07.100_bib0067) 2016 Papadakis (10.1016/j.jss.2019.07.100_bib0143) 2015 Cachia (10.1016/j.jss.2019.07.100_bib0025) 2013 Untch (10.1016/j.jss.2019.07.100_bib0181) 1997 Offutt (10.1016/j.jss.2019.07.100_bib0137) 1992 Parsai (10.1016/j.jss.2019.07.100_bib0153) 2016 Reales (10.1016/j.jss.2019.07.100_bib0165) 2013; 39 Kintis (10.1016/j.jss.2019.07.100_bib0100) 2017; 44 Zhang (10.1016/j.jss.2019.07.100_bib0198) 2013 Petrović (10.1016/j.jss.2019.07.100_bib0157) 2018 Holling (10.1016/j.jss.2019.07.100_bib0075) 2016 Budd (10.1016/j.jss.2019.07.100_bib0024) 1982; 8 Ferrari (10.1016/j.jss.2019.07.100_bib0056) 2013; 78 Fraser (10.1016/j.jss.2019.07.100_bib0060) 2010 Derezińska (10.1016/j.jss.2019.07.100_bib0045) 2017 Polo (10.1016/j.jss.2019.07.100_bib0158) 2009; 19 Just (10.1016/j.jss.2019.07.100_bib0085) 2014 Kaminski (10.1016/j.jss.2019.07.100_bib0092) 2011; 21 Kaminski (10.1016/j.jss.2019.07.100_bib0095) 2011; 53 Acree (10.1016/j.jss.2019.07.100_bib0002) 1979 Polo (10.1016/j.jss.2019.07.100_bib0159) 2010; 27 Offutt (10.1016/j.jss.2019.07.100_bib0139) 2000 Silva (10.1016/j.jss.2019.07.100_bib0173) 2017; 81 Offutt (10.1016/j.jss.2019.07.100_bib0132) 1991 Wang (10.1016/j.jss.2019.07.100_bib0185) 2017 Aichernig (10.1016/j.jss.2019.07.100_bib0006) 2013 Wright (10.1016/j.jss.2019.07.100_bib0194) 2014 Delamaro (10.1016/j.jss.2019.07.100_bib0028) 2014 Papadakis (10.1016/j.jss.2019.07.100_bib0145) 2013 Denisov (10.1016/j.jss.2019.07.100_bib0040) 2018 Krauser (10.1016/j.jss.2019.07.100_bib0106) 1988 Delgado-Pérez (10.1016/j.jss.2019.07.100_bib0031) 2017 Petrović (10.1016/j.jss.2019.07.100_bib0156) 2018 Woodward (10.1016/j.jss.2019.07.100_bib0192) 1988 Bashir (10.1016/j.jss.2019.07.100_bib0014) 2017; 5 Inozemtseva (10.1016/j.jss.2019.07.100_bib0079) 2013 Untch (10.1016/j.jss.2019.07.100_bib0180) 2009 Mresa (10.1016/j.jss.2019.07.100_bib0127) 1999; 9 Gligoric (10.1016/j.jss.2019.07.100_bib0063) 2010 Kintis (10.1016/j.jss.2019.07.100_bib0103) 2015; 25 DeMillo (10.1016/j.jss.2019.07.100_bib0035) 1991 Ma (10.1016/j.jss.2019.07.100_bib0114) 2016; 115 Harman (10.1016/j.jss.2019.07.100_bib0070) 2000 Papadakis (10.1016/j.jss.2019.07.100_bib0152) 2010 Just (10.1016/j.jss.2019.07.100_bib0086) 2011 Gopinath (10.1016/j.jss.2019.07.100_bib0065) 2017; 66 Iida (10.1016/j.jss.2019.07.100_bib0078) 2017 Ferrari (10.1016/j.jss.2019.07.100_sbref0055) 2018 Kaminski (10.1016/j.jss.2019.07.100_bib0094) 2013; 86 Li (10.1016/j.jss.2019.07.100_bib0111) 2015 Aichernig (10.1016/j.jss.2019.07.100_bib0005) 2012 Hierons (10.1016/j.jss.2019.07.100_bib0074) 1999; 9 Delgado-Pérez (10.1016/j.jss.2019.07.100_bib0034) 2017; 27 Kintis (10.1016/j.jss.2019.07.100_bib0102) 2012 Liu (10.1016/j.jss.2019.07.100_bib0113) 2006 Madeyski (10.1016/j.jss.2019.07.100_bib0117) 2014; 40 Kitchenham (10.1016/j.jss.2019.07.100_bib0105) 2004 Kurtz (10.1016/j.jss.2019.07.100_bib0108) 2016 Praphamontripong (10.1016/j.jss.2019.07.100_bib0160) 2017 Harman (10.1016/j.jss.2019.07.100_bib0071) 2014 Kintis (10.1016/j.jss.2019.07.100_bib0097) 2013 Ayari (10.1016/j.jss.2019.07.100_bib0012) 2007 Offutt (10.1016/j.jss.2019.07.100_bib0130) 1999; 29 Delamaro (10.1016/j.jss.2019.07.100_bib0029) 2014 Sahinoğlu (10.1016/j.jss.2019.07.100_bib0167) 1990 Barbosa (10.1016/j.jss.2019.07.100_bib0013) 2001; 11 Derezińska (10.1016/j.jss.2019.07.100_bib0041) 2013 Ammann (10.1016/j.jss.2019.07.100_bib0009) 2014 Just (10.1016/j.jss.2019.07.100_bib0087) 2012 Lima (10.1016/j.jss.2019.07.100_bib0112) 2016 Matnei Filho (10.1016/j.jss.2019.07.100_bib0124) 2015 Siami-Namin (10.1016/j.jss.2019.07.100_bib0171) 2006 Papadakis (10.1016/j.jss.2019.07.100_bib0148) 2010 Anbalagan (10.1016/j.jss.2019.07.100_bib0010) 2008 Li (10.1016/j.jss.2019.07.100_bib0110) 2009 MacDonell (10.1016/j.jss.2019.07.100_bib0116) 2010; 36 Derezińska (10.1016/j.jss.2019.07.100_bib0044) 2012 Wong (10.1016/j.jss.2019.07.100_bib0189) 1994 Zhu (10.1016/j.jss.2019.07.100_bib0202) 2018 Wong (10.1016/j.jss.2019.07.100_bib0190) 1995; 31 Mathur (10.1016/j.jss.2019.07.100_bib0123) 1994; 4 Alexander (10.1016/j.jss.2019.07.100_bib0008) 2002 Baudry (10.1016/j.jss.2019.07.100_bib0015) 2005; 15 McMinn (10.1016/j.jss.2019.07.100_bib0125) 2016 Papadakis (10.1016/j.jss.2019.07.100_bib0149) 2011 Offutt (10.1016/j.jss.2019.07.100_bib0134) 2006 Biolchini (10.1016/j.jss.2019.07.100_bib0018) 2005 Derezińska (10.1016/j.jss.2019.07.100_bib0043) 2015 Howden (10.1016/j.jss.2019.07.100_bib0076) 1982; 8 Aichernig (10.1016/j.jss.2019.07.100_bib0004) 2014 Ferrari (10.1016/j.jss.2019.07.100_bib0054) 2018 McMinn (10.1016/j.jss.2019.07.100_bib0126) 2018 Belli (10.1016/j.jss.2019.07.100_bib0016) 2015; 41 Chen (10.1016/j.jss.2019.07.100_bib0026) 2018 Kintis (10.1016/j.jss.2019.07.100_bib0101) 2010 Reuling (10.1016/j.jss.2019.07.100_bib0166) 2015 Zhu (10.1016/j.jss.2019.07.100_bib0201) 2017 Kaminski (10.1016/j.jss.2019.07.100_bib0093) 2011 Deng (10.1016/j.jss.2019.07.100_bib0039) 2013 Fernandes (10.1016/j.jss.2019.07.100_bib0053) 2017 Nobre (10.1016/j.jss.2019.07.100_bib0128) 2012 Do (10.1016/j.jss.2019.07.100_bib0048) 2006; 32 Domínguez-Jiménez (10.1016/j.jss.2019.07.100_bib0050) 2011; 53 Fraser (10.1016/j.jss.2019.07.100_bib0061) 2012; 38 Just (10.1016/j.jss.2019.07.100_bib0089) 2017
References_xml	– start-page: 69 year: 2009 end-page: 80 ident: bib0168 article-title: Efficient mutation testing by checking invariant violations publication-title: Proceedings of the 18th International Symposium on Software Testing and Analysis (ISSTA) – start-page: 1 year: 2018 end-page: 10 ident: bib0054 article-title: A systematic review of cost reduction techniques for mutation testing: preliminary results publication-title: Proceedings of the 13th International Workshop on Mutation Analysis (Mutation) – volume: 37 start-page: 649 year: 2011 end-page: 678 ident: bib0082 article-title: An analysis and survey of the development of mutation testing publication-title: IEEE Trans. Softw. Eng. – start-page: 63 year: 2013 end-page: 72 ident: bib0193 article-title: Efficient mutation analysis of relational database structure using mutant schemata and parallelisation publication-title: Proceedings of the 8th International Workshop on Mutation Analysis (Mutation) – start-page: 829 year: 2013 end-page: 836 ident: bib0140 article-title: A coevolutionary algorithm to automatic test case selection and mutant in mutation testing publication-title: Proceedings of the 2013 IEEE Congress on Evolutionary Computation (CEC) – start-page: 351 year: 2008 end-page: 360 ident: bib0172 article-title: Sufficient mutation operators for measuring test effectiveness publication-title: Proceedings of the 30th International Conference on Software Engineering (ICSE) – start-page: 337 year: 2001 end-page: 340 ident: bib0017 article-title: A technique for mutation of Java objects publication-title: Proceedings of the 16th International Conference on Automated Software Engineering (ASE) - Short Paper – start-page: 171 year: 1988 end-page: 177 ident: bib0106 article-title: High performance testing on SIMD machines publication-title: Proceedings of the 2nd Workshop on Software Testing, Verification, and Analysis – start-page: 681 year: 2012 end-page: 690 ident: bib0052 article-title: Toward harnessing high-level language virtual machines for further speeding up weak mutation testing publication-title: Proceedings of the 5th International Conference on Software Testing, Verification and Validation (ICST) – start-page: 92 year: 2014 end-page: 106 ident: bib0072 article-title: Mutation-based generation of software product line test configurations publication-title: Proceedings of the 6th International Symposium Search-Based Software Engineering (SSBSE) – volume: 38 start-page: 278 year: 2012 end-page: 292 ident: bib0061 article-title: Mutation-driven generation of oracles and unit tests publication-title: IEEE Trans. Softw. Eng. – start-page: 18 year: 2018 end-page: 24 ident: bib0068 article-title: If you can’t kill a supermutant, you have a problem publication-title: Proceedings of the 13th International Workshop on Mutation Analysis (Mutation) – volume: 19 start-page: 111 year: 2009 end-page: 131 ident: bib0158 article-title: Decreasing the cost of mutation testing with second-order mutants publication-title: Softw. Test. Verif. Reliabil. – start-page: 43 year: 1990 end-page: 56 ident: bib0167 article-title: A Bayes sequential statistical procedure for approving software products publication-title: Proceedings of the IFIP Conference on Approving Software Products (ASP) – start-page: 511 year: 2016 end-page: 522 ident: bib0066 article-title: On the limits of mutation reduction strategies publication-title: Proceedings of the 38th International Conference on Software Engineering (ICSE) – volume: 3 start-page: 279 year: 1977 end-page: 290 ident: bib0069 article-title: Testing programs with the aid of a compiler publication-title: IEEE Trans. Softw. Eng. – volume: 15 start-page: 97 year: 2005 end-page: 133 ident: bib0115 article-title: MuJava: an automated class mutation system publication-title: Softw. Test. Verif. Reliabil. – start-page: 1 year: 2012 end-page: 10 ident: bib0141 article-title: An exploratory study of higher order mutation testing in aspect-oriented programming publication-title: Proceedings of the 23th International Symposium on Software Reliability Engineering (ISSRE) – start-page: 169 year: 2017 end-page: 184 ident: bib0032 article-title: Assessment of class mutation operators for C++ with the MuCPP mutation system publication-title: Inf. Softw. Technol. – volume: 68 start-page: 1 year: 2015 end-page: 17 ident: bib0099 article-title: MEDIC: a static analysis framework for equivalent mutant identification publication-title: Inf. Softw. Technol. – start-page: 78 year: 2006 end-page: 84 ident: bib0134 article-title: The class-level mutants of MuJava publication-title: Proceedings of the International Workshop on Automation of Software Test (AST) – year: 2005 ident: bib0018 article-title: Systematic Review in Software Engineering publication-title: Tech. Report RT-ES 679/05 – volume: 29 start-page: 167 year: 1999 end-page: 193 ident: bib0130 article-title: The dynamic domain reduction approach to test data generation publication-title: Softw. Pract. Exp. – year: 2018 ident: bib0055 article-title: SLR on Cost Reduction for Mutation Testing – Companion Website – volume: 9 start-page: 205 year: 1999 end-page: 232 ident: bib0127 article-title: Efficiency of mutation operators and selective mutation strategies: an empirical study publication-title: Softw. Test. Verif. Reliabil. – year: 1979 ident: bib0002 article-title: Mutation Analysis publication-title: Technical Report GIT-ICS-79/08 – start-page: 149 year: 1993 end-page: 158 ident: bib0187 article-title: Improved serial algorithms for mutation analysis publication-title: Proceedings of the International Symposium on Software Testing and Analysis (ISSTA) – start-page: 121 year: 2010 end-page: 130 ident: bib0148 article-title: Automatic mutation test case generation via dynamic symbolic execution publication-title: Proceedings of the IEEE 21th International Symposium on Software Reliability Engineering (ISSRE) – start-page: 200 year: 1991 end-page: 213 ident: bib0132 article-title: How strong is weak mutation? publication-title: Proceedings of the International Symposium on Software Testing and Analysis (ISSTA) – start-page: 11 year: 2012 end-page: 20 ident: bib0088 article-title: Using non-redundant mutation operators and test suite prioritization to achieve efficient and scalable mutation analysis publication-title: Proceedings of the IEEE 23th International Symposium on Software Reliability Engineering (ISSRE) – start-page: 84 year: 2013 end-page: 93 ident: bib0039 article-title: Empirical evaluation of the statement deletion mutation operator publication-title: Proceedings of the 6th International Conference on Software Testing, Verification and Validation (ICST) – start-page: 34 year: 2000 end-page: 44 ident: bib0139 article-title: Mutation 2000: uniting the orthogonal publication-title: Proceedings of the Mutation 2000 Symposium – start-page: 386 year: 2009 end-page: 395 ident: bib0091 article-title: Using a fault hierarchy to improve the efficiency of DNF logic mutation testing publication-title: Proceedings of the 2nd International Conference on Software Testing, Verification and Validation (ICST) – start-page: 331 year: 2012 end-page: 341 ident: bib0199 article-title: Regression mutation testing publication-title: Proceedings of the 21st International Symposium on Software Testing and Analysis (ISSTA) – volume: 38 start-page: 235 year: 1997 end-page: 253 ident: bib0058 article-title: All-uses vs mutation testing: an experimental comparison of effectiveness publication-title: J. Syst. Softw. – start-page: 320 year: 1993 end-page: 335 ident: bib0122 article-title: Evaluation of the cost of alternative mutation testing strategies publication-title: Proceedings of the 7th Brazilian Symposium on Software Engineering (SBES) – start-page: 36 year: 2016 end-page: 42 ident: bib0125 article-title: Virtual mutation analysis of relational database schemas publication-title: Proceedings of the 11th International Workshop on Automation of Software Test (AST) – volume: 20 start-page: 783 year: 2015 end-page: 812 ident: bib0059 article-title: Achieving scalable mutation-based generation of whole test suites publication-title: Empir. Softw. Eng. – volume: 11 start-page: 113 year: 2001 end-page: 136 ident: bib0013 article-title: Toward the determination of sufficient mutant operators for C publication-title: Softw. Test. Verif. Reliabil. – volume: 41 start-page: 113 year: 2015 end-page: 134 ident: bib0016 article-title: Exploiting model morphology for event-based testing publication-title: IEEE Trans. Softw. Eng. – start-page: 42 year: 2012 end-page: 57 ident: bib0044 article-title: Quality evaluation of object-oriented and standard mutation operators applied to C# programs publication-title: Proceedings of the 50th International Conference on Modelling Techniques and Tools for Computer Performance Evaluation (TOOLS) – start-page: 247 year: 2011 end-page: 248 ident: bib0149 article-title: Automatic mutation based test data generation publication-title: Proceedings of the 13th Genetic and Evolutionary Computation Conference (GECCO): Search-Based Software Engineering Track (Poster Session) – start-page: 711 year: 2012 end-page: 719 ident: bib0155 article-title: MESSI: mutant evaluation by static semantic interpretation publication-title: Proceedings of the 5th International Conference on Software Testing, Verification and Validation (ICST) – volume: 44 start-page: 1 year: 2017 end-page: 25 ident: bib0100 article-title: Detecting trivial mutant equivalences via compiler optimisations publication-title: IEEE Trans. Softw. Eng. – volume: 5 start-page: 3657 year: 2017 end-page: 3674 ident: bib0014 article-title: Improved genetic algorithm to reduce mutation testing cost publication-title: IEEE Access – start-page: 235 year: 2013 end-page: 245 ident: bib0198 article-title: Faster mutation testing inspired by test prioritization and reduction publication-title: Proceedings of the 22nd International Symposium on Software Testing and Analysis (ISSTA) – start-page: 196 year: 2014 end-page: 205 ident: bib0098 article-title: Using data flow patterns for equivalent mutant detection publication-title: Proceedings of the 9th International Workshop on Mutation Analysis (Mutation) – start-page: 55 year: 2000 end-page: 61 ident: bib0080 article-title: Parallel firm mutation of Java programs publication-title: Proceedings of the Mutation 2000 Symposium – start-page: 50 year: 2011 end-page: 56 ident: bib0086 article-title: Using conditional mutation to increase the efficiency of mutation analysis publication-title: Proceedings of the 6th International Workshop on Automation of Software Test (AST) – start-page: 147 year: 2010 end-page: 158 ident: bib0060 article-title: Mutation-driven generation of oracles and unit tests publication-title: Proceedings of the 19th International Symposium on Software Testing and Analysis (ISSTA) – start-page: 1 year: 2009 end-page: 6 ident: bib0081 article-title: A novel method of mutation clustering based on domain analysis publication-title: Proceedings of the 21th International Conference on Software Engineering and Knowledge Engineering (SEKE) – start-page: 97 year: 2016 end-page: 108 ident: bib0042 article-title: Evaluation of deletion mutation operators in mutation testing of C# programs publication-title: Proceedings of the 11th International Conference on Dependability and Complex Systems (DepCoS-RELCOMEX) – start-page: 341 year: 2002 end-page: 351 ident: bib0008 article-title: Mutation of Java objects publication-title: Proceedings of the 13th International Symposium on Software Reliability Engineering (ISSRE) – start-page: 187 year: 2017 end-page: 198 ident: bib0053 article-title: Avoiding useless mutants publication-title: Proceedings of the 16th ACM International Conference on Generative Programming: Concepts and Experiences (GPCE) – start-page: 55 year: 2010 end-page: 64 ident: bib0063 article-title: MuTMuT: efficient exploration for mutation testing of multithreaded code publication-title: Proceedings of the 3th International Conference on Software Testing, Verification and Validation (ICST) – start-page: 664 year: 2012 end-page: 672 ident: bib0162 article-title: Mutant execution cost reduction: through MUSIC (Mutant schema improved with extra code) publication-title: Proceedings of the 5th International Conference on Software Testing, Verification and Validation (ICST) – volume: 11 start-page: 34 year: 1978 end-page: 43 ident: bib0036 article-title: Hints on test data selection: help for the practicing programmer publication-title: IEEE Comput. – volume: 25 start-page: 490 year: 2015 end-page: 507 ident: bib0090 article-title: Higher accuracy and lower run time: efficient mutation analysis using non-redundant mutation operators publication-title: Softw. Test. Verif. Reliabil. – start-page: 298 year: 2014 end-page: 319 ident: bib0142 article-title: Mitigating the effects of equivalent mutants with mutant classification strategies publication-title: Sci. Comput. Programm. – start-page: 11 year: 2014 end-page: 20 ident: bib0030 article-title: Designing deletion mutation operators publication-title: Proceedings of the 7th International Conference on Software Testing, Verification and Validation (ICST) – volume: 7 start-page: 165 year: 1997 end-page: 192 ident: bib0136 article-title: Automatically detecting equivalent mutants and infeasible paths publication-title: Softw. Test. Verif. Reliabil. – start-page: 1223 year: 2013 end-page: 1229 ident: bib0145 article-title: Mutation testing strategies using mutant classification publication-title: Proceedings of the 28th ACM Symposium on Applied Computing (SAC) – start-page: 45 year: 2010 end-page: 54 ident: bib0169 article-title: (Un-)Covering equivalent mutants publication-title: Proceedings of the 3th International Conference on Software Testing, Verification and Validation (ICST) – volume: 32 start-page: 99 year: 1990 end-page: 104 ident: bib0119 article-title: Static dataflow-aided weak mutation analysis (SDAWM) publication-title: Inf. Softw. Technol. – start-page: 92 year: 2013 end-page: 102 ident: bib0196 article-title: Operator-based and random mutant selection: better together publication-title: Proceedings of the 28th International Conference on Automated Software Engineering (ASE) – volume: 78 start-page: 1639 year: 2013 end-page: 1662 ident: bib0056 article-title: Towards the practical mutation testing of AspectJ programs publication-title: Sci. Comput. Programm. – start-page: 93 year: 2014 end-page: 102 ident: bib0021 article-title: Reductions of operators in Java mutation testing publication-title: Proceedings of the 9th International Conference on Dependability and Complex Systems (DepCoS-RELCOMEX) – start-page: 351 year: 1991 end-page: 356 ident: bib0035 article-title: Compiler-integrated program mutation publication-title: Proceedings of the 15th IEEE Annual Computer Software and Applications Conference (COMPSAC) – volume: 31 start-page: 185 year: 1995 end-page: 196 ident: bib0190 article-title: Reducing the cost of mutation testing: an empirical study publication-title: J. Syst. Softw. – volume: 23 start-page: 375 year: 2012 end-page: 403 ident: bib0062 article-title: Efficient mutation testing of multithreaded code publication-title: Softw. Test. Verif. Reliabil. – start-page: 71 year: 2009 end-page: 75 ident: bib0180 article-title: On reduced neighborhood mutation analysis using a single mutagenic operator publication-title: Proceedings of the 47th Annual Southeast Regional Conference (ACM-SE) – start-page: 5 year: 2000 end-page: 13 ident: bib0070 article-title: The relationship between program dependence and mutation analysis publication-title: Proceedings of the Mutation 2000 Symposium – start-page: 239 year: 2008 end-page: 248 ident: bib0010 article-title: Automated generation of pointcut mutants for testing pointcuts in AspectJ programs publication-title: Proceeding of the 19th International Symposium on Software Reliability Engineering (ISSRE) – start-page: 163 year: 2018 end-page: 171 ident: bib0156 article-title: State of mutation testing at Google publication-title: Proceedings of the 40th International Conference on Software Engineering - Software Engineering in Practice Track (ICSE-SEIP) (to appear) – start-page: 134 year: 2017 end-page: 142 ident: bib0160 article-title: Finding redundancy in web mutation operators publication-title: Proceedings of the 12th International Workshop on Mutation Analysis (Mutation) – start-page: 97 year: 2009 end-page: 106 ident: bib0049 article-title: GAmera: an automatic mutant generation system for WS-BPEL compositions publication-title: Proceedings of the 7th IEEE European Conference on Web Services (ECOWS) – start-page: 439 year: 1994 end-page: 452 ident: bib0189 article-title: Constrained mutation in C programs publication-title: Proceedings of the 8th Brazilian Symposium on Software Engineering (SBES) – start-page: 424 year: 2017 end-page: 429 ident: bib0047 article-title: Automata language equivalence vs. simulations for model-based mutant equivalence: an empirical evaluation publication-title: Proceedings of the 10th IEEE International Conference on Software Testing, Verification and Validation (ICST) – year: 1992 ident: bib0137 article-title: Mutation testing of software using a MIMD computer publication-title: Proceedings of the International Conference on Parallel Processing (ICPP) – start-page: 655 year: 2016 end-page: 666 ident: bib0046 article-title: Featured model-based mutation analysis publication-title: Proceedings of the 38th International Conference on Software Engineering (ICSE) – start-page: 131 year: 2015 end-page: 140 ident: bib0166 article-title: Fault-based product-line testing: effective sample generation based on feature-diagram mutation publication-title: Proceedings of the 19th International Conference on Software Product Line (SPLC) – start-page: 1 year: 2014 end-page: 19 ident: bib0004 article-title: Model-based mutation testing of an industrial measurement device publication-title: Proceedings of the 8th International Conference Tests and Proofs (TAP) – volume: 27 start-page: 1630 year: 2017 end-page: 1649 ident: bib0034 article-title: Assessment of C++ object-oriented mutation operators: a selective mutation approach publication-title: Softw. Test. Verif. Reliabil. – start-page: 233 year: 2015 end-page: 242 ident: bib0043 article-title: Improving mutation testing process of python programs publication-title: Proceedings of the 4th Computer Science On-line Conference Software Engineering in Intelligent Systems (CSOC) – start-page: 397 year: 2014 end-page: 408 ident: bib0071 article-title: Angels and monsters: an empirical investigation of potential test effectiveness and efficiency improvement from strongly subsuming higher order mutation publication-title: Proceedings of the 29th International Conference on Automated Software Engineering (ASE) – volume: 25 start-page: 508 year: 2015 end-page: 535 ident: bib0103 article-title: Employing second-order mutation for isolating first-order equivalent mutants publication-title: Softw. Test. Verif. Reliabil. – start-page: 604 year: 1991 end-page: 605 ident: bib0120 article-title: Performance, effectiveness, and reliability issues in software testing publication-title: Proceedings of the 15th IEEE Annual Computer Software and Applications Conference (COMPSAC) – volume: 23 start-page: 315 year: 2013 end-page: 350 ident: bib0163 article-title: Parallel mutation testing publication-title: Softw. Test. Verif. Reliabil. – volume: 2 start-page: 109 year: 1993 end-page: 127 ident: bib0038 article-title: Experimental results from an automatic test case generator publication-title: ACM Trans. Softw. Eng.Methodol. – start-page: 1387 year: 2017 end-page: 1392 ident: bib0033 article-title: GiGAn: evolutionary mutation testing for C++ object-oriented systems publication-title: Proceedings of the 32nd ACM Symposium on Applied Computing (SAC) – start-page: 81 year: 2014 end-page: 90 ident: bib0029 article-title: Growing a reduced set of mutation operators publication-title: Proceedings of the 28th Brazilian Symposium on Software Engineering (SBES) – start-page: 701 year: 2012 end-page: 710 ident: bib0102 article-title: Isolating first order equivalent mutants via second order mutation publication-title: Proceedings of the 5th IEEE International Conference on Software Testing, Verification and Validation (ICST) – start-page: 220 year: 2009 end-page: 229 ident: bib0110 article-title: An experimental comparison of four unit test criteria: mutation, edge-pair, all-uses and prime path coverage publication-title: Proceedings of the 4th International Workshop on Mutation Analysis (Mutation) – start-page: 1 year: 2010 end-page: 10 ident: bib0200 article-title: Test generation via dynamic symbolic execution for mutation testing publication-title: Proceedings of the 26th International Conference on Software Maintenance (ICSM) – start-page: 1 year: 2006 end-page: 10 ident: bib0171 article-title: Finding sufficient mutation operators via variable reduction publication-title: Proceedings of the 2nd Workshop on Mutation Analysis (Mutation) – start-page: 273 year: 2006 end-page: 282 ident: bib0022 article-title: Aspect-oriented response injection: an alternative to classical mutation testing publication-title: Proceedings of the IFIP Working Conference on Software Engineering Techniques: Design for Quality (SET) – volume: 81 start-page: 19 year: 2017 end-page: 35 ident: bib0173 article-title: A systematic review on search based mutation testing publication-title: Inf. Softw. Technol. – start-page: 180 year: 2013 end-page: 188 ident: bib0097 article-title: Identifying more equivalent mutants via code similarity publication-title: Proceedings of the 20th Asia-Pacific Software Engineering Conference (APSEC) – start-page: 1 year: 2015 end-page: 6 ident: bib0111 article-title: Mutation testing in practice using ruby publication-title: Proceedings of the 10th International Workshop on Mutation Analysis (Mutation) – start-page: 41 year: 2013 end-page: 51 ident: bib0019 article-title: Reduction of computational cost in mutation testing by sampling mutants publication-title: Proceedings of the 8th International Conference on Dependability and Complex Systems (DepCoS-RELCOMEX) – volume: 9 start-page: 233 year: 1999 end-page: 262 ident: bib0074 article-title: Using program slicing to assist in the detection of equivalent mutants publication-title: Softw. Test. Verif. Reliabil. – start-page: 123 year: 2016 end-page: 138(LNCS v.9976) ident: bib0154 article-title: Resolving the equivalent mutant problem in the presence of non-determinism and coincidental correctness publication-title: Proceedings of the 28th International Conference on Testing Software and Systems (ICTSS) – volume: 60 start-page: 143 year: 2017 end-page: 158 ident: bib0176 article-title: An empirical study on mutation testing of WS-BPEL programs publication-title: Comput. J. – volume: 15 start-page: 13 year: 2012 end-page: 25 ident: bib0073 article-title: Using GQM and TAM to evaluate StArt - a tool that supports systematic review publication-title: CLEI Electron. J. – volume: 32 start-page: 733 year: 2006 end-page: 752 ident: bib0048 article-title: On the use of mutation faults in empirical assessments of test case prioritization techniques publication-title: IEEE Trans. Softw. Eng. – volume: 12 start-page: 675 year: 2002 end-page: 689 ident: bib0184 article-title: Bayesian-learning based guidelines to determine equivalent mutants publication-title: Int. J. Softw. Eng.Knowl. Eng. – start-page: 58 year: 2018 end-page: 69 ident: bib0026 article-title: Speeding up mutation testing via regression test selection: an extensive study publication-title: Proceedings of the 11th International Conference on Software Testing, Verification and Validation (ICST) – start-page: 1 year: 2016 end-page: 10 ident: bib0153 article-title: Evaluating random mutant selection at class-level in projects with non-adequate test suites publication-title: Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering (EASE) – volume: 39 start-page: 570 year: 2013 end-page: 587 ident: bib0165 article-title: Validating second-order mutation at system level publication-title: IEEE Trans. Softw. Eng. – volume: 17 start-page: 403 year: 1991 end-page: 423 ident: bib0107 article-title: High performance software testing on SIMD machines publication-title: IEEE Trans. Softw. Eng. – start-page: 100 year: 1993 end-page: 107 ident: bib0138 article-title: An experimental evaluation of selective mutation publication-title: Proceedings of the 15th International Conference on Software Engineering (ICSE) – start-page: 152 year: 1988 end-page: 158 ident: bib0192 article-title: From weak to strong, dead or alive? An analysis of some mutation testing issues publication-title: Proceedings of the 2nd Workshop on Software Testing, Verification, and Analysis – start-page: 21 year: 2014 end-page: 30 ident: bib0009 article-title: Establishing theoretical minimal sets of mutants publication-title: Proceedings of the 7th Conference on Software Testing, Verification and Validation (ICST) – volume: 10 start-page: 34 year: 2018 end-page: 45 ident: bib0001 article-title: An approach for the generation of higher order mutants using genetic algorithms publication-title: Int. J. Intell. Syst. Appl. – year: 2018 ident: bib0126 article-title: Automatic detection and removal of ineffective mutants for the mutation analysis of relational database schemas (in press) publication-title: IEEE Trans. Softw. Eng. – year: 2004 ident: bib0104 article-title: Procedures for Performing Systematic Reviews publication-title: Joint Technical Report TR/SE-0401 (Keele) - 0400011T.1 (NICTA) – start-page: 900 year: 2012 end-page: 914 ident: bib0186 article-title: On generating mutants for AspectJ programs publication-title: Inf. Softw. Technol. – start-page: 2 year: 2013 end-page: 11 ident: bib0025 article-title: Towards incremental mutation testing publication-title: Proceedings of the 2013 Validation Strategies for Software Evolution Workshop (VSSE) – start-page: 274 year: 2018 end-page: 284 ident: bib0202 article-title: An investigation of compression techniques to speed up mutation testing publication-title: Proceedings of the 11th International Conference on Software Testing, Verification and Validation (ICST) – start-page: 224 year: 1996 end-page: 236 ident: bib0135 article-title: Detecting equivalent mutants and the feasible path problem publication-title: Proceedings of the 11th Annual Conference on Computer Assurance (COMPASS) – start-page: 103 year: 2017 end-page: 109 ident: bib0201 article-title: Speeding-up mutation testing via data compression and state infection publication-title: Proceedings of the 12th International Workshop on Mutation Analysis (Mutation) – start-page: 139 year: 1993 end-page: 148 ident: bib0182 article-title: Mutation analysis using mutant schemata publication-title: Proceedings of the International Symposium on Software Testing and Analysis (ISSTA) – start-page: 111 year: 2010 end-page: 118 ident: bib0152 article-title: Towards automating the generation of mutation tests publication-title: Proceedings of the 5th Workshop on Automation of Software Test (AST) – start-page: 456 year: 2018 end-page: 467 ident: bib0118 article-title: Time to clean your test objectives publication-title: Proceedings of the 40th International Conference on Software Engineering (ICSE) – start-page: 152 year: 2016 end-page: 161 ident: bib0075 article-title: Nequivack: assessing mutation score confidence publication-title: Proceedings of the 11th International Workshop on Mutation Analysis (Mutation) – start-page: 1 year: 2014 end-page: 10 ident: bib0188 article-title: Guidelines for snowballing in systematic literature studies and a replication in software engineering publication-title: Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering (EASE) – volume: 23 start-page: 353 year: 2013 end-page: 374 ident: bib0170 article-title: Covering and uncovering equivalent mutants publication-title: Softw. Test. Verif. Reliabil. – volume: 11 start-page: 249 year: 2001 end-page: 268 ident: bib0183 article-title: Unit and integration testing strategies for C programs using mutation publication-title: Softw. Test. Verif. Reliabil. – volume: 86 start-page: 2002 year: 2013 end-page: 2012 ident: bib0094 article-title: Improving logic-based testing publication-title: J. Syst. Softw. – volume: 36 start-page: 676 year: 2010 end-page: 687 ident: bib0116 article-title: How reliable are systematic reviews in empirical software engineering? publication-title: IEEE Trans. Softw. Eng. – start-page: 334 year: 2011 end-page: 341 ident: bib0077 article-title: An analysis of OO mutation operators publication-title: Proceedings of the 6th International Workshop on Mutation Analysis (Mutation) – volume: 15 start-page: 73 year: 2005 end-page: 96 ident: bib0015 article-title: From genetic to bacteriological algorithms for mutation-based testing publication-title: Softw. Test. Verif. Reliabil. – start-page: 21 year: 2014 end-page: 30 ident: bib0109 article-title: Towards the establishment of a sufficient set of mutation operators for AspectJ programs publication-title: Proceedings of the 8th Brazilian Workshop on Systematic and Automated Software Testing (SAST) – volume: 19 start-page: 691 year: 2011 end-page: 723 ident: bib0150 article-title: Automatically performing weak mutation with the aid of symbolic execution, concolic testing and search-based testing publication-title: Softw. Qual. J. – start-page: 285 year: 1992 end-page: 291 ident: bib0179 article-title: Mutation-based software testing using program schemata publication-title: Proceedings of the 30th Annual Southeast Regional Conference (ACM-SE) – volume: 20 start-page: 337 year: 1994 end-page: 344 ident: bib0133 article-title: An empirical evaluation of weak mutation publication-title: IEEE Trans. Softw. Eng. – year: 2004 ident: bib0003 article-title: How to overcome the equivalent mutant problem and achieve tailored selective mutation using co-evolution publication-title: Proceedings of the 3rd Genetic and Evolutionary Computation Conference (GECCO) – start-page: 1315 year: 2017 end-page: 1324 ident: bib0045 article-title: Evaluation of mutant sampling criteria in object-oriented mutation testing publication-title: Proceedings of the Federated Conference on Computer Science and Information Systems (ACSIS) – start-page: 57 year: 2011 end-page: 63 ident: bib0093 article-title: Better predicate testing publication-title: Proceedings of the 6th International Workshop on Automation of Software Test (AST) – volume: 49 start-page: 398 year: 2007 end-page: 417 ident: bib0178 article-title: Mutating database queries publication-title: Inf. Softw. Technol. – start-page: 113 year: 2006 end-page: 122 ident: bib0113 article-title: An approach to test data generation for killing multiple mutants publication-title: Proceedings of the 22th International Conference on Software Maintenance (ICSM) – start-page: 342 year: 2016 end-page: 353 ident: bib0195 article-title: Predictive mutation testing publication-title: Proceedings of the 25th International Symposium on Software Testing and Analysis (ISSTA) – start-page: 297 year: 2014 end-page: 304 ident: bib0020 article-title: Reduction in mutation testing of Java classes publication-title: Proceedings of the 9th International Conference on Software Engineering and Applications (ICSOFT-EA) – start-page: 435 year: 2010 end-page: 444 ident: bib0197 article-title: Is operator-based mutant selection superior to random mutant selection? publication-title: Proceedings of the 32th International Conference on Software Engineering (ICSE) – start-page: 21 year: 2012 end-page: 30 ident: bib0005 article-title: Efficient refinement checking for model-based mutation testing publication-title: Proceedings of the 12th International Conference on Quality Software (QSIC) – start-page: 936 year: 2015 end-page: 946 ident: bib0143 article-title: Trivial compiler equivalence: a large scale empirical study of a simple, fast and effective equivalent mutant detection technique publication-title: Proceedings of the 37th International Conference on Software Engineering (ICSE) – start-page: 258 year: 1995 end-page: 265 ident: bib0191 article-title: Mutation versus all-uses: an empirical evaluation of cost, strength and effectiveness publication-title: Softw. Qual. Product. – year: 2007 ident: bib0121 article-title: Foundations of Software Testing – volume: 20 start-page: 135 year: 1993 end-page: 152 ident: bib0027 article-title: High-performance mutation testing publication-title: J. Syst. Softw. – start-page: 174 year: 1997 end-page: 181 ident: bib0181 article-title: TUMS: testing using mutant schemata publication-title: Proceedings of the 35th Annual Southeast Regional Conference (ACM-SE) – start-page: 1 year: 2016 end-page: 4 ident: bib0161 article-title: Improving mutant generation for simulink models using genetic algorithm publication-title: Proceedings of the International Conference on Electronics, Information, and Communications (ICEIC) – start-page: 1 year: 2013 end-page: 19 ident: bib0006 article-title: Incremental refinement checking for test case generation publication-title: Proceedings of the 7th International Conference Tests and Proofs (TAP) – volume: 115 start-page: 18 year: 2016 end-page: 30 ident: bib0114 article-title: Mutation testing cost reduction by clustering overlapped mutants publication-title: J. Syst. Softw. – volume: 40 start-page: 23 year: 2014 end-page: 42 ident: bib0117 article-title: Overcoming the equivalent mutant problem: a systematic literature review and a comparative experiment of second order mutation publication-title: IEEE Trans. Softw. Eng. – volume: 4 start-page: 131 year: 1994 end-page: 154 ident: bib0129 article-title: Using compiler optimization techniques to detect equivalent mutants publication-title: Softw. Test. Verif. Reliabil. – start-page: 185 year: 1994 end-page: 195 ident: bib0057 article-title: Efficient mutation analysis: a new approach publication-title: Proceedings of the International Symposium on Software Testing and Analysis (ISSTA) – volume: 4 start-page: 9 year: 1994 end-page: 31 ident: bib0123 article-title: An empirical comparison of data flow and mutation based test adequacy criteria publication-title: Softw. Test. Verif. Reliabil. – start-page: 571 year: 2016 end-page: 582 ident: bib0108 article-title: Analyzing the validity of selective mutation with dominator mutants publication-title: Proceedings of the 24th International Symposium on Foundations of Software Engineering (FSE) – start-page: 295 year: 2017 end-page: 306 ident: bib0185 article-title: Faster mutation analysis via equivalence modulo states publication-title: Proceedings of the 26th International Symposium on Software Testing and Analysis (ISSTA) – start-page: 654 year: 2014 end-page: 665 ident: bib0085 article-title: Are mutants a valid substitute for real faults in software testing? publication-title: Proceedings of the 22nd International Symposium on Foundations of Software Engineering (FSE) – start-page: 25 year: 2018 end-page: 31 ident: bib0040 article-title: Mull it over: mutation testing based on LLVM publication-title: Proceedings of the 13th International Workshop on Mutation Analysis (Mutation) – start-page: 203 year: 2014 end-page: 212 ident: bib0028 article-title: Experimental evaluation of SDL and One-Op mutation for C publication-title: Proceedings of the 7th International Conference on Software Testing, Verification and Validation (ICST) – start-page: 21 year: 2015 end-page: 30 ident: bib0124 article-title: A mutation and multi-objective test data generation approach for feature testing of software product lines publication-title: Proceedings of the 29th Brazilian Symposium on Software Engineering (SBES) – volume: 25 start-page: 464 year: 2014 end-page: 489 ident: bib0164 article-title: Reducing mutation costs through uncovered mutants publication-title: Softw. Test. Verif. Reliabil. – start-page: 229 year: 2009 end-page: 240 ident: bib0051 article-title: A framework for mutant genetic generation for WS-BPEL publication-title: Proceedings of the 35th Conference on Current Trends in Theory and Practice of Computer Science (SOFSEM) – start-page: 128 year: 2017 end-page: 133 ident: bib0078 article-title: Reducing mutants with mutant killable precondition publication-title: Proceedings of the 12th International Workshop on Mutation Analysis (Mutation) – start-page: 284 year: 2017 end-page: 294 ident: bib0089 article-title: Inferring mutant utility from program context publication-title: Proceedings of the 26th International Symposium on Software Testing and Analysis (ISSTA) – start-page: 720 year: 2012 end-page: 725 ident: bib0087 article-title: Do redundant mutants affect the effectiveness and efficiency of mutation analysis? publication-title: Proceedings of the 5th IEEE International Conference on Software Testing, Verification and Validation (ICST) – volume: 53 start-page: 1137 year: 2011 end-page: 1152 ident: bib0095 article-title: A logic mutation approach to selective mutation for programs and queries publication-title: Inf. Softw. Technol. – start-page: 57 year: 2014 end-page: 66 ident: bib0194 article-title: The impact of equivalent, redundant and quasi mutants on database schema mutation analysis publication-title: Proceedings of the 14th International Conference on Quality Software (QSIC) – start-page: 315 year: 2014 end-page: 326 ident: bib0084 article-title: Efficient mutation analysis by propagating and partitioning infected execution states publication-title: Proceedings of the 23rd International Symposium on Software Testing and Analysis (ISSTA) – volume: 17 start-page: 900 year: 1991 end-page: 910 ident: bib0037 article-title: Constraint-based automatic test data generation publication-title: IEEE Trans. Softw. Eng. – volume: 53 start-page: 1108 year: 2011 end-page: 1123 ident: bib0050 article-title: Evolutionary mutation testing publication-title: Inf. Softw. Technol. – start-page: 300 year: 2010 end-page: 309 ident: bib0101 article-title: Evaluating mutation testing alternatives: a collateral experiment publication-title: Proceedings of the 17th Asia-Pacific Software Engineering Conference (APSEC) – volume: 21 start-page: 155 year: 2011 end-page: 193 ident: bib0092 article-title: Reducing logic test set size while preserving fault detection publication-title: Softw. Test. Verif. Reliabil. – start-page: 202 year: 2006 end-page: 204 ident: bib0023 article-title: Evaluation of test code quality with aspect-oriented mutations publication-title: Proceedings of the 7th International Conference Extreme Programming and Agile Processes in Software Engineering (XP) - Posters and Demonstrations – start-page: 2 year: 2017 end-page: 8 ident: bib0007 article-title: Efficient mutation testing in configurable systems publication-title: Proceedings of the IEEE/ACM 2nd International Workshop on Variability and Complexity in Software Design (VACE) – volume: 8 start-page: 371 year: 1982 end-page: 379 ident: bib0076 article-title: Weak mutation testing and completeness of test sets publication-title: IEEE Trans. Softw. Eng. – volume: 54 start-page: 915 year: 2012 end-page: 932 ident: bib0151 article-title: Mutation based test case generation via a path selection strategy publication-title: Inf. Softw. Technol. – volume: 5 start-page: 99 year: 1996 end-page: 118 ident: bib0131 article-title: An experimental determination of sufficient mutant operators publication-title: ACM Trans. Softw. Eng. Methodol. – volume: 66 start-page: 854 year: 2017 end-page: 874 ident: bib0065 article-title: Mutation reduction strategies considered harmful publication-title: IEEE Trans. Softw. Reliabil. – volume: 23 start-page: 647 year: 2012 end-page: 668 ident: bib0096 article-title: Combining weak and strong mutation for a noninterpretive Java mutation system publication-title: Softw. Test. Verif. Reliabil. – start-page: 639 year: 2013 end-page: 642 ident: bib0079 article-title: Using fault history to improve mutation reduction publication-title: Proceedings of the 9th Joint Meeting on Foundations of Software Engineering: New Ideas Track (ESEC/FSE) – volume: 8 start-page: 31 year: 1982 end-page: 45 ident: bib0024 article-title: Two notions of correctness and their relation to testing publication-title: Acta Inform. – volume: 112 start-page: 275 year: 2019 end-page: 378 ident: bib0144 article-title: Mutation testing advances: an analysis and survey publication-title: Advances in Computers – start-page: 402 year: 2005 end-page: 411 ident: bib0011 article-title: Is mutation an appropriate tool for testing experiments? publication-title: Proceedings of the 27th International Conference on Software Engineering (ICSE) – start-page: 47 year: 2018 end-page: 53 ident: bib0157 article-title: An industrial application of mutation testing: lessons, challenges, and research directions publication-title: Proceedings of the 13th International Workshop on Mutation Analysis (Mutation) – start-page: 740 year: 2016 end-page: 743 ident: bib0067 article-title: Topsy-turvy: a smarter and faster parallelization of mutation analysis publication-title: Proceedings of the 38th International Conference on Software Engineering Companion (ICSE) – start-page: 381 year: 2017 end-page: 391 ident: bib0031 article-title: Using evolutionary computation to improve mutation testing publication-title: Proceedings of the 14th International Work-Conference on Artificial Neural Networks (IWANN) – start-page: 422 year: 2009 end-page: 429 ident: bib0146 article-title: An effective path selection strategy for mutation testing publication-title: Proceedings of the 16th Asia-Pacific Software Engineering Conference (APSEC) – start-page: 433 year: 2014 end-page: 436 ident: bib0083 article-title: The major mutation framework: efficient and scalable mutation analysis for Java publication-title: Proceedings of the 23rd International Symposium on Software Testing and Analysis (ISSTA) – start-page: 1074 year: 2007 end-page: 1081 ident: bib0012 article-title: Automatic mutation test input data generation via ant colony publication-title: Proceedings of the 9th Genetic and Evolutionary Computation Conference (GECCO) – start-page: 21 year: 2012 end-page: 40 ident: bib0128 article-title: Reducing interface mutation costs with multiobjective optimization algorithms publication-title: Int. J. Nat. Comput.Res. – start-page: 119 year: 2013 end-page: 129(AISC v.224) ident: bib0041 article-title: A quality estimation of mutation clustering in C# programs publication-title: Proceedings of the 8th International Conference on Dependability and Complex Systems (DepCoS-RELCOMEX) – start-page: 378 year: 2010 end-page: 387 ident: bib0174 article-title: Prioritizing mutation operators based on importance sampling publication-title: Proceedings of the IEEE 21th International Symposium on Software Reliability Engineering (ISSRE) – start-page: 224 year: 2013 end-page: 234 ident: bib0064 article-title: Selective mutation testing for concurrent code publication-title: Proceedings of the 22nd International Symposium on Software Testing and Analysis (ISSTA) – volume: 81 start-page: 65 year: 2017 end-page: 81 ident: bib0177 article-title: A path-aware approach to mutant reduction in mutation testing publication-title: Inf. Softw. Technol. – start-page: 273 year: 2004 end-page: 281 ident: bib0105 article-title: Evidence-based software engineering publication-title: Proceedings of the 26th International Conference on Software Engineering (ICSE) – start-page: 90 year: 2010 end-page: 99 ident: bib0147 article-title: An empirical evaluation of the first and second order mutation testing strategies publication-title: Proceedings of the 5th International Workshop on Mutation Analysis (Mutation) – start-page: 425 year: 2010 end-page: 434 ident: bib0175 article-title: From behaviour preservation to behaviour modification: constraint-based mutant generation publication-title: Proceedings of the 32th International Conference on Software Engineering (ICSE) – volume: 27 start-page: 80 year: 2010 end-page: 86 ident: bib0159 article-title: Mutation testing cost reduction techniques: a survey publication-title: IEEE Softw. – start-page: 4:1 year: 2016 end-page: 4:10 ident: bib0112 article-title: Evaluating different strategies for reduction of mutation testing costs publication-title: Proceedings of the 1st Brazilian Symposium on Systematic and Automated Software Testing (SAST) – start-page: 45 year: 2010 ident: 10.1016/j.jss.2019.07.100_bib0169 article-title: (Un-)Covering equivalent mutants – start-page: 224 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0064 article-title: Selective mutation testing for concurrent code – start-page: 456 year: 2018 ident: 10.1016/j.jss.2019.07.100_bib0118 article-title: Time to clean your test objectives – volume: 11 start-page: 113 issue: 2 year: 2001 ident: 10.1016/j.jss.2019.07.100_bib0013 article-title: Toward the determination of sufficient mutant operators for C publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/stvr.226 – start-page: 1387 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0033 article-title: GiGAn: evolutionary mutation testing for C++ object-oriented systems – volume: 38 start-page: 235 issue: 3 year: 1997 ident: 10.1016/j.jss.2019.07.100_bib0058 article-title: All-uses vs mutation testing: an experimental comparison of effectiveness publication-title: J. Syst. Softw. doi: 10.1016/S0164-1212(96)00154-9 – start-page: 664 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0162 article-title: Mutant execution cost reduction: through MUSIC (Mutant schema improved with extra code) – start-page: 274 year: 2018 ident: 10.1016/j.jss.2019.07.100_bib0202 article-title: An investigation of compression techniques to speed up mutation testing – start-page: 152 year: 2016 ident: 10.1016/j.jss.2019.07.100_bib0075 article-title: Nequivack: assessing mutation score confidence – volume: 8 start-page: 371 issue: 4 year: 1982 ident: 10.1016/j.jss.2019.07.100_bib0076 article-title: Weak mutation testing and completeness of test sets publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.1982.235571 – volume: 27 start-page: 1630 issue: 4–5 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0034 article-title: Assessment of C++ object-oriented mutation operators: a selective mutation approach publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/stvr.1630 – volume: 39 start-page: 570 issue: 4 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0165 article-title: Validating second-order mutation at system level publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2012.39 – volume: 36 start-page: 676 issue: 5 year: 2010 ident: 10.1016/j.jss.2019.07.100_bib0116 article-title: How reliable are systematic reviews in empirical software engineering? publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2010.28 – start-page: 435 year: 2010 ident: 10.1016/j.jss.2019.07.100_bib0197 article-title: Is operator-based mutant selection superior to random mutant selection? – start-page: 273 year: 2004 ident: 10.1016/j.jss.2019.07.100_bib0105 article-title: Evidence-based software engineering – start-page: 11 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0030 article-title: Designing deletion mutation operators – year: 2018 ident: 10.1016/j.jss.2019.07.100_sbref0055 – volume: 31 start-page: 185 issue: 3 year: 1995 ident: 10.1016/j.jss.2019.07.100_bib0190 article-title: Reducing the cost of mutation testing: an empirical study publication-title: J. Syst. Softw. doi: 10.1016/0164-1212(94)00098-0 – volume: 29 start-page: 167 issue: 2 year: 1999 ident: 10.1016/j.jss.2019.07.100_bib0130 article-title: The dynamic domain reduction approach to test data generation publication-title: Softw. Pract. Exp. doi: 10.1002/(SICI)1097-024X(199902)29:2<167::AID-SPE225>3.0.CO;2-V – start-page: 342 year: 2016 ident: 10.1016/j.jss.2019.07.100_bib0195 article-title: Predictive mutation testing – start-page: 36 year: 2016 ident: 10.1016/j.jss.2019.07.100_bib0125 article-title: Virtual mutation analysis of relational database schemas – start-page: 58 year: 2018 ident: 10.1016/j.jss.2019.07.100_bib0026 article-title: Speeding up mutation testing via regression test selection: an extensive study – start-page: 397 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0071 article-title: Angels and monsters: an empirical investigation of potential test effectiveness and efficiency improvement from strongly subsuming higher order mutation – start-page: 57 year: 2011 ident: 10.1016/j.jss.2019.07.100_bib0093 article-title: Better predicate testing – start-page: 1 year: 2016 ident: 10.1016/j.jss.2019.07.100_bib0161 article-title: Improving mutant generation for simulink models using genetic algorithm – volume: 53 start-page: 1137 issue: 10 year: 2011 ident: 10.1016/j.jss.2019.07.100_bib0095 article-title: A logic mutation approach to selective mutation for programs and queries publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2011.03.009 – start-page: 57 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0194 article-title: The impact of equivalent, redundant and quasi mutants on database schema mutation analysis – start-page: 123 year: 2016 ident: 10.1016/j.jss.2019.07.100_bib0154 article-title: Resolving the equivalent mutant problem in the presence of non-determinism and coincidental correctness – volume: 81 start-page: 19 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0173 article-title: A systematic review on search based mutation testing publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2016.01.017 – start-page: 351 year: 1991 ident: 10.1016/j.jss.2019.07.100_bib0035 article-title: Compiler-integrated program mutation – start-page: 139 year: 1993 ident: 10.1016/j.jss.2019.07.100_bib0182 article-title: Mutation analysis using mutant schemata – start-page: 701 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0102 article-title: Isolating first order equivalent mutants via second order mutation – start-page: 1 year: 2010 ident: 10.1016/j.jss.2019.07.100_bib0200 article-title: Test generation via dynamic symbolic execution for mutation testing – volume: 20 start-page: 135 issue: 2 year: 1993 ident: 10.1016/j.jss.2019.07.100_bib0027 article-title: High-performance mutation testing publication-title: J. Syst. Softw. doi: 10.1016/0164-1212(93)90005-I – start-page: 424 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0047 article-title: Automata language equivalence vs. simulations for model-based mutant equivalence: an empirical evaluation – start-page: 233 year: 2015 ident: 10.1016/j.jss.2019.07.100_bib0043 article-title: Improving mutation testing process of python programs – start-page: 55 year: 2010 ident: 10.1016/j.jss.2019.07.100_bib0063 article-title: MuTMuT: efficient exploration for mutation testing of multithreaded code – start-page: 47 year: 2018 ident: 10.1016/j.jss.2019.07.100_bib0157 article-title: An industrial application of mutation testing: lessons, challenges, and research directions – start-page: 284 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0089 article-title: Inferring mutant utility from program context – start-page: 295 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0185 article-title: Faster mutation analysis via equivalence modulo states – year: 2004 ident: 10.1016/j.jss.2019.07.100_bib0104 article-title: Procedures for Performing Systematic Reviews – start-page: 4:1 year: 2016 ident: 10.1016/j.jss.2019.07.100_bib0112 article-title: Evaluating different strategies for reduction of mutation testing costs – start-page: 381 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0031 article-title: Using evolutionary computation to improve mutation testing – start-page: 1 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0141 article-title: An exploratory study of higher order mutation testing in aspect-oriented programming – start-page: 2 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0007 article-title: Efficient mutation testing in configurable systems – start-page: 43 year: 1990 ident: 10.1016/j.jss.2019.07.100_bib0167 article-title: A Bayes sequential statistical procedure for approving software products – start-page: 439 year: 1994 ident: 10.1016/j.jss.2019.07.100_bib0189 article-title: Constrained mutation in C programs – volume: 21 start-page: 155 issue: 3 year: 2011 ident: 10.1016/j.jss.2019.07.100_bib0092 article-title: Reducing logic test set size while preserving fault detection publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/stvr.442 – volume: 60 start-page: 143 issue: 1 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0176 article-title: An empirical study on mutation testing of WS-BPEL programs publication-title: Comput. J. doi: 10.1093/comjnl/bxw076 – start-page: 1315 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0045 article-title: Evaluation of mutant sampling criteria in object-oriented mutation testing doi: 10.15439/2017F375 – volume: 20 start-page: 783 issue: 3 year: 2015 ident: 10.1016/j.jss.2019.07.100_bib0059 article-title: Achieving scalable mutation-based generation of whole test suites publication-title: Empir. Softw. Eng. doi: 10.1007/s10664-013-9299-z – start-page: 298 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0142 article-title: Mitigating the effects of equivalent mutants with mutant classification strategies publication-title: Sci. Comput. Programm. doi: 10.1016/j.scico.2014.05.012 – start-page: 97 year: 2009 ident: 10.1016/j.jss.2019.07.100_bib0049 article-title: GAmera: an automatic mutant generation system for WS-BPEL compositions – start-page: 5 year: 2000 ident: 10.1016/j.jss.2019.07.100_bib0070 article-title: The relationship between program dependence and mutation analysis – volume: 15 start-page: 73 issue: 2 year: 2005 ident: 10.1016/j.jss.2019.07.100_bib0015 article-title: From genetic to bacteriological algorithms for mutation-based testing publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/stvr.313 – start-page: 21 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0128 article-title: Reducing interface mutation costs with multiobjective optimization algorithms publication-title: Int. J. Nat. Comput.Res. doi: 10.4018/jncr.2012070102 – volume: 66 start-page: 854 issue: 3 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0065 article-title: Mutation reduction strategies considered harmful publication-title: IEEE Trans. Softw. Reliabil. doi: 10.1109/TR.2017.2705662 – start-page: 63 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0193 article-title: Efficient mutation analysis of relational database structure using mutant schemata and parallelisation – start-page: 300 year: 2010 ident: 10.1016/j.jss.2019.07.100_bib0101 article-title: Evaluating mutation testing alternatives: a collateral experiment – start-page: 422 year: 2009 ident: 10.1016/j.jss.2019.07.100_bib0146 article-title: An effective path selection strategy for mutation testing – volume: 20 start-page: 337 issue: 5 year: 1994 ident: 10.1016/j.jss.2019.07.100_bib0133 article-title: An empirical evaluation of weak mutation publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/32.286422 – start-page: 1 year: 2018 ident: 10.1016/j.jss.2019.07.100_bib0054 article-title: A systematic review of cost reduction techniques for mutation testing: preliminary results – year: 1992 ident: 10.1016/j.jss.2019.07.100_bib0137 article-title: Mutation testing of software using a MIMD computer – volume: 49 start-page: 398 issue: 4 year: 2007 ident: 10.1016/j.jss.2019.07.100_bib0178 article-title: Mutating database queries publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2006.06.009 – start-page: 337 year: 2001 ident: 10.1016/j.jss.2019.07.100_bib0017 article-title: A technique for mutation of Java objects – volume: 3 start-page: 279 issue: 4 year: 1977 ident: 10.1016/j.jss.2019.07.100_bib0069 article-title: Testing programs with the aid of a compiler publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.1977.231145 – start-page: 11 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0088 article-title: Using non-redundant mutation operators and test suite prioritization to achieve efficient and scalable mutation analysis – start-page: 18 year: 2018 ident: 10.1016/j.jss.2019.07.100_bib0068 article-title: If you can’t kill a supermutant, you have a problem – volume: 40 start-page: 23 issue: 1 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0117 article-title: Overcoming the equivalent mutant problem: a systematic literature review and a comparative experiment of second order mutation publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2013.44 – volume: 10 start-page: 34 issue: 1 year: 2018 ident: 10.1016/j.jss.2019.07.100_bib0001 article-title: An approach for the generation of higher order mutants using genetic algorithms publication-title: Int. J. Intell. Syst. Appl. – start-page: 654 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0085 article-title: Are mutants a valid substitute for real faults in software testing? – start-page: 571 year: 2016 ident: 10.1016/j.jss.2019.07.100_bib0108 article-title: Analyzing the validity of selective mutation with dominator mutants – start-page: 1 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0006 article-title: Incremental refinement checking for test case generation – start-page: 21 year: 2015 ident: 10.1016/j.jss.2019.07.100_bib0124 article-title: A mutation and multi-objective test data generation approach for feature testing of software product lines – start-page: 147 year: 2010 ident: 10.1016/j.jss.2019.07.100_bib0060 article-title: Mutation-driven generation of oracles and unit tests – start-page: 152 year: 1988 ident: 10.1016/j.jss.2019.07.100_bib0192 article-title: From weak to strong, dead or alive? An analysis of some mutation testing issues – start-page: 171 year: 1988 ident: 10.1016/j.jss.2019.07.100_bib0106 article-title: High performance testing on SIMD machines – start-page: 55 year: 2000 ident: 10.1016/j.jss.2019.07.100_bib0080 article-title: Parallel firm mutation of Java programs – volume: 115 start-page: 18 issue: C year: 2016 ident: 10.1016/j.jss.2019.07.100_bib0114 article-title: Mutation testing cost reduction by clustering overlapped mutants publication-title: J. Syst. Softw. doi: 10.1016/j.jss.2016.01.007 – start-page: 187 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0053 article-title: Avoiding useless mutants – start-page: 21 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0009 article-title: Establishing theoretical minimal sets of mutants – start-page: 511 year: 2016 ident: 10.1016/j.jss.2019.07.100_bib0066 article-title: On the limits of mutation reduction strategies – start-page: 936 year: 2015 ident: 10.1016/j.jss.2019.07.100_bib0143 article-title: Trivial compiler equivalence: a large scale empirical study of a simple, fast and effective equivalent mutant detection technique – start-page: 297 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0020 article-title: Reduction in mutation testing of Java classes – volume: 2 start-page: 109 issue: 2 year: 1993 ident: 10.1016/j.jss.2019.07.100_bib0038 article-title: Experimental results from an automatic test case generator publication-title: ACM Trans. Softw. Eng.Methodol. doi: 10.1145/151257.151258 – start-page: 41 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0019 article-title: Reduction of computational cost in mutation testing by sampling mutants – start-page: 185 year: 1994 ident: 10.1016/j.jss.2019.07.100_bib0057 article-title: Efficient mutation analysis: a new approach – start-page: 740 year: 2016 ident: 10.1016/j.jss.2019.07.100_bib0067 article-title: Topsy-turvy: a smarter and faster parallelization of mutation analysis – start-page: 229 year: 2009 ident: 10.1016/j.jss.2019.07.100_bib0051 article-title: A framework for mutant genetic generation for WS-BPEL – start-page: 111 year: 2010 ident: 10.1016/j.jss.2019.07.100_bib0152 article-title: Towards automating the generation of mutation tests – volume: 23 start-page: 647 issue: 8 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0096 article-title: Combining weak and strong mutation for a noninterpretive Java mutation system publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/stvr.1480 – start-page: 81 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0029 article-title: Growing a reduced set of mutation operators – start-page: 50 year: 2011 ident: 10.1016/j.jss.2019.07.100_bib0086 article-title: Using conditional mutation to increase the efficiency of mutation analysis – start-page: 425 year: 2010 ident: 10.1016/j.jss.2019.07.100_bib0175 article-title: From behaviour preservation to behaviour modification: constraint-based mutant generation – start-page: 331 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0199 article-title: Regression mutation testing – start-page: 200 year: 1991 ident: 10.1016/j.jss.2019.07.100_bib0132 article-title: How strong is weak mutation? – volume: 41 start-page: 113 issue: 2 year: 2015 ident: 10.1016/j.jss.2019.07.100_bib0016 article-title: Exploiting model morphology for event-based testing publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2014.2360690 – start-page: 900 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0186 article-title: On generating mutants for AspectJ programs publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2011.12.001 – start-page: 315 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0084 article-title: Efficient mutation analysis by propagating and partitioning infected execution states – year: 2004 ident: 10.1016/j.jss.2019.07.100_sbref0003 article-title: How to overcome the equivalent mutant problem and achieve tailored selective mutation using co-evolution – start-page: 131 year: 2015 ident: 10.1016/j.jss.2019.07.100_bib0166 article-title: Fault-based product-line testing: effective sample generation based on feature-diagram mutation – start-page: 341 year: 2002 ident: 10.1016/j.jss.2019.07.100_bib0008 article-title: Mutation of Java objects – start-page: 655 year: 2016 ident: 10.1016/j.jss.2019.07.100_bib0046 article-title: Featured model-based mutation analysis – start-page: 92 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0072 article-title: Mutation-based generation of software product line test configurations – start-page: 334 year: 2011 ident: 10.1016/j.jss.2019.07.100_bib0077 article-title: An analysis of OO mutation operators – start-page: 351 year: 2008 ident: 10.1016/j.jss.2019.07.100_bib0172 article-title: Sufficient mutation operators for measuring test effectiveness – start-page: 720 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0087 article-title: Do redundant mutants affect the effectiveness and efficiency of mutation analysis? – start-page: 829 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0140 article-title: A coevolutionary algorithm to automatic test case selection and mutant in mutation testing – start-page: 78 year: 2006 ident: 10.1016/j.jss.2019.07.100_bib0134 article-title: The class-level mutants of MuJava – start-page: 1 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0188 article-title: Guidelines for snowballing in systematic literature studies and a replication in software engineering – start-page: 202 year: 2006 ident: 10.1016/j.jss.2019.07.100_bib0023 article-title: Evaluation of test code quality with aspect-oriented mutations – start-page: 258 year: 1995 ident: 10.1016/j.jss.2019.07.100_bib0191 article-title: Mutation versus all-uses: an empirical evaluation of cost, strength and effectiveness publication-title: Softw. Qual. Product. doi: 10.1007/978-0-387-34848-3_40 – start-page: 1 year: 2009 ident: 10.1016/j.jss.2019.07.100_bib0081 article-title: A novel method of mutation clustering based on domain analysis – volume: 27 start-page: 80 issue: 3 year: 2010 ident: 10.1016/j.jss.2019.07.100_bib0159 article-title: Mutation testing cost reduction techniques: a survey publication-title: IEEE Softw. doi: 10.1109/MS.2010.79 – volume: 38 start-page: 278 issue: 2 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0061 article-title: Mutation-driven generation of oracles and unit tests publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2011.93 – start-page: 1 year: 2015 ident: 10.1016/j.jss.2019.07.100_bib0111 article-title: Mutation testing in practice using ruby – start-page: 2 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0025 article-title: Towards incremental mutation testing – volume: 23 start-page: 353 issue: 5 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0170 article-title: Covering and uncovering equivalent mutants publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/stvr.1473 – volume: 9 start-page: 233 issue: 4 year: 1999 ident: 10.1016/j.jss.2019.07.100_bib0074 article-title: Using program slicing to assist in the detection of equivalent mutants publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/(SICI)1099-1689(199912)9:4<233::AID-STVR191>3.0.CO;2-3 – volume: 9 start-page: 205 issue: 4 year: 1999 ident: 10.1016/j.jss.2019.07.100_bib0127 article-title: Efficiency of mutation operators and selective mutation strategies: an empirical study publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/(SICI)1099-1689(199912)9:4<205::AID-STVR186>3.0.CO;2-X – volume: 5 start-page: 99 issue: 2 year: 1996 ident: 10.1016/j.jss.2019.07.100_bib0131 article-title: An experimental determination of sufficient mutant operators publication-title: ACM Trans. Softw. Eng. Methodol. doi: 10.1145/227607.227610 – start-page: 174 year: 1997 ident: 10.1016/j.jss.2019.07.100_bib0181 article-title: TUMS: testing using mutant schemata – start-page: 196 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0098 article-title: Using data flow patterns for equivalent mutant detection – start-page: 21 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0109 article-title: Towards the establishment of a sufficient set of mutation operators for AspectJ programs – year: 1979 ident: 10.1016/j.jss.2019.07.100_bib0002 article-title: Mutation Analysis – volume: 112 start-page: 275 year: 2019 ident: 10.1016/j.jss.2019.07.100_bib0144 article-title: Mutation testing advances: an analysis and survey doi: 10.1016/bs.adcom.2018.03.015 – start-page: 90 year: 2010 ident: 10.1016/j.jss.2019.07.100_bib0147 article-title: An empirical evaluation of the first and second order mutation testing strategies – start-page: 69 year: 2009 ident: 10.1016/j.jss.2019.07.100_bib0168 article-title: Efficient mutation testing by checking invariant violations – volume: 32 start-page: 733 issue: 9 year: 2006 ident: 10.1016/j.jss.2019.07.100_bib0048 article-title: On the use of mutation faults in empirical assessments of test case prioritization techniques publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2006.92 – volume: 25 start-page: 490 issue: 5–7 year: 2015 ident: 10.1016/j.jss.2019.07.100_bib0090 article-title: Higher accuracy and lower run time: efficient mutation analysis using non-redundant mutation operators publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/stvr.1561 – volume: 86 start-page: 2002 issue: 8 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0094 article-title: Improving logic-based testing publication-title: J. Syst. Softw. doi: 10.1016/j.jss.2012.08.024 – start-page: 1 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0004 article-title: Model-based mutation testing of an industrial measurement device – year: 2018 ident: 10.1016/j.jss.2019.07.100_bib0126 article-title: Automatic detection and removal of ineffective mutants for the mutation analysis of relational database schemas (in press) publication-title: IEEE Trans. Softw. Eng. – start-page: 604 year: 1991 ident: 10.1016/j.jss.2019.07.100_bib0120 article-title: Performance, effectiveness, and reliability issues in software testing – start-page: 21 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0005 article-title: Efficient refinement checking for model-based mutation testing – volume: 23 start-page: 375 issue: 5 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0062 article-title: Efficient mutation testing of multithreaded code publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/stvr.1469 – start-page: 42 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0044 article-title: Quality evaluation of object-oriented and standard mutation operators applied to C# programs – start-page: 285 year: 1992 ident: 10.1016/j.jss.2019.07.100_bib0179 article-title: Mutation-based software testing using program schemata – start-page: 180 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0097 article-title: Identifying more equivalent mutants via code similarity – volume: 25 start-page: 508 issue: 5–7 year: 2015 ident: 10.1016/j.jss.2019.07.100_bib0103 article-title: Employing second-order mutation for isolating first-order equivalent mutants publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/stvr.1529 – year: 2005 ident: 10.1016/j.jss.2019.07.100_bib0018 article-title: Systematic Review in Software Engineering – start-page: 320 year: 1993 ident: 10.1016/j.jss.2019.07.100_bib0122 article-title: Evaluation of the cost of alternative mutation testing strategies – volume: 19 start-page: 111 issue: 2 year: 2009 ident: 10.1016/j.jss.2019.07.100_bib0158 article-title: Decreasing the cost of mutation testing with second-order mutants publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/stvr.392 – volume: 68 start-page: 1 year: 2015 ident: 10.1016/j.jss.2019.07.100_bib0099 article-title: MEDIC: a static analysis framework for equivalent mutant identification publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2015.07.009 – start-page: 121 year: 2010 ident: 10.1016/j.jss.2019.07.100_bib0148 article-title: Automatic mutation test case generation via dynamic symbolic execution – start-page: 273 year: 2006 ident: 10.1016/j.jss.2019.07.100_bib0022 article-title: Aspect-oriented response injection: an alternative to classical mutation testing – volume: 17 start-page: 900 issue: 9 year: 1991 ident: 10.1016/j.jss.2019.07.100_bib0037 article-title: Constraint-based automatic test data generation publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/32.92910 – volume: 19 start-page: 691 issue: 4 year: 2011 ident: 10.1016/j.jss.2019.07.100_bib0150 article-title: Automatically performing weak mutation with the aid of symbolic execution, concolic testing and search-based testing publication-title: Softw. Qual. J. doi: 10.1007/s11219-011-9142-y – start-page: 433 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0083 article-title: The major mutation framework: efficient and scalable mutation analysis for Java – volume: 81 start-page: 65 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0177 article-title: A path-aware approach to mutant reduction in mutation testing publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2016.02.006 – start-page: 235 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0198 article-title: Faster mutation testing inspired by test prioritization and reduction – start-page: 119 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0041 article-title: A quality estimation of mutation clustering in C# programs – volume: 78 start-page: 1639 issue: 9 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0056 article-title: Towards the practical mutation testing of AspectJ programs publication-title: Sci. Comput. Programm. doi: 10.1016/j.scico.2013.02.011 – volume: 37 start-page: 649 issue: 5 year: 2011 ident: 10.1016/j.jss.2019.07.100_bib0082 article-title: An analysis and survey of the development of mutation testing publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2010.62 – start-page: 378 year: 2010 ident: 10.1016/j.jss.2019.07.100_bib0174 article-title: Prioritizing mutation operators based on importance sampling – start-page: 247 year: 2011 ident: 10.1016/j.jss.2019.07.100_bib0149 article-title: Automatic mutation based test data generation – start-page: 128 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0078 article-title: Reducing mutants with mutant killable precondition – volume: 25 start-page: 464 issue: 5–7 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0164 article-title: Reducing mutation costs through uncovered mutants publication-title: Softw. Test. Verif. Reliabil. – start-page: 402 year: 2005 ident: 10.1016/j.jss.2019.07.100_bib0011 article-title: Is mutation an appropriate tool for testing experiments? – start-page: 93 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0021 article-title: Reductions of operators in Java mutation testing – start-page: 163 year: 2018 ident: 10.1016/j.jss.2019.07.100_bib0156 article-title: State of mutation testing at Google – start-page: 134 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0160 article-title: Finding redundancy in web mutation operators – start-page: 220 year: 2009 ident: 10.1016/j.jss.2019.07.100_bib0110 article-title: An experimental comparison of four unit test criteria: mutation, edge-pair, all-uses and prime path coverage – volume: 4 start-page: 131 issue: 3 year: 1994 ident: 10.1016/j.jss.2019.07.100_bib0129 article-title: Using compiler optimization techniques to detect equivalent mutants publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/stvr.4370040303 – volume: 23 start-page: 315 issue: 4 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0163 article-title: Parallel mutation testing publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/stvr.1471 – start-page: 97 year: 2016 ident: 10.1016/j.jss.2019.07.100_bib0042 article-title: Evaluation of deletion mutation operators in mutation testing of C# programs – start-page: 1 year: 2006 ident: 10.1016/j.jss.2019.07.100_bib0171 article-title: Finding sufficient mutation operators via variable reduction – volume: 15 start-page: 13 issue: 1 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0073 article-title: Using GQM and TAM to evaluate StArt - a tool that supports systematic review publication-title: CLEI Electron. J. doi: 10.19153/cleiej.15.1.2 – start-page: 34 year: 2000 ident: 10.1016/j.jss.2019.07.100_bib0139 article-title: Mutation 2000: uniting the orthogonal – volume: 5 start-page: 3657 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0014 article-title: Improved genetic algorithm to reduce mutation testing cost publication-title: IEEE Access doi: 10.1109/ACCESS.2017.2678200 – volume: 15 start-page: 97 issue: 2 year: 2005 ident: 10.1016/j.jss.2019.07.100_bib0115 article-title: MuJava: an automated class mutation system publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/stvr.308 – start-page: 84 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0039 article-title: Empirical evaluation of the statement deletion mutation operator – start-page: 203 year: 2014 ident: 10.1016/j.jss.2019.07.100_bib0028 article-title: Experimental evaluation of SDL and One-Op mutation for C – volume: 44 start-page: 1 issue: 4 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0100 article-title: Detecting trivial mutant equivalences via compiler optimisations publication-title: IEEE Trans. Softw. Eng. – volume: 54 start-page: 915 issue: 9 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0151 article-title: Mutation based test case generation via a path selection strategy publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2012.02.004 – start-page: 681 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0052 article-title: Toward harnessing high-level language virtual machines for further speeding up weak mutation testing – volume: 7 start-page: 165 issue: 3 year: 1997 ident: 10.1016/j.jss.2019.07.100_bib0136 article-title: Automatically detecting equivalent mutants and infeasible paths publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/(SICI)1099-1689(199709)7:3<165::AID-STVR143>3.0.CO;2-U – start-page: 25 year: 2018 ident: 10.1016/j.jss.2019.07.100_bib0040 article-title: Mull it over: mutation testing based on LLVM – year: 2007 ident: 10.1016/j.jss.2019.07.100_bib0121 – start-page: 239 year: 2008 ident: 10.1016/j.jss.2019.07.100_bib0010 article-title: Automated generation of pointcut mutants for testing pointcuts in AspectJ programs – start-page: 1 year: 2016 ident: 10.1016/j.jss.2019.07.100_bib0153 article-title: Evaluating random mutant selection at class-level in projects with non-adequate test suites – volume: 4 start-page: 9 issue: 1 year: 1994 ident: 10.1016/j.jss.2019.07.100_bib0123 article-title: An empirical comparison of data flow and mutation based test adequacy criteria publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/stvr.4370040104 – volume: 17 start-page: 403 issue: 5 year: 1991 ident: 10.1016/j.jss.2019.07.100_bib0107 article-title: High performance software testing on SIMD machines publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/32.90444 – volume: 12 start-page: 675 issue: 6 year: 2002 ident: 10.1016/j.jss.2019.07.100_bib0184 article-title: Bayesian-learning based guidelines to determine equivalent mutants publication-title: Int. J. Softw. Eng.Knowl. Eng. doi: 10.1142/S021819400200113X – volume: 11 start-page: 34 issue: 4 year: 1978 ident: 10.1016/j.jss.2019.07.100_bib0036 article-title: Hints on test data selection: help for the practicing programmer publication-title: IEEE Comput. doi: 10.1109/C-M.1978.218136 – start-page: 71 year: 2009 ident: 10.1016/j.jss.2019.07.100_bib0180 article-title: On reduced neighborhood mutation analysis using a single mutagenic operator – volume: 53 start-page: 1108 year: 2011 ident: 10.1016/j.jss.2019.07.100_bib0050 article-title: Evolutionary mutation testing publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2011.03.008 – start-page: 386 year: 2009 ident: 10.1016/j.jss.2019.07.100_bib0091 article-title: Using a fault hierarchy to improve the efficiency of DNF logic mutation testing – volume: 11 start-page: 249 issue: 4 year: 2001 ident: 10.1016/j.jss.2019.07.100_bib0183 article-title: Unit and integration testing strategies for C programs using mutation publication-title: Softw. Test. Verif. Reliabil. doi: 10.1002/stvr.242 – start-page: 149 year: 1993 ident: 10.1016/j.jss.2019.07.100_bib0187 article-title: Improved serial algorithms for mutation analysis – start-page: 169 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0032 article-title: Assessment of class mutation operators for C++ with the MuCPP mutation system publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2016.07.002 – start-page: 1223 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0145 article-title: Mutation testing strategies using mutant classification – start-page: 711 year: 2012 ident: 10.1016/j.jss.2019.07.100_bib0155 article-title: MESSI: mutant evaluation by static semantic interpretation – start-page: 92 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0196 article-title: Operator-based and random mutant selection: better together – start-page: 639 year: 2013 ident: 10.1016/j.jss.2019.07.100_bib0079 article-title: Using fault history to improve mutation reduction – start-page: 1074 year: 2007 ident: 10.1016/j.jss.2019.07.100_bib0012 article-title: Automatic mutation test input data generation via ant colony – start-page: 103 year: 2017 ident: 10.1016/j.jss.2019.07.100_bib0201 article-title: Speeding-up mutation testing via data compression and state infection – start-page: 100 year: 1993 ident: 10.1016/j.jss.2019.07.100_bib0138 article-title: An experimental evaluation of selective mutation – volume: 32 start-page: 99 issue: 1 year: 1990 ident: 10.1016/j.jss.2019.07.100_bib0119 article-title: Static dataflow-aided weak mutation analysis (SDAWM) publication-title: Inf. Softw. Technol. doi: 10.1016/0950-5849(90)90053-T – start-page: 224 year: 1996 ident: 10.1016/j.jss.2019.07.100_bib0135 article-title: Detecting equivalent mutants and the feasible path problem – volume: 8 start-page: 31 issue: 1 year: 1982 ident: 10.1016/j.jss.2019.07.100_bib0024 article-title: Two notions of correctness and their relation to testing publication-title: Acta Inform. doi: 10.1007/BF00625279 – start-page: 113 year: 2006 ident: 10.1016/j.jss.2019.07.100_bib0113 article-title: An approach to test data generation for killing multiple mutants
SSID	ssj0007202
Score	2.5534189
Snippet	•Comprehensive classifications for cost reduction goals and cost reduction techniques.•Overview of all selected studies grouped by cost reduction...
SourceID	crossref elsevier
SourceType	Enrichment Source Index Database Publisher
StartPage	110388
SubjectTerms	Cost reduction Mutation analysis Mutation testing Systematic review
Title	A systematic literature review of techniques and metrics to reduce the cost of mutation testing
URI	https://dx.doi.org/10.1016/j.jss.2019.07.100
Volume	157
WOSCitedRecordID	wos000488137500004&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVESC databaseName: ScienceDirect customDbUrl: eissn: 1873-1228 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0007202 issn: 0164-1212 databaseCode: AIEXJ dateStart: 19950101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1La9wwEBbbTQ-99F2avtChpwYX2yvL1nEJWdpSQqBp2ZuRZKnssrHD2puG_I_-346sh930QVvoRRhhWWbmYzQez3yD0EsuSKZkLCOqKhERTuKIVVpFQlcJp1QWJBV9s4n8-LhYLtnJZPLV18JcbPK6Li4v2fl_VTXMgbJN6exfqDs8FCbgGpQOI6gdxj9S_HzMzrwJrMmjIpXA22r5mc9MUy3ZMz1sDZGr6p1R2bR9ksDZzuUjdoaPw51z6wFjI4_W7msf2oJ5_8KHzNqT1dVVAxjxVTVtyw1VwsGnVbMJJ8NCmabzfX7Bghsy9ObgECT1eRVCwVrv3N8spfX1WHgPyfeqGUcyEuZK-kJ4zZfYfJcBaijAoiR1udbKWukin8Gcqyr3ZtwSXf9wJNjoxPr1ujXs7AkzXK1JHA_nX8hK_GD2MluBU2tcSXID7aV5xoop2pu_PVq-C0d8nvbJrOHd_O_yPnHw2kY_d3hGTszpXXTb6QrPLWruoYmq76M7vrMHdob-ASrneAARHkCELYhwo_EAIgyyxw5EuGuwBREGEGEDInOzBxF2IHqIPi6OTg_fRK4VRyRTlncR45qA8Z8lVFHzFaxZoWiex5LqKuUkYzFlIKgZJZRrlmaKZJpoxjNRMcHSavYITeumVo8RFkwV4GNmEkbCUyqYmGkuOY1ZQQSP91Hs5VVKx1Nv2qVsSp-QuC5BxKURcRnnhnR7H70KS84tScvvbiZeCaXzMq33WAJifr3syb8te4puDVB_hqbddqeeo5vyolu12xcOV98Az2Glyw
linkProvider	Elsevier
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+systematic+literature+review+of+techniques+and+metrics+to+reduce+the+cost+of+mutation+testing&rft.jtitle=The+Journal+of+systems+and+software&rft.au=Pizzoleto%2C+Alessandro+Viola&rft.au=Ferrari%2C+Fabiano+Cutigi&rft.au=Offutt%2C+Jeff&rft.au=Fernandes%2C+Leo&rft.date=2019-11-01&rft.pub=Elsevier+Inc&rft.issn=0164-1212&rft.eissn=1873-1228&rft.volume=157&rft_id=info:doi/10.1016%2Fj.jss.2019.07.100&rft.externalDocID=S0164121219301554
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0164-1212&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0164-1212&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0164-1212&client=summon