A tertiary study on links between source code metrics and external quality attributes
Several secondary studies have investigated the relationship between internal quality attributes, source code metrics and external quality attributes. Sometimes they have contradictory results. We synthesize evidence of the link between internal quality attributes, source code metrics and external q...
Saved in:
| Published in: | Information and software technology Vol. 165; p. 107348 |
|---|---|
| Main Authors: | , , , |
| Format: | Journal Article |
| Language: | English |
| Published: |
Elsevier B.V
01.01.2024
|
| Subjects: | |
| ISSN: | 0950-5849, 1873-6025, 1873-6025 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | Several secondary studies have investigated the relationship between internal quality attributes, source code metrics and external quality attributes. Sometimes they have contradictory results.
We synthesize evidence of the link between internal quality attributes, source code metrics and external quality attributes along with the efficacy of the prediction models used.
We conducted a tertiary review to identify, evaluate and synthesize secondary studies. We used several characteristics of secondary studies as indicators for the strength of evidence and considered them when synthesizing the results.
From 711 secondary studies, we identified 15 secondary studies that have investigated the link between source code and external quality. Our results show : (1) primarily, the focus has been on object-oriented systems, (2) maintainability and reliability are most often linked to internal quality attributes and source code metrics, with only one secondary study reporting evidence for security, (3) only a small set of complexity, coupling, and size-related source code metrics report a consistent positive link with maintainability and reliability, and (4) group method of data handling (GMDH) based prediction models have performed better than other prediction models for maintainability prediction.
Based on our results, lines of code, coupling, complexity and the cohesion metrics from Chidamber & Kemerer (CK) metrics are good indicators of maintainability with consistent evidence from high and moderate-quality secondary studies. Similarly, four CK metrics related to coupling, complexity and cohesion are good indicators of reliability, while inheritance and certain cohesion metrics show no consistent evidence of links to maintainability and reliability. Further empirical studies are needed to explore the link between internal quality attributes, source code metrics and other external quality attributes, including functionality, portability, and usability. The results will help researchers and practitioners understand the body of knowledge on the subject and identify future research directions. |
|---|---|
| AbstractList | Several secondary studies have investigated the relationship between internal quality attributes, source code metrics and external quality attributes. Sometimes they have contradictory results.
We synthesize evidence of the link between internal quality attributes, source code metrics and external quality attributes along with the efficacy of the prediction models used.
We conducted a tertiary review to identify, evaluate and synthesize secondary studies. We used several characteristics of secondary studies as indicators for the strength of evidence and considered them when synthesizing the results.
From 711 secondary studies, we identified 15 secondary studies that have investigated the link between source code and external quality. Our results show : (1) primarily, the focus has been on object-oriented systems, (2) maintainability and reliability are most often linked to internal quality attributes and source code metrics, with only one secondary study reporting evidence for security, (3) only a small set of complexity, coupling, and size-related source code metrics report a consistent positive link with maintainability and reliability, and (4) group method of data handling (GMDH) based prediction models have performed better than other prediction models for maintainability prediction.
Based on our results, lines of code, coupling, complexity and the cohesion metrics from Chidamber & Kemerer (CK) metrics are good indicators of maintainability with consistent evidence from high and moderate-quality secondary studies. Similarly, four CK metrics related to coupling, complexity and cohesion are good indicators of reliability, while inheritance and certain cohesion metrics show no consistent evidence of links to maintainability and reliability. Further empirical studies are needed to explore the link between internal quality attributes, source code metrics and other external quality attributes, including functionality, portability, and usability. The results will help researchers and practitioners understand the body of knowledge on the subject and identify future research directions. Context: Several secondary studies have investigated the relationship between internal quality attributes, source code metrics and external quality attributes. Sometimes they have contradictory results. Objective: We synthesize evidence of the link between internal quality attributes, source code metrics and external quality attributes along with the efficacy of the prediction models used. Method: We conducted a tertiary review to identify, evaluate and synthesize secondary studies. We used several characteristics of secondary studies as indicators for the strength of evidence and considered them when synthesizing the results. Results: From 711 secondary studies, we identified 15 secondary studies that have investigated the link between source code and external quality. Our results show : (1) primarily, the focus has been on object-oriented systems, (2) maintainability and reliability are most often linked to internal quality attributes and source code metrics, with only one secondary study reporting evidence for security, (3) only a small set of complexity, coupling, and size-related source code metrics report a consistent positive link with maintainability and reliability, and (4) group method of data handling (GMDH) based prediction models have performed better than other prediction models for maintainability prediction. Conclusions: Based on our results, lines of code, coupling, complexity and the cohesion metrics from Chidamber & Kemerer (CK) metrics are good indicators of maintainability with consistent evidence from high and moderate-quality secondary studies. Similarly, four CK metrics related to coupling, complexity and cohesion are good indicators of reliability, while inheritance and certain cohesion metrics show no consistent evidence of links to maintainability and reliability. Further empirical studies are needed to explore the link between internal quality attributes, source code metrics and other external quality attributes, including functionality, portability, and usability. The results will help researchers and practitioners understand the body of knowledge on the subject and identify future research directions. © 2023 The Author(s) |
| ArticleNumber | 107348 |
| Author | Börstler, Jürgen Usman, Muhammad Iftikhar, Umar Ali, Nauman Bin |
| Author_xml | – sequence: 1 givenname: Umar orcidid: 0000-0003-3177-6138 surname: Iftikhar fullname: Iftikhar, Umar email: umar.iftikhar@bth.se – sequence: 2 givenname: Nauman Bin surname: Ali fullname: Ali, Nauman Bin email: nauman.ali@bth.se – sequence: 3 givenname: Jürgen orcidid: 0000-0003-0639-4234 surname: Börstler fullname: Börstler, Jürgen email: jurgen.borstler@bth.se – sequence: 4 givenname: Muhammad orcidid: 0000-0002-8132-0107 surname: Usman fullname: Usman, Muhammad email: muhammad.usman@bth.se |
| BackLink | https://urn.kb.se/resolve?urn=urn:nbn:se:bth-25555$$DView record from Swedish Publication Index (Blekinge Tekniska Högskola) |
| BookMark | eNqFkEtPwzAMgCM0JMbjH3DID6DDadq15YA0jaeExAW4Rnl4kNElI0mB_Xs6FS4cwBdLtj9b_vbJyHmHhBwzmDBg09PlxLpF9ItJDjnvSxUv6h0yZnXFsynk5YiMoSkhK-ui2SP7MS4BWAUcxuRxRhOGZGXY0Jg6s6He0da610gVpg9ER6PvgkaqvUG6whSsjlQ6Q_GzJ51s6VsnW5s2VKa-qbqE8ZDsLmQb8eg7H5DHq8uH-U12d399O5_dZZrXTcoYYsG5YVqr0kimJECpoIJaQ14zmHIodF6YUiqJVcMQTKENV1Jj3rCqMfyAnAx74weuOyXWwa76T4SXVlzYp5nw4Vmo9CLyso9-_GwY18HHGHAhtE0yWe9SkLYVDMTWp1iKwafY-hSDzx4ufsE_1_7BzgcMew_vFoOI2qLTaGxAnYTx9u8FX2uFlcw |
| CitedBy_id | crossref_primary_10_1109_MS_2025_3537821 crossref_primary_10_1109_ACCESS_2025_3529687 crossref_primary_10_1016_j_infsof_2025_107757 |
| Cites_doi | 10.1504/IJCAT.2016.080487 10.1142/S0218194013500484 10.1016/j.advengsoft.2011.06.001 10.1007/s10664-012-9218-8 10.1145/3143434.3143445 10.1016/j.infsof.2018.11.008 10.1109/32.295895 10.1016/j.jss.2009.06.041 10.14236/ewic/EASE2010.17 10.1016/j.infsof.2017.01.007 10.1016/j.jss.2020.110610 10.1007/s11219-011-9146-7 10.1016/j.infsof.2023.107174 10.1016/j.csi.2018.12.003 10.1016/j.jss.2017.03.044 10.1109/ACCESS.2021.3054730 10.1142/S0218194016500431 10.1016/j.infsof.2013.02.009 10.1016/S0065-2458(02)80005-5 10.1016/j.csi.2019.04.011 10.1016/j.infsof.2018.05.011 10.1109/32.979986 10.1016/j.infsof.2018.02.002 10.1109/TSE.2004.43 10.1049/sej.1990.0007 10.1109/TSE.2005.58 10.1145/2652524.2652557 10.1007/s10664-013-9291-7 10.1109/52.476281 10.1016/j.infsof.2015.04.002 10.1016/S0950-5849(96)00006-7 10.1049/ip-sen:20010506 10.1016/j.infsof.2018.08.015 10.14236/ewic/EASE2008.8 10.1109/TSE.2022.3174092 10.1109/TSE.2021.3119012 10.1109/TSE.2003.1245300 10.1007/s00500-020-05005-4 10.1016/j.infsof.2015.03.007 10.1016/j.infsof.2019.04.006 10.2307/2529310 10.1016/j.jss.2017.01.026 10.1023/A:1009820201126 10.1145/1809223.1809227 10.1007/s10664-011-9183-7 10.1109/32.481535 10.1007/s11432-018-9608-3 10.1016/j.eswa.2008.10.027 10.1145/3172871.3172878 10.1145/1010627.807911 10.3844/jcssp.2020.1558.1569 10.1109/TSE.2017.2770124 10.1109/32.345830 |
| ContentType | Journal Article |
| Copyright | 2023 The Author(s) |
| Copyright_xml | – notice: 2023 The Author(s) |
| DBID | 6I. AAFTH AAYXX CITATION ADTPV AOWAS D8T DF3 ZZAVC |
| DOI | 10.1016/j.infsof.2023.107348 |
| DatabaseName | ScienceDirect Open Access Titles Elsevier:ScienceDirect:Open Access CrossRef SwePub SwePub Articles SWEPUB Freely available online SWEPUB Blekinge Tekniska Högskola SwePub Articles full text |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Business |
| EISSN | 1873-6025 |
| ExternalDocumentID | oai_DiVA_org_bth_25555 10_1016_j_infsof_2023_107348 S0950584923002033 |
| GroupedDBID | --K --M -~X .DC .~1 0R~ 1B1 1~. 1~5 29I 4.4 457 4G. 5GY 5VS 6I. 7-5 71M 77K 8P~ 9JN AABNK AACTN AAEDT AAEDW AAFTH AAIAV AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AAXUO AAYFN AAYOK ABBOA ABFNM ABFRF ABJNI ABMAC ABTAH ABXDB ABYKQ ACDAQ ACGFO ACGFS ACGOD ACNNM ACRLP ACZNC ADBBV ADEZE ADJOM ADMUD AEBSH AEFWE AEKER AENEX AFKWA AFTJW AGHFR AGUBO AGYEJ AHHHB AHZHX AIALX AIEXJ AIKHN AITUG AJBFU AJOXV ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ AOUOD ASPBG AVWKF AXJTR AZFZN BKOJK BKOMP BLXMC CS3 DU5 EBS EFJIC EFLBG EJD EO8 EO9 EP2 EP3 FDB FEDTE FGOYB FIRID FNPLU FYGXN G-Q G8K GBLVA GBOLZ HLZ HVGLF HZ~ IHE J1W KOM LG9 M41 MO0 MS~ N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. PQQKQ Q38 R2- RIG ROL RPZ SBC SDF SDG SDP SES SEW SPC SPCBC SSV SSZ T5K TWZ UHS UNMZH WH7 WUQ XFK ZY4 ~G- 77I 9DU AATTM AAXKI AAYWO AAYXX ABDPE ABWVN ACLOT ACRPL ACVFH ADCNI ADNMO AEIPS AEUPX AFJKZ AFPUW AGQPQ AIGII AIIUN AKBMS AKRWK AKYEP ANKPU APXCP CITATION EFKBS ~HD ADTPV AOWAS D8T DF3 ZZAVC |
| ID | FETCH-LOGICAL-c389t-1ee433d1ccb5da1ba005b0708c028106304c24d5abae791e0d4cd3bace29179d3 |
| ISICitedReferencesCount | 4 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001102357100001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0950-5849 1873-6025 |
| IngestDate | Tue Nov 04 16:11:25 EST 2025 Tue Nov 18 22:19:50 EST 2025 Sat Nov 29 07:12:03 EST 2025 Fri Feb 23 02:35:42 EST 2024 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | Product quality Tertiary review Evidence Code quality Tertiary study Quality models |
| Language | English |
| License | This is an open access article under the CC BY license. |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c389t-1ee433d1ccb5da1ba005b0708c028106304c24d5abae791e0d4cd3bace29179d3 |
| ORCID | 0000-0003-3177-6138 0000-0002-8132-0107 0000-0003-0639-4234 |
| OpenAccessLink | https://urn.kb.se/resolve?urn=urn:nbn:se:bth-25555 |
| ParticipantIDs | swepub_primary_oai_DiVA_org_bth_25555 crossref_citationtrail_10_1016_j_infsof_2023_107348 crossref_primary_10_1016_j_infsof_2023_107348 elsevier_sciencedirect_doi_10_1016_j_infsof_2023_107348 |
| PublicationCentury | 2000 |
| PublicationDate | January 2024 2024-01-00 2024 |
| PublicationDateYYYYMMDD | 2024-01-01 |
| PublicationDate_xml | – month: 01 year: 2024 text: January 2024 |
| PublicationDecade | 2020 |
| PublicationTitle | Information and software technology |
| PublicationYear | 2024 |
| Publisher | Elsevier B.V |
| Publisher_xml | – name: Elsevier B.V |
| References | Chidamber, Kemerer (b68) 1994; 20 Fenton, Bieman (b9) 2019 Al-Jamimi, Ahmed (b11) 2012 Yan, Xia, Zhang, Xu, Yang, Li (b54) 2019; 62 Isong, Obeten (b100) 2013; 23 Morrison, Moye, Pandita, Williams (b58) 2018; 102 Bansiya, Davis (b71) 2002; 28 Curcio, Santana, Reinehr, Malucelli (b47) 2019; 64 Kitchenham, Pickard, Linkman (b89) 1990; 5 Ali, Tanveer (b37) 2022 Herraiz, Hassan (b86) 2010 Lorenz, Kidd (b69) 1994 Radjenović, Heričko, Torkar, Živkovič (b99) 2013; 55 M.A.A. Mamun, C. Berger, J. Hansson, Correlations of software code metrics: an empirical study, in: Proceedings of the 27th International Workshop on Software Measurement and 12th International Conference on Software Process and Product Measurement, 2017, pp. 255–266. G. Concas, M. Marchesi, A. Murgia, S. Pinna, R. Tonelli, Assessing traditional and new metrics for object-oriented systems, in: Proceedings of the 2010 ICSE Workshop on Emerging Trends in Software Metrics, 2010, pp. 24–31. Arisholm, Sjoberg (b88) 2004; 30 Organización Internacional de Normalización (b6) 2011 Myrtveit, Stensrud (b79) 2012; 17 J. Murillo-Morera, C. Quesada-López, M. Jenkins, Software fault prediction: A systematic mapping study, in: CIBSE 2015 - XVIII Ibero-American Conference on Software Engineering, 2015, pp. 446–459. Spray, Sinha, Sen, Cheng (b66) 2021; 48 Hosseini, Turhan, Gunarathna (b82) 2019; 45 Romanovsky, Vardanega (b29) 2011 Malhotra, Chug (b95) 2016; 26 Khan, Elish, El-Attar (b57) 2012; vol. 7336 LNCS . Malhotra, Chug (b19) 2016; 26 Elish, Al-Yafei, Al-Mulhem (b74) 2011; 42 Tran, Börstler, bin Ali, Unterkalmsteiner (b38) 2022; 16 Briand, Morasca, Basili (b72) 1996; 22 Börstler, Ali, Petersen (b43) 2023; 158 Fregnan, Baum, Palomba, Bacchelli (b84) 2019; 107 Tahir, MacDonell (b62) 2012 Nuñez-Varela, Pérez-Gonzalez, Martínez-Perez, Soubervielle-Montalvo (b21) 2017; 128 Grady, Caswell (b23) 1987 Nagappan, Williams, Vouk, Osborne (b64) 2007 El-Sharkawy, Yamagishi-Eichler, Schmid (b92) 2019; 106 Baldassarre, Caivano, Romano, Scanniello (b16) 2019 El Emam (b41) 1999; 4 Landis, Koch (b40) 1977 Mordal-Manet, Balmas, Denier, Ducasse, Wertz, Laval, Bellingard, Vaillergues (b26) 2009 Malhotra, Lata (b90) 2020; 24 Mayer, Hall (b75) 1999 Conte, Dunsmore, Shen (b51) 1986 Myrtveit, Stensrud, Shepperd (b78) 2005; 31 Almugrin, Albattah, Alaql, Alzahrani, Melton (b12) 2014 A. Mayr, R. Plösch, M. Kläs, C. Lampasona, F. Iese, M. Saft, A Comprehensive Code-based Quality Model for Embedded Systems, in: 2012 IEEE 23rd International Symposium on Software Reliability Engineering, 2012, p. 10. Organización Internacional de Normalización (b65) 2016 F.B. Abreu, R. Carapuça, Object-oriented software engineering: Measuring and controlling the development process, in: Proceedings of the 4th International Conference on Software Quality, Vol. 186, 1994, pp. 1–8. Elmidaoui, Cheikhi, Idri, Abran (b93) 2019; 13 Petersen, Vakkalanka, Kuzniarz (b33) 2015; 64 Colakoglu, Yazici, Mishra (b56) 2021; 9 Budgen, Brereton, Williams, Drummond (b45) 2020; 14 Ali, Usman (b44) 2019; 112 Harrison, Counsell, Nithi (b73) 1997 Dromey (b5) 1995; 21 Burrows, Garcia, Taïani (b20) 2009 Malhotra, Khanna (b94) 2019; 13 Kitchenham (b101) 2010; 83 Kitchenham, Budgen, Brereton (b31) 2015 Gray, MacDonell (b50) 1997; 39 Saraiva, Soares, Castor (b17) 2013 Briand, Wüst (b14) 2002; 56 Barros-Justo, Benitti, Matalonga (b36) 2019; 66 Kitchenham, Madeyski, Budgen (b48) 2022; 49 Lacerda, Petrillo, Pimenta, Guéhéneuc (b30) 2020 McCall, Richards, Walters (b3) 1977 Jørgensen (b76) 2007 Henry, Kafura, Harris (b85) 1981; 10 K. Petersen, R. Feldt, S. Mujtaba, M. Mattsson, Systematic mapping studies in software engineering, in: 12th International Conference on Evaluation and Assessment in Software Engineering, EASE 12, 2008, pp. 1–10. Miguel, Mauricio, Rodriguez (b10) 2014; 5 Oman, Hagemeister (b61) 1992 Turner (b35) 2010 Nagappan, Williams, Osborne, Vouk, Abrahamsson (b63) 2005 Soto, Ciolkowski (b24) 2009 Jabangwe, Börstler, Šmite, Wohlin (b52) 2015; 20 Riaz, Mendes, Tempero (b15) 2009 Hoda, Salleh, Grundy, Tee (b46) 2017; 85 Kitchenham, Pickard, MacDonell, Shepperd (b77) 2001; 148 N.B. Ali, K. Petersen, Evaluating strategies for study selection in systematic literature studies, in: Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, 2014, pp. 1–4. Yan, Xia, Zhang, Xu, Yang (b55) 2017 CISQ Specifications for Automated Quality Characteristic Measures (b28) 2012 Sreeji, Lakshmi (b53) 2015; 10 Riaz, Breaux, Williams (b97) 2015; 65 Rashidi, Sadeghzadeh Hemayati (b27) 2018; 6 Saraiva, Barreiros, Almeida, Lima, Alencar, Lima, Soares, Castor (b83) 2012; 2012 L. Chen, M.A. Babar, H. Zhang, Towards an evidence-based understanding of electronic data sources, in: 14th International Conference on Evaluation and Assessment in Software Engineering, EASE, 2010, pp. 1–4. Usman, Ali, Wohlin (b49) 2023; 17 IEEE (b2) 2006 Foss, Stensrud, Kitchenham, Myrtveit (b80) 2003; 29 Kitchenham, Pfleeger (b1) 1996; 13 S. Tiwari, S. Rathore, Coupling and cohesion metrics for object-oriented software: A systematic mapping study, in: ACM International Conference Proceeding Series, 2018 B.W. Boehm, J.R. Brown, M. Lipow, QUANTITATIVE EVALUATION OF SOFTWARE QUALITY, in: Proceedings of the 2nd International Conference on Software Engineering, 1976, pp. 592–605. Catal, Diri (b60) 2009; 36 Okutan, Yıldız (b67) 2014; 19 Montagud, Abrahão, Insfran (b7) 2012; 20 Ali, Usman (b32) 2018; 99 Saharudin, Wei, Na (b91) 2020; 16 Malhotra, Bansal (b96) 2016; 54 Saxena, Saini (b59) 2011; 22 ISO (b22) 2001 Arvanitou, Ampatzoglou, Chatzigeorgiou, Galster, Avgeriou (b8) 2017; 127 Abilio, Teles, Costa, Figueiredo (b18) 2012 Börstler (10.1016/j.infsof.2023.107348_b43) 2023; 158 Petersen (10.1016/j.infsof.2023.107348_b33) 2015; 64 10.1016/j.infsof.2023.107348_b70 Lorenz (10.1016/j.infsof.2023.107348_b69) 1994 Baldassarre (10.1016/j.infsof.2023.107348_b16) 2019 Tran (10.1016/j.infsof.2023.107348_b38) 2022; 16 El Emam (10.1016/j.infsof.2023.107348_b41) 1999; 4 Saraiva (10.1016/j.infsof.2023.107348_b17) 2013 Tahir (10.1016/j.infsof.2023.107348_b62) 2012 Jabangwe (10.1016/j.infsof.2023.107348_b52) 2015; 20 Briand (10.1016/j.infsof.2023.107348_b72) 1996; 22 Malhotra (10.1016/j.infsof.2023.107348_b90) 2020; 24 Ali (10.1016/j.infsof.2023.107348_b32) 2018; 99 10.1016/j.infsof.2023.107348_b87 Sreeji (10.1016/j.infsof.2023.107348_b53) 2015; 10 Foss (10.1016/j.infsof.2023.107348_b80) 2003; 29 10.1016/j.infsof.2023.107348_b81 10.1016/j.infsof.2023.107348_b4 Hoda (10.1016/j.infsof.2023.107348_b46) 2017; 85 Briand (10.1016/j.infsof.2023.107348_b14) 2002; 56 Myrtveit (10.1016/j.infsof.2023.107348_b79) 2012; 17 Almugrin (10.1016/j.infsof.2023.107348_b12) 2014 Lacerda (10.1016/j.infsof.2023.107348_b30) 2020 CISQ Specifications for Automated Quality Characteristic Measures (10.1016/j.infsof.2023.107348_b28) 2012 10.1016/j.infsof.2023.107348_b13 Spray (10.1016/j.infsof.2023.107348_b66) 2021; 48 Hosseini (10.1016/j.infsof.2023.107348_b82) 2019; 45 Miguel (10.1016/j.infsof.2023.107348_b10) 2014; 5 10.1016/j.infsof.2023.107348_b98 Myrtveit (10.1016/j.infsof.2023.107348_b78) 2005; 31 Saraiva (10.1016/j.infsof.2023.107348_b83) 2012; 2012 Fenton (10.1016/j.infsof.2023.107348_b9) 2019 Catal (10.1016/j.infsof.2023.107348_b60) 2009; 36 Bansiya (10.1016/j.infsof.2023.107348_b71) 2002; 28 10.1016/j.infsof.2023.107348_b25 Gray (10.1016/j.infsof.2023.107348_b50) 1997; 39 Al-Jamimi (10.1016/j.infsof.2023.107348_b11) 2012 Mayer (10.1016/j.infsof.2023.107348_b75) 1999 Conte (10.1016/j.infsof.2023.107348_b51) 1986 Elish (10.1016/j.infsof.2023.107348_b74) 2011; 42 Saharudin (10.1016/j.infsof.2023.107348_b91) 2020; 16 Dromey (10.1016/j.infsof.2023.107348_b5) 1995; 21 Arvanitou (10.1016/j.infsof.2023.107348_b8) 2017; 127 Barros-Justo (10.1016/j.infsof.2023.107348_b36) 2019; 66 Henry (10.1016/j.infsof.2023.107348_b85) 1981; 10 El-Sharkawy (10.1016/j.infsof.2023.107348_b92) 2019; 106 Kitchenham (10.1016/j.infsof.2023.107348_b48) 2022; 49 Khan (10.1016/j.infsof.2023.107348_b57) 2012; vol. 7336 LNCS Soto (10.1016/j.infsof.2023.107348_b24) 2009 10.1016/j.infsof.2023.107348_b34 Harrison (10.1016/j.infsof.2023.107348_b73) 1997 Riaz (10.1016/j.infsof.2023.107348_b97) 2015; 65 Radjenović (10.1016/j.infsof.2023.107348_b99) 2013; 55 Yan (10.1016/j.infsof.2023.107348_b54) 2019; 62 Malhotra (10.1016/j.infsof.2023.107348_b94) 2019; 13 Kitchenham (10.1016/j.infsof.2023.107348_b101) 2010; 83 Turner (10.1016/j.infsof.2023.107348_b35) 2010 Kitchenham (10.1016/j.infsof.2023.107348_b1) 1996; 13 Okutan (10.1016/j.infsof.2023.107348_b67) 2014; 19 Fregnan (10.1016/j.infsof.2023.107348_b84) 2019; 107 10.1016/j.infsof.2023.107348_b39 Oman (10.1016/j.infsof.2023.107348_b61) 1992 Organización Internacional de Normalización (10.1016/j.infsof.2023.107348_b65) 2016 10.1016/j.infsof.2023.107348_b42 Riaz (10.1016/j.infsof.2023.107348_b15) 2009 Nuñez-Varela (10.1016/j.infsof.2023.107348_b21) 2017; 128 Kitchenham (10.1016/j.infsof.2023.107348_b77) 2001; 148 Burrows (10.1016/j.infsof.2023.107348_b20) 2009 Saxena (10.1016/j.infsof.2023.107348_b59) 2011; 22 Arisholm (10.1016/j.infsof.2023.107348_b88) 2004; 30 Romanovsky (10.1016/j.infsof.2023.107348_b29) 2011 Chidamber (10.1016/j.infsof.2023.107348_b68) 1994; 20 Kitchenham (10.1016/j.infsof.2023.107348_b89) 1990; 5 Isong (10.1016/j.infsof.2023.107348_b100) 2013; 23 Jørgensen (10.1016/j.infsof.2023.107348_b76) 2007 Colakoglu (10.1016/j.infsof.2023.107348_b56) 2021; 9 Organización Internacional de Normalización (10.1016/j.infsof.2023.107348_b6) 2011 Yan (10.1016/j.infsof.2023.107348_b55) 2017 Nagappan (10.1016/j.infsof.2023.107348_b64) 2007 Herraiz (10.1016/j.infsof.2023.107348_b86) 2010 Mordal-Manet (10.1016/j.infsof.2023.107348_b26) 2009 Morrison (10.1016/j.infsof.2023.107348_b58) 2018; 102 Malhotra (10.1016/j.infsof.2023.107348_b19) 2016; 26 Landis (10.1016/j.infsof.2023.107348_b40) 1977 Curcio (10.1016/j.infsof.2023.107348_b47) 2019; 64 Montagud (10.1016/j.infsof.2023.107348_b7) 2012; 20 Budgen (10.1016/j.infsof.2023.107348_b45) 2020; 14 IEEE (10.1016/j.infsof.2023.107348_b2) 2006 ISO (10.1016/j.infsof.2023.107348_b22) 2001 McCall (10.1016/j.infsof.2023.107348_b3) 1977 Ali (10.1016/j.infsof.2023.107348_b44) 2019; 112 Ali (10.1016/j.infsof.2023.107348_b37) 2022 Abilio (10.1016/j.infsof.2023.107348_b18) 2012 Grady (10.1016/j.infsof.2023.107348_b23) 1987 Nagappan (10.1016/j.infsof.2023.107348_b63) 2005 Rashidi (10.1016/j.infsof.2023.107348_b27) 2018; 6 Kitchenham (10.1016/j.infsof.2023.107348_b31) 2015 Elmidaoui (10.1016/j.infsof.2023.107348_b93) 2019; 13 Malhotra (10.1016/j.infsof.2023.107348_b95) 2016; 26 Malhotra (10.1016/j.infsof.2023.107348_b96) 2016; 54 Usman (10.1016/j.infsof.2023.107348_b49) 2023; 17 |
| References_xml | – year: 2015 ident: b31 article-title: Evidence-Based Software Engineering and Systematic Reviews, Vol. 4 – reference: S. Tiwari, S. Rathore, Coupling and cohesion metrics for object-oriented software: A systematic mapping study, in: ACM International Conference Proceeding Series, 2018, – volume: 28 start-page: 4 year: 2002 end-page: 17 ident: b71 article-title: A hierarchical model for object-oriented design quality assessment publication-title: IEEE Trans. Softw. Eng. – start-page: 337 year: 1992 end-page: 338 ident: b61 article-title: Metrics for assessing a software system’s maintainability publication-title: Proceedings Conference on Software Maintenance 1992 – start-page: 367 year: 2009 end-page: 377 ident: b15 article-title: A systematic review of software maintainability prediction and metrics publication-title: 2009 3rd International Symposium on Empirical Software Engineering and Measurement – reference: M.A.A. Mamun, C. Berger, J. Hansson, Correlations of software code metrics: an empirical study, in: Proceedings of the 27th International Workshop on Software Measurement and 12th International Conference on Software Process and Product Measurement, 2017, pp. 255–266. – volume: 26 start-page: 1221 year: 2016 end-page: 1253 ident: b19 article-title: Software maintainability: Systematic literature review and current trends publication-title: Int. J. Softw. Eng. Knowl. Eng. – volume: 19 start-page: 154 year: 2014 end-page: 181 ident: b67 article-title: Software defect prediction using Bayesian networks publication-title: Empir. Softw. Eng. – volume: 64 start-page: 1 year: 2015 end-page: 18 ident: b33 article-title: Guidelines for conducting systematic mapping studies in software engineering: An update publication-title: Inf. Softw. Technol. – volume: 20 start-page: 640 year: 2015 end-page: 693 ident: b52 article-title: Empirical evidence on the link between object-oriented measures and external quality attributes: A systematic literature review publication-title: Empir. Softw. Eng. – start-page: 85 year: 2005 end-page: 94 ident: b63 article-title: Providing test quality feedback using static source code and automatic test suite metrics publication-title: 16th IEEE International Symposium on Software Reliability Engineering – start-page: 230 year: 1997 end-page: 235 ident: b73 article-title: An overview of object-oriented design metrics publication-title: Proceedings Eighth IEEE International Workshop on Software Technology and Engineering Practice Incorporating Computer Aided Software Engineering – volume: 42 start-page: 852 year: 2011 end-page: 859 ident: b74 article-title: Empirical comparison of three metrics suites for fault prediction in packages of object-oriented systems: A case study of Eclipse publication-title: Adv. Eng. Softw. – volume: 158 year: 2023 ident: b43 article-title: Double-counting in software engineering tertiary studies - An overlooked threat to validity publication-title: Inf. Softw. Technol. – volume: 22 start-page: 68 year: 1996 end-page: 86 ident: b72 article-title: Property-based software engineering measurement publication-title: IEEE Trans. Softw. Eng. – volume: 14 start-page: 7 year: 2020 end-page: 60 ident: b45 article-title: What support do systematic reviews provide for evidence-informed teaching about software engineering practice? publication-title: e-Inform. Softw. Eng. J. – reference: A. Mayr, R. Plösch, M. Kläs, C. Lampasona, F. Iese, M. Saft, A Comprehensive Code-based Quality Model for Embedded Systems, in: 2012 IEEE 23rd International Symposium on Software Reliability Engineering, 2012, p. 10. – start-page: 159 year: 1977 end-page: 174 ident: b40 article-title: The measurement of observer agreement for categorical data publication-title: Biometrics – volume: 99 start-page: 133 year: 2018 end-page: 147 ident: b32 article-title: Reliability of search in systematic reviews: Towards a quality assessment framework for the automated-search strategy publication-title: Inf. Softw. Technol. – volume: 49 start-page: 1273 year: 2022 end-page: 1298 ident: b48 article-title: SEGRESS: Software engineering guidelines for reporting secondary studies publication-title: IEEE Trans. Softw. Eng. – volume: 2012 start-page: 253 year: 2012 end-page: 262 ident: b83 article-title: Aspect-oriented software maintenance metrics: A systematic mapping study publication-title: IET Semin. Digest – volume: 20 start-page: 425 year: 2012 end-page: 486 ident: b7 article-title: A systematic review of quality attributes and measures for software product lines publication-title: Softw. Qual. J. – year: 2006 ident: b2 article-title: 1074-2006–IEEE Standard for Developing a Software Project Life Cycle Process – start-page: 252 year: 2019 end-page: 259 ident: b16 article-title: Software models for source code maintainability: A systematic literature review publication-title: 2019 45th Euromicro Conference on Software Engineering and Advanced Applications – volume: 102 start-page: 146 year: 2018 end-page: 159 ident: b58 article-title: Mapping the field of software life cycle security metrics publication-title: Inf. Softw. Technol. – volume: 127 start-page: 52 year: 2017 end-page: 77 ident: b8 article-title: A mapping study on design-time quality attributes and metrics publication-title: J. Syst. Softw. – start-page: 209 year: 2007 end-page: 214 ident: b64 article-title: Using in-process testing metrics to estimate post-release field quality publication-title: The 18th IEEE International Symposium on Software Reliability – volume: 54 start-page: 240 year: 2016 end-page: 256 ident: b96 article-title: Software change prediction: A literature review publication-title: Int. J. Comput. Appl. Technol. – volume: 5 start-page: 50 year: 1990 end-page: 58 ident: b89 article-title: An evaluation of some design metrics publication-title: Softw. Eng. J. – reference: J. Murillo-Morera, C. Quesada-López, M. Jenkins, Software fault prediction: A systematic mapping study, in: CIBSE 2015 - XVIII Ibero-American Conference on Software Engineering, 2015, pp. 446–459. – volume: 16 start-page: 1558 year: 2020 end-page: 1569 ident: b91 article-title: Machine learning techniques for software bug prediction: A systematic review publication-title: J. Comput. Sci. – start-page: 277 year: 2009 end-page: 290 ident: b20 article-title: Coupling metrics for aspect-oriented programming: A systematic review of maintainability studies publication-title: Eval. Nov. Approaches Softw. Eng. – start-page: 130 year: 2012 end-page: 139 ident: b18 article-title: A systematic review of contemporary metrics for software maintainability publication-title: 2012 Sixth Brazilian Symposium on Software Components, Architectures and Reuse – year: 2016 ident: b65 article-title: ISO-IEC 25023: 2016-Systems and Software Engineering-Systems and software Quality Requirements and Evaluation (SQuaRE)-Measurement of System and Software Product Quality – year: 2022 ident: b37 article-title: A comparison of citation sources for reference and citation-based search in systematic literature reviews publication-title: e-Inform. Softw. Eng. J. – volume: 148 start-page: 81 year: 2001 end-page: 85 ident: b77 article-title: What accuracy statistics really measure [software estimation] publication-title: IEE Proc.-Softw. – volume: 5 start-page: 31 year: 2014 end-page: 53 ident: b10 article-title: A review of software quality models for the evaluation of software products publication-title: Int. J. Softw. Eng. Appl. – volume: 17 start-page: 23 year: 2012 end-page: 33 ident: b79 article-title: Validity and reliability of evaluation procedures in comparative studies of effort prediction models publication-title: Empir. Softw. Eng. – volume: 45 start-page: 111 year: 2019 end-page: 147 ident: b82 article-title: A systematic literature review and meta-analysis on cross project defect prediction publication-title: IEEE Trans. Softw. Eng. – volume: 66 year: 2019 ident: b36 article-title: Trends in software reuse research: A tertiary study publication-title: Comput. Stand. Interfaces – volume: 10 start-page: 81 year: 1981 end-page: 88 ident: b85 article-title: On the relationships among three software metrics publication-title: ACM SIGMETRICS Perform. Eval. Rev. – volume: 13 start-page: 141 year: 2019 end-page: 202 ident: b93 article-title: Empirical studies on software product maintainability prediction: A systematic mapping and review publication-title: e-Inform. Softw. Eng. J. – volume: 55 start-page: 1397 year: 2013 end-page: 1418 ident: b99 article-title: Software fault prediction metrics: A systematic literature review publication-title: Inf. Softw. Technol. – year: 1994 ident: b69 article-title: Object-Oriented Software Metrics: A Practical Guide – volume: 30 start-page: 521 year: 2004 end-page: 534 ident: b88 article-title: Evaluating the effect of a delegated versus centralized control style on the maintainability of object-oriented software publication-title: IEEE Trans. Softw. Eng. – start-page: 84 year: 2013 end-page: 87 ident: b17 article-title: Towards a catalog of object-oriented software maintainability metrics publication-title: 2013 4th International Workshop on Emerging Trends in Software Metrics – volume: 107 start-page: 159 year: 2019 end-page: 178 ident: b84 article-title: A survey on software coupling relations and tools publication-title: Inf. Softw. Technol. – volume: 17 year: 2023 ident: b49 article-title: A quality assessment instrument for systematic literature reviews in software engineering publication-title: e-Inform. Softw. Eng. J. – volume: 24 start-page: 16655 year: 2020 end-page: 16677 ident: b90 article-title: A systematic literature review on empirical studies towards prediction of software maintainability publication-title: Soft Comput. – volume: 106 start-page: 1 year: 2019 end-page: 30 ident: b92 article-title: Metrics for analyzing variability and its implementation in software product lines: A systematic literature review publication-title: Inf. Softw. Technol. – volume: 10 start-page: 39696 year: 2015 end-page: 39707 ident: b53 article-title: A systematic literature review: Recent trends and open issues in software refactoring publication-title: Int. J. Appl. Eng. Res. – year: 2011 ident: b6 article-title: ISO-IEC 25010: 2011 Systems and Software Engineering-Systems and Software Quality Requirements and Evaluation (SQuaRE)-System and Software Quality Models – reference: G. Concas, M. Marchesi, A. Murgia, S. Pinna, R. Tonelli, Assessing traditional and new metrics for object-oriented systems, in: Proceedings of the 2010 ICSE Workshop on Emerging Trends in Software Metrics, 2010, pp. 24–31. – volume: 9 start-page: 44647 year: 2021 end-page: 44670 ident: b56 article-title: Software product quality metrics: A systematic mapping study publication-title: IEEE Access – volume: 83 start-page: 37 year: 2010 end-page: 51 ident: b101 article-title: What’s up with software metrics? - A preliminary mapping study publication-title: J. Syst. Softw. – year: 2010 ident: b35 article-title: Digital Libraries and Search Engines for Software Engineering Research: an Overview – year: 1986 ident: b51 article-title: Software Engineering Metrics and Models – volume: 36 start-page: 7346 year: 2009 end-page: 7354 ident: b60 article-title: A systematic review of software fault prediction studies publication-title: Expert Syst. Appl. – year: 2001 ident: b22 article-title: IEC 9126-1: Software Engineering-Product Quality-Part 1: Quality Model, Vol. 21 – volume: vol. 7336 LNCS start-page: 258 year: 2012 end-page: 273 ident: b57 publication-title: A Systematic Review on the Impact of CK Metrics on the Functional Correctness of Object-Oriented Classes – year: 1987 ident: b23 article-title: Software Metrics: Establishing a Company-Wide Program – reference: N.B. Ali, K. Petersen, Evaluating strategies for study selection in systematic literature studies, in: Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, 2014, pp. 1–4. – volume: 6 year: 2018 ident: b27 article-title: Software quality models: A comprehensive review and analysis publication-title: J. Electr. Comput. Eng. Innov. – volume: 13 start-page: 227 year: 2019 end-page: 259 ident: b94 article-title: Software change prediction: A systematic review and future guidelines publication-title: e-Inform. Softw. Eng. J. – start-page: 531 year: 2009 end-page: 534 ident: b26 article-title: The squale model — A practice-based industrial quality model publication-title: 2009 IEEE International Conference on Software Maintenance – volume: 56 start-page: 97 year: 2002 end-page: 166 ident: b14 article-title: Empirical studies of quality models in object-oriented systems publication-title: Adv. Comput – volume: 62 year: 2019 ident: b54 article-title: Software quality assessment model: a systematic mapping study publication-title: Sci. China Inf. Sci. – reference: L. Chen, M.A. Babar, H. Zhang, Towards an evidence-based understanding of electronic data sources, in: 14th International Conference on Evaluation and Assessment in Software Engineering, EASE, 2010, pp. 1–4. – reference: B.W. Boehm, J.R. Brown, M. Lipow, QUANTITATIVE EVALUATION OF SOFTWARE QUALITY, in: Proceedings of the 2nd International Conference on Software Engineering, 1976, pp. 592–605. – year: 2020 ident: b30 article-title: Code smells and refactoring: a tertiary systematic review of challenges and observations publication-title: J. Syst. Softw. – start-page: 125 year: 2010 end-page: 141 ident: b86 article-title: Beyond lines of code: Do we need more complexity metrics publication-title: Making Software: What Really Works, and Why We Believe It – start-page: 108 year: 1999 end-page: 117 ident: b75 article-title: Measuring OO systems: a critical analysis of the MOOD metrics publication-title: Proceedings Technology of Object-Oriented Languages and Systems. TOOLS 29 (Cat. No. PR00275) – start-page: 326 year: 2012 end-page: 335 ident: b62 article-title: A systematic mapping study on dynamic metrics and software quality publication-title: IEEE International Conference on Software Maintenance – start-page: 702 year: 2012 end-page: 705 ident: b11 article-title: Prediction of software maintainability using fuzzy logic publication-title: 2012 IEEE International Conference on Computer Science and Automation Engineering – volume: 23 start-page: 1513 year: 2013 end-page: 1540 ident: b100 article-title: A systematic review of the empirical validation of object-oriented metrics towards fault-proneness prediction publication-title: Int. J. Softw. Eng. Knowl. Eng. – start-page: 498 year: 2009 end-page: 501 ident: b24 article-title: The qualoss open source assessment model measuring the performance of open source communities publication-title: 2009 3rd International Symposium on Empirical Software Engineering and Measurement – year: 2019 ident: b9 article-title: Software Metrics: A Rigorous and Practical Approach – volume: 39 start-page: 425 year: 1997 end-page: 437 ident: b50 article-title: A comparison of techniques for developing predictive models of software metrics publication-title: Inf. Softw. Technol. – volume: 128 start-page: 164 year: 2017 end-page: 197 ident: b21 article-title: Source code metrics: A systematic mapping study publication-title: J. Syst. Softw. – reference: F.B. Abreu, R. Carapuça, Object-oriented software engineering: Measuring and controlling the development process, in: Proceedings of the 4th International Conference on Software Quality, Vol. 186, 1994, pp. 1–8. – start-page: 1 year: 2007 end-page: 6 ident: b76 article-title: A critique of how we measure and interpret the accuracy of software development effort estimation publication-title: First International Workshop on Software Productivity Analysis and Cost Estimation – start-page: 63 year: 2017 end-page: 71 ident: b55 article-title: A systematic mapping study of quality assessment models for software products publication-title: 2017 International Conference on Software Analysis, Testing and Evolution – start-page: 364 year: 2014 end-page: 373 ident: b12 article-title: Instability and abstractness metrics based on responsibility publication-title: 2014 IEEE 38th Annual Computer Software and Applications Conference – year: 2011 ident: b29 article-title: Reliable Software Technologies–Ada-Europe 2011: 16th Ada-Europe International Conference on Reliable Software Technologies, Edinburgh, UK, June 20–24, 2011. Proceedings, Vol. 6652 – volume: 13 start-page: 12 year: 1996 end-page: 21 ident: b1 article-title: Software quality: the elusive target [special issues section] publication-title: IEEE Softw. – volume: 4 start-page: 113 year: 1999 end-page: 133 ident: b41 article-title: Benchmarking Kappa: Interrater agreement in software process assessments publication-title: Empir. Softw. Eng. – volume: 16 year: 2022 ident: b38 article-title: How good are my search strings? Reflections on using an existing review as a quasi-gold standard publication-title: e-Inform. Softw. Eng. J. – year: 1977 ident: b3 article-title: Factors in Software Quality, Volumes I, II, and III – volume: 22 start-page: 41 year: 2011 end-page: 45 ident: b59 article-title: Empirical studies to predict fault proneness: A review publication-title: Int. J. Comput. Appl. – volume: 85 start-page: 60 year: 2017 end-page: 70 ident: b46 article-title: Systematic literature reviews in agile software development: A tertiary study publication-title: Inf. Softw. Technol. – volume: 29 start-page: 985 year: 2003 end-page: 995 ident: b80 article-title: A simulation study of the model evaluation criterion MMRE publication-title: IEEE Trans. Softw. Eng. – volume: 64 start-page: 61 year: 2019 end-page: 77 ident: b47 article-title: Usability in agile software development: A tertiary study publication-title: Comput. Stand. Interfaces – volume: 21 start-page: 146 year: 1995 end-page: 162 ident: b5 article-title: A model for software product quality publication-title: IEEE Trans. Softw. Eng. – reference: . – volume: 48 start-page: 4397 year: 2021 end-page: 4410 ident: b66 article-title: Building maintainable software using abstraction layering publication-title: IEEE Trans. Softw. Eng. – volume: 31 start-page: 380 year: 2005 end-page: 391 ident: b78 article-title: Reliability and validity in comparative studies of software prediction models publication-title: IEEE Trans. Softw. Eng. – volume: 112 start-page: 48 year: 2019 end-page: 50 ident: b44 article-title: A critical appraisal tool for systematic literature reviews in software engineering publication-title: Inf. Softw. Technol. – volume: 26 start-page: 1221 year: 2016 end-page: 1253 ident: b95 article-title: Software maintainability: Systematic literature review and current trends publication-title: Int. J. Softw. Eng. Knowl. Eng. – volume: 65 start-page: 14 year: 2015 end-page: 38 ident: b97 article-title: How have we evaluated software pattern application? A systematic mapping study of research design practices publication-title: Inf. Softw. Technol. – year: 2012 ident: b28 article-title: CISQ Technical Work Groups for Reliability, Performance Efficiency, Security, Maintainability – volume: 20 start-page: 476 year: 1994 end-page: 493 ident: b68 article-title: A metrics suite for object oriented design publication-title: IEEE Trans. Softw. Eng. – reference: K. Petersen, R. Feldt, S. Mujtaba, M. Mattsson, Systematic mapping studies in software engineering, in: 12th International Conference on Evaluation and Assessment in Software Engineering, EASE 12, 2008, pp. 1–10. – volume: 54 start-page: 240 issue: 4 year: 2016 ident: 10.1016/j.infsof.2023.107348_b96 article-title: Software change prediction: A literature review publication-title: Int. J. Comput. Appl. Technol. doi: 10.1504/IJCAT.2016.080487 – volume: 23 start-page: 1513 issue: 10 year: 2013 ident: 10.1016/j.infsof.2023.107348_b100 article-title: A systematic review of the empirical validation of object-oriented metrics towards fault-proneness prediction publication-title: Int. J. Softw. Eng. Knowl. Eng. doi: 10.1142/S0218194013500484 – volume: 42 start-page: 852 issue: 10 year: 2011 ident: 10.1016/j.infsof.2023.107348_b74 article-title: Empirical comparison of three metrics suites for fault prediction in packages of object-oriented systems: A case study of Eclipse publication-title: Adv. Eng. Softw. doi: 10.1016/j.advengsoft.2011.06.001 – volume: 5 start-page: 31 issue: 6 year: 2014 ident: 10.1016/j.infsof.2023.107348_b10 article-title: A review of software quality models for the evaluation of software products publication-title: Int. J. Softw. Eng. Appl. – volume: 19 start-page: 154 issue: 1 year: 2014 ident: 10.1016/j.infsof.2023.107348_b67 article-title: Software defect prediction using Bayesian networks publication-title: Empir. Softw. Eng. doi: 10.1007/s10664-012-9218-8 – year: 2022 ident: 10.1016/j.infsof.2023.107348_b37 article-title: A comparison of citation sources for reference and citation-based search in systematic literature reviews publication-title: e-Inform. Softw. Eng. J. – ident: 10.1016/j.infsof.2023.107348_b87 doi: 10.1145/3143434.3143445 – volume: 107 start-page: 159 year: 2019 ident: 10.1016/j.infsof.2023.107348_b84 article-title: A survey on software coupling relations and tools publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2018.11.008 – volume: 20 start-page: 476 issue: 6 year: 1994 ident: 10.1016/j.infsof.2023.107348_b68 article-title: A metrics suite for object oriented design publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/32.295895 – start-page: 364 year: 2014 ident: 10.1016/j.infsof.2023.107348_b12 article-title: Instability and abstractness metrics based on responsibility – volume: 83 start-page: 37 issue: 1 year: 2010 ident: 10.1016/j.infsof.2023.107348_b101 article-title: What’s up with software metrics? - A preliminary mapping study publication-title: J. Syst. Softw. doi: 10.1016/j.jss.2009.06.041 – ident: 10.1016/j.infsof.2023.107348_b34 doi: 10.14236/ewic/EASE2010.17 – volume: 85 start-page: 60 year: 2017 ident: 10.1016/j.infsof.2023.107348_b46 article-title: Systematic literature reviews in agile software development: A tertiary study publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2017.01.007 – year: 2020 ident: 10.1016/j.infsof.2023.107348_b30 article-title: Code smells and refactoring: a tertiary systematic review of challenges and observations publication-title: J. Syst. Softw. doi: 10.1016/j.jss.2020.110610 – volume: 16 issue: 1 year: 2022 ident: 10.1016/j.infsof.2023.107348_b38 article-title: How good are my search strings? Reflections on using an existing review as a quasi-gold standard publication-title: e-Inform. Softw. Eng. J. – volume: 17 issue: 1 year: 2023 ident: 10.1016/j.infsof.2023.107348_b49 article-title: A quality assessment instrument for systematic literature reviews in software engineering publication-title: e-Inform. Softw. Eng. J. – volume: 20 start-page: 425 issue: 3–4 year: 2012 ident: 10.1016/j.infsof.2023.107348_b7 article-title: A systematic review of quality attributes and measures for software product lines publication-title: Softw. Qual. J. doi: 10.1007/s11219-011-9146-7 – volume: 158 year: 2023 ident: 10.1016/j.infsof.2023.107348_b43 article-title: Double-counting in software engineering tertiary studies - An overlooked threat to validity publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2023.107174 – volume: 64 start-page: 61 year: 2019 ident: 10.1016/j.infsof.2023.107348_b47 article-title: Usability in agile software development: A tertiary study publication-title: Comput. Stand. Interfaces doi: 10.1016/j.csi.2018.12.003 – ident: 10.1016/j.infsof.2023.107348_b70 – volume: 128 start-page: 164 year: 2017 ident: 10.1016/j.infsof.2023.107348_b21 article-title: Source code metrics: A systematic mapping study publication-title: J. Syst. Softw. doi: 10.1016/j.jss.2017.03.044 – volume: 9 start-page: 44647 year: 2021 ident: 10.1016/j.infsof.2023.107348_b56 article-title: Software product quality metrics: A systematic mapping study publication-title: IEEE Access doi: 10.1109/ACCESS.2021.3054730 – volume: 26 start-page: 1221 issue: 08 year: 2016 ident: 10.1016/j.infsof.2023.107348_b19 article-title: Software maintainability: Systematic literature review and current trends publication-title: Int. J. Softw. Eng. Knowl. Eng. doi: 10.1142/S0218194016500431 – start-page: 702 year: 2012 ident: 10.1016/j.infsof.2023.107348_b11 article-title: Prediction of software maintainability using fuzzy logic – volume: 55 start-page: 1397 issue: 8 year: 2013 ident: 10.1016/j.infsof.2023.107348_b99 article-title: Software fault prediction metrics: A systematic literature review publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2013.02.009 – start-page: 1 year: 2007 ident: 10.1016/j.infsof.2023.107348_b76 article-title: A critique of how we measure and interpret the accuracy of software development effort estimation – volume: 13 start-page: 141 issue: 1 year: 2019 ident: 10.1016/j.infsof.2023.107348_b93 article-title: Empirical studies on software product maintainability prediction: A systematic mapping and review publication-title: e-Inform. Softw. Eng. J. – volume: 56 start-page: 97 year: 2002 ident: 10.1016/j.infsof.2023.107348_b14 article-title: Empirical studies of quality models in object-oriented systems publication-title: Adv. Comput doi: 10.1016/S0065-2458(02)80005-5 – volume: 66 year: 2019 ident: 10.1016/j.infsof.2023.107348_b36 article-title: Trends in software reuse research: A tertiary study publication-title: Comput. Stand. Interfaces doi: 10.1016/j.csi.2019.04.011 – year: 1994 ident: 10.1016/j.infsof.2023.107348_b69 – year: 2011 ident: 10.1016/j.infsof.2023.107348_b6 – year: 2012 ident: 10.1016/j.infsof.2023.107348_b28 – volume: 102 start-page: 146 year: 2018 ident: 10.1016/j.infsof.2023.107348_b58 article-title: Mapping the field of software life cycle security metrics publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2018.05.011 – start-page: 84 year: 2013 ident: 10.1016/j.infsof.2023.107348_b17 article-title: Towards a catalog of object-oriented software maintainability metrics – volume: 28 start-page: 4 issue: 1 year: 2002 ident: 10.1016/j.infsof.2023.107348_b71 article-title: A hierarchical model for object-oriented design quality assessment publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/32.979986 – year: 2006 ident: 10.1016/j.infsof.2023.107348_b2 – volume: 99 start-page: 133 year: 2018 ident: 10.1016/j.infsof.2023.107348_b32 article-title: Reliability of search in systematic reviews: Towards a quality assessment framework for the automated-search strategy publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2018.02.002 – ident: 10.1016/j.infsof.2023.107348_b98 – volume: 30 start-page: 521 issue: 8 year: 2004 ident: 10.1016/j.infsof.2023.107348_b88 article-title: Evaluating the effect of a delegated versus centralized control style on the maintainability of object-oriented software publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2004.43 – volume: 5 start-page: 50 issue: 1 year: 1990 ident: 10.1016/j.infsof.2023.107348_b89 article-title: An evaluation of some design metrics publication-title: Softw. Eng. J. doi: 10.1049/sej.1990.0007 – start-page: 326 year: 2012 ident: 10.1016/j.infsof.2023.107348_b62 article-title: A systematic mapping study on dynamic metrics and software quality – start-page: 209 year: 2007 ident: 10.1016/j.infsof.2023.107348_b64 article-title: Using in-process testing metrics to estimate post-release field quality – volume: 31 start-page: 380 issue: 5 year: 2005 ident: 10.1016/j.infsof.2023.107348_b78 article-title: Reliability and validity in comparative studies of software prediction models publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2005.58 – year: 2001 ident: 10.1016/j.infsof.2023.107348_b22 – year: 2011 ident: 10.1016/j.infsof.2023.107348_b29 – ident: 10.1016/j.infsof.2023.107348_b39 doi: 10.1145/2652524.2652557 – volume: 20 start-page: 640 issue: 3 year: 2015 ident: 10.1016/j.infsof.2023.107348_b52 article-title: Empirical evidence on the link between object-oriented measures and external quality attributes: A systematic literature review publication-title: Empir. Softw. Eng. doi: 10.1007/s10664-013-9291-7 – start-page: 498 year: 2009 ident: 10.1016/j.infsof.2023.107348_b24 article-title: The qualoss open source assessment model measuring the performance of open source communities – volume: 13 start-page: 12 issue: 1 year: 1996 ident: 10.1016/j.infsof.2023.107348_b1 article-title: Software quality: the elusive target [special issues section] publication-title: IEEE Softw. doi: 10.1109/52.476281 – volume: 65 start-page: 14 year: 2015 ident: 10.1016/j.infsof.2023.107348_b97 article-title: How have we evaluated software pattern application? A systematic mapping study of research design practices publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2015.04.002 – year: 1987 ident: 10.1016/j.infsof.2023.107348_b23 – volume: 39 start-page: 425 issue: 6 year: 1997 ident: 10.1016/j.infsof.2023.107348_b50 article-title: A comparison of techniques for developing predictive models of software metrics publication-title: Inf. Softw. Technol. doi: 10.1016/S0950-5849(96)00006-7 – year: 1977 ident: 10.1016/j.infsof.2023.107348_b3 – volume: 22 start-page: 41 issue: 8 year: 2011 ident: 10.1016/j.infsof.2023.107348_b59 article-title: Empirical studies to predict fault proneness: A review publication-title: Int. J. Comput. Appl. – volume: 148 start-page: 81 issue: 3 year: 2001 ident: 10.1016/j.infsof.2023.107348_b77 article-title: What accuracy statistics really measure [software estimation] publication-title: IEE Proc.-Softw. doi: 10.1049/ip-sen:20010506 – volume: 106 start-page: 1 year: 2019 ident: 10.1016/j.infsof.2023.107348_b92 article-title: Metrics for analyzing variability and its implementation in software product lines: A systematic literature review publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2018.08.015 – ident: 10.1016/j.infsof.2023.107348_b42 doi: 10.14236/ewic/EASE2008.8 – volume: 49 start-page: 1273 issue: 3 year: 2022 ident: 10.1016/j.infsof.2023.107348_b48 article-title: SEGRESS: Software engineering guidelines for reporting secondary studies publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2022.3174092 – volume: 48 start-page: 4397 issue: 11 year: 2021 ident: 10.1016/j.infsof.2023.107348_b66 article-title: Building maintainable software using abstraction layering publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2021.3119012 – volume: 29 start-page: 985 issue: 11 year: 2003 ident: 10.1016/j.infsof.2023.107348_b80 article-title: A simulation study of the model evaluation criterion MMRE publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2003.1245300 – volume: 24 start-page: 16655 issue: 21 year: 2020 ident: 10.1016/j.infsof.2023.107348_b90 article-title: A systematic literature review on empirical studies towards prediction of software maintainability publication-title: Soft Comput. doi: 10.1007/s00500-020-05005-4 – volume: 64 start-page: 1 year: 2015 ident: 10.1016/j.infsof.2023.107348_b33 article-title: Guidelines for conducting systematic mapping studies in software engineering: An update publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2015.03.007 – volume: 112 start-page: 48 year: 2019 ident: 10.1016/j.infsof.2023.107348_b44 article-title: A critical appraisal tool for systematic literature reviews in software engineering publication-title: Inf. Softw. Technol. doi: 10.1016/j.infsof.2019.04.006 – volume: 14 start-page: 7 issue: 1 year: 2020 ident: 10.1016/j.infsof.2023.107348_b45 article-title: What support do systematic reviews provide for evidence-informed teaching about software engineering practice? publication-title: e-Inform. Softw. Eng. J. – start-page: 130 year: 2012 ident: 10.1016/j.infsof.2023.107348_b18 article-title: A systematic review of contemporary metrics for software maintainability – start-page: 125 year: 2010 ident: 10.1016/j.infsof.2023.107348_b86 article-title: Beyond lines of code: Do we need more complexity metrics – start-page: 252 year: 2019 ident: 10.1016/j.infsof.2023.107348_b16 article-title: Software models for source code maintainability: A systematic literature review – start-page: 159 year: 1977 ident: 10.1016/j.infsof.2023.107348_b40 article-title: The measurement of observer agreement for categorical data publication-title: Biometrics doi: 10.2307/2529310 – volume: 127 start-page: 52 year: 2017 ident: 10.1016/j.infsof.2023.107348_b8 article-title: A mapping study on design-time quality attributes and metrics publication-title: J. Syst. Softw. doi: 10.1016/j.jss.2017.01.026 – year: 2016 ident: 10.1016/j.infsof.2023.107348_b65 – year: 2010 ident: 10.1016/j.infsof.2023.107348_b35 – volume: 4 start-page: 113 issue: 2 year: 1999 ident: 10.1016/j.infsof.2023.107348_b41 article-title: Benchmarking Kappa: Interrater agreement in software process assessments publication-title: Empir. Softw. Eng. doi: 10.1023/A:1009820201126 – start-page: 367 year: 2009 ident: 10.1016/j.infsof.2023.107348_b15 article-title: A systematic review of software maintainability prediction and metrics – ident: 10.1016/j.infsof.2023.107348_b25 – volume: 13 start-page: 227 issue: 1 year: 2019 ident: 10.1016/j.infsof.2023.107348_b94 article-title: Software change prediction: A systematic review and future guidelines publication-title: e-Inform. Softw. Eng. J. – ident: 10.1016/j.infsof.2023.107348_b13 doi: 10.1145/1809223.1809227 – volume: 17 start-page: 23 year: 2012 ident: 10.1016/j.infsof.2023.107348_b79 article-title: Validity and reliability of evaluation procedures in comparative studies of effort prediction models publication-title: Empir. Softw. Eng. doi: 10.1007/s10664-011-9183-7 – volume: 26 start-page: 1221 issue: 8 year: 2016 ident: 10.1016/j.infsof.2023.107348_b95 article-title: Software maintainability: Systematic literature review and current trends publication-title: Int. J. Softw. Eng. Knowl. Eng. doi: 10.1142/S0218194016500431 – volume: 22 start-page: 68 issue: 1 year: 1996 ident: 10.1016/j.infsof.2023.107348_b72 article-title: Property-based software engineering measurement publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/32.481535 – volume: 10 start-page: 39696 issue: 18 year: 2015 ident: 10.1016/j.infsof.2023.107348_b53 article-title: A systematic literature review: Recent trends and open issues in software refactoring publication-title: Int. J. Appl. Eng. Res. – start-page: 277 year: 2009 ident: 10.1016/j.infsof.2023.107348_b20 article-title: Coupling metrics for aspect-oriented programming: A systematic review of maintainability studies publication-title: Eval. Nov. Approaches Softw. Eng. – year: 2019 ident: 10.1016/j.infsof.2023.107348_b9 – start-page: 230 year: 1997 ident: 10.1016/j.infsof.2023.107348_b73 article-title: An overview of object-oriented design metrics – start-page: 63 year: 2017 ident: 10.1016/j.infsof.2023.107348_b55 article-title: A systematic mapping study of quality assessment models for software products – volume: 6 issue: 1 year: 2018 ident: 10.1016/j.infsof.2023.107348_b27 article-title: Software quality models: A comprehensive review and analysis publication-title: J. Electr. Comput. Eng. Innov. – volume: 62 issue: 9 year: 2019 ident: 10.1016/j.infsof.2023.107348_b54 article-title: Software quality assessment model: a systematic mapping study publication-title: Sci. China Inf. Sci. doi: 10.1007/s11432-018-9608-3 – volume: 36 start-page: 7346 issue: 4 year: 2009 ident: 10.1016/j.infsof.2023.107348_b60 article-title: A systematic review of software fault prediction studies publication-title: Expert Syst. Appl. doi: 10.1016/j.eswa.2008.10.027 – ident: 10.1016/j.infsof.2023.107348_b81 doi: 10.1145/3172871.3172878 – volume: 10 start-page: 81 issue: 1 year: 1981 ident: 10.1016/j.infsof.2023.107348_b85 article-title: On the relationships among three software metrics publication-title: ACM SIGMETRICS Perform. Eval. Rev. doi: 10.1145/1010627.807911 – volume: 16 start-page: 1558 issue: 11 year: 2020 ident: 10.1016/j.infsof.2023.107348_b91 article-title: Machine learning techniques for software bug prediction: A systematic review publication-title: J. Comput. Sci. doi: 10.3844/jcssp.2020.1558.1569 – volume: 2012 start-page: 253 issue: 1 year: 2012 ident: 10.1016/j.infsof.2023.107348_b83 article-title: Aspect-oriented software maintenance metrics: A systematic mapping study publication-title: IET Semin. Digest – volume: vol. 7336 LNCS start-page: 258 issue: no. PART 4 year: 2012 ident: 10.1016/j.infsof.2023.107348_b57 – year: 2015 ident: 10.1016/j.infsof.2023.107348_b31 – start-page: 337 year: 1992 ident: 10.1016/j.infsof.2023.107348_b61 article-title: Metrics for assessing a software system’s maintainability – start-page: 85 year: 2005 ident: 10.1016/j.infsof.2023.107348_b63 article-title: Providing test quality feedback using static source code and automatic test suite metrics – volume: 45 start-page: 111 issue: 2 year: 2019 ident: 10.1016/j.infsof.2023.107348_b82 article-title: A systematic literature review and meta-analysis on cross project defect prediction publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/TSE.2017.2770124 – year: 1986 ident: 10.1016/j.infsof.2023.107348_b51 – ident: 10.1016/j.infsof.2023.107348_b4 – start-page: 531 year: 2009 ident: 10.1016/j.infsof.2023.107348_b26 article-title: The squale model - A practice-based industrial quality model – start-page: 108 year: 1999 ident: 10.1016/j.infsof.2023.107348_b75 article-title: Measuring OO systems: a critical analysis of the MOOD metrics – volume: 21 start-page: 146 issue: 2 year: 1995 ident: 10.1016/j.infsof.2023.107348_b5 article-title: A model for software product quality publication-title: IEEE Trans. Softw. Eng. doi: 10.1109/32.345830 |
| SSID | ssj0017030 |
| Score | 2.4440222 |
| SecondaryResourceType | review_article |
| Snippet | Several secondary studies have investigated the relationship between internal quality attributes, source code metrics and external quality attributes.... Context: Several secondary studies have investigated the relationship between internal quality attributes, source code metrics and external quality attributes.... |
| SourceID | swepub crossref elsevier |
| SourceType | Open Access Repository Enrichment Source Index Database Publisher |
| StartPage | 107348 |
| SubjectTerms | Code quality Codes (symbols) Computer programming languages Data handling Evidence External quality Forecasting Internal quality Maintainability Object oriented programming Product quality Products quality Quality attributes Quality modeling Quality models Reliability Source code metrics Tertiary review Tertiary study |
| Title | A tertiary study on links between source code metrics and external quality attributes |
| URI | https://dx.doi.org/10.1016/j.infsof.2023.107348 https://urn.kb.se/resolve?urn=urn:nbn:se:bth-25555 |
| Volume | 165 |
| WOSCitedRecordID | wos001102357100001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 customDbUrl: eissn: 1873-6025 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0017030 issn: 0950-5849 databaseCode: AIEXJ dateStart: 19950101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1Lb9NAEF6FFKFeUHmJFor2ACfLKI7t2D66pYhWEHFoqpxY7cvEaeNUjvvg3zPj3XVbBdRy4GJZq107mfl2Pe8h5H2gwkBwkfkpj7UfFRHsOdBDQGsVowF876RuTdknX5PxOJ1Os--93g-XC3N5llRVen2dnf9XVsMYMBtTZ_-B3d1DYQDugelwBbbD9UGMzz1085cYDbcyFaMrr3XTdjFZxmDvYTY7dpCuXaFmVxHaZlr-8nhj-mHZOMO5i3rvMh49Y3YvmisMIGvWzPSHRVOezkwM92TBu0Dg3CRlj3nrQhBlh9A9dNzvjWp0PrerjtqBfUwRdXMmK2u1_XYx44sFV7ctFyZVujM-DnwQfbI757BpGrF2phvzwhwVEfhDH7HfOwxiVZ6bb9idatmfypOcLeufTDQzBipTHD8iG8MkztI-2cgPD6ZHnZ8JzztTjdH8HlTP0yT0RyAKukTLNhpw_eV_FWRuV5xtpZTjLfLUqhc0N7B4Rnq6ek6euOyGF2SSU4cO2qKDLivaooNadFCDDorooBYdFNhMHQWoRQe9QcdLMvl8cLz_xbedNXwJAmrjB1pHYagCKUWsOGxWOIsFHP6pBHEzwDJskRxGKuaC6yQL9EBFUoWCSz0E9T5T4SvSr5aVfk1oAOtBaBwUsM2jJFJC8EJKrRIdgqQcp9skdGRi0padx-4nZ8zFF86ZIS5D4jJD3G3id6vOTdmVe-YnjgPMio5GJGSAontWfjAM697zZwjtPHDeG7KJWDdWurek39QXepc8lpdNuarfWfz9BiS-oR4 |
| linkProvider | Elsevier |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+tertiary+study+on+links+between+source+code+metrics+and+external+quality+attributes&rft.jtitle=Information+and+software+technology&rft.au=Iftikhar%2C+Umar&rft.au=Ali%2C+Nauman+bin&rft.au=B%C3%B6rstler%2C+J%C3%BCrgen&rft.au=Usman%2C+Muhammad&rft.date=2024&rft.issn=0950-5849&rft.volume=165&rft_id=info:doi/10.1016%2Fj.infsof.2023.107348&rft.externalDocID=oai_DiVA_org_bth_25555 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0950-5849&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0950-5849&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0950-5849&client=summon |