Comparing the Effectiveness of Software Testing Strategies

This study applies an experimentation methodology to compare three state-of-the-practice software testing techniques: a) code reading by stepwise abstraction, b) functional testing using equivalence partitioning and boundary value analysis, and c) structural testing using 100 percent statement cover...

Celý popis

Uložené v:

Podrobná bibliografia
Vydané v:	IEEE transactions on software engineering Ročník SE-13; číslo 12; s. 1278 - 1296
Hlavní autori:	Basili, V.R., Selby, R.W.
Médium:	Journal Article
Jazyk:	English
Vydavateľské údaje:	Legacy CDMS IEEE 01.12.1987 Institute of Electrical and Electronics Engineers IEEE Computer Society
Predmet:	Applied sciences Code reading Comparative analysis Computer programming Computer Programming And Software Computer science Computer science; control theory; systems Computer systems performance. Reliability Costs Design for experiments Effectiveness empirical study Exact sciences and technology Fault detection functional testing Measurement methodology evaluation Methods Military computing NASA off-line software review Programmers Programming profession Reading Scholarships & fellowships Software Software development Software measurement Software reviews Software testing Statistical analysis structural testing Techniques Testing Uncertainty Value analysis Evaluation Methodology Functional test Empirical method Test method Critical study Software Test efficiency Comparative study Defect detection
ISSN:	0098-5589, 1939-3520
On-line prístup:	Získať plný text
Tagy:	Pridať tag Žiadne tagy, Buďte prvý, kto otaguje tento záznam!

Abstract	This study applies an experimentation methodology to compare three state-of-the-practice software testing techniques: a) code reading by stepwise abstraction, b) functional testing using equivalence partitioning and boundary value analysis, and c) structural testing using 100 percent statement coverage criteria. The study compares the strategies in three aspects of software testing: fault detection effectiveness, fault detection cost, and classes of faults detected. Thirty-two professional programmers and 42 advanced students applied the three techniques to four unit-sized programs in a fractional factorial experimental design. The major results of this study are the following. 1) With the professional programmers, code reading detected more software faults and had a higher fault detection rate than did functional or structural testing, while functional testing detected more faults than did structural testing, but functional and structural testing were not different in fault detection rate. 2) In one advanced student subject group, code reading and functional testing were not different in faults found, but were both superior to structural testing, while in the other advanced student subject group there was no difference among the techniques. 3) With the advanced student subjects, the three techniques were not different in fault detection rate. 4) Number of faults observed, fault detection rate, and total effort in detection depended on the type of software tested. 5) Code reading detected more interface faults than did the other methods. 6) Functional testing detected more control faults than did the other methods.
AbstractList	This study compares the results of code reading, functional testing, and structural testing in three aspects of software testing: fault detection effectiveness, fault detection cost, and classes of faults detected. Thirty two professional programmers and 42 advanced students applied the three techniques to four unit-sized programs in a fractional experimental design. The major results of this study are the following: (1) With the professional programmers, code reading detected more software faults and had a higher detection rate than did functional or structural testing, while functional testing detected more faults than did structural testing, but functional and structural testing were not different in fault detection rate. (2) In one advanced student subject group, code reading and functional testing were not different in faults found, but were superior to structural testing, while in the other advanced student subject group there was no difference among the techniques. (3) With the advanced student subjects, the three techniques were not different in fault deteciton rate. (4) Number of faults observed, fault detection rate, and total effort in detection depended on the type of software tested. (5) Code reading detected more interface faults than did the other methods. (6) Functional testing detected more control faults than did the other methods. (7) When asked to estimate the percentage of faults detected, code readers gave the most accurate estimates while functional testers gave the least accurate estimates. Appendix B includes the source code for the word. This study compares the results of code reading, functional testing, and structural testing in three aspects of software testing: fault detection effectiveness, fault detection cost, and classes of faults detected. Thirty two professional programmers and 42 advanced students applied the three techniques to four unit-sized programs in a fractional experimental design. The major results of this study are the following: (1) With the professional programmers, code reading detected more software faults and had a higher detection rate than did functional or structural testing, while functional testing detected more faults than did structural testing, but functional and structural testing were not different in fault detection rate. (2) In one advanced student subject group, code reading and functional testing were not different in faults found, but were superior to structural testing, while in the other advanced student subject group there was no difference among the techniques. (3) With the advanced student subjects, the three techniques were not different in fault deteciton rate. (4) Number of faults observed, fault detection rate, and total effort in detection depended on the type of software tested. (5) Code reading detected more interface faults than did the other methods. (6) Functional testing detected more control faults than did the other methods. (7) When asked to estimate the percentage of faults detected, code readers gave the most accurate estimates while functional testers gave the least accurate estimates. Appendix B includes the source code for the word. (Author) An experimentation methodology is applied to compare 3 state-of-the-practice software testing techniques: 1. code reading by stepwise abstraction, 2. functional testing using equivalence partitioning and boundary value analysis, and 3. structural testing using 100% statement coverage criteria. The strategies are compared in terms of fault detection effectiveness, fault detection cost, and classes of faults detected. Thirty-two professional programmers and 42 advanced students applied the techniques to 4 unit-sized programs in a fractional experimental design. Among the major results are: 1. With the professional programmers, code reading detected more software faults and had a higher fault detection rate than did functional or structural testing. 2. In one student subject group, code reading and functional testing were not different in faults found but were superior to structural testing. 3. With the student subjects, the 3 techniques were not different in fault detection rate. 4. Functional testing discovered more control faults than did the other methods. This study applies an experimentation methodology to compare three state-of-the-practice software testing techniques: a) code reading by stepwise abstraction, b) functional testing using equivalence partitioning and boundary value analysis, and c) structural testing using 100 percent statement coverage criteria. The study compares the strategies in three aspects of software testing: fault detection effectiveness, fault detection cost, and classes of faults detected. Thirty-two professional programmers and 42 advanced students applied the three techniques to four unit-sized programs in a fractional factorial experimental design. The major results of this study are the following. 1) With the professional programmers, code reading detected more software faults and had a higher fault detection rate than did functional or structural testing, while functional testing detected more faults than did structural testing, but functional and structural testing were not different in fault detection rate. 2) In one advanced student subject group, code reading and functional testing were not different in faults found, but were both superior to structural testing, while in the other advanced student subject group there was no difference among the techniques. 3) With the advanced student subjects, the three techniques were not different in fault detection rate. 4) Number of faults observed, fault detection rate, and total effort in detection depended on the type of software tested. 5) Code reading detected more interface faults than did the other methods. 6) Functional testing detected more control faults than did the other methods. This study applies an experimentation methodology to compare three state-of-the-practice software testing techniques: a) code reading by stepwise abstraction, b) functional testing using equivalence partitioning and boundary value analysis, and c) structural testing using 100 percent statement coverage criteria. The study compares the strategies in three aspects of software testing: fault detection effectiveness, fault detection cost, and classes of faults detected.
Audience	PUBLIC
Author	Selby, R.W. Basili, V.R.
Author_xml	– sequence: 1 givenname: V.R. surname: Basili fullname: Basili, V.R. organization: Department of Computer Science, University of Maryland – sequence: 2 givenname: R.W. surname: Selby fullname: Selby, R.W.
BackLink	http://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=7730101$$DView record in Pascal Francis
BookMark	eNqNkcFPHCEUxkljk67Ws4f2MDGmt1l5MAzgzWzW1sTEw-6dsAgWMwsrsJr-92UyxiYeqgfyDvy-974v3yE6CDFYhE4AzwGwPF-vlnOQgs8JJULAJzQDSWVLGcEHaIaxFC1jQn5Bhzk_YIwZ52yGLhZxu9PJh_um_LbN0jlrin-ywebcRNesoivPOtlmbXMZqVVJuth7b_NX9NnpIdvjl3mE1lfL9eJXe3P783pxedOajsjSCt7ju444UV9POjBsA8AdbEhPN9psGLbSAONEUuqcoZKIvgPJ3J3uCaH0CP2Y1u5SfNxXF2rrs7HDoION-6woG-NX9Xsg6ajsMKUfBKGr4Okb8CHuU6hhVTXIBOMwnj17gXQ2enBJB-Oz2iW_1emP4pxiwFCx8wkzKeacrHslAKsxgaoFqrFANRVYFeyNwviii4-hVuCH_-i-T7qgs1YVHt0KgWv0no3pv03f3lr7zwTHBLikfwExga8h
CODEN	IESEDJ
CitedBy_id	crossref_primary_10_1002_smr_265 crossref_primary_10_1016_S0164_1212_99_00107_7 crossref_primary_10_1016_0164_1212_92_90122_Z crossref_primary_10_1109_MC_2008_85 crossref_primary_10_1007_s10664_006_9021_5 crossref_primary_10_1109_TSE_2015_2510633 crossref_primary_10_1007_s10664_007_9044_6 crossref_primary_10_1145_267580_267590 crossref_primary_10_1049_iet_sen_20070094 crossref_primary_10_1109_32_888629 crossref_primary_10_1109_TSE_2025_3541922 crossref_primary_10_1016_S0164_1212_01_00109_1 crossref_primary_10_1145_64137_65018 crossref_primary_10_1016_j_infsof_2013_02_015 crossref_primary_10_1109_24_855537 crossref_primary_10_1145_62959_62962 crossref_primary_10_1016_S0164_1212_96_00175_6 crossref_primary_10_1007_s10664_006_5964_9 crossref_primary_10_1007_s10009_010_0182_6 crossref_primary_10_1109_TSE_2008_26 crossref_primary_10_1007_s10009_008_0086_x crossref_primary_10_1016_j_jss_2014_06_039 crossref_primary_10_1016_S0164_1212_00_00024_8 crossref_primary_10_1109_MS_2006_166 crossref_primary_10_1007_s11390_019_1906_z crossref_primary_10_1007_s10664_013_9262_z crossref_primary_10_1023_B_EMSE_0000013513_48963_1b crossref_primary_10_1109_32_238581 crossref_primary_10_1023_A_1018979130614 crossref_primary_10_1007_s10664_022_10232_4 crossref_primary_10_1002_stvr_319 crossref_primary_10_1016_S0950_5849_97_00028_1 crossref_primary_10_1007_s10664_010_9141_9 crossref_primary_10_1145_1449603_1449609 crossref_primary_10_1109_52_28123 crossref_primary_10_1109_TSE_2017_2777831 crossref_primary_10_1002_stvr_1479 crossref_primary_10_1016_S0164_1212_96_00152_5 crossref_primary_10_1145_2211616_2211620 crossref_primary_10_1109_TSE_2011_46 crossref_primary_10_1145_267896_267915 crossref_primary_10_1007_s10664_006_9024_2 crossref_primary_10_1002_stvr_439 crossref_primary_10_1007_s10009_007_0059_5 crossref_primary_10_1016_0950_5849_94_00456_3 crossref_primary_10_1007_s10664_020_09805_y crossref_primary_10_1007_s11219_015_9273_7 crossref_primary_10_1002_stvr_4370010203 crossref_primary_10_1109_32_799939 crossref_primary_10_1109_TSE_2015_2467378 crossref_primary_10_1016_j_infsof_2011_01_005 crossref_primary_10_1007_s10664_021_10010_8 crossref_primary_10_1002_j_2334_5837_2012_tb01345_x crossref_primary_10_1145_1022494_1022544 crossref_primary_10_1016_0950_5849_94_90056_6 crossref_primary_10_1109_52_50773 crossref_primary_10_1016_0951_8320_91_90053_A crossref_primary_10_1109_32_491648 crossref_primary_10_1109_MS_2006_89 crossref_primary_10_1007_s10664_013_9266_8 crossref_primary_10_1016_S0950_5849_97_00029_3 crossref_primary_10_1002_smr_2640 crossref_primary_10_1007_s10664_017_9523_3 crossref_primary_10_1007_s11219_023_09655_z crossref_primary_10_1016_S0164_1212_99_00073_4 crossref_primary_10_1007_s13173_011_0043_5 crossref_primary_10_1007_s13198_019_00899_2 crossref_primary_10_1109_MS_2009_2 crossref_primary_10_1109_TSE_2011_102 crossref_primary_10_1145_1297797_1297819 crossref_primary_10_1002_stvr_415 crossref_primary_10_1145_64140_65018 crossref_primary_10_1145_181610_181625 crossref_primary_10_1023_A_1018535229843 crossref_primary_10_1016_j_infsof_2011_06_003 crossref_primary_10_1002_j_2334_5837_2006_tb02834_x crossref_primary_10_1016_j_infsof_2008_01_007 crossref_primary_10_1145_2723872_2723875 crossref_primary_10_1016_0026_2714_92_90090_8 crossref_primary_10_1109_32_245736 crossref_primary_10_1002_stvr_243 crossref_primary_10_1016_j_jss_2013_09_043 crossref_primary_10_1109_TSE_2011_78 crossref_primary_10_1002_smr_456 crossref_primary_10_1007_s11219_019_09446_5 crossref_primary_10_1007_s10664_022_10160_3 crossref_primary_10_1109_32_825766 crossref_primary_10_1109_32_87281 crossref_primary_10_1109_TR_2018_2802047 crossref_primary_10_1016_j_jss_2022_111261 crossref_primary_10_1109_52_300090 crossref_primary_10_1007_s10664_013_9267_7 crossref_primary_10_1016_j_infsof_2012_12_004 crossref_primary_10_1016_S0950_5849_97_00030_X crossref_primary_10_1007_s11432_016_9039_4 crossref_primary_10_1109_TSE_2008_71 crossref_primary_10_1002_stvr_4370020303 crossref_primary_10_1007_s11219_017_9388_0 crossref_primary_10_1016_j_jengtecman_2004_11_006 crossref_primary_10_1109_TSE_2002_1000450 crossref_primary_10_1023_A_1009747104814 crossref_primary_10_1007_s11219_008_9067_2 crossref_primary_10_1016_j_infsof_2017_12_016 crossref_primary_10_1016_S0164_1212_97_00065_4 crossref_primary_10_1109_TSE_2012_55 crossref_primary_10_1002_smr_1883 crossref_primary_10_1016_j_jss_2024_112060 crossref_primary_10_1109_TG_2020_3032796 crossref_primary_10_1016_j_jss_2006_02_049 crossref_primary_10_1145_301687_289568 crossref_primary_10_1109_32_6156 crossref_primary_10_1016_j_infsof_2022_107054 crossref_primary_10_1145_140738_140763 crossref_primary_10_1007_BF00127447 crossref_primary_10_1016_j_infsof_2012_07_016 crossref_primary_10_1109_5_24144 crossref_primary_10_25046_aj020102 crossref_primary_10_1016_0026_2714_91_90312_U crossref_primary_10_1109_32_67598 crossref_primary_10_1023_A_1011489321999 crossref_primary_10_1145_125489_122826
Cites_doi	10.1016/S0020-7373(75)80005-8 10.1177/001872087401600308 10.1109/TSE.1980.230473 10.1145/69605.2085 10.1145/359588.359602 10.1109/TSE.1987.233525 10.1109/TSE.1975.6312836 10.1109/TSE.1985.232190 10.1109/C-M.1978.218138 10.1145/800027.808459 10.1147/sj.153.0182 10.1109/MS.1985.229776 10.1145/359178.359185 10.1016/0164-1212(84)90028-1 10.21236/ADA097231 10.1007/BF00260923 10.1145/357103.357107 10.1055/s-2005-871775 10.1007/BF01946816 10.1109/TSE.1984.5010301 10.1109/TSE.1977.231144 10.1109/TSE.1980.234487 10.1109/MC.1984.1659162 10.1109/TSE.1980.230467 10.1109/TSE.1986.6312975 10.1145/1036508.1036511 10.1002/spe.4380080402
ContentType	Journal Article
Copyright	1988 INIST-CNRS Copyright Institute of Electrical and Electronics Engineers, Inc. (IEEE) Dec 1987
Copyright_xml	– notice: 1988 INIST-CNRS – notice: Copyright Institute of Electrical and Electronics Engineers, Inc. (IEEE) Dec 1987
DBID	CYE CYI AAYXX CITATION IQODW 3V. 7WY 7WZ 7X7 7XB 87Z 88E 88F 88I 88K 8AL 8FE 8FG 8FI 8FJ 8FK 8FL 8G5 ABJCF ABUWG AFKRA ARAPS AZQEC BENPR BEZIV BGLVJ CCPQU DWQXO FRNLG FYUFA F~G GHDGH GNUQQ GUQSH HCIFZ JQ2 K60 K6~ K7- K9. L.- L6V M0C M0N M0S M1P M1Q M2O M2P M2T M7S MBDVC P5Z P62 PHGZM PHGZT PJZUB PKEHL PPXIY PQBIZ PQBZA PQEST PQGLB PQQKQ PQUKI PRINS PTHSS Q9U 8FD H8D L7M 7SC L~C L~D 7SP F28 FR3
DOI	10.1109/TSE.1987.232881
DatabaseName	NASA Scientific and Technical Information NASA Technical Reports Server CrossRef Pascal-Francis ProQuest Central (Corporate) ABI/INFORM Collection ABI/INFORM Global (PDF only) Health & Medical Collection ProQuest Central (purchase pre-March 2016) ABI/INFORM Collection Medical Database (Alumni Edition) Military Database (Alumni Edition) Science Database (Alumni Edition) Telecommunications (Alumni Edition) Computing Database (Alumni Edition) ProQuest SciTech Collection ProQuest Technology Collection Hospital Premium Collection Hospital Premium Collection (Alumni Edition) ProQuest Central (Alumni) (purchase pre-March 2016) ABI/INFORM Collection (Alumni) ProQuest Research Library Materials Science & Engineering Collection ProQuest Central (Alumni) ProQuest Central UK/Ireland Advanced Technologies & Computer Science Collection ProQuest Central Essentials - QC ProQuest Central Business Premium Collection Technology collection ProQuest One Community College ProQuest Central Korea Business Premium Collection (Alumni) Health Research Premium Collection ABI/INFORM Global (Corporate) Health Research Premium Collection (Alumni) ProQuest Central Student ProQuest Research Library SciTech Premium Collection ProQuest Computer Science Collection ProQuest Business Collection (Alumni Edition) ProQuest Business Collection Computer Science Database ProQuest Health & Medical Complete (Alumni) ABI/INFORM Professional Advanced ProQuest Engineering Collection ABI/INFORM Global Computing Database ProQuest Health & Medical Collection Medical Database Military Database Research Library Science Database Telecommunications Database Engineering Database Research Library (Corporate) Advanced Technologies & Aerospace Database ProQuest Advanced Technologies & Aerospace Collection ProQuest Central Premium ProQuest One Academic (New) ProQuest Health & Medical Research Collection ProQuest One Academic Middle East (New) ProQuest One Health & Nursing ProQuest One Business (UW System Shared) ProQuest One Business (Alumni) ProQuest One Academic Eastern Edition (DO NOT USE) One Applied & Life Sciences ProQuest One Academic (retired) ProQuest One Academic UKI Edition ProQuest Central China Engineering Collection ProQuest Central Basic Technology Research Database Aerospace Database Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional Electronics & Communications Abstracts ANTE: Abstracts in New Technology & Engineering Engineering Research Database
DatabaseTitle	CrossRef ProQuest Business Collection (Alumni Edition) Research Library Prep Computer Science Database ProQuest Central Student ProQuest Advanced Technologies & Aerospace Collection ProQuest Central Essentials ProQuest Computer Science Collection SciTech Premium Collection ProQuest Military Collection ProQuest Central China ABI/INFORM Complete ProQuest Telecommunications ProQuest One Applied & Life Sciences Health Research Premium Collection Health & Medical Research Collection ProQuest Central (New) ProQuest Medical Library (Alumni) Engineering Collection Advanced Technologies & Aerospace Collection Business Premium Collection ABI/INFORM Global Engineering Database ProQuest Science Journals (Alumni Edition) ProQuest One Academic Eastern Edition ProQuest Hospital Collection ProQuest Technology Collection Health Research Premium Collection (Alumni) ProQuest Telecommunications (Alumni Edition) ProQuest Business Collection ProQuest Hospital Collection (Alumni) ProQuest Health & Medical Complete ProQuest One Academic UKI Edition ProQuest One Academic ProQuest One Academic (New) ABI/INFORM Global (Corporate) ProQuest One Business Technology Collection ProQuest One Academic Middle East (New) ProQuest Health & Medical Complete (Alumni) ProQuest Central (Alumni Edition) ProQuest One Community College ProQuest One Health & Nursing Research Library (Alumni Edition) ProQuest Central ABI/INFORM Professional Advanced ProQuest Health & Medical Research Collection ProQuest Engineering Collection Health and Medicine Complete (Alumni Edition) ProQuest Central Korea ProQuest Research Library ABI/INFORM Complete (Alumni Edition) ProQuest Computing ABI/INFORM Global (Alumni Edition) ProQuest Central Basic ProQuest Science Journals ProQuest Computing (Alumni Edition) ProQuest Military Collection (Alumni Edition) ProQuest SciTech Collection Advanced Technologies & Aerospace Database ProQuest Medical Library Materials Science & Engineering Collection ProQuest One Business (Alumni) ProQuest Central (Alumni) Business Premium Collection (Alumni) Technology Research Database Aerospace Database Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Computer and Information Systems Abstracts – Academic Computer and Information Systems Abstracts Professional Electronics & Communications Abstracts Engineering Research Database ANTE: Abstracts in New Technology & Engineering
DatabaseTitleList	Technology Research Database Technology Research Database ProQuest Business Collection (Alumni Edition) Computer and Information Systems Abstracts
Database_xml	– sequence: 1 dbid: BENPR name: ProQuest Central url: https://www.proquest.com/central sourceTypes: Aggregation Database
DeliveryMethod	fulltext_linktorsrc
Discipline	Computer Science Applied Sciences
EISSN	1939-3520
EndPage	1296
ExternalDocumentID	1143564 7730101 10_1109_TSE_1987_232881 19880033653 1702179
Genre	tech-survey
GrantInformation	F49620-80-C-0001 NSG-5123
GroupedDBID	--Z -DZ -~X .4S .DC 0R~ 29I 3EH 4.4 5GY 5VS 6IK 7WY 7X7 85S 88E 88I 8FE 8FG 8FI 8FJ 8FL 8G5 8R4 8R5 97E 9M8 AAJGR AARMG AASAJ AAWTH ABAZT ABFSI ABJCF ABPPZ ABQJQ ABUWG ABVLG ACGFO ACGOD ACIWK ACNCT ADBBV AENEX AETIX AFKRA AGQYO AGSQL AHBIQ AI. AIBXA AKJIK AKQYR ALLEH ALMA_UNASSIGNED_HOLDINGS ARAPS ARCSS ASUFR ATWAV AZQEC BEFXN BENPR BEZIV BFFAM BGLVJ BGNUA BKEBE BKOMP BPEOZ BPHCQ BVXVI CCPQU CS3 DU5 DWQXO E.L EBS EDO EJD FRNLG FYUFA GNUQQ GROUPED_ABI_INFORM_RESEARCH GUQSH HCIFZ HMCUK HZ~ H~9 I-F IBMZZ ICLAB IEDLZ IFIPE IFJZH IPLJI ITG ITH JAVBF K60 K6V K6~ K7- L6V LAI M0C M1P M1Q M2O M2P M43 M7S MS~ O9- OCL OHT P2P P62 PHGZM PHGZT PJZUB PPXIY PQBIZ PQBZA PQGLB PQQKQ PROAC PSQYO PTHSS PUEGO Q2X RIA RIE RNI RNS RXW RZB S10 TAE TN5 TWZ UHB UKHRP UPT UQL VH1 WH7 XOL YYP YZZ ZCG AFFHD CYE CYI AAYXX CITATION ALIPV IQODW RIG 3V. 7XB 88K 8AL 8FK JQ2 K9. L.- M0N M2T MBDVC PKEHL PQEST PQUKI PRINS Q9U 8FD H8D L7M 7SC L~C L~D 7SP F28 FR3
ID	FETCH-LOGICAL-c429t-8760d42f842f6241c5b117f1b263bacb50e9c1572933ffc392864195fda62233
IEDL.DBID	RIE
ISICitedReferencesCount	187
ISICitedReferencesURI	http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=10_1109_TSE_1987_232881&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN	0098-5589
IngestDate	Sun Nov 09 09:23:26 EST 2025 Sat Sep 27 22:08:54 EDT 2025 Sun Sep 28 10:34:03 EDT 2025 Mon Oct 06 16:56:04 EDT 2025 Mon Jul 21 09:12:44 EDT 2025 Tue Nov 18 22:04:50 EST 2025 Sat Nov 29 03:10:16 EST 2025 Fri Nov 21 15:36:54 EST 2025 Wed Aug 27 02:47:44 EDT 2025
IsPeerReviewed	true
IsScholarly	true
Issue	12
Keywords	Evaluation Methodology Functional test Empirical method Test method Critical study Software Test efficiency Comparative study Defect detection
Language	English
License	https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html CC BY 4.0
LinkModel	DirectLink
MergedId	FETCHMERGED-LOGICAL-c429t-8760d42f842f6241c5b117f1b263bacb50e9c1572933ffc392864195fda62233
Notes	CDMS Legacy CDMS ISSN: 0098-5589 ObjectType-Article-1 SourceType-Scholarly Journals-1 content type line 14 ObjectType-Article-2 ObjectType-Feature-1 content type line 23
PQID	195585719
PQPubID	23500
PageCount	19
ParticipantIDs	crossref_primary_10_1109_TSE_1987_232881 nasa_ntrs_19880033653 proquest_miscellaneous_24394014 ieee_primary_1702179 pascalfrancis_primary_7730101 crossref_citationtrail_10_1109_TSE_1987_232881 proquest_miscellaneous_24394033 proquest_journals_195585719 proquest_miscellaneous_35110929
PublicationCentury	1900
PublicationDate	1987-12-01
PublicationDateYYYYMMDD	1987-12-01
PublicationDate_xml	– month: 12 year: 1987 text: 1987-12-01 day: 01
PublicationDecade	1980
PublicationPlace	Legacy CDMS
PublicationPlace_xml	– name: Legacy CDMS – name: New York, NY – name: New York
PublicationTitle	IEEE transactions on software engineering
PublicationTitleAbbrev	TSE
PublicationYear	1987
Publisher	IEEE Institute of Electrical and Electronics Engineers IEEE Computer Society
Publisher_xml	– name: IEEE – name: Institute of Electrical and Electronics Engineers – name: IEEE Computer Society
References	mcmullin (ref36) 1980 ref56 ref15 linger (ref35) 1979 ref14 hetzel (ref23) 1976 (ref33) 1974 ref55 ref54 ref10 frankl (ref16) 1986 ref19 selby (ref49) 1986 miller (ref38) 1981 (ref31) 1983 valdes (ref53) 1983 ref50 stucki (ref52) 1977 ref45 howden (ref29) 1981 budd (ref8) 1978; 47 basili (ref4) 1986; se 12 ref41 ref44 ref43 ref9 ref6 selby (ref48) 1985 myers (ref42) 1979 jelinski (ref32) 1973 cochran (ref12) 1950 basili (ref2) 1984 ref40 ref37 basili (ref3) 1985 hwang (ref30) 1981 ref1 deprie (ref13) 1985 box (ref7) 1978 selby (ref47) 1983 basili (ref5) 1976 johnson (ref34) 1983 ref24 ref26 ref25 ref20 ref22 gloss-soler (ref18) 1979 ref28 ref27 selby (ref51) 1984 mills (ref39) 0 gould (ref21) 1974; 16 church (ref11) 1984 scheffe (ref46) 1959 girgis (ref17) 1986
References_xml	– ident: ref20 doi: 10.1016/S0020-7373(75)80005-8 – year: 1983 ident: ref47 article-title: an empirical study comparing software testing techniques publication-title: Proc Sixth Minnowbrook Workshop Software Performance Evaluation – year: 1977 ident: ref52 publication-title: Current Trends in Programming Methodology – year: 1984 ident: ref11 publication-title: Benchmark statistics for the VAX 11/780 and the IBM 4341 – volume: 16 start-page: 258 year: 1974 ident: ref21 article-title: an exploratory study of computer program debugging publication-title: Human Factors doi: 10.1177/001872087401600308 – ident: ref55 doi: 10.1109/TSE.1980.230473 – ident: ref1 doi: 10.1145/69605.2085 – ident: ref41 doi: 10.1145/359588.359602 – start-page: 64 year: 1986 ident: ref17 article-title: an experimental comparison of the error exposing ability of program testing criteria publication-title: Proc Workshop Software Testing – ident: ref50 doi: 10.1109/TSE.1987.233525 – ident: ref19 doi: 10.1109/TSE.1975.6312836 – year: 1983 ident: ref53 article-title: an error-specific approach to testing publication-title: Proc 8th Annu Software Eng Workshop – ident: ref54 doi: 10.1109/TSE.1985.232190 – year: 1959 ident: ref46 publication-title: The Analysis of Variance – year: 1979 ident: ref42 publication-title: The Art of Software Testing – ident: ref45 doi: 10.1109/C-M.1978.218138 – year: 1981 ident: ref38 publication-title: Tutorial Software Testing & Validation Techniques – ident: ref40 doi: 10.1145/800027.808459 – ident: ref14 doi: 10.1147/sj.153.0182 – start-page: 4 year: 1986 ident: ref16 article-title: data flow testing in the presence of unexecutable paths publication-title: Proc Workshop Software Testing – ident: ref37 doi: 10.1109/MS.1985.229776 – year: 1979 ident: ref35 publication-title: Structured Programming Theory and Practice – ident: ref9 doi: 10.1145/359178.359185 – ident: ref44 doi: 10.1016/0164-1212(84)90028-1 – year: 1980 ident: ref36 publication-title: Evaluating a data abstraction testing system based on formal specifications doi: 10.21236/ADA097231 – ident: ref25 doi: 10.1007/BF00260923 – year: 1985 ident: ref3 publication-title: Comparing the effectiveness of software testing strategies – year: 1974 ident: ref33 publication-title: Pascal User Manual and Report – ident: ref28 doi: 10.1145/357103.357107 – ident: ref10 doi: 10.1055/s-2005-871775 – year: 1984 ident: ref2 article-title: data collection and analysis in software research and management publication-title: Proc Amer Statist Ass and Biometric Soc Joint Statistical Meetings – year: 1976 ident: ref5 publication-title: SIMPL-T A Structured Programming Language – year: 1976 ident: ref23 publication-title: An expermental analysis of program verification methods – year: 1985 ident: ref48 publication-title: Evaluations of Software Technologies Testing Cleanroom and Metrics – year: 1978 ident: ref7 publication-title: Statistics for Experimenters – start-page: 78 year: 1973 ident: ref32 article-title: applications of a probability-based model to a code reading experiment publication-title: Proc IEEE Symp Computer Software Reliability – ident: ref43 doi: 10.1007/BF01946816 – volume: 47 start-page: 623 year: 1978 ident: ref8 article-title: the design of a prototype mutation system for program testing publication-title: Proc AFIPS Conf – ident: ref6 doi: 10.1109/TSE.1984.5010301 – year: 0 ident: ref39 publication-title: Mathematical foundations for structural programming – year: 1985 ident: ref13 article-title: report from the ifip working group on terminology publication-title: Proc 15th Annu Int Symp Fault Tolerant Computing – year: 1981 ident: ref30 publication-title: An empirical study in functional testing structural testing and code reading inspection* – start-page: 209 year: 1981 ident: ref29 publication-title: Tutorial Software Testing & Validation Techniques – ident: ref24 doi: 10.1109/TSE.1977.231144 – ident: ref15 doi: 10.1109/TSE.1980.234487 – ident: ref56 doi: 10.1109/MC.1984.1659162 – ident: ref27 doi: 10.1109/TSE.1980.230467 – year: 1983 ident: ref34 article-title: an effective bug classification scheme must take the programmer into account publication-title: Proc Workshop High-Level Debugging – volume: se 12 start-page: 733 year: 1986 ident: ref4 article-title: experimentation in software engineering publication-title: IEEE Trans Software Eng doi: 10.1109/TSE.1986.6312975 – start-page: 82 year: 1986 ident: ref49 article-title: combining software testing strategies: an empirical evaluation publication-title: Proc Workshop Software Testing – ident: ref22 doi: 10.1145/1036508.1036511 – ident: ref26 doi: 10.1002/spe.4380080402 – year: 1950 ident: ref12 publication-title: Experimental Designs – year: 1983 ident: ref31 publication-title: IEEE Standard Glossary of Software Engineering Terminology – year: 1979 ident: ref18 publication-title: The DACS glossary A bibliography of software engineering terms Data & Analysis Center for Software – year: 1984 ident: ref51 article-title: evaluating software testing strategies publication-title: Proc Ninth Annu Software Eng Workshop
SSID	ssj0005775
Score	1.7131394
Snippet	This study applies an experimentation methodology to compare three state-of-the-practice software testing techniques: a) code reading by stepwise abstraction,... This study compares the results of code reading, functional testing, and structural testing in three aspects of software testing: fault detection... An experimentation methodology is applied to compare 3 state-of-the-practice software testing techniques: 1. code reading by stepwise abstraction, 2....
SourceID	proquest pascalfrancis crossref nasa ieee
SourceType	Aggregation Database Index Database Enrichment Source Publisher
StartPage	1278
SubjectTerms	Applied sciences Code reading Comparative analysis Computer programming Computer Programming And Software Computer science Computer science; control theory; systems Computer systems performance. Reliability Costs Design for experiments Effectiveness empirical study Exact sciences and technology Fault detection functional testing Measurement methodology evaluation Methods Military computing NASA off-line software review Programmers Programming profession Reading Scholarships & fellowships Software Software development Software measurement Software reviews Software testing Statistical analysis structural testing Techniques Testing Uncertainty Value analysis
SummonAdditionalLinks	– databaseName: Military Database dbid: M1Q link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV09T-QwEB3BQUEDx5fIAUeKK2iyxLGdxDQIIdA1IE5sQRfZjo2QUBY2C_x9ZhJnEULcFVesUux4N_aLZ96sZ-cB_PJeClbkMmGaZ4motUpUplliDAUj4ZR0aSc2UVxdlbe36jrU5rShrHLwiZ2jrieWfiM_Ykoisy2YOnl8Skg0ig5Xg4LGIiwhT1ZU0XfJ_rxXeBSFHFpm4mAVOvuwVB2Nb85HlG6PkFCUJfsQlDqVFbw0utVUKqlbXC3fy1x88thdGLpY-88JfIfVwD_j0_6BWYcF12zA2qDtEIetvgnHZ71AYXMXI0WM-ybHwTPGEx_foPt-1VMXj6lNB1oNbW5duwXji_Px2e8k6CwkFqPRjBxiWovMl_jKMaJbaRgrPDNZzo22RqZOWSaRhnPuvUVGVeYCp-NrnSOgfBvXatK4HYgFF4bWE2kb9QHEbEqaUtFhZW2NEDKC0bDOlQ09yEkK46HqcpFUVQhMRcBUPTARHM4HPPbtN7423STg3s0KSrdUBFsEZIXf05J5Sep1ueQR7H9Adj6uIJ-X4sftDjBWYVvT-IBhBAfzd3E_0iGLbtzkua0y-qsx5p3_suD8aws63E2Rt_746z3swgpNv6-t2YNvs-mz24dl-zK7b6c_u63wBgvJCvY priority: 102 providerName: ProQuest
Title	Comparing the Effectiveness of Software Testing Strategies
URI	https://ieeexplore.ieee.org/document/1702179 https://ntrs.nasa.gov/citations/19880033653 https://www.proquest.com/docview/195585719 https://www.proquest.com/docview/24394014 https://www.proquest.com/docview/24394033 https://www.proquest.com/docview/35110929
Volume	SE-13
WOSCitedRecordID	wos10_1109_TSE_1987_232881&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText	1
inHoldings	1
isFullTextHit
isPrint
journalDatabaseRights	– providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) customDbUrl: eissn: 1939-3520 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0005775 issn: 0098-5589 databaseCode: RIE dateStart: 19750101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE – providerCode: PRVPQU databaseName: ABI/INFORM Collection customDbUrl: eissn: 1939-3520 dateEnd: 20120331 omitProxy: false ssIdentifier: ssj0005775 issn: 0098-5589 databaseCode: 7WY dateStart: 19870101 isFulltext: true titleUrlDefault: https://www.proquest.com/abicomplete providerName: ProQuest – providerCode: PRVPQU databaseName: ABI/INFORM Global customDbUrl: eissn: 1939-3520 dateEnd: 20120331 omitProxy: false ssIdentifier: ssj0005775 issn: 0098-5589 databaseCode: M0C dateStart: 19870101 isFulltext: true titleUrlDefault: https://search.proquest.com/abiglobal providerName: ProQuest – providerCode: PRVPQU databaseName: Computer Science Database (ProQuest) customDbUrl: eissn: 1939-3520 dateEnd: 20120331 omitProxy: false ssIdentifier: ssj0005775 issn: 0098-5589 databaseCode: K7- dateStart: 19870101 isFulltext: true titleUrlDefault: http://search.proquest.com/compscijour providerName: ProQuest – providerCode: PRVPQU databaseName: Engineering Database (ProQuest) customDbUrl: eissn: 1939-3520 dateEnd: 20120331 omitProxy: false ssIdentifier: ssj0005775 issn: 0098-5589 databaseCode: M7S dateStart: 19870101 isFulltext: true titleUrlDefault: http://search.proquest.com providerName: ProQuest – providerCode: PRVPQU databaseName: Health & Medical Collection (ProQuest) customDbUrl: eissn: 1939-3520 dateEnd: 20120331 omitProxy: false ssIdentifier: ssj0005775 issn: 0098-5589 databaseCode: 7X7 dateStart: 19870101 isFulltext: true titleUrlDefault: https://search.proquest.com/healthcomplete providerName: ProQuest – providerCode: PRVPQU databaseName: Military Database (ProQuest) customDbUrl: eissn: 1939-3520 dateEnd: 20120331 omitProxy: false ssIdentifier: ssj0005775 issn: 0098-5589 databaseCode: M1Q dateStart: 19870101 isFulltext: true titleUrlDefault: https://search.proquest.com/military providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest advanced technologies & aerospace journals customDbUrl: eissn: 1939-3520 dateEnd: 20120331 omitProxy: false ssIdentifier: ssj0005775 issn: 0098-5589 databaseCode: P5Z dateStart: 19870101 isFulltext: true titleUrlDefault: https://search.proquest.com/hightechjournals providerName: ProQuest – providerCode: PRVPQU databaseName: ProQuest Central customDbUrl: eissn: 1939-3520 dateEnd: 20120331 omitProxy: false ssIdentifier: ssj0005775 issn: 0098-5589 databaseCode: BENPR dateStart: 19870101 isFulltext: true titleUrlDefault: https://www.proquest.com/central providerName: ProQuest – providerCode: PRVPQU databaseName: Research Library (ProQuest) customDbUrl: eissn: 1939-3520 dateEnd: 20120331 omitProxy: false ssIdentifier: ssj0005775 issn: 0098-5589 databaseCode: M2O dateStart: 19870101 isFulltext: true titleUrlDefault: https://search.proquest.com/pqrl providerName: ProQuest – providerCode: PRVPQU databaseName: Science Database (ProQuest) customDbUrl: eissn: 1939-3520 dateEnd: 20120331 omitProxy: false ssIdentifier: ssj0005775 issn: 0098-5589 databaseCode: M2P dateStart: 19870101 isFulltext: true titleUrlDefault: https://search.proquest.com/sciencejournals providerName: ProQuest
link	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlR1db9Mw0NqAB14YsKGVsZIHHnggXRzbccwbVJ2QEKXQSBReItuxERJKUdPC3-fOTjpNMCEeckmUsxPf-T4c23eEPPNecCoLkVLN8pQ3WqUq1zQ1Bo0Rd0q4LCSbkPN5uVqpxQF5sd8L45wLi8_cBC_DXH6ztjv8VXZBJXrQ6pAcSinjXq2r5RxSiiE-phCl6sP40ExdVMvZBMfWE_AeypJes0AhpQqcWt1pXBepOyCNjzkt_lDPweZcHv3f194n93rfMnkVO8MDcuDah-RoyNuQ9GJ8TF5OY_LB9msC7l8SAxj3Wi9Z-2QJqvmX3rikwhAcgDWEsHXdCakuZ9X0TdrnUEgtWJotKrus4bkv4SjAWlthKJWemrxgRlsjMqcsFeBiM-a9BW-pLDhVwje6AGaxR0CadetOScIZN0g-cMkwxh-MlIQpFU5ENtZwLkZkMpC1tn18cUxz8b0O44xM1cCHGvlQRz6MyPN9gR8xtMbNqMdI3yu0SNoROUG-1fCeDtFLzExXCDYi59cYuS8nUZ9lUN3ZwNi6F1ksD91GSAq1Pt0_BVnDCRTduvWuq3PcRgxjyn9hMHYzBk7cZuCTPv57k87IXWx3XDDzhNzabnbunNyxP7ffus0YOv6nzwhXckxuv57NFx_h7q1MAb7LpgjpB4T5-wAXAVYI5RLgQnwZB7H5DefYBVk
linkProvider	IEEE
linkToHtml	http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Lb9QwEB6VhwQXCrQVoZT6ABKXbOPYTmIkhFBp1artCtQcerMcx0ZIKFs2Wyr-Ez-SmTy2qlDh1AOHKIeMEyfzeR6xPR_AqxCU5HmmYm5FGsva6linlsdVRc5Ieq180pFN5NNpcXamP63Ar3EvDC2rHG1iZ6jrmaN_5DtcK4xsc67fn3-PiTSKJldHBo0eFUf-5yVmbO27w4-o3tdpur9X7h7EA6lA7ND0Lmj0J7VMQ4FHhu7LqYrzPPAqzURlXaUSrx1XGHMKEYLD8KHIJD481DbD3gu87R24JzHOofF0wj9fLSjJczVW6MS-6qGQEE_0Tnm6N6HsfoLxS1Hwaz6wI3XBU2NbSyszbYvKCT2rxh8OovN6-6v_1_d6DI-G6Jp96IfDE1jxzVNYHZkr2GDI1uDtbk-_2HxhGACzvoTzYPfZLLBTdE6Xdu5ZSUVIUGos4uvbdShv4wU2UDWzxj8DJoWsSH0YlFKVQ8wVVVVomoqtXSWlimAyqtW4ocI6EX18M12mlWiDODCEA9PjIII3ywbnfXGRm0XXCCdXYjklkzqCdcKNwee0JF4QN1-mRARb14C0bJeTRU_wdpsjasxgtKj9AJkItpdX0drQFJJt_OyiNSltpMas-l8SQtwsQVPXCUblz__ah214cFCeHJvjw-nRJjykT9GvInoBdxfzC78F992Pxdd2_rIbhQzMLaP4N4xaZB4
openUrl	ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Comparing+the+effectiveness+of+software+testing+strategies&rft.jtitle=IEEE+transactions+on+software+engineering&rft.au=Basili%2C+V+R&rft.au=Selby%2C+R+W&rft.date=1987-12-01&rft.issn=0098-5589&rft.volume=SE-13&rft.issue=12&rft.spage=1278&rft.epage=1296&rft_id=info:doi/10.1109%2FTSE.1987.232881&rft.externalDBID=NO_FULL_TEXT
thumbnail_l	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0098-5589&client=summon
thumbnail_m	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0098-5589&client=summon
thumbnail_s	http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0098-5589&client=summon