Does Code Coverage Provide a Good Stopping Rule for Operational Profile Based Testing?

We introduce a new coverage measure, called the operational coverage, which is customized to the usage profile (count spectrum) of the entities to be covered. Operational coverage is proposed as an adequacy criterion for operational profile based testing, i.e., to assess the thoroughness of a black...

Full description

Saved in:
Bibliographic Details
Published in:2016 IEEE/ACM 11th International Workshop in Automation of Software Test (AST) pp. 22 - 28
Main Authors: Miranda, Breno, Bertolino, Antonia
Format: Conference Proceeding
Language:English
Published: ACM 01.05.2016
Subjects:
Correlation
Coverage Testing
Mathematical model
Operational Coverage
Operational Profile Based Testing
Program Spectra
Relative Coverage
Reliability
Software
Software testing
Time measurement
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract We introduce a new coverage measure, called the operational coverage, which is customized to the usage profile (count spectrum) of the entities to be covered. Operational coverage is proposed as an adequacy criterion for operational profile based testing, i.e., to assess the thoroughness of a black box test suite derived from the operational profile. To validate the approach we study the correlation between operational coverage of branches, statements, and functions, and the probability that the next test input will not fail. On the three subjects considered, we observed a moderate correlation in all cases (except a low correlation for function coverage for one subject), and consistently better results than traditional coverage measure.
AbstractList We introduce a new coverage measure, called the operational coverage, which is customized to the usage profile (count spectrum) of the entities to be covered. Operational coverage is proposed as an adequacy criterion for operational profile based testing, i.e., to assess the thoroughness of a black box test suite derived from the operational profile. To validate the approach we study the correlation between operational coverage of branches, statements, and functions, and the probability that the next test input will not fail. On the three subjects considered, we observed a moderate correlation in all cases (except a low correlation for function coverage for one subject), and consistently better results than traditional coverage measure.
Author Bertolino, Antonia
Miranda, Breno
Author_xml – sequence: 1
  givenname: Breno
  surname: Miranda
  fullname: Miranda, Breno
  email: breno.miranda@di.unipi.it
  organization: Univ. di Pisa, Pisa, Italy
– sequence: 2
  givenname: Antonia
  surname: Bertolino
  fullname: Bertolino, Antonia
  email: antonia.bertolino@isti.cnr.it
  organization: ISTI, Pisa, Italy
BookMark eNotjk1LAzEYhCPoQWvPHrzkD2zdN1-bnERXrUKhpVavJbt5UwLrZsmuBf-98eMyAzMPw1yQ0z72SMgVlAsAIW-YNsowWPw6Fydkbiqdi5ILkKDOyftDxJHW0WGWIyZ7QLpJ8RhyYOkyRkdfpzgMoT_Q7WeH1MdE10MGpxB72_3APuT83o7o6A7HKaO3l-TM227E-b_PyNvT465-Llbr5Ut9tyosE9VUtJUuW8yXtJDagdXWCAfYMBBCyYZrVTqBUjLFFAppsKlKZ1rmwRsHDfAZuf7bDYi4H1L4sOlrn1eNBs2_AdAgTHY
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1145/2896921.2896934
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9781450341516
1450341519
EndPage 28
ExternalDocumentID 7809818
Genre orig-research
GroupedDBID 6IE
6IL
CBEJK
RIE
RIL
ID FETCH-LOGICAL-a247t-c780ce9788458d1a8a94d1eb214465b3860d4e552626e459eb70d9c2f1f9d1b13
IEDL.DBID RIE
ISICitedReferencesCount 9
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000392695800004&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Thu Jan 18 11:13:35 EST 2024
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a247t-c780ce9788458d1a8a94d1eb214465b3860d4e552626e459eb70d9c2f1f9d1b13
PageCount 7
ParticipantIDs ieee_primary_7809818
PublicationCentury 2000
PublicationDate 2016-May
PublicationDateYYYYMMDD 2016-05-01
PublicationDate_xml – month: 05
  year: 2016
  text: 2016-May
PublicationDecade 2010
PublicationTitle 2016 IEEE/ACM 11th International Workshop in Automation of Software Test (AST)
PublicationTitleAbbrev IWAST
PublicationYear 2016
Publisher ACM
Publisher_xml – name: ACM
Score 1.6498463
Snippet We introduce a new coverage measure, called the operational coverage, which is customized to the usage profile (count spectrum) of the entities to be covered....
SourceID ieee
SourceType Publisher
StartPage 22
SubjectTerms Correlation
Coverage Testing
Mathematical model
Operational Coverage
Operational Profile Based Testing
Program Spectra
Relative Coverage
Reliability
Software
Software testing
Time measurement
Title Does Code Coverage Provide a Good Stopping Rule for Operational Profile Based Testing?
URI https://ieeexplore.ieee.org/document/7809818
WOSCitedRecordID wos000392695800004&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV2xTsMwELXaioEJUIuAAvLASGic2LE9IVEoTKWCgrpVTu5SIaGkalO-n3MaFQYWFtuyLNk627p7Z987xq6SBGWmMxN4svFApqgCFysZAITKpCZRUQh1sgk9HpvZzE5a7HoXC4OI9eczvPHN-i0fymzjXWUDbUJLCqbN2lrrbaxWw9YjpBoQdEhsRJjP1z4R8q90KbW2GB38b55D1vsJu-OTnUI5Yi0suuz9vsQ1H5aAVNC5o_vvB_nwOe74Y1kCf61Kz7Kw4C-bT-RkhfLnJa4aL58f7MmX-B3pK-BTz6pRLG577G30MB0-BU0yhMBFUldBRovKkDCfkcqAcMZZCYJwcU15lsYmCUGiUhEhFJTKYqpDsFmUi9yCSEV8zDpFWeAJ4zYGBEPQiKCOFLkzxgmNLs4hDCGS8SnrepnMl1u-i3kjjrO_u_tsn4yIZPsJ8Jx1qtUGL9he9lV9rFeX9SZ9A9B_lBM
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LSwMxEB5qFfSk0opvc_Do2s1uspucBOujYq1Fq_RWsjuzRZDd0m79_SbbUj148ZKEEEiYhMx8k8w3AOdRRCKNU-U5snFPJCQ9E0rhIfpSJSqSgY9Vsom411PDoe7X4GIVC0NE1eczunTN6i0fi3TuXGWtWPnaKpg1WJdCBHwRrbXk6-FCtix4iHRgUZ-rXSrkXwlTKn1xt_2_mXag-RN4x_orlbILNcob8H5T0Iy1CyRb2JNnbwA3yAXQMcPuiwLZa1k4noUxe5l_ErN2KHue0HTp53ODHf0Su7YaC9nA8Wrk46smvN3dDtodb5kOwTOBiEsvtYtKyaI-JaRCbpTRArlFxhXpWRKqyEdBUgYWo5CQmpLYR50GGc808oSHe1DPi5z2gekQCZUFRxbsCJ4ZpQyPyYQZ-j4GIjyAhpPJaLJgvBgtxXH4d_cZbHYGT91R96H3eARb1qSIFl8Cj6FeTud0AhvpV_kxm55WG_YNtEqXWg
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2016+IEEE%2FACM+11th+International+Workshop+in+Automation+of+Software+Test+%28AST%29&rft.atitle=Does+Code+Coverage+Provide+a+Good+Stopping+Rule+for+Operational+Profile+Based+Testing%3F&rft.au=Miranda%2C+Breno&rft.au=Bertolino%2C+Antonia&rft.date=2016-05-01&rft.pub=ACM&rft.spage=22&rft.epage=28&rft_id=info:doi/10.1145%2F2896921.2896934&rft.externalDocID=7809818