Does Code Coverage Provide a Good Stopping Rule for Operational Profile Based Testing?

We introduce a new coverage measure, called the operational coverage, which is customized to the usage profile (count spectrum) of the entities to be covered. Operational coverage is proposed as an adequacy criterion for operational profile based testing, i.e., to assess the thoroughness of a black...

Full description

Saved in:
Bibliographic Details
Published in:2016 IEEE/ACM 11th International Workshop in Automation of Software Test (AST) pp. 22 - 28
Main Authors: Miranda, Breno, Bertolino, Antonia
Format: Conference Proceeding
Language:English
Published: ACM 01.05.2016
Subjects:
Correlation
Coverage Testing
Mathematical model
Operational Coverage
Operational Profile Based Testing
Program Spectra
Relative Coverage
Reliability
Software
Software testing
Time measurement
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We introduce a new coverage measure, called the operational coverage, which is customized to the usage profile (count spectrum) of the entities to be covered. Operational coverage is proposed as an adequacy criterion for operational profile based testing, i.e., to assess the thoroughness of a black box test suite derived from the operational profile. To validate the approach we study the correlation between operational coverage of branches, statements, and functions, and the probability that the next test input will not fail. On the three subjects considered, we observed a moderate correlation in all cases (except a low correlation for function coverage for one subject), and consistently better results than traditional coverage measure.
DOI:10.1145/2896921.2896934