Does Code Coverage Provide a Good Stopping Rule for Operational Profile Based Testing?

We introduce a new coverage measure, called the operational coverage, which is customized to the usage profile (count spectrum) of the entities to be covered. Operational coverage is proposed as an adequacy criterion for operational profile based testing, i.e., to assess the thoroughness of a black...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:2016 IEEE/ACM 11th International Workshop in Automation of Software Test (AST) S. 22 - 28
Hauptverfasser: Miranda, Breno, Bertolino, Antonia
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: ACM 01.05.2016
Schlagworte:
Correlation
Coverage Testing
Mathematical model
Operational Coverage
Operational Profile Based Testing
Program Spectra
Relative Coverage
Reliability
Software
Software testing
Time measurement
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:We introduce a new coverage measure, called the operational coverage, which is customized to the usage profile (count spectrum) of the entities to be covered. Operational coverage is proposed as an adequacy criterion for operational profile based testing, i.e., to assess the thoroughness of a black box test suite derived from the operational profile. To validate the approach we study the correlation between operational coverage of branches, statements, and functions, and the probability that the next test input will not fail. On the three subjects considered, we observed a moderate correlation in all cases (except a low correlation for function coverage for one subject), and consistently better results than traditional coverage measure.
DOI:10.1145/2896921.2896934