Learning and statistical model checking of system response times

Since computers have become increasingly more powerful, users are less willing to accept slow responses of systems. Hence, performance testing is important for interactive systems. However, it is still challenging to test if a system provides acceptable performance or can satisfy certain response-ti...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Software quality journal Ročník 27; číslo 2; s. 757 - 795
Hlavní autoři: Aichernig, Bernhard K., Bauerstätter, Priska, Jöbstl, Elisabeth, Kann, Severin, Korošec, Robert, Krenn, Willibald, Mateis, Cristinel, Schlick, Rupert, Schumi, Richard
Médium: Journal Article
Jazyk:angličtina
Vydáno: New York Springer US 01.06.2019
Springer Nature B.V
Témata:
Compilers
Computer Science
Computer simulation
Data Structures and Information Theory
Feasibility studies
Interactive systems
Interpreters
Monte Carlo simulation
Operating Systems
Performance prediction
Probability
Programming Languages
Response time
Software Engineering/Programming and Operating Systems
Software quality
Statistical models
Stochastic models
User behavior
User profiles
Web services
Workloads
User profiles
Model-based testing
Response time
Cost learning
Statistical model checking
Performance testing
FsCheck
Property-based testing
ISSN:0963-9314, 1573-1367
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Since computers have become increasingly more powerful, users are less willing to accept slow responses of systems. Hence, performance testing is important for interactive systems. However, it is still challenging to test if a system provides acceptable performance or can satisfy certain response-time limits, especially for different usage scenarios. On the one hand, there are performance-testing techniques that require numerous costly tests of the system. On the other hand, model-based performance analysis methods have a doubtful model quality. Hence, we propose a combined method to mitigate these issues. We learn response-time distributions from test data in order to augment existing behavioral models with timing aspects. Then, we perform statistical model checking with the resulting model for a performance prediction. Finally, we test the accuracy of our prediction with hypotheses testing of the real system. Our method is implemented with a property-based testing tool with integrated statistical model checking algorithms. We demonstrate the feasibility of our techniques in an industrial case study with a web-service application.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0963-9314
1573-1367
DOI:10.1007/s11219-018-9432-8