Identifying Useful Mutants to Test Time Properties
2018 (English)In: 2018 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), IEEE Computer Society, 2018, p. 69-76Conference paper, Published paper (Refereed)
Abstract [en]
Real-time systems have to be verified and tested for timely behavior as well as functional behavior. Thus, time is an extra dimension that adds to the complexity of software testing. A timed automata model with a model-checker can be used to generate timed test traces. To properly test the timely behavior, the set of test traces should challenge the different time constraints in the model. This paper describes and adapts mutation operators that target such time constraints in timed automata models. Time mutation operators apply a delta to the time constraints to help testers design tests that exceed the time constraints. We suggest that the size of this delta determines how easy the mutant is to kill and that the optimal delta varies by the program, mutation operator, and the individual mutant. To avoid trivial and equivalent time mutants, the delta should be set individually for each mutant. We discuss mutant subsumption and define the problem of finding dominator mutants in this new domain. In this position paper, we outline an iterative tuning process where a statistical model-checker, UPPAAL SMC, is used to: (i) create a tuned set of dominator time mutants, and (ii) generate test traces that kill the mutants.
Place, publisher, year, edition, pages
IEEE Computer Society, 2018. p. 69-76
Keywords [en]
mutation testing, model-based testing, mutant subsumption, real-time systems, embedded systems
National Category
Computer Sciences
Research subject
Distributed Real-Time Systems
Identifiers
URN: urn:nbn:se:his:diva-16049DOI: 10.1109/ICSTW.2018.00030ISI: 000492760300010Scopus ID: 2-s2.0-85050973857ISBN: 978-1-5386-6352-3 (electronic)ISBN: 978-1-5386-6353-0 (print)OAI: oai:DiVA.org:his-16049DiVA, id: diva2:1238354
Conference
2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, 9–13 April 2018, Västerås, Sweden
Projects
TOCSYC
Funder
Knowledge Foundation, 201300852018-08-132018-08-132019-12-19Bibliographically approved