his.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Using Mutant Stubbornness to Create Minimal and Prioritized Test Sets
University of Skövde, School of Informatics. University of Skövde, The Informatics Research Centre. (Distribuerade realtidssystem, Distributed Real-Time Systems (DRTS))
University of Skövde, School of Informatics. University of Skövde, The Informatics Research Centre. (Distribuerade realtidssystem, Distributed Real-Time Systems (DRTS))ORCID iD: 0000-0002-1039-5830
George Mason University, USA.
University of Skövde, School of Informatics. University of Skövde, The Informatics Research Centre. (Distribuerade realtidssystem, Distributed Real-Time Systems (DRTS))ORCID iD: 0000-0002-6662-9034
Show others and affiliations
2018 (English)In: 2018 IEEE International Conference on Software Quality, Reliability and Security (QRS), IEEE Computer Society, 2018, p. 446-457Conference paper, Published paper (Refereed)
Abstract [en]

In testing, engineers want to run the most useful tests early (prioritization). When tests are run hundreds or thousands of times, minimizing a test set can result in significant savings (minimization). This paper proposes a new analysis technique to address both the minimal test set and the test case prioritization problems. This paper precisely defines the concept of mutant stubbornness, which is the basis for our analysis technique. We empirically compare our technique with other test case minimization and prioritization techniques in terms of the size of the minimized test sets and how quickly mutants are killed. We used seven C language subjects from the Siemens Repository, specifically the test sets and the killing matrices from a previous study. We used 30 different orders for each set and ran every technique 100 times over each set. Results show that our analysis technique performed significantly better than prior techniques for creating minimal test sets and was able to establish new bounds for all cases. Also, our analysis technique killed mutants as fast or faster than prior techniques. These results indicate that our mutant stubbornness technique constructs test sets that are both minimal in size, and prioritized effectively, as well or better than other techniques.

Place, publisher, year, edition, pages
IEEE Computer Society, 2018. p. 446-457
Keywords [en]
Test Case Minimization, Minimal Sets, Test Case Prioritization, Mutant Stubbornness
National Category
Computer Sciences
Research subject
Distributed Real-Time Systems
Identifiers
URN: urn:nbn:se:his:diva-16050DOI: 10.1109/QRS.2018.00058Scopus ID: 2-s2.0-85052313827ISBN: 978-1-5386-7757-5 (electronic)ISBN: 978-1-5386-7758-2 (print)OAI: oai:DiVA.org:his-16050DiVA, id: diva2:1238371
Conference
2018 IEEE 18th International Conference on Software Quality, Reliability, and Security (QRS 2018), 16–20 July 2018, Lisbon, Portugal
Projects
TOCSYC
Funder
Knowledge Foundation, 20130085Available from: 2018-08-13 Created: 2018-08-13 Last updated: 2018-11-26Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopushttp://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8424996&isnumber=8424858

Authority records BETA

González-Hernández, LoretoLindström, BirgittaAndler, Sten F.

Search in DiVA

By author/editor
González-Hernández, LoretoLindström, BirgittaAndler, Sten F.
By organisation
School of InformaticsThe Informatics Research Centre
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 240 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf