his.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
An Evaluation of Combination Strategies for Test Case Selection
University of Skövde, School of Humanities and Informatics.
University of Skövde, School of Humanities and Informatics.
University of Skövde, School of Humanities and Informatics.
University of Skövde, School of Humanities and Informatics.
2003 (English)Report (Other academic)
Abstract [en]

In this report we present the results from a comparative evaluation of five combination strategies. Combination strategies are test case selection methods that combine interesting values of the input parameters of a test object to form test cases. One of the investigated combination strategies, namely the Each Choice strategy, satisfies 1-wise coverage, i.e., each interesting value of each parameter is represented at least once in the test suite. Two of the strategies, the Orthogonal Arrays and Heuristic Pair-Wise strategies both satisfy pair-wise coverage, i.e., every possible pair of interesting values of any two parameters are included in the test suite. The fourth combination strategy, the All Values strategy, generates all possible combinations of the interesting values of the input parameters. The fifth and last combination strategy, the Base Choice combination strategy, satisfies 1-wise coverage but in addition makes use of some semantic information to construct the test cases.

Except for the All Values strategy, which is only used as a reference point with respect to the number of test cases, the combination strategies are evaluated and compared with respect to number of test cases, number of faults found, test suite failure density, and achieved decision coverage in an experiment comprising five programs, similar to Unix commands, seeded with 131 faults. As expected, the Each Choice strategy finds the smallest number of faults among the evaluated combination strategies. Surprisingly, the Base Choice strategy performs as well, in terms of detecting faults, as the pair-wise combination strategies, despite fewer test cases. Since the programs and faults in our experiment may not be representative of actual testing problems in an industrial setting, we cannot draw any general conclusions regarding the number of faults detected by the evaluated combination strategies. However, our analysis shows some properties of the combination strategies that appear significant in spite of the programs and faults not being representative. The two most important results are that the Each Choice strategy is unpredictable in terms of which faults will be detected, i.e., most faults found are found by chance, and that the Base Choice and the pair-wise combination strategies to some extent target different types of faults.

Place, publisher, year, edition, pages
Skövde: Institutionen för kommunikation och information , 2003.
Series
IKI Technical Reports, HS-IDA-TR-03-001
National Category
Information Systems
Identifiers
URN: urn:nbn:se:his:diva-1189OAI: oai:DiVA.org:his-1189DiVA: diva2:2316
Available from: 2008-06-17 Created: 2008-06-17 Last updated: 2018-01-13

Open Access in DiVA

fulltext(437 kB)1112 downloads
File information
File name FULLTEXT01.pdfFile size 437 kBChecksum SHA-1
d66c3ea6c14a694887571d9b26384079203f5a47f4c74ffc2fd446efe5a34a90340a664e
Type fulltextMimetype application/pdf

Authority records BETA

Lindström, BirgittaOffutt, JeffAndler, Sten F

Search in DiVA

By author/editor
Lindström, BirgittaOffutt, JeffAndler, Sten F
By organisation
School of Humanities and Informatics
Information Systems

Search outside of DiVA

GoogleGoogle Scholar
Total: 1112 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 1921 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf