his.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
An Evaluation of Combination Strategies for Test Case Selection
University of Skövde, School of Humanities and Informatics.
University of Skövde, School of Humanities and Informatics.
University of Skövde, School of Humanities and Informatics.
University of Skövde, School of Humanities and Informatics.
2003 (English)Report (Other academic)
Abstract [en]

In this report we present the results from a comparative evaluation of five combination strategies. Combination strategies are test case selection methods that combine interesting values of the input parameters of a test object to form test cases. One of the investigated combination strategies, namely the Each Choice strategy, satisfies 1-wise coverage, i.e., each interesting value of each parameter is represented at least once in the test suite. Two of the strategies, the Orthogonal Arrays and Heuristic Pair-Wise strategies both satisfy pair-wise coverage, i.e., every possible pair of interesting values of any two parameters are included in the test suite. The fourth combination strategy, the All Values strategy, generates all possible combinations of the interesting values of the input parameters. The fifth and last combination strategy, the Base Choice combination strategy, satisfies 1-wise coverage but in addition makes use of some semantic information to construct the test cases.

Except for the All Values strategy, which is only used as a reference point with respect to the number of test cases, the combination strategies are evaluated and compared with respect to number of test cases, number of faults found, test suite failure density, and achieved decision coverage in an experiment comprising five programs, similar to Unix commands, seeded with 131 faults. As expected, the Each Choice strategy finds the smallest number of faults among the evaluated combination strategies. Surprisingly, the Base Choice strategy performs as well, in terms of detecting faults, as the pair-wise combination strategies, despite fewer test cases. Since the programs and faults in our experiment may not be representative of actual testing problems in an industrial setting, we cannot draw any general conclusions regarding the number of faults detected by the evaluated combination strategies. However, our analysis shows some properties of the combination strategies that appear significant in spite of the programs and faults not being representative. The two most important results are that the Each Choice strategy is unpredictable in terms of which faults will be detected, i.e., most faults found are found by chance, and that the Base Choice and the pair-wise combination strategies to some extent target different types of faults.

Place, publisher, year, edition, pages
Skövde: Institutionen för kommunikation och information , 2003.
Series
IKI Technical Reports, HS-IDA-TR-03-001
National Category
Information Science
Identifiers
URN: urn:nbn:se:his:diva-1189OAI: oai:DiVA.org:his-1189DiVA: diva2:2316
Available from: 2008-06-17 Created: 2008-06-17 Last updated: 2010-04-08

Open Access in DiVA

fulltext(437 kB)1030 downloads
File information
File name FULLTEXT01.pdfFile size 437 kBChecksum MD5
203f5a47f4c74ffc2fd446efe5a34a90340a664ed66c3ea6c14a694887571d9b26384079
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Lindström, BirgittaOffutt, JeffAndler, Sten F
By organisation
School of Humanities and Informatics
Information Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 1030 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 1800 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf