his.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Robustness Testing of Embedded Software Systems: An Industrial Interview Study
Swedish Institute of Computer Science.
Swedish Institute of Computer Science / Mälardalen University, Sw eden.
University of Skövde, School of Informatics. University of Skövde, The Informatics Research Centre. (Distribuerade Realtidssystem (DRTS), Distributed Real-Time Systems)ORCID iD: 0000-0002-1039-5830
University of Skövde, School of Informatics. University of Skövde, The Informatics Research Centre. (Distribuerade Realtidssystem (DRTS), Distributed Real-Time Systems)ORCID iD: 0000-0002-6662-9034
2016 (English)In: IEEE Access, E-ISSN 2169-3536, Vol. 4, 1859-1871 p., 7438745Article in journal (Refereed) Published
Abstract [en]

Embedded software is at the core of current and future telecommunication, automotive, multimedia, and industrial automation systems. The success of practically any industrial application depends on the embedded software system’s dependability, and one method to verify the dependability of a system is testing its robustness. The motivation behind this study is to provide a knowledge base of the state of the practice in robustness testing of embedded software systems and to compare this to the state of the art. We have gathered information on the state of the practice in robustness testing from seven different industrial domains (telecommunication, automotive, multimedia, critical infrastructure, aerospace, consumer products, and banking) by conducting thirteen semi-structured interviews. We investigate different aspects of robustness testing, such as the general view of robustness, relation to requirements engineering and design, test execution, failures, and tools. We highlight knowledge from the state of the practice of robustness testing of embedded software systems. We found different robustness testing practices that have not been previously described. Our study shows that the state of the practice, when it comes to robustness testing, differs between organizations and is quite different from the state of the art described in the scientific literature. For example, methods commonly described in the literature (e.g., the fuzzy approach) are not used in the organizations we studied. Instead, the interviewees described several ad-hoc approaches that take specific scenarios into account (e.g., power failure or overload). Other differences we found concern classification of robustness failures, the hypothesized root causes of robustness failures, and the types of tools used for robustness testing. The study is a first step in capturing the state of the practice of robustness testing of embedded software systems. The results can be used by both researchers and- practitioners. Researchers can use our findings to understand the gap between the state of the art and the state of the practice and develop their studies to fill this gap. Practitioners can also learn from this knowledge base regarding how they can improve their practice and acquire other practices.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2016. Vol. 4, 1859-1871 p., 7438745
National Category
Computer Science
Research subject
Distributed Real-Time Systems
Identifiers
URN: urn:nbn:se:his:diva-12154DOI: 10.1109/ACCESS.2016.2544951ISI: 000401699000001Scopus ID: 2-s2.0-84979823446OAI: oai:DiVA.org:his-12154DiVA: diva2:920638
Available from: 2016-04-18 Created: 2016-04-18 Last updated: 2017-06-20Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Lindström, BirgittaAndler, Sten F.
By organisation
School of InformaticsThe Informatics Research Centre
In the same journal
IEEE Access
Computer Science

Search outside of DiVA

GoogleGoogle Scholar

Altmetric score

Total: 641 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf