Högskolan i Skövde

his.sePublications
Change search
Link to record
Permanent link

Direct link
Alternative names
Publications (10 of 14) Show all publications
Lindström, B., Offutt, J., Baral, K. & Márki, A. (2020). Message from the TestEd 2020 Chairs. In: 2020 IEEE 13th International Conference on Software Testing, Verification and Validation Workshops: 23–27 March 2020 Porto, Portugal. Paper presented at 2020 IEEE 13th International Conference on Software Testing, Verification and Validation Workshops, 23–27 March 2020 Porto, Portugal. IEEE, Article ID 9155714.
Open this publication in new window or tab >>Message from the TestEd 2020 Chairs
2020 (English)In: 2020 IEEE 13th International Conference on Software Testing, Verification and Validation Workshops: 23–27 March 2020 Porto, Portugal, IEEE, 2020, article id 9155714Conference paper, Published paper (Other academic)
Place, publisher, year, edition, pages
IEEE, 2020
National Category
Software Engineering
Research subject
Distributed Real-Time Systems
Identifiers
urn:nbn:se:his:diva-19159 (URN)10.1109/ICSTW50294.2020.00016 (DOI)2-s2.0-85091756245 (Scopus ID)978-1-7281-1075-2 (ISBN)978-1-7281-1076-9 (ISBN)
Conference
2020 IEEE 13th International Conference on Software Testing, Verification and Validation Workshops, 23–27 March 2020 Porto, Portugal
Note

Editorial

Available from: 2020-12-29 Created: 2020-12-29 Last updated: 2021-03-31Bibliographically approved
Offutt, J., Lindström, B. & Baral, K. (2019). Teaching an International Distributed Discussion-Based Course. In: Hamid R. Arabnia, Leonidas Deligiannidis, Fernando G. Tinetti, Quoc-Nam Tran (Ed.), Proceedings of the 2019 International Conference on Frontiers in Education: Computer Science & Computer Engineering (FECS'19). Paper presented at The 15th Int'l Conf on Frontiers in Education: Computer Science & Computer Engineering (FECS'19). Las Vegas, USA, 29 July - 1 August, 2019 (pp. 149-154). CSREA, Computer Science Research, Education, and Applications Press
Open this publication in new window or tab >>Teaching an International Distributed Discussion-Based Course
2019 (English)In: Proceedings of the 2019 International Conference on Frontiers in Education: Computer Science & Computer Engineering (FECS'19) / [ed] Hamid R. Arabnia, Leonidas Deligiannidis, Fernando G. Tinetti, Quoc-Nam Tran, CSREA, Computer Science Research, Education, and Applications Press , 2019, p. 149-154Conference paper, Published paper (Refereed)
Abstract [en]

Small discussion-based courses pose several challenges. Low enrollments make the course difficult to justify and can restrict active discussions. Impromptu discussions are hard to encourage. Students come to class tired, not well prepared, reluctant to speak out, or not able to verbalize abstract thoughts fast enough to fully engage. Sometimes a few students dominate the discussions while other students stay silent. This paper describes a novel teaching model that was created to allow one professor to teach the same course at multiple universities. As the course design emerged, the asynchronous online distributed nature of the course turned out to not only solve the initial problem, but also other challenges of discussion-based courses. Instructors and students found this model led to more engagement, increased learning, and higher performance.

Place, publisher, year, edition, pages
CSREA, Computer Science Research, Education, and Applications Press, 2019
Keywords
experiment, teaching methodology, teaching applied research, teaching software engineering experiment
National Category
Computer Sciences
Research subject
Distributed Real-Time Systems
Identifiers
urn:nbn:se:his:diva-18044 (URN)1-60132-498-7 (ISBN)
Conference
The 15th Int'l Conf on Frontiers in Education: Computer Science & Computer Engineering (FECS'19). Las Vegas, USA, 29 July - 1 August, 2019
Available from: 2019-12-30 Created: 2019-12-30 Last updated: 2020-01-29Bibliographically approved
Lindström, B., Offutt, J., Sundmark, D., Andler, S. F. & Pettersson, P. (2017). Using mutation to design tests for aspect-oriented models. Information and Software Technology, 81, 112-130
Open this publication in new window or tab >>Using mutation to design tests for aspect-oriented models
Show others...
2017 (English)In: Information and Software Technology, ISSN 0950-5849, E-ISSN 1873-6025, Vol. 81, p. 112-130Article in journal (Refereed) Published
Abstract [en]

Abstract Context: Testing for properties such as robustness or security is complicated because their concerns are often repeated in many locations and muddled with the normal code. Such “cross-cutting concerns” include things like interrupt events, exception handling, and security protocols. Aspect-oriented (AO) modeling allows developers to model the cross-cutting behavior independently of the normal behavior, thus supporting model-based testing of cross-cutting concerns. However, mutation operators defined for AO programs (source code) are usually not applicable to AO models (AOMs) and operators defined for models do not target the AO features. Objective: We present a method to design abstract tests at the aspect-oriented model level. We define mutation operators for aspect-oriented models and evaluate the generated mutants for an example system. Method: AOMs are mutated with novel operators that specifically target the AO modeling features. Test traces killing these mutant models are then generated. The generated and selected traces are abstract tests that can be transformed to concrete black-box tests and run on the implementation level, to evaluate the behavior of the woven cross-cutting concerns (combined aspect and base models). Results: This paper is a significant extension of our paper at Mutation 2015. We present a complete fault model, additional mutation operators, and a thorough analysis of the mutants generated for an example system. Conclusions: The analysis shows that some mutants are stillborn (syntactically illegal) but none is equivalent (exhibiting the same behavior as the original model). Additionally, our AOM-specific mutation operators can be combined with pre-existing operators to mutate code or models without any overlap.

Place, publisher, year, edition, pages
Elsevier, 2017
Keywords
Model-based testing, Aspect-oriented model, Mutation testing
National Category
Computer Sciences
Research subject
Distributed Real-Time Systems
Identifiers
urn:nbn:se:his:diva-12767 (URN)10.1016/j.infsof.2016.04.007 (DOI)000387634200009 ()2-s2.0-84963813590 (Scopus ID)
Note

Received 21 July 2015, Revised 24 March 2016, Accepted 11 April 2016, Available online 13 April 2016

Available from: 2016-08-09 Created: 2016-08-09 Last updated: 2022-12-30Bibliographically approved
Lindström, B., Andler, S. F., Offutt, J., Pettersson, P. & Sundmark, D. (2015). Mutating Aspect-Oriented Models to Test Cross-Cutting Concerns. In: 2015 IEEE 8th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2015 - Proceedings: . Paper presented at 2015 IEEE Eighth International Conference on Software Testing, Verification and Validation Workshops (ICSTW), Graz, 13-17 April 2015 (pp. Article number 7107456). IEEE conference proceedings
Open this publication in new window or tab >>Mutating Aspect-Oriented Models to Test Cross-Cutting Concerns
Show others...
2015 (English)In: 2015 IEEE 8th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2015 - Proceedings, IEEE conference proceedings, 2015, p. Article number 7107456-Conference paper, Published paper (Refereed)
Place, publisher, year, edition, pages
IEEE conference proceedings, 2015
Keywords
Mutation analysis, aspect-oriented modeling, robustness testing
National Category
Computer Sciences
Research subject
Technology; Distributed Real-Time Systems
Identifiers
urn:nbn:se:his:diva-10978 (URN)10.1109/ICSTW.2015.7107456 (DOI)000373338600052 ()2-s2.0-84934343223 (Scopus ID)978-1-4799-1885-0 (ISBN)
Conference
2015 IEEE Eighth International Conference on Software Testing, Verification and Validation Workshops (ICSTW), Graz, 13-17 April 2015
Projects
TOCSYC
Available from: 2015-05-29 Created: 2015-05-29 Last updated: 2019-09-11Bibliographically approved
Lindström, B., Offutt, J. & Andler, S. F. (2008). Testability of Dynamic Real-Time Systems: An Empirical Study of Constrained Execution Environment Implications. In: Proceedings of the First International Conference on Software Testing, Verification and Validation: ICST 2008. Paper presented at 2008 International Conference on Software Testing, Verification, and Validation, Lillehammer, Norway, April 9-11, 2008 (pp. 112-120). Los Alamitos: IEEE Computer Society
Open this publication in new window or tab >>Testability of Dynamic Real-Time Systems: An Empirical Study of Constrained Execution Environment Implications
2008 (English)In: Proceedings of the First International Conference on Software Testing, Verification and Validation: ICST 2008, Los Alamitos: IEEE Computer Society, 2008, p. 112-120Conference paper, Published paper (Refereed)
Abstract [en]

Real-time systems must respond to events in a timely fashion; in hard real-time systems the penalty for a missed deadline is high. It is therefore necessary to design hard real-time systems so that the timing behavior of the tasks can be predicted. Static real-time systems have prior knowledge of the worst-case arrival patterns and resource usage. Therefore, a schedule can be calculated off-line and tasks can be guaranteed to have sufficient resources to complete (resource adequacy). Dynamic real-time systems, on the other hand, do not have such prior knowledge, and therefore must react to events when they occur. They also must adapt to changes in the urgencies of various tasks, and fairly allocate resources among the tasks. A disadvantage of static real-time systems is that a requirement on resource adequacy makes them expensive and often impractical. Dynamic realtime systems, on the other hand, have the disadvantage of being less predictable and therefore difficult to test. Hence, in dynamic systems, timeliness is hard to guarantee and reliability is often low. Using a constrained execution environment, we attempt to increase the testability of such systems. An initial step is to identify factors that affect testability. We present empirical results on how various factors in the execution environment impacts testability of real-time systems. The results show that some of the factors, previously identified as possibly impacting testability, do not have an impact, while others do.

Place, publisher, year, edition, pages
Los Alamitos: IEEE Computer Society, 2008
Series
IEEE International Conference on Software Testing, Verification and Validation Workshops, ISSN 2159-4848
National Category
Computer Sciences
Research subject
Technology
Identifiers
urn:nbn:se:his:diva-2880 (URN)10.1109/ICST.2008.21 (DOI)2-s2.0-50649091611 (Scopus ID)978-0-7695-3127-4 (ISBN)0-7695-3127-X (ISBN)
Conference
2008 International Conference on Software Testing, Verification, and Validation, Lillehammer, Norway, April 9-11, 2008
Available from: 2009-03-23 Created: 2009-03-23 Last updated: 2019-10-11Bibliographically approved
Lindström, B., Pettersson, P. & Offutt, J. (2007). Generating Trace-Sets for Model-Based Testing. In: Lisa O’Conner (Ed.), Proceedings 18th IEEE International Symposiumon Software Reliability Engineering: ISSRE 2007. Paper presented at 18th IEEE International Symposiumon Software Reliability Engineering, ISSRE 2007, Trollhättan, Sweden, 5–9 November 2007 (pp. 171-180). IEEE
Open this publication in new window or tab >>Generating Trace-Sets for Model-Based Testing
2007 (English)In: Proceedings 18th IEEE International Symposiumon Software Reliability Engineering: ISSRE 2007 / [ed] Lisa O’Conner, IEEE, 2007, p. 171-180Conference paper, Published paper (Refereed)
Abstract [en]

Model-checkers are powerful tools that can find individual traces through models to satisfy desired properties. These traces provide solutions to a number of problems. Instead of individual traces, software testing needs sets of traces that satisfy coverage criteria. Finding a trace set in a large model is difficult because model checkers generate single traces and use a lot of memory. Space and time requirements of modelchecking algorithms grow exponentially with respect to the number of variables and parallel automata of the model being analyzed. We present a method that generates a set of traces by iteratively invoking a model checker. The method mitigates the memory consumption problem by dynamically building partitions along the traces. This method was applied to a testability case study, and it generated the complete trace set, while ordinary model-checking could only generate 26%.

Place, publisher, year, edition, pages
IEEE, 2007
Series
Proceedings - International Symposium on Software Reliability Engineering., ISSN 1071-9458, E-ISSN 2332-6549
National Category
Engineering and Technology Computer Sciences
Research subject
Technology; Information Systems
Identifiers
urn:nbn:se:his:diva-1459 (URN)10.1109/ISSRE.2007.15 (DOI)000252180900018 ()2-s2.0-47349093066 (Scopus ID)978-0-7695-3024-6 (ISBN)0-7695-3024-9 (ISBN)
Conference
18th IEEE International Symposiumon Software Reliability Engineering, ISSRE 2007, Trollhättan, Sweden, 5–9 November 2007
Available from: 2008-09-26 Created: 2008-09-26 Last updated: 2021-02-18Bibliographically approved
Lindström, B., Nilsson, R., Ericsson, A., Grindal, M., Andler, S. F., Eftring, B. & Offutt, J. (2007). Six Issues in Testing Event-Triggered Real-Time Systems. Skövde: Institutionen för kommunikation och information
Open this publication in new window or tab >>Six Issues in Testing Event-Triggered Real-Time Systems
Show others...
2007 (English)Report (Other academic)
Abstract [en]

Verification of real-time systems is a complex task, with problems coming from issues like concurrency. A previous paper suggested dealing with these problems by using a time-triggered design, which gives good support both for testing and formal analysis. However, a

time-triggered solution is not always feasible and an event-triggered design is needed. Event-triggered systems are far more difficult to test than time-triggered systems.

This paper revisits previously identified testing problems from a new perspective and identifies additional problems for event-triggered systems. The paper also presents an approach to deal with these problems. The TETReS project assumes a model-driven development

process. We combine research within three different fields: (i) transformation of rule sets between timed automata specifications and ECA rules with maintained semantics, (ii) increasing testability in event-triggered system, and (iii) development of test case generation methods for event-triggered systems.

Place, publisher, year, edition, pages
Skövde: Institutionen för kommunikation och information, 2007. p. 10
Series
IKI Technical Reports ; HS-IKI-TR-07-005
National Category
Information Systems
Identifiers
urn:nbn:se:his:diva-1269 (URN)
Available from: 2008-06-17 Created: 2008-06-17 Last updated: 2018-09-07Bibliographically approved
Grindal, M., Offutt, J. & Mellin, J. (2006). Handling Constraints in the Input Space when Using Combination Strategies for Software Testing. Skövde: Institutionen för kommunikation och information
Open this publication in new window or tab >>Handling Constraints in the Input Space when Using Combination Strategies for Software Testing
2006 (English)Report (Other academic)
Abstract [en]

This study compares seven different methods for handling constraints in input parameter models when using combination strategies to select test cases. Combination strategies are used to select test cases based on input parameter models. An input parameter model is a representation of the input space of the system under test via a set of parameters and values for these parameters. A test case is one specific combination of values for all the parameters. Sometimes the input parameter model may contain parameters that are not independent. Some sub-combinations of values of the dependent parameters may not be valid, i.e., these sub-combinations do not make sense. Combination strategies, in their basic forms, do not take into account any semantic information. Thus, invalid sub-combinations may be included in test cases in the test suite. This paper proposes four new constraint handling methods and compares these with three existing methods in an experiment in which the seven constraint handling methods are used to handle a number of different constraints in different sized input parameter models under three different coverage criteria. All in all, 2568 test suites with a total of 634,263 test cases have been generated within the scope of this experiment.

Place, publisher, year, edition, pages
Skövde: Institutionen för kommunikation och information, 2006. p. 39
Series
IKI Technical Reports ; HS-IKI-TR-06-001
National Category
Information Systems
Identifiers
urn:nbn:se:his:diva-1263 (URN)
Available from: 2008-06-17 Created: 2008-06-17 Last updated: 2018-09-07Bibliographically approved
Nilsson, R., Offutt, J. & Mellin, J. (2006). Test case generation for mutation-based testing of timeliness. Paper presented at Second Workshop on Model Based Testing 2006 (MBT 2006), 25-26 March 2006, Vienna, Austria. Electronic Notes in Theoretical Computer Science, 164(4), 97-114
Open this publication in new window or tab >>Test case generation for mutation-based testing of timeliness
2006 (English)In: Electronic Notes in Theoretical Computer Science, E-ISSN 1571-0661, Vol. 164, no 4, p. 97-114Article in journal (Refereed) Published
Abstract [en]

Temporal correctness is crucial for real-time systems. Few methods exist to test temporal correctness and most methods used in practice are ad-hoc. A problem with testing real-time applications is the response-time dependency on the execution order of concurrent tasks. Execution order in turn depends on execution environment properties such as scheduling protocols, use of mutual exclusive resources as well as the point in time when stimuli is injected. Model based mutation testing has previously been proposed to determine the execution orders that need to be verified to increase confidence in timeliness. An effective way to automatically generate such test cases for dynamic real-time systems is still needed. This paper presents a method using heuristic-driven simulation to generate test cases.

Place, publisher, year, edition, pages
Elsevier, 2006
Keywords
Real-time Systems, Mutation Testing, Model based
National Category
Computer Systems Computer Sciences Information Systems
Research subject
Distributed Real-Time Systems
Identifiers
urn:nbn:se:his:diva-1811 (URN)10.1016/j.entcs.2006.10.010 (DOI)2-s2.0-33750062888 (Scopus ID)
Conference
Second Workshop on Model Based Testing 2006 (MBT 2006), 25-26 March 2006, Vienna, Austria
Note

CC BY-NC-ND 3.0

Special issue: Proceedings of the Second Workshop on Model Based Testing (MBT 2006). Edited by B. Finkbeiner, Y. Gurevich, A.K. Petrenko

Available from: 2007-10-12 Created: 2007-10-12 Last updated: 2024-07-04Bibliographically approved
Grindal, M., Offutt, J. & Andler, S. F. (2005). Combination Testing Strategies: A Survey. Software testing, verification & reliability, 15(3), 167-199
Open this publication in new window or tab >>Combination Testing Strategies: A Survey
2005 (English)In: Software testing, verification & reliability, ISSN 0960-0833, E-ISSN 1099-1689, Vol. 15, no 3, p. 167-199Article in journal (Refereed) Published
Abstract [en]

Combination strategies are test case selection methods that identify test cases by combining values of the different test object input parameters based on some combinatorial strategy. This survey presents 16 different combination strategies, covering more than 40 papers that focus on one or several combination strategies. This collection represents most of the existing work performed on combination strategies. This survey describes the basic algorithms used by the combination strategies. Some properties of combination strategies, including coverage criteria and theoretical bounds on the size of test suites, are also included in this description. This survey paper also includes a subsumption hierarchy that attempts to relate the various coverage criteria associated with the identified combination strategies

Place, publisher, year, edition, pages
John Wiley & Sons, 2005
National Category
Engineering and Technology
Research subject
Technology
Identifiers
urn:nbn:se:his:diva-1694 (URN)10.1002/stvr.319 (DOI)000232009700003 ()2-s2.0-24944512941 (Scopus ID)
Available from: 2007-08-13 Created: 2007-08-13 Last updated: 2017-12-12Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-8657-2557

Search in DiVA

Show all publications