Potential Errors and Test Assessment in Software Product Line Engineering

Hartmut Lackner
(Humboldt-Universität zu Berlin)
Martin Schmidt
(Humboldt-Universität zu Berlin)

Software product lines (SPL) are a method for the development of variant-rich software systems. Compared to non-variable systems, testing SPLs is extensive due to an increasingly amount of possible products. Different approaches exist for testing SPLs, but there is less research for assessing the quality of these tests by means of error detection capability. Such test assessment is based on error injection into correct version of the system under test. However to our knowledge, potential errors in SPL engineering have never been systematically identified before. This article presents an overview over existing paradigms for specifying software product lines and the errors that can occur during the respective specification processes. For assessment of test quality, we leverage mutation testing techniques to SPL engineering and implement the identified errors as mutation operators. This allows us to run existing tests against defective products for the purpose of test assessment. From the results, we draw conclusions about the error-proneness of the surveyed SPL design paradigms and how quality of SPL tests can be improved.

In Nikolay Pakulin, Alexander K. Petrenko and Bernd-Holger Schlingloff: Proceedings Tenth Workshop on Model Based Testing (MBT 2015), London, UK, 18th April 2015, Electronic Proceedings in Theoretical Computer Science 180, pp. 57–72.
Published: 10th April 2015.

ArXived at: http://dx.doi.org/10.4204/EPTCS.180.4 bibtex PDF
References in reconstructed bibtex, XML and HTML format (approximated).
Comments and questions to: eptcs@eptcs.org
For website issues: webmaster@eptcs.org