Exploring the Link Between Test Suite Quality and Automatic Specification Inference

Luke Chircop
(University Of Malta)
Christian Colombo
(University Of Malta)
Mark Micallef
(University Of Malta)

While no one doubts the importance of correct and complete specifications, many industrial systems still do not have formal specifications written out — and even when they do, it is hard to check their correctness and completeness. This work explores the possibility of using an invariant extraction tool such as Daikon to automatically infer specifications from available test suites with the idea of aiding software engineers to improve the specifications by having another version to compare to. Given that our initial experiments did not produce satisfactory results, in this paper we explore which test suite attributes influence the quality of the inferred specification. Following further study, we found that instruction, branch and method coverage are correlated to high recall values, reaching up to 97.93%.

In Adrian Francalanza and Gordon J. Pace: Proceedings Second International Workshop on Pre- and Post-Deployment Verification Techniques (PrePost 2017), Torino, Italy, 19 September 2017, Electronic Proceedings in Theoretical Computer Science 254, pp. 44–56.
Published: 23rd August 2017.

ArXived at: http://dx.doi.org/10.4204/EPTCS.254.4 bibtex PDF
References in reconstructed bibtex, XML and HTML format (approximated).
Comments and questions to: eptcs@eptcs.org
For website issues: webmaster@eptcs.org