The 3rd Reactive Synthesis Competition (SYNTCOMP 2016): Benchmarks, Participants & Results

Swen Jacobs
(Saarland University)
Roderick Bloem
(Graz University of Technology)
Romain Brenguier
(University of Oxford)
Ayrat Khalimov
(Graz University of Technology)
Felix Klein
(Saarland University)
Robert Könighofer
(Graz University of Technology)
Jens Kreber
(Saarland University)
Alexander Legg
(Data 61, CSIRO (formerly NICTA) and UNSW)
Nina Narodytska
(Samsung Research America)
Guillermo A. Pérez
(Université Libre de Bruxelles)
Jean-François Raskin
(Université Libre de Bruxelles)
Leonid Ryzhyk
(Samsung Research America)
Ocan Sankur
(CNRS, Irisa)
Martina Seidl
(Johannes-Kepler-University Linz)
Leander Tentrup
(Saarland University)
Adam Walker
(Independent Researcher)

We report on the benchmarks, participants and results of the third reactive synthesis competition(SYNTCOMP 2016). The benchmark library of SYNTCOMP 2016 has been extended to benchmarks in the new LTL-based temporal logic synthesis format (TLSF), and 2 new sets of benchmarks for the existing AIGER-based format for safety specifications. The participants of SYNTCOMP 2016 can be separated according to these two classes of specifications, and we give an overview of the 6 tools that entered the competition in the AIGER-based track, and the 3 participants that entered the TLSF-based track. We briefly describe the benchmark selection, evaluation scheme and the experimental setup of SYNTCOMP 2016. Finally, we present and analyze the results of our experimental evaluation, including a comparison to participants of previous competitions and a legacy tool.

In Ruzica Piskac and Rayna Dimitrova: Proceedings Fifth Workshop on Synthesis (SYNT 2016), Toronto, Canada, July 17-18, 2016, Electronic Proceedings in Theoretical Computer Science 229, pp. 149–177.
Published: 22nd November 2016.

ArXived at: https://dx.doi.org/10.4204/EPTCS.229.12 bibtex PDF
References in reconstructed bibtex, XML and HTML format (approximated).
Comments and questions to: eptcs@eptcs.org
For website issues: webmaster@eptcs.org