The 4th Syntax-Guided Synthesis Competition (SyGuS-Comp) will take place as a satellite event of CAV and SYNT 2017.
UPDATE: SyGuS-Comp 2017 has concluded (Results). Congratulations to all winners.
|22 July 2017||Solvers presentation (at SYNT’17 workshop)|
Call for Participation
This is a call for participation in the 4th Syntax-Guided Synthesis Competition to be organized as a satellite event of SYNT and CAV 2017.
There has been a lot of recent interest in both using SyGuS solvers for various synthesis applications and developing different solving algorithms. The SyGuS competition (SyGuS-Comp’17) will allow solvers to compete on a large collection of benchmarks and advance the state-of-the-art for program-synthesis tools. We invite authors to submit their SyGuS solvers to this year’s SyGuS Competition.
For questions regarding the competition please contact the organizers at firstname.lastname@example.org.
This year’s competition will have 5 tracks:
- General SyGuS track (General),
- Invariant synthesis track (INV),
- Conditional Linear Integer Arithmetic track (CLIA),
- Programming By Examples [Strings] track (PBE-Strings), and
- Programming By Examples [Bit Vectors] track (PBE-BV).
See Specification Language for more details about these tracks.
Solvers will be evaluated on the StarExec platform, which provided 200 dual quad-core machines with 256GB memory each. The solvers would be run with a TIMEOUT value. The SyGuS-correctness checker, as well as the solvers from last year’s competition are available on the SyGuS community at StarExec. Candidate participants are invited to register on StarExec, where they can easily compare their solvers to the previous ones against the public benchmarks.
Tool Submission and Description
We expect tool developers to test their solvers on the public benchmarks, and submit the solver binaries on StarExec by the solver submission deadline. Each solver submission should also be accompanied by a brief (1 – 2 page in IEEE format) description of the key ideas of the solver.
Licensing of Tools and Benchmarks:
All benchmarks will be made public after the competition. We encourage the tool developers to make their solvers open-source, but participants are welcomed to submit binaries of proprietary tools as well.
Five solvers participated in SyGuS-Comp’17:
- CVC4 (in all 5 tracks)
Andrew Reynolds (University of Iowa), Haniel Barbosa (University of Iowa), Andres Notzli (Stanford University), Cesare Tinelli (University of Iowa) and Clark Barrett (Stanford University)
- DryadSynth (in INV and CLIA tracks)
KangJing Huang (Purdue University), Xiaokang Qiu (Purdue University) and Yanjun Wang (Purdue University)
- EUSolver (in all 5 tracks)
Arjun Radhakrishna (Microsoft) and Abhishek Udupa (Microsoft)
- Euphony (in all 5 tracks)
Woosuk Lee (University of Pennsylvania), Arjun Radhakrishna (Microsoft) and Abhishek Udupa (Microsoft)
- E3Solver (in PBE-BV track)
Ammar Ben Khadra (University of Kaiserslautern)
- LoopInvGen (in INV track)
Saswat Padhi (UCLA) and Todd Millstein (UCLA)
The winners for various tracks are as follows.
- PBE-BV Track: E3Solver
- PBE-Strings Track: CVC4
- INV Track: LoopInvGen
- CLIA Track: CVC4
- General Track: CVC4
A detailed final report is also available here.