The 1st Syntax-Guided Synthesis Competition (SyGuS-Comp) took place as a satellite event of FLoC, CAV and SYNT 2014.
Solvers are evaluated on the StarExec platform, which provided 200 dual quad-core machines with 256GB memory each. The solvers are run with a TIMEOUT value as well. The solvers were compared against 250 benchmarks and the scores were based primarily on the number of benchmark solved and the solving time, and secondarily on the succinctness of the synthesized solution.
Five solvers participated in SyGuS-Comp’14:
Pranav Garg (UIUC), Shambwaditya Saha (UIUC) and P. Madhusudan (UIUC)
Abhishek Udupa (University of Pennsylvania)
Rishabh Singh (Massachusetts Institute of Technology), Armando Solar-Lezama (Massachusetts Institute of Technology)
Mukund Raghothaman (University of Pennsylvania)
Garvit Juniwal (University of California at Berkeley)
The winner of the competition was the Enumerative (CEGIS) solver.
A detailed final report is available here.