This site gives some information based on the answers provided by the different solvers. Not all answers given by a solver can be checked efficiently. Therefore, some answers given by a solver may be wrong but this may be unnoticed by the evaluation environment.

Here are the checks made for each answer.

- SATISFIABLE answers:

The model provided by the solver is given to a verifier program which checks that all constraints are actually satisfied. These answers are the only ones that are guaranteed to be true. - UNSATISFIABLE answers:

The only check that is made is to verify that no other solver found a solution to this instance. An UNSATISFIABLE answer is not reliable. Some solvers may wrongly indicate UNSATISFIABLE but unless another solver finds a model, this will remain undetected. - OPTIMUM FOUND answers:

Beyond verifying the model and the value of the objective function, the only check that is made is to verify that no other solver found a better solution to this instance. An OPTIMUM FOUND answer is not reliable. Some solvers may wrongly indicate OPTIMUM FOUND but unless another solver finds a better model, this will remain undetected.

- Information about solvers (command line, supported categories,...)
- Information about selected instances (no solver result)

- Ranking of solvers
- All solvers (tabular format, summary)
- All solvers (tabular format, detailed results)

- borg
*pb-dec-11.04.03*(complete) (list format) - borg
*pb-opt-11.04.03*(complete) (list format) - bsolo
*3.2*(complete) (list format) - clasp
*2.0-R4191***[DEPRECATED]**(complete) (list format) - clasp
*2.0-R4191*(complete) (list format) - clasp
*2.0-R4191-patched (fixed)*(complete) (list format) - MinisatID
*2.4.8***[DEPRECATED]**(complete) (list format) - MinisatID
*2.4.8-gmp***[DEPRECATED]**(complete) (list format) - MinisatID
*2.5.2 (fixed)*(complete) (list format) - MinisatID
*2.5.2-gmp (fixed)*(complete) (list format) - pwbo
*1.1*(complete) (list format) - Sat4j CuttingPlanes
*2.3.0*(complete) (list format) - Sat4j Res//CP
*2.3.0*(complete) (list format) - Sat4j Resolution
*2.3.0*(complete) (list format) - SCIP spx
*SCIP 2.0.1.4. with SoPlex 1.5.0.4***[DEPRECATED]**(complete) (list format) - SCIP spx 2
*2011-06-10 (fixed)*(complete) (list format) - SCIP spx E
*SCIP 2.0.1.4b with SoPlex 1.5.0.4***[DEPRECATED]**(complete) (list format) - SCIP spx E_2
*2011-06-10 (fixed)*(complete) (list format) - wbo
*1.6*(complete) (list format)

- Number of instances solved in a given amount of time
- Number of instances solved within a given amount of memory
- Memory versus time for each solvers
- Evolution of the solution quality for solver borg
*pb-dec-11.04.03*(complete) - Evolution of the solution quality for solver borg
*pb-opt-11.04.03*(complete) - Evolution of the solution quality for solver bsolo
*3.2*(complete) - Evolution of the solution quality for solver clasp
*2.0-R4191***[DEPRECATED]**(complete) - Evolution of the solution quality for solver clasp
*2.0-R4191*(complete) - Evolution of the solution quality for solver clasp
*2.0-R4191-patched (fixed)*(complete) - Evolution of the solution quality for solver MinisatID
*2.4.8***[DEPRECATED]**(complete) - Evolution of the solution quality for solver MinisatID
*2.4.8-gmp***[DEPRECATED]**(complete) - Evolution of the solution quality for solver MinisatID
*2.5.2 (fixed)*(complete) - Evolution of the solution quality for solver MinisatID
*2.5.2-gmp (fixed)*(complete) - Evolution of the solution quality for solver pwbo
*1.1*(complete) - Evolution of the solution quality for solver Sat4j CuttingPlanes
*2.3.0*(complete) - Evolution of the solution quality for solver Sat4j Res//CP
*2.3.0*(complete) - Evolution of the solution quality for solver Sat4j Resolution
*2.3.0*(complete) - Evolution of the solution quality for solver SCIP spx
*SCIP 2.0.1.4. with SoPlex 1.5.0.4***[DEPRECATED]**(complete) - Evolution of the solution quality for solver SCIP spx 2
*2011-06-10 (fixed)*(complete) - Evolution of the solution quality for solver SCIP spx E
*SCIP 2.0.1.4b with SoPlex 1.5.0.4***[DEPRECATED]**(complete) - Evolution of the solution quality for solver SCIP spx E_2
*2011-06-10 (fixed)*(complete) - Evolution of the solution quality for solver wbo
*1.6*(complete)

- Results for category DEC-SMALLINT-LIN (no optimisation, small integers, linear constraints, 481 instances)
- Results for category Handmade (Handmade) (264 instances)
- Results for category Graphs (Graph Problems - Vertex Cover and Degree Bounded Spanning Tree) (15 instances)
- Results for category Numerical (Numerical Problems) (5 instances)
- Results for category Pigeon-Hole (Pigeon Hole) (20 instances)
- Results for category PPP (Progressive Party Problem) (6 instances)
- Results for category Queens (Queens Problems) (112 instances)
- Results for category TSP (Traveling Salesperson Problem) (100 instances)
- Results for category TTP-Round-Robin (Travelling Tournament Problem) (6 instances)
- Results for category Industrial (Industrial) (107 instances)
- Results for category FPGA (FPGA ...) (57 instances)
- Results for category UCLID (UCLID Benchmarks) (50 instances)
- Results for category DEC-SMALLINT-NLC (no optimisation, small integers, non linear constraints, 100 instances)
- Results for category OPT-BIGINT-LIN (optimisation, big integers, linear constraints, 557 instances)
- Results for category Handmade (Handmade) (377 instances)
- Results for category Course-Assignment (Course Assignment) (1 instances)
- Results for category Factorization (Number Factorization) (100 instances)
- Results for category MPS (MPS to OPB) (276 instances)
- Results for category OPT-SMALLINT-LIN (optimisation, small integers, linear constraints, 731 instances)
- Results for category Handmade (Handmade) (294 instances)
- Results for category Course-Assignment (Course Assignment) (4 instances)
- Results for category Dominating-Set (Weighted Dominating Set) (15 instances)
- Results for category Graphs (Graph Problems - Vertex Cover and Degree Bounded Spanning Tree) (15 instances)
- Results for category Haplotype (Haplotype Inference) (8 instances)
- Results for category Min-Prime (Minimum-Size Prime Implicant) (130 instances)
- Results for category Misc (Misc) (3 instances)
- Results for category MPS (MPS to OPB) (32 instances)
- Results for category Numerical (Numerical Problems) (34 instances)
- Results for category PTL/CMOS-Circuits (Synthesis PTL/CMOS Circuits) (8 instances)
- Results for category Queens (Queens Problems) (15 instances)
- Results for category Radar (Radar Surveillance) (12 instances)
- Results for category Routing (Routing) (10 instances)
- Results for category TTP-Round-Robin (Travelling Tournament Problem) (8 instances)
- Results for category Industrial (Industrial) (74 instances)
- Results for category Logic-Synthesis (Logic Synthesis) (74 instances)
- Results for category Random (Random) (80 instances)
- Results for category Kexu (Kexu Benchmarks) (40 instances)
- Results for category Market-Split (Market Split Problem) (40 instances)
- Results for category OPT-SMALLINT-NLC (optimisation, small integers, non linear constraints, 409 instances)
- Results for all categories