This site gives some information based on the answers provided by the different solvers. Not all answers given by a solver can be checked efficiently. Therefore, some answers given by a solver may be wrong but this may be unnoticed by the evaluation environment.

Here are the checks made for each answer.

- SATISFIABLE answers:

The model provided by the solver is given to a verifier program which checks that all constraints are actually satisfied. These answers are the only ones that are guaranteed to be true. - UNSATISFIABLE answers:

The only check that is made is to verify that no other solver found a solution to this instance. An UNSATISFIABLE answer is not reliable. Some solvers may wrongly indicate UNSATISFIABLE but unless another solver finds a model, this will remain undetected. - OPTIMUM FOUND answers:

Beyond verifying the model and the value of the objective function, the only check that is made is to verify that no other solver found a better solution to this instance. An OPTIMUM FOUND answer is not reliable. Some solvers may wrongly indicate OPTIMUM FOUND but unless another solver finds a better model, this will remain undetected.

- Information about solvers (command line, supported categories,...)
- Information about selected instances (no solver result)

- Ranking of solvers
- All solvers (tabular format, summary)
- All solvers (tabular format, detailed results)

- CASHWMaxSAT-DisjCad-S
*2024-07-10*(complete) (list format) - CASHWMaxSAT-DisjCad-SP
*2024-07-10*(complete) (list format) - CASHWMaxSAT-DisjCom-S
*2024-07-10*(complete) (list format) - CASHWMaxSAT-DisjCom-SP
*2024-07-10*(complete) (list format) - DLS-PBO
*2024-07-09*(incomplete) (list format) - Exact
*2024-07-05*(complete) (list format) - Exact_no_SoPlex
*2024-07-05*(complete) (list format) - Exact_veripb2
*2024-07-05*(complete) (list format) - Exact_veripb2_no_SoPlex
*2024-07-05*(complete) (list format) - FiberSCIP
*2024-07-02*(complete) (list format) - FiberSCIP
*2024-07-30*(complete) (list format) - FiberSCIP
*20 cores, 2024-07-30*(complete) (list format) - FiberSCIP
*20 cores, 2024-08-09*(complete) (list format) - FiberSCIP
*20 cores, 2024-08-12*(complete) (list format) - Hybrid-CASHWMaxSATDisjCadSP+Exact
*2024-07-11*(complete) (list format) - Hybrid-CASHWMaxSATDisjComS+Exact
*2024-07-11*(complete) (list format) - Hybrid-LSMabP+Exact
*2024-07-11*(incomplete) (list format) - Hybrid-LSMabSP+CASHWMaxSATDisjCom
*2024-07-11*(incomplete) (list format) - Hybrid-LSMabSP+Exact
*2024-07-11*(incomplete) (list format) - IPBHS-GUROBI
*2024-07-09*(complete) (list format) - IPBHS-GUROBI-SYM
*2024-07-09*(complete) (list format) - IPBHS-SCIP
*2024-07-09*(complete) (list format) - LS-Mab
*2024-07-10*(incomplete) (list format) - LS-MabP
*2024-07-10*(incomplete) (list format) - LS-MabS
*2024-07-10*(incomplete) (list format) - LS-MabSP
*2024-07-10*(incomplete) (list format) - mixed-bag
*2024-07-02*(complete) (list format) - mixed-bag
*2024-07-19*(complete) (list format) - NaPS
*1.03*(complete) (list format) - NaPS-GM
*1.03*(complete) (list format) - NaPS-PB16
*1.02b5*(complete) (list format) - ParLS-PBO-1.1
*2024-07-09*(incomplete) (list format) - ParLS-PBO-1.1
*20 cores, 2024-07-09*(incomplete) (list format) - pb-oll-rs
*2024-07-02*(complete) (list format) - pb-oll-rs
*2024-07-19*(complete) (list format) - Picat
*2024-06-18*(complete) (list format) - RoundingSat
*log (1)*(complete) (list format) - RoundingSat
*log (2)*(complete) (list format) - RoundingSat
*log (3)*(complete) (list format) - RoundingSat
*nolog (1)*(complete) (list format) - RoundingSat
*nolog (2)*(complete) (list format) - Sat4j Cutting Planes 2024
*2024-07-12*(complete) (list format) - Sat4j Partial RoundingSAT 2024
*2024-07-12*(complete) (list format) - Sat4j Resolution 2024
*2024-07-07*(complete) (list format) - Sat4j Resolution Default
*2024-07-07*(complete) (list format) - SCIP
*2024-07-07*(complete) (list format)

- Number of instances solved in a given amount of time
- Number of instances solved within a given amount of memory
- Memory versus time for each solvers
- Evolution of the solution quality for solver CASHWMaxSAT-DisjCad-S
*2024-07-10*(complete) - Evolution of the solution quality for solver CASHWMaxSAT-DisjCad-SP
*2024-07-10*(complete) - Evolution of the solution quality for solver CASHWMaxSAT-DisjCom-S
*2024-07-10*(complete) - Evolution of the solution quality for solver CASHWMaxSAT-DisjCom-SP
*2024-07-10*(complete) - Evolution of the solution quality for solver DLS-PBO
*2024-07-09*(incomplete) - Evolution of the solution quality for solver Exact
*2024-07-05*(complete) - Evolution of the solution quality for solver Exact_no_SoPlex
*2024-07-05*(complete) - Evolution of the solution quality for solver Exact_veripb2
*2024-07-05*(complete) - Evolution of the solution quality for solver Exact_veripb2_no_SoPlex
*2024-07-05*(complete) - Evolution of the solution quality for solver FiberSCIP
*2024-07-02*(complete) - Evolution of the solution quality for solver FiberSCIP
*2024-07-30*(complete) - Evolution of the solution quality for solver FiberSCIP
*20 cores, 2024-07-30*(complete) - Evolution of the solution quality for solver FiberSCIP
*20 cores, 2024-08-09*(complete) - Evolution of the solution quality for solver FiberSCIP
*20 cores, 2024-08-12*(complete) - Evolution of the solution quality for solver Hybrid-CASHWMaxSATDisjCadSP+Exact
*2024-07-11*(complete) - Evolution of the solution quality for solver Hybrid-CASHWMaxSATDisjComS+Exact
*2024-07-11*(complete) - Evolution of the solution quality for solver Hybrid-LSMabP+Exact
*2024-07-11*(incomplete) - Evolution of the solution quality for solver Hybrid-LSMabSP+CASHWMaxSATDisjCom
*2024-07-11*(incomplete) - Evolution of the solution quality for solver Hybrid-LSMabSP+Exact
*2024-07-11*(incomplete) - Evolution of the solution quality for solver IPBHS-GUROBI
*2024-07-09*(complete) - Evolution of the solution quality for solver IPBHS-GUROBI-SYM
*2024-07-09*(complete) - Evolution of the solution quality for solver IPBHS-SCIP
*2024-07-09*(complete) - Evolution of the solution quality for solver LS-Mab
*2024-07-10*(incomplete) - Evolution of the solution quality for solver LS-MabP
*2024-07-10*(incomplete) - Evolution of the solution quality for solver LS-MabS
*2024-07-10*(incomplete) - Evolution of the solution quality for solver LS-MabSP
*2024-07-10*(incomplete) - Evolution of the solution quality for solver mixed-bag
*2024-07-02*(complete) - Evolution of the solution quality for solver mixed-bag
*2024-07-19*(complete) - Evolution of the solution quality for solver NaPS
*1.03*(complete) - Evolution of the solution quality for solver NaPS-GM
*1.03*(complete) - Evolution of the solution quality for solver NaPS-PB16
*1.02b5*(complete) - Evolution of the solution quality for solver ParLS-PBO-1.1
*2024-07-09*(incomplete) - Evolution of the solution quality for solver ParLS-PBO-1.1
*20 cores, 2024-07-09*(incomplete) - Evolution of the solution quality for solver pb-oll-rs
*2024-07-02*(complete) - Evolution of the solution quality for solver pb-oll-rs
*2024-07-19*(complete) - Evolution of the solution quality for solver Picat
*2024-06-18*(complete) - Evolution of the solution quality for solver RoundingSat
*log (1)*(complete) - Evolution of the solution quality for solver RoundingSat
*log (2)*(complete) - Evolution of the solution quality for solver RoundingSat
*log (3)*(complete) - Evolution of the solution quality for solver RoundingSat
*nolog (1)*(complete) - Evolution of the solution quality for solver RoundingSat
*nolog (2)*(complete) - Evolution of the solution quality for solver Sat4j Cutting Planes 2024
*2024-07-12*(complete) - Evolution of the solution quality for solver Sat4j Partial RoundingSAT 2024
*2024-07-12*(complete) - Evolution of the solution quality for solver Sat4j Resolution 2024
*2024-07-07*(complete) - Evolution of the solution quality for solver Sat4j Resolution Default
*2024-07-07*(complete) - Evolution of the solution quality for solver SCIP
*2024-07-07*(complete)

- Graphical comparison of two solvers based on CPU time
- Graphical comparison of two solvers based on memory

- Results for category DEC-LIN (decision problem, linear constraints, no UNSAT certificate, 397 instances)
- Results for category DEC-NLC (decision problem, non-linear constraints, no UNSAT certificate, 10 instances)
- Results for category OPT-LIN (optimization problem, linear constraints, no OPT/UNSAT certificate, 478 instances)
- Results for category OPT-NLC (optimization problem, non-linear constraints, no OPT/UNSAT certificate, 54 instances)
- Results for all categories