Solver Name | #benchs | UNSAT. | MOPT. | SAT. | MSAT. | MSAT (timeout) | MSAT (out of mem.) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | Sig. Caught | NO CERT. | WRONG UNSAT. | WRONG OPT. | WRONG CERT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Sat4j Resolution 2011-06-08 (complete) |
263 | 0 (0%) |
115 (43.73%) |
0 (0%) |
0 (0%) |
126 (47.91%) |
0 (0%) |
0 (0%) |
22 (8.37%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | Sat4j Resolution 2011-06-08 (complete) |
|
---|
Solver Name | #benchs | UNSAT. | MOPT. | SAT. | MSAT. | MSAT (timeout) | MSAT (out of mem.) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | Sig. Caught | NO CERT. | WRONG UNSAT. | WRONG OPT. | WRONG CERT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
clasp 2.0-RC2 (complete) |
536 | 1 (0.19%) |
454 (84.7%) |
0 (0%) |
0 (0%) |
81 (15.11%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Sat4j Resolution 2011-06-08 (complete) |
536 | 1 (0.19%) |
447 (83.4%) |
0 (0%) |
0 (0%) |
87 (16.23%) |
0 (0%) |
0 (0%) |
1 (0.19%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 (complete) |
536 | 1 (0.19%) |
382 (71.27%) |
0 (0%) |
3 (0.56%) |
125 (23.32%) |
0 (0%) |
0 (0%) |
25 (4.66%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
wbo 1.6 (complete) |
536 | 1 (0.19%) |
372 (69.4%) |
0 (0%) |
25 (4.66%) |
0 (0%) |
0 (0%) |
0 (0%) |
138 (25.75%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | clasp 2.0-RC2 (complete) |
|
Sat4j Resolution 2011-06-08 (complete) |
|
SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 (complete) |
|
wbo 1.6 (complete) |
|
---|
Solver Name | #benchs | UNSAT. | MOPT. | SAT. | MSAT. | MSAT (timeout) | MSAT (out of mem.) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | Sig. Caught | NO CERT. | WRONG UNSAT. | WRONG OPT. | WRONG CERT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Sat4j Resolution 2011-06-08 (complete) |
46 | 0 (0%) |
33 (71.74%) |
0 (0%) |
0 (0%) |
13 (28.26%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | Sat4j Resolution 2011-06-08 (complete) |
|
---|
Solver Name | #benchs | UNSAT. | MOPT. | SAT. | MSAT. | MSAT (timeout) | MSAT (out of mem.) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | Sig. Caught | NO CERT. | WRONG UNSAT. | WRONG OPT. | WRONG CERT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
clasp 2.0-RC2 (complete) |
201 | 0 (0%) |
163 (81.09%) |
0 (0%) |
0 (0%) |
38 (18.91%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Sat4j Resolution 2011-06-08 (complete) |
201 | 0 (0%) |
162 (80.6%) |
0 (0%) |
0 (0%) |
39 (19.4%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 (complete) |
201 | 0 (0%) |
120 (59.7%) |
0 (0%) |
4 (1.99%) |
43 (21.39%) |
0 (0%) |
0 (0%) |
34 (16.92%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
wbo 1.6 (complete) |
201 | 0 (0%) |
160 (79.6%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
41 (20.4%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | clasp 2.0-RC2 (complete) |
|
Sat4j Resolution 2011-06-08 (complete) |
|
SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 (complete) |
|
wbo 1.6 (complete) |
|
---|
Solver Name | #benchs | UNSAT. | MOPT. | SAT. | MSAT. | MSAT (timeout) | MSAT (out of mem.) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | Sig. Caught | NO CERT. | WRONG UNSAT. | WRONG OPT. | WRONG CERT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Sat4j Resolution 2011-06-08 (complete) |
1046 | 1 (0.1%) |
757 (72.37%) |
0 (0%) |
0 (0%) |
265 (25.33%) |
0 (0%) |
0 (0%) |
23 (2.2%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | Sat4j Resolution 2011-06-08 (complete) |
|
---|
This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.
Solver Name | #benchs | UNSAT. | MOPT. | SAT. | MSAT. | MSAT (timeout) | MSAT (out of mem.) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | Sig. Caught | NO CERT. | WRONG UNSAT. | WRONG OPT. | WRONG CERT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
clasp 2.0-RC2 (complete) |
536 | 1 (0.19%) |
454 (84.7%) |
0 (0%) |
0 (0%) |
81 (15.11%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
clasp 2.0-RC2 (complete) |
201 | 0 (0%) |
163 (81.09%) |
0 (0%) |
0 (0%) |
38 (18.91%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Sat4j Resolution 2011-06-08 (complete) |
1046 | 1 (0.1%) |
757 (72.37%) |
0 (0%) |
0 (0%) |
265 (25.33%) |
0 (0%) |
0 (0%) |
23 (2.2%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 (complete) |
737 | 1 (0.14%) |
502 (68.11%) |
0 (0%) |
7 (0.95%) |
168 (22.8%) |
0 (0%) |
0 (0%) |
59 (8.01%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
wbo 1.6 (complete) |
737 | 1 (0.14%) |
532 (72.18%) |
0 (0%) |
25 (3.39%) |
0 (0%) |
0 (0%) |
0 (0%) |
179 (24.29%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | clasp 2.0-RC2 (complete) |
|
clasp 2.0-RC2 (complete) |
|
Sat4j Resolution 2011-06-08 (complete) |
|
SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 (complete) |
|
wbo 1.6 (complete) |
|
---|