solver | a "light red" background denotes a solver which was disqualified because it gave an incorrect answer, and which will not appear in the ranking |
solver | a "light yellow" background denotes a solver which was replaced by another version, and which will not appear in the ranking |
Solver Name | #benchs | Solved | UNSAT | OPT/SAT | SAT (TO/MO) | UNKNOWN | Bad Answers |
---|---|---|---|---|---|---|---|
cosoco-mini 1.12 (complete) |
117 | 42 (35.9%) |
0 (0%) |
42 (35.9%) |
73 (62.39%) |
2 (1.71%) |
0 (0%) |
cosoco-mini 1.1 (2017-06-27) (complete) |
117 | 42 (35.9%) |
0 (0%) |
42 (35.9%) |
5 (4.27%) |
70 (59.83%) |
0 (0%) |
cosoco-mini 1.1 (2017-07-29) (complete) |
117 | 42 (35.9%) |
0 (0%) |
42 (35.9%) |
73 (62.39%) |
2 (1.71%) |
0 (0%) |
Naxos 1.1.0 (complete) |
117 | 33 (28.21%) |
0 (0%) |
33 (28.21%) |
60 (51.28%) |
24 (20.51%) |
0 (0%) |
Solver Name | Progress | cosoco-mini 1.12 (complete) |
|
cosoco-mini 1.1 (2017-06-27) (complete) |
|
cosoco-mini 1.1 (2017-07-29) (complete) |
|
Naxos 1.1.0 (complete) |
|
---|
Solver Name | #benchs | Solved | UNSAT | OPT/SAT | SAT (TO/MO) | UNKNOWN | Bad Answers |
---|---|---|---|---|---|---|---|
cosoco-mini 1.12 (complete) |
242 | 181 (74.79%) |
62 (25.62%) |
119 (49.17%) |
0 (0%) |
61 (25.21%) |
0 (0%) |
cosoco-mini 1.1 (2017-06-27) (complete) |
242 | 180 (74.38%) |
62 (25.62%) |
118 (48.76%) |
0 (0%) |
61 (25.21%) |
1 (0.41%) |
cosoco-mini 1.1 (2017-07-29) (complete) |
242 | 181 (74.79%) |
62 (25.62%) |
119 (49.17%) |
0 (0%) |
61 (25.21%) |
0 (0%) |
miniBTD 2017-06-30 (complete) |
242 | 162 (66.94%) |
58 (23.97%) |
104 (42.98%) |
0 (0%) |
79 (32.64%) |
1 (0.41%) |
miniBTD 2017-08-10 (complete) |
242 | 163 (67.36%) |
58 (23.97%) |
105 (43.39%) |
0 (0%) |
79 (32.64%) |
0 (0%) |
Naxos 1.1.0 (complete) |
242 | 143 (59.09%) |
41 (16.94%) |
102 (42.15%) |
0 (0%) |
99 (40.91%) |
0 (0%) |
Solver Name | Progress | cosoco-mini 1.12 (complete) |
|
cosoco-mini 1.1 (2017-06-27) (complete) |
|
cosoco-mini 1.1 (2017-07-29) (complete) |
|
miniBTD 2017-06-30 (complete) |
|
miniBTD 2017-08-10 (complete) |
|
Naxos 1.1.0 (complete) |
|
---|
Solver Name | #benchs | Solved | UNSAT | OPT/SAT | SAT (TO/MO) | UNKNOWN | Bad Answers |
---|---|---|---|---|---|---|---|
cosoco-mini 1.12 (complete) |
359 | 223 (62.12%) |
62 (17.27%) |
161 (44.85%) |
73 (20.33%) |
63 (17.55%) |
0 (0%) |
cosoco-mini 1.1 (2017-06-27) (complete) |
359 | 222 (61.84%) |
62 (17.27%) |
160 (44.57%) |
5 (1.39%) |
131 (36.49%) |
1 (0.28%) |
cosoco-mini 1.1 (2017-07-29) (complete) |
359 | 223 (62.12%) |
62 (17.27%) |
161 (44.85%) |
73 (20.33%) |
63 (17.55%) |
0 (0%) |
Naxos 1.1.0 (complete) |
359 | 176 (49.03%) |
41 (11.42%) |
135 (37.6%) |
60 (16.71%) |
123 (34.26%) |
0 (0%) |
Solver Name | Progress | cosoco-mini 1.12 (complete) |
|
cosoco-mini 1.1 (2017-06-27) (complete) |
|
cosoco-mini 1.1 (2017-07-29) (complete) |
|
Naxos 1.1.0 (complete) |
|
---|
This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.
Solver Name | #benchs | Solved | UNSAT | OPT/SAT | SAT (TO/MO) | UNKNOWN | Bad Answers |
---|---|---|---|---|---|---|---|
cosoco-mini 1.12 (complete) |
359 | 223 (62.12%) |
62 (17.27%) |
161 (44.85%) |
73 (20.33%) |
63 (17.55%) |
0 (0%) |
cosoco-mini 1.1 (2017-06-27) (complete) |
359 | 222 (61.84%) |
62 (17.27%) |
160 (44.57%) |
5 (1.39%) |
131 (36.49%) |
1 (0.28%) |
cosoco-mini 1.1 (2017-07-29) (complete) |
359 | 223 (62.12%) |
62 (17.27%) |
161 (44.85%) |
73 (20.33%) |
63 (17.55%) |
0 (0%) |
miniBTD 2017-06-30 (complete) |
242 | 162 (66.94%) |
58 (23.97%) |
104 (42.98%) |
0 (0%) |
79 (32.64%) |
1 (0.41%) |
miniBTD 2017-08-10 (complete) |
242 | 163 (67.36%) |
58 (23.97%) |
105 (43.39%) |
0 (0%) |
79 (32.64%) |
0 (0%) |
Naxos 1.1.0 (complete) |
359 | 176 (49.03%) |
41 (11.42%) |
135 (37.6%) |
60 (16.71%) |
123 (34.26%) |
0 (0%) |
Solver Name | Progress | cosoco-mini 1.12 (complete) |
|
cosoco-mini 1.1 (2017-06-27) (complete) |
|
cosoco-mini 1.1 (2017-07-29) (complete) |
|
miniBTD 2017-06-30 (complete) |
|
miniBTD 2017-08-10 (complete) |
|
Naxos 1.1.0 (complete) |
|
---|