solver | a "light red" background denotes a solver which was disqualified because it gave an incorrect answer, and which will not appear in the ranking |
solver | a "light yellow" background denotes a solver which was replaced by another version, and which will not appear in the ranking |
Solver Name | #benchs | Solved | UNSAT. | OPT | SAT | SAT (subopt.) | SAT (timeout) | SAT (out of mem.) | UNKNOWN | UNKNOWN (no support) | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | Sig. Caught | NO CERT. | WRONG CERT. | WRONG OPT. | WRONG UNSAT. | WRONG ANS. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Choco-solver 4.0.7b seq (e747e1e) (complete) |
346 | 89 (25.72%) |
0 (0%) |
89 (25.72%) |
0 (0%) |
0 (0%) |
193 (55.78%) |
0 (0%) |
4 (1.16%) |
0 (0%) |
60 (17.34%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Concrete 3.9.2 (complete) |
346 | 85 (24.57%) |
0 (0%) |
85 (24.57%) |
0 (0%) |
0 (0%) |
196 (56.65%) |
0 (0%) |
0 (0%) |
0 (0%) |
65 (18.79%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Concrete 3.9.2-SuperNG (complete) |
346 | 83 (23.99%) |
0 (0%) |
83 (23.99%) |
0 (0%) |
1 (0.29%) |
189 (54.62%) |
0 (0%) |
0 (0%) |
0 (0%) |
73 (21.1%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
cosoco 1.12 (complete) |
346 | 51 (14.74%) |
0 (0%) |
51 (14.74%) |
0 (0%) |
1 (0.29%) |
191 (55.2%) |
0 (0%) |
6 (1.73%) |
46 (13.29%) |
48 (13.87%) |
2 (0.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.29%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Mistral-2.0 2018-08-01 (complete) |
346 | 85 (24.57%) |
0 (0%) |
85 (24.57%) |
0 (0%) |
0 (0%) |
197 (56.94%) |
0 (0%) |
0 (0%) |
22 (6.36%) |
26 (7.51%) |
3 (0.87%) |
0 (0%) |
0 (0%) |
0 (0%) |
12 (3.47%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.29%) |
0 (0%) |
OscaR - Conflict Ordering with restarts 2018-08-14 (complete) |
346 | 0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
109 (31.5%) |
153 (44.22%) |
0 (0%) |
16 (4.62%) |
0 (0%) |
68 (19.65%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
OscaR - Conflict Ordering with restarts 2018-08-17 (complete) |
346 | 83 (23.99%) |
0 (0%) |
83 (23.99%) |
0 (0%) |
72 (20.81%) |
107 (30.92%) |
0 (0%) |
16 (4.62%) |
0 (0%) |
68 (19.65%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
OscaR - Hybrid 2018-08-14 (complete) |
346 | 59 (17.05%) |
0 (0%) |
59 (17.05%) |
0 (0%) |
0 (0%) |
212 (61.27%) |
0 (0%) |
9 (2.6%) |
0 (0%) |
66 (19.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Sat4j-CSP 2018-07-11 (complete) |
346 | 41 (11.85%) |
0 (0%) |
41 (11.85%) |
0 (0%) |
0 (0%) |
119 (34.39%) |
0 (0%) |
1 (0.29%) |
0 (0%) |
185 (53.47%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | Choco-solver 4.0.7b seq (e747e1e) (complete) |
|
Concrete 3.9.2 (complete) |
|
Concrete 3.9.2-SuperNG (complete) |
|
cosoco 1.12 (complete) |
|
Mistral-2.0 2018-08-01 (complete) |
|
OscaR - Conflict Ordering with restarts 2018-08-14 (complete) |
|
OscaR - Conflict Ordering with restarts 2018-08-17 (complete) |
|
OscaR - Hybrid 2018-08-14 (complete) |
|
Sat4j-CSP 2018-07-11 (complete) |
|
---|