solver | a "light red" background denotes a solver which was disqualified because it gave an incorrect answer, and which will not appear in the ranking |
solver | a "light yellow" background denotes a solver which was replaced by another version, and which will not appear in the ranking |
Solver Name | #benchs | Solved | UNSAT. | OPT | SAT | SAT (subopt.) | SAT (timeout) | SAT (out of mem.) | UNKNOWN | UNKNOWN (no support) | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | Sig. Caught | NO CERT. | WRONG CERT. | WRONG OPT. | WRONG UNSAT. | WRONG ANS. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Choco-solver 4.0.7 seq (493a269) (complete) |
346 | 99 (28.61%) |
0 (0%) |
99 (28.61%) |
0 (0%) |
0 (0%) |
201 (58.09%) |
0 (0%) |
9 (2.6%) |
0 (0%) |
28 (8.09%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.29%) |
8 (2.31%) |
0 (0%) |
Choco-solver 4.0.7b seq (e747e1e) (complete) |
346 | 102 (29.48%) |
0 (0%) |
102 (29.48%) |
0 (0%) |
0 (0%) |
206 (59.54%) |
0 (0%) |
9 (2.6%) |
0 (0%) |
29 (8.38%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Concrete 3.9.2 (complete) |
346 | 105 (30.35%) |
0 (0%) |
105 (30.35%) |
0 (0%) |
1 (0.29%) |
192 (55.49%) |
0 (0%) |
3 (0.87%) |
0 (0%) |
45 (13.01%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Concrete 3.9.2-SuperNG (complete) |
346 | 99 (28.61%) |
0 (0%) |
99 (28.61%) |
0 (0%) |
1 (0.29%) |
197 (56.94%) |
0 (0%) |
2 (0.58%) |
0 (0%) |
47 (13.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Concrete 3.8 2018-06-13 (complete) |
346 | 103 (29.77%) |
0 (0%) |
103 (29.77%) |
0 (0%) |
0 (0%) |
189 (54.62%) |
0 (0%) |
5 (1.45%) |
0 (0%) |
45 (13.01%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (1.16%) |
0 (0%) |
0 (0%) |
0 (0%) |
Concrete 3.8-SuperNG 2018-06-13 (complete) |
346 | 99 (28.61%) |
0 (0%) |
99 (28.61%) |
0 (0%) |
2 (0.58%) |
188 (54.34%) |
0 (0%) |
3 (0.87%) |
0 (0%) |
50 (14.45%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (1.16%) |
0 (0%) |
0 (0%) |
0 (0%) |
cosoco 1.12 (complete) |
346 | 64 (18.5%) |
0 (0%) |
64 (18.5%) |
0 (0%) |
1 (0.29%) |
193 (55.78%) |
0 (0%) |
6 (1.73%) |
46 (13.29%) |
33 (9.54%) |
2 (0.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.29%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Mistral-2.0 2018-06-15 (complete) |
346 | 105 (30.35%) |
0 (0%) |
105 (30.35%) |
0 (0%) |
0 (0%) |
169 (48.84%) |
0 (0%) |
0 (0%) |
19 (5.49%) |
24 (6.94%) |
6 (1.73%) |
0 (0%) |
0 (0%) |
0 (0%) |
11 (3.18%) |
0 (0%) |
0 (0%) |
0 (0%) |
12 (3.47%) |
0 (0%) |
Mistral-2.0 2018-08-01 (complete) |
346 | 106 (30.64%) |
0 (0%) |
106 (30.64%) |
0 (0%) |
0 (0%) |
178 (51.45%) |
0 (0%) |
0 (0%) |
22 (6.36%) |
24 (6.94%) |
3 (0.87%) |
0 (0%) |
0 (0%) |
0 (0%) |
12 (3.47%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.29%) |
0 (0%) |
OscaR - Conflict Ordering with restarts 2018-07-02 (complete) |
346 | 0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
6 (1.73%) |
265 (76.59%) |
0 (0%) |
11 (3.18%) |
0 (0%) |
58 (16.76%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
6 (1.73%) |
0 (0%) |
OscaR - Conflict Ordering with restarts 2018-08-14 (complete) |
346 | 0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (1.16%) |
277 (80.06%) |
0 (0%) |
11 (3.18%) |
0 (0%) |
54 (15.61%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
OscaR - Conflict Ordering with restarts 2018-08-17 (complete) |
346 | 99 (28.61%) |
0 (0%) |
99 (28.61%) |
0 (0%) |
1 (0.29%) |
177 (51.16%) |
0 (0%) |
12 (3.47%) |
0 (0%) |
57 (16.47%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
OscaR - Hybrid 2018-07-02 (complete) |
346 | 63 (18.21%) |
0 (0%) |
63 (18.21%) |
0 (0%) |
1 (0.29%) |
198 (57.23%) |
0 (0%) |
11 (3.18%) |
0 (0%) |
55 (15.9%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
9 (2.6%) |
9 (2.6%) |
0 (0%) |
OscaR - Hybrid 2018-08-14 (complete) |
346 | 61 (17.63%) |
0 (0%) |
61 (17.63%) |
0 (0%) |
0 (0%) |
215 (62.14%) |
0 (0%) |
10 (2.89%) |
0 (0%) |
60 (17.34%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
PicatSAT 2018-06-15 (complete) |
346 | 130 (37.57%) |
0 (0%) |
130 (37.57%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
204 (58.96%) |
1 (0.29%) |
9 (2.6%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
2 (0.58%) |
0 (0%) |
PicatSAT 2018-08-02 (complete) |
346 | 132 (38.15%) |
0 (0%) |
132 (38.15%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
203 (58.67%) |
2 (0.58%) |
8 (2.31%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.29%) |
0 (0%) |
0 (0%) |
0 (0%) |
PicatSAT 2018-08-14 (complete) |
346 | 132 (38.15%) |
0 (0%) |
132 (38.15%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
204 (58.96%) |
2 (0.58%) |
8 (2.31%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Sat4j-CSP 2018-07-11 (complete) |
346 | 54 (15.61%) |
0 (0%) |
54 (15.61%) |
0 (0%) |
0 (0%) |
111 (32.08%) |
0 (0%) |
69 (19.94%) |
0 (0%) |
99 (28.61%) |
0 (0%) |
0 (0%) |
0 (0%) |
13 (3.76%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | Choco-solver 4.0.7 seq (493a269) (complete) |
|
Choco-solver 4.0.7b seq (e747e1e) (complete) |
|
Concrete 3.9.2 (complete) |
|
Concrete 3.9.2-SuperNG (complete) |
|
Concrete 3.8 2018-06-13 (complete) |
|
Concrete 3.8-SuperNG 2018-06-13 (complete) |
|
cosoco 1.12 (complete) |
|
Mistral-2.0 2018-06-15 (complete) |
|
Mistral-2.0 2018-08-01 (complete) |
|
OscaR - Conflict Ordering with restarts 2018-07-02 (complete) |
|
OscaR - Conflict Ordering with restarts 2018-08-14 (complete) |
|
OscaR - Conflict Ordering with restarts 2018-08-17 (complete) |
|
OscaR - Hybrid 2018-07-02 (complete) |
|
OscaR - Hybrid 2018-08-14 (complete) |
|
PicatSAT 2018-06-15 (complete) |
|
PicatSAT 2018-08-02 (complete) |
|
PicatSAT 2018-08-14 (complete) |
|
Sat4j-CSP 2018-07-11 (complete) |
|
---|
Solver Name | #benchs | Solved | UNSAT. | OPT | SAT | SAT (subopt.) | SAT (timeout) | SAT (out of mem.) | UNKNOWN | UNKNOWN (no support) | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | Sig. Caught | NO CERT. | WRONG CERT. | WRONG OPT. | WRONG UNSAT. | WRONG ANS. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
BTD 2018.06.11_3 (complete) |
236 | 80 (33.9%) |
50 (21.19%) |
0 (0%) |
30 (12.71%) |
0 (0%) |
0 (0%) |
0 (0%) |
13 (5.51%) |
73 (30.93%) |
69 (29.24%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.42%) |
0 (0%) |
BTD 2018.07.27_3 (complete) |
236 | 76 (32.2%) |
45 (19.07%) |
0 (0%) |
31 (13.14%) |
0 (0%) |
0 (0%) |
0 (0%) |
16 (6.78%) |
73 (30.93%) |
71 (30.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
BTD_12 2018-06-11_12 (complete) |
236 | 80 (33.9%) |
49 (20.76%) |
0 (0%) |
31 (13.14%) |
0 (0%) |
0 (0%) |
0 (0%) |
23 (9.75%) |
73 (30.93%) |
59 (25%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.42%) |
0 (0%) |
BTD_12 2018.07.27_12 (complete) |
236 | 77 (32.63%) |
45 (19.07%) |
0 (0%) |
32 (13.56%) |
0 (0%) |
0 (0%) |
0 (0%) |
22 (9.32%) |
73 (30.93%) |
64 (27.12%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Choco-solver 4.0.7 seq (493a269) (complete) |
236 | 115 (48.73%) |
38 (16.1%) |
0 (0%) |
77 (32.63%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
121 (51.27%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Choco-solver 4.0.7b seq (e747e1e) (complete) |
236 | 115 (48.73%) |
38 (16.1%) |
0 (0%) |
77 (32.63%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
121 (51.27%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Concrete 3.9.2 (complete) |
236 | 92 (38.98%) |
28 (11.86%) |
0 (0%) |
64 (27.12%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
144 (61.02%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Concrete 3.9.2-SuperNG (complete) |
236 | 84 (35.59%) |
29 (12.29%) |
0 (0%) |
55 (23.31%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
152 (64.41%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Concrete 3.8 2018-06-13 (complete) |
236 | 95 (40.25%) |
30 (12.71%) |
0 (0%) |
65 (27.54%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
141 (59.75%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Concrete 3.8-SuperNG 2018-06-13 (complete) |
236 | 86 (36.44%) |
28 (11.86%) |
0 (0%) |
58 (24.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
150 (63.56%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
cosoco 1.12 (complete) |
236 | 79 (33.47%) |
26 (11.02%) |
0 (0%) |
53 (22.46%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
12 (5.08%) |
144 (61.02%) |
1 (0.42%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
macht 2018.06.11 (complete) |
236 | 70 (29.66%) |
38 (16.1%) |
0 (0%) |
32 (13.56%) |
0 (0%) |
0 (0%) |
0 (0%) |
16 (6.78%) |
73 (30.93%) |
76 (32.2%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.42%) |
0 (0%) |
macht 2018.07.27 (complete) |
236 | 66 (27.97%) |
33 (13.98%) |
0 (0%) |
33 (13.98%) |
0 (0%) |
0 (0%) |
0 (0%) |
6 (2.54%) |
73 (30.93%) |
91 (38.56%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Mistral-2.0 2018-06-15 (complete) |
236 | 115 (48.73%) |
37 (15.68%) |
0 (0%) |
78 (33.05%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
121 (51.27%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Mistral-2.0 2018-08-01 (complete) |
236 | 116 (49.15%) |
36 (15.25%) |
0 (0%) |
80 (33.9%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
120 (50.85%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
OscaR - Conflict Ordering 2018-07-02 (complete) |
236 | 81 (34.32%) |
30 (12.71%) |
0 (0%) |
51 (21.61%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.42%) |
0 (0%) |
154 (65.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
OscaR - Conflict Ordering 2018-08-14 (complete) |
236 | 82 (34.75%) |
30 (12.71%) |
0 (0%) |
52 (22.03%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
154 (65.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
OscaR - Conflict Ordering with restarts 2018-07-02 (complete) |
236 | 60 (25.42%) |
0 (0%) |
0 (0%) |
60 (25.42%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
176 (74.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
OscaR - Conflict Ordering with restarts 2018-08-14 (complete) |
236 | 60 (25.42%) |
0 (0%) |
0 (0%) |
60 (25.42%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
176 (74.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
OscaR - Conflict Ordering with restarts 2018-08-17 (complete) |
236 | 90 (38.14%) |
28 (11.86%) |
0 (0%) |
62 (26.27%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.42%) |
0 (0%) |
145 (61.44%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
PicatSAT 2018-06-15 (complete) |
236 | 137 (58.05%) |
53 (22.46%) |
0 (0%) |
84 (35.59%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
99 (41.95%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
PicatSAT 2018-08-02 (complete) |
236 | 137 (58.05%) |
53 (22.46%) |
0 (0%) |
84 (35.59%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
99 (41.95%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
PicatSAT 2018-08-14 (complete) |
236 | 138 (58.47%) |
53 (22.46%) |
0 (0%) |
85 (36.02%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
98 (41.53%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Sat4j-CSP 2018-07-11 (complete) |
236 | 83 (35.17%) |
43 (18.22%) |
0 (0%) |
40 (16.95%) |
0 (0%) |
0 (0%) |
0 (0%) |
23 (9.75%) |
0 (0%) |
129 (54.66%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.42%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
scop both+MapleCOMSPS (2018-06-13) (complete) |
236 | 123 (52.12%) |
52 (22.03%) |
0 (0%) |
71 (30.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
47 (19.92%) |
66 (27.97%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
scop both+MapleCOMSPS (2018-07-31) (complete) |
236 | 141 (59.75%) |
53 (22.46%) |
0 (0%) |
88 (37.29%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
95 (40.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
scop order+MapleCOMSPS (2018-06-13) (complete) |
236 | 123 (52.12%) |
53 (22.46%) |
0 (0%) |
70 (29.66%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
44 (18.64%) |
69 (29.24%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
scop order+MapleCOMSPS (2018-07-31) (complete) |
236 | 146 (61.86%) |
54 (22.88%) |
0 (0%) |
92 (38.98%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
88 (37.29%) |
2 (0.85%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | BTD 2018.06.11_3 (complete) |
|
BTD 2018.07.27_3 (complete) |
|
BTD_12 2018-06-11_12 (complete) |
|
BTD_12 2018.07.27_12 (complete) |
|
Choco-solver 4.0.7 seq (493a269) (complete) |
|
Choco-solver 4.0.7b seq (e747e1e) (complete) |
|
Concrete 3.9.2 (complete) |
|
Concrete 3.9.2-SuperNG (complete) |
|
Concrete 3.8 2018-06-13 (complete) |
|
Concrete 3.8-SuperNG 2018-06-13 (complete) |
|
cosoco 1.12 (complete) |
|
macht 2018.06.11 (complete) |
|
macht 2018.07.27 (complete) |
|
Mistral-2.0 2018-06-15 (complete) |
|
Mistral-2.0 2018-08-01 (complete) |
|
OscaR - Conflict Ordering 2018-07-02 (complete) |
|
OscaR - Conflict Ordering 2018-08-14 (complete) |
|
OscaR - Conflict Ordering with restarts 2018-07-02 (complete) |
|
OscaR - Conflict Ordering with restarts 2018-08-14 (complete) |
|
OscaR - Conflict Ordering with restarts 2018-08-17 (complete) |
|
PicatSAT 2018-06-15 (complete) |
|
PicatSAT 2018-08-02 (complete) |
|
PicatSAT 2018-08-14 (complete) |
|
Sat4j-CSP 2018-07-11 (complete) |
|
scop both+MapleCOMSPS (2018-06-13) (complete) |
|
scop both+MapleCOMSPS (2018-07-31) (complete) |
|
scop order+MapleCOMSPS (2018-06-13) (complete) |
|
scop order+MapleCOMSPS (2018-07-31) (complete) |
|
---|
Solver Name | Progress | Choco-solver 4.0.7 seq (493a269) (complete) |
|
Choco-solver 4.0.7b seq (e747e1e) (complete) |
|
Concrete 3.9.2 (complete) |
|
Concrete 3.9.2-SuperNG (complete) |
|
Concrete 3.8 2018-06-13 (complete) |
|
Concrete 3.8-SuperNG 2018-06-13 (complete) |
|
cosoco 1.12 (complete) |
|
Mistral-2.0 2018-06-15 (complete) |
|
Mistral-2.0 2018-08-01 (complete) |
|
OscaR - Conflict Ordering with restarts 2018-07-02 (complete) |
|
OscaR - Conflict Ordering with restarts 2018-08-14 (complete) |
|
OscaR - Conflict Ordering with restarts 2018-08-17 (complete) |
|
PicatSAT 2018-06-15 (complete) |
|
PicatSAT 2018-08-02 (complete) |
|
PicatSAT 2018-08-14 (complete) |
|
Sat4j-CSP 2018-07-11 (complete) |
|
---|
This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.
Solver Name | Progress | BTD 2018.06.11_3 (complete) |
|
BTD 2018.07.27_3 (complete) |
|
BTD_12 2018-06-11_12 (complete) |
|
BTD_12 2018.07.27_12 (complete) |
|
Choco-solver 4.0.7 seq (493a269) (complete) |
|
Choco-solver 4.0.7b seq (e747e1e) (complete) |
|
Concrete 3.9.2 (complete) |
|
Concrete 3.9.2-SuperNG (complete) |
|
Concrete 3.8 2018-06-13 (complete) |
|
Concrete 3.8-SuperNG 2018-06-13 (complete) |
|
cosoco 1.12 (complete) |
|
macht 2018.06.11 (complete) |
|
macht 2018.07.27 (complete) |
|
Mistral-2.0 2018-06-15 (complete) |
|
Mistral-2.0 2018-08-01 (complete) |
|
OscaR - Conflict Ordering 2018-07-02 (complete) |
|
OscaR - Conflict Ordering 2018-08-14 (complete) |
|
OscaR - Conflict Ordering with restarts 2018-07-02 (complete) |
|
OscaR - Conflict Ordering with restarts 2018-08-14 (complete) |
|
OscaR - Conflict Ordering with restarts 2018-08-17 (complete) |
|
OscaR - Hybrid 2018-07-02 (complete) |
|
OscaR - Hybrid 2018-08-14 (complete) |
|
PicatSAT 2018-06-15 (complete) |
|
PicatSAT 2018-08-02 (complete) |
|
PicatSAT 2018-08-14 (complete) |
|
Sat4j-CSP 2018-07-11 (complete) |
|
scop both+MapleCOMSPS (2018-06-13) (complete) |
|
scop both+MapleCOMSPS (2018-07-31) (complete) |
|
scop order+MapleCOMSPS (2018-06-13) (complete) |
|
scop order+MapleCOMSPS (2018-07-31) (complete) |
|
---|