Solver Name | Progress | borg-sat 11.03.02-industrial [DEPRECATED] (complete) |
|
borg-sat 11.03.02-par-industrial (fixed) (complete) |
|
borg-sat 11.03.02-seq-industrial (fixed) (complete) |
|
claspmt 2.0-R4095 [DEPRECATED] (complete) |
|
claspmt 2.0-R4095-patched (fixed) (complete) |
|
CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night-2-mt (fixed) (complete) |
|
CryptoMiniSat Strange-Night2-st (fixed) (complete) |
|
EBGlucose 1.0 (incomplete) |
|
glucose 2 (complete) |
|
glueminisat 2.2.5 (complete) |
|
Lingeling 587 [DEPRECATED] (complete) |
|
Lingeling 587f (fixed) (complete) |
|
minisat hack: cir_minisat 2011-05-13 (simp) (complete) |
|
minisat hack: contrasat 2011-03-02 (complete) |
|
minisat hack: EBMiniSAT 2011-03-02 (incomplete) |
|
minisat hack: LR_GL_SHR 2011-03-02 (complete) |
|
minisat hack: MiniSAT 2.2.0-agile-26 (complete) |
|
minisat hack: minisat_psm 2011-04-01 (complete) |
|
minisat hack reference: minisat 2.2.0 (complete) |
|
MPhaseSAT64 2011-05-14 (fixed) (complete) |
|
Plingeling 587 [DEPRECATED] (complete) |
|
Plingeling 587f (fixed) (complete) |
|
ppfolio par (complete) |
|
QuteRSat 2011-05-12 (fixed) (complete) |
|
rcl 2011-04-01 (complete) |
|
RestartSAT B95 (complete) |
|
SAT09 reference solver:glucose 1.0 (complete) |
|
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20 (complete) |
|
SAT09 reference solver:precosat 236 (complete) |
|
Satisfiability Solver Selector 2011-03-18 (complete) |
|
---|
Solver Name | #benchs | Solved | UNSAT. | SAT. | SAT (timeout) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | UNKNOWN (abort) | Sig. Caught | NO CERT. | WRONG CERT. | WRONG UNSAT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
clasp 2.0-R4092-crafted (complete) |
300 | 149 (49.67%) |
62 (20.67%) |
87 (29%) |
0 (0%) |
0 (0%) |
151 (50.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
claspmt 2.0-R4095 [DEPRECATED] (complete) |
300 | 167 (55.67%) |
69 (23%) |
98 (32.67%) |
0 (0%) |
0 (0%) |
128 (42.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
5 (1.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
claspmt 2.0-R4095-patched (fixed) (complete) |
300 | 170 (56.67%) |
70 (23.33%) |
100 (33.33%) |
0 (0%) |
0 (0%) |
126 (42%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (1.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-2-mt (fixed) (complete) |
300 | 131 (43.67%) |
45 (15%) |
86 (28.67%) |
0 (0%) |
0 (0%) |
169 (56.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night2-st (fixed) (complete) |
300 | 110 (36.67%) |
40 (13.33%) |
70 (23.33%) |
0 (0%) |
0 (0%) |
190 (63.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
glucose 2 (complete) |
300 | 125 (41.67%) |
42 (14%) |
83 (27.67%) |
0 (0%) |
0 (0%) |
175 (58.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
jMiniSat 2011 (complete) |
300 | 98 (32.67%) |
28 (9.33%) |
70 (23.33%) |
0 (0%) |
0 (0%) |
202 (67.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT 2011-02-15 (complete) |
300 | 132 (44%) |
39 (13%) |
93 (31%) |
0 (0%) |
0 (0%) |
168 (56%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
PicoSAT 941 (complete) |
300 | 121 (40.33%) |
40 (13.33%) |
81 (27%) |
0 (0%) |
0 (0%) |
179 (59.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Plingeling 587f (fixed) (complete) |
300 | 131 (43.67%) |
40 (13.33%) |
91 (30.33%) |
0 (0%) |
0 (0%) |
169 (56.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ppfolio par (complete) |
300 | 187 (62.33%) |
60 (20%) |
127 (42.33%) |
0 (0%) |
0 (0%) |
113 (37.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ppfolio seq (complete) |
300 | 152 (50.67%) |
38 (12.67%) |
114 (38%) |
0 (0%) |
0 (0%) |
144 (48%) |
4 (1.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
priss 1.0 (complete) |
300 | 104 (34.67%) |
31 (10.33%) |
73 (24.33%) |
0 (0%) |
0 (0%) |
194 (64.67%) |
0 (0%) |
2 (0.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
QuteRSat 2011-05-12 (fixed) (complete) |
300 | 110 (36.67%) |
40 (13.33%) |
70 (23.33%) |
0 (0%) |
0 (0%) |
190 (63.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
RestartSAT B95 (complete) |
300 | 112 (37.33%) |
35 (11.67%) |
77 (25.67%) |
0 (0%) |
0 (0%) |
188 (62.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SApperloT2010 2011-05-15 (fixed) (complete) |
300 | 109 (36.33%) |
33 (11%) |
76 (25.33%) |
0 (0%) |
0 (0%) |
191 (63.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SArTagnan 2011-05-15 (fixed) (complete) |
300 | 148 (49.33%) |
47 (15.67%) |
101 (33.67%) |
0 (0%) |
0 (0%) |
147 (49%) |
0 (0%) |
5 (1.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT07 reference solver: minisat SAT 2007 (complete) |
300 | 122 (40.67%) |
44 (14.67%) |
78 (26%) |
0 (0%) |
0 (0%) |
178 (59.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: clasp 1.2.0-SAT09-32 (complete) |
300 | 149 (49.67%) |
64 (21.33%) |
85 (28.33%) |
0 (0%) |
0 (0%) |
151 (50.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: SATzilla2009_C 2009-03-22 (complete) |
300 | 116 (38.67%) |
43 (14.33%) |
73 (24.33%) |
0 (0%) |
0 (0%) |
5 (1.67%) |
0 (0%) |
179 (59.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sathys 2011-04-01 (complete) |
300 | 96 (32%) |
23 (7.67%) |
73 (24.33%) |
0 (0%) |
0 (0%) |
204 (68%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Satisfiability Solver Selector 2011-03-18 (complete) |
300 | 163 (54.33%) |
51 (17%) |
112 (37.33%) |
0 (0%) |
0 (0%) |
137 (45.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sattime 2011-03-02 (incomplete) |
300 | 109 (36.33%) |
0 (0%) |
109 (36.33%) |
0 (0%) |
0 (0%) |
191 (63.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sattime+ 2011-03-02 (incomplete) |
300 | 106 (35.33%) |
0 (0%) |
106 (35.33%) |
0 (0%) |
0 (0%) |
194 (64.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Sol 2011-04-04 (complete) |
300 | 116 (38.67%) |
37 (12.33%) |
79 (26.33%) |
0 (0%) |
0 (0%) |
181 (60.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
3 (1%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | clasp 2.0-R4092-crafted (complete) |
|
claspmt 2.0-R4095 [DEPRECATED] (complete) |
|
claspmt 2.0-R4095-patched (fixed) (complete) |
|
CryptoMiniSat Strange-Night-2-mt (fixed) (complete) |
|
CryptoMiniSat Strange-Night2-st (fixed) (complete) |
|
glucose 2 (complete) |
|
jMiniSat 2011 (complete) |
|
MPhaseSAT 2011-02-15 (complete) |
|
PicoSAT 941 (complete) |
|
Plingeling 587f (fixed) (complete) |
|
ppfolio par (complete) |
|
ppfolio seq (complete) |
|
priss 1.0 (complete) |
|
QuteRSat 2011-05-12 (fixed) (complete) |
|
RestartSAT B95 (complete) |
|
SApperloT2010 2011-05-15 (fixed) (complete) |
|
SArTagnan 2011-05-15 (fixed) (complete) |
|
SAT07 reference solver: minisat SAT 2007 (complete) |
|
SAT09 reference solver: clasp 1.2.0-SAT09-32 (complete) |
|
SAT09 reference solver: SATzilla2009_C 2009-03-22 (complete) |
|
sathys 2011-04-01 (complete) |
|
Satisfiability Solver Selector 2011-03-18 (complete) |
|
sattime 2011-03-02 (incomplete) |
|
sattime+ 2011-03-02 (incomplete) |
|
Sol 2011-04-04 (complete) |
|
---|
Solver Name | #benchs | Solved | UNSAT. | SAT. | SAT (timeout) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | UNKNOWN (abort) | Sig. Caught | NO CERT. | WRONG CERT. | WRONG UNSAT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ppfolio par (complete) |
1200 | 860 (71.67%) |
304 (25.33%) |
556 (46.33%) |
0 (0%) |
0 (0%) |
334 (27.83%) |
6 (0.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Satisfiability Solver Selector 2011-03-18 (complete) |
1200 | 771 (64.25%) |
256 (21.33%) |
515 (42.92%) |
0 (0%) |
0 (0%) |
429 (35.75%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | ppfolio par (complete) |
|
Satisfiability Solver Selector 2011-03-18 (complete) |
|
---|
This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.
Solver Name | #benchs | Solved | UNSAT. | SAT. | SAT (timeout) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | UNKNOWN (abort) | Sig. Caught | NO CERT. | WRONG CERT. | WRONG UNSAT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
adaptg2wsat2011 2011-03-02 (incomplete) |
600 | 328 (54.67%) |
0 (0%) |
328 (54.67%) |
0 (0%) |
0 (0%) |
272 (45.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
borg-sat 11.03.02-industrial [DEPRECATED] (complete) |
300 | 196 (65.33%) |
105 (35%) |
91 (30.33%) |
0 (0%) |
0 (0%) |
57 (19%) |
37 (12.33%) |
10 (3.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
borg-sat 11.03.02-par-industrial (fixed) (complete) |
300 | 195 (65%) |
105 (35%) |
90 (30%) |
0 (0%) |
51 (17%) |
6 (2%) |
37 (12.33%) |
11 (3.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
borg-sat 11.03.02-par-random (fixed) (complete) |
600 | 363 (60.5%) |
112 (18.67%) |
251 (41.83%) |
0 (0%) |
54 (9%) |
16 (2.67%) |
95 (15.83%) |
70 (11.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
2 (0.33%) |
0 (0%) |
borg-sat 11.03.02-random [DEPRECATED] (complete) |
600 | 347 (57.83%) |
110 (18.33%) |
237 (39.5%) |
0 (0%) |
0 (0%) |
77 (12.83%) |
98 (16.33%) |
76 (12.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
2 (0.33%) |
0 (0%) |
borg-sat 11.03.02-seq-industrial (fixed) (complete) |
300 | 190 (63.33%) |
100 (33.33%) |
90 (30%) |
0 (0%) |
0 (0%) |
87 (29%) |
23 (7.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
borg-sat 11.03.02-seq-random (fixed) (complete) |
600 | 415 (69.17%) |
111 (18.5%) |
304 (50.67%) |
0 (0%) |
1 (0.17%) |
107 (17.83%) |
72 (12%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
5 (0.83%) |
0 (0%) |
clasp 2.0-R4092-crafted (complete) |
300 | 149 (49.67%) |
62 (20.67%) |
87 (29%) |
0 (0%) |
0 (0%) |
151 (50.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
claspmt 2.0-R4095 [DEPRECATED] (complete) |
600 | 376 (62.67%) |
181 (30.17%) |
195 (32.5%) |
0 (0%) |
0 (0%) |
206 (34.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
10 (1.67%) |
0 (0%) |
8 (1.33%) |
0 (0%) |
claspmt 2.0-R4095-patched (fixed) (complete) |
600 | 382 (63.67%) |
187 (31.17%) |
195 (32.5%) |
0 (0%) |
0 (0%) |
208 (34.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
10 (1.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete) |
300 | 224 (74.67%) |
127 (42.33%) |
97 (32.33%) |
0 (0%) |
0 (0%) |
60 (20%) |
12 (4%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (1.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-2-mt (fixed) (complete) |
600 | 361 (60.17%) |
178 (29.67%) |
183 (30.5%) |
0 (0%) |
0 (0%) |
226 (37.67%) |
12 (2%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night2-st (fixed) (complete) |
600 | 317 (52.83%) |
159 (26.5%) |
158 (26.33%) |
0 (0%) |
0 (0%) |
274 (45.67%) |
9 (1.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
csls pnorm-8cores (incomplete) |
600 | 335 (55.83%) |
0 (0%) |
335 (55.83%) |
0 (0%) |
0 (0%) |
165 (27.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
100 (16.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
EagleUP 1.565.350 (incomplete) |
600 | 328 (54.67%) |
0 (0%) |
328 (54.67%) |
0 (0%) |
0 (0%) |
272 (45.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
EBGlucose 1.0 (incomplete) |
300 | 199 (66.33%) |
108 (36%) |
91 (30.33%) |
0 (0%) |
0 (0%) |
101 (33.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
glucose 2 (complete) |
600 | 340 (56.67%) |
163 (27.17%) |
177 (29.5%) |
0 (0%) |
0 (0%) |
260 (43.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
glueminisat 2.2.5 (complete) |
300 | 211 (70.33%) |
126 (42%) |
85 (28.33%) |
0 (0%) |
0 (0%) |
89 (29.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
jMiniSat 2011 (complete) |
300 | 98 (32.67%) |
28 (9.33%) |
70 (23.33%) |
0 (0%) |
0 (0%) |
202 (67.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Lingeling 587 [DEPRECATED] (complete) |
300 | 208 (69.33%) |
117 (39%) |
91 (30.33%) |
0 (0%) |
0 (0%) |
91 (30.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
Lingeling 587f (fixed) (complete) |
300 | 208 (69.33%) |
117 (39%) |
91 (30.33%) |
0 (0%) |
0 (0%) |
92 (30.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
march_rw 2011-03-02 (complete) |
600 | 251 (41.83%) |
123 (20.5%) |
128 (21.33%) |
0 (0%) |
0 (0%) |
349 (58.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack: cir_minisat 2011-05-13 (simp) (complete) |
300 | 202 (67.33%) |
103 (34.33%) |
99 (33%) |
0 (0%) |
0 (0%) |
94 (31.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (1.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack: contrasat 2011-03-02 (complete) |
300 | 199 (66.33%) |
100 (33.33%) |
99 (33%) |
0 (0%) |
0 (0%) |
96 (32%) |
0 (0%) |
5 (1.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack: EBMiniSAT 2011-03-02 (incomplete) |
300 | 196 (65.33%) |
98 (32.67%) |
98 (32.67%) |
0 (0%) |
0 (0%) |
100 (33.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (1.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack: LR_GL_SHR 2011-03-02 (complete) |
300 | 191 (63.67%) |
110 (36.67%) |
81 (27%) |
0 (0%) |
0 (0%) |
109 (36.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack: MiniSAT 2.2.0-agile-26 (complete) |
300 | 189 (63%) |
94 (31.33%) |
95 (31.67%) |
0 (0%) |
0 (0%) |
108 (36%) |
0 (0%) |
0 (0%) |
0 (0%) |
3 (1%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack: minisat_psm 2011-04-01 (complete) |
300 | 197 (65.67%) |
102 (34%) |
95 (31.67%) |
0 (0%) |
0 (0%) |
103 (34.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack reference: minisat 2.2.0 (complete) |
300 | 194 (64.67%) |
99 (33%) |
95 (31.67%) |
0 (0%) |
0 (0%) |
102 (34%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (1.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT 2011-02-15 (complete) |
300 | 132 (44%) |
39 (13%) |
93 (31%) |
0 (0%) |
0 (0%) |
168 (56%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT64 2011-05-14 (fixed) (complete) |
300 | 201 (67%) |
102 (34%) |
99 (33%) |
0 (0%) |
0 (0%) |
98 (32.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT_M 2011-02-16 (complete) |
600 | 359 (59.83%) |
104 (17.33%) |
255 (42.5%) |
0 (0%) |
0 (0%) |
241 (40.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
PicoSAT 941 (complete) |
300 | 121 (40.33%) |
40 (13.33%) |
81 (27%) |
0 (0%) |
0 (0%) |
179 (59.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Plingeling 587 [DEPRECATED] (complete) |
300 | 230 (76.67%) |
124 (41.33%) |
106 (35.33%) |
0 (0%) |
0 (0%) |
66 (22%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (1.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
Plingeling 587f (fixed) (complete) |
600 | 361 (60.17%) |
164 (27.33%) |
197 (32.83%) |
0 (0%) |
0 (0%) |
238 (39.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ppfolio par (complete) |
1200 | 860 (71.67%) |
304 (25.33%) |
556 (46.33%) |
0 (0%) |
0 (0%) |
334 (27.83%) |
6 (0.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ppfolio seq (complete) |
900 | 527 (58.56%) |
105 (11.67%) |
422 (46.89%) |
0 (0%) |
0 (0%) |
367 (40.78%) |
6 (0.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
priss 1.0 (complete) |
300 | 104 (34.67%) |
31 (10.33%) |
73 (24.33%) |
0 (0%) |
0 (0%) |
194 (64.67%) |
0 (0%) |
2 (0.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
QuteRSat 2011-05-12 (fixed) (complete) |
600 | 316 (52.67%) |
160 (26.67%) |
156 (26%) |
0 (0%) |
0 (0%) |
283 (47.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
rcl 2011-04-01 (complete) |
300 | 184 (61.33%) |
91 (30.33%) |
93 (31%) |
0 (0%) |
0 (0%) |
116 (38.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
RestartSAT B95 (complete) |
600 | 313 (52.17%) |
139 (23.17%) |
174 (29%) |
0 (0%) |
0 (0%) |
287 (47.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SApperloT2010 2011-05-15 (fixed) (complete) |
300 | 109 (36.33%) |
33 (11%) |
76 (25.33%) |
0 (0%) |
0 (0%) |
191 (63.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SArTagnan 2011-05-15 (fixed) (complete) |
300 | 148 (49.33%) |
47 (15.67%) |
101 (33.67%) |
0 (0%) |
0 (0%) |
147 (49%) |
0 (0%) |
5 (1.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT07 reference solver: minisat SAT 2007 (complete) |
300 | 122 (40.67%) |
44 (14.67%) |
78 (26%) |
0 (0%) |
0 (0%) |
178 (59.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: clasp 1.2.0-SAT09-32 (complete) |
300 | 149 (49.67%) |
64 (21.33%) |
85 (28.33%) |
0 (0%) |
0 (0%) |
151 (50.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver:glucose 1.0 (complete) |
300 | 197 (65.67%) |
110 (36.67%) |
87 (29%) |
0 (0%) |
0 (0%) |
103 (34.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: gnovelty+2 2009-03-22 (incomplete) |
600 | 298 (49.67%) |
0 (0%) |
298 (49.67%) |
0 (0%) |
0 (0%) |
302 (50.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20 (complete) |
300 | 194 (64.67%) |
109 (36.33%) |
85 (28.33%) |
0 (0%) |
0 (0%) |
64 (21.33%) |
0 (0%) |
42 (14%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: march_hi hi (complete) |
600 | 251 (41.83%) |
123 (20.5%) |
128 (21.33%) |
0 (0%) |
0 (0%) |
349 (58.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver:precosat 236 (complete) |
300 | 206 (68.67%) |
110 (36.67%) |
96 (32%) |
0 (0%) |
0 (0%) |
90 (30%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (1.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: SATzilla2009_C 2009-03-22 (complete) |
300 | 116 (38.67%) |
43 (14.33%) |
73 (24.33%) |
0 (0%) |
0 (0%) |
5 (1.67%) |
0 (0%) |
179 (59.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: SATzilla2009_R 2009-03-22 (complete) |
600 | 384 (64%) |
97 (16.17%) |
287 (47.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
216 (36%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: TNM 2009-03-22 (incomplete) |
600 | 324 (54%) |
0 (0%) |
324 (54%) |
0 (0%) |
0 (0%) |
276 (46%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sathys 2011-04-01 (complete) |
300 | 96 (32%) |
23 (7.67%) |
73 (24.33%) |
0 (0%) |
0 (0%) |
204 (68%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Satisfiability Solver Selector 2011-03-18 (complete) |
1200 | 771 (64.25%) |
256 (21.33%) |
515 (42.92%) |
0 (0%) |
0 (0%) |
429 (35.75%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sattime 2011-03-02 (incomplete) |
300 | 109 (36.33%) |
0 (0%) |
109 (36.33%) |
0 (0%) |
0 (0%) |
191 (63.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sattime+ 2011-03-02 (incomplete) |
300 | 106 (35.33%) |
0 (0%) |
106 (35.33%) |
0 (0%) |
0 (0%) |
194 (64.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sattime2011 2011-03-02 (incomplete) |
600 | 334 (55.67%) |
0 (0%) |
334 (55.67%) |
0 (0%) |
0 (0%) |
266 (44.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Sol 2011-04-04 (complete) |
300 | 116 (38.67%) |
37 (12.33%) |
79 (26.33%) |
0 (0%) |
0 (0%) |
181 (60.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
3 (1%) |
0 (0%) |
0 (0%) |
0 (0%) |
sparrow2011 sparrow2011_ubcsat1.2_2011-03-02 (incomplete) |
600 | 362 (60.33%) |
0 (0%) |
362 (60.33%) |
0 (0%) |
0 (0%) |
238 (39.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | adaptg2wsat2011 2011-03-02 (incomplete) |
|
borg-sat 11.03.02-industrial [DEPRECATED] (complete) |
|
borg-sat 11.03.02-par-industrial (fixed) (complete) |
|
borg-sat 11.03.02-par-random (fixed) (complete) |
|
borg-sat 11.03.02-random [DEPRECATED] (complete) |
|
borg-sat 11.03.02-seq-industrial (fixed) (complete) |
|
borg-sat 11.03.02-seq-random (fixed) (complete) |
|
clasp 2.0-R4092-crafted (complete) |
|
claspmt 2.0-R4095 [DEPRECATED] (complete) |
|
claspmt 2.0-R4095-patched (fixed) (complete) |
|
CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night-2-mt (fixed) (complete) |
|
CryptoMiniSat Strange-Night2-st (fixed) (complete) |
|
csls pnorm-8cores (incomplete) |
|
EagleUP 1.565.350 (incomplete) |
|
EBGlucose 1.0 (incomplete) |
|
glucose 2 (complete) |
|
glueminisat 2.2.5 (complete) |
|
jMiniSat 2011 (complete) |
|
Lingeling 587 [DEPRECATED] (complete) |
|
Lingeling 587f (fixed) (complete) |
|
march_rw 2011-03-02 (complete) |
|
minisat hack: cir_minisat 2011-05-13 (simp) (complete) |
|
minisat hack: contrasat 2011-03-02 (complete) |
|
minisat hack: EBMiniSAT 2011-03-02 (incomplete) |
|
minisat hack: LR_GL_SHR 2011-03-02 (complete) |
|
minisat hack: MiniSAT 2.2.0-agile-26 (complete) |
|
minisat hack: minisat_psm 2011-04-01 (complete) |
|
minisat hack reference: minisat 2.2.0 (complete) |
|
MPhaseSAT 2011-02-15 (complete) |
|
MPhaseSAT64 2011-05-14 (fixed) (complete) |
|
MPhaseSAT_M 2011-02-16 (complete) |
|
PicoSAT 941 (complete) |
|
Plingeling 587 [DEPRECATED] (complete) |
|
Plingeling 587f (fixed) (complete) |
|
ppfolio par (complete) |
|
ppfolio seq (complete) |
|
priss 1.0 (complete) |
|
QuteRSat 2011-05-12 (fixed) (complete) |
|
rcl 2011-04-01 (complete) |
|
RestartSAT B95 (complete) |
|
SApperloT2010 2011-05-15 (fixed) (complete) |
|
SArTagnan 2011-05-15 (fixed) (complete) |
|
SAT07 reference solver: minisat SAT 2007 (complete) |
|
SAT09 reference solver: clasp 1.2.0-SAT09-32 (complete) |
|
SAT09 reference solver:glucose 1.0 (complete) |
|
SAT09 reference solver: gnovelty+2 2009-03-22 (incomplete) |
|
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20 (complete) |
|
SAT09 reference solver: march_hi hi (complete) |
|
SAT09 reference solver:precosat 236 (complete) |
|
SAT09 reference solver: SATzilla2009_C 2009-03-22 (complete) |
|
SAT09 reference solver: SATzilla2009_R 2009-03-22 (complete) |
|
SAT09 reference solver: TNM 2009-03-22 (incomplete) |
|
sathys 2011-04-01 (complete) |
|
Satisfiability Solver Selector 2011-03-18 (complete) |
|
sattime 2011-03-02 (incomplete) |
|
sattime+ 2011-03-02 (incomplete) |
|
sattime2011 2011-03-02 (incomplete) |
|
Sol 2011-04-04 (complete) |
|
sparrow2011 sparrow2011_ubcsat1.2_2011-03-02 (incomplete) |
|
---|