Solver Name | Progress | adaptg2wsat2011 2011-03-02 (incomplete) |
|
Black Hole SAT 2011-03-08 (complete) |
|
borg-sat 11.03.02-industrial [DEPRECATED] (complete) |
|
borg-sat 11.03.02-par-industrial (fixed) (complete) |
|
borg-sat 11.03.02-seq-industrial (fixed) (complete) |
|
borg-sat 11.03.02-seq-industrial (fixed, 1200 s timeout) (complete) |
|
clasp 2.0-R4092-indust (complete) |
|
claspmt 2.0-R4095 [DEPRECATED] (complete) |
|
claspmt 2.0-R4095-patched (fixed) (complete) |
|
CryptoMiniSat Strange-Night-1-mt [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night-1-mt (fixed) (complete) |
|
CryptoMiniSat Strange-Night-1-st [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night-1-st (fixed) (complete) |
|
CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night-2-mt (fixed) (complete) |
|
CryptoMiniSat Strange-Night2-st [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night2-st (fixed) (complete) |
|
CryptoMiniSat TechDemo-Alpha-mt (complete) |
|
CryptoMiniSat TechDemo-Alpha-st (complete) |
|
EBGlucose 1.0 (incomplete) |
|
glucose 2 (complete) |
|
glueminisat 2.2.5 (complete) |
|
jMiniSat 2011 (complete) |
|
kw 2011-02-28 (complete) |
|
Lingeling 587 [DEPRECATED] (complete) |
|
Lingeling 587f (fixed) (complete) |
|
march_rw 2011-03-02 (complete) |
|
minisat hack: cir_minisat 2011-03-02 (complete) |
|
minisat hack: cir_minisat 2011-05-13 (simp) (complete) |
|
minisat hack: contrasat 2011-03-02 (complete) |
|
minisat hack: EBMiniSAT 2011-03-02 (incomplete) |
|
minisat hack: LR_GL_NOSHR 2011-03-02 (complete) |
|
minisat hack: LR_GL_SHR 2011-03-02 (complete) |
|
minisat hack: LR_NOGL_NOSHR 2011-03-02 (complete) |
|
minisat hack: MiniSAT 2.2.0-agile-26 (complete) |
|
minisat hack: minisat_psm 2011-04-01 (complete) |
|
minisat hack reference: minisat 2.2.0 (complete) |
|
MPhaseSAT 2011-02-15 (complete) |
|
MPhaseSAT64 2011-03-03 [DEPRECATED] (complete) |
|
MPhaseSAT64 2011-05-14 (fixed) (complete) |
|
MPhaseSAT_M 2011-02-16 (complete) |
|
PicoSAT 941 (complete) |
|
Plingeling 587 [DEPRECATED] (complete) |
|
Plingeling 587f (fixed) (complete) |
|
ppfolio par (complete) |
|
ppfolio seq (complete) |
|
priss 1.0 (complete) |
|
priss Auto (complete) |
|
priss UP (complete) |
|
QuteRSat 2011-03-01 [DEPRECATED] (complete) |
|
QuteRSat 2011-05-12 (fixed) (complete) |
|
rcl 2011-04-01 (complete) |
|
RestartSAT A75 (complete) |
|
RestartSAT B95 (complete) |
|
riss 1.0 (complete) |
|
riss Auto (complete) |
|
riss Auto (1200 s timeout) (complete) |
|
riss Exp (complete) |
|
SApperloT 2011-03-23 (complete) |
|
SApperloT2010 2011-03-04 [DEPRECATED] (complete) |
|
SApperloT2010 2011-05-15 (fixed) (complete) |
|
SArTagnan 2011-03-24 [DEPRECATED] (complete) |
|
SArTagnan 2011-05-15 (fixed) (complete) |
|
SAT09 reference solver:glucose 1.0 (complete) |
|
SAT09 reference solver:LySAT i/2009-03-20 (complete) |
|
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20 (complete) |
|
SAT09 reference solver:precosat 236 (complete) |
|
SAT4J core 2.3.0 SNAPSHOT 2011-02-06 (complete) |
|
sathys 2011-04-01 (complete) |
|
Satisfiability Solver Selector 2011-03-18 (complete) |
|
Satisfiability Solver Selector 2011-03-18 (1200 s timeout) (complete) |
|
sattime 2011-03-02 (incomplete) |
|
sattime+ 2011-03-02 (incomplete) |
|
sattime2011 2011-03-02 (incomplete) |
|
shortsattime+ 2011-03-02 (incomplete) |
|
shortsattime2011 2011-03-02 (incomplete) |
|
Sol 2011-04-04 (complete) |
|
STRUCTure 0.1 (complete) |
|
STRUCTure 0.1 (hbr=2) (complete) |
|
synit_sat 2011-03-03 (complete) |
|
UmSat 2011-02-25 [DEPRECATED] (complete) |
|
UmSat 2011-05-12 (fixed) (complete) |
|
---|
Solver Name | #benchs | Solved | UNSAT. | SAT. | SAT (timeout) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | UNKNOWN (abort) | Sig. Caught | NO CERT. | WRONG CERT. | WRONG UNSAT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
adaptg2wsat2011 2011-03-02 (incomplete) |
600 | 300 (50%) |
0 (0%) |
300 (50%) |
0 (0%) |
0 (0%) |
300 (50%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Black Hole SAT 2011-03-08 (complete) |
600 | 47 (7.83%) |
29 (4.83%) |
18 (3%) |
0 (0%) |
0 (0%) |
553 (92.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
borg-sat 11.03.02-par-random (fixed) (complete) |
600 | 408 (68%) |
106 (17.67%) |
302 (50.33%) |
0 (0%) |
108 (18%) |
5 (0.83%) |
78 (13%) |
1 (0.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
borg-sat 11.03.02-random [DEPRECATED] (complete) |
600 | 403 (67.17%) |
106 (17.67%) |
297 (49.5%) |
0 (0%) |
0 (0%) |
105 (17.5%) |
81 (13.5%) |
10 (1.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.17%) |
0 (0%) |
borg-sat 11.03.02-seq-random (fixed) (complete) |
600 | 398 (66.33%) |
106 (17.67%) |
292 (48.67%) |
0 (0%) |
0 (0%) |
111 (18.5%) |
91 (15.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
borg-sat 11.03.02-seq-random (fixed, 1200 s timeout) (complete) |
600 | 396 (66%) |
102 (17%) |
294 (49%) |
0 (0%) |
18 (3%) |
97 (16.17%) |
88 (14.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.17%) |
0 (0%) |
CryptoMiniSat Strange-Night-1-mt [DEPRECATED] (complete) |
600 | 86 (14.33%) |
49 (8.17%) |
37 (6.17%) |
0 (0%) |
0 (0%) |
514 (85.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-1-mt (fixed) (complete) |
600 | 86 (14.33%) |
49 (8.17%) |
37 (6.17%) |
0 (0%) |
0 (0%) |
514 (85.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-1-st [DEPRECATED] (complete) |
600 | 76 (12.67%) |
48 (8%) |
28 (4.67%) |
0 (0%) |
0 (0%) |
524 (87.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-1-st (fixed) (complete) |
600 | 75 (12.5%) |
48 (8%) |
27 (4.5%) |
0 (0%) |
0 (0%) |
525 (87.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete) |
600 | 89 (14.83%) |
49 (8.17%) |
40 (6.67%) |
0 (0%) |
0 (0%) |
511 (85.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-2-mt (fixed) (complete) |
600 | 89 (14.83%) |
49 (8.17%) |
40 (6.67%) |
0 (0%) |
0 (0%) |
511 (85.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night2-st [DEPRECATED] (complete) |
600 | 80 (13.33%) |
48 (8%) |
32 (5.33%) |
0 (0%) |
0 (0%) |
520 (86.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night2-st (fixed) (complete) |
600 | 81 (13.5%) |
48 (8%) |
33 (5.5%) |
0 (0%) |
0 (0%) |
519 (86.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat TechDemo-Alpha-mt (complete) |
600 | 59 (9.83%) |
31 (5.17%) |
28 (4.67%) |
0 (0%) |
0 (0%) |
541 (90.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat TechDemo-Alpha-st (complete) |
600 | 55 (9.17%) |
31 (5.17%) |
24 (4%) |
0 (0%) |
0 (0%) |
545 (90.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
csls pnorm-8cores (incomplete) |
600 | 307 (51.17%) |
0 (0%) |
307 (51.17%) |
0 (0%) |
0 (0%) |
293 (48.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
csls prob-4cores (incomplete) |
600 | 303 (50.5%) |
0 (0%) |
303 (50.5%) |
0 (0%) |
0 (0%) |
297 (49.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
csls prob-8cores (incomplete) |
600 | 301 (50.17%) |
0 (0%) |
301 (50.17%) |
0 (0%) |
0 (0%) |
299 (49.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
EagleUP 1.565.350 (incomplete) |
600 | 315 (52.5%) |
0 (0%) |
315 (52.5%) |
0 (0%) |
0 (0%) |
285 (47.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
jMiniSat 2011 (complete) |
600 | 81 (13.5%) |
43 (7.17%) |
38 (6.33%) |
0 (0%) |
0 (0%) |
519 (86.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
march_rw 2011-03-02 (complete) |
600 | 217 (36.17%) |
108 (18%) |
109 (18.17%) |
0 (0%) |
0 (0%) |
383 (63.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT 2011-02-15 (complete) |
600 | 310 (51.67%) |
68 (11.33%) |
242 (40.33%) |
0 (0%) |
0 (0%) |
290 (48.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT64 2011-03-03 [DEPRECATED] (complete) |
600 | 306 (51%) |
64 (10.67%) |
242 (40.33%) |
0 (0%) |
1 (0.17%) |
293 (48.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT64 2011-05-14 (fixed) (complete) |
600 | 312 (52%) |
69 (11.5%) |
243 (40.5%) |
0 (0%) |
0 (0%) |
288 (48%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT_M 2011-02-16 (complete) |
600 | 342 (57%) |
100 (16.67%) |
242 (40.33%) |
0 (0%) |
0 (0%) |
258 (43%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MultiFlip 2011-02-11 (incomplete) |
600 | 274 (45.67%) |
0 (0%) |
274 (45.67%) |
0 (0%) |
0 (0%) |
326 (54.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ppfolio par (complete) |
600 | 375 (62.5%) |
102 (17%) |
273 (45.5%) |
0 (0%) |
0 (0%) |
222 (37%) |
3 (0.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ppfolio seq (complete) |
600 | 323 (53.83%) |
60 (10%) |
263 (43.83%) |
0 (0%) |
0 (0%) |
272 (45.33%) |
5 (0.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
QuteRSat 2011-03-01 [DEPRECATED] (complete) |
600 | 79 (13.17%) |
48 (8%) |
31 (5.17%) |
0 (0%) |
0 (0%) |
521 (86.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
QuteRSat 2011-05-12 (fixed) (complete) |
600 | 83 (13.83%) |
49 (8.17%) |
34 (5.67%) |
0 (0%) |
0 (0%) |
517 (86.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
RestartSAT A75 (complete) |
600 | 77 (12.83%) |
39 (6.5%) |
38 (6.33%) |
0 (0%) |
0 (0%) |
523 (87.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
RestartSAT B95 (complete) |
600 | 83 (13.83%) |
49 (8.17%) |
34 (5.67%) |
0 (0%) |
0 (0%) |
517 (86.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: gnovelty+2 2009-03-22 (incomplete) |
600 | 276 (46%) |
0 (0%) |
276 (46%) |
0 (0%) |
0 (0%) |
324 (54%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: march_hi hi (complete) |
600 | 212 (35.33%) |
106 (17.67%) |
106 (17.67%) |
0 (0%) |
0 (0%) |
388 (64.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: SATzilla2009_R 2009-03-22 (complete) |
600 | 352 (58.67%) |
83 (13.83%) |
269 (44.83%) |
0 (0%) |
0 (0%) |
248 (41.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: TNM 2009-03-22 (incomplete) |
600 | 294 (49%) |
0 (0%) |
294 (49%) |
0 (0%) |
0 (0%) |
306 (51%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT4J core 2.3.0 SNAPSHOT 2011-02-06 (complete) |
600 | 66 (11%) |
32 (5.33%) |
34 (5.67%) |
0 (0%) |
0 (0%) |
534 (89%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sathys 2011-04-01 (complete) |
600 | 183 (30.5%) |
23 (3.83%) |
160 (26.67%) |
0 (0%) |
0 (0%) |
417 (69.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT_Intersec_01 2011-03-01 (complete) |
600 | 0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
590 (98.33%) |
0 (0%) |
10 (1.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Satisfiability Solver Selector 2011-03-18 (complete) |
600 | 380 (63.33%) |
96 (16%) |
284 (47.33%) |
0 (0%) |
0 (0%) |
220 (36.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Satisfiability Solver Selector 2011-03-18 (1200 s timeout) (complete) |
600 | 399 (66.5%) |
106 (17.67%) |
293 (48.83%) |
0 (0%) |
0 (0%) |
201 (33.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sattime 2011-03-02 (incomplete) |
600 | 251 (41.83%) |
0 (0%) |
251 (41.83%) |
0 (0%) |
0 (0%) |
349 (58.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sattime+ 2011-03-02 (incomplete) |
600 | 216 (36%) |
0 (0%) |
216 (36%) |
0 (0%) |
0 (0%) |
384 (64%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sattime2011 2011-03-02 (incomplete) |
600 | 309 (51.5%) |
0 (0%) |
309 (51.5%) |
0 (0%) |
0 (0%) |
291 (48.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
shortsattime+ 2011-03-02 (incomplete) |
600 | 211 (35.17%) |
0 (0%) |
211 (35.17%) |
0 (0%) |
0 (0%) |
389 (64.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
shortsattime2011 2011-03-02 (incomplete) |
600 | 304 (50.67%) |
0 (0%) |
304 (50.67%) |
0 (0%) |
0 (0%) |
296 (49.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Sol 2011-04-04 (complete) |
600 | 53 (8.83%) |
30 (5%) |
23 (3.83%) |
0 (0%) |
0 (0%) |
547 (91.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sparrow2011 sparrow2011_ubcsat1.2_2011-03-02 (incomplete) |
600 | 343 (57.17%) |
0 (0%) |
343 (57.17%) |
0 (0%) |
0 (0%) |
257 (42.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
STRUCTure 0.1 (complete) |
600 | 103 (17.17%) |
60 (10%) |
43 (7.17%) |
0 (0%) |
0 (0%) |
497 (82.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
STRUCTure 0.1 (hbr=2) (complete) |
600 | 107 (17.83%) |
60 (10%) |
47 (7.83%) |
0 (0%) |
0 (0%) |
493 (82.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
synit_sat 2011-03-03 (complete) |
600 | 76 (12.67%) |
48 (8%) |
28 (4.67%) |
0 (0%) |
0 (0%) |
524 (87.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
UmSat 2011-02-25 [DEPRECATED] (complete) |
600 | 62 (10.33%) |
36 (6%) |
26 (4.33%) |
0 (0%) |
0 (0%) |
537 (89.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | adaptg2wsat2011 2011-03-02 (incomplete) |
|
Black Hole SAT 2011-03-08 (complete) |
|
borg-sat 11.03.02-par-random (fixed) (complete) |
|
borg-sat 11.03.02-random [DEPRECATED] (complete) |
|
borg-sat 11.03.02-seq-random (fixed) (complete) |
|
borg-sat 11.03.02-seq-random (fixed, 1200 s timeout) (complete) |
|
CryptoMiniSat Strange-Night-1-mt [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night-1-mt (fixed) (complete) |
|
CryptoMiniSat Strange-Night-1-st [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night-1-st (fixed) (complete) |
|
CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night-2-mt (fixed) (complete) |
|
CryptoMiniSat Strange-Night2-st [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night2-st (fixed) (complete) |
|
CryptoMiniSat TechDemo-Alpha-mt (complete) |
|
CryptoMiniSat TechDemo-Alpha-st (complete) |
|
csls pnorm-8cores (incomplete) |
|
csls prob-4cores (incomplete) |
|
csls prob-8cores (incomplete) |
|
EagleUP 1.565.350 (incomplete) |
|
jMiniSat 2011 (complete) |
|
march_rw 2011-03-02 (complete) |
|
MPhaseSAT 2011-02-15 (complete) |
|
MPhaseSAT64 2011-03-03 [DEPRECATED] (complete) |
|
MPhaseSAT64 2011-05-14 (fixed) (complete) |
|
MPhaseSAT_M 2011-02-16 (complete) |
|
MultiFlip 2011-02-11 (incomplete) |
|
ppfolio par (complete) |
|
ppfolio seq (complete) |
|
QuteRSat 2011-03-01 [DEPRECATED] (complete) |
|
QuteRSat 2011-05-12 (fixed) (complete) |
|
RestartSAT A75 (complete) |
|
RestartSAT B95 (complete) |
|
SAT09 reference solver: gnovelty+2 2009-03-22 (incomplete) |
|
SAT09 reference solver: march_hi hi (complete) |
|
SAT09 reference solver: SATzilla2009_R 2009-03-22 (complete) |
|
SAT09 reference solver: TNM 2009-03-22 (incomplete) |
|
SAT4J core 2.3.0 SNAPSHOT 2011-02-06 (complete) |
|
sathys 2011-04-01 (complete) |
|
SAT_Intersec_01 2011-03-01 (complete) |
|
Satisfiability Solver Selector 2011-03-18 (complete) |
|
Satisfiability Solver Selector 2011-03-18 (1200 s timeout) (complete) |
|
sattime 2011-03-02 (incomplete) |
|
sattime+ 2011-03-02 (incomplete) |
|
sattime2011 2011-03-02 (incomplete) |
|
shortsattime+ 2011-03-02 (incomplete) |
|
shortsattime2011 2011-03-02 (incomplete) |
|
Sol 2011-04-04 (complete) |
|
sparrow2011 sparrow2011_ubcsat1.2_2011-03-02 (incomplete) |
|
STRUCTure 0.1 (complete) |
|
STRUCTure 0.1 (hbr=2) (complete) |
|
synit_sat 2011-03-03 (complete) |
|
UmSat 2011-02-25 [DEPRECATED] (complete) |
|
---|
Solver Name | #benchs | Solved | UNSAT. | SAT. | SAT (timeout) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | UNKNOWN (abort) | Sig. Caught | NO CERT. | WRONG CERT. | WRONG UNSAT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
adaptg2wsat2011 2011-03-02 (incomplete) |
1200 | 414 (34.5%) |
0 (0%) |
414 (34.5%) |
0 (0%) |
9 (0.75%) |
770 (64.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
7 (0.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Black Hole SAT 2011-03-08 (complete) |
1200 | 110 (9.17%) |
45 (3.75%) |
65 (5.42%) |
0 (0%) |
0 (0%) |
1090 (90.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-1-mt [DEPRECATED] (complete) |
1200 | 378 (31.5%) |
191 (15.92%) |
187 (15.58%) |
0 (0%) |
0 (0%) |
808 (67.33%) |
10 (0.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (0.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-1-mt (fixed) (complete) |
1200 | 380 (31.67%) |
189 (15.75%) |
191 (15.92%) |
0 (0%) |
0 (0%) |
806 (67.17%) |
10 (0.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (0.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-1-st [DEPRECATED] (complete) |
1200 | 328 (27.33%) |
171 (14.25%) |
157 (13.08%) |
0 (0%) |
0 (0%) |
869 (72.42%) |
3 (0.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-1-st (fixed) (complete) |
1200 | 327 (27.25%) |
171 (14.25%) |
156 (13%) |
0 (0%) |
0 (0%) |
870 (72.5%) |
3 (0.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete) |
1200 | 387 (32.25%) |
187 (15.58%) |
200 (16.67%) |
0 (0%) |
0 (0%) |
793 (66.08%) |
13 (1.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
7 (0.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-2-mt (fixed) (complete) |
1200 | 386 (32.17%) |
190 (15.83%) |
196 (16.33%) |
0 (0%) |
0 (0%) |
800 (66.67%) |
11 (0.92%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
3 (0.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night2-st [DEPRECATED] (complete) |
1200 | 348 (29%) |
176 (14.67%) |
172 (14.33%) |
0 (0%) |
0 (0%) |
835 (69.58%) |
13 (1.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (0.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night2-st (fixed) (complete) |
1200 | 351 (29.25%) |
176 (14.67%) |
175 (14.58%) |
0 (0%) |
0 (0%) |
835 (69.58%) |
13 (1.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat TechDemo-Alpha-mt (complete) |
1200 | 269 (22.42%) |
128 (10.67%) |
141 (11.75%) |
0 (0%) |
0 (0%) |
905 (75.42%) |
3 (0.25%) |
1 (0.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
22 (1.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat TechDemo-Alpha-st (complete) |
1200 | 253 (21.08%) |
122 (10.17%) |
131 (10.92%) |
0 (0%) |
0 (0%) |
936 (78%) |
1 (0.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
8 (0.67%) |
0 (0%) |
0 (0%) |
2 (0.17%) |
jMiniSat 2011 (complete) |
1200 | 297 (24.75%) |
128 (10.67%) |
169 (14.08%) |
0 (0%) |
0 (0%) |
903 (75.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
march_rw 2011-03-02 (complete) |
1200 | 323 (26.92%) |
142 (11.83%) |
181 (15.08%) |
0 (0%) |
0 (0%) |
851 (70.92%) |
17 (1.42%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
9 (0.75%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT 2011-02-15 (complete) |
1200 | 579 (48.25%) |
176 (14.67%) |
403 (33.58%) |
0 (0%) |
2 (0.17%) |
619 (51.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT64 2011-03-03 [DEPRECATED] (complete) |
1200 | 566 (47.17%) |
169 (14.08%) |
397 (33.08%) |
0 (0%) |
40 (3.33%) |
593 (49.42%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT64 2011-05-14 (fixed) (complete) |
1200 | 589 (49.08%) |
182 (15.17%) |
407 (33.92%) |
0 (0%) |
5 (0.42%) |
605 (50.42%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT_M 2011-02-16 (complete) |
1200 | 612 (51%) |
207 (17.25%) |
405 (33.75%) |
0 (0%) |
2 (0.17%) |
586 (48.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ppfolio par (complete) |
1200 | 710 (59.17%) |
238 (19.83%) |
472 (39.33%) |
0 (0%) |
0 (0%) |
475 (39.58%) |
15 (1.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ppfolio seq (complete) |
1200 | 617 (51.42%) |
176 (14.67%) |
441 (36.75%) |
0 (0%) |
0 (0%) |
562 (46.83%) |
21 (1.75%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
QuteRSat 2011-03-01 [DEPRECATED] (complete) |
1200 | 338 (28.17%) |
177 (14.75%) |
161 (13.42%) |
0 (0%) |
0 (0%) |
844 (70.33%) |
12 (1%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
5 (0.42%) |
0 (0%) |
1 (0.08%) |
0 (0%) |
QuteRSat 2011-05-12 (fixed) (complete) |
1200 | 351 (29.25%) |
178 (14.83%) |
173 (14.42%) |
0 (0%) |
0 (0%) |
842 (70.17%) |
5 (0.42%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
2 (0.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
RestartSAT A75 (complete) |
1200 | 337 (28.08%) |
158 (13.17%) |
179 (14.92%) |
0 (0%) |
0 (0%) |
863 (71.92%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
RestartSAT B95 (complete) |
1200 | 349 (29.08%) |
166 (13.83%) |
183 (15.25%) |
0 (0%) |
0 (0%) |
851 (70.92%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT4J core 2.3.0 SNAPSHOT 2011-02-06 (complete) |
1200 | 263 (21.92%) |
113 (9.42%) |
150 (12.5%) |
0 (0%) |
0 (0%) |
937 (78.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sathys 2011-04-01 (complete) |
1200 | 410 (34.17%) |
113 (9.42%) |
297 (24.75%) |
0 (0%) |
0 (0%) |
789 (65.75%) |
0 (0%) |
1 (0.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Satisfiability Solver Selector 2011-03-18 (complete) |
1200 | 675 (56.25%) |
204 (17%) |
471 (39.25%) |
0 (0%) |
0 (0%) |
525 (43.75%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Satisfiability Solver Selector 2011-03-18 (1200 s timeout) (complete) |
1200 | 701 (58.42%) |
223 (18.58%) |
478 (39.83%) |
0 (0%) |
0 (0%) |
499 (41.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sattime 2011-03-02 (incomplete) |
1200 | 371 (30.92%) |
0 (0%) |
371 (30.92%) |
0 (0%) |
9 (0.75%) |
813 (67.75%) |
0 (0%) |
0 (0%) |
0 (0%) |
7 (0.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sattime+ 2011-03-02 (incomplete) |
1200 | 337 (28.08%) |
7 (0.58%) |
330 (27.5%) |
0 (0%) |
9 (0.75%) |
854 (71.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sattime2011 2011-03-02 (incomplete) |
1200 | 429 (35.75%) |
0 (0%) |
429 (35.75%) |
0 (0%) |
9 (0.75%) |
755 (62.92%) |
0 (0%) |
0 (0%) |
0 (0%) |
7 (0.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
shortsattime+ 2011-03-02 (incomplete) |
1200 | 338 (28.17%) |
7 (0.58%) |
331 (27.58%) |
0 (0%) |
9 (0.75%) |
853 (71.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
shortsattime2011 2011-03-02 (incomplete) |
1200 | 422 (35.17%) |
0 (0%) |
422 (35.17%) |
0 (0%) |
9 (0.75%) |
762 (63.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
7 (0.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Sol 2011-04-04 (complete) |
1200 | 275 (22.92%) |
121 (10.08%) |
154 (12.83%) |
0 (0%) |
0 (0%) |
915 (76.25%) |
9 (0.75%) |
0 (0%) |
0 (0%) |
1 (0.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
STRUCTure 0.1 (complete) |
1200 | 194 (16.17%) |
91 (7.58%) |
103 (8.58%) |
0 (0%) |
0 (0%) |
1006 (83.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
STRUCTure 0.1 (hbr=2) (complete) |
1200 | 196 (16.33%) |
91 (7.58%) |
105 (8.75%) |
0 (0%) |
0 (0%) |
1004 (83.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
synit_sat 2011-03-03 (complete) |
1200 | 333 (27.75%) |
176 (14.67%) |
157 (13.08%) |
0 (0%) |
0 (0%) |
839 (69.92%) |
11 (0.92%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
16 (1.33%) |
0 (0%) |
0 (0%) |
1 (0.08%) |
UmSat 2011-02-25 [DEPRECATED] (complete) |
1200 | 165 (13.75%) |
76 (6.33%) |
89 (7.42%) |
0 (0%) |
0 (0%) |
868 (72.33%) |
3 (0.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
163 (13.58%) |
0 (0%) |
1 (0.08%) |
0 (0%) |
Solver Name | Progress | adaptg2wsat2011 2011-03-02 (incomplete) |
|
Black Hole SAT 2011-03-08 (complete) |
|
CryptoMiniSat Strange-Night-1-mt [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night-1-mt (fixed) (complete) |
|
CryptoMiniSat Strange-Night-1-st [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night-1-st (fixed) (complete) |
|
CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night-2-mt (fixed) (complete) |
|
CryptoMiniSat Strange-Night2-st [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night2-st (fixed) (complete) |
|
CryptoMiniSat TechDemo-Alpha-mt (complete) |
|
CryptoMiniSat TechDemo-Alpha-st (complete) |
|
jMiniSat 2011 (complete) |
|
march_rw 2011-03-02 (complete) |
|
MPhaseSAT 2011-02-15 (complete) |
|
MPhaseSAT64 2011-03-03 [DEPRECATED] (complete) |
|
MPhaseSAT64 2011-05-14 (fixed) (complete) |
|
MPhaseSAT_M 2011-02-16 (complete) |
|
ppfolio par (complete) |
|
ppfolio seq (complete) |
|
QuteRSat 2011-03-01 [DEPRECATED] (complete) |
|
QuteRSat 2011-05-12 (fixed) (complete) |
|
RestartSAT A75 (complete) |
|
RestartSAT B95 (complete) |
|
SAT4J core 2.3.0 SNAPSHOT 2011-02-06 (complete) |
|
sathys 2011-04-01 (complete) |
|
Satisfiability Solver Selector 2011-03-18 (complete) |
|
Satisfiability Solver Selector 2011-03-18 (1200 s timeout) (complete) |
|
sattime 2011-03-02 (incomplete) |
|
sattime+ 2011-03-02 (incomplete) |
|
sattime2011 2011-03-02 (incomplete) |
|
shortsattime+ 2011-03-02 (incomplete) |
|
shortsattime2011 2011-03-02 (incomplete) |
|
Sol 2011-04-04 (complete) |
|
STRUCTure 0.1 (complete) |
|
STRUCTure 0.1 (hbr=2) (complete) |
|
synit_sat 2011-03-03 (complete) |
|
UmSat 2011-02-25 [DEPRECATED] (complete) |
|
---|
This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.
Solver Name | #benchs | Solved | UNSAT. | SAT. | SAT (timeout) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | UNKNOWN (abort) | Sig. Caught | NO CERT. | WRONG CERT. | WRONG UNSAT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
adaptg2wsat2011 2011-03-02 (incomplete) |
1200 | 414 (34.5%) |
0 (0%) |
414 (34.5%) |
0 (0%) |
9 (0.75%) |
770 (64.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
7 (0.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Black Hole SAT 2011-03-08 (complete) |
1200 | 110 (9.17%) |
45 (3.75%) |
65 (5.42%) |
0 (0%) |
0 (0%) |
1090 (90.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
borg-sat 11.03.02-industrial [DEPRECATED] (complete) |
300 | 175 (58.33%) |
89 (29.67%) |
86 (28.67%) |
0 (0%) |
0 (0%) |
97 (32.33%) |
21 (7%) |
7 (2.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
borg-sat 11.03.02-par-industrial (fixed) (complete) |
300 | 179 (59.67%) |
94 (31.33%) |
85 (28.33%) |
0 (0%) |
91 (30.33%) |
10 (3.33%) |
17 (5.67%) |
2 (0.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.33%) |
0 (0%) |
0 (0%) |
borg-sat 11.03.02-par-random (fixed) (complete) |
600 | 408 (68%) |
106 (17.67%) |
302 (50.33%) |
0 (0%) |
108 (18%) |
5 (0.83%) |
78 (13%) |
1 (0.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
borg-sat 11.03.02-random [DEPRECATED] (complete) |
600 | 403 (67.17%) |
106 (17.67%) |
297 (49.5%) |
0 (0%) |
0 (0%) |
105 (17.5%) |
81 (13.5%) |
10 (1.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.17%) |
0 (0%) |
borg-sat 11.03.02-seq-industrial (fixed) (complete) |
300 | 160 (53.33%) |
84 (28%) |
76 (25.33%) |
0 (0%) |
0 (0%) |
126 (42%) |
14 (4.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
borg-sat 11.03.02-seq-industrial (fixed, 1200 s timeout) (complete) |
300 | 160 (53.33%) |
85 (28.33%) |
75 (25%) |
0 (0%) |
1 (0.33%) |
134 (44.67%) |
5 (1.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
borg-sat 11.03.02-seq-random (fixed) (complete) |
600 | 398 (66.33%) |
106 (17.67%) |
292 (48.67%) |
0 (0%) |
0 (0%) |
111 (18.5%) |
91 (15.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
borg-sat 11.03.02-seq-random (fixed, 1200 s timeout) (complete) |
600 | 396 (66%) |
102 (17%) |
294 (49%) |
0 (0%) |
18 (3%) |
97 (16.17%) |
88 (14.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.17%) |
0 (0%) |
clasp 2.0-R4092-crafted (complete) |
300 | 105 (35%) |
37 (12.33%) |
68 (22.67%) |
0 (0%) |
0 (0%) |
195 (65%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
clasp 2.0-R4092-indust (complete) |
300 | 154 (51.33%) |
81 (27%) |
73 (24.33%) |
0 (0%) |
0 (0%) |
146 (48.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
claspmt 2.0-R4095 [DEPRECATED] (complete) |
600 | 307 (51.17%) |
130 (21.67%) |
177 (29.5%) |
0 (0%) |
0 (0%) |
286 (47.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
7 (1.17%) |
0 (0%) |
claspmt 2.0-R4095-patched (fixed) (complete) |
600 | 314 (52.33%) |
135 (22.5%) |
179 (29.83%) |
0 (0%) |
0 (0%) |
286 (47.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-1-mt [DEPRECATED] (complete) |
1200 | 378 (31.5%) |
191 (15.92%) |
187 (15.58%) |
0 (0%) |
0 (0%) |
808 (67.33%) |
10 (0.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (0.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-1-mt (fixed) (complete) |
1200 | 380 (31.67%) |
189 (15.75%) |
191 (15.92%) |
0 (0%) |
0 (0%) |
806 (67.17%) |
10 (0.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (0.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-1-st [DEPRECATED] (complete) |
1200 | 328 (27.33%) |
171 (14.25%) |
157 (13.08%) |
0 (0%) |
0 (0%) |
869 (72.42%) |
3 (0.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-1-st (fixed) (complete) |
1200 | 327 (27.25%) |
171 (14.25%) |
156 (13%) |
0 (0%) |
0 (0%) |
870 (72.5%) |
3 (0.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete) |
1200 | 387 (32.25%) |
187 (15.58%) |
200 (16.67%) |
0 (0%) |
0 (0%) |
793 (66.08%) |
13 (1.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
7 (0.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night-2-mt (fixed) (complete) |
1200 | 386 (32.17%) |
190 (15.83%) |
196 (16.33%) |
0 (0%) |
0 (0%) |
800 (66.67%) |
11 (0.92%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
3 (0.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night2-st [DEPRECATED] (complete) |
1200 | 348 (29%) |
176 (14.67%) |
172 (14.33%) |
0 (0%) |
0 (0%) |
835 (69.58%) |
13 (1.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (0.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat Strange-Night2-st (fixed) (complete) |
1200 | 351 (29.25%) |
176 (14.67%) |
175 (14.58%) |
0 (0%) |
0 (0%) |
835 (69.58%) |
13 (1.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat TechDemo-Alpha-mt (complete) |
1200 | 269 (22.42%) |
128 (10.67%) |
141 (11.75%) |
0 (0%) |
0 (0%) |
905 (75.42%) |
3 (0.25%) |
1 (0.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
22 (1.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
CryptoMiniSat TechDemo-Alpha-st (complete) |
1200 | 253 (21.08%) |
122 (10.17%) |
131 (10.92%) |
0 (0%) |
0 (0%) |
936 (78%) |
1 (0.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
8 (0.67%) |
0 (0%) |
0 (0%) |
2 (0.17%) |
csls pnorm-8cores (incomplete) |
600 | 307 (51.17%) |
0 (0%) |
307 (51.17%) |
0 (0%) |
0 (0%) |
293 (48.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
csls prob-4cores (incomplete) |
600 | 303 (50.5%) |
0 (0%) |
303 (50.5%) |
0 (0%) |
0 (0%) |
297 (49.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
csls prob-8cores (incomplete) |
600 | 301 (50.17%) |
0 (0%) |
301 (50.17%) |
0 (0%) |
0 (0%) |
299 (49.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
EagleUP 1.565.350 (incomplete) |
600 | 315 (52.5%) |
0 (0%) |
315 (52.5%) |
0 (0%) |
0 (0%) |
285 (47.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
EBGlucose 1.0 (incomplete) |
300 | 158 (52.67%) |
82 (27.33%) |
76 (25.33%) |
0 (0%) |
0 (0%) |
142 (47.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
glucose 2 (complete) |
600 | 268 (44.67%) |
125 (20.83%) |
143 (23.83%) |
0 (0%) |
0 (0%) |
332 (55.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
glueminisat 2.2.5 (complete) |
300 | 171 (57%) |
98 (32.67%) |
73 (24.33%) |
0 (0%) |
0 (0%) |
129 (43%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
jMiniSat 2011 (complete) |
1200 | 297 (24.75%) |
128 (10.67%) |
169 (14.08%) |
0 (0%) |
0 (0%) |
903 (75.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
kw 2011-02-28 (complete) |
300 | 156 (52%) |
83 (27.67%) |
73 (24.33%) |
0 (0%) |
0 (0%) |
143 (47.67%) |
1 (0.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Lingeling 587 [DEPRECATED] (complete) |
600 | 261 (43.5%) |
120 (20%) |
141 (23.5%) |
0 (0%) |
0 (0%) |
339 (56.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Lingeling 587f (fixed) (complete) |
600 | 261 (43.5%) |
120 (20%) |
141 (23.5%) |
0 (0%) |
0 (0%) |
339 (56.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
march_rw 2011-03-02 (complete) |
1200 | 323 (26.92%) |
142 (11.83%) |
181 (15.08%) |
0 (0%) |
0 (0%) |
851 (70.92%) |
17 (1.42%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
9 (0.75%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack: cir_minisat 2011-03-02 (complete) |
300 | 159 (53%) |
74 (24.67%) |
85 (28.33%) |
0 (0%) |
0 (0%) |
141 (47%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack: cir_minisat 2011-05-13 (simp) (complete) |
300 | 164 (54.67%) |
82 (27.33%) |
82 (27.33%) |
0 (0%) |
0 (0%) |
136 (45.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack: contrasat 2011-03-02 (complete) |
300 | 161 (53.67%) |
72 (24%) |
89 (29.67%) |
0 (0%) |
0 (0%) |
134 (44.67%) |
0 (0%) |
5 (1.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack: EBMiniSAT 2011-03-02 (incomplete) |
300 | 162 (54%) |
78 (26%) |
84 (28%) |
0 (0%) |
0 (0%) |
138 (46%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack: LR_GL_NOSHR 2011-03-02 (complete) |
300 | 155 (51.67%) |
71 (23.67%) |
84 (28%) |
0 (0%) |
0 (0%) |
145 (48.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack: LR_GL_SHR 2011-03-02 (complete) |
300 | 158 (52.67%) |
90 (30%) |
68 (22.67%) |
0 (0%) |
0 (0%) |
142 (47.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack: LR_NOGL_NOSHR 2011-03-02 (complete) |
300 | 154 (51.33%) |
71 (23.67%) |
83 (27.67%) |
0 (0%) |
0 (0%) |
146 (48.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack: MiniSAT 2.2.0-agile-26 (complete) |
300 | 160 (53.33%) |
74 (24.67%) |
86 (28.67%) |
0 (0%) |
0 (0%) |
139 (46.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack: minisat_psm 2011-04-01 (complete) |
300 | 163 (54.33%) |
77 (25.67%) |
86 (28.67%) |
0 (0%) |
0 (0%) |
137 (45.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat hack reference: minisat 2.2.0 (complete) |
300 | 161 (53.67%) |
74 (24.67%) |
87 (29%) |
0 (0%) |
0 (0%) |
139 (46.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT 2011-02-15 (complete) |
1200 | 579 (48.25%) |
176 (14.67%) |
403 (33.58%) |
0 (0%) |
2 (0.17%) |
619 (51.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT64 2011-03-03 [DEPRECATED] (complete) |
1200 | 566 (47.17%) |
169 (14.08%) |
397 (33.08%) |
0 (0%) |
40 (3.33%) |
593 (49.42%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT64 2011-05-14 (fixed) (complete) |
1200 | 589 (49.08%) |
182 (15.17%) |
407 (33.92%) |
0 (0%) |
5 (0.42%) |
605 (50.42%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MPhaseSAT_M 2011-02-16 (complete) |
1200 | 612 (51%) |
207 (17.25%) |
405 (33.75%) |
0 (0%) |
2 (0.17%) |
586 (48.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MultiFlip 2011-02-11 (incomplete) |
600 | 274 (45.67%) |
0 (0%) |
274 (45.67%) |
0 (0%) |
0 (0%) |
326 (54.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
PicoSAT 941 (complete) |
600 | 233 (38.83%) |
94 (15.67%) |
139 (23.17%) |
0 (0%) |
0 (0%) |
367 (61.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Plingeling 587 [DEPRECATED] (complete) |
600 | 293 (48.83%) |
124 (20.67%) |
169 (28.17%) |
0 (0%) |
0 (0%) |
307 (51.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Plingeling 587f (fixed) (complete) |
600 | 295 (49.17%) |
126 (21%) |
169 (28.17%) |
0 (0%) |
0 (0%) |
305 (50.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ppfolio par (complete) |
1200 | 710 (59.17%) |
238 (19.83%) |
472 (39.33%) |
0 (0%) |
0 (0%) |
475 (39.58%) |
15 (1.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ppfolio seq (complete) |
1200 | 617 (51.42%) |
176 (14.67%) |
441 (36.75%) |
0 (0%) |
0 (0%) |
562 (46.83%) |
21 (1.75%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
priss 1.0 (complete) |
600 | 229 (38.17%) |
97 (16.17%) |
132 (22%) |
0 (0%) |
0 (0%) |
363 (60.5%) |
0 (0%) |
8 (1.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
priss Auto (complete) |
600 | 233 (38.83%) |
98 (16.33%) |
135 (22.5%) |
0 (0%) |
0 (0%) |
361 (60.17%) |
0 (0%) |
6 (1%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
priss UP (complete) |
600 | 226 (37.67%) |
95 (15.83%) |
131 (21.83%) |
0 (0%) |
0 (0%) |
372 (62%) |
0 (0%) |
2 (0.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
QuteRSat 2011-03-01 [DEPRECATED] (complete) |
1200 | 338 (28.17%) |
177 (14.75%) |
161 (13.42%) |
0 (0%) |
0 (0%) |
844 (70.33%) |
12 (1%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
5 (0.42%) |
0 (0%) |
1 (0.08%) |
0 (0%) |
QuteRSat 2011-05-12 (fixed) (complete) |
1200 | 351 (29.25%) |
178 (14.83%) |
173 (14.42%) |
0 (0%) |
0 (0%) |
842 (70.17%) |
5 (0.42%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
2 (0.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
rcl 2011-04-01 (complete) |
600 | 243 (40.5%) |
99 (16.5%) |
144 (24%) |
0 (0%) |
0 (0%) |
357 (59.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
RestartSAT A75 (complete) |
1200 | 337 (28.08%) |
158 (13.17%) |
179 (14.92%) |
0 (0%) |
0 (0%) |
863 (71.92%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
RestartSAT B95 (complete) |
1200 | 349 (29.08%) |
166 (13.83%) |
183 (15.25%) |
0 (0%) |
0 (0%) |
851 (70.92%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
riss 1.0 (complete) |
600 | 222 (37%) |
97 (16.17%) |
125 (20.83%) |
0 (0%) |
0 (0%) |
376 (62.67%) |
0 (0%) |
2 (0.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
riss Auto (complete) |
600 | 222 (37%) |
97 (16.17%) |
125 (20.83%) |
0 (0%) |
0 (0%) |
376 (62.67%) |
0 (0%) |
2 (0.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
riss Auto (1200 s timeout) (complete) |
600 | 214 (35.67%) |
95 (15.83%) |
119 (19.83%) |
0 (0%) |
0 (0%) |
384 (64%) |
0 (0%) |
2 (0.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
riss Exp (complete) |
600 | 212 (35.33%) |
89 (14.83%) |
123 (20.5%) |
0 (0%) |
0 (0%) |
383 (63.83%) |
0 (0%) |
5 (0.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SApperloT 2011-03-23 (complete) |
600 | 240 (40%) |
104 (17.33%) |
136 (22.67%) |
0 (0%) |
0 (0%) |
360 (60%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SApperloT2010 2011-03-04 [DEPRECATED] (complete) |
600 | 208 (34.67%) |
108 (18%) |
100 (16.67%) |
0 (0%) |
0 (0%) |
353 (58.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
35 (5.83%) |
4 (0.67%) |
0 (0%) |
SApperloT2010 2011-05-15 (fixed) (complete) |
600 | 250 (41.67%) |
108 (18%) |
142 (23.67%) |
0 (0%) |
0 (0%) |
350 (58.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SArTagnan 2011-03-24 [DEPRECATED] (complete) |
600 | 202 (33.67%) |
107 (17.83%) |
95 (15.83%) |
0 (0%) |
0 (0%) |
332 (55.33%) |
4 (0.67%) |
21 (3.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
41 (6.83%) |
0 (0%) |
SArTagnan 2011-05-15 (fixed) (complete) |
600 | 239 (39.83%) |
104 (17.33%) |
135 (22.5%) |
0 (0%) |
0 (0%) |
334 (55.67%) |
4 (0.67%) |
23 (3.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT07 reference solver: minisat SAT 2007 (complete) |
300 | 92 (30.67%) |
32 (10.67%) |
60 (20%) |
0 (0%) |
0 (0%) |
208 (69.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: clasp 1.2.0-SAT09-32 (complete) |
300 | 93 (31%) |
34 (11.33%) |
59 (19.67%) |
0 (0%) |
0 (0%) |
207 (69%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver:glucose 1.0 (complete) |
300 | 159 (53%) |
84 (28%) |
75 (25%) |
0 (0%) |
0 (0%) |
141 (47%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: gnovelty+2 2009-03-22 (incomplete) |
600 | 276 (46%) |
0 (0%) |
276 (46%) |
0 (0%) |
0 (0%) |
324 (54%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver:LySAT i/2009-03-20 (complete) |
300 | 131 (43.67%) |
71 (23.67%) |
60 (20%) |
0 (0%) |
0 (0%) |
154 (51.33%) |
0 (0%) |
15 (5%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20 (complete) |
300 | 169 (56.33%) |
91 (30.33%) |
78 (26%) |
0 (0%) |
0 (0%) |
102 (34%) |
0 (0%) |
29 (9.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: march_hi hi (complete) |
600 | 212 (35.33%) |
106 (17.67%) |
106 (17.67%) |
0 (0%) |
0 (0%) |
388 (64.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver:precosat 236 (complete) |
300 | 167 (55.67%) |
88 (29.33%) |
79 (26.33%) |
0 (0%) |
0 (0%) |
131 (43.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
2 (0.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: SATzilla2009_C 2009-03-22 (complete) |
300 | 81 (27%) |
31 (10.33%) |
50 (16.67%) |
0 (0%) |
0 (0%) |
219 (73%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: SATzilla2009_R 2009-03-22 (complete) |
600 | 352 (58.67%) |
83 (13.83%) |
269 (44.83%) |
0 (0%) |
0 (0%) |
248 (41.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT09 reference solver: TNM 2009-03-22 (incomplete) |
600 | 294 (49%) |
0 (0%) |
294 (49%) |
0 (0%) |
0 (0%) |
306 (51%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT4J core 2.3.0 SNAPSHOT 2011-02-06 (complete) |
1200 | 263 (21.92%) |
113 (9.42%) |
150 (12.5%) |
0 (0%) |
0 (0%) |
937 (78.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sathys 2011-04-01 (complete) |
1200 | 410 (34.17%) |
113 (9.42%) |
297 (24.75%) |
0 (0%) |
0 (0%) |
789 (65.75%) |
0 (0%) |
1 (0.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT_Intersec_01 2011-03-01 (complete) |
600 | 0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
590 (98.33%) |
0 (0%) |
10 (1.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Satisfiability Solver Selector 2011-03-18 (complete) |
1200 | 675 (56.25%) |
204 (17%) |
471 (39.25%) |
0 (0%) |
0 (0%) |
525 (43.75%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Satisfiability Solver Selector 2011-03-18 (1200 s timeout) (complete) |
1200 | 701 (58.42%) |
223 (18.58%) |
478 (39.83%) |
0 (0%) |
0 (0%) |
499 (41.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sattime 2011-03-02 (incomplete) |
1200 | 371 (30.92%) |
0 (0%) |
371 (30.92%) |
0 (0%) |
9 (0.75%) |
813 (67.75%) |
0 (0%) |
0 (0%) |
0 (0%) |
7 (0.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sattime+ 2011-03-02 (incomplete) |
1200 | 337 (28.08%) |
7 (0.58%) |
330 (27.5%) |
0 (0%) |
9 (0.75%) |
854 (71.17%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sattime2011 2011-03-02 (incomplete) |
1200 | 429 (35.75%) |
0 (0%) |
429 (35.75%) |
0 (0%) |
9 (0.75%) |
755 (62.92%) |
0 (0%) |
0 (0%) |
0 (0%) |
7 (0.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
shortsattime+ 2011-03-02 (incomplete) |
1200 | 338 (28.17%) |
7 (0.58%) |
331 (27.58%) |
0 (0%) |
9 (0.75%) |
853 (71.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
shortsattime2011 2011-03-02 (incomplete) |
1200 | 422 (35.17%) |
0 (0%) |
422 (35.17%) |
0 (0%) |
9 (0.75%) |
762 (63.5%) |
0 (0%) |
0 (0%) |
0 (0%) |
7 (0.58%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Sol 2011-04-04 (complete) |
1200 | 275 (22.92%) |
121 (10.08%) |
154 (12.83%) |
0 (0%) |
0 (0%) |
915 (76.25%) |
9 (0.75%) |
0 (0%) |
0 (0%) |
1 (0.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
sparrow2011 sparrow2011_ubcsat1.2_2011-03-02 (incomplete) |
600 | 343 (57.17%) |
0 (0%) |
343 (57.17%) |
0 (0%) |
0 (0%) |
257 (42.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
STRUCTure 0.1 (complete) |
1200 | 194 (16.17%) |
91 (7.58%) |
103 (8.58%) |
0 (0%) |
0 (0%) |
1006 (83.83%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
STRUCTure 0.1 (hbr=2) (complete) |
1200 | 196 (16.33%) |
91 (7.58%) |
105 (8.75%) |
0 (0%) |
0 (0%) |
1004 (83.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
synit_sat 2011-03-03 (complete) |
1200 | 333 (27.75%) |
176 (14.67%) |
157 (13.08%) |
0 (0%) |
0 (0%) |
839 (69.92%) |
11 (0.92%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
16 (1.33%) |
0 (0%) |
0 (0%) |
1 (0.08%) |
tts 5-4 (complete) |
300 | 37 (12.33%) |
17 (5.67%) |
20 (6.67%) |
0 (0%) |
0 (0%) |
248 (82.67%) |
13 (4.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
2 (0.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
ttsth 5-4 (complete) |
300 | 46 (15.33%) |
20 (6.67%) |
26 (8.67%) |
0 (0%) |
10 (3.33%) |
239 (79.67%) |
3 (1%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
2 (0.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
UmSat 2011-02-25 [DEPRECATED] (complete) |
1200 | 165 (13.75%) |
76 (6.33%) |
89 (7.42%) |
0 (0%) |
0 (0%) |
868 (72.33%) |
3 (0.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
163 (13.58%) |
0 (0%) |
1 (0.08%) |
0 (0%) |
UmSat 2011-05-12 (fixed) (complete) |
600 | 159 (26.5%) |
63 (10.5%) |
96 (16%) |
0 (0%) |
0 (0%) |
435 (72.5%) |
2 (0.33%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
4 (0.67%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | adaptg2wsat2011 2011-03-02 (incomplete) |
|
Black Hole SAT 2011-03-08 (complete) |
|
borg-sat 11.03.02-industrial [DEPRECATED] (complete) |
|
borg-sat 11.03.02-par-industrial (fixed) (complete) |
|
borg-sat 11.03.02-par-random (fixed) (complete) |
|
borg-sat 11.03.02-random [DEPRECATED] (complete) |
|
borg-sat 11.03.02-seq-industrial (fixed) (complete) |
|
borg-sat 11.03.02-seq-industrial (fixed, 1200 s timeout) (complete) |
|
borg-sat 11.03.02-seq-random (fixed) (complete) |
|
borg-sat 11.03.02-seq-random (fixed, 1200 s timeout) (complete) |
|
clasp 2.0-R4092-crafted (complete) |
|
clasp 2.0-R4092-indust (complete) |
|
claspmt 2.0-R4095 [DEPRECATED] (complete) |
|
claspmt 2.0-R4095-patched (fixed) (complete) |
|
CryptoMiniSat Strange-Night-1-mt [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night-1-mt (fixed) (complete) |
|
CryptoMiniSat Strange-Night-1-st [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night-1-st (fixed) (complete) |
|
CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night-2-mt (fixed) (complete) |
|
CryptoMiniSat Strange-Night2-st [DEPRECATED] (complete) |
|
CryptoMiniSat Strange-Night2-st (fixed) (complete) |
|
CryptoMiniSat TechDemo-Alpha-mt (complete) |
|
CryptoMiniSat TechDemo-Alpha-st (complete) |
|
csls pnorm-8cores (incomplete) |
|
csls prob-4cores (incomplete) |
|
csls prob-8cores (incomplete) |
|
EagleUP 1.565.350 (incomplete) |
|
EBGlucose 1.0 (incomplete) |
|
glucose 2 (complete) |
|
glueminisat 2.2.5 (complete) |
|
jMiniSat 2011 (complete) |
|
kw 2011-02-28 (complete) |
|
Lingeling 587 [DEPRECATED] (complete) |
|
Lingeling 587f (fixed) (complete) |
|
march_rw 2011-03-02 (complete) |
|
minisat hack: cir_minisat 2011-03-02 (complete) |
|
minisat hack: cir_minisat 2011-05-13 (simp) (complete) |
|
minisat hack: contrasat 2011-03-02 (complete) |
|
minisat hack: EBMiniSAT 2011-03-02 (incomplete) |
|
minisat hack: LR_GL_NOSHR 2011-03-02 (complete) |
|
minisat hack: LR_GL_SHR 2011-03-02 (complete) |
|
minisat hack: LR_NOGL_NOSHR 2011-03-02 (complete) |
|
minisat hack: MiniSAT 2.2.0-agile-26 (complete) |
|
minisat hack: minisat_psm 2011-04-01 (complete) |
|
minisat hack reference: minisat 2.2.0 (complete) |
|
MPhaseSAT 2011-02-15 (complete) |
|
MPhaseSAT64 2011-03-03 [DEPRECATED] (complete) |
|
MPhaseSAT64 2011-05-14 (fixed) (complete) |
|
MPhaseSAT_M 2011-02-16 (complete) |
|
MultiFlip 2011-02-11 (incomplete) |
|
PicoSAT 941 (complete) |
|
Plingeling 587 [DEPRECATED] (complete) |
|
Plingeling 587f (fixed) (complete) |
|
ppfolio par (complete) |
|
ppfolio seq (complete) |
|
priss 1.0 (complete) |
|
priss Auto (complete) |
|
priss UP (complete) |
|
QuteRSat 2011-03-01 [DEPRECATED] (complete) |
|
QuteRSat 2011-05-12 (fixed) (complete) |
|
rcl 2011-04-01 (complete) |
|
RestartSAT A75 (complete) |
|
RestartSAT B95 (complete) |
|
riss 1.0 (complete) |
|
riss Auto (complete) |
|
riss Auto (1200 s timeout) (complete) |
|
riss Exp (complete) |
|
SApperloT 2011-03-23 (complete) |
|
SApperloT2010 2011-03-04 [DEPRECATED] (complete) |
|
SApperloT2010 2011-05-15 (fixed) (complete) |
|
SArTagnan 2011-03-24 [DEPRECATED] (complete) |
|
SArTagnan 2011-05-15 (fixed) (complete) |
|
SAT07 reference solver: minisat SAT 2007 (complete) |
|
SAT09 reference solver: clasp 1.2.0-SAT09-32 (complete) |
|
SAT09 reference solver:glucose 1.0 (complete) |
|
SAT09 reference solver: gnovelty+2 2009-03-22 (incomplete) |
|
SAT09 reference solver:LySAT i/2009-03-20 (complete) |
|
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20 (complete) |
|
SAT09 reference solver: march_hi hi (complete) |
|
SAT09 reference solver:precosat 236 (complete) |
|
SAT09 reference solver: SATzilla2009_C 2009-03-22 (complete) |
|
SAT09 reference solver: SATzilla2009_R 2009-03-22 (complete) |
|
SAT09 reference solver: TNM 2009-03-22 (incomplete) |
|
SAT4J core 2.3.0 SNAPSHOT 2011-02-06 (complete) |
|
sathys 2011-04-01 (complete) |
|
SAT_Intersec_01 2011-03-01 (complete) |
|
Satisfiability Solver Selector 2011-03-18 (complete) |
|
Satisfiability Solver Selector 2011-03-18 (1200 s timeout) (complete) |
|
sattime 2011-03-02 (incomplete) |
|
sattime+ 2011-03-02 (incomplete) |
|
sattime2011 2011-03-02 (incomplete) |
|
shortsattime+ 2011-03-02 (incomplete) |
|
shortsattime2011 2011-03-02 (incomplete) |
|
Sol 2011-04-04 (complete) |
|
sparrow2011 sparrow2011_ubcsat1.2_2011-03-02 (incomplete) |
|
STRUCTure 0.1 (complete) |
|
STRUCTure 0.1 (hbr=2) (complete) |
|
synit_sat 2011-03-03 (complete) |
|
tts 5-4 (complete) |
|
ttsth 5-4 (complete) |
|
UmSat 2011-02-25 [DEPRECATED] (complete) |
|
UmSat 2011-05-12 (fixed) (complete) |
|
---|