Solver Name | Progress | CircUs 2009-03-23 (complete) |
|
clasp 1.2.0-SAT09-32 (complete) |
|
glucose 1.0 (complete) |
|
kw 2009-03-20 (complete) |
|
LySAT i/2009-03-20 (complete) |
|
ManySAT 1.1 aimd 1/2009-03-20 (complete) |
|
MiniSat 2.1 (Sat-race'08 Edition) (complete) |
|
MiniSAT 09z 2009-03-22 (complete) |
|
minisat_cumr p-2009-03-18 (complete) |
|
MXC 2009-03-10 (complete) |
|
precosat 236 (complete) |
|
Rsat 2009-03-22 (complete) |
|
SApperloT base (complete) |
|
SAT07 reference solver: picosat 535 (complete) |
|
SAT07 reference solver: Rsat 2007-02-08 (complete) |
|
SATzilla2009_I 2009-03-22 (complete) |
|
---|
Solver Name | #benchs | Solved | UNSAT. | SAT. | SAT (timeout) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | UNKNOWN (abort) | Sig. Caught | NO CERT. | WRONG CERT. | WRONG UNSAT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
clasp 1.2.0-SAT09-32 (complete) |
281 | 156 (55.52%) |
64 (22.78%) |
92 (32.74%) |
0 (0%) |
0 (0%) |
123 (43.77%) |
2 (0.71%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
glucose 1.0 (complete) |
281 | 135 (48.04%) |
49 (17.44%) |
86 (30.6%) |
0 (0%) |
0 (0%) |
146 (51.96%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
IUT_BMB_SAT 1.0 (complete) |
281 | 149 (53.02%) |
60 (21.35%) |
89 (31.67%) |
0 (0%) |
0 (0%) |
128 (45.55%) |
4 (1.42%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
LySAT c/2009-03-20 (complete) |
281 | 141 (50.18%) |
58 (20.64%) |
83 (29.54%) |
0 (0%) |
0 (0%) |
138 (49.11%) |
2 (0.71%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MiniSat 2.1 (Sat-race'08 Edition) (complete) |
281 | 137 (48.75%) |
50 (17.79%) |
87 (30.96%) |
0 (0%) |
0 (0%) |
144 (51.25%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
MXC 2009-03-10 (complete) |
281 | 146 (51.96%) |
55 (19.57%) |
91 (32.38%) |
0 (0%) |
0 (0%) |
135 (48.04%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
precosat 236 (complete) |
281 | 141 (50.18%) |
51 (18.15%) |
90 (32.03%) |
0 (0%) |
0 (0%) |
140 (49.82%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SApperloT base (complete) |
281 | 149 (53.02%) |
57 (20.28%) |
92 (32.74%) |
0 (0%) |
0 (0%) |
132 (46.98%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT07 reference solver: minisat SAT 2007 (complete) |
281 | 150 (53.38%) |
60 (21.35%) |
90 (32.03%) |
0 (0%) |
0 (0%) |
128 (45.55%) |
3 (1.07%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT07 reference solver: SATzilla CRAFTED (complete) |
281 | 137 (48.75%) |
53 (18.86%) |
84 (29.89%) |
0 (0%) |
11 (3.91%) |
8 (2.85%) |
1 (0.36%) |
124 (44.13%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SATzilla2009_C 2009-03-22 (complete) |
281 | 155 (55.16%) |
72 (25.62%) |
83 (29.54%) |
0 (0%) |
0 (0%) |
0 (0%) |
2 (0.71%) |
124 (44.13%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
VARSAT-industrial 2009-03-22 (complete) |
281 | 145 (51.6%) |
60 (21.35%) |
85 (30.25%) |
0 (0%) |
0 (0%) |
133 (47.33%) |
3 (1.07%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | clasp 1.2.0-SAT09-32 (complete) |
|
glucose 1.0 (complete) |
|
IUT_BMB_SAT 1.0 (complete) |
|
LySAT c/2009-03-20 (complete) |
|
MiniSat 2.1 (Sat-race'08 Edition) (complete) |
|
MXC 2009-03-10 (complete) |
|
precosat 236 (complete) |
|
SApperloT base (complete) |
|
SAT07 reference solver: minisat SAT 2007 (complete) |
|
SAT07 reference solver: SATzilla CRAFTED (complete) |
|
SATzilla2009_C 2009-03-22 (complete) |
|
VARSAT-industrial 2009-03-22 (complete) |
|
---|
Solver Name | #benchs | Solved | UNSAT. | SAT. | SAT (timeout) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | UNKNOWN (abort) | Sig. Caught | NO CERT. | WRONG CERT. | WRONG UNSAT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
adaptg2wsat2009++ 2009-03-23 (incomplete) |
610 | 338 (55.41%) |
0 (0%) |
338 (55.41%) |
0 (0%) |
0 (0%) |
272 (44.59%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
gnovelty+2 2009-03-22 (incomplete) |
610 | 355 (58.2%) |
0 (0%) |
355 (58.2%) |
0 (0%) |
0 (0%) |
254 (41.64%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
1 (0.16%) |
0 (0%) |
0 (0%) |
0 (0%) |
gNovelty+-T 2009-03-22 (incomplete) |
610 | 314 (51.48%) |
0 (0%) |
314 (51.48%) |
0 (0%) |
0 (0%) |
296 (48.52%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
hybridGM3 3 (incomplete) |
610 | 340 (55.74%) |
0 (0%) |
340 (55.74%) |
0 (0%) |
0 (0%) |
261 (42.79%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
9 (1.48%) |
0 (0%) |
0 (0%) |
0 (0%) |
iPAWS 2009-03-22 (incomplete) |
610 | 288 (47.21%) |
0 (0%) |
288 (47.21%) |
0 (0%) |
0 (0%) |
322 (52.79%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
march_hi hi (complete) |
610 | 313 (51.31%) |
140 (22.95%) |
173 (28.36%) |
0 (0%) |
0 (0%) |
297 (48.69%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT07 reference solver: adaptg2wsat+ 2007-02-08 (incomplete) |
610 | 298 (48.85%) |
0 (0%) |
298 (48.85%) |
0 (0%) |
0 (0%) |
312 (51.15%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT07 reference solver: gnovelty+ 2007-02-08 (incomplete) |
610 | 318 (52.13%) |
0 (0%) |
318 (52.13%) |
0 (0%) |
0 (0%) |
292 (47.87%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT07 reference solver: March KS 2007-02-08 (complete) |
610 | 308 (50.49%) |
131 (21.48%) |
177 (29.02%) |
0 (0%) |
0 (0%) |
297 (48.69%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
5 (0.82%) |
0 (0%) |
0 (0%) |
0 (0%) |
SAT07 reference solver: SATzilla RANDOM (complete) |
610 | 308 (50.49%) |
127 (20.82%) |
181 (29.67%) |
0 (0%) |
73 (11.97%) |
4 (0.66%) |
0 (0%) |
225 (36.89%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SATzilla2009_R 2009-03-22 (complete) |
610 | 435 (71.31%) |
96 (15.74%) |
339 (55.57%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
175 (28.69%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
TNM 2009-03-22 (incomplete) |
610 | 379 (62.13%) |
0 (0%) |
379 (62.13%) |
0 (0%) |
0 (0%) |
231 (37.87%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | adaptg2wsat2009++ 2009-03-23 (incomplete) |
|
gnovelty+2 2009-03-22 (incomplete) |
|
gNovelty+-T 2009-03-22 (incomplete) |
|
hybridGM3 3 (incomplete) |
|
iPAWS 2009-03-22 (incomplete) |
|
march_hi hi (complete) |
|
SAT07 reference solver: adaptg2wsat+ 2007-02-08 (incomplete) |
|
SAT07 reference solver: gnovelty+ 2007-02-08 (incomplete) |
|
SAT07 reference solver: March KS 2007-02-08 (complete) |
|
SAT07 reference solver: SATzilla RANDOM (complete) |
|
SATzilla2009_R 2009-03-22 (complete) |
|
TNM 2009-03-22 (incomplete) |
|
---|
This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.
Solver Name | Progress | adaptg2wsat2009++ 2009-03-23 (incomplete) |
|
CircUs 2009-03-23 (complete) |
|
clasp 1.2.0-SAT09-32 (complete) |
|
glucose 1.0 (complete) |
|
gnovelty+2 2009-03-22 (incomplete) |
|
gNovelty+-T 2009-03-22 (incomplete) |
|
hybridGM3 3 (incomplete) |
|
iPAWS 2009-03-22 (incomplete) |
|
IUT_BMB_SAT 1.0 (complete) |
|
kw 2009-03-20 (complete) |
|
LySAT c/2009-03-20 (complete) |
|
LySAT i/2009-03-20 (complete) |
|
ManySAT 1.1 aimd 1/2009-03-20 (complete) |
|
march_hi hi (complete) |
|
MiniSat 2.1 (Sat-race'08 Edition) (complete) |
|
MiniSAT 09z 2009-03-22 (complete) |
|
minisat_cumr p-2009-03-18 (complete) |
|
MXC 2009-03-10 (complete) |
|
precosat 236 (complete) |
|
Rsat 2009-03-22 (complete) |
|
SApperloT base (complete) |
|
SAT07 reference solver: adaptg2wsat+ 2007-02-08 (incomplete) |
|
SAT07 reference solver: gnovelty+ 2007-02-08 (incomplete) |
|
SAT07 reference solver: March KS 2007-02-08 (complete) |
|
SAT07 reference solver: minisat SAT 2007 (complete) |
|
SAT07 reference solver: picosat 535 (complete) |
|
SAT07 reference solver: Rsat 2007-02-08 (complete) |
|
SAT07 reference solver: SATzilla CRAFTED (complete) |
|
SAT07 reference solver: SATzilla RANDOM (complete) |
|
SATzilla2009_C 2009-03-22 (complete) |
|
SATzilla2009_I 2009-03-22 (complete) |
|
SATzilla2009_R 2009-03-22 (complete) |
|
TNM 2009-03-22 (incomplete) |
|
VARSAT-industrial 2009-03-22 (complete) |
|
---|