Solver Name | #benchs | Solved | UNSAT. | SAT. | SAT (timeout) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | UNKNOWN (abort) | Sig. Caught | NO CERT. | WRONG CERT. | WRONG UNSAT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
IUT_BMB_SIM 1.0 (complete) |
292 | 111 (38.01%) |
65 (22.26%) |
46 (15.75%) |
0 (0%) |
0 (0%) |
170 (58.22%) |
11 (3.77%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
kw_pre 2009-03-21 (complete) |
292 | 149 (51.03%) |
91 (31.16%) |
58 (19.86%) |
0 (0%) |
0 (0%) |
135 (46.23%) |
8 (2.74%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat2-core 070721 (complete) |
292 | 106 (36.3%) |
59 (20.21%) |
47 (16.1%) |
0 (0%) |
0 (0%) |
181 (61.99%) |
5 (1.71%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat2-simp 070721 (complete) |
292 | 116 (39.73%) |
70 (23.97%) |
46 (15.75%) |
0 (0%) |
0 (0%) |
172 (58.9%) |
4 (1.37%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ReVivAl 0.23 2009-03-18 (complete) |
292 | 117 (40.07%) |
64 (21.92%) |
53 (18.15%) |
0 (0%) |
0 (0%) |
174 (59.59%) |
1 (0.34%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ReVivAl 0.23 + SatElite 2009-03-18 (complete) |
292 | 121 (41.44%) |
70 (23.97%) |
51 (17.47%) |
0 (0%) |
0 (0%) |
162 (55.48%) |
0 (0%) |
0 (0%) |
0 (0%) |
9 (3.08%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SatElite + ReVivAl 0.23 2009-03-18 (complete) |
292 | 119 (40.75%) |
71 (24.32%) |
48 (16.44%) |
0 (0%) |
0 (0%) |
164 (56.16%) |
1 (0.34%) |
0 (0%) |
0 (0%) |
8 (2.74%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | IUT_BMB_SIM 1.0 (complete) |
|
kw_pre 2009-03-21 (complete) |
|
minisat2-core 070721 (complete) |
|
minisat2-simp 070721 (complete) |
|
ReVivAl 0.23 2009-03-18 (complete) |
|
ReVivAl 0.23 + SatElite 2009-03-18 (complete) |
|
SatElite + ReVivAl 0.23 2009-03-18 (complete) |
|
---|
Solver Name | #benchs | Solved | UNSAT. | SAT. | SAT (timeout) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | UNKNOWN (abort) | Sig. Caught | NO CERT. | WRONG CERT. | WRONG UNSAT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
IUT_BMB_SIM 1.0 (complete) |
281 | 107 (38.08%) |
33 (11.74%) |
74 (26.33%) |
0 (0%) |
0 (0%) |
174 (61.92%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
kw_pre 2009-03-21 (complete) |
281 | 106 (37.72%) |
34 (12.1%) |
72 (25.62%) |
0 (0%) |
0 (0%) |
175 (62.28%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat2-core 070721 (complete) |
281 | 100 (35.59%) |
31 (11.03%) |
69 (24.56%) |
0 (0%) |
0 (0%) |
181 (64.41%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat2-simp 070721 (complete) |
281 | 119 (42.35%) |
43 (15.3%) |
76 (27.05%) |
0 (0%) |
0 (0%) |
161 (57.3%) |
1 (0.36%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ReVivAl 0.23 2009-03-18 (complete) |
281 | 114 (40.57%) |
42 (14.95%) |
72 (25.62%) |
0 (0%) |
0 (0%) |
166 (59.07%) |
1 (0.36%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ReVivAl 0.23 + SatElite 2009-03-18 (complete) |
281 | 119 (42.35%) |
44 (15.66%) |
75 (26.69%) |
0 (0%) |
0 (0%) |
162 (57.65%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SatElite + ReVivAl 0.23 2009-03-18 (complete) |
281 | 119 (42.35%) |
44 (15.66%) |
75 (26.69%) |
0 (0%) |
0 (0%) |
162 (57.65%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | IUT_BMB_SIM 1.0 (complete) |
|
kw_pre 2009-03-21 (complete) |
|
minisat2-core 070721 (complete) |
|
minisat2-simp 070721 (complete) |
|
ReVivAl 0.23 2009-03-18 (complete) |
|
ReVivAl 0.23 + SatElite 2009-03-18 (complete) |
|
SatElite + ReVivAl 0.23 2009-03-18 (complete) |
|
---|
Solver Name | #benchs | Solved | UNSAT. | SAT. | SAT (timeout) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | UNKNOWN (abort) | Sig. Caught | NO CERT. | WRONG CERT. | WRONG UNSAT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
IUT_BMB_SIM 1.0 (complete) |
573 | 218 (38.05%) |
98 (17.1%) |
120 (20.94%) |
0 (0%) |
0 (0%) |
344 (60.03%) |
11 (1.92%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
kw_pre 2009-03-21 (complete) |
573 | 255 (44.5%) |
125 (21.82%) |
130 (22.69%) |
0 (0%) |
0 (0%) |
310 (54.1%) |
8 (1.4%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat2-core 070721 (complete) |
573 | 206 (35.95%) |
90 (15.71%) |
116 (20.24%) |
0 (0%) |
0 (0%) |
362 (63.18%) |
5 (0.87%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat2-simp 070721 (complete) |
573 | 235 (41.01%) |
113 (19.72%) |
122 (21.29%) |
0 (0%) |
0 (0%) |
333 (58.12%) |
5 (0.87%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ReVivAl 0.23 2009-03-18 (complete) |
573 | 231 (40.31%) |
106 (18.5%) |
125 (21.82%) |
0 (0%) |
0 (0%) |
340 (59.34%) |
2 (0.35%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ReVivAl 0.23 + SatElite 2009-03-18 (complete) |
573 | 240 (41.88%) |
114 (19.9%) |
126 (21.99%) |
0 (0%) |
0 (0%) |
324 (56.54%) |
0 (0%) |
0 (0%) |
0 (0%) |
9 (1.57%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SatElite + ReVivAl 0.23 2009-03-18 (complete) |
573 | 238 (41.54%) |
115 (20.07%) |
123 (21.47%) |
0 (0%) |
0 (0%) |
326 (56.89%) |
1 (0.17%) |
0 (0%) |
0 (0%) |
8 (1.4%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | IUT_BMB_SIM 1.0 (complete) |
|
kw_pre 2009-03-21 (complete) |
|
minisat2-core 070721 (complete) |
|
minisat2-simp 070721 (complete) |
|
ReVivAl 0.23 2009-03-18 (complete) |
|
ReVivAl 0.23 + SatElite 2009-03-18 (complete) |
|
SatElite + ReVivAl 0.23 2009-03-18 (complete) |
|
---|
This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.
Solver Name | #benchs | Solved | UNSAT. | SAT. | SAT (timeout) | UNKNOWN | UNKNOWN (timeout) | UNKNOWN (out of mem.) | UNKNOWN (exit code) | UNKNOWN (conv. script) | UNKNOWN (problem) | UNKNOWN (abort) | Sig. Caught | NO CERT. | WRONG CERT. | WRONG UNSAT. |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
IUT_BMB_SIM 1.0 (complete) |
573 | 218 (38.05%) |
98 (17.1%) |
120 (20.94%) |
0 (0%) |
0 (0%) |
344 (60.03%) |
11 (1.92%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
kw_pre 2009-03-21 (complete) |
573 | 255 (44.5%) |
125 (21.82%) |
130 (22.69%) |
0 (0%) |
0 (0%) |
310 (54.1%) |
8 (1.4%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat2-core 070721 (complete) |
573 | 206 (35.95%) |
90 (15.71%) |
116 (20.24%) |
0 (0%) |
0 (0%) |
362 (63.18%) |
5 (0.87%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
minisat2-simp 070721 (complete) |
573 | 235 (41.01%) |
113 (19.72%) |
122 (21.29%) |
0 (0%) |
0 (0%) |
333 (58.12%) |
5 (0.87%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ReVivAl 0.23 2009-03-18 (complete) |
573 | 231 (40.31%) |
106 (18.5%) |
125 (21.82%) |
0 (0%) |
0 (0%) |
340 (59.34%) |
2 (0.35%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
ReVivAl 0.23 + SatElite 2009-03-18 (complete) |
573 | 240 (41.88%) |
114 (19.9%) |
126 (21.99%) |
0 (0%) |
0 (0%) |
324 (56.54%) |
0 (0%) |
0 (0%) |
0 (0%) |
9 (1.57%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
SatElite + ReVivAl 0.23 2009-03-18 (complete) |
573 | 238 (41.54%) |
115 (20.07%) |
123 (21.47%) |
0 (0%) |
0 (0%) |
326 (56.89%) |
1 (0.17%) |
0 (0%) |
0 (0%) |
8 (1.4%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
0 (0%) |
Solver Name | Progress | IUT_BMB_SIM 1.0 (complete) |
|
kw_pre 2009-03-21 (complete) |
|
minisat2-core 070721 (complete) |
|
minisat2-simp 070721 (complete) |
|
ReVivAl 0.23 2009-03-18 (complete) |
|
ReVivAl 0.23 + SatElite 2009-03-18 (complete) |
|
SatElite + ReVivAl 0.23 2009-03-18 (complete) |
|
---|