SAT 2009 Competition: preprocessors track: solvers page (tabular format, summary)

Some explanations

Category "applications instances" (APPLICATION)

Solver Name#benchsSolvedUNSATSATUNKNOWNBad Answers
IUT_BMB_SIM
1.0
(complete)		 292111
(38.01%)		 65
(22.26%)		 46
(15.75%)		 181
(61.99%)		 0
(0%)
kw_pre
2009-03-21
(complete)		 292149
(51.03%)		 91
(31.16%)		 58
(19.86%)		 143
(48.97%)		 0
(0%)
minisat2-core
070721
(complete)		 292106
(36.3%)		 59
(20.21%)		 47
(16.1%)		 186
(63.7%)		 0
(0%)
minisat2-simp
070721
(complete)		 292116
(39.73%)		 70
(23.97%)		 46
(15.75%)		 176
(60.27%)		 0
(0%)
ReVivAl 0.23
2009-03-18
(complete)		 292117
(40.07%)		 64
(21.92%)		 53
(18.15%)		 175
(59.93%)		 0
(0%)
ReVivAl 0.23 + SatElite
2009-03-18
(complete)		 292121
(41.44%)		 70
(23.97%)		 51
(17.47%)		 171
(58.56%)		 0
(0%)
SatElite + ReVivAl 0.23
2009-03-18
(complete)		 292119
(40.75%)		 71
(24.32%)		 48
(16.44%)		 173
(59.25%)		 0
(0%)

Solver NameProgress
IUT_BMB_SIM
1.0
(complete)
done
292
UNSAT
65		SAT
46		?
181
kw_pre
2009-03-21
(complete)
done
292
UNSAT
91		SAT
58		?
143
minisat2-core
070721
(complete)
done
292
UNSAT
59		SAT
47		?
186
minisat2-simp
070721
(complete)
done
292
UNSAT
70		SAT
46		?
176
ReVivAl 0.23
2009-03-18
(complete)
done
292
UNSAT
64		SAT
53		?
175
ReVivAl 0.23 + SatElite
2009-03-18
(complete)
done
292
UNSAT
70		SAT
51		?
171
SatElite + ReVivAl 0.23
2009-03-18
(complete)
done
292
UNSAT
71		SAT
48		?
173

Category "crafted instances" (CRAFTED)

Solver Name#benchsSolvedUNSATSATUNKNOWNBad Answers
IUT_BMB_SIM
1.0
(complete)		 281107
(38.08%)		 33
(11.74%)		 74
(26.33%)		 174
(61.92%)		 0
(0%)
kw_pre
2009-03-21
(complete)		 281106
(37.72%)		 34
(12.1%)		 72
(25.62%)		 175
(62.28%)		 0
(0%)
minisat2-core
070721
(complete)		 281100
(35.59%)		 31
(11.03%)		 69
(24.56%)		 181
(64.41%)		 0
(0%)
minisat2-simp
070721
(complete)		 281119
(42.35%)		 43
(15.3%)		 76
(27.05%)		 162
(57.65%)		 0
(0%)
ReVivAl 0.23
2009-03-18
(complete)		 281114
(40.57%)		 42
(14.95%)		 72
(25.62%)		 167
(59.43%)		 0
(0%)
ReVivAl 0.23 + SatElite
2009-03-18
(complete)		 281119
(42.35%)		 44
(15.66%)		 75
(26.69%)		 162
(57.65%)		 0
(0%)
SatElite + ReVivAl 0.23
2009-03-18
(complete)		 281119
(42.35%)		 44
(15.66%)		 75
(26.69%)		 162
(57.65%)		 0
(0%)

Solver NameProgress
IUT_BMB_SIM
1.0
(complete)
done
281
UNSAT
33		SAT
74		?
174
kw_pre
2009-03-21
(complete)
done
281
UNSAT
34		SAT
72		?
175
minisat2-core
070721
(complete)
done
281
UNSAT
31		SAT
69		?
181
minisat2-simp
070721
(complete)
done
281
UNSAT
43		SAT
76		?
162
ReVivAl 0.23
2009-03-18
(complete)
done
281
UNSAT
42		SAT
72		?
167
ReVivAl 0.23 + SatElite
2009-03-18
(complete)
done
281
UNSAT
44		SAT
75		?
162
SatElite + ReVivAl 0.23
2009-03-18
(complete)
done
281
UNSAT
44		SAT
75		?
162

All categories for solvers registered in all categories

Solver Name#benchsSolvedUNSATSATUNKNOWNBad Answers
IUT_BMB_SIM
1.0
(complete)		 573218
(38.05%)		 98
(17.1%)		 120
(20.94%)		 355
(61.95%)		 0
(0%)
kw_pre
2009-03-21
(complete)		 573255
(44.5%)		 125
(21.82%)		 130
(22.69%)		 318
(55.5%)		 0
(0%)
minisat2-core
070721
(complete)		 573206
(35.95%)		 90
(15.71%)		 116
(20.24%)		 367
(64.05%)		 0
(0%)
minisat2-simp
070721
(complete)		 573235
(41.01%)		 113
(19.72%)		 122
(21.29%)		 338
(58.99%)		 0
(0%)
ReVivAl 0.23
2009-03-18
(complete)		 573231
(40.31%)		 106
(18.5%)		 125
(21.82%)		 342
(59.69%)		 0
(0%)
ReVivAl 0.23 + SatElite
2009-03-18
(complete)		 573240
(41.88%)		 114
(19.9%)		 126
(21.99%)		 333
(58.12%)		 0
(0%)
SatElite + ReVivAl 0.23
2009-03-18
(complete)		 573238
(41.54%)		 115
(20.07%)		 123
(21.47%)		 335
(58.46%)		 0
(0%)

Solver NameProgress
IUT_BMB_SIM
1.0
(complete)
done
573
UNSAT
98		SAT
120		?
355
kw_pre
2009-03-21
(complete)
done
573
UNSAT
125		SAT
130		?
318
minisat2-core
070721
(complete)
done
573
UNSAT
90		SAT
116		?
367
minisat2-simp
070721
(complete)
done
573
UNSAT
113		SAT
122		?
338
ReVivAl 0.23
2009-03-18
(complete)
done
573
UNSAT
106		SAT
125		?
342
ReVivAl 0.23 + SatElite
2009-03-18
(complete)
done
573
UNSAT
114		SAT
126		?
333
SatElite + ReVivAl 0.23
2009-03-18
(complete)
done
573
UNSAT
115		SAT
123		?
335

All categories and all solvers (regardless of their ability to support all categories)

This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.

Solver Name#benchsSolvedUNSATSATUNKNOWNBad Answers
IUT_BMB_SIM
1.0
(complete)		 573218
(38.05%)		 98
(17.1%)		 120
(20.94%)		 355
(61.95%)		 0
(0%)
kw_pre
2009-03-21
(complete)		 573255
(44.5%)		 125
(21.82%)		 130
(22.69%)		 318
(55.5%)		 0
(0%)
minisat2-core
070721
(complete)		 573206
(35.95%)		 90
(15.71%)		 116
(20.24%)		 367
(64.05%)		 0
(0%)
minisat2-simp
070721
(complete)		 573235
(41.01%)		 113
(19.72%)		 122
(21.29%)		 338
(58.99%)		 0
(0%)
ReVivAl 0.23
2009-03-18
(complete)		 573231
(40.31%)		 106
(18.5%)		 125
(21.82%)		 342
(59.69%)		 0
(0%)
ReVivAl 0.23 + SatElite
2009-03-18
(complete)		 573240
(41.88%)		 114
(19.9%)		 126
(21.99%)		 333
(58.12%)		 0
(0%)
SatElite + ReVivAl 0.23
2009-03-18
(complete)		 573238
(41.54%)		 115
(20.07%)		 123
(21.47%)		 335
(58.46%)		 0
(0%)

Solver NameProgress
IUT_BMB_SIM
1.0
(complete)
done
573
UNSAT
98		SAT
120		?
355
kw_pre
2009-03-21
(complete)
done
573
UNSAT
125		SAT
130		?
318
minisat2-core
070721
(complete)
done
573
UNSAT
90		SAT
116		?
367
minisat2-simp
070721
(complete)
done
573
UNSAT
113		SAT
122		?
338
ReVivAl 0.23
2009-03-18
(complete)
done
573
UNSAT
106		SAT
125		?
342
ReVivAl 0.23 + SatElite
2009-03-18
(complete)
done
573
UNSAT
114		SAT
126		?
333
SatElite + ReVivAl 0.23
2009-03-18
(complete)
done
573
UNSAT
115		SAT
123		?
335