SAT 2011 Competition: main competition (phase 2): solvers page (tabular format, summary)

Some explanations

Category "applications instances" (APPLICATION)

Solver Name#benchsSolvedUNSATSATUNKNOWNBad Answers
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)		 300196
(65.33%)		 105
(35%)		 91
(30.33%)		 104
(34.67%)		 0
(0%)
borg-sat
11.03.02-par-industrial (fixed)
(complete)		 300195
(65%)		 105
(35%)		 90
(30%)		 105
(35%)		 0
(0%)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)		 300190
(63.33%)		 100
(33.33%)		 90
(30%)		 110
(36.67%)		 0
(0%)
claspmt
2.0-R4095 [DEPRECATED]
(complete)		 300209
(69.67%)		 112
(37.33%)		 97
(32.33%)		 83
(27.67%)		 8
(2.67%)
claspmt
2.0-R4095-patched (fixed)
(complete)		 300212
(70.67%)		 117
(39%)		 95
(31.67%)		 88
(29.33%)		 0
(0%)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)		 300224
(74.67%)		 127
(42.33%)		 97
(32.33%)		 76
(25.33%)		 0
(0%)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)		 300230
(76.67%)		 133
(44.33%)		 97
(32.33%)		 70
(23.33%)		 0
(0%)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)		 300207
(69%)		 119
(39.67%)		 88
(29.33%)		 93
(31%)		 0
(0%)
EBGlucose
1.0
(incomplete)		 300199
(66.33%)		 108
(36%)		 91
(30.33%)		 101
(33.67%)		 0
(0%)
glucose
2
(complete)		 300215
(71.67%)		 121
(40.33%)		 94
(31.33%)		 85
(28.33%)		 0
(0%)
glueminisat
2.2.5
(complete)		 300211
(70.33%)		 126
(42%)		 85
(28.33%)		 89
(29.67%)		 0
(0%)
Lingeling
587 [DEPRECATED]
(complete)		 300208
(69.33%)		 117
(39%)		 91
(30.33%)		 92
(30.67%)		 0
(0%)
Lingeling
587f (fixed)
(complete)		 300208
(69.33%)		 117
(39%)		 91
(30.33%)		 92
(30.67%)		 0
(0%)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)		 300202
(67.33%)		 103
(34.33%)		 99
(33%)		 98
(32.67%)		 0
(0%)
minisat hack: contrasat
2011-03-02
(complete)		 300199
(66.33%)		 100
(33.33%)		 99
(33%)		 101
(33.67%)		 0
(0%)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)		 300196
(65.33%)		 98
(32.67%)		 98
(32.67%)		 104
(34.67%)		 0
(0%)
minisat hack: LR_GL_SHR
2011-03-02
(complete)		 300191
(63.67%)		 110
(36.67%)		 81
(27%)		 109
(36.33%)		 0
(0%)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)		 300189
(63%)		 94
(31.33%)		 95
(31.67%)		 111
(37%)		 0
(0%)
minisat hack: minisat_psm
2011-04-01
(complete)		 300197
(65.67%)		 102
(34%)		 95
(31.67%)		 103
(34.33%)		 0
(0%)
minisat hack reference: minisat
2.2.0
(complete)		 300194
(64.67%)		 99
(33%)		 95
(31.67%)		 106
(35.33%)		 0
(0%)
MPhaseSAT64
2011-05-14 (fixed)
(complete)		 300201
(67%)		 102
(34%)		 99
(33%)		 99
(33%)		 0
(0%)
Plingeling
587 [DEPRECATED]
(complete)		 300230
(76.67%)		 124
(41.33%)		 106
(35.33%)		 70
(23.33%)		 0
(0%)
Plingeling
587f (fixed)
(complete)		 300230
(76.67%)		 124
(41.33%)		 106
(35.33%)		 70
(23.33%)		 0
(0%)
ppfolio
par
(complete)		 300229
(76.33%)		 122
(40.67%)		 107
(35.67%)		 71
(23.67%)		 0
(0%)
QuteRSat
2011-05-12 (fixed)
(complete)		 300206
(68.67%)		 120
(40%)		 86
(28.67%)		 94
(31.33%)		 0
(0%)
rcl
2011-04-01
(complete)		 300184
(61.33%)		 91
(30.33%)		 93
(31%)		 116
(38.67%)		 0
(0%)
RestartSAT
B95
(complete)		 300201
(67%)		 104
(34.67%)		 97
(32.33%)		 99
(33%)		 0
(0%)
SAT09 reference solver:glucose
1.0
(complete)		 300197
(65.67%)		 110
(36.67%)		 87
(29%)		 103
(34.33%)		 0
(0%)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)		 300194
(64.67%)		 109
(36.33%)		 85
(28.33%)		 106
(35.33%)		 0
(0%)
SAT09 reference solver:precosat
236
(complete)		 300206
(68.67%)		 110
(36.67%)		 96
(32%)		 94
(31.33%)		 0
(0%)
Satisfiability Solver Selector
2011-03-18
(complete)		 300200
(66.67%)		 109
(36.33%)		 91
(30.33%)		 100
(33.33%)		 0
(0%)

Solver NameProgress
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
done
300
UNSAT
105		SAT
91		?
104
borg-sat
11.03.02-par-industrial (fixed)
(complete)
done
300
UNSAT
105		SAT
90		?
105
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
done
300
UNSAT
100		SAT
90		?
110
claspmt
2.0-R4095 [DEPRECATED]
(complete)
done
300
UNSAT
112		SAT
97		?
83		ERR
8
claspmt
2.0-R4095-patched (fixed)
(complete)
done
300
UNSAT
117		SAT
95		?
88
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
done
300
UNSAT
127		SAT
97		?
76
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
done
300
UNSAT
133		SAT
97		?
70
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
done
300
UNSAT
119		SAT
88		?
93
EBGlucose
1.0
(incomplete)
done
300
UNSAT
108		SAT
91		?
101
glucose
2
(complete)
done
300
UNSAT
121		SAT
94		?
85
glueminisat
2.2.5
(complete)
done
300
UNSAT
126		SAT
85		?
89
Lingeling
587 [DEPRECATED]
(complete)
done
300
UNSAT
117		SAT
91		?
92
Lingeling
587f (fixed)
(complete)
done
300
UNSAT
117		SAT
91		?
92
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
done
300
UNSAT
103		SAT
99		?
98
minisat hack: contrasat
2011-03-02
(complete)
done
300
UNSAT
100		SAT
99		?
101
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
done
300
UNSAT
98		SAT
98		?
104
minisat hack: LR_GL_SHR
2011-03-02
(complete)
done
300
UNSAT
110		SAT
81		?
109
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
done
300
UNSAT
94		SAT
95		?
111
minisat hack: minisat_psm
2011-04-01
(complete)
done
300
UNSAT
102		SAT
95		?
103
minisat hack reference: minisat
2.2.0
(complete)
done
300
UNSAT
99		SAT
95		?
106
MPhaseSAT64
2011-05-14 (fixed)
(complete)
done
300
UNSAT
102		SAT
99		?
99
Plingeling
587 [DEPRECATED]
(complete)
done
300
UNSAT
124		SAT
106		?
70
Plingeling
587f (fixed)
(complete)
done
300
UNSAT
124		SAT
106		?
70
ppfolio
par
(complete)
done
300
UNSAT
122		SAT
107		?
71
QuteRSat
2011-05-12 (fixed)
(complete)
done
300
UNSAT
120		SAT
86		?
94
rcl
2011-04-01
(complete)
done
300
UNSAT
91		SAT
93		?
116
RestartSAT
B95
(complete)
done
300
UNSAT
104		SAT
97		?
99
SAT09 reference solver:glucose
1.0
(complete)
done
300
UNSAT
110		SAT
87		?
103
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
done
300
UNSAT
109		SAT
85		?
106
SAT09 reference solver:precosat
236
(complete)
done
300
UNSAT
110		SAT
96		?
94
Satisfiability Solver Selector
2011-03-18
(complete)
done
300
UNSAT
109		SAT
91		?
100

Category "crafted instances" (CRAFTED)

Solver Name#benchsSolvedUNSATSATUNKNOWNBad Answers
clasp
2.0-R4092-crafted
(complete)		 300149
(49.67%)		 62
(20.67%)		 87
(29%)		 151
(50.33%)		 0
(0%)
claspmt
2.0-R4095 [DEPRECATED]
(complete)		 300167
(55.67%)		 69
(23%)		 98
(32.67%)		 133
(44.33%)		 0
(0%)
claspmt
2.0-R4095-patched (fixed)
(complete)		 300170
(56.67%)		 70
(23.33%)		 100
(33.33%)		 130
(43.33%)		 0
(0%)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)		 300131
(43.67%)		 45
(15%)		 86
(28.67%)		 169
(56.33%)		 0
(0%)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)		 300110
(36.67%)		 40
(13.33%)		 70
(23.33%)		 190
(63.33%)		 0
(0%)
glucose
2
(complete)		 300125
(41.67%)		 42
(14%)		 83
(27.67%)		 175
(58.33%)		 0
(0%)
jMiniSat
2011
(complete)		 30098
(32.67%)		 28
(9.33%)		 70
(23.33%)		 202
(67.33%)		 0
(0%)
MPhaseSAT
2011-02-15
(complete)		 300132
(44%)		 39
(13%)		 93
(31%)		 168
(56%)		 0
(0%)
PicoSAT
941
(complete)		 300121
(40.33%)		 40
(13.33%)		 81
(27%)		 179
(59.67%)		 0
(0%)
Plingeling
587f (fixed)
(complete)		 300131
(43.67%)		 40
(13.33%)		 91
(30.33%)		 169
(56.33%)		 0
(0%)
ppfolio
par
(complete)		 300187
(62.33%)		 60
(20%)		 127
(42.33%)		 113
(37.67%)		 0
(0%)
ppfolio
seq
(complete)		 300152
(50.67%)		 38
(12.67%)		 114
(38%)		 148
(49.33%)		 0
(0%)
priss
1.0
(complete)		 300104
(34.67%)		 31
(10.33%)		 73
(24.33%)		 196
(65.33%)		 0
(0%)
QuteRSat
2011-05-12 (fixed)
(complete)		 300110
(36.67%)		 40
(13.33%)		 70
(23.33%)		 190
(63.33%)		 0
(0%)
RestartSAT
B95
(complete)		 300112
(37.33%)		 35
(11.67%)		 77
(25.67%)		 188
(62.67%)		 0
(0%)
SApperloT2010
2011-05-15 (fixed)
(complete)		 300109
(36.33%)		 33
(11%)		 76
(25.33%)		 191
(63.67%)		 0
(0%)
SArTagnan
2011-05-15 (fixed)
(complete)		 300148
(49.33%)		 47
(15.67%)		 101
(33.67%)		 152
(50.67%)		 0
(0%)
SAT07 reference solver: minisat
SAT 2007
(complete)		 300122
(40.67%)		 44
(14.67%)		 78
(26%)		 178
(59.33%)		 0
(0%)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)		 300149
(49.67%)		 64
(21.33%)		 85
(28.33%)		 151
(50.33%)		 0
(0%)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)		 300116
(38.67%)		 43
(14.33%)		 73
(24.33%)		 184
(61.33%)		 0
(0%)
sathys
2011-04-01
(complete)		 30096
(32%)		 23
(7.67%)		 73
(24.33%)		 204
(68%)		 0
(0%)
Satisfiability Solver Selector
2011-03-18
(complete)		 300163
(54.33%)		 51
(17%)		 112
(37.33%)		 137
(45.67%)		 0
(0%)
sattime
2011-03-02
(incomplete)		 300109
(36.33%)		 0
(0%)		 109
(36.33%)		 191
(63.67%)		 0
(0%)
sattime+
2011-03-02
(incomplete)		 300106
(35.33%)		 0
(0%)		 106
(35.33%)		 194
(64.67%)		 0
(0%)
Sol
2011-04-04
(complete)		 300116
(38.67%)		 37
(12.33%)		 79
(26.33%)		 184
(61.33%)		 0
(0%)

Solver NameProgress
clasp
2.0-R4092-crafted
(complete)
done
300
UNSAT
62		SAT
87		?
151
claspmt
2.0-R4095 [DEPRECATED]
(complete)
done
300
UNSAT
69		SAT
98		?
133
claspmt
2.0-R4095-patched (fixed)
(complete)
done
300
UNSAT
70		SAT
100		?
130
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
done
300
UNSAT
45		SAT
86		?
169
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
done
300
UNSAT
40		SAT
70		?
190
glucose
2
(complete)
done
300
UNSAT
42		SAT
83		?
175
jMiniSat
2011
(complete)
done
300
UNSAT
28		SAT
70		?
202
MPhaseSAT
2011-02-15
(complete)
done
300
UNSAT
39		SAT
93		?
168
PicoSAT
941
(complete)
done
300
UNSAT
40		SAT
81		?
179
Plingeling
587f (fixed)
(complete)
done
300
UNSAT
40		SAT
91		?
169
ppfolio
par
(complete)
done
300
UNSAT
60		SAT
127		?
113
ppfolio
seq
(complete)
done
300
UNSAT
38		SAT
114		?
148
priss
1.0
(complete)
done
300
UNSAT
31		SAT
73		?
196
QuteRSat
2011-05-12 (fixed)
(complete)
done
300
UNSAT
40		SAT
70		?
190
RestartSAT
B95
(complete)
done
300
UNSAT
35		SAT
77		?
188
SApperloT2010
2011-05-15 (fixed)
(complete)
done
300
UNSAT
33		SAT
76		?
191
SArTagnan
2011-05-15 (fixed)
(complete)
done
300
UNSAT
47		SAT
101		?
152
SAT07 reference solver: minisat
SAT 2007
(complete)
done
300
UNSAT
44		SAT
78		?
178
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
done
300
UNSAT
64		SAT
85		?
151
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
done
300
UNSAT
43		SAT
73		?
184
sathys
2011-04-01
(complete)
done
300
UNSAT
23		SAT
73		?
204
Satisfiability Solver Selector
2011-03-18
(complete)
done
300
UNSAT
51		SAT
112		?
137
sattime
2011-03-02
(incomplete)
done
300
SAT
109		?
191
sattime+
2011-03-02
(incomplete)
done
300
SAT
106		?
194
Sol
2011-04-04
(complete)
done
300
UNSAT
37		SAT
79		?
184

Category "random instances" (RANDOM)

Solver Name#benchsSolvedUNSATSATUNKNOWNBad Answers
adaptg2wsat2011
2011-03-02
(incomplete)		 600328
(54.67%)		 0
(0%)		 328
(54.67%)		 272
(45.33%)		 0
(0%)
borg-sat
11.03.02-par-random (fixed)
(complete)		 600363
(60.5%)		 112
(18.67%)		 251
(41.83%)		 235
(39.17%)		 2
(0.33%)
borg-sat
11.03.02-random [DEPRECATED]
(complete)		 600347
(57.83%)		 110
(18.33%)		 237
(39.5%)		 251
(41.83%)		 2
(0.33%)
borg-sat
11.03.02-seq-random (fixed)
(complete)		 600415
(69.17%)		 111
(18.5%)		 304
(50.67%)		 180
(30%)		 5
(0.83%)
csls
pnorm-8cores
(incomplete)		 600335
(55.83%)		 0
(0%)		 335
(55.83%)		 265
(44.17%)		 0
(0%)
EagleUP
1.565.350
(incomplete)		 600328
(54.67%)		 0
(0%)		 328
(54.67%)		 272
(45.33%)		 0
(0%)
march_rw
2011-03-02
(complete)		 600251
(41.83%)		 123
(20.5%)		 128
(21.33%)		 349
(58.17%)		 0
(0%)
MPhaseSAT_M
2011-02-16
(complete)		 600359
(59.83%)		 104
(17.33%)		 255
(42.5%)		 241
(40.17%)		 0
(0%)
ppfolio
par
(complete)		 600444
(74%)		 122
(20.33%)		 322
(53.67%)		 156
(26%)		 0
(0%)
ppfolio
seq
(complete)		 600375
(62.5%)		 67
(11.17%)		 308
(51.33%)		 225
(37.5%)		 0
(0%)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)		 600298
(49.67%)		 0
(0%)		 298
(49.67%)		 302
(50.33%)		 0
(0%)
SAT09 reference solver: march_hi
hi
(complete)		 600251
(41.83%)		 123
(20.5%)		 128
(21.33%)		 349
(58.17%)		 0
(0%)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)		 600384
(64%)		 97
(16.17%)		 287
(47.83%)		 216
(36%)		 0
(0%)
SAT09 reference solver: TNM
2009-03-22
(incomplete)		 600324
(54%)		 0
(0%)		 324
(54%)		 276
(46%)		 0
(0%)
Satisfiability Solver Selector
2011-03-18
(complete)		 600408
(68%)		 96
(16%)		 312
(52%)		 192
(32%)		 0
(0%)
sattime2011
2011-03-02
(incomplete)		 600334
(55.67%)		 0
(0%)		 334
(55.67%)		 266
(44.33%)		 0
(0%)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)		 600362
(60.33%)		 0
(0%)		 362
(60.33%)		 238
(39.67%)		 0
(0%)

Solver NameProgress
adaptg2wsat2011
2011-03-02
(incomplete)
done
600
SAT
328		?
272
borg-sat
11.03.02-par-random (fixed)
(complete)
done
600
UNSAT
112		SAT
251		?
235		ERR
2
borg-sat
11.03.02-random [DEPRECATED]
(complete)
done
600
UNSAT
110		SAT
237		?
251		ERR
2
borg-sat
11.03.02-seq-random (fixed)
(complete)
done
600
UNSAT
111		SAT
304		?
180		ERR
5
csls
pnorm-8cores
(incomplete)
done
600
SAT
335		?
265
EagleUP
1.565.350
(incomplete)
done
600
SAT
328		?
272
march_rw
2011-03-02
(complete)
done
600
UNSAT
123		SAT
128		?
349
MPhaseSAT_M
2011-02-16
(complete)
done
600
UNSAT
104		SAT
255		?
241
ppfolio
par
(complete)
done
600
UNSAT
122		SAT
322		?
156
ppfolio
seq
(complete)
done
600
UNSAT
67		SAT
308		?
225
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
done
600
SAT
298		?
302
SAT09 reference solver: march_hi
hi
(complete)
done
600
UNSAT
123		SAT
128		?
349
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
done
600
UNSAT
97		SAT
287		?
216
SAT09 reference solver: TNM
2009-03-22
(incomplete)
done
600
SAT
324		?
276
Satisfiability Solver Selector
2011-03-18
(complete)
done
600
UNSAT
96		SAT
312		?
192
sattime2011
2011-03-02
(incomplete)
done
600
SAT
334		?
266
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
done
600
SAT
362		?
238

All categories for solvers registered in all categories

Solver Name#benchsSolvedUNSATSATUNKNOWNBad Answers
ppfolio
par
(complete)		 1200860
(71.67%)		 304
(25.33%)		 556
(46.33%)		 340
(28.33%)		 0
(0%)
Satisfiability Solver Selector
2011-03-18
(complete)		 1200771
(64.25%)		 256
(21.33%)		 515
(42.92%)		 429
(35.75%)		 0
(0%)

Solver NameProgress
ppfolio
par
(complete)
done
1200
UNSAT
304		SAT
556		?
340
Satisfiability Solver Selector
2011-03-18
(complete)
done
1200
UNSAT
256		SAT
515		?
429

All categories and all solvers (regardless of their ability to support all categories)

This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.

Solver Name#benchsSolvedUNSATSATUNKNOWNBad Answers
adaptg2wsat2011
2011-03-02
(incomplete)		 600328
(54.67%)		 0
(0%)		 328
(54.67%)		 272
(45.33%)		 0
(0%)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)		 300196
(65.33%)		 105
(35%)		 91
(30.33%)		 104
(34.67%)		 0
(0%)
borg-sat
11.03.02-par-industrial (fixed)
(complete)		 300195
(65%)		 105
(35%)		 90
(30%)		 105
(35%)		 0
(0%)
borg-sat
11.03.02-par-random (fixed)
(complete)		 600363
(60.5%)		 112
(18.67%)		 251
(41.83%)		 235
(39.17%)		 2
(0.33%)
borg-sat
11.03.02-random [DEPRECATED]
(complete)		 600347
(57.83%)		 110
(18.33%)		 237
(39.5%)		 251
(41.83%)		 2
(0.33%)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)		 300190
(63.33%)		 100
(33.33%)		 90
(30%)		 110
(36.67%)		 0
(0%)
borg-sat
11.03.02-seq-random (fixed)
(complete)		 600415
(69.17%)		 111
(18.5%)		 304
(50.67%)		 180
(30%)		 5
(0.83%)
clasp
2.0-R4092-crafted
(complete)		 300149
(49.67%)		 62
(20.67%)		 87
(29%)		 151
(50.33%)		 0
(0%)
claspmt
2.0-R4095 [DEPRECATED]
(complete)		 600376
(62.67%)		 181
(30.17%)		 195
(32.5%)		 216
(36%)		 8
(1.33%)
claspmt
2.0-R4095-patched (fixed)
(complete)		 600382
(63.67%)		 187
(31.17%)		 195
(32.5%)		 218
(36.33%)		 0
(0%)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)		 300224
(74.67%)		 127
(42.33%)		 97
(32.33%)		 76
(25.33%)		 0
(0%)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)		 600361
(60.17%)		 178
(29.67%)		 183
(30.5%)		 239
(39.83%)		 0
(0%)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)		 600317
(52.83%)		 159
(26.5%)		 158
(26.33%)		 283
(47.17%)		 0
(0%)
csls
pnorm-8cores
(incomplete)		 600335
(55.83%)		 0
(0%)		 335
(55.83%)		 265
(44.17%)		 0
(0%)
EagleUP
1.565.350
(incomplete)		 600328
(54.67%)		 0
(0%)		 328
(54.67%)		 272
(45.33%)		 0
(0%)
EBGlucose
1.0
(incomplete)		 300199
(66.33%)		 108
(36%)		 91
(30.33%)		 101
(33.67%)		 0
(0%)
glucose
2
(complete)		 600340
(56.67%)		 163
(27.17%)		 177
(29.5%)		 260
(43.33%)		 0
(0%)
glueminisat
2.2.5
(complete)		 300211
(70.33%)		 126
(42%)		 85
(28.33%)		 89
(29.67%)		 0
(0%)
jMiniSat
2011
(complete)		 30098
(32.67%)		 28
(9.33%)		 70
(23.33%)		 202
(67.33%)		 0
(0%)
Lingeling
587 [DEPRECATED]
(complete)		 300208
(69.33%)		 117
(39%)		 91
(30.33%)		 92
(30.67%)		 0
(0%)
Lingeling
587f (fixed)
(complete)		 300208
(69.33%)		 117
(39%)		 91
(30.33%)		 92
(30.67%)		 0
(0%)
march_rw
2011-03-02
(complete)		 600251
(41.83%)		 123
(20.5%)		 128
(21.33%)		 349
(58.17%)		 0
(0%)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)		 300202
(67.33%)		 103
(34.33%)		 99
(33%)		 98
(32.67%)		 0
(0%)
minisat hack: contrasat
2011-03-02
(complete)		 300199
(66.33%)		 100
(33.33%)		 99
(33%)		 101
(33.67%)		 0
(0%)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)		 300196
(65.33%)		 98
(32.67%)		 98
(32.67%)		 104
(34.67%)		 0
(0%)
minisat hack: LR_GL_SHR
2011-03-02
(complete)		 300191
(63.67%)		 110
(36.67%)		 81
(27%)		 109
(36.33%)		 0
(0%)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)		 300189
(63%)		 94
(31.33%)		 95
(31.67%)		 111
(37%)		 0
(0%)
minisat hack: minisat_psm
2011-04-01
(complete)		 300197
(65.67%)		 102
(34%)		 95
(31.67%)		 103
(34.33%)		 0
(0%)
minisat hack reference: minisat
2.2.0
(complete)		 300194
(64.67%)		 99
(33%)		 95
(31.67%)		 106
(35.33%)		 0
(0%)
MPhaseSAT
2011-02-15
(complete)		 300132
(44%)		 39
(13%)		 93
(31%)		 168
(56%)		 0
(0%)
MPhaseSAT64
2011-05-14 (fixed)
(complete)		 300201
(67%)		 102
(34%)		 99
(33%)		 99
(33%)		 0
(0%)
MPhaseSAT_M
2011-02-16
(complete)		 600359
(59.83%)		 104
(17.33%)		 255
(42.5%)		 241
(40.17%)		 0
(0%)
PicoSAT
941
(complete)		 300121
(40.33%)		 40
(13.33%)		 81
(27%)		 179
(59.67%)		 0
(0%)
Plingeling
587 [DEPRECATED]
(complete)		 300230
(76.67%)		 124
(41.33%)		 106
(35.33%)		 70
(23.33%)		 0
(0%)
Plingeling
587f (fixed)
(complete)		 600361
(60.17%)		 164
(27.33%)		 197
(32.83%)		 239
(39.83%)		 0
(0%)
ppfolio
par
(complete)		 1200860
(71.67%)		 304
(25.33%)		 556
(46.33%)		 340
(28.33%)		 0
(0%)
ppfolio
seq
(complete)		 900527
(58.56%)		 105
(11.67%)		 422
(46.89%)		 373
(41.44%)		 0
(0%)
priss
1.0
(complete)		 300104
(34.67%)		 31
(10.33%)		 73
(24.33%)		 196
(65.33%)		 0
(0%)
QuteRSat
2011-05-12 (fixed)
(complete)		 600316
(52.67%)		 160
(26.67%)		 156
(26%)		 284
(47.33%)		 0
(0%)
rcl
2011-04-01
(complete)		 300184
(61.33%)		 91
(30.33%)		 93
(31%)		 116
(38.67%)		 0
(0%)
RestartSAT
B95
(complete)		 600313
(52.17%)		 139
(23.17%)		 174
(29%)		 287
(47.83%)		 0
(0%)
SApperloT2010
2011-05-15 (fixed)
(complete)		 300109
(36.33%)		 33
(11%)		 76
(25.33%)		 191
(63.67%)		 0
(0%)
SArTagnan
2011-05-15 (fixed)
(complete)		 300148
(49.33%)		 47
(15.67%)		 101
(33.67%)		 152
(50.67%)		 0
(0%)
SAT07 reference solver: minisat
SAT 2007
(complete)		 300122
(40.67%)		 44
(14.67%)		 78
(26%)		 178
(59.33%)		 0
(0%)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)		 300149
(49.67%)		 64
(21.33%)		 85
(28.33%)		 151
(50.33%)		 0
(0%)
SAT09 reference solver:glucose
1.0
(complete)		 300197
(65.67%)		 110
(36.67%)		 87
(29%)		 103
(34.33%)		 0
(0%)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)		 600298
(49.67%)		 0
(0%)		 298
(49.67%)		 302
(50.33%)		 0
(0%)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)		 300194
(64.67%)		 109
(36.33%)		 85
(28.33%)		 106
(35.33%)		 0
(0%)
SAT09 reference solver: march_hi
hi
(complete)		 600251
(41.83%)		 123
(20.5%)		 128
(21.33%)		 349
(58.17%)		 0
(0%)
SAT09 reference solver:precosat
236
(complete)		 300206
(68.67%)		 110
(36.67%)		 96
(32%)		 94
(31.33%)		 0
(0%)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)		 300116
(38.67%)		 43
(14.33%)		 73
(24.33%)		 184
(61.33%)		 0
(0%)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)		 600384
(64%)		 97
(16.17%)		 287
(47.83%)		 216
(36%)		 0
(0%)
SAT09 reference solver: TNM
2009-03-22
(incomplete)		 600324
(54%)		 0
(0%)		 324
(54%)		 276
(46%)		 0
(0%)
sathys
2011-04-01
(complete)		 30096
(32%)		 23
(7.67%)		 73
(24.33%)		 204
(68%)		 0
(0%)
Satisfiability Solver Selector
2011-03-18
(complete)		 1200771
(64.25%)		 256
(21.33%)		 515
(42.92%)		 429
(35.75%)		 0
(0%)
sattime
2011-03-02
(incomplete)		 300109
(36.33%)		 0
(0%)		 109
(36.33%)		 191
(63.67%)		 0
(0%)
sattime+
2011-03-02
(incomplete)		 300106
(35.33%)		 0
(0%)		 106
(35.33%)		 194
(64.67%)		 0
(0%)
sattime2011
2011-03-02
(incomplete)		 600334
(55.67%)		 0
(0%)		 334
(55.67%)		 266
(44.33%)		 0
(0%)
Sol
2011-04-04
(complete)		 300116
(38.67%)		 37
(12.33%)		 79
(26.33%)		 184
(61.33%)		 0
(0%)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)		 600362
(60.33%)		 0
(0%)		 362
(60.33%)		 238
(39.67%)		 0
(0%)

Solver NameProgress
adaptg2wsat2011
2011-03-02
(incomplete)
done
600
SAT
328		?
272
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
done
300
UNSAT
105		SAT
91		?
104
borg-sat
11.03.02-par-industrial (fixed)
(complete)
done
300
UNSAT
105		SAT
90		?
105
borg-sat
11.03.02-par-random (fixed)
(complete)
done
600
UNSAT
112		SAT
251		?
235		ERR
2
borg-sat
11.03.02-random [DEPRECATED]
(complete)
done
600
UNSAT
110		SAT
237		?
251		ERR
2
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
done
300
UNSAT
100		SAT
90		?
110
borg-sat
11.03.02-seq-random (fixed)
(complete)
done
600
UNSAT
111		SAT
304		?
180		ERR
5
clasp
2.0-R4092-crafted
(complete)
done
300
UNSAT
62		SAT
87		?
151
claspmt
2.0-R4095 [DEPRECATED]
(complete)
done
600
UNSAT
181		SAT
195		?
216		ERR
8
claspmt
2.0-R4095-patched (fixed)
(complete)
done
600
UNSAT
187		SAT
195		?
218
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
done
300
UNSAT
127		SAT
97		?
76
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
done
600
UNSAT
178		SAT
183		?
239
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
done
600
UNSAT
159		SAT
158		?
283
csls
pnorm-8cores
(incomplete)
done
600
SAT
335		?
265
EagleUP
1.565.350
(incomplete)
done
600
SAT
328		?
272
EBGlucose
1.0
(incomplete)
done
300
UNSAT
108		SAT
91		?
101
glucose
2
(complete)
done
600
UNSAT
163		SAT
177		?
260
glueminisat
2.2.5
(complete)
done
300
UNSAT
126		SAT
85		?
89
jMiniSat
2011
(complete)
done
300
UNSAT
28		SAT
70		?
202
Lingeling
587 [DEPRECATED]
(complete)
done
300
UNSAT
117		SAT
91		?
92
Lingeling
587f (fixed)
(complete)
done
300
UNSAT
117		SAT
91		?
92
march_rw
2011-03-02
(complete)
done
600
UNSAT
123		SAT
128		?
349
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
done
300
UNSAT
103		SAT
99		?
98
minisat hack: contrasat
2011-03-02
(complete)
done
300
UNSAT
100		SAT
99		?
101
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
done
300
UNSAT
98		SAT
98		?
104
minisat hack: LR_GL_SHR
2011-03-02
(complete)
done
300
UNSAT
110		SAT
81		?
109
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
done
300
UNSAT
94		SAT
95		?
111
minisat hack: minisat_psm
2011-04-01
(complete)
done
300
UNSAT
102		SAT
95		?
103
minisat hack reference: minisat
2.2.0
(complete)
done
300
UNSAT
99		SAT
95		?
106
MPhaseSAT
2011-02-15
(complete)
done
300
UNSAT
39		SAT
93		?
168
MPhaseSAT64
2011-05-14 (fixed)
(complete)
done
300
UNSAT
102		SAT
99		?
99
MPhaseSAT_M
2011-02-16
(complete)
done
600
UNSAT
104		SAT
255		?
241
PicoSAT
941
(complete)
done
300
UNSAT
40		SAT
81		?
179
Plingeling
587 [DEPRECATED]
(complete)
done
300
UNSAT
124		SAT
106		?
70
Plingeling
587f (fixed)
(complete)
done
600
UNSAT
164		SAT
197		?
239
ppfolio
par
(complete)
done
1200
UNSAT
304		SAT
556		?
340
ppfolio
seq
(complete)
done
900
UNSAT
105		SAT
422		?
373
priss
1.0
(complete)
done
300
UNSAT
31		SAT
73		?
196
QuteRSat
2011-05-12 (fixed)
(complete)
done
600
UNSAT
160		SAT
156		?
284
rcl
2011-04-01
(complete)
done
300
UNSAT
91		SAT
93		?
116
RestartSAT
B95
(complete)
done
600
UNSAT
139		SAT
174		?
287
SApperloT2010
2011-05-15 (fixed)
(complete)
done
300
UNSAT
33		SAT
76		?
191
SArTagnan
2011-05-15 (fixed)
(complete)
done
300
UNSAT
47		SAT
101		?
152
SAT07 reference solver: minisat
SAT 2007
(complete)
done
300
UNSAT
44		SAT
78		?
178
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
done
300
UNSAT
64		SAT
85		?
151
SAT09 reference solver:glucose
1.0
(complete)
done
300
UNSAT
110		SAT
87		?
103
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
done
600
SAT
298		?
302
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
done
300
UNSAT
109		SAT
85		?
106
SAT09 reference solver: march_hi
hi
(complete)
done
600
UNSAT
123		SAT
128		?
349
SAT09 reference solver:precosat
236
(complete)
done
300
UNSAT
110		SAT
96		?
94
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
done
300
UNSAT
43		SAT
73		?
184
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
done
600
UNSAT
97		SAT
287		?
216
SAT09 reference solver: TNM
2009-03-22
(incomplete)
done
600
SAT
324		?
276
sathys
2011-04-01
(complete)
done
300
UNSAT
23		SAT
73		?
204
Satisfiability Solver Selector
2011-03-18
(complete)
done
1200
UNSAT
256		SAT
515		?
429
sattime
2011-03-02
(incomplete)
done
300
SAT
109		?
191
sattime+
2011-03-02
(incomplete)
done
300
SAT
106		?
194
sattime2011
2011-03-02
(incomplete)
done
600
SAT
334		?
266
Sol
2011-04-04
(complete)
done
300
UNSAT
37		SAT
79		?
184
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
done
600
SAT
362		?
238