SAT 2011 Competition: main competition (phase 1): solvers page (tabular format, detailed results)

Some explanations

Category "applications instances" (APPLICATION)

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)UNKNOWN (abort)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.
adaptg2wsat2011
2011-03-02
(incomplete)
30015
(5%)
0
(0%)
15
(5%)
0
(0%)
9
(3%)
269
(89.67%)
0
(0%)
0
(0%)
0
(0%)
7
(2.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Black Hole SAT
2011-03-08
(complete)
30027
(9%)
5
(1.67%)
22
(7.33%)
0
(0%)
0
(0%)
273
(91%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
300175
(58.33%)
89
(29.67%)
86
(28.67%)
0
(0%)
0
(0%)
97
(32.33%)
21
(7%)
7
(2.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
300179
(59.67%)
94
(31.33%)
85
(28.33%)
0
(0%)
91
(30.33%)
10
(3.33%)
17
(5.67%)
2
(0.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.33%)
0
(0%)
0
(0%)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
300160
(53.33%)
84
(28%)
76
(25.33%)
0
(0%)
0
(0%)
126
(42%)
14
(4.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
borg-sat
11.03.02-seq-industrial (fixed, 1200 s timeout)
(complete)
300160
(53.33%)
85
(28.33%)
75
(25%)
0
(0%)
1
(0.33%)
134
(44.67%)
5
(1.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
clasp
2.0-R4092-indust
(complete)
300154
(51.33%)
81
(27%)
73
(24.33%)
0
(0%)
0
(0%)
146
(48.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
300178
(59.33%)
89
(29.67%)
89
(29.67%)
0
(0%)
0
(0%)
116
(38.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
6
(2%)
0
(0%)
claspmt
2.0-R4095-patched (fixed)
(complete)
300181
(60.33%)
92
(30.67%)
89
(29.67%)
0
(0%)
0
(0%)
119
(39.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-mt [DEPRECATED]
(complete)
300181
(60.33%)
104
(34.67%)
77
(25.67%)
0
(0%)
0
(0%)
105
(35%)
10
(3.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
4
(1.33%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-mt (fixed)
(complete)
300181
(60.33%)
103
(34.33%)
78
(26%)
0
(0%)
0
(0%)
105
(35%)
10
(3.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
4
(1.33%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-st [DEPRECATED]
(complete)
300163
(54.33%)
91
(30.33%)
72
(24%)
0
(0%)
0
(0%)
134
(44.67%)
3
(1%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-st (fixed)
(complete)
300163
(54.33%)
91
(30.33%)
72
(24%)
0
(0%)
0
(0%)
134
(44.67%)
3
(1%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
300191
(63.67%)
103
(34.33%)
88
(29.33%)
0
(0%)
0
(0%)
89
(29.67%)
13
(4.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
7
(2.33%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
300192
(64%)
105
(35%)
87
(29%)
0
(0%)
0
(0%)
94
(31.33%)
11
(3.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
3
(1%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night2-st [DEPRECATED]
(complete)
300173
(57.67%)
96
(32%)
77
(25.67%)
0
(0%)
0
(0%)
110
(36.67%)
13
(4.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
4
(1.33%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
300174
(58%)
96
(32%)
78
(26%)
0
(0%)
0
(0%)
112
(37.33%)
13
(4.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.33%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
TechDemo-Alpha-mt
(complete)
300139
(46.33%)
72
(24%)
67
(22.33%)
0
(0%)
0
(0%)
136
(45.33%)
3
(1%)
1
(0.33%)
0
(0%)
0
(0%)
0
(0%)
21
(7%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
TechDemo-Alpha-st
(complete)
300136
(45.33%)
73
(24.33%)
63
(21%)
0
(0%)
0
(0%)
153
(51%)
1
(0.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
8
(2.67%)
0
(0%)
0
(0%)
2
(0.67%)
EBGlucose
1.0
(incomplete)
300158
(52.67%)
82
(27.33%)
76
(25.33%)
0
(0%)
0
(0%)
142
(47.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
glucose
2
(complete)
300177
(59%)
94
(31.33%)
83
(27.67%)
0
(0%)
0
(0%)
123
(41%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
glueminisat
2.2.5
(complete)
300171
(57%)
98
(32.67%)
73
(24.33%)
0
(0%)
0
(0%)
129
(43%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
jMiniSat
2011
(complete)
300132
(44%)
62
(20.67%)
70
(23.33%)
0
(0%)
0
(0%)
168
(56%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
kw
2011-02-28
(complete)
300156
(52%)
83
(27.67%)
73
(24.33%)
0
(0%)
0
(0%)
143
(47.67%)
1
(0.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Lingeling
587 [DEPRECATED]
(complete)
300172
(57.33%)
93
(31%)
79
(26.33%)
0
(0%)
0
(0%)
128
(42.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Lingeling
587f (fixed)
(complete)
300172
(57.33%)
93
(31%)
79
(26.33%)
0
(0%)
0
(0%)
128
(42.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
march_rw
2011-03-02
(complete)
30023
(7.67%)
8
(2.67%)
15
(5%)
0
(0%)
0
(0%)
251
(83.67%)
17
(5.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
9
(3%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: cir_minisat
2011-03-02
(complete)
300159
(53%)
74
(24.67%)
85
(28.33%)
0
(0%)
0
(0%)
141
(47%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
300164
(54.67%)
82
(27.33%)
82
(27.33%)
0
(0%)
0
(0%)
136
(45.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: contrasat
2011-03-02
(complete)
300161
(53.67%)
72
(24%)
89
(29.67%)
0
(0%)
0
(0%)
134
(44.67%)
0
(0%)
5
(1.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
300162
(54%)
78
(26%)
84
(28%)
0
(0%)
0
(0%)
138
(46%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: LR_GL_NOSHR
2011-03-02
(complete)
300155
(51.67%)
71
(23.67%)
84
(28%)
0
(0%)
0
(0%)
145
(48.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
300158
(52.67%)
90
(30%)
68
(22.67%)
0
(0%)
0
(0%)
142
(47.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: LR_NOGL_NOSHR
2011-03-02
(complete)
300154
(51.33%)
71
(23.67%)
83
(27.67%)
0
(0%)
0
(0%)
146
(48.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
300160
(53.33%)
74
(24.67%)
86
(28.67%)
0
(0%)
0
(0%)
139
(46.33%)
0
(0%)
0
(0%)
0
(0%)
1
(0.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: minisat_psm
2011-04-01
(complete)
300163
(54.33%)
77
(25.67%)
86
(28.67%)
0
(0%)
0
(0%)
137
(45.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack reference: minisat
2.2.0
(complete)
300161
(53.67%)
74
(24.67%)
87
(29%)
0
(0%)
0
(0%)
139
(46.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT
2011-02-15
(complete)
300162
(54%)
82
(27.33%)
80
(26.67%)
0
(0%)
2
(0.67%)
136
(45.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT64
2011-03-03 [DEPRECATED]
(complete)
300161
(53.67%)
79
(26.33%)
82
(27.33%)
0
(0%)
1
(0.33%)
137
(45.67%)
0
(0%)
0
(0%)
0
(0%)
1
(0.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
300170
(56.67%)
86
(28.67%)
84
(28%)
0
(0%)
0
(0%)
129
(43%)
0
(0%)
0
(0%)
0
(0%)
1
(0.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT_M
2011-02-16
(complete)
300166
(55.33%)
82
(27.33%)
84
(28%)
0
(0%)
2
(0.67%)
132
(44%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
PicoSAT
941
(complete)
300141
(47%)
67
(22.33%)
74
(24.67%)
0
(0%)
0
(0%)
159
(53%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Plingeling
587 [DEPRECATED]
(complete)
300190
(63.33%)
95
(31.67%)
95
(31.67%)
0
(0%)
0
(0%)
110
(36.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Plingeling
587f (fixed)
(complete)
300192
(64%)
96
(32%)
96
(32%)
0
(0%)
0
(0%)
108
(36%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ppfolio
par
(complete)
300184
(61.33%)
98
(32.67%)
86
(28.67%)
0
(0%)
0
(0%)
109
(36.33%)
7
(2.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ppfolio
seq
(complete)
300155
(51.67%)
84
(28%)
71
(23.67%)
0
(0%)
0
(0%)
145
(48.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
priss
1.0
(complete)
300147
(49%)
77
(25.67%)
70
(23.33%)
0
(0%)
0
(0%)
147
(49%)
0
(0%)
6
(2%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
priss
Auto
(complete)
300152
(50.67%)
78
(26%)
74
(24.67%)
0
(0%)
0
(0%)
142
(47.33%)
0
(0%)
6
(2%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
priss
UP
(complete)
300144
(48%)
73
(24.33%)
71
(23.67%)
0
(0%)
0
(0%)
154
(51.33%)
0
(0%)
2
(0.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
QuteRSat
2011-03-01 [DEPRECATED]
(complete)
300169
(56.33%)
97
(32.33%)
72
(24%)
0
(0%)
0
(0%)
113
(37.67%)
12
(4%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
5
(1.67%)
0
(0%)
1
(0.33%)
0
(0%)
QuteRSat
2011-05-12 (fixed)
(complete)
300174
(58%)
96
(32%)
78
(26%)
0
(0%)
0
(0%)
119
(39.67%)
5
(1.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
2
(0.67%)
0
(0%)
0
(0%)
0
(0%)
rcl
2011-04-01
(complete)
300157
(52.33%)
74
(24.67%)
83
(27.67%)
0
(0%)
0
(0%)
143
(47.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RestartSAT
A75
(complete)
300171
(57%)
93
(31%)
78
(26%)
0
(0%)
0
(0%)
129
(43%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RestartSAT
B95
(complete)
300172
(57.33%)
89
(29.67%)
83
(27.67%)
0
(0%)
0
(0%)
128
(42.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
riss
1.0
(complete)
300145
(48.33%)
75
(25%)
70
(23.33%)
0
(0%)
0
(0%)
153
(51%)
0
(0%)
2
(0.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
riss
Auto
(complete)
300145
(48.33%)
75
(25%)
70
(23.33%)
0
(0%)
0
(0%)
153
(51%)
0
(0%)
2
(0.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
riss
Auto (1200 s timeout)
(complete)
300138
(46%)
73
(24.33%)
65
(21.67%)
0
(0%)
0
(0%)
160
(53.33%)
0
(0%)
2
(0.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
riss
Exp
(complete)
300138
(46%)
69
(23%)
69
(23%)
0
(0%)
0
(0%)
157
(52.33%)
0
(0%)
5
(1.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SApperloT
2011-03-23
(complete)
300152
(50.67%)
77
(25.67%)
75
(25%)
0
(0%)
0
(0%)
148
(49.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SApperloT2010
2011-03-04 [DEPRECATED]
(complete)
300144
(48%)
81
(27%)
63
(21%)
0
(0%)
0
(0%)
143
(47.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
9
(3%)
4
(1.33%)
0
(0%)
SApperloT2010
2011-05-15 (fixed)
(complete)
300157
(52.33%)
82
(27.33%)
75
(25%)
0
(0%)
0
(0%)
143
(47.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SArTagnan
2011-03-24 [DEPRECATED]
(complete)
300135
(45%)
80
(26.67%)
55
(18.33%)
0
(0%)
0
(0%)
118
(39.33%)
4
(1.33%)
21
(7%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
22
(7.33%)
0
(0%)
SArTagnan
2011-05-15 (fixed)
(complete)
300154
(51.33%)
79
(26.33%)
75
(25%)
0
(0%)
0
(0%)
119
(39.67%)
4
(1.33%)
23
(7.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver:glucose
1.0
(complete)
300159
(53%)
84
(28%)
75
(25%)
0
(0%)
0
(0%)
141
(47%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver:LySAT
i/2009-03-20
(complete)
300131
(43.67%)
71
(23.67%)
60
(20%)
0
(0%)
0
(0%)
154
(51.33%)
0
(0%)
15
(5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
300169
(56.33%)
91
(30.33%)
78
(26%)
0
(0%)
0
(0%)
102
(34%)
0
(0%)
29
(9.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver:precosat
236
(complete)
300167
(55.67%)
88
(29.33%)
79
(26.33%)
0
(0%)
0
(0%)
131
(43.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
2
(0.67%)
0
(0%)
0
(0%)
0
(0%)
SAT4J core
2.3.0 SNAPSHOT 2011-02-06
(complete)
300119
(39.67%)
56
(18.67%)
63
(21%)
0
(0%)
0
(0%)
181
(60.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sathys
2011-04-01
(complete)
300139
(46.33%)
70
(23.33%)
69
(23%)
0
(0%)
0
(0%)
160
(53.33%)
0
(0%)
1
(0.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Satisfiability Solver Selector
2011-03-18
(complete)
300158
(52.67%)
79
(26.33%)
79
(26.33%)
0
(0%)
0
(0%)
142
(47.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Satisfiability Solver Selector
2011-03-18 (1200 s timeout)
(complete)
300171
(57%)
86
(28.67%)
85
(28.33%)
0
(0%)
0
(0%)
129
(43%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sattime
2011-03-02
(incomplete)
30016
(5.33%)
0
(0%)
16
(5.33%)
0
(0%)
9
(3%)
268
(89.33%)
0
(0%)
0
(0%)
0
(0%)
7
(2.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sattime+
2011-03-02
(incomplete)
30019
(6.33%)
7
(2.33%)
12
(4%)
0
(0%)
9
(3%)
272
(90.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sattime2011
2011-03-02
(incomplete)
30016
(5.33%)
0
(0%)
16
(5.33%)
0
(0%)
9
(3%)
268
(89.33%)
0
(0%)
0
(0%)
0
(0%)
7
(2.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
shortsattime+
2011-03-02
(incomplete)
30022
(7.33%)
7
(2.33%)
15
(5%)
0
(0%)
9
(3%)
269
(89.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
shortsattime2011
2011-03-02
(incomplete)
30015
(5%)
0
(0%)
15
(5%)
0
(0%)
9
(3%)
269
(89.67%)
0
(0%)
0
(0%)
0
(0%)
7
(2.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sol
2011-04-04
(complete)
300119
(39.67%)
61
(20.33%)
58
(19.33%)
0
(0%)
0
(0%)
171
(57%)
9
(3%)
0
(0%)
0
(0%)
1
(0.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
STRUCTure
0.1
(complete)
30031
(10.33%)
14
(4.67%)
17
(5.67%)
0
(0%)
0
(0%)
269
(89.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
STRUCTure
0.1 (hbr=2)
(complete)
30028
(9.33%)
14
(4.67%)
14
(4.67%)
0
(0%)
0
(0%)
272
(90.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
synit_sat
2011-03-03
(complete)
300163
(54.33%)
96
(32%)
67
(22.33%)
0
(0%)
0
(0%)
109
(36.33%)
11
(3.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
16
(5.33%)
0
(0%)
0
(0%)
1
(0.33%)
UmSat
2011-02-25 [DEPRECATED]
(complete)
30041
(13.67%)
23
(7.67%)
18
(6%)
0
(0%)
0
(0%)
109
(36.33%)
3
(1%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
146
(48.67%)
0
(0%)
1
(0.33%)
0
(0%)
UmSat
2011-05-12 (fixed)
(complete)
30091
(30.33%)
44
(14.67%)
47
(15.67%)
0
(0%)
0
(0%)
203
(67.67%)
2
(0.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
4
(1.33%)
0
(0%)
0
(0%)
0
(0%)

Solver NameProgress
adaptg2wsat2011
2011-03-02
(incomplete)
done
300
SAT.
15
?
9
? (TO)
269
? (?)
7
Black Hole SAT
2011-03-08
(complete)
done
300
UNSAT.
5
SAT.
22
? (TO)
273
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
done
300
UNSAT.
89
SAT.
86
? (TO)
97
? (MO)
21
? (EC)
7
borg-sat
11.03.02-par-industrial (fixed)
(complete)
done
300
UNSAT.
94
SAT.
85
?
91
? (TO)
10
? (MO)
17
? (EC)
2
NO CERT.
1
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
done
300
UNSAT.
84
SAT.
76
? (TO)
126
? (MO)
14
borg-sat
11.03.02-seq-industrial (fixed, 1200 s timeout)
(complete)
done
300
UNSAT.
85
SAT.
75
?
1
? (TO)
134
? (MO)
5
clasp
2.0-R4092-indust
(complete)
done
300
UNSAT.
81
SAT.
73
? (TO)
146
claspmt
2.0-R4095 [DEPRECATED]
(complete)
done
300
UNSAT.
89
SAT.
89
? (TO)
116
ERR CERT
6
claspmt
2.0-R4095-patched (fixed)
(complete)
done
300
UNSAT.
92
SAT.
89
? (TO)
119
CryptoMiniSat
Strange-Night-1-mt [DEPRECATED]
(complete)
done
300
UNSAT.
104
SAT.
77
? (TO)
105
? (MO)
10
? (SIG)
4
CryptoMiniSat
Strange-Night-1-mt (fixed)
(complete)
done
300
UNSAT.
103
SAT.
78
? (TO)
105
? (MO)
10
? (SIG)
4
CryptoMiniSat
Strange-Night-1-st [DEPRECATED]
(complete)
done
300
UNSAT.
91
SAT.
72
? (TO)
134
? (MO)
3
CryptoMiniSat
Strange-Night-1-st (fixed)
(complete)
done
300
UNSAT.
91
SAT.
72
? (TO)
134
? (MO)
3
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
done
300
UNSAT.
103
SAT.
88
? (TO)
89
? (MO)
13
? (SIG)
7
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
done
300
UNSAT.
105
SAT.
87
? (TO)
94
? (MO)
11
? (SIG)
3
CryptoMiniSat
Strange-Night2-st [DEPRECATED]
(complete)
done
300
UNSAT.
96
SAT.
77
? (TO)
110
? (MO)
13
? (SIG)
4
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
done
300
UNSAT.
96
SAT.
78
? (TO)
112
? (MO)
13
? (SIG)
1
CryptoMiniSat
TechDemo-Alpha-mt
(complete)
done
300
UNSAT.
72
SAT.
67
? (TO)
136
? (MO)
3
? (EC)
1
? (SIG)
21
CryptoMiniSat
TechDemo-Alpha-st
(complete)
done
300
UNSAT.
73
SAT.
63
? (TO)
153
? (MO)
1
? (SIG)
8
WRONG UNSAT.
2
EBGlucose
1.0
(incomplete)
done
300
UNSAT.
82
SAT.
76
? (TO)
142
glucose
2
(complete)
done
300
UNSAT.
94
SAT.
83
? (TO)
123
glueminisat
2.2.5
(complete)
done
300
UNSAT.
98
SAT.
73
? (TO)
129
jMiniSat
2011
(complete)
done
300
UNSAT.
62
SAT.
70
? (TO)
168
kw
2011-02-28
(complete)
done
300
UNSAT.
83
SAT.
73
? (TO)
143
? (MO)
1
Lingeling
587 [DEPRECATED]
(complete)
done
300
UNSAT.
93
SAT.
79
? (TO)
128
Lingeling
587f (fixed)
(complete)
done
300
UNSAT.
93
SAT.
79
? (TO)
128
march_rw
2011-03-02
(complete)
done
300
UNSAT.
8
SAT.
15
? (TO)
251
? (MO)
17
? (SIG)
9
minisat hack: cir_minisat
2011-03-02
(complete)
done
300
UNSAT.
74
SAT.
85
? (TO)
141
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
done
300
UNSAT.
82
SAT.
82
? (TO)
136
minisat hack: contrasat
2011-03-02
(complete)
done
300
UNSAT.
72
SAT.
89
? (TO)
134
? (EC)
5
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
done
300
UNSAT.
78
SAT.
84
? (TO)
138
minisat hack: LR_GL_NOSHR
2011-03-02
(complete)
done
300
UNSAT.
71
SAT.
84
? (TO)
145
minisat hack: LR_GL_SHR
2011-03-02
(complete)
done
300
UNSAT.
90
SAT.
68
? (TO)
142
minisat hack: LR_NOGL_NOSHR
2011-03-02
(complete)
done
300
UNSAT.
71
SAT.
83
? (TO)
146
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
done
300
UNSAT.
74
SAT.
86
? (TO)
139
? (?)
1
minisat hack: minisat_psm
2011-04-01
(complete)
done
300
UNSAT.
77
SAT.
86
? (TO)
137
minisat hack reference: minisat
2.2.0
(complete)
done
300
UNSAT.
74
SAT.
87
? (TO)
139
MPhaseSAT
2011-02-15
(complete)
done
300
UNSAT.
82
SAT.
80
?
2
? (TO)
136
MPhaseSAT64
2011-03-03 [DEPRECATED]
(complete)
done
300
UNSAT.
79
SAT.
82
?
1
? (TO)
137
? (?)
1
MPhaseSAT64
2011-05-14 (fixed)
(complete)
done
300
UNSAT.
86
SAT.
84
? (TO)
129
? (?)
1
MPhaseSAT_M
2011-02-16
(complete)
done
300
UNSAT.
82
SAT.
84
?
2
? (TO)
132
PicoSAT
941
(complete)
done
300
UNSAT.
67
SAT.
74
? (TO)
159
Plingeling
587 [DEPRECATED]
(complete)
done
300
UNSAT.
95
SAT.
95
? (TO)
110
Plingeling
587f (fixed)
(complete)
done
300
UNSAT.
96
SAT.
96
? (TO)
108
ppfolio
par
(complete)
done
300
UNSAT.
98
SAT.
86
? (TO)
109
? (MO)
7
ppfolio
seq
(complete)
done
300
UNSAT.
84
SAT.
71
? (TO)
145
priss
1.0
(complete)
done
300
UNSAT.
77
SAT.
70
? (TO)
147
? (EC)
6
priss
Auto
(complete)
done
300
UNSAT.
78
SAT.
74
? (TO)
142
? (EC)
6
priss
UP
(complete)
done
300
UNSAT.
73
SAT.
71
? (TO)
154
? (EC)
2
QuteRSat
2011-03-01 [DEPRECATED]
(complete)
done
300
UNSAT.
97
SAT.
72
? (TO)
113
? (MO)
12
? (SIG)
5
ERR CERT
1
QuteRSat
2011-05-12 (fixed)
(complete)
done
300
UNSAT.
96
SAT.
78
? (TO)
119
? (MO)
5
? (SIG)
2
rcl
2011-04-01
(complete)
done
300
UNSAT.
74
SAT.
83
? (TO)
143
RestartSAT
A75
(complete)
done
300
UNSAT.
93
SAT.
78
? (TO)
129
RestartSAT
B95
(complete)
done
300
UNSAT.
89
SAT.
83
? (TO)
128
riss
1.0
(complete)
done
300
UNSAT.
75
SAT.
70
? (TO)
153
? (EC)
2
riss
Auto
(complete)
done
300
UNSAT.
75
SAT.
70
? (TO)
153
? (EC)
2
riss
Auto (1200 s timeout)
(complete)
done
300
UNSAT.
73
SAT.
65
? (TO)
160
? (EC)
2
riss
Exp
(complete)
done
300
UNSAT.
69
SAT.
69
? (TO)
157
? (EC)
5
SApperloT
2011-03-23
(complete)
done
300
UNSAT.
77
SAT.
75
? (TO)
148
SApperloT2010
2011-03-04 [DEPRECATED]
(complete)
done
300
UNSAT.
81
SAT.
63
? (TO)
143
NO CERT.
9
ERR CERT
4
SApperloT2010
2011-05-15 (fixed)
(complete)
done
300
UNSAT.
82
SAT.
75
? (TO)
143
SArTagnan
2011-03-24 [DEPRECATED]
(complete)
done
300
UNSAT.
80
SAT.
55
? (TO)
118
? (MO)
4
? (EC)
21
ERR CERT
22
SArTagnan
2011-05-15 (fixed)
(complete)
done
300
UNSAT.
79
SAT.
75
? (TO)
119
? (MO)
4
? (EC)
23
SAT09 reference solver:glucose
1.0
(complete)
done
300
UNSAT.
84
SAT.
75
? (TO)
141
SAT09 reference solver:LySAT
i/2009-03-20
(complete)
done
300
UNSAT.
71
SAT.
60
? (TO)
154
? (EC)
15
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
done
300
UNSAT.
91
SAT.
78
? (TO)
102
? (EC)
29
SAT09 reference solver:precosat
236
(complete)
done
300
UNSAT.
88
SAT.
79
? (TO)
131
? (SIG)
2
SAT4J core
2.3.0 SNAPSHOT 2011-02-06
(complete)
done
300
UNSAT.
56
SAT.
63
? (TO)
181
sathys
2011-04-01
(complete)
done
300
UNSAT.
70
SAT.
69
? (TO)
160
? (EC)
1
Satisfiability Solver Selector
2011-03-18
(complete)
done
300
UNSAT.
79
SAT.
79
? (TO)
142
Satisfiability Solver Selector
2011-03-18 (1200 s timeout)
(complete)
done
300
UNSAT.
86
SAT.
85
? (TO)
129
sattime
2011-03-02
(incomplete)
done
300
SAT.
16
?
9
? (TO)
268
? (?)
7
sattime+
2011-03-02
(incomplete)
done
300
UNSAT.
7
SAT.
12
?
9
? (TO)
272
sattime2011
2011-03-02
(incomplete)
done
300
SAT.
16
?
9
? (TO)
268
? (?)
7
shortsattime+
2011-03-02
(incomplete)
done
300
UNSAT.
7
SAT.
15
?
9
? (TO)
269
shortsattime2011
2011-03-02
(incomplete)
done
300
SAT.
15
?
9
? (TO)
269
? (?)
7
Sol
2011-04-04
(complete)
done
300
UNSAT.
61
SAT.
58
? (TO)
171
? (MO)
9
? (?)
1
STRUCTure
0.1
(complete)
done
300
UNSAT.
14
SAT.
17
? (TO)
269
STRUCTure
0.1 (hbr=2)
(complete)
done
300
UNSAT.
14
SAT.
14
? (TO)
272
synit_sat
2011-03-03
(complete)
done
300
UNSAT.
96
SAT.
67
? (TO)
109
? (MO)
11
? (SIG)
16
WRONG UNSAT.
1
UmSat
2011-02-25 [DEPRECATED]
(complete)
done
300
UNSAT.
23
SAT.
18
? (TO)
109
? (MO)
3
? (SIG)
146
ERR CERT
1
UmSat
2011-05-12 (fixed)
(complete)
done
300
UNSAT.
44
SAT.
47
? (TO)
203
? (MO)
2
? (SIG)
4

Category "crafted instances" (CRAFTED)

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)UNKNOWN (abort)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.
adaptg2wsat2011
2011-03-02
(incomplete)
30099
(33%)
0
(0%)
99
(33%)
0
(0%)
0
(0%)
201
(67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Black Hole SAT
2011-03-08
(complete)
30036
(12%)
11
(3.67%)
25
(8.33%)
0
(0%)
0
(0%)
264
(88%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
clasp
2.0-R4092-crafted
(complete)
300105
(35%)
37
(12.33%)
68
(22.67%)
0
(0%)
0
(0%)
195
(65%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
300129
(43%)
41
(13.67%)
88
(29.33%)
0
(0%)
0
(0%)
170
(56.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.33%)
0
(0%)
claspmt
2.0-R4095-patched (fixed)
(complete)
300133
(44.33%)
43
(14.33%)
90
(30%)
0
(0%)
0
(0%)
167
(55.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-mt [DEPRECATED]
(complete)
300111
(37%)
38
(12.67%)
73
(24.33%)
0
(0%)
0
(0%)
189
(63%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-mt (fixed)
(complete)
300113
(37.67%)
37
(12.33%)
76
(25.33%)
0
(0%)
0
(0%)
187
(62.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-st [DEPRECATED]
(complete)
30089
(29.67%)
32
(10.67%)
57
(19%)
0
(0%)
0
(0%)
211
(70.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-st (fixed)
(complete)
30089
(29.67%)
32
(10.67%)
57
(19%)
0
(0%)
0
(0%)
211
(70.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
300107
(35.67%)
35
(11.67%)
72
(24%)
0
(0%)
0
(0%)
193
(64.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
300105
(35%)
36
(12%)
69
(23%)
0
(0%)
0
(0%)
195
(65%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night2-st [DEPRECATED]
(complete)
30095
(31.67%)
32
(10.67%)
63
(21%)
0
(0%)
0
(0%)
205
(68.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
30096
(32%)
32
(10.67%)
64
(21.33%)
0
(0%)
0
(0%)
204
(68%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
TechDemo-Alpha-mt
(complete)
30071
(23.67%)
25
(8.33%)
46
(15.33%)
0
(0%)
0
(0%)
228
(76%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.33%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
TechDemo-Alpha-st
(complete)
30062
(20.67%)
18
(6%)
44
(14.67%)
0
(0%)
0
(0%)
238
(79.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
glucose
2
(complete)
30091
(30.33%)
31
(10.33%)
60
(20%)
0
(0%)
0
(0%)
209
(69.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
jMiniSat
2011
(complete)
30084
(28%)
23
(7.67%)
61
(20.33%)
0
(0%)
0
(0%)
216
(72%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Lingeling
587 [DEPRECATED]
(complete)
30089
(29.67%)
27
(9%)
62
(20.67%)
0
(0%)
0
(0%)
211
(70.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Lingeling
587f (fixed)
(complete)
30089
(29.67%)
27
(9%)
62
(20.67%)
0
(0%)
0
(0%)
211
(70.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
march_rw
2011-03-02
(complete)
30083
(27.67%)
26
(8.67%)
57
(19%)
0
(0%)
0
(0%)
217
(72.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT
2011-02-15
(complete)
300107
(35.67%)
26
(8.67%)
81
(27%)
0
(0%)
0
(0%)
193
(64.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT64
2011-03-03 [DEPRECATED]
(complete)
30099
(33%)
26
(8.67%)
73
(24.33%)
0
(0%)
38
(12.67%)
163
(54.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
300107
(35.67%)
27
(9%)
80
(26.67%)
0
(0%)
5
(1.67%)
188
(62.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT_M
2011-02-16
(complete)
300104
(34.67%)
25
(8.33%)
79
(26.33%)
0
(0%)
0
(0%)
196
(65.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
PicoSAT
941
(complete)
30092
(30.67%)
27
(9%)
65
(21.67%)
0
(0%)
0
(0%)
208
(69.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Plingeling
587 [DEPRECATED]
(complete)
300103
(34.33%)
29
(9.67%)
74
(24.67%)
0
(0%)
0
(0%)
197
(65.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Plingeling
587f (fixed)
(complete)
300103
(34.33%)
30
(10%)
73
(24.33%)
0
(0%)
0
(0%)
197
(65.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ppfolio
par
(complete)
300151
(50.33%)
38
(12.67%)
113
(37.67%)
0
(0%)
0
(0%)
144
(48%)
5
(1.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ppfolio
seq
(complete)
300139
(46.33%)
32
(10.67%)
107
(35.67%)
0
(0%)
0
(0%)
145
(48.33%)
16
(5.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
priss
1.0
(complete)
30082
(27.33%)
20
(6.67%)
62
(20.67%)
0
(0%)
0
(0%)
216
(72%)
0
(0%)
2
(0.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
priss
Auto
(complete)
30081
(27%)
20
(6.67%)
61
(20.33%)
0
(0%)
0
(0%)
219
(73%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
priss
UP
(complete)
30082
(27.33%)
22
(7.33%)
60
(20%)
0
(0%)
0
(0%)
218
(72.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
QuteRSat
2011-03-01 [DEPRECATED]
(complete)
30090
(30%)
32
(10.67%)
58
(19.33%)
0
(0%)
0
(0%)
210
(70%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
QuteRSat
2011-05-12 (fixed)
(complete)
30094
(31.33%)
33
(11%)
61
(20.33%)
0
(0%)
0
(0%)
206
(68.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
rcl
2011-04-01
(complete)
30086
(28.67%)
25
(8.33%)
61
(20.33%)
0
(0%)
0
(0%)
214
(71.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RestartSAT
A75
(complete)
30089
(29.67%)
26
(8.67%)
63
(21%)
0
(0%)
0
(0%)
211
(70.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RestartSAT
B95
(complete)
30094
(31.33%)
28
(9.33%)
66
(22%)
0
(0%)
0
(0%)
206
(68.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
riss
1.0
(complete)
30077
(25.67%)
22
(7.33%)
55
(18.33%)
0
(0%)
0
(0%)
223
(74.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
riss
Auto
(complete)
30077
(25.67%)
22
(7.33%)
55
(18.33%)
0
(0%)
0
(0%)
223
(74.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
riss
Auto (1200 s timeout)
(complete)
30076
(25.33%)
22
(7.33%)
54
(18%)
0
(0%)
0
(0%)
224
(74.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
riss
Exp
(complete)
30074
(24.67%)
20
(6.67%)
54
(18%)
0
(0%)
0
(0%)
226
(75.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SApperloT
2011-03-23
(complete)
30088
(29.33%)
27
(9%)
61
(20.33%)
0
(0%)
0
(0%)
212
(70.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SApperloT2010
2011-03-04 [DEPRECATED]
(complete)
30064
(21.33%)
27
(9%)
37
(12.33%)
0
(0%)
0
(0%)
210
(70%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
26
(8.67%)
0
(0%)
0
(0%)
SApperloT2010
2011-05-15 (fixed)
(complete)
30093
(31%)
26
(8.67%)
67
(22.33%)
0
(0%)
0
(0%)
207
(69%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SArTagnan
2011-03-24 [DEPRECATED]
(complete)
30067
(22.33%)
27
(9%)
40
(13.33%)
0
(0%)
0
(0%)
214
(71.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
19
(6.33%)
0
(0%)
SArTagnan
2011-05-15 (fixed)
(complete)
30085
(28.33%)
25
(8.33%)
60
(20%)
0
(0%)
0
(0%)
215
(71.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT07 reference solver: minisat
SAT 2007
(complete)
30092
(30.67%)
32
(10.67%)
60
(20%)
0
(0%)
0
(0%)
208
(69.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
30093
(31%)
34
(11.33%)
59
(19.67%)
0
(0%)
0
(0%)
207
(69%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
30081
(27%)
31
(10.33%)
50
(16.67%)
0
(0%)
0
(0%)
219
(73%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT4J core
2.3.0 SNAPSHOT 2011-02-06
(complete)
30078
(26%)
25
(8.33%)
53
(17.67%)
0
(0%)
0
(0%)
222
(74%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sathys
2011-04-01
(complete)
30088
(29.33%)
20
(6.67%)
68
(22.67%)
0
(0%)
0
(0%)
212
(70.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Satisfiability Solver Selector
2011-03-18
(complete)
300137
(45.67%)
29
(9.67%)
108
(36%)
0
(0%)
0
(0%)
163
(54.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Satisfiability Solver Selector
2011-03-18 (1200 s timeout)
(complete)
300131
(43.67%)
31
(10.33%)
100
(33.33%)
0
(0%)
0
(0%)
169
(56.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sattime
2011-03-02
(incomplete)
300104
(34.67%)
0
(0%)
104
(34.67%)
0
(0%)
0
(0%)
196
(65.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sattime+
2011-03-02
(incomplete)
300102
(34%)
0
(0%)
102
(34%)
0
(0%)
0
(0%)
198
(66%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sattime2011
2011-03-02
(incomplete)
300104
(34.67%)
0
(0%)
104
(34.67%)
0
(0%)
0
(0%)
196
(65.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
shortsattime+
2011-03-02
(incomplete)
300105
(35%)
0
(0%)
105
(35%)
0
(0%)
0
(0%)
195
(65%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
shortsattime2011
2011-03-02
(incomplete)
300103
(34.33%)
0
(0%)
103
(34.33%)
0
(0%)
0
(0%)
197
(65.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sol
2011-04-04
(complete)
300103
(34.33%)
30
(10%)
73
(24.33%)
0
(0%)
0
(0%)
197
(65.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
STRUCTure
0.1
(complete)
30060
(20%)
17
(5.67%)
43
(14.33%)
0
(0%)
0
(0%)
240
(80%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
STRUCTure
0.1 (hbr=2)
(complete)
30061
(20.33%)
17
(5.67%)
44
(14.67%)
0
(0%)
0
(0%)
239
(79.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
synit_sat
2011-03-03
(complete)
30094
(31.33%)
32
(10.67%)
62
(20.67%)
0
(0%)
0
(0%)
206
(68.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
tts
5-4
(complete)
30037
(12.33%)
17
(5.67%)
20
(6.67%)
0
(0%)
0
(0%)
248
(82.67%)
13
(4.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
2
(0.67%)
0
(0%)
0
(0%)
0
(0%)
ttsth
5-4
(complete)
30046
(15.33%)
20
(6.67%)
26
(8.67%)
0
(0%)
10
(3.33%)
239
(79.67%)
3
(1%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
2
(0.67%)
0
(0%)
0
(0%)
0
(0%)
UmSat
2011-02-25 [DEPRECATED]
(complete)
30062
(20.67%)
17
(5.67%)
45
(15%)
0
(0%)
0
(0%)
222
(74%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
16
(5.33%)
0
(0%)
0
(0%)
0
(0%)
UmSat
2011-05-12 (fixed)
(complete)
30068
(22.67%)
19
(6.33%)
49
(16.33%)
0
(0%)
0
(0%)
232
(77.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)

Solver NameProgress
adaptg2wsat2011
2011-03-02
(incomplete)
done
300
SAT.
99
? (TO)
201
Black Hole SAT
2011-03-08
(complete)
done
300
UNSAT.
11
SAT.
25
? (TO)
264
clasp
2.0-R4092-crafted
(complete)
done
300
UNSAT.
37
SAT.
68
? (TO)
195
claspmt
2.0-R4095 [DEPRECATED]
(complete)
done
300
UNSAT.
41
SAT.
88
? (TO)
170
ERR CERT
1
claspmt
2.0-R4095-patched (fixed)
(complete)
done
300
UNSAT.
43
SAT.
90
? (TO)
167
CryptoMiniSat
Strange-Night-1-mt [DEPRECATED]
(complete)
done
300
UNSAT.
38
SAT.
73
? (TO)
189
CryptoMiniSat
Strange-Night-1-mt (fixed)
(complete)
done
300
UNSAT.
37
SAT.
76
? (TO)
187
CryptoMiniSat
Strange-Night-1-st [DEPRECATED]
(complete)
done
300
UNSAT.
32
SAT.
57
? (TO)
211
CryptoMiniSat
Strange-Night-1-st (fixed)
(complete)
done
300
UNSAT.
32
SAT.
57
? (TO)
211
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
done
300
UNSAT.
35
SAT.
72
? (TO)
193
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
done
300
UNSAT.
36
SAT.
69
? (TO)
195
CryptoMiniSat
Strange-Night2-st [DEPRECATED]
(complete)
done
300
UNSAT.
32
SAT.
63
? (TO)
205
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
done
300
UNSAT.
32
SAT.
64
? (TO)
204
CryptoMiniSat
TechDemo-Alpha-mt
(complete)
done
300
UNSAT.
25
SAT.
46
? (TO)
228
? (SIG)
1
CryptoMiniSat
TechDemo-Alpha-st
(complete)
done
300
UNSAT.
18
SAT.
44
? (TO)
238
glucose
2
(complete)
done
300
UNSAT.
31
SAT.
60
? (TO)
209
jMiniSat
2011
(complete)
done
300
UNSAT.
23
SAT.
61
? (TO)
216
Lingeling
587 [DEPRECATED]
(complete)
done
300
UNSAT.
27
SAT.
62
? (TO)
211
Lingeling
587f (fixed)
(complete)
done
300
UNSAT.
27
SAT.
62
? (TO)
211
march_rw
2011-03-02
(complete)
done
300
UNSAT.
26
SAT.
57
? (TO)
217
MPhaseSAT
2011-02-15
(complete)
done
300
UNSAT.
26
SAT.
81
? (TO)
193
MPhaseSAT64
2011-03-03 [DEPRECATED]
(complete)
done
300
UNSAT.
26
SAT.
73
?
38
? (TO)
163
MPhaseSAT64
2011-05-14 (fixed)
(complete)
done
300
UNSAT.
27
SAT.
80
?
5
? (TO)
188
MPhaseSAT_M
2011-02-16
(complete)
done
300
UNSAT.
25
SAT.
79
? (TO)
196
PicoSAT
941
(complete)
done
300
UNSAT.
27
SAT.
65
? (TO)
208
Plingeling
587 [DEPRECATED]
(complete)
done
300
UNSAT.
29
SAT.
74
? (TO)
197
Plingeling
587f (fixed)
(complete)
done
300
UNSAT.
30
SAT.
73
? (TO)
197
ppfolio
par
(complete)
done
300
UNSAT.
38
SAT.
113
? (TO)
144
? (MO)
5
ppfolio
seq
(complete)
done
300
UNSAT.
32
SAT.
107
? (TO)
145
? (MO)
16
priss
1.0
(complete)
done
300
UNSAT.
20
SAT.
62
? (TO)
216
? (EC)
2
priss
Auto
(complete)
done
300
UNSAT.
20
SAT.
61
? (TO)
219
priss
UP
(complete)
done
300
UNSAT.
22
SAT.
60
? (TO)
218
QuteRSat
2011-03-01 [DEPRECATED]
(complete)
done
300
UNSAT.
32
SAT.
58
? (TO)
210
QuteRSat
2011-05-12 (fixed)
(complete)
done
300
UNSAT.
33
SAT.
61
? (TO)
206
rcl
2011-04-01
(complete)
done
300
UNSAT.
25
SAT.
61
? (TO)
214
RestartSAT
A75
(complete)
done
300
UNSAT.
26
SAT.
63
? (TO)
211
RestartSAT
B95
(complete)
done
300
UNSAT.
28
SAT.
66
? (TO)
206
riss
1.0
(complete)
done
300
UNSAT.
22
SAT.
55
? (TO)
223
riss
Auto
(complete)
done
300
UNSAT.
22
SAT.
55
? (TO)
223
riss
Auto (1200 s timeout)
(complete)
done
300
UNSAT.
22
SAT.
54
? (TO)
224
riss
Exp
(complete)
done
300
UNSAT.
20
SAT.
54
? (TO)
226
SApperloT
2011-03-23
(complete)
done
300
UNSAT.
27
SAT.
61
? (TO)
212
SApperloT2010
2011-03-04 [DEPRECATED]
(complete)
done
300
UNSAT.
27
SAT.
37
? (TO)
210
NO CERT.
26
SApperloT2010
2011-05-15 (fixed)
(complete)
done
300
UNSAT.
26
SAT.
67
? (TO)
207
SArTagnan
2011-03-24 [DEPRECATED]
(complete)
done
300
UNSAT.
27
SAT.
40
? (TO)
214
ERR CERT
19
SArTagnan
2011-05-15 (fixed)
(complete)
done
300
UNSAT.
25
SAT.
60
? (TO)
215
SAT07 reference solver: minisat
SAT 2007
(complete)
done
300
UNSAT.
32
SAT.
60
? (TO)
208
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
done
300
UNSAT.
34
SAT.
59
? (TO)
207
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
done
300
UNSAT.
31
SAT.
50
? (TO)
219
SAT4J core
2.3.0 SNAPSHOT 2011-02-06
(complete)
done
300
UNSAT.
25
SAT.
53
? (TO)
222
sathys
2011-04-01
(complete)
done
300
UNSAT.
20
SAT.
68
? (TO)
212
Satisfiability Solver Selector
2011-03-18
(complete)
done
300
UNSAT.
29
SAT.
108
? (TO)
163
Satisfiability Solver Selector
2011-03-18 (1200 s timeout)
(complete)
done
300
UNSAT.
31
SAT.
100
? (TO)
169
sattime
2011-03-02
(incomplete)
done
300
SAT.
104
? (TO)
196
sattime+
2011-03-02
(incomplete)
done
300
SAT.
102
? (TO)
198
sattime2011
2011-03-02
(incomplete)
done
300
SAT.
104
? (TO)
196
shortsattime+
2011-03-02
(incomplete)
done
300
SAT.
105
? (TO)
195
shortsattime2011
2011-03-02
(incomplete)
done
300
SAT.
103
? (TO)
197
Sol
2011-04-04
(complete)
done
300
UNSAT.
30
SAT.
73
? (TO)
197
STRUCTure
0.1
(complete)
done
300
UNSAT.
17
SAT.
43
? (TO)
240
STRUCTure
0.1 (hbr=2)
(complete)
done
300
UNSAT.
17
SAT.
44
? (TO)
239
synit_sat
2011-03-03
(complete)
done
300
UNSAT.
32
SAT.
62
? (TO)
206
tts
5-4
(complete)
done
300
UNSAT.
17
SAT.
20
? (TO)
248
? (MO)
13
? (SIG)
2
ttsth
5-4
(complete)
done
300
UNSAT.
20
SAT.
26
?
10
? (TO)
239
? (MO)
3
? (SIG)
2
UmSat
2011-02-25 [DEPRECATED]
(complete)
done
300
UNSAT.
17
SAT.
45
? (TO)
222
? (SIG)
16
UmSat
2011-05-12 (fixed)
(complete)
done
300
UNSAT.
19
SAT.
49
? (TO)
232

Category "random instances" (RANDOM)

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)UNKNOWN (abort)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.
adaptg2wsat2011
2011-03-02
(incomplete)
600300
(50%)
0
(0%)
300
(50%)
0
(0%)
0
(0%)
300
(50%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Black Hole SAT
2011-03-08
(complete)
60047
(7.83%)
29
(4.83%)
18
(3%)
0
(0%)
0
(0%)
553
(92.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
borg-sat
11.03.02-par-random (fixed)
(complete)
600408
(68%)
106
(17.67%)
302
(50.33%)
0
(0%)
108
(18%)
5
(0.83%)
78
(13%)
1
(0.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
600403
(67.17%)
106
(17.67%)
297
(49.5%)
0
(0%)
0
(0%)
105
(17.5%)
81
(13.5%)
10
(1.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.17%)
0
(0%)
borg-sat
11.03.02-seq-random (fixed)
(complete)
600398
(66.33%)
106
(17.67%)
292
(48.67%)
0
(0%)
0
(0%)
111
(18.5%)
91
(15.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
borg-sat
11.03.02-seq-random (fixed, 1200 s timeout)
(complete)
600396
(66%)
102
(17%)
294
(49%)
0
(0%)
18
(3%)
97
(16.17%)
88
(14.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.17%)
0
(0%)
CryptoMiniSat
Strange-Night-1-mt [DEPRECATED]
(complete)
60086
(14.33%)
49
(8.17%)
37
(6.17%)
0
(0%)
0
(0%)
514
(85.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-mt (fixed)
(complete)
60086
(14.33%)
49
(8.17%)
37
(6.17%)
0
(0%)
0
(0%)
514
(85.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-st [DEPRECATED]
(complete)
60076
(12.67%)
48
(8%)
28
(4.67%)
0
(0%)
0
(0%)
524
(87.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-st (fixed)
(complete)
60075
(12.5%)
48
(8%)
27
(4.5%)
0
(0%)
0
(0%)
525
(87.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
60089
(14.83%)
49
(8.17%)
40
(6.67%)
0
(0%)
0
(0%)
511
(85.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
60089
(14.83%)
49
(8.17%)
40
(6.67%)
0
(0%)
0
(0%)
511
(85.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night2-st [DEPRECATED]
(complete)
60080
(13.33%)
48
(8%)
32
(5.33%)
0
(0%)
0
(0%)
520
(86.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
60081
(13.5%)
48
(8%)
33
(5.5%)
0
(0%)
0
(0%)
519
(86.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
TechDemo-Alpha-mt
(complete)
60059
(9.83%)
31
(5.17%)
28
(4.67%)
0
(0%)
0
(0%)
541
(90.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
TechDemo-Alpha-st
(complete)
60055
(9.17%)
31
(5.17%)
24
(4%)
0
(0%)
0
(0%)
545
(90.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
csls
pnorm-8cores
(incomplete)
600307
(51.17%)
0
(0%)
307
(51.17%)
0
(0%)
0
(0%)
293
(48.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
csls
prob-4cores
(incomplete)
600303
(50.5%)
0
(0%)
303
(50.5%)
0
(0%)
0
(0%)
297
(49.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
csls
prob-8cores
(incomplete)
600301
(50.17%)
0
(0%)
301
(50.17%)
0
(0%)
0
(0%)
299
(49.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
EagleUP
1.565.350
(incomplete)
600315
(52.5%)
0
(0%)
315
(52.5%)
0
(0%)
0
(0%)
285
(47.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
jMiniSat
2011
(complete)
60081
(13.5%)
43
(7.17%)
38
(6.33%)
0
(0%)
0
(0%)
519
(86.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
march_rw
2011-03-02
(complete)
600217
(36.17%)
108
(18%)
109
(18.17%)
0
(0%)
0
(0%)
383
(63.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT
2011-02-15
(complete)
600310
(51.67%)
68
(11.33%)
242
(40.33%)
0
(0%)
0
(0%)
290
(48.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT64
2011-03-03 [DEPRECATED]
(complete)
600306
(51%)
64
(10.67%)
242
(40.33%)
0
(0%)
1
(0.17%)
293
(48.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
600312
(52%)
69
(11.5%)
243
(40.5%)
0
(0%)
0
(0%)
288
(48%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT_M
2011-02-16
(complete)
600342
(57%)
100
(16.67%)
242
(40.33%)
0
(0%)
0
(0%)
258
(43%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MultiFlip
2011-02-11
(incomplete)
600274
(45.67%)
0
(0%)
274
(45.67%)
0
(0%)
0
(0%)
326
(54.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ppfolio
par
(complete)
600375
(62.5%)
102
(17%)
273
(45.5%)
0
(0%)
0
(0%)
222
(37%)
3
(0.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ppfolio
seq
(complete)
600323
(53.83%)
60
(10%)
263
(43.83%)
0
(0%)
0
(0%)
272
(45.33%)
5
(0.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
QuteRSat
2011-03-01 [DEPRECATED]
(complete)
60079
(13.17%)
48
(8%)
31
(5.17%)
0
(0%)
0
(0%)
521
(86.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
QuteRSat
2011-05-12 (fixed)
(complete)
60083
(13.83%)
49
(8.17%)
34
(5.67%)
0
(0%)
0
(0%)
517
(86.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RestartSAT
A75
(complete)
60077
(12.83%)
39
(6.5%)
38
(6.33%)
0
(0%)
0
(0%)
523
(87.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RestartSAT
B95
(complete)
60083
(13.83%)
49
(8.17%)
34
(5.67%)
0
(0%)
0
(0%)
517
(86.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
600276
(46%)
0
(0%)
276
(46%)
0
(0%)
0
(0%)
324
(54%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver: march_hi
hi
(complete)
600212
(35.33%)
106
(17.67%)
106
(17.67%)
0
(0%)
0
(0%)
388
(64.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
600352
(58.67%)
83
(13.83%)
269
(44.83%)
0
(0%)
0
(0%)
248
(41.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
600294
(49%)
0
(0%)
294
(49%)
0
(0%)
0
(0%)
306
(51%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT4J core
2.3.0 SNAPSHOT 2011-02-06
(complete)
60066
(11%)
32
(5.33%)
34
(5.67%)
0
(0%)
0
(0%)
534
(89%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sathys
2011-04-01
(complete)
600183
(30.5%)
23
(3.83%)
160
(26.67%)
0
(0%)
0
(0%)
417
(69.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT_Intersec_01
2011-03-01
(complete)
6000
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
590
(98.33%)
0
(0%)
10
(1.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Satisfiability Solver Selector
2011-03-18
(complete)
600380
(63.33%)
96
(16%)
284
(47.33%)
0
(0%)
0
(0%)
220
(36.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Satisfiability Solver Selector
2011-03-18 (1200 s timeout)
(complete)
600399
(66.5%)
106
(17.67%)
293
(48.83%)
0
(0%)
0
(0%)
201
(33.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sattime
2011-03-02
(incomplete)
600251
(41.83%)
0
(0%)
251
(41.83%)
0
(0%)
0
(0%)
349
(58.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sattime+
2011-03-02
(incomplete)
600216
(36%)
0
(0%)
216
(36%)
0
(0%)
0
(0%)
384
(64%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sattime2011
2011-03-02
(incomplete)
600309
(51.5%)
0
(0%)
309
(51.5%)
0
(0%)
0
(0%)
291
(48.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
shortsattime+
2011-03-02
(incomplete)
600211
(35.17%)
0
(0%)
211
(35.17%)
0
(0%)
0
(0%)
389
(64.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
shortsattime2011
2011-03-02
(incomplete)
600304
(50.67%)
0
(0%)
304
(50.67%)
0
(0%)
0
(0%)
296
(49.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sol
2011-04-04
(complete)
60053
(8.83%)
30
(5%)
23
(3.83%)
0
(0%)
0
(0%)
547
(91.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
600343
(57.17%)
0
(0%)
343
(57.17%)
0
(0%)
0
(0%)
257
(42.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
STRUCTure
0.1
(complete)
600103
(17.17%)
60
(10%)
43
(7.17%)
0
(0%)
0
(0%)
497
(82.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
STRUCTure
0.1 (hbr=2)
(complete)
600107
(17.83%)
60
(10%)
47
(7.83%)
0
(0%)
0
(0%)
493
(82.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
synit_sat
2011-03-03
(complete)
60076
(12.67%)
48
(8%)
28
(4.67%)
0
(0%)
0
(0%)
524
(87.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
UmSat
2011-02-25 [DEPRECATED]
(complete)
60062
(10.33%)
36
(6%)
26
(4.33%)
0
(0%)
0
(0%)
537
(89.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.17%)
0
(0%)
0
(0%)
0
(0%)

Solver NameProgress
adaptg2wsat2011
2011-03-02
(incomplete)
done
600
SAT.
300
? (TO)
300
Black Hole SAT
2011-03-08
(complete)
done
600
UNSAT.
29
SAT.
18
? (TO)
553
borg-sat
11.03.02-par-random (fixed)
(complete)
done
600
UNSAT.
106
SAT.
302
?
108
? (TO)
5
? (MO)
78
? (EC)
1
borg-sat
11.03.02-random [DEPRECATED]
(complete)
done
600
UNSAT.
106
SAT.
297
? (TO)
105
? (MO)
81
? (EC)
10
ERR CERT
1
borg-sat
11.03.02-seq-random (fixed)
(complete)
done
600
UNSAT.
106
SAT.
292
? (TO)
111
? (MO)
91
borg-sat
11.03.02-seq-random (fixed, 1200 s timeout)
(complete)
done
600
UNSAT.
102
SAT.
294
?
18
? (TO)
97
? (MO)
88
ERR CERT
1
CryptoMiniSat
Strange-Night-1-mt [DEPRECATED]
(complete)
done
600
UNSAT.
49
SAT.
37
? (TO)
514
CryptoMiniSat
Strange-Night-1-mt (fixed)
(complete)
done
600
UNSAT.
49
SAT.
37
? (TO)
514
CryptoMiniSat
Strange-Night-1-st [DEPRECATED]
(complete)
done
600
UNSAT.
48
SAT.
28
? (TO)
524
CryptoMiniSat
Strange-Night-1-st (fixed)
(complete)
done
600
UNSAT.
48
SAT.
27
? (TO)
525
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
done
600
UNSAT.
49
SAT.
40
? (TO)
511
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
done
600
UNSAT.
49
SAT.
40
? (TO)
511
CryptoMiniSat
Strange-Night2-st [DEPRECATED]
(complete)
done
600
UNSAT.
48
SAT.
32
? (TO)
520
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
done
600
UNSAT.
48
SAT.
33
? (TO)
519
CryptoMiniSat
TechDemo-Alpha-mt
(complete)
done
600
UNSAT.
31
SAT.
28
? (TO)
541
CryptoMiniSat
TechDemo-Alpha-st
(complete)
done
600
UNSAT.
31
SAT.
24
? (TO)
545
csls
pnorm-8cores
(incomplete)
done
600
SAT.
307
? (TO)
293
csls
prob-4cores
(incomplete)
done
600
SAT.
303
? (TO)
297
csls
prob-8cores
(incomplete)
done
600
SAT.
301
? (TO)
299
EagleUP
1.565.350
(incomplete)
done
600
SAT.
315
? (TO)
285
jMiniSat
2011
(complete)
done
600
UNSAT.
43
SAT.
38
? (TO)
519
march_rw
2011-03-02
(complete)
done
600
UNSAT.
108
SAT.
109
? (TO)
383
MPhaseSAT
2011-02-15
(complete)
done
600
UNSAT.
68
SAT.
242
? (TO)
290
MPhaseSAT64
2011-03-03 [DEPRECATED]
(complete)
done
600
UNSAT.
64
SAT.
242
?
1
? (TO)
293
MPhaseSAT64
2011-05-14 (fixed)
(complete)
done
600
UNSAT.
69
SAT.
243
? (TO)
288
MPhaseSAT_M
2011-02-16
(complete)
done
600
UNSAT.
100
SAT.
242
? (TO)
258
MultiFlip
2011-02-11
(incomplete)
done
600
SAT.
274
? (TO)
326
ppfolio
par
(complete)
done
600
UNSAT.
102
SAT.
273
? (TO)
222
? (MO)
3
ppfolio
seq
(complete)
done
600
UNSAT.
60
SAT.
263
? (TO)
272
? (MO)
5
QuteRSat
2011-03-01 [DEPRECATED]
(complete)
done
600
UNSAT.
48
SAT.
31
? (TO)
521
QuteRSat
2011-05-12 (fixed)
(complete)
done
600
UNSAT.
49
SAT.
34
? (TO)
517
RestartSAT
A75
(complete)
done
600
UNSAT.
39
SAT.
38
? (TO)
523
RestartSAT
B95
(complete)
done
600
UNSAT.
49
SAT.
34
? (TO)
517
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
done
600
SAT.
276
? (TO)
324
SAT09 reference solver: march_hi
hi
(complete)
done
600
UNSAT.
106
SAT.
106
? (TO)
388
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
done
600
UNSAT.
83
SAT.
269
? (TO)
248
SAT09 reference solver: TNM
2009-03-22
(incomplete)
done
600
SAT.
294
? (TO)
306
SAT4J core
2.3.0 SNAPSHOT 2011-02-06
(complete)
done
600
UNSAT.
32
SAT.
34
? (TO)
534
sathys
2011-04-01
(complete)
done
600
UNSAT.
23
SAT.
160
? (TO)
417
SAT_Intersec_01
2011-03-01
(complete)
done
600
? (TO)
590
? (EC)
10
Satisfiability Solver Selector
2011-03-18
(complete)
done
600
UNSAT.
96
SAT.
284
? (TO)
220
Satisfiability Solver Selector
2011-03-18 (1200 s timeout)
(complete)
done
600
UNSAT.
106
SAT.
293
? (TO)
201
sattime
2011-03-02
(incomplete)
done
600
SAT.
251
? (TO)
349
sattime+
2011-03-02
(incomplete)
done
600
SAT.
216
? (TO)
384
sattime2011
2011-03-02
(incomplete)
done
600
SAT.
309
? (TO)
291
shortsattime+
2011-03-02
(incomplete)
done
600
SAT.
211
? (TO)
389
shortsattime2011
2011-03-02
(incomplete)
done
600
SAT.
304
? (TO)
296
Sol
2011-04-04
(complete)
done
600
UNSAT.
30
SAT.
23
? (TO)
547
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
done
600
SAT.
343
? (TO)
257
STRUCTure
0.1
(complete)
done
600
UNSAT.
60
SAT.
43
? (TO)
497
STRUCTure
0.1 (hbr=2)
(complete)
done
600
UNSAT.
60
SAT.
47
? (TO)
493
synit_sat
2011-03-03
(complete)
done
600
UNSAT.
48
SAT.
28
? (TO)
524
UmSat
2011-02-25 [DEPRECATED]
(complete)
done
600
UNSAT.
36
SAT.
26
? (TO)
537
? (SIG)
1

All categories for solvers registered in all categories

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)UNKNOWN (abort)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.
adaptg2wsat2011
2011-03-02
(incomplete)
1200414
(34.5%)
0
(0%)
414
(34.5%)
0
(0%)
9
(0.75%)
770
(64.17%)
0
(0%)
0
(0%)
0
(0%)
7
(0.58%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Black Hole SAT
2011-03-08
(complete)
1200110
(9.17%)
45
(3.75%)
65
(5.42%)
0
(0%)
0
(0%)
1090
(90.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-mt [DEPRECATED]
(complete)
1200378
(31.5%)
191
(15.92%)
187
(15.58%)
0
(0%)
0
(0%)
808
(67.33%)
10
(0.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
4
(0.33%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-mt (fixed)
(complete)
1200380
(31.67%)
189
(15.75%)
191
(15.92%)
0
(0%)
0
(0%)
806
(67.17%)
10
(0.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
4
(0.33%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-st [DEPRECATED]
(complete)
1200328
(27.33%)
171
(14.25%)
157
(13.08%)
0
(0%)
0
(0%)
869
(72.42%)
3
(0.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-st (fixed)
(complete)
1200327
(27.25%)
171
(14.25%)
156
(13%)
0
(0%)
0
(0%)
870
(72.5%)
3
(0.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
1200387
(32.25%)
187
(15.58%)
200
(16.67%)
0
(0%)
0
(0%)
793
(66.08%)
13
(1.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
7
(0.58%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
1200386
(32.17%)
190
(15.83%)
196
(16.33%)
0
(0%)
0
(0%)
800
(66.67%)
11
(0.92%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
3
(0.25%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night2-st [DEPRECATED]
(complete)
1200348
(29%)
176
(14.67%)
172
(14.33%)
0
(0%)
0
(0%)
835
(69.58%)
13
(1.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
4
(0.33%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
1200351
(29.25%)
176
(14.67%)
175
(14.58%)
0
(0%)
0
(0%)
835
(69.58%)
13
(1.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.08%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
TechDemo-Alpha-mt
(complete)
1200269
(22.42%)
128
(10.67%)
141
(11.75%)
0
(0%)
0
(0%)
905
(75.42%)
3
(0.25%)
1
(0.08%)
0
(0%)
0
(0%)
0
(0%)
22
(1.83%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
TechDemo-Alpha-st
(complete)
1200253
(21.08%)
122
(10.17%)
131
(10.92%)
0
(0%)
0
(0%)
936
(78%)
1
(0.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
8
(0.67%)
0
(0%)
0
(0%)
2
(0.17%)
jMiniSat
2011
(complete)
1200297
(24.75%)
128
(10.67%)
169
(14.08%)
0
(0%)
0
(0%)
903
(75.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
march_rw
2011-03-02
(complete)
1200323
(26.92%)
142
(11.83%)
181
(15.08%)
0
(0%)
0
(0%)
851
(70.92%)
17
(1.42%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
9
(0.75%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT
2011-02-15
(complete)
1200579
(48.25%)
176
(14.67%)
403
(33.58%)
0
(0%)
2
(0.17%)
619
(51.58%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT64
2011-03-03 [DEPRECATED]
(complete)
1200566
(47.17%)
169
(14.08%)
397
(33.08%)
0
(0%)
40
(3.33%)
593
(49.42%)
0
(0%)
0
(0%)
0
(0%)
1
(0.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
1200589
(49.08%)
182
(15.17%)
407
(33.92%)
0
(0%)
5
(0.42%)
605
(50.42%)
0
(0%)
0
(0%)
0
(0%)
1
(0.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT_M
2011-02-16
(complete)
1200612
(51%)
207
(17.25%)
405
(33.75%)
0
(0%)
2
(0.17%)
586
(48.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ppfolio
par
(complete)
1200710
(59.17%)
238
(19.83%)
472
(39.33%)
0
(0%)
0
(0%)
475
(39.58%)
15
(1.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ppfolio
seq
(complete)
1200617
(51.42%)
176
(14.67%)
441
(36.75%)
0
(0%)
0
(0%)
562
(46.83%)
21
(1.75%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
QuteRSat
2011-03-01 [DEPRECATED]
(complete)
1200338
(28.17%)
177
(14.75%)
161
(13.42%)
0
(0%)
0
(0%)
844
(70.33%)
12
(1%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
5
(0.42%)
0
(0%)
1
(0.08%)
0
(0%)
QuteRSat
2011-05-12 (fixed)
(complete)
1200351
(29.25%)
178
(14.83%)
173
(14.42%)
0
(0%)
0
(0%)
842
(70.17%)
5
(0.42%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
2
(0.17%)
0
(0%)
0
(0%)
0
(0%)
RestartSAT
A75
(complete)
1200337
(28.08%)
158
(13.17%)
179
(14.92%)
0
(0%)
0
(0%)
863
(71.92%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RestartSAT
B95
(complete)
1200349
(29.08%)
166
(13.83%)
183
(15.25%)
0
(0%)
0
(0%)
851
(70.92%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT4J core
2.3.0 SNAPSHOT 2011-02-06
(complete)
1200263
(21.92%)
113
(9.42%)
150
(12.5%)
0
(0%)
0
(0%)
937
(78.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sathys
2011-04-01
(complete)
1200410
(34.17%)
113
(9.42%)
297
(24.75%)
0
(0%)
0
(0%)
789
(65.75%)
0
(0%)
1
(0.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Satisfiability Solver Selector
2011-03-18
(complete)
1200675
(56.25%)
204
(17%)
471
(39.25%)
0
(0%)
0
(0%)
525
(43.75%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Satisfiability Solver Selector
2011-03-18 (1200 s timeout)
(complete)
1200701
(58.42%)
223
(18.58%)
478
(39.83%)
0
(0%)
0
(0%)
499
(41.58%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sattime
2011-03-02
(incomplete)
1200371
(30.92%)
0
(0%)
371
(30.92%)
0
(0%)
9
(0.75%)
813
(67.75%)
0
(0%)
0
(0%)
0
(0%)
7
(0.58%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sattime+
2011-03-02
(incomplete)
1200337
(28.08%)
7
(0.58%)
330
(27.5%)
0
(0%)
9
(0.75%)
854
(71.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sattime2011
2011-03-02
(incomplete)
1200429
(35.75%)
0
(0%)
429
(35.75%)
0
(0%)
9
(0.75%)
755
(62.92%)
0
(0%)
0
(0%)
0
(0%)
7
(0.58%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
shortsattime+
2011-03-02
(incomplete)
1200338
(28.17%)
7
(0.58%)
331
(27.58%)
0
(0%)
9
(0.75%)
853
(71.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
shortsattime2011
2011-03-02
(incomplete)
1200422
(35.17%)
0
(0%)
422
(35.17%)
0
(0%)
9
(0.75%)
762
(63.5%)
0
(0%)
0
(0%)
0
(0%)
7
(0.58%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sol
2011-04-04
(complete)
1200275
(22.92%)
121
(10.08%)
154
(12.83%)
0
(0%)
0
(0%)
915
(76.25%)
9
(0.75%)
0
(0%)
0
(0%)
1
(0.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
STRUCTure
0.1
(complete)
1200194
(16.17%)
91
(7.58%)
103
(8.58%)
0
(0%)
0
(0%)
1006
(83.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
STRUCTure
0.1 (hbr=2)
(complete)
1200196
(16.33%)
91
(7.58%)
105
(8.75%)
0
(0%)
0
(0%)
1004
(83.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
synit_sat
2011-03-03
(complete)
1200333
(27.75%)
176
(14.67%)
157
(13.08%)
0
(0%)
0
(0%)
839
(69.92%)
11
(0.92%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
16
(1.33%)
0
(0%)
0
(0%)
1
(0.08%)
UmSat
2011-02-25 [DEPRECATED]
(complete)
1200165
(13.75%)
76
(6.33%)
89
(7.42%)
0
(0%)
0
(0%)
868
(72.33%)
3
(0.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
163
(13.58%)
0
(0%)
1
(0.08%)
0
(0%)

Solver NameProgress
adaptg2wsat2011
2011-03-02
(incomplete)
done
1200
SAT.
414
?
9
? (TO)
770
? (?)
7
Black Hole SAT
2011-03-08
(complete)
done
1200
UNSAT.
45
SAT.
65
? (TO)
1090
CryptoMiniSat
Strange-Night-1-mt [DEPRECATED]
(complete)
done
1200
UNSAT.
191
SAT.
187
? (TO)
808
? (MO)
10
? (SIG)
4
CryptoMiniSat
Strange-Night-1-mt (fixed)
(complete)
done
1200
UNSAT.
189
SAT.
191
? (TO)
806
? (MO)
10
? (SIG)
4
CryptoMiniSat
Strange-Night-1-st [DEPRECATED]
(complete)
done
1200
UNSAT.
171
SAT.
157
? (TO)
869
? (MO)
3
CryptoMiniSat
Strange-Night-1-st (fixed)
(complete)
done
1200
UNSAT.
171
SAT.
156
? (TO)
870
? (MO)
3
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
done
1200
UNSAT.
187
SAT.
200
? (TO)
793
? (MO)
13
? (SIG)
7
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
done
1200
UNSAT.
190
SAT.
196
? (TO)
800
? (MO)
11
? (SIG)
3
CryptoMiniSat
Strange-Night2-st [DEPRECATED]
(complete)
done
1200
UNSAT.
176
SAT.
172
? (TO)
835
? (MO)
13
? (SIG)
4
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
done
1200
UNSAT.
176
SAT.
175
? (TO)
835
? (MO)
13
? (SIG)
1
CryptoMiniSat
TechDemo-Alpha-mt
(complete)
done
1200
UNSAT.
128
SAT.
141
? (TO)
905
? (MO)
3
? (EC)
1
? (SIG)
22
CryptoMiniSat
TechDemo-Alpha-st
(complete)
done
1200
UNSAT.
122
SAT.
131
? (TO)
936
? (MO)
1
? (SIG)
8
WRONG UNSAT.
2
jMiniSat
2011
(complete)
done
1200
UNSAT.
128
SAT.
169
? (TO)
903
march_rw
2011-03-02
(complete)
done
1200
UNSAT.
142
SAT.
181
? (TO)
851
? (MO)
17
? (SIG)
9
MPhaseSAT
2011-02-15
(complete)
done
1200
UNSAT.
176
SAT.
403
?
2
? (TO)
619
MPhaseSAT64
2011-03-03 [DEPRECATED]
(complete)
done
1200
UNSAT.
169
SAT.
397
?
40
? (TO)
593
? (?)
1
MPhaseSAT64
2011-05-14 (fixed)
(complete)
done
1200
UNSAT.
182
SAT.
407
?
5
? (TO)
605
? (?)
1
MPhaseSAT_M
2011-02-16
(complete)
done
1200
UNSAT.
207
SAT.
405
?
2
? (TO)
586
ppfolio
par
(complete)
done
1200
UNSAT.
238
SAT.
472
? (TO)
475
? (MO)
15
ppfolio
seq
(complete)
done
1200
UNSAT.
176
SAT.
441
? (TO)
562
? (MO)
21
QuteRSat
2011-03-01 [DEPRECATED]
(complete)
done
1200
UNSAT.
177
SAT.
161
? (TO)
844
? (MO)
12
? (SIG)
5
ERR CERT
1
QuteRSat
2011-05-12 (fixed)
(complete)
done
1200
UNSAT.
178
SAT.
173
? (TO)
842
? (MO)
5
? (SIG)
2
RestartSAT
A75
(complete)
done
1200
UNSAT.
158
SAT.
179
? (TO)
863
RestartSAT
B95
(complete)
done
1200
UNSAT.
166
SAT.
183
? (TO)
851
SAT4J core
2.3.0 SNAPSHOT 2011-02-06
(complete)
done
1200
UNSAT.
113
SAT.
150
? (TO)
937
sathys
2011-04-01
(complete)
done
1200
UNSAT.
113
SAT.
297
? (TO)
789
? (EC)
1
Satisfiability Solver Selector
2011-03-18
(complete)
done
1200
UNSAT.
204
SAT.
471
? (TO)
525
Satisfiability Solver Selector
2011-03-18 (1200 s timeout)
(complete)
done
1200
UNSAT.
223
SAT.
478
? (TO)
499
sattime
2011-03-02
(incomplete)
done
1200
SAT.
371
?
9
? (TO)
813
? (?)
7
sattime+
2011-03-02
(incomplete)
done
1200
UNSAT.
7
SAT.
330
?
9
? (TO)
854
sattime2011
2011-03-02
(incomplete)
done
1200
SAT.
429
?
9
? (TO)
755
? (?)
7
shortsattime+
2011-03-02
(incomplete)
done
1200
UNSAT.
7
SAT.
331
?
9
? (TO)
853
shortsattime2011
2011-03-02
(incomplete)
done
1200
SAT.
422
?
9
? (TO)
762
? (?)
7
Sol
2011-04-04
(complete)
done
1200
UNSAT.
121
SAT.
154
? (TO)
915
? (MO)
9
? (?)
1
STRUCTure
0.1
(complete)
done
1200
UNSAT.
91
SAT.
103
? (TO)
1006
STRUCTure
0.1 (hbr=2)
(complete)
done
1200
UNSAT.
91
SAT.
105
? (TO)
1004
synit_sat
2011-03-03
(complete)
done
1200
UNSAT.
176
SAT.
157
? (TO)
839
? (MO)
11
? (SIG)
16
WRONG UNSAT.
1
UmSat
2011-02-25 [DEPRECATED]
(complete)
done
1200
UNSAT.
76
SAT.
89
? (TO)
868
? (MO)
3
? (SIG)
163
ERR CERT
1

All categories and all solvers (regardless of their ability to support all categories)

This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)UNKNOWN (abort)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.
adaptg2wsat2011
2011-03-02
(incomplete)
1200414
(34.5%)
0
(0%)
414
(34.5%)
0
(0%)
9
(0.75%)
770
(64.17%)
0
(0%)
0
(0%)
0
(0%)
7
(0.58%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Black Hole SAT
2011-03-08
(complete)
1200110
(9.17%)
45
(3.75%)
65
(5.42%)
0
(0%)
0
(0%)
1090
(90.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
300175
(58.33%)
89
(29.67%)
86
(28.67%)
0
(0%)
0
(0%)
97
(32.33%)
21
(7%)
7
(2.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
borg-sat
11.03.02-par-industrial (fixed)
(complete)
300179
(59.67%)
94
(31.33%)
85
(28.33%)
0
(0%)
91
(30.33%)
10
(3.33%)
17
(5.67%)
2
(0.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.33%)
0
(0%)
0
(0%)
borg-sat
11.03.02-par-random (fixed)
(complete)
600408
(68%)
106
(17.67%)
302
(50.33%)
0
(0%)
108
(18%)
5
(0.83%)
78
(13%)
1
(0.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
borg-sat
11.03.02-random [DEPRECATED]
(complete)
600403
(67.17%)
106
(17.67%)
297
(49.5%)
0
(0%)
0
(0%)
105
(17.5%)
81
(13.5%)
10
(1.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.17%)
0
(0%)
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
300160
(53.33%)
84
(28%)
76
(25.33%)
0
(0%)
0
(0%)
126
(42%)
14
(4.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
borg-sat
11.03.02-seq-industrial (fixed, 1200 s timeout)
(complete)
300160
(53.33%)
85
(28.33%)
75
(25%)
0
(0%)
1
(0.33%)
134
(44.67%)
5
(1.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
borg-sat
11.03.02-seq-random (fixed)
(complete)
600398
(66.33%)
106
(17.67%)
292
(48.67%)
0
(0%)
0
(0%)
111
(18.5%)
91
(15.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
borg-sat
11.03.02-seq-random (fixed, 1200 s timeout)
(complete)
600396
(66%)
102
(17%)
294
(49%)
0
(0%)
18
(3%)
97
(16.17%)
88
(14.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.17%)
0
(0%)
clasp
2.0-R4092-crafted
(complete)
300105
(35%)
37
(12.33%)
68
(22.67%)
0
(0%)
0
(0%)
195
(65%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
clasp
2.0-R4092-indust
(complete)
300154
(51.33%)
81
(27%)
73
(24.33%)
0
(0%)
0
(0%)
146
(48.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
claspmt
2.0-R4095 [DEPRECATED]
(complete)
600307
(51.17%)
130
(21.67%)
177
(29.5%)
0
(0%)
0
(0%)
286
(47.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
7
(1.17%)
0
(0%)
claspmt
2.0-R4095-patched (fixed)
(complete)
600314
(52.33%)
135
(22.5%)
179
(29.83%)
0
(0%)
0
(0%)
286
(47.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-mt [DEPRECATED]
(complete)
1200378
(31.5%)
191
(15.92%)
187
(15.58%)
0
(0%)
0
(0%)
808
(67.33%)
10
(0.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
4
(0.33%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-mt (fixed)
(complete)
1200380
(31.67%)
189
(15.75%)
191
(15.92%)
0
(0%)
0
(0%)
806
(67.17%)
10
(0.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
4
(0.33%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-st [DEPRECATED]
(complete)
1200328
(27.33%)
171
(14.25%)
157
(13.08%)
0
(0%)
0
(0%)
869
(72.42%)
3
(0.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-1-st (fixed)
(complete)
1200327
(27.25%)
171
(14.25%)
156
(13%)
0
(0%)
0
(0%)
870
(72.5%)
3
(0.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
1200387
(32.25%)
187
(15.58%)
200
(16.67%)
0
(0%)
0
(0%)
793
(66.08%)
13
(1.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
7
(0.58%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
1200386
(32.17%)
190
(15.83%)
196
(16.33%)
0
(0%)
0
(0%)
800
(66.67%)
11
(0.92%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
3
(0.25%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night2-st [DEPRECATED]
(complete)
1200348
(29%)
176
(14.67%)
172
(14.33%)
0
(0%)
0
(0%)
835
(69.58%)
13
(1.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
4
(0.33%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
1200351
(29.25%)
176
(14.67%)
175
(14.58%)
0
(0%)
0
(0%)
835
(69.58%)
13
(1.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
1
(0.08%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
TechDemo-Alpha-mt
(complete)
1200269
(22.42%)
128
(10.67%)
141
(11.75%)
0
(0%)
0
(0%)
905
(75.42%)
3
(0.25%)
1
(0.08%)
0
(0%)
0
(0%)
0
(0%)
22
(1.83%)
0
(0%)
0
(0%)
0
(0%)
CryptoMiniSat
TechDemo-Alpha-st
(complete)
1200253
(21.08%)
122
(10.17%)
131
(10.92%)
0
(0%)
0
(0%)
936
(78%)
1
(0.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
8
(0.67%)
0
(0%)
0
(0%)
2
(0.17%)
csls
pnorm-8cores
(incomplete)
600307
(51.17%)
0
(0%)
307
(51.17%)
0
(0%)
0
(0%)
293
(48.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
csls
prob-4cores
(incomplete)
600303
(50.5%)
0
(0%)
303
(50.5%)
0
(0%)
0
(0%)
297
(49.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
csls
prob-8cores
(incomplete)
600301
(50.17%)
0
(0%)
301
(50.17%)
0
(0%)
0
(0%)
299
(49.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
EagleUP
1.565.350
(incomplete)
600315
(52.5%)
0
(0%)
315
(52.5%)
0
(0%)
0
(0%)
285
(47.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
EBGlucose
1.0
(incomplete)
300158
(52.67%)
82
(27.33%)
76
(25.33%)
0
(0%)
0
(0%)
142
(47.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
glucose
2
(complete)
600268
(44.67%)
125
(20.83%)
143
(23.83%)
0
(0%)
0
(0%)
332
(55.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
glueminisat
2.2.5
(complete)
300171
(57%)
98
(32.67%)
73
(24.33%)
0
(0%)
0
(0%)
129
(43%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
jMiniSat
2011
(complete)
1200297
(24.75%)
128
(10.67%)
169
(14.08%)
0
(0%)
0
(0%)
903
(75.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
kw
2011-02-28
(complete)
300156
(52%)
83
(27.67%)
73
(24.33%)
0
(0%)
0
(0%)
143
(47.67%)
1
(0.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Lingeling
587 [DEPRECATED]
(complete)
600261
(43.5%)
120
(20%)
141
(23.5%)
0
(0%)
0
(0%)
339
(56.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Lingeling
587f (fixed)
(complete)
600261
(43.5%)
120
(20%)
141
(23.5%)
0
(0%)
0
(0%)
339
(56.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
march_rw
2011-03-02
(complete)
1200323
(26.92%)
142
(11.83%)
181
(15.08%)
0
(0%)
0
(0%)
851
(70.92%)
17
(1.42%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
9
(0.75%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: cir_minisat
2011-03-02
(complete)
300159
(53%)
74
(24.67%)
85
(28.33%)
0
(0%)
0
(0%)
141
(47%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
300164
(54.67%)
82
(27.33%)
82
(27.33%)
0
(0%)
0
(0%)
136
(45.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: contrasat
2011-03-02
(complete)
300161
(53.67%)
72
(24%)
89
(29.67%)
0
(0%)
0
(0%)
134
(44.67%)
0
(0%)
5
(1.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
300162
(54%)
78
(26%)
84
(28%)
0
(0%)
0
(0%)
138
(46%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: LR_GL_NOSHR
2011-03-02
(complete)
300155
(51.67%)
71
(23.67%)
84
(28%)
0
(0%)
0
(0%)
145
(48.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: LR_GL_SHR
2011-03-02
(complete)
300158
(52.67%)
90
(30%)
68
(22.67%)
0
(0%)
0
(0%)
142
(47.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: LR_NOGL_NOSHR
2011-03-02
(complete)
300154
(51.33%)
71
(23.67%)
83
(27.67%)
0
(0%)
0
(0%)
146
(48.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
300160
(53.33%)
74
(24.67%)
86
(28.67%)
0
(0%)
0
(0%)
139
(46.33%)
0
(0%)
0
(0%)
0
(0%)
1
(0.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack: minisat_psm
2011-04-01
(complete)
300163
(54.33%)
77
(25.67%)
86
(28.67%)
0
(0%)
0
(0%)
137
(45.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
minisat hack reference: minisat
2.2.0
(complete)
300161
(53.67%)
74
(24.67%)
87
(29%)
0
(0%)
0
(0%)
139
(46.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT
2011-02-15
(complete)
1200579
(48.25%)
176
(14.67%)
403
(33.58%)
0
(0%)
2
(0.17%)
619
(51.58%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT64
2011-03-03 [DEPRECATED]
(complete)
1200566
(47.17%)
169
(14.08%)
397
(33.08%)
0
(0%)
40
(3.33%)
593
(49.42%)
0
(0%)
0
(0%)
0
(0%)
1
(0.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT64
2011-05-14 (fixed)
(complete)
1200589
(49.08%)
182
(15.17%)
407
(33.92%)
0
(0%)
5
(0.42%)
605
(50.42%)
0
(0%)
0
(0%)
0
(0%)
1
(0.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MPhaseSAT_M
2011-02-16
(complete)
1200612
(51%)
207
(17.25%)
405
(33.75%)
0
(0%)
2
(0.17%)
586
(48.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
MultiFlip
2011-02-11
(incomplete)
600274
(45.67%)
0
(0%)
274
(45.67%)
0
(0%)
0
(0%)
326
(54.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
PicoSAT
941
(complete)
600233
(38.83%)
94
(15.67%)
139
(23.17%)
0
(0%)
0
(0%)
367
(61.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Plingeling
587 [DEPRECATED]
(complete)
600293
(48.83%)
124
(20.67%)
169
(28.17%)
0
(0%)
0
(0%)
307
(51.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Plingeling
587f (fixed)
(complete)
600295
(49.17%)
126
(21%)
169
(28.17%)
0
(0%)
0
(0%)
305
(50.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ppfolio
par
(complete)
1200710
(59.17%)
238
(19.83%)
472
(39.33%)
0
(0%)
0
(0%)
475
(39.58%)
15
(1.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
ppfolio
seq
(complete)
1200617
(51.42%)
176
(14.67%)
441
(36.75%)
0
(0%)
0
(0%)
562
(46.83%)
21
(1.75%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
priss
1.0
(complete)
600229
(38.17%)
97
(16.17%)
132
(22%)
0
(0%)
0
(0%)
363
(60.5%)
0
(0%)
8
(1.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
priss
Auto
(complete)
600233
(38.83%)
98
(16.33%)
135
(22.5%)
0
(0%)
0
(0%)
361
(60.17%)
0
(0%)
6
(1%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
priss
UP
(complete)
600226
(37.67%)
95
(15.83%)
131
(21.83%)
0
(0%)
0
(0%)
372
(62%)
0
(0%)
2
(0.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
QuteRSat
2011-03-01 [DEPRECATED]
(complete)
1200338
(28.17%)
177
(14.75%)
161
(13.42%)
0
(0%)
0
(0%)
844
(70.33%)
12
(1%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
5
(0.42%)
0
(0%)
1
(0.08%)
0
(0%)
QuteRSat
2011-05-12 (fixed)
(complete)
1200351
(29.25%)
178
(14.83%)
173
(14.42%)
0
(0%)
0
(0%)
842
(70.17%)
5
(0.42%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
2
(0.17%)
0
(0%)
0
(0%)
0
(0%)
rcl
2011-04-01
(complete)
600243
(40.5%)
99
(16.5%)
144
(24%)
0
(0%)
0
(0%)
357
(59.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RestartSAT
A75
(complete)
1200337
(28.08%)
158
(13.17%)
179
(14.92%)
0
(0%)
0
(0%)
863
(71.92%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
RestartSAT
B95
(complete)
1200349
(29.08%)
166
(13.83%)
183
(15.25%)
0
(0%)
0
(0%)
851
(70.92%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
riss
1.0
(complete)
600222
(37%)
97
(16.17%)
125
(20.83%)
0
(0%)
0
(0%)
376
(62.67%)
0
(0%)
2
(0.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
riss
Auto
(complete)
600222
(37%)
97
(16.17%)
125
(20.83%)
0
(0%)
0
(0%)
376
(62.67%)
0
(0%)
2
(0.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
riss
Auto (1200 s timeout)
(complete)
600214
(35.67%)
95
(15.83%)
119
(19.83%)
0
(0%)
0
(0%)
384
(64%)
0
(0%)
2
(0.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
riss
Exp
(complete)
600212
(35.33%)
89
(14.83%)
123
(20.5%)
0
(0%)
0
(0%)
383
(63.83%)
0
(0%)
5
(0.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SApperloT
2011-03-23
(complete)
600240
(40%)
104
(17.33%)
136
(22.67%)
0
(0%)
0
(0%)
360
(60%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SApperloT2010
2011-03-04 [DEPRECATED]
(complete)
600208
(34.67%)
108
(18%)
100
(16.67%)
0
(0%)
0
(0%)
353
(58.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
35
(5.83%)
4
(0.67%)
0
(0%)
SApperloT2010
2011-05-15 (fixed)
(complete)
600250
(41.67%)
108
(18%)
142
(23.67%)
0
(0%)
0
(0%)
350
(58.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SArTagnan
2011-03-24 [DEPRECATED]
(complete)
600202
(33.67%)
107
(17.83%)
95
(15.83%)
0
(0%)
0
(0%)
332
(55.33%)
4
(0.67%)
21
(3.5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
41
(6.83%)
0
(0%)
SArTagnan
2011-05-15 (fixed)
(complete)
600239
(39.83%)
104
(17.33%)
135
(22.5%)
0
(0%)
0
(0%)
334
(55.67%)
4
(0.67%)
23
(3.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT07 reference solver: minisat
SAT 2007
(complete)
30092
(30.67%)
32
(10.67%)
60
(20%)
0
(0%)
0
(0%)
208
(69.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
30093
(31%)
34
(11.33%)
59
(19.67%)
0
(0%)
0
(0%)
207
(69%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver:glucose
1.0
(complete)
300159
(53%)
84
(28%)
75
(25%)
0
(0%)
0
(0%)
141
(47%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
600276
(46%)
0
(0%)
276
(46%)
0
(0%)
0
(0%)
324
(54%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver:LySAT
i/2009-03-20
(complete)
300131
(43.67%)
71
(23.67%)
60
(20%)
0
(0%)
0
(0%)
154
(51.33%)
0
(0%)
15
(5%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
300169
(56.33%)
91
(30.33%)
78
(26%)
0
(0%)
0
(0%)
102
(34%)
0
(0%)
29
(9.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver: march_hi
hi
(complete)
600212
(35.33%)
106
(17.67%)
106
(17.67%)
0
(0%)
0
(0%)
388
(64.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver:precosat
236
(complete)
300167
(55.67%)
88
(29.33%)
79
(26.33%)
0
(0%)
0
(0%)
131
(43.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
2
(0.67%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
30081
(27%)
31
(10.33%)
50
(16.67%)
0
(0%)
0
(0%)
219
(73%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
600352
(58.67%)
83
(13.83%)
269
(44.83%)
0
(0%)
0
(0%)
248
(41.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT09 reference solver: TNM
2009-03-22
(incomplete)
600294
(49%)
0
(0%)
294
(49%)
0
(0%)
0
(0%)
306
(51%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT4J core
2.3.0 SNAPSHOT 2011-02-06
(complete)
1200263
(21.92%)
113
(9.42%)
150
(12.5%)
0
(0%)
0
(0%)
937
(78.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sathys
2011-04-01
(complete)
1200410
(34.17%)
113
(9.42%)
297
(24.75%)
0
(0%)
0
(0%)
789
(65.75%)
0
(0%)
1
(0.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
SAT_Intersec_01
2011-03-01
(complete)
6000
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
590
(98.33%)
0
(0%)
10
(1.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Satisfiability Solver Selector
2011-03-18
(complete)
1200675
(56.25%)
204
(17%)
471
(39.25%)
0
(0%)
0
(0%)
525
(43.75%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Satisfiability Solver Selector
2011-03-18 (1200 s timeout)
(complete)
1200701
(58.42%)
223
(18.58%)
478
(39.83%)
0
(0%)
0
(0%)
499
(41.58%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sattime
2011-03-02
(incomplete)
1200371
(30.92%)
0
(0%)
371
(30.92%)
0
(0%)
9
(0.75%)
813
(67.75%)
0
(0%)
0
(0%)
0
(0%)
7
(0.58%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sattime+
2011-03-02
(incomplete)
1200337
(28.08%)
7
(0.58%)
330
(27.5%)
0
(0%)
9
(0.75%)
854
(71.17%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sattime2011
2011-03-02
(incomplete)
1200429
(35.75%)
0
(0%)
429
(35.75%)
0
(0%)
9
(0.75%)
755
(62.92%)
0
(0%)
0
(0%)
0
(0%)
7
(0.58%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
shortsattime+
2011-03-02
(incomplete)
1200338
(28.17%)
7
(0.58%)
331
(27.58%)
0
(0%)
9
(0.75%)
853
(71.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
shortsattime2011
2011-03-02
(incomplete)
1200422
(35.17%)
0
(0%)
422
(35.17%)
0
(0%)
9
(0.75%)
762
(63.5%)
0
(0%)
0
(0%)
0
(0%)
7
(0.58%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
Sol
2011-04-04
(complete)
1200275
(22.92%)
121
(10.08%)
154
(12.83%)
0
(0%)
0
(0%)
915
(76.25%)
9
(0.75%)
0
(0%)
0
(0%)
1
(0.08%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
600343
(57.17%)
0
(0%)
343
(57.17%)
0
(0%)
0
(0%)
257
(42.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
STRUCTure
0.1
(complete)
1200194
(16.17%)
91
(7.58%)
103
(8.58%)
0
(0%)
0
(0%)
1006
(83.83%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
STRUCTure
0.1 (hbr=2)
(complete)
1200196
(16.33%)
91
(7.58%)
105
(8.75%)
0
(0%)
0
(0%)
1004
(83.67%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
synit_sat
2011-03-03
(complete)
1200333
(27.75%)
176
(14.67%)
157
(13.08%)
0
(0%)
0
(0%)
839
(69.92%)
11
(0.92%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
16
(1.33%)
0
(0%)
0
(0%)
1
(0.08%)
tts
5-4
(complete)
30037
(12.33%)
17
(5.67%)
20
(6.67%)
0
(0%)
0
(0%)
248
(82.67%)
13
(4.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
2
(0.67%)
0
(0%)
0
(0%)
0
(0%)
ttsth
5-4
(complete)
30046
(15.33%)
20
(6.67%)
26
(8.67%)
0
(0%)
10
(3.33%)
239
(79.67%)
3
(1%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
2
(0.67%)
0
(0%)
0
(0%)
0
(0%)
UmSat
2011-02-25 [DEPRECATED]
(complete)
1200165
(13.75%)
76
(6.33%)
89
(7.42%)
0
(0%)
0
(0%)
868
(72.33%)
3
(0.25%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
163
(13.58%)
0
(0%)
1
(0.08%)
0
(0%)
UmSat
2011-05-12 (fixed)
(complete)
600159
(26.5%)
63
(10.5%)
96
(16%)
0
(0%)
0
(0%)
435
(72.5%)
2
(0.33%)
0
(0%)
0
(0%)
0
(0%)
0
(0%)
4
(0.67%)
0
(0%)
0
(0%)
0
(0%)

Solver NameProgress
adaptg2wsat2011
2011-03-02
(incomplete)
done
1200
SAT.
414
?
9
? (TO)
770
? (?)
7
Black Hole SAT
2011-03-08
(complete)
done
1200
UNSAT.
45
SAT.
65
? (TO)
1090
borg-sat
11.03.02-industrial [DEPRECATED]
(complete)
done
300
UNSAT.
89
SAT.
86
? (TO)
97
? (MO)
21
? (EC)
7
borg-sat
11.03.02-par-industrial (fixed)
(complete)
done
300
UNSAT.
94
SAT.
85
?
91
? (TO)
10
? (MO)
17
? (EC)
2
NO CERT.
1
borg-sat
11.03.02-par-random (fixed)
(complete)
done
600
UNSAT.
106
SAT.
302
?
108
? (TO)
5
? (MO)
78
? (EC)
1
borg-sat
11.03.02-random [DEPRECATED]
(complete)
done
600
UNSAT.
106
SAT.
297
? (TO)
105
? (MO)
81
? (EC)
10
ERR CERT
1
borg-sat
11.03.02-seq-industrial (fixed)
(complete)
done
300
UNSAT.
84
SAT.
76
? (TO)
126
? (MO)
14
borg-sat
11.03.02-seq-industrial (fixed, 1200 s timeout)
(complete)
done
300
UNSAT.
85
SAT.
75
?
1
? (TO)
134
? (MO)
5
borg-sat
11.03.02-seq-random (fixed)
(complete)
done
600
UNSAT.
106
SAT.
292
? (TO)
111
? (MO)
91
borg-sat
11.03.02-seq-random (fixed, 1200 s timeout)
(complete)
done
600
UNSAT.
102
SAT.
294
?
18
? (TO)
97
? (MO)
88
ERR CERT
1
clasp
2.0-R4092-crafted
(complete)
done
300
UNSAT.
37
SAT.
68
? (TO)
195
clasp
2.0-R4092-indust
(complete)
done
300
UNSAT.
81
SAT.
73
? (TO)
146
claspmt
2.0-R4095 [DEPRECATED]
(complete)
done
600
UNSAT.
130
SAT.
177
? (TO)
286
ERR CERT
7
claspmt
2.0-R4095-patched (fixed)
(complete)
done
600
UNSAT.
135
SAT.
179
? (TO)
286
CryptoMiniSat
Strange-Night-1-mt [DEPRECATED]
(complete)
done
1200
UNSAT.
191
SAT.
187
? (TO)
808
? (MO)
10
? (SIG)
4
CryptoMiniSat
Strange-Night-1-mt (fixed)
(complete)
done
1200
UNSAT.
189
SAT.
191
? (TO)
806
? (MO)
10
? (SIG)
4
CryptoMiniSat
Strange-Night-1-st [DEPRECATED]
(complete)
done
1200
UNSAT.
171
SAT.
157
? (TO)
869
? (MO)
3
CryptoMiniSat
Strange-Night-1-st (fixed)
(complete)
done
1200
UNSAT.
171
SAT.
156
? (TO)
870
? (MO)
3
CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)
done
1200
UNSAT.
187
SAT.
200
? (TO)
793
? (MO)
13
? (SIG)
7
CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)
done
1200
UNSAT.
190
SAT.
196
? (TO)
800
? (MO)
11
? (SIG)
3
CryptoMiniSat
Strange-Night2-st [DEPRECATED]
(complete)
done
1200
UNSAT.
176
SAT.
172
? (TO)
835
? (MO)
13
? (SIG)
4
CryptoMiniSat
Strange-Night2-st (fixed)
(complete)
done
1200
UNSAT.
176
SAT.
175
? (TO)
835
? (MO)
13
? (SIG)
1
CryptoMiniSat
TechDemo-Alpha-mt
(complete)
done
1200
UNSAT.
128
SAT.
141
? (TO)
905
? (MO)
3
? (EC)
1
? (SIG)
22
CryptoMiniSat
TechDemo-Alpha-st
(complete)
done
1200
UNSAT.
122
SAT.
131
? (TO)
936
? (MO)
1
? (SIG)
8
WRONG UNSAT.
2
csls
pnorm-8cores
(incomplete)
done
600
SAT.
307
? (TO)
293
csls
prob-4cores
(incomplete)
done
600
SAT.
303
? (TO)
297
csls
prob-8cores
(incomplete)
done
600
SAT.
301
? (TO)
299
EagleUP
1.565.350
(incomplete)
done
600
SAT.
315
? (TO)
285
EBGlucose
1.0
(incomplete)
done
300
UNSAT.
82
SAT.
76
? (TO)
142
glucose
2
(complete)
done
600
UNSAT.
125
SAT.
143
? (TO)
332
glueminisat
2.2.5
(complete)
done
300
UNSAT.
98
SAT.
73
? (TO)
129
jMiniSat
2011
(complete)
done
1200
UNSAT.
128
SAT.
169
? (TO)
903
kw
2011-02-28
(complete)
done
300
UNSAT.
83
SAT.
73
? (TO)
143
? (MO)
1
Lingeling
587 [DEPRECATED]
(complete)
done
600
UNSAT.
120
SAT.
141
? (TO)
339
Lingeling
587f (fixed)
(complete)
done
600
UNSAT.
120
SAT.
141
? (TO)
339
march_rw
2011-03-02
(complete)
done
1200
UNSAT.
142
SAT.
181
? (TO)
851
? (MO)
17
? (SIG)
9
minisat hack: cir_minisat
2011-03-02
(complete)
done
300
UNSAT.
74
SAT.
85
? (TO)
141
minisat hack: cir_minisat
2011-05-13 (simp)
(complete)
done
300
UNSAT.
82
SAT.
82
? (TO)
136
minisat hack: contrasat
2011-03-02
(complete)
done
300
UNSAT.
72
SAT.
89
? (TO)
134
? (EC)
5
minisat hack: EBMiniSAT
2011-03-02
(incomplete)
done
300
UNSAT.
78
SAT.
84
? (TO)
138
minisat hack: LR_GL_NOSHR
2011-03-02
(complete)
done
300
UNSAT.
71
SAT.
84
? (TO)
145
minisat hack: LR_GL_SHR
2011-03-02
(complete)
done
300
UNSAT.
90
SAT.
68
? (TO)
142
minisat hack: LR_NOGL_NOSHR
2011-03-02
(complete)
done
300
UNSAT.
71
SAT.
83
? (TO)
146
minisat hack: MiniSAT
2.2.0-agile-26
(complete)
done
300
UNSAT.
74
SAT.
86
? (TO)
139
? (?)
1
minisat hack: minisat_psm
2011-04-01
(complete)
done
300
UNSAT.
77
SAT.
86
? (TO)
137
minisat hack reference: minisat
2.2.0
(complete)
done
300
UNSAT.
74
SAT.
87
? (TO)
139
MPhaseSAT
2011-02-15
(complete)
done
1200
UNSAT.
176
SAT.
403
?
2
? (TO)
619
MPhaseSAT64
2011-03-03 [DEPRECATED]
(complete)
done
1200
UNSAT.
169
SAT.
397
?
40
? (TO)
593
? (?)
1
MPhaseSAT64
2011-05-14 (fixed)
(complete)
done
1200
UNSAT.
182
SAT.
407
?
5
? (TO)
605
? (?)
1
MPhaseSAT_M
2011-02-16
(complete)
done
1200
UNSAT.
207
SAT.
405
?
2
? (TO)
586
MultiFlip
2011-02-11
(incomplete)
done
600
SAT.
274
? (TO)
326
PicoSAT
941
(complete)
done
600
UNSAT.
94
SAT.
139
? (TO)
367
Plingeling
587 [DEPRECATED]
(complete)
done
600
UNSAT.
124
SAT.
169
? (TO)
307
Plingeling
587f (fixed)
(complete)
done
600
UNSAT.
126
SAT.
169
? (TO)
305
ppfolio
par
(complete)
done
1200
UNSAT.
238
SAT.
472
? (TO)
475
? (MO)
15
ppfolio
seq
(complete)
done
1200
UNSAT.
176
SAT.
441
? (TO)
562
? (MO)
21
priss
1.0
(complete)
done
600
UNSAT.
97
SAT.
132
? (TO)
363
? (EC)
8
priss
Auto
(complete)
done
600
UNSAT.
98
SAT.
135
? (TO)
361
? (EC)
6
priss
UP
(complete)
done
600
UNSAT.
95
SAT.
131
? (TO)
372
? (EC)
2
QuteRSat
2011-03-01 [DEPRECATED]
(complete)
done
1200
UNSAT.
177
SAT.
161
? (TO)
844
? (MO)
12
? (SIG)
5
ERR CERT
1
QuteRSat
2011-05-12 (fixed)
(complete)
done
1200
UNSAT.
178
SAT.
173
? (TO)
842
? (MO)
5
? (SIG)
2
rcl
2011-04-01
(complete)
done
600
UNSAT.
99
SAT.
144
? (TO)
357
RestartSAT
A75
(complete)
done
1200
UNSAT.
158
SAT.
179
? (TO)
863
RestartSAT
B95
(complete)
done
1200
UNSAT.
166
SAT.
183
? (TO)
851
riss
1.0
(complete)
done
600
UNSAT.
97
SAT.
125
? (TO)
376
? (EC)
2
riss
Auto
(complete)
done
600
UNSAT.
97
SAT.
125
? (TO)
376
? (EC)
2
riss
Auto (1200 s timeout)
(complete)
done
600
UNSAT.
95
SAT.
119
? (TO)
384
? (EC)
2
riss
Exp
(complete)
done
600
UNSAT.
89
SAT.
123
? (TO)
383
? (EC)
5
SApperloT
2011-03-23
(complete)
done
600
UNSAT.
104
SAT.
136
? (TO)
360
SApperloT2010
2011-03-04 [DEPRECATED]
(complete)
done
600
UNSAT.
108
SAT.
100
? (TO)
353
NO CERT.
35
ERR CERT
4
SApperloT2010
2011-05-15 (fixed)
(complete)
done
600
UNSAT.
108
SAT.
142
? (TO)
350
SArTagnan
2011-03-24 [DEPRECATED]
(complete)
done
600
UNSAT.
107
SAT.
95
? (TO)
332
? (MO)
4
? (EC)
21
ERR CERT
41
SArTagnan
2011-05-15 (fixed)
(complete)
done
600
UNSAT.
104
SAT.
135
? (TO)
334
? (MO)
4
? (EC)
23
SAT07 reference solver: minisat
SAT 2007
(complete)
done
300
UNSAT.
32
SAT.
60
? (TO)
208
SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)
done
300
UNSAT.
34
SAT.
59
? (TO)
207
SAT09 reference solver:glucose
1.0
(complete)
done
300
UNSAT.
84
SAT.
75
? (TO)
141
SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)
done
600
SAT.
276
? (TO)
324
SAT09 reference solver:LySAT
i/2009-03-20
(complete)
done
300
UNSAT.
71
SAT.
60
? (TO)
154
? (EC)
15
SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)
done
300
UNSAT.
91
SAT.
78
? (TO)
102
? (EC)
29
SAT09 reference solver: march_hi
hi
(complete)
done
600
UNSAT.
106
SAT.
106
? (TO)
388
SAT09 reference solver:precosat
236
(complete)
done
300
UNSAT.
88
SAT.
79
? (TO)
131
? (SIG)
2
SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)
done
300
UNSAT.
31
SAT.
50
? (TO)
219
SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)
done
600
UNSAT.
83
SAT.
269
? (TO)
248
SAT09 reference solver: TNM
2009-03-22
(incomplete)
done
600
SAT.
294
? (TO)
306
SAT4J core
2.3.0 SNAPSHOT 2011-02-06
(complete)
done
1200
UNSAT.
113
SAT.
150
? (TO)
937
sathys
2011-04-01
(complete)
done
1200
UNSAT.
113
SAT.
297
? (TO)
789
? (EC)
1
SAT_Intersec_01
2011-03-01
(complete)
done
600
? (TO)
590
? (EC)
10
Satisfiability Solver Selector
2011-03-18
(complete)
done
1200
UNSAT.
204
SAT.
471
? (TO)
525
Satisfiability Solver Selector
2011-03-18 (1200 s timeout)
(complete)
done
1200
UNSAT.
223
SAT.
478
? (TO)
499
sattime
2011-03-02
(incomplete)
done
1200
SAT.
371
?
9
? (TO)
813
? (?)
7
sattime+
2011-03-02
(incomplete)
done
1200
UNSAT.
7
SAT.
330
?
9
? (TO)
854
sattime2011
2011-03-02
(incomplete)
done
1200
SAT.
429
?
9
? (TO)
755
? (?)
7
shortsattime+
2011-03-02
(incomplete)
done
1200
UNSAT.
7
SAT.
331
?
9
? (TO)
853
shortsattime2011
2011-03-02
(incomplete)
done
1200
SAT.
422
?
9
? (TO)
762
? (?)
7
Sol
2011-04-04
(complete)
done
1200
UNSAT.
121
SAT.
154
? (TO)
915
? (MO)
9
? (?)
1
sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)
done
600
SAT.
343
? (TO)
257
STRUCTure
0.1
(complete)
done
1200
UNSAT.
91
SAT.
103
? (TO)
1006
STRUCTure
0.1 (hbr=2)
(complete)
done
1200
UNSAT.
91
SAT.
105
? (TO)
1004
synit_sat
2011-03-03
(complete)
done
1200
UNSAT.
176
SAT.
157
? (TO)
839
? (MO)
11
? (SIG)
16
WRONG UNSAT.
1
tts
5-4
(complete)
done
300
UNSAT.
17
SAT.
20
? (TO)
248
? (MO)
13
? (SIG)
2
ttsth
5-4
(complete)
done
300
UNSAT.
20
SAT.
26
?
10
? (TO)
239
? (MO)
3
? (SIG)
2
UmSat
2011-02-25 [DEPRECATED]
(complete)
done
1200
UNSAT.
76
SAT.
89
? (TO)
868
? (MO)
3
? (SIG)
163
ERR CERT
1
UmSat
2011-05-12 (fixed)
(complete)
done
600
UNSAT.
63
SAT.
96
? (TO)
435
? (MO)
2
? (SIG)
4