SAT 2009 Competition: main competition (phase 1): solvers page (tabular format, detailed results)

Some explanations

Category "applications instances" (APPLICATION)

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)UNKNOWN (abort)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.
adaptg2wsat2009
2009-03-23
(incomplete)		 29211
(3.77%)		 3
(1.03%)		 8
(2.74%)		 0
(0%)		 9
(3.08%)		 271
(92.81%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)
adaptg2wsat2009++
2009-03-23
(incomplete)		 29211
(3.77%)		 3
(1.03%)		 8
(2.74%)		 0
(0%)		 9
(3.08%)		 271
(92.81%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)
CircUs
2009-03-23
(complete)		 292144
(49.32%)		 85
(29.11%)		 59
(20.21%)		 0
(0%)		 0
(0%)		 146
(50%)		 1
(0.34%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
clasp
1.2.0-SAT09-32
(complete)		 292138
(47.26%)		 85
(29.11%)		 53
(18.15%)		 0
(0%)		 0
(0%)		 151
(51.71%)		 3
(1.03%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
CSat
2009-03-22
(complete)		 29291
(31.16%)		 51
(17.47%)		 40
(13.7%)		 0
(0%)		 0
(0%)		 200
(68.49%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
glucose
1.0
(complete)		 292152
(52.05%)		 98
(33.56%)		 54
(18.49%)		 0
(0%)		 0
(0%)		 139
(47.6%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
gnovelty+
2009-03-22
(incomplete)		 2927
(2.4%)		 0
(0%)		 7
(2.4%)		 0
(0%)		 0
(0%)		 269
(92.12%)		 0
(0%)		 16
(5.48%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
gnovelty+2
2009-03-22
(incomplete)		 2924
(1.37%)		 0
(0%)		 4
(1.37%)		 0
(0%)		 0
(0%)		 266
(91.1%)		 0
(0%)		 16
(5.48%)		 0
(0%)		 0
(0%)		 0
(0%)		 6
(2.05%)		 0
(0%)		 0
(0%)		 0
(0%)
gnovelty+2-H
2009-03-22
(incomplete)		 2924
(1.37%)		 0
(0%)		 4
(1.37%)		 0
(0%)		 0
(0%)		 267
(91.44%)		 0
(0%)		 16
(5.48%)		 0
(0%)		 0
(0%)		 0
(0%)		 4
(1.37%)		 0
(0%)		 1
(0.34%)		 0
(0%)
gNovelty+-T
2009-03-22
(incomplete)		 2927
(2.4%)		 0
(0%)		 7
(2.4%)		 0
(0%)		 0
(0%)		 251
(85.96%)		 0
(0%)		 16
(5.48%)		 0
(0%)		 0
(0%)		 0
(0%)		 18
(6.16%)		 0
(0%)		 0
(0%)		 0
(0%)
gNovelty+-V.2-T
2009-03-22
(incomplete)		 2924
(1.37%)		 0
(0%)		 4
(1.37%)		 0
(0%)		 0
(0%)		 261
(89.38%)		 0
(0%)		 15
(5.14%)		 0
(0%)		 0
(0%)		 0
(0%)		 9
(3.08%)		 0
(0%)		 3
(1.03%)		 0
(0%)
gNovelty+-V.2-T-H
2009-03-22
(incomplete)		 2924
(1.37%)		 0
(0%)		 4
(1.37%)		 0
(0%)		 0
(0%)		 261
(89.38%)		 0
(0%)		 15
(5.14%)		 0
(0%)		 0
(0%)		 0
(0%)		 10
(3.42%)		 0
(0%)		 2
(0.68%)		 0
(0%)
Hybrid2
2009-03-22
(incomplete)		 29212
(4.11%)		 1
(0.34%)		 11
(3.77%)		 0
(0%)		 9
(3.08%)		 264
(90.41%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 7
(2.4%)		 0
(0%)		 0
(0%)		 0
(0%)
hybridGM
1
(incomplete)		 2925
(1.71%)		 0
(0%)		 5
(1.71%)		 0
(0%)		 0
(0%)		 206
(70.55%)		 0
(0%)		 65
(22.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 16
(5.48%)		 0
(0%)		 0
(0%)		 0
(0%)
hybridGM3
3
(incomplete)		 2925
(1.71%)		 0
(0%)		 5
(1.71%)		 0
(0%)		 0
(0%)		 207
(70.89%)		 0
(0%)		 65
(22.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 15
(5.14%)		 0
(0%)		 0
(0%)		 0
(0%)
hybridGM7
7
(incomplete)		 2927
(2.4%)		 0
(0%)		 7
(2.4%)		 0
(0%)		 0
(0%)		 198
(67.81%)		 0
(0%)		 65
(22.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 22
(7.53%)		 0
(0%)		 0
(0%)		 0
(0%)
HydraSAT
2009-03-22-Base
(complete)		 292116
(39.73%)		 63
(21.58%)		 53
(18.15%)		 0
(0%)		 0
(0%)		 175
(59.93%)		 0
(0%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
HydraSAT-Flat
2009-03-22-Flat
(complete)		 292115
(39.38%)		 64
(21.92%)		 51
(17.47%)		 0
(0%)		 0
(0%)		 176
(60.27%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
HydraSAT-Multi
2009-03-22-Multi
(complete)		 292106
(36.3%)		 57
(19.52%)		 49
(16.78%)		 0
(0%)		 0
(0%)		 185
(63.36%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
iPAWS
2009-03-22
(incomplete)		 2928
(2.74%)		 0
(0%)		 8
(2.74%)		 0
(0%)		 85
(29.11%)		 199
(68.15%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
IUT_BMB_SAT
1.0
(complete)		 292116
(39.73%)		 70
(23.97%)		 46
(15.75%)		 0
(0%)		 0
(0%)		 167
(57.19%)		 9
(3.08%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
kw
2009-03-20
(complete)		 292150
(51.37%)		 92
(31.51%)		 58
(19.86%)		 0
(0%)		 0
(0%)		 134
(45.89%)		 8
(2.74%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
LySAT
c/2009-03-20
(complete)		 292123
(42.12%)		 72
(24.66%)		 51
(17.47%)		 0
(0%)		 0
(0%)		 162
(55.48%)		 3
(1.03%)		 4
(1.37%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
LySAT
i/2009-03-20
(complete)		 292153
(52.4%)		 96
(32.88%)		 57
(19.52%)		 0
(0%)		 0
(0%)		 134
(45.89%)		 1
(0.34%)		 4
(1.37%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ManySAT 1.1
aimd 0/2009-03-20
(complete)		 292149
(51.03%)		 95
(32.53%)		 54
(18.49%)		 0
(0%)		 0
(0%)		 138
(47.26%)		 1
(0.34%)		 4
(1.37%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ManySAT 1.1
aimd 1/2009-03-20
(complete)		 292149
(51.03%)		 95
(32.53%)		 54
(18.49%)		 0
(0%)		 0
(0%)		 138
(47.26%)		 1
(0.34%)		 4
(1.37%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ManySAT 1.1
aimd 2/2009-03-20
(complete)		 292145
(49.66%)		 94
(32.19%)		 51
(17.47%)		 0
(0%)		 0
(0%)		 142
(48.63%)		 1
(0.34%)		 4
(1.37%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
march_hi
hi
(complete)		 29221
(7.19%)		 12
(4.11%)		 9
(3.08%)		 0
(0%)		 0
(0%)		 247
(84.59%)		 23
(7.88%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)
march_nn
nn
(complete)		 29221
(7.19%)		 11
(3.77%)		 10
(3.42%)		 0
(0%)		 0
(0%)		 246
(84.25%)		 23
(7.88%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 2
(0.68%)		 0
(0%)		 0
(0%)		 0
(0%)
MiniSat
2.1 (Sat-race'08 Edition)
(complete)		 292155
(53.08%)		 90
(30.82%)		 65
(22.26%)		 0
(0%)		 0
(0%)		 136
(46.58%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
MiniSAT 09z
2009-03-22
(complete)		 292152
(52.05%)		 93
(31.85%)		 59
(20.21%)		 0
(0%)		 0
(0%)		 139
(47.6%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
minisat_cumr
p-2009-03-18
(complete)		 292141
(48.29%)		 83
(28.42%)		 58
(19.86%)		 0
(0%)		 0
(0%)		 150
(51.37%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
MoRsat
2009-03-03
(complete)		 292114
(39.04%)		 69
(23.63%)		 45
(15.41%)		 0
(0%)		 4
(1.37%)		 159
(54.45%)		 0
(0%)		 0
(0%)		 0
(0%)		 9
(3.08%)		 0
(0%)		 0
(0%)		 1
(0.34%)		 1
(0.34%)		 4
(1.37%)
MXC
2009-03-10
(complete)		 292147
(50.34%)		 85
(29.11%)		 62
(21.23%)		 0
(0%)		 1
(0.34%)		 144
(49.32%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
NCVWr
2009-03-22
(incomplete)		 29210
(3.42%)		 1
(0.34%)		 9
(3.08%)		 0
(0%)		 9
(3.08%)		 266
(91.1%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 7
(2.4%)		 0
(0%)		 0
(0%)		 0
(0%)
picosat
913
(complete)		 292139
(47.6%)		 76
(26.03%)		 63
(21.58%)		 0
(0%)		 0
(0%)		 153
(52.4%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
precosat
236
(complete)		 292164
(56.16%)		 99
(33.9%)		 65
(22.26%)		 0
(0%)		 0
(0%)		 125
(42.81%)		 2
(0.68%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)
Rsat
2009-03-22
(complete)		 292143
(48.97%)		 90
(30.82%)		 53
(18.15%)		 0
(0%)		 4
(1.37%)		 144
(49.32%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SApperloT
base
(complete)		 292129
(44.18%)		 74
(25.34%)		 55
(18.84%)		 0
(0%)		 0
(0%)		 163
(55.82%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SApperloT
hrp
(complete)		 292107
(36.64%)		 65
(22.26%)		 42
(14.38%)		 0
(0%)		 0
(0%)		 184
(63.01%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: picosat
535
(complete)		 292126
(43.15%)		 67
(22.95%)		 59
(20.21%)		 0
(0%)		 0
(0%)		 166
(56.85%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: Rsat
2007-02-08
(complete)		 292133
(45.55%)		 77
(26.37%)		 56
(19.18%)		 0
(0%)		 0
(0%)		 158
(54.11%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT4J CORE
2.1 RC1
(complete)		 29295
(32.53%)		 49
(16.78%)		 46
(15.75%)		 0
(0%)		 0
(0%)		 196
(67.12%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
satake
2009-03-22
(complete)		 29292
(31.51%)		 52
(17.81%)		 40
(13.7%)		 0
(0%)		 3
(1.03%)		 192
(65.75%)		 3
(1.03%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 2
(0.68%)		 0
(0%)		 0
(0%)
SATzilla2009_C
2009-03-22
(complete)		 292106
(36.3%)		 61
(20.89%)		 45
(15.41%)		 0
(0%)		 0
(0%)		 3
(1.03%)		 2
(0.68%)		 181
(61.99%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SATzilla2009_I
2009-03-22
(complete)		 292142
(48.63%)		 82
(28.08%)		 60
(20.55%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.34%)		 148
(50.68%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.34%)		 0
(0%)		 0
(0%)
SATzilla2009_R
2009-03-22
(complete)		 29259
(20.21%)		 23
(7.88%)		 36
(12.33%)		 0
(0%)		 0
(0%)		 2
(0.68%)		 3
(1.03%)		 228
(78.08%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
slstc
1.0
(incomplete)		 29210
(3.42%)		 1
(0.34%)		 9
(3.08%)		 0
(0%)		 0
(0%)		 279
(95.55%)		 3
(1.03%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
TNM
2009-03-22
(incomplete)		 2926
(2.05%)		 1
(0.34%)		 5
(1.71%)		 0
(0%)		 9
(3.08%)		 270
(92.47%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 7
(2.4%)		 0
(0%)		 0
(0%)		 0
(0%)
tts
tts-5-0
(complete)		 29210
(3.42%)		 4
(1.37%)		 6
(2.05%)		 0
(0%)		 47
(16.1%)		 86
(29.45%)		 81
(27.74%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 68
(23.29%)		 0
(0%)		 0
(0%)		 0
(0%)
ttsth-5-0
2009-03-19
(complete)		 2928
(2.74%)		 4
(1.37%)		 4
(1.37%)		 0
(0%)		 23
(7.88%)		 93
(31.85%)		 99
(33.9%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 69
(23.63%)		 0
(0%)		 0
(0%)		 0
(0%)
VARSAT-crafted
2009-03-22
(complete)		 29299
(33.9%)		 55
(18.84%)		 44
(15.07%)		 0
(0%)		 0
(0%)		 189
(64.73%)		 4
(1.37%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
VARSAT-industrial
2009-03-22
(complete)		 292110
(37.67%)		 61
(20.89%)		 49
(16.78%)		 0
(0%)		 0
(0%)		 179
(61.3%)		 3
(1.03%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
VARSAT-random
2009-03-22
(complete)		 29259
(20.21%)		 34
(11.64%)		 25
(8.56%)		 0
(0%)		 0
(0%)		 230
(78.77%)		 3
(1.03%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)

Solver NameProgress
adaptg2wsat2009
2009-03-23
(incomplete)
done
292
UNSAT.
3		SAT.
8		?
9		? (TO)
271		? (SIG)
1
adaptg2wsat2009++
2009-03-23
(incomplete)
done
292
UNSAT.
3		SAT.
8		?
9		? (TO)
271		? (SIG)
1
CircUs
2009-03-23
(complete)
done
292
UNSAT.
85		SAT.
59		? (TO)
146		? (MO)
1		? (EC)
1
clasp
1.2.0-SAT09-32
(complete)
done
292
UNSAT.
85		SAT.
53		? (TO)
151		? (MO)
3
CSat
2009-03-22
(complete)
done
292
UNSAT.
51		SAT.
40		? (TO)
200		? (MO)
1
glucose
1.0
(complete)
done
292
UNSAT.
98		SAT.
54		? (TO)
139		? (MO)
1
gnovelty+
2009-03-22
(incomplete)
done
292
SAT.
7		? (TO)
269		? (EC)
16
gnovelty+2
2009-03-22
(incomplete)
done
292
SAT.
4		? (TO)
266		? (EC)
16		? (SIG)
6
gnovelty+2-H
2009-03-22
(incomplete)
done
292
SAT.
4		? (TO)
267		? (EC)
16		? (SIG)
4		ERR CERT
1
gNovelty+-T
2009-03-22
(incomplete)
done
292
SAT.
7		? (TO)
251		? (EC)
16		? (SIG)
18
gNovelty+-V.2-T
2009-03-22
(incomplete)
done
292
SAT.
4		? (TO)
261		? (EC)
15		? (SIG)
9		ERR CERT
3
gNovelty+-V.2-T-H
2009-03-22
(incomplete)
done
292
SAT.
4		? (TO)
261		? (EC)
15		? (SIG)
10		ERR CERT
2
Hybrid2
2009-03-22
(incomplete)
done
292
UNSAT.
1		SAT.
11		?
9		? (TO)
264		? (SIG)
7
hybridGM
1
(incomplete)
done
292
SAT.
5		? (TO)
206		? (EC)
65		? (SIG)
16
hybridGM3
3
(incomplete)
done
292
SAT.
5		? (TO)
207		? (EC)
65		? (SIG)
15
hybridGM7
7
(incomplete)
done
292
SAT.
7		? (TO)
198		? (EC)
65		? (SIG)
22
HydraSAT
2009-03-22-Base
(complete)
done
292
UNSAT.
63		SAT.
53		? (TO)
175		? (EC)
1
HydraSAT-Flat
2009-03-22-Flat
(complete)
done
292
UNSAT.
64		SAT.
51		? (TO)
176		? (MO)
1
HydraSAT-Multi
2009-03-22-Multi
(complete)
done
292
UNSAT.
57		SAT.
49		? (TO)
185		? (MO)
1
iPAWS
2009-03-22
(incomplete)
done
292
SAT.
8		?
85		? (TO)
199
IUT_BMB_SAT
1.0
(complete)
done
292
UNSAT.
70		SAT.
46		? (TO)
167		? (MO)
9
kw
2009-03-20
(complete)
done
292
UNSAT.
92		SAT.
58		? (TO)
134		? (MO)
8
LySAT
c/2009-03-20
(complete)
done
292
UNSAT.
72		SAT.
51		? (TO)
162		? (MO)
3		? (EC)
4
LySAT
i/2009-03-20
(complete)
done
292
UNSAT.
96		SAT.
57		? (TO)
134		? (MO)
1		? (EC)
4
ManySAT 1.1
aimd 0/2009-03-20
(complete)
done
292
UNSAT.
95		SAT.
54		? (TO)
138		? (MO)
1		? (EC)
4
ManySAT 1.1
aimd 1/2009-03-20
(complete)
done
292
UNSAT.
95		SAT.
54		? (TO)
138		? (MO)
1		? (EC)
4
ManySAT 1.1
aimd 2/2009-03-20
(complete)
done
292
UNSAT.
94		SAT.
51		? (TO)
142		? (MO)
1		? (EC)
4
march_hi
hi
(complete)
done
292
UNSAT.
12		SAT.
9		? (TO)
247		? (MO)
23		? (SIG)
1
march_nn
nn
(complete)
done
292
UNSAT.
11		SAT.
10		? (TO)
246		? (MO)
23		? (SIG)
2
MiniSat
2.1 (Sat-race'08 Edition)
(complete)
done
292
UNSAT.
90		SAT.
65		? (TO)
136		? (MO)
1
MiniSAT 09z
2009-03-22
(complete)
done
292
UNSAT.
93		SAT.
59		? (TO)
139		? (MO)
1
minisat_cumr
p-2009-03-18
(complete)
done
292
UNSAT.
83		SAT.
58		? (TO)
150		? (MO)
1
MoRsat
2009-03-03
(complete)
done
292
UNSAT.
69		SAT.
45		?
4		? (TO)
159		? (?)
9		NO CERT.
1		ERR CERT
1		WRONG UNSAT.
4
MXC
2009-03-10
(complete)
done
292
UNSAT.
85		SAT.
62		?
1		? (TO)
144
NCVWr
2009-03-22
(incomplete)
done
292
UNSAT.
1		SAT.
9		?
9		? (TO)
266		? (SIG)
7
picosat
913
(complete)
done
292
UNSAT.
76		SAT.
63		? (TO)
153
precosat
236
(complete)
done
292
UNSAT.
99		SAT.
65		? (TO)
125		? (MO)
2		? (SIG)
1
Rsat
2009-03-22
(complete)
done
292
UNSAT.
90		SAT.
53		?
4		? (TO)
144		? (MO)
1
SApperloT
base
(complete)
done
292
UNSAT.
74		SAT.
55		? (TO)
163
SApperloT
hrp
(complete)
done
292
UNSAT.
65		SAT.
42		? (TO)
184		? (SIG)
1
SAT07 reference solver: picosat
535
(complete)
done
292
UNSAT.
67		SAT.
59		? (TO)
166
SAT07 reference solver: Rsat
2007-02-08
(complete)
done
292
UNSAT.
77		SAT.
56		? (TO)
158		? (MO)
1
SAT4J CORE
2.1 RC1
(complete)
done
292
UNSAT.
49		SAT.
46		? (TO)
196		? (MO)
1
satake
2009-03-22
(complete)
done
292
UNSAT.
52		SAT.
40		?
3		? (TO)
192		? (MO)
3		NO CERT.
2
SATzilla2009_C
2009-03-22
(complete)
done
292
UNSAT.
61		SAT.
45		? (TO)
3		? (MO)
2		? (EC)
181
SATzilla2009_I
2009-03-22
(complete)
done
292
UNSAT.
82		SAT.
60		? (MO)
1		? (EC)
148		NO CERT.
1
SATzilla2009_R
2009-03-22
(complete)
done
292
UNSAT.
23		SAT.
36		? (TO)
2		? (MO)
3		? (EC)
228
slstc
1.0
(incomplete)
done
292
UNSAT.
1		SAT.
9		? (TO)
279		? (MO)
3
TNM
2009-03-22
(incomplete)
done
292
UNSAT.
1		SAT.
5		?
9		? (TO)
270		? (SIG)
7
tts
tts-5-0
(complete)
done
292
UNSAT.
4		SAT.
6		?
47		? (TO)
86		? (MO)
81		? (SIG)
68
ttsth-5-0
2009-03-19
(complete)
done
292
UNSAT.
4		SAT.
4		?
23		? (TO)
93		? (MO)
99		? (SIG)
69
VARSAT-crafted
2009-03-22
(complete)
done
292
UNSAT.
55		SAT.
44		? (TO)
189		? (MO)
4
VARSAT-industrial
2009-03-22
(complete)
done
292
UNSAT.
61		SAT.
49		? (TO)
179		? (MO)
3
VARSAT-random
2009-03-22
(complete)
done
292
UNSAT.
34		SAT.
25		? (TO)
230		? (MO)
3

Category "crafted instances" (CRAFTED)

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)UNKNOWN (abort)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.
adaptg2wsat2009
2009-03-23
(incomplete)		 28170
(24.91%)		 2
(0.71%)		 68
(24.2%)		 0
(0%)		 0
(0%)		 211
(75.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
adaptg2wsat2009++
2009-03-23
(incomplete)		 28166
(23.49%)		 2
(0.71%)		 64
(22.78%)		 0
(0%)		 0
(0%)		 215
(76.51%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
CircUs
2009-03-23
(complete)		 281107
(38.08%)		 37
(13.17%)		 70
(24.91%)		 0
(0%)		 0
(0%)		 174
(61.92%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
clasp
1.2.0-SAT09-32
(complete)		 281131
(46.62%)		 53
(18.86%)		 78
(27.76%)		 0
(0%)		 0
(0%)		 150
(53.38%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
CSat
2009-03-22
(complete)		 28165
(23.13%)		 15
(5.34%)		 50
(17.79%)		 0
(0%)		 0
(0%)		 216
(76.87%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
glucose
1.0
(complete)		 281114
(40.57%)		 39
(13.88%)		 75
(26.69%)		 0
(0%)		 0
(0%)		 167
(59.43%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
gnovelty+
2009-03-22
(incomplete)		 28154
(19.22%)		 0
(0%)		 54
(19.22%)		 0
(0%)		 0
(0%)		 227
(80.78%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
gnovelty+2
2009-03-22
(incomplete)		 28146
(16.37%)		 2
(0.71%)		 44
(15.66%)		 0
(0%)		 0
(0%)		 214
(76.16%)		 10
(3.56%)		 7
(2.49%)		 0
(0%)		 0
(0%)		 0
(0%)		 4
(1.42%)		 0
(0%)		 0
(0%)		 0
(0%)
gnovelty+2-H
2009-03-22
(incomplete)		 28143
(15.3%)		 2
(0.71%)		 41
(14.59%)		 0
(0%)		 0
(0%)		 219
(77.94%)		 5
(1.78%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 8
(2.85%)		 0
(0%)		 6
(2.14%)		 0
(0%)
gNovelty+-T
2009-03-22
(incomplete)		 28153
(18.86%)		 0
(0%)		 53
(18.86%)		 0
(0%)		 0
(0%)		 228
(81.14%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
gNovelty+-V.2-T
2009-03-22
(incomplete)		 28150
(17.79%)		 2
(0.71%)		 48
(17.08%)		 0
(0%)		 0
(0%)		 213
(75.8%)		 3
(1.07%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 7
(2.49%)		 0
(0%)		 8
(2.85%)		 0
(0%)
gNovelty+-V.2-T-H
2009-03-22
(incomplete)		 28146
(16.37%)		 2
(0.71%)		 44
(15.66%)		 0
(0%)		 0
(0%)		 228
(81.14%)		 3
(1.07%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 3
(1.07%)		 0
(0%)		 1
(0.36%)		 0
(0%)
Hybrid2
2009-03-22
(incomplete)		 28166
(23.49%)		 0
(0%)		 66
(23.49%)		 0
(0%)		 0
(0%)		 215
(76.51%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
hybridGM
1
(incomplete)		 28151
(18.15%)		 0
(0%)		 51
(18.15%)		 0
(0%)		 0
(0%)		 201
(71.53%)		 0
(0%)		 22
(7.83%)		 0
(0%)		 0
(0%)		 0
(0%)		 7
(2.49%)		 0
(0%)		 0
(0%)		 0
(0%)
hybridGM3
3
(incomplete)		 28151
(18.15%)		 0
(0%)		 51
(18.15%)		 0
(0%)		 0
(0%)		 202
(71.89%)		 0
(0%)		 25
(8.9%)		 0
(0%)		 0
(0%)		 0
(0%)		 3
(1.07%)		 0
(0%)		 0
(0%)		 0
(0%)
hybridGM7
7
(incomplete)		 28138
(13.52%)		 0
(0%)		 38
(13.52%)		 0
(0%)		 0
(0%)		 159
(56.58%)		 0
(0%)		 44
(15.66%)		 0
(0%)		 0
(0%)		 0
(0%)		 40
(14.23%)		 0
(0%)		 0
(0%)		 0
(0%)
HydraSAT
2009-03-22-Base
(complete)		 28199
(35.23%)		 33
(11.74%)		 66
(23.49%)		 0
(0%)		 0
(0%)		 182
(64.77%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
HydraSAT-Flat
2009-03-22-Flat
(complete)		 281102
(36.3%)		 32
(11.39%)		 70
(24.91%)		 0
(0%)		 0
(0%)		 179
(63.7%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
HydraSAT-Multi
2009-03-22-Multi
(complete)		 281103
(36.65%)		 33
(11.74%)		 70
(24.91%)		 0
(0%)		 0
(0%)		 178
(63.35%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
iPAWS
2009-03-22
(incomplete)		 28171
(25.27%)		 0
(0%)		 71
(25.27%)		 0
(0%)		 0
(0%)		 208
(74.02%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 2
(0.71%)		 0
(0%)		 0
(0%)		 0
(0%)
IUT_BMB_SAT
1.0
(complete)		 281120
(42.7%)		 44
(15.66%)		 76
(27.05%)		 0
(0%)		 0
(0%)		 160
(56.94%)		 1
(0.36%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
kw
2009-03-20
(complete)		 281106
(37.72%)		 34
(12.1%)		 72
(25.62%)		 0
(0%)		 0
(0%)		 175
(62.28%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
LySAT
c/2009-03-20
(complete)		 281112
(39.86%)		 42
(14.95%)		 70
(24.91%)		 0
(0%)		 0
(0%)		 168
(59.79%)		 1
(0.36%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
LySAT
i/2009-03-20
(complete)		 281100
(35.59%)		 31
(11.03%)		 69
(24.56%)		 0
(0%)		 0
(0%)		 180
(64.06%)		 0
(0%)		 1
(0.36%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ManySAT 1.1
aimd 0/2009-03-20
(complete)		 28199
(35.23%)		 28
(9.96%)		 71
(25.27%)		 0
(0%)		 0
(0%)		 180
(64.06%)		 0
(0%)		 1
(0.36%)		 0
(0%)		 1
(0.36%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ManySAT 1.1
aimd 1/2009-03-20
(complete)		 281103
(36.65%)		 31
(11.03%)		 72
(25.62%)		 0
(0%)		 0
(0%)		 177
(62.99%)		 0
(0%)		 1
(0.36%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ManySAT 1.1
aimd 2/2009-03-20
(complete)		 28199
(35.23%)		 29
(10.32%)		 70
(24.91%)		 0
(0%)		 0
(0%)		 180
(64.06%)		 0
(0%)		 1
(0.36%)		 0
(0%)		 1
(0.36%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
march_hi
hi
(complete)		 28163
(22.42%)		 18
(6.41%)		 45
(16.01%)		 0
(0%)		 0
(0%)		 214
(76.16%)		 3
(1.07%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.36%)		 0
(0%)		 0
(0%)		 0
(0%)
march_nn
nn
(complete)		 28158
(20.64%)		 15
(5.34%)		 43
(15.3%)		 0
(0%)		 0
(0%)		 219
(77.94%)		 3
(1.07%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.36%)		 0
(0%)		 0
(0%)		 0
(0%)
MiniSat
2.1 (Sat-race'08 Edition)
(complete)		 281114
(40.57%)		 40
(14.23%)		 74
(26.33%)		 0
(0%)		 0
(0%)		 167
(59.43%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
MiniSAT 09z
2009-03-22
(complete)		 28199
(35.23%)		 27
(9.61%)		 72
(25.62%)		 0
(0%)		 0
(0%)		 181
(64.41%)		 0
(0%)		 1
(0.36%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
minisat_cumr
p-2009-03-18
(complete)		 281102
(36.3%)		 27
(9.61%)		 75
(26.69%)		 0
(0%)		 0
(0%)		 178
(63.35%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.36%)		 0
(0%)		 0
(0%)
MoRsat
2009-03-03
(complete)		 28193
(33.1%)		 30
(10.68%)		 63
(22.42%)		 0
(0%)		 0
(0%)		 176
(62.63%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 12
(4.27%)		 0
(0%)		 0
(0%)		 0
(0%)
MXC
2009-03-10
(complete)		 281124
(44.13%)		 44
(15.66%)		 80
(28.47%)		 0
(0%)		 0
(0%)		 157
(55.87%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
NCVWr
2009-03-22
(incomplete)		 28148
(17.08%)		 0
(0%)		 48
(17.08%)		 0
(0%)		 0
(0%)		 233
(82.92%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
picosat
913
(complete)		 281112
(39.86%)		 32
(11.39%)		 80
(28.47%)		 0
(0%)		 0
(0%)		 169
(60.14%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
precosat
236
(complete)		 281122
(43.42%)		 41
(14.59%)		 81
(28.83%)		 0
(0%)		 0
(0%)		 159
(56.58%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
Rsat
2009-03-22
(complete)		 281105
(37.37%)		 34
(12.1%)		 71
(25.27%)		 0
(0%)		 0
(0%)		 176
(62.63%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SApperloT
base
(complete)		 281113
(40.21%)		 40
(14.23%)		 73
(25.98%)		 0
(0%)		 0
(0%)		 168
(59.79%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SApperloT
hrp
(complete)		 281102
(36.3%)		 33
(11.74%)		 69
(24.56%)		 0
(0%)		 0
(0%)		 179
(63.7%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: March KS
2007-02-08
(complete)		 28161
(21.71%)		 19
(6.76%)		 42
(14.95%)		 0
(0%)		 0
(0%)		 210
(74.73%)		 3
(1.07%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 7
(2.49%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: minisat
SAT 2007
(complete)		 281119
(42.35%)		 43
(15.3%)		 76
(27.05%)		 0
(0%)		 0
(0%)		 162
(57.65%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: SATzilla
CRAFTED
(complete)		 281114
(40.57%)		 32
(11.39%)		 82
(29.18%)		 0
(0%)		 5
(1.78%)		 15
(5.34%)		 0
(0%)		 147
(52.31%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT4J CORE
2.1 RC1
(complete)		 28171
(25.27%)		 21
(7.47%)		 50
(17.79%)		 0
(0%)		 0
(0%)		 210
(74.73%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
satake
2009-03-22
(complete)		 28175
(26.69%)		 20
(7.12%)		 55
(19.57%)		 0
(0%)		 0
(0%)		 201
(71.53%)		 0
(0%)		 2
(0.71%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 3
(1.07%)		 0
(0%)		 0
(0%)
SATzilla2009_C
2009-03-22
(complete)		 281125
(44.48%)		 52
(18.51%)		 73
(25.98%)		 0
(0%)		 0
(0%)		 1
(0.36%)		 0
(0%)		 155
(55.16%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SATzilla2009_I
2009-03-22
(complete)		 281128
(45.55%)		 42
(14.95%)		 86
(30.6%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 153
(54.45%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SATzilla2009_R
2009-03-22
(complete)		 281104
(37.01%)		 26
(9.25%)		 78
(27.76%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 177
(62.99%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
slstc
1.0
(incomplete)		 28133
(11.74%)		 0
(0%)		 33
(11.74%)		 0
(0%)		 0
(0%)		 248
(88.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
TNM
2009-03-22
(incomplete)		 28162
(22.06%)		 0
(0%)		 62
(22.06%)		 0
(0%)		 0
(0%)		 219
(77.94%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
tts
tts-5-0
(complete)		 28146
(16.37%)		 21
(7.47%)		 25
(8.9%)		 0
(0%)		 48
(17.08%)		 124
(44.13%)		 60
(21.35%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 3
(1.07%)		 0
(0%)		 0
(0%)		 0
(0%)
ttsth-5-0
2009-03-19
(complete)		 28146
(16.37%)		 22
(7.83%)		 24
(8.54%)		 0
(0%)		 33
(11.74%)		 122
(43.42%)		 76
(27.05%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 4
(1.42%)		 0
(0%)		 0
(0%)		 0
(0%)
VARSAT-crafted
2009-03-22
(complete)		 281102
(36.3%)		 41
(14.59%)		 61
(21.71%)		 0
(0%)		 0
(0%)		 179
(63.7%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
VARSAT-industrial
2009-03-22
(complete)		 281113
(40.21%)		 40
(14.23%)		 73
(25.98%)		 0
(0%)		 0
(0%)		 168
(59.79%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
VARSAT-random
2009-03-22
(complete)		 28184
(29.89%)		 37
(13.17%)		 47
(16.73%)		 0
(0%)		 0
(0%)		 197
(70.11%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)

Solver NameProgress
adaptg2wsat2009
2009-03-23
(incomplete)
done
281
UNSAT.
2		SAT.
68		? (TO)
211
adaptg2wsat2009++
2009-03-23
(incomplete)
done
281
UNSAT.
2		SAT.
64		? (TO)
215
CircUs
2009-03-23
(complete)
done
281
UNSAT.
37		SAT.
70		? (TO)
174
clasp
1.2.0-SAT09-32
(complete)
done
281
UNSAT.
53		SAT.
78		? (TO)
150
CSat
2009-03-22
(complete)
done
281
UNSAT.
15		SAT.
50		? (TO)
216
glucose
1.0
(complete)
done
281
UNSAT.
39		SAT.
75		? (TO)
167
gnovelty+
2009-03-22
(incomplete)
done
281
SAT.
54		? (TO)
227
gnovelty+2
2009-03-22
(incomplete)
done
281
UNSAT.
2		SAT.
44		? (TO)
214		? (MO)
10		? (EC)
7		? (SIG)
4
gnovelty+2-H
2009-03-22
(incomplete)
done
281
UNSAT.
2		SAT.
41		? (TO)
219		? (MO)
5		? (SIG)
8		ERR CERT
6
gNovelty+-T
2009-03-22
(incomplete)
done
281
SAT.
53		? (TO)
228
gNovelty+-V.2-T
2009-03-22
(incomplete)
done
281
UNSAT.
2		SAT.
48		? (TO)
213		? (MO)
3		? (SIG)
7		ERR CERT
8
gNovelty+-V.2-T-H
2009-03-22
(incomplete)
done
281
UNSAT.
2		SAT.
44		? (TO)
228		? (MO)
3		? (SIG)
3		ERR CERT
1
Hybrid2
2009-03-22
(incomplete)
done
281
SAT.
66		? (TO)
215
hybridGM
1
(incomplete)
done
281
SAT.
51		? (TO)
201		? (EC)
22		? (SIG)
7
hybridGM3
3
(incomplete)
done
281
SAT.
51		? (TO)
202		? (EC)
25		? (SIG)
3
hybridGM7
7
(incomplete)
done
281
SAT.
38		? (TO)
159		? (EC)
44		? (SIG)
40
HydraSAT
2009-03-22-Base
(complete)
done
281
UNSAT.
33		SAT.
66		? (TO)
182
HydraSAT-Flat
2009-03-22-Flat
(complete)
done
281
UNSAT.
32		SAT.
70		? (TO)
179
HydraSAT-Multi
2009-03-22-Multi
(complete)
done
281
UNSAT.
33		SAT.
70		? (TO)
178
iPAWS
2009-03-22
(incomplete)
done
281
SAT.
71		? (TO)
208		? (SIG)
2
IUT_BMB_SAT
1.0
(complete)
done
281
UNSAT.
44		SAT.
76		? (TO)
160		? (MO)
1
kw
2009-03-20
(complete)
done
281
UNSAT.
34		SAT.
72		? (TO)
175
LySAT
c/2009-03-20
(complete)
done
281
UNSAT.
42		SAT.
70		? (TO)
168		? (MO)
1
LySAT
i/2009-03-20
(complete)
done
281
UNSAT.
31		SAT.
69		? (TO)
180		? (EC)
1
ManySAT 1.1
aimd 0/2009-03-20
(complete)
done
281
UNSAT.
28		SAT.
71		? (TO)
180		? (EC)
1		? (?)
1
ManySAT 1.1
aimd 1/2009-03-20
(complete)
done
281
UNSAT.
31		SAT.
72		? (TO)
177		? (EC)
1
ManySAT 1.1
aimd 2/2009-03-20
(complete)
done
281
UNSAT.
29		SAT.
70		? (TO)
180		? (EC)
1		? (?)
1
march_hi
hi
(complete)
done
281
UNSAT.
18		SAT.
45		? (TO)
214		? (MO)
3		? (SIG)
1
march_nn
nn
(complete)
done
281
UNSAT.
15		SAT.
43		? (TO)
219		? (MO)
3		? (SIG)
1
MiniSat
2.1 (Sat-race'08 Edition)
(complete)
done
281
UNSAT.
40		SAT.
74		? (TO)
167
MiniSAT 09z
2009-03-22
(complete)
done
281
UNSAT.
27		SAT.
72		? (TO)
181		? (EC)
1
minisat_cumr
p-2009-03-18
(complete)
done
281
UNSAT.
27		SAT.
75		? (TO)
178		NO CERT.
1
MoRsat
2009-03-03
(complete)
done
281
UNSAT.
30		SAT.
63		? (TO)
176		? (SIG)
12
MXC
2009-03-10
(complete)
done
281
UNSAT.
44		SAT.
80		? (TO)
157
NCVWr
2009-03-22
(incomplete)
done
281
SAT.
48		? (TO)
233
picosat
913
(complete)
done
281
UNSAT.
32		SAT.
80		? (TO)
169
precosat
236
(complete)
done
281
UNSAT.
41		SAT.
81		? (TO)
159
Rsat
2009-03-22
(complete)
done
281
UNSAT.
34		SAT.
71		? (TO)
176
SApperloT
base
(complete)
done
281
UNSAT.
40		SAT.
73		? (TO)
168
SApperloT
hrp
(complete)
done
281
UNSAT.
33		SAT.
69		? (TO)
179
SAT07 reference solver: March KS
2007-02-08
(complete)
done
281
UNSAT.
19		SAT.
42		? (TO)
210		? (MO)
3		? (SIG)
7
SAT07 reference solver: minisat
SAT 2007
(complete)
done
281
UNSAT.
43		SAT.
76		? (TO)
162
SAT07 reference solver: SATzilla
CRAFTED
(complete)
done
281
UNSAT.
32		SAT.
82		?
5		? (TO)
15		? (EC)
147
SAT4J CORE
2.1 RC1
(complete)
done
281
UNSAT.
21		SAT.
50		? (TO)
210
satake
2009-03-22
(complete)
done
281
UNSAT.
20		SAT.
55		? (TO)
201		? (EC)
2		NO CERT.
3
SATzilla2009_C
2009-03-22
(complete)
done
281
UNSAT.
52		SAT.
73		? (TO)
1		? (EC)
155
SATzilla2009_I
2009-03-22
(complete)
done
281
UNSAT.
42		SAT.
86		? (EC)
153
SATzilla2009_R
2009-03-22
(complete)
done
281
UNSAT.
26		SAT.
78		? (EC)
177
slstc
1.0
(incomplete)
done
281
SAT.
33		? (TO)
248
TNM
2009-03-22
(incomplete)
done
281
SAT.
62		? (TO)
219
tts
tts-5-0
(complete)
done
281
UNSAT.
21		SAT.
25		?
48		? (TO)
124		? (MO)
60		? (SIG)
3
ttsth-5-0
2009-03-19
(complete)
done
281
UNSAT.
22		SAT.
24		?
33		? (TO)
122		? (MO)
76		? (SIG)
4
VARSAT-crafted
2009-03-22
(complete)
done
281
UNSAT.
41		SAT.
61		? (TO)
179
VARSAT-industrial
2009-03-22
(complete)
done
281
UNSAT.
40		SAT.
73		? (TO)
168
VARSAT-random
2009-03-22
(complete)
done
281
UNSAT.
37		SAT.
47		? (TO)
197

Category "random instances" (RANDOM)

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)UNKNOWN (abort)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.
adaptg2wsat2009
2009-03-23
(incomplete)		 570294
(51.58%)		 0
(0%)		 294
(51.58%)		 0
(0%)		 0
(0%)		 276
(48.42%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
adaptg2wsat2009++
2009-03-23
(incomplete)		 570297
(52.11%)		 0
(0%)		 297
(52.11%)		 0
(0%)		 0
(0%)		 273
(47.89%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
CircUs
2009-03-23
(complete)		 5708
(1.4%)		 0
(0%)		 8
(1.4%)		 0
(0%)		 0
(0%)		 562
(98.6%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
clasp
1.2.0-SAT09-32
(complete)		 57084
(14.74%)		 18
(3.16%)		 66
(11.58%)		 0
(0%)		 0
(0%)		 486
(85.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
CSat
2009-03-22
(complete)		 5706
(1.05%)		 0
(0%)		 6
(1.05%)		 0
(0%)		 0
(0%)		 564
(98.95%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
glucose
1.0
(complete)		 57017
(2.98%)		 0
(0%)		 17
(2.98%)		 0
(0%)		 0
(0%)		 553
(97.02%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
gnovelty+
2009-03-22
(incomplete)		 570281
(49.3%)		 0
(0%)		 281
(49.3%)		 0
(0%)		 0
(0%)		 289
(50.7%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
gnovelty+2
2009-03-22
(incomplete)		 570305
(53.51%)		 0
(0%)		 305
(53.51%)		 0
(0%)		 0
(0%)		 265
(46.49%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
gnovelty+2-H
2009-03-22
(incomplete)		 570305
(53.51%)		 0
(0%)		 305
(53.51%)		 0
(0%)		 0
(0%)		 265
(46.49%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
gNovelty+-T
2009-03-22
(incomplete)		 570266
(46.67%)		 0
(0%)		 266
(46.67%)		 0
(0%)		 0
(0%)		 304
(53.33%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
gNovelty+-V.2-T
2009-03-22
(incomplete)		 570304
(53.33%)		 0
(0%)		 304
(53.33%)		 0
(0%)		 0
(0%)		 266
(46.67%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
gNovelty+-V.2-T-H
2009-03-22
(incomplete)		 570287
(50.35%)		 0
(0%)		 287
(50.35%)		 0
(0%)		 0
(0%)		 283
(49.65%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
Hybrid2
2009-03-22
(incomplete)		 570290
(50.88%)		 0
(0%)		 290
(50.88%)		 0
(0%)		 0
(0%)		 280
(49.12%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
hybridGM
1
(incomplete)		 570294
(51.58%)		 0
(0%)		 294
(51.58%)		 0
(0%)		 0
(0%)		 270
(47.37%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 6
(1.05%)		 0
(0%)		 0
(0%)		 0
(0%)
hybridGM3
3
(incomplete)		 570299
(52.46%)		 0
(0%)		 299
(52.46%)		 0
(0%)		 0
(0%)		 266
(46.67%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 5
(0.88%)		 0
(0%)		 0
(0%)		 0
(0%)
hybridGM7
7
(incomplete)		 570298
(52.28%)		 0
(0%)		 298
(52.28%)		 0
(0%)		 0
(0%)		 222
(38.95%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 50
(8.77%)		 0
(0%)		 0
(0%)		 0
(0%)
HydraSAT
2009-03-22-Base
(complete)		 57013
(2.28%)		 0
(0%)		 13
(2.28%)		 0
(0%)		 0
(0%)		 557
(97.72%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
HydraSAT-Flat
2009-03-22-Flat
(complete)		 57016
(2.81%)		 1
(0.18%)		 15
(2.63%)		 0
(0%)		 0
(0%)		 554
(97.19%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
HydraSAT-Multi
2009-03-22-Multi
(complete)		 57016
(2.81%)		 0
(0%)		 16
(2.81%)		 0
(0%)		 0
(0%)		 554
(97.19%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
iPAWS
2009-03-22
(incomplete)		 570258
(45.26%)		 0
(0%)		 258
(45.26%)		 0
(0%)		 0
(0%)		 312
(54.74%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
IUT_BMB_SAT
1.0
(complete)		 57063
(11.05%)		 13
(2.28%)		 50
(8.77%)		 0
(0%)		 0
(0%)		 507
(88.95%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
kw
2009-03-20
(complete)		 5704
(0.7%)		 0
(0%)		 4
(0.7%)		 0
(0%)		 0
(0%)		 566
(99.3%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
LySAT
c/2009-03-20
(complete)		 57060
(10.53%)		 12
(2.11%)		 48
(8.42%)		 0
(0%)		 0
(0%)		 510
(89.47%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
LySAT
i/2009-03-20
(complete)		 5706
(1.05%)		 0
(0%)		 6
(1.05%)		 0
(0%)		 0
(0%)		 564
(98.95%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ManySAT 1.1
aimd 0/2009-03-20
(complete)		 5707
(1.23%)		 0
(0%)		 7
(1.23%)		 0
(0%)		 0
(0%)		 563
(98.77%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ManySAT 1.1
aimd 1/2009-03-20
(complete)		 5705
(0.88%)		 0
(0%)		 5
(0.88%)		 0
(0%)		 0
(0%)		 565
(99.12%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ManySAT 1.1
aimd 2/2009-03-20
(complete)		 5706
(1.05%)		 0
(0%)		 6
(1.05%)		 0
(0%)		 0
(0%)		 564
(98.95%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
march_hi
hi
(complete)		 570247
(43.33%)		 100
(17.54%)		 147
(25.79%)		 0
(0%)		 0
(0%)		 323
(56.67%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
march_nn
nn
(complete)		 570243
(42.63%)		 98
(17.19%)		 145
(25.44%)		 0
(0%)		 0
(0%)		 327
(57.37%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
MiniSat
2.1 (Sat-race'08 Edition)
(complete)		 57041
(7.19%)		 4
(0.7%)		 37
(6.49%)		 0
(0%)		 0
(0%)		 529
(92.81%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
MiniSAT 09z
2009-03-22
(complete)		 5703
(0.53%)		 0
(0%)		 3
(0.53%)		 0
(0%)		 0
(0%)		 567
(99.47%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
minisat_cumr
p-2009-03-18
(complete)		 57029
(5.09%)		 0
(0%)		 29
(5.09%)		 0
(0%)		 0
(0%)		 541
(94.91%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
MoRsat
2009-03-03
(complete)		 570212
(37.19%)		 22
(3.86%)		 190
(33.33%)		 0
(0%)		 0
(0%)		 358
(62.81%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
MXC
2009-03-10
(complete)		 57061
(10.7%)		 11
(1.93%)		 50
(8.77%)		 0
(0%)		 0
(0%)		 509
(89.3%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
NCVWr
2009-03-22
(incomplete)		 570278
(48.77%)		 0
(0%)		 278
(48.77%)		 0
(0%)		 0
(0%)		 292
(51.23%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
picosat
913
(complete)		 57079
(13.86%)		 22
(3.86%)		 57
(10%)		 0
(0%)		 0
(0%)		 491
(86.14%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
precosat
236
(complete)		 57027
(4.74%)		 2
(0.35%)		 25
(4.39%)		 0
(0%)		 0
(0%)		 543
(95.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
Rsat
2009-03-22
(complete)		 5705
(0.88%)		 0
(0%)		 5
(0.88%)		 0
(0%)		 0
(0%)		 565
(99.12%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SApperloT
base
(complete)		 57070
(12.28%)		 17
(2.98%)		 53
(9.3%)		 0
(0%)		 0
(0%)		 500
(87.72%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SApperloT
hrp
(complete)		 57017
(2.98%)		 4
(0.7%)		 13
(2.28%)		 0
(0%)		 0
(0%)		 553
(97.02%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: adaptg2wsat+
2007-02-08
(incomplete)		 570265
(46.49%)		 0
(0%)		 265
(46.49%)		 0
(0%)		 0
(0%)		 305
(53.51%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: gnovelty+
2007-02-08
(incomplete)		 570272
(47.72%)		 0
(0%)		 272
(47.72%)		 0
(0%)		 0
(0%)		 298
(52.28%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: March KS
2007-02-08
(complete)		 570239
(41.93%)		 90
(15.79%)		 149
(26.14%)		 0
(0%)		 0
(0%)		 327
(57.37%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 4
(0.7%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: SATzilla
RANDOM
(complete)		 570268
(47.02%)		 91
(15.96%)		 177
(31.05%)		 0
(0%)		 31
(5.44%)		 28
(4.91%)		 0
(0%)		 243
(42.63%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT4J CORE
2.1 RC1
(complete)		 5704
(0.7%)		 0
(0%)		 4
(0.7%)		 0
(0%)		 0
(0%)		 566
(99.3%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
satake
2009-03-22
(complete)		 57024
(4.21%)		 0
(0%)		 24
(4.21%)		 0
(0%)		 5
(0.88%)		 541
(94.91%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SATzilla2009_C
2009-03-22
(complete)		 57073
(12.81%)		 12
(2.11%)		 61
(10.7%)		 0
(0%)		 0
(0%)		 19
(3.33%)		 0
(0%)		 478
(83.86%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SATzilla2009_I
2009-03-22
(complete)		 570145
(25.44%)		 55
(9.65%)		 90
(15.79%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 425
(74.56%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SATzilla2009_R
2009-03-22
(complete)		 570365
(64.04%)		 66
(11.58%)		 299
(52.46%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 205
(35.96%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
slstc
1.0
(incomplete)		 570118
(20.7%)		 0
(0%)		 118
(20.7%)		 0
(0%)		 0
(0%)		 452
(79.3%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
TNM
2009-03-22
(incomplete)		 570317
(55.61%)		 0
(0%)		 317
(55.61%)		 0
(0%)		 0
(0%)		 253
(44.39%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
tts
tts-5-0
(complete)		 5700
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 83
(14.56%)		 487
(85.44%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ttsth-5-0
2009-03-19
(complete)		 5700
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 51
(8.95%)		 512
(89.82%)		 7
(1.23%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
VARSAT-crafted
2009-03-22
(complete)		 57070
(12.28%)		 10
(1.75%)		 60
(10.53%)		 0
(0%)		 0
(0%)		 500
(87.72%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
VARSAT-industrial
2009-03-22
(complete)		 57071
(12.46%)		 10
(1.75%)		 61
(10.7%)		 0
(0%)		 0
(0%)		 499
(87.54%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
VARSAT-random
2009-03-22
(complete)		 57083
(14.56%)		 11
(1.93%)		 72
(12.63%)		 0
(0%)		 0
(0%)		 487
(85.44%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)

Solver NameProgress
adaptg2wsat2009
2009-03-23
(incomplete)
done
570
SAT.
294		? (TO)
276
adaptg2wsat2009++
2009-03-23
(incomplete)
done
570
SAT.
297		? (TO)
273
CircUs
2009-03-23
(complete)
done
570
SAT.
8		? (TO)
562
clasp
1.2.0-SAT09-32
(complete)
done
570
UNSAT.
18		SAT.
66		? (TO)
486
CSat
2009-03-22
(complete)
done
570
SAT.
6		? (TO)
564
glucose
1.0
(complete)
done
570
SAT.
17		? (TO)
553
gnovelty+
2009-03-22
(incomplete)
done
570
SAT.
281		? (TO)
289
gnovelty+2
2009-03-22
(incomplete)
done
570
SAT.
305		? (TO)
265
gnovelty+2-H
2009-03-22
(incomplete)
done
570
SAT.
305		? (TO)
265
gNovelty+-T
2009-03-22
(incomplete)
done
570
SAT.
266		? (TO)
304
gNovelty+-V.2-T
2009-03-22
(incomplete)
done
570
SAT.
304		? (TO)
266
gNovelty+-V.2-T-H
2009-03-22
(incomplete)
done
570
SAT.
287		? (TO)
283
Hybrid2
2009-03-22
(incomplete)
done
570
SAT.
290		? (TO)
280
hybridGM
1
(incomplete)
done
570
SAT.
294		? (TO)
270		? (SIG)
6
hybridGM3
3
(incomplete)
done
570
SAT.
299		? (TO)
266		? (SIG)
5
hybridGM7
7
(incomplete)
done
570
SAT.
298		? (TO)
222		? (SIG)
50
HydraSAT
2009-03-22-Base
(complete)
done
570
SAT.
13		? (TO)
557
HydraSAT-Flat
2009-03-22-Flat
(complete)
done
570
UNSAT.
1		SAT.
15		? (TO)
554
HydraSAT-Multi
2009-03-22-Multi
(complete)
done
570
SAT.
16		? (TO)
554
iPAWS
2009-03-22
(incomplete)
done
570
SAT.
258		? (TO)
312
IUT_BMB_SAT
1.0
(complete)
done
570
UNSAT.
13		SAT.
50		? (TO)
507
kw
2009-03-20
(complete)
done
570
SAT.
4		? (TO)
566
LySAT
c/2009-03-20
(complete)
done
570
UNSAT.
12		SAT.
48		? (TO)
510
LySAT
i/2009-03-20
(complete)
done
570
SAT.
6		? (TO)
564
ManySAT 1.1
aimd 0/2009-03-20
(complete)
done
570
SAT.
7		? (TO)
563
ManySAT 1.1
aimd 1/2009-03-20
(complete)
done
570
SAT.
5		? (TO)
565
ManySAT 1.1
aimd 2/2009-03-20
(complete)
done
570
SAT.
6		? (TO)
564
march_hi
hi
(complete)
done
570
UNSAT.
100		SAT.
147		? (TO)
323
march_nn
nn
(complete)
done
570
UNSAT.
98		SAT.
145		? (TO)
327
MiniSat
2.1 (Sat-race'08 Edition)
(complete)
done
570
UNSAT.
4		SAT.
37		? (TO)
529
MiniSAT 09z
2009-03-22
(complete)
done
570
SAT.
3		? (TO)
567
minisat_cumr
p-2009-03-18
(complete)
done
570
SAT.
29		? (TO)
541
MoRsat
2009-03-03
(complete)
done
570
UNSAT.
22		SAT.
190		? (TO)
358
MXC
2009-03-10
(complete)
done
570
UNSAT.
11		SAT.
50		? (TO)
509
NCVWr
2009-03-22
(incomplete)
done
570
SAT.
278		? (TO)
292
picosat
913
(complete)
done
570
UNSAT.
22		SAT.
57		? (TO)
491
precosat
236
(complete)
done
570
UNSAT.
2		SAT.
25		? (TO)
543
Rsat
2009-03-22
(complete)
done
570
SAT.
5		? (TO)
565
SApperloT
base
(complete)
done
570
UNSAT.
17		SAT.
53		? (TO)
500
SApperloT
hrp
(complete)
done
570
UNSAT.
4		SAT.
13		? (TO)
553
SAT07 reference solver: adaptg2wsat+
2007-02-08
(incomplete)
done
570
SAT.
265		? (TO)
305
SAT07 reference solver: gnovelty+
2007-02-08
(incomplete)
done
570
SAT.
272		? (TO)
298
SAT07 reference solver: March KS
2007-02-08
(complete)
done
570
UNSAT.
90		SAT.
149		? (TO)
327		? (SIG)
4
SAT07 reference solver: SATzilla
RANDOM
(complete)
done
570
UNSAT.
91		SAT.
177		?
31		? (TO)
28		? (EC)
243
SAT4J CORE
2.1 RC1
(complete)
done
570
SAT.
4		? (TO)
566
satake
2009-03-22
(complete)
done
570
SAT.
24		?
5		? (TO)
541
SATzilla2009_C
2009-03-22
(complete)
done
570
UNSAT.
12		SAT.
61		? (TO)
19		? (EC)
478
SATzilla2009_I
2009-03-22
(complete)
done
570
UNSAT.
55		SAT.
90		? (EC)
425
SATzilla2009_R
2009-03-22
(complete)
done
570
UNSAT.
66		SAT.
299		? (EC)
205
slstc
1.0
(incomplete)
done
570
SAT.
118		? (TO)
452
TNM
2009-03-22
(incomplete)
done
570
SAT.
317		? (TO)
253
tts
tts-5-0
(complete)
done
570
?
83		? (TO)
487
ttsth-5-0
2009-03-19
(complete)
done
570
?
51		? (TO)
512		? (MO)
7
VARSAT-crafted
2009-03-22
(complete)
done
570
UNSAT.
10		SAT.
60		? (TO)
500
VARSAT-industrial
2009-03-22
(complete)
done
570
UNSAT.
10		SAT.
61		? (TO)
499
VARSAT-random
2009-03-22
(complete)
done
570
UNSAT.
11		SAT.
72		? (TO)
487

All categories for solvers registered in all categories

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)UNKNOWN (abort)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.
adaptg2wsat2009
2009-03-23
(incomplete)		 1143375
(32.81%)		 5
(0.44%)		 370
(32.37%)		 0
(0%)		 9
(0.79%)		 758
(66.32%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)
adaptg2wsat2009++
2009-03-23
(incomplete)		 1143374
(32.72%)		 5
(0.44%)		 369
(32.28%)		 0
(0%)		 9
(0.79%)		 759
(66.4%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)
CircUs
2009-03-23
(complete)		 1143259
(22.66%)		 122
(10.67%)		 137
(11.99%)		 0
(0%)		 0
(0%)		 882
(77.17%)		 1
(0.09%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
clasp
1.2.0-SAT09-32
(complete)		 1143353
(30.88%)		 156
(13.65%)		 197
(17.24%)		 0
(0%)		 0
(0%)		 787
(68.85%)		 3
(0.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
CSat
2009-03-22
(complete)		 1143162
(14.17%)		 66
(5.77%)		 96
(8.4%)		 0
(0%)		 0
(0%)		 980
(85.74%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
glucose
1.0
(complete)		 1143283
(24.76%)		 137
(11.99%)		 146
(12.77%)		 0
(0%)		 0
(0%)		 859
(75.15%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
gnovelty+
2009-03-22
(incomplete)		 1143342
(29.92%)		 0
(0%)		 342
(29.92%)		 0
(0%)		 0
(0%)		 785
(68.68%)		 0
(0%)		 16
(1.4%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
gnovelty+2
2009-03-22
(incomplete)		 1143355
(31.06%)		 2
(0.17%)		 353
(30.88%)		 0
(0%)		 0
(0%)		 745
(65.18%)		 10
(0.87%)		 23
(2.01%)		 0
(0%)		 0
(0%)		 0
(0%)		 10
(0.87%)		 0
(0%)		 0
(0%)		 0
(0%)
gnovelty+2-H
2009-03-22
(incomplete)		 1143352
(30.8%)		 2
(0.17%)		 350
(30.62%)		 0
(0%)		 0
(0%)		 751
(65.7%)		 5
(0.44%)		 16
(1.4%)		 0
(0%)		 0
(0%)		 0
(0%)		 12
(1.05%)		 0
(0%)		 7
(0.61%)		 0
(0%)
gNovelty+-T
2009-03-22
(incomplete)		 1143326
(28.52%)		 0
(0%)		 326
(28.52%)		 0
(0%)		 0
(0%)		 783
(68.5%)		 0
(0%)		 16
(1.4%)		 0
(0%)		 0
(0%)		 0
(0%)		 18
(1.57%)		 0
(0%)		 0
(0%)		 0
(0%)
gNovelty+-V.2-T
2009-03-22
(incomplete)		 1143358
(31.32%)		 2
(0.17%)		 356
(31.15%)		 0
(0%)		 0
(0%)		 740
(64.74%)		 3
(0.26%)		 15
(1.31%)		 0
(0%)		 0
(0%)		 0
(0%)		 16
(1.4%)		 0
(0%)		 11
(0.96%)		 0
(0%)
gNovelty+-V.2-T-H
2009-03-22
(incomplete)		 1143337
(29.48%)		 2
(0.17%)		 335
(29.31%)		 0
(0%)		 0
(0%)		 772
(67.54%)		 3
(0.26%)		 15
(1.31%)		 0
(0%)		 0
(0%)		 0
(0%)		 13
(1.14%)		 0
(0%)		 3
(0.26%)		 0
(0%)
Hybrid2
2009-03-22
(incomplete)		 1143368
(32.2%)		 1
(0.09%)		 367
(32.11%)		 0
(0%)		 9
(0.79%)		 759
(66.4%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 7
(0.61%)		 0
(0%)		 0
(0%)		 0
(0%)
hybridGM
1
(incomplete)		 1143350
(30.62%)		 0
(0%)		 350
(30.62%)		 0
(0%)		 0
(0%)		 677
(59.23%)		 0
(0%)		 87
(7.61%)		 0
(0%)		 0
(0%)		 0
(0%)		 29
(2.54%)		 0
(0%)		 0
(0%)		 0
(0%)
hybridGM3
3
(incomplete)		 1143355
(31.06%)		 0
(0%)		 355
(31.06%)		 0
(0%)		 0
(0%)		 675
(59.06%)		 0
(0%)		 90
(7.87%)		 0
(0%)		 0
(0%)		 0
(0%)		 23
(2.01%)		 0
(0%)		 0
(0%)		 0
(0%)
hybridGM7
7
(incomplete)		 1143343
(30.01%)		 0
(0%)		 343
(30.01%)		 0
(0%)		 0
(0%)		 579
(50.66%)		 0
(0%)		 109
(9.54%)		 0
(0%)		 0
(0%)		 0
(0%)		 112
(9.8%)		 0
(0%)		 0
(0%)		 0
(0%)
HydraSAT
2009-03-22-Base
(complete)		 1143228
(19.95%)		 96
(8.4%)		 132
(11.55%)		 0
(0%)		 0
(0%)		 914
(79.97%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
HydraSAT-Flat
2009-03-22-Flat
(complete)		 1143233
(20.38%)		 97
(8.49%)		 136
(11.9%)		 0
(0%)		 0
(0%)		 909
(79.53%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
HydraSAT-Multi
2009-03-22-Multi
(complete)		 1143225
(19.69%)		 90
(7.87%)		 135
(11.81%)		 0
(0%)		 0
(0%)		 917
(80.23%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
iPAWS
2009-03-22
(incomplete)		 1143337
(29.48%)		 0
(0%)		 337
(29.48%)		 0
(0%)		 85
(7.44%)		 719
(62.9%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 2
(0.17%)		 0
(0%)		 0
(0%)		 0
(0%)
IUT_BMB_SAT
1.0
(complete)		 1143299
(26.16%)		 127
(11.11%)		 172
(15.05%)		 0
(0%)		 0
(0%)		 834
(72.97%)		 10
(0.87%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
kw
2009-03-20
(complete)		 1143260
(22.75%)		 126
(11.02%)		 134
(11.72%)		 0
(0%)		 0
(0%)		 875
(76.55%)		 8
(0.7%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
LySAT
c/2009-03-20
(complete)		 1143295
(25.81%)		 126
(11.02%)		 169
(14.79%)		 0
(0%)		 0
(0%)		 840
(73.49%)		 4
(0.35%)		 4
(0.35%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
LySAT
i/2009-03-20
(complete)		 1143259
(22.66%)		 127
(11.11%)		 132
(11.55%)		 0
(0%)		 0
(0%)		 878
(76.82%)		 1
(0.09%)		 5
(0.44%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ManySAT 1.1
aimd 0/2009-03-20
(complete)		 1143255
(22.31%)		 123
(10.76%)		 132
(11.55%)		 0
(0%)		 0
(0%)		 881
(77.08%)		 1
(0.09%)		 5
(0.44%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ManySAT 1.1
aimd 1/2009-03-20
(complete)		 1143257
(22.48%)		 126
(11.02%)		 131
(11.46%)		 0
(0%)		 0
(0%)		 880
(76.99%)		 1
(0.09%)		 5
(0.44%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ManySAT 1.1
aimd 2/2009-03-20
(complete)		 1143250
(21.87%)		 123
(10.76%)		 127
(11.11%)		 0
(0%)		 0
(0%)		 886
(77.52%)		 1
(0.09%)		 5
(0.44%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
march_hi
hi
(complete)		 1143331
(28.96%)		 130
(11.37%)		 201
(17.59%)		 0
(0%)		 0
(0%)		 784
(68.59%)		 26
(2.27%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 2
(0.17%)		 0
(0%)		 0
(0%)		 0
(0%)
march_nn
nn
(complete)		 1143322
(28.17%)		 124
(10.85%)		 198
(17.32%)		 0
(0%)		 0
(0%)		 792
(69.29%)		 26
(2.27%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 3
(0.26%)		 0
(0%)		 0
(0%)		 0
(0%)
MiniSat
2.1 (Sat-race'08 Edition)
(complete)		 1143310
(27.12%)		 134
(11.72%)		 176
(15.4%)		 0
(0%)		 0
(0%)		 832
(72.79%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
MiniSAT 09z
2009-03-22
(complete)		 1143254
(22.22%)		 120
(10.5%)		 134
(11.72%)		 0
(0%)		 0
(0%)		 887
(77.6%)		 1
(0.09%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
minisat_cumr
p-2009-03-18
(complete)		 1143272
(23.8%)		 110
(9.62%)		 162
(14.17%)		 0
(0%)		 0
(0%)		 869
(76.03%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)
MoRsat
2009-03-03
(complete)		 1143419
(36.66%)		 121
(10.59%)		 298
(26.07%)		 0
(0%)		 4
(0.35%)		 693
(60.63%)		 0
(0%)		 0
(0%)		 0
(0%)		 9
(0.79%)		 0
(0%)		 12
(1.05%)		 1
(0.09%)		 1
(0.09%)		 4
(0.35%)
MXC
2009-03-10
(complete)		 1143332
(29.05%)		 140
(12.25%)		 192
(16.8%)		 0
(0%)		 1
(0.09%)		 810
(70.87%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
NCVWr
2009-03-22
(incomplete)		 1143336
(29.4%)		 1
(0.09%)		 335
(29.31%)		 0
(0%)		 9
(0.79%)		 791
(69.2%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 7
(0.61%)		 0
(0%)		 0
(0%)		 0
(0%)
picosat
913
(complete)		 1143330
(28.87%)		 130
(11.37%)		 200
(17.5%)		 0
(0%)		 0
(0%)		 813
(71.13%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
precosat
236
(complete)		 1143313
(27.38%)		 142
(12.42%)		 171
(14.96%)		 0
(0%)		 0
(0%)		 827
(72.35%)		 2
(0.17%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)
Rsat
2009-03-22
(complete)		 1143253
(22.13%)		 124
(10.85%)		 129
(11.29%)		 0
(0%)		 4
(0.35%)		 885
(77.43%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SApperloT
base
(complete)		 1143312
(27.3%)		 131
(11.46%)		 181
(15.84%)		 0
(0%)		 0
(0%)		 831
(72.7%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SApperloT
hrp
(complete)		 1143226
(19.77%)		 102
(8.92%)		 124
(10.85%)		 0
(0%)		 0
(0%)		 916
(80.14%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT4J CORE
2.1 RC1
(complete)		 1143170
(14.87%)		 70
(6.12%)		 100
(8.75%)		 0
(0%)		 0
(0%)		 972
(85.04%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
satake
2009-03-22
(complete)		 1143191
(16.71%)		 72
(6.3%)		 119
(10.41%)		 0
(0%)		 8
(0.7%)		 934
(81.71%)		 3
(0.26%)		 2
(0.17%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 5
(0.44%)		 0
(0%)		 0
(0%)
SATzilla2009_C
2009-03-22
(complete)		 1143304
(26.6%)		 125
(10.94%)		 179
(15.66%)		 0
(0%)		 0
(0%)		 23
(2.01%)		 2
(0.17%)		 814
(71.22%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SATzilla2009_I
2009-03-22
(complete)		 1143415
(36.31%)		 179
(15.66%)		 236
(20.65%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.09%)		 726
(63.52%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)
SATzilla2009_R
2009-03-22
(complete)		 1143528
(46.19%)		 115
(10.06%)		 413
(36.13%)		 0
(0%)		 0
(0%)		 2
(0.17%)		 3
(0.26%)		 610
(53.37%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
slstc
1.0
(incomplete)		 1143161
(14.09%)		 1
(0.09%)		 160
(14%)		 0
(0%)		 0
(0%)		 979
(85.65%)		 3
(0.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
TNM
2009-03-22
(incomplete)		 1143385
(33.68%)		 1
(0.09%)		 384
(33.6%)		 0
(0%)		 9
(0.79%)		 742
(64.92%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 7
(0.61%)		 0
(0%)		 0
(0%)		 0
(0%)
tts
tts-5-0
(complete)		 114356
(4.9%)		 25
(2.19%)		 31
(2.71%)		 0
(0%)		 178
(15.57%)		 697
(60.98%)		 141
(12.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 71
(6.21%)		 0
(0%)		 0
(0%)		 0
(0%)
ttsth-5-0
2009-03-19
(complete)		 114354
(4.72%)		 26
(2.27%)		 28
(2.45%)		 0
(0%)		 107
(9.36%)		 727
(63.6%)		 182
(15.92%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 73
(6.39%)		 0
(0%)		 0
(0%)		 0
(0%)
VARSAT-crafted
2009-03-22
(complete)		 1143271
(23.71%)		 106
(9.27%)		 165
(14.44%)		 0
(0%)		 0
(0%)		 868
(75.94%)		 4
(0.35%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
VARSAT-industrial
2009-03-22
(complete)		 1143294
(25.72%)		 111
(9.71%)		 183
(16.01%)		 0
(0%)		 0
(0%)		 846
(74.02%)		 3
(0.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
VARSAT-random
2009-03-22
(complete)		 1143226
(19.77%)		 82
(7.17%)		 144
(12.6%)		 0
(0%)		 0
(0%)		 914
(79.97%)		 3
(0.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)

Solver NameProgress
adaptg2wsat2009
2009-03-23
(incomplete)
done
1143
UNSAT.
5		SAT.
370		?
9		? (TO)
758		? (SIG)
1
adaptg2wsat2009++
2009-03-23
(incomplete)
done
1143
UNSAT.
5		SAT.
369		?
9		? (TO)
759		? (SIG)
1
CircUs
2009-03-23
(complete)
done
1143
UNSAT.
122		SAT.
137		? (TO)
882		? (MO)
1		? (EC)
1
clasp
1.2.0-SAT09-32
(complete)
done
1143
UNSAT.
156		SAT.
197		? (TO)
787		? (MO)
3
CSat
2009-03-22
(complete)
done
1143
UNSAT.
66		SAT.
96		? (TO)
980		? (MO)
1
glucose
1.0
(complete)
done
1143
UNSAT.
137		SAT.
146		? (TO)
859		? (MO)
1
gnovelty+
2009-03-22
(incomplete)
done
1143
SAT.
342		? (TO)
785		? (EC)
16
gnovelty+2
2009-03-22
(incomplete)
done
1143
UNSAT.
2		SAT.
353		? (TO)
745		? (MO)
10		? (EC)
23		? (SIG)
10
gnovelty+2-H
2009-03-22
(incomplete)
done
1143
UNSAT.
2		SAT.
350		? (TO)
751		? (MO)
5		? (EC)
16		? (SIG)
12		ERR CERT
7
gNovelty+-T
2009-03-22
(incomplete)
done
1143
SAT.
326		? (TO)
783		? (EC)
16		? (SIG)
18
gNovelty+-V.2-T
2009-03-22
(incomplete)
done
1143
UNSAT.
2		SAT.
356		? (TO)
740		? (MO)
3		? (EC)
15		? (SIG)
16		ERR CERT
11
gNovelty+-V.2-T-H
2009-03-22
(incomplete)
done
1143
UNSAT.
2		SAT.
335		? (TO)
772		? (MO)
3		? (EC)
15		? (SIG)
13		ERR CERT
3
Hybrid2
2009-03-22
(incomplete)
done
1143
UNSAT.
1		SAT.
367		?
9		? (TO)
759		? (SIG)
7
hybridGM
1
(incomplete)
done
1143
SAT.
350		? (TO)
677		? (EC)
87		? (SIG)
29
hybridGM3
3
(incomplete)
done
1143
SAT.
355		? (TO)
675		? (EC)
90		? (SIG)
23
hybridGM7
7
(incomplete)
done
1143
SAT.
343		? (TO)
579		? (EC)
109		? (SIG)
112
HydraSAT
2009-03-22-Base
(complete)
done
1143
UNSAT.
96		SAT.
132		? (TO)
914		? (EC)
1
HydraSAT-Flat
2009-03-22-Flat
(complete)
done
1143
UNSAT.
97		SAT.
136		? (TO)
909		? (MO)
1
HydraSAT-Multi
2009-03-22-Multi
(complete)
done
1143
UNSAT.
90		SAT.
135		? (TO)
917		? (MO)
1
iPAWS
2009-03-22
(incomplete)
done
1143
SAT.
337		?
85		? (TO)
719		? (SIG)
2
IUT_BMB_SAT
1.0
(complete)
done
1143
UNSAT.
127		SAT.
172		? (TO)
834		? (MO)
10
kw
2009-03-20
(complete)
done
1143
UNSAT.
126		SAT.
134		? (TO)
875		? (MO)
8
LySAT
c/2009-03-20
(complete)
done
1143
UNSAT.
126		SAT.
169		? (TO)
840		? (MO)
4		? (EC)
4
LySAT
i/2009-03-20
(complete)
done
1143
UNSAT.
127		SAT.
132		? (TO)
878		? (MO)
1		? (EC)
5
ManySAT 1.1
aimd 0/2009-03-20
(complete)
done
1143
UNSAT.
123		SAT.
132		? (TO)
881		? (MO)
1		? (EC)
5		? (?)
1
ManySAT 1.1
aimd 1/2009-03-20
(complete)
done
1143
UNSAT.
126		SAT.
131		? (TO)
880		? (MO)
1		? (EC)
5
ManySAT 1.1
aimd 2/2009-03-20
(complete)
done
1143
UNSAT.
123		SAT.
127		? (TO)
886		? (MO)
1		? (EC)
5		? (?)
1
march_hi
hi
(complete)
done
1143
UNSAT.
130		SAT.
201		? (TO)
784		? (MO)
26		? (SIG)
2
march_nn
nn
(complete)
done
1143
UNSAT.
124		SAT.
198		? (TO)
792		? (MO)
26		? (SIG)
3
MiniSat
2.1 (Sat-race'08 Edition)
(complete)
done
1143
UNSAT.
134		SAT.
176		? (TO)
832		? (MO)
1
MiniSAT 09z
2009-03-22
(complete)
done
1143
UNSAT.
120		SAT.
134		? (TO)
887		? (MO)
1		? (EC)
1
minisat_cumr
p-2009-03-18
(complete)
done
1143
UNSAT.
110		SAT.
162		? (TO)
869		? (MO)
1		NO CERT.
1
MoRsat
2009-03-03
(complete)
done
1143
UNSAT.
121		SAT.
298		?
4		? (TO)
693		? (?)
9		? (SIG)
12		NO CERT.
1		ERR CERT
1		WRONG UNSAT.
4
MXC
2009-03-10
(complete)
done
1143
UNSAT.
140		SAT.
192		?
1		? (TO)
810
NCVWr
2009-03-22
(incomplete)
done
1143
UNSAT.
1		SAT.
335		?
9		? (TO)
791		? (SIG)
7
picosat
913
(complete)
done
1143
UNSAT.
130		SAT.
200		? (TO)
813
precosat
236
(complete)
done
1143
UNSAT.
142		SAT.
171		? (TO)
827		? (MO)
2		? (SIG)
1
Rsat
2009-03-22
(complete)
done
1143
UNSAT.
124		SAT.
129		?
4		? (TO)
885		? (MO)
1
SApperloT
base
(complete)
done
1143
UNSAT.
131		SAT.
181		? (TO)
831
SApperloT
hrp
(complete)
done
1143
UNSAT.
102		SAT.
124		? (TO)
916		? (SIG)
1
SAT4J CORE
2.1 RC1
(complete)
done
1143
UNSAT.
70		SAT.
100		? (TO)
972		? (MO)
1
satake
2009-03-22
(complete)
done
1143
UNSAT.
72		SAT.
119		?
8		? (TO)
934		? (MO)
3		? (EC)
2		NO CERT.
5
SATzilla2009_C
2009-03-22
(complete)
done
1143
UNSAT.
125		SAT.
179		? (TO)
23		? (MO)
2		? (EC)
814
SATzilla2009_I
2009-03-22
(complete)
done
1143
UNSAT.
179		SAT.
236		? (MO)
1		? (EC)
726		NO CERT.
1
SATzilla2009_R
2009-03-22
(complete)
done
1143
UNSAT.
115		SAT.
413		? (TO)
2		? (MO)
3		? (EC)
610
slstc
1.0
(incomplete)
done
1143
UNSAT.
1		SAT.
160		? (TO)
979		? (MO)
3
TNM
2009-03-22
(incomplete)
done
1143
UNSAT.
1		SAT.
384		?
9		? (TO)
742		? (SIG)
7
tts
tts-5-0
(complete)
done
1143
UNSAT.
25		SAT.
31		?
178		? (TO)
697		? (MO)
141		? (SIG)
71
ttsth-5-0
2009-03-19
(complete)
done
1143
UNSAT.
26		SAT.
28		?
107		? (TO)
727		? (MO)
182		? (SIG)
73
VARSAT-crafted
2009-03-22
(complete)
done
1143
UNSAT.
106		SAT.
165		? (TO)
868		? (MO)
4
VARSAT-industrial
2009-03-22
(complete)
done
1143
UNSAT.
111		SAT.
183		? (TO)
846		? (MO)
3
VARSAT-random
2009-03-22
(complete)
done
1143
UNSAT.
82		SAT.
144		? (TO)
914		? (MO)
3

All categories and all solvers (regardless of their ability to support all categories)

This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)UNKNOWN (abort)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.
adaptg2wsat2009
2009-03-23
(incomplete)		 1143375
(32.81%)		 5
(0.44%)		 370
(32.37%)		 0
(0%)		 9
(0.79%)		 758
(66.32%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)
adaptg2wsat2009++
2009-03-23
(incomplete)		 1143374
(32.72%)		 5
(0.44%)		 369
(32.28%)		 0
(0%)		 9
(0.79%)		 759
(66.4%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)
CircUs
2009-03-23
(complete)		 1143259
(22.66%)		 122
(10.67%)		 137
(11.99%)		 0
(0%)		 0
(0%)		 882
(77.17%)		 1
(0.09%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
clasp
1.2.0-SAT09-32
(complete)		 1143353
(30.88%)		 156
(13.65%)		 197
(17.24%)		 0
(0%)		 0
(0%)		 787
(68.85%)		 3
(0.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
CSat
2009-03-22
(complete)		 1143162
(14.17%)		 66
(5.77%)		 96
(8.4%)		 0
(0%)		 0
(0%)		 980
(85.74%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
glucose
1.0
(complete)		 1143283
(24.76%)		 137
(11.99%)		 146
(12.77%)		 0
(0%)		 0
(0%)		 859
(75.15%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
gnovelty+
2009-03-22
(incomplete)		 1143342
(29.92%)		 0
(0%)		 342
(29.92%)		 0
(0%)		 0
(0%)		 785
(68.68%)		 0
(0%)		 16
(1.4%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
gnovelty+2
2009-03-22
(incomplete)		 1143355
(31.06%)		 2
(0.17%)		 353
(30.88%)		 0
(0%)		 0
(0%)		 745
(65.18%)		 10
(0.87%)		 23
(2.01%)		 0
(0%)		 0
(0%)		 0
(0%)		 10
(0.87%)		 0
(0%)		 0
(0%)		 0
(0%)
gnovelty+2-H
2009-03-22
(incomplete)		 1143352
(30.8%)		 2
(0.17%)		 350
(30.62%)		 0
(0%)		 0
(0%)		 751
(65.7%)		 5
(0.44%)		 16
(1.4%)		 0
(0%)		 0
(0%)		 0
(0%)		 12
(1.05%)		 0
(0%)		 7
(0.61%)		 0
(0%)
gNovelty+-T
2009-03-22
(incomplete)		 1143326
(28.52%)		 0
(0%)		 326
(28.52%)		 0
(0%)		 0
(0%)		 783
(68.5%)		 0
(0%)		 16
(1.4%)		 0
(0%)		 0
(0%)		 0
(0%)		 18
(1.57%)		 0
(0%)		 0
(0%)		 0
(0%)
gNovelty+-V.2-T
2009-03-22
(incomplete)		 1143358
(31.32%)		 2
(0.17%)		 356
(31.15%)		 0
(0%)		 0
(0%)		 740
(64.74%)		 3
(0.26%)		 15
(1.31%)		 0
(0%)		 0
(0%)		 0
(0%)		 16
(1.4%)		 0
(0%)		 11
(0.96%)		 0
(0%)
gNovelty+-V.2-T-H
2009-03-22
(incomplete)		 1143337
(29.48%)		 2
(0.17%)		 335
(29.31%)		 0
(0%)		 0
(0%)		 772
(67.54%)		 3
(0.26%)		 15
(1.31%)		 0
(0%)		 0
(0%)		 0
(0%)		 13
(1.14%)		 0
(0%)		 3
(0.26%)		 0
(0%)
Hybrid2
2009-03-22
(incomplete)		 1143368
(32.2%)		 1
(0.09%)		 367
(32.11%)		 0
(0%)		 9
(0.79%)		 759
(66.4%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 7
(0.61%)		 0
(0%)		 0
(0%)		 0
(0%)
hybridGM
1
(incomplete)		 1143350
(30.62%)		 0
(0%)		 350
(30.62%)		 0
(0%)		 0
(0%)		 677
(59.23%)		 0
(0%)		 87
(7.61%)		 0
(0%)		 0
(0%)		 0
(0%)		 29
(2.54%)		 0
(0%)		 0
(0%)		 0
(0%)
hybridGM3
3
(incomplete)		 1143355
(31.06%)		 0
(0%)		 355
(31.06%)		 0
(0%)		 0
(0%)		 675
(59.06%)		 0
(0%)		 90
(7.87%)		 0
(0%)		 0
(0%)		 0
(0%)		 23
(2.01%)		 0
(0%)		 0
(0%)		 0
(0%)
hybridGM7
7
(incomplete)		 1143343
(30.01%)		 0
(0%)		 343
(30.01%)		 0
(0%)		 0
(0%)		 579
(50.66%)		 0
(0%)		 109
(9.54%)		 0
(0%)		 0
(0%)		 0
(0%)		 112
(9.8%)		 0
(0%)		 0
(0%)		 0
(0%)
HydraSAT
2009-03-22-Base
(complete)		 1143228
(19.95%)		 96
(8.4%)		 132
(11.55%)		 0
(0%)		 0
(0%)		 914
(79.97%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
HydraSAT-Flat
2009-03-22-Flat
(complete)		 1143233
(20.38%)		 97
(8.49%)		 136
(11.9%)		 0
(0%)		 0
(0%)		 909
(79.53%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
HydraSAT-Multi
2009-03-22-Multi
(complete)		 1143225
(19.69%)		 90
(7.87%)		 135
(11.81%)		 0
(0%)		 0
(0%)		 917
(80.23%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
iPAWS
2009-03-22
(incomplete)		 1143337
(29.48%)		 0
(0%)		 337
(29.48%)		 0
(0%)		 85
(7.44%)		 719
(62.9%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 2
(0.17%)		 0
(0%)		 0
(0%)		 0
(0%)
IUT_BMB_SAT
1.0
(complete)		 1143299
(26.16%)		 127
(11.11%)		 172
(15.05%)		 0
(0%)		 0
(0%)		 834
(72.97%)		 10
(0.87%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
kw
2009-03-20
(complete)		 1143260
(22.75%)		 126
(11.02%)		 134
(11.72%)		 0
(0%)		 0
(0%)		 875
(76.55%)		 8
(0.7%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
LySAT
c/2009-03-20
(complete)		 1143295
(25.81%)		 126
(11.02%)		 169
(14.79%)		 0
(0%)		 0
(0%)		 840
(73.49%)		 4
(0.35%)		 4
(0.35%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
LySAT
i/2009-03-20
(complete)		 1143259
(22.66%)		 127
(11.11%)		 132
(11.55%)		 0
(0%)		 0
(0%)		 878
(76.82%)		 1
(0.09%)		 5
(0.44%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ManySAT 1.1
aimd 0/2009-03-20
(complete)		 1143255
(22.31%)		 123
(10.76%)		 132
(11.55%)		 0
(0%)		 0
(0%)		 881
(77.08%)		 1
(0.09%)		 5
(0.44%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ManySAT 1.1
aimd 1/2009-03-20
(complete)		 1143257
(22.48%)		 126
(11.02%)		 131
(11.46%)		 0
(0%)		 0
(0%)		 880
(76.99%)		 1
(0.09%)		 5
(0.44%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
ManySAT 1.1
aimd 2/2009-03-20
(complete)		 1143250
(21.87%)		 123
(10.76%)		 127
(11.11%)		 0
(0%)		 0
(0%)		 886
(77.52%)		 1
(0.09%)		 5
(0.44%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
march_hi
hi
(complete)		 1143331
(28.96%)		 130
(11.37%)		 201
(17.59%)		 0
(0%)		 0
(0%)		 784
(68.59%)		 26
(2.27%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 2
(0.17%)		 0
(0%)		 0
(0%)		 0
(0%)
march_nn
nn
(complete)		 1143322
(28.17%)		 124
(10.85%)		 198
(17.32%)		 0
(0%)		 0
(0%)		 792
(69.29%)		 26
(2.27%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 3
(0.26%)		 0
(0%)		 0
(0%)		 0
(0%)
MiniSat
2.1 (Sat-race'08 Edition)
(complete)		 1143310
(27.12%)		 134
(11.72%)		 176
(15.4%)		 0
(0%)		 0
(0%)		 832
(72.79%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
MiniSAT 09z
2009-03-22
(complete)		 1143254
(22.22%)		 120
(10.5%)		 134
(11.72%)		 0
(0%)		 0
(0%)		 887
(77.6%)		 1
(0.09%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
minisat_cumr
p-2009-03-18
(complete)		 1143272
(23.8%)		 110
(9.62%)		 162
(14.17%)		 0
(0%)		 0
(0%)		 869
(76.03%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)
MoRsat
2009-03-03
(complete)		 1143419
(36.66%)		 121
(10.59%)		 298
(26.07%)		 0
(0%)		 4
(0.35%)		 693
(60.63%)		 0
(0%)		 0
(0%)		 0
(0%)		 9
(0.79%)		 0
(0%)		 12
(1.05%)		 1
(0.09%)		 1
(0.09%)		 4
(0.35%)
MXC
2009-03-10
(complete)		 1143332
(29.05%)		 140
(12.25%)		 192
(16.8%)		 0
(0%)		 1
(0.09%)		 810
(70.87%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
NCVWr
2009-03-22
(incomplete)		 1143336
(29.4%)		 1
(0.09%)		 335
(29.31%)		 0
(0%)		 9
(0.79%)		 791
(69.2%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 7
(0.61%)		 0
(0%)		 0
(0%)		 0
(0%)
picosat
913
(complete)		 1143330
(28.87%)		 130
(11.37%)		 200
(17.5%)		 0
(0%)		 0
(0%)		 813
(71.13%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
precosat
236
(complete)		 1143313
(27.38%)		 142
(12.42%)		 171
(14.96%)		 0
(0%)		 0
(0%)		 827
(72.35%)		 2
(0.17%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)
Rsat
2009-03-22
(complete)		 1143253
(22.13%)		 124
(10.85%)		 129
(11.29%)		 0
(0%)		 4
(0.35%)		 885
(77.43%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SApperloT
base
(complete)		 1143312
(27.3%)		 131
(11.46%)		 181
(15.84%)		 0
(0%)		 0
(0%)		 831
(72.7%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SApperloT
hrp
(complete)		 1143226
(19.77%)		 102
(8.92%)		 124
(10.85%)		 0
(0%)		 0
(0%)		 916
(80.14%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: adaptg2wsat+
2007-02-08
(incomplete)		 570265
(46.49%)		 0
(0%)		 265
(46.49%)		 0
(0%)		 0
(0%)		 305
(53.51%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: gnovelty+
2007-02-08
(incomplete)		 570272
(47.72%)		 0
(0%)		 272
(47.72%)		 0
(0%)		 0
(0%)		 298
(52.28%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: March KS
2007-02-08
(complete)		 851300
(35.25%)		 109
(12.81%)		 191
(22.44%)		 0
(0%)		 0
(0%)		 537
(63.1%)		 3
(0.35%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 11
(1.29%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: minisat
SAT 2007
(complete)		 281119
(42.35%)		 43
(15.3%)		 76
(27.05%)		 0
(0%)		 0
(0%)		 162
(57.65%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: picosat
535
(complete)		 292126
(43.15%)		 67
(22.95%)		 59
(20.21%)		 0
(0%)		 0
(0%)		 166
(56.85%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: Rsat
2007-02-08
(complete)		 292133
(45.55%)		 77
(26.37%)		 56
(19.18%)		 0
(0%)		 0
(0%)		 158
(54.11%)		 1
(0.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: SATzilla
CRAFTED
(complete)		 281114
(40.57%)		 32
(11.39%)		 82
(29.18%)		 0
(0%)		 5
(1.78%)		 15
(5.34%)		 0
(0%)		 147
(52.31%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT07 reference solver: SATzilla
RANDOM
(complete)		 570268
(47.02%)		 91
(15.96%)		 177
(31.05%)		 0
(0%)		 31
(5.44%)		 28
(4.91%)		 0
(0%)		 243
(42.63%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SAT4J CORE
2.1 RC1
(complete)		 1143170
(14.87%)		 70
(6.12%)		 100
(8.75%)		 0
(0%)		 0
(0%)		 972
(85.04%)		 1
(0.09%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
satake
2009-03-22
(complete)		 1143191
(16.71%)		 72
(6.3%)		 119
(10.41%)		 0
(0%)		 8
(0.7%)		 934
(81.71%)		 3
(0.26%)		 2
(0.17%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 5
(0.44%)		 0
(0%)		 0
(0%)
SATzilla2009_C
2009-03-22
(complete)		 1143304
(26.6%)		 125
(10.94%)		 179
(15.66%)		 0
(0%)		 0
(0%)		 23
(2.01%)		 2
(0.17%)		 814
(71.22%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
SATzilla2009_I
2009-03-22
(complete)		 1143415
(36.31%)		 179
(15.66%)		 236
(20.65%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.09%)		 726
(63.52%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
(0%)
SATzilla2009_R
2009-03-22
(complete)		 1143528
(46.19%)		 115
(10.06%)		 413
(36.13%)		 0
(0%)		 0
(0%)		 2
(0.17%)		 3
(0.26%)		 610
(53.37%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
slstc
1.0
(incomplete)		 1143161
(14.09%)		 1
(0.09%)		 160
(14%)		 0
(0%)		 0
(0%)		 979
(85.65%)		 3
(0.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
TNM
2009-03-22
(incomplete)		 1143385
(33.68%)		 1
(0.09%)		 384
(33.6%)		 0
(0%)		 9
(0.79%)		 742
(64.92%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 7
(0.61%)		 0
(0%)		 0
(0%)		 0
(0%)
tts
tts-5-0
(complete)		 114356
(4.9%)		 25
(2.19%)		 31
(2.71%)		 0
(0%)		 178
(15.57%)		 697
(60.98%)		 141
(12.34%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 71
(6.21%)		 0
(0%)		 0
(0%)		 0
(0%)
ttsth-5-0
2009-03-19
(complete)		 114354
(4.72%)		 26
(2.27%)		 28
(2.45%)		 0
(0%)		 107
(9.36%)		 727
(63.6%)		 182
(15.92%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 73
(6.39%)		 0
(0%)		 0
(0%)		 0
(0%)
VARSAT-crafted
2009-03-22
(complete)		 1143271
(23.71%)		 106
(9.27%)		 165
(14.44%)		 0
(0%)		 0
(0%)		 868
(75.94%)		 4
(0.35%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
VARSAT-industrial
2009-03-22
(complete)		 1143294
(25.72%)		 111
(9.71%)		 183
(16.01%)		 0
(0%)		 0
(0%)		 846
(74.02%)		 3
(0.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)
VARSAT-random
2009-03-22
(complete)		 1143226
(19.77%)		 82
(7.17%)		 144
(12.6%)		 0
(0%)		 0
(0%)		 914
(79.97%)		 3
(0.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)

Solver NameProgress
adaptg2wsat2009
2009-03-23
(incomplete)
done
1143
UNSAT.
5		SAT.
370		?
9		? (TO)
758		? (SIG)
1
adaptg2wsat2009++
2009-03-23
(incomplete)
done
1143
UNSAT.
5		SAT.
369		?
9		? (TO)
759		? (SIG)
1
CircUs
2009-03-23
(complete)
done
1143
UNSAT.
122		SAT.
137		? (TO)
882		? (MO)
1		? (EC)
1
clasp
1.2.0-SAT09-32
(complete)
done
1143
UNSAT.
156		SAT.
197		? (TO)
787		? (MO)
3
CSat
2009-03-22
(complete)
done
1143
UNSAT.
66		SAT.
96		? (TO)
980		? (MO)
1
glucose
1.0
(complete)
done
1143
UNSAT.
137		SAT.
146		? (TO)
859		? (MO)
1
gnovelty+
2009-03-22
(incomplete)
done
1143
SAT.
342		? (TO)
785		? (EC)
16
gnovelty+2
2009-03-22
(incomplete)
done
1143
UNSAT.
2		SAT.
353		? (TO)
745		? (MO)
10		? (EC)
23		? (SIG)
10
gnovelty+2-H
2009-03-22
(incomplete)
done
1143
UNSAT.
2		SAT.
350		? (TO)
751		? (MO)
5		? (EC)
16		? (SIG)
12		ERR CERT
7
gNovelty+-T
2009-03-22
(incomplete)
done
1143
SAT.
326		? (TO)
783		? (EC)
16		? (SIG)
18
gNovelty+-V.2-T
2009-03-22
(incomplete)
done
1143
UNSAT.
2		SAT.
356		? (TO)
740		? (MO)
3		? (EC)
15		? (SIG)
16		ERR CERT
11
gNovelty+-V.2-T-H
2009-03-22
(incomplete)
done
1143
UNSAT.
2		SAT.
335		? (TO)
772		? (MO)
3		? (EC)
15		? (SIG)
13		ERR CERT
3
Hybrid2
2009-03-22
(incomplete)
done
1143
UNSAT.
1		SAT.
367		?
9		? (TO)
759		? (SIG)
7
hybridGM
1
(incomplete)
done
1143
SAT.
350		? (TO)
677		? (EC)
87		? (SIG)
29
hybridGM3
3
(incomplete)
done
1143
SAT.
355		? (TO)
675		? (EC)
90		? (SIG)
23
hybridGM7
7
(incomplete)
done
1143
SAT.
343		? (TO)
579		? (EC)
109		? (SIG)
112
HydraSAT
2009-03-22-Base
(complete)
done
1143
UNSAT.
96		SAT.
132		? (TO)
914		? (EC)
1
HydraSAT-Flat
2009-03-22-Flat
(complete)
done
1143
UNSAT.
97		SAT.
136		? (TO)
909		? (MO)
1
HydraSAT-Multi
2009-03-22-Multi
(complete)
done
1143
UNSAT.
90		SAT.
135		? (TO)
917		? (MO)
1
iPAWS
2009-03-22
(incomplete)
done
1143
SAT.
337		?
85		? (TO)
719		? (SIG)
2
IUT_BMB_SAT
1.0
(complete)
done
1143
UNSAT.
127		SAT.
172		? (TO)
834		? (MO)
10
kw
2009-03-20
(complete)
done
1143
UNSAT.
126		SAT.
134		? (TO)
875		? (MO)
8
LySAT
c/2009-03-20
(complete)
done
1143
UNSAT.
126		SAT.
169		? (TO)
840		? (MO)
4		? (EC)
4
LySAT
i/2009-03-20
(complete)
done
1143
UNSAT.
127		SAT.
132		? (TO)
878		? (MO)
1		? (EC)
5
ManySAT 1.1
aimd 0/2009-03-20
(complete)
done
1143
UNSAT.
123		SAT.
132		? (TO)
881		? (MO)
1		? (EC)
5		? (?)
1
ManySAT 1.1
aimd 1/2009-03-20
(complete)
done
1143
UNSAT.
126		SAT.
131		? (TO)
880		? (MO)
1		? (EC)
5
ManySAT 1.1
aimd 2/2009-03-20
(complete)
done
1143
UNSAT.
123		SAT.
127		? (TO)
886		? (MO)
1		? (EC)
5		? (?)
1
march_hi
hi
(complete)
done
1143
UNSAT.
130		SAT.
201		? (TO)
784		? (MO)
26		? (SIG)
2
march_nn
nn
(complete)
done
1143
UNSAT.
124		SAT.
198		? (TO)
792		? (MO)
26		? (SIG)
3
MiniSat
2.1 (Sat-race'08 Edition)
(complete)
done
1143
UNSAT.
134		SAT.
176		? (TO)
832		? (MO)
1
MiniSAT 09z
2009-03-22
(complete)
done
1143
UNSAT.
120		SAT.
134		? (TO)
887		? (MO)
1		? (EC)
1
minisat_cumr
p-2009-03-18
(complete)
done
1143
UNSAT.
110		SAT.
162		? (TO)
869		? (MO)
1		NO CERT.
1
MoRsat
2009-03-03
(complete)
done
1143
UNSAT.
121		SAT.
298		?
4		? (TO)
693		? (?)
9		? (SIG)
12		NO CERT.
1		ERR CERT
1		WRONG UNSAT.
4
MXC
2009-03-10
(complete)
done
1143
UNSAT.
140		SAT.
192		?
1		? (TO)
810
NCVWr
2009-03-22
(incomplete)
done
1143
UNSAT.
1		SAT.
335		?
9		? (TO)
791		? (SIG)
7
picosat
913
(complete)
done
1143
UNSAT.
130		SAT.
200		? (TO)
813
precosat
236
(complete)
done
1143
UNSAT.
142		SAT.
171		? (TO)
827		? (MO)
2		? (SIG)
1
Rsat
2009-03-22
(complete)
done
1143
UNSAT.
124		SAT.
129		?
4		? (TO)
885		? (MO)
1
SApperloT
base
(complete)
done
1143
UNSAT.
131		SAT.
181		? (TO)
831
SApperloT
hrp
(complete)
done
1143
UNSAT.
102		SAT.
124		? (TO)
916		? (SIG)
1
SAT07 reference solver: adaptg2wsat+
2007-02-08
(incomplete)
done
570
SAT.
265		? (TO)
305
SAT07 reference solver: gnovelty+
2007-02-08
(incomplete)
done
570
SAT.
272		? (TO)
298
SAT07 reference solver: March KS
2007-02-08
(complete)
done
851
UNSAT.
109		SAT.
191		? (TO)
537		? (MO)
3		? (SIG)
11
SAT07 reference solver: minisat
SAT 2007
(complete)
done
281
UNSAT.
43		SAT.
76		? (TO)
162
SAT07 reference solver: picosat
535
(complete)
done
292
UNSAT.
67		SAT.
59		? (TO)
166
SAT07 reference solver: Rsat
2007-02-08
(complete)
done
292
UNSAT.
77		SAT.
56		? (TO)
158		? (MO)
1
SAT07 reference solver: SATzilla
CRAFTED
(complete)
done
281
UNSAT.
32		SAT.
82		?
5		? (TO)
15		? (EC)
147
SAT07 reference solver: SATzilla
RANDOM
(complete)
done
570
UNSAT.
91		SAT.
177		?
31		? (TO)
28		? (EC)
243
SAT4J CORE
2.1 RC1
(complete)
done
1143
UNSAT.
70		SAT.
100		? (TO)
972		? (MO)
1
satake
2009-03-22
(complete)
done
1143
UNSAT.
72		SAT.
119		?
8		? (TO)
934		? (MO)
3		? (EC)
2		NO CERT.
5
SATzilla2009_C
2009-03-22
(complete)
done
1143
UNSAT.
125		SAT.
179		? (TO)
23		? (MO)
2		? (EC)
814
SATzilla2009_I
2009-03-22
(complete)
done
1143
UNSAT.
179		SAT.
236		? (MO)
1		? (EC)
726		NO CERT.
1
SATzilla2009_R
2009-03-22
(complete)
done
1143
UNSAT.
115		SAT.
413		? (TO)
2		? (MO)
3		? (EC)
610
slstc
1.0
(incomplete)
done
1143
UNSAT.
1		SAT.
160		? (TO)
979		? (MO)
3
TNM
2009-03-22
(incomplete)
done
1143
UNSAT.
1		SAT.
384		?
9		? (TO)
742		? (SIG)
7
tts
tts-5-0
(complete)
done
1143
UNSAT.
25		SAT.
31		?
178		? (TO)
697		? (MO)
141		? (SIG)
71
ttsth-5-0
2009-03-19
(complete)
done
1143
UNSAT.
26		SAT.
28		?
107		? (TO)
727		? (MO)
182		? (SIG)
73
VARSAT-crafted
2009-03-22
(complete)
done
1143
UNSAT.
106		SAT.
165		? (TO)
868		? (MO)
4
VARSAT-industrial
2009-03-22
(complete)
done
1143
UNSAT.
111		SAT.
183		? (TO)
846		? (MO)
3
VARSAT-random
2009-03-22
(complete)
done
1143
UNSAT.
82		SAT.
144		? (TO)
914		? (MO)
3