SAT 2011 Competition: main competition (phase 2): solvers page (tabular format, detailed results)

Some explanations

#Benchs: Number of benchs for this solver
Solved: Total number of solved instances (this is the sum of the SAT and UNSAT columns)
UNSAT.: solver proved unsatitisfiability ("s UNSATISFIABLE" was output)
SAT.: solver found a solution ("s SATISFIABLE" was output) and the provided implicant satisfies each constraint
SAT (timeout): solver exceeded the time limit but was able to find a solution ("s SATISFIABLE" was output) and the provided implicant satisfies each constraint
UNKNOWN: solver couldn't decide ("s UNKNOWN" was output)
UNKNOWN (timeout): solver exceeded the time limit and gave no answer. These runs are considered to give result UNKNOWN
UNKNOWN (out of mem.): solver exceeded the memory limit and gave no answer. These runs are considered to give result UNKNOWN.
UNKNOWN (exit code): solver didn't output a solution line and terminated with an unexpected exit code. These runs are considered to give result UNKNOWN.
UNKNOWN (conv. script): The conversion script failed to convert the instance. These runs are considered to give result UNKNOWN.
UNKNOWN (problem): No solution line was correctly recognized. These runs are considered to give result UNKNOWN.
UNKNOWN (abort): Solver was aborted by the user
Sig. Caught: solver was terminated by a signal (SIGSEGV for example) and didn't output a solution line
NO CERT.: solver answered SATISFIABLE but either didn't provide a certificate (the "v " line) or either gave a truncated certificate (which doesn't end in a new line)
WRONG CERT.: solver gave an implicant but it appears that it doesn't satisfy every constraint
WRONG UNSAT.: solver proved unsatisfiability but was wrong ("s UNSATISFIABLE" was output)

Category "applications instances" (APPLICATION)

Solver Name	#benchs	Solved	UNSAT.	SAT.	UNKNOWN	UNKNOWN (timeout)	UNKNOWN (out of mem.)	UNKNOWN (exit code)	UNKNOWN (problem)	Sig. Caught	WRONG CERT.
borg-sat 11.03.02-industrial [DEPRECATED] (complete)	300	196 (65.33%)	105 (35%)	91 (30.33%)	0 (0%)	57 (19%)	37 (12.33%)	10 (3.33%)	0 (0%)	0 (0%)	0 (0%)
borg-sat 11.03.02-par-industrial (fixed) (complete)	300	195 (65%)	105 (35%)	90 (30%)	51 (17%)	6 (2%)	37 (12.33%)	11 (3.67%)	0 (0%)	0 (0%)	0 (0%)
borg-sat 11.03.02-seq-industrial (fixed) (complete)	300	190 (63.33%)	100 (33.33%)	90 (30%)	0 (0%)	87 (29%)	23 (7.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
claspmt 2.0-R4095 [DEPRECATED] (complete)	300	209 (69.67%)	112 (37.33%)	97 (32.33%)	0 (0%)	78 (26%)	0 (0%)	0 (0%)	0 (0%)	5 (1.67%)	8 (2.67%)
claspmt 2.0-R4095-patched (fixed) (complete)	300	212 (70.67%)	117 (39%)	95 (31.67%)	0 (0%)	82 (27.33%)	0 (0%)	0 (0%)	0 (0%)	6 (2%)	0 (0%)
CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete)	300	224 (74.67%)	127 (42.33%)	97 (32.33%)	0 (0%)	60 (20%)	12 (4%)	0 (0%)	0 (0%)	4 (1.33%)	0 (0%)
CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	300	230 (76.67%)	133 (44.33%)	97 (32.33%)	0 (0%)	57 (19%)	12 (4%)	0 (0%)	0 (0%)	1 (0.33%)	0 (0%)
CryptoMiniSat Strange-Night2-st (fixed) (complete)	300	207 (69%)	119 (39.67%)	88 (29.33%)	0 (0%)	84 (28%)	9 (3%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
EBGlucose 1.0 (incomplete)	300	199 (66.33%)	108 (36%)	91 (30.33%)	0 (0%)	101 (33.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
glucose 2 (complete)	300	215 (71.67%)	121 (40.33%)	94 (31.33%)	0 (0%)	85 (28.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
glueminisat 2.2.5 (complete)	300	211 (70.33%)	126 (42%)	85 (28.33%)	0 (0%)	89 (29.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
Lingeling 587 [DEPRECATED] (complete)	300	208 (69.33%)	117 (39%)	91 (30.33%)	0 (0%)	91 (30.33%)	0 (0%)	0 (0%)	0 (0%)	1 (0.33%)	0 (0%)
Lingeling 587f (fixed) (complete)	300	208 (69.33%)	117 (39%)	91 (30.33%)	0 (0%)	92 (30.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
minisat hack: cir_minisat 2011-05-13 (simp) (complete)	300	202 (67.33%)	103 (34.33%)	99 (33%)	0 (0%)	94 (31.33%)	0 (0%)	0 (0%)	4 (1.33%)	0 (0%)	0 (0%)
minisat hack: contrasat 2011-03-02 (complete)	300	199 (66.33%)	100 (33.33%)	99 (33%)	0 (0%)	96 (32%)	0 (0%)	5 (1.67%)	0 (0%)	0 (0%)	0 (0%)
minisat hack: EBMiniSAT 2011-03-02 (incomplete)	300	196 (65.33%)	98 (32.67%)	98 (32.67%)	0 (0%)	100 (33.33%)	0 (0%)	0 (0%)	4 (1.33%)	0 (0%)	0 (0%)
minisat hack: LR_GL_SHR 2011-03-02 (complete)	300	191 (63.67%)	110 (36.67%)	81 (27%)	0 (0%)	109 (36.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
minisat hack: MiniSAT 2.2.0-agile-26 (complete)	300	189 (63%)	94 (31.33%)	95 (31.67%)	0 (0%)	108 (36%)	0 (0%)	0 (0%)	3 (1%)	0 (0%)	0 (0%)
minisat hack: minisat_psm 2011-04-01 (complete)	300	197 (65.67%)	102 (34%)	95 (31.67%)	0 (0%)	103 (34.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
minisat hack reference: minisat 2.2.0 (complete)	300	194 (64.67%)	99 (33%)	95 (31.67%)	0 (0%)	102 (34%)	0 (0%)	0 (0%)	4 (1.33%)	0 (0%)	0 (0%)
MPhaseSAT64 2011-05-14 (fixed) (complete)	300	201 (67%)	102 (34%)	99 (33%)	0 (0%)	98 (32.67%)	0 (0%)	0 (0%)	1 (0.33%)	0 (0%)	0 (0%)
Plingeling 587 [DEPRECATED] (complete)	300	230 (76.67%)	124 (41.33%)	106 (35.33%)	0 (0%)	66 (22%)	0 (0%)	0 (0%)	0 (0%)	4 (1.33%)	0 (0%)
Plingeling 587f (fixed) (complete)	300	230 (76.67%)	124 (41.33%)	106 (35.33%)	0 (0%)	69 (23%)	0 (0%)	0 (0%)	1 (0.33%)	0 (0%)	0 (0%)
ppfolio par (complete)	300	229 (76.33%)	122 (40.67%)	107 (35.67%)	0 (0%)	68 (22.67%)	3 (1%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
QuteRSat 2011-05-12 (fixed) (complete)	300	206 (68.67%)	120 (40%)	86 (28.67%)	0 (0%)	93 (31%)	0 (0%)	0 (0%)	0 (0%)	1 (0.33%)	0 (0%)
rcl 2011-04-01 (complete)	300	184 (61.33%)	91 (30.33%)	93 (31%)	0 (0%)	116 (38.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
RestartSAT B95 (complete)	300	201 (67%)	104 (34.67%)	97 (32.33%)	0 (0%)	99 (33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver:glucose 1.0 (complete)	300	197 (65.67%)	110 (36.67%)	87 (29%)	0 (0%)	103 (34.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20 (complete)	300	194 (64.67%)	109 (36.33%)	85 (28.33%)	0 (0%)	64 (21.33%)	0 (0%)	42 (14%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver:precosat 236 (complete)	300	206 (68.67%)	110 (36.67%)	96 (32%)	0 (0%)	90 (30%)	0 (0%)	0 (0%)	0 (0%)	4 (1.33%)	0 (0%)
Satisfiability Solver Selector 2011-03-18 (complete)	300	200 (66.67%)	109 (36.33%)	91 (30.33%)	0 (0%)	100 (33.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)

Solver Name

Progress

borg-sat
11.03.02-industrial [DEPRECATED]
(complete)

done
300

UNSAT.
105

SAT.
91

? (TO)
57

? (MO)
37

? (EC)
10

borg-sat
11.03.02-par-industrial (fixed)
(complete)

done
300

UNSAT.
105

SAT.
90

?
51

? (TO)
6

? (MO)
37

? (EC)
11

borg-sat
11.03.02-seq-industrial (fixed)
(complete)

done
300

UNSAT.
100

SAT.
90

? (TO)
87

? (MO)
23

claspmt
2.0-R4095 [DEPRECATED]
(complete)

done
300

UNSAT.
112

SAT.
97

? (TO)
78

? (SIG)
5

ERR CERT
8

claspmt
2.0-R4095-patched (fixed)
(complete)

done
300

UNSAT.
117

SAT.
95

? (TO)
82

? (SIG)
6

CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)

done
300

UNSAT.
127

SAT.
97

? (TO)
60

? (MO)
12

? (SIG)
4

CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)

done
300

UNSAT.
133

SAT.
97

? (TO)
57

? (MO)
12

? (SIG)
1

CryptoMiniSat
Strange-Night2-st (fixed)
(complete)

done
300

UNSAT.
119

SAT.
88

? (TO)
84

? (MO)
9

EBGlucose
1.0
(incomplete)

done
300

UNSAT.
108

SAT.
91

? (TO)
101

glucose
2
(complete)

done
300

UNSAT.
121

SAT.
94

? (TO)
85

glueminisat
2.2.5
(complete)

done
300

UNSAT.
126

SAT.
85

? (TO)
89

Lingeling
587 [DEPRECATED]
(complete)

done
300

UNSAT.
117

SAT.
91

? (TO)
91

? (SIG)
1

Lingeling
587f (fixed)
(complete)

done
300

UNSAT.
117

SAT.
91

? (TO)
92

minisat hack: cir_minisat
2011-05-13 (simp)
(complete)

done
300

UNSAT.
103

SAT.
99

? (TO)
94

? (?)
4

minisat hack: contrasat
2011-03-02
(complete)

done
300

UNSAT.
100

SAT.
99

? (TO)
96

? (EC)
5

minisat hack: EBMiniSAT
2011-03-02
(incomplete)

done
300

UNSAT.
98

SAT.
98

? (TO)
100

? (?)
4

minisat hack: LR_GL_SHR
2011-03-02
(complete)

done
300

UNSAT.
110

SAT.
81

? (TO)
109

minisat hack: MiniSAT
2.2.0-agile-26
(complete)

done
300

UNSAT.
94

SAT.
95

? (TO)
108

? (?)
3

minisat hack: minisat_psm
2011-04-01
(complete)

done
300

UNSAT.
102

SAT.
95

? (TO)
103

minisat hack reference: minisat
2.2.0
(complete)

done
300

UNSAT.
99

SAT.
95

? (TO)
102

? (?)
4

MPhaseSAT64
2011-05-14 (fixed)
(complete)

done
300

UNSAT.
102

SAT.
99

? (TO)
98

? (?)
1

Plingeling
587 [DEPRECATED]
(complete)

done
300

UNSAT.
124

SAT.
106

? (TO)
66

? (SIG)
4

Plingeling
587f (fixed)
(complete)

done
300

UNSAT.
124

SAT.
106

? (TO)
69

? (?)
1

ppfolio
par
(complete)

done
300

UNSAT.
122

SAT.
107

? (TO)
68

? (MO)
3

QuteRSat
2011-05-12 (fixed)
(complete)

done
300

UNSAT.
120

SAT.
86

? (TO)
93

? (SIG)
1

rcl
2011-04-01
(complete)

done
300

UNSAT.
91

SAT.
93

? (TO)
116

RestartSAT
B95
(complete)

done
300

UNSAT.
104

SAT.
97

? (TO)
99

SAT09 reference solver:glucose
1.0
(complete)

done
300

UNSAT.
110

SAT.
87

? (TO)
103

SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)

done
300

UNSAT.
109

SAT.
85

? (TO)
64

? (EC)
42

SAT09 reference solver:precosat
236
(complete)

done
300

UNSAT.
110

SAT.
96

? (TO)
90

? (SIG)
4

Satisfiability Solver Selector
2011-03-18
(complete)

done
300

UNSAT.
109

SAT.
91

? (TO)
100

Category "crafted instances" (CRAFTED)

Solver Name	#benchs	Solved	UNSAT.	SAT.	UNKNOWN (timeout)	UNKNOWN (out of mem.)	UNKNOWN (exit code)	Sig. Caught
clasp 2.0-R4092-crafted (complete)	300	149 (49.67%)	62 (20.67%)	87 (29%)	151 (50.33%)	0 (0%)	0 (0%)	0 (0%)
claspmt 2.0-R4095 [DEPRECATED] (complete)	300	167 (55.67%)	69 (23%)	98 (32.67%)	128 (42.67%)	0 (0%)	0 (0%)	5 (1.67%)
claspmt 2.0-R4095-patched (fixed) (complete)	300	170 (56.67%)	70 (23.33%)	100 (33.33%)	126 (42%)	0 (0%)	0 (0%)	4 (1.33%)
CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	300	131 (43.67%)	45 (15%)	86 (28.67%)	169 (56.33%)	0 (0%)	0 (0%)	0 (0%)
CryptoMiniSat Strange-Night2-st (fixed) (complete)	300	110 (36.67%)	40 (13.33%)	70 (23.33%)	190 (63.33%)	0 (0%)	0 (0%)	0 (0%)
glucose 2 (complete)	300	125 (41.67%)	42 (14%)	83 (27.67%)	175 (58.33%)	0 (0%)	0 (0%)	0 (0%)
jMiniSat 2011 (complete)	300	98 (32.67%)	28 (9.33%)	70 (23.33%)	202 (67.33%)	0 (0%)	0 (0%)	0 (0%)
MPhaseSAT 2011-02-15 (complete)	300	132 (44%)	39 (13%)	93 (31%)	168 (56%)	0 (0%)	0 (0%)	0 (0%)
PicoSAT 941 (complete)	300	121 (40.33%)	40 (13.33%)	81 (27%)	179 (59.67%)	0 (0%)	0 (0%)	0 (0%)
Plingeling 587f (fixed) (complete)	300	131 (43.67%)	40 (13.33%)	91 (30.33%)	169 (56.33%)	0 (0%)	0 (0%)	0 (0%)
ppfolio par (complete)	300	187 (62.33%)	60 (20%)	127 (42.33%)	113 (37.67%)	0 (0%)	0 (0%)	0 (0%)
ppfolio seq (complete)	300	152 (50.67%)	38 (12.67%)	114 (38%)	144 (48%)	4 (1.33%)	0 (0%)	0 (0%)
priss 1.0 (complete)	300	104 (34.67%)	31 (10.33%)	73 (24.33%)	194 (64.67%)	0 (0%)	2 (0.67%)	0 (0%)
QuteRSat 2011-05-12 (fixed) (complete)	300	110 (36.67%)	40 (13.33%)	70 (23.33%)	190 (63.33%)	0 (0%)	0 (0%)	0 (0%)
RestartSAT B95 (complete)	300	112 (37.33%)	35 (11.67%)	77 (25.67%)	188 (62.67%)	0 (0%)	0 (0%)	0 (0%)
SApperloT2010 2011-05-15 (fixed) (complete)	300	109 (36.33%)	33 (11%)	76 (25.33%)	191 (63.67%)	0 (0%)	0 (0%)	0 (0%)
SArTagnan 2011-05-15 (fixed) (complete)	300	148 (49.33%)	47 (15.67%)	101 (33.67%)	147 (49%)	0 (0%)	5 (1.67%)	0 (0%)
SAT07 reference solver: minisat SAT 2007 (complete)	300	122 (40.67%)	44 (14.67%)	78 (26%)	178 (59.33%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver: clasp 1.2.0-SAT09-32 (complete)	300	149 (49.67%)	64 (21.33%)	85 (28.33%)	151 (50.33%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver: SATzilla2009_C 2009-03-22 (complete)	300	116 (38.67%)	43 (14.33%)	73 (24.33%)	5 (1.67%)	0 (0%)	179 (59.67%)	0 (0%)
sathys 2011-04-01 (complete)	300	96 (32%)	23 (7.67%)	73 (24.33%)	204 (68%)	0 (0%)	0 (0%)	0 (0%)
Satisfiability Solver Selector 2011-03-18 (complete)	300	163 (54.33%)	51 (17%)	112 (37.33%)	137 (45.67%)	0 (0%)	0 (0%)	0 (0%)
sattime 2011-03-02 (incomplete)	300	109 (36.33%)	0 (0%)	109 (36.33%)	191 (63.67%)	0 (0%)	0 (0%)	0 (0%)
sattime+ 2011-03-02 (incomplete)	300	106 (35.33%)	0 (0%)	106 (35.33%)	194 (64.67%)	0 (0%)	0 (0%)	0 (0%)
Sol 2011-04-04 (complete)	300	116 (38.67%)	37 (12.33%)	79 (26.33%)	181 (60.33%)	0 (0%)	0 (0%)	3 (1%)

Solver Name

Progress

clasp
2.0-R4092-crafted
(complete)

done
300

UNSAT.
62

SAT.
87

? (TO)
151

claspmt
2.0-R4095 [DEPRECATED]
(complete)

done
300

UNSAT.
69

SAT.
98

? (TO)
128

? (SIG)
5

claspmt
2.0-R4095-patched (fixed)
(complete)

done
300

UNSAT.
70

SAT.
100

? (TO)
126

? (SIG)
4

CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)

done
300

UNSAT.
45

SAT.
86

? (TO)
169

CryptoMiniSat
Strange-Night2-st (fixed)
(complete)

done
300

UNSAT.
40

SAT.
70

? (TO)
190

glucose
2
(complete)

done
300

UNSAT.
42

SAT.
83

? (TO)
175

jMiniSat
2011
(complete)

done
300

UNSAT.
28

SAT.
70

? (TO)
202

MPhaseSAT
2011-02-15
(complete)

done
300

UNSAT.
39

SAT.
93

? (TO)
168

PicoSAT
941
(complete)

done
300

UNSAT.
40

SAT.
81

? (TO)
179

Plingeling
587f (fixed)
(complete)

done
300

UNSAT.
40

SAT.
91

? (TO)
169

ppfolio
par
(complete)

done
300

UNSAT.
60

SAT.
127

? (TO)
113

ppfolio
seq
(complete)

done
300

UNSAT.
38

SAT.
114

? (TO)
144

? (MO)
4

priss
1.0
(complete)

done
300

UNSAT.
31

SAT.
73

? (TO)
194

? (EC)
2

QuteRSat
2011-05-12 (fixed)
(complete)

done
300

UNSAT.
40

SAT.
70

? (TO)
190

RestartSAT
B95
(complete)

done
300

UNSAT.
35

SAT.
77

? (TO)
188

SApperloT2010
2011-05-15 (fixed)
(complete)

done
300

UNSAT.
33

SAT.
76

? (TO)
191

SArTagnan
2011-05-15 (fixed)
(complete)

done
300

UNSAT.
47

SAT.
101

? (TO)
147

? (EC)
5

SAT07 reference solver: minisat
SAT 2007
(complete)

done
300

UNSAT.
44

SAT.
78

? (TO)
178

SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)

done
300

UNSAT.
64

SAT.
85

? (TO)
151

SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)

done
300

UNSAT.
43

SAT.
73

? (TO)
5

? (EC)
179

sathys
2011-04-01
(complete)

done
300

UNSAT.
23

SAT.
73

? (TO)
204

Satisfiability Solver Selector
2011-03-18
(complete)

done
300

UNSAT.
51

SAT.
112

? (TO)
137

sattime
2011-03-02
(incomplete)

done
300

SAT.
109

? (TO)
191

sattime+
2011-03-02
(incomplete)

done
300

SAT.
106

? (TO)
194

Sol
2011-04-04
(complete)

done
300

UNSAT.
37

SAT.
79

? (TO)
181

? (SIG)
3

Category "random instances" (RANDOM)

Solver Name	#benchs	Solved	UNSAT.	SAT.	UNKNOWN	UNKNOWN (timeout)	UNKNOWN (out of mem.)	UNKNOWN (exit code)	UNKNOWN (problem)	WRONG CERT.
adaptg2wsat2011 2011-03-02 (incomplete)	600	328 (54.67%)	0 (0%)	328 (54.67%)	0 (0%)	272 (45.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
borg-sat 11.03.02-par-random (fixed) (complete)	600	363 (60.5%)	112 (18.67%)	251 (41.83%)	54 (9%)	16 (2.67%)	95 (15.83%)	70 (11.67%)	0 (0%)	2 (0.33%)
borg-sat 11.03.02-random [DEPRECATED] (complete)	600	347 (57.83%)	110 (18.33%)	237 (39.5%)	0 (0%)	77 (12.83%)	98 (16.33%)	76 (12.67%)	0 (0%)	2 (0.33%)
borg-sat 11.03.02-seq-random (fixed) (complete)	600	415 (69.17%)	111 (18.5%)	304 (50.67%)	1 (0.17%)	107 (17.83%)	72 (12%)	0 (0%)	0 (0%)	5 (0.83%)
csls pnorm-8cores (incomplete)	600	335 (55.83%)	0 (0%)	335 (55.83%)	0 (0%)	165 (27.5%)	0 (0%)	0 (0%)	100 (16.67%)	0 (0%)
EagleUP 1.565.350 (incomplete)	600	328 (54.67%)	0 (0%)	328 (54.67%)	0 (0%)	272 (45.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
march_rw 2011-03-02 (complete)	600	251 (41.83%)	123 (20.5%)	128 (21.33%)	0 (0%)	349 (58.17%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
MPhaseSAT_M 2011-02-16 (complete)	600	359 (59.83%)	104 (17.33%)	255 (42.5%)	0 (0%)	241 (40.17%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
ppfolio par (complete)	600	444 (74%)	122 (20.33%)	322 (53.67%)	0 (0%)	153 (25.5%)	3 (0.5%)	0 (0%)	0 (0%)	0 (0%)
ppfolio seq (complete)	600	375 (62.5%)	67 (11.17%)	308 (51.33%)	0 (0%)	223 (37.17%)	2 (0.33%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver: gnovelty+2 2009-03-22 (incomplete)	600	298 (49.67%)	0 (0%)	298 (49.67%)	0 (0%)	302 (50.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver: march_hi hi (complete)	600	251 (41.83%)	123 (20.5%)	128 (21.33%)	0 (0%)	349 (58.17%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver: SATzilla2009_R 2009-03-22 (complete)	600	384 (64%)	97 (16.17%)	287 (47.83%)	0 (0%)	0 (0%)	0 (0%)	216 (36%)	0 (0%)	0 (0%)
SAT09 reference solver: TNM 2009-03-22 (incomplete)	600	324 (54%)	0 (0%)	324 (54%)	0 (0%)	276 (46%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
Satisfiability Solver Selector 2011-03-18 (complete)	600	408 (68%)	96 (16%)	312 (52%)	0 (0%)	192 (32%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
sattime2011 2011-03-02 (incomplete)	600	334 (55.67%)	0 (0%)	334 (55.67%)	0 (0%)	266 (44.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
sparrow2011 sparrow2011_ubcsat1.2_2011-03-02 (incomplete)	600	362 (60.33%)	0 (0%)	362 (60.33%)	0 (0%)	238 (39.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)

Solver Name

Progress

adaptg2wsat2011
2011-03-02
(incomplete)

done
600

SAT.
328

? (TO)
272

borg-sat
11.03.02-par-random (fixed)
(complete)

done
600

UNSAT.
112

SAT.
251

?
54

? (TO)
16

? (MO)
95

? (EC)
70

ERR CERT
2

borg-sat
11.03.02-random [DEPRECATED]
(complete)

done
600

UNSAT.
110

SAT.
237

? (TO)
77

? (MO)
98

? (EC)
76

ERR CERT
2

borg-sat
11.03.02-seq-random (fixed)
(complete)

done
600

UNSAT.
111

SAT.
304

?
1

? (TO)
107

? (MO)
72

ERR CERT
5

csls
pnorm-8cores
(incomplete)

done
600

SAT.
335

? (TO)
165

? (?)
100

EagleUP
1.565.350
(incomplete)

done
600

SAT.
328

? (TO)
272

march_rw
2011-03-02
(complete)

done
600

UNSAT.
123

SAT.
128

? (TO)
349

MPhaseSAT_M
2011-02-16
(complete)

done
600

UNSAT.
104

SAT.
255

? (TO)
241

ppfolio
par
(complete)

done
600

UNSAT.
122

SAT.
322

? (TO)
153

? (MO)
3

ppfolio
seq
(complete)

done
600

UNSAT.
67

SAT.
308

? (TO)
223

? (MO)
2

SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)

done
600

SAT.
298

? (TO)
302

SAT09 reference solver: march_hi
hi
(complete)

done
600

UNSAT.
123

SAT.
128

? (TO)
349

SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)

done
600

UNSAT.
97

SAT.
287

? (EC)
216

SAT09 reference solver: TNM
2009-03-22
(incomplete)

done
600

SAT.
324

? (TO)
276

Satisfiability Solver Selector
2011-03-18
(complete)

done
600

UNSAT.
96

SAT.
312

? (TO)
192

sattime2011
2011-03-02
(incomplete)

done
600

SAT.
334

? (TO)
266

sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)

done
600

SAT.
362

? (TO)
238

All categories for solvers registered in all categories

Solver Name	#benchs	Solved	UNSAT.	SAT.	SAT (timeout)	UNKNOWN	UNKNOWN (timeout)	UNKNOWN (out of mem.)	UNKNOWN (exit code)	UNKNOWN (conv. script)	UNKNOWN (problem)	UNKNOWN (abort)	Sig. Caught	NO CERT.	WRONG CERT.	WRONG UNSAT.
ppfolio par (complete)	1200	860 (71.67%)	304 (25.33%)	556 (46.33%)	0 (0%)	0 (0%)	334 (27.83%)	6 (0.5%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
Satisfiability Solver Selector 2011-03-18 (complete)	1200	771 (64.25%)	256 (21.33%)	515 (42.92%)	0 (0%)	0 (0%)	429 (35.75%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)

Solver Name

Progress

ppfolio
par
(complete)

done
1200

UNSAT.
304

SAT.
556

? (TO)
334

? (MO)
6

Satisfiability Solver Selector
2011-03-18
(complete)

done
1200

UNSAT.
256

SAT.
515

? (TO)
429

All categories and all solvers (regardless of their ability to support all categories)

This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.

Solver Name	#benchs	Solved	UNSAT.	SAT.	UNKNOWN	UNKNOWN (timeout)	UNKNOWN (out of mem.)	UNKNOWN (exit code)	UNKNOWN (problem)	Sig. Caught	WRONG CERT.
adaptg2wsat2011 2011-03-02 (incomplete)	600	328 (54.67%)	0 (0%)	328 (54.67%)	0 (0%)	272 (45.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
borg-sat 11.03.02-industrial [DEPRECATED] (complete)	300	196 (65.33%)	105 (35%)	91 (30.33%)	0 (0%)	57 (19%)	37 (12.33%)	10 (3.33%)	0 (0%)	0 (0%)	0 (0%)
borg-sat 11.03.02-par-industrial (fixed) (complete)	300	195 (65%)	105 (35%)	90 (30%)	51 (17%)	6 (2%)	37 (12.33%)	11 (3.67%)	0 (0%)	0 (0%)	0 (0%)
borg-sat 11.03.02-par-random (fixed) (complete)	600	363 (60.5%)	112 (18.67%)	251 (41.83%)	54 (9%)	16 (2.67%)	95 (15.83%)	70 (11.67%)	0 (0%)	0 (0%)	2 (0.33%)
borg-sat 11.03.02-random [DEPRECATED] (complete)	600	347 (57.83%)	110 (18.33%)	237 (39.5%)	0 (0%)	77 (12.83%)	98 (16.33%)	76 (12.67%)	0 (0%)	0 (0%)	2 (0.33%)
borg-sat 11.03.02-seq-industrial (fixed) (complete)	300	190 (63.33%)	100 (33.33%)	90 (30%)	0 (0%)	87 (29%)	23 (7.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
borg-sat 11.03.02-seq-random (fixed) (complete)	600	415 (69.17%)	111 (18.5%)	304 (50.67%)	1 (0.17%)	107 (17.83%)	72 (12%)	0 (0%)	0 (0%)	0 (0%)	5 (0.83%)
clasp 2.0-R4092-crafted (complete)	300	149 (49.67%)	62 (20.67%)	87 (29%)	0 (0%)	151 (50.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
claspmt 2.0-R4095 [DEPRECATED] (complete)	600	376 (62.67%)	181 (30.17%)	195 (32.5%)	0 (0%)	206 (34.33%)	0 (0%)	0 (0%)	0 (0%)	10 (1.67%)	8 (1.33%)
claspmt 2.0-R4095-patched (fixed) (complete)	600	382 (63.67%)	187 (31.17%)	195 (32.5%)	0 (0%)	208 (34.67%)	0 (0%)	0 (0%)	0 (0%)	10 (1.67%)	0 (0%)
CryptoMiniSat Strange-Night-2-mt [DEPRECATED] (complete)	300	224 (74.67%)	127 (42.33%)	97 (32.33%)	0 (0%)	60 (20%)	12 (4%)	0 (0%)	0 (0%)	4 (1.33%)	0 (0%)
CryptoMiniSat Strange-Night-2-mt (fixed) (complete)	600	361 (60.17%)	178 (29.67%)	183 (30.5%)	0 (0%)	226 (37.67%)	12 (2%)	0 (0%)	0 (0%)	1 (0.17%)	0 (0%)
CryptoMiniSat Strange-Night2-st (fixed) (complete)	600	317 (52.83%)	159 (26.5%)	158 (26.33%)	0 (0%)	274 (45.67%)	9 (1.5%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
csls pnorm-8cores (incomplete)	600	335 (55.83%)	0 (0%)	335 (55.83%)	0 (0%)	165 (27.5%)	0 (0%)	0 (0%)	100 (16.67%)	0 (0%)	0 (0%)
EagleUP 1.565.350 (incomplete)	600	328 (54.67%)	0 (0%)	328 (54.67%)	0 (0%)	272 (45.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
EBGlucose 1.0 (incomplete)	300	199 (66.33%)	108 (36%)	91 (30.33%)	0 (0%)	101 (33.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
glucose 2 (complete)	600	340 (56.67%)	163 (27.17%)	177 (29.5%)	0 (0%)	260 (43.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
glueminisat 2.2.5 (complete)	300	211 (70.33%)	126 (42%)	85 (28.33%)	0 (0%)	89 (29.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
jMiniSat 2011 (complete)	300	98 (32.67%)	28 (9.33%)	70 (23.33%)	0 (0%)	202 (67.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
Lingeling 587 [DEPRECATED] (complete)	300	208 (69.33%)	117 (39%)	91 (30.33%)	0 (0%)	91 (30.33%)	0 (0%)	0 (0%)	0 (0%)	1 (0.33%)	0 (0%)
Lingeling 587f (fixed) (complete)	300	208 (69.33%)	117 (39%)	91 (30.33%)	0 (0%)	92 (30.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
march_rw 2011-03-02 (complete)	600	251 (41.83%)	123 (20.5%)	128 (21.33%)	0 (0%)	349 (58.17%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
minisat hack: cir_minisat 2011-05-13 (simp) (complete)	300	202 (67.33%)	103 (34.33%)	99 (33%)	0 (0%)	94 (31.33%)	0 (0%)	0 (0%)	4 (1.33%)	0 (0%)	0 (0%)
minisat hack: contrasat 2011-03-02 (complete)	300	199 (66.33%)	100 (33.33%)	99 (33%)	0 (0%)	96 (32%)	0 (0%)	5 (1.67%)	0 (0%)	0 (0%)	0 (0%)
minisat hack: EBMiniSAT 2011-03-02 (incomplete)	300	196 (65.33%)	98 (32.67%)	98 (32.67%)	0 (0%)	100 (33.33%)	0 (0%)	0 (0%)	4 (1.33%)	0 (0%)	0 (0%)
minisat hack: LR_GL_SHR 2011-03-02 (complete)	300	191 (63.67%)	110 (36.67%)	81 (27%)	0 (0%)	109 (36.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
minisat hack: MiniSAT 2.2.0-agile-26 (complete)	300	189 (63%)	94 (31.33%)	95 (31.67%)	0 (0%)	108 (36%)	0 (0%)	0 (0%)	3 (1%)	0 (0%)	0 (0%)
minisat hack: minisat_psm 2011-04-01 (complete)	300	197 (65.67%)	102 (34%)	95 (31.67%)	0 (0%)	103 (34.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
minisat hack reference: minisat 2.2.0 (complete)	300	194 (64.67%)	99 (33%)	95 (31.67%)	0 (0%)	102 (34%)	0 (0%)	0 (0%)	4 (1.33%)	0 (0%)	0 (0%)
MPhaseSAT 2011-02-15 (complete)	300	132 (44%)	39 (13%)	93 (31%)	0 (0%)	168 (56%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
MPhaseSAT64 2011-05-14 (fixed) (complete)	300	201 (67%)	102 (34%)	99 (33%)	0 (0%)	98 (32.67%)	0 (0%)	0 (0%)	1 (0.33%)	0 (0%)	0 (0%)
MPhaseSAT_M 2011-02-16 (complete)	600	359 (59.83%)	104 (17.33%)	255 (42.5%)	0 (0%)	241 (40.17%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
PicoSAT 941 (complete)	300	121 (40.33%)	40 (13.33%)	81 (27%)	0 (0%)	179 (59.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
Plingeling 587 [DEPRECATED] (complete)	300	230 (76.67%)	124 (41.33%)	106 (35.33%)	0 (0%)	66 (22%)	0 (0%)	0 (0%)	0 (0%)	4 (1.33%)	0 (0%)
Plingeling 587f (fixed) (complete)	600	361 (60.17%)	164 (27.33%)	197 (32.83%)	0 (0%)	238 (39.67%)	0 (0%)	0 (0%)	1 (0.17%)	0 (0%)	0 (0%)
ppfolio par (complete)	1200	860 (71.67%)	304 (25.33%)	556 (46.33%)	0 (0%)	334 (27.83%)	6 (0.5%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
ppfolio seq (complete)	900	527 (58.56%)	105 (11.67%)	422 (46.89%)	0 (0%)	367 (40.78%)	6 (0.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
priss 1.0 (complete)	300	104 (34.67%)	31 (10.33%)	73 (24.33%)	0 (0%)	194 (64.67%)	0 (0%)	2 (0.67%)	0 (0%)	0 (0%)	0 (0%)
QuteRSat 2011-05-12 (fixed) (complete)	600	316 (52.67%)	160 (26.67%)	156 (26%)	0 (0%)	283 (47.17%)	0 (0%)	0 (0%)	0 (0%)	1 (0.17%)	0 (0%)
rcl 2011-04-01 (complete)	300	184 (61.33%)	91 (30.33%)	93 (31%)	0 (0%)	116 (38.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
RestartSAT B95 (complete)	600	313 (52.17%)	139 (23.17%)	174 (29%)	0 (0%)	287 (47.83%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
SApperloT2010 2011-05-15 (fixed) (complete)	300	109 (36.33%)	33 (11%)	76 (25.33%)	0 (0%)	191 (63.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
SArTagnan 2011-05-15 (fixed) (complete)	300	148 (49.33%)	47 (15.67%)	101 (33.67%)	0 (0%)	147 (49%)	0 (0%)	5 (1.67%)	0 (0%)	0 (0%)	0 (0%)
SAT07 reference solver: minisat SAT 2007 (complete)	300	122 (40.67%)	44 (14.67%)	78 (26%)	0 (0%)	178 (59.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver: clasp 1.2.0-SAT09-32 (complete)	300	149 (49.67%)	64 (21.33%)	85 (28.33%)	0 (0%)	151 (50.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver:glucose 1.0 (complete)	300	197 (65.67%)	110 (36.67%)	87 (29%)	0 (0%)	103 (34.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver: gnovelty+2 2009-03-22 (incomplete)	600	298 (49.67%)	0 (0%)	298 (49.67%)	0 (0%)	302 (50.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20 (complete)	300	194 (64.67%)	109 (36.33%)	85 (28.33%)	0 (0%)	64 (21.33%)	0 (0%)	42 (14%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver: march_hi hi (complete)	600	251 (41.83%)	123 (20.5%)	128 (21.33%)	0 (0%)	349 (58.17%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver:precosat 236 (complete)	300	206 (68.67%)	110 (36.67%)	96 (32%)	0 (0%)	90 (30%)	0 (0%)	0 (0%)	0 (0%)	4 (1.33%)	0 (0%)
SAT09 reference solver: SATzilla2009_C 2009-03-22 (complete)	300	116 (38.67%)	43 (14.33%)	73 (24.33%)	0 (0%)	5 (1.67%)	0 (0%)	179 (59.67%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver: SATzilla2009_R 2009-03-22 (complete)	600	384 (64%)	97 (16.17%)	287 (47.83%)	0 (0%)	0 (0%)	0 (0%)	216 (36%)	0 (0%)	0 (0%)	0 (0%)
SAT09 reference solver: TNM 2009-03-22 (incomplete)	600	324 (54%)	0 (0%)	324 (54%)	0 (0%)	276 (46%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
sathys 2011-04-01 (complete)	300	96 (32%)	23 (7.67%)	73 (24.33%)	0 (0%)	204 (68%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
Satisfiability Solver Selector 2011-03-18 (complete)	1200	771 (64.25%)	256 (21.33%)	515 (42.92%)	0 (0%)	429 (35.75%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
sattime 2011-03-02 (incomplete)	300	109 (36.33%)	0 (0%)	109 (36.33%)	0 (0%)	191 (63.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
sattime+ 2011-03-02 (incomplete)	300	106 (35.33%)	0 (0%)	106 (35.33%)	0 (0%)	194 (64.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
sattime2011 2011-03-02 (incomplete)	600	334 (55.67%)	0 (0%)	334 (55.67%)	0 (0%)	266 (44.33%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)
Sol 2011-04-04 (complete)	300	116 (38.67%)	37 (12.33%)	79 (26.33%)	0 (0%)	181 (60.33%)	0 (0%)	0 (0%)	0 (0%)	3 (1%)	0 (0%)
sparrow2011 sparrow2011_ubcsat1.2_2011-03-02 (incomplete)	600	362 (60.33%)	0 (0%)	362 (60.33%)	0 (0%)	238 (39.67%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)	0 (0%)

Solver Name

Progress

adaptg2wsat2011
2011-03-02
(incomplete)

done
600

SAT.
328

? (TO)
272

borg-sat
11.03.02-industrial [DEPRECATED]
(complete)

done
300

UNSAT.
105

SAT.
91

? (TO)
57

? (MO)
37

? (EC)
10

borg-sat
11.03.02-par-industrial (fixed)
(complete)

done
300

UNSAT.
105

SAT.
90

?
51

? (TO)
6

? (MO)
37

? (EC)
11

borg-sat
11.03.02-par-random (fixed)
(complete)

done
600

UNSAT.
112

SAT.
251

?
54

? (TO)
16

? (MO)
95

? (EC)
70

ERR CERT
2

borg-sat
11.03.02-random [DEPRECATED]
(complete)

done
600

UNSAT.
110

SAT.
237

? (TO)
77

? (MO)
98

? (EC)
76

ERR CERT
2

borg-sat
11.03.02-seq-industrial (fixed)
(complete)

done
300

UNSAT.
100

SAT.
90

? (TO)
87

? (MO)
23

borg-sat
11.03.02-seq-random (fixed)
(complete)

done
600

UNSAT.
111

SAT.
304

?
1

? (TO)
107

? (MO)
72

ERR CERT
5

clasp
2.0-R4092-crafted
(complete)

done
300

UNSAT.
62

SAT.
87

? (TO)
151

claspmt
2.0-R4095 [DEPRECATED]
(complete)

done
600

UNSAT.
181

SAT.
195

? (TO)
206

? (SIG)
10

ERR CERT
8

claspmt
2.0-R4095-patched (fixed)
(complete)

done
600

UNSAT.
187

SAT.
195

? (TO)
208

? (SIG)
10

CryptoMiniSat
Strange-Night-2-mt [DEPRECATED]
(complete)

done
300

UNSAT.
127

SAT.
97

? (TO)
60

? (MO)
12

? (SIG)
4

CryptoMiniSat
Strange-Night-2-mt (fixed)
(complete)

done
600

UNSAT.
178

SAT.
183

? (TO)
226

? (MO)
12

? (SIG)
1

CryptoMiniSat
Strange-Night2-st (fixed)
(complete)

done
600

UNSAT.
159

SAT.
158

? (TO)
274

? (MO)
9

csls
pnorm-8cores
(incomplete)

done
600

SAT.
335

? (TO)
165

? (?)
100

EagleUP
1.565.350
(incomplete)

done
600

SAT.
328

? (TO)
272

EBGlucose
1.0
(incomplete)

done
300

UNSAT.
108

SAT.
91

? (TO)
101

glucose
2
(complete)

done
600

UNSAT.
163

SAT.
177

? (TO)
260

glueminisat
2.2.5
(complete)

done
300

UNSAT.
126

SAT.
85

? (TO)
89

jMiniSat
2011
(complete)

done
300

UNSAT.
28

SAT.
70

? (TO)
202

Lingeling
587 [DEPRECATED]
(complete)

done
300

UNSAT.
117

SAT.
91

? (TO)
91

? (SIG)
1

Lingeling
587f (fixed)
(complete)

done
300

UNSAT.
117

SAT.
91

? (TO)
92

march_rw
2011-03-02
(complete)

done
600

UNSAT.
123

SAT.
128

? (TO)
349

minisat hack: cir_minisat
2011-05-13 (simp)
(complete)

done
300

UNSAT.
103

SAT.
99

? (TO)
94

? (?)
4

minisat hack: contrasat
2011-03-02
(complete)

done
300

UNSAT.
100

SAT.
99

? (TO)
96

? (EC)
5

minisat hack: EBMiniSAT
2011-03-02
(incomplete)

done
300

UNSAT.
98

SAT.
98

? (TO)
100

? (?)
4

minisat hack: LR_GL_SHR
2011-03-02
(complete)

done
300

UNSAT.
110

SAT.
81

? (TO)
109

minisat hack: MiniSAT
2.2.0-agile-26
(complete)

done
300

UNSAT.
94

SAT.
95

? (TO)
108

? (?)
3

minisat hack: minisat_psm
2011-04-01
(complete)

done
300

UNSAT.
102

SAT.
95

? (TO)
103

minisat hack reference: minisat
2.2.0
(complete)

done
300

UNSAT.
99

SAT.
95

? (TO)
102

? (?)
4

MPhaseSAT
2011-02-15
(complete)

done
300

UNSAT.
39

SAT.
93

? (TO)
168

MPhaseSAT64
2011-05-14 (fixed)
(complete)

done
300

UNSAT.
102

SAT.
99

? (TO)
98

? (?)
1

MPhaseSAT_M
2011-02-16
(complete)

done
600

UNSAT.
104

SAT.
255

? (TO)
241

PicoSAT
941
(complete)

done
300

UNSAT.
40

SAT.
81

? (TO)
179

Plingeling
587 [DEPRECATED]
(complete)

done
300

UNSAT.
124

SAT.
106

? (TO)
66

? (SIG)
4

Plingeling
587f (fixed)
(complete)

done
600

UNSAT.
164

SAT.
197

? (TO)
238

? (?)
1

ppfolio
par
(complete)

done
1200

UNSAT.
304

SAT.
556

? (TO)
334

? (MO)
6

ppfolio
seq
(complete)

done
900

UNSAT.
105

SAT.
422

? (TO)
367

? (MO)
6

priss
1.0
(complete)

done
300

UNSAT.
31

SAT.
73

? (TO)
194

? (EC)
2

QuteRSat
2011-05-12 (fixed)
(complete)

done
600

UNSAT.
160

SAT.
156

? (TO)
283

? (SIG)
1

rcl
2011-04-01
(complete)

done
300

UNSAT.
91

SAT.
93

? (TO)
116

RestartSAT
B95
(complete)

done
600

UNSAT.
139

SAT.
174

? (TO)
287

SApperloT2010
2011-05-15 (fixed)
(complete)

done
300

UNSAT.
33

SAT.
76

? (TO)
191

SArTagnan
2011-05-15 (fixed)
(complete)

done
300

UNSAT.
47

SAT.
101

? (TO)
147

? (EC)
5

SAT07 reference solver: minisat
SAT 2007
(complete)

done
300

UNSAT.
44

SAT.
78

? (TO)
178

SAT09 reference solver: clasp
1.2.0-SAT09-32
(complete)

done
300

UNSAT.
64

SAT.
85

? (TO)
151

SAT09 reference solver:glucose
1.0
(complete)

done
300

UNSAT.
110

SAT.
87

? (TO)
103

SAT09 reference solver: gnovelty+2
2009-03-22
(incomplete)

done
600

SAT.
298

? (TO)
302

SAT09 reference solver: ManySAT 1.1
aimd 1/2009-03-20
(complete)

done
300

UNSAT.
109

SAT.
85

? (TO)
64

? (EC)
42

SAT09 reference solver: march_hi
hi
(complete)

done
600

UNSAT.
123

SAT.
128

? (TO)
349

SAT09 reference solver:precosat
236
(complete)

done
300

UNSAT.
110

SAT.
96

? (TO)
90

? (SIG)
4

SAT09 reference solver: SATzilla2009_C
2009-03-22
(complete)

done
300

UNSAT.
43

SAT.
73

? (TO)
5

? (EC)
179

SAT09 reference solver: SATzilla2009_R
2009-03-22
(complete)

done
600

UNSAT.
97

SAT.
287

? (EC)
216

SAT09 reference solver: TNM
2009-03-22
(incomplete)

done
600

SAT.
324

? (TO)
276

sathys
2011-04-01
(complete)

done
300

UNSAT.
23

SAT.
73

? (TO)
204

Satisfiability Solver Selector
2011-03-18
(complete)

done
1200

UNSAT.
256

SAT.
515

? (TO)
429

sattime
2011-03-02
(incomplete)

done
300

SAT.
109

? (TO)
191

sattime+
2011-03-02
(incomplete)

done
300

SAT.
106

? (TO)
194

sattime2011
2011-03-02
(incomplete)

done
600

SAT.
334

? (TO)
266

Sol
2011-04-04
(complete)

done
300

UNSAT.
37

SAT.
79

? (TO)
181

? (SIG)
3

sparrow2011
sparrow2011_ubcsat1.2_2011-03-02
(incomplete)

done
600

SAT.
362

? (TO)
238