SAT 2009 Competition: multithread track: solvers page (tabular format, summary)

Some explanations

#Benchs: Number of benchs for this solver
Solved: Total number of solved instances (this is the sum of the SAT and UNSAT columns)
UNSAT: Total number of UNSAT answers
SAT: Total number of SAT answers
UNKNOWN: Total number of UNKNOWN answers
Bad Answers: Total number of bad answers

Category "applications instances" (APPLICATION)

Solver Name	#benchs	Solved	UNSAT	SAT	UNKNOWN	Bad Answers
ManySAT 1.1 aimd 0/2009-03-20 (4 threads) (complete)	292	185 (63.36%)	116 (39.73%)	69 (23.63%)	107 (36.64%)	0 (0%)
ManySAT 1.1 aimd 1/2009-03-20 (4 threads) (complete)	292	187 (64.04%)	119 (40.75%)	68 (23.29%)	105 (35.96%)	0 (0%)
ManySAT 1.1 aimd 2/2009-03-20 (4 threads) (complete)	292	181 (61.99%)	116 (39.73%)	65 (22.26%)	111 (38.01%)	0 (0%)
satake 2009-03-22 (16 threads) (complete)	292	106 (36.3%)	66 (22.6%)	40 (13.7%)	174 (59.59%)	12 (4.11%)
satake 2009-03-22 (4 threads) (complete)	292	118 (40.41%)	66 (22.6%)	52 (17.81%)	174 (59.59%)	0 (0%)
ttsth-5-0 2009-03-19 (16 threads) (complete)	292	7 (2.4%)	4 (1.37%)	3 (1.03%)	285 (97.6%)	0 (0%)
ttsth-5-0 2009-03-19 (4 threads) (complete)	292	7 (2.4%)	4 (1.37%)	3 (1.03%)	285 (97.6%)	0 (0%)

Solver Name

Progress

ManySAT 1.1
aimd 0/2009-03-20 (4 threads)
(complete)

done
292

UNSAT
116

SAT
69

?
107

ManySAT 1.1
aimd 1/2009-03-20 (4 threads)
(complete)

done
292

UNSAT
119

SAT
68

?
105

ManySAT 1.1
aimd 2/2009-03-20 (4 threads)
(complete)

done
292

UNSAT
116

SAT
65

?
111

satake
2009-03-22 (16 threads)
(complete)

done
292

UNSAT
66

SAT
40

?
174

ERR
12

satake
2009-03-22 (4 threads)
(complete)

done
292

UNSAT
66

SAT
52

?
174

ttsth-5-0
2009-03-19 (16 threads)
(complete)

done
292

UNSAT
4

SAT
3

?
285

ttsth-5-0
2009-03-19 (4 threads)
(complete)

done
292

UNSAT
4

SAT
3

?
285

Category "random instances" (RANDOM)

Solver Name	#benchs	Solved	UNSAT	SAT	UNKNOWN	Bad Answers
gNovelty+-T 2009-03-22 (16 threads) (incomplete)	570	237 (41.58%)	0 (0%)	237 (41.58%)	333 (58.42%)	0 (0%)
gNovelty+-T 2009-03-22 (4 threads) (incomplete)	570	296 (51.93%)	0 (0%)	296 (51.93%)	274 (48.07%)	0 (0%)

Solver Name

Progress

gNovelty+-T
2009-03-22 (16 threads)
(incomplete)

done
570

SAT
237

?
333

gNovelty+-T
2009-03-22 (4 threads)
(incomplete)

done
570

SAT
296

?
274

All categories for solvers registered in all categories

All categories and all solvers (regardless of their ability to support all categories)

This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.

Solver Name	#benchs	Solved	UNSAT	SAT	UNKNOWN	Bad Answers
gNovelty+-T 2009-03-22 (16 threads) (incomplete)	570	237 (41.58%)	0 (0%)	237 (41.58%)	333 (58.42%)	0 (0%)
gNovelty+-T 2009-03-22 (4 threads) (incomplete)	570	296 (51.93%)	0 (0%)	296 (51.93%)	274 (48.07%)	0 (0%)
ManySAT 1.1 aimd 0/2009-03-20 (4 threads) (complete)	292	185 (63.36%)	116 (39.73%)	69 (23.63%)	107 (36.64%)	0 (0%)
ManySAT 1.1 aimd 1/2009-03-20 (4 threads) (complete)	292	187 (64.04%)	119 (40.75%)	68 (23.29%)	105 (35.96%)	0 (0%)
ManySAT 1.1 aimd 2/2009-03-20 (4 threads) (complete)	292	181 (61.99%)	116 (39.73%)	65 (22.26%)	111 (38.01%)	0 (0%)
satake 2009-03-22 (16 threads) (complete)	292	106 (36.3%)	66 (22.6%)	40 (13.7%)	174 (59.59%)	12 (4.11%)
satake 2009-03-22 (4 threads) (complete)	292	118 (40.41%)	66 (22.6%)	52 (17.81%)	174 (59.59%)	0 (0%)
ttsth-5-0 2009-03-19 (16 threads) (complete)	292	7 (2.4%)	4 (1.37%)	3 (1.03%)	285 (97.6%)	0 (0%)
ttsth-5-0 2009-03-19 (4 threads) (complete)	292	7 (2.4%)	4 (1.37%)	3 (1.03%)	285 (97.6%)	0 (0%)