CSP 2006 Competition (second round): solvers page (tabular format, summary)

Category "binary constraints in extension" (2-ARY-EXT)

Solver Name#benchsSolvedUNSATSATUNKNOWNIncomplete AnswersBad AnswersMisc.
Abscon
109 ESAC		 11951081
(90.46%)		 498
(41.67%)		 583
(48.79%)		 114
(9.54%)		 0
(0%)		 0
(0%)		 0
Abscon
109 AC		 11951082
(90.54%)		 498
(41.67%)		 584
(48.87%)		 113
(9.46%)		 0
(0%)		 0
(0%)		 0
BPrologCSPSolver70a
2006-12-13		 1195938
(78.49%)		 444
(37.15%)		 494
(41.34%)		 257
(21.51%)		 0
(0%)		 0
(0%)		 0
buggy_2_5
2007-01-08		 11951092
(91.38%)		 504
(42.18%)		 588
(49.21%)		 103
(8.62%)		 0
(0%)		 0
(0%)		 0
buggy_2_5_s
2007-01-08		 11951093
(91.46%)		 504
(42.18%)		 589
(49.29%)		 102
(8.54%)		 0
(0%)		 0
(0%)		 0
CSP4J - Combo
2006-12-19		 11951026
(85.86%)		 483
(40.42%)		 543
(45.44%)		 167
(13.97%)		 0
(0%)		 2
(0.17%)		 0
CSP4J - MAC
2006-12-19		 11951026
(85.86%)		 491
(41.09%)		 535
(44.77%)		 167
(13.97%)		 0
(0%)		 2
(0.17%)		 0
CSP4J - MAC
2007-01-16		 11951025
(85.77%)		 491
(41.09%)		 534
(44.69%)		 170
(14.23%)		 0
(0%)		 0
(0%)		 0
CSPtoSAT+minisat
0.3		 1195877
(73.39%)		 403
(33.72%)		 474
(39.67%)		 318
(26.61%)		 0
(0%)		 0
(0%)		 0
Diarmuid-rndi
2006-12-21		 1195888
(74.31%)		 429
(35.9%)		 459
(38.41%)		 303
(25.36%)		 0
(0%)		 4
(0.33%)		 0
Diarmuid-rndi
2007-01-22		 1195883
(73.89%)		 429
(35.9%)		 454
(37.99%)		 308
(25.77%)		 0
(0%)		 4
(0.33%)		 0
Diarmuid-wtdi
2006-12-21		 1195823
(68.87%)		 384
(32.13%)		 439
(36.74%)		 368
(30.79%)		 0
(0%)		 4
(0.33%)		 0
galac
1		 1195940
(78.66%)		 444
(37.15%)		 496
(41.51%)		 255
(21.34%)		 0
(0%)		 0
(0%)		 0
galacJ
beta 1		 1195928
(77.66%)		 428
(35.82%)		 500
(41.84%)		 267
(22.34%)		 0
(0%)		 0
(0%)		 0
Mistral
2006-12-04		 11951060
(88.7%)		 498
(41.67%)		 562
(47.03%)		 135
(11.3%)		 0
(0%)		 0
(0%)		 0
rjw-solver
2006-12-09		 1195879
(73.56%)		 428
(35.82%)		 451
(37.74%)		 312
(26.11%)		 0
(0%)		 4
(0.33%)		 0
rjw-solver
2007-01-21		 1195879
(73.56%)		 428
(35.82%)		 451
(37.74%)		 313
(26.19%)		 0
(0%)		 3
(0.25%)		 0
sat4jCSP
1.7 RC BF3		 1195917
(76.74%)		 417
(34.9%)		 500
(41.84%)		 278
(23.26%)		 0
(0%)		 0
(0%)		 0
SAT4JCSP-CACHED
1.7 RC BF3		 1195915
(76.57%)		 414
(34.64%)		 501
(41.92%)		 280
(23.43%)		 0
(0%)		 0
(0%)		 0
sugar
0.40		 1195806
(67.45%)		 383
(32.05%)		 423
(35.4%)		 389
(32.55%)		 0
(0%)		 0
(0%)		 0
Tramontane
2006-12-04		 11951047
(87.62%)		 497
(41.59%)		 550
(46.03%)		 148
(12.38%)		 0
(0%)		 0
(0%)		 0
VALCSP
3.0		 11951093
(91.46%)		 503
(42.09%)		 590
(49.37%)		 102
(8.54%)		 0
(0%)		 0
(0%)		 0
VALCSP
3.1		 11951092
(91.38%)		 504
(42.18%)		 588
(49.21%)		 100
(8.37%)		 0
(0%)		 3
(0.25%)		 0

Solver NameProgress
Abscon
109 ESAC
done
1195
UNSAT
498		SAT
583		?
114
Abscon
109 AC
done
1195
UNSAT
498		SAT
584		?
113
BPrologCSPSolver70a
2006-12-13
done
1195
UNSAT
444		SAT
494		?
257
buggy_2_5
2007-01-08
done
1195
UNSAT
504		SAT
588		?
103
buggy_2_5_s
2007-01-08
done
1195
UNSAT
504		SAT
589		?
102
CSP4J - Combo
2006-12-19
done
1195
UNSAT
483		SAT
543		?
167		ERR
2
CSP4J - MAC
2006-12-19
done
1195
UNSAT
491		SAT
535		?
167		ERR
2
CSP4J - MAC
2007-01-16
done
1195
UNSAT
491		SAT
534		?
170
CSPtoSAT+minisat
0.3
done
1195
UNSAT
403		SAT
474		?
318
Diarmuid-rndi
2006-12-21
done
1195
UNSAT
429		SAT
459		?
303		ERR
4
Diarmuid-rndi
2007-01-22
done
1195
UNSAT
429		SAT
454		?
308		ERR
4
Diarmuid-wtdi
2006-12-21
done
1195
UNSAT
384		SAT
439		?
368		ERR
4
galac
1
done
1195
UNSAT
444		SAT
496		?
255
galacJ
beta 1
done
1195
UNSAT
428		SAT
500		?
267
Mistral
2006-12-04
done
1195
UNSAT
498		SAT
562		?
135
rjw-solver
2006-12-09
done
1195
UNSAT
428		SAT
451		?
312		ERR
4
rjw-solver
2007-01-21
done
1195
UNSAT
428		SAT
451		?
313		ERR
3
sat4jCSP
1.7 RC BF3
done
1195
UNSAT
417		SAT
500		?
278
SAT4JCSP-CACHED
1.7 RC BF3
done
1195
UNSAT
414		SAT
501		?
280
sugar
0.40
done
1195
UNSAT
383		SAT
423		?
389
Tramontane
2006-12-04
done
1195
UNSAT
497		SAT
550		?
148
VALCSP
3.0
done
1195
UNSAT
503		SAT
590		?
102
VALCSP
3.1
done
1195
UNSAT
504		SAT
588		?
100		ERR
3

Category "binary constraints in intension" (2-ARY-INT)

Solver Name#benchsSolvedUNSATSATUNKNOWNIncomplete AnswersBad AnswersMisc.
Abscon
109 ESAC		 774575
(74.29%)		 276
(35.66%)		 299
(38.63%)		 199
(25.71%)		 0
(0%)		 0
(0%)		 0
Abscon
109 AC		 774561
(72.48%)		 268
(34.63%)		 293
(37.86%)		 213
(27.52%)		 0
(0%)		 0
(0%)		 0
BPrologCSPSolver70a
2006-12-13		 774226
(29.2%)		 110
(14.21%)		 116
(14.99%)		 548
(70.8%)		 0
(0%)		 0
(0%)		 0
buggy_2_5
2007-01-08		 774626
(80.88%)		 315
(40.7%)		 311
(40.18%)		 148
(19.12%)		 0
(0%)		 0
(0%)		 0
buggy_2_5_s
2007-01-08		 774627
(81.01%)		 317
(40.96%)		 310
(40.05%)		 147
(18.99%)		 0
(0%)		 0
(0%)		 0
CSP4J - Combo
2006-12-19		 774438
(56.59%)		 223
(28.81%)		 215
(27.78%)		 336
(43.41%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2006-12-19		 774432
(55.81%)		 225
(29.07%)		 207
(26.74%)		 342
(44.19%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2007-01-16		 774405
(52.33%)		 205
(26.49%)		 200
(25.84%)		 369
(47.67%)		 0
(0%)		 0
(0%)		 0
CSPtoSAT+minisat
0.3		 77455
(7.11%)		 46
(5.94%)		 9
(1.16%)		 719
(92.89%)		 0
(0%)		 0
(0%)		 0
galac
1		 774245
(31.65%)		 118
(15.25%)		 127
(16.41%)		 529
(68.35%)		 0
(0%)		 0
(0%)		 0
galacJ
beta 1		 774220
(28.42%)		 109
(14.08%)		 111
(14.34%)		 554
(71.58%)		 0
(0%)		 0
(0%)		 0
Mistral
2006-12-04		 774423
(54.65%)		 203
(26.23%)		 220
(28.42%)		 351
(45.35%)		 0
(0%)		 0
(0%)		 0
sat4jCSP
1.7 RC BF3		 774258
(33.33%)		 117
(15.12%)		 141
(18.22%)		 516
(66.67%)		 0
(0%)		 0
(0%)		 0
SAT4JCSP-CACHED
1.7 RC BF3		 774217
(28.04%)		 97
(12.53%)		 120
(15.5%)		 557
(71.96%)		 0
(0%)		 0
(0%)		 0
sugar
0.40		 774276
(35.66%)		 101
(13.05%)		 175
(22.61%)		 498
(64.34%)		 0
(0%)		 0
(0%)		 0
Tramontane
2006-12-04		 774457
(59.04%)		 223
(28.81%)		 234
(30.23%)		 317
(40.96%)		 0
(0%)		 0
(0%)		 0
VALCSP
3.0		 774289
(37.34%)		 133
(17.18%)		 156
(20.16%)		 436
(56.33%)		 0
(0%)		 49
(6.33%)		 0
VALCSP
3.1		 774281
(36.3%)		 135
(17.44%)		 146
(18.86%)		 482
(62.27%)		 0
(0%)		 11
(1.42%)		 0

Solver NameProgress
Abscon
109 ESAC
done
774
UNSAT
276		SAT
299		?
199
Abscon
109 AC
done
774
UNSAT
268		SAT
293		?
213
BPrologCSPSolver70a
2006-12-13
done
774
UNSAT
110		SAT
116		?
548
buggy_2_5
2007-01-08
done
774
UNSAT
315		SAT
311		?
148
buggy_2_5_s
2007-01-08
done
774
UNSAT
317		SAT
310		?
147
CSP4J - Combo
2006-12-19
done
774
UNSAT
223		SAT
215		?
336
CSP4J - MAC
2006-12-19
done
774
UNSAT
225		SAT
207		?
342
CSP4J - MAC
2007-01-16
done
774
UNSAT
205		SAT
200		?
369
CSPtoSAT+minisat
0.3
done
774
UNSAT
46		SAT
9		?
719
galac
1
done
774
UNSAT
118		SAT
127		?
529
galacJ
beta 1
done
774
UNSAT
109		SAT
111		?
554
Mistral
2006-12-04
done
774
UNSAT
203		SAT
220		?
351
sat4jCSP
1.7 RC BF3
done
774
UNSAT
117		SAT
141		?
516
SAT4JCSP-CACHED
1.7 RC BF3
done
774
UNSAT
97		SAT
120		?
557
sugar
0.40
done
774
UNSAT
101		SAT
175		?
498
Tramontane
2006-12-04
done
774
UNSAT
223		SAT
234		?
317
VALCSP
3.0
done
774
UNSAT
133		SAT
156		?
436		ERR
49
VALCSP
3.1
done
774
UNSAT
135		SAT
146		?
482		ERR
11

Category "global constraints" (GLOBAL)

Solver Name#benchsSolvedUNSATSATUNKNOWNIncomplete AnswersBad AnswersMisc.
Abscon
109 ESAC		 132126
(95.45%)		 22
(16.67%)		 104
(78.79%)		 6
(4.55%)		 0
(0%)		 0
(0%)		 0
Abscon
109 AC		 132127
(96.21%)		 22
(16.67%)		 105
(79.55%)		 5
(3.79%)		 0
(0%)		 0
(0%)		 0
BPrologCSPSolver70a
2006-12-13		 132127
(96.21%)		 22
(16.67%)		 105
(79.55%)		 5
(3.79%)		 0
(0%)		 0
(0%)		 0
CSP4J - Combo
2006-12-19		 132126
(95.45%)		 22
(16.67%)		 104
(78.79%)		 6
(4.55%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2006-12-19		 132126
(95.45%)		 22
(16.67%)		 104
(78.79%)		 6
(4.55%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2007-01-16		 132125
(94.7%)		 22
(16.67%)		 103
(78.03%)		 7
(5.3%)		 0
(0%)		 0
(0%)		 0
CSPtoSAT+minisat
0.3		 132114
(86.36%)		 11
(8.33%)		 103
(78.03%)		 18
(13.64%)		 0
(0%)		 0
(0%)		 0
galac
1		 132110
(83.33%)		 8
(6.06%)		 102
(77.27%)		 22
(16.67%)		 0
(0%)		 0
(0%)		 0
galacJ
beta 1		 132106
(80.3%)		 4
(3.03%)		 102
(77.27%)		 21
(15.91%)		 0
(0%)		 5
(3.79%)		 0
Mistral
2006-12-04		 132125
(94.7%)		 22
(16.67%)		 103
(78.03%)		 7
(5.3%)		 0
(0%)		 0
(0%)		 0
sat4jCSP
1.7 RC BF3		 132115
(87.12%)		 10
(7.58%)		 105
(79.55%)		 17
(12.88%)		 0
(0%)		 0
(0%)		 0
SAT4JCSP-CACHED
1.7 RC BF3		 132114
(86.36%)		 10
(7.58%)		 104
(78.79%)		 18
(13.64%)		 0
(0%)		 0
(0%)		 0
sugar
0.40		 132118
(89.39%)		 13
(9.85%)		 105
(79.55%)		 14
(10.61%)		 0
(0%)		 0
(0%)		 0
Tramontane
2006-12-04		 132125
(94.7%)		 22
(16.67%)		 103
(78.03%)		 7
(5.3%)		 0
(0%)		 0
(0%)		 0

Solver NameProgress
Abscon
109 ESAC
done
132
UNSAT
22		SAT
104		?
6
Abscon
109 AC
done
132
UNSAT
22		SAT
105		?
5
BPrologCSPSolver70a
2006-12-13
done
132
UNSAT
22		SAT
105		?
5
CSP4J - Combo
2006-12-19
done
132
UNSAT
22		SAT
104		?
6
CSP4J - MAC
2006-12-19
done
132
UNSAT
22		SAT
104		?
6
CSP4J - MAC
2007-01-16
done
132
UNSAT
22		SAT
103		?
7
CSPtoSAT+minisat
0.3
done
132
UNSAT
11		SAT
103		?
18
galac
1
done
132
UNSAT
8		SAT
102		?
22
galacJ
beta 1
done
132
UNSAT
4		SAT
102		?
21		ERR
5
Mistral
2006-12-04
done
132
UNSAT
22		SAT
103		?
7
sat4jCSP
1.7 RC BF3
done
132
UNSAT
10		SAT
105		?
17
SAT4JCSP-CACHED
1.7 RC BF3
done
132
UNSAT
10		SAT
104		?
18
sugar
0.40
done
132
UNSAT
13		SAT
105		?
14
Tramontane
2006-12-04
done
132
UNSAT
22		SAT
103		?
7

Category "n-ary constraints in extension" (N-ARY-EXT)

Solver Name#benchsSolvedUNSATSATUNKNOWNIncomplete AnswersBad AnswersMisc.
Abscon
109 ESAC		 399276
(69.17%)		 112
(28.07%)		 164
(41.1%)		 123
(30.83%)		 0
(0%)		 0
(0%)		 0
Abscon
109 AC		 399277
(69.42%)		 111
(27.82%)		 166
(41.6%)		 122
(30.58%)		 0
(0%)		 0
(0%)		 0
BPrologCSPSolver70a
2006-12-13		 399150
(37.59%)		 61
(15.29%)		 89
(22.31%)		 249
(62.41%)		 0
(0%)		 0
(0%)		 0
CSP4J - Combo
2006-12-19		 399219
(54.89%)		 83
(20.8%)		 136
(34.09%)		 180
(45.11%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2006-12-19		 399234
(58.65%)		 90
(22.56%)		 144
(36.09%)		 165
(41.35%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2007-01-16		 399239
(59.9%)		 91
(22.81%)		 148
(37.09%)		 160
(40.1%)		 0
(0%)		 0
(0%)		 0
CSPtoSAT+minisat
0.3		 399176
(44.11%)		 98
(24.56%)		 78
(19.55%)		 223
(55.89%)		 0
(0%)		 0
(0%)		 0
galac
1		 399191
(47.87%)		 98
(24.56%)		 93
(23.31%)		 208
(52.13%)		 0
(0%)		 0
(0%)		 0
galacJ
beta 1		 399175
(43.86%)		 97
(24.31%)		 78
(19.55%)		 224
(56.14%)		 0
(0%)		 0
(0%)		 0
Mistral
2006-12-04		 399269
(67.42%)		 100
(25.06%)		 169
(42.36%)		 130
(32.58%)		 0
(0%)		 0
(0%)		 0
sat4jCSP
1.7 RC BF3		 399187
(46.87%)		 84
(21.05%)		 103
(25.81%)		 212
(53.13%)		 0
(0%)		 0
(0%)		 0
SAT4JCSP-CACHED
1.7 RC BF3		 399187
(46.87%)		 84
(21.05%)		 103
(25.81%)		 212
(53.13%)		 0
(0%)		 0
(0%)		 0
sugar
0.40		 399161
(40.35%)		 87
(21.8%)		 74
(18.55%)		 238
(59.65%)		 0
(0%)		 0
(0%)		 0
Tramontane
2006-12-04		 399260
(65.16%)		 95
(23.81%)		 165
(41.35%)		 139
(34.84%)		 0
(0%)		 0
(0%)		 0

Solver NameProgress
Abscon
109 ESAC
done
399
UNSAT
112		SAT
164		?
123
Abscon
109 AC
done
399
UNSAT
111		SAT
166		?
122
BPrologCSPSolver70a
2006-12-13
done
399
UNSAT
61		SAT
89		?
249
CSP4J - Combo
2006-12-19
done
399
UNSAT
83		SAT
136		?
180
CSP4J - MAC
2006-12-19
done
399
UNSAT
90		SAT
144		?
165
CSP4J - MAC
2007-01-16
done
399
UNSAT
91		SAT
148		?
160
CSPtoSAT+minisat
0.3
done
399
UNSAT
98		SAT
78		?
223
galac
1
done
399
UNSAT
98		SAT
93		?
208
galacJ
beta 1
done
399
UNSAT
97		SAT
78		?
224
Mistral
2006-12-04
done
399
UNSAT
100		SAT
169		?
130
sat4jCSP
1.7 RC BF3
done
399
UNSAT
84		SAT
103		?
212
SAT4JCSP-CACHED
1.7 RC BF3
done
399
UNSAT
84		SAT
103		?
212
sugar
0.40
done
399
UNSAT
87		SAT
74		?
238
Tramontane
2006-12-04
done
399
UNSAT
95		SAT
165		?
139

Category "n-ary constraints in intension" (N-ARY-INT)

Solver Name#benchsSolvedUNSATSATUNKNOWNIncomplete AnswersBad AnswersMisc.
Abscon
109 ESAC		 925509
(55.03%)		 52
(5.62%)		 457
(49.41%)		 416
(44.97%)		 0
(0%)		 0
(0%)		 0
Abscon
109 AC		 925490
(52.97%)		 51
(5.51%)		 439
(47.46%)		 435
(47.03%)		 0
(0%)		 0
(0%)		 0
BPrologCSPSolver70a
2006-12-13		 925579
(62.59%)		 120
(12.97%)		 459
(49.62%)		 346
(37.41%)		 0
(0%)		 0
(0%)		 0
CSP4J - Combo
2006-12-19		 925364
(39.35%)		 39
(4.22%)		 325
(35.14%)		 561
(60.65%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2006-12-19		 925370
(40%)		 39
(4.22%)		 331
(35.78%)		 555
(60%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2007-01-16		 925346
(37.41%)		 38
(4.11%)		 308
(33.3%)		 504
(54.49%)		 0
(0%)		 75
(8.11%)		 0
CSPtoSAT+minisat
0.3		 925395
(42.7%)		 60
(6.49%)		 335
(36.22%)		 530
(57.3%)		 0
(0%)		 0
(0%)		 0
galac
1		 925352
(38.05%)		 65
(7.03%)		 287
(31.03%)		 573
(61.95%)		 0
(0%)		 0
(0%)		 0
galacJ
beta 1		 925331
(35.78%)		 63
(6.81%)		 268
(28.97%)		 594
(64.22%)		 0
(0%)		 0
(0%)		 0
Mistral
2006-12-04		 925304
(32.86%)		 50
(5.41%)		 254
(27.46%)		 621
(67.14%)		 0
(0%)		 0
(0%)		 0
sat4jCSP
1.7 RC BF3		 925228
(24.65%)		 40
(4.32%)		 188
(20.32%)		 697
(75.35%)		 0
(0%)		 0
(0%)		 0
SAT4JCSP-CACHED
1.7 RC BF3		 925219
(23.68%)		 36
(3.89%)		 183
(19.78%)		 686
(74.16%)		 0
(0%)		 20
(2.16%)		 0
sugar
0.40		 925431
(46.59%)		 77
(8.32%)		 354
(38.27%)		 493
(53.3%)		 1
(0.11%)		 0
(0%)		 0
Tramontane
2006-12-04		 925313
(33.84%)		 45
(4.86%)		 268
(28.97%)		 612
(66.16%)		 0
(0%)		 0
(0%)		 0

Solver NameProgress
Abscon
109 ESAC
done
925
UNSAT
52		SAT
457		?
416
Abscon
109 AC
done
925
UNSAT
51		SAT
439		?
435
BPrologCSPSolver70a
2006-12-13
done
925
UNSAT
120		SAT
459		?
346
CSP4J - Combo
2006-12-19
done
925
UNSAT
39		SAT
325		?
561
CSP4J - MAC
2006-12-19
done
925
UNSAT
39		SAT
331		?
555
CSP4J - MAC
2007-01-16
done
925
UNSAT
38		SAT
308		?
504		ERR
75
CSPtoSAT+minisat
0.3
done
925
UNSAT
60		SAT
335		?
530
galac
1
done
925
UNSAT
65		SAT
287		?
573
galacJ
beta 1
done
925
UNSAT
63		SAT
268		?
594
Mistral
2006-12-04
done
925
UNSAT
50		SAT
254		?
621
sat4jCSP
1.7 RC BF3
done
925
UNSAT
40		SAT
188		?
697
SAT4JCSP-CACHED
1.7 RC BF3
done
925
UNSAT
36		SAT
183		?
686		ERR
20
sugar
0.40
done
925
UNSAT
77		SAT
354		?
493		Inc. Answer
1
Tramontane
2006-12-04
done
925
UNSAT
45		SAT
268		?
612

All categories for solvers registered in all categories

Solver Name#benchsSolvedUNSATSATUNKNOWNIncomplete AnswersBad AnswersMisc.
Abscon
109 ESAC		 34252567
(74.95%)		 960
(28.03%)		 1607
(46.92%)		 858
(25.05%)		 0
(0%)		 0
(0%)		 0
Abscon
109 AC		 34252537
(74.07%)		 950
(27.74%)		 1587
(46.34%)		 888
(25.93%)		 0
(0%)		 0
(0%)		 0
BPrologCSPSolver70a
2006-12-13		 34252020
(58.98%)		 757
(22.1%)		 1263
(36.88%)		 1405
(41.02%)		 0
(0%)		 0
(0%)		 0
CSP4J - Combo
2006-12-19		 34252173
(63.45%)		 850
(24.82%)		 1323
(38.63%)		 1250
(36.5%)		 0
(0%)		 2
(0.06%)		 0
CSP4J - MAC
2006-12-19		 34252188
(63.88%)		 867
(25.31%)		 1321
(38.57%)		 1235
(36.06%)		 0
(0%)		 2
(0.06%)		 0
CSP4J - MAC
2007-01-16		 34252140
(62.48%)		 847
(24.73%)		 1293
(37.75%)		 1210
(35.33%)		 0
(0%)		 75
(2.19%)		 0
CSPtoSAT+minisat
0.3		 34251617
(47.21%)		 618
(18.04%)		 999
(29.17%)		 1808
(52.79%)		 0
(0%)		 0
(0%)		 0
galac
1		 34251838
(53.66%)		 733
(21.4%)		 1105
(32.26%)		 1587
(46.34%)		 0
(0%)		 0
(0%)		 0
galacJ
beta 1		 34251760
(51.39%)		 701
(20.47%)		 1059
(30.92%)		 1660
(48.47%)		 0
(0%)		 5
(0.15%)		 0
Mistral
2006-12-04		 34252181
(63.68%)		 873
(25.49%)		 1308
(38.19%)		 1244
(36.32%)		 0
(0%)		 0
(0%)		 0
sat4jCSP
1.7 RC BF3		 34251705
(49.78%)		 668
(19.5%)		 1037
(30.28%)		 1720
(50.22%)		 0
(0%)		 0
(0%)		 0
SAT4JCSP-CACHED
1.7 RC BF3		 34251652
(48.23%)		 641
(18.72%)		 1011
(29.52%)		 1753
(51.18%)		 0
(0%)		 20
(0.58%)		 0
sugar
0.40		 34251792
(52.32%)		 661
(19.3%)		 1131
(33.02%)		 1632
(47.65%)		 1
(0.03%)		 0
(0%)		 0
Tramontane
2006-12-04		 34252202
(64.29%)		 882
(25.75%)		 1320
(38.54%)		 1223
(35.71%)		 0
(0%)		 0
(0%)		 0

Solver NameProgress
Abscon
109 ESAC
done
3425
UNSAT
960		SAT
1607		?
858
Abscon
109 AC
done
3425
UNSAT
950		SAT
1587		?
888
BPrologCSPSolver70a
2006-12-13
done
3425
UNSAT
757		SAT
1263		?
1405
CSP4J - Combo
2006-12-19
done
3425
UNSAT
850		SAT
1323		?
1250		ERR
2
CSP4J - MAC
2006-12-19
done
3425
UNSAT
867		SAT
1321		?
1235		ERR
2
CSP4J - MAC
2007-01-16
done
3425
UNSAT
847		SAT
1293		?
1210		ERR
75
CSPtoSAT+minisat
0.3
done
3425
UNSAT
618		SAT
999		?
1808
galac
1
done
3425
UNSAT
733		SAT
1105		?
1587
galacJ
beta 1
done
3425
UNSAT
701		SAT
1059		?
1660		ERR
5
Mistral
2006-12-04
done
3425
UNSAT
873		SAT
1308		?
1244
sat4jCSP
1.7 RC BF3
done
3425
UNSAT
668		SAT
1037		?
1720
SAT4JCSP-CACHED
1.7 RC BF3
done
3425
UNSAT
641		SAT
1011		?
1753		ERR
20
sugar
0.40
done
3425
UNSAT
661		SAT
1131		?
1632		Inc. Answer
1
Tramontane
2006-12-04
done
3425
UNSAT
882		SAT
1320		?
1223

All categories and all solvers (regardless of their ability to support all categories)

This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.

Solver Name#benchsSolvedUNSATSATUNKNOWNIncomplete AnswersBad AnswersMisc.
Abscon
109 ESAC		 34252567
(74.95%)		 960
(28.03%)		 1607
(46.92%)		 858
(25.05%)		 0
(0%)		 0
(0%)		 0
Abscon
109 AC		 34252537
(74.07%)		 950
(27.74%)		 1587
(46.34%)		 888
(25.93%)		 0
(0%)		 0
(0%)		 0
BPrologCSPSolver70a
2006-12-13		 34252020
(58.98%)		 757
(22.1%)		 1263
(36.88%)		 1405
(41.02%)		 0
(0%)		 0
(0%)		 0
buggy_2_5
2007-01-08		 19691718
(87.25%)		 819
(41.59%)		 899
(45.66%)		 251
(12.75%)		 0
(0%)		 0
(0%)		 0
buggy_2_5_s
2007-01-08		 19691720
(87.35%)		 821
(41.7%)		 899
(45.66%)		 249
(12.65%)		 0
(0%)		 0
(0%)		 0
CSP4J - Combo
2006-12-19		 34252173
(63.45%)		 850
(24.82%)		 1323
(38.63%)		 1250
(36.5%)		 0
(0%)		 2
(0.06%)		 0
CSP4J - MAC
2006-12-19		 34252188
(63.88%)		 867
(25.31%)		 1321
(38.57%)		 1235
(36.06%)		 0
(0%)		 2
(0.06%)		 0
CSP4J - MAC
2007-01-16		 34252140
(62.48%)		 847
(24.73%)		 1293
(37.75%)		 1210
(35.33%)		 0
(0%)		 75
(2.19%)		 0
CSPtoSAT+minisat
0.3		 34251617
(47.21%)		 618
(18.04%)		 999
(29.17%)		 1808
(52.79%)		 0
(0%)		 0
(0%)		 0
Diarmuid-rndi
2006-12-21		 1195888
(74.31%)		 429
(35.9%)		 459
(38.41%)		 303
(25.36%)		 0
(0%)		 4
(0.33%)		 0
Diarmuid-rndi
2007-01-22		 1195883
(73.89%)		 429
(35.9%)		 454
(37.99%)		 308
(25.77%)		 0
(0%)		 4
(0.33%)		 0
Diarmuid-wtdi
2006-12-21		 1195823
(68.87%)		 384
(32.13%)		 439
(36.74%)		 368
(30.79%)		 0
(0%)		 4
(0.33%)		 0
galac
1		 34251838
(53.66%)		 733
(21.4%)		 1105
(32.26%)		 1587
(46.34%)		 0
(0%)		 0
(0%)		 0
galacJ
beta 1		 34251760
(51.39%)		 701
(20.47%)		 1059
(30.92%)		 1660
(48.47%)		 0
(0%)		 5
(0.15%)		 0
Mistral
2006-12-04		 34252181
(63.68%)		 873
(25.49%)		 1308
(38.19%)		 1244
(36.32%)		 0
(0%)		 0
(0%)		 0
rjw-solver
2006-12-09		 1195879
(73.56%)		 428
(35.82%)		 451
(37.74%)		 312
(26.11%)		 0
(0%)		 4
(0.33%)		 0
rjw-solver
2007-01-21		 1195879
(73.56%)		 428
(35.82%)		 451
(37.74%)		 313
(26.19%)		 0
(0%)		 3
(0.25%)		 0
sat4jCSP
1.7 RC BF3		 34251705
(49.78%)		 668
(19.5%)		 1037
(30.28%)		 1720
(50.22%)		 0
(0%)		 0
(0%)		 0
SAT4JCSP-CACHED
1.7 RC BF3		 34251652
(48.23%)		 641
(18.72%)		 1011
(29.52%)		 1753
(51.18%)		 0
(0%)		 20
(0.58%)		 0
sugar
0.40		 34251792
(52.32%)		 661
(19.3%)		 1131
(33.02%)		 1632
(47.65%)		 1
(0.03%)		 0
(0%)		 0
Tramontane
2006-12-04		 34252202
(64.29%)		 882
(25.75%)		 1320
(38.54%)		 1223
(35.71%)		 0
(0%)		 0
(0%)		 0
VALCSP
3.0		 19691382
(70.19%)		 636
(32.3%)		 746
(37.89%)		 538
(27.32%)		 0
(0%)		 49
(2.49%)		 0
VALCSP
3.1		 19691373
(69.73%)		 639
(32.45%)		 734
(37.28%)		 582
(29.56%)		 0
(0%)		 14
(0.71%)		 0

Solver NameProgress
Abscon
109 ESAC
done
3425
UNSAT
960		SAT
1607		?
858
Abscon
109 AC
done
3425
UNSAT
950		SAT
1587		?
888
BPrologCSPSolver70a
2006-12-13
done
3425
UNSAT
757		SAT
1263		?
1405
buggy_2_5
2007-01-08
done
1969
UNSAT
819		SAT
899		?
251
buggy_2_5_s
2007-01-08
done
1969
UNSAT
821		SAT
899		?
249
CSP4J - Combo
2006-12-19
done
3425
UNSAT
850		SAT
1323		?
1250		ERR
2
CSP4J - MAC
2006-12-19
done
3425
UNSAT
867		SAT
1321		?
1235		ERR
2
CSP4J - MAC
2007-01-16
done
3425
UNSAT
847		SAT
1293		?
1210		ERR
75
CSPtoSAT+minisat
0.3
done
3425
UNSAT
618		SAT
999		?
1808
Diarmuid-rndi
2006-12-21
done
1195
UNSAT
429		SAT
459		?
303		ERR
4
Diarmuid-rndi
2007-01-22
done
1195
UNSAT
429		SAT
454		?
308		ERR
4
Diarmuid-wtdi
2006-12-21
done
1195
UNSAT
384		SAT
439		?
368		ERR
4
galac
1
done
3425
UNSAT
733		SAT
1105		?
1587
galacJ
beta 1
done
3425
UNSAT
701		SAT
1059		?
1660		ERR
5
Mistral
2006-12-04
done
3425
UNSAT
873		SAT
1308		?
1244
rjw-solver
2006-12-09
done
1195
UNSAT
428		SAT
451		?
312		ERR
4
rjw-solver
2007-01-21
done
1195
UNSAT
428		SAT
451		?
313		ERR
3
sat4jCSP
1.7 RC BF3
done
3425
UNSAT
668		SAT
1037		?
1720
SAT4JCSP-CACHED
1.7 RC BF3
done
3425
UNSAT
641		SAT
1011		?
1753		ERR
20
sugar
0.40
done
3425
UNSAT
661		SAT
1131		?
1632		Inc. Answer
1
Tramontane
2006-12-04
done
3425
UNSAT
882		SAT
1320		?
1223
VALCSP
3.0
done
1969
UNSAT
636		SAT
746		?
538		ERR
49
VALCSP
3.1
done
1969
UNSAT
639		SAT
734		?
582		ERR
14

Some explanations