CSP 2006 Competition (second round): solvers page (tabular format, detailed results)

Category "binary constraints in extension" (2-ARY-EXT)

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.Misc.
Abscon
109 ESAC		 11951081
(90.46%)		 498
(41.67%)		 583
(48.79%)		 0
(0%)		 0
(0%)		 114
(9.54%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Abscon
109 AC		 11951082
(90.54%)		 498
(41.67%)		 584
(48.87%)		 0
(0%)		 0
(0%)		 113
(9.46%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
BPrologCSPSolver70a
2006-12-13		 1195938
(78.49%)		 444
(37.15%)		 494
(41.34%)		 0
(0%)		 0
(0%)		 237
(19.83%)		 0
(0%)		 0
(0%)		 20
(1.67%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
buggy_2_5
2007-01-08		 11951092
(91.38%)		 504
(42.18%)		 588
(49.21%)		 0
(0%)		 0
(0%)		 103
(8.62%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
buggy_2_5_s
2007-01-08		 11951093
(91.46%)		 504
(42.18%)		 589
(49.29%)		 0
(0%)		 0
(0%)		 102
(8.54%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - Combo
2006-12-19		 11951026
(85.86%)		 483
(40.42%)		 543
(45.44%)		 0
(0%)		 9
(0.75%)		 158
(13.22%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 2
(0.17%)		 0
(0%)		 0
CSP4J - MAC
2006-12-19		 11951026
(85.86%)		 491
(41.09%)		 535
(44.77%)		 0
(0%)		 9
(0.75%)		 158
(13.22%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 2
(0.17%)		 0
(0%)		 0
CSP4J - MAC
2007-01-16		 11951025
(85.77%)		 491
(41.09%)		 534
(44.69%)		 0
(0%)		 10
(0.84%)		 160
(13.39%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSPtoSAT+minisat
0.3		 1195877
(73.39%)		 403
(33.72%)		 474
(39.67%)		 0
(0%)		 0
(0%)		 254
(21.26%)		 64
(5.36%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Diarmuid-rndi
2006-12-21		 1195888
(74.31%)		 429
(35.9%)		 459
(38.41%)		 0
(0%)		 0
(0%)		 184
(15.4%)		 1
(0.08%)		 0
(0%)		 22
(1.84%)		 96
(8.03%)		 0
(0%)		 0
(0%)		 4
(0.33%)		 0
(0%)		 0
Diarmuid-rndi
2007-01-22		 1195883
(73.89%)		 429
(35.9%)		 454
(37.99%)		 0
(0%)		 0
(0%)		 190
(15.9%)		 1
(0.08%)		 0
(0%)		 17
(1.42%)		 100
(8.37%)		 0
(0%)		 0
(0%)		 3
(0.25%)		 1
(0.08%)		 0
Diarmuid-wtdi
2006-12-21		 1195823
(68.87%)		 384
(32.13%)		 439
(36.74%)		 0
(0%)		 0
(0%)		 244
(20.42%)		 1
(0.08%)		 0
(0%)		 21
(1.76%)		 102
(8.54%)		 0
(0%)		 0
(0%)		 4
(0.33%)		 0
(0%)		 0
galac
1		 1195940
(78.66%)		 444
(37.15%)		 496
(41.51%)		 0
(0%)		 0
(0%)		 235
(19.67%)		 2
(0.17%)		 0
(0%)		 0
(0%)		 18
(1.51%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
galacJ
beta 1		 1195928
(77.66%)		 428
(35.82%)		 500
(41.84%)		 0
(0%)		 0
(0%)		 245
(20.5%)		 0
(0%)		 0
(0%)		 0
(0%)		 22
(1.84%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Mistral
2006-12-04		 11951060
(88.7%)		 498
(41.67%)		 562
(47.03%)		 0
(0%)		 0
(0%)		 135
(11.3%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
rjw-solver
2006-12-09		 1195879
(73.56%)		 428
(35.82%)		 451
(37.74%)		 0
(0%)		 0
(0%)		 193
(16.15%)		 1
(0.08%)		 0
(0%)		 18
(1.51%)		 100
(8.37%)		 0
(0%)		 0
(0%)		 4
(0.33%)		 0
(0%)		 0
rjw-solver
2007-01-21		 1195879
(73.56%)		 428
(35.82%)		 451
(37.74%)		 0
(0%)		 0
(0%)		 195
(16.32%)		 1
(0.08%)		 0
(0%)		 17
(1.42%)		 100
(8.37%)		 0
(0%)		 0
(0%)		 2
(0.17%)		 1
(0.08%)		 0
sat4jCSP
1.7 RC BF3		 1195917
(76.74%)		 417
(34.9%)		 500
(41.84%)		 0
(0%)		 0
(0%)		 276
(23.1%)		 2
(0.17%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
SAT4JCSP-CACHED
1.7 RC BF3		 1195915
(76.57%)		 414
(34.64%)		 501
(41.92%)		 0
(0%)		 0
(0%)		 278
(23.26%)		 2
(0.17%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
sugar
0.40		 1195806
(67.45%)		 383
(32.05%)		 423
(35.4%)		 0
(0%)		 20
(1.67%)		 369
(30.88%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Tramontane
2006-12-04		 11951047
(87.62%)		 497
(41.59%)		 550
(46.03%)		 0
(0%)		 0
(0%)		 148
(12.38%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
VALCSP
3.0		 11951093
(91.46%)		 503
(42.09%)		 590
(49.37%)		 0
(0%)		 0
(0%)		 101
(8.45%)		 1
(0.08%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
VALCSP
3.1		 11951092
(91.38%)		 504
(42.18%)		 588
(49.21%)		 0
(0%)		 0
(0%)		 99
(8.28%)		 1
(0.08%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 3
(0.25%)		 0
(0%)		 0

Solver NameProgress
Abscon
109 ESAC
done
1195
UNSAT.
498		SAT.
583		? (TO)
114
Abscon
109 AC
done
1195
UNSAT.
498		SAT.
584		? (TO)
113
BPrologCSPSolver70a
2006-12-13
done
1195
UNSAT.
444		SAT.
494		? (TO)
237		? (Conv)
20
buggy_2_5
2007-01-08
done
1195
UNSAT.
504		SAT.
588		? (TO)
103
buggy_2_5_s
2007-01-08
done
1195
UNSAT.
504		SAT.
589		? (TO)
102
CSP4J - Combo
2006-12-19
done
1195
UNSAT.
483		SAT.
543		?
9		? (TO)
158		ERR CERT
2
CSP4J - MAC
2006-12-19
done
1195
UNSAT.
491		SAT.
535		?
9		? (TO)
158		ERR CERT
2
CSP4J - MAC
2007-01-16
done
1195
UNSAT.
491		SAT.
534		?
10		? (TO)
160
CSPtoSAT+minisat
0.3
done
1195
UNSAT.
403		SAT.
474		? (TO)
254		? (MO)
64
Diarmuid-rndi
2006-12-21
done
1195
UNSAT.
429		SAT.
459		? (TO)
184		? (MO)
1		? (Conv)
22		? (?)
96		ERR CERT
4
Diarmuid-rndi
2007-01-22
done
1195
UNSAT.
429		SAT.
454		? (TO)
190		? (MO)
1		? (Conv)
17		? (?)
100		ERR CERT
3		WRONG UNSAT.
1
Diarmuid-wtdi
2006-12-21
done
1195
UNSAT.
384		SAT.
439		? (TO)
244		? (MO)
1		? (Conv)
21		? (?)
102		ERR CERT
4
galac
1
done
1195
UNSAT.
444		SAT.
496		? (TO)
235		? (MO)
2		? (?)
18
galacJ
beta 1
done
1195
UNSAT.
428		SAT.
500		? (TO)
245		? (?)
22
Mistral
2006-12-04
done
1195
UNSAT.
498		SAT.
562		? (TO)
135
rjw-solver
2006-12-09
done
1195
UNSAT.
428		SAT.
451		? (TO)
193		? (MO)
1		? (Conv)
18		? (?)
100		ERR CERT
4
rjw-solver
2007-01-21
done
1195
UNSAT.
428		SAT.
451		? (TO)
195		? (MO)
1		? (Conv)
17		? (?)
100		ERR CERT
2		WRONG UNSAT.
1
sat4jCSP
1.7 RC BF3
done
1195
UNSAT.
417		SAT.
500		? (TO)
276		? (MO)
2
SAT4JCSP-CACHED
1.7 RC BF3
done
1195
UNSAT.
414		SAT.
501		? (TO)
278		? (MO)
2
sugar
0.40
done
1195
UNSAT.
383		SAT.
423		?
20		? (TO)
369
Tramontane
2006-12-04
done
1195
UNSAT.
497		SAT.
550		? (TO)
148
VALCSP
3.0
done
1195
UNSAT.
503		SAT.
590		? (TO)
101		? (MO)
1
VALCSP
3.1
done
1195
UNSAT.
504		SAT.
588		? (TO)
99		? (MO)
1		ERR CERT
3

Category "binary constraints in intension" (2-ARY-INT)

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.Misc.
Abscon
109 ESAC		 774575
(74.29%)		 276
(35.66%)		 299
(38.63%)		 0
(0%)		 1
(0.13%)		 197
(25.45%)		 1
(0.13%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Abscon
109 AC		 774561
(72.48%)		 268
(34.63%)		 293
(37.86%)		 0
(0%)		 1
(0.13%)		 212
(27.39%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
BPrologCSPSolver70a
2006-12-13		 774226
(29.2%)		 110
(14.21%)		 116
(14.99%)		 0
(0%)		 0
(0%)		 539
(69.64%)		 0
(0%)		 5
(0.65%)		 4
(0.52%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
buggy_2_5
2007-01-08		 774626
(80.88%)		 315
(40.7%)		 311
(40.18%)		 0
(0%)		 0
(0%)		 144
(18.6%)		 4
(0.52%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
buggy_2_5_s
2007-01-08		 774627
(81.01%)		 317
(40.96%)		 310
(40.05%)		 0
(0%)		 0
(0%)		 143
(18.48%)		 4
(0.52%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - Combo
2006-12-19		 774438
(56.59%)		 223
(28.81%)		 215
(27.78%)		 0
(0%)		 194
(25.06%)		 131
(16.93%)		 0
(0%)		 11
(1.42%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2006-12-19		 774432
(55.81%)		 225
(29.07%)		 207
(26.74%)		 0
(0%)		 194
(25.06%)		 139
(17.96%)		 0
(0%)		 9
(1.16%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2007-01-16		 774405
(52.33%)		 205
(26.49%)		 200
(25.84%)		 0
(0%)		 254
(32.82%)		 115
(14.86%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSPtoSAT+minisat
0.3		 77455
(7.11%)		 46
(5.94%)		 9
(1.16%)		 0
(0%)		 0
(0%)		 705
(91.09%)		 13
(1.68%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.13%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
galac
1		 774245
(31.65%)		 118
(15.25%)		 127
(16.41%)		 0
(0%)		 0
(0%)		 133
(17.18%)		 48
(6.2%)		 0
(0%)		 0
(0%)		 348
(44.96%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
galacJ
beta 1		 774220
(28.42%)		 109
(14.08%)		 111
(14.34%)		 0
(0%)		 0
(0%)		 128
(16.54%)		 16
(2.07%)		 0
(0%)		 0
(0%)		 410
(52.97%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Mistral
2006-12-04		 774423
(54.65%)		 203
(26.23%)		 220
(28.42%)		 0
(0%)		 0
(0%)		 298
(38.5%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 53
(6.85%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
sat4jCSP
1.7 RC BF3		 774258
(33.33%)		 117
(15.12%)		 141
(18.22%)		 0
(0%)		 247
(31.91%)		 59
(7.62%)		 194
(25.06%)		 16
(2.07%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
SAT4JCSP-CACHED
1.7 RC BF3		 774217
(28.04%)		 97
(12.53%)		 120
(15.5%)		 0
(0%)		 246
(31.78%)		 42
(5.43%)		 236
(30.49%)		 33
(4.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
sugar
0.40		 774276
(35.66%)		 101
(13.05%)		 175
(22.61%)		 0
(0%)		 368
(47.55%)		 123
(15.89%)		 7
(0.9%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Tramontane
2006-12-04		 774457
(59.04%)		 223
(28.81%)		 234
(30.23%)		 0
(0%)		 0
(0%)		 264
(34.11%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 53
(6.85%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
VALCSP
3.0		 774289
(37.34%)		 133
(17.18%)		 156
(20.16%)		 0
(0%)		 0
(0%)		 49
(6.33%)		 384
(49.61%)		 3
(0.39%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 49
(6.33%)		 0
(0%)		 0
VALCSP
3.1		 774281
(36.3%)		 135
(17.44%)		 146
(18.86%)		 0
(0%)		 0
(0%)		 95
(12.27%)		 384
(49.61%)		 3
(0.39%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 11
(1.42%)		 0
(0%)		 0

Solver NameProgress
Abscon
109 ESAC
done
774
UNSAT.
276		SAT.
299		?
1		? (TO)
197		? (MO)
1
Abscon
109 AC
done
774
UNSAT.
268		SAT.
293		?
1		? (TO)
212
BPrologCSPSolver70a
2006-12-13
done
774
UNSAT.
110		SAT.
116		? (TO)
539		? (EC)
5		? (Conv)
4
buggy_2_5
2007-01-08
done
774
UNSAT.
315		SAT.
311		? (TO)
144		? (MO)
4
buggy_2_5_s
2007-01-08
done
774
UNSAT.
317		SAT.
310		? (TO)
143		? (MO)
4
CSP4J - Combo
2006-12-19
done
774
UNSAT.
223		SAT.
215		?
194		? (TO)
131		? (EC)
11
CSP4J - MAC
2006-12-19
done
774
UNSAT.
225		SAT.
207		?
194		? (TO)
139		? (EC)
9
CSP4J - MAC
2007-01-16
done
774
UNSAT.
205		SAT.
200		?
254		? (TO)
115
CSPtoSAT+minisat
0.3
done
774
UNSAT.
46		SAT.
9		? (TO)
705		? (MO)
13		? (SIG)
1
galac
1
done
774
UNSAT.
118		SAT.
127		? (TO)
133		? (MO)
48		? (?)
348
galacJ
beta 1
done
774
UNSAT.
109		SAT.
111		? (TO)
128		? (MO)
16		? (?)
410
Mistral
2006-12-04
done
774
UNSAT.
203		SAT.
220		? (TO)
298		? (SIG)
53
sat4jCSP
1.7 RC BF3
done
774
UNSAT.
117		SAT.
141		?
247		? (TO)
59		? (MO)
194		? (EC)
16
SAT4JCSP-CACHED
1.7 RC BF3
done
774
UNSAT.
97		SAT.
120		?
246		? (TO)
42		? (MO)
236		? (EC)
33
sugar
0.40
done
774
UNSAT.
101		SAT.
175		?
368		? (TO)
123		? (MO)
7
Tramontane
2006-12-04
done
774
UNSAT.
223		SAT.
234		? (TO)
264		? (SIG)
53
VALCSP
3.0
done
774
UNSAT.
133		SAT.
156		? (TO)
49		? (MO)
384		? (EC)
3		ERR CERT
49
VALCSP
3.1
done
774
UNSAT.
135		SAT.
146		? (TO)
95		? (MO)
384		? (EC)
3		ERR CERT
11

Category "global constraints" (GLOBAL)

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.Misc.
Abscon
109 ESAC		 132126
(95.45%)		 22
(16.67%)		 104
(78.79%)		 0
(0%)		 0
(0%)		 6
(4.55%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Abscon
109 AC		 132127
(96.21%)		 22
(16.67%)		 105
(79.55%)		 0
(0%)		 0
(0%)		 5
(3.79%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
BPrologCSPSolver70a
2006-12-13		 132127
(96.21%)		 22
(16.67%)		 105
(79.55%)		 0
(0%)		 0
(0%)		 5
(3.79%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - Combo
2006-12-19		 132126
(95.45%)		 22
(16.67%)		 104
(78.79%)		 0
(0%)		 0
(0%)		 6
(4.55%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2006-12-19		 132126
(95.45%)		 22
(16.67%)		 104
(78.79%)		 0
(0%)		 0
(0%)		 6
(4.55%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2007-01-16		 132125
(94.7%)		 22
(16.67%)		 103
(78.03%)		 0
(0%)		 0
(0%)		 7
(5.3%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSPtoSAT+minisat
0.3		 132114
(86.36%)		 11
(8.33%)		 103
(78.03%)		 0
(0%)		 0
(0%)		 18
(13.64%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
galac
1		 132110
(83.33%)		 8
(6.06%)		 102
(77.27%)		 0
(0%)		 0
(0%)		 17
(12.88%)		 5
(3.79%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
galacJ
beta 1		 132106
(80.3%)		 4
(3.03%)		 102
(77.27%)		 0
(0%)		 0
(0%)		 16
(12.12%)		 5
(3.79%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 5
(3.79%)		 0
(0%)		 0
Mistral
2006-12-04		 132125
(94.7%)		 22
(16.67%)		 103
(78.03%)		 0
(0%)		 0
(0%)		 5
(3.79%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 2
(1.52%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
sat4jCSP
1.7 RC BF3		 132115
(87.12%)		 10
(7.58%)		 105
(79.55%)		 0
(0%)		 0
(0%)		 17
(12.88%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
SAT4JCSP-CACHED
1.7 RC BF3		 132114
(86.36%)		 10
(7.58%)		 104
(78.79%)		 0
(0%)		 1
(0.76%)		 17
(12.88%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
sugar
0.40		 132118
(89.39%)		 13
(9.85%)		 105
(79.55%)		 0
(0%)		 0
(0%)		 14
(10.61%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Tramontane
2006-12-04		 132125
(94.7%)		 22
(16.67%)		 103
(78.03%)		 0
(0%)		 0
(0%)		 5
(3.79%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 2
(1.52%)		 0
(0%)		 0
(0%)		 0
(0%)		 0

Solver NameProgress
Abscon
109 ESAC
done
132
UNSAT.
22		SAT.
104		? (TO)
6
Abscon
109 AC
done
132
UNSAT.
22		SAT.
105		? (TO)
5
BPrologCSPSolver70a
2006-12-13
done
132
UNSAT.
22		SAT.
105		? (TO)
5
CSP4J - Combo
2006-12-19
done
132
UNSAT.
22		SAT.
104		? (TO)
6
CSP4J - MAC
2006-12-19
done
132
UNSAT.
22		SAT.
104		? (TO)
6
CSP4J - MAC
2007-01-16
done
132
UNSAT.
22		SAT.
103		? (TO)
7
CSPtoSAT+minisat
0.3
done
132
UNSAT.
11		SAT.
103		? (TO)
18
galac
1
done
132
UNSAT.
8		SAT.
102		? (TO)
17		? (MO)
5
galacJ
beta 1
done
132
UNSAT.
4		SAT.
102		? (TO)
16		? (MO)
5		ERR CERT
5
Mistral
2006-12-04
done
132
UNSAT.
22		SAT.
103		? (TO)
5		? (SIG)
2
sat4jCSP
1.7 RC BF3
done
132
UNSAT.
10		SAT.
105		? (TO)
17
SAT4JCSP-CACHED
1.7 RC BF3
done
132
UNSAT.
10		SAT.
104		?
1		? (TO)
17
sugar
0.40
done
132
UNSAT.
13		SAT.
105		? (TO)
14
Tramontane
2006-12-04
done
132
UNSAT.
22		SAT.
103		? (TO)
5		? (SIG)
2

Category "n-ary constraints in extension" (N-ARY-EXT)

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.Misc.
Abscon
109 ESAC		 399276
(69.17%)		 112
(28.07%)		 164
(41.1%)		 0
(0%)		 0
(0%)		 123
(30.83%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Abscon
109 AC		 399277
(69.42%)		 111
(27.82%)		 166
(41.6%)		 0
(0%)		 0
(0%)		 122
(30.58%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
BPrologCSPSolver70a
2006-12-13		 399150
(37.59%)		 61
(15.29%)		 89
(22.31%)		 0
(0%)		 0
(0%)		 227
(56.89%)		 0
(0%)		 0
(0%)		 10
(2.51%)		 12
(3.01%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - Combo
2006-12-19		 399219
(54.89%)		 83
(20.8%)		 136
(34.09%)		 0
(0%)		 33
(8.27%)		 147
(36.84%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2006-12-19		 399234
(58.65%)		 90
(22.56%)		 144
(36.09%)		 0
(0%)		 33
(8.27%)		 132
(33.08%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2007-01-16		 399239
(59.9%)		 91
(22.81%)		 148
(37.09%)		 0
(0%)		 34
(8.52%)		 126
(31.58%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSPtoSAT+minisat
0.3		 399176
(44.11%)		 98
(24.56%)		 78
(19.55%)		 0
(0%)		 0
(0%)		 124
(31.08%)		 99
(24.81%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
galac
1		 399191
(47.87%)		 98
(24.56%)		 93
(23.31%)		 0
(0%)		 0
(0%)		 208
(52.13%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
galacJ
beta 1		 399175
(43.86%)		 97
(24.31%)		 78
(19.55%)		 0
(0%)		 0
(0%)		 184
(46.12%)		 4
(1%)		 0
(0%)		 0
(0%)		 36
(9.02%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Mistral
2006-12-04		 399269
(67.42%)		 100
(25.06%)		 169
(42.36%)		 0
(0%)		 0
(0%)		 110
(27.57%)		 0
(0%)		 20
(5.01%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
sat4jCSP
1.7 RC BF3		 399187
(46.87%)		 84
(21.05%)		 103
(25.81%)		 0
(0%)		 1
(0.25%)		 154
(38.6%)		 57
(14.29%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
SAT4JCSP-CACHED
1.7 RC BF3		 399187
(46.87%)		 84
(21.05%)		 103
(25.81%)		 0
(0%)		 2
(0.5%)		 154
(38.6%)		 56
(14.04%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
sugar
0.40		 399161
(40.35%)		 87
(21.8%)		 74
(18.55%)		 0
(0%)		 119
(29.82%)		 119
(29.82%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Tramontane
2006-12-04		 399260
(65.16%)		 95
(23.81%)		 165
(41.35%)		 0
(0%)		 0
(0%)		 119
(29.82%)		 0
(0%)		 20
(5.01%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0

Solver NameProgress
Abscon
109 ESAC
done
399
UNSAT.
112		SAT.
164		? (TO)
123
Abscon
109 AC
done
399
UNSAT.
111		SAT.
166		? (TO)
122
BPrologCSPSolver70a
2006-12-13
done
399
UNSAT.
61		SAT.
89		? (TO)
227		? (Conv)
10		? (?)
12
CSP4J - Combo
2006-12-19
done
399
UNSAT.
83		SAT.
136		?
33		? (TO)
147
CSP4J - MAC
2006-12-19
done
399
UNSAT.
90		SAT.
144		?
33		? (TO)
132
CSP4J - MAC
2007-01-16
done
399
UNSAT.
91		SAT.
148		?
34		? (TO)
126
CSPtoSAT+minisat
0.3
done
399
UNSAT.
98		SAT.
78		? (TO)
124		? (MO)
99
galac
1
done
399
UNSAT.
98		SAT.
93		? (TO)
208
galacJ
beta 1
done
399
UNSAT.
97		SAT.
78		? (TO)
184		? (MO)
4		? (?)
36
Mistral
2006-12-04
done
399
UNSAT.
100		SAT.
169		? (TO)
110		? (EC)
20
sat4jCSP
1.7 RC BF3
done
399
UNSAT.
84		SAT.
103		?
1		? (TO)
154		? (MO)
57
SAT4JCSP-CACHED
1.7 RC BF3
done
399
UNSAT.
84		SAT.
103		?
2		? (TO)
154		? (MO)
56
sugar
0.40
done
399
UNSAT.
87		SAT.
74		?
119		? (TO)
119
Tramontane
2006-12-04
done
399
UNSAT.
95		SAT.
165		? (TO)
119		? (EC)
20

Category "n-ary constraints in intension" (N-ARY-INT)

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.Misc.
Abscon
109 ESAC		 925509
(55.03%)		 52
(5.62%)		 457
(49.41%)		 0
(0%)		 126
(13.62%)		 290
(31.35%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Abscon
109 AC		 925490
(52.97%)		 51
(5.51%)		 439
(47.46%)		 0
(0%)		 123
(13.3%)		 312
(33.73%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
BPrologCSPSolver70a
2006-12-13		 925579
(62.59%)		 120
(12.97%)		 459
(49.62%)		 0
(0%)		 0
(0%)		 330
(35.68%)		 0
(0%)		 0
(0%)		 15
(1.62%)		 1
(0.11%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - Combo
2006-12-19		 925364
(39.35%)		 39
(4.22%)		 325
(35.14%)		 0
(0%)		 194
(20.97%)		 343
(37.08%)		 2
(0.22%)		 22
(2.38%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2006-12-19		 925370
(40%)		 39
(4.22%)		 331
(35.78%)		 0
(0%)		 194
(20.97%)		 336
(36.32%)		 3
(0.32%)		 22
(2.38%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - MAC
2007-01-16		 925346
(37.41%)		 38
(4.11%)		 308
(33.3%)		 0
(0%)		 207
(22.38%)		 287
(31.03%)		 1
(0.11%)		 9
(0.97%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 75
(8.11%)		 0
(0%)		 0
CSPtoSAT+minisat
0.3		 925395
(42.7%)		 60
(6.49%)		 335
(36.22%)		 0
(0%)		 0
(0%)		 208
(22.49%)		 206
(22.27%)		 0
(0%)		 0
(0%)		 0
(0%)		 116
(12.54%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
galac
1		 925352
(38.05%)		 65
(7.03%)		 287
(31.03%)		 0
(0%)		 0
(0%)		 521
(56.32%)		 41
(4.43%)		 0
(0%)		 0
(0%)		 11
(1.19%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
galacJ
beta 1		 925331
(35.78%)		 63
(6.81%)		 268
(28.97%)		 0
(0%)		 0
(0%)		 533
(57.62%)		 48
(5.19%)		 0
(0%)		 0
(0%)		 13
(1.41%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Mistral
2006-12-04		 925304
(32.86%)		 50
(5.41%)		 254
(27.46%)		 0
(0%)		 0
(0%)		 283
(30.59%)		 96
(10.38%)		 7
(0.76%)		 0
(0%)		 27
(2.92%)		 208
(22.49%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
sat4jCSP
1.7 RC BF3		 925228
(24.65%)		 40
(4.32%)		 188
(20.32%)		 0
(0%)		 144
(15.57%)		 100
(10.81%)		 450
(48.65%)		 3
(0.32%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
SAT4JCSP-CACHED
1.7 RC BF3		 925219
(23.68%)		 36
(3.89%)		 183
(19.78%)		 0
(0%)		 155
(16.76%)		 32
(3.46%)		 497
(53.73%)		 2
(0.22%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 19
(2.05%)		 1
(0.11%)		 0
sugar
0.40		 925431
(46.59%)		 77
(8.32%)		 354
(38.27%)		 0
(0%)		 154
(16.65%)		 279
(30.16%)		 60
(6.49%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.11%)		 0
(0%)		 0
(0%)		 0
Tramontane
2006-12-04		 925313
(33.84%)		 45
(4.86%)		 268
(28.97%)		 0
(0%)		 0
(0%)		 274
(29.62%)		 98
(10.59%)		 5
(0.54%)		 0
(0%)		 27
(2.92%)		 208
(22.49%)		 0
(0%)		 0
(0%)		 0
(0%)		 0

Solver NameProgress
Abscon
109 ESAC
done
925
UNSAT.
52		SAT.
457		?
126		? (TO)
290
Abscon
109 AC
done
925
UNSAT.
51		SAT.
439		?
123		? (TO)
312
BPrologCSPSolver70a
2006-12-13
done
925
UNSAT.
120		SAT.
459		? (TO)
330		? (Conv)
15		? (?)
1
CSP4J - Combo
2006-12-19
done
925
UNSAT.
39		SAT.
325		?
194		? (TO)
343		? (MO)
2		? (EC)
22
CSP4J - MAC
2006-12-19
done
925
UNSAT.
39		SAT.
331		?
194		? (TO)
336		? (MO)
3		? (EC)
22
CSP4J - MAC
2007-01-16
done
925
UNSAT.
38		SAT.
308		?
207		? (TO)
287		? (MO)
1		? (EC)
9		ERR CERT
75
CSPtoSAT+minisat
0.3
done
925
UNSAT.
60		SAT.
335		? (TO)
208		? (MO)
206		? (SIG)
116
galac
1
done
925
UNSAT.
65		SAT.
287		? (TO)
521		? (MO)
41		? (?)
11
galacJ
beta 1
done
925
UNSAT.
63		SAT.
268		? (TO)
533		? (MO)
48		? (?)
13
Mistral
2006-12-04
done
925
UNSAT.
50		SAT.
254		? (TO)
283		? (MO)
96		? (EC)
7		? (?)
27		? (SIG)
208
sat4jCSP
1.7 RC BF3
done
925
UNSAT.
40		SAT.
188		?
144		? (TO)
100		? (MO)
450		? (EC)
3
SAT4JCSP-CACHED
1.7 RC BF3
done
925
UNSAT.
36		SAT.
183		?
155		? (TO)
32		? (MO)
497		? (EC)
2		ERR CERT
19		WRONG UNSAT.
1
sugar
0.40
done
925
UNSAT.
77		SAT.
354		?
154		? (TO)
279		? (MO)
60		NO CERT.
1
Tramontane
2006-12-04
done
925
UNSAT.
45		SAT.
268		? (TO)
274		? (MO)
98		? (EC)
5		? (?)
27		? (SIG)
208

All categories for solvers registered in all categories

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.Misc.
Abscon
109 ESAC		 34252567
(74.95%)		 960
(28.03%)		 1607
(46.92%)		 0
(0%)		 127
(3.71%)		 730
(21.31%)		 1
(0.03%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Abscon
109 AC		 34252537
(74.07%)		 950
(27.74%)		 1587
(46.34%)		 0
(0%)		 124
(3.62%)		 764
(22.31%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
BPrologCSPSolver70a
2006-12-13		 34252020
(58.98%)		 757
(22.1%)		 1263
(36.88%)		 0
(0%)		 0
(0%)		 1338
(39.07%)		 0
(0%)		 5
(0.15%)		 49
(1.43%)		 13
(0.38%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - Combo
2006-12-19		 34252173
(63.45%)		 850
(24.82%)		 1323
(38.63%)		 0
(0%)		 430
(12.55%)		 785
(22.92%)		 2
(0.06%)		 33
(0.96%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 2
(0.06%)		 0
(0%)		 0
CSP4J - MAC
2006-12-19		 34252188
(63.88%)		 867
(25.31%)		 1321
(38.57%)		 0
(0%)		 430
(12.55%)		 771
(22.51%)		 3
(0.09%)		 31
(0.91%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 2
(0.06%)		 0
(0%)		 0
CSP4J - MAC
2007-01-16		 34252140
(62.48%)		 847
(24.73%)		 1293
(37.75%)		 0
(0%)		 505
(14.74%)		 695
(20.29%)		 1
(0.03%)		 9
(0.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 75
(2.19%)		 0
(0%)		 0
CSPtoSAT+minisat
0.3		 34251617
(47.21%)		 618
(18.04%)		 999
(29.17%)		 0
(0%)		 0
(0%)		 1309
(38.22%)		 382
(11.15%)		 0
(0%)		 0
(0%)		 0
(0%)		 117
(3.42%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
galac
1		 34251838
(53.66%)		 733
(21.4%)		 1105
(32.26%)		 0
(0%)		 0
(0%)		 1114
(32.53%)		 96
(2.8%)		 0
(0%)		 0
(0%)		 377
(11.01%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
galacJ
beta 1		 34251760
(51.39%)		 701
(20.47%)		 1059
(30.92%)		 0
(0%)		 0
(0%)		 1106
(32.29%)		 73
(2.13%)		 0
(0%)		 0
(0%)		 481
(14.04%)		 0
(0%)		 0
(0%)		 5
(0.15%)		 0
(0%)		 0
Mistral
2006-12-04		 34252181
(63.68%)		 873
(25.49%)		 1308
(38.19%)		 0
(0%)		 0
(0%)		 831
(24.26%)		 96
(2.8%)		 27
(0.79%)		 0
(0%)		 27
(0.79%)		 263
(7.68%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
sat4jCSP
1.7 RC BF3		 34251705
(49.78%)		 668
(19.5%)		 1037
(30.28%)		 0
(0%)		 392
(11.45%)		 606
(17.69%)		 703
(20.53%)		 19
(0.55%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
SAT4JCSP-CACHED
1.7 RC BF3		 34251652
(48.23%)		 641
(18.72%)		 1011
(29.52%)		 0
(0%)		 404
(11.8%)		 523
(15.27%)		 791
(23.09%)		 35
(1.02%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 19
(0.55%)		 1
(0.03%)		 0
sugar
0.40		 34251792
(52.32%)		 661
(19.3%)		 1131
(33.02%)		 0
(0%)		 661
(19.3%)		 904
(26.39%)		 67
(1.96%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.03%)		 0
(0%)		 0
(0%)		 0
Tramontane
2006-12-04		 34252202
(64.29%)		 882
(25.75%)		 1320
(38.54%)		 0
(0%)		 0
(0%)		 810
(23.65%)		 98
(2.86%)		 25
(0.73%)		 0
(0%)		 27
(0.79%)		 263
(7.68%)		 0
(0%)		 0
(0%)		 0
(0%)		 0

Solver NameProgress
Abscon
109 ESAC
done
3425
UNSAT.
960		SAT.
1607		?
127		? (TO)
730		? (MO)
1
Abscon
109 AC
done
3425
UNSAT.
950		SAT.
1587		?
124		? (TO)
764
BPrologCSPSolver70a
2006-12-13
done
3425
UNSAT.
757		SAT.
1263		? (TO)
1338		? (EC)
5		? (Conv)
49		? (?)
13
CSP4J - Combo
2006-12-19
done
3425
UNSAT.
850		SAT.
1323		?
430		? (TO)
785		? (MO)
2		? (EC)
33		ERR CERT
2
CSP4J - MAC
2006-12-19
done
3425
UNSAT.
867		SAT.
1321		?
430		? (TO)
771		? (MO)
3		? (EC)
31		ERR CERT
2
CSP4J - MAC
2007-01-16
done
3425
UNSAT.
847		SAT.
1293		?
505		? (TO)
695		? (MO)
1		? (EC)
9		ERR CERT
75
CSPtoSAT+minisat
0.3
done
3425
UNSAT.
618		SAT.
999		? (TO)
1309		? (MO)
382		? (SIG)
117
galac
1
done
3425
UNSAT.
733		SAT.
1105		? (TO)
1114		? (MO)
96		? (?)
377
galacJ
beta 1
done
3425
UNSAT.
701		SAT.
1059		? (TO)
1106		? (MO)
73		? (?)
481		ERR CERT
5
Mistral
2006-12-04
done
3425
UNSAT.
873		SAT.
1308		? (TO)
831		? (MO)
96		? (EC)
27		? (?)
27		? (SIG)
263
sat4jCSP
1.7 RC BF3
done
3425
UNSAT.
668		SAT.
1037		?
392		? (TO)
606		? (MO)
703		? (EC)
19
SAT4JCSP-CACHED
1.7 RC BF3
done
3425
UNSAT.
641		SAT.
1011		?
404		? (TO)
523		? (MO)
791		? (EC)
35		ERR CERT
19		WRONG UNSAT.
1
sugar
0.40
done
3425
UNSAT.
661		SAT.
1131		?
661		? (TO)
904		? (MO)
67		NO CERT.
1
Tramontane
2006-12-04
done
3425
UNSAT.
882		SAT.
1320		? (TO)
810		? (MO)
98		? (EC)
25		? (?)
27		? (SIG)
263

All categories and all solvers (regardless of their ability to support all categories)

This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.

Solver Name#benchsSolvedUNSAT.SAT.SAT (timeout)UNKNOWNUNKNOWN (timeout)UNKNOWN (out of mem.)UNKNOWN (exit code)UNKNOWN (conv. script)UNKNOWN (problem)Sig. CaughtNO CERT.WRONG CERT.WRONG UNSAT.Misc.
Abscon
109 ESAC		 34252567
(74.95%)		 960
(28.03%)		 1607
(46.92%)		 0
(0%)		 127
(3.71%)		 730
(21.31%)		 1
(0.03%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Abscon
109 AC		 34252537
(74.07%)		 950
(27.74%)		 1587
(46.34%)		 0
(0%)		 124
(3.62%)		 764
(22.31%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
BPrologCSPSolver70a
2006-12-13		 34252020
(58.98%)		 757
(22.1%)		 1263
(36.88%)		 0
(0%)		 0
(0%)		 1338
(39.07%)		 0
(0%)		 5
(0.15%)		 49
(1.43%)		 13
(0.38%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
buggy_2_5
2007-01-08		 19691718
(87.25%)		 819
(41.59%)		 899
(45.66%)		 0
(0%)		 0
(0%)		 247
(12.54%)		 4
(0.2%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
buggy_2_5_s
2007-01-08		 19691720
(87.35%)		 821
(41.7%)		 899
(45.66%)		 0
(0%)		 0
(0%)		 245
(12.44%)		 4
(0.2%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - Combo
2006-12-19		 34252173
(63.45%)		 850
(24.82%)		 1323
(38.63%)		 0
(0%)		 430
(12.55%)		 785
(22.92%)		 2
(0.06%)		 33
(0.96%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 2
(0.06%)		 0
(0%)		 0
CSP4J - MAC
2006-12-19		 34252188
(63.88%)		 867
(25.31%)		 1321
(38.57%)		 0
(0%)		 430
(12.55%)		 771
(22.51%)		 3
(0.09%)		 31
(0.91%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 2
(0.06%)		 0
(0%)		 0
CSP4J - MAC
2007-01-16		 34252140
(62.48%)		 847
(24.73%)		 1293
(37.75%)		 0
(0%)		 505
(14.74%)		 695
(20.29%)		 1
(0.03%)		 9
(0.26%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 75
(2.19%)		 0
(0%)		 0
CSPtoSAT+minisat
0.3		 34251617
(47.21%)		 618
(18.04%)		 999
(29.17%)		 0
(0%)		 0
(0%)		 1309
(38.22%)		 382
(11.15%)		 0
(0%)		 0
(0%)		 0
(0%)		 117
(3.42%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
Diarmuid-rndi
2006-12-21		 1195888
(74.31%)		 429
(35.9%)		 459
(38.41%)		 0
(0%)		 0
(0%)		 184
(15.4%)		 1
(0.08%)		 0
(0%)		 22
(1.84%)		 96
(8.03%)		 0
(0%)		 0
(0%)		 4
(0.33%)		 0
(0%)		 0
Diarmuid-rndi
2007-01-22		 1195883
(73.89%)		 429
(35.9%)		 454
(37.99%)		 0
(0%)		 0
(0%)		 190
(15.9%)		 1
(0.08%)		 0
(0%)		 17
(1.42%)		 100
(8.37%)		 0
(0%)		 0
(0%)		 3
(0.25%)		 1
(0.08%)		 0
Diarmuid-wtdi
2006-12-21		 1195823
(68.87%)		 384
(32.13%)		 439
(36.74%)		 0
(0%)		 0
(0%)		 244
(20.42%)		 1
(0.08%)		 0
(0%)		 21
(1.76%)		 102
(8.54%)		 0
(0%)		 0
(0%)		 4
(0.33%)		 0
(0%)		 0
galac
1		 34251838
(53.66%)		 733
(21.4%)		 1105
(32.26%)		 0
(0%)		 0
(0%)		 1114
(32.53%)		 96
(2.8%)		 0
(0%)		 0
(0%)		 377
(11.01%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
galacJ
beta 1		 34251760
(51.39%)		 701
(20.47%)		 1059
(30.92%)		 0
(0%)		 0
(0%)		 1106
(32.29%)		 73
(2.13%)		 0
(0%)		 0
(0%)		 481
(14.04%)		 0
(0%)		 0
(0%)		 5
(0.15%)		 0
(0%)		 0
Mistral
2006-12-04		 34252181
(63.68%)		 873
(25.49%)		 1308
(38.19%)		 0
(0%)		 0
(0%)		 831
(24.26%)		 96
(2.8%)		 27
(0.79%)		 0
(0%)		 27
(0.79%)		 263
(7.68%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
rjw-solver
2006-12-09		 1195879
(73.56%)		 428
(35.82%)		 451
(37.74%)		 0
(0%)		 0
(0%)		 193
(16.15%)		 1
(0.08%)		 0
(0%)		 18
(1.51%)		 100
(8.37%)		 0
(0%)		 0
(0%)		 4
(0.33%)		 0
(0%)		 0
rjw-solver
2007-01-21		 1195879
(73.56%)		 428
(35.82%)		 451
(37.74%)		 0
(0%)		 0
(0%)		 195
(16.32%)		 1
(0.08%)		 0
(0%)		 17
(1.42%)		 100
(8.37%)		 0
(0%)		 0
(0%)		 2
(0.17%)		 1
(0.08%)		 0
sat4jCSP
1.7 RC BF3		 34251705
(49.78%)		 668
(19.5%)		 1037
(30.28%)		 0
(0%)		 392
(11.45%)		 606
(17.69%)		 703
(20.53%)		 19
(0.55%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
SAT4JCSP-CACHED
1.7 RC BF3		 34251652
(48.23%)		 641
(18.72%)		 1011
(29.52%)		 0
(0%)		 404
(11.8%)		 523
(15.27%)		 791
(23.09%)		 35
(1.02%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 19
(0.55%)		 1
(0.03%)		 0
sugar
0.40		 34251792
(52.32%)		 661
(19.3%)		 1131
(33.02%)		 0
(0%)		 661
(19.3%)		 904
(26.39%)		 67
(1.96%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 1
(0.03%)		 0
(0%)		 0
(0%)		 0
Tramontane
2006-12-04		 34252202
(64.29%)		 882
(25.75%)		 1320
(38.54%)		 0
(0%)		 0
(0%)		 810
(23.65%)		 98
(2.86%)		 25
(0.73%)		 0
(0%)		 27
(0.79%)		 263
(7.68%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
VALCSP
3.0		 19691382
(70.19%)		 636
(32.3%)		 746
(37.89%)		 0
(0%)		 0
(0%)		 150
(7.62%)		 385
(19.55%)		 3
(0.15%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 49
(2.49%)		 0
(0%)		 0
VALCSP
3.1		 19691373
(69.73%)		 639
(32.45%)		 734
(37.28%)		 0
(0%)		 0
(0%)		 194
(9.85%)		 385
(19.55%)		 3
(0.15%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
(0%)		 14
(0.71%)		 0
(0%)		 0

Solver NameProgress
Abscon
109 ESAC
done
3425
UNSAT.
960		SAT.
1607		?
127		? (TO)
730		? (MO)
1
Abscon
109 AC
done
3425
UNSAT.
950		SAT.
1587		?
124		? (TO)
764
BPrologCSPSolver70a
2006-12-13
done
3425
UNSAT.
757		SAT.
1263		? (TO)
1338		? (EC)
5		? (Conv)
49		? (?)
13
buggy_2_5
2007-01-08
done
1969
UNSAT.
819		SAT.
899		? (TO)
247		? (MO)
4
buggy_2_5_s
2007-01-08
done
1969
UNSAT.
821		SAT.
899		? (TO)
245		? (MO)
4
CSP4J - Combo
2006-12-19
done
3425
UNSAT.
850		SAT.
1323		?
430		? (TO)
785		? (MO)
2		? (EC)
33		ERR CERT
2
CSP4J - MAC
2006-12-19
done
3425
UNSAT.
867		SAT.
1321		?
430		? (TO)
771		? (MO)
3		? (EC)
31		ERR CERT
2
CSP4J - MAC
2007-01-16
done
3425
UNSAT.
847		SAT.
1293		?
505		? (TO)
695		? (MO)
1		? (EC)
9		ERR CERT
75
CSPtoSAT+minisat
0.3
done
3425
UNSAT.
618		SAT.
999		? (TO)
1309		? (MO)
382		? (SIG)
117
Diarmuid-rndi
2006-12-21
done
1195
UNSAT.
429		SAT.
459		? (TO)
184		? (MO)
1		? (Conv)
22		? (?)
96		ERR CERT
4
Diarmuid-rndi
2007-01-22
done
1195
UNSAT.
429		SAT.
454		? (TO)
190		? (MO)
1		? (Conv)
17		? (?)
100		ERR CERT
3		WRONG UNSAT.
1
Diarmuid-wtdi
2006-12-21
done
1195
UNSAT.
384		SAT.
439		? (TO)
244		? (MO)
1		? (Conv)
21		? (?)
102		ERR CERT
4
galac
1
done
3425
UNSAT.
733		SAT.
1105		? (TO)
1114		? (MO)
96		? (?)
377
galacJ
beta 1
done
3425
UNSAT.
701		SAT.
1059		? (TO)
1106		? (MO)
73		? (?)
481		ERR CERT
5
Mistral
2006-12-04
done
3425
UNSAT.
873		SAT.
1308		? (TO)
831		? (MO)
96		? (EC)
27		? (?)
27		? (SIG)
263
rjw-solver
2006-12-09
done
1195
UNSAT.
428		SAT.
451		? (TO)
193		? (MO)
1		? (Conv)
18		? (?)
100		ERR CERT
4
rjw-solver
2007-01-21
done
1195
UNSAT.
428		SAT.
451		? (TO)
195		? (MO)
1		? (Conv)
17		? (?)
100		ERR CERT
2		WRONG UNSAT.
1
sat4jCSP
1.7 RC BF3
done
3425
UNSAT.
668		SAT.
1037		?
392		? (TO)
606		? (MO)
703		? (EC)
19
SAT4JCSP-CACHED
1.7 RC BF3
done
3425
UNSAT.
641		SAT.
1011		?
404		? (TO)
523		? (MO)
791		? (EC)
35		ERR CERT
19		WRONG UNSAT.
1
sugar
0.40
done
3425
UNSAT.
661		SAT.
1131		?
661		? (TO)
904		? (MO)
67		NO CERT.
1
Tramontane
2006-12-04
done
3425
UNSAT.
882		SAT.
1320		? (TO)
810		? (MO)
98		? (EC)
25		? (?)
27		? (SIG)
263
VALCSP
3.0
done
1969
UNSAT.
636		SAT.
746		? (TO)
150		? (MO)
385		? (EC)
3		ERR CERT
49
VALCSP
3.1
done
1969
UNSAT.
639		SAT.
734		? (TO)
194		? (MO)
385		? (EC)
3		ERR CERT
14

Some explanations