MAX-CSP 2006 Competition: solvers page (tabular format, summary)

Category "binary constraints in extension" (2-ARY-EXT)

Solver Name#benchsSolvedMOPTSATMSATUNKNOWNIncomplete AnswersBad AnswersMisc.
AbsconMax
109 EPFC		 686418
(60.93%)		 396
(57.73%)		 22
(3.21%)		 268
(39.07%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
AbsconMax
109 PFC		 686437
(63.7%)		 415
(60.5%)		 22
(3.21%)		 249
(36.3%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
aolibdvo
2007-01-17		 686466
(67.93%)		 445
(64.87%)		 21
(3.06%)		 27
(3.94%)		 193
(28.13%)		 0
(0%)		 0
(0%)		 0
aolibpvo
2007-01-17		 686452
(65.89%)		 431
(62.83%)		 21
(3.06%)		 33
(4.81%)		 201
(29.3%)		 0
(0%)		 0
(0%)		 0
CSP4J - MaxCSP
2006-12-19		 68624
(3.5%)		 2
(0.29%)		 22
(3.21%)		 380
(55.39%)		 282
(41.11%)		 0
(0%)		 0
(0%)		 0
toolbar
2007-01-12		 686588
(85.71%)		 566
(82.51%)		 22
(3.21%)		 64
(9.33%)		 34
(4.96%)		 0
(0%)		 0
(0%)		 0
Toolbar_BTD
2007-01-12		 686589
(85.86%)		 567
(82.65%)		 22
(3.21%)		 0
(0%)		 97
(14.14%)		 0
(0%)		 0
(0%)		 0
Toolbar_MaxSat
2007-01-19		 686172
(25.07%)		 150
(21.87%)		 22
(3.21%)		 0
(0%)		 508
(74.05%)		 0
(0%)		 6
(0.87%)		 0
Toulbar2
2007-01-12		 686537
(78.28%)		 515
(75.07%)		 22
(3.21%)		 112
(16.33%)		 37
(5.39%)		 0
(0%)		 0
(0%)		 0

Solver NameProgress
AbsconMax
109 EPFC
done
686
MOPT
396		SAT
22		MSAT
268
AbsconMax
109 PFC
done
686
MOPT
415		SAT
22		MSAT
249
aolibdvo
2007-01-17
done
686
MOPT
445		SAT
21		MSAT
27		?
193
aolibpvo
2007-01-17
done
686
MOPT
431		SAT
21		MSAT
33		?
201
CSP4J - MaxCSP
2006-12-19
done
686
MOPT
2		SAT
22		MSAT
380		?
282
toolbar
2007-01-12
done
686
MOPT
566		SAT
22		MSAT
64		?
34
Toolbar_BTD
2007-01-12
done
686
MOPT
567		SAT
22		?
97
Toolbar_MaxSat
2007-01-19
done
686
MOPT
150		SAT
22		?
508		ERR
6
Toulbar2
2007-01-12
done
686
MOPT
515		SAT
22		MSAT
112		?
37

Category "binary constraints in intension" (2-ARY-INT)

Solver Name#benchsSolvedMOPTSATMSATUNKNOWNIncomplete AnswersBad AnswersMisc.
AbsconMax
109 EPFC		 19018
(9.47%)		 18
(9.47%)		 0
(0%)		 172
(90.53%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
AbsconMax
109 PFC		 19017
(8.95%)		 17
(8.95%)		 0
(0%)		 173
(91.05%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
CSP4J - MaxCSP
2006-12-19		 1900
(0%)		 0
(0%)		 0
(0%)		 85
(44.74%)		 105
(55.26%)		 0
(0%)		 0
(0%)		 0

Solver NameProgress
AbsconMax
109 EPFC
done
190
MOPT
18		MSAT
172
AbsconMax
109 PFC
done
190
MOPT
17		MSAT
173
CSP4J - MaxCSP
2006-12-19
done
190
MSAT
85		?
105

Category "n-ary constraints in extension" (N-ARY-EXT)

Solver Name#benchsSolvedMOPTSATMSATUNKNOWNIncomplete AnswersBad AnswersMisc.
AbsconMax
109 EPFC		 13554
(40%)		 50
(37.04%)		 4
(2.96%)		 81
(60%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
AbsconMax
109 PFC		 13558
(42.96%)		 54
(40%)		 4
(2.96%)		 77
(57.04%)		 0
(0%)		 0
(0%)		 0
(0%)		 0
aolibdvo
2007-01-17		 13554
(40%)		 50
(37.04%)		 4
(2.96%)		 15
(11.11%)		 66
(48.89%)		 0
(0%)		 0
(0%)		 0
aolibpvo
2007-01-17		 13563
(46.67%)		 59
(43.7%)		 4
(2.96%)		 14
(10.37%)		 57
(42.22%)		 0
(0%)		 1
(0.74%)		 0
CSP4J - MaxCSP
2006-12-19		 1354
(2.96%)		 0
(0%)		 4
(2.96%)		 83
(61.48%)		 48
(35.56%)		 0
(0%)		 0
(0%)		 0
toolbar
2007-01-12		 13579
(58.52%)		 75
(55.56%)		 4
(2.96%)		 29
(21.48%)		 27
(20%)		 0
(0%)		 0
(0%)		 0
Toolbar_BTD
2007-01-12		 13583
(61.48%)		 79
(58.52%)		 4
(2.96%)		 0
(0%)		 52
(38.52%)		 0
(0%)		 0
(0%)		 0
Toolbar_MaxSat
2007-01-19		 13556
(41.48%)		 52
(38.52%)		 4
(2.96%)		 0
(0%)		 79
(58.52%)		 0
(0%)		 0
(0%)		 0
Toulbar2
2007-01-12		 13582
(60.74%)		 78
(57.78%)		 4
(2.96%)		 39
(28.89%)		 14
(10.37%)		 0
(0%)		 0
(0%)		 0

Solver NameProgress
AbsconMax
109 EPFC
done
135
MOPT
50		SAT
4		MSAT
81
AbsconMax
109 PFC
done
135
MOPT
54		SAT
4		MSAT
77
aolibdvo
2007-01-17
done
135
MOPT
50		SAT
4		MSAT
15		?
66
aolibpvo
2007-01-17
done
135
MOPT
59		SAT
4		MSAT
14		?
57		ERR
1
CSP4J - MaxCSP
2006-12-19
done
135
SAT
4		MSAT
83		?
48
toolbar
2007-01-12
done
135
MOPT
75		SAT
4		MSAT
29		?
27
Toolbar_BTD
2007-01-12
done
135
MOPT
79		SAT
4		?
52
Toolbar_MaxSat
2007-01-19
done
135
MOPT
52		SAT
4		?
79
Toulbar2
2007-01-12
done
135
MOPT
78		SAT
4		MSAT
39		?
14

Category "n-ary constraints in intension" (N-ARY-INT)

Solver Name#benchsSolvedMOPTSATMSATUNKNOWNIncomplete AnswersBad AnswersMisc.
AbsconMax
109 EPFC		 5815
(25.86%)		 15
(25.86%)		 0
(0%)		 42
(72.41%)		 0
(0%)		 1
(1.72%)		 0
(0%)		 0
AbsconMax
109 PFC		 5814
(24.14%)		 14
(24.14%)		 0
(0%)		 43
(74.14%)		 0
(0%)		 1
(1.72%)		 0
(0%)		 0
CSP4J - MaxCSP
2006-12-19		 580
(0%)		 0
(0%)		 0
(0%)		 44
(75.86%)		 14
(24.14%)		 0
(0%)		 0
(0%)		 0

Solver NameProgress
AbsconMax
109 EPFC
done
58
MOPT
15		MSAT
42		Inc. Answer
1
AbsconMax
109 PFC
done
58
MOPT
14		MSAT
43		Inc. Answer
1
CSP4J - MaxCSP
2006-12-19
done
58
MSAT
44		?
14

All categories for solvers registered in all categories

Solver Name#benchsSolvedMOPTSATMSATUNKNOWNIncomplete AnswersBad AnswersMisc.
AbsconMax
109 EPFC		 1069505
(47.24%)		 479
(44.81%)		 26
(2.43%)		 563
(52.67%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
AbsconMax
109 PFC		 1069526
(49.2%)		 500
(46.77%)		 26
(2.43%)		 542
(50.7%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
CSP4J - MaxCSP
2006-12-19		 106928
(2.62%)		 2
(0.19%)		 26
(2.43%)		 592
(55.38%)		 449
(42%)		 0
(0%)		 0
(0%)		 0

Solver NameProgress
AbsconMax
109 EPFC
done
1069
MOPT
479		SAT
26		MSAT
563		Inc. Answer
1
AbsconMax
109 PFC
done
1069
MOPT
500		SAT
26		MSAT
542		Inc. Answer
1
CSP4J - MaxCSP
2006-12-19
done
1069
MOPT
2		SAT
26		MSAT
592		?
449

All categories and all solvers (regardless of their ability to support all categories)

This table summarizes the results in all categories for all solvers. Note however that some solvers may not have support for some categories. Therefore, the solvers may have run on a different number of benchmarks and this table should not be used to compare them.

Solver Name#benchsSolvedMOPTSATMSATUNKNOWNIncomplete AnswersBad AnswersMisc.
AbsconMax
109 EPFC		 1069505
(47.24%)		 479
(44.81%)		 26
(2.43%)		 563
(52.67%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
AbsconMax
109 PFC		 1069526
(49.2%)		 500
(46.77%)		 26
(2.43%)		 542
(50.7%)		 0
(0%)		 1
(0.09%)		 0
(0%)		 0
aolibdvo
2007-01-17		 821520
(63.34%)		 495
(60.29%)		 25
(3.05%)		 42
(5.12%)		 259
(31.55%)		 0
(0%)		 0
(0%)		 0
aolibpvo
2007-01-17		 821515
(62.73%)		 490
(59.68%)		 25
(3.05%)		 47
(5.72%)		 258
(31.43%)		 0
(0%)		 1
(0.12%)		 0
CSP4J - MaxCSP
2006-12-19		 106928
(2.62%)		 2
(0.19%)		 26
(2.43%)		 592
(55.38%)		 449
(42%)		 0
(0%)		 0
(0%)		 0
toolbar
2007-01-12		 821667
(81.24%)		 641
(78.08%)		 26
(3.17%)		 93
(11.33%)		 61
(7.43%)		 0
(0%)		 0
(0%)		 0
Toolbar_BTD
2007-01-12		 821672
(81.85%)		 646
(78.68%)		 26
(3.17%)		 0
(0%)		 149
(18.15%)		 0
(0%)		 0
(0%)		 0
Toolbar_MaxSat
2007-01-19		 821228
(27.77%)		 202
(24.6%)		 26
(3.17%)		 0
(0%)		 587
(71.5%)		 0
(0%)		 6
(0.73%)		 0
Toulbar2
2007-01-12		 821619
(75.4%)		 593
(72.23%)		 26
(3.17%)		 151
(18.39%)		 51
(6.21%)		 0
(0%)		 0
(0%)		 0

Solver NameProgress
AbsconMax
109 EPFC
done
1069
MOPT
479		SAT
26		MSAT
563		Inc. Answer
1
AbsconMax
109 PFC
done
1069
MOPT
500		SAT
26		MSAT
542		Inc. Answer
1
aolibdvo
2007-01-17
done
821
MOPT
495		SAT
25		MSAT
42		?
259
aolibpvo
2007-01-17
done
821
MOPT
490		SAT
25		MSAT
47		?
258		ERR
1
CSP4J - MaxCSP
2006-12-19
done
1069
MOPT
2		SAT
26		MSAT
592		?
449
toolbar
2007-01-12
done
821
MOPT
641		SAT
26		MSAT
93		?
61
Toolbar_BTD
2007-01-12
done
821
MOPT
646		SAT
26		?
149
Toolbar_MaxSat
2007-01-19
done
821
MOPT
202		SAT
26		?
587		ERR
6
Toulbar2
2007-01-12
done
821
MOPT
593		SAT
26		MSAT
151		?
51

Some explanations