MAX-CSP 2008 Competition: results by benchmark

Results by benchmark for category binary constraints in intension (2-ARY-INT), subcategory academic problems

This page displays the results of the different solvers for each benchmark for category binary constraints in intension (2-ARY-INT), subcategory academic problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
AbsconMax 112 pc-d
AbsconMax 112 pc-w
Concrete + CSP4J - MCRW Engine 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Sugar v1.13+minisat
Sugar++ v1.13+minisat-inc

Bench name	Best results on this instance	AbsconMax 112 pc-d	AbsconMax 112 pc-w	Concrete + CSP4J - MCRW Engine 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Sugar v1.13+minisat	Sugar++ v1.13+minisat-inc
csp/knights/ normalized-knights-12-5.xml	MOPT f=1 TT=0.878 T1=0.66	OPTIMUM f=1 TT=36.657 T1=0.66 CHECKS=558698 NODES=143	OPTIMUM f=1 TT=36.55 T1=0.67 CHECKS=558698 NODES=143	MSAT (TO) f=1 TT=3600.1	MSAT (TO) f=1 TT=3600.07	OPTIMUM f=1 TT=0.878 T1=0.66	OPTIMUM f=1 TT=1.071 T1=0.84
csp/knights/ normalized-knights-12-9.xml	MOPT f=1 TT=44.701 T1=0.68	OPTIMUM f=1 TT=48.282 T1=0.69 CHECKS=1764220 NODES=385	OPTIMUM f=1 TT=44.701 T1=0.68 CHECKS=1236270 NODES=192	MSAT (TO) f=1 TT=3600.01	MSAT (TO) f=1 TT=3600.04	OPTIMUM f=1 TT=44.707 T1=1.11	OPTIMUM f=1 TT=68.079 T1=1.15
csp/knights/ normalized-knights-15-9.xml	MOPT f=1 TT=62.845 T1=0.57	OPTIMUM f=1 TT=79.581 T1=0.68 CHECKS=6625880 NODES=788	OPTIMUM f=1 TT=62.845 T1=0.57 CHECKS=4475070 NODES=342	MSAT (TO) f=1 TT=3600.09	MSAT (TO) f=1 TT=3600.05	OPTIMUM f=1 TT=150.35 T1=1.21	OPTIMUM f=1 TT=176.267 T1=1.12
csp/knights/ normalized-knights-25-5.xml	MOPT f=1 TT=1.188 T1=0.85	OPTIMUM f=1 TT=138.243 T1=0.99 CHECKS=36604800 NODES=624	OPTIMUM f=1 TT=131.193 T1=0.88 CHECKS=36604800 NODES=624	MSAT (TO) f=1 TT=3600.01	MSAT (TO) f=1 TT=3600	OPTIMUM f=1 TT=1.316 T1=0.89	OPTIMUM f=1 TT=1.188 T1=0.85
csp/knights/ normalized-knights-25-9.xml	MOPT f=1 TT=276.481 T1=0.99	OPTIMUM f=1 TT=387.217 T1=0.99 CHECKS=125474000 NODES=2903	OPTIMUM f=1 TT=276.481 T1=1.18 CHECKS=87069200 NODES=1095	MSAT (TO) f=1 TT=3600.09	MSAT (TO) f=1 TT=3600	OPTIMUM f=1 TT=614.707 T1=1.47	OPTIMUM f=1 TT=613.784 T1=1.26
csp/knights/ normalized-knights-50-9.xml	MOPT f=1 TT=2555.83 T1=1.81	MSAT (TO) f=1 TT=1606.05 T1=7.62	MSAT (TO) f=1 TT=1619.27 T1=7.8	MSAT (TO) f=1 TT=3600.03	MSAT (TO) f=1 TT=3600.05	OPTIMUM f=1 TT=2796.16 T1=3.32	OPTIMUM f=1 TT=2555.83 T1=1.81
csp/knights/ normalized-knights-8-5.xml	MOPT f=1 TT=0.871 T1=0.58	OPTIMUM f=1 TT=31.963 T1=0.58 CHECKS=56074 NODES=63	OPTIMUM f=1 TT=31.9 T1=0.59 CHECKS=56074 NODES=63	MSAT (TO) f=1 TT=3600.02	MSAT (TO) f=1 TT=3600.05	OPTIMUM f=1 TT=0.961 T1=0.84	OPTIMUM f=1 TT=0.871 T1=0.68
csp/langford2/ normalized-langford-2-10.xml	MOPT f=1 TT=17.771 T1=0.68	MSAT (TO) f=1 TT=1619.66 T1=0.77	OPTIMUM f=1 TT=856.616 T1=0.68 CHECKS=47509100 NODES=169673	MSAT (TO) f=1 TT=3600.04	MSAT (TO) f=1 TT=3600.07	OPTIMUM f=1 TT=17.771 T1=2.2	OPTIMUM f=1 TT=51.021 T1=1.91
csp/langford2/ normalized-langford-2-2.xml	MOPT f=1 TT=0.705 T1=0.48	OPTIMUM f=1 TT=30.674 T1=0.48 CHECKS=60 NODES=1	OPTIMUM f=1 TT=30.748 T1=0.57 CHECKS=60 NODES=1	MSAT (TO) f=1 TT=3600.06	MSAT (TO) f=1 TT=3600.02	OPTIMUM f=1 TT=0.705 T1=0.59	OPTIMUM f=1 TT=0.713 T1=0.48
csp/langford2/ normalized-langford-2-5.xml	MOPT f=1 TT=1.122 T1=0.59	OPTIMUM f=1 TT=31.039 T1=0.64 CHECKS=8018 NODES=83	OPTIMUM f=1 TT=31.211 T1=0.59 CHECKS=18102 NODES=113	MSAT (TO) f=1 TT=3600.02	MSAT (TO) f=1 TT=3600.08	OPTIMUM f=1 TT=1.241 T1=1.09	OPTIMUM f=1 TT=1.122 T1=0.97
Bench name	Best results on this instance	AbsconMax 112 pc-d	AbsconMax 112 pc-w	Concrete + CSP4J - MCRW Engine 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Sugar v1.13+minisat	Sugar++ v1.13+minisat-inc
csp/langford3/ normalized-langford-3-11.xml	MSAT TO f=2 TT=1587.45 T1=3.73	MSAT (TO) f=2 TT=1587.45 T1=7.49	MSAT (TO) f=2 TT=1608.12 T1=7.57	MSAT (TO) f=2 TT=3600.07	MSAT (TO) f=2 TT=3600.01	MSAT (TO) f=3 TT=3600.08 T1=6.67	MSAT (TO) f=2 TT=3600.14 T1=3.73
csp/langford3/ normalized-langford-3-12.xml	MSAT TO f=2 TT=1613.25 T1=4.15	MSAT (TO) f=2 TT=1630.64 T1=11.97	MSAT (TO) f=2 TT=1613.25 T1=12.06	MSAT (TO) f=2 TT=3600.05	MSAT (TO) f=2 TT=3600.09	MSAT (TO) f=2 TT=3600.04 T1=7.82	MSAT (TO) f=2 TT=3600.18 T1=4.15
csp/langford3/ normalized-langford-3-13.xml	MSAT TO f=2 TT=3600.02 T1=5.33	MSAT (TO) f=3 TT=1613.71 T1=13.41	MSAT (TO) f=3 TT=1616.02 T1=12.37	MSAT (TO) f=2 TT=3600.02	MSAT (TO) f=2 TT=3600.06	MSAT (TO) f=2 TT=3600.09 T1=10.73	MSAT (TO) f=2 TT=3600.22 T1=5.33
csp/langford3/ normalized-langford-3-2.xml	MOPT f=2 TT=0.732 T1=0.47	OPTIMUM f=2 TT=30.886 T1=0.58 CHECKS=1892 NODES=21	OPTIMUM f=2 TT=30.765 T1=0.47 CHECKS=1793 NODES=17	MSAT (TO) f=2 TT=3600.06	MSAT (TO) f=2 TT=3600.02	OPTIMUM f=2 TT=0.732 T1=0.61	OPTIMUM f=2 TT=0.756 T1=0.62
csp/langford3/ normalized-langford-3-3.xml	MOPT f=2 TT=1.008 T1=0.49	OPTIMUM f=2 TT=32.055 T1=0.49 CHECKS=64646 NODES=246	OPTIMUM f=2 TT=31.575 T1=0.59 CHECKS=33100 NODES=148	MSAT (TO) f=2 TT=3600.05	MSAT (TO) f=2 TT=3600.03	OPTIMUM f=2 TT=1.008 T1=0.88	OPTIMUM f=2 TT=1.031 T1=0.9
csp/langford3/ normalized-langford-3-5.xml	MOPT f=2 TT=1.757 T1=0.58	OPTIMUM f=2 TT=1177.92 T1=0.58 CHECKS=68201700 NODES=69281	OPTIMUM f=2 TT=108.021 T1=0.6 CHECKS=4087010 NODES=5179	MSAT (TO) f=2 TT=3600	MSAT (TO) f=2 TT=3600.1	OPTIMUM f=2 TT=1.757 T1=1.59	OPTIMUM f=2 TT=1.937 T1=1.8
csp/langford3/ normalized-langford-3-6.xml	MOPT f=2 TT=2.174 T1=0.72	MSAT (TO) f=2 TT=1586.43 T1=0.72	OPTIMUM f=2 TT=1018.56 T1=0.78 CHECKS=53891200 NODES=40950	MSAT (TO) f=2 TT=3600.06	MSAT (TO) f=2 TT=3600.07	OPTIMUM f=2 TT=2.174 T1=1.94	OPTIMUM f=2 TT=2.185 T1=1.86
csp/langford4/ normalized-langford-4-11.xml	MOPT f=2 TT=542.383 T1=256.16	MSAT (TO) f=5 TT=1631.49 T1=23.16	MSAT (TO) f=5 TT=1643.94 T1=22.98	MSAT (TO) f=2 TT=3600.04	MSAT (TO) f=2 TT=3600.07	OPTIMUM f=2 TT=542.383 T1=256.16	OPTIMUM f=2 TT=600.328 T1=599.74
csp/langford4/ normalized-langford-4-12.xml	MOPT f=2 TT=3296.4 T1=185.28	MSAT (TO) f=4 TT=1626.84 T1=49.96	MSAT (TO) f=4 TT=1637.86 T1=53.86	MSAT (TO) f=3 TT=3600.03	MSAT (TO) f=2 TT=3600.09	MSAT (TO) f=2 TT=3600.01 T1=185.28	OPTIMUM f=2 TT=3296.4 T1=3296.01
csp/langford4/ normalized-langford-4-14.xml	MSAT TO f=3 TT=3600.05 T1=142.62	MSAT (TO) f=8 TT=1608.74 T1=13.75	MSAT (TO) f=8 TT=1653.18 T1=13.52	MSAT (TO) f=4 TT=3600.05	MSAT (TO) f=3 TT=3600.05	MSAT (TO) f=5 TT=3600.06 T1=49.56	MSAT (TO) f=3 TT=3600.19 T1=142.62
Bench name	Best results on this instance	AbsconMax 112 pc-d	AbsconMax 112 pc-w	Concrete + CSP4J - MCRW Engine 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Sugar v1.13+minisat	Sugar++ v1.13+minisat-inc
csp/langford4/ normalized-langford-4-2.xml	MOPT f=2 TT=0.97 T1=0.48	OPTIMUM f=2 TT=31.101 T1=0.48 CHECKS=14067 NODES=63	OPTIMUM f=2 TT=31.205 T1=0.58 CHECKS=16354 NODES=78	MSAT (TO) f=2 TT=3600.04	MSAT (TO) f=2 TT=3600.06	OPTIMUM f=2 TT=0.973 T1=0.87	OPTIMUM f=2 TT=0.97 T1=0.82
csp/langford4/ normalized-langford-4-3.xml	MOPT f=2 TT=1.224 T1=0.67	OPTIMUM f=2 TT=47.868 T1=0.67 CHECKS=916726 NODES=1498	OPTIMUM f=2 TT=32.995 T1=0.69 CHECKS=103328 NODES=196	MSAT (TO) f=2 TT=3600	MSAT (TO) f=2 TT=3600.02	OPTIMUM f=2 TT=1.418 T1=1.25	OPTIMUM f=2 TT=1.224 T1=1.06
csp/langford4/ normalized-langford-4-4.xml	MOPT f=2 TT=1.688 T1=1.08	OPTIMUM f=2 TT=1123.77 T1=1.18 CHECKS=58578100 NODES=44959	OPTIMUM f=2 TT=104.942 T1=1.08 CHECKS=4059760 NODES=4269	MSAT (TO) f=2 TT=3600.07	MSAT (TO) f=2 TT=3600.09	OPTIMUM f=2 TT=1.843 T1=1.65	OPTIMUM f=2 TT=1.688 T1=1.52
csp/langford4/ normalized-langford-4-5.xml	MOPT f=3 TT=2.581 T1=0.86	MSAT (TO) f=3 TT=1609.43 T1=0.88	MSAT (TO) f=3 TT=1599.27 T1=0.86	MSAT (TO) f=3 TT=3600.01	MSAT (TO) f=3 TT=3600.05	OPTIMUM f=3 TT=2.753 T1=2.09	OPTIMUM f=3 TT=2.581 T1=2.41
csp/langford4/ normalized-langford-4-8.xml	MOPT f=1 TT=4.577 T1=4.36	MSAT (TO) f=2 TT=1598.83 T1=10.98	MSAT (TO) f=2 TT=1619.57 T1=11.62	MSAT (TO) f=1 TT=3600.01	MSAT (TO) f=1 TT=3600.03	OPTIMUM f=1 TT=9.165 T1=8.5	OPTIMUM f=1 TT=4.577 T1=4.36
csp/langford4/ normalized-langford-4-9.xml	MOPT f=2 TT=26.698 T1=17.67	MSAT (TO) f=3 TT=1611.48 T1=29.31	MSAT (TO) f=3 TT=1632.85 T1=29.09	MSAT (TO) f=2 TT=3600.06	MSAT (TO) f=2 TT=3600.01	OPTIMUM f=2 TT=26.698 T1=17.67	OPTIMUM f=2 TT=44.648 T1=44.38
csp/nengfa/ normalized-color.xml	MSAT TO f=1035 TT=3600.01	MSAT (TO) f=1119 TT=1725.88 T1=106.33	MSAT (TO) f=1119 TT=1714.33 T1=97.89	MSAT (TO) f=1035 TT=3600.01	MSAT (TO) f=1057 TT=3600.01	? TT=280.022	? TT=239.107
csp/pigeons/ normalized-pigeons-11.xml	MOPT f=1 TT=2.691 T1=0.53	MSAT (TO) f=1 TT=1647.82 T1=0.58	MSAT (TO) f=1 TT=1647.11 T1=0.53	MSAT (TO) f=1 TT=3600.07	MSAT (TO) f=1 TT=3600.1	OPTIMUM f=1 TT=2.691 T1=0.99	OPTIMUM f=1 TT=3.191 T1=0.98
csp/pigeons/ normalized-pigeons-13.xml	MOPT f=1 TT=75.432 T1=0.53	MSAT (TO) f=1 TT=1639.2 T1=0.61	MSAT (TO) f=1 TT=1652.46 T1=0.53	MSAT (TO) f=1 TT=3600.04	MSAT (TO) f=1 TT=3600.06	OPTIMUM f=1 TT=75.432 T1=1.42	OPTIMUM f=1 TT=87.304 T1=1.18
csp/pigeons/ normalized-pigeons-14.xml	MOPT f=1 TT=505.13 T1=0.52	MSAT (TO) f=1 TT=1628.66 T1=0.57	MSAT (TO) f=1 TT=1643.48 T1=0.52	MSAT (TO) f=1 TT=3600.07	MSAT (TO) f=1 TT=3600.04	OPTIMUM f=1 TT=649.361 T1=1.36	OPTIMUM f=1 TT=505.13 T1=1.33
Bench name	Best results on this instance	AbsconMax 112 pc-d	AbsconMax 112 pc-w	Concrete + CSP4J - MCRW Engine 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Sugar v1.13+minisat	Sugar++ v1.13+minisat-inc
csp/pigeons/ normalized-pigeons-16.xml	MSAT TO f=1 TT=1636.18 T1=0.48	MSAT (TO) f=1 TT=1636.18 T1=0.48	MSAT (TO) f=1 TT=1649.9 T1=0.57	MSAT (TO) f=1 TT=3600.07	MSAT (TO) f=1 TT=3600.06	MSAT (TO) f=1 TT=3600.05 T1=1.54	MSAT (TO) f=1 TT=3600.07 T1=1.46
csp/pigeons/ normalized-pigeons-30-ord.xml	MOPT f=1 TT=7.183 T1=0.99	OPTIMUM f=1 TT=297.481 T1=0.99 CHECKS=13959600 NODES=758	MSAT (TO) f=1 TT=1605.33 T1=0.99	MSAT (TO) f=1 TT=3600.08	MSAT (TO) f=1 TT=3600.01	OPTIMUM f=1 TT=16.425 T1=14.96	OPTIMUM f=1 TT=7.183 T1=7.11
csp/pigeons/ normalized-pigeons-30.xml	MSAT TO f=1 TT=1634.16 T1=0.87	MSAT (TO) f=1 TT=1651.66 T1=0.87	MSAT (TO) f=1 TT=1634.16 T1=0.91	MSAT (TO) f=1 TT=3600.09	MSAT (TO) f=1 TT=3600.01	MSAT (TO) f=1 TT=3600.09 T1=5.15	MSAT (TO) f=1 TT=3600.1 T1=2.87
csp/pigeons/ normalized-pigeons-35.xml	MSAT TO f=1 TT=1629.33 T1=0.78	MSAT (TO) f=1 TT=1639.53 T1=0.78	MSAT (TO) f=1 TT=1629.33 T1=0.88	MSAT (TO) f=1 TT=3600	MSAT (TO) f=1 TT=3600.09	MSAT (TO) f=1 TT=3600.04 T1=7.69	MSAT (TO) f=1 TT=3600.18 T1=4.27
csp/pigeons/ normalized-pigeons-40.xml	MSAT TO f=1 TT=1651.38 T1=0.97	MSAT (TO) f=1 TT=1654.42 T1=0.98	MSAT (TO) f=1 TT=1651.38 T1=0.97	MSAT (TO) f=1 TT=3600.06	MSAT (TO) f=1 TT=3600	MSAT (TO) f=1 TT=3600.02 T1=13.81	MSAT (TO) f=1 TT=3600.18 T1=5.62
csp/pigeons/ normalized-pigeons-50.xml	MSAT TO f=1 TT=1654.74 T1=0.97	MSAT (TO) f=1 TT=1675.2 T1=1.17	MSAT (TO) f=1 TT=1654.74 T1=0.97	MSAT (TO) f=1 TT=3600.01	MSAT (TO) f=1 TT=3600.04	MSAT (TO) f=1 TT=3600.05 T1=31.41	MSAT (TO) f=1 TT=3600.13 T1=8.87
csp/pigeons/ normalized-pigeons-8.xml	MOPT f=1 TT=0.933 T1=0.57	OPTIMUM f=1 TT=36.74 T1=0.57 CHECKS=447418 NODES=6139	OPTIMUM f=1 TT=42.532 T1=0.58 CHECKS=938994 NODES=11217	MSAT (TO) f=1 TT=3600.04	MSAT (TO) f=1 TT=3600.05	OPTIMUM f=1 TT=1.073 T1=0.9	OPTIMUM f=1 TT=0.933 T1=0.78
csp/queenAttacking/ normalized-queenAttacking-3.xml	MOPT f=1 TT=1.06 T1=0.58	OPTIMUM f=1 TT=31.436 T1=0.58 CHECKS=24143 NODES=131	OPTIMUM f=1 TT=31.501 T1=0.58 CHECKS=30242 NODES=141	MSAT (TO) f=1 TT=3600.03	MSAT (TO) f=1 TT=3600.01	OPTIMUM f=1 TT=1.163 T1=1	OPTIMUM f=1 TT=1.06 T1=0.9
csp/queenAttacking/ normalized-queenAttacking-4.xml	MOPT f=1 TT=2.179 T1=0.63	OPTIMUM f=1 TT=67.472 T1=0.68 CHECKS=1995390 NODES=5374	OPTIMUM f=1 TT=80.595 T1=0.63 CHECKS=2905650 NODES=5891	MSAT (TO) f=1 TT=3600.03	MSAT (TO) f=1 TT=3600.05	OPTIMUM f=1 TT=2.179 T1=1.66	OPTIMUM f=1 TT=2.752 T1=2.18
csp/queensKnights/ normalized-queensKnights-100-5-add.xml	MSAT TO f=1 TT=3600.06	? TT=275.975	? TT=259.238	MSAT (TO) f=1 TT=3600.07	MSAT (TO) f=1 TT=3600.06	? (MO) TT=88.36	? (MO) TT=90.713
Bench name	Best results on this instance	AbsconMax 112 pc-d	AbsconMax 112 pc-w	Concrete + CSP4J - MCRW Engine 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Sugar v1.13+minisat	Sugar++ v1.13+minisat-inc
csp/queensKnights/ normalized-queensKnights-100-5-mul.xml	MSAT TO f=1 TT=3600.02	? TT=388.412	? TT=364.143	MSAT (TO) f=1 TT=3600.02	MSAT (TO) f=1 TT=3600.06	? (MO) TT=103.548	? (MO) TT=103.512
csp/queensKnights/ normalized-queensKnights-10-5-mul.xml	MOPT f=1 TT=1.771 T1=0.57	OPTIMUM f=1 TT=33.824 T1=0.57 CHECKS=238773 NODES=99	OPTIMUM f=1 TT=34.064 T1=0.68 CHECKS=238773 NODES=99	MSAT (TO) f=1 TT=3600.08	MSAT (TO) f=1 TT=3600.02	OPTIMUM f=1 TT=1.952 T1=1.69	OPTIMUM f=1 TT=1.771 T1=1.52
csp/queensKnights/ normalized-queensKnights-12-5-mul.xml	MOPT f=1 TT=1.765 T1=0.68	OPTIMUM f=1 TT=36.78 T1=0.68 CHECKS=655259 NODES=143	OPTIMUM f=1 TT=37.381 T1=0.77 CHECKS=655259 NODES=143	MSAT (TO) f=1 TT=3600.09	MSAT (TO) f=1 TT=3600.04	OPTIMUM f=1 TT=1.765 T1=1.45	OPTIMUM f=1 TT=1.916 T1=1.64
csp/queensKnights/ normalized-queensKnights-20-5-mul.xml	MOPT f=1 TT=3.364 T1=0.98	OPTIMUM f=1 TT=76.176 T1=0.98 CHECKS=11540500 NODES=399	OPTIMUM f=1 TT=79.334 T1=1.16 CHECKS=11540500 NODES=399	MSAT (TO) f=1 TT=3600.08	MSAT (TO) f=1 TT=3600.04	OPTIMUM f=1 TT=4.765 T1=4.12	OPTIMUM f=1 TT=3.364 T1=2.9
csp/queensKnights/ normalized-queensKnights-50-5-add.xml	MOPT f=1 TT=21.138 T1=7.2	MSAT (TO) f=1 TT=1667.71 T1=7.2	MSAT (TO) f=1 TT=1669.91 T1=7.81	MSAT (TO) f=1 TT=3600.05	MSAT (TO) f=1 TT=3600.05	OPTIMUM f=1 TT=56.453 T1=51.27	OPTIMUM f=1 TT=21.138 T1=17.27
csp/queensKnights/ normalized-queensKnights-80-5-add.xml	MOPT f=1 TT=75.06 T1=4.64	? f=1 TT=669.197 T1=4.64	? f=1 TT=1049.58 T1=6.02	MSAT (TO) f=1 TT=3600.06	MSAT (TO) f=1 TT=3600.09	OPTIMUM f=1 TT=577.034 T1=526.86	OPTIMUM f=1 TT=75.06 T1=72.94
csp/queensKnights/ normalized-queensKnights-80-5-mul.xml	MOPT f=1 TT=974.987 T1=31.26	MSAT f=1 TT=1197.15 T1=33.49	MSAT f=1 TT=1137.45 T1=31.26	MSAT (TO) f=1 TT=3600.1	MSAT (TO) f=1 TT=3600.04	OPTIMUM f=1 TT=974.987 T1=906.83	MSAT (MO) f=214 TT=45.9 T1=45.27
csp/queensKnights/ normalized-queensKnights-8-5-add.xml	MOPT f=1 TT=1.272 T1=0.57	OPTIMUM f=1 TT=31.922 T1=0.57 CHECKS=56074 NODES=63	OPTIMUM f=1 TT=31.932 T1=0.57 CHECKS=56074 NODES=63	MSAT (TO) f=1 TT=3600.06	MSAT (TO) f=1 TT=3600.06	OPTIMUM f=1 TT=1.273 T1=1.07	OPTIMUM f=1 TT=1.272 T1=1.09
csp/queensKnights/ normalized-queensKnights-8-5-mul.xml	MOPT f=1 TT=1.647 T1=0.68	OPTIMUM f=1 TT=32.219 T1=0.68 CHECKS=67863 NODES=63	OPTIMUM f=1 TT=32.201 T1=0.68 CHECKS=67863 NODES=63	MSAT (TO) f=1 TT=3600.08	MSAT (TO) f=1 TT=3600.06	OPTIMUM f=1 TT=1.665 T1=1.45	OPTIMUM f=1 TT=1.647 T1=1.43

Some statistics...

	AbsconMax 112 pc-d	AbsconMax 112 pc-w	Concrete + CSP4J - MCRW Engine 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Sugar v1.13+minisat	Sugar++ v1.13+minisat-inc
Number of times the solver is able to give the best known answer	30	31	11	11	43	45
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	39	39	47	48	44	45
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	2	8	4	4	15	22
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	21	18	0	0	4	8