CSP 2008 Competition: results by benchmark

Results by benchmark for category n-ary constraints in intension (N-ARY-INT), subcategory real world problems

This page displays the results of the different solvers for each benchmark for category n-ary constraints in intension (N-ARY-INT), subcategory real world problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bmc/ normalized-bmc-ibm-01-02.xml	SAT TT=4.363	SAT TT=29.73 CHECKS=241772 NODES=9685	SAT TT=94.841 CHECKS=434684 NODES=9685	SAT TT=14.316	SAT TT=34.04 CHECKS=27432000	SAT TT=23.305 CHECKS=4974480	SAT TT=43.209 ASSIGNMENTS=3047	SAT TT=114.175 ASSIGNMENTS=3680	SAT TT=1029.42 CHECKS=269743 NODES=12023	? (TO) TT=1800.08	SAT TT=829.557 CHECKS=42754500 NODES=847	SAT TT=4.363 ASSIGNMENTS=2982 CHECKS=552844	SAT TT=4.591 ASSIGNMENTS=2982 CHECKS=552844	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=4.68 ASSIGNMENTS=2982 CHECKS=552844	SAT TT=6.708 ASSIGNMENTS=7449 CHECKS=2648600	? (exit code) TT=48.71	SAT TT=542.22 ASSIGNMENTS=179610 CHECKS=389595000	SAT TT=5.099 ASSIGNMENTS=2974 CHECKS=550099	? (TO) TT=1800.12	SAT TT=18.558	SAT TT=20.983
csp/bmc/ normalized-bmc-ibm-01-04.xml	SAT TT=4.88	SAT TT=46.524 CHECKS=277843 NODES=9685	SAT TT=109.15 CHECKS=471661 NODES=9685	SAT TT=14.386	SAT TT=33.861 CHECKS=27276700	SAT TT=26.365 CHECKS=5819680	SAT TT=45.716 ASSIGNMENTS=3047	SAT TT=116.267 ASSIGNMENTS=3594	SAT TT=1079.35 CHECKS=460897 NODES=12023	? (TO) TT=1800.09	SAT TT=1531.44 CHECKS=50592700 NODES=1043	SAT TT=5.337 ASSIGNMENTS=2984 CHECKS=831891	SAT TT=5.142 ASSIGNMENTS=2984 CHECKS=831891	? (problem) TT=618.021	? (problem) TT=615.144	SAT TT=4.88 ASSIGNMENTS=2984 CHECKS=831891	SAT TT=9.558 ASSIGNMENTS=12112 CHECKS=4800940	? (exit code) TT=57.1	SAT TT=755.923 ASSIGNMENTS=216803 CHECKS=463569000	SAT TT=5.072 ASSIGNMENTS=2965 CHECKS=829131	? (TO) TT=1800.08	SAT TT=29.75	SAT TT=31.996
csp/bmc/ normalized-bmc-ibm-01-08.xml	SAT TT=5.184	SAT TT=44.953 CHECKS=296181 NODES=9685	SAT TT=111.373 CHECKS=493586 NODES=9685	SAT TT=13.705	SAT TT=39.282 CHECKS=27589300	SAT TT=24.12 CHECKS=5768100	SAT TT=43.929 ASSIGNMENTS=3047	SAT TT=118.807 ASSIGNMENTS=3466	SAT TT=999.342 CHECKS=755074 NODES=12023	? (TO) TT=1800.04	SAT TT=1044.62 CHECKS=47338100 NODES=940	SAT TT=5.184 ASSIGNMENTS=2964 CHECKS=908579	SAT TT=5.315 ASSIGNMENTS=2964 CHECKS=908579	? (problem) TT=275.489	? (problem) TT=265.126	SAT TT=5.25 ASSIGNMENTS=2964 CHECKS=908579	SAT TT=5.438 ASSIGNMENTS=3221 CHECKS=1190170	? (exit code) TT=59.388	SAT TT=660.8 ASSIGNMENTS=197964 CHECKS=460048000	SAT TT=5.38 ASSIGNMENTS=2942 CHECKS=904546	? (TO) TT=1800.16	SAT TT=47.927	SAT TT=34.211
csp/bmc/ normalized-bmc-ibm-02-02.xml	SAT TT=1.061	SAT TT=4.745 CHECKS=36650 NODES=2810	SAT TT=8.058 CHECKS=80150 NODES=2810	SAT TT=2.764	SAT TT=3.107 CHECKS=2923840	SAT TT=2.447 CHECKS=2583460	SAT TT=9.431 ASSIGNMENTS=524	SAT TT=13.655 ASSIGNMENTS=948	SAT TT=35.609 CHECKS=44487 NODES=3231	SAT TT=48.242 CHECKS=20323500 NODES=150399	SAT TT=29.265 CHECKS=3201460 NODES=301	SAT TT=1.076 ASSIGNMENTS=518 CHECKS=113645	SAT TT=1.14 ASSIGNMENTS=518 CHECKS=113645	Wrong UNSAT TT=23.492	Wrong UNSAT TT=14.86	SAT TT=1.061 ASSIGNMENTS=518 CHECKS=113645	SAT TT=1.064 ASSIGNMENTS=623 CHECKS=116517	Wrong Cert. TT=7.664	SAT TT=1.397 ASSIGNMENTS=977 CHECKS=306968	SAT TT=1.119 ASSIGNMENTS=516 CHECKS=113632	SAT TT=22.403	SAT TT=3.75	SAT TT=3.821
csp/bmc/ normalized-bmc-ibm-02-04.xml	SAT TT=0.959	SAT TT=5.754 CHECKS=42126 NODES=2810	SAT TT=9.114 CHECKS=88133 NODES=2810	SAT TT=2.792	SAT TT=3.265 CHECKS=2893460	SAT TT=2.899 CHECKS=2903340	SAT TT=8.706 ASSIGNMENTS=524	SAT TT=12.488 ASSIGNMENTS=948	SAT TT=93.781 CHECKS=125768 NODES=3231	SAT TT=29.959 CHECKS=236362 NODES=505	SAT TT=29.64 CHECKS=3296770 NODES=293	SAT TT=1.086 ASSIGNMENTS=533 CHECKS=124256	SAT TT=0.959 ASSIGNMENTS=533 CHECKS=124256	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=1.038 ASSIGNMENTS=533 CHECKS=124256	SAT TT=1.098 ASSIGNMENTS=637 CHECKS=126390	Wrong Cert. TT=7.908	SAT TT=1.354 ASSIGNMENTS=1161 CHECKS=340866	SAT TT=1.069 ASSIGNMENTS=523 CHECKS=124238	? (TO) TT=1800.16	SAT TT=5.414	SAT TT=5.485
csp/bmc/ normalized-bmc-ibm-02-08.xml	SAT TT=1.282	SAT TT=5.867 CHECKS=52577 NODES=2810	SAT TT=9.073 CHECKS=101579 NODES=2810	SAT TT=2.557	SAT TT=3.294 CHECKS=2932360	SAT TT=2.659 CHECKS=2907560	SAT TT=8.76 ASSIGNMENTS=524	SAT TT=13.139 ASSIGNMENTS=948	SAT TT=143.797 CHECKS=251544 NODES=3231	SAT TT=126.996 CHECKS=39298300 NODES=300418	SAT TT=86.334 CHECKS=3272800 NODES=280	SAT TT=1.329 ASSIGNMENTS=516 CHECKS=187140	SAT TT=1.371 ASSIGNMENTS=516 CHECKS=187140	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=1.282 ASSIGNMENTS=516 CHECKS=187140	SAT TT=1.304 ASSIGNMENTS=562 CHECKS=188841	Wrong Cert. TT=8.018	SAT TT=1.497 ASSIGNMENTS=777 CHECKS=278312	SAT TT=1.373 ASSIGNMENTS=515 CHECKS=187129	? (TO) TT=1800.15	SAT TT=6.106	SAT TT=5.86
csp/bmc/ normalized-bmc-ibm-03-02.xml	SAT TT=5.86	SAT TT=56.183 CHECKS=436936 NODES=14957	SAT TT=108.559 CHECKS=520289 NODES=14957	SAT TT=18.366	SAT TT=65.854 CHECKS=28934900	SAT TT=35.799 CHECKS=6301210	SAT TT=61.849 ASSIGNMENTS=3635	SAT TT=156.548 ASSIGNMENTS=4517	SAT TT=1577.42 CHECKS=315108 NODES=19685	? TT=1148.04 CHECKS=362170 NODES=0	? TT=1142.38 CHECKS=356782 NODES=0	SAT TT=5.86 ASSIGNMENTS=3795 CHECKS=504719	SAT TT=6.09 ASSIGNMENTS=3795 CHECKS=504719	Wrong UNSAT TT=505.806	Wrong UNSAT TT=325.438	SAT TT=5.904 ASSIGNMENTS=3808 CHECKS=506554	SAT TT=6.462 ASSIGNMENTS=11113 CHECKS=1282160	? (exit code) TT=89.294	SAT TT=537.923 ASSIGNMENTS=239824 CHECKS=281075000	SAT TT=6.06 ASSIGNMENTS=3918 CHECKS=622129	? (TO) TT=1800.15	SAT TT=20.108	SAT TT=21.912
csp/bmc/ normalized-bmc-ibm-03-04.xml	SAT TT=5.803	SAT TT=99.273 CHECKS=462760 NODES=14957	SAT TT=150.182 CHECKS=546529 NODES=14957	SAT TT=18.885	SAT TT=55.328 CHECKS=28679600	SAT TT=78.729 CHECKS=6617540	SAT TT=57.921 ASSIGNMENTS=3635	SAT TT=157.57 ASSIGNMENTS=4513	SAT TT=1670.73 CHECKS=542517 NODES=19685	? TT=1196.46 CHECKS=776607 NODES=0	? TT=1160.09 CHECKS=778964 NODES=0	SAT TT=6.243 ASSIGNMENTS=3808 CHECKS=639451	SAT TT=5.803 ASSIGNMENTS=3808 CHECKS=639451	? (MO) TT=558.09	? (MO) TT=581.01	SAT TT=6.34 ASSIGNMENTS=3794 CHECKS=641318	SAT TT=21.207 ASSIGNMENTS=94022 CHECKS=13293500	? (exit code) TT=92.785	SAT TT=642.025 ASSIGNMENTS=241310 CHECKS=290346000	SAT TT=6.376 ASSIGNMENTS=3936 CHECKS=756906	? (TO) TT=1800.15	SAT TT=28.599	SAT TT=31.118
csp/bmc/ normalized-bmc-ibm-03-08.xml	SAT TT=6.544	SAT TT=106.126 CHECKS=498560 NODES=14957	SAT TT=150.697 CHECKS=584119 NODES=14957	SAT TT=19.367	SAT TT=51.997 CHECKS=28710300	SAT TT=47.166 CHECKS=6581710	SAT TT=59.177 ASSIGNMENTS=3635	SAT TT=163.291 ASSIGNMENTS=4835	SAT TT=1671.12 CHECKS=864394 NODES=19685	? TT=1476.18 CHECKS=1565200 NODES=0	? TT=1560.13 CHECKS=1561190 NODES=0	SAT TT=6.568 ASSIGNMENTS=3819 CHECKS=858711	SAT TT=20.247 ASSIGNMENTS=3965 CHECKS=1201170	? (problem) TT=789.303	? (problem) TT=737.069	SAT TT=6.544 ASSIGNMENTS=3828 CHECKS=897010	SAT TT=40.231 ASSIGNMENTS=142633 CHECKS=28031200	? (exit code) TT=104.685	SAT TT=835.428 ASSIGNMENTS=184947 CHECKS=391541000	SAT TT=7.395 ASSIGNMENTS=3965 CHECKS=1201170	? (TO) TT=1800.13	SAT TT=33.989	SAT TT=36.581
csp/bmc/ normalized-bmc-ibm-03-16.xml	SAT TT=6.98	SAT TT=104.135 CHECKS=360610 NODES=14930	SAT TT=158.387 CHECKS=452966 NODES=14930	SAT TT=19.451	SAT TT=49.237 CHECKS=28654000	SAT TT=50.234 CHECKS=6544100	SAT TT=57.243 ASSIGNMENTS=3635	SAT TT=160.242 ASSIGNMENTS=4474	SAT TT=1692.16 CHECKS=1483520 NODES=19685	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=20.352 ASSIGNMENTS=3955 CHECKS=1265710	SAT TT=21.55 ASSIGNMENTS=3955 CHECKS=1265710	? (problem) TT=424.216	? (problem) TT=395.496	SAT TT=6.98 ASSIGNMENTS=3823 CHECKS=950673	SAT TT=30.546 ASSIGNMENTS=90097 CHECKS=19382900	? (exit code) TT=95.755	SAT TT=1390.51 ASSIGNMENTS=404901 CHECKS=806402000	SAT TT=7.431 ASSIGNMENTS=3955 CHECKS=1265710	? (TO) TT=1800.12	SAT TT=33.914	SAT TT=33.878
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bmc/ normalized-bmc-ibm-04-04.xml	SAT TT=12.94	? TT=160.859	? TT=157.898	SAT TT=43.594	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=135.249 ASSIGNMENTS=5470	? (MO) TT=153.949	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=31.672 ASSIGNMENTS=5364 CHECKS=1433340	SAT TT=30.985 ASSIGNMENTS=5364 CHECKS=1433340	? (problem) TT=1097.55	? (problem) TT=1174.09	SAT TT=12.94 ASSIGNMENTS=5384 CHECKS=1419310	SAT TT=46.786 ASSIGNMENTS=74837 CHECKS=31673100	? (exit code) TT=789.348	? (TO) TT=1800.11	SAT TT=13.02 ASSIGNMENTS=5364 CHECKS=1433340	? (TO) TT=1800.14	SAT TT=115.65	SAT TT=87.319
csp/bmc/ normalized-bmc-ibm-04-16.xml	SAT TT=14.673	? TT=157.649	? TT=157.92	SAT TT=44.017	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=123.756 ASSIGNMENTS=5470	SAT TT=252.862 ASSIGNMENTS=5467	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=31.779 ASSIGNMENTS=5243 CHECKS=1897450	SAT TT=32.391 ASSIGNMENTS=5243 CHECKS=1897450	? (problem) TT=1018.97	? (problem) TT=1033.43	SAT TT=14.765 ASSIGNMENTS=5237 CHECKS=1886310	SAT TT=69.62 ASSIGNMENTS=75978 CHECKS=41013900	? (MO) TT=5.78	? (TO) TT=1800.12	SAT TT=14.673 ASSIGNMENTS=5243 CHECKS=1897450	? (TO) TT=1800.17	SAT TT=212.199	SAT TT=92.351
csp/bmc/ normalized-bmc-ibm-05-02.xml	SAT TT=3.129	SAT TT=27.091 CHECKS=147611 NODES=9396	SAT TT=21.288 CHECKS=159500 NODES=0	SAT TT=10.783	SAT TT=26.531 CHECKS=14047600	SAT TT=21.191 CHECKS=6387210	SAT TT=30.562 ASSIGNMENTS=3109	SAT TT=110.528 ASSIGNMENTS=4111	SAT TT=478.908 CHECKS=178374 NODES=9396	SAT TT=390.93 CHECKS=550424 NODES=764	SAT TT=393.976 CHECKS=24153000 NODES=644	SAT TT=3.197 ASSIGNMENTS=3215 CHECKS=260135	SAT TT=3.246 ASSIGNMENTS=3215 CHECKS=260135	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=3.495 ASSIGNMENTS=3215 CHECKS=260135	SAT TT=3.129 ASSIGNMENTS=3205 CHECKS=242080	? (exit code) TT=33.219	SAT TT=58.428 ASSIGNMENTS=58730 CHECKS=26600500	SAT TT=3.152 ASSIGNMENTS=3229 CHECKS=261404	? (TO) TT=1800.12	SAT TT=10.228	SAT TT=10.498
csp/bmc/ normalized-bmc-ibm-07-08.xml	UNSAT TT=2.231	UNSAT TT=13.522 CHECKS=49 NODES=0	UNSAT TT=14.913 CHECKS=49 NODES=0	UNSAT TT=9.367	UNSAT TT=4.583 CHECKS=133933	UNSAT TT=2.231 CHECKS=133933	UNSAT TT=25.012 ASSIGNMENTS=0	UNSAT TT=24.619 ASSIGNMENTS=0	UNSAT TT=448.335 CHECKS=259635 NODES=0	UNSAT TT=531.494 CHECKS=483036 NODES=0	UNSAT TT=617.988 CHECKS=483036 NODES=0	UNSAT TT=3.126 ASSIGNMENTS=0 CHECKS=127236	UNSAT TT=2.979 ASSIGNMENTS=0 CHECKS=127236	? (problem) TT=808.092	? (problem) TT=783.441	UNSAT TT=3.098 ASSIGNMENTS=0 CHECKS=127236	UNSAT TT=3.248 ASSIGNMENTS=0 CHECKS=127236	? (exit code) TT=35.409	UNSAT TT=3.108 ASSIGNMENTS=0 CHECKS=127236	UNSAT TT=3.073 ASSIGNMENTS=0 CHECKS=127236	? (TO) TT=1800.11	UNSAT TT=16.09	UNSAT TT=19.227
csp/bmc/ normalized-bmc-ibm-07-16.xml	UNSAT TT=2.312	UNSAT TT=13.534 CHECKS=49 NODES=0	UNSAT TT=15.139 CHECKS=49 NODES=0	UNSAT TT=10.158	UNSAT TT=4.519 CHECKS=133933	UNSAT TT=2.312 CHECKS=133933	UNSAT TT=25.216 ASSIGNMENTS=0	UNSAT TT=25.549 ASSIGNMENTS=0	UNSAT TT=447.693 CHECKS=585551 NODES=0	UNSAT TT=574.736 CHECKS=986939 NODES=0	UNSAT TT=602.167 CHECKS=986939 NODES=0	UNSAT TT=3.531 ASSIGNMENTS=0 CHECKS=155836	UNSAT TT=3.296 ASSIGNMENTS=0 CHECKS=155836	? (problem) TT=517.363	? (problem) TT=517.87	UNSAT TT=3.229 ASSIGNMENTS=0 CHECKS=155836	UNSAT TT=3.216 ASSIGNMENTS=0 CHECKS=155836	? (exit code) TT=36.753	UNSAT TT=3.373 ASSIGNMENTS=0 CHECKS=155836	UNSAT TT=3.538 ASSIGNMENTS=0 CHECKS=155836	? (TO) TT=1800.13	UNSAT TT=15.974	UNSAT TT=19.774
csp/lexHerald/ normalized-crossword-m1-lex-05-01.xml	SAT TT=0.418	SAT TT=1.036 CHECKS=18787 NODES=96	SAT TT=1.414 CHECKS=129622 NODES=401	SAT TT=3.723	SAT TT=0.651 CHECKS=12998	SAT TT=0.568 CHECKS=13433	SAT TT=9.235 ASSIGNMENTS=786	SAT TT=1.73 ASSIGNMENTS=10	SAT TT=66.942 CHECKS=69865000 NODES=87	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=17.073 ASSIGNMENTS=786	SAT TT=8.126 ASSIGNMENTS=627 CHECKS=249532	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=6.474 ASSIGNMENTS=7815 CHECKS=3876700	SAT TT=1.852 ASSIGNMENTS=9359 CHECKS=971161	SAT TT=1.476	SAT TT=0.418 ASSIGNMENTS=600 CHECKS=216831	SAT TT=0.443 ASSIGNMENTS=627 CHECKS=249532	? (MO) TT=30.602	SAT TT=19.376	SAT TT=21.277
csp/lexHerald/ normalized-crossword-m1-lex-05-05.xml	SAT TT=0.031	SAT TT=0.996 CHECKS=6381 NODES=22	SAT TT=0.877 CHECKS=10499 NODES=22	SAT TT=0.778	SAT TT=0.275 CHECKS=3812	SAT TT=0.235 CHECKS=3941	SAT TT=1.303 ASSIGNMENTS=122	SAT TT=1.129 ASSIGNMENTS=11	SAT TT=115.396 CHECKS=6073740 NODES=17	SAT TT=48.049 CHECKS=5385310 NODES=1950020	SAT TT=111.204 CHECKS=119153000 NODES=17153	SAT TT=0.484 ASSIGNMENTS=2319 CHECKS=417902	SAT TT=0.486 ASSIGNMENTS=2319 CHECKS=417902	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=0.402 ASSIGNMENTS=1796 CHECKS=316642	SAT TT=0.081 ASSIGNMENTS=404 CHECKS=35936	SAT TT=0.723	SAT TT=0.031 ASSIGNMENTS=68 CHECKS=6483	SAT TT=0.032 ASSIGNMENTS=110 CHECKS=10499	? (MO) TT=37.787	SAT TT=2.26	SAT TT=2.676
csp/lexHerald/ normalized-crossword-m1-lex-05-06.xml	SAT TT=0.028	SAT TT=0.921 CHECKS=2391 NODES=25	SAT TT=0.903 CHECKS=4114 NODES=25	SAT TT=2.413	SAT TT=0.4 CHECKS=3486	SAT TT=0.353 CHECKS=3500	SAT TT=4.279 ASSIGNMENTS=498	SAT TT=1.355 ASSIGNMENTS=19	SAT TT=99.699 CHECKS=17986800 NODES=27	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=11.731 ASSIGNMENTS=498	SAT TT=11.357 ASSIGNMENTS=498	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=3.444 ASSIGNMENTS=5619 CHECKS=1058470	SAT TT=1.575 ASSIGNMENTS=5644 CHECKS=560596	SAT TT=0.79	SAT TT=0.028 ASSIGNMENTS=38 CHECKS=3438	SAT TT=0.066 ASSIGNMENTS=143 CHECKS=15881	? (MO) TT=33.971	SAT TT=5.236	SAT TT=7.376
csp/lexHerald/ normalized-crossword-m1-lex-05-09.xml	SAT TT=0.019	SAT TT=0.852 CHECKS=2077 NODES=20	SAT TT=0.854 CHECKS=1737 NODES=0	SAT TT=1.037	SAT TT=0.23 CHECKS=1259	SAT TT=0.233 CHECKS=1522	SAT TT=1.38 ASSIGNMENTS=163	SAT TT=0.952 ASSIGNMENTS=10	SAT TT=122.873 CHECKS=6459080 NODES=21	SAT TT=78.469 CHECKS=8258500 NODES=3600140	SAT TT=108.639 CHECKS=22229900 NODES=1807	SAT TT=0.295 ASSIGNMENTS=835 CHECKS=83953	SAT TT=0.292 ASSIGNMENTS=835 CHECKS=83953	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=0.254 ASSIGNMENTS=627 CHECKS=65526	SAT TT=0.019 ASSIGNMENTS=5 CHECKS=489	SAT TT=0.568	SAT TT=0.028 ASSIGNMENTS=46 CHECKS=2728	SAT TT=0.046 ASSIGNMENTS=154 CHECKS=10251	? (MO) TT=40.181	SAT TT=2.619	SAT TT=3.499
csp/lexHerald/ normalized-crossword-m1-lex-05-10.xml	SAT TT=0.018	SAT TT=0.831 CHECKS=3735 NODES=17	SAT TT=0.864 CHECKS=2824 NODES=0	SAT TT=0.788	SAT TT=0.216 CHECKS=2571	SAT TT=0.134 CHECKS=1506	SAT TT=1.283 ASSIGNMENTS=142	SAT TT=0.957 ASSIGNMENTS=10	SAT TT=128.76 CHECKS=5780890 NODES=19	SAT TT=71.398 CHECKS=12264000 NODES=43950000	SAT TT=74.675 CHECKS=15291600 NODES=1808	SAT TT=0.357 ASSIGNMENTS=1540 CHECKS=270899	SAT TT=0.355 ASSIGNMENTS=1540 CHECKS=270899	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.553 ASSIGNMENTS=2330 CHECKS=417960	SAT TT=0.018 ASSIGNMENTS=11 CHECKS=1052	SAT TT=0.632	SAT TT=0.024 ASSIGNMENTS=29 CHECKS=3176	SAT TT=0.027 ASSIGNMENTS=75 CHECKS=6665	? TT=91.799	SAT TT=2.264	SAT TT=2.633
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexHerald/ normalized-crossword-m1-lex-15-03.xml	SAT TT=0.217	SAT TT=3.723 CHECKS=451693 NODES=808	SAT TT=2.782 CHECKS=203731 NODES=200	? (TO) TT=1800.13	SAT TT=8.436 CHECKS=232924	SAT TT=8.774 CHECKS=611707	SAT TT=12.13 ASSIGNMENTS=79	SAT TT=61.674 ASSIGNMENTS=264	SAT TT=437.681 CHECKS=1808380000 NODES=412	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=0.256 ASSIGNMENTS=74 CHECKS=112311	SAT TT=0.259 ASSIGNMENTS=74 CHECKS=112311	? (TO) TT=1800.11	? (TO) TT=1800.09	SAT TT=0.217 ASSIGNMENTS=60 CHECKS=75949	SAT TT=20.205 ASSIGNMENTS=19830 CHECKS=24677700	? (TO) TT=1800.01	SAT TT=49.78 ASSIGNMENTS=30186 CHECKS=27135400	SAT TT=0.601 ASSIGNMENTS=347 CHECKS=433695	? (MO) TT=33.931	SAT TT=583.863	? (TO) TT=1800.1
csp/lexHerald/ normalized-crossword-m1-lex-15-04.xml	UNSAT TT=1.608	UNSAT TT=11.64 CHECKS=1902950 NODES=4951	UNSAT TT=7.381 CHECKS=485064 NODES=2299	? (TO) TT=1800.08	UNSAT TT=29.944 CHECKS=1705940	UNSAT TT=14.108 CHECKS=1097550	UNSAT TT=21.806 ASSIGNMENTS=0	UNSAT TT=28.002 ASSIGNMENTS=0	UNSAT TT=1107.29 CHECKS=6570340000 NODES=1316	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=19.79 ASSIGNMENTS=4951 CHECKS=1902950	UNSAT TT=17.717 ASSIGNMENTS=4951 CHECKS=1902950	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=1.608 ASSIGNMENTS=606 CHECKS=1300030	UNSAT TT=13.909 ASSIGNMENTS=7960 CHECKS=9925820	UNSAT TT=8.32	UNSAT TT=11.008 ASSIGNMENTS=3266 CHECKS=7793880	UNSAT TT=1.814 ASSIGNMENTS=463 CHECKS=1291450	? (MO) TT=37.824	UNSAT TT=735.255	UNSAT TT=503.359
csp/lexHerald/ normalized-crossword-m1-lex-15-05.xml	SAT TT=0.268	SAT TT=2.478 CHECKS=174192 NODES=189	SAT TT=3.228 CHECKS=349278 NODES=334	SAT TT=1161.83	SAT TT=44.178 CHECKS=2649060	SAT TT=6.993 CHECKS=521272	SAT TT=12.297 ASSIGNMENTS=91	SAT TT=62.35 ASSIGNMENTS=57	SAT TT=223.569 CHECKS=667871000 NODES=453	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.297 ASSIGNMENTS=108 CHECKS=144862	SAT TT=0.283 ASSIGNMENTS=108 CHECKS=144862	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=0.327 ASSIGNMENTS=173 CHECKS=229543	SAT TT=17.543 ASSIGNMENTS=12298 CHECKS=22138500	SAT TT=20.109	SAT TT=95.833 ASSIGNMENTS=52996 CHECKS=48824600	SAT TT=0.268 ASSIGNMENTS=107 CHECKS=144633	? (MO) TT=31.4	SAT TT=313.94	? (TO) TT=1800.03
csp/lexHerald/ normalized-crossword-m1-lex-15-07.xml	SAT TT=11.293	SAT TT=17.613 CHECKS=3581190 NODES=7324	SAT TT=60.213 CHECKS=16093000 NODES=26775	? (TO) TT=1800.05	SAT TT=86.262 CHECKS=3896450	SAT TT=107.417 CHECKS=6199500	SAT TT=39.872 ASSIGNMENTS=2012	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=41.897 ASSIGNMENTS=11470 CHECKS=16897400	SAT TT=116.223 ASSIGNMENTS=48839 CHECKS=32646700	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=11.293 ASSIGNMENTS=3123 CHECKS=5013950	SAT TT=511.508 ASSIGNMENTS=198214 CHECKS=254744000	? (TO) TT=1800	SAT TT=116.261 ASSIGNMENTS=40983 CHECKS=45057400	SAT TT=33.732 ASSIGNMENTS=11470 CHECKS=16897400	? (MO) TT=32.115	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/lexHerald/ normalized-crossword-m1-lex-15-09.xml	SAT TT=0.202	SAT TT=2.383 CHECKS=126350 NODES=368	SAT TT=2.878 CHECKS=221545 NODES=362	? (TO) TT=1800.07	SAT TT=8.379 CHECKS=191646	SAT TT=6.265 CHECKS=146823	SAT TT=9.325 ASSIGNMENTS=91	SAT TT=42.989 ASSIGNMENTS=177	SAT TT=283.501 CHECKS=826296000 NODES=414	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT TT=0.213 ASSIGNMENTS=77 CHECKS=72829	SAT TT=0.214 ASSIGNMENTS=77 CHECKS=72829	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=0.202 ASSIGNMENTS=76 CHECKS=74439	SAT TT=15.897 ASSIGNMENTS=18918 CHECKS=19043600	SAT TT=23.655	SAT TT=42.172 ASSIGNMENTS=31691 CHECKS=22246500	SAT TT=0.455 ASSIGNMENTS=340 CHECKS=336082	? (MO) TT=43.413	SAT TT=975.246	? (TO) TT=1800.01
csp/lexHerald/ normalized-crossword-m1-lex-19-03.xml	SAT TT=71.437	SAT TT=147.472 CHECKS=36729500 NODES=85434	SAT TT=71.437 CHECKS=14985600 NODES=41201	? (TO) TT=1800.1	SAT TT=391.963 CHECKS=42224200	SAT TT=1096.19 CHECKS=133928000	? (TO) TT=1800.15	? (TO) TT=1800.09	SAT TT=815.439 CHECKS=449591000 NODES=11872	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=105.106 ASSIGNMENTS=48894 CHECKS=23590800	SAT TT=112.3 ASSIGNMENTS=48894 CHECKS=23590800	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=637.39 ASSIGNMENTS=184969 CHECKS=315635000	SAT TT=432.318 ASSIGNMENTS=127767 CHECKS=300676000	? (MO) TT=36.206	? (TO) TT=1800.07	? (TO) TT=1800.07
csp/lexHerald/ normalized-crossword-m1-lex-19-06.xml	SAT TT=0.466	SAT TT=4.966 CHECKS=772627 NODES=812	SAT TT=6.031 CHECKS=956265 NODES=803	? (TO) TT=1800.12	SAT TT=11.769 CHECKS=755822	SAT TT=8.725 CHECKS=633577	SAT TT=21.718 ASSIGNMENTS=127	SAT TT=74.735 ASSIGNMENTS=550	SAT TT=263.124 CHECKS=682795000 NODES=800	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=0.487 ASSIGNMENTS=162 CHECKS=274165	SAT TT=0.466 ASSIGNMENTS=162 CHECKS=274165	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=0.5 ASSIGNMENTS=161 CHECKS=308193	SAT TT=14.098 ASSIGNMENTS=7494 CHECKS=15675900	SAT TT=1590.83	SAT TT=71.613 ASSIGNMENTS=46714 CHECKS=88412500	SAT TT=0.677 ASSIGNMENTS=385 CHECKS=510826	? (MO) TT=30.686	SAT TT=1536.08	? (TO) TT=1800
csp/lexHerald/ normalized-crossword-m1-lex-19-09.xml	SAT TT=0.438	SAT TT=5.075 CHECKS=518365 NODES=712	SAT TT=5.796 CHECKS=695502 NODES=714	? (TO) TT=1800.12	SAT TT=51.814 CHECKS=5030510	SAT TT=9.664 CHECKS=1043110	SAT TT=29.9 ASSIGNMENTS=99	SAT TT=66.151 ASSIGNMENTS=158	SAT TT=254.075 CHECKS=750639000 NODES=607	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=0.45 ASSIGNMENTS=118 CHECKS=240060	SAT TT=0.452 ASSIGNMENTS=118 CHECKS=240060	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=0.438 ASSIGNMENTS=123 CHECKS=245428	SAT TT=15.655 ASSIGNMENTS=7544 CHECKS=18843300	SAT TT=13.349	SAT TT=203.996 ASSIGNMENTS=97691 CHECKS=255082000	SAT TT=1.113 ASSIGNMENTS=525 CHECKS=1295660	? (MO) TT=37.204	SAT TT=1078.92	? (TO) TT=1800.04
csp/lexHerald/ normalized-crossword-m1-lex-21-02.xml	SAT TT=2.459	SAT TT=14.147 CHECKS=3939890 NODES=2734	SAT TT=12.698 CHECKS=2702910 NODES=3138	? (TO) TT=1800.14	SAT TT=47.277 CHECKS=5779680	SAT TT=26.625 CHECKS=3485260	SAT TT=37.476 ASSIGNMENTS=436	SAT TT=1683.59 ASSIGNMENTS=62008	SAT TT=1085.48 CHECKS=5267680000 NODES=1610	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=10.604 ASSIGNMENTS=937 CHECKS=2921020	SAT TT=21.469 ASSIGNMENTS=2734 CHECKS=3939890	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=3.457 ASSIGNMENTS=1267 CHECKS=4112260	SAT TT=17.63 ASSIGNMENTS=8455 CHECKS=18309100	? (TO) TT=1800.04	SAT TT=59.948 ASSIGNMENTS=33245 CHECKS=67448800	SAT TT=2.459 ASSIGNMENTS=937 CHECKS=2921020	? (MO) TT=33.675	? (TO) TT=1800.02	? (TO) TT=1800.01
csp/lexHerald/ normalized-crossword-m1-lex-21-03.xml	SAT TT=2.199	SAT TT=10.366 CHECKS=2336370 NODES=3048	SAT TT=15.835 CHECKS=3429390 NODES=4487	? (TO) TT=1800.1	SAT TT=22.739 CHECKS=1419380	SAT TT=72.019 CHECKS=8262950	SAT TT=42.259 ASSIGNMENTS=880	SAT TT=88.146 ASSIGNMENTS=678	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=9.703 ASSIGNMENTS=754 CHECKS=1999630	SAT TT=17.206 ASSIGNMENTS=3048 CHECKS=2336370	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=29.923 ASSIGNMENTS=10122 CHECKS=27589700	SAT TT=37.093 ASSIGNMENTS=16981 CHECKS=36958800	? (TO) TT=1800.05	SAT TT=51.753 ASSIGNMENTS=23652 CHECKS=47890800	SAT TT=2.199 ASSIGNMENTS=754 CHECKS=1999630	? (MO) TT=27.138	? (TO) TT=1800.07	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexHerald/ normalized-crossword-m1-lex-21-10.xml	UNSAT TT=372.809	UNSAT TT=398.458 CHECKS=21511500 NODES=218824	UNSAT TT=372.809 CHECKS=21744400 NODES=218588	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=377.016 ASSIGNMENTS=223441 CHECKS=22517000	UNSAT TT=376.39 ASSIGNMENTS=223441 CHECKS=22517000	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=533.778 ASSIGNMENTS=149152 CHECKS=523911000	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=934.013 ASSIGNMENTS=259349 CHECKS=927253000	? (MO) TT=32.141	? (TO) TT=1800.04	? (TO) TT=1800.05
csp/lexHerald/ normalized-crossword-m1-lex-23-02.xml	SAT TT=1.775	SAT TT=11.881 CHECKS=2654310 NODES=2351	SAT TT=81.809 CHECKS=29273000 NODES=9382	? (TO) TT=1800.07	SAT TT=128.731 CHECKS=17908900	SAT TT=43.04 CHECKS=7745670	SAT TT=59.735 ASSIGNMENTS=972	? (TO) TT=1800.12	SAT TT=602.784 CHECKS=2660000000 NODES=1338	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=1.786 ASSIGNMENTS=647 CHECKS=1754510	SAT TT=1.775 ASSIGNMENTS=647 CHECKS=1754510	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT TT=3.69 ASSIGNMENTS=1608 CHECKS=4340680	SAT TT=20.817 ASSIGNMENTS=9041 CHECKS=25641800	? (TO) TT=1800.07	SAT TT=220.415 ASSIGNMENTS=104223 CHECKS=280985000	SAT TT=2.002 ASSIGNMENTS=786 CHECKS=2178710	? (MO) TT=39.303	? (TO) TT=1800.02	? (TO) TT=1800.09
csp/lexHerald/ normalized-crossword-m1-lex-23-04.xml	SAT TT=858.914	SAT TT=917.591 CHECKS=279462000 NODES=99832	SAT TT=1150.59 CHECKS=351873000 NODES=148537	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=858.914 ASSIGNMENTS=99832 CHECKS=279462000	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=91.379	? (TO) TT=1800.06	? (TO) TT=1800
csp/lexHerald/ normalized-crossword-m1-lex-23-05.xml	SAT TT=9.753	SAT TT=12.391 CHECKS=2048810 NODES=2102	SAT TT=34.197 CHECKS=8956970 NODES=6194	? (TO) TT=1800.15	SAT TT=236.834 CHECKS=45479900	SAT TT=143.8 CHECKS=30439800	SAT TT=50.089 ASSIGNMENTS=576	? (TO) TT=1800.08	SAT TT=232.729 CHECKS=576070000 NODES=954	? (TO) TT=1800.06	? (TO) TT=1800	SAT TT=19.948 ASSIGNMENTS=4020 CHECKS=18178300	SAT TT=21.91 ASSIGNMENTS=4020 CHECKS=18178300	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=9.753 ASSIGNMENTS=3993 CHECKS=15566000	SAT TT=29.721 ASSIGNMENTS=10870 CHECKS=34409600	SAT TT=244.698	SAT TT=106.103 ASSIGNMENTS=46161 CHECKS=135373000	SAT TT=13.284 ASSIGNMENTS=4020 CHECKS=18178300	? (MO) TT=31.696	? (TO) TT=1800.06	? (TO) TT=1800.02
csp/lexHerald/ normalized-crossword-m1-lex-23-06.xml	UNSAT TT=1071.41	UNSAT TT=1137.5 CHECKS=68146500 NODES=602394	? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=1071.41 ASSIGNMENTS=602394 CHECKS=68146500	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.02	? (MO) TT=37.641	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle02.xml	SAT TT=0.01	SAT TT=0.82 CHECKS=1533 NODES=8	SAT TT=0.738 CHECKS=1229 NODES=0	SAT TT=0.06	SAT TT=0.043 CHECKS=538	SAT TT=0.04 CHECKS=759	SAT TT=0.672 ASSIGNMENTS=55	SAT TT=0.65 ASSIGNMENTS=7	SAT TT=88.456 CHECKS=23225 NODES=8	SAT TT=36.59 CHECKS=21881 NODES=5	SAT TT=37.881 CHECKS=21666 NODES=3	SAT TT=0.039 ASSIGNMENTS=183 CHECKS=6457	SAT TT=0.033 ASSIGNMENTS=183 CHECKS=6457	SAT TT=75.174	SAT TT=74.445	SAT TT=0.019 ASSIGNMENTS=183 CHECKS=6457	SAT TT=0.017 ASSIGNMENTS=130 CHECKS=4029	SAT TT=0.358	SAT TT=0.01 ASSIGNMENTS=7 CHECKS=204	SAT TT=0.014 ASSIGNMENTS=138 CHECKS=3449	SAT TT=1372.9	SAT TT=0.708	SAT TT=0.766
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle03.xml	SAT TT=0.026	SAT TT=0.798 CHECKS=2828 NODES=14	SAT TT=0.784 CHECKS=1626 NODES=0	SAT TT=0.188	SAT TT=0.135 CHECKS=974	SAT TT=0.113 CHECKS=982	SAT TT=1.142 ASSIGNMENTS=136	SAT TT=0.796 ASSIGNMENTS=10	SAT TT=133.797 CHECKS=366167 NODES=21	SAT TT=70.064 CHECKS=356803 NODES=13	SAT TT=76.061 CHECKS=4801750 NODES=130	SAT TT=0.18 ASSIGNMENTS=1047 CHECKS=71660	SAT TT=0.183 ASSIGNMENTS=1047 CHECKS=71660	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=0.244 ASSIGNMENTS=1427 CHECKS=103989	SAT TT=0.122 ASSIGNMENTS=865 CHECKS=49235	SAT TT=0.495	SAT TT=0.026 ASSIGNMENTS=72 CHECKS=4443	SAT TT=0.027 ASSIGNMENTS=120 CHECKS=7321	? (TO) TT=1800.14	SAT TT=1.162	SAT TT=1.534
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle04.xml	SAT TT=0.033	SAT TT=0.806 CHECKS=1979 NODES=20	SAT TT=0.887 CHECKS=4639 NODES=21	SAT TT=1.147	SAT TT=0.24 CHECKS=1558	SAT TT=0.219 CHECKS=1508	SAT TT=1.347 ASSIGNMENTS=58	SAT TT=1.038 ASSIGNMENTS=11	SAT TT=133.643 CHECKS=11674000 NODES=34	SAT TT=68.511 CHECKS=59750700 NODES=67350000	SAT TT=538.034 CHECKS=889337000 NODES=35485	SAT TT=0.341 ASSIGNMENTS=1114 CHECKS=91661	SAT TT=0.342 ASSIGNMENTS=1114 CHECKS=91661	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=0.343 ASSIGNMENTS=1241 CHECKS=102716	SAT TT=0.325 ASSIGNMENTS=1338 CHECKS=91920	SAT TT=0.596	SAT TT=0.036 ASSIGNMENTS=76 CHECKS=4980	SAT TT=0.033 ASSIGNMENTS=92 CHECKS=5246	? (MO) TT=38.362	SAT TT=2.863	SAT TT=3.47
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle05.xml	SAT TT=0.026	SAT TT=0.822 CHECKS=2257 NODES=21	SAT TT=0.812 CHECKS=1036 NODES=0	SAT TT=0.741	SAT TT=0.259 CHECKS=1528	SAT TT=0.242 CHECKS=1539	SAT TT=2.057 ASSIGNMENTS=348	SAT TT=1.032 ASSIGNMENTS=11	SAT TT=93.233 CHECKS=6638670 NODES=24	SAT TT=69.57 CHECKS=210681000 NODES=234900000	SAT TT=200.703 CHECKS=366129000 NODES=18765	SAT TT=0.519 ASSIGNMENTS=1571 CHECKS=122081	SAT TT=0.491 ASSIGNMENTS=1571 CHECKS=122081	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.399 ASSIGNMENTS=1381 CHECKS=106865	SAT TT=0.051 ASSIGNMENTS=155 CHECKS=8426	SAT TT=0.768	SAT TT=0.026 ASSIGNMENTS=32 CHECKS=1614	SAT TT=0.037 ASSIGNMENTS=123 CHECKS=7525	? (MO) TT=34.862	SAT TT=2.653	SAT TT=3.077
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle06.xml	SAT TT=0.024	SAT TT=1.018 CHECKS=2629 NODES=23	SAT TT=0.884 CHECKS=3109 NODES=0	SAT TT=2.037	SAT TT=0.325 CHECKS=2074	SAT TT=0.257 CHECKS=1589	SAT TT=76.719 ASSIGNMENTS=14855	SAT TT=1.227 ASSIGNMENTS=12	SAT TT=91.445 CHECKS=17782400 NODES=24	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=0.501 ASSIGNMENTS=1307 CHECKS=181427	SAT TT=0.505 ASSIGNMENTS=1307 CHECKS=181427	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=0.405 ASSIGNMENTS=1065 CHECKS=158935	SAT TT=1.53 ASSIGNMENTS=4940 CHECKS=507035	SAT TT=0.669	SAT TT=0.024 ASSIGNMENTS=23 CHECKS=2871	SAT TT=0.029 ASSIGNMENTS=74 CHECKS=6238	? (MO) TT=32.623	SAT TT=4.538	SAT TT=6.234
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle07.xml	SAT TT=0.026	SAT TT=0.929 CHECKS=4359 NODES=32	SAT TT=0.908 CHECKS=6330 NODES=0	SAT TT=2.814	SAT TT=0.288 CHECKS=1736	SAT TT=0.323 CHECKS=2374	SAT TT=6.059 ASSIGNMENTS=1437	SAT TT=1.152 ASSIGNMENTS=23	SAT TT=122.692 CHECKS=12082400 NODES=31	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=0.257 ASSIGNMENTS=1021 CHECKS=97562	SAT TT=0.258 ASSIGNMENTS=1021 CHECKS=97562	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=0.222 ASSIGNMENTS=1046 CHECKS=98434	SAT TT=0.233 ASSIGNMENTS=1015 CHECKS=86635	SAT TT=0.711	SAT TT=0.026 ASSIGNMENTS=24 CHECKS=1849	SAT TT=0.05 ASSIGNMENTS=153 CHECKS=13098	? TT=95.735	SAT TT=3.638	SAT TT=5.237
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle09.xml	SAT TT=0.078	SAT TT=0.984 CHECKS=4673 NODES=35	SAT TT=1.095 CHECKS=4418 NODES=0	SAT TT=4.223	SAT TT=0.407 CHECKS=2492	SAT TT=0.347 CHECKS=2541	SAT TT=6.818 ASSIGNMENTS=613	SAT TT=1.983 ASSIGNMENTS=20	SAT TT=122.752 CHECKS=12872500 NODES=37	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=14.946 ASSIGNMENTS=613	SAT TT=14.911 ASSIGNMENTS=613	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=2.565 ASSIGNMENTS=2848 CHECKS=877711	SAT TT=0.407 ASSIGNMENTS=649 CHECKS=104187	SAT TT=1.05	SAT TT=0.078 ASSIGNMENTS=102 CHECKS=12891	SAT TT=0.12 ASSIGNMENTS=160 CHECKS=34349	? (MO) TT=33.801	SAT TT=16.323	SAT TT=20.502
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle10.xml	SAT TT=0.037	SAT TT=1.064 CHECKS=20650 NODES=42	SAT TT=1.006 CHECKS=14188 NODES=0	SAT TT=2.372	SAT TT=0.724 CHECKS=10703	SAT TT=0.461 CHECKS=7367	SAT TT=1.907 ASSIGNMENTS=22	SAT TT=2.086 ASSIGNMENTS=18	SAT TT=128.797 CHECKS=122086 NODES=45	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.05 ASSIGNMENTS=25 CHECKS=5247	SAT TT=0.049 ASSIGNMENTS=25 CHECKS=5247	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=0.038 ASSIGNMENTS=24 CHECKS=6221	SAT TT=3.193 ASSIGNMENTS=9076 CHECKS=2026060	SAT TT=1.608	SAT TT=0.082 ASSIGNMENTS=123 CHECKS=30648	SAT TT=0.037 ASSIGNMENTS=20 CHECKS=5805	? (TO) TT=1800.1	SAT TT=16.58	SAT TT=21.649
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle11.xml	SAT TT=0.094	SAT TT=0.959 CHECKS=3576 NODES=38	SAT TT=1.026 CHECKS=8716 NODES=39	SAT TT=10.16	SAT TT=0.622 CHECKS=4391	SAT TT=0.48 CHECKS=3724	SAT TT=3.999 ASSIGNMENTS=270	SAT TT=1.876 ASSIGNMENTS=20	SAT TT=154.657 CHECKS=378218000 NODES=40	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=0.879 ASSIGNMENTS=1364 CHECKS=292760	SAT TT=0.885 ASSIGNMENTS=1364 CHECKS=292760	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=1.039 ASSIGNMENTS=1505 CHECKS=321028	SAT TT=3.699 ASSIGNMENTS=5046 CHECKS=823050	SAT TT=1.105	SAT TT=0.238 ASSIGNMENTS=327 CHECKS=47061	SAT TT=0.094 ASSIGNMENTS=113 CHECKS=23475	? TT=79.694	SAT TT=18.385	SAT TT=20.815
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle15.xml	SAT TT=0.075	SAT TT=1.5 CHECKS=54249 NODES=103	SAT TT=1.648 CHECKS=116865 NODES=108	SAT TT=8.52	SAT TT=2.227 CHECKS=31265	SAT TT=1.647 CHECKS=32495	SAT TT=4.038 ASSIGNMENTS=48	SAT TT=6.913 ASSIGNMENTS=58	SAT TT=132.992 CHECKS=675650 NODES=143	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=0.088 ASSIGNMENTS=52 CHECKS=25836	SAT TT=0.091 ASSIGNMENTS=52 CHECKS=25836	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=0.075 ASSIGNMENTS=52 CHECKS=25836	SAT TT=6.808 ASSIGNMENTS=18851 CHECKS=8104390	SAT TT=2.285	SAT TT=1.787 ASSIGNMENTS=2677 CHECKS=1679310	SAT TT=0.077 ASSIGNMENTS=58 CHECKS=27431	? TT=100.623	SAT TT=26.958	SAT TT=26.961
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle16.xml	SAT TT=0.142	SAT TT=2.297 CHECKS=199736 NODES=273	SAT TT=2.278 CHECKS=306346 NODES=274	SAT TT=8.928	SAT TT=2.674 CHECKS=65052	SAT TT=1.943 CHECKS=86643	SAT TT=5.286 ASSIGNMENTS=64	SAT TT=23.286 ASSIGNMENTS=60	SAT TT=328.121 CHECKS=1136900000 NODES=339	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=0.159 ASSIGNMENTS=81 CHECKS=47351	SAT TT=0.157 ASSIGNMENTS=81 CHECKS=47351	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=0.144 ASSIGNMENTS=81 CHECKS=47351	SAT TT=10.175 ASSIGNMENTS=19445 CHECKS=13858700	? (TO) TT=1800.1	SAT TT=3.491 ASSIGNMENTS=3989 CHECKS=2580580	SAT TT=0.142 ASSIGNMENTS=76 CHECKS=40586	? (MO) TT=41.689	SAT TT=54.137	SAT TT=51.276
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle17.xml	SAT TT=0.229	SAT TT=2.337 CHECKS=215531 NODES=185	SAT TT=3.123 CHECKS=411522 NODES=342	SAT TT=14.974	SAT TT=5.421 CHECKS=201448	SAT TT=3.709 CHECKS=246570	SAT TT=8.952 ASSIGNMENTS=80	SAT TT=52.986 ASSIGNMENTS=66	SAT TT=257.972 CHECKS=631407000 NODES=304	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.251 ASSIGNMENTS=85 CHECKS=72551	SAT TT=0.246 ASSIGNMENTS=85 CHECKS=72551	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.229 ASSIGNMENTS=85 CHECKS=72551	SAT TT=20.451 ASSIGNMENTS=22718 CHECKS=27243900	? (TO) TT=1800.1	SAT TT=58.865 ASSIGNMENTS=39497 CHECKS=31136500	SAT TT=0.271 ASSIGNMENTS=122 CHECKS=101036	? TT=100.989	SAT TT=433.106	SAT TT=740.86
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle18.xml	SAT TT=0.203	SAT TT=2.589 CHECKS=225836 NODES=351	SAT TT=2.923 CHECKS=356791 NODES=349	? (TO) TT=1800.11	SAT TT=39.606 CHECKS=2776440	SAT TT=2.56 CHECKS=198283	SAT TT=9.902 ASSIGNMENTS=87	SAT TT=62.262 ASSIGNMENTS=81	SAT TT=134.216 CHECKS=2539450 NODES=342	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=0.214 ASSIGNMENTS=106 CHECKS=82330	SAT TT=0.228 ASSIGNMENTS=106 CHECKS=82330	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=0.214 ASSIGNMENTS=106 CHECKS=82330	SAT TT=17.696 ASSIGNMENTS=19647 CHECKS=25036800	SAT TT=5.997	SAT TT=61.746 ASSIGNMENTS=40259 CHECKS=33673700	SAT TT=0.203 ASSIGNMENTS=94 CHECKS=79210	? (MO) TT=63.926	SAT TT=66.768	SAT TT=264.508
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle19.xml	SAT TT=0.392	SAT TT=2.884 CHECKS=263371 NODES=477	SAT TT=3.073 CHECKS=329057 NODES=456	? (TO) TT=1800.05	SAT TT=7.485 CHECKS=339092	SAT TT=6.216 CHECKS=354095	SAT TT=13.725 ASSIGNMENTS=383	SAT TT=39.523 ASSIGNMENTS=76	SAT TT=269.03 CHECKS=895289000 NODES=385	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=0.412 ASSIGNMENTS=170 CHECKS=162308	SAT TT=0.392 ASSIGNMENTS=170 CHECKS=162308	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=0.795 ASSIGNMENTS=327 CHECKS=371749	SAT TT=18.573 ASSIGNMENTS=16620 CHECKS=20136200	? (TO) TT=1800	SAT TT=53.476 ASSIGNMENTS=39152 CHECKS=29860900	SAT TT=0.489 ASSIGNMENTS=212 CHECKS=235755	? (MO) TT=32.135	SAT TT=332.475	? (TO) TT=1800.02
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle20.xml	SAT TT=0.099	SAT TT=1.187 CHECKS=4919 NODES=53	SAT TT=1.145 CHECKS=21196 NODES=66	SAT TT=4.904	SAT TT=0.987 CHECKS=8936	SAT TT=0.829 CHECKS=8377	SAT TT=118.778 ASSIGNMENTS=9403	SAT TT=2.318 ASSIGNMENTS=20	SAT TT=121.882 CHECKS=14309600 NODES=53	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=116.449 ASSIGNMENTS=9403	SAT TT=126.131 ASSIGNMENTS=9403	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=7.137 ASSIGNMENTS=8734 CHECKS=3582390	SAT TT=4.722 ASSIGNMENTS=6705 CHECKS=1581020	SAT TT=1.645	SAT TT=0.255 ASSIGNMENTS=408 CHECKS=85202	SAT TT=0.099 ASSIGNMENTS=218 CHECKS=44647	? (MO) TT=45.677	SAT TT=21.736	SAT TT=34.944
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdHerald/ normalized-crossword-m1-ogd-05-01.xml	SAT TT=0.069	SAT TT=0.927 CHECKS=3576 NODES=25	SAT TT=1.168 CHECKS=6613 NODES=25	SAT TT=4.815	SAT TT=1.11 CHECKS=4281	SAT TT=1.029 CHECKS=4299	SAT TT=16.792 ASSIGNMENTS=906	SAT TT=1.92 ASSIGNMENTS=15	SAT TT=62.681 CHECKS=20081800 NODES=28	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=22.841 ASSIGNMENTS=906	SAT TT=7.603 ASSIGNMENTS=188 CHECKS=22235	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=9.559 ASSIGNMENTS=7855 CHECKS=3435890	SAT TT=2.047 ASSIGNMENTS=9293 CHECKS=982195	SAT TT=1.744	SAT TT=0.1 ASSIGNMENTS=178 CHECKS=26480	SAT TT=0.069 ASSIGNMENTS=188 CHECKS=22235	? (MO) TT=37.439	SAT TT=14.928	SAT TT=17.969
csp/ogdHerald/ normalized-crossword-m1-ogd-05-04.xml	SAT TT=0.032	SAT TT=1.043 CHECKS=2400 NODES=19	SAT TT=0.872 CHECKS=1602 NODES=0	SAT TT=1.954	SAT TT=0.349 CHECKS=976	SAT TT=0.355 CHECKS=1271	SAT TT=2.936 ASSIGNMENTS=302	SAT TT=1.127 ASSIGNMENTS=13	SAT TT=117.14 CHECKS=4579910 NODES=22	SAT TT=57.856 CHECKS=5420250 NODES=3150030	SAT TT=222.148 CHECKS=333000000 NODES=11118	SAT TT=0.401 ASSIGNMENTS=1155 CHECKS=93290	SAT TT=0.387 ASSIGNMENTS=1155 CHECKS=93290	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.443 ASSIGNMENTS=1830 CHECKS=132036	SAT TT=0.032 ASSIGNMENTS=14 CHECKS=923	SAT TT=0.747	SAT TT=0.042 ASSIGNMENTS=50 CHECKS=2724	SAT TT=0.052 ASSIGNMENTS=147 CHECKS=6599	? (MO) TT=35.953	SAT TT=4.129	SAT TT=5.392
csp/ogdHerald/ normalized-crossword-m1-ogd-05-06.xml	SAT TT=0.073	SAT TT=0.952 CHECKS=1698 NODES=23	SAT TT=1.056 CHECKS=1859 NODES=0	SAT TT=2.889	SAT TT=0.768 CHECKS=2152	SAT TT=0.749 CHECKS=2392	SAT TT=3.672 ASSIGNMENTS=226	SAT TT=1.774 ASSIGNMENTS=14	SAT TT=92.684 CHECKS=11673400 NODES=29	SAT TT=1277.58 CHECKS=5293990000 NODES=1231330000	? (TO) TT=1800.08	SAT TT=0.697 ASSIGNMENTS=1207 CHECKS=200133	SAT TT=0.676 ASSIGNMENTS=1207 CHECKS=200133	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=0.643 ASSIGNMENTS=1211 CHECKS=199439	SAT TT=0.189 ASSIGNMENTS=388 CHECKS=40675	SAT TT=1.532	SAT TT=0.073 ASSIGNMENTS=93 CHECKS=10453	SAT TT=0.097 ASSIGNMENTS=164 CHECKS=17465	? (MO) TT=33.032	SAT TT=9.217	SAT TT=12.92
csp/ogdHerald/ normalized-crossword-m1-ogd-05-08.xml	SAT TT=0.052	SAT TT=0.904 CHECKS=3016 NODES=21	SAT TT=0.889 CHECKS=2122 NODES=0	SAT TT=2.888	SAT TT=0.622 CHECKS=2056	SAT TT=0.617 CHECKS=2188	SAT TT=2.343 ASSIGNMENTS=152	SAT TT=1.64 ASSIGNMENTS=15	SAT TT=108.151 CHECKS=10842600 NODES=25	SAT TT=293.004 CHECKS=180117000 NODES=1608000000	? (TO) TT=1800.02	SAT TT=0.705 ASSIGNMENTS=1228 CHECKS=186984	SAT TT=0.724 ASSIGNMENTS=1228 CHECKS=186984	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=0.902 ASSIGNMENTS=1698 CHECKS=268346	SAT TT=0.802 ASSIGNMENTS=2992 CHECKS=236565	SAT TT=1.31	SAT TT=0.097 ASSIGNMENTS=150 CHECKS=15797	SAT TT=0.052 ASSIGNMENTS=94 CHECKS=6447	? (MO) TT=30.944	SAT TT=9.615	SAT TT=11.736
csp/ogdHerald/ normalized-crossword-m1-ogd-05-09.xml	SAT TT=0.043	SAT TT=0.833 CHECKS=2166 NODES=19	SAT TT=0.868 CHECKS=1510 NODES=0	SAT TT=1.496	SAT TT=0.381 CHECKS=1278	SAT TT=0.327 CHECKS=1084	SAT TT=1.281 ASSIGNMENTS=71	SAT TT=1.126 ASSIGNMENTS=13	SAT TT=123.1 CHECKS=3387240 NODES=21	SAT TT=78.446 CHECKS=7038580 NODES=4500020	? (MO) TT=17.78	SAT TT=0.324 ASSIGNMENTS=802 CHECKS=77748	SAT TT=0.314 ASSIGNMENTS=802 CHECKS=77748	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.289 ASSIGNMENTS=695 CHECKS=70796	SAT TT=0.044 ASSIGNMENTS=61 CHECKS=3535	SAT TT=0.784	SAT TT=0.043 ASSIGNMENTS=59 CHECKS=2906	SAT TT=0.049 ASSIGNMENTS=109 CHECKS=6808	? (MO) TT=38.389	SAT TT=4.367	SAT TT=5.516
csp/ogdHerald/ normalized-crossword-m1-ogd-05-10.xml	SAT TT=0.034	SAT TT=0.881 CHECKS=4858 NODES=17	SAT TT=0.847 CHECKS=4129 NODES=0	SAT TT=1.589	SAT TT=0.28 CHECKS=1400	SAT TT=0.253 CHECKS=1609	SAT TT=1.506 ASSIGNMENTS=121	SAT TT=1.007 ASSIGNMENTS=15	SAT TT=129.347 CHECKS=2984550 NODES=19	SAT TT=66.936 CHECKS=3899510 NODES=7800020	SAT TT=94.905 CHECKS=22446700 NODES=4257	SAT TT=0.247 ASSIGNMENTS=1009 CHECKS=178578	SAT TT=0.225 ASSIGNMENTS=1009 CHECKS=178578	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=0.424 ASSIGNMENTS=1362 CHECKS=245977	SAT TT=0.095 ASSIGNMENTS=326 CHECKS=26284	SAT TT=0.722	SAT TT=0.034 ASSIGNMENTS=25 CHECKS=2334	SAT TT=0.093 ASSIGNMENTS=251 CHECKS=24689	? (MO) TT=35.732	SAT TT=3.944	SAT TT=4.515
csp/ogdHerald/ normalized-crossword-m1-ogd-15-02.xml	SAT TT=0.913	SAT TT=3.913 CHECKS=219221 NODES=324	SAT TT=4.49 CHECKS=338547 NODES=321	? (TO) TT=1800.06	SAT TT=30.145 CHECKS=156028	SAT TT=16.889 CHECKS=62487	SAT TT=33.333 ASSIGNMENTS=86	SAT TT=60.567 ASSIGNMENTS=81	SAT TT=229.704 CHECKS=622558000 NODES=371	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=0.952 ASSIGNMENTS=79 CHECKS=69464	SAT TT=0.937 ASSIGNMENTS=79 CHECKS=69464	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=0.913 ASSIGNMENTS=79 CHECKS=69464	SAT TT=74.31 ASSIGNMENTS=15050 CHECKS=19984800	SAT TT=38.231	SAT TT=51.759 ASSIGNMENTS=11278 CHECKS=9593620	SAT TT=0.944 ASSIGNMENTS=97 CHECKS=73114	? TT=98.717	? (MO) TT=6.67	? (TO) TT=1800.07
csp/ogdHerald/ normalized-crossword-m1-ogd-15-03.xml	SAT TT=0.538	SAT TT=2.948 CHECKS=154375 NODES=195	SAT TT=3.916 CHECKS=288911 NODES=195	SAT TT=33.076	SAT TT=30.822 CHECKS=95812	SAT TT=23.169 CHECKS=53313	SAT TT=21.15 ASSIGNMENTS=106	SAT TT=60.539 ASSIGNMENTS=84	SAT TT=207.889 CHECKS=544969000 NODES=265	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=0.552 ASSIGNMENTS=103 CHECKS=63534	SAT TT=0.553 ASSIGNMENTS=103 CHECKS=63534	? (TO) TT=1800.03	? (TO) TT=1800	SAT TT=0.547 ASSIGNMENTS=103 CHECKS=63534	SAT TT=48.748 ASSIGNMENTS=25562 CHECKS=22188600	SAT TT=21.468	SAT TT=22.164 ASSIGNMENTS=6130 CHECKS=4927320	SAT TT=0.538 ASSIGNMENTS=100 CHECKS=63137	? (MO) TT=31.643	? (TO) TT=1800	? (TO) TT=1800.06
csp/ogdHerald/ normalized-crossword-m1-ogd-15-05.xml	SAT TT=0.746	SAT TT=3.321 CHECKS=193399 NODES=185	SAT TT=3.954 CHECKS=351613 NODES=188	? (TO) TT=1800.1	SAT TT=26.24 CHECKS=111013	SAT TT=14.09 CHECKS=103171	SAT TT=19.93 ASSIGNMENTS=104	SAT TT=62.577 ASSIGNMENTS=85	SAT TT=160.785 CHECKS=234090000 NODES=307	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.798 ASSIGNMENTS=98 CHECKS=75903	SAT TT=0.929 ASSIGNMENTS=98 CHECKS=75903	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.904 ASSIGNMENTS=98 CHECKS=75903	SAT TT=54.165 ASSIGNMENTS=21622 CHECKS=23144400	SAT TT=18.597	SAT TT=59.227 ASSIGNMENTS=16202 CHECKS=13764700	SAT TT=0.746 ASSIGNMENTS=90 CHECKS=63126	? TT=87.88	? (TO) TT=1800.05	? (TO) TT=1800.2
csp/ogdHerald/ normalized-crossword-m1-ogd-15-06.xml	SAT TT=0.897	SAT TT=6.153 CHECKS=269791 NODES=930	SAT TT=7.19 CHECKS=147950 NODES=501	? (TO) TT=1800.07	SAT TT=37.424 CHECKS=109965	SAT TT=25.347 CHECKS=40197	SAT TT=31.924 ASSIGNMENTS=70	SAT TT=47.523 ASSIGNMENTS=68	SAT TT=204.321 CHECKS=562974000 NODES=323	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=0.907 ASSIGNMENTS=78 CHECKS=56861	SAT TT=0.966 ASSIGNMENTS=78 CHECKS=56861	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=0.897 ASSIGNMENTS=79 CHECKS=57081	SAT TT=65.317 ASSIGNMENTS=17865 CHECKS=14628300	SAT TT=35.02	SAT TT=45.762 ASSIGNMENTS=7837 CHECKS=5057230	SAT TT=1.072 ASSIGNMENTS=107 CHECKS=61590	? TT=77.503	? (TO) TT=1800.09	? (MO) TT=6.376
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdHerald/ normalized-crossword-m1-ogd-15-08.xml	SAT TT=0.569	SAT TT=3.127 CHECKS=161512 NODES=188	SAT TT=3.901 CHECKS=289040 NODES=189	? (TO) TT=1800.12	SAT TT=27.059 CHECKS=91234	SAT TT=20.057 CHECKS=66612	SAT TT=17.161 ASSIGNMENTS=106	SAT TT=42.976 ASSIGNMENTS=78	SAT TT=186.8 CHECKS=423219000 NODES=258	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=0.61 ASSIGNMENTS=114 CHECKS=58012	SAT TT=0.569 ASSIGNMENTS=114 CHECKS=58012	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=0.595 ASSIGNMENTS=114 CHECKS=58012	SAT TT=31.899 ASSIGNMENTS=21460 CHECKS=22485200	SAT TT=31.624	SAT TT=35.012 ASSIGNMENTS=13176 CHECKS=8775080	SAT TT=0.619 ASSIGNMENTS=103 CHECKS=61284	? (MO) TT=35.324	? (TO) TT=1800	? (TO) TT=1800.04
csp/ogdHerald/ normalized-crossword-m1-ogd-19-02.xml	SAT TT=1.147	SAT TT=5.918 CHECKS=359025 NODES=531	SAT TT=7.95 CHECKS=513466 NODES=531	? (TO) TT=1800.17	SAT TT=34.443 CHECKS=196117	SAT TT=28.547 CHECKS=237161	SAT TT=43.694 ASSIGNMENTS=114	SAT TT=66.435 ASSIGNMENTS=212	SAT TT=224.064 CHECKS=579765000 NODES=423	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=1.158 ASSIGNMENTS=103 CHECKS=118325	SAT TT=1.163 ASSIGNMENTS=103 CHECKS=118325	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=1.147 ASSIGNMENTS=103 CHECKS=118325	SAT TT=113.024 ASSIGNMENTS=20375 CHECKS=45974700	SAT TT=63.359	SAT TT=75.491 ASSIGNMENTS=12729 CHECKS=14687700	SAT TT=1.243 ASSIGNMENTS=142 CHECKS=135414	? TT=77.559	? (MO) TT=7.392	? (MO) TT=7.481
csp/ogdHerald/ normalized-crossword-m1-ogd-19-05.xml	SAT TT=0.591	SAT TT=3.968 CHECKS=389571 NODES=292	SAT TT=6.338 CHECKS=839027 NODES=299	? (TO) TT=1800.06	SAT TT=29.035 CHECKS=258501	SAT TT=13.478 CHECKS=159602	SAT TT=32.706 ASSIGNMENTS=112	SAT TT=66.631 ASSIGNMENTS=360	SAT TT=319.478 CHECKS=962057000 NODES=442	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.592 ASSIGNMENTS=120 CHECKS=164203	SAT TT=0.591 ASSIGNMENTS=120 CHECKS=164203	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.666 ASSIGNMENTS=120 CHECKS=164203	SAT TT=5.159 ASSIGNMENTS=1361 CHECKS=2496820	SAT TT=29.896	SAT TT=39.656 ASSIGNMENTS=10876 CHECKS=22538400	SAT TT=0.658 ASSIGNMENTS=124 CHECKS=169335	? (MO) TT=45.764	? (TO) TT=1800.05	? (TO) TT=1800.04
csp/ogdHerald/ normalized-crossword-m1-ogd-19-06.xml	SAT TT=1.454	SAT TT=5.327 CHECKS=443343 NODES=291	SAT TT=7.206 CHECKS=678067 NODES=291	? (TO) TT=1800.07	SAT TT=55.531 CHECKS=260089	SAT TT=27.71 CHECKS=109972	SAT TT=42.008 ASSIGNMENTS=153	SAT TT=65.947 ASSIGNMENTS=139	SAT TT=216.712 CHECKS=411071000 NODES=504	? (TO) TT=1800.04	? (TO) TT=1800	SAT TT=1.537 ASSIGNMENTS=157 CHECKS=161643	SAT TT=1.48 ASSIGNMENTS=157 CHECKS=161643	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=1.454 ASSIGNMENTS=157 CHECKS=161643	SAT TT=20.576 ASSIGNMENTS=3554 CHECKS=4652140	? (TO) TT=1800.03	SAT TT=203.098 ASSIGNMENTS=31585 CHECKS=47613500	SAT TT=1.491 ASSIGNMENTS=153 CHECKS=163902	? TT=100.411	? (MO) TT=7.29	? (MO) TT=7.88
csp/ogdHerald/ normalized-crossword-m1-ogd-19-08.xml	SAT TT=1.522	SAT TT=6.147 CHECKS=570466 NODES=302	SAT TT=8.602 CHECKS=1242960 NODES=568	? (TO) TT=1800.1	SAT TT=40.694 CHECKS=209968	SAT TT=25.092 CHECKS=133892	SAT TT=43.13 ASSIGNMENTS=150	SAT TT=69.216 ASSIGNMENTS=328	SAT TT=199.618 CHECKS=331564000 NODES=469	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=1.707 ASSIGNMENTS=192 CHECKS=243341	SAT TT=1.604 ASSIGNMENTS=192 CHECKS=243341	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1.734 ASSIGNMENTS=193 CHECKS=244313	SAT TT=55.023 ASSIGNMENTS=10905 CHECKS=18585500	SAT TT=202.706	SAT TT=42.129 ASSIGNMENTS=7809 CHECKS=14590800	SAT TT=1.522 ASSIGNMENTS=200 CHECKS=231462	? TT=81.781	? (MO) TT=8.23	? (MO) TT=8.06
csp/ogdHerald/ normalized-crossword-m1-ogd-21-03.xml	SAT TT=1.495	SAT TT=5.532 CHECKS=272797 NODES=371	SAT TT=7.693 CHECKS=463302 NODES=371	? (TO) TT=1800.12	SAT TT=43.687 CHECKS=219325	SAT TT=45.024 CHECKS=167154	SAT TT=51.517 ASSIGNMENTS=154	SAT TT=66.435 ASSIGNMENTS=140	SAT TT=492.62 CHECKS=1814310000 NODES=676	? (TO) TT=1800	? (TO) TT=1800.05	SAT TT=1.513 ASSIGNMENTS=180 CHECKS=161589	SAT TT=1.511 ASSIGNMENTS=180 CHECKS=161589	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=1.495 ASSIGNMENTS=180 CHECKS=161589	SAT TT=73.105 ASSIGNMENTS=11084 CHECKS=13950500	? (MO) TT=41.58	SAT TT=89.574 ASSIGNMENTS=14041 CHECKS=18222900	SAT TT=1.78 ASSIGNMENTS=191 CHECKS=216462	? TT=96.658	? (TO) TT=1800.2	? (MO) TT=8.45
csp/ogdHerald/ normalized-crossword-m1-ogd-21-05.xml	SAT TT=0.856	SAT TT=4.916 CHECKS=265481 NODES=383	SAT TT=6.868 CHECKS=373260 NODES=378	? (TO) TT=1800.11	SAT TT=51.277 CHECKS=370406	SAT TT=35.486 CHECKS=215167	SAT TT=42.235 ASSIGNMENTS=177	SAT TT=103.782 ASSIGNMENTS=1395	SAT TT=1376.45 CHECKS=6470460000 NODES=1036	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=1.332 ASSIGNMENTS=224 CHECKS=296774	SAT TT=1.259 ASSIGNMENTS=224 CHECKS=296774	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=1.184 ASSIGNMENTS=226 CHECKS=298539	SAT TT=49.589 ASSIGNMENTS=11555 CHECKS=16229300	SAT TT=48.976	SAT TT=107.702 ASSIGNMENTS=25082 CHECKS=38040600	SAT TT=0.856 ASSIGNMENTS=177 CHECKS=200195	? (MO) TT=34.788	? (TO) TT=1800.26	? (TO) TT=1800.29
csp/ogdHerald/ normalized-crossword-m1-ogd-21-08.xml	SAT TT=1.141	SAT TT=7.07 CHECKS=599752 NODES=367	SAT TT=8.68 CHECKS=1065130 NODES=371	? (TO) TT=1800.11	SAT TT=69.655 CHECKS=603265	SAT TT=31.593 CHECKS=358159	SAT TT=45.187 ASSIGNMENTS=198	? (TO) TT=1800.15	SAT TT=478.945 CHECKS=1936670000 NODES=890	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.15 ASSIGNMENTS=202 CHECKS=265265	SAT TT=1.214 ASSIGNMENTS=202 CHECKS=265265	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=1.141 ASSIGNMENTS=202 CHECKS=265265	SAT TT=38.767 ASSIGNMENTS=10651 CHECKS=17630500	? (TO) TT=1800.01	SAT TT=155.23 ASSIGNMENTS=36787 CHECKS=69086700	SAT TT=1.145 ASSIGNMENTS=207 CHECKS=261998	? TT=83.358	? (MO) TT=7.381	? (MO) TT=7.28
csp/ogdHerald/ normalized-crossword-m1-ogd-21-10.xml	SAT TT=3.256	SAT TT=8.983 CHECKS=265498 NODES=1384	SAT TT=11.328 CHECKS=200122 NODES=1029	? (problem) TT=51.237	SAT TT=89.782 CHECKS=1055370	SAT TT=60.949 CHECKS=470543	SAT TT=68.034 ASSIGNMENTS=151	? (TO) TT=1800.14	SAT TT=606.018 CHECKS=2703620000 NODES=997	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=16.73 ASSIGNMENTS=1383 CHECKS=264722	SAT TT=16.209 ASSIGNMENTS=1383 CHECKS=264722	? (TO) TT=1800.06	? (TO) TT=1800	SAT TT=4.932 ASSIGNMENTS=669 CHECKS=964438	SAT TT=94.418 ASSIGNMENTS=9794 CHECKS=16726500	? (MO) TT=45.47	SAT TT=157.801 ASSIGNMENTS=18001 CHECKS=30589900	SAT TT=3.256 ASSIGNMENTS=348 CHECKS=505001	? TT=78.311	? (MO) TT=7.09	? (MO) TT=7.07
csp/ogdHerald/ normalized-crossword-m1-ogd-23-02.xml	SAT TT=2.258	SAT TT=9.265 CHECKS=760880 NODES=608	SAT TT=11.278 CHECKS=1171760 NODES=444	? (problem) TT=65.319	SAT TT=72.649 CHECKS=509655	SAT TT=32.518 CHECKS=269031	SAT TT=70.359 ASSIGNMENTS=205	SAT TT=159.886 ASSIGNMENTS=2706	SAT TT=368.915 CHECKS=1156120000 NODES=874	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=2.392 ASSIGNMENTS=213 CHECKS=306603	SAT TT=2.502 ASSIGNMENTS=213 CHECKS=306603	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=2.387 ASSIGNMENTS=213 CHECKS=306603	SAT TT=85.353 ASSIGNMENTS=13279 CHECKS=24747700	? (MO) TT=44.76	SAT TT=269.006 ASSIGNMENTS=37726 CHECKS=77871200	SAT TT=2.258 ASSIGNMENTS=214 CHECKS=301928	? TT=98.452	? (MO) TT=9.35	? (MO) TT=9.31
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdHerald/ normalized-crossword-m1-ogd-23-03.xml	SAT TT=2.543	SAT TT=9.84 CHECKS=505816 NODES=1123	SAT TT=13.26 CHECKS=824798 NODES=1123	? (problem) TT=70.915	SAT TT=85.375 CHECKS=766586	SAT TT=39.048 CHECKS=351549	SAT TT=69.474 ASSIGNMENTS=179	SAT TT=600.469 ASSIGNMENTS=16825	SAT TT=531.525 CHECKS=2052790000 NODES=618	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=2.825 ASSIGNMENTS=250 CHECKS=346176	SAT TT=2.842 ASSIGNMENTS=250 CHECKS=346176	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=2.882 ASSIGNMENTS=276 CHECKS=369680	SAT TT=94.283 ASSIGNMENTS=11615 CHECKS=20454700	? (MO) TT=44.75	SAT TT=126.51 ASSIGNMENTS=15103 CHECKS=27159900	SAT TT=2.543 ASSIGNMENTS=201 CHECKS=286927	? TT=109.239	? (MO) TT=9.53	? (MO) TT=9.53
csp/ogdHerald/ normalized-crossword-m1-ogd-23-07.xml	SAT TT=2.426	SAT TT=9.987 CHECKS=632546 NODES=849	SAT TT=12.623 CHECKS=857925 NODES=450	? (problem) TT=64.583	SAT TT=73.616 CHECKS=425359	SAT TT=35.295 CHECKS=286091	SAT TT=71.405 ASSIGNMENTS=203	SAT TT=75.498 ASSIGNMENTS=380	SAT TT=430.468 CHECKS=1645730000 NODES=946	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=2.582 ASSIGNMENTS=189 CHECKS=283028	SAT TT=2.452 ASSIGNMENTS=189 CHECKS=283028	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=2.426 ASSIGNMENTS=189 CHECKS=283028	SAT TT=111.345 ASSIGNMENTS=12587 CHECKS=24669700	? (MO) TT=46	SAT TT=445.216 ASSIGNMENTS=51001 CHECKS=108336000	SAT TT=2.555 ASSIGNMENTS=192 CHECKS=283738	? TT=100.139	? (MO) TT=9.44	? (MO) TT=9.549
csp/ogdHerald/ normalized-crossword-m1-ogd-23-08.xml	SAT TT=1.429	SAT TT=8.74 CHECKS=635114 NODES=936	SAT TT=13.575 CHECKS=756952 NODES=1315	? (TO) TT=1800.18	SAT TT=78.405 CHECKS=758967	SAT TT=86.406 CHECKS=1929500	SAT TT=62.719 ASSIGNMENTS=254	? (TO) TT=1800.06	SAT TT=681.81 CHECKS=2860230000 NODES=988	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=1.449 ASSIGNMENTS=210 CHECKS=317852	SAT TT=1.443 ASSIGNMENTS=210 CHECKS=317852	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=1.429 ASSIGNMENTS=210 CHECKS=317852	SAT TT=66.898 ASSIGNMENTS=13076 CHECKS=22436100	? (MO) TT=49.84	SAT TT=236.242 ASSIGNMENTS=50588 CHECKS=89435300	SAT TT=1.619 ASSIGNMENTS=228 CHECKS=375495	? TT=83.992	? (TO) TT=1800.19	? (MO) TT=6.26
csp/ogdHerald/ normalized-crossword-m1-ogd-23-09.xml	SAT TT=2.094	SAT TT=10.762 CHECKS=1245680 NODES=1199	SAT TT=14.848 CHECKS=1005220 NODES=1235	? (TO) TT=1800.15	SAT TT=63.14 CHECKS=1138740	SAT TT=44.932 CHECKS=525345	SAT TT=71.804 ASSIGNMENTS=159	? (TO) TT=1800.07	SAT TT=555.663 CHECKS=2507880000 NODES=813	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=2.183 ASSIGNMENTS=222 CHECKS=546396	SAT TT=2.316 ASSIGNMENTS=222 CHECKS=546396	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=2.177 ASSIGNMENTS=226 CHECKS=551566	SAT TT=70.611 ASSIGNMENTS=10721 CHECKS=31297700	? (MO) TT=44.01	SAT TT=276.167 ASSIGNMENTS=42035 CHECKS=136670000	SAT TT=2.094 ASSIGNMENTS=216 CHECKS=624994	? TT=73.589	? (TO) TT=1800.11	? (MO) TT=7.415
csp/ogdHerald/ normalized-crossword-m1-ogd-23-10.xml	SAT TT=5.559	SAT TT=12.025 CHECKS=395373 NODES=1288	SAT TT=29.92 CHECKS=1389220 NODES=3196	? (problem) TT=60.821	SAT TT=84.148 CHECKS=333817	SAT TT=99.018 CHECKS=555449	SAT TT=69.622 ASSIGNMENTS=135	? (TO) TT=1800.14	SAT TT=216.174 CHECKS=228422000 NODES=1070	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=23.005 ASSIGNMENTS=2114 CHECKS=853311	SAT TT=26.045 ASSIGNMENTS=2114 CHECKS=853311	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=5.559 ASSIGNMENTS=352 CHECKS=585943	SAT TT=147.162 ASSIGNMENTS=11257 CHECKS=17668900	? (MO) TT=7.49	SAT TT=635.023 ASSIGNMENTS=52023 CHECKS=86383100	SAT TT=8.976 ASSIGNMENTS=507 CHECKS=963852	? TT=63.457	? (MO) TT=7.31	? (MO) TT=7.14
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle02.xml	SAT TT=0.009	SAT TT=0.741 CHECKS=1738 NODES=8	SAT TT=0.725 CHECKS=1041 NODES=0	SAT TT=0.065	SAT TT=0.04 CHECKS=436	SAT TT=0.034 CHECKS=488	SAT TT=0.732 ASSIGNMENTS=68	SAT TT=0.673 ASSIGNMENTS=6	SAT TT=88.955 CHECKS=17595 NODES=9	SAT TT=31.147 CHECKS=21926 NODES=8	SAT TT=32.547 CHECKS=19369 NODES=3	SAT TT=0.03 ASSIGNMENTS=143 CHECKS=5947	SAT TT=0.028 ASSIGNMENTS=143 CHECKS=5947	SAT TT=79.999	SAT TT=75.08	SAT TT=0.019 ASSIGNMENTS=145 CHECKS=6112	SAT TT=0.009 ASSIGNMENTS=15 CHECKS=613	SAT TT=0.343	SAT TT=0.01 ASSIGNMENTS=7 CHECKS=231	SAT TT=0.015 ASSIGNMENTS=118 CHECKS=3255	SAT TT=1337.74	SAT TT=0.834	SAT TT=0.896
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle03.xml	SAT TT=0.022	SAT TT=0.778 CHECKS=2393 NODES=14	SAT TT=0.814 CHECKS=1528 NODES=0	SAT TT=0.24	SAT TT=0.154 CHECKS=1032	SAT TT=0.131 CHECKS=997	SAT TT=1.212 ASSIGNMENTS=67	SAT TT=1.012 ASSIGNMENTS=11	SAT TT=136.879 CHECKS=415980 NODES=15	SAT TT=89.731 CHECKS=1966270 NODES=2250010	SAT TT=85.095 CHECKS=428991 NODES=12	SAT TT=0.222 ASSIGNMENTS=914 CHECKS=69613	SAT TT=0.209 ASSIGNMENTS=914 CHECKS=69613	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=0.204 ASSIGNMENTS=812 CHECKS=64590	SAT TT=0.057 ASSIGNMENTS=418 CHECKS=20259	SAT TT=0.497	SAT TT=0.024 ASSIGNMENTS=76 CHECKS=4153	SAT TT=0.022 ASSIGNMENTS=97 CHECKS=4590	? (TO) TT=1800.12	SAT TT=1.414	SAT TT=1.778
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle05.xml	SAT TT=0.036	SAT TT=0.859 CHECKS=2409 NODES=21	SAT TT=0.873 CHECKS=1744 NODES=0	SAT TT=1.543	SAT TT=0.339 CHECKS=1014	SAT TT=0.356 CHECKS=1263	SAT TT=2.752 ASSIGNMENTS=228	SAT TT=1.051 ASSIGNMENTS=15	SAT TT=90.287 CHECKS=3778160 NODES=22	SAT TT=38.4 CHECKS=50809300 NODES=56400000	SAT TT=46.702 CHECKS=29324900 NODES=1384	SAT TT=9.924 ASSIGNMENTS=228	SAT TT=10.565 ASSIGNMENTS=228	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.236 ASSIGNMENTS=2855 CHECKS=236063	SAT TT=0.076 ASSIGNMENTS=155 CHECKS=8744	SAT TT=0.914	SAT TT=0.036 ASSIGNMENTS=23 CHECKS=1155	SAT TT=0.061 ASSIGNMENTS=223 CHECKS=8840	? (MO) TT=40.129	SAT TT=4.423	SAT TT=5.662
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle06.xml	SAT TT=0.037	SAT TT=0.866 CHECKS=3346 NODES=24	SAT TT=0.884 CHECKS=2363 NODES=0	SAT TT=2.962	SAT TT=0.622 CHECKS=1547	SAT TT=0.527 CHECKS=1586	SAT TT=6.057 ASSIGNMENTS=297	SAT TT=1.457 ASSIGNMENTS=12	SAT TT=93.936 CHECKS=10348500 NODES=24	SAT TT=233.416 CHECKS=153308000 NODES=1398300000	? (TO) TT=1800.09	SAT TT=0.971 ASSIGNMENTS=1623 CHECKS=267414	SAT TT=1.055 ASSIGNMENTS=1623 CHECKS=267414	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=3.094 ASSIGNMENTS=4739 CHECKS=921562	SAT TT=0.037 ASSIGNMENTS=20 CHECKS=2672	SAT TT=1.097	SAT TT=0.053 ASSIGNMENTS=66 CHECKS=5705	SAT TT=0.047 ASSIGNMENTS=95 CHECKS=8714	? (MO) TT=37.661	SAT TT=9.449	SAT TT=11.887
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle07.xml	SAT TT=0.038	SAT TT=0.909 CHECKS=4866 NODES=30	SAT TT=0.903 CHECKS=4732 NODES=0	SAT TT=2.034	SAT TT=0.769 CHECKS=3743	SAT TT=0.511 CHECKS=2039	SAT TT=14.943 ASSIGNMENTS=3056	SAT TT=1.585 ASSIGNMENTS=23	SAT TT=132.296 CHECKS=7555750 NODES=31	SAT TT=1392.27 CHECKS=4822550000 NODES=1478230000	SAT TT=1018.32 CHECKS=1648650000 NODES=85045	SAT TT=0.21 ASSIGNMENTS=592 CHECKS=85849	SAT TT=0.208 ASSIGNMENTS=592 CHECKS=85849	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=0.204 ASSIGNMENTS=606 CHECKS=87656	SAT TT=0.054 ASSIGNMENTS=74 CHECKS=5663	SAT TT=1.016	SAT TT=0.038 ASSIGNMENTS=40 CHECKS=2377	SAT TT=0.074 ASSIGNMENTS=154 CHECKS=13498	? TT=100.925	SAT TT=7.027	SAT TT=8.72
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle08.xml	SAT TT=0.16	SAT TT=1.137 CHECKS=15503 NODES=41	SAT TT=1.122 CHECKS=12944 NODES=0	SAT TT=13.089	SAT TT=1.946 CHECKS=6389	SAT TT=2.458 CHECKS=10336	SAT TT=3.286 ASSIGNMENTS=273	SAT TT=3.09 ASSIGNMENTS=25	SAT TT=131.115 CHECKS=315091 NODES=44	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=1.024 ASSIGNMENTS=1526 CHECKS=530618	SAT TT=1.018 ASSIGNMENTS=1526 CHECKS=530618	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=1.014 ASSIGNMENTS=1438 CHECKS=502068	SAT TT=2.214 ASSIGNMENTS=1469 CHECKS=272335	SAT TT=2.805	SAT TT=0.165 ASSIGNMENTS=74 CHECKS=8801	SAT TT=0.16 ASSIGNMENTS=160 CHECKS=30198	? (TO) TT=1800.15	SAT TT=183.298	SAT TT=174.917
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle10.xml	SAT TT=0.118	SAT TT=1.213 CHECKS=22773 NODES=41	SAT TT=1.387 CHECKS=57768 NODES=44	SAT TT=4.219	SAT TT=48.738 CHECKS=247516	SAT TT=3.257 CHECKS=15114	SAT TT=3.581 ASSIGNMENTS=26	SAT TT=3.971 ASSIGNMENTS=28	SAT TT=129.362 CHECKS=134913 NODES=45	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=0.135 ASSIGNMENTS=24 CHECKS=5687	SAT TT=0.135 ASSIGNMENTS=24 CHECKS=5687	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=0.13 ASSIGNMENTS=24 CHECKS=5687	SAT TT=8.544 ASSIGNMENTS=11465 CHECKS=1729850	SAT TT=3.58	SAT TT=0.182 ASSIGNMENTS=71 CHECKS=18703	SAT TT=0.118 ASSIGNMENTS=24 CHECKS=5687	? (TO) TT=1800.18	SAT TT=232.981	SAT TT=237.225
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle11.xml	SAT TT=0.265	SAT TT=1.312 CHECKS=5711 NODES=38	SAT TT=1.182 CHECKS=3201 NODES=0	SAT TT=6.391	SAT TT=2.631 CHECKS=4449	SAT TT=2.664 CHECKS=5252	SAT TT=4.044 ASSIGNMENTS=174	SAT TT=3.643 ASSIGNMENTS=18	SAT TT=112.484 CHECKS=189330000 NODES=38	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=0.889 ASSIGNMENTS=1056 CHECKS=185443	SAT TT=0.901 ASSIGNMENTS=1056 CHECKS=185443	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.633 ASSIGNMENTS=944 CHECKS=170415	SAT TT=0.806 ASSIGNMENTS=322 CHECKS=48295	SAT TT=3.262	SAT TT=0.477 ASSIGNMENTS=208 CHECKS=21188	SAT TT=0.265 ASSIGNMENTS=110 CHECKS=22983	? TT=80.039	SAT TT=151.287	SAT TT=166.573
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle12.xml	SAT TT=0.045	SAT TT=1.079 CHECKS=24190 NODES=52	SAT TT=1.245 CHECKS=18061 NODES=0	SAT TT=2.563	SAT TT=0.88 CHECKS=8278	SAT TT=0.671 CHECKS=8767	SAT TT=1.981 ASSIGNMENTS=39	SAT TT=2.596 ASSIGNMENTS=36	SAT TT=128.682 CHECKS=10179500 NODES=56	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=0.059 ASSIGNMENTS=37 CHECKS=6989	SAT TT=0.06 ASSIGNMENTS=37 CHECKS=6989	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.045 ASSIGNMENTS=37 CHECKS=6989	SAT TT=2.603 ASSIGNMENTS=11178 CHECKS=2503680	? (TO) TT=1800.11	SAT TT=0.274 ASSIGNMENTS=643 CHECKS=155602	SAT TT=0.052 ASSIGNMENTS=44 CHECKS=10653	? (MO) TT=31.768	SAT TT=8.543	SAT TT=11.358
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle13.xml	SAT TT=0.298	SAT TT=1.712 CHECKS=34538 NODES=65	SAT TT=1.696 CHECKS=32395 NODES=0	SAT TT=10.352	SAT TT=8.014 CHECKS=26757	SAT TT=5.478 CHECKS=13912	SAT TT=6.587 ASSIGNMENTS=46	SAT TT=7.216 ASSIGNMENTS=34	SAT TT=137.415 CHECKS=2182740 NODES=70	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=0.324 ASSIGNMENTS=46 CHECKS=12954	SAT TT=0.307 ASSIGNMENTS=46 CHECKS=12954	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=0.298 ASSIGNMENTS=46 CHECKS=12954	SAT TT=18.772 ASSIGNMENTS=15822 CHECKS=4252790	SAT TT=5.715	SAT TT=2.268 ASSIGNMENTS=1121 CHECKS=433612	SAT TT=0.323 ASSIGNMENTS=40 CHECKS=13064	? (MO) TT=43.156	SAT TT=1202.06	SAT TT=1352.68
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle16.xml	SAT TT=0.275	SAT TT=2.326 CHECKS=141580 NODES=137	SAT TT=2.725 CHECKS=305792 NODES=137	SAT TT=1634.91	SAT TT=5.409 CHECKS=44521	SAT TT=3.878 CHECKS=38213	SAT TT=8.192 ASSIGNMENTS=87	SAT TT=19.296 ASSIGNMENTS=82	SAT TT=214.463 CHECKS=526612000 NODES=221	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=0.308 ASSIGNMENTS=88 CHECKS=40120	SAT TT=0.307 ASSIGNMENTS=88 CHECKS=40120	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=0.275 ASSIGNMENTS=88 CHECKS=40120	SAT TT=17.251 ASSIGNMENTS=19910 CHECKS=14155900	SAT TT=6.177	SAT TT=6.419 ASSIGNMENTS=4355 CHECKS=2539200	SAT TT=0.287 ASSIGNMENTS=82 CHECKS=39313	? (MO) TT=54.361	SAT TT=223.944	SAT TT=232.776
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle17.xml	SAT TT=0.418	SAT TT=2.599 CHECKS=245496 NODES=185	SAT TT=3.612 CHECKS=452743 NODES=185	? (TO) TT=1800.06	SAT TT=12.358 CHECKS=69677	SAT TT=10.756 CHECKS=69033	SAT TT=15.711 ASSIGNMENTS=98	SAT TT=51.771 ASSIGNMENTS=102	SAT TT=191.13 CHECKS=305425000 NODES=241	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=0.445 ASSIGNMENTS=108 CHECKS=73192	SAT TT=0.448 ASSIGNMENTS=108 CHECKS=73192	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=0.45 ASSIGNMENTS=108 CHECKS=73192	SAT TT=40.023 ASSIGNMENTS=25361 CHECKS=27031400	? (TO) TT=1800.06	SAT TT=58.84 ASSIGNMENTS=25913 CHECKS=18753700	SAT TT=0.418 ASSIGNMENTS=104 CHECKS=67307	? TT=79.348	SAT TT=1046.23	SAT TT=1059.65
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle19.xml	SAT TT=0.826	SAT TT=3.1 CHECKS=154205 NODES=193	SAT TT=4.187 CHECKS=280376 NODES=193	? (TO) TT=1800.08	SAT TT=34.378 CHECKS=134278	SAT TT=13.675 CHECKS=48994	SAT TT=22.766 ASSIGNMENTS=91	SAT TT=60.356 ASSIGNMENTS=88	SAT TT=168.358 CHECKS=370142000 NODES=266	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=0.929 ASSIGNMENTS=100 CHECKS=59462	SAT TT=0.907 ASSIGNMENTS=100 CHECKS=59462	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.871 ASSIGNMENTS=100 CHECKS=59462	SAT TT=43.948 ASSIGNMENTS=21103 CHECKS=19679500	SAT TT=19.251	SAT TT=21.767 ASSIGNMENTS=5689 CHECKS=4028720	SAT TT=0.826 ASSIGNMENTS=92 CHECKS=53804	? TT=79.599	? (MO) TT=6.337	? (MO) TT=6.87
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle21.xml	SAT TT=0.162	SAT TT=1.752 CHECKS=116587 NODES=131	SAT TT=2.259 CHECKS=213548 NODES=128	SAT TT=11.408	SAT TT=6.849 CHECKS=38625	SAT TT=6.707 CHECKS=89031	SAT TT=6.928 ASSIGNMENTS=71	SAT TT=17.395 ASSIGNMENTS=79	SAT TT=295.425 CHECKS=784086000 NODES=199	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.172 ASSIGNMENTS=79 CHECKS=32801	SAT TT=0.172 ASSIGNMENTS=79 CHECKS=32801	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.162 ASSIGNMENTS=78 CHECKS=32650	SAT TT=9.876 ASSIGNMENTS=19879 CHECKS=9969070	SAT TT=5.674	SAT TT=4.095 ASSIGNMENTS=4094 CHECKS=1997310	SAT TT=0.163 ASSIGNMENTS=96 CHECKS=35630	? (MO) TT=41.805	SAT TT=113.241	SAT TT=122.424
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle22.xml	SAT TT=0.347	SAT TT=2.187 CHECKS=81327 NODES=134	SAT TT=2.833 CHECKS=139203 NODES=134	? (TO) TT=1800.05	SAT TT=15.41 CHECKS=68840	SAT TT=13.484 CHECKS=42701	SAT TT=18.974 ASSIGNMENTS=63	SAT TT=24.086 ASSIGNMENTS=62	SAT TT=133.131 CHECKS=3284820 NODES=138	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=0.367 ASSIGNMENTS=60 CHECKS=34811	SAT TT=0.347 ASSIGNMENTS=60 CHECKS=34811	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=0.364 ASSIGNMENTS=60 CHECKS=34811	SAT TT=55.861 ASSIGNMENTS=14353 CHECKS=11369000	SAT TT=13.183	SAT TT=17.441 ASSIGNMENTS=3790 CHECKS=3330050	SAT TT=0.428 ASSIGNMENTS=87 CHECKS=50191	? (MO) TT=41.999	? (TO) TT=1800.07	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukHerald/ normalized-crossword-m1-uk-05-02.xml	SAT TT=0.046	SAT TT=0.948 CHECKS=2899 NODES=23	SAT TT=0.915 CHECKS=2305 NODES=0	SAT TT=3.217	SAT TT=1.491 CHECKS=4152	SAT TT=1.11 CHECKS=2268	? (TO) TT=1800.08	SAT TT=1.612 ASSIGNMENTS=15	SAT TT=103.121 CHECKS=8225240 NODES=27	SAT TT=460.797 CHECKS=1447100000 NODES=1648800000	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=4.211 ASSIGNMENTS=6009 CHECKS=942989	SAT TT=0.193 ASSIGNMENTS=477 CHECKS=36087	SAT TT=1.68	SAT TT=0.046 ASSIGNMENTS=9 CHECKS=1290	SAT TT=0.139 ASSIGNMENTS=159 CHECKS=18459	? (MO) TT=32.444	SAT TT=17.515	SAT TT=21.08
csp/ukHerald/ normalized-crossword-m1-uk-05-05.xml	SAT TT=0.038	SAT TT=0.892 CHECKS=5817 NODES=17	SAT TT=0.873 CHECKS=8932 NODES=0	SAT TT=1.492	SAT TT=0.585 CHECKS=3876	SAT TT=0.318 CHECKS=1616	SAT TT=1.425 ASSIGNMENTS=100	SAT TT=1.02 ASSIGNMENTS=13	SAT TT=108.664 CHECKS=2733030 NODES=18	SAT TT=54.492 CHECKS=1990580 NODES=3750010	SAT TT=48.045 CHECKS=2307500 NODES=61	SAT TT=0.956 ASSIGNMENTS=4755 CHECKS=878016	SAT TT=0.897 ASSIGNMENTS=4755 CHECKS=878016	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=1.142 ASSIGNMENTS=6468 CHECKS=1185040	SAT TT=0.459 ASSIGNMENTS=1998 CHECKS=176846	SAT TT=0.955	SAT TT=0.038 ASSIGNMENTS=31 CHECKS=2760	SAT TT=0.115 ASSIGNMENTS=234 CHECKS=27385	? (MO) TT=45.596	SAT TT=6.169	SAT TT=6.93
csp/ukHerald/ normalized-crossword-m1-uk-15-01.xml	SAT TT=0.523	SAT TT=2.44 CHECKS=96913 NODES=193	SAT TT=3.612 CHECKS=197374 NODES=193	? (TO) TT=1800.06	SAT TT=13.571 CHECKS=42875	SAT TT=13.68 CHECKS=45565	SAT TT=16.976 ASSIGNMENTS=108	SAT TT=36.537 ASSIGNMENTS=72	SAT TT=271.525 CHECKS=816286000 NODES=231	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=0.595 ASSIGNMENTS=114 CHECKS=49434	SAT TT=0.681 ASSIGNMENTS=114 CHECKS=49434	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.592 ASSIGNMENTS=107 CHECKS=46263	SAT TT=56.272 ASSIGNMENTS=18777 CHECKS=15974000	SAT TT=38.014	SAT TT=18.061 ASSIGNMENTS=5545 CHECKS=2916720	SAT TT=0.523 ASSIGNMENTS=88 CHECKS=43588	? (MO) TT=34.453	? (TO) TT=1800.06	? (TO) TT=1800.05
csp/ukHerald/ normalized-crossword-m1-uk-15-02.xml	SAT TT=0.601	SAT TT=3.29 CHECKS=189251 NODES=341	SAT TT=3.558 CHECKS=264556 NODES=200	? (TO) TT=1800.08	SAT TT=26.614 CHECKS=282581	SAT TT=14.166 CHECKS=105858	SAT TT=20.367 ASSIGNMENTS=84	SAT TT=49.898 ASSIGNMENTS=95	SAT TT=249.371 CHECKS=568097000 NODES=304	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=1.459 ASSIGNMENTS=150 CHECKS=154585	SAT TT=1.495 ASSIGNMENTS=150 CHECKS=154585	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=1.892 ASSIGNMENTS=174 CHECKS=213851	SAT TT=51.806 ASSIGNMENTS=18346 CHECKS=20437400	SAT TT=180.021	SAT TT=84.927 ASSIGNMENTS=25311 CHECKS=18957800	SAT TT=0.601 ASSIGNMENTS=90 CHECKS=56622	? TT=93.953	? (TO) TT=1800.04	? (MO) TT=8.53
csp/ukHerald/ normalized-crossword-m1-uk-15-03.xml	SAT TT=0.435	SAT TT=3.011 CHECKS=164281 NODES=193	SAT TT=3.844 CHECKS=295964 NODES=193	SAT TT=43.554	SAT TT=23.499 CHECKS=64065	SAT TT=21.954 CHECKS=65746	SAT TT=16.759 ASSIGNMENTS=96	SAT TT=62.969 ASSIGNMENTS=85	SAT TT=211.905 CHECKS=569706000 NODES=277	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.477 ASSIGNMENTS=100 CHECKS=57505	SAT TT=0.475 ASSIGNMENTS=100 CHECKS=57505	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=0.435 ASSIGNMENTS=100 CHECKS=57505	SAT TT=48.676 ASSIGNMENTS=32342 CHECKS=25682200	? (TO) TT=1800.01	SAT TT=57.119 ASSIGNMENTS=19822 CHECKS=13527000	SAT TT=0.461 ASSIGNMENTS=97 CHECKS=59762	? (MO) TT=32.129	? (TO) TT=1800.18	? (TO) TT=1800.1
csp/ukHerald/ normalized-crossword-m1-uk-15-07.xml	SAT TT=0.72	SAT TT=3.169 CHECKS=131821 NODES=339	SAT TT=5.196 CHECKS=301246 NODES=563	? (TO) TT=1800.08	SAT TT=28.692 CHECKS=53325	SAT TT=25.231 CHECKS=41955	SAT TT=20.794 ASSIGNMENTS=81	SAT TT=57.916 ASSIGNMENTS=398	SAT TT=155.299 CHECKS=352556000 NODES=282	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=0.72 ASSIGNMENTS=93 CHECKS=52502	SAT TT=0.741 ASSIGNMENTS=93 CHECKS=52502	? (TO) TT=1800	? (TO) TT=1800.08	SAT TT=0.831 ASSIGNMENTS=89 CHECKS=53188	SAT TT=76.223 ASSIGNMENTS=21195 CHECKS=18353600	SAT TT=42.588	SAT TT=60.925 ASSIGNMENTS=15212 CHECKS=8491090	SAT TT=3.478 ASSIGNMENTS=253 CHECKS=259613	? (MO) TT=32.317	? (MO) TT=6.367	? (MO) TT=6.318
csp/ukHerald/ normalized-crossword-m1-uk-15-08.xml	SAT TT=0.489	SAT TT=2.831 CHECKS=175189 NODES=192	SAT TT=3.323 CHECKS=321226 NODES=193	? (TO) TT=1800.06	SAT TT=21.768 CHECKS=57960	SAT TT=20.096 CHECKS=55098	SAT TT=13.178 ASSIGNMENTS=101	SAT TT=54.732 ASSIGNMENTS=92	SAT TT=194.18 CHECKS=355224000 NODES=336	? (TO) TT=1800.03	? (TO) TT=1800	SAT TT=0.508 ASSIGNMENTS=106 CHECKS=53264	SAT TT=0.509 ASSIGNMENTS=106 CHECKS=53264	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT TT=0.497 ASSIGNMENTS=106 CHECKS=53264	SAT TT=34.811 ASSIGNMENTS=27410 CHECKS=21478700	? (TO) TT=1800.07	SAT TT=57.259 ASSIGNMENTS=25215 CHECKS=13960600	SAT TT=0.489 ASSIGNMENTS=113 CHECKS=53723	? TT=83.108	SAT TT=1760.92	? (TO) TT=1800.04
csp/ukHerald/ normalized-crossword-m1-uk-15-09.xml	SAT TT=0.372	SAT TT=2.573 CHECKS=130241 NODES=192	SAT TT=3.334 CHECKS=240541 NODES=190	? (TO) TT=1800.12	SAT TT=21.763 CHECKS=52515	SAT TT=20.271 CHECKS=55401	SAT TT=15.21 ASSIGNMENTS=112	SAT TT=62.966 ASSIGNMENTS=104	SAT TT=196.766 CHECKS=346094000 NODES=252	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=0.414 ASSIGNMENTS=108 CHECKS=54672	SAT TT=0.441 ASSIGNMENTS=108 CHECKS=54672	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=0.408 ASSIGNMENTS=108 CHECKS=54672	SAT TT=33.865 ASSIGNMENTS=29957 CHECKS=18910800	? (TO) TT=1800.07	SAT TT=60.154 ASSIGNMENTS=28153 CHECKS=16552900	SAT TT=0.372 ASSIGNMENTS=102 CHECKS=53487	? (MO) TT=38.593	SAT TT=1323.61	? (TO) TT=1800
csp/ukHerald/ normalized-crossword-m1-uk-15-10.xml	SAT TT=0.912	SAT TT=3.116 CHECKS=154549 NODES=194	SAT TT=4.127 CHECKS=244835 NODES=194	? (TO) TT=1800.08	SAT TT=29.029 CHECKS=226542	SAT TT=13.128 CHECKS=54908	SAT TT=21.926 ASSIGNMENTS=67	SAT TT=144.075 ASSIGNMENTS=580	SAT TT=137.068 CHECKS=213827000 NODES=311	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.944 ASSIGNMENTS=99 CHECKS=107863	SAT TT=0.953 ASSIGNMENTS=99 CHECKS=107863	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=1.12 ASSIGNMENTS=113 CHECKS=125368	SAT TT=75.587 ASSIGNMENTS=23894 CHECKS=25025700	SAT TT=1187.63	SAT TT=57.147 ASSIGNMENTS=12945 CHECKS=10499400	SAT TT=0.912 ASSIGNMENTS=89 CHECKS=95330	? TT=76.313	? (MO) TT=6.336	? (MO) TT=9.609
csp/ukHerald/ normalized-crossword-m1-uk-19-01.xml	SAT TT=0.883	SAT TT=5.176 CHECKS=562361 NODES=309	SAT TT=6.925 CHECKS=966890 NODES=309	? (TO) TT=1800.07	SAT TT=68.764 CHECKS=746010	SAT TT=27.379 CHECKS=149285	SAT TT=29.125 ASSIGNMENTS=146	SAT TT=65.627 ASSIGNMENTS=148	SAT TT=177.186 CHECKS=394318000 NODES=605	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.955 ASSIGNMENTS=168 CHECKS=175819	SAT TT=0.948 ASSIGNMENTS=168 CHECKS=175819	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.883 ASSIGNMENTS=168 CHECKS=175819	SAT TT=13.812 ASSIGNMENTS=3627 CHECKS=5037440	? (TO) TT=1800.07	SAT TT=112.345 ASSIGNMENTS=37431 CHECKS=51947300	SAT TT=1.044 ASSIGNMENTS=175 CHECKS=193230	? TT=79.855	? (TO) TT=1800.13	? (MO) TT=6.34
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukHerald/ normalized-crossword-m1-uk-19-04.xml	SAT TT=0.884	SAT TT=4.284 CHECKS=402686 NODES=303	SAT TT=5.829 CHECKS=785714 NODES=304	? (TO) TT=1800.06	SAT TT=43.358 CHECKS=212130	SAT TT=37.909 CHECKS=184866	SAT TT=26.109 ASSIGNMENTS=178	SAT TT=64.389 ASSIGNMENTS=146	SAT TT=256.306 CHECKS=652979000 NODES=549	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=0.889 ASSIGNMENTS=173 CHECKS=151353	SAT TT=0.998 ASSIGNMENTS=173 CHECKS=151353	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=0.884 ASSIGNMENTS=172 CHECKS=153766	SAT TT=76.836 ASSIGNMENTS=25743 CHECKS=45344000	? (TO) TT=1800.09	SAT TT=53.358 ASSIGNMENTS=10581 CHECKS=10652000	SAT TT=0.989 ASSIGNMENTS=196 CHECKS=208081	? (MO) TT=40.503	? (TO) TT=1800.06	? (TO) TT=1800
csp/ukHerald/ normalized-crossword-m1-uk-19-05.xml	SAT TT=0.578	SAT TT=3.988 CHECKS=415238 NODES=294	SAT TT=5.809 CHECKS=711803 NODES=294	? (TO) TT=1800.07	SAT TT=20.76 CHECKS=199060	SAT TT=15.169 CHECKS=164919	SAT TT=30.108 ASSIGNMENTS=145	SAT TT=64.699 ASSIGNMENTS=153	SAT TT=233.301 CHECKS=532002000 NODES=352	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=0.613 ASSIGNMENTS=149 CHECKS=142805	SAT TT=0.627 ASSIGNMENTS=149 CHECKS=142805	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=0.578 ASSIGNMENTS=149 CHECKS=142805	SAT TT=2.763 ASSIGNMENTS=808 CHECKS=1224110	? (TO) TT=1800	SAT TT=30.603 ASSIGNMENTS=9426 CHECKS=16563700	SAT TT=0.614 ASSIGNMENTS=152 CHECKS=151127	? (MO) TT=30.333	? (TO) TT=1800.09	? (TO) TT=1800.04
csp/ukHerald/ normalized-crossword-m1-uk-19-08.xml	SAT TT=0.977	SAT TT=5.455 CHECKS=605917 NODES=306	SAT TT=7.162 CHECKS=1047760 NODES=301	? (TO) TT=1800.08	SAT TT=26.145 CHECKS=195273	SAT TT=17.47 CHECKS=150606	SAT TT=31.761 ASSIGNMENTS=157	SAT TT=69.351 ASSIGNMENTS=445	SAT TT=186.606 CHECKS=270481000 NODES=576	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=0.977 ASSIGNMENTS=188 CHECKS=193713	SAT TT=1.043 ASSIGNMENTS=188 CHECKS=193713	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1.042 ASSIGNMENTS=183 CHECKS=192874	SAT TT=3.072 ASSIGNMENTS=835 CHECKS=1164130	SAT TT=84.294	SAT TT=57.431 ASSIGNMENTS=18956 CHECKS=30979000	SAT TT=0.982 ASSIGNMENTS=165 CHECKS=174481	? (MO) TT=32.194	? (MO) TT=7.03	? (TO) TT=1800.03
csp/ukHerald/ normalized-crossword-m1-uk-19-10.xml	SAT TT=0.768	SAT TT=5.392 CHECKS=620917 NODES=297	SAT TT=7.56 CHECKS=1227720 NODES=296	? (TO) TT=1800.08	SAT TT=20.186 CHECKS=256793	SAT TT=14.809 CHECKS=234835	SAT TT=32.523 ASSIGNMENTS=155	SAT TT=65.847 ASSIGNMENTS=135	SAT TT=206.331 CHECKS=533569000 NODES=508	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=0.768 ASSIGNMENTS=155 CHECKS=178397	SAT TT=0.825 ASSIGNMENTS=155 CHECKS=178397	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=0.812 ASSIGNMENTS=155 CHECKS=178397	SAT TT=1.262 ASSIGNMENTS=384 CHECKS=531593	SAT TT=19.472	SAT TT=87.007 ASSIGNMENTS=33061 CHECKS=71046500	SAT TT=0.82 ASSIGNMENTS=147 CHECKS=189234	? TT=79.018	? (TO) TT=1800.08	? (TO) TT=1800.04
csp/ukHerald/ normalized-crossword-m1-uk-21-02.xml	SAT TT=1.214	SAT TT=5.768 CHECKS=519482 NODES=374	SAT TT=8.513 CHECKS=960284 NODES=648	? (TO) TT=1800.14	SAT TT=37.847 CHECKS=229293	SAT TT=29.984 CHECKS=160252	SAT TT=35.257 ASSIGNMENTS=169	SAT TT=209.427 ASSIGNMENTS=8461	SAT TT=362.062 CHECKS=1270520000 NODES=702	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=1.36 ASSIGNMENTS=232 CHECKS=266580	SAT TT=1.354 ASSIGNMENTS=232 CHECKS=266580	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=1.315 ASSIGNMENTS=232 CHECKS=259831	SAT TT=47.348 ASSIGNMENTS=12305 CHECKS=18195500	SAT TT=143.473	SAT TT=124.792 ASSIGNMENTS=32369 CHECKS=47701200	SAT TT=1.214 ASSIGNMENTS=180 CHECKS=209962	? TT=65.758	? (TO) TT=1800.15	? (MO) TT=6.281
csp/ukHerald/ normalized-crossword-m1-uk-21-04.xml	SAT TT=5.888	SAT TT=11.48 CHECKS=1494660 NODES=2095	SAT TT=9.823 CHECKS=716755 NODES=1111	? (TO) TT=1800.16	SAT TT=59.402 CHECKS=867483	SAT TT=153.594 CHECKS=1937540	SAT TT=114.376 ASSIGNMENTS=779	? (TO) TT=1800.11	SAT TT=252.471 CHECKS=782416000 NODES=665	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=18.114 ASSIGNMENTS=1973 CHECKS=1698940	SAT TT=18.213 ASSIGNMENTS=1973 CHECKS=1698940	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=11.017 ASSIGNMENTS=1334 CHECKS=2083100	SAT TT=58.316 ASSIGNMENTS=11441 CHECKS=17480000	? (MO) TT=37.79	SAT TT=46.807 ASSIGNMENTS=10147 CHECKS=15381800	SAT TT=5.888 ASSIGNMENTS=792 CHECKS=1339600	? TT=82.69	? (TO) TT=1800.21	? (TO) TT=1800.17
csp/ukHerald/ normalized-crossword-m1-uk-23-01.xml	SAT TT=1.35	SAT TT=12.021 CHECKS=1354100 NODES=2088	SAT TT=13.91 CHECKS=1362450 NODES=1630	? (TO) TT=1800.11	SAT TT=53.6 CHECKS=763199	SAT TT=43.096 CHECKS=575273	SAT TT=69.315 ASSIGNMENTS=157	? (TO) TT=1800.06	SAT TT=175.647 CHECKS=196994000 NODES=994	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=2.01 ASSIGNMENTS=263 CHECKS=449526	SAT TT=1.884 ASSIGNMENTS=263 CHECKS=449526	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=2.387 ASSIGNMENTS=332 CHECKS=613928	SAT TT=71.243 ASSIGNMENTS=9228 CHECKS=18808600	? (MO) TT=41.13	SAT TT=374.255 ASSIGNMENTS=54622 CHECKS=133821000	SAT TT=1.35 ASSIGNMENTS=183 CHECKS=249968	? TT=93.939	? (MO) TT=7.406	? (MO) TT=6.98
csp/ukHerald/ normalized-crossword-m1-uk-23-02.xml	SAT TT=1.471	SAT TT=9.087 CHECKS=1290960 NODES=737	SAT TT=10.085 CHECKS=1446230 NODES=443	? (TO) TT=1800.15	SAT TT=47.458 CHECKS=408161	SAT TT=35.499 CHECKS=339184	SAT TT=44.654 ASSIGNMENTS=199	SAT TT=958.567 ASSIGNMENTS=30636	SAT TT=335.906 CHECKS=918327000 NODES=721	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1.681 ASSIGNMENTS=225 CHECKS=317981	SAT TT=1.942 ASSIGNMENTS=225 CHECKS=317981	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=1.71 ASSIGNMENTS=227 CHECKS=322505	SAT TT=11.792 ASSIGNMENTS=2614 CHECKS=4719430	? (MO) TT=39.95	SAT TT=168.643 ASSIGNMENTS=42650 CHECKS=77359600	SAT TT=1.471 ASSIGNMENTS=209 CHECKS=300938	? TT=94.037	? (MO) TT=8.12	? (MO) TT=8.17
csp/ukHerald/ normalized-crossword-m1-uk-23-07.xml	SAT TT=1.539	SAT TT=7.453 CHECKS=623282 NODES=454	SAT TT=12.283 CHECKS=1631290 NODES=877	? (TO) TT=1800.18	Signal TT=21.229	SAT TT=46.736 CHECKS=261306	SAT TT=59.87 ASSIGNMENTS=376	? (TO) TT=1800.12	SAT TT=440.563 CHECKS=1599670000 NODES=806	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=1.622 ASSIGNMENTS=192 CHECKS=278495	SAT TT=1.625 ASSIGNMENTS=192 CHECKS=278495	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=1.539 ASSIGNMENTS=192 CHECKS=278495	SAT TT=72.53 ASSIGNMENTS=12606 CHECKS=25315800	? (MO) TT=40.64	SAT TT=418.712 ASSIGNMENTS=86335 CHECKS=163247000	SAT TT=2.155 ASSIGNMENTS=284 CHECKS=463154	? (MO) TT=36.778	? (MO) TT=8	? (MO) TT=7.243
csp/ukHerald/ normalized-crossword-m1-uk-23-09.xml	SAT TT=1.388	SAT TT=12.913 CHECKS=2032160 NODES=1459	SAT TT=15.423 CHECKS=1762240 NODES=1294	? (TO) TT=1800.12	SAT TT=53.079 CHECKS=1452100	SAT TT=41.87 CHECKS=685117	SAT TT=68.736 ASSIGNMENTS=257	SAT TT=519.31 ASSIGNMENTS=9059	SAT TT=720.149 CHECKS=3126790000 NODES=859	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=1.897 ASSIGNMENTS=232 CHECKS=622054	SAT TT=1.888 ASSIGNMENTS=232 CHECKS=622054	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=2.341 ASSIGNMENTS=290 CHECKS=769641	SAT TT=57.252 ASSIGNMENTS=10767 CHECKS=29627900	? (MO) TT=40.3	SAT TT=232.74 ASSIGNMENTS=46448 CHECKS=129061000	SAT TT=1.388 ASSIGNMENTS=194 CHECKS=401189	? (MO) TT=35.066	? (MO) TT=6.327	? (TO) TT=1800.14
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle03.xml	SAT TT=0.026	SAT TT=0.803 CHECKS=1815 NODES=14	SAT TT=0.813 CHECKS=1513 NODES=0	SAT TT=0.349	SAT TT=0.259 CHECKS=1109	SAT TT=0.214 CHECKS=918	SAT TT=1.17 ASSIGNMENTS=80	SAT TT=1.025 ASSIGNMENTS=10	SAT TT=130.827 CHECKS=315682 NODES=14	SAT TT=70.561 CHECKS=530593 NODES=300015	SAT TT=84.724 CHECKS=761223 NODES=18	SAT TT=0.236 ASSIGNMENTS=1077 CHECKS=65303	SAT TT=0.253 ASSIGNMENTS=1077 CHECKS=65303	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=0.226 ASSIGNMENTS=769 CHECKS=51674	SAT TT=0.027 ASSIGNMENTS=53 CHECKS=2106	SAT TT=0.635	SAT TT=0.028 ASSIGNMENTS=51 CHECKS=2632	SAT TT=0.026 ASSIGNMENTS=80 CHECKS=4357	? (TO) TT=1800.15	SAT TT=1.805	SAT TT=2.543
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle04.xml	SAT TT=0.047	SAT TT=0.871 CHECKS=2467 NODES=19	SAT TT=0.887 CHECKS=5240 NODES=19	SAT TT=1.862	SAT TT=0.626 CHECKS=1738	SAT TT=0.477 CHECKS=1127	SAT TT=1.489 ASSIGNMENTS=66	SAT TT=1.215 ASSIGNMENTS=15	SAT TT=116.504 CHECKS=2756070 NODES=20	SAT TT=55.429 CHECKS=3288410 NODES=2550010	SAT TT=119.606 CHECKS=111861000 NODES=4952	SAT TT=0.375 ASSIGNMENTS=997 CHECKS=75703	SAT TT=0.354 ASSIGNMENTS=997 CHECKS=75703	? (TO) TT=1800	? (TO) TT=1800.07	SAT TT=0.475 ASSIGNMENTS=1832 CHECKS=125766	SAT TT=0.182 ASSIGNMENTS=424 CHECKS=23238	SAT TT=0.96	SAT TT=0.047 ASSIGNMENTS=27 CHECKS=1367	SAT TT=0.074 ASSIGNMENTS=363 CHECKS=12708	? (MO) TT=46.073	SAT TT=6.754	SAT TT=8.954
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle07.xml	SAT TT=0.076	SAT TT=0.905 CHECKS=4691 NODES=30	SAT TT=1.032 CHECKS=5537 NODES=0	SAT TT=2.087	SAT TT=0.941 CHECKS=2908	SAT TT=0.824 CHECKS=1868	SAT TT=7.555 ASSIGNMENTS=824	SAT TT=1.463 ASSIGNMENTS=22	SAT TT=121.185 CHECKS=5122460 NODES=31	SAT TT=146.875 CHECKS=195718000 NODES=294000000	SAT TT=1022.98 CHECKS=1455280000 NODES=85341	SAT TT=0.357 ASSIGNMENTS=968 CHECKS=86777	SAT TT=0.39 ASSIGNMENTS=968 CHECKS=86777	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=0.602 ASSIGNMENTS=1462 CHECKS=144297	SAT TT=0.171 ASSIGNMENTS=318 CHECKS=27838	SAT TT=1.392	SAT TT=0.081 ASSIGNMENTS=128 CHECKS=7361	SAT TT=0.076 ASSIGNMENTS=113 CHECKS=8072	? TT=99.585	SAT TT=12.823	SAT TT=14.045
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle08.xml	SAT TT=0.113	SAT TT=1.389 CHECKS=13338 NODES=41	SAT TT=1.273 CHECKS=10461 NODES=0	SAT TT=3.552	SAT TT=1.751 CHECKS=4697	SAT TT=1.662 CHECKS=5619	SAT TT=3.061 ASSIGNMENTS=282	SAT TT=2.55 ASSIGNMENTS=28	SAT TT=121.85 CHECKS=229328 NODES=41	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=0.657 ASSIGNMENTS=1746 CHECKS=361913	SAT TT=0.659 ASSIGNMENTS=1746 CHECKS=361913	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=0.643 ASSIGNMENTS=1546 CHECKS=335204	SAT TT=2.161 ASSIGNMENTS=1725 CHECKS=282309	SAT TT=3.287	SAT TT=0.113 ASSIGNMENTS=24 CHECKS=2799	SAT TT=0.151 ASSIGNMENTS=171 CHECKS=31449	? (TO) TT=1800.18	SAT TT=203.699	SAT TT=221.05
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle09.xml	SAT TT=0.16	SAT TT=1.111 CHECKS=6784 NODES=35	SAT TT=1.273 CHECKS=6058 NODES=0	SAT TT=4.772	SAT TT=1.786 CHECKS=2683	SAT TT=2.547 CHECKS=4877	SAT TT=4.565 ASSIGNMENTS=280	SAT TT=2.616 ASSIGNMENTS=23	SAT TT=130.85 CHECKS=4519480 NODES=35	? (TO) TT=1800	? (TO) TT=1800.04	SAT TT=1.487 ASSIGNMENTS=1833 CHECKS=497320	SAT TT=1.476 ASSIGNMENTS=1833 CHECKS=497320	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=1.305 ASSIGNMENTS=1569 CHECKS=437323	SAT TT=7.109 ASSIGNMENTS=4093 CHECKS=539529	SAT TT=3.394	SAT TT=0.27 ASSIGNMENTS=118 CHECKS=13089	SAT TT=0.16 ASSIGNMENTS=125 CHECKS=18633	? (MO) TT=32.903	SAT TT=211.699	SAT TT=226.039
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle10.xml	SAT TT=0.108	SAT TT=1.151 CHECKS=24482 NODES=40	SAT TT=1.127 CHECKS=16158 NODES=0	SAT TT=1355.1	SAT TT=2.545 CHECKS=7703	SAT TT=1.988 CHECKS=6570	SAT TT=3.312 ASSIGNMENTS=29	SAT TT=2.95 ASSIGNMENTS=28	SAT TT=129.193 CHECKS=106246 NODES=40	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=0.121 ASSIGNMENTS=24 CHECKS=5277	SAT TT=0.122 ASSIGNMENTS=24 CHECKS=5277	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=0.11 ASSIGNMENTS=24 CHECKS=5277	SAT TT=10.354 ASSIGNMENTS=7536 CHECKS=1293040	SAT TT=468.74	SAT TT=0.174 ASSIGNMENTS=105 CHECKS=18614	SAT TT=0.108 ASSIGNMENTS=29 CHECKS=5271	? (TO) TT=1800.09	SAT TT=291.449	SAT TT=281.36
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle11.xml	SAT TT=0.227	SAT TT=1.148 CHECKS=5174 NODES=38	SAT TT=1.146 CHECKS=1221 NODES=0	SAT TT=1350.29	SAT TT=1.981 CHECKS=2350	SAT TT=1.66 CHECKS=2096	SAT TT=3.891 ASSIGNMENTS=165	SAT TT=3.364 ASSIGNMENTS=19	SAT TT=106.108 CHECKS=183813000 NODES=38	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=0.66 ASSIGNMENTS=1031 CHECKS=180780	SAT TT=0.714 ASSIGNMENTS=1031 CHECKS=180780	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=0.706 ASSIGNMENTS=1029 CHECKS=177782	SAT TT=0.391 ASSIGNMENTS=119 CHECKS=18880	SAT TT=3.388	SAT TT=0.635 ASSIGNMENTS=295 CHECKS=32235	SAT TT=0.227 ASSIGNMENTS=131 CHECKS=18151	? TT=75.756	SAT TT=204.964	SAT TT=233.893
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle12.xml	SAT TT=0.102	SAT TT=1.255 CHECKS=25332 NODES=52	SAT TT=1.203 CHECKS=47841 NODES=52	SAT TT=2.954	SAT TT=1.23 CHECKS=7820	SAT TT=1.001 CHECKS=7088	SAT TT=3.715 ASSIGNMENTS=290	SAT TT=2.739 ASSIGNMENTS=30	SAT TT=123.203 CHECKS=6973150 NODES=53	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=0.997 ASSIGNMENTS=3328 CHECKS=1101320	SAT TT=1.007 ASSIGNMENTS=3328 CHECKS=1101320	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=1.569 ASSIGNMENTS=5479 CHECKS=1486600	SAT TT=3.133 ASSIGNMENTS=13071 CHECKS=2459550	? (TO) TT=1800.09	SAT TT=0.369 ASSIGNMENTS=740 CHECKS=158692	SAT TT=0.102 ASSIGNMENTS=129 CHECKS=57234	? (MO) TT=39.414	SAT TT=14.77	SAT TT=18.98
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle13.xml	SAT TT=0.162	SAT TT=1.699 CHECKS=44249 NODES=65	SAT TT=1.808 CHECKS=82027 NODES=65	SAT TT=1363.7	SAT TT=3.676 CHECKS=27505	SAT TT=3.337 CHECKS=27447	SAT TT=4.417 ASSIGNMENTS=43	SAT TT=5.291 ASSIGNMENTS=34	SAT TT=134.676 CHECKS=1416850 NODES=68	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=0.173 ASSIGNMENTS=46 CHECKS=11081	SAT TT=0.192 ASSIGNMENTS=46 CHECKS=11081	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=0.171 ASSIGNMENTS=46 CHECKS=11081	SAT TT=10.987 ASSIGNMENTS=17069 CHECKS=4218740	SAT TT=4.502	SAT TT=0.316 ASSIGNMENTS=289 CHECKS=74490	SAT TT=0.162 ASSIGNMENTS=39 CHECKS=11221	? (MO) TT=42.922	SAT TT=644.536	SAT TT=636.278
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle15.xml	SAT TT=0.115	SAT TT=1.621 CHECKS=69791 NODES=98	SAT TT=1.947 CHECKS=143798 NODES=98	SAT TT=12.197	SAT TT=6.078 CHECKS=46430	SAT TT=5.603 CHECKS=56144	SAT TT=5.349 ASSIGNMENTS=66	SAT TT=8.325 ASSIGNMENTS=55	SAT TT=129.709 CHECKS=356010 NODES=102	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.129 ASSIGNMENTS=68 CHECKS=22090	SAT TT=0.122 ASSIGNMENTS=68 CHECKS=22090	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=0.116 ASSIGNMENTS=68 CHECKS=22090	SAT TT=9.577 ASSIGNMENTS=26553 CHECKS=8537890	SAT TT=4.917	SAT TT=2.744 ASSIGNMENTS=2814 CHECKS=1438050	SAT TT=0.115 ASSIGNMENTS=66 CHECKS=24137	? (MO) TT=41.38	SAT TT=58.842	SAT TT=77.107
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle16.xml	SAT TT=0.284	SAT TT=2.207 CHECKS=140913 NODES=136	SAT TT=2.703 CHECKS=335213 NODES=136	SAT TT=14.623	SAT TT=6.019 CHECKS=40202	SAT TT=4.563 CHECKS=40753	SAT TT=7.583 ASSIGNMENTS=100	SAT TT=21.422 ASSIGNMENTS=78	SAT TT=205.709 CHECKS=468002000 NODES=218	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=0.305 ASSIGNMENTS=96 CHECKS=36156	SAT TT=0.307 ASSIGNMENTS=96 CHECKS=36156	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=0.304 ASSIGNMENTS=96 CHECKS=36156	SAT TT=19.123 ASSIGNMENTS=25436 CHECKS=14858700	SAT TT=7.324	SAT TT=5.752 ASSIGNMENTS=4365 CHECKS=2302620	SAT TT=0.284 ASSIGNMENTS=93 CHECKS=36316	? (MO) TT=57.712	SAT TT=296.957	SAT TT=301.171
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle17.xml	SAT TT=0.423	SAT TT=2.884 CHECKS=236831 NODES=183	SAT TT=3.682 CHECKS=514465 NODES=180	? (TO) TT=1800.14	SAT TT=12.03 CHECKS=68615	SAT TT=9.645 CHECKS=66258	SAT TT=12.831 ASSIGNMENTS=105	SAT TT=58.022 ASSIGNMENTS=95	SAT TT=196.235 CHECKS=355008000 NODES=274	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=0.463 ASSIGNMENTS=114 CHECKS=64953	SAT TT=0.464 ASSIGNMENTS=114 CHECKS=64953	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=0.447 ASSIGNMENTS=114 CHECKS=64953	SAT TT=34.202 ASSIGNMENTS=26549 CHECKS=23662900	? (TO) TT=1800.05	SAT TT=25.903 ASSIGNMENTS=6615 CHECKS=7068150	SAT TT=0.423 ASSIGNMENTS=102 CHECKS=63464	? TT=82.801	SAT TT=1641.3	? (TO) TT=1800.08
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle19.xml	SAT TT=0.894	SAT TT=3.011 CHECKS=169772 NODES=190	SAT TT=3.985 CHECKS=298553 NODES=190	? (TO) TT=1800.1	SAT TT=12.452 CHECKS=54182	SAT TT=12.883 CHECKS=58255	SAT TT=15.345 ASSIGNMENTS=101	SAT TT=44.029 ASSIGNMENTS=76	SAT TT=153.966 CHECKS=295613000 NODES=250	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=0.934 ASSIGNMENTS=128 CHECKS=78071	SAT TT=0.901 ASSIGNMENTS=128 CHECKS=78071	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=1.079 ASSIGNMENTS=162 CHECKS=99529	SAT TT=42.008 ASSIGNMENTS=27790 CHECKS=20524300	? (TO) TT=1800.01	SAT TT=47.406 ASSIGNMENTS=17135 CHECKS=10247800	SAT TT=0.894 ASSIGNMENTS=135 CHECKS=71067	? TT=82.311	? (TO) TT=1800.01	? (TO) TT=1800.06
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle22.xml	SAT TT=0.219	SAT TT=2.08 CHECKS=126191 NODES=193	SAT TT=2.39 CHECKS=177480 NODES=135	? (TO) TT=1800.12	SAT TT=8.853 CHECKS=47363	SAT TT=7.246 CHECKS=48707	SAT TT=11.823 ASSIGNMENTS=67	SAT TT=24.841 ASSIGNMENTS=87	SAT TT=133.931 CHECKS=2587760 NODES=134	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=0.245 ASSIGNMENTS=81 CHECKS=38680	SAT TT=0.238 ASSIGNMENTS=81 CHECKS=38680	? (TO) TT=1800	? (TO) TT=1800.05	SAT TT=0.219 ASSIGNMENTS=81 CHECKS=38680	SAT TT=27.076 ASSIGNMENTS=18427 CHECKS=10550200	SAT TT=27.304	SAT TT=9.226 ASSIGNMENTS=3810 CHECKS=3286960	SAT TT=0.226 ASSIGNMENTS=63 CHECKS=36795	? (MO) TT=34.985	SAT TT=645.075	SAT TT=849.984
csp/wordsHerald/ normalized-crossword-m1-words-05-01.xml	SAT TT=0.045	SAT TT=0.952 CHECKS=4459 NODES=30	SAT TT=1.1 CHECKS=18642 NODES=60	SAT TT=4.131	SAT TT=1.209 CHECKS=35034	SAT TT=1.095 CHECKS=33362	SAT TT=8.139 ASSIGNMENTS=719	SAT TT=1.986 ASSIGNMENTS=33	SAT TT=66.275 CHECKS=62943700 NODES=105	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=16.65 ASSIGNMENTS=719	SAT TT=7.495 ASSIGNMENTS=162 CHECKS=17924	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=4.257 ASSIGNMENTS=4006 CHECKS=2090980	SAT TT=1.877 ASSIGNMENTS=8321 CHECKS=914459	SAT TT=1.049	SAT TT=0.543 ASSIGNMENTS=652 CHECKS=244430	SAT TT=0.045 ASSIGNMENTS=162 CHECKS=17924	? (MO) TT=45.153	SAT TT=10.01	SAT TT=19.734
csp/wordsHerald/ normalized-crossword-m1-words-05-03.xml	SAT TT=0.037	SAT TT=0.839 CHECKS=742 NODES=21	SAT TT=0.915 CHECKS=891 NODES=0	SAT TT=2.01	SAT TT=0.296 CHECKS=1560	SAT TT=0.245 CHECKS=1513	SAT TT=2.378 ASSIGNMENTS=186	SAT TT=1.21 ASSIGNMENTS=10	SAT TT=82.834 CHECKS=14117600 NODES=22	SAT TT=416.227 CHECKS=1958090000 NODES=-1986620000	? (TO) TT=1800.05	SAT TT=0.938 ASSIGNMENTS=1828 CHECKS=246965	SAT TT=0.925 ASSIGNMENTS=1828 CHECKS=246965	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=2.106 ASSIGNMENTS=3784 CHECKS=566325	SAT TT=1.689 ASSIGNMENTS=4360 CHECKS=400578	SAT TT=0.945	SAT TT=0.087 ASSIGNMENTS=162 CHECKS=17362	SAT TT=0.037 ASSIGNMENTS=63 CHECKS=5430	? (MO) TT=33.852	SAT TT=4.911	SAT TT=6.251
csp/wordsHerald/ normalized-crossword-m1-words-05-04.xml	SAT TT=0.031	SAT TT=0.833 CHECKS=2050 NODES=19	SAT TT=0.876 CHECKS=4427 NODES=20	SAT TT=1.712	SAT TT=0.384 CHECKS=3178	SAT TT=0.27 CHECKS=2015	SAT TT=1.298 ASSIGNMENTS=64	SAT TT=1.03 ASSIGNMENTS=15	SAT TT=128.584 CHECKS=7367150 NODES=20	SAT TT=91.565 CHECKS=78564900 NODES=88050000	? (TO) TT=1800.05	SAT TT=0.372 ASSIGNMENTS=1135 CHECKS=99727	SAT TT=0.389 ASSIGNMENTS=1135 CHECKS=99727	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=0.44 ASSIGNMENTS=1541 CHECKS=130648	SAT TT=0.289 ASSIGNMENTS=1199 CHECKS=70623	SAT TT=0.641	SAT TT=0.041 ASSIGNMENTS=81 CHECKS=4996	SAT TT=0.031 ASSIGNMENTS=54 CHECKS=3932	? (MO) TT=44.249	SAT TT=2.812	SAT TT=3.571
csp/wordsHerald/ normalized-crossword-m1-words-05-08.xml	SAT TT=0.039	SAT TT=0.925 CHECKS=1544 NODES=23	SAT TT=0.879 CHECKS=1406 NODES=0	SAT TT=2.668	SAT TT=0.418 CHECKS=2565	SAT TT=0.301 CHECKS=1990	SAT TT=1.828 ASSIGNMENTS=134	SAT TT=1.453 ASSIGNMENTS=17	SAT TT=113.3 CHECKS=19294200 NODES=24	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.538 ASSIGNMENTS=1151 CHECKS=162787	SAT TT=0.527 ASSIGNMENTS=1151 CHECKS=162787	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=1.45 ASSIGNMENTS=3273 CHECKS=510343	SAT TT=1.496 ASSIGNMENTS=5671 CHECKS=465268	SAT TT=1.058	SAT TT=0.042 ASSIGNMENTS=55 CHECKS=6799	SAT TT=0.039 ASSIGNMENTS=98 CHECKS=7894	? (MO) TT=32.76	SAT TT=5.947	SAT TT=7.65
csp/wordsHerald/ normalized-crossword-m1-words-05-10.xml	SAT TT=0.03	SAT TT=0.867 CHECKS=3843 NODES=17	SAT TT=0.866 CHECKS=3799 NODES=0	SAT TT=1.075	SAT TT=0.204 CHECKS=1974	SAT TT=0.169 CHECKS=2064	SAT TT=1.544 ASSIGNMENTS=223	SAT TT=1.052 ASSIGNMENTS=11	SAT TT=121.587 CHECKS=5454510 NODES=17	SAT TT=79.937 CHECKS=6277100 NODES=8550010	SAT TT=87.306 CHECKS=45158600 NODES=8526	SAT TT=0.39 ASSIGNMENTS=1397 CHECKS=257440	SAT TT=0.39 ASSIGNMENTS=1397 CHECKS=257440	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=0.503 ASSIGNMENTS=2102 CHECKS=388492	SAT TT=0.135 ASSIGNMENTS=507 CHECKS=44182	SAT TT=0.591	SAT TT=0.032 ASSIGNMENTS=46 CHECKS=5560	SAT TT=0.03 ASSIGNMENTS=75 CHECKS=4517	? (MO) TT=42.651	SAT TT=2.653	SAT TT=3.063
csp/wordsHerald/ normalized-crossword-m1-words-15-02.xml	SAT TT=1.075	SAT TT=4.761 CHECKS=809987 NODES=976	SAT TT=6.345 CHECKS=1192720 NODES=1361	? (TO) TT=1800.07	SAT TT=59.89 CHECKS=2808580	SAT TT=16.86 CHECKS=984087	SAT TT=21.5 ASSIGNMENTS=369	SAT TT=102.681 ASSIGNMENTS=1364	SAT TT=885.714 CHECKS=4645810000 NODES=928	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=1.075 ASSIGNMENTS=297 CHECKS=533197	SAT TT=1.098 ASSIGNMENTS=297 CHECKS=533197	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=1.227 ASSIGNMENTS=361 CHECKS=643439	SAT TT=24.837 ASSIGNMENTS=11671 CHECKS=18541500	SAT TT=21.678	SAT TT=185.859 ASSIGNMENTS=90940 CHECKS=90050100	SAT TT=1.801 ASSIGNMENTS=454 CHECKS=899974	? (MO) TT=33.437	? (TO) TT=1800.02	? (TO) TT=1800.01
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsHerald/ normalized-crossword-m1-words-15-04.xml	SAT TT=9.996	SAT TT=19.365 CHECKS=4697600 NODES=8733	SAT TT=9.996 CHECKS=1955800 NODES=3680	? (TO) TT=1800.12	SAT TT=169.242 CHECKS=11930400	SAT TT=265.575 CHECKS=23472400	SAT TT=63.387 ASSIGNMENTS=2814	SAT TT=120.063 ASSIGNMENTS=4486	SAT TT=698.756 CHECKS=3984310000 NODES=907	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=23.795 ASSIGNMENTS=8733 CHECKS=4697600	SAT TT=24.006 ASSIGNMENTS=8733 CHECKS=4697600	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=22.528 ASSIGNMENTS=9940 CHECKS=16109000	SAT TT=67.573 ASSIGNMENTS=24827 CHECKS=40432900	SAT TT=800.625	SAT TT=244.611 ASSIGNMENTS=87647 CHECKS=117981000	SAT TT=68.244 ASSIGNMENTS=16330 CHECKS=42120800	? (MO) TT=36.649	? (TO) TT=1800.02	? (TO) TT=1800.05
csp/wordsHerald/ normalized-crossword-m1-words-15-06.xml	SAT TT=30.486	SAT TT=30.486 CHECKS=3973860 NODES=20398	SAT TT=30.869 CHECKS=5213310 NODES=18243	? (TO) TT=1800.13	? (TO) TT=1800.08	SAT TT=97.157 CHECKS=4793650	SAT TT=366.88 ASSIGNMENTS=11944	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=40.931 ASSIGNMENTS=9597 CHECKS=15938200	SAT TT=36.698 ASSIGNMENTS=20398 CHECKS=3973860	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=185.599 ASSIGNMENTS=49529 CHECKS=79345300	SAT TT=57.904 ASSIGNMENTS=19307 CHECKS=28690800	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=33.13 ASSIGNMENTS=9597 CHECKS=15938200	? (MO) TT=45.044	? (TO) TT=1800.04	? (TO) TT=1800.05
csp/wordsHerald/ normalized-crossword-m1-words-15-08.xml	SAT TT=0.246	SAT TT=2.435 CHECKS=149593 NODES=351	SAT TT=2.83 CHECKS=268775 NODES=333	? (TO) TT=1800.11	SAT TT=42.014 CHECKS=1247230	SAT TT=10.717 CHECKS=229204	SAT TT=11.066 ASSIGNMENTS=80	SAT TT=39.092 ASSIGNMENTS=142	SAT TT=217.1 CHECKS=610744000 NODES=297	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=0.303 ASSIGNMENTS=129 CHECKS=102862	SAT TT=0.306 ASSIGNMENTS=129 CHECKS=102862	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=0.295 ASSIGNMENTS=132 CHECKS=103219	SAT TT=20.943 ASSIGNMENTS=17755 CHECKS=22652000	? (TO) TT=1800.05	SAT TT=81.976 ASSIGNMENTS=53012 CHECKS=36679900	SAT TT=0.246 ASSIGNMENTS=84 CHECKS=68738	? (MO) TT=40.682	SAT TT=322.61	? (TO) TT=1800.01
csp/wordsHerald/ normalized-crossword-m1-words-19-01.xml	SAT TT=0.593	SAT TT=5.058 CHECKS=760956 NODES=503	SAT TT=6.509 CHECKS=1050920 NODES=496	? (TO) TT=1800.06	SAT TT=49.747 CHECKS=2618860	SAT TT=11.511 CHECKS=602217	SAT TT=24.86 ASSIGNMENTS=131	SAT TT=68.85 ASSIGNMENTS=217	SAT TT=270.747 CHECKS=887003000 NODES=603	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=1.726 ASSIGNMENTS=600 CHECKS=1430960	SAT TT=1.629 ASSIGNMENTS=600 CHECKS=1430960	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=2.327 ASSIGNMENTS=853 CHECKS=2081220	SAT TT=18.595 ASSIGNMENTS=8403 CHECKS=18053700	SAT TT=29.87	SAT TT=106.369 ASSIGNMENTS=63797 CHECKS=116453000	SAT TT=0.593 ASSIGNMENTS=176 CHECKS=273748	? (MO) TT=32.322	? (TO) TT=1800.11	? (TO) TT=1800.04
csp/wordsHerald/ normalized-crossword-m1-words-19-03.xml	SAT TT=4.442	SAT TT=23.536 CHECKS=5295640 NODES=7838	SAT TT=57.325 CHECKS=13343700 NODES=25509	? (TO) TT=1800.14	SAT TT=694.114 CHECKS=47077200	SAT TT=308.625 CHECKS=26102900	SAT TT=64.253 ASSIGNMENTS=1641	SAT TT=76.115 ASSIGNMENTS=593	SAT TT=283.064 CHECKS=101780000 NODES=2509	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=26.111 ASSIGNMENTS=6853 CHECKS=3811780	SAT TT=25.385 ASSIGNMENTS=6853 CHECKS=3811780	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=1069.06 ASSIGNMENTS=508283 CHECKS=824675000	SAT TT=59.471 ASSIGNMENTS=19162 CHECKS=45669500	? (TO) TT=1800.06	SAT TT=379.566 ASSIGNMENTS=114280 CHECKS=151196000	SAT TT=4.442 ASSIGNMENTS=1481 CHECKS=2499540	? (MO) TT=43.88	? (TO) TT=1800.11	? (TO) TT=1800.05
csp/wordsHerald/ normalized-crossword-m1-words-19-05.xml	SAT TT=1.032	SAT TT=5.636 CHECKS=733248 NODES=1356	SAT TT=6.144 CHECKS=1006730 NODES=1238	? (TO) TT=1800.05	SAT TT=82.476 CHECKS=9465730	SAT TT=9.213 CHECKS=606844	SAT TT=42.543 ASSIGNMENTS=930	SAT TT=68.104 ASSIGNMENTS=229	SAT TT=321.919 CHECKS=1013880000 NODES=441	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1.035 ASSIGNMENTS=226 CHECKS=814865	SAT TT=1.032 ASSIGNMENTS=226 CHECKS=814865	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=1.76 ASSIGNMENTS=459 CHECKS=1710190	SAT TT=16.346 ASSIGNMENTS=6350 CHECKS=17188500	? (TO) TT=1800.04	SAT TT=181.857 ASSIGNMENTS=65016 CHECKS=192796000	SAT TT=1.033 ASSIGNMENTS=220 CHECKS=856671	? (MO) TT=43.143	SAT TT=987.205	? (TO) TT=1800.06
csp/wordsHerald/ normalized-crossword-m1-words-19-08.xml	SAT TT=0.586	SAT TT=5.69 CHECKS=1004380 NODES=561	SAT TT=7.052 CHECKS=1524340 NODES=784	? (TO) TT=1800.09	SAT TT=14.042 CHECKS=608688	SAT TT=7.573 CHECKS=622707	SAT TT=25.691 ASSIGNMENTS=101	SAT TT=65.609 ASSIGNMENTS=146	SAT TT=225.689 CHECKS=539741000 NODES=582	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=0.605 ASSIGNMENTS=140 CHECKS=278988	SAT TT=0.607 ASSIGNMENTS=140 CHECKS=278988	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=0.586 ASSIGNMENTS=140 CHECKS=278988	SAT TT=19.286 ASSIGNMENTS=8133 CHECKS=21189900	? (TO) TT=1800.09	SAT TT=82.569 ASSIGNMENTS=41746 CHECKS=99388800	SAT TT=0.623 ASSIGNMENTS=173 CHECKS=360717	? (MO) TT=31.39	? (TO) TT=1800.02	? (TO) TT=1800.01
csp/wordsHerald/ normalized-crossword-m1-words-21-01.xml	SAT TT=45.202	SAT TT=367.338 CHECKS=88943200 NODES=84365	SAT TT=221.297 CHECKS=64692400 NODES=60778	? (TO) TT=1800.11	SAT TT=528.771 CHECKS=55155700	SAT TT=163.009 CHECKS=17593000	SAT TT=617.182 ASSIGNMENTS=19270	SAT TT=931.838 ASSIGNMENTS=29933	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=101.311 ASSIGNMENTS=20939 CHECKS=74833500	SAT TT=371.378 ASSIGNMENTS=84365 CHECKS=88943200	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=295.914 ASSIGNMENTS=75157 CHECKS=232868000	SAT TT=45.202 ASSIGNMENTS=10974 CHECKS=32270200	? (TO) TT=1800.04	SAT TT=402.652 ASSIGNMENTS=112731 CHECKS=293581000	SAT TT=92.725 ASSIGNMENTS=20939 CHECKS=74833500	? (MO) TT=33.649	? (TO) TT=1800.15	? (TO) TT=1800.06
csp/wordsHerald/ normalized-crossword-m1-words-21-05.xml	SAT TT=4.563	SAT TT=11.862 CHECKS=2069950 NODES=4123	SAT TT=8.487 CHECKS=753379 NODES=2024	? (TO) TT=1800.12	SAT TT=69.995 CHECKS=5019410	SAT TT=67.967 CHECKS=5581790	SAT TT=111.201 ASSIGNMENTS=2879	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=19.188 ASSIGNMENTS=4123 CHECKS=2069950	SAT TT=18.617 ASSIGNMENTS=4123 CHECKS=2069950	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=167.46 ASSIGNMENTS=50958 CHECKS=121384000	SAT TT=21.379 ASSIGNMENTS=9002 CHECKS=16298200	SAT TT=146.865	SAT TT=41.804 ASSIGNMENTS=21655 CHECKS=36903600	SAT TT=4.563 ASSIGNMENTS=1684 CHECKS=3836930	? (MO) TT=43.08	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/wordsHerald/ normalized-crossword-m1-words-21-07.xml	SAT TT=0.999	SAT TT=29.928 CHECKS=9495560 NODES=6682	SAT TT=13.178 CHECKS=3260890 NODES=3057	? (TO) TT=1800.11	SAT TT=97.58 CHECKS=7500180	SAT TT=41.712 CHECKS=3116670	SAT TT=68.122 ASSIGNMENTS=1497	? (TO) TT=1800.16	SAT TT=1084.61 CHECKS=5453890000 NODES=1637	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=1.504 ASSIGNMENTS=431 CHECKS=1012080	SAT TT=1.515 ASSIGNMENTS=431 CHECKS=1012080	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=5.341 ASSIGNMENTS=1884 CHECKS=5020640	SAT TT=21.829 ASSIGNMENTS=8561 CHECKS=16650400	? (TO) TT=1800.08	SAT TT=154.62 ASSIGNMENTS=76763 CHECKS=133447000	SAT TT=0.999 ASSIGNMENTS=309 CHECKS=639214	? (MO) TT=48.195	? (TO) TT=1800.12	? (TO) TT=1800.01
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsHerald/ normalized-crossword-m1-words-21-08.xml	SAT TT=0.628	SAT TT=5.714 CHECKS=613531 NODES=469	SAT TT=7.377 CHECKS=1019940 NODES=699	? (TO) TT=1800.07	SAT TT=50.986 CHECKS=2788160	SAT TT=15.922 CHECKS=977795	SAT TT=39.84 ASSIGNMENTS=870	? (TO) TT=1800.07	SAT TT=612.412 CHECKS=2687100000 NODES=982	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=0.677 ASSIGNMENTS=193 CHECKS=351784	SAT TT=0.677 ASSIGNMENTS=193 CHECKS=351784	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=0.628 ASSIGNMENTS=186 CHECKS=343283	SAT TT=21.557 ASSIGNMENTS=9616 CHECKS=23259500	SAT TT=182.1	SAT TT=193.662 ASSIGNMENTS=99617 CHECKS=223470000	SAT TT=0.74 ASSIGNMENTS=201 CHECKS=376638	? (MO) TT=34.98	? (TO) TT=1800.06	? (TO) TT=1800.01
csp/wordsHerald/ normalized-crossword-m1-words-21-10.xml		? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.1	? (MO) TT=34.181	? (TO) TT=1800.15	? (TO) TT=1800.03
csp/wordsHerald/ normalized-crossword-m1-words-23-03.xml	SAT TT=22.069	SAT TT=308.21 CHECKS=104121000 NODES=61251	SAT TT=196.868 CHECKS=65045800 NODES=35278	? (TO) TT=1800.07	SAT TT=457.118 CHECKS=47181600	SAT TT=190.128 CHECKS=21206600	SAT TT=219.231 ASSIGNMENTS=6191	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=29.15 ASSIGNMENTS=6131 CHECKS=19540800	SAT TT=302.926 ASSIGNMENTS=61251 CHECKS=104121000	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=121.893 ASSIGNMENTS=39827 CHECKS=106420000	SAT TT=31.339 ASSIGNMENTS=10392 CHECKS=26664300	? (TO) TT=1800	SAT TT=218.832 ASSIGNMENTS=75323 CHECKS=177307000	SAT TT=22.069 ASSIGNMENTS=6131 CHECKS=19540800	? (MO) TT=32.699	? (MO) TT=6.03	? (TO) TT=1800.07
csp/wordsHerald/ normalized-crossword-m1-words-23-07.xml	SAT TT=3.82	SAT TT=12.955 CHECKS=2664720 NODES=2396	SAT TT=11.567 CHECKS=1423230 NODES=1736	? (TO) TT=1800.1	SAT TT=85.248 CHECKS=8815670	SAT TT=147.809 CHECKS=20175000	SAT TT=47.977 ASSIGNMENTS=348	? (TO) TT=1800.16	SAT TT=956.227 CHECKS=5250500000 NODES=1854	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=12.53 ASSIGNMENTS=1070 CHECKS=3017620	SAT TT=19.733 ASSIGNMENTS=2396 CHECKS=2664720	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=5.745 ASSIGNMENTS=1441 CHECKS=4922340	SAT TT=35.52 ASSIGNMENTS=10083 CHECKS=29737000	SAT TT=82.735	SAT TT=363.073 ASSIGNMENTS=127404 CHECKS=333911000	SAT TT=3.82 ASSIGNMENTS=1070 CHECKS=3017620	? (MO) TT=37.759	? (TO) TT=1800.1	? (TO) TT=1800.02
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle04.xml	SAT TT=0.026	SAT TT=0.813 CHECKS=2050 NODES=19	SAT TT=0.899 CHECKS=4427 NODES=20	SAT TT=1.706	SAT TT=0.283 CHECKS=1719	SAT TT=0.221 CHECKS=1413	SAT TT=1.253 ASSIGNMENTS=64	SAT TT=1.274 ASSIGNMENTS=15	SAT TT=135.292 CHECKS=7367150 NODES=20	SAT TT=80.531 CHECKS=78564900 NODES=88050000	? (TO) TT=1800.03	SAT TT=0.38 ASSIGNMENTS=1135 CHECKS=99727	SAT TT=0.381 ASSIGNMENTS=1135 CHECKS=99727	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=0.442 ASSIGNMENTS=1541 CHECKS=130648	SAT TT=0.026 ASSIGNMENTS=22 CHECKS=1452	SAT TT=0.635	SAT TT=0.042 ASSIGNMENTS=81 CHECKS=4996	SAT TT=0.031 ASSIGNMENTS=54 CHECKS=3932	? (MO) TT=43.125	SAT TT=3.303	SAT TT=3.833
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle06.xml	SAT TT=0.048	SAT TT=0.859 CHECKS=2857 NODES=23	SAT TT=0.868 CHECKS=1829 NODES=0	SAT TT=3.158	SAT TT=0.393 CHECKS=2232	SAT TT=0.463 CHECKS=3371	SAT TT=74.566 ASSIGNMENTS=13092	SAT TT=1.329 ASSIGNMENTS=13	SAT TT=90.101 CHECKS=15202600 NODES=26	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=1.318 ASSIGNMENTS=2060 CHECKS=373853	SAT TT=1.317 ASSIGNMENTS=2060 CHECKS=373853	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=5.777 ASSIGNMENTS=7762 CHECKS=1552520	SAT TT=0.524 ASSIGNMENTS=1564 CHECKS=154848	SAT TT=0.911	SAT TT=0.048 ASSIGNMENTS=86 CHECKS=9906	SAT TT=0.049 ASSIGNMENTS=118 CHECKS=11436	? (MO) TT=38.2	SAT TT=7.422	SAT TT=7.228
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle08.xml	SAT TT=0.045	SAT TT=1.162 CHECKS=12830 NODES=41	SAT TT=1.053 CHECKS=23376 NODES=42	SAT TT=1341.66	SAT TT=0.573 CHECKS=4576	SAT TT=0.493 CHECKS=5474	SAT TT=2.028 ASSIGNMENTS=26	SAT TT=2.106 ASSIGNMENTS=21	SAT TT=130.198 CHECKS=496657 NODES=44	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=0.058 ASSIGNMENTS=21 CHECKS=2877	SAT TT=0.059 ASSIGNMENTS=21 CHECKS=2877	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=0.045 ASSIGNMENTS=21 CHECKS=2877	SAT TT=0.713 ASSIGNMENTS=1177 CHECKS=243683	SAT TT=1.369	SAT TT=0.145 ASSIGNMENTS=200 CHECKS=32984	SAT TT=0.11 ASSIGNMENTS=81 CHECKS=25054	? (TO) TT=1800.18	SAT TT=29.779	SAT TT=32.801
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle09.xml	SAT TT=0.102	SAT TT=0.931 CHECKS=3535 NODES=35	SAT TT=1.035 CHECKS=10310 NODES=35	SAT TT=4.895	SAT TT=1.015 CHECKS=10238	SAT TT=1.028 CHECKS=10000	SAT TT=14.927 ASSIGNMENTS=887	SAT TT=2.256 ASSIGNMENTS=17	SAT TT=123.789 CHECKS=10306000 NODES=43	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=1.424 ASSIGNMENTS=956 CHECKS=308392	SAT TT=1.333 ASSIGNMENTS=956 CHECKS=308392	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=0.721 ASSIGNMENTS=755 CHECKS=242690	SAT TT=4.18 ASSIGNMENTS=4929 CHECKS=831056	SAT TT=1.339	SAT TT=0.264 ASSIGNMENTS=285 CHECKS=51922	SAT TT=0.102 ASSIGNMENTS=87 CHECKS=19959	? (MO) TT=37.533	SAT TT=33.757	SAT TT=38.675
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle10.xml	SAT TT=0.048	SAT TT=1.04 CHECKS=17681 NODES=44	SAT TT=1.042 CHECKS=17274 NODES=0	SAT TT=2.513	SAT TT=0.894 CHECKS=11376	SAT TT=0.636 CHECKS=9131	SAT TT=2.414 ASSIGNMENTS=17	SAT TT=2.371 ASSIGNMENTS=17	SAT TT=122.034 CHECKS=162704 NODES=40	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=0.06 ASSIGNMENTS=21 CHECKS=5716	SAT TT=0.061 ASSIGNMENTS=21 CHECKS=5716	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=0.048 ASSIGNMENTS=21 CHECKS=5716	SAT TT=3.757 ASSIGNMENTS=11337 CHECKS=1799110	SAT TT=2.52	SAT TT=0.178 ASSIGNMENTS=221 CHECKS=63884	SAT TT=0.051 ASSIGNMENTS=22 CHECKS=6151	? (TO) TT=1800.11	SAT TT=35.548	SAT TT=44.014
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle13.xml	SAT TT=0.067	SAT TT=1.285 CHECKS=37184 NODES=66	SAT TT=1.538 CHECKS=68604 NODES=66	SAT TT=3.583	SAT TT=1.071 CHECKS=18237	SAT TT=2.715 CHECKS=83837	SAT TT=3.444 ASSIGNMENTS=29	SAT TT=4.114 ASSIGNMENTS=25	SAT TT=130.187 CHECKS=2597130 NODES=69	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.08 ASSIGNMENTS=35 CHECKS=14078	SAT TT=0.078 ASSIGNMENTS=35 CHECKS=14078	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=0.068 ASSIGNMENTS=35 CHECKS=14078	SAT TT=4.562 ASSIGNMENTS=11962 CHECKS=4015900	SAT TT=1.985	SAT TT=1.105 ASSIGNMENTS=1685 CHECKS=776283	SAT TT=0.067 ASSIGNMENTS=34 CHECKS=14008	? (TO) TT=1802.2	SAT TT=36.178	SAT TT=45.008
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle14.xml	SAT TT=0.342	SAT TT=1.311 CHECKS=12479 NODES=67	SAT TT=1.287 CHECKS=25830 NODES=62	SAT TT=44.41	SAT TT=1.629 CHECKS=8750	SAT TT=2.681 CHECKS=24960	SAT TT=152.324 ASSIGNMENTS=9815	SAT TT=3.195 ASSIGNMENTS=26	SAT TT=139.966 CHECKS=21934100 NODES=66	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=162.135 ASSIGNMENTS=9815	SAT TT=152.612 ASSIGNMENTS=9815	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=35.039 ASSIGNMENTS=30934 CHECKS=14212700	SAT TT=7.333 ASSIGNMENTS=7491 CHECKS=2518680	SAT TT=2.279	SAT TT=1.278 ASSIGNMENTS=1324 CHECKS=390392	SAT TT=0.342 ASSIGNMENTS=316 CHECKS=143687	? (MO) TT=31.058	SAT TT=47.034	SAT TT=60.263
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle15.xml	SAT TT=0.08	SAT TT=1.695 CHECKS=59238 NODES=107	SAT TT=1.884 CHECKS=127940 NODES=159	SAT TT=10.715	SAT TT=3.584 CHECKS=78570	SAT TT=2.393 CHECKS=56888	SAT TT=4.623 ASSIGNMENTS=55	SAT TT=6.963 ASSIGNMENTS=52	SAT TT=132.085 CHECKS=1292310 NODES=197	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=0.091 ASSIGNMENTS=39 CHECKS=23590	SAT TT=0.09 ASSIGNMENTS=39 CHECKS=23590	? (TO) TT=1800	? (TO) TT=1800.07	SAT TT=0.08 ASSIGNMENTS=39 CHECKS=23590	SAT TT=7.902 ASSIGNMENTS=20432 CHECKS=8558900	SAT TT=2.704	SAT TT=2.038 ASSIGNMENTS=2831 CHECKS=1780010	SAT TT=0.088 ASSIGNMENTS=56 CHECKS=28723	? TT=52.103	SAT TT=24.442	SAT TT=44.505
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle16.xml	SAT TT=0.161	SAT TT=1.812 CHECKS=125604 NODES=137	SAT TT=2.364 CHECKS=251161 NODES=137	SAT TT=12.419	SAT TT=3.572 CHECKS=86776	SAT TT=2.398 CHECKS=95361	SAT TT=6.157 ASSIGNMENTS=79	SAT TT=23.059 ASSIGNMENTS=58	SAT TT=239.169 CHECKS=626844000 NODES=203	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=0.187 ASSIGNMENTS=86 CHECKS=45919	SAT TT=0.183 ASSIGNMENTS=86 CHECKS=45919	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=0.169 ASSIGNMENTS=86 CHECKS=45919	SAT TT=13.393 ASSIGNMENTS=16473 CHECKS=17541000	SAT TT=3.985	SAT TT=3.928 ASSIGNMENTS=4020 CHECKS=2634130	SAT TT=0.161 ASSIGNMENTS=77 CHECKS=42503	? (MO) TT=46.953	SAT TT=59.766	SAT TT=63.373
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle17.xml	SAT TT=0.278	SAT TT=2.903 CHECKS=344769 NODES=317	SAT TT=3.129 CHECKS=605257 NODES=342	SAT TT=16.272	SAT TT=5.747 CHECKS=113563	SAT TT=3.569 CHECKS=113563	SAT TT=10.876 ASSIGNMENTS=111	SAT TT=55.246 ASSIGNMENTS=83	SAT TT=223.522 CHECKS=535080000 NODES=303	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=0.297 ASSIGNMENTS=89 CHECKS=79736	SAT TT=0.292 ASSIGNMENTS=89 CHECKS=79736	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=0.278 ASSIGNMENTS=89 CHECKS=79736	SAT TT=26.692 ASSIGNMENTS=17414 CHECKS=29632700	? (TO) TT=1800.09	SAT TT=57.409 ASSIGNMENTS=36406 CHECKS=30307700	SAT TT=0.305 ASSIGNMENTS=124 CHECKS=98066	? TT=100.36	SAT TT=453.943	? (TO) TT=1800.06
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle18.xml	SAT TT=0.231	SAT TT=2.458 CHECKS=201114 NODES=187	SAT TT=2.912 CHECKS=345168 NODES=187	? (TO) TT=1800.1	SAT TT=40.341 CHECKS=2243140	SAT TT=3.789 CHECKS=233423	SAT TT=11.418 ASSIGNMENTS=90	SAT TT=63.201 ASSIGNMENTS=165	SAT TT=127.826 CHECKS=2479220 NODES=279	? (TO) TT=1800.05	? (TO) TT=1800	SAT TT=0.243 ASSIGNMENTS=110 CHECKS=84297	SAT TT=0.247 ASSIGNMENTS=110 CHECKS=84297	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=0.233 ASSIGNMENTS=110 CHECKS=84297	SAT TT=16.837 ASSIGNMENTS=20772 CHECKS=24590200	SAT TT=1520.13	SAT TT=90.702 ASSIGNMENTS=57346 CHECKS=46910300	SAT TT=0.231 ASSIGNMENTS=103 CHECKS=82641	? (MO) TT=64.548	SAT TT=87.269	SAT TT=517.768
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle19.xml	SAT TT=0.279	SAT TT=2.476 CHECKS=139837 NODES=338	SAT TT=2.798 CHECKS=204719 NODES=340	? (TO) TT=1800.13	SAT TT=6.689 CHECKS=158595	SAT TT=5.78 CHECKS=211835	SAT TT=12.175 ASSIGNMENTS=70	SAT TT=43.473 ASSIGNMENTS=57	SAT TT=239.318 CHECKS=870521000 NODES=360	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=0.831 ASSIGNMENTS=209 CHECKS=304176	SAT TT=0.845 ASSIGNMENTS=209 CHECKS=304176	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=0.751 ASSIGNMENTS=249 CHECKS=305184	SAT TT=21.939 ASSIGNMENTS=18024 CHECKS=20727600	? (TO) TT=1800.09	SAT TT=31.91 ASSIGNMENTS=17863 CHECKS=13366500	SAT TT=0.279 ASSIGNMENTS=85 CHECKS=69863	? (MO) TT=41.617	SAT TT=561.941	? (TO) TT=1800.05
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle20.xml	SAT TT=0.124	SAT TT=1.091 CHECKS=6921 NODES=53	SAT TT=1.136 CHECKS=14969 NODES=53	SAT TT=29.463	SAT TT=1.233 CHECKS=6491	SAT TT=1.299 CHECKS=7544	SAT TT=6.287 ASSIGNMENTS=543	SAT TT=2.689 ASSIGNMENTS=24	SAT TT=139.521 CHECKS=19814900 NODES=74	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=13.121 ASSIGNMENTS=543	SAT TT=13.857 ASSIGNMENTS=543	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=3.392 ASSIGNMENTS=3790 CHECKS=1634580	SAT TT=5.522 ASSIGNMENTS=6902 CHECKS=1603950	SAT TT=1.6	SAT TT=0.623 ASSIGNMENTS=659 CHECKS=164502	SAT TT=0.124 ASSIGNMENTS=215 CHECKS=43627	? (MO) TT=35.984	SAT TT=44.694	SAT TT=47.547
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle21.xml	SAT TT=0.121	SAT TT=1.848 CHECKS=104321 NODES=133	SAT TT=1.999 CHECKS=190961 NODES=132	SAT TT=8.471	SAT TT=7.255 CHECKS=215628	SAT TT=6.795 CHECKS=256717	SAT TT=5.875 ASSIGNMENTS=70	SAT TT=18.171 ASSIGNMENTS=60	SAT TT=278.965 CHECKS=867019000 NODES=168	? (TO) TT=1800.01	? (TO) TT=1800	SAT TT=0.133 ASSIGNMENTS=66 CHECKS=40534	SAT TT=0.146 ASSIGNMENTS=66 CHECKS=40534	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=0.121 ASSIGNMENTS=66 CHECKS=40534	SAT TT=8.903 ASSIGNMENTS=16160 CHECKS=10297800	? (TO) TT=1800.01	SAT TT=3.343 ASSIGNMENTS=3938 CHECKS=2227030	SAT TT=0.132 ASSIGNMENTS=72 CHECKS=37999	? (MO) TT=40.571	SAT TT=79.779	SAT TT=74.871
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle22.xml	SAT TT=0.169	SAT TT=3.626 CHECKS=724469 NODES=925	SAT TT=3.858 CHECKS=756368 NODES=758	? (TO) TT=1800.12	SAT TT=44.584 CHECKS=2875320	SAT TT=8.701 CHECKS=636622	SAT TT=11.511 ASSIGNMENTS=67	SAT TT=406.519 ASSIGNMENTS=64957	SAT TT=132.266 CHECKS=8054480 NODES=193	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=0.174 ASSIGNMENTS=84 CHECKS=92978	SAT TT=0.169 ASSIGNMENTS=84 CHECKS=92978	? (TO) TT=1800.06	? (TO) TT=1800	SAT TT=0.176 ASSIGNMENTS=104 CHECKS=113613	SAT TT=11.646 ASSIGNMENTS=9766 CHECKS=10421400	SAT TT=6.404	SAT TT=5.63 ASSIGNMENTS=3504 CHECKS=4149620	SAT TT=13.742 ASSIGNMENTS=7949 CHECKS=12476300	? (MO) TT=36.573	SAT TT=50.268	SAT TT=210.122

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	156	155	84	151	153	136	147	32	27	157	155	154	155	152	156	3	99	86
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	156	155	84	151	153	136	147	32	27	157	155	154	155	152	156	3	99	86
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	1	3	0	0	2	0	0	0	0	9	10	40	8	19	66	0	0	0
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0