CSP 2008 Competition: results by benchmark

Results by benchmark for category n-ary constraints in extension (N-ARY-EXT), subcategory real world problems

This page displays the results of the different solvers for each benchmark for category n-ary constraints in extension (N-ARY-EXT), subcategory real world problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
mddc-solv 2008-06-09
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
spider 2008-06-14
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg10-11_ext.xml	UNSAT TT=1.55	UNSAT TT=1.701 CHECKS=0 NODES=221	UNSAT TT=3.236 CHECKS=0 NODES=209	? (TO) TT=1800.09	UNSAT TT=41.101 CHECKS=112511	UNSAT TT=17.807 CHECKS=43417	UNSAT TT=20.787 ASSIGNMENTS=0	UNSAT TT=22.258 ASSIGNMENTS=0	UNSAT TT=2.762 CHECKS=0 NODES=368	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=9.329 ASSIGNMENTS=221 CHECKS=0	UNSAT TT=9.026 ASSIGNMENTS=221 CHECKS=0	UNSAT TT=64.248	UNSAT TT=51.21	UNSAT TT=4.342 CHECKS=36205	UNSAT TT=1.55 ASSIGNMENTS=206 CHECKS=41245	UNSAT TT=18.017 ASSIGNMENTS=3472 CHECKS=462122	UNSAT TT=14.413	UNSAT TT=7.462 ASSIGNMENTS=1645 CHECKS=197688	UNSAT TT=1.631 ASSIGNMENTS=238 CHECKS=43669	? TT=31.591	? (TO) TT=1800.08	UNSAT TT=181.014	? (TO) TT=1800
csp/lexVg/ normalized-crossword-m1c-lex-vg10-12_ext.xml	UNSAT TT=0.371	UNSAT TT=0.943 CHECKS=0 NODES=58	UNSAT TT=1.906 CHECKS=0 NODES=0	? (TO) TT=1800.08	UNSAT TT=9.712 CHECKS=26649	UNSAT TT=8.838 CHECKS=24132	UNSAT TT=4.181 ASSIGNMENTS=0	UNSAT TT=4.548 ASSIGNMENTS=0	UNSAT TT=1.055 CHECKS=0 NODES=74	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=0.421 ASSIGNMENTS=60 CHECKS=9481	UNSAT TT=0.422 ASSIGNMENTS=60 CHECKS=9481	UNSAT TT=34.658	UNSAT TT=27.653	UNSAT TT=0.957 CHECKS=6723	UNSAT TT=0.4 ASSIGNMENTS=60 CHECKS=9433	UNSAT TT=15.501 ASSIGNMENTS=3172 CHECKS=436031	UNSAT TT=7.774	UNSAT TT=1.35 ASSIGNMENTS=279 CHECKS=37352	UNSAT TT=0.371 ASSIGNMENTS=60 CHECKS=9481	? TT=32.877	? (TO) TT=1800.11	UNSAT TT=88.589	UNSAT TT=149.832
csp/lexVg/ normalized-crossword-m1c-lex-vg11-12_ext.xml	UNSAT TT=0.214	UNSAT TT=0.836 CHECKS=0 NODES=23	UNSAT TT=0.877 CHECKS=0 NODES=0	? (TO) TT=1800.14	UNSAT TT=3.369 CHECKS=9260	UNSAT TT=3.622 CHECKS=9134	UNSAT TT=1.993 ASSIGNMENTS=0	UNSAT TT=2.337 ASSIGNMENTS=0	UNSAT TT=0.81 CHECKS=0 NODES=27	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.36 ASSIGNMENTS=40 CHECKS=8217	UNSAT TT=0.338 ASSIGNMENTS=40 CHECKS=8217	UNSAT TT=19.154	UNSAT TT=14.674	UNSAT TT=0.378 CHECKS=2811	UNSAT TT=0.214 ASSIGNMENTS=29 CHECKS=5256	UNSAT TT=1.682 ASSIGNMENTS=343 CHECKS=45212	UNSAT TT=2.263	UNSAT TT=0.422 ASSIGNMENTS=72 CHECKS=10791	UNSAT TT=0.32 ASSIGNMENTS=40 CHECKS=8217	? TT=32.237	? (TO) TT=1800.02	UNSAT TT=51.717	UNSAT TT=60.992
csp/lexVg/ normalized-crossword-m1c-lex-vg11-13_ext.xml	UNSAT TT=0.09	UNSAT TT=0.776 CHECKS=0 NODES=7	UNSAT TT=0.829 CHECKS=0 NODES=0	UNSAT TT=223.836	UNSAT TT=0.656 CHECKS=1168	UNSAT TT=0.883 CHECKS=1644	UNSAT TT=0.792 ASSIGNMENTS=0	UNSAT TT=0.698 ASSIGNMENTS=0	UNSAT TT=0.542 CHECKS=0 NODES=7	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.096 ASSIGNMENTS=6 CHECKS=1652	UNSAT TT=0.1 ASSIGNMENTS=6 CHECKS=1652	UNSAT TT=14.086	UNSAT TT=10.75	UNSAT TT=0.175 CHECKS=967	UNSAT TT=0.09 ASSIGNMENTS=6 CHECKS=1652	UNSAT TT=0.118 ASSIGNMENTS=15 CHECKS=2242	UNSAT TT=1.197	UNSAT TT=0.114 ASSIGNMENTS=15 CHECKS=2098	UNSAT TT=0.09 ASSIGNMENTS=6 CHECKS=1652	? TT=33.724	? (TO) TT=1800.01	UNSAT TT=35.674	UNSAT TT=575.879
csp/lexVg/ normalized-crossword-m1c-lex-vg11-15_ext.xml	UNSAT TT=0.019	UNSAT TT=0.741 CHECKS=0 NODES=0	UNSAT TT=0.795 CHECKS=0 NODES=0	UNSAT TT=20.418	UNSAT TT=0.248 CHECKS=41	UNSAT TT=0.243 CHECKS=41	UNSAT TT=0.481 ASSIGNMENTS=0	UNSAT TT=0.456 ASSIGNMENTS=0	UNSAT TT=0.467 CHECKS=0 NODES=0	UNSAT TT=0.453 CHECKS=0 NODES=0	UNSAT TT=0.431 CHECKS=0 NODES=0	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=11.872	UNSAT TT=9.553	UNSAT TT=0.06 CHECKS=151	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=1.053	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=12	? TT=34.5	? (TO) TT=1800.08	UNSAT TT=34.783	UNSAT TT=47.764
csp/lexVg/ normalized-crossword-m1c-lex-vg12-12_ext.xml	UNSAT TT=0.085	UNSAT TT=0.835 CHECKS=0 NODES=8	UNSAT TT=0.786 CHECKS=0 NODES=0	UNSAT TT=279.771	UNSAT TT=1.212 CHECKS=3480	UNSAT TT=1.121 CHECKS=3878	UNSAT TT=0.88 ASSIGNMENTS=0	UNSAT TT=0.967 ASSIGNMENTS=0	UNSAT TT=0.499 CHECKS=0 NODES=11	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.104 ASSIGNMENTS=11 CHECKS=1916	UNSAT TT=0.103 ASSIGNMENTS=11 CHECKS=1916	UNSAT TT=12.92	UNSAT TT=10.64	UNSAT TT=0.121 CHECKS=1037	UNSAT TT=0.085 ASSIGNMENTS=8 CHECKS=1469	UNSAT TT=0.221 ASSIGNMENTS=38 CHECKS=4969	UNSAT TT=1.154	UNSAT TT=0.153 ASSIGNMENTS=20 CHECKS=3565	UNSAT TT=0.094 ASSIGNMENTS=11 CHECKS=1916	? TT=57.464	? (TO) TT=1800.05	UNSAT TT=38.436	? (TO) TT=1800.04
csp/lexVg/ normalized-crossword-m1c-lex-vg12-13_ext.xml	UNSAT TT=0.031	UNSAT TT=0.754 CHECKS=0 NODES=0	UNSAT TT=0.788 CHECKS=0 NODES=0	UNSAT TT=122.654	UNSAT TT=0.192 CHECKS=66	UNSAT TT=0.187 CHECKS=66	UNSAT TT=0.613 ASSIGNMENTS=0	UNSAT TT=0.575 ASSIGNMENTS=0	UNSAT TT=0.605 CHECKS=0 NODES=0	UNSAT TT=0.453 CHECKS=0 NODES=0	UNSAT TT=0.629 CHECKS=0 NODES=0	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=10.486	UNSAT TT=8.251	UNSAT TT=0.054 CHECKS=223	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=1.028	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=104	? TT=54.929	? (TO) TT=1800.05	UNSAT TT=21.316	UNSAT TT=287.535
csp/lexVg/ normalized-crossword-m1c-lex-vg12-14_ext.xml	UNSAT TT=0.027	UNSAT TT=0.793 CHECKS=0 NODES=0	UNSAT TT=0.91 CHECKS=0 NODES=0	UNSAT TT=52.102	UNSAT TT=0.172 CHECKS=51	UNSAT TT=0.173 CHECKS=51	UNSAT TT=0.48 ASSIGNMENTS=0	UNSAT TT=0.549 ASSIGNMENTS=0	UNSAT TT=0.517 CHECKS=0 NODES=0	UNSAT TT=0.447 CHECKS=0 NODES=0	UNSAT TT=0.437 CHECKS=0 NODES=0	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=8.512	UNSAT TT=7.711	UNSAT TT=0.044 CHECKS=159	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.846	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=55	? TT=53.509	? (TO) TT=1800.04	UNSAT TT=18.139	UNSAT TT=39.923
csp/lexVg/ normalized-crossword-m1c-lex-vg13-13_ext.xml	UNSAT TT=0.026	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=0.762 CHECKS=0 NODES=0	UNSAT TT=66.948	UNSAT TT=0.168 CHECKS=82	UNSAT TT=0.168 CHECKS=82	UNSAT TT=0.442 ASSIGNMENTS=0	UNSAT TT=0.47 ASSIGNMENTS=0	UNSAT TT=0.386 CHECKS=0 NODES=0	UNSAT TT=0.393 CHECKS=0 NODES=0	UNSAT TT=0.439 CHECKS=0 NODES=0	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=7.706	UNSAT TT=6.444	UNSAT TT=0.034 CHECKS=218	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.719	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=53	? TT=53.693	? (TO) TT=1800.08	UNSAT TT=13.599	UNSAT TT=42.119
csp/lexVg/ normalized-crossword-m1c-lex-vg13-15_ext.xml	UNSAT TT=0.019	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=0.743 CHECKS=0 NODES=0	UNSAT TT=8.3	UNSAT TT=0.085 CHECKS=29	UNSAT TT=0.085 CHECKS=29	UNSAT TT=0.53 ASSIGNMENTS=0	UNSAT TT=0.53 ASSIGNMENTS=0	UNSAT TT=0.423 CHECKS=0 NODES=0	UNSAT TT=0.422 CHECKS=0 NODES=0	UNSAT TT=0.419 CHECKS=0 NODES=0	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=6.26	UNSAT TT=5.443	UNSAT TT=0.032 CHECKS=65	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.623	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=14	? TT=51.591	? (TO) TT=1800.07	UNSAT TT=7.693	UNSAT TT=12.517
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg13-16_ext.xml	UNSAT TT=0.017	UNSAT TT=0.723 CHECKS=0 NODES=0	UNSAT TT=0.8 CHECKS=0 NODES=0	UNSAT TT=8.962	UNSAT TT=0.087 CHECKS=29	UNSAT TT=0.085 CHECKS=29	UNSAT TT=0.48 ASSIGNMENTS=0	UNSAT TT=0.433 ASSIGNMENTS=0	UNSAT TT=0.378 CHECKS=0 NODES=0	UNSAT TT=0.377 CHECKS=0 NODES=0	UNSAT TT=0.376 CHECKS=0 NODES=0	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=5.637	UNSAT TT=5.237	UNSAT TT=0.026 CHECKS=82	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.629	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=14	? TT=62.107	? (TO) TT=1800.04	UNSAT TT=7.926	UNSAT TT=12.638
csp/lexVg/ normalized-crossword-m1c-lex-vg13-17_ext.xml	UNSAT TT=0.016	UNSAT TT=0.771 CHECKS=0 NODES=0	UNSAT TT=0.765 CHECKS=0 NODES=0	UNSAT TT=6.71	UNSAT TT=0.09 CHECKS=30	UNSAT TT=0.084 CHECKS=30	UNSAT TT=0.455 ASSIGNMENTS=0	UNSAT TT=0.427 ASSIGNMENTS=0	UNSAT TT=0.402 CHECKS=0 NODES=0	UNSAT TT=0.374 CHECKS=0 NODES=0	UNSAT TT=0.492 CHECKS=0 NODES=0	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=5.989	UNSAT TT=5.188	UNSAT TT=0.025 CHECKS=55	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.599	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=14	? TT=57.387	? (TO) TT=1800.03	UNSAT TT=8.143	UNSAT TT=11.668
csp/lexVg/ normalized-crossword-m1c-lex-vg14-15_ext.xml	UNSAT TT=0.019	UNSAT TT=0.75 CHECKS=0 NODES=0	UNSAT TT=0.793 CHECKS=0 NODES=0	UNSAT TT=4.283	UNSAT TT=0.056 CHECKS=29	UNSAT TT=0.056 CHECKS=29	UNSAT TT=0.471 ASSIGNMENTS=0	UNSAT TT=0.566 ASSIGNMENTS=0	UNSAT TT=0.455 CHECKS=0 NODES=0	UNSAT TT=0.376 CHECKS=0 NODES=0	UNSAT TT=0.392 CHECKS=0 NODES=0	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=4.316	UNSAT TT=4.034	UNSAT TT=0.025 CHECKS=98	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.547	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=15	? (exit code) TT=88.171	? (TO) TT=1800.11	UNSAT TT=5.422	UNSAT TT=6.838
csp/lexVg/ normalized-crossword-m1c-lex-vg14-18_ext.xml	UNSAT TT=0.015	UNSAT TT=0.973 CHECKS=0 NODES=0	UNSAT TT=0.846 CHECKS=0 NODES=0	UNSAT TT=4.796	UNSAT TT=0.061 CHECKS=19	UNSAT TT=0.06 CHECKS=19	UNSAT TT=0.428 ASSIGNMENTS=0	UNSAT TT=0.464 ASSIGNMENTS=0	UNSAT TT=0.421 CHECKS=0 NODES=0	UNSAT TT=0.471 CHECKS=0 NODES=0	UNSAT TT=0.386 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=4.282	UNSAT TT=4.096	UNSAT TT=0.025 CHECKS=30	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.513	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=15	? TT=101.027	? (TO) TT=1800.08	UNSAT TT=4.127	UNSAT TT=6.515
csp/lexVg/ normalized-crossword-m1c-lex-vg15-16_ext.xml	UNSAT TT=0.019	UNSAT TT=0.792 CHECKS=0 NODES=0	UNSAT TT=0.797 CHECKS=0 NODES=0	UNSAT TT=1.342	UNSAT TT=0.034 CHECKS=17	UNSAT TT=0.034 CHECKS=17	UNSAT TT=0.422 ASSIGNMENTS=0	UNSAT TT=0.46 ASSIGNMENTS=0	UNSAT TT=0.371 CHECKS=0 NODES=0	UNSAT TT=0.366 CHECKS=0 NODES=0	UNSAT TT=0.381 CHECKS=0 NODES=0	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=3.638	UNSAT TT=3.334	UNSAT TT=0.023 CHECKS=50	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.476	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=16	? (exit code) TT=82.514	? (TO) TT=1800.02	UNSAT TT=2.36	UNSAT TT=3.774
csp/lexVg/ normalized-crossword-m1c-lex-vg15-17_ext.xml	UNSAT TT=0.016	UNSAT TT=0.748 CHECKS=0 NODES=0	UNSAT TT=0.731 CHECKS=0 NODES=0	UNSAT TT=1.411	UNSAT TT=0.031 CHECKS=18	UNSAT TT=0.029 CHECKS=18	UNSAT TT=0.481 ASSIGNMENTS=0	UNSAT TT=0.443 ASSIGNMENTS=0	UNSAT TT=0.375 CHECKS=0 NODES=0	UNSAT TT=0.359 CHECKS=0 NODES=0	UNSAT TT=0.371 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=3.47	UNSAT TT=2.961	UNSAT TT=0.021 CHECKS=24	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.423	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	? TT=81.753	? (TO) TT=1800.02	UNSAT TT=2.196	UNSAT TT=3.076
csp/lexVg/ normalized-crossword-m1c-lex-vg15-18_ext.xml	UNSAT TT=0.014	UNSAT TT=0.727 CHECKS=0 NODES=0	UNSAT TT=0.832 CHECKS=0 NODES=0	UNSAT TT=1.397	UNSAT TT=0.034 CHECKS=19	UNSAT TT=0.032 CHECKS=19	UNSAT TT=0.43 ASSIGNMENTS=0	UNSAT TT=0.467 ASSIGNMENTS=0	UNSAT TT=0.401 CHECKS=0 NODES=0	UNSAT TT=0.363 CHECKS=0 NODES=0	UNSAT TT=0.347 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=3.505	UNSAT TT=3.147	UNSAT TT=0.024 CHECKS=18	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.428	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=16	? TT=85.732	? (TO) TT=1800.04	UNSAT TT=2.01	UNSAT TT=3.077
csp/lexVg/ normalized-crossword-m1c-lex-vg16-18_ext.xml	UNSAT TT=0.016	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=0.766 CHECKS=0 NODES=0	UNSAT TT=0.605	UNSAT TT=0.025 CHECKS=19	UNSAT TT=0.025 CHECKS=19	UNSAT TT=0.454 ASSIGNMENTS=0	UNSAT TT=0.444 ASSIGNMENTS=0	UNSAT TT=0.415 CHECKS=0 NODES=0	UNSAT TT=0.375 CHECKS=0 NODES=0	UNSAT TT=0.375 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=3.32	UNSAT TT=2.936	UNSAT TT=0.021 CHECKS=5	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.427	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=17	? (exit code) TT=78.15	? (TO) TT=1800.05	UNSAT TT=1.696	UNSAT TT=2.085
csp/lexVg/ normalized-crossword-m1c-lex-vg16-20_ext.xml	UNSAT TT=0.014	UNSAT TT=0.804 CHECKS=0 NODES=0	UNSAT TT=0.768 CHECKS=0 NODES=0	UNSAT TT=0.713	UNSAT TT=0.038 CHECKS=45	UNSAT TT=0.035 CHECKS=45	UNSAT TT=0.496 ASSIGNMENTS=0	UNSAT TT=0.479 ASSIGNMENTS=0	UNSAT TT=0.449 CHECKS=0 NODES=0	UNSAT TT=0.388 CHECKS=0 NODES=0	UNSAT TT=0.383 CHECKS=0 NODES=0	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=3.297	UNSAT TT=3.091	UNSAT TT=0.024 CHECKS=6	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.432	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=17	? TT=99.572	? (TO) TT=1800.05	UNSAT TT=1.466	UNSAT TT=2.051
csp/lexVg/ normalized-crossword-m1c-lex-vg4-5_ext.xml	SAT TT=0.017	SAT TT=0.731 CHECKS=34 NODES=28	SAT TT=0.743 CHECKS=9 NODES=21	SAT TT=2.39	SAT TT=0.247 CHECKS=601	SAT TT=0.191 CHECKS=446	SAT TT=0.906 ASSIGNMENTS=11	SAT TT=0.952 ASSIGNMENTS=10	SAT TT=16.223 CHECKS=11747400 NODES=22	SAT TT=1386.18 CHECKS=8572600000 NODES=-33934500	? (TO) TT=1800.1	SAT TT=0.03 ASSIGNMENTS=7 CHECKS=192	SAT TT=0.03 ASSIGNMENTS=7 CHECKS=192	SAT TT=12.305	SAT TT=15.472	SAT TT=0.036 CHECKS=101	SAT TT=0.018 ASSIGNMENTS=7 CHECKS=192	SAT TT=0.021 ASSIGNMENTS=13 CHECKS=466	SAT TT=0.59	SAT TT=0.032 ASSIGNMENTS=55 CHECKS=1527	SAT TT=0.017 ASSIGNMENTS=7 CHECKS=192	? (MO) TT=33.132	SAT TT=0.489 ASSIGNMENTS=28 CHECKS=2552530	SAT TT=4.352	SAT TT=4.706
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg4-6_ext.xml	SAT TT=0.048	SAT TT=0.899 CHECKS=101 NODES=156	SAT TT=0.862 CHECKS=126 NODES=148	SAT TT=2.814	SAT TT=4.063 CHECKS=28721	SAT TT=0.533 CHECKS=2652	SAT TT=1.382 ASSIGNMENTS=28	SAT TT=1.266 ASSIGNMENTS=11	SAT TT=143.507 CHECKS=395229000 NODES=31	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=0.283 ASSIGNMENTS=359 CHECKS=17565	SAT TT=0.302 ASSIGNMENTS=359 CHECKS=17565	SAT TT=11.639	SAT TT=117.246	SAT TT=0.048 CHECKS=218	SAT TT=0.215 ASSIGNMENTS=233 CHECKS=12157	SAT TT=0.077 ASSIGNMENTS=85 CHECKS=3461	SAT TT=0.749	SAT TT=0.395 ASSIGNMENTS=568 CHECKS=22976	SAT TT=0.288 ASSIGNMENTS=359 CHECKS=17565	? TT=89.73	SAT TT=0.511 ASSIGNMENTS=43 CHECKS=767573	SAT TT=10.841	SAT TT=18.813
csp/lexVg/ normalized-crossword-m1c-lex-vg4-8_ext.xml	SAT TT=6	SAT TT=7.02 CHECKS=17728 NODES=12539	SAT TT=8.65 CHECKS=21002 NODES=14447	? (TO) TT=1800.09	SAT TT=103.668 CHECKS=435754	SAT TT=442.774 CHECKS=2678410	SAT TT=156.672 ASSIGNMENTS=18790	SAT TT=43.101 ASSIGNMENTS=3021	SAT TT=6 CHECKS=62294500 NODES=2113	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=13.961 ASSIGNMENTS=12539 CHECKS=17728	SAT TT=14.033 ASSIGNMENTS=12539 CHECKS=17728	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=27.041 CHECKS=1314950	SAT TT=13.482 ASSIGNMENTS=8925 CHECKS=712766	SAT TT=10.905 ASSIGNMENTS=7987 CHECKS=576957	SAT TT=31.701	SAT TT=52.702 ASSIGNMENTS=33893 CHECKS=2879500	SAT TT=15.466 ASSIGNMENTS=10304 CHECKS=850296	? TT=89.115	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.14
csp/lexVg/ normalized-crossword-m1c-lex-vg5-5_ext.xml	SAT TT=0.02	SAT TT=0.9 CHECKS=41 NODES=40	SAT TT=0.894 CHECKS=11 NODES=0	SAT TT=3.518	SAT TT=0.396 CHECKS=1194	SAT TT=0.397 CHECKS=1131	SAT TT=1.257 ASSIGNMENTS=13	SAT TT=1.385 ASSIGNMENTS=32	SAT TT=39.172 CHECKS=28272600 NODES=25	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=0.03 ASSIGNMENTS=16 CHECKS=616	SAT TT=0.032 ASSIGNMENTS=16 CHECKS=616	SAT TT=16.753	SAT TT=7.432	SAT TT=0.044 CHECKS=1636	SAT TT=0.02 ASSIGNMENTS=16 CHECKS=572	SAT TT=0.015 ASSIGNMENTS=7 CHECKS=202	SAT TT=0.808	SAT TT=0.036 ASSIGNMENTS=41 CHECKS=1426	SAT TT=0.021 ASSIGNMENTS=16 CHECKS=616	? (MO) TT=33.176	SAT TT=0.965 ASSIGNMENTS=50 CHECKS=5442460	SAT TT=7.881	SAT TT=10.453
csp/lexVg/ normalized-crossword-m1c-lex-vg5-6_ext.xml	SAT TT=5.481	SAT TT=14.966 CHECKS=67154 NODES=34824	SAT TT=7.608 CHECKS=27230 NODES=18004	SAT TT=1434.67	SAT TT=288.28 CHECKS=1413740	SAT TT=511.806 CHECKS=2788560	SAT TT=60.654 ASSIGNMENTS=6073	SAT TT=38.659 ASSIGNMENTS=2881	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=21.738 ASSIGNMENTS=34824 CHECKS=67154	SAT TT=20.968 ASSIGNMENTS=34824 CHECKS=67154	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=5.481 CHECKS=300900	SAT TT=39.486 ASSIGNMENTS=31273 CHECKS=2360280	SAT TT=10.026 ASSIGNMENTS=8886 CHECKS=578393	SAT TT=131.506	SAT TT=24.026 ASSIGNMENTS=18289 CHECKS=1333380	SAT TT=31.575 ASSIGNMENTS=23984 CHECKS=1805910	? (MO) TT=33.896	SAT TT=1169.48 ASSIGNMENTS=919 CHECKS=25025400	SAT TT=388.49	SAT TT=100.415
csp/lexVg/ normalized-crossword-m1c-lex-vg5-7_ext.xml	UNSAT TT=113.01	UNSAT TT=113.01 CHECKS=553586 NODES=217904	UNSAT TT=121.249 CHECKS=555619 NODES=222056	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=1042.07 ASSIGNMENTS=86032	UNSAT TT=1353.24 ASSIGNMENTS=73497	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=116.863 ASSIGNMENTS=217904 CHECKS=553586	UNSAT TT=116.706 ASSIGNMENTS=217904 CHECKS=553586	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=248.753 CHECKS=10004200	UNSAT TT=230.921 ASSIGNMENTS=134726 CHECKS=11781500	UNSAT TT=273.408 ASSIGNMENTS=155190 CHECKS=13480400	UNSAT TT=1468.67	UNSAT TT=294.211 ASSIGNMENTS=162921 CHECKS=14358100	UNSAT TT=275.054 ASSIGNMENTS=149956 CHECKS=13027900	? (MO) TT=36.928	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.13
csp/lexVg/ normalized-crossword-m1c-lex-vg5-8_ext.xml	UNSAT TT=54.047	UNSAT TT=54.047 CHECKS=177197 NODES=79365	UNSAT TT=73.236 CHECKS=192182 NODES=96226	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=463.75 ASSIGNMENTS=37211	UNSAT TT=525.961 ASSIGNMENTS=27337	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=61.254 ASSIGNMENTS=79365 CHECKS=177197	UNSAT TT=61.763 ASSIGNMENTS=79365 CHECKS=177197	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=111.967 CHECKS=4011410	UNSAT TT=149.995 ASSIGNMENTS=66894 CHECKS=6523850	UNSAT TT=128.855 ASSIGNMENTS=59690 CHECKS=5669970	UNSAT TT=785.589	UNSAT TT=132.879 ASSIGNMENTS=59941 CHECKS=5923160	UNSAT TT=141.269 ASSIGNMENTS=68671 CHECKS=6687120	? (MO) TT=31.666	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.11
csp/lexVg/ normalized-crossword-m1c-lex-vg5-9_ext.xml	UNSAT TT=24.422	UNSAT TT=26.015 CHECKS=39642 NODES=26821	UNSAT TT=24.422 CHECKS=45677 NODES=26632	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=681.814 CHECKS=2370920	UNSAT TT=99.853 ASSIGNMENTS=6430	UNSAT TT=227.732 ASSIGNMENTS=9209	UNSAT TT=1471.33 CHECKS=19400100000 NODES=32922	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=31.488 ASSIGNMENTS=26821 CHECKS=39642	UNSAT TT=31.45 ASSIGNMENTS=26821 CHECKS=39642	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=73.371 CHECKS=2175040	UNSAT TT=39.676 ASSIGNMENTS=16104 CHECKS=1751530	UNSAT TT=41.817 ASSIGNMENTS=17833 CHECKS=1817980	UNSAT TT=425.674	UNSAT TT=55.295 ASSIGNMENTS=21432 CHECKS=2264480	UNSAT TT=42.57 ASSIGNMENTS=16042 CHECKS=1744540	? (MO) TT=32.274	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08
csp/lexVg/ normalized-crossword-m1c-lex-vg6-10_ext.xml	UNSAT TT=9.73	UNSAT TT=11.104 CHECKS=8326 NODES=6470	UNSAT TT=9.73 CHECKS=7068 NODES=5945	? (TO) TT=1800.11	UNSAT TT=253.363 CHECKS=685443	UNSAT TT=189.733 CHECKS=560726	UNSAT TT=44.96 ASSIGNMENTS=1818	UNSAT TT=170.455 ASSIGNMENTS=4764	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=18.029 ASSIGNMENTS=6470 CHECKS=8326	UNSAT TT=18.838 ASSIGNMENTS=6470 CHECKS=8326	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=28.994 CHECKS=407705	UNSAT TT=16.8 ASSIGNMENTS=4326 CHECKS=580228	UNSAT TT=25.002 ASSIGNMENTS=7420 CHECKS=832156	UNSAT TT=137.664	UNSAT TT=16.611 ASSIGNMENTS=4523 CHECKS=562966	UNSAT TT=17.585 ASSIGNMENTS=4497 CHECKS=604233	? TT=70.152	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.02
csp/lexVg/ normalized-crossword-m1c-lex-vg6-6_ext.xml	SAT TT=0.038	SAT TT=1.792 CHECKS=1191 NODES=1338	SAT TT=2.302 CHECKS=1818 NODES=1929	? (TO) TT=1800.05	SAT TT=5.758 CHECKS=29328	SAT TT=9.541 CHECKS=51071	SAT TT=13.062 ASSIGNMENTS=741	SAT TT=16.543 ASSIGNMENTS=644	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1.115 ASSIGNMENTS=580 CHECKS=52453	SAT TT=1.13 ASSIGNMENTS=580 CHECKS=52453	SAT TT=468.03	SAT TT=84.71	SAT TT=0.618 CHECKS=24183	SAT TT=9.907 ASSIGNMENTS=5182 CHECKS=487622	SAT TT=5.45 ASSIGNMENTS=3669 CHECKS=220267	SAT TT=25.22	SAT TT=0.038 ASSIGNMENTS=18 CHECKS=1051	SAT TT=1.119 ASSIGNMENTS=580 CHECKS=52453	? TT=81.992	SAT TT=344.255 ASSIGNMENTS=861 CHECKS=692529000	SAT TT=168.793	SAT TT=265.099
csp/lexVg/ normalized-crossword-m1c-lex-vg6-8_ext.xml	UNSAT TT=81.531	UNSAT TT=81.531 CHECKS=184004 NODES=86556	UNSAT TT=85.263 CHECKS=165544 NODES=82937	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=382.009 ASSIGNMENTS=21381	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.1	UNSAT TT=94.433 ASSIGNMENTS=86556 CHECKS=184004	UNSAT TT=88.698 ASSIGNMENTS=86556 CHECKS=184004	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=200.206 CHECKS=4343720	UNSAT TT=139.865 ASSIGNMENTS=48746 CHECKS=5602740	UNSAT TT=144.642 ASSIGNMENTS=50798 CHECKS=5777040	UNSAT TT=1588.24	UNSAT TT=155.979 ASSIGNMENTS=50043 CHECKS=5808880	UNSAT TT=147.117 ASSIGNMENTS=50737 CHECKS=5833450	? TT=76.066	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg6-9_ext.xml	UNSAT TT=28.952	UNSAT TT=39.342 CHECKS=56094 NODES=28413	UNSAT TT=28.952 CHECKS=39520 NODES=20961	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=803.118 CHECKS=2408340	UNSAT TT=166.768 ASSIGNMENTS=8020	UNSAT TT=851.778 ASSIGNMENTS=25462	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=43.435 ASSIGNMENTS=28413 CHECKS=56094	UNSAT TT=43.196 ASSIGNMENTS=28413 CHECKS=56094	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=93.842 CHECKS=1681860	UNSAT TT=64.502 ASSIGNMENTS=17705 CHECKS=2225640	UNSAT TT=55.206 ASSIGNMENTS=16800 CHECKS=2007220	UNSAT TT=620.48	UNSAT TT=46.203 ASSIGNMENTS=12884 CHECKS=1590250	UNSAT TT=58.808 ASSIGNMENTS=15940 CHECKS=2046330	? TT=77.226	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04
csp/lexVg/ normalized-crossword-m1c-lex-vg7-10_ext.xml	UNSAT TT=10.191	UNSAT TT=10.191 CHECKS=2573 NODES=5081	UNSAT TT=10.815 CHECKS=4929 NODES=5427	? (TO) TT=1800.03	UNSAT TT=321.609 CHECKS=778394	UNSAT TT=204.588 CHECKS=469694	UNSAT TT=34.439 ASSIGNMENTS=885	UNSAT TT=135.204 ASSIGNMENTS=3112	UNSAT TT=20.883 CHECKS=0 NODES=5397	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=16.559 ASSIGNMENTS=5081 CHECKS=2573	UNSAT TT=17.843 ASSIGNMENTS=5081 CHECKS=2573	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=66.523 CHECKS=802216	UNSAT TT=19.345 ASSIGNMENTS=3904 CHECKS=593591	UNSAT TT=27.061 ASSIGNMENTS=6624 CHECKS=797786	UNSAT TT=171.092	UNSAT TT=13.506 ASSIGNMENTS=3128 CHECKS=416562	UNSAT TT=18.522 ASSIGNMENTS=3720 CHECKS=568056	? TT=76.499	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.02
csp/lexVg/ normalized-crossword-m1c-lex-vg7-8_ext.xml	UNSAT TT=81.69	UNSAT TT=87.174 CHECKS=201289 NODES=72247	UNSAT TT=81.69 CHECKS=201777 NODES=66473	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=1397.94 CHECKS=3717400	UNSAT TT=350.519 ASSIGNMENTS=15347	UNSAT TT=1296.04 ASSIGNMENTS=35283	UNSAT TT=257.786 CHECKS=0 NODES=105887	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=88.609 ASSIGNMENTS=72247 CHECKS=201289	UNSAT TT=88.827 ASSIGNMENTS=72247 CHECKS=201289	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=254.472 CHECKS=4424240	UNSAT TT=250.017 ASSIGNMENTS=61554 CHECKS=8324050	UNSAT TT=142.02 ASSIGNMENTS=35950 CHECKS=4527790	UNSAT TT=1367.69	UNSAT TT=223.413 ASSIGNMENTS=55319 CHECKS=7251720	UNSAT TT=190.978 ASSIGNMENTS=46456 CHECKS=6124340	? TT=91.849	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09
csp/lexVg/ normalized-crossword-m1c-lex-vg7-9_ext.xml	UNSAT TT=30.657	UNSAT TT=30.657 CHECKS=41191 NODES=21224	UNSAT TT=33.966 CHECKS=56096 NODES=21473	? (TO) TT=1800.13	UNSAT TT=914.653 CHECKS=2276300	UNSAT TT=721.99 CHECKS=1838910	UNSAT TT=586.789 ASSIGNMENTS=19560	UNSAT TT=335.795 ASSIGNMENTS=8491	UNSAT TT=93.068 CHECKS=0 NODES=31989	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=37.412 ASSIGNMENTS=21224 CHECKS=41191	UNSAT TT=37.23 ASSIGNMENTS=21224 CHECKS=41191	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=135.989 CHECKS=2042900	UNSAT TT=70.163 ASSIGNMENTS=15252 CHECKS=2164980	UNSAT TT=58.358 ASSIGNMENTS=13817 CHECKS=1746510	UNSAT TT=466.618	UNSAT TT=51.589 ASSIGNMENTS=11677 CHECKS=1591190	UNSAT TT=49.639 ASSIGNMENTS=11558 CHECKS=1636660	? TT=89.817	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.02
csp/lexVg/ normalized-crossword-m1c-lex-vg8-12_ext.xml	UNSAT TT=1.051	UNSAT TT=1.642 CHECKS=33 NODES=220	UNSAT TT=3.16 CHECKS=28 NODES=191	? (TO) TT=1800.05	UNSAT TT=51.803 CHECKS=123458	UNSAT TT=16.962 CHECKS=35104	UNSAT TT=15.986 ASSIGNMENTS=20	UNSAT TT=16.241 ASSIGNMENTS=16	UNSAT TT=2.011 CHECKS=0 NODES=264	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=1.222 ASSIGNMENTS=209 CHECKS=33829	UNSAT TT=1.221 ASSIGNMENTS=209 CHECKS=33829	UNSAT TT=94.475	UNSAT TT=43.092	UNSAT TT=1.968 CHECKS=17670	UNSAT TT=1.051 ASSIGNMENTS=183 CHECKS=29040	UNSAT TT=14.854 ASSIGNMENTS=3437 CHECKS=401250	UNSAT TT=10.053	UNSAT TT=4.622 ASSIGNMENTS=1230 CHECKS=126819	UNSAT TT=1.194 ASSIGNMENTS=209 CHECKS=33829	? TT=33.488	? (TO) TT=1800.07	UNSAT TT=165.665	? (TO) TT=1800.09
csp/lexVg/ normalized-crossword-m1c-lex-vg8-8_ext.xml	UNSAT TT=41.382	UNSAT TT=44.378 CHECKS=57921 NODES=25529	UNSAT TT=41.382 CHECKS=60510 NODES=26356	? (TO) TT=1800.06	UNSAT TT=665.823 CHECKS=2337270	UNSAT TT=1058.7 CHECKS=3496070	UNSAT TT=624.682 ASSIGNMENTS=20986	? (TO) TT=1800.07	UNSAT TT=117.416 CHECKS=0 NODES=37004	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=49.505 ASSIGNMENTS=25047 CHECKS=57145	UNSAT TT=52.717 ASSIGNMENTS=25047 CHECKS=57145	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=117.481 CHECKS=1866740	UNSAT TT=126.588 ASSIGNMENTS=27845 CHECKS=4042700	UNSAT TT=76.948 ASSIGNMENTS=17353 CHECKS=2324880	UNSAT TT=560.966	UNSAT TT=123.224 ASSIGNMENTS=26884 CHECKS=3848170	UNSAT TT=81.442 ASSIGNMENTS=17445 CHECKS=2518560	? TT=32.642	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07
csp/lexVg/ normalized-crossword-m1c-lex-vg8-9_ext.xml	UNSAT TT=16.812	UNSAT TT=16.812 CHECKS=11528 NODES=7482	UNSAT TT=19.493 CHECKS=18281 NODES=8704	? (TO) TT=1800.06	UNSAT TT=497.331 CHECKS=1061760	UNSAT TT=315.34 CHECKS=676415	UNSAT TT=95.673 ASSIGNMENTS=2788	UNSAT TT=654.701 ASSIGNMENTS=12117	UNSAT TT=40.437 CHECKS=0 NODES=9731	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=23.768 ASSIGNMENTS=7482 CHECKS=11528	UNSAT TT=24.03 ASSIGNMENTS=7482 CHECKS=11528	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=68.586 CHECKS=737436	UNSAT TT=30.558 ASSIGNMENTS=5550 CHECKS=869739	UNSAT TT=39.64 ASSIGNMENTS=8434 CHECKS=1100810	UNSAT TT=539.045	UNSAT TT=21.744 ASSIGNMENTS=4366 CHECKS=628606	UNSAT TT=39.919 ASSIGNMENTS=7439 CHECKS=1135480	? TT=24.921	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08
csp/lexVg/ normalized-crossword-m1c-lex-vg9-10_ext.xml	UNSAT TT=5.347	UNSAT TT=5.347 CHECKS=149 NODES=1309	UNSAT TT=5.434 CHECKS=129 NODES=1252	? (TO) TT=1800.09	UNSAT TT=116.417 CHECKS=235006	UNSAT TT=97.733 CHECKS=171745	UNSAT TT=25.666 ASSIGNMENTS=290	UNSAT TT=143.003 ASSIGNMENTS=2171	UNSAT TT=10.453 CHECKS=0 NODES=1606	? (TO) TT=1800	? (TO) TT=1800.1	UNSAT TT=12.375 ASSIGNMENTS=1309 CHECKS=149	UNSAT TT=12.945 ASSIGNMENTS=1309 CHECKS=149	UNSAT TT=535.569	UNSAT TT=464.654	UNSAT TT=18.442 CHECKS=140229	UNSAT TT=6.353 ASSIGNMENTS=969 CHECKS=188303	UNSAT TT=21.078 ASSIGNMENTS=4384 CHECKS=545587	UNSAT TT=59.797	UNSAT TT=11.228 ASSIGNMENTS=2238 CHECKS=305118	UNSAT TT=7.269 ASSIGNMENTS=1047 CHECKS=203531	? TT=31.714	? (TO) TT=1800.04	UNSAT TT=1389.91	? (TO) TT=1800.03
csp/lexVg/ normalized-crossword-m1c-lex-vg9-12_ext.xml	UNSAT TT=0.747	UNSAT TT=1.275 CHECKS=0 NODES=103	UNSAT TT=3.472 CHECKS=0 NODES=109	? (TO) TT=1800.08	UNSAT TT=30.283 CHECKS=75131	UNSAT TT=11.949 CHECKS=25367	UNSAT TT=19.074 ASSIGNMENTS=0	UNSAT TT=18.929 ASSIGNMENTS=0	UNSAT TT=1.757 CHECKS=0 NODES=152	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.942 ASSIGNMENTS=156 CHECKS=25448	UNSAT TT=0.937 ASSIGNMENTS=156 CHECKS=25448	UNSAT TT=57.316	UNSAT TT=44.296	UNSAT TT=2.892 CHECKS=19941	UNSAT TT=0.747 ASSIGNMENTS=118 CHECKS=19036	UNSAT TT=16.836 ASSIGNMENTS=3356 CHECKS=430306	UNSAT TT=10.644	UNSAT TT=5.721 ASSIGNMENTS=1389 CHECKS=146535	UNSAT TT=0.998 ASSIGNMENTS=156 CHECKS=25448	? TT=39.105	? (TO) TT=1800.1	UNSAT TT=155.094	? (TO) TT=1800.07
csp/lexVg/ normalized-crossword-m1c-lex-vg9-9_ext.xml	UNSAT TT=10.384	UNSAT TT=10.384 CHECKS=1840 NODES=3110	UNSAT TT=12.865 CHECKS=2142 NODES=3871	? (TO) TT=1800.09	UNSAT TT=206.949 CHECKS=545607	UNSAT TT=200.06 CHECKS=595263	UNSAT TT=44.966 ASSIGNMENTS=859	UNSAT TT=223.399 ASSIGNMENTS=4120	UNSAT TT=32.394 CHECKS=0 NODES=5241	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=17.56 ASSIGNMENTS=3450 CHECKS=2792	UNSAT TT=17.928 ASSIGNMENTS=3450 CHECKS=2792	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=26.255 CHECKS=274715	UNSAT TT=20.787 ASSIGNMENTS=3398 CHECKS=577238	UNSAT TT=28.083 ASSIGNMENTS=5806 CHECKS=732491	UNSAT TT=155.491	UNSAT TT=16.293 ASSIGNMENTS=3385 CHECKS=478366	UNSAT TT=16.977 ASSIGNMENTS=2892 CHECKS=461466	? TT=38.363	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/modifiedRenault/ normalized-renault-mod-0_ext.xml	SAT TT=0.586	SAT TT=1.958 CHECKS=3626 NODES=523	SAT TT=1.766 CHECKS=1487 NODES=0	SAT TT=917.438	SAT TT=37.664 CHECKS=101021	SAT TT=6.888 CHECKS=14856	SAT TT=5.155 ASSIGNMENTS=19	SAT TT=5.03 ASSIGNMENTS=35	SAT TT=84.176 CHECKS=101284000 NODES=156	SAT TT=1399 CHECKS=557903000 NODES=-1590470000	? (TO) TT=1800.05	SAT TT=0.598 ASSIGNMENTS=40 CHECKS=1423	SAT TT=0.617 ASSIGNMENTS=40 CHECKS=1423	SAT TT=13.541	SAT TT=10.973	SAT TT=1.053 CHECKS=903	SAT TT=0.615 ASSIGNMENTS=40 CHECKS=1423	SAT TT=0.662 ASSIGNMENTS=134 CHECKS=4246	SAT TT=5.722	SAT TT=1.158 ASSIGNMENTS=501 CHECKS=45371	SAT TT=0.586 ASSIGNMENTS=40 CHECKS=1423	? TT=46.175	SAT TT=1.4 ASSIGNMENTS=202 CHECKS=25542	SAT TT=7.595	SAT TT=8.073
csp/modifiedRenault/ normalized-renault-mod-10_ext.xml	UNSAT TT=0.749	UNSAT TT=1.886 CHECKS=1969 NODES=466	UNSAT TT=2.212 CHECKS=3217 NODES=440	? (TO) TT=1800.07	UNSAT TT=6.491 CHECKS=30544	UNSAT TT=7.508 CHECKS=38433	UNSAT TT=5.156 ASSIGNMENTS=224	UNSAT TT=166.284 ASSIGNMENTS=32934	UNSAT TT=68.165 CHECKS=40090600 NODES=154	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=0.749 ASSIGNMENTS=910 CHECKS=29032	UNSAT TT=0.751 ASSIGNMENTS=910 CHECKS=29032	UNSAT TT=10.281	UNSAT TT=9.332	UNSAT TT=1.313 CHECKS=10769	UNSAT TT=0.774 ASSIGNMENTS=901 CHECKS=28428	UNSAT TT=2.664 ASSIGNMENTS=5421 CHECKS=137844	UNSAT TT=5.138	UNSAT TT=1.162 ASSIGNMENTS=1518 CHECKS=65435	UNSAT TT=0.808 ASSIGNMENTS=910 CHECKS=29032	? TT=129.243	UNSAT TT=1.719 ASSIGNMENTS=88 CHECKS=50227	UNSAT TT=7.577	UNSAT TT=8.504
csp/modifiedRenault/ normalized-renault-mod-11_ext.xml	SAT TT=0.537	SAT TT=1.638 CHECKS=673 NODES=116	SAT TT=1.81 CHECKS=1360 NODES=115	SAT TT=911.968	SAT TT=8.224 CHECKS=22812	SAT TT=6.057 CHECKS=13873	SAT TT=4.188 ASSIGNMENTS=26	SAT TT=4.62 ASSIGNMENTS=91	SAT TT=70.806 CHECKS=39912500 NODES=111	SAT TT=684.737 CHECKS=630211000 NODES=980250000	? (TO) TT=1800.08	SAT TT=0.558 ASSIGNMENTS=22 CHECKS=924	SAT TT=0.553 ASSIGNMENTS=22 CHECKS=924	SAT TT=12.169	SAT TT=11.445	SAT TT=1.059 CHECKS=1630	SAT TT=0.582 ASSIGNMENTS=22 CHECKS=924	SAT TT=0.6 ASSIGNMENTS=148 CHECKS=4412	SAT TT=5.276	SAT TT=0.584 ASSIGNMENTS=53 CHECKS=1669	SAT TT=0.537 ASSIGNMENTS=22 CHECKS=924	? TT=45.094	SAT TT=1.428 ASSIGNMENTS=152 CHECKS=48746	SAT TT=7.434	SAT TT=8.231
csp/modifiedRenault/ normalized-renault-mod-12_ext.xml	UNSAT TT=0.689	UNSAT TT=2.284 CHECKS=5192 NODES=378	UNSAT TT=1.795 CHECKS=1383 NODES=0	? (TO) TT=1800.07	UNSAT TT=22.409 CHECKS=63692	UNSAT TT=8.276 CHECKS=36129	UNSAT TT=4.338 ASSIGNMENTS=0	UNSAT TT=4.366 ASSIGNMENTS=0	UNSAT TT=68.559 CHECKS=39967600 NODES=32	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=0.706 ASSIGNMENTS=148 CHECKS=9814	UNSAT TT=0.719 ASSIGNMENTS=148 CHECKS=9814	UNSAT TT=9.044	UNSAT TT=8.545	UNSAT TT=1.112 CHECKS=16907	UNSAT TT=0.769 ASSIGNMENTS=298 CHECKS=18751	UNSAT TT=3.217 ASSIGNMENTS=4792 CHECKS=178896	UNSAT TT=4.993	UNSAT TT=1.409 ASSIGNMENTS=475 CHECKS=50686	UNSAT TT=0.689 ASSIGNMENTS=148 CHECKS=9814	? TT=61.249	UNSAT TT=1.498 ASSIGNMENTS=294 CHECKS=287261	UNSAT TT=7.535	UNSAT TT=8.295
csp/modifiedRenault/ normalized-renault-mod-13_ext.xml	SAT TT=0.545	SAT TT=1.584 CHECKS=669 NODES=117	SAT TT=1.741 CHECKS=1200 NODES=125	SAT TT=16.185	SAT TT=5.812 CHECKS=14726	SAT TT=5.143 CHECKS=14131	SAT TT=4.148 ASSIGNMENTS=27	SAT TT=4.736 ASSIGNMENTS=60	SAT TT=125.437 CHECKS=243215000 NODES=239	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=0.599 ASSIGNMENTS=42 CHECKS=1620	SAT TT=0.555 ASSIGNMENTS=42 CHECKS=1620	SAT TT=12.962	SAT TT=11.901	SAT TT=1.06 CHECKS=2230	SAT TT=0.587 ASSIGNMENTS=42 CHECKS=1620	SAT TT=1.005 ASSIGNMENTS=1029 CHECKS=32077	SAT TT=5.019	SAT TT=1.049 ASSIGNMENTS=679 CHECKS=43700	SAT TT=0.545 ASSIGNMENTS=42 CHECKS=1620	? TT=56.712	SAT TT=1.484 ASSIGNMENTS=165 CHECKS=26701	SAT TT=8.03	SAT TT=8.516
csp/modifiedRenault/ normalized-renault-mod-14_ext.xml	UNSAT TT=0.661	UNSAT TT=2.037 CHECKS=2983 NODES=243	UNSAT TT=2.349 CHECKS=5227 NODES=302	? (TO) TT=1800.06	UNSAT TT=23.798 CHECKS=62150	UNSAT TT=7.787 CHECKS=29979	UNSAT TT=5.495 ASSIGNMENTS=72	UNSAT TT=8.924 ASSIGNMENTS=574	UNSAT TT=72.756 CHECKS=39978200 NODES=64	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.665 ASSIGNMENTS=278 CHECKS=12018	UNSAT TT=0.663 ASSIGNMENTS=278 CHECKS=12018	UNSAT TT=9.645	UNSAT TT=8.761	UNSAT TT=1.107 CHECKS=11572	UNSAT TT=0.758 ASSIGNMENTS=541 CHECKS=23880	UNSAT TT=2.971 ASSIGNMENTS=5276 CHECKS=160311	UNSAT TT=5.921	UNSAT TT=0.88 ASSIGNMENTS=407 CHECKS=34354	UNSAT TT=0.661 ASSIGNMENTS=278 CHECKS=12018	? TT=74.054	UNSAT TT=1.664 ASSIGNMENTS=402 CHECKS=429170	UNSAT TT=7.707	UNSAT TT=8.421
csp/modifiedRenault/ normalized-renault-mod-16_ext.xml	UNSAT TT=0.728	UNSAT TT=2.308 CHECKS=2463 NODES=805	UNSAT TT=2.328 CHECKS=3123 NODES=798	? (TO) TT=1800.09	UNSAT TT=7.494 CHECKS=38231	UNSAT TT=6.68 CHECKS=43301	UNSAT TT=5.987 ASSIGNMENTS=777	UNSAT TT=95.609 ASSIGNMENTS=54837	UNSAT TT=72.823 CHECKS=40088800 NODES=211	? (TO) TT=1800.1	? (TO) TT=1800	UNSAT TT=0.728 ASSIGNMENTS=1303 CHECKS=48533	UNSAT TT=0.81 ASSIGNMENTS=1303 CHECKS=48533	UNSAT TT=10.047	UNSAT TT=8.767	UNSAT TT=1.142 CHECKS=20062	UNSAT TT=0.787 ASSIGNMENTS=1343 CHECKS=49320	UNSAT TT=2.603 ASSIGNMENTS=5486 CHECKS=158224	UNSAT TT=5.672	UNSAT TT=1.216 ASSIGNMENTS=1537 CHECKS=74974	UNSAT TT=0.761 ASSIGNMENTS=1303 CHECKS=48533	? TT=47.966	UNSAT TT=1.789 ASSIGNMENTS=738 CHECKS=386796	UNSAT TT=7.661	UNSAT TT=8.553
csp/modifiedRenault/ normalized-renault-mod-17_ext.xml	UNSAT TT=0.669	UNSAT TT=2.371 CHECKS=6031 NODES=495	UNSAT TT=1.789 CHECKS=797 NODES=0	? (TO) TT=1800.1	UNSAT TT=13.595 CHECKS=37874	UNSAT TT=13.728 CHECKS=48337	UNSAT TT=5.616 ASSIGNMENTS=0	UNSAT TT=5.636 ASSIGNMENTS=0	UNSAT TT=72.26 CHECKS=46176000 NODES=43	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=0.685 ASSIGNMENTS=104 CHECKS=6206	UNSAT TT=0.682 ASSIGNMENTS=104 CHECKS=6206	UNSAT TT=10.219	UNSAT TT=8.764	UNSAT TT=1.291 CHECKS=7008	UNSAT TT=0.745 ASSIGNMENTS=219 CHECKS=11739	UNSAT TT=2.935 ASSIGNMENTS=5053 CHECKS=161976	UNSAT TT=5.202	UNSAT TT=1.287 ASSIGNMENTS=541 CHECKS=56023	UNSAT TT=0.669 ASSIGNMENTS=104 CHECKS=6206	? TT=53.293	UNSAT TT=1.567 ASSIGNMENTS=103 CHECKS=160279	UNSAT TT=7.883	UNSAT TT=8.847
csp/modifiedRenault/ normalized-renault-mod-18_ext.xml	UNSAT TT=0.667	UNSAT TT=2.002 CHECKS=3110 NODES=540	UNSAT TT=2.258 CHECKS=2523 NODES=512	? (TO) TT=1800.12	UNSAT TT=6.563 CHECKS=29093	UNSAT TT=6.656 CHECKS=27980	UNSAT TT=5.227 ASSIGNMENTS=169	UNSAT TT=59.376 ASSIGNMENTS=28546	UNSAT TT=72.67 CHECKS=39992900 NODES=89	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.685 ASSIGNMENTS=565 CHECKS=18446	UNSAT TT=0.685 ASSIGNMENTS=565 CHECKS=18446	UNSAT TT=10.407	UNSAT TT=8.647	UNSAT TT=1.329 CHECKS=8632	UNSAT TT=0.695 ASSIGNMENTS=607 CHECKS=19705	UNSAT TT=2.646 ASSIGNMENTS=5351 CHECKS=145590	UNSAT TT=5.25	UNSAT TT=0.909 ASSIGNMENTS=464 CHECKS=35515	UNSAT TT=0.667 ASSIGNMENTS=565 CHECKS=18446	? TT=56.946	UNSAT TT=1.578 ASSIGNMENTS=262 CHECKS=115516	UNSAT TT=7.676	UNSAT TT=8.01
csp/modifiedRenault/ normalized-renault-mod-19_ext.xml	UNSAT TT=0.626	UNSAT TT=1.856 CHECKS=1700 NODES=532	UNSAT TT=2.546 CHECKS=3886 NODES=487	? (TO) TT=1800.12	UNSAT TT=21.086 CHECKS=61613	UNSAT TT=6.182 CHECKS=21886	UNSAT TT=3.765 ASSIGNMENTS=0	UNSAT TT=3.844 ASSIGNMENTS=0	UNSAT TT=73.141 CHECKS=39994500 NODES=59	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.626 ASSIGNMENTS=169 CHECKS=8262	UNSAT TT=0.667 ASSIGNMENTS=169 CHECKS=8262	UNSAT TT=8.918	UNSAT TT=10.172	UNSAT TT=1.094 CHECKS=9927	UNSAT TT=0.72 ASSIGNMENTS=357 CHECKS=18774	UNSAT TT=2.457 ASSIGNMENTS=5324 CHECKS=137622	UNSAT TT=5.467	UNSAT TT=0.908 ASSIGNMENTS=482 CHECKS=37874	UNSAT TT=0.661 ASSIGNMENTS=169 CHECKS=8262	? TT=51.966	UNSAT TT=1.551 ASSIGNMENTS=169 CHECKS=144994	UNSAT TT=7.676	UNSAT TT=7.957
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/modifiedRenault/ normalized-renault-mod-1_ext.xml	UNSAT TT=0.649	UNSAT TT=1.85 CHECKS=1408 NODES=63	UNSAT TT=1.789 CHECKS=787 NODES=0	? (TO) TT=1800.09	UNSAT TT=16.162 CHECKS=59393	UNSAT TT=7.117 CHECKS=30527	UNSAT TT=3.813 ASSIGNMENTS=0	UNSAT TT=3.59 ASSIGNMENTS=0	UNSAT TT=84.224 CHECKS=91225600 NODES=42	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.665 ASSIGNMENTS=101 CHECKS=5324	UNSAT TT=0.676 ASSIGNMENTS=101 CHECKS=5324	UNSAT TT=10.231	UNSAT TT=9.49	UNSAT TT=1.239 CHECKS=11261	UNSAT TT=0.766 ASSIGNMENTS=286 CHECKS=13200	UNSAT TT=2.357 ASSIGNMENTS=5127 CHECKS=165726	UNSAT TT=5.293	UNSAT TT=0.888 ASSIGNMENTS=339 CHECKS=29363	UNSAT TT=0.649 ASSIGNMENTS=101 CHECKS=5324	? TT=50.207	UNSAT TT=1.476 ASSIGNMENTS=268 CHECKS=198173	UNSAT TT=7.902	UNSAT TT=8.127
csp/modifiedRenault/ normalized-renault-mod-20_ext.xml	UNSAT TT=0.66	UNSAT TT=2.5 CHECKS=5667 NODES=504	UNSAT TT=2.667 CHECKS=5542 NODES=460	? (TO) TT=1800.13	UNSAT TT=28.31 CHECKS=124829	UNSAT TT=8.153 CHECKS=46720	UNSAT TT=4.066 ASSIGNMENTS=0	UNSAT TT=4.129 ASSIGNMENTS=0	UNSAT TT=119.764 CHECKS=243225000 NODES=57	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.721 ASSIGNMENTS=129 CHECKS=15234	UNSAT TT=0.727 ASSIGNMENTS=129 CHECKS=15234	UNSAT TT=10.551	UNSAT TT=9.609	UNSAT TT=1.125 CHECKS=15273	UNSAT TT=0.725 ASSIGNMENTS=237 CHECKS=23353	UNSAT TT=2.674 ASSIGNMENTS=4933 CHECKS=246583	UNSAT TT=5.546	UNSAT TT=1.017 ASSIGNMENTS=371 CHECKS=48210	UNSAT TT=0.66 ASSIGNMENTS=129 CHECKS=15234	? TT=122.496	UNSAT TT=2.123 ASSIGNMENTS=626 CHECKS=1121500	UNSAT TT=7.603	UNSAT TT=8.355
csp/modifiedRenault/ normalized-renault-mod-21_ext.xml	UNSAT TT=0.648	UNSAT TT=2.037 CHECKS=3583 NODES=248	UNSAT TT=2.326 CHECKS=3930 NODES=235	? (TO) TT=1800.13	UNSAT TT=13.146 CHECKS=67969	UNSAT TT=7.624 CHECKS=42925	UNSAT TT=5.777 ASSIGNMENTS=118	UNSAT TT=12.387 ASSIGNMENTS=1729	UNSAT TT=67.82 CHECKS=40040800 NODES=70	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.648 ASSIGNMENTS=320 CHECKS=19660	UNSAT TT=0.701 ASSIGNMENTS=320 CHECKS=19660	UNSAT TT=10.441	UNSAT TT=10.093	UNSAT TT=1.216 CHECKS=22417	UNSAT TT=0.739 ASSIGNMENTS=585 CHECKS=34379	UNSAT TT=2.959 ASSIGNMENTS=5148 CHECKS=185284	UNSAT TT=5.774	UNSAT TT=1.241 ASSIGNMENTS=479 CHECKS=46920	UNSAT TT=0.684 ASSIGNMENTS=320 CHECKS=19660	? TT=93.144	UNSAT TT=1.529 ASSIGNMENTS=301 CHECKS=240401	UNSAT TT=8.042	UNSAT TT=7.829
csp/modifiedRenault/ normalized-renault-mod-22_ext.xml	UNSAT TT=0.672	UNSAT TT=2.021 CHECKS=1765 NODES=401	UNSAT TT=2.297 CHECKS=2874 NODES=266	? (TO) TT=1800.07	UNSAT TT=20.658 CHECKS=64436	UNSAT TT=8.351 CHECKS=42912	UNSAT TT=8.464 ASSIGNMENTS=0	UNSAT TT=4.721 ASSIGNMENTS=0	UNSAT TT=68.154 CHECKS=39988900 NODES=47	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.672 ASSIGNMENTS=208 CHECKS=16290	UNSAT TT=0.717 ASSIGNMENTS=208 CHECKS=16290	UNSAT TT=11.927	UNSAT TT=8.896	UNSAT TT=1.103 CHECKS=23084	UNSAT TT=0.776 ASSIGNMENTS=364 CHECKS=31816	UNSAT TT=3.25 ASSIGNMENTS=5219 CHECKS=177267	UNSAT TT=5.024	UNSAT TT=1.057 ASSIGNMENTS=571 CHECKS=47708	UNSAT TT=0.712 ASSIGNMENTS=208 CHECKS=16290	? TT=91.479	UNSAT TT=1.48 ASSIGNMENTS=106 CHECKS=107428	UNSAT TT=7.339	UNSAT TT=7.936
csp/modifiedRenault/ normalized-renault-mod-23_ext.xml	UNSAT TT=0.727	UNSAT TT=2.188 CHECKS=6738 NODES=426	UNSAT TT=2.394 CHECKS=6016 NODES=404	? (TO) TT=1800.05	UNSAT TT=19.088 CHECKS=64596	UNSAT TT=12.985 CHECKS=68595	UNSAT TT=3.814 ASSIGNMENTS=0	UNSAT TT=3.847 ASSIGNMENTS=0	UNSAT TT=81.353 CHECKS=94440800 NODES=55	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=0.756 ASSIGNMENTS=213 CHECKS=18567	UNSAT TT=0.727 ASSIGNMENTS=213 CHECKS=18567	UNSAT TT=12.176	UNSAT TT=9.791	UNSAT TT=1.13 CHECKS=27042	UNSAT TT=0.859 ASSIGNMENTS=388 CHECKS=34039	UNSAT TT=2.475 ASSIGNMENTS=5281 CHECKS=192586	UNSAT TT=5.609	UNSAT TT=1.325 ASSIGNMENTS=822 CHECKS=75938	UNSAT TT=0.743 ASSIGNMENTS=213 CHECKS=18567	? TT=93.089	UNSAT TT=1.663 ASSIGNMENTS=367 CHECKS=441179	UNSAT TT=8.334	UNSAT TT=8.49
csp/modifiedRenault/ normalized-renault-mod-24_ext.xml	UNSAT TT=0.692	UNSAT TT=2.429 CHECKS=1356 NODES=140	UNSAT TT=1.901 CHECKS=1182 NODES=0	? (TO) TT=1800.1	UNSAT TT=16.308 CHECKS=58834	UNSAT TT=7.512 CHECKS=31884	UNSAT TT=4.743 ASSIGNMENTS=0	UNSAT TT=4.271 ASSIGNMENTS=0	UNSAT TT=70.045 CHECKS=39963600 NODES=51	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=0.692 ASSIGNMENTS=193 CHECKS=12290	UNSAT TT=0.736 ASSIGNMENTS=193 CHECKS=12290	UNSAT TT=10.855	UNSAT TT=9.894	UNSAT TT=1.196 CHECKS=18642	UNSAT TT=0.764 ASSIGNMENTS=248 CHECKS=17161	UNSAT TT=3.296 ASSIGNMENTS=5094 CHECKS=230564	UNSAT TT=5.303	UNSAT TT=1.052 ASSIGNMENTS=388 CHECKS=35259	UNSAT TT=0.724 ASSIGNMENTS=193 CHECKS=12290	? TT=96.454	UNSAT TT=1.55 ASSIGNMENTS=176 CHECKS=154826	UNSAT TT=7.901	UNSAT TT=8.577
csp/modifiedRenault/ normalized-renault-mod-26_ext.xml	UNSAT TT=0.682	UNSAT TT=2.505 CHECKS=2392 NODES=543	UNSAT TT=2.597 CHECKS=2736 NODES=525	? (TO) TT=1800.09	UNSAT TT=10.824 CHECKS=54195	UNSAT TT=6.777 CHECKS=38132	UNSAT TT=4.278 ASSIGNMENTS=82	UNSAT TT=13.152 ASSIGNMENTS=2319	UNSAT TT=68.897 CHECKS=40044200 NODES=85	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.752 ASSIGNMENTS=411 CHECKS=26129	UNSAT TT=0.7 ASSIGNMENTS=411 CHECKS=26129	UNSAT TT=12.103	UNSAT TT=10.246	UNSAT TT=1.414 CHECKS=15583	UNSAT TT=0.7 ASSIGNMENTS=419 CHECKS=28928	UNSAT TT=2.855 ASSIGNMENTS=5134 CHECKS=191794	UNSAT TT=6.08	UNSAT TT=1.067 ASSIGNMENTS=474 CHECKS=41607	UNSAT TT=0.682 ASSIGNMENTS=411 CHECKS=26129	? TT=101.112	UNSAT TT=1.611 ASSIGNMENTS=209 CHECKS=124708	UNSAT TT=8.778	UNSAT TT=7.986
csp/modifiedRenault/ normalized-renault-mod-27_ext.xml	UNSAT TT=0.698	UNSAT TT=1.843 CHECKS=2627 NODES=187	UNSAT TT=1.765 CHECKS=786 NODES=0	? (TO) TT=1800.12	UNSAT TT=11.871 CHECKS=31145	UNSAT TT=14.613 CHECKS=51656	UNSAT TT=4.429 ASSIGNMENTS=0	UNSAT TT=4.492 ASSIGNMENTS=0	UNSAT TT=70.322 CHECKS=39983400 NODES=46	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=0.715 ASSIGNMENTS=109 CHECKS=9336	UNSAT TT=0.722 ASSIGNMENTS=109 CHECKS=9336	UNSAT TT=10.567	UNSAT TT=9.875	UNSAT TT=1.14 CHECKS=10834	UNSAT TT=0.756 ASSIGNMENTS=272 CHECKS=22197	UNSAT TT=1.128 ASSIGNMENTS=1112 CHECKS=43235	UNSAT TT=5.21	UNSAT TT=0.996 ASSIGNMENTS=337 CHECKS=34524	UNSAT TT=0.698 ASSIGNMENTS=109 CHECKS=9336	? TT=94.376	UNSAT TT=1.586 ASSIGNMENTS=75 CHECKS=69916	UNSAT TT=8.424	UNSAT TT=8.327
csp/modifiedRenault/ normalized-renault-mod-28_ext.xml	UNSAT TT=0.659	UNSAT TT=2.112 CHECKS=1712 NODES=224	UNSAT TT=2.071 CHECKS=2589 NODES=215	? (TO) TT=1800.09	UNSAT TT=44.444 CHECKS=119372	UNSAT TT=8.885 CHECKS=41601	UNSAT TT=4.714 ASSIGNMENTS=0	UNSAT TT=4.925 ASSIGNMENTS=0	UNSAT TT=71.084 CHECKS=40034700 NODES=54	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=0.723 ASSIGNMENTS=189 CHECKS=17363	UNSAT TT=0.672 ASSIGNMENTS=189 CHECKS=17363	UNSAT TT=12.031	UNSAT TT=9.828	UNSAT TT=1.212 CHECKS=20421	UNSAT TT=0.821 ASSIGNMENTS=391 CHECKS=34799	UNSAT TT=2.533 ASSIGNMENTS=5158 CHECKS=179476	UNSAT TT=5.591	UNSAT TT=1.99 ASSIGNMENTS=1536 CHECKS=140448	UNSAT TT=0.659 ASSIGNMENTS=189 CHECKS=17363	? (exit code) TT=120.609	UNSAT TT=1.799 ASSIGNMENTS=156 CHECKS=394915	UNSAT TT=8.12	UNSAT TT=9.292
csp/modifiedRenault/ normalized-renault-mod-29_ext.xml	UNSAT TT=0.728	UNSAT TT=1.95 CHECKS=21 NODES=9	UNSAT TT=2.057 CHECKS=1303 NODES=0	? (TO) TT=1800.06	UNSAT TT=8.079 CHECKS=25436	UNSAT TT=7.977 CHECKS=34564	UNSAT TT=3.328 ASSIGNMENTS=0	UNSAT TT=3.15 ASSIGNMENTS=0	UNSAT TT=67.8 CHECKS=39980600 NODES=40	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.728 ASSIGNMENTS=84 CHECKS=10879	UNSAT TT=0.734 ASSIGNMENTS=84 CHECKS=10879	UNSAT TT=10.659	UNSAT TT=9.692	UNSAT TT=1.094 CHECKS=11443	UNSAT TT=0.796 ASSIGNMENTS=124 CHECKS=15453	UNSAT TT=2.82 ASSIGNMENTS=4664 CHECKS=250101	UNSAT TT=5.726	UNSAT TT=0.971 ASSIGNMENTS=204 CHECKS=29409	UNSAT TT=0.728 ASSIGNMENTS=84 CHECKS=10879	? (exit code) TT=105.217	UNSAT TT=1.576 ASSIGNMENTS=126 CHECKS=227519	UNSAT TT=8.199	UNSAT TT=8.569
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/modifiedRenault/ normalized-renault-mod-30_ext.xml	UNSAT TT=0.844	UNSAT TT=2.769 CHECKS=6588 NODES=609	UNSAT TT=3.453 CHECKS=7982 NODES=568	? (TO) TT=1800.07	UNSAT TT=49.513 CHECKS=174067	UNSAT TT=19.099 CHECKS=86332	UNSAT TT=4.848 ASSIGNMENTS=209	UNSAT TT=5.702 ASSIGNMENTS=397	UNSAT TT=327.083 CHECKS=1089730000 NODES=145	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.904 ASSIGNMENTS=338 CHECKS=33601	UNSAT TT=0.901 ASSIGNMENTS=338 CHECKS=33601	UNSAT TT=10.267	UNSAT TT=9.254	UNSAT TT=1.191 CHECKS=37209	UNSAT TT=0.888 ASSIGNMENTS=572 CHECKS=55353	UNSAT TT=3.736 ASSIGNMENTS=4821 CHECKS=258171	UNSAT TT=5.709	UNSAT TT=1.151 ASSIGNMENTS=502 CHECKS=51791	UNSAT TT=0.844 ASSIGNMENTS=338 CHECKS=33601	? TT=77.893	UNSAT TT=2.4 ASSIGNMENTS=100 CHECKS=918667	UNSAT TT=7.928	UNSAT TT=8.598
csp/modifiedRenault/ normalized-renault-mod-31_ext.xml	SAT TT=0.641	SAT TT=1.889 CHECKS=4320 NODES=503	SAT TT=2.313 CHECKS=5954 NODES=481	SAT TT=1356.4	SAT TT=38.058 CHECKS=151760	SAT TT=9.763 CHECKS=41300	SAT TT=5.458 ASSIGNMENTS=107	SAT TT=8.203 ASSIGNMENTS=1252	SAT TT=153.486 CHECKS=420892000 NODES=246	SAT TT=843.105 CHECKS=2268540000 NODES=888300000	? (TO) TT=1800.03	SAT TT=0.709 ASSIGNMENTS=190 CHECKS=13751	SAT TT=0.661 ASSIGNMENTS=190 CHECKS=13751	SAT TT=12.974	SAT TT=12.138	SAT TT=1.054 CHECKS=10708	SAT TT=0.641 ASSIGNMENTS=178 CHECKS=8365	SAT TT=1.906 ASSIGNMENTS=3611 CHECKS=121754	SAT TT=5.251	SAT TT=1.854 ASSIGNMENTS=496 CHECKS=52086	SAT TT=0.703 ASSIGNMENTS=190 CHECKS=13751	? TT=73.525	SAT TT=1.532 ASSIGNMENTS=180 CHECKS=68523	SAT TT=7.324	SAT TT=8.395
csp/modifiedRenault/ normalized-renault-mod-33_ext.xml	UNSAT TT=0.65	UNSAT TT=2.914 CHECKS=4746 NODES=297	UNSAT TT=3.131 CHECKS=4604 NODES=221	? (TO) TT=1800.12	UNSAT TT=30.581 CHECKS=120695	UNSAT TT=7.187 CHECKS=37114	UNSAT TT=5.214 ASSIGNMENTS=47	UNSAT TT=5.682 ASSIGNMENTS=76	UNSAT TT=85.448 CHECKS=84192500 NODES=144	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.676 ASSIGNMENTS=137 CHECKS=10183	UNSAT TT=0.674 ASSIGNMENTS=137 CHECKS=10183	UNSAT TT=9.851	UNSAT TT=9.03	UNSAT TT=1.171 CHECKS=9681	UNSAT TT=0.693 ASSIGNMENTS=201 CHECKS=14300	UNSAT TT=3.417 ASSIGNMENTS=4752 CHECKS=249865	UNSAT TT=5.333	UNSAT TT=2.077 ASSIGNMENTS=406 CHECKS=42101	UNSAT TT=0.65 ASSIGNMENTS=137 CHECKS=10183	? TT=58.668	UNSAT TT=1.497 ASSIGNMENTS=227 CHECKS=240572	UNSAT TT=7.696	UNSAT TT=7.593
csp/modifiedRenault/ normalized-renault-mod-35_ext.xml	UNSAT TT=0.706	UNSAT TT=2.449 CHECKS=9707 NODES=174	UNSAT TT=1.756 CHECKS=1027 NODES=0	UNSAT TT=15.913	UNSAT TT=2.755 CHECKS=3036	UNSAT TT=2.774 CHECKS=3442	UNSAT TT=2.037 ASSIGNMENTS=0	UNSAT TT=1.949 ASSIGNMENTS=0	UNSAT TT=101.663 CHECKS=158203000 NODES=7	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=0.722 ASSIGNMENTS=37 CHECKS=8271	UNSAT TT=0.715 ASSIGNMENTS=37 CHECKS=8271	UNSAT TT=9.813	UNSAT TT=8.582	UNSAT TT=1.048 CHECKS=14872	UNSAT TT=0.762 ASSIGNMENTS=73 CHECKS=12338	UNSAT TT=0.923 ASSIGNMENTS=277 CHECKS=17921	UNSAT TT=4.874	UNSAT TT=1.448 ASSIGNMENTS=145 CHECKS=25921	UNSAT TT=0.706 ASSIGNMENTS=37 CHECKS=8271	? TT=63.708	UNSAT TT=1.495 ASSIGNMENTS=171 CHECKS=258826	UNSAT TT=8.053	UNSAT TT=8.056
csp/modifiedRenault/ normalized-renault-mod-36_ext.xml	SAT TT=0.674	SAT TT=2.426 CHECKS=6273 NODES=505	SAT TT=2.635 CHECKS=7996 NODES=449	? (TO) TT=1800.11	SAT TT=35.845 CHECKS=118776	SAT TT=7.588 CHECKS=32223	SAT TT=4.471 ASSIGNMENTS=27	SAT TT=5.209 ASSIGNMENTS=31	SAT TT=71.287 CHECKS=51895100 NODES=172	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=0.705 ASSIGNMENTS=157 CHECKS=9629	SAT TT=0.699 ASSIGNMENTS=157 CHECKS=9629	SAT TT=12.389	SAT TT=13.403	SAT TT=1.127 CHECKS=5532	SAT TT=0.702 ASSIGNMENTS=241 CHECKS=12189	SAT TT=3.949 ASSIGNMENTS=4717 CHECKS=210178	SAT TT=5.417	SAT TT=1.339 ASSIGNMENTS=473 CHECKS=56149	SAT TT=0.674 ASSIGNMENTS=157 CHECKS=9629	? TT=58.108	SAT TT=1.48 ASSIGNMENTS=167 CHECKS=34894	SAT TT=7.648	SAT TT=8.351
csp/modifiedRenault/ normalized-renault-mod-37_ext.xml	UNSAT TT=0.679	UNSAT TT=2.265 CHECKS=6446 NODES=351	UNSAT TT=1.782 CHECKS=810 NODES=0	? (TO) TT=1800.11	UNSAT TT=11.244 CHECKS=30827	UNSAT TT=8.159 CHECKS=38646	UNSAT TT=3.963 ASSIGNMENTS=0	UNSAT TT=4.441 ASSIGNMENTS=0	UNSAT TT=70.373 CHECKS=39950600 NODES=30	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=0.762 ASSIGNMENTS=163 CHECKS=12791	UNSAT TT=0.679 ASSIGNMENTS=163 CHECKS=12791	UNSAT TT=9.094	UNSAT TT=8.408	UNSAT TT=1.121 CHECKS=19956	UNSAT TT=0.848 ASSIGNMENTS=327 CHECKS=24777	UNSAT TT=3.049 ASSIGNMENTS=4921 CHECKS=160326	UNSAT TT=4.936	UNSAT TT=1.384 ASSIGNMENTS=407 CHECKS=40166	UNSAT TT=0.723 ASSIGNMENTS=163 CHECKS=12791	? TT=108.576	UNSAT TT=1.573 ASSIGNMENTS=242 CHECKS=202317	UNSAT TT=7.504	UNSAT TT=8.227
csp/modifiedRenault/ normalized-renault-mod-39_ext.xml	UNSAT TT=0.643	UNSAT TT=2.07 CHECKS=2872 NODES=472	UNSAT TT=1.823 CHECKS=1720 NODES=0	? (TO) TT=1800.07	UNSAT TT=21.085 CHECKS=67486	UNSAT TT=13.145 CHECKS=48945	UNSAT TT=4.667 ASSIGNMENTS=0	UNSAT TT=4.902 ASSIGNMENTS=0	UNSAT TT=68.321 CHECKS=40022800 NODES=47	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=0.643 ASSIGNMENTS=148 CHECKS=8994	UNSAT TT=0.717 ASSIGNMENTS=148 CHECKS=8994	UNSAT TT=9.489	UNSAT TT=9.444	UNSAT TT=1.327 CHECKS=13144	UNSAT TT=0.762 ASSIGNMENTS=294 CHECKS=18917	UNSAT TT=3.579 ASSIGNMENTS=4858 CHECKS=181297	UNSAT TT=4.964	UNSAT TT=1.29 ASSIGNMENTS=418 CHECKS=44047	UNSAT TT=0.693 ASSIGNMENTS=148 CHECKS=8994	? TT=50.746	UNSAT TT=1.585 ASSIGNMENTS=184 CHECKS=205978	UNSAT TT=7.76	UNSAT TT=8.082
csp/modifiedRenault/ normalized-renault-mod-3_ext.xml	UNSAT TT=0.622	UNSAT TT=1.954 CHECKS=3251 NODES=177	UNSAT TT=1.959 CHECKS=1812 NODES=0	? (TO) TT=1800.12	UNSAT TT=14.39 CHECKS=38040	UNSAT TT=7.86 CHECKS=26893	UNSAT TT=4.717 ASSIGNMENTS=0	UNSAT TT=4.36 ASSIGNMENTS=0	UNSAT TT=71.162 CHECKS=39973900 NODES=54	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.628 ASSIGNMENTS=134 CHECKS=5245	UNSAT TT=0.637 ASSIGNMENTS=134 CHECKS=5245	UNSAT TT=10.532	UNSAT TT=8.621	UNSAT TT=1.071 CHECKS=8929	UNSAT TT=0.694 ASSIGNMENTS=290 CHECKS=12409	UNSAT TT=2.922 ASSIGNMENTS=5059 CHECKS=142238	UNSAT TT=5.008	UNSAT TT=1.017 ASSIGNMENTS=393 CHECKS=37173	UNSAT TT=0.622 ASSIGNMENTS=134 CHECKS=5245	? TT=57.657	UNSAT TT=1.503 ASSIGNMENTS=313 CHECKS=262539	UNSAT TT=7.778	UNSAT TT=8.11
csp/modifiedRenault/ normalized-renault-mod-40_ext.xml	UNSAT TT=0.645	UNSAT TT=1.488 CHECKS=175 NODES=7	UNSAT TT=1.594 CHECKS=1162 NODES=0	? (TO) TT=1800.06	UNSAT TT=11.619 CHECKS=35310	UNSAT TT=7.922 CHECKS=27864	UNSAT TT=3.706 ASSIGNMENTS=0	UNSAT TT=4.028 ASSIGNMENTS=0	UNSAT TT=84.46 CHECKS=81984500 NODES=39	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=0.657 ASSIGNMENTS=117 CHECKS=6941	UNSAT TT=0.658 ASSIGNMENTS=117 CHECKS=6941	UNSAT TT=8.607	UNSAT TT=8.057	UNSAT TT=1.142 CHECKS=7509	UNSAT TT=0.674 ASSIGNMENTS=197 CHECKS=10083	UNSAT TT=1.868 ASSIGNMENTS=4555 CHECKS=122011	UNSAT TT=4.919	UNSAT TT=0.943 ASSIGNMENTS=403 CHECKS=44227	UNSAT TT=0.645 ASSIGNMENTS=117 CHECKS=6941	? TT=81.505	UNSAT TT=1.63 ASSIGNMENTS=156 CHECKS=277918	UNSAT TT=7.702	UNSAT TT=7.455
csp/modifiedRenault/ normalized-renault-mod-41_ext.xml	SAT TT=0.597	SAT TT=1.704 CHECKS=2191 NODES=282	SAT TT=1.81 CHECKS=2636 NODES=273	SAT TT=1577.5	SAT TT=30.891 CHECKS=144874	SAT TT=5.684 CHECKS=28581	SAT TT=3.784 ASSIGNMENTS=127	SAT TT=5.451 ASSIGNMENTS=865	SAT TT=71.078 CHECKS=50154600 NODES=170	SAT TT=211.22 CHECKS=193187000 NODES=337201000	? (TO) TT=1800.04	SAT TT=0.649 ASSIGNMENTS=188 CHECKS=5882	SAT TT=0.612 ASSIGNMENTS=188 CHECKS=5882	SAT TT=13.533	SAT TT=11.443	SAT TT=1.026 CHECKS=8259	SAT TT=0.687 ASSIGNMENTS=255 CHECKS=7089	SAT TT=1.602 ASSIGNMENTS=4992 CHECKS=146347	SAT TT=5.513	SAT TT=0.724 ASSIGNMENTS=363 CHECKS=22038	SAT TT=0.597 ASSIGNMENTS=188 CHECKS=5882	? TT=58.891	SAT TT=1.475 ASSIGNMENTS=148 CHECKS=37258	SAT TT=8.377	SAT TT=8.205
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/modifiedRenault/ normalized-renault-mod-42_ext.xml	UNSAT TT=0.607	UNSAT TT=2.097 CHECKS=4676 NODES=223	UNSAT TT=1.719 CHECKS=804 NODES=0	? (TO) TT=1800.1	UNSAT TT=11.653 CHECKS=37960	UNSAT TT=6.241 CHECKS=20586	UNSAT TT=4.344 ASSIGNMENTS=0	UNSAT TT=4.529 ASSIGNMENTS=0	UNSAT TT=70 CHECKS=43011200 NODES=36	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.607 ASSIGNMENTS=91 CHECKS=4093	UNSAT TT=0.643 ASSIGNMENTS=91 CHECKS=4093	UNSAT TT=9.475	UNSAT TT=8.46	UNSAT TT=1.084 CHECKS=5470	UNSAT TT=0.713 ASSIGNMENTS=157 CHECKS=8423	UNSAT TT=2.931 ASSIGNMENTS=4886 CHECKS=155509	UNSAT TT=5.047	UNSAT TT=1.034 ASSIGNMENTS=542 CHECKS=44319	UNSAT TT=0.628 ASSIGNMENTS=91 CHECKS=4093	? TT=78.349	UNSAT TT=1.428 ASSIGNMENTS=198 CHECKS=134598	UNSAT TT=7.592	UNSAT TT=8.597
csp/modifiedRenault/ normalized-renault-mod-43_ext.xml	SAT TT=0.594	SAT TT=2.086 CHECKS=3961 NODES=504	SAT TT=2.2 CHECKS=1929 NODES=0	SAT TT=23.22	SAT TT=19.13 CHECKS=67662	SAT TT=9.506 CHECKS=31724	SAT TT=4.053 ASSIGNMENTS=17	SAT TT=4.474 ASSIGNMENTS=35	SAT TT=98.918 CHECKS=164856000 NODES=124	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.608 ASSIGNMENTS=33 CHECKS=1920	SAT TT=0.608 ASSIGNMENTS=33 CHECKS=1920	SAT TT=12.359	SAT TT=11.756	SAT TT=1.043 CHECKS=1146	SAT TT=0.596 ASSIGNMENTS=33 CHECKS=1920	Wrong Cert. TT=0.6 ASSIGNMENTS=27 CHECKS=1465	SAT TT=5.68	SAT TT=0.871 ASSIGNMENTS=122 CHECKS=13740	SAT TT=0.594 ASSIGNMENTS=33 CHECKS=1920	? TT=80.649	SAT TT=1.413 ASSIGNMENTS=114 CHECKS=31298	SAT TT=7.815	SAT TT=7.982
csp/modifiedRenault/ normalized-renault-mod-44_ext.xml	SAT TT=0.551	SAT TT=1.75 CHECKS=700 NODES=108	SAT TT=1.776 CHECKS=1455 NODES=0	SAT TT=15.203	SAT TT=46.879 CHECKS=151943	SAT TT=5.183 CHECKS=11400	SAT TT=4.5 ASSIGNMENTS=32	SAT TT=4.267 ASSIGNMENTS=34	SAT TT=68.709 CHECKS=39909400 NODES=108	SAT TT=95.774 CHECKS=256697000 NODES=80850100	? (TO) TT=1800.04	SAT TT=0.563 ASSIGNMENTS=30 CHECKS=1394	SAT TT=0.603 ASSIGNMENTS=30 CHECKS=1394	SAT TT=12.337	SAT TT=10.625	SAT TT=1.047 CHECKS=769	SAT TT=0.6 ASSIGNMENTS=30 CHECKS=1394	SAT TT=0.58 ASSIGNMENTS=32 CHECKS=1311	SAT TT=5.989	SAT TT=0.723 ASSIGNMENTS=134 CHECKS=9268	SAT TT=0.551 ASSIGNMENTS=30 CHECKS=1394	? TT=78.757	SAT TT=1.401 ASSIGNMENTS=109 CHECKS=20354	SAT TT=7.123	SAT TT=7.823
csp/modifiedRenault/ normalized-renault-mod-46_ext.xml	SAT TT=0.563	SAT TT=1.629 CHECKS=609 NODES=108	SAT TT=1.73 CHECKS=707 NODES=0	SAT TT=14.676	SAT TT=46.599 CHECKS=155637	SAT TT=5.432 CHECKS=11883	SAT TT=4.058 ASSIGNMENTS=29	SAT TT=4.645 ASSIGNMENTS=40	SAT TT=92.075 CHECKS=116118000 NODES=110	SAT TT=118.658 CHECKS=153790000 NODES=165450000	? (TO) TT=1800.06	SAT TT=0.617 ASSIGNMENTS=29 CHECKS=1382	SAT TT=0.61 ASSIGNMENTS=29 CHECKS=1382	SAT TT=12.343	SAT TT=12.191	SAT TT=1.076 CHECKS=831	SAT TT=0.563 ASSIGNMENTS=29 CHECKS=1382	SAT TT=0.602 ASSIGNMENTS=28 CHECKS=1301	SAT TT=4.922	SAT TT=0.711 ASSIGNMENTS=98 CHECKS=5639	SAT TT=0.606 ASSIGNMENTS=29 CHECKS=1382	? TT=87.202	SAT TT=1.404 ASSIGNMENTS=109 CHECKS=21056	SAT TT=7.587	SAT TT=8.022
csp/modifiedRenault/ normalized-renault-mod-47_ext.xml	UNSAT TT=0.664	UNSAT TT=1.627 CHECKS=19 NODES=7	UNSAT TT=1.873 CHECKS=1258 NODES=0	? (TO) TT=1800.06	UNSAT TT=5.864 CHECKS=21704	UNSAT TT=10.681 CHECKS=41826	UNSAT TT=2.685 ASSIGNMENTS=0	UNSAT TT=3.049 ASSIGNMENTS=0	UNSAT TT=100.459 CHECKS=154626000 NODES=16	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=0.706 ASSIGNMENTS=78 CHECKS=7062	UNSAT TT=0.69 ASSIGNMENTS=78 CHECKS=7062	UNSAT TT=8.773	UNSAT TT=9.29	UNSAT TT=1.007 CHECKS=11074	UNSAT TT=0.688 ASSIGNMENTS=179 CHECKS=14162	UNSAT TT=2.24 ASSIGNMENTS=2914 CHECKS=167937	UNSAT TT=4.993	UNSAT TT=0.81 ASSIGNMENTS=128 CHECKS=20626	UNSAT TT=0.664 ASSIGNMENTS=78 CHECKS=7062	? TT=85.286	UNSAT TT=1.606 ASSIGNMENTS=220 CHECKS=208470	UNSAT TT=7.754	UNSAT TT=8.015
csp/modifiedRenault/ normalized-renault-mod-48_ext.xml	SAT TT=0.592	SAT TT=2.329 CHECKS=3437 NODES=215	SAT TT=1.667 CHECKS=761 NODES=0	SAT TT=14.922	SAT TT=18.268 CHECKS=41888	SAT TT=7.31 CHECKS=18846	SAT TT=5.113 ASSIGNMENTS=23	SAT TT=5.244 ASSIGNMENTS=27	SAT TT=69.788 CHECKS=41379900 NODES=143	SAT TT=630.193 CHECKS=659834000 NODES=1043850000	SAT TT=487.752 CHECKS=1318350000 NODES=788164	SAT TT=0.627 ASSIGNMENTS=36 CHECKS=2047	SAT TT=0.611 ASSIGNMENTS=36 CHECKS=2047	SAT TT=12.164	SAT TT=11.996	SAT TT=1.243 CHECKS=2088	SAT TT=0.592 ASSIGNMENTS=36 CHECKS=2047	SAT TT=0.698 ASSIGNMENTS=210 CHECKS=11333	SAT TT=5.78	SAT TT=1.497 ASSIGNMENTS=295 CHECKS=44062	SAT TT=0.594 ASSIGNMENTS=36 CHECKS=2047	? TT=59.101	SAT TT=1.432 ASSIGNMENTS=109 CHECKS=20641	SAT TT=7.905	SAT TT=8.116
csp/modifiedRenault/ normalized-renault-mod-49_ext.xml	SAT TT=0.624	SAT TT=2.014 CHECKS=3357 NODES=425	SAT TT=2.105 CHECKS=3797 NODES=366	SAT TT=15.988	SAT TT=22.682 CHECKS=90177	SAT TT=5.448 CHECKS=16965	SAT TT=4.892 ASSIGNMENTS=84	SAT TT=4.3 ASSIGNMENTS=29	SAT TT=67.659 CHECKS=39983200 NODES=114	SAT TT=877.011 CHECKS=1065020000 NODES=1321950000	? (TO) TT=1800.02	SAT TT=0.632 ASSIGNMENTS=112 CHECKS=3602	SAT TT=0.669 ASSIGNMENTS=112 CHECKS=3602	SAT TT=11.208	SAT TT=11.478	SAT TT=1.061 CHECKS=3838	SAT TT=0.645 ASSIGNMENTS=116 CHECKS=3633	SAT TT=1.669 ASSIGNMENTS=2798 CHECKS=92527	SAT TT=5.34	SAT TT=1.022 ASSIGNMENTS=527 CHECKS=41799	SAT TT=0.624 ASSIGNMENTS=112 CHECKS=3602	? TT=49.9	SAT TT=1.589 ASSIGNMENTS=378 CHECKS=210626	SAT TT=8.689	SAT TT=7.94
csp/modifiedRenault/ normalized-renault-mod-4_ext.xml	SAT TT=0.564	SAT TT=1.801 CHECKS=1715 NODES=171	SAT TT=1.734 CHECKS=1067 NODES=0	SAT TT=14.558	SAT TT=12.675 CHECKS=32936	SAT TT=6.182 CHECKS=14063	SAT TT=4.465 ASSIGNMENTS=26	SAT TT=4.451 ASSIGNMENTS=37	SAT TT=68.47 CHECKS=39876300 NODES=114	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=0.609 ASSIGNMENTS=28 CHECKS=1322	SAT TT=0.564 ASSIGNMENTS=28 CHECKS=1322	SAT TT=12.157	SAT TT=11.133	SAT TT=1.112 CHECKS=1305	SAT TT=0.568 ASSIGNMENTS=28 CHECKS=1322	SAT TT=0.64 ASSIGNMENTS=41 CHECKS=1284	SAT TT=5.566	SAT TT=1.05 ASSIGNMENTS=478 CHECKS=34365	SAT TT=0.615 ASSIGNMENTS=28 CHECKS=1322	? TT=48.2	SAT TT=1.423 ASSIGNMENTS=113 CHECKS=21818	SAT TT=7.928	SAT TT=8.177
csp/modifiedRenault/ normalized-renault-mod-5_ext.xml	UNSAT TT=0.641	UNSAT TT=2.218 CHECKS=3925 NODES=344	UNSAT TT=2.108 CHECKS=1891 NODES=0	? (TO) TT=1800.1	UNSAT TT=21.484 CHECKS=60361	UNSAT TT=9.485 CHECKS=28966	UNSAT TT=3.834 ASSIGNMENTS=0	UNSAT TT=3.908 ASSIGNMENTS=0	UNSAT TT=70.983 CHECKS=39980700 NODES=31	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.662 ASSIGNMENTS=116 CHECKS=6288	UNSAT TT=0.662 ASSIGNMENTS=116 CHECKS=6288	UNSAT TT=9.453	UNSAT TT=8.613	UNSAT TT=1.077 CHECKS=12537	UNSAT TT=0.734 ASSIGNMENTS=293 CHECKS=15975	UNSAT TT=2.55 ASSIGNMENTS=4920 CHECKS=141554	UNSAT TT=4.794	UNSAT TT=0.997 ASSIGNMENTS=356 CHECKS=34272	UNSAT TT=0.641 ASSIGNMENTS=116 CHECKS=6288	? TT=66.33	UNSAT TT=1.672 ASSIGNMENTS=229 CHECKS=245928	UNSAT TT=7.828	UNSAT TT=8.189
csp/modifiedRenault/ normalized-renault-mod-9_ext.xml	SAT TT=0.584	SAT TT=2.091 CHECKS=3556 NODES=571	SAT TT=2.277 CHECKS=3714 NODES=537	SAT TT=915.421	SAT TT=6.137 CHECKS=17926	SAT TT=7.846 CHECKS=17407	SAT TT=4.463 ASSIGNMENTS=28	SAT TT=4.802 ASSIGNMENTS=222	SAT TT=69.128 CHECKS=41076000 NODES=161	SAT TT=1651.47 CHECKS=728258000 NODES=-1120970000	? (TO) TT=1800.04	SAT TT=0.602 ASSIGNMENTS=44 CHECKS=1756	SAT TT=0.6 ASSIGNMENTS=44 CHECKS=1756	SAT TT=12.812	SAT TT=10.984	SAT TT=0.996 CHECKS=2421	SAT TT=0.62 ASSIGNMENTS=44 CHECKS=1756	SAT TT=2.784 ASSIGNMENTS=5054 CHECKS=151671	SAT TT=5.512	SAT TT=1.365 ASSIGNMENTS=443 CHECKS=44815	SAT TT=0.584 ASSIGNMENTS=44 CHECKS=1756	? TT=69.38	SAT TT=1.516 ASSIGNMENTS=112 CHECKS=21611	SAT TT=8.019	SAT TT=7.796
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdVg/ normalized-crossword-m1c-ogd-vg10-10_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (MO) TT=40.13	? (TO) TT=1800.11	? (TO) TT=1800.08	? TT=40.428	? (TO) TT=1800.04	? (TO) TT=1800.18	? (TO) TT=1800.15
csp/ogdVg/ normalized-crossword-m1c-ogd-vg10-11_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (MO) TT=37.05	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=34.472	? (TO) TT=1800.01	? (MO) TT=6.199	? (TO) TT=1800.26
csp/ogdVg/ normalized-crossword-m1c-ogd-vg10-12_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? (MO) TT=36.23	? (TO) TT=1800.04	? (TO) TT=1800.03	? TT=35.852	? (TO) TT=1800.06	? (TO) TT=1800.92	? (TO) TT=1800.18
csp/ogdVg/ normalized-crossword-m1c-ogd-vg10-13_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.03	? (MO) TT=34.91	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=43.803	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.2
csp/ogdVg/ normalized-crossword-m1c-ogd-vg10-14_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	? (MO) TT=31.91	? (TO) TT=1800.01	? (TO) TT=1800.06	? TT=35.561	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.19
csp/ogdVg/ normalized-crossword-m1c-ogd-vg11-11_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	? (MO) TT=37.85	? (TO) TT=1800.04	? (TO) TT=1800.06	? TT=31.551	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.42
csp/ogdVg/ normalized-crossword-m1c-ogd-vg11-12_ext.xml		? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800.19	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (MO) TT=39.44	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=33.193	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.19
csp/ogdVg/ normalized-crossword-m1c-ogd-vg11-13_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.07	? (MO) TT=35.26	? (TO) TT=1800.02	? (TO) TT=1800.03	? TT=44.875	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.2
csp/ogdVg/ normalized-crossword-m1c-ogd-vg11-14_ext.xml	UNSAT TT=1512.65	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=1512.65 ASSIGNMENTS=16057 CHECKS=3278980	? (TO) TT=1800.06	? (MO) TT=32.87	UNSAT TT=1689.84 ASSIGNMENTS=19978 CHECKS=4017500	UNSAT TT=1719.67 ASSIGNMENTS=17198 CHECKS=3506410	? TT=37.112	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.21
csp/ogdVg/ normalized-crossword-m1c-ogd-vg11-15_ext.xml	UNSAT TT=518.23	UNSAT TT=979.969 CHECKS=2573 NODES=8237	UNSAT TT=929.901 CHECKS=3002 NODES=7899	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.1	UNSAT TT=1149.16 ASSIGNMENTS=2757	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=1301.97 ASSIGNMENTS=6522 CHECKS=1319550	UNSAT TT=972.559 ASSIGNMENTS=8237 CHECKS=2573	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=518.23 ASSIGNMENTS=6440 CHECKS=1290740	UNSAT TT=786.378 ASSIGNMENTS=10533 CHECKS=1887510	? (MO) TT=33.28	UNSAT TT=617.418 ASSIGNMENTS=8433 CHECKS=1636530	UNSAT TT=572.414 ASSIGNMENTS=6522 CHECKS=1319550	? TT=43.655	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.19
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdVg/ normalized-crossword-m1c-ogd-vg12-12_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	? (MO) TT=39.78	? (TO) TT=1800.09	? (TO) TT=1800.05	? TT=97.335	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.08
csp/ogdVg/ normalized-crossword-m1c-ogd-vg12-13_ext.xml	UNSAT TT=1417.23	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=1530.36 ASSIGNMENTS=17381 CHECKS=3221680	? (TO) TT=1800.1	? (MO) TT=32.46	? (TO) TT=1800.07	UNSAT TT=1417.23 ASSIGNMENTS=16474 CHECKS=3045320	? TT=78.954	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.19
csp/ogdVg/ normalized-crossword-m1c-ogd-vg12-14_ext.xml	UNSAT TT=669.147	UNSAT TT=1239.15 CHECKS=806 NODES=11735	UNSAT TT=1231.95 CHECKS=1057 NODES=11511	? (TO) TT=1800.18	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=1298.55 ASSIGNMENTS=11735 CHECKS=806	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=724.573 ASSIGNMENTS=8505 CHECKS=1691960	UNSAT TT=1041.51 ASSIGNMENTS=13373 CHECKS=2426480	? (MO) TT=33.5	UNSAT TT=775.6 ASSIGNMENTS=10227 CHECKS=1996470	UNSAT TT=669.147 ASSIGNMENTS=8295 CHECKS=1659000	? TT=97.085	? (TO) TT=1800.07	? (TO) TT=1800.49	? (TO) TT=1800.14
csp/ogdVg/ normalized-crossword-m1c-ogd-vg12-15_ext.xml	UNSAT TT=287.458	UNSAT TT=429.469 CHECKS=33 NODES=4293	UNSAT TT=426.248 CHECKS=40 NODES=3940	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=601.768 ASSIGNMENTS=1269	? (TO) TT=1800.14	UNSAT TT=1100.52 CHECKS=0 NODES=5464	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=424.163 ASSIGNMENTS=4293 CHECKS=33	UNSAT TT=412.483 ASSIGNMENTS=4293 CHECKS=33	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=796.511 CHECKS=694107	UNSAT TT=305.904 ASSIGNMENTS=4107 CHECKS=815376	UNSAT TT=450.663 ASSIGNMENTS=6829 CHECKS=1178890	? (MO) TT=30.52	UNSAT TT=330.881 ASSIGNMENTS=5241 CHECKS=1015330	UNSAT TT=287.458 ASSIGNMENTS=3479 CHECKS=705376	? TT=88.302	? (TO) TT=1800.02	? (TO) TT=1800.21	? (TO) TT=1800.14
csp/ogdVg/ normalized-crossword-m1c-ogd-vg13-13_ext.xml	UNSAT TT=380.573	UNSAT TT=680.515 CHECKS=2148 NODES=8731	UNSAT TT=678.507 CHECKS=264 NODES=8836	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.17	UNSAT TT=1071.35 ASSIGNMENTS=2465	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=604.797 ASSIGNMENTS=7947 CHECKS=2323	UNSAT TT=613.536 ASSIGNMENTS=7947 CHECKS=2323	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=1458.23 CHECKS=1941580	UNSAT TT=380.573 ASSIGNMENTS=6039 CHECKS=1111060	UNSAT TT=791.277 ASSIGNMENTS=11790 CHECKS=1996590	? (MO) TT=34.65	UNSAT TT=608.191 ASSIGNMENTS=10577 CHECKS=1901610	UNSAT TT=419.765 ASSIGNMENTS=6063 CHECKS=1114500	? TT=86.202	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.21
csp/ogdVg/ normalized-crossword-m1c-ogd-vg13-14_ext.xml	UNSAT TT=162.52	UNSAT TT=268.483 CHECKS=42 NODES=3371	UNSAT TT=360.628 CHECKS=44 NODES=3586	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=688.568 ASSIGNMENTS=1522	? (TO) TT=1800.09	UNSAT TT=818.118 CHECKS=0 NODES=5059	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=285.049 ASSIGNMENTS=3371 CHECKS=42	UNSAT TT=280.857 ASSIGNMENTS=3371 CHECKS=42	? (TO) TT=1800.1	UNSAT TT=1788.31	UNSAT TT=793.802 CHECKS=984750	UNSAT TT=186.72 ASSIGNMENTS=2859 CHECKS=525846	UNSAT TT=440.328 ASSIGNMENTS=7395 CHECKS=1283530	? (MO) TT=29.25	UNSAT TT=253.248 ASSIGNMENTS=4817 CHECKS=927999	UNSAT TT=162.52 ASSIGNMENTS=2811 CHECKS=518691	? TT=82.81	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.12
csp/ogdVg/ normalized-crossword-m1c-ogd-vg13-15_ext.xml	UNSAT TT=63.781	UNSAT TT=93.138 CHECKS=0 NODES=1269	UNSAT TT=139.364 CHECKS=0 NODES=1498	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=211.223 ASSIGNMENTS=498	? (TO) TT=1800.13	UNSAT TT=283.088 CHECKS=0 NODES=1748	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=108.445 ASSIGNMENTS=1269 CHECKS=0	UNSAT TT=100.427 ASSIGNMENTS=1269 CHECKS=0	UNSAT TT=742.887	UNSAT TT=663.537	UNSAT TT=206.048 CHECKS=233272	UNSAT TT=63.781 ASSIGNMENTS=1215 CHECKS=227538	UNSAT TT=260.15 ASSIGNMENTS=4885 CHECKS=805937	? (MO) TT=28.03	UNSAT TT=129.861 ASSIGNMENTS=3296 CHECKS=641554	UNSAT TT=68.531 ASSIGNMENTS=1273 CHECKS=231987	? TT=85.028	? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.17
csp/ogdVg/ normalized-crossword-m1c-ogd-vg13-16_ext.xml	UNSAT TT=4.545	UNSAT TT=14.879 CHECKS=0 NODES=160	UNSAT TT=49.367 CHECKS=0 NODES=99	? (TO) TT=1800.06	UNSAT TT=309.986 CHECKS=31605	UNSAT TT=363.928 CHECKS=28628	UNSAT TT=76.441 ASSIGNMENTS=45	UNSAT TT=432.115 ASSIGNMENTS=554	UNSAT TT=29.286 CHECKS=0 NODES=202	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=21.958 ASSIGNMENTS=160 CHECKS=0	UNSAT TT=21.11 ASSIGNMENTS=160 CHECKS=0	UNSAT TT=176.18	UNSAT TT=153.466	UNSAT TT=18.774 CHECKS=18544	UNSAT TT=4.545 ASSIGNMENTS=99 CHECKS=21592	UNSAT TT=155.696 ASSIGNMENTS=3544 CHECKS=627492	? (MO) TT=26.82	UNSAT TT=87.54 ASSIGNMENTS=2656 CHECKS=491936	UNSAT TT=5.48 ASSIGNMENTS=116 CHECKS=22862	? TT=89.673	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.1
csp/ogdVg/ normalized-crossword-m1c-ogd-vg14-15_ext.xml	UNSAT TT=35.759	UNSAT TT=39.124 CHECKS=0 NODES=771	UNSAT TT=93.436 CHECKS=0 NODES=1033	? (TO) TT=1800.17	UNSAT TT=645.513 CHECKS=93187	UNSAT TT=1090.35 CHECKS=165861	UNSAT TT=126.418 ASSIGNMENTS=267	? (TO) TT=1800.12	UNSAT TT=137.913 CHECKS=0 NODES=1141	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=47.584 ASSIGNMENTS=771 CHECKS=0	UNSAT TT=49.214 ASSIGNMENTS=771 CHECKS=0	UNSAT TT=817.899	UNSAT TT=959.646	UNSAT TT=196.57 CHECKS=246486	UNSAT TT=35.759 ASSIGNMENTS=785 CHECKS=163768	UNSAT TT=162.593 ASSIGNMENTS=4410 CHECKS=785270	? (MO) TT=24.62	UNSAT TT=120.796 ASSIGNMENTS=3294 CHECKS=718130	UNSAT TT=35.812 ASSIGNMENTS=799 CHECKS=167426	? TT=102.436	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.18
csp/ogdVg/ normalized-crossword-m1c-ogd-vg14-17_ext.xml	UNSAT TT=1.498	UNSAT TT=3.017 CHECKS=0 NODES=39	UNSAT TT=12.433 CHECKS=0 NODES=0	? (TO) TT=1800.09	UNSAT TT=80.385 CHECKS=11658	UNSAT TT=58.901 CHECKS=11341	UNSAT TT=68.38 ASSIGNMENTS=0	UNSAT TT=86.127 ASSIGNMENTS=51	UNSAT TT=10.613 CHECKS=0 NODES=69	? (TO) TT=1800	? (TO) TT=1800.1	UNSAT TT=10.069 ASSIGNMENTS=39 CHECKS=0	UNSAT TT=1.579 ASSIGNMENTS=44 CHECKS=9327	UNSAT TT=141.446	UNSAT TT=113.431	UNSAT TT=11.653 CHECKS=17264	UNSAT TT=1.904 ASSIGNMENTS=53 CHECKS=11269	UNSAT TT=100.213 ASSIGNMENTS=3324 CHECKS=636470	? (MO) TT=23.21	UNSAT TT=4.509 ASSIGNMENTS=176 CHECKS=27329	UNSAT TT=1.498 ASSIGNMENTS=44 CHECKS=9327	? TT=82.806	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdVg/ normalized-crossword-m1c-ogd-vg15-16_ext.xml	UNSAT TT=1.089	UNSAT TT=1.997 CHECKS=0 NODES=38	UNSAT TT=4.383 CHECKS=0 NODES=0	? (TO) TT=1800.14	UNSAT TT=52.729 CHECKS=19297	UNSAT TT=32.462 CHECKS=13101	UNSAT TT=66.345 ASSIGNMENTS=0	UNSAT TT=60.415 ASSIGNMENTS=0	UNSAT TT=6.037 CHECKS=0 NODES=62	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=1.089 ASSIGNMENTS=30 CHECKS=8031	UNSAT TT=1.106 ASSIGNMENTS=30 CHECKS=8031	UNSAT TT=157.003	UNSAT TT=113.356	UNSAT TT=4.699 CHECKS=6148	UNSAT TT=1.152 ASSIGNMENTS=36 CHECKS=8531	UNSAT TT=79.498 ASSIGNMENTS=3305 CHECKS=654744	UNSAT TT=55.665	UNSAT TT=9.049 ASSIGNMENTS=459 CHECKS=74787	UNSAT TT=1.136 ASSIGNMENTS=30 CHECKS=8031	? TT=79.683	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.07
csp/ogdVg/ normalized-crossword-m1c-ogd-vg15-19_ext.xml	UNSAT TT=0.183	UNSAT TT=1.082 CHECKS=0 NODES=0	UNSAT TT=1.269 CHECKS=0 NODES=0	? (TO) TT=1800.18	UNSAT TT=5.31 CHECKS=88	UNSAT TT=5.295 CHECKS=88	UNSAT TT=0.818 ASSIGNMENTS=0	UNSAT TT=0.913 ASSIGNMENTS=0	UNSAT TT=1.809 CHECKS=0 NODES=0	UNSAT TT=1.722 CHECKS=0 NODES=0	UNSAT TT=1.773 CHECKS=0 NODES=0	UNSAT TT=0.214 ASSIGNMENTS=0 CHECKS=453	UNSAT TT=0.193 ASSIGNMENTS=0 CHECKS=453	UNSAT TT=87.539	UNSAT TT=63.788	UNSAT TT=0.81 CHECKS=596	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=453	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=453	UNSAT TT=17.507	UNSAT TT=0.183 ASSIGNMENTS=0 CHECKS=453	UNSAT TT=0.201 ASSIGNMENTS=0 CHECKS=453	? TT=84.723	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.15
csp/ogdVg/ normalized-crossword-m1c-ogd-vg16-16_ext.xml	UNSAT TT=0.278	UNSAT TT=1.045 CHECKS=0 NODES=8	UNSAT TT=1.052 CHECKS=0 NODES=0	? (TO) TT=1800.17	UNSAT TT=5.664 CHECKS=4213	UNSAT TT=4.838 CHECKS=3992	UNSAT TT=1.549 ASSIGNMENTS=0	UNSAT TT=1.646 ASSIGNMENTS=0	UNSAT TT=0.967 CHECKS=0 NODES=11	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.314 ASSIGNMENTS=6 CHECKS=2917	UNSAT TT=0.318 ASSIGNMENTS=6 CHECKS=2917	UNSAT TT=58.762	UNSAT TT=50.741	UNSAT TT=0.619 CHECKS=1511	UNSAT TT=0.278 ASSIGNMENTS=7 CHECKS=3034	UNSAT TT=1.431 ASSIGNMENTS=89 CHECKS=17835	UNSAT TT=5.784	UNSAT TT=0.4 ASSIGNMENTS=22 CHECKS=3517	UNSAT TT=0.304 ASSIGNMENTS=6 CHECKS=2917	? TT=87.061	? (TO) TT=1800.08	UNSAT TT=794.444	? (TO) TT=1800.07
csp/ogdVg/ normalized-crossword-m1c-ogd-vg16-18_ext.xml	UNSAT TT=0.106	UNSAT TT=0.857 CHECKS=0 NODES=0	UNSAT TT=0.846 CHECKS=0 NODES=0	? (TO) TT=1800.08	UNSAT TT=1.039 CHECKS=102	UNSAT TT=1.019 CHECKS=102	UNSAT TT=0.621 ASSIGNMENTS=0	UNSAT TT=0.656 ASSIGNMENTS=0	UNSAT TT=0.864 CHECKS=0 NODES=0	UNSAT TT=0.701 CHECKS=0 NODES=0	UNSAT TT=0.7 CHECKS=0 NODES=0	UNSAT TT=0.123 ASSIGNMENTS=0 CHECKS=539	UNSAT TT=0.119 ASSIGNMENTS=0 CHECKS=539	UNSAT TT=40.317	UNSAT TT=30.401	UNSAT TT=0.143 CHECKS=138	UNSAT TT=0.109 ASSIGNMENTS=0 CHECKS=539	UNSAT TT=0.112 ASSIGNMENTS=0 CHECKS=539	UNSAT TT=4.462	UNSAT TT=0.106 ASSIGNMENTS=0 CHECKS=539	UNSAT TT=0.11 ASSIGNMENTS=0 CHECKS=539	? TT=82.142	? (TO) TT=1800.03	UNSAT TT=411.384	? (TO) TT=1800.1
csp/ogdVg/ normalized-crossword-m1c-ogd-vg16-20_ext.xml	UNSAT TT=0.087	UNSAT TT=1 CHECKS=0 NODES=0	UNSAT TT=0.878 CHECKS=0 NODES=0	UNSAT TT=72.162	UNSAT TT=1.036 CHECKS=57	UNSAT TT=1.042 CHECKS=57	UNSAT TT=0.593 ASSIGNMENTS=0	UNSAT TT=0.72 ASSIGNMENTS=0	UNSAT TT=0.627 CHECKS=0 NODES=0	UNSAT TT=0.736 CHECKS=0 NODES=0	UNSAT TT=0.603 CHECKS=0 NODES=0	UNSAT TT=0.099 ASSIGNMENTS=0 CHECKS=77	UNSAT TT=0.098 ASSIGNMENTS=0 CHECKS=77	UNSAT TT=35.999	UNSAT TT=27.343	UNSAT TT=0.113 CHECKS=77	UNSAT TT=0.091 ASSIGNMENTS=0 CHECKS=77	UNSAT TT=0.087 ASSIGNMENTS=0 CHECKS=77	UNSAT TT=3.953	UNSAT TT=0.087 ASSIGNMENTS=0 CHECKS=77	UNSAT TT=0.088 ASSIGNMENTS=0 CHECKS=77	? TT=74.452	? (TO) TT=1800.05	UNSAT TT=425.284	UNSAT TT=489.767
csp/ogdVg/ normalized-crossword-m1c-ogd-vg4-4_ext.xml	SAT TT=0.01	SAT TT=0.691 CHECKS=9 NODES=16	SAT TT=0.687 CHECKS=9 NODES=0	SAT TT=0.25	SAT TT=0.245 CHECKS=590	SAT TT=0.229 CHECKS=534	SAT TT=0.745 ASSIGNMENTS=15	SAT TT=0.706 ASSIGNMENTS=13	SAT TT=1.251 CHECKS=694140 NODES=16	SAT TT=2.683 CHECKS=19790600 NODES=12900000	SAT TT=15.238 CHECKS=48921900 NODES=3853	SAT TT=0.023 ASSIGNMENTS=12 CHECKS=185	SAT TT=0.024 ASSIGNMENTS=12 CHECKS=185	SAT TT=4.435	SAT TT=3.641	SAT TT=0.023 CHECKS=76	SAT TT=0.01 ASSIGNMENTS=12 CHECKS=185	SAT TT=0.012 ASSIGNMENTS=10 CHECKS=176	SAT TT=0.62	SAT TT=0.012 ASSIGNMENTS=8 CHECKS=135	SAT TT=0.013 ASSIGNMENTS=12 CHECKS=185	SAT TT=14.725	SAT TT=0.032 ASSIGNMENTS=16 CHECKS=23159	SAT TT=2.021	SAT TT=2.51
csp/ogdVg/ normalized-crossword-m1c-ogd-vg4-6_ext.xml	SAT TT=0.066	SAT TT=0.816 CHECKS=10 NODES=25	SAT TT=1.07 CHECKS=26 NODES=32	SAT TT=2.895	SAT TT=1.077 CHECKS=796	SAT TT=0.971 CHECKS=652	SAT TT=1.724 ASSIGNMENTS=13	SAT TT=1.745 ASSIGNMENTS=11	SAT TT=102.039 CHECKS=192408000 NODES=26	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=0.084 ASSIGNMENTS=16 CHECKS=385	SAT TT=0.083 ASSIGNMENTS=16 CHECKS=385	SAT TT=20.325	SAT TT=17.539	SAT TT=0.116 CHECKS=216	SAT TT=0.073 ASSIGNMENTS=16 CHECKS=385	SAT TT=0.077 ASSIGNMENTS=18 CHECKS=523	SAT TT=1.749	SAT TT=0.066 ASSIGNMENTS=20 CHECKS=448	SAT TT=0.071 ASSIGNMENTS=16 CHECKS=385	? TT=109.604	SAT TT=0.243 ASSIGNMENTS=29 CHECKS=250750	SAT TT=46.228	SAT TT=47.527
csp/ogdVg/ normalized-crossword-m1c-ogd-vg4-8_ext.xml	SAT TT=0.36	SAT TT=1.038 CHECKS=46 NODES=41	SAT TT=1.406 CHECKS=50 NODES=69	SAT TT=403.61	SAT TT=7.585 CHECKS=1794	SAT TT=5.754 CHECKS=1277	SAT TT=5.99 ASSIGNMENTS=22	SAT TT=9.39 ASSIGNMENTS=35	SAT TT=2.502 CHECKS=558265 NODES=35	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=0.581 ASSIGNMENTS=52 CHECKS=3033	SAT TT=0.546 ASSIGNMENTS=52 CHECKS=3033	SAT TT=168.189	SAT TT=77.766	SAT TT=0.36 CHECKS=3334	SAT TT=0.531 ASSIGNMENTS=48 CHECKS=2783	SAT TT=1.25 ASSIGNMENTS=105 CHECKS=5476	SAT TT=6.164	SAT TT=4.495 ASSIGNMENTS=627 CHECKS=28771	SAT TT=0.588 ASSIGNMENTS=52 CHECKS=3033	? TT=95.061	SAT TT=987.208 ASSIGNMENTS=1085 CHECKS=294168000	SAT TT=1065.92	SAT TT=1072.48
csp/ogdVg/ normalized-crossword-m1c-ogd-vg5-7_ext.xml	SAT TT=0.268	SAT TT=0.976 CHECKS=28 NODES=42	SAT TT=1.801 CHECKS=85 NODES=253	SAT TT=1358.65	SAT TT=7.951 CHECKS=6263	SAT TT=8.496 CHECKS=4312	SAT TT=11.171 ASSIGNMENTS=226	SAT TT=4.579 ASSIGNMENTS=12	SAT TT=31.097 CHECKS=20962400 NODES=66	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=1.13 ASSIGNMENTS=193 CHECKS=12016	SAT TT=1.098 ASSIGNMENTS=193 CHECKS=12016	SAT TT=927.074	SAT TT=1002.72	SAT TT=0.268 CHECKS=2595	SAT TT=0.948 ASSIGNMENTS=156 CHECKS=10360	SAT TT=0.376 ASSIGNMENTS=61 CHECKS=3190	SAT TT=5.024	SAT TT=2.861 ASSIGNMENTS=696 CHECKS=32108	SAT TT=1.113 ASSIGNMENTS=193 CHECKS=12016	? TT=90.888	SAT TT=0.349 ASSIGNMENTS=46 CHECKS=44371	SAT TT=352.155	SAT TT=372.204
csp/ogdVg/ normalized-crossword-m1c-ogd-vg5-8_ext.xml	SAT TT=0.231	SAT TT=1.863 CHECKS=170 NODES=272	SAT TT=1.612 CHECKS=61 NODES=60	SAT TT=1362.19	SAT TT=14.587 CHECKS=4896	SAT TT=27.049 CHECKS=9235	SAT TT=181.325 ASSIGNMENTS=1990	SAT TT=16.779 ASSIGNMENTS=93	SAT TT=33.553 CHECKS=19330300 NODES=58	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=0.255 ASSIGNMENTS=15 CHECKS=579	SAT TT=0.257 ASSIGNMENTS=15 CHECKS=579	? (TO) TT=1800.05	SAT TT=725.525	SAT TT=0.41 CHECKS=3323	SAT TT=0.231 ASSIGNMENTS=15 CHECKS=579	SAT TT=16.626 ASSIGNMENTS=1450 CHECKS=79113	SAT TT=8.181	SAT TT=82.183 ASSIGNMENTS=6546 CHECKS=506737	SAT TT=0.235 ASSIGNMENTS=15 CHECKS=579	? (MO) TT=42.539	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdVg/ normalized-crossword-m1c-ogd-vg6-10_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.02	? TT=82.691	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02
csp/ogdVg/ normalized-crossword-m1c-ogd-vg6-6_ext.xml	SAT TT=0.141	SAT TT=0.911 CHECKS=13 NODES=36	SAT TT=0.842 CHECKS=13 NODES=0	SAT TT=21.019	SAT TT=7.185 CHECKS=9263	SAT TT=3.211 CHECKS=1168	SAT TT=4.186 ASSIGNMENTS=21	SAT TT=3.969 ASSIGNMENTS=14	SAT TT=218.917 CHECKS=671845000 NODES=37	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.181 ASSIGNMENTS=36 CHECKS=1717	SAT TT=0.179 ASSIGNMENTS=36 CHECKS=1717	SAT TT=327.045	SAT TT=51.826	SAT TT=0.141 CHECKS=584	SAT TT=0.323 ASSIGNMENTS=67 CHECKS=3422	SAT TT=1.746 ASSIGNMENTS=451 CHECKS=21794	SAT TT=4.393	SAT TT=2.951 ASSIGNMENTS=844 CHECKS=40139	SAT TT=0.171 ASSIGNMENTS=36 CHECKS=1717	? TT=76.039	SAT TT=11.94 ASSIGNMENTS=128 CHECKS=16203500	SAT TT=131.418	SAT TT=160.795
csp/ogdVg/ normalized-crossword-m1c-ogd-vg6-7_ext.xml	SAT TT=0.431	SAT TT=1.521 CHECKS=82 NODES=276	SAT TT=1.646 CHECKS=53 NODES=60	SAT TT=305.388	SAT TT=287.031 CHECKS=178635	SAT TT=156.207 CHECKS=111363	SAT TT=236.656 ASSIGNMENTS=3885	SAT TT=12.664 ASSIGNMENTS=79	SAT TT=198.167 CHECKS=761548000 NODES=175	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=8.947 ASSIGNMENTS=276 CHECKS=82	SAT TT=8.95 ASSIGNMENTS=276 CHECKS=82	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=0.431 CHECKS=3884	SAT TT=16.602 ASSIGNMENTS=1624 CHECKS=125302	SAT TT=28.844 ASSIGNMENTS=3687 CHECKS=208875	SAT TT=25.203	SAT TT=19.255 ASSIGNMENTS=2061 CHECKS=148616	SAT TT=13.394 ASSIGNMENTS=1437 CHECKS=112167	? TT=91.293	SAT TT=1560.45 ASSIGNMENTS=19086 CHECKS=201007000	SAT TT=441.144	SAT TT=709.33
csp/ogdVg/ normalized-crossword-m1c-ogd-vg6-8_ext.xml	SAT TT=4.418	SAT TT=5.613 CHECKS=6280 NODES=3643	SAT TT=4.418 CHECKS=980 NODES=1160	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=164.195 CHECKS=54840	SAT TT=16.056 ASSIGNMENTS=99	SAT TT=1352.11 ASSIGNMENTS=6159	SAT TT=1510.03 CHECKS=13889200000 NODES=18944	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=13.329 ASSIGNMENTS=3643 CHECKS=6280	SAT TT=13.892 ASSIGNMENTS=3643 CHECKS=6280	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=23.564 CHECKS=635281	SAT TT=49.06 ASSIGNMENTS=2351 CHECKS=185680	SAT TT=957.925 ASSIGNMENTS=44839 CHECKS=3920490	SAT TT=284.547	SAT TT=195.546 ASSIGNMENTS=9679 CHECKS=846691	SAT TT=57.258 ASSIGNMENTS=2939 CHECKS=216796	? TT=100.943	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05
csp/ogdVg/ normalized-crossword-m1c-ogd-vg6-9_ext.xml	SAT TT=36.449	SAT TT=224.14 CHECKS=360767 NODES=175034	SAT TT=193.642 CHECKS=310908 NODES=131717	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800	SAT TT=234.109 ASSIGNMENTS=175034 CHECKS=360767	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=36.449 CHECKS=785238	SAT TT=1365.79 ASSIGNMENTS=44721 CHECKS=3897980	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=1390.37 ASSIGNMENTS=46379 CHECKS=4046340	? TT=100.63	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/ogdVg/ normalized-crossword-m1c-ogd-vg7-10_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=118.79	? (TO) TT=1800.07	? (TO) TT=1800.21	? (TO) TT=1800.02
csp/ogdVg/ normalized-crossword-m1c-ogd-vg7-11_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=120.365	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09
csp/ogdVg/ normalized-crossword-m1c-ogd-vg7-7_ext.xml	SAT TT=1.082	SAT TT=5.29 CHECKS=3169 NODES=2303	SAT TT=2.059 CHECKS=15 NODES=134	SAT TT=1454.8	SAT TT=455.258 CHECKS=383399	SAT TT=38.587 CHECKS=19400	? (TO) TT=1800.15	SAT TT=46.698 ASSIGNMENTS=337	SAT TT=9.241 CHECKS=0 NODES=1352	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=13.075 ASSIGNMENTS=2296 CHECKS=3562	SAT TT=13.049 ASSIGNMENTS=2296 CHECKS=3562	? (TO) TT=1800	SAT TT=1001.96	SAT TT=1.082 CHECKS=21133	SAT TT=8.435 ASSIGNMENTS=553 CHECKS=60632	SAT TT=43.142 ASSIGNMENTS=4112 CHECKS=270622	SAT TT=11.535	SAT TT=849.349 ASSIGNMENTS=67661 CHECKS=5853160	SAT TT=9.894 ASSIGNMENTS=595 CHECKS=63657	? TT=80.978	SAT TT=74.075 ASSIGNMENTS=451 CHECKS=1149820	SAT TT=1036.91	? (TO) TT=1800.03
csp/ogdVg/ normalized-crossword-m1c-ogd-vg7-8_ext.xml	SAT TT=702.439	SAT TT=702.439 CHECKS=1229680 NODES=415397	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? TT=82.491	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02
csp/ogdVg/ normalized-crossword-m1c-ogd-vg7-9_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.1	? TT=101.094	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.06
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdVg/ normalized-crossword-m1c-ogd-vg8-10_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (MO) TT=34.38	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=39.628	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.2
csp/ogdVg/ normalized-crossword-m1c-ogd-vg8-11_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.09	? (MO) TT=33.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=33.904	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.15
csp/ogdVg/ normalized-crossword-m1c-ogd-vg8-12_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (MO) TT=33.17	? (TO) TT=1800.08	? (TO) TT=1800.08	? TT=33.598	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.15
csp/ogdVg/ normalized-crossword-m1c-ogd-vg8-8_ext.xml	SAT TT=24.369	SAT TT=85.533 CHECKS=36691 NODES=19214	SAT TT=1521.21 CHECKS=1227840 NODES=423141	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.17	SAT TT=63.225 ASSIGNMENTS=108	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=24.369 ASSIGNMENTS=3194 CHECKS=4324	SAT TT=24.756 ASSIGNMENTS=3194 CHECKS=4324	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=737.285 ASSIGNMENTS=19240 CHECKS=2077540	? (TO) TT=1800.04	SAT TT=30.52	SAT TT=758.225 ASSIGNMENTS=20687 CHECKS=2221110	SAT TT=758.685 ASSIGNMENTS=18692 CHECKS=2090520	? TT=35.713	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.03
csp/ogdVg/ normalized-crossword-m1c-ogd-vg9-10_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.02	? (MO) TT=36.71	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=31.35	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.03
csp/ogdVg/ normalized-crossword-m1c-ogd-vg9-12_ext.xml		? (TO) TT=1800.04	? (MO) TT=1.371	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (MO) TT=32.5	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=33.512	? (TO) TT=1800.05	? (TO) TT=1800.19	? (TO) TT=1800.12
csp/ogdVg/ normalized-crossword-m1c-ogd-vg9-13_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.06	? (MO) TT=32.94	? (TO) TT=1800.1	? (TO) TT=1800.04	? TT=38.863	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.13
csp/ogdVg/ normalized-crossword-m1c-ogd-vg9-9_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (MO) TT=36.29	? (TO) TT=1800.05	? (TO) TT=1800.04	? TT=28.965	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.02
csp/renault/ normalized-renault_ext.xml	SAT TT=0.548	SAT TT=1.578 CHECKS=313 NODES=101	SAT TT=1.806 CHECKS=377 NODES=0	SAT TT=15.428	SAT TT=5.948 CHECKS=11142	SAT TT=4.777 CHECKS=8696	SAT TT=4.408 ASSIGNMENTS=16	SAT TT=4.319 ASSIGNMENTS=36	SAT TT=69.752 CHECKS=39909200 NODES=101	SAT TT=62.978 CHECKS=47007700 NODES=101700000	SAT TT=306.893 CHECKS=735698000 NODES=60086	SAT TT=0.548 ASSIGNMENTS=18 CHECKS=741	SAT TT=0.583 ASSIGNMENTS=18 CHECKS=741	SAT TT=10.791	SAT TT=10.169	SAT TT=1.12 CHECKS=643	SAT TT=0.581 ASSIGNMENTS=18 CHECKS=741	SAT TT=0.607 ASSIGNMENTS=27 CHECKS=1061	SAT TT=5.03	SAT TT=0.582 ASSIGNMENTS=23 CHECKS=653	SAT TT=0.573 ASSIGNMENTS=18 CHECKS=741	? TT=87.525	SAT TT=1.418 ASSIGNMENTS=101 CHECKS=19797	SAT TT=7.865	SAT TT=7.652
csp/renault/ normalized-renault-mgd_ext.xml	SAT TT=0.539	SAT TT=1.547 CHECKS=383 NODES=101	SAT TT=1.622 CHECKS=642 NODES=0	SAT TT=15.491	SAT TT=5.46 CHECKS=11086	SAT TT=5.709 CHECKS=10432	SAT TT=4.364 ASSIGNMENTS=16	SAT TT=3.804 ASSIGNMENTS=36	SAT TT=70.942 CHECKS=39908900 NODES=101	SAT TT=237.327 CHECKS=79510000 NODES=490800000	SAT TT=676.776 CHECKS=1568950000 NODES=153877	SAT TT=0.549 ASSIGNMENTS=18 CHECKS=685	SAT TT=0.581 ASSIGNMENTS=18 CHECKS=685	SAT TT=10.734	SAT TT=9.999	SAT TT=1.095 CHECKS=580	SAT TT=0.571 ASSIGNMENTS=18 CHECKS=685	SAT TT=0.587 ASSIGNMENTS=31 CHECKS=1046	SAT TT=4.735	SAT TT=0.539 ASSIGNMENTS=23 CHECKS=599	SAT TT=0.573 ASSIGNMENTS=18 CHECKS=685	? TT=78.148	SAT TT=1.42 ASSIGNMENTS=101 CHECKS=19875	SAT TT=7.112	SAT TT=8.015
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukVg/ normalized-crossword-m1c-uk-vg10-10_ext.xml		? (TO) TT=1800.6	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.05	? TT=31.162	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.12
csp/ukVg/ normalized-crossword-m1c-uk-vg10-11_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? TT=35.157	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.16
csp/ukVg/ normalized-crossword-m1c-uk-vg10-13_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.06	? TT=31.954	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.03
csp/ukVg/ normalized-crossword-m1c-uk-vg11-11_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? TT=33.008	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08
csp/ukVg/ normalized-crossword-m1c-uk-vg11-12_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	? TT=31.497	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.14
csp/ukVg/ normalized-crossword-m1c-uk-vg11-13_ext.xml	UNSAT TT=1649.07	UNSAT TT=1649.07 CHECKS=152751 NODES=150905	UNSAT TT=1674.24 CHECKS=156403 NODES=148863	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=1653.12 ASSIGNMENTS=150905 CHECKS=152751	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=35.679	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08
csp/ukVg/ normalized-crossword-m1c-uk-vg11-14_ext.xml	UNSAT TT=508.719	UNSAT TT=543.041 CHECKS=79294 NODES=33832	UNSAT TT=571.055 CHECKS=82460 NODES=34640	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=508.719 ASSIGNMENTS=33832 CHECKS=79294	UNSAT TT=549.733 ASSIGNMENTS=33832 CHECKS=79294	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=1056.8 ASSIGNMENTS=27370 CHECKS=6778740	UNSAT TT=917.131 ASSIGNMENTS=26842 CHECKS=6095480	? (TO) TT=1800.07	UNSAT TT=755.616 ASSIGNMENTS=23182 CHECKS=5251280	UNSAT TT=671.838 ASSIGNMENTS=16800 CHECKS=4301810	? TT=33.808	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.19
csp/ukVg/ normalized-crossword-m1c-uk-vg11-15_ext.xml	UNSAT TT=170.271	UNSAT TT=181.952 CHECKS=17600 NODES=10428	UNSAT TT=209.726 CHECKS=17664 NODES=10421	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=512.519 ASSIGNMENTS=2560	? (TO) TT=1800.11	UNSAT TT=506.182 CHECKS=0 NODES=9296	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=206.757 ASSIGNMENTS=10428 CHECKS=17600	UNSAT TT=192.501 ASSIGNMENTS=10428 CHECKS=17600	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=361.343 CHECKS=919661	UNSAT TT=222.192 ASSIGNMENTS=6231 CHECKS=1600700	UNSAT TT=271.865 ASSIGNMENTS=9617 CHECKS=2006630	? (TO) TT=1800.09	UNSAT TT=238.24 ASSIGNMENTS=8604 CHECKS=1952030	UNSAT TT=170.271 ASSIGNMENTS=5212 CHECKS=1311370	? TT=73.429	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02
csp/ukVg/ normalized-crossword-m1c-uk-vg12-14_ext.xml	UNSAT TT=305.384	UNSAT TT=305.384 CHECKS=30734 NODES=20719	UNSAT TT=317.247 CHECKS=28212 NODES=20620	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.17	UNSAT TT=1114.73 CHECKS=0 NODES=23442	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=323.076 ASSIGNMENTS=20719 CHECKS=30734	UNSAT TT=309.248 ASSIGNMENTS=20719 CHECKS=30734	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=1587.08 CHECKS=2752970	UNSAT TT=486.914 ASSIGNMENTS=14506 CHECKS=3844850	UNSAT TT=536.793 ASSIGNMENTS=17024 CHECKS=4058120	? (TO) TT=1800.07	UNSAT TT=526.095 ASSIGNMENTS=17273 CHECKS=4131640	UNSAT TT=500.137 ASSIGNMENTS=14964 CHECKS=3859320	? TT=86.233	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.19
csp/ukVg/ normalized-crossword-m1c-uk-vg12-16_ext.xml	UNSAT TT=38.795	UNSAT TT=38.795 CHECKS=5 NODES=2209	UNSAT TT=42.263 CHECKS=0 NODES=2398	? (TO) TT=1800.09	UNSAT TT=467.097 CHECKS=264717	UNSAT TT=408.287 CHECKS=234527	UNSAT TT=168.867 ASSIGNMENTS=707	UNSAT TT=939.667 ASSIGNMENTS=2877	UNSAT TT=102.551 CHECKS=0 NODES=2366	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=42.333 ASSIGNMENTS=2209 CHECKS=5	UNSAT TT=42.616 ASSIGNMENTS=2209 CHECKS=5	UNSAT TT=1462.49	? (TO) TT=1800.06	UNSAT TT=257.618 CHECKS=343782	UNSAT TT=53.41 ASSIGNMENTS=2067 CHECKS=519786	UNSAT TT=127.349 ASSIGNMENTS=5267 CHECKS=1073550	UNSAT TT=1368.84	UNSAT TT=73.76 ASSIGNMENTS=3582 CHECKS=752543	UNSAT TT=70.839 ASSIGNMENTS=2511 CHECKS=639936	? TT=87.237	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.15
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukVg/ normalized-crossword-m1c-uk-vg13-17_ext.xml	UNSAT TT=10.203	UNSAT TT=10.203 CHECKS=0 NODES=665	UNSAT TT=13.982 CHECKS=0 NODES=657	? (TO) TT=1800.11	UNSAT TT=254.979 CHECKS=122994	UNSAT TT=129.931 CHECKS=105244	UNSAT TT=85.207 ASSIGNMENTS=182	UNSAT TT=258.596 ASSIGNMENTS=668	UNSAT TT=36.997 CHECKS=0 NODES=1012	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=17.5 ASSIGNMENTS=665 CHECKS=0	UNSAT TT=17.989 ASSIGNMENTS=665 CHECKS=0	UNSAT TT=416.052	UNSAT TT=526.803	UNSAT TT=53.044 CHECKS=111322	UNSAT TT=14.532 ASSIGNMENTS=559 CHECKS=150201	UNSAT TT=82.749 ASSIGNMENTS=3869 CHECKS=784609	UNSAT TT=167.471	UNSAT TT=58.73 ASSIGNMENTS=3026 CHECKS=625114	UNSAT TT=15.049 ASSIGNMENTS=638 CHECKS=164400	? TT=86.224	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02
csp/ukVg/ normalized-crossword-m1c-uk-vg14-14_ext.xml	UNSAT TT=79.57	UNSAT TT=79.991 CHECKS=480 NODES=5840	UNSAT TT=79.57 CHECKS=963 NODES=5662	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=1604.1 CHECKS=1478390	UNSAT TT=402.103 ASSIGNMENTS=2468	UNSAT TT=614.57 ASSIGNMENTS=3039	UNSAT TT=283.494 CHECKS=0 NODES=7549	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=83.72 ASSIGNMENTS=5922 CHECKS=420	UNSAT TT=83.038 ASSIGNMENTS=5922 CHECKS=420	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=336.901 CHECKS=799726	UNSAT TT=111.984 ASSIGNMENTS=4499 CHECKS=1232550	UNSAT TT=183.889 ASSIGNMENTS=8276 CHECKS=1908730	? (TO) TT=1800.05	UNSAT TT=140.591 ASSIGNMENTS=6277 CHECKS=1508090	UNSAT TT=130.215 ASSIGNMENTS=5342 CHECKS=1451260	? TT=76.966	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01
csp/ukVg/ normalized-crossword-m1c-uk-vg14-15_ext.xml	UNSAT TT=29.205	UNSAT TT=34.985 CHECKS=3 NODES=2576	UNSAT TT=29.205 CHECKS=18 NODES=2138	? (TO) TT=1800.18	UNSAT TT=396.224 CHECKS=274500	UNSAT TT=912.039 CHECKS=443023	UNSAT TT=155.406 ASSIGNMENTS=682	UNSAT TT=706.428 ASSIGNMENTS=2952	UNSAT TT=80.269 CHECKS=0 NODES=2410	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=40.873 ASSIGNMENTS=2576 CHECKS=3	UNSAT TT=40.616 ASSIGNMENTS=2576 CHECKS=3	UNSAT TT=1614.61	? (TO) TT=1800.08	UNSAT TT=174.172 CHECKS=311632	UNSAT TT=68.42 ASSIGNMENTS=2566 CHECKS=748872	UNSAT TT=113.346 ASSIGNMENTS=5186 CHECKS=1153980	UNSAT TT=662.595	UNSAT TT=89.852 ASSIGNMENTS=4155 CHECKS=1026320	UNSAT TT=68.147 ASSIGNMENTS=2609 CHECKS=722854	? TT=81.513	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.08
csp/ukVg/ normalized-crossword-m1c-uk-vg14-17_ext.xml	UNSAT TT=7.038	UNSAT TT=7.038 CHECKS=0 NODES=513	UNSAT TT=12.065 CHECKS=0 NODES=487	? (TO) TT=1800.16	UNSAT TT=164.038 CHECKS=108823	UNSAT TT=127.567 CHECKS=77190	UNSAT TT=77.465 ASSIGNMENTS=108	UNSAT TT=144.509 ASSIGNMENTS=318	UNSAT TT=27.853 CHECKS=0 NODES=763	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=13.912 ASSIGNMENTS=513 CHECKS=0	UNSAT TT=14.363 ASSIGNMENTS=513 CHECKS=0	UNSAT TT=222.155	UNSAT TT=324.394	UNSAT TT=39.93 CHECKS=93400	UNSAT TT=11.404 ASSIGNMENTS=423 CHECKS=122354	UNSAT TT=77.165 ASSIGNMENTS=3730 CHECKS=818417	UNSAT TT=104.578	UNSAT TT=57.626 ASSIGNMENTS=3191 CHECKS=638545	UNSAT TT=10.07 ASSIGNMENTS=395 CHECKS=108025	? TT=83.552	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800
csp/ukVg/ normalized-crossword-m1c-uk-vg14-18_ext.xml	UNSAT TT=3.549	UNSAT TT=3.549 CHECKS=0 NODES=177	UNSAT TT=42.943 CHECKS=0 NODES=151	? (TO) TT=1800.14	UNSAT TT=102.556 CHECKS=72154	UNSAT TT=45.157 CHECKS=39108	UNSAT TT=66.714 ASSIGNMENTS=14	UNSAT TT=65.483 ASSIGNMENTS=14	UNSAT TT=13.385 CHECKS=0 NODES=313	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=10.699 ASSIGNMENTS=177 CHECKS=0	UNSAT TT=11.018 ASSIGNMENTS=177 CHECKS=0	UNSAT TT=146.397	UNSAT TT=132.575	UNSAT TT=13.268 CHECKS=32202	UNSAT TT=4.51 ASSIGNMENTS=163 CHECKS=49317	UNSAT TT=75.601 ASSIGNMENTS=3483 CHECKS=802072	UNSAT TT=103.107	UNSAT TT=47.335 ASSIGNMENTS=2916 CHECKS=520984	UNSAT TT=4.913 ASSIGNMENTS=187 CHECKS=53046	? TT=77.251	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.07
csp/ukVg/ normalized-crossword-m1c-uk-vg15-17_ext.xml	UNSAT TT=3.382	UNSAT TT=3.382 CHECKS=0 NODES=264	UNSAT TT=13.866 CHECKS=0 NODES=192	? (TO) TT=1800.11	UNSAT TT=56.107 CHECKS=60784	UNSAT TT=51.633 CHECKS=43935	UNSAT TT=80.027 ASSIGNMENTS=67	UNSAT TT=74.524 ASSIGNMENTS=44	UNSAT TT=10.247 CHECKS=0 NODES=365	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=10.936 ASSIGNMENTS=264 CHECKS=0	UNSAT TT=10.923 ASSIGNMENTS=264 CHECKS=0	UNSAT TT=163.562	UNSAT TT=193.365	UNSAT TT=17.343 CHECKS=41821	UNSAT TT=5.138 ASSIGNMENTS=188 CHECKS=61515	UNSAT TT=72.085 ASSIGNMENTS=3535 CHECKS=825732	UNSAT TT=82.475	UNSAT TT=53.06 ASSIGNMENTS=3367 CHECKS=664354	UNSAT TT=3.587 ASSIGNMENTS=122 CHECKS=40673	? TT=75.479	? (TO) TT=1800.02	UNSAT TT=920.155	? (TO) TT=1800.04
csp/ukVg/ normalized-crossword-m1c-uk-vg15-18_ext.xml	UNSAT TT=1.63	UNSAT TT=1.63 CHECKS=0 NODES=87	UNSAT TT=6.733 CHECKS=0 NODES=0	? (TO) TT=1800.16	UNSAT TT=59.197 CHECKS=61585	UNSAT TT=20.441 CHECKS=19258	UNSAT TT=25.651 ASSIGNMENTS=0	UNSAT TT=23.81 ASSIGNMENTS=0	UNSAT TT=3.55 CHECKS=0 NODES=132	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=8.675 ASSIGNMENTS=87 CHECKS=0	UNSAT TT=8.586 ASSIGNMENTS=87 CHECKS=0	UNSAT TT=86.55	UNSAT TT=78.449	UNSAT TT=6.36 CHECKS=11709	UNSAT TT=2.115 ASSIGNMENTS=79 CHECKS=23691	UNSAT TT=66.358 ASSIGNMENTS=3313 CHECKS=828342	UNSAT TT=38.467	UNSAT TT=11.554 ASSIGNMENTS=573 CHECKS=137755	UNSAT TT=2.299 ASSIGNMENTS=87 CHECKS=27655	? TT=84.275	? (TO) TT=1800.01	UNSAT TT=907.757	? (TO) TT=1800.01
csp/ukVg/ normalized-crossword-m1c-uk-vg15-19_ext.xml	UNSAT TT=0.888	UNSAT TT=1.372 CHECKS=0 NODES=25	UNSAT TT=1.585 CHECKS=0 NODES=0	? (TO) TT=1800.08	UNSAT TT=33.463 CHECKS=31841	UNSAT TT=15.913 CHECKS=16600	UNSAT TT=6.142 ASSIGNMENTS=0	UNSAT TT=6.517 ASSIGNMENTS=0	UNSAT TT=2.625 CHECKS=0 NODES=68	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=1.208 ASSIGNMENTS=38 CHECKS=12742	UNSAT TT=1.134 ASSIGNMENTS=38 CHECKS=12742	UNSAT TT=75.577	UNSAT TT=64.012	UNSAT TT=3.674 CHECKS=7968	UNSAT TT=0.888 ASSIGNMENTS=28 CHECKS=9863	UNSAT TT=27.619 ASSIGNMENTS=1377 CHECKS=333190	UNSAT TT=11.21	UNSAT TT=1.864 ASSIGNMENTS=88 CHECKS=19550	UNSAT TT=1.194 ASSIGNMENTS=38 CHECKS=12742	? TT=104.661	? (TO) TT=1800.02	UNSAT TT=844.553	? (TO) TT=1800.1
csp/ukVg/ normalized-crossword-m1c-uk-vg16-16_ext.xml	UNSAT TT=3.384	UNSAT TT=3.384 CHECKS=0 NODES=328	UNSAT TT=9.339 CHECKS=0 NODES=254	? (TO) TT=1800.16	UNSAT TT=78.065 CHECKS=120959	UNSAT TT=40.329 CHECKS=67675	UNSAT TT=71.617 ASSIGNMENTS=43	UNSAT TT=85.056 ASSIGNMENTS=86	UNSAT TT=10.397 CHECKS=0 NODES=532	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=10.52 ASSIGNMENTS=325 CHECKS=0	UNSAT TT=10.516 ASSIGNMENTS=325 CHECKS=0	UNSAT TT=211.536	UNSAT TT=204.513	UNSAT TT=11.289 CHECKS=39904	UNSAT TT=8.187 ASSIGNMENTS=308 CHECKS=100733	UNSAT TT=71.562 ASSIGNMENTS=3594 CHECKS=858302	UNSAT TT=75.162	UNSAT TT=63.421 ASSIGNMENTS=3726 CHECKS=778362	UNSAT TT=8.236 ASSIGNMENTS=336 CHECKS=106580	? TT=81.072	? (TO) TT=1800.02	UNSAT TT=907.752	? (TO) TT=1800.05
csp/ukVg/ normalized-crossword-m1c-uk-vg16-17_ext.xml	UNSAT TT=2.626	UNSAT TT=2.626 CHECKS=0 NODES=207	UNSAT TT=18.425 CHECKS=0 NODES=116	? (TO) TT=1800.18	UNSAT TT=42.553 CHECKS=62397	UNSAT TT=29.109 CHECKS=47982	UNSAT TT=69.328 ASSIGNMENTS=7	UNSAT TT=64.868 ASSIGNMENTS=15	UNSAT TT=4.586 CHECKS=0 NODES=217	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=9.616 ASSIGNMENTS=207 CHECKS=0	UNSAT TT=10.023 ASSIGNMENTS=207 CHECKS=0	UNSAT TT=186.349	UNSAT TT=101.223	UNSAT TT=7.96 CHECKS=23759	UNSAT TT=3.243 ASSIGNMENTS=126 CHECKS=41897	UNSAT TT=64.577 ASSIGNMENTS=3407 CHECKS=832445	UNSAT TT=94.13	UNSAT TT=28.156 ASSIGNMENTS=1587 CHECKS=341492	UNSAT TT=3.503 ASSIGNMENTS=134 CHECKS=41365	? TT=68.994	? (TO) TT=1800.01	UNSAT TT=478.273	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukVg/ normalized-crossword-m1c-uk-vg16-18_ext.xml	UNSAT TT=0.812	UNSAT TT=1.288 CHECKS=0 NODES=31	UNSAT TT=1.278 CHECKS=0 NODES=0	? (TO) TT=1800.12	UNSAT TT=24.851 CHECKS=32026	UNSAT TT=10.055 CHECKS=13711	UNSAT TT=14.41 ASSIGNMENTS=0	UNSAT TT=14.343 ASSIGNMENTS=0	UNSAT TT=1.721 CHECKS=0 NODES=61	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=0.879 ASSIGNMENTS=25 CHECKS=10417	UNSAT TT=0.946 ASSIGNMENTS=25 CHECKS=10417	UNSAT TT=66.746	UNSAT TT=51.674	UNSAT TT=3.055 CHECKS=6923	UNSAT TT=0.812 ASSIGNMENTS=21 CHECKS=8924	UNSAT TT=69.264 ASSIGNMENTS=3169 CHECKS=806347	UNSAT TT=13.511	UNSAT TT=1.49 ASSIGNMENTS=65 CHECKS=18205	UNSAT TT=0.967 ASSIGNMENTS=25 CHECKS=10417	? TT=70.643	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/ukVg/ normalized-crossword-m1c-uk-vg16-19_ext.xml	UNSAT TT=0.472	UNSAT TT=1.064 CHECKS=0 NODES=19	UNSAT TT=1.07 CHECKS=0 NODES=0	? (TO) TT=1800.14	UNSAT TT=5.74 CHECKS=5136	UNSAT TT=8.379 CHECKS=7750	UNSAT TT=2.93 ASSIGNMENTS=0	UNSAT TT=2.881 ASSIGNMENTS=0	UNSAT TT=0.929 CHECKS=0 NODES=18	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=0.483 ASSIGNMENTS=12 CHECKS=4481	UNSAT TT=0.487 ASSIGNMENTS=12 CHECKS=4481	UNSAT TT=58.166	UNSAT TT=55.002	UNSAT TT=1.558 CHECKS=4042	UNSAT TT=0.472 ASSIGNMENTS=11 CHECKS=4508	UNSAT TT=3.155 ASSIGNMENTS=153 CHECKS=38817	UNSAT TT=4.781	UNSAT TT=0.957 ASSIGNMENTS=39 CHECKS=10003	UNSAT TT=0.473 ASSIGNMENTS=12 CHECKS=4481	? TT=77.604	? (TO) TT=1800.02	UNSAT TT=326.949	? (TO) TT=1800.07
csp/ukVg/ normalized-crossword-m1c-uk-vg4-4_ext.xml	SAT TT=0.016	SAT TT=0.69 CHECKS=9 NODES=16	SAT TT=0.727 CHECKS=9 NODES=0	SAT TT=0.39	SAT TT=0.344 CHECKS=401	SAT TT=0.388 CHECKS=468	SAT TT=0.804 ASSIGNMENTS=15	SAT TT=1.038 ASSIGNMENTS=12	SAT TT=1.005 CHECKS=372458 NODES=16	SAT TT=0.926 CHECKS=4281270 NODES=2550060	SAT TT=2.792 CHECKS=8260180 NODES=2638	SAT TT=0.03 ASSIGNMENTS=14 CHECKS=152	SAT TT=0.029 ASSIGNMENTS=14 CHECKS=152	SAT TT=7.601	SAT TT=5.896	SAT TT=0.029 CHECKS=56	SAT TT=0.016 ASSIGNMENTS=14 CHECKS=152	SAT TT=0.016 ASSIGNMENTS=12 CHECKS=181	SAT TT=0.937	SAT TT=0.016 ASSIGNMENTS=9 CHECKS=121	SAT TT=0.018 ASSIGNMENTS=14 CHECKS=152	SAT TT=13.736	SAT TT=0.036 ASSIGNMENTS=16 CHECKS=14574	SAT TT=2.576	SAT TT=3.818
csp/ukVg/ normalized-crossword-m1c-uk-vg4-6_ext.xml	SAT TT=0.106	SAT TT=0.853 CHECKS=10 NODES=24	SAT TT=0.886 CHECKS=10 NODES=25	SAT TT=3.634	SAT TT=1.471 CHECKS=1082	SAT TT=1.426 CHECKS=956	SAT TT=2.029 ASSIGNMENTS=16	SAT TT=1.947 ASSIGNMENTS=12	SAT TT=102.866 CHECKS=210186000 NODES=25	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=0.128 ASSIGNMENTS=39 CHECKS=1400	SAT TT=0.119 ASSIGNMENTS=39 CHECKS=1400	SAT TT=28.204	SAT TT=24.313	SAT TT=0.112 CHECKS=182	SAT TT=0.106 ASSIGNMENTS=38 CHECKS=1356	SAT TT=0.065 ASSIGNMENTS=11 CHECKS=251	SAT TT=2.141	SAT TT=0.115 ASSIGNMENTS=47 CHECKS=1079	SAT TT=0.118 ASSIGNMENTS=39 CHECKS=1400	? TT=82.949	SAT TT=0.438 ASSIGNMENTS=24 CHECKS=982254	SAT TT=75.095	SAT TT=80.714
csp/ukVg/ normalized-crossword-m1c-uk-vg4-7_ext.xml	SAT TT=0.176	SAT TT=0.945 CHECKS=11 NODES=31	SAT TT=1.183 CHECKS=11 NODES=28	SAT TT=4.031	SAT TT=2.417 CHECKS=1361	SAT TT=2.882 CHECKS=1570	SAT TT=3.417 ASSIGNMENTS=28	SAT TT=2.878 ASSIGNMENTS=19	SAT TT=1.514 CHECKS=191343 NODES=32	? (TO) TT=1800	? (TO) TT=1800.1	SAT TT=0.459 ASSIGNMENTS=90 CHECKS=5083	SAT TT=0.462 ASSIGNMENTS=90 CHECKS=5083	SAT TT=51.223	SAT TT=76.373	SAT TT=0.176 CHECKS=423	SAT TT=0.36 ASSIGNMENTS=80 CHECKS=4299	SAT TT=0.1 ASSIGNMENTS=10 CHECKS=349	SAT TT=3.502	SAT TT=0.217 ASSIGNMENTS=64 CHECKS=1742	SAT TT=0.467 ASSIGNMENTS=90 CHECKS=5083	? TT=79.239	SAT TT=0.302 ASSIGNMENTS=52 CHECKS=78618	SAT TT=279.089	SAT TT=291.974
csp/ukVg/ normalized-crossword-m1c-uk-vg5-5_ext.xml	SAT TT=0.046	SAT TT=0.99 CHECKS=11 NODES=25	SAT TT=1.048 CHECKS=11 NODES=0	SAT TT=3.91	SAT TT=1.713 CHECKS=1839	SAT TT=1.637 CHECKS=1407	SAT TT=1.606 ASSIGNMENTS=12	SAT TT=1.645 ASSIGNMENTS=21	SAT TT=40.173 CHECKS=11506900 NODES=26	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=0.058 ASSIGNMENTS=16 CHECKS=438	SAT TT=0.059 ASSIGNMENTS=16 CHECKS=438	SAT TT=27.144	SAT TT=32.925	SAT TT=0.064 CHECKS=124	SAT TT=0.05 ASSIGNMENTS=16 CHECKS=438	SAT TT=0.035 ASSIGNMENTS=11 CHECKS=230	SAT TT=2.055	SAT TT=0.046 ASSIGNMENTS=19 CHECKS=468	SAT TT=0.046 ASSIGNMENTS=16 CHECKS=438	? (MO) TT=40.019	SAT TT=0.116 ASSIGNMENTS=30 CHECKS=122481	SAT TT=27.455	SAT TT=32.772
csp/ukVg/ normalized-crossword-m1c-uk-vg5-6_ext.xml	SAT TT=0.133	SAT TT=0.945 CHECKS=11 NODES=32	SAT TT=1.016 CHECKS=11 NODES=31	SAT TT=5.697	SAT TT=2.307 CHECKS=1543	SAT TT=2.255 CHECKS=1705	SAT TT=3.724 ASSIGNMENTS=55	SAT TT=2.858 ASSIGNMENTS=17	SAT TT=154.892 CHECKS=426171000 NODES=72	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=0.572 ASSIGNMENTS=180 CHECKS=10013	SAT TT=0.542 ASSIGNMENTS=180 CHECKS=10013	SAT TT=420.064	SAT TT=267.772	SAT TT=0.156 CHECKS=163	SAT TT=0.133 ASSIGNMENTS=30 CHECKS=1320	SAT TT=1.288 ASSIGNMENTS=501 CHECKS=21554	SAT TT=3.049	SAT TT=1.419 ASSIGNMENTS=641 CHECKS=23131	SAT TT=0.515 ASSIGNMENTS=180 CHECKS=10013	? (exit code) TT=146.12	SAT TT=3.084 ASSIGNMENTS=38 CHECKS=1336660	SAT TT=99.8	SAT TT=138.289
csp/ukVg/ normalized-crossword-m1c-uk-vg5-7_ext.xml	SAT TT=0.699	SAT TT=0.96 CHECKS=47 NODES=42	SAT TT=1.236 CHECKS=34 NODES=42	SAT TT=1416.94	SAT TT=149.309 CHECKS=100172	SAT TT=90.296 CHECKS=76471	SAT TT=9.738 ASSIGNMENTS=129	SAT TT=5.609 ASSIGNMENTS=61	SAT TT=38.877 CHECKS=103680000 NODES=1215	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=1.266 ASSIGNMENTS=221 CHECKS=14388	SAT TT=1.255 ASSIGNMENTS=221 CHECKS=14388	SAT TT=528.822	SAT TT=701.316	SAT TT=0.699 CHECKS=15528	SAT TT=2.414 ASSIGNMENTS=400 CHECKS=25462	SAT TT=18.262 ASSIGNMENTS=4083 CHECKS=205746	SAT TT=19.161	SAT TT=62.832 ASSIGNMENTS=10805 CHECKS=791637	SAT TT=1.293 ASSIGNMENTS=221 CHECKS=14388	? (MO) TT=31.629	SAT TT=14.934 ASSIGNMENTS=296 CHECKS=17648200	SAT TT=730.148	SAT TT=1049.96
csp/ukVg/ normalized-crossword-m1c-uk-vg5-8_ext.xml	SAT TT=2.561	SAT TT=4.463 CHECKS=8876 NODES=5219	SAT TT=2.561 CHECKS=1635 NODES=1448	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=320.102 ASSIGNMENTS=4577	SAT TT=1160.08 ASSIGNMENTS=11417	SAT TT=77.62 CHECKS=547313000 NODES=9607	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=11.508 ASSIGNMENTS=5219 CHECKS=8876	SAT TT=11.748 ASSIGNMENTS=5219 CHECKS=8876	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=7.914 CHECKS=228306	SAT TT=117.387 ASSIGNMENTS=11429 CHECKS=876022	SAT TT=195.878 ASSIGNMENTS=20812 CHECKS=1619500	SAT TT=22.647	SAT TT=34.063 ASSIGNMENTS=3934 CHECKS=266765	SAT TT=130.186 ASSIGNMENTS=12322 CHECKS=942620	? (MO) TT=33.028	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.04
csp/ukVg/ normalized-crossword-m1c-uk-vg5-9_ext.xml	SAT TT=16.074	SAT TT=16.074 CHECKS=32744 NODES=21532	SAT TT=72.609 CHECKS=147081 NODES=89910	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=1507.41 ASSIGNMENTS=15801	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=467.044 ASSIGNMENTS=36518 CHECKS=3189880	SAT TT=22.854 ASSIGNMENTS=21532 CHECKS=32744	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=194.45 CHECKS=5392520	SAT TT=496.763 ASSIGNMENTS=38187 CHECKS=3325500	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=503.565 ASSIGNMENTS=36518 CHECKS=3189880	? TT=89.432	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.01
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukVg/ normalized-crossword-m1c-uk-vg6-10_ext.xml		? (TO) TT=1800.22	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=81.915	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.06
csp/ukVg/ normalized-crossword-m1c-uk-vg6-6_ext.xml	SAT TT=0.459	SAT TT=1.148 CHECKS=69 NODES=137	SAT TT=1.094 CHECKS=65 NODES=79	SAT TT=7.007	SAT TT=4.526 CHECKS=2460	SAT TT=8.974 CHECKS=9014	SAT TT=21.65 ASSIGNMENTS=580	SAT TT=3.005 ASSIGNMENTS=10	SAT TT=183.148 CHECKS=575147000 NODES=38	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=8.137 ASSIGNMENTS=465 CHECKS=227	SAT TT=8.399 ASSIGNMENTS=465 CHECKS=227	? (TO) TT=1800.09	SAT TT=365.629	SAT TT=0.459 CHECKS=11234	SAT TT=8.232 ASSIGNMENTS=1565 CHECKS=111821	SAT TT=11.573 ASSIGNMENTS=2598 CHECKS=128071	SAT TT=4.699	SAT TT=2.047 ASSIGNMENTS=720 CHECKS=27902	SAT TT=6.409 ASSIGNMENTS=1300 CHECKS=90211	? TT=78.021	SAT TT=82.958 ASSIGNMENTS=714 CHECKS=18200700	SAT TT=392.25	SAT TT=547.982
csp/ukVg/ normalized-crossword-m1c-uk-vg6-7_ext.xml	SAT TT=5.381	SAT TT=5.381 CHECKS=3796 NODES=3533	SAT TT=24.408 CHECKS=77241 NODES=39109	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=1210.34 ASSIGNMENTS=10632	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=10.556 ASSIGNMENTS=3533 CHECKS=3796	SAT TT=11.216 ASSIGNMENTS=3533 CHECKS=3796	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=54.733 CHECKS=1573290	SAT TT=552.86 ASSIGNMENTS=58244 CHECKS=5050430	? (TO) TT=1800.01	SAT TT=528.423	? (TO) TT=1800.07	? (TO) TT=1800.03	? TT=52.165	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04
csp/ukVg/ normalized-crossword-m1c-uk-vg6-8_ext.xml	SAT TT=1256.66	SAT TT=1256.66 CHECKS=3690100 NODES=1339970	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.03	? TT=74.485	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.1
csp/ukVg/ normalized-crossword-m1c-uk-vg7-10_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? TT=81.377	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05
csp/ukVg/ normalized-crossword-m1c-uk-vg7-7_ext.xml	SAT TT=2.745	SAT TT=54.917 CHECKS=106087 NODES=51269	SAT TT=60.657 CHECKS=128699 NODES=54631	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=680.342 CHECKS=516489	? (TO) TT=1800.16	SAT TT=64.423 ASSIGNMENTS=585	SAT TT=718.124 CHECKS=0 NODES=281683	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=80.814 ASSIGNMENTS=64644 CHECKS=139493	SAT TT=78.154 ASSIGNMENTS=64644 CHECKS=139493	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=2.745 CHECKS=47438	? (TO) TT=1800.02	SAT TT=468.604 ASSIGNMENTS=34130 CHECKS=3237800	SAT TT=10.18	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=103.181	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08
csp/ukVg/ normalized-crossword-m1c-uk-vg7-8_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.08	? TT=93.692	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.01
csp/ukVg/ normalized-crossword-m1c-uk-vg7-9_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? TT=85.873	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1
csp/ukVg/ normalized-crossword-m1c-uk-vg8-10_ext.xml		? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=29.433	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08
csp/ukVg/ normalized-crossword-m1c-uk-vg8-11_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=31.915	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.01
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukVg/ normalized-crossword-m1c-uk-vg8-12_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=29.554	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.05
csp/ukVg/ normalized-crossword-m1c-uk-vg9-10_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=31.887	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.23
csp/ukVg/ normalized-crossword-m1c-uk-vg9-11_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1969.92	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.11	? TT=28.901	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.21
csp/ukVg/ normalized-crossword-m1c-uk-vg9-12_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=26.447	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05
csp/ukVg/ normalized-crossword-m1c-uk-vg9-13_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.03	? TT=34.185	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.09
csp/ukVg/ normalized-crossword-m1c-uk-vg9-9_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.09	? TT=31.022	? (TO) TT=1800.06	? (TO) TT=1800.22	? (TO) TT=1800.14
csp/wordsVg/ normalized-crossword-m1c-words-vg10-10_ext.xml	UNSAT TT=12.172	UNSAT TT=12.172 CHECKS=444 NODES=2355	UNSAT TT=12.89 CHECKS=624 NODES=2425	? (TO) TT=1800.06	UNSAT TT=396.931 CHECKS=556355	UNSAT TT=158.644 CHECKS=271973	UNSAT TT=66.186 ASSIGNMENTS=888	UNSAT TT=179.316 ASSIGNMENTS=1883	UNSAT TT=37.106 CHECKS=0 NODES=2833	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=20.535 ASSIGNMENTS=2572 CHECKS=399	UNSAT TT=20.091 ASSIGNMENTS=2572 CHECKS=399	UNSAT TT=1359.99	UNSAT TT=1084.31	UNSAT TT=47.573 CHECKS=315477	UNSAT TT=18.318 ASSIGNMENTS=1990 CHECKS=388412	UNSAT TT=38.354 ASSIGNMENTS=5465 CHECKS=759391	UNSAT TT=195.076	UNSAT TT=24.451 ASSIGNMENTS=3293 CHECKS=484948	UNSAT TT=20.34 ASSIGNMENTS=2231 CHECKS=443768	? TT=29.601	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.05
csp/wordsVg/ normalized-crossword-m1c-words-vg10-12_ext.xml	UNSAT TT=1.274	UNSAT TT=2.402 CHECKS=28 NODES=269	UNSAT TT=3.357 CHECKS=0 NODES=255	? (TO) TT=1800.13	UNSAT TT=63.249 CHECKS=90622	UNSAT TT=29.592 CHECKS=34744	UNSAT TT=36.986 ASSIGNMENTS=22	UNSAT TT=37.036 ASSIGNMENTS=10	UNSAT TT=6.226 CHECKS=0 NODES=483	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=1.3 ASSIGNMENTS=122 CHECKS=24854	UNSAT TT=1.274 ASSIGNMENTS=122 CHECKS=24854	UNSAT TT=127.379	UNSAT TT=93.979	UNSAT TT=6.585 CHECKS=29983	UNSAT TT=2.293 ASSIGNMENTS=243 CHECKS=44095	UNSAT TT=24.794 ASSIGNMENTS=3581 CHECKS=510438	UNSAT TT=27.947	UNSAT TT=12.295 ASSIGNMENTS=1842 CHECKS=247245	UNSAT TT=1.275 ASSIGNMENTS=122 CHECKS=24854	? TT=31.676	? (TO) TT=1800.02	UNSAT TT=1177.75	? (TO) TT=1800.09
csp/wordsVg/ normalized-crossword-m1c-words-vg10-14_ext.xml	UNSAT TT=0.239	UNSAT TT=1.183 CHECKS=0 NODES=15	UNSAT TT=1.037 CHECKS=0 NODES=0	? (TO) TT=1800.1	UNSAT TT=10.131 CHECKS=13603	UNSAT TT=6.208 CHECKS=8493	UNSAT TT=4.667 ASSIGNMENTS=0	UNSAT TT=4.891 ASSIGNMENTS=0	UNSAT TT=1.116 CHECKS=0 NODES=24	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.254 ASSIGNMENTS=18 CHECKS=4771	UNSAT TT=0.257 ASSIGNMENTS=18 CHECKS=4771	UNSAT TT=38.626	UNSAT TT=30.151	UNSAT TT=1.091 CHECKS=3925	UNSAT TT=0.239 ASSIGNMENTS=15 CHECKS=4360	UNSAT TT=5.953 ASSIGNMENTS=808 CHECKS=115363	UNSAT TT=4.411	UNSAT TT=0.444 ASSIGNMENTS=54 CHECKS=8945	UNSAT TT=0.245 ASSIGNMENTS=18 CHECKS=4771	? TT=33.512	? (TO) TT=1800.06	UNSAT TT=268.98	UNSAT TT=280.426
csp/wordsVg/ normalized-crossword-m1c-words-vg11-13_ext.xml	UNSAT TT=0.307	UNSAT TT=1.094 CHECKS=0 NODES=29	UNSAT TT=1.388 CHECKS=0 NODES=0	? (TO) TT=1800.07	UNSAT TT=17.265 CHECKS=25379	UNSAT TT=6.947 CHECKS=10724	UNSAT TT=7.261 ASSIGNMENTS=0	UNSAT TT=7.164 ASSIGNMENTS=0	UNSAT TT=1.15 CHECKS=0 NODES=49	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.423 ASSIGNMENTS=31 CHECKS=7704	UNSAT TT=0.425 ASSIGNMENTS=31 CHECKS=7704	UNSAT TT=35.874	UNSAT TT=26.937	UNSAT TT=1.194 CHECKS=5838	UNSAT TT=0.307 ASSIGNMENTS=23 CHECKS=5323	UNSAT TT=15.931 ASSIGNMENTS=2230 CHECKS=338585	UNSAT TT=7.377	UNSAT TT=2.081 ASSIGNMENTS=299 CHECKS=41597	UNSAT TT=0.411 ASSIGNMENTS=31 CHECKS=7704	? TT=30.737	? (TO) TT=1800.06	UNSAT TT=353.938	? (TO) TT=1800.04
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsVg/ normalized-crossword-m1c-words-vg11-14_ext.xml	UNSAT TT=0.099	UNSAT TT=0.887 CHECKS=0 NODES=5	UNSAT TT=0.918 CHECKS=0 NODES=0	UNSAT TT=376.223	UNSAT TT=5.55 CHECKS=6351	UNSAT TT=3.258 CHECKS=3448	UNSAT TT=1.386 ASSIGNMENTS=0	UNSAT TT=1.363 ASSIGNMENTS=0	UNSAT TT=0.756 CHECKS=0 NODES=10	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.127 ASSIGNMENTS=8 CHECKS=1506	UNSAT TT=0.128 ASSIGNMENTS=8 CHECKS=1506	UNSAT TT=25.941	UNSAT TT=20.396	UNSAT TT=0.406 CHECKS=1314	UNSAT TT=0.099 ASSIGNMENTS=5 CHECKS=1441	UNSAT TT=0.533 ASSIGNMENTS=65 CHECKS=9670	UNSAT TT=2.991	UNSAT TT=0.303 ASSIGNMENTS=33 CHECKS=5148	UNSAT TT=0.12 ASSIGNMENTS=8 CHECKS=1506	? TT=32.117	? (TO) TT=1800.06	UNSAT TT=173.817	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg11-15_ext.xml	UNSAT TT=0.053	UNSAT TT=0.99 CHECKS=0 NODES=0	UNSAT TT=0.823 CHECKS=0 NODES=0	UNSAT TT=101.607	UNSAT TT=0.718 CHECKS=93	UNSAT TT=0.713 CHECKS=93	UNSAT TT=0.557 ASSIGNMENTS=0	UNSAT TT=0.51 ASSIGNMENTS=0	UNSAT TT=0.631 CHECKS=0 NODES=0	UNSAT TT=0.862 CHECKS=0 NODES=0	UNSAT TT=0.66 CHECKS=0 NODES=0	UNSAT TT=0.066 ASSIGNMENTS=0 CHECKS=357	UNSAT TT=0.069 ASSIGNMENTS=0 CHECKS=357	UNSAT TT=23.44	UNSAT TT=18.886	UNSAT TT=0.241 CHECKS=664	UNSAT TT=0.055 ASSIGNMENTS=0 CHECKS=357	UNSAT TT=0.055 ASSIGNMENTS=0 CHECKS=357	UNSAT TT=2.396	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=357	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=357	? TT=32.248	? (TO) TT=1800.06	UNSAT TT=168.63	UNSAT TT=428.884
csp/wordsVg/ normalized-crossword-m1c-words-vg12-13_ext.xml	UNSAT TT=0.13	UNSAT TT=0.854 CHECKS=0 NODES=6	UNSAT TT=0.887 CHECKS=0 NODES=0	? (TO) TT=1800.08	UNSAT TT=3.643 CHECKS=4275	UNSAT TT=4.11 CHECKS=5036	UNSAT TT=1.495 ASSIGNMENTS=0	UNSAT TT=1.666 ASSIGNMENTS=0	UNSAT TT=0.672 CHECKS=0 NODES=12	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.158 ASSIGNMENTS=10 CHECKS=2195	UNSAT TT=0.158 ASSIGNMENTS=10 CHECKS=2195	UNSAT TT=23.852	UNSAT TT=18.682	UNSAT TT=0.301 CHECKS=1198	UNSAT TT=0.13 ASSIGNMENTS=6 CHECKS=1935	UNSAT TT=0.853 ASSIGNMENTS=100 CHECKS=16127	UNSAT TT=3.367	UNSAT TT=0.343 ASSIGNMENTS=30 CHECKS=6295	UNSAT TT=0.144 ASSIGNMENTS=10 CHECKS=2195	? (exit code) TT=77.999	? (TO) TT=1800.05	UNSAT TT=191.747	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg12-15_ext.xml	UNSAT TT=0.039	UNSAT TT=0.769 CHECKS=0 NODES=0	UNSAT TT=0.832 CHECKS=0 NODES=0	UNSAT TT=66.932	UNSAT TT=0.468 CHECKS=43	UNSAT TT=0.537 CHECKS=43	UNSAT TT=0.475 ASSIGNMENTS=0	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.517 CHECKS=0 NODES=0	UNSAT TT=0.674 CHECKS=0 NODES=0	UNSAT TT=0.66 CHECKS=0 NODES=0	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=58	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=58	UNSAT TT=16.157	UNSAT TT=14.507	UNSAT TT=0.068 CHECKS=70	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=58	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=58	UNSAT TT=1.866	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=58	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=58	? TT=69.507	? (TO) TT=1800.09	UNSAT TT=122.934	UNSAT TT=210.892
csp/wordsVg/ normalized-crossword-m1c-words-vg12-16_ext.xml	UNSAT TT=0.028	UNSAT TT=0.792 CHECKS=0 NODES=0	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=23.98	UNSAT TT=0.44 CHECKS=29	UNSAT TT=0.421 CHECKS=29	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.521 ASSIGNMENTS=0	UNSAT TT=0.647 CHECKS=0 NODES=0	UNSAT TT=0.487 CHECKS=0 NODES=0	UNSAT TT=0.787 CHECKS=0 NODES=0	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=13	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=13	UNSAT TT=16.299	UNSAT TT=14.727	UNSAT TT=0.062 CHECKS=76	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=13	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=13	UNSAT TT=1.889	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=13	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=13	? (exit code) TT=83.74	? (TO) TT=1800.04	UNSAT TT=92.183	UNSAT TT=125.154
csp/wordsVg/ normalized-crossword-m1c-words-vg13-13_ext.xml	UNSAT TT=0.069	UNSAT TT=0.826 CHECKS=0 NODES=6	UNSAT TT=0.816 CHECKS=0 NODES=0	UNSAT TT=568.889	UNSAT TT=1.153 CHECKS=1783	UNSAT TT=1.035 CHECKS=1435	UNSAT TT=0.732 ASSIGNMENTS=0	UNSAT TT=0.743 ASSIGNMENTS=0	UNSAT TT=0.798 CHECKS=0 NODES=4	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.092 ASSIGNMENTS=3 CHECKS=1042	UNSAT TT=0.088 ASSIGNMENTS=3 CHECKS=1042	UNSAT TT=19.48	UNSAT TT=15.405	UNSAT TT=0.152 CHECKS=866	UNSAT TT=0.069 ASSIGNMENTS=2 CHECKS=824	UNSAT TT=0.14 ASSIGNMENTS=18 CHECKS=2354	UNSAT TT=2.101	UNSAT TT=0.154 ASSIGNMENTS=19 CHECKS=2325	UNSAT TT=0.073 ASSIGNMENTS=3 CHECKS=1042	? TT=62.275	? (TO) TT=1800.11	UNSAT TT=118.866	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg13-16_ext.xml	UNSAT TT=0.034	UNSAT TT=0.765 CHECKS=0 NODES=0	UNSAT TT=0.782 CHECKS=0 NODES=0	UNSAT TT=16.932	UNSAT TT=0.297 CHECKS=29	UNSAT TT=0.294 CHECKS=29	UNSAT TT=0.549 ASSIGNMENTS=0	UNSAT TT=0.653 ASSIGNMENTS=0	UNSAT TT=0.572 CHECKS=0 NODES=0	UNSAT TT=0.458 CHECKS=0 NODES=0	UNSAT TT=0.555 CHECKS=0 NODES=0	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=30	UNSAT TT=0.049 ASSIGNMENTS=0 CHECKS=30	UNSAT TT=12.203	UNSAT TT=11.306	UNSAT TT=0.049 CHECKS=83	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=30	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=30	UNSAT TT=1.327	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=30	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=30	? TT=108.571	? (TO) TT=1800.03	UNSAT TT=50.915	UNSAT TT=78.127
csp/wordsVg/ normalized-crossword-m1c-words-vg13-17_ext.xml	UNSAT TT=0.033	UNSAT TT=0.804 CHECKS=0 NODES=0	UNSAT TT=0.752 CHECKS=0 NODES=0	UNSAT TT=18.398	UNSAT TT=0.329 CHECKS=30	UNSAT TT=0.288 CHECKS=30	UNSAT TT=0.465 ASSIGNMENTS=0	UNSAT TT=0.603 ASSIGNMENTS=0	UNSAT TT=0.459 CHECKS=0 NODES=0	UNSAT TT=0.456 CHECKS=0 NODES=0	UNSAT TT=0.445 CHECKS=0 NODES=0	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=31	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=31	UNSAT TT=12.814	UNSAT TT=9.976	UNSAT TT=0.045 CHECKS=55	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=31	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=31	UNSAT TT=1.49	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=31	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=31	? TT=82.639	? (TO) TT=1800.09	UNSAT TT=50.075	UNSAT TT=76.339
csp/wordsVg/ normalized-crossword-m1c-words-vg14-14_ext.xml	UNSAT TT=0.035	UNSAT TT=0.915 CHECKS=0 NODES=0	UNSAT TT=0.774 CHECKS=0 NODES=0	UNSAT TT=118.394	UNSAT TT=0.361 CHECKS=98	UNSAT TT=0.363 CHECKS=98	UNSAT TT=0.512 ASSIGNMENTS=0	UNSAT TT=0.461 ASSIGNMENTS=0	UNSAT TT=0.442 CHECKS=0 NODES=0	UNSAT TT=0.42 CHECKS=0 NODES=0	UNSAT TT=0.436 CHECKS=0 NODES=0	UNSAT TT=0.049 ASSIGNMENTS=0 CHECKS=57	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=57	UNSAT TT=11.373	UNSAT TT=9.512	UNSAT TT=0.052 CHECKS=291	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=57	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=57	UNSAT TT=1.232	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=57	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=57	? TT=80.729	? (TO) TT=1800.04	UNSAT TT=43.788	UNSAT TT=77.833
csp/wordsVg/ normalized-crossword-m1c-words-vg14-16_ext.xml	UNSAT TT=0.026	UNSAT TT=0.904 CHECKS=0 NODES=0	UNSAT TT=0.903 CHECKS=0 NODES=0	UNSAT TT=16.945	UNSAT TT=0.182 CHECKS=30	UNSAT TT=0.179 CHECKS=30	UNSAT TT=0.464 ASSIGNMENTS=0	UNSAT TT=0.467 ASSIGNMENTS=0	UNSAT TT=0.451 CHECKS=0 NODES=0	UNSAT TT=0.459 CHECKS=0 NODES=0	UNSAT TT=0.41 CHECKS=0 NODES=0	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=9.247	UNSAT TT=7.763	UNSAT TT=0.035 CHECKS=97	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=1.103	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=15	? TT=108.428	? (TO) TT=1800.07	UNSAT TT=22.311	UNSAT TT=32.982
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsVg/ normalized-crossword-m1c-words-vg14-17_ext.xml	UNSAT TT=0.026	UNSAT TT=0.76 CHECKS=0 NODES=0	UNSAT TT=0.781 CHECKS=0 NODES=0	UNSAT TT=16.327	UNSAT TT=0.171 CHECKS=31	UNSAT TT=0.173 CHECKS=31	UNSAT TT=0.458 ASSIGNMENTS=0	UNSAT TT=0.452 ASSIGNMENTS=0	UNSAT TT=0.432 CHECKS=0 NODES=0	UNSAT TT=0.409 CHECKS=0 NODES=0	UNSAT TT=0.433 CHECKS=0 NODES=0	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=9.541	UNSAT TT=8.016	UNSAT TT=0.037 CHECKS=64	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.941	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=15	? TT=89.863	? (TO) TT=1800.05	UNSAT TT=22.494	UNSAT TT=33.116
csp/wordsVg/ normalized-crossword-m1c-words-vg14-18_ext.xml	UNSAT TT=0.025	UNSAT TT=0.759 CHECKS=0 NODES=0	UNSAT TT=0.788 CHECKS=0 NODES=0	UNSAT TT=15.821	UNSAT TT=0.194 CHECKS=32	UNSAT TT=0.184 CHECKS=32	UNSAT TT=0.556 ASSIGNMENTS=0	UNSAT TT=0.532 ASSIGNMENTS=0	UNSAT TT=0.434 CHECKS=0 NODES=0	UNSAT TT=0.43 CHECKS=0 NODES=0	UNSAT TT=0.431 CHECKS=0 NODES=0	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=9.22	UNSAT TT=7.502	UNSAT TT=0.03 CHECKS=54	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=1.062	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=15	? TT=80.81	? (TO) TT=1800.09	UNSAT TT=22.551	UNSAT TT=31.529
csp/wordsVg/ normalized-crossword-m1c-words-vg15-15_ext.xml	UNSAT TT=0.024	UNSAT TT=0.878 CHECKS=0 NODES=0	UNSAT TT=0.786 CHECKS=0 NODES=0	UNSAT TT=14.499	UNSAT TT=0.202 CHECKS=61	UNSAT TT=0.201 CHECKS=61	UNSAT TT=0.461 ASSIGNMENTS=0	UNSAT TT=0.447 ASSIGNMENTS=0	UNSAT TT=0.412 CHECKS=0 NODES=0	UNSAT TT=0.403 CHECKS=0 NODES=0	UNSAT TT=0.471 CHECKS=0 NODES=0	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=8.256	UNSAT TT=7.704	UNSAT TT=0.031 CHECKS=107	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.929	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=15	? TT=84.554	? (TO) TT=1800.01	UNSAT TT=19.613	UNSAT TT=28.02
csp/wordsVg/ normalized-crossword-m1c-words-vg15-16_ext.xml	UNSAT TT=0.026	UNSAT TT=0.793 CHECKS=0 NODES=0	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=11.076	UNSAT TT=0.124 CHECKS=31	UNSAT TT=0.123 CHECKS=31	UNSAT TT=0.548 ASSIGNMENTS=0	UNSAT TT=0.445 ASSIGNMENTS=0	UNSAT TT=0.443 CHECKS=0 NODES=0	UNSAT TT=0.487 CHECKS=0 NODES=0	UNSAT TT=0.521 CHECKS=0 NODES=0	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=6.892	UNSAT TT=6.277	UNSAT TT=0.032 CHECKS=60	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.868	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=16	? TT=82.058	? (TO) TT=1800.04	UNSAT TT=12.818	UNSAT TT=21.692
csp/wordsVg/ normalized-crossword-m1c-words-vg15-19_ext.xml	UNSAT TT=0.016	UNSAT TT=0.81 CHECKS=0 NODES=0	UNSAT TT=0.798 CHECKS=0 NODES=0	UNSAT TT=8.53	UNSAT TT=0.12 CHECKS=20	UNSAT TT=0.115 CHECKS=20	UNSAT TT=0.529 ASSIGNMENTS=0	UNSAT TT=0.536 ASSIGNMENTS=0	UNSAT TT=0.396 CHECKS=0 NODES=0	UNSAT TT=0.411 CHECKS=0 NODES=0	UNSAT TT=0.41 CHECKS=0 NODES=0	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=7.108	UNSAT TT=5.989	UNSAT TT=0.025 CHECKS=13	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.735	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=16	? TT=79.532	? (TO) TT=1800.05	UNSAT TT=11.325	UNSAT TT=17.094
csp/wordsVg/ normalized-crossword-m1c-words-vg4-4_ext.xml	SAT TT=0.011	SAT TT=0.806 CHECKS=9 NODES=16	SAT TT=0.818 CHECKS=9 NODES=0	SAT TT=0.232	SAT TT=0.19 CHECKS=485	SAT TT=0.217 CHECKS=580	SAT TT=0.964 ASSIGNMENTS=8	SAT TT=0.714 ASSIGNMENTS=13	SAT TT=1.264 CHECKS=969108 NODES=16	SAT TT=4.428 CHECKS=37403000 NODES=21000000	SAT TT=49.586 CHECKS=138264000 NODES=8795	SAT TT=0.025 ASSIGNMENTS=10 CHECKS=179	SAT TT=0.024 ASSIGNMENTS=10 CHECKS=179	SAT TT=4.324	SAT TT=3.86	SAT TT=0.021 CHECKS=89	SAT TT=0.012 ASSIGNMENTS=10 CHECKS=179	SAT TT=0.011 ASSIGNMENTS=8 CHECKS=193	SAT TT=0.507	SAT TT=0.011 ASSIGNMENTS=6 CHECKS=145	SAT TT=0.012 ASSIGNMENTS=10 CHECKS=179	SAT TT=30.552	SAT TT=0.029 ASSIGNMENTS=16 CHECKS=22445	SAT TT=1.652	SAT TT=2.169
csp/wordsVg/ normalized-crossword-m1c-words-vg4-6_ext.xml	SAT TT=0.037	SAT TT=0.914 CHECKS=20 NODES=31	SAT TT=0.788 CHECKS=10 NODES=24	SAT TT=5.522	SAT TT=0.483 CHECKS=1233	SAT TT=0.993 CHECKS=4312	SAT TT=1.336 ASSIGNMENTS=16	SAT TT=1.625 ASSIGNMENTS=22	SAT TT=201.178 CHECKS=714908000 NODES=65	? (TO) TT=1800	? (TO) TT=1800.04	SAT TT=0.051 ASSIGNMENTS=21 CHECKS=925	SAT TT=0.049 ASSIGNMENTS=21 CHECKS=925	SAT TT=24.336	SAT TT=89.032	SAT TT=0.057 CHECKS=218	SAT TT=0.04 ASSIGNMENTS=21 CHECKS=925	SAT TT=0.091 ASSIGNMENTS=83 CHECKS=3631	SAT TT=1.143	SAT TT=0.054 ASSIGNMENTS=49 CHECKS=1545	SAT TT=0.037 ASSIGNMENTS=21 CHECKS=925	? TT=88.422	SAT TT=0.549 ASSIGNMENTS=31 CHECKS=1275210	SAT TT=18.231	SAT TT=20.028
csp/wordsVg/ normalized-crossword-m1c-words-vg4-8_ext.xml	SAT TT=0.974	SAT TT=1.84 CHECKS=1545 NODES=1546	SAT TT=1.712 CHECKS=1975 NODES=1646	SAT TT=484.152	SAT TT=11.128 CHECKS=40259	SAT TT=9.851 CHECKS=33180	SAT TT=7.951 ASSIGNMENTS=436	SAT TT=3.219 ASSIGNMENTS=39	SAT TT=3.652 CHECKS=28784600 NODES=936	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.116 ASSIGNMENTS=542 CHECKS=42666	SAT TT=1.114 ASSIGNMENTS=542 CHECKS=42666	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.974 CHECKS=43766	SAT TT=4.415 ASSIGNMENTS=2016 CHECKS=164176	SAT TT=1.781 ASSIGNMENTS=1099 CHECKS=59647	SAT TT=7.324	SAT TT=1.033 ASSIGNMENTS=683 CHECKS=36816	SAT TT=1.099 ASSIGNMENTS=542 CHECKS=42666	? TT=87.035	? (TO) TT=1800.08	SAT TT=279.292	? (TO) TT=1800.13
csp/wordsVg/ normalized-crossword-m1c-words-vg5-7_ext.xml	SAT TT=3.18	SAT TT=3.18 CHECKS=4205 NODES=3991	SAT TT=16.22 CHECKS=74393 NODES=29537	? (TO) TT=1800.03	SAT TT=1233.7 CHECKS=4034100	SAT TT=679.765 CHECKS=2142610	SAT TT=124.473 ASSIGNMENTS=8385	SAT TT=1248.51 ASSIGNMENTS=48797	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=10.52 ASSIGNMENTS=3991 CHECKS=4205	SAT TT=10.1 ASSIGNMENTS=3991 CHECKS=4205	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=26.911 CHECKS=1061090	SAT TT=76.013 ASSIGNMENTS=30776 CHECKS=2636340	SAT TT=30.819 ASSIGNMENTS=13285 CHECKS=997653	SAT TT=935.789	SAT TT=292.342 ASSIGNMENTS=120850 CHECKS=10029800	SAT TT=53.217 ASSIGNMENTS=23732 CHECKS=1976390	? (MO) TT=33.837	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11
csp/wordsVg/ normalized-crossword-m1c-words-vg5-8_ext.xml	UNSAT TT=307.298	UNSAT TT=307.298 CHECKS=1191930 NODES=431363	UNSAT TT=357.151 CHECKS=1360750 NODES=539564	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=824.685 ASSIGNMENTS=212436 CHECKS=19484800	UNSAT TT=813.226 ASSIGNMENTS=212436 CHECKS=19484800	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=701.392 CHECKS=22958800	UNSAT TT=528.036 ASSIGNMENTS=185261 CHECKS=17560200	UNSAT TT=606.044 ASSIGNMENTS=200284 CHECKS=19178800	? (TO) TT=1800.04	UNSAT TT=577.449 ASSIGNMENTS=187959 CHECKS=17787200	UNSAT TT=607.972 ASSIGNMENTS=212436 CHECKS=19484800	? (MO) TT=31.078	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsVg/ normalized-crossword-m1c-words-vg5-9_ext.xml	UNSAT TT=138.233	UNSAT TT=162.747 CHECKS=395997 NODES=180738	UNSAT TT=138.233 CHECKS=296146 NODES=149872	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=750.89 ASSIGNMENTS=38664	UNSAT TT=821.525 ASSIGNMENTS=28579	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.03	UNSAT TT=159.848 ASSIGNMENTS=180738 CHECKS=395997	UNSAT TT=162.573 ASSIGNMENTS=180738 CHECKS=395997	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=403.078 CHECKS=10695600	UNSAT TT=255.868 ASSIGNMENTS=72007 CHECKS=7473690	UNSAT TT=230.804 ASSIGNMENTS=66358 CHECKS=6728890	? (TO) TT=1800.02	UNSAT TT=224.855 ASSIGNMENTS=63104 CHECKS=6593790	UNSAT TT=202.435 ASSIGNMENTS=57395 CHECKS=6080460	? (MO) TT=31.734	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09
csp/wordsVg/ normalized-crossword-m1c-words-vg6-10_ext.xml	UNSAT TT=68.176	UNSAT TT=74.684 CHECKS=80827 NODES=46555	UNSAT TT=69.459 CHECKS=63229 NODES=38966	? (TO) TT=1800.08	UNSAT TT=1255.31 CHECKS=2136320	UNSAT TT=913.349 CHECKS=1526180	UNSAT TT=157.28 ASSIGNMENTS=5391	UNSAT TT=918.097 ASSIGNMENTS=17271	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=80.856 ASSIGNMENTS=46555 CHECKS=80827	UNSAT TT=81.429 ASSIGNMENTS=46555 CHECKS=80827	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=219.464 CHECKS=2848640	UNSAT TT=85.97 ASSIGNMENTS=15932 CHECKS=2176830	UNSAT TT=85.72 ASSIGNMENTS=16531 CHECKS=2010940	UNSAT TT=874.653	UNSAT TT=68.176 ASSIGNMENTS=14219 CHECKS=1795420	UNSAT TT=72.915 ASSIGNMENTS=13221 CHECKS=1767860	? TT=74.011	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg6-6_ext.xml	SAT TT=0.329	SAT TT=0.984 CHECKS=344 NODES=235	SAT TT=1.155 CHECKS=110 NODES=139	SAT TT=922.487	SAT TT=15.876 CHECKS=54494	SAT TT=3.341 CHECKS=9718	SAT TT=4.33 ASSIGNMENTS=135	SAT TT=8.528 ASSIGNMENTS=284	SAT TT=607.591 CHECKS=3562100000 NODES=373	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=0.89 ASSIGNMENTS=375 CHECKS=25267	SAT TT=0.935 ASSIGNMENTS=375 CHECKS=25267	SAT TT=195.146	SAT TT=129.62	SAT TT=0.329 CHECKS=12398	SAT TT=0.632 ASSIGNMENTS=263 CHECKS=17852	SAT TT=7.361 ASSIGNMENTS=3892 CHECKS=225798	SAT TT=14.558	SAT TT=1.202 ASSIGNMENTS=772 CHECKS=39992	SAT TT=0.871 ASSIGNMENTS=375 CHECKS=25267	? TT=78.757	SAT TT=1.93 ASSIGNMENTS=40 CHECKS=5034760	SAT TT=605.979	SAT TT=395.396
csp/wordsVg/ normalized-crossword-m1c-words-vg6-7_ext.xml	UNSAT TT=1005.97	UNSAT TT=1005.97 CHECKS=3474640 NODES=1224090	UNSAT TT=1028.96 CHECKS=3544520 NODES=1241430	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=76.462	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg7-10_ext.xml	UNSAT TT=61.528	UNSAT TT=61.528 CHECKS=48414 NODES=29536	UNSAT TT=62.877 CHECKS=46695 NODES=25763	? (TO) TT=1800.11	UNSAT TT=1767.78 CHECKS=2260520	UNSAT TT=1174.03 CHECKS=1702450	UNSAT TT=599.454 ASSIGNMENTS=14881	UNSAT TT=805.409 ASSIGNMENTS=13360	UNSAT TT=180.598 CHECKS=0 NODES=28641	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=69.717 ASSIGNMENTS=29536 CHECKS=48414	UNSAT TT=67.65 ASSIGNMENTS=29536 CHECKS=48414	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=313.011 CHECKS=2834840	UNSAT TT=120.43 ASSIGNMENTS=18632 CHECKS=2703850	UNSAT TT=128.536 ASSIGNMENTS=20404 CHECKS=2816800	UNSAT TT=943.241	UNSAT TT=104.145 ASSIGNMENTS=16293 CHECKS=2396050	UNSAT TT=117.566 ASSIGNMENTS=18216 CHECKS=2689390	? TT=86.202	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/wordsVg/ normalized-crossword-m1c-words-vg7-11_ext.xml	UNSAT TT=17.7	UNSAT TT=18.683 CHECKS=5627 NODES=6585	UNSAT TT=17.7 CHECKS=3807 NODES=5779	? (TO) TT=1800.04	UNSAT TT=268.487 CHECKS=398580	UNSAT TT=237.829 CHECKS=361626	UNSAT TT=53.081 ASSIGNMENTS=1231	UNSAT TT=154.36 ASSIGNMENTS=2138	UNSAT TT=56.137 CHECKS=0 NODES=7468	? (TO) TT=1800.01	? (TO) TT=1800.09	UNSAT TT=26.322 ASSIGNMENTS=6585 CHECKS=5627	UNSAT TT=27.567 ASSIGNMENTS=6585 CHECKS=5627	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=70.242 CHECKS=569138	UNSAT TT=27.848 ASSIGNMENTS=4119 CHECKS=656014	UNSAT TT=41.782 ASSIGNMENTS=6904 CHECKS=872345	UNSAT TT=275.404	UNSAT TT=30.875 ASSIGNMENTS=4658 CHECKS=672887	UNSAT TT=27.376 ASSIGNMENTS=3794 CHECKS=588277	? TT=89.713	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg7-7_ext.xml	SAT TT=42.386	SAT TT=89.503 CHECKS=245428 NODES=81118	SAT TT=86.625 CHECKS=254815 NODES=80512	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=343.776 ASSIGNMENTS=13195	SAT TT=1516.06 ASSIGNMENTS=38642	SAT TT=72.1 CHECKS=0 NODES=34780	? (TO) TT=1800.01	? (TO) TT=1800.13	SAT TT=62.636 ASSIGNMENTS=56255 CHECKS=191430	SAT TT=64.281 ASSIGNMENTS=56255 CHECKS=191430	? (TO) TT=1800	? (TO) TT=1800	SAT TT=644.918 CHECKS=12405900	SAT TT=228.488 ASSIGNMENTS=47786 CHECKS=5146290	SAT TT=330.483 ASSIGNMENTS=70519 CHECKS=7328750	? (TO) TT=1800.05	SAT TT=42.386 ASSIGNMENTS=9246 CHECKS=1009290	SAT TT=146.834 ASSIGNMENTS=32967 CHECKS=3586880	? TT=87.722	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.04
csp/wordsVg/ normalized-crossword-m1c-words-vg7-8_ext.xml	UNSAT TT=482.525	UNSAT TT=482.525 CHECKS=1306110 NODES=362557	UNSAT TT=540.328 CHECKS=1456270 NODES=402965	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.12	UNSAT TT=1575.42 CHECKS=0 NODES=459316	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=1525.7 CHECKS=24583200	UNSAT TT=1011.57 ASSIGNMENTS=176374 CHECKS=21345000	UNSAT TT=1041.51 ASSIGNMENTS=190386 CHECKS=23437500	? (TO) TT=1800.05	UNSAT TT=1103.11 ASSIGNMENTS=187539 CHECKS=23116300	UNSAT TT=874.042 ASSIGNMENTS=163505 CHECKS=19945100	? TT=88.319	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05
csp/wordsVg/ normalized-crossword-m1c-words-vg7-9_ext.xml	UNSAT TT=205.883	UNSAT TT=229.929 CHECKS=341501 NODES=117941	UNSAT TT=205.883 CHECKS=309939 NODES=104461	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=601.414 ASSIGNMENTS=18012	? (TO) TT=1800.12	UNSAT TT=695.471 CHECKS=0 NODES=152135	? (TO) TT=1800	? (TO) TT=1800.09	UNSAT TT=553.936 ASSIGNMENTS=67552 CHECKS=9134720	UNSAT TT=585.674 ASSIGNMENTS=67552 CHECKS=9134720	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=604.447 CHECKS=6786270	UNSAT TT=530.53 ASSIGNMENTS=81405 CHECKS=11396800	UNSAT TT=390.686 ASSIGNMENTS=60537 CHECKS=8012880	? (TO) TT=1800.09	UNSAT TT=353.875 ASSIGNMENTS=59728 CHECKS=7867780	UNSAT TT=433.659 ASSIGNMENTS=67552 CHECKS=9134720	? TT=86.172	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.04
csp/wordsVg/ normalized-crossword-m1c-words-vg8-11_ext.xml	UNSAT TT=14.987	UNSAT TT=14.987 CHECKS=5427 NODES=3503	UNSAT TT=16.36 CHECKS=4384 NODES=3675	? (TO) TT=1800.05	UNSAT TT=151.909 CHECKS=213522	UNSAT TT=226.321 CHECKS=288234	UNSAT TT=68.522 ASSIGNMENTS=1139	UNSAT TT=108.321 ASSIGNMENTS=1355	UNSAT TT=64.987 CHECKS=0 NODES=7168	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=20.923 ASSIGNMENTS=3503 CHECKS=5427	UNSAT TT=21.123 ASSIGNMENTS=3503 CHECKS=5427	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=54.614 CHECKS=321395	UNSAT TT=17.807 ASSIGNMENTS=2270 CHECKS=383933	UNSAT TT=40.622 ASSIGNMENTS=5935 CHECKS=770052	UNSAT TT=224.578	UNSAT TT=27.874 ASSIGNMENTS=3911 CHECKS=568179	UNSAT TT=18.03 ASSIGNMENTS=2331 CHECKS=385833	? TT=30.182	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsVg/ normalized-crossword-m1c-words-vg8-12_ext.xml	UNSAT TT=2.994	UNSAT TT=4.533 CHECKS=319 NODES=859	UNSAT TT=5.223 CHECKS=262 NODES=860	? (TO) TT=1800.04	UNSAT TT=81.204 CHECKS=111491	UNSAT TT=47.421 CHECKS=75110	UNSAT TT=27.659 ASSIGNMENTS=214	UNSAT TT=38.474 ASSIGNMENTS=283	UNSAT TT=18.832 CHECKS=0 NODES=1276	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=11.966 ASSIGNMENTS=859 CHECKS=319	UNSAT TT=12.689 ASSIGNMENTS=859 CHECKS=319	UNSAT TT=538.073	UNSAT TT=372.307	UNSAT TT=6.247 CHECKS=39626	UNSAT TT=2.994 ASSIGNMENTS=328 CHECKS=61768	UNSAT TT=25.34 ASSIGNMENTS=4172 CHECKS=530408	UNSAT TT=34.749	UNSAT TT=10.763 ASSIGNMENTS=1718 CHECKS=230100	UNSAT TT=3.039 ASSIGNMENTS=328 CHECKS=62934	? TT=27.252	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800
csp/wordsVg/ normalized-crossword-m1c-words-vg8-8_ext.xml	UNSAT TT=256.285	UNSAT TT=256.285 CHECKS=426947 NODES=134285	UNSAT TT=303.051 CHECKS=519285 NODES=150321	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=1532.94 ASSIGNMENTS=42898	? (TO) TT=1800.14	UNSAT TT=945.495 CHECKS=0 NODES=187913	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=715.543 ASSIGNMENTS=86725 CHECKS=11935100	UNSAT TT=739.616 ASSIGNMENTS=86725 CHECKS=11935100	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=595.667 CHECKS=7742600	UNSAT TT=586.258 ASSIGNMENTS=85013 CHECKS=11811600	UNSAT TT=571.922 ASSIGNMENTS=84026 CHECKS=11362200	? (TO) TT=1800.08	UNSAT TT=526.102 ASSIGNMENTS=82817 CHECKS=11378900	UNSAT TT=559.285 ASSIGNMENTS=86725 CHECKS=11935100	? TT=27.985	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg8-9_ext.xml	UNSAT TT=157.179	UNSAT TT=157.179 CHECKS=203242 NODES=68003	UNSAT TT=206.856 CHECKS=219348 NODES=84429	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=1211.58 ASSIGNMENTS=29613	? (TO) TT=1800.08	UNSAT TT=502.983 CHECKS=0 NODES=79532	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=161.908 ASSIGNMENTS=68003 CHECKS=203242	UNSAT TT=375.816 ASSIGNMENTS=33324 CHECKS=4975340	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=279.881 CHECKS=2741370	UNSAT TT=230.623 ASSIGNMENTS=30065 CHECKS=4530170	UNSAT TT=233.677 ASSIGNMENTS=31296 CHECKS=4457640	? (TO) TT=1800.08	UNSAT TT=215.221 ASSIGNMENTS=28633 CHECKS=4184700	UNSAT TT=236.248 ASSIGNMENTS=33324 CHECKS=4975340	? TT=35.786	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02
csp/wordsVg/ normalized-crossword-m1c-words-vg9-10_ext.xml	UNSAT TT=25.952	UNSAT TT=25.952 CHECKS=3137 NODES=5749	UNSAT TT=26.456 CHECKS=3604 NODES=5760	? (TO) TT=1800.07	UNSAT TT=731.397 CHECKS=730952	UNSAT TT=384.645 CHECKS=481514	UNSAT TT=97.258 ASSIGNMENTS=1737	UNSAT TT=1654.54 ASSIGNMENTS=17873	UNSAT TT=83.236 CHECKS=0 NODES=7129	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=31.387 ASSIGNMENTS=5749 CHECKS=3137	UNSAT TT=31.94 ASSIGNMENTS=5749 CHECKS=3137	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=124.13 CHECKS=796497	UNSAT TT=47.702 ASSIGNMENTS=5299 CHECKS=909166	UNSAT TT=55.867 ASSIGNMENTS=7798 CHECKS=1107920	UNSAT TT=344.076	UNSAT TT=45.792 ASSIGNMENTS=5835 CHECKS=879127	UNSAT TT=68.572 ASSIGNMENTS=8274 CHECKS=1297820	? TT=31.916	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03
csp/wordsVg/ normalized-crossword-m1c-words-vg9-11_ext.xml	UNSAT TT=9.688	UNSAT TT=9.688 CHECKS=628 NODES=1930	UNSAT TT=11.253 CHECKS=706 NODES=1898	? (TO) TT=1800.12	UNSAT TT=331.904 CHECKS=360313	UNSAT TT=122.437 CHECKS=151365	UNSAT TT=46.97 ASSIGNMENTS=486	UNSAT TT=84.602 ASSIGNMENTS=897	UNSAT TT=29.583 CHECKS=0 NODES=2185	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=17.041 ASSIGNMENTS=1930 CHECKS=628	UNSAT TT=16.863 ASSIGNMENTS=1930 CHECKS=628	UNSAT TT=948.661	UNSAT TT=1110.34	UNSAT TT=31.108 CHECKS=162880	UNSAT TT=12.807 ASSIGNMENTS=1424 CHECKS=241581	UNSAT TT=35.179 ASSIGNMENTS=4847 CHECKS=657431	UNSAT TT=113.591	UNSAT TT=18.707 ASSIGNMENTS=2778 CHECKS=406946	UNSAT TT=15.741 ASSIGNMENTS=1788 CHECKS=312446	? TT=29.779	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07
csp/wordsVg/ normalized-crossword-m1c-words-vg9-12_ext.xml	UNSAT TT=3.542	UNSAT TT=3.855 CHECKS=72 NODES=593	UNSAT TT=5.1 CHECKS=100 NODES=588	? (TO) TT=1800.14	UNSAT TT=103.125 CHECKS=123784	UNSAT TT=64.532 CHECKS=69241	UNSAT TT=30.268 ASSIGNMENTS=119	UNSAT TT=36.959 ASSIGNMENTS=133	UNSAT TT=10.905 CHECKS=0 NODES=780	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=11.015 ASSIGNMENTS=593 CHECKS=72	UNSAT TT=11.386 ASSIGNMENTS=593 CHECKS=72	UNSAT TT=353.65	UNSAT TT=261.355	UNSAT TT=13.454 CHECKS=62134	UNSAT TT=3.542 ASSIGNMENTS=396 CHECKS=70514	UNSAT TT=26.578 ASSIGNMENTS=3882 CHECKS=499662	UNSAT TT=31.826	UNSAT TT=11.595 ASSIGNMENTS=1776 CHECKS=242355	UNSAT TT=5.186 ASSIGNMENTS=599 CHECKS=102215	? TT=24.807	? (TO) TT=1800.03	UNSAT TT=1550.59	? (TO) TT=1800.07
csp/wordsVg/ normalized-crossword-m1c-words-vg9-13_ext.xml	UNSAT TT=1.217	UNSAT TT=1.769 CHECKS=0 NODES=161	UNSAT TT=4.298 CHECKS=0 NODES=161	? (TO) TT=1800.1	UNSAT TT=62.482 CHECKS=83238	UNSAT TT=28.338 CHECKS=30748	UNSAT TT=25.693 ASSIGNMENTS=0	UNSAT TT=25.182 ASSIGNMENTS=0	UNSAT TT=4.139 CHECKS=0 NODES=214	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=1.241 ASSIGNMENTS=120 CHECKS=24524	UNSAT TT=1.227 ASSIGNMENTS=120 CHECKS=24524	UNSAT TT=124.56	UNSAT TT=77.744	UNSAT TT=5.52 CHECKS=22357	UNSAT TT=1.308 ASSIGNMENTS=138 CHECKS=25506	UNSAT TT=24.231 ASSIGNMENTS=3439 CHECKS=457977	UNSAT TT=16.551	UNSAT TT=8.597 ASSIGNMENTS=1554 CHECKS=181939	UNSAT TT=1.217 ASSIGNMENTS=120 CHECKS=24524	? TT=24.597	? (TO) TT=1800.03	UNSAT TT=567.205	? (TO) TT=1800.02

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	178	176	69	144	150	164	155	155	44	35	173	172	126	128	170	175	152	171	174	3	116	94
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	178	176	69	144	150	164	155	155	44	35	173	172	126	128	170	175	152	171	174	3	116	94
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	33	12	0	0	0	0	0	1	0	0	13	4	0	0	14	44	0	20	47	0	0	0
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0