CSP 2008 Competition: results by benchmark

Results by benchmark for category n-ary constraints in extension (N-ARY-EXT)

This page displays the results of the different solvers for each benchmark for category n-ary constraints in extension (N-ARY-EXT)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
mddc-solv 2008-06-09
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
spider 2008-06-14
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-100/ normalized-aim-100-1-6-sat-1_ext.xml	SAT TT=0.009	SAT TT=0.837 CHECKS=1705 NODES=236	SAT TT=0.854 CHECKS=3280 NODES=357	SAT TT=30.865	SAT TT=0.013 CHECKS=1438	SAT TT=0.017 CHECKS=4422	SAT TT=0.509 ASSIGNMENTS=15	SAT TT=0.467 ASSIGNMENTS=8	SAT TT=0.423 CHECKS=809 NODES=151	? (TO) TT=1800.04	SAT TT=0.443 CHECKS=153439 NODES=1104	SAT TT=0.022 ASSIGNMENTS=81 CHECKS=2550	SAT TT=0.023 ASSIGNMENTS=81 CHECKS=2550	SAT TT=0.971	SAT TT=1.179	SAT TT=0.057 CHECKS=4633	SAT TT=0.009 ASSIGNMENTS=80 CHECKS=2661	SAT TT=0.035 ASSIGNMENTS=5759 CHECKS=89684	SAT TT=0.431	SAT TT=0.013 ASSIGNMENTS=353 CHECKS=12552	SAT TT=0.011 ASSIGNMENTS=81 CHECKS=2550	SAT TT=0.973	SAT TT=0.025 ASSIGNMENTS=105 CHECKS=1900	SAT TT=0.743	SAT TT=0.742
csp/aim-100/ normalized-aim-100-1-6-sat-2_ext.xml	SAT TT=0.013	SAT TT=0.836 CHECKS=6717 NODES=839	SAT TT=0.862 CHECKS=3778 NODES=490	SAT TT=154.458	SAT TT=0.023 CHECKS=7555	SAT TT=0.041 CHECKS=31706	SAT TT=0.501 ASSIGNMENTS=33	SAT TT=0.479 ASSIGNMENTS=17	SAT TT=0.496 CHECKS=2236 NODES=308	? (TO) TT=1800.05	SAT TT=0.419 CHECKS=145002 NODES=943	SAT TT=0.024 ASSIGNMENTS=274 CHECKS=7201	SAT TT=0.025 ASSIGNMENTS=274 CHECKS=7201	SAT TT=1.1	SAT TT=0.909	SAT TT=0.046 CHECKS=9881	SAT TT=0.013 ASSIGNMENTS=407 CHECKS=10178	SAT TT=0.031 ASSIGNMENTS=5908 CHECKS=85589	SAT TT=0.427	SAT TT=0.013 ASSIGNMENTS=357 CHECKS=8522	SAT TT=0.013 ASSIGNMENTS=274 CHECKS=7201	SAT TT=0.873	SAT TT=0.026 ASSIGNMENTS=227 CHECKS=5363	SAT TT=0.661	SAT TT=0.694
csp/aim-100/ normalized-aim-100-1-6-sat-3_ext.xml	SAT TT=0.011	SAT TT=0.837 CHECKS=5946 NODES=929	SAT TT=0.968 CHECKS=7737 NODES=937	SAT TT=110.652	SAT TT=0.014 CHECKS=3166	SAT TT=0.038 CHECKS=30860	SAT TT=0.527 ASSIGNMENTS=273	SAT TT=0.553 ASSIGNMENTS=327	SAT TT=0.449 CHECKS=1065 NODES=174	? (TO) TT=1800.06	SAT TT=2.144 CHECKS=12091200 NODES=73135	SAT TT=0.022 ASSIGNMENTS=203 CHECKS=5090	SAT TT=0.022 ASSIGNMENTS=203 CHECKS=5090	SAT TT=0.906	SAT TT=0.975	SAT TT=0.045 CHECKS=10042	SAT TT=0.012 ASSIGNMENTS=413 CHECKS=10441	SAT TT=0.03 ASSIGNMENTS=6055 CHECKS=77553	SAT TT=0.346	SAT TT=0.012 ASSIGNMENTS=372 CHECKS=6794	SAT TT=0.011 ASSIGNMENTS=203 CHECKS=5090	SAT TT=0.902	SAT TT=0.041 ASSIGNMENTS=540 CHECKS=25724	SAT TT=0.645	SAT TT=0.689
csp/aim-100/ normalized-aim-100-1-6-sat-4_ext.xml	SAT TT=0.011	SAT TT=0.77 CHECKS=1103 NODES=215	SAT TT=0.819 CHECKS=1526 NODES=212	SAT TT=1.302	SAT TT=0.022 CHECKS=7911	SAT TT=0.02 CHECKS=7522	SAT TT=0.528 ASSIGNMENTS=230	SAT TT=0.552 ASSIGNMENTS=79	SAT TT=0.4 CHECKS=1190 NODES=177	? (TO) TT=1800.05	SAT TT=0.501 CHECKS=298671 NODES=1688	SAT TT=0.023 ASSIGNMENTS=168 CHECKS=4432	SAT TT=0.023 ASSIGNMENTS=168 CHECKS=4432	SAT TT=0.929	SAT TT=1.105	SAT TT=0.039 CHECKS=2257	SAT TT=0.012 ASSIGNMENTS=186 CHECKS=4657	SAT TT=0.032 ASSIGNMENTS=5793 CHECKS=86640	SAT TT=0.354	SAT TT=0.011 ASSIGNMENTS=265 CHECKS=4661	SAT TT=0.011 ASSIGNMENTS=168 CHECKS=4432	SAT TT=0.805	SAT TT=0.024 ASSIGNMENTS=317 CHECKS=15269	SAT TT=0.696	SAT TT=0.648
csp/aim-100/ normalized-aim-100-1-6-unsat-1_ext.xml	UNSAT TT=0.023	UNSAT TT=1.061 CHECKS=54585 NODES=5225	UNSAT TT=1.07 CHECKS=50025 NODES=4694	? (TO) TT=1800.04	UNSAT TT=0.102 CHECKS=61774	UNSAT TT=0.089 CHECKS=64928	UNSAT TT=1.032 ASSIGNMENTS=5914	UNSAT TT=0.82 ASSIGNMENTS=1391	UNSAT TT=0.456 CHECKS=7064 NODES=589	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=0.041 ASSIGNMENTS=2886 CHECKS=60434	UNSAT TT=0.04 ASSIGNMENTS=2886 CHECKS=60434	UNSAT TT=0.565	UNSAT TT=0.696	UNSAT TT=0.07 CHECKS=26332	UNSAT TT=0.024 ASSIGNMENTS=2881 CHECKS=63131	UNSAT TT=0.031 ASSIGNMENTS=8029 CHECKS=90757	UNSAT TT=0.445	UNSAT TT=0.023 ASSIGNMENTS=2017 CHECKS=35977	UNSAT TT=0.025 ASSIGNMENTS=2886 CHECKS=60434	UNSAT TT=0.821	UNSAT TT=0.066 ASSIGNMENTS=887 CHECKS=32392	UNSAT TT=0.66	UNSAT TT=0.648
csp/aim-100/ normalized-aim-100-1-6-unsat-2_ext.xml	UNSAT TT=0.015	UNSAT TT=0.962 CHECKS=19505 NODES=1835	UNSAT TT=0.926 CHECKS=19461 NODES=1768	UNSAT TT=201.423	UNSAT TT=0.058 CHECKS=29844	UNSAT TT=0.171 CHECKS=131979	UNSAT TT=0.712 ASSIGNMENTS=1705	UNSAT TT=0.607 ASSIGNMENTS=388	UNSAT TT=0.525 CHECKS=5820 NODES=494	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=0.04 ASSIGNMENTS=2271 CHECKS=56365	UNSAT TT=0.037 ASSIGNMENTS=2271 CHECKS=56365	UNSAT TT=0.572	UNSAT TT=0.57	UNSAT TT=0.069 CHECKS=25720	UNSAT TT=0.028 ASSIGNMENTS=2350 CHECKS=61699	UNSAT TT=0.038 ASSIGNMENTS=7613 CHECKS=107465	UNSAT TT=0.366	UNSAT TT=0.015 ASSIGNMENTS=620 CHECKS=13227	UNSAT TT=0.023 ASSIGNMENTS=2271 CHECKS=56365	UNSAT TT=0.799	UNSAT TT=0.059 ASSIGNMENTS=1466 CHECKS=65779	UNSAT TT=0.65	UNSAT TT=0.678
csp/aim-100/ normalized-aim-100-1-6-unsat-3_ext.xml	UNSAT TT=0.068	UNSAT TT=1.089 CHECKS=71698 NODES=6813	UNSAT TT=1.282 CHECKS=105326 NODES=9372	? (TO) TT=1800.08	UNSAT TT=0.448 CHECKS=317483	UNSAT TT=0.226 CHECKS=192589	UNSAT TT=2.701 ASSIGNMENTS=27877	UNSAT TT=0.713 ASSIGNMENTS=1207	UNSAT TT=0.898 CHECKS=114616 NODES=7084	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.09 ASSIGNMENTS=10409 CHECKS=226716	UNSAT TT=0.094 ASSIGNMENTS=10409 CHECKS=226716	UNSAT TT=0.715	UNSAT TT=0.557	UNSAT TT=0.127 CHECKS=72138	UNSAT TT=0.068 ASSIGNMENTS=9660 CHECKS=213423	UNSAT TT=0.067 ASSIGNMENTS=13197 CHECKS=210238	UNSAT TT=0.618	UNSAT TT=0.084 ASSIGNMENTS=10146 CHECKS=239740	UNSAT TT=0.07 ASSIGNMENTS=10409 CHECKS=226716	UNSAT TT=0.817	UNSAT TT=0.617 ASSIGNMENTS=21358 CHECKS=700509	UNSAT TT=0.668	UNSAT TT=0.689
csp/aim-100/ normalized-aim-100-1-6-unsat-4_ext.xml	UNSAT TT=0.028	UNSAT TT=1.012 CHECKS=28155 NODES=3311	UNSAT TT=1.02 CHECKS=33338 NODES=3713	? (TO) TT=1800.1	UNSAT TT=0.145 CHECKS=87309	UNSAT TT=0.15 CHECKS=118548	UNSAT TT=1.276 ASSIGNMENTS=8856	UNSAT TT=1.814 ASSIGNMENTS=11034	UNSAT TT=0.47 CHECKS=6361 NODES=596	? (TO) TT=1800.09	? (TO) TT=1800	UNSAT TT=0.076 ASSIGNMENTS=8133 CHECKS=178844	UNSAT TT=0.077 ASSIGNMENTS=8133 CHECKS=178844	UNSAT TT=0.705	UNSAT TT=0.564	UNSAT TT=0.071 CHECKS=21643	UNSAT TT=0.037 ASSIGNMENTS=5255 CHECKS=118129	UNSAT TT=0.034 ASSIGNMENTS=8264 CHECKS=82592	UNSAT TT=0.441	UNSAT TT=0.028 ASSIGNMENTS=2732 CHECKS=52884	UNSAT TT=0.052 ASSIGNMENTS=8133 CHECKS=178844	UNSAT TT=0.868	UNSAT TT=0.085 ASSIGNMENTS=2108 CHECKS=68085	UNSAT TT=0.666	UNSAT TT=0.705
csp/aim-100/ normalized-aim-100-2-0-sat-1_ext.xml	SAT TT=0.013	SAT TT=0.868 CHECKS=6443 NODES=838	SAT TT=0.929 CHECKS=8534 NODES=938	SAT TT=193.579	SAT TT=0.066 CHECKS=40312	SAT TT=0.036 CHECKS=23149	SAT TT=0.638 ASSIGNMENTS=707	SAT TT=0.834 ASSIGNMENTS=1272	SAT TT=0.537 CHECKS=3027 NODES=272	SAT TT=18.447 CHECKS=66901000 NODES=3076570	SAT TT=0.59 CHECKS=1001320 NODES=5272	SAT TT=0.024 ASSIGNMENTS=490 CHECKS=12713	SAT TT=0.026 ASSIGNMENTS=490 CHECKS=12713	SAT TT=1.076	SAT TT=0.94	SAT TT=0.049 CHECKS=11863	SAT TT=0.015 ASSIGNMENTS=561 CHECKS=19429	SAT TT=0.043 ASSIGNMENTS=5316 CHECKS=136211	SAT TT=0.392	SAT TT=0.013 ASSIGNMENTS=450 CHECKS=9729	SAT TT=0.013 ASSIGNMENTS=490 CHECKS=12713	SAT TT=0.827	SAT TT=0.065 ASSIGNMENTS=1130 CHECKS=63380	SAT TT=0.735	SAT TT=0.708
csp/aim-100/ normalized-aim-100-2-0-sat-2_ext.xml	SAT TT=0.016	SAT TT=0.96 CHECKS=26691 NODES=2591	SAT TT=1.025 CHECKS=25652 NODES=2414	SAT TT=54.542	SAT TT=0.178 CHECKS=151621	SAT TT=0.136 CHECKS=154655	SAT TT=0.896 ASSIGNMENTS=2354	SAT TT=1.103 ASSIGNMENTS=3374	SAT TT=0.525 CHECKS=19967 NODES=928	SAT TT=604.591 CHECKS=2285100000 NODES=100912000	SAT TT=1532.64 CHECKS=11544600000 NODES=31098400	SAT TT=0.031 ASSIGNMENTS=822 CHECKS=33873	SAT TT=0.03 ASSIGNMENTS=822 CHECKS=33873	SAT TT=1.025	SAT TT=1.244	SAT TT=0.065 CHECKS=32651	SAT TT=0.016 ASSIGNMENTS=800 CHECKS=32848	SAT TT=0.044 ASSIGNMENTS=5354 CHECKS=142545	SAT TT=0.406	SAT TT=0.016 ASSIGNMENTS=585 CHECKS=17249	SAT TT=0.019 ASSIGNMENTS=822 CHECKS=33873	SAT TT=0.876	SAT TT=0.076 ASSIGNMENTS=639 CHECKS=29969	SAT TT=0.673	SAT TT=0.796
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-100/ normalized-aim-100-2-0-sat-3_ext.xml	SAT TT=0.013	SAT TT=0.859 CHECKS=5023 NODES=570	SAT TT=0.822 CHECKS=1673 NODES=233	SAT TT=2.442	SAT TT=0.015 CHECKS=4055	SAT TT=0.118 CHECKS=147710	SAT TT=0.591 ASSIGNMENTS=338	SAT TT=0.485 ASSIGNMENTS=7	SAT TT=0.524 CHECKS=2766 NODES=256	SAT TT=439.907 CHECKS=1594820000 NODES=77786100	? (TO) TT=1800.04	SAT TT=0.034 ASSIGNMENTS=968 CHECKS=42795	SAT TT=0.033 ASSIGNMENTS=968 CHECKS=42795	SAT TT=1.124	SAT TT=1.032	SAT TT=0.077 CHECKS=12697	SAT TT=0.023 ASSIGNMENTS=1443 CHECKS=55357	SAT TT=0.046 ASSIGNMENTS=5382 CHECKS=136304	SAT TT=0.441	SAT TT=0.013 ASSIGNMENTS=563 CHECKS=15966	SAT TT=0.02 ASSIGNMENTS=968 CHECKS=42795	SAT TT=1.007	SAT TT=0.055 ASSIGNMENTS=724 CHECKS=31913	SAT TT=0.748	SAT TT=0.719
csp/aim-100/ normalized-aim-100-2-0-sat-4_ext.xml	SAT TT=0.015	SAT TT=0.923 CHECKS=8479 NODES=977	SAT TT=0.891 CHECKS=10400 NODES=1197	SAT TT=332.479	SAT TT=0.089 CHECKS=63789	SAT TT=0.058 CHECKS=65978	SAT TT=0.574 ASSIGNMENTS=279	SAT TT=0.682 ASSIGNMENTS=768	SAT TT=0.424 CHECKS=2819 NODES=255	SAT TT=796.756 CHECKS=3027680000 NODES=143701000	SAT TT=0.515 CHECKS=173781 NODES=1221	SAT TT=0.026 ASSIGNMENTS=271 CHECKS=12723	SAT TT=0.019 ASSIGNMENTS=271 CHECKS=12723	SAT TT=1.04	SAT TT=1.096	SAT TT=0.065 CHECKS=19179	SAT TT=0.015 ASSIGNMENTS=445 CHECKS=23246	SAT TT=0.045 ASSIGNMENTS=5460 CHECKS=141277	SAT TT=0.417	SAT TT=0.025 ASSIGNMENTS=1439 CHECKS=58079	SAT TT=0.015 ASSIGNMENTS=271 CHECKS=12723	SAT TT=0.891	SAT TT=0.033 ASSIGNMENTS=247 CHECKS=7456	SAT TT=0.676	SAT TT=0.713
csp/aim-100/ normalized-aim-100-2-0-unsat-1_ext.xml	UNSAT TT=0.011	UNSAT TT=0.812 CHECKS=1576 NODES=238	UNSAT TT=0.803 CHECKS=1036 NODES=147	UNSAT TT=388.858	UNSAT TT=0.024 CHECKS=6978	UNSAT TT=0.025 CHECKS=10526	UNSAT TT=0.533 ASSIGNMENTS=203	UNSAT TT=0.664 ASSIGNMENTS=120	UNSAT TT=0.435 CHECKS=1422 NODES=89	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.025 ASSIGNMENTS=181 CHECKS=6009	UNSAT TT=0.025 ASSIGNMENTS=181 CHECKS=6009	UNSAT TT=0.804	UNSAT TT=0.601	UNSAT TT=0.04 CHECKS=2754	UNSAT TT=0.013 ASSIGNMENTS=173 CHECKS=5951	UNSAT TT=0.041 ASSIGNMENTS=5820 CHECKS=122320	UNSAT TT=0.397	UNSAT TT=0.012 ASSIGNMENTS=228 CHECKS=3612	UNSAT TT=0.011 ASSIGNMENTS=181 CHECKS=6009	UNSAT TT=0.876	UNSAT TT=0.023 ASSIGNMENTS=74 CHECKS=3047	UNSAT TT=0.74	UNSAT TT=0.741
csp/aim-100/ normalized-aim-100-2-0-unsat-2_ext.xml	UNSAT TT=0.013	UNSAT TT=0.99 CHECKS=8547 NODES=869	UNSAT TT=0.945 CHECKS=15082 NODES=1327	? (TO) TT=1800.07	UNSAT TT=0.079 CHECKS=49886	UNSAT TT=0.135 CHECKS=119309	UNSAT TT=0.671 ASSIGNMENTS=957	UNSAT TT=0.602 ASSIGNMENTS=371	UNSAT TT=0.481 CHECKS=7666 NODES=439	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.027 ASSIGNMENTS=872 CHECKS=26851	UNSAT TT=0.029 ASSIGNMENTS=872 CHECKS=26851	UNSAT TT=0.615	UNSAT TT=0.739	UNSAT TT=0.059 CHECKS=15480	UNSAT TT=0.017 ASSIGNMENTS=875 CHECKS=27836	UNSAT TT=0.043 ASSIGNMENTS=5835 CHECKS=130309	UNSAT TT=0.393	UNSAT TT=0.013 ASSIGNMENTS=427 CHECKS=8833	UNSAT TT=0.018 ASSIGNMENTS=872 CHECKS=26851	UNSAT TT=0.872	UNSAT TT=0.032 ASSIGNMENTS=263 CHECKS=13063	UNSAT TT=0.74	UNSAT TT=0.711
csp/aim-100/ normalized-aim-100-2-0-unsat-3_ext.xml	UNSAT TT=0.014	UNSAT TT=0.875 CHECKS=5497 NODES=672	UNSAT TT=0.88 CHECKS=4609 NODES=485	? (TO) TT=1800.05	UNSAT TT=0.098 CHECKS=61315	UNSAT TT=0.075 CHECKS=60036	UNSAT TT=0.765 ASSIGNMENTS=1532	UNSAT TT=1.178 ASSIGNMENTS=3895	UNSAT TT=0.439 CHECKS=1450 NODES=118	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.027 ASSIGNMENTS=718 CHECKS=17966	UNSAT TT=0.027 ASSIGNMENTS=718 CHECKS=17966	UNSAT TT=0.607	UNSAT TT=0.716	UNSAT TT=0.055 CHECKS=14314	UNSAT TT=0.016 ASSIGNMENTS=781 CHECKS=21279	UNSAT TT=0.043 ASSIGNMENTS=5849 CHECKS=128601	UNSAT TT=0.426	UNSAT TT=0.014 ASSIGNMENTS=311 CHECKS=5465	UNSAT TT=0.014 ASSIGNMENTS=718 CHECKS=17966	UNSAT TT=0.813	UNSAT TT=0.033 ASSIGNMENTS=428 CHECKS=20560	UNSAT TT=0.71	UNSAT TT=0.708
csp/aim-100/ normalized-aim-100-2-0-unsat-4_ext.xml	UNSAT TT=0.013	UNSAT TT=0.87 CHECKS=4386 NODES=605	UNSAT TT=0.871 CHECKS=4646 NODES=533	? (TO) TT=1800.07	UNSAT TT=0.057 CHECKS=28397	UNSAT TT=0.048 CHECKS=33238	UNSAT TT=0.678 ASSIGNMENTS=1228	UNSAT TT=0.748 ASSIGNMENTS=860	UNSAT TT=0.438 CHECKS=1931 NODES=160	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=0.027 ASSIGNMENTS=1286 CHECKS=26574	UNSAT TT=0.03 ASSIGNMENTS=1286 CHECKS=26574	UNSAT TT=0.595	UNSAT TT=0.592	UNSAT TT=0.061 CHECKS=12185	UNSAT TT=0.015 ASSIGNMENTS=693 CHECKS=17969	UNSAT TT=0.047 ASSIGNMENTS=6023 CHECKS=128980	UNSAT TT=0.394	UNSAT TT=0.013 ASSIGNMENTS=392 CHECKS=8781	UNSAT TT=0.017 ASSIGNMENTS=1286 CHECKS=26574	UNSAT TT=0.868	UNSAT TT=0.029 ASSIGNMENTS=316 CHECKS=20565	UNSAT TT=0.728	UNSAT TT=0.734
csp/aim-100/ normalized-aim-100-3-4-sat-1_ext.xml	SAT TT=0.017	SAT TT=0.943 CHECKS=6661 NODES=482	SAT TT=0.983 CHECKS=4564 NODES=260	SAT TT=0.096	SAT TT=0.04 CHECKS=20518	SAT TT=0.059 CHECKS=47645	SAT TT=0.588 ASSIGNMENTS=72	SAT TT=0.65 ASSIGNMENTS=43	SAT TT=0.49 CHECKS=6534 NODES=225	SAT TT=0.598 CHECKS=513932 NODES=13417	SAT TT=0.752 CHECKS=1443200 NODES=6733	SAT TT=0.031 ASSIGNMENTS=294 CHECKS=39044	SAT TT=0.034 ASSIGNMENTS=294 CHECKS=39044	SAT TT=1.109	SAT TT=1.333	SAT TT=0.073 CHECKS=26182	SAT TT=0.017 ASSIGNMENTS=146 CHECKS=12809	SAT TT=0.023 ASSIGNMENTS=502 CHECKS=47403	SAT TT=0.522	SAT TT=0.018 ASSIGNMENTS=288 CHECKS=24805	SAT TT=0.022 ASSIGNMENTS=294 CHECKS=39044	SAT TT=1.08	SAT TT=0.036 ASSIGNMENTS=356 CHECKS=32039	SAT TT=0.804	SAT TT=0.932
csp/aim-100/ normalized-aim-100-3-4-sat-2_ext.xml	SAT TT=0.016	SAT TT=0.941 CHECKS=15528 NODES=937	SAT TT=0.981 CHECKS=6237 NODES=487	SAT TT=0.138	SAT TT=0.045 CHECKS=25461	SAT TT=0.18 CHECKS=214568	SAT TT=0.757 ASSIGNMENTS=456	SAT TT=0.762 ASSIGNMENTS=225	SAT TT=0.5 CHECKS=5724 NODES=223	SAT TT=0.519 CHECKS=66552 NODES=1641	SAT TT=0.507 CHECKS=67361 NODES=597	SAT TT=0.027 ASSIGNMENTS=76 CHECKS=6737	SAT TT=0.027 ASSIGNMENTS=76 CHECKS=6737	SAT TT=1.25	SAT TT=1.214	SAT TT=0.078 CHECKS=22749	SAT TT=0.016 ASSIGNMENTS=112 CHECKS=11424	SAT TT=0.107 ASSIGNMENTS=4400 CHECKS=410169	SAT TT=0.528	SAT TT=0.018 ASSIGNMENTS=238 CHECKS=13364	SAT TT=0.016 ASSIGNMENTS=76 CHECKS=6737	SAT TT=1.007	SAT TT=0.037 ASSIGNMENTS=127 CHECKS=10643	SAT TT=0.879	SAT TT=0.921
csp/aim-100/ normalized-aim-100-3-4-sat-3_ext.xml	SAT TT=0.017	SAT TT=0.946 CHECKS=8184 NODES=554	SAT TT=1.105 CHECKS=6108 NODES=383	SAT TT=0.404	SAT TT=0.049 CHECKS=27040	SAT TT=0.079 CHECKS=81656	SAT TT=0.668 ASSIGNMENTS=237	SAT TT=0.854 ASSIGNMENTS=407	SAT TT=0.498 CHECKS=12536 NODES=319	SAT TT=1.883 CHECKS=5109430 NODES=135596	SAT TT=0.605 CHECKS=884700 NODES=4991	SAT TT=0.029 ASSIGNMENTS=213 CHECKS=24325	SAT TT=0.03 ASSIGNMENTS=213 CHECKS=24325	SAT TT=1.368	SAT TT=1.116	SAT TT=0.073 CHECKS=18507	SAT TT=0.017 ASSIGNMENTS=179 CHECKS=19251	SAT TT=0.101 ASSIGNMENTS=4148 CHECKS=370323	SAT TT=0.513	SAT TT=0.017 ASSIGNMENTS=195 CHECKS=12246	SAT TT=0.018 ASSIGNMENTS=213 CHECKS=24325	SAT TT=1.064	SAT TT=0.045 ASSIGNMENTS=306 CHECKS=35529	SAT TT=0.82	SAT TT=0.8
csp/aim-100/ normalized-aim-100-3-4-sat-4_ext.xml	SAT TT=0.015	SAT TT=1.043 CHECKS=12276 NODES=818	SAT TT=0.999 CHECKS=14267 NODES=951	SAT TT=0.122	SAT TT=0.038 CHECKS=16731	SAT TT=0.085 CHECKS=97262	SAT TT=0.753 ASSIGNMENTS=223	SAT TT=0.623 ASSIGNMENTS=78	SAT TT=0.501 CHECKS=3037 NODES=152	SAT TT=0.591 CHECKS=462611 NODES=12097	SAT TT=0.5 CHECKS=42780 NODES=370	SAT TT=0.027 ASSIGNMENTS=85 CHECKS=8617	SAT TT=0.028 ASSIGNMENTS=85 CHECKS=8617	SAT TT=1.115	SAT TT=1.184	SAT TT=0.062 CHECKS=7732	SAT TT=0.016 ASSIGNMENTS=102 CHECKS=11081	SAT TT=0.087 ASSIGNMENTS=4132 CHECKS=349463	SAT TT=0.442	SAT TT=0.023 ASSIGNMENTS=432 CHECKS=38569	SAT TT=0.015 ASSIGNMENTS=85 CHECKS=8617	SAT TT=0.961	SAT TT=0.057 ASSIGNMENTS=347 CHECKS=41517	SAT TT=0.831	SAT TT=0.872
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-100/ normalized-aim-100-6-0-sat-1_ext.xml	SAT TT=0.016	SAT TT=0.965 CHECKS=2044 NODES=127	SAT TT=0.982 CHECKS=2530 NODES=0	SAT TT=0.111	SAT TT=0.028 CHECKS=6997	SAT TT=0.033 CHECKS=12271	SAT TT=0.605 ASSIGNMENTS=1	SAT TT=0.622 ASSIGNMENTS=1	SAT TT=0.548 CHECKS=3151 NODES=123	SAT TT=3.935 CHECKS=10146500 NODES=150955	SAT TT=0.588 CHECKS=46368 NODES=200	SAT TT=0.032 ASSIGNMENTS=23 CHECKS=7338	SAT TT=0.033 ASSIGNMENTS=23 CHECKS=7338	SAT TT=1.338	SAT TT=1.222	SAT TT=0.067 CHECKS=4888	SAT TT=0.016 ASSIGNMENTS=17 CHECKS=3926	SAT TT=0.02 ASSIGNMENTS=32 CHECKS=9463	SAT TT=0.523	SAT TT=0.02 ASSIGNMENTS=66 CHECKS=5961	SAT TT=0.018 ASSIGNMENTS=23 CHECKS=7338	SAT TT=1.076	SAT TT=0.043 ASSIGNMENTS=146 CHECKS=24760	SAT TT=0.969	SAT TT=1.051
csp/aim-100/ normalized-aim-100-6-0-sat-2_ext.xml	SAT TT=0.018	SAT TT=1.039 CHECKS=4821 NODES=226	SAT TT=1.02 CHECKS=5772 NODES=210	SAT TT=0.118	SAT TT=0.041 CHECKS=15112	SAT TT=0.032 CHECKS=10693	SAT TT=0.792 ASSIGNMENTS=1	SAT TT=0.624 ASSIGNMENTS=1	SAT TT=0.694 CHECKS=2725 NODES=115	SAT TT=0.808 CHECKS=23695 NODES=236	SAT TT=0.598 CHECKS=63307 NODES=347	SAT TT=0.032 ASSIGNMENTS=27 CHECKS=6514	SAT TT=0.032 ASSIGNMENTS=27 CHECKS=6514	SAT TT=1.435	SAT TT=1.296	SAT TT=0.073 CHECKS=4909	SAT TT=0.02 ASSIGNMENTS=18 CHECKS=5475	SAT TT=0.024 ASSIGNMENTS=128 CHECKS=26139	SAT TT=0.56	SAT TT=0.018 ASSIGNMENTS=31 CHECKS=4629	SAT TT=0.021 ASSIGNMENTS=27 CHECKS=6514	SAT TT=1.14	SAT TT=0.043 ASSIGNMENTS=154 CHECKS=23821	SAT TT=0.904	SAT TT=1.104
csp/aim-100/ normalized-aim-100-6-0-sat-3_ext.xml	SAT TT=0.019	SAT TT=0.92 CHECKS=1876 NODES=116	SAT TT=0.938 CHECKS=3048 NODES=0	SAT TT=0.089	SAT TT=0.029 CHECKS=6762	SAT TT=0.031 CHECKS=11254	SAT TT=0.782 ASSIGNMENTS=1	SAT TT=0.633 ASSIGNMENTS=1	SAT TT=0.598 CHECKS=4664 NODES=146	SAT TT=3.681 CHECKS=10094400 NODES=150168	SAT TT=0.593 CHECKS=46215 NODES=171	SAT TT=0.032 ASSIGNMENTS=30 CHECKS=7329	SAT TT=0.033 ASSIGNMENTS=30 CHECKS=7329	SAT TT=1.445	SAT TT=1.222	SAT TT=0.068 CHECKS=5839	SAT TT=0.019 ASSIGNMENTS=22 CHECKS=6290	SAT TT=0.021 ASSIGNMENTS=72 CHECKS=13300	SAT TT=0.631	SAT TT=0.02 ASSIGNMENTS=65 CHECKS=5689	SAT TT=0.019 ASSIGNMENTS=30 CHECKS=7329	SAT TT=1.114	SAT TT=0.044 ASSIGNMENTS=172 CHECKS=29147	SAT TT=0.898	SAT TT=0.864
csp/aim-100/ normalized-aim-100-6-0-sat-4_ext.xml	SAT TT=0.017	SAT TT=1.004 CHECKS=3682 NODES=177	SAT TT=1.05 CHECKS=7157 NODES=289	SAT TT=0.121	SAT TT=0.034 CHECKS=11086	SAT TT=0.026 CHECKS=4382	SAT TT=0.78 ASSIGNMENTS=1	SAT TT=0.719 ASSIGNMENTS=1	SAT TT=0.632 CHECKS=7841 NODES=182	SAT TT=6.771 CHECKS=20423200 NODES=300527	SAT TT=0.593 CHECKS=34954 NODES=70	SAT TT=0.03 ASSIGNMENTS=4 CHECKS=1706	SAT TT=0.031 ASSIGNMENTS=4 CHECKS=1706	SAT TT=1.352	SAT TT=1.318	SAT TT=0.072 CHECKS=1088	SAT TT=0.019 ASSIGNMENTS=4 CHECKS=1706	SAT TT=0.021 ASSIGNMENTS=57 CHECKS=12723	SAT TT=0.525	SAT TT=0.017 ASSIGNMENTS=19 CHECKS=2722	SAT TT=0.018 ASSIGNMENTS=4 CHECKS=1706	SAT TT=1.131	SAT TT=0.054 ASSIGNMENTS=200 CHECKS=39342	SAT TT=0.911	SAT TT=0.927
csp/aim-200/ normalized-aim-200-1-6-sat-1_ext.xml	SAT TT=0.021	SAT TT=1.023 CHECKS=11029 NODES=1166	SAT TT=1.009 CHECKS=11207 NODES=1361	? (TO) TT=1800.1	SAT TT=0.025 CHECKS=5722	SAT TT=0.204 CHECKS=165656	SAT TT=0.641 ASSIGNMENTS=109	SAT TT=0.743 ASSIGNMENTS=19	SAT TT=0.603 CHECKS=8905 NODES=650	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=0.037 ASSIGNMENTS=1258 CHECKS=41486	SAT TT=0.039 ASSIGNMENTS=1258 CHECKS=41486	SAT TT=1.269	SAT TT=1.478	SAT TT=0.071 CHECKS=11265	SAT TT=0.021 ASSIGNMENTS=609 CHECKS=20957	SAT TT=0.05 ASSIGNMENTS=9439 CHECKS=133351	SAT TT=0.498	SAT TT=0.036 ASSIGNMENTS=1849 CHECKS=77436	SAT TT=0.024 ASSIGNMENTS=1258 CHECKS=41486	SAT TT=1.097	SAT TT=0.097 ASSIGNMENTS=1397 CHECKS=86627	SAT TT=0.945	SAT TT=1.021
csp/aim-200/ normalized-aim-200-1-6-sat-2_ext.xml	SAT TT=0.026	SAT TT=1.038 CHECKS=21578 NODES=2333	SAT TT=1.121 CHECKS=27461 NODES=2783	? (TO) TT=1800.1	SAT TT=0.026 CHECKS=7575	SAT TT=0.128 CHECKS=90276	SAT TT=0.853 ASSIGNMENTS=1705	SAT TT=1.215 ASSIGNMENTS=2429	SAT TT=0.661 CHECKS=19083 NODES=1445	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.044 ASSIGNMENTS=1785 CHECKS=71585	SAT TT=0.047 ASSIGNMENTS=1785 CHECKS=71585	SAT TT=1.26	SAT TT=1.469	SAT TT=0.112 CHECKS=63908	SAT TT=0.027 ASSIGNMENTS=1700 CHECKS=57651	SAT TT=0.047 ASSIGNMENTS=8708 CHECKS=122936	SAT TT=0.512	SAT TT=0.04 ASSIGNMENTS=2623 CHECKS=85927	SAT TT=0.03 ASSIGNMENTS=1785 CHECKS=71585	SAT TT=1.222	SAT TT=0.102 ASSIGNMENTS=530 CHECKS=35411	SAT TT=0.819	SAT TT=0.82
csp/aim-200/ normalized-aim-200-1-6-sat-3_ext.xml	SAT TT=0.023	SAT TT=1.179 CHECKS=32189 NODES=2509	SAT TT=1.069 CHECKS=15908 NODES=1648	? (TO) TT=1800.03	SAT TT=0.025 CHECKS=8897	SAT TT=0.146 CHECKS=106726	SAT TT=0.849 ASSIGNMENTS=1238	SAT TT=1.042 ASSIGNMENTS=1571	SAT TT=0.623 CHECKS=15885 NODES=959	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=0.045 ASSIGNMENTS=1565 CHECKS=70607	SAT TT=0.044 ASSIGNMENTS=1565 CHECKS=70607	SAT TT=1.481	SAT TT=1.238	SAT TT=0.116 CHECKS=76676	SAT TT=0.031 ASSIGNMENTS=1334 CHECKS=71623	SAT TT=0.042 ASSIGNMENTS=8616 CHECKS=102589	SAT TT=0.503	SAT TT=0.023 ASSIGNMENTS=986 CHECKS=25428	SAT TT=0.033 ASSIGNMENTS=1565 CHECKS=70607	SAT TT=1.179	SAT TT=0.132 ASSIGNMENTS=527 CHECKS=25946	SAT TT=0.954	SAT TT=1.016
csp/aim-200/ normalized-aim-200-1-6-sat-4_ext.xml	SAT TT=0.018	SAT TT=0.964 CHECKS=7397 NODES=1227	SAT TT=0.992 CHECKS=8749 NODES=1302	? (TO) TT=1800.08	SAT TT=0.832 CHECKS=539750	SAT TT=0.222 CHECKS=158736	SAT TT=0.809 ASSIGNMENTS=1357	SAT TT=1.338 ASSIGNMENTS=3798	SAT TT=0.632 CHECKS=7270 NODES=805	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=0.357 ASSIGNMENTS=41221 CHECKS=1176040	SAT TT=0.358 ASSIGNMENTS=41221 CHECKS=1176040	SAT TT=1.212	SAT TT=1.349	SAT TT=0.137 CHECKS=59179	SAT TT=0.05 ASSIGNMENTS=3998 CHECKS=144523	SAT TT=0.053 ASSIGNMENTS=9562 CHECKS=142737	SAT TT=0.512	SAT TT=0.018 ASSIGNMENTS=754 CHECKS=15506	SAT TT=0.303 ASSIGNMENTS=41221 CHECKS=1176040	SAT TT=1.168	SAT TT=0.174 ASSIGNMENTS=615 CHECKS=26419	SAT TT=0.896	SAT TT=1.013
csp/aim-200/ normalized-aim-200-1-6-unsat-1_ext.xml	UNSAT TT=0.1	UNSAT TT=1.264 CHECKS=67766 NODES=6260	UNSAT TT=1.451 CHECKS=110235 NODES=9963	? (TO) TT=1800.04	UNSAT TT=0.256 CHECKS=120605	UNSAT TT=0.205 CHECKS=104252	UNSAT TT=4.365 ASSIGNMENTS=39464	UNSAT TT=0.72 ASSIGNMENTS=388	UNSAT TT=1.024 CHECKS=37586 NODES=2541	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=0.312 ASSIGNMENTS=27682 CHECKS=850312	UNSAT TT=0.31 ASSIGNMENTS=27682 CHECKS=850312	UNSAT TT=0.861	UNSAT TT=0.726	UNSAT TT=0.15 CHECKS=62782	UNSAT TT=0.1 ASSIGNMENTS=11794 CHECKS=290551	UNSAT TT=0.075 ASSIGNMENTS=14419 CHECKS=218094	UNSAT TT=0.664	UNSAT TT=0.102 ASSIGNMENTS=8725 CHECKS=213659	UNSAT TT=0.263 ASSIGNMENTS=27682 CHECKS=850312	UNSAT TT=1.03	UNSAT TT=0.916 ASSIGNMENTS=14738 CHECKS=706070	UNSAT TT=0.918	UNSAT TT=0.819
csp/aim-200/ normalized-aim-200-1-6-unsat-2_ext.xml	UNSAT TT=0.093	UNSAT TT=3.051 CHECKS=677790 NODES=48377	UNSAT TT=2.433 CHECKS=421570 NODES=31169	? (TO) TT=1800.03	UNSAT TT=3.092 CHECKS=1519030	UNSAT TT=1.667 CHECKS=770360	UNSAT TT=37.926 ASSIGNMENTS=461040	UNSAT TT=0.801 ASSIGNMENTS=874	UNSAT TT=1.841 CHECKS=144456 NODES=8846	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.978 ASSIGNMENTS=108309 CHECKS=2758150	UNSAT TT=1.067 ASSIGNMENTS=108309 CHECKS=2758150	UNSAT TT=0.828	UNSAT TT=0.813	UNSAT TT=0.143 CHECKS=67087	UNSAT TT=1.139 ASSIGNMENTS=149653 CHECKS=3776660	UNSAT TT=0.073 ASSIGNMENTS=14253 CHECKS=194678	UNSAT TT=1.602	UNSAT TT=0.093 ASSIGNMENTS=7273 CHECKS=175856	UNSAT TT=0.908 ASSIGNMENTS=108309 CHECKS=2758150	UNSAT TT=1.058	UNSAT TT=1.673 ASSIGNMENTS=35817 CHECKS=1422050	UNSAT TT=0.83	UNSAT TT=0.863
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-200/ normalized-aim-200-1-6-unsat-3_ext.xml	UNSAT TT=0.276	UNSAT TT=1.389 CHECKS=104910 NODES=9817	UNSAT TT=1.507 CHECKS=130883 NODES=11569	? (TO) TT=1800.09	UNSAT TT=0.422 CHECKS=170407	UNSAT TT=78.245 CHECKS=35596400	UNSAT TT=7.519 ASSIGNMENTS=84406	UNSAT TT=2.227 ASSIGNMENTS=10764	UNSAT TT=2.588 CHECKS=216789 NODES=16453	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=0.703 ASSIGNMENTS=73965 CHECKS=1857130	UNSAT TT=0.698 ASSIGNMENTS=73965 CHECKS=1857130	UNSAT TT=0.865	UNSAT TT=0.87	UNSAT TT=0.276 CHECKS=139662	UNSAT TT=0.507 ASSIGNMENTS=66263 CHECKS=1642260	UNSAT TT=0.109 ASSIGNMENTS=19351 CHECKS=326320	UNSAT TT=1.324	UNSAT TT=0.294 ASSIGNMENTS=27068 CHECKS=612829	UNSAT TT=0.593 ASSIGNMENTS=73965 CHECKS=1857130	UNSAT TT=1.103	UNSAT TT=3.412 ASSIGNMENTS=62281 CHECKS=2719140	UNSAT TT=0.912	UNSAT TT=0.896
csp/aim-200/ normalized-aim-200-1-6-unsat-4_ext.xml	UNSAT TT=0.05	UNSAT TT=1.056 CHECKS=15911 NODES=1987	UNSAT TT=1.538 CHECKS=11586 NODES=1400	? (TO) TT=1800.05	UNSAT TT=0.178 CHECKS=77417	UNSAT TT=0.318 CHECKS=180038	UNSAT TT=1.119 ASSIGNMENTS=5150	UNSAT TT=1.109 ASSIGNMENTS=2687	UNSAT TT=0.681 CHECKS=16675 NODES=1360	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=0.086 ASSIGNMENTS=7381 CHECKS=203222	UNSAT TT=0.091 ASSIGNMENTS=7381 CHECKS=203222	UNSAT TT=0.674	UNSAT TT=0.683	UNSAT TT=0.087 CHECKS=31357	UNSAT TT=0.083 ASSIGNMENTS=10013 CHECKS=256527	UNSAT TT=0.05 ASSIGNMENTS=12665 CHECKS=137656	UNSAT TT=0.56	UNSAT TT=0.05 ASSIGNMENTS=4130 CHECKS=90804	UNSAT TT=0.071 ASSIGNMENTS=7381 CHECKS=203222	UNSAT TT=0.959	UNSAT TT=0.24 ASSIGNMENTS=4722 CHECKS=221193	UNSAT TT=0.825	UNSAT TT=0.821
csp/aim-200/ normalized-aim-200-2-0-sat-1_ext.xml	SAT TT=0.046	SAT TT=2.502 CHECKS=509422 NODES=31016	SAT TT=1.179 CHECKS=33816 NODES=3318	? (TO) TT=1800.09	SAT TT=0.046 CHECKS=28612	SAT TT=18.735 CHECKS=16294500	SAT TT=7.138 ASSIGNMENTS=47554	SAT TT=29.794 ASSIGNMENTS=202059	SAT TT=0.812 CHECKS=37256 NODES=2001	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=0.709 ASSIGNMENTS=58735 CHECKS=2402750	SAT TT=0.653 ASSIGNMENTS=58735 CHECKS=2402750	SAT TT=1.503	SAT TT=1.287	SAT TT=0.37 CHECKS=292603	SAT TT=0.603 ASSIGNMENTS=54680 CHECKS=2571650	SAT TT=0.102 ASSIGNMENTS=12374 CHECKS=350327	SAT TT=0.531	SAT TT=0.091 ASSIGNMENTS=6849 CHECKS=246887	SAT TT=0.591 ASSIGNMENTS=58735 CHECKS=2402750	SAT TT=1.268	SAT TT=0.475 ASSIGNMENTS=8167 CHECKS=384294	SAT TT=0.935	SAT TT=0.936
csp/aim-200/ normalized-aim-200-2-0-sat-2_ext.xml	SAT TT=0.032	SAT TT=1.385 CHECKS=90938 NODES=7751	SAT TT=1.349 CHECKS=33199 NODES=3333	? (TO) TT=1800.07	SAT TT=0.032 CHECKS=17918	SAT TT=6.167 CHECKS=5789110	SAT TT=0.892 ASSIGNMENTS=1436	SAT TT=3.513 ASSIGNMENTS=19117	SAT TT=0.781 CHECKS=8773 NODES=742	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=0.307 ASSIGNMENTS=23234 CHECKS=1092160	SAT TT=0.31 ASSIGNMENTS=23234 CHECKS=1092160	SAT TT=1.207	SAT TT=1.204	SAT TT=0.251 CHECKS=190932	SAT TT=0.521 ASSIGNMENTS=41838 CHECKS=2010540	SAT TT=0.097 ASSIGNMENTS=9997 CHECKS=325862	SAT TT=0.533	SAT TT=0.069 ASSIGNMENTS=4727 CHECKS=180051	SAT TT=0.271 ASSIGNMENTS=23234 CHECKS=1092160	SAT TT=1.112	SAT TT=0.968 ASSIGNMENTS=14745 CHECKS=862607	SAT TT=0.894	SAT TT=0.895
csp/aim-200/ normalized-aim-200-2-0-sat-3_ext.xml	SAT TT=0.032	SAT TT=1.125 CHECKS=14497 NODES=1701	SAT TT=1.042 CHECKS=7096 NODES=925	? (TO) TT=1800.05	SAT TT=0.255 CHECKS=168239	SAT TT=0.316 CHECKS=226718	SAT TT=1.743 ASSIGNMENTS=6899	SAT TT=1.063 ASSIGNMENTS=1944	SAT TT=0.606 CHECKS=9252 NODES=730	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.091 ASSIGNMENTS=5275 CHECKS=225910	SAT TT=0.089 ASSIGNMENTS=5275 CHECKS=225910	SAT TT=1.203	SAT TT=1.613	SAT TT=0.171 CHECKS=142569	SAT TT=0.085 ASSIGNMENTS=6760 CHECKS=300611	SAT TT=0.061 ASSIGNMENTS=7833 CHECKS=194761	SAT TT=0.665	SAT TT=0.032 ASSIGNMENTS=1322 CHECKS=42443	SAT TT=0.071 ASSIGNMENTS=5275 CHECKS=225910	SAT TT=1.115	SAT TT=0.151 ASSIGNMENTS=2780 CHECKS=157815	SAT TT=0.942	SAT TT=0.875
csp/aim-200/ normalized-aim-200-2-0-sat-4_ext.xml	SAT TT=0.175	SAT TT=2.376 CHECKS=376081 NODES=28342	SAT TT=1.705 CHECKS=196506 NODES=16455	? (TO) TT=1800.04	SAT TT=4.083 CHECKS=2413160	SAT TT=2.077 CHECKS=1719160	SAT TT=46.733 ASSIGNMENTS=353502	? (TO) TT=1800.06	SAT TT=1.91 CHECKS=196169 NODES=8579	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=0.206 ASSIGNMENTS=14504 CHECKS=662745	SAT TT=0.206 ASSIGNMENTS=14504 CHECKS=662745	SAT TT=1.448	SAT TT=1.523	SAT TT=0.711 CHECKS=712031	SAT TT=0.285 ASSIGNMENTS=26656 CHECKS=1104880	SAT TT=0.094 ASSIGNMENTS=11292 CHECKS=324048	SAT TT=0.499	SAT TT=0.262 ASSIGNMENTS=15794 CHECKS=829886	SAT TT=0.175 ASSIGNMENTS=14504 CHECKS=662745	SAT TT=1.414	SAT TT=0.793 ASSIGNMENTS=9140 CHECKS=390879	SAT TT=0.873	SAT TT=0.969
csp/aim-200/ normalized-aim-200-2-0-unsat-1_ext.xml	UNSAT TT=0.124	UNSAT TT=1.496 CHECKS=100732 NODES=8897	UNSAT TT=1.127 CHECKS=30931 NODES=3274	? (TO) TT=1800.09	UNSAT TT=0.492 CHECKS=220768	UNSAT TT=0.183 CHECKS=107427	UNSAT TT=3.701 ASSIGNMENTS=30063	UNSAT TT=11.176 ASSIGNMENTS=66909	UNSAT TT=0.664 CHECKS=8545 NODES=667	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.194 ASSIGNMENTS=18507 CHECKS=542051	UNSAT TT=0.192 ASSIGNMENTS=18507 CHECKS=542051	UNSAT TT=0.76	UNSAT TT=0.76	UNSAT TT=0.146 CHECKS=69081	UNSAT TT=0.175 ASSIGNMENTS=19989 CHECKS=615076	UNSAT TT=0.084 ASSIGNMENTS=11603 CHECKS=254715	UNSAT TT=0.95	UNSAT TT=0.124 ASSIGNMENTS=10621 CHECKS=276575	UNSAT TT=0.155 ASSIGNMENTS=18507 CHECKS=542051	UNSAT TT=1.129	UNSAT TT=0.136 ASSIGNMENTS=1919 CHECKS=101622	UNSAT TT=0.94	UNSAT TT=1.054
csp/aim-200/ normalized-aim-200-2-0-unsat-2_ext.xml	UNSAT TT=0.046	UNSAT TT=1.146 CHECKS=26963 NODES=2887	UNSAT TT=1.199 CHECKS=34097 NODES=3269	? (TO) TT=1800.11	UNSAT TT=0.224 CHECKS=87525	UNSAT TT=0.357 CHECKS=181892	UNSAT TT=1.433 ASSIGNMENTS=4914	UNSAT TT=4.173 ASSIGNMENTS=19399	UNSAT TT=0.93 CHECKS=31031 NODES=2304	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.062 ASSIGNMENTS=3620 CHECKS=111557	UNSAT TT=0.061 ASSIGNMENTS=3620 CHECKS=111557	UNSAT TT=0.979	UNSAT TT=0.776	UNSAT TT=0.13 CHECKS=49335	UNSAT TT=0.073 ASSIGNMENTS=6305 CHECKS=214256	UNSAT TT=0.075 ASSIGNMENTS=10094 CHECKS=221725	UNSAT TT=0.584	UNSAT TT=0.046 ASSIGNMENTS=2686 CHECKS=74315	UNSAT TT=0.046 ASSIGNMENTS=3620 CHECKS=111557	UNSAT TT=1.125	UNSAT TT=0.157 ASSIGNMENTS=2646 CHECKS=145444	UNSAT TT=0.952	UNSAT TT=0.957
csp/aim-200/ normalized-aim-200-2-0-unsat-3_ext.xml	UNSAT TT=0.023	UNSAT TT=0.964 CHECKS=3008 NODES=498	UNSAT TT=1.008 CHECKS=2641 NODES=396	? (TO) TT=1800.06	UNSAT TT=0.176 CHECKS=79911	UNSAT TT=0.189 CHECKS=110388	UNSAT TT=1.082 ASSIGNMENTS=2556	UNSAT TT=2.867 ASSIGNMENTS=11250	UNSAT TT=0.742 CHECKS=16718 NODES=1263	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.057 ASSIGNMENTS=3802 CHECKS=120210	UNSAT TT=0.061 ASSIGNMENTS=3802 CHECKS=120210	UNSAT TT=0.747	UNSAT TT=0.751	UNSAT TT=0.095 CHECKS=30919	UNSAT TT=0.03 ASSIGNMENTS=1966 CHECKS=68850	UNSAT TT=0.068 ASSIGNMENTS=8470 CHECKS=193920	UNSAT TT=0.576	UNSAT TT=0.023 ASSIGNMENTS=862 CHECKS=17811	UNSAT TT=0.046 ASSIGNMENTS=3802 CHECKS=120210	UNSAT TT=1.065	UNSAT TT=0.059 ASSIGNMENTS=566 CHECKS=29479	UNSAT TT=0.951	UNSAT TT=0.898
csp/aim-200/ normalized-aim-200-2-0-unsat-4_ext.xml	UNSAT TT=0.027	UNSAT TT=1.121 CHECKS=17162 NODES=1811	UNSAT TT=1.147 CHECKS=17871 NODES=1904	? (TO) TT=1800.02	UNSAT TT=0.173 CHECKS=84008	UNSAT TT=0.153 CHECKS=81889	UNSAT TT=1.032 ASSIGNMENTS=3557	UNSAT TT=3.432 ASSIGNMENTS=17814	UNSAT TT=0.603 CHECKS=3927 NODES=321	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=0.055 ASSIGNMENTS=3197 CHECKS=87383	UNSAT TT=0.05 ASSIGNMENTS=3197 CHECKS=87383	UNSAT TT=0.771	UNSAT TT=0.764	UNSAT TT=0.1 CHECKS=35971	UNSAT TT=0.041 ASSIGNMENTS=3174 CHECKS=90460	UNSAT TT=0.061 ASSIGNMENTS=8835 CHECKS=190029	UNSAT TT=0.711	UNSAT TT=0.027 ASSIGNMENTS=1056 CHECKS=25418	UNSAT TT=0.039 ASSIGNMENTS=3197 CHECKS=87383	UNSAT TT=1.055	UNSAT TT=0.072 ASSIGNMENTS=438 CHECKS=23736	UNSAT TT=0.921	UNSAT TT=0.897
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-200/ normalized-aim-200-3-4-sat-1_ext.xml	SAT TT=0.116	SAT TT=1.438 CHECKS=93593 NODES=5310	SAT TT=1.421 CHECKS=73136 NODES=4319	SAT TT=413.578	SAT TT=0.518 CHECKS=369488	SAT TT=0.492 CHECKS=467978	SAT TT=1.556 ASSIGNMENTS=1852	SAT TT=10.808 ASSIGNMENTS=31820	SAT TT=0.715 CHECKS=10639 NODES=442	SAT TT=352.153 CHECKS=1088850000 NODES=28182200	SAT TT=1.366 CHECKS=4638590 NODES=16290	SAT TT=0.14 ASSIGNMENTS=3560 CHECKS=486082	SAT TT=0.139 ASSIGNMENTS=3560 CHECKS=486082	SAT TT=1.529	SAT TT=1.409	SAT TT=0.462 CHECKS=418968	SAT TT=0.233 ASSIGNMENTS=7498 CHECKS=1105960	SAT TT=0.176 ASSIGNMENTS=7192 CHECKS=692968	SAT TT=0.769	SAT TT=0.183 ASSIGNMENTS=4164 CHECKS=691528	SAT TT=0.116 ASSIGNMENTS=3560 CHECKS=486082	SAT TT=1.397	SAT TT=1.176 ASSIGNMENTS=8014 CHECKS=1132020	SAT TT=1.049	SAT TT=1.157
csp/aim-200/ normalized-aim-200-3-4-sat-2_ext.xml	SAT TT=0.034	SAT TT=1.338 CHECKS=40974 NODES=2306	SAT TT=1.666 CHECKS=112624 NODES=5354	SAT TT=107.806	SAT TT=1.966 CHECKS=1477930	SAT TT=13.628 CHECKS=12124700	SAT TT=1.235 ASSIGNMENTS=1220	SAT TT=6.407 ASSIGNMENTS=16146	SAT TT=2.126 CHECKS=253720 NODES=4472	SAT TT=166.171 CHECKS=502942000 NODES=13125200	SAT TT=0.649 CHECKS=195193 NODES=1584	SAT TT=0.044 ASSIGNMENTS=437 CHECKS=56321	SAT TT=0.047 ASSIGNMENTS=437 CHECKS=56321	SAT TT=1.463	SAT TT=1.35	SAT TT=0.165 CHECKS=117131	SAT TT=0.051 ASSIGNMENTS=943 CHECKS=135046	SAT TT=0.197 ASSIGNMENTS=7621 CHECKS=864733	SAT TT=0.71	SAT TT=0.034 ASSIGNMENTS=514 CHECKS=51939	SAT TT=0.034 ASSIGNMENTS=437 CHECKS=56321	SAT TT=1.515	SAT TT=0.262 ASSIGNMENTS=557 CHECKS=73910	SAT TT=1.182	SAT TT=1.196
csp/aim-200/ normalized-aim-200-3-4-sat-3_ext.xml	SAT TT=0.045	SAT TT=3.706 CHECKS=798771 NODES=33688	SAT TT=1.442 CHECKS=91923 NODES=5269	SAT TT=60.547	SAT TT=0.523 CHECKS=387775	SAT TT=19.96 CHECKS=20156900	SAT TT=1.18 ASSIGNMENTS=810	SAT TT=1.378 ASSIGNMENTS=1644	SAT TT=0.751 CHECKS=24165 NODES=722	SAT TT=216.284 CHECKS=622232000 NODES=16217800	SAT TT=0.666 CHECKS=395939 NODES=2427	SAT TT=0.081 ASSIGNMENTS=1137 CHECKS=202171	SAT TT=0.073 ASSIGNMENTS=1137 CHECKS=202171	SAT TT=1.317	SAT TT=1.322	SAT TT=0.217 CHECKS=183005	SAT TT=0.055 ASSIGNMENTS=883 CHECKS=168949	SAT TT=0.279 ASSIGNMENTS=9229 CHECKS=1203210	SAT TT=0.619	SAT TT=0.045 ASSIGNMENTS=1158 CHECKS=115570	SAT TT=0.062 ASSIGNMENTS=1137 CHECKS=202171	SAT TT=1.416	SAT TT=0.965 ASSIGNMENTS=3868 CHECKS=631658	SAT TT=0.922	SAT TT=1.094
csp/aim-200/ normalized-aim-200-3-4-sat-4_ext.xml	SAT TT=0.055	SAT TT=1.184 CHECKS=10487 NODES=924	SAT TT=1.327 CHECKS=24349 NODES=1947	SAT TT=311.112	SAT TT=0.335 CHECKS=230256	SAT TT=0.551 CHECKS=559767	SAT TT=15.809 ASSIGNMENTS=42294	SAT TT=6.634 ASSIGNMENTS=18009	SAT TT=0.758 CHECKS=25332 NODES=607	SAT TT=281.764 CHECKS=874114000 NODES=22651800	? (TO) TT=1800.03	SAT TT=0.084 ASSIGNMENTS=1574 CHECKS=247251	SAT TT=0.087 ASSIGNMENTS=1574 CHECKS=247251	SAT TT=1.63	SAT TT=1.492	SAT TT=0.416 CHECKS=419268	SAT TT=0.223 ASSIGNMENTS=6134 CHECKS=985469	SAT TT=0.135 ASSIGNMENTS=5594 CHECKS=561550	SAT TT=0.665	SAT TT=0.055 ASSIGNMENTS=1203 CHECKS=140078	SAT TT=0.072 ASSIGNMENTS=1574 CHECKS=247251	SAT TT=1.281	SAT TT=0.212 ASSIGNMENTS=742 CHECKS=106897	SAT TT=1.065	SAT TT=1.054
csp/aim-200/ normalized-aim-200-6-0-sat-1_ext.xml	SAT TT=0.036	SAT TT=1.345 CHECKS=9742 NODES=442	SAT TT=1.097 CHECKS=4705 NODES=0	SAT TT=0.523	SAT TT=0.111 CHECKS=45356	SAT TT=0.196 CHECKS=159928	SAT TT=0.935 ASSIGNMENTS=8	SAT TT=0.788 ASSIGNMENTS=2	SAT TT=0.803 CHECKS=3850 NODES=223	SAT TT=5.497 CHECKS=10526400 NODES=152155	SAT TT=0.823 CHECKS=149257 NODES=667	SAT TT=0.057 ASSIGNMENTS=158 CHECKS=62878	SAT TT=0.058 ASSIGNMENTS=158 CHECKS=62878	SAT TT=1.688	SAT TT=1.588	SAT TT=0.22 CHECKS=147498	SAT TT=0.04 ASSIGNMENTS=124 CHECKS=39264	SAT TT=0.15 ASSIGNMENTS=2367 CHECKS=624995	SAT TT=0.672	SAT TT=0.036 ASSIGNMENTS=26 CHECKS=5553	SAT TT=0.044 ASSIGNMENTS=158 CHECKS=62878	SAT TT=1.758	SAT TT=0.105 ASSIGNMENTS=385 CHECKS=60565	SAT TT=0.995	SAT TT=1.02
csp/aim-200/ normalized-aim-200-6-0-sat-2_ext.xml	SAT TT=0.052	SAT TT=1.216 CHECKS=11440 NODES=519	SAT TT=1.158 CHECKS=8092 NODES=383	SAT TT=31.235	SAT TT=0.533 CHECKS=356619	SAT TT=0.197 CHECKS=155651	SAT TT=1.283 ASSIGNMENTS=411	SAT TT=0.783 ASSIGNMENTS=39	SAT TT=0.926 CHECKS=29892 NODES=447	SAT TT=4.999 CHECKS=10526500 NODES=150831	SAT TT=0.769 CHECKS=119405 NODES=156	SAT TT=0.092 ASSIGNMENTS=721 CHECKS=279403	SAT TT=0.096 ASSIGNMENTS=721 CHECKS=279403	SAT TT=1.499	SAT TT=1.737	SAT TT=0.105 CHECKS=26070	SAT TT=0.073 ASSIGNMENTS=614 CHECKS=250029	SAT TT=0.208 ASSIGNMENTS=4241 CHECKS=1039110	SAT TT=0.729	SAT TT=0.052 ASSIGNMENTS=566 CHECKS=121971	SAT TT=0.085 ASSIGNMENTS=721 CHECKS=279403	SAT TT=1.866	SAT TT=0.189 ASSIGNMENTS=748 CHECKS=223057	SAT TT=0.973	SAT TT=1.068
csp/aim-200/ normalized-aim-200-6-0-sat-3_ext.xml	SAT TT=0.034	SAT TT=1.231 CHECKS=15252 NODES=617	SAT TT=1.189 CHECKS=6741 NODES=321	SAT TT=59.204	SAT TT=0.08 CHECKS=35355	SAT TT=0.548 CHECKS=483646	SAT TT=0.806 ASSIGNMENTS=14	SAT TT=0.853 ASSIGNMENTS=4	SAT TT=0.785 CHECKS=9732 NODES=253	SAT TT=9.23 CHECKS=20811000 NODES=300337	SAT TT=0.827 CHECKS=130517 NODES=310	SAT TT=0.049 ASSIGNMENTS=74 CHECKS=24294	SAT TT=0.05 ASSIGNMENTS=74 CHECKS=24294	SAT TT=1.755	SAT TT=1.581	SAT TT=0.125 CHECKS=48290	SAT TT=0.045 ASSIGNMENTS=235 CHECKS=83036	SAT TT=0.047 ASSIGNMENTS=256 CHECKS=70039	SAT TT=0.67	SAT TT=0.04 ASSIGNMENTS=272 CHECKS=27161	SAT TT=0.034 ASSIGNMENTS=74 CHECKS=24294	SAT TT=1.914	SAT TT=0.129 ASSIGNMENTS=266 CHECKS=31352	SAT TT=1.07	SAT TT=1.234
csp/aim-200/ normalized-aim-200-6-0-sat-4_ext.xml	SAT TT=0.04	SAT TT=1.452 CHECKS=63138 NODES=2466	SAT TT=1.201 CHECKS=5346 NODES=0	SAT TT=11.757	SAT TT=0.209 CHECKS=106012	SAT TT=0.363 CHECKS=295753	SAT TT=0.996 ASSIGNMENTS=306	SAT TT=0.744 ASSIGNMENTS=28	SAT TT=0.976 CHECKS=28293 NODES=456	SAT TT=23.469 CHECKS=51751700 NODES=750589	SAT TT=0.818 CHECKS=120736 NODES=229	SAT TT=0.068 ASSIGNMENTS=420 CHECKS=151332	SAT TT=0.067 ASSIGNMENTS=420 CHECKS=151332	SAT TT=1.589	SAT TT=1.49	SAT TT=0.427 CHECKS=357619	SAT TT=0.129 ASSIGNMENTS=1323 CHECKS=533288	SAT TT=0.237 ASSIGNMENTS=4339 CHECKS=1104890	SAT TT=0.662	SAT TT=0.04 ASSIGNMENTS=300 CHECKS=37101	SAT TT=0.061 ASSIGNMENTS=420 CHECKS=151332	SAT TT=1.91	SAT TT=0.257 ASSIGNMENTS=341 CHECKS=76300	SAT TT=1.226	SAT TT=1.019
csp/aim-50/ normalized-aim-50-1-6-sat-1_ext.xml	SAT TT=0.007	SAT TT=0.745 CHECKS=2808 NODES=322	SAT TT=0.771 CHECKS=1463 NODES=207	SAT TT=0.086	SAT TT=0.009 CHECKS=1187	SAT TT=0.021 CHECKS=17728	SAT TT=0.434 ASSIGNMENTS=7	SAT TT=0.405 ASSIGNMENTS=3	SAT TT=0.392 CHECKS=1226 NODES=130	SAT TT=127.314 CHECKS=468919000 NODES=81600600	SAT TT=0.373 CHECKS=127074 NODES=1243	SAT TT=0.023 ASSIGNMENTS=309 CHECKS=9070	SAT TT=0.023 ASSIGNMENTS=309 CHECKS=9070	SAT TT=0.782	SAT TT=0.861	SAT TT=0.034 CHECKS=2062	SAT TT=0.009 ASSIGNMENTS=312 CHECKS=7820	SAT TT=0.021 ASSIGNMENTS=4316 CHECKS=62439	SAT TT=0.322	SAT TT=0.007 ASSIGNMENTS=77 CHECKS=964	SAT TT=0.011 ASSIGNMENTS=309 CHECKS=9070	SAT TT=0.737	SAT TT=0.015 ASSIGNMENTS=124 CHECKS=2506	SAT TT=0.59	SAT TT=0.607
csp/aim-50/ normalized-aim-50-1-6-sat-2_ext.xml	SAT TT=0.006	SAT TT=0.766 CHECKS=792 NODES=132	SAT TT=0.68 CHECKS=325 NODES=0	SAT TT=0.136	SAT TT=0.012 CHECKS=958	SAT TT=0.011 CHECKS=2502	SAT TT=0.427 ASSIGNMENTS=1	SAT TT=0.436 ASSIGNMENTS=1	SAT TT=0.366 CHECKS=1717 NODES=118	SAT TT=2.881 CHECKS=8895340 NODES=1800060	SAT TT=0.347 CHECKS=25091 NODES=284	SAT TT=0.02 ASSIGNMENTS=51 CHECKS=1416	SAT TT=0.02 ASSIGNMENTS=51 CHECKS=1416	SAT TT=0.974	SAT TT=0.796	SAT TT=0.034 CHECKS=1167	SAT TT=0.008 ASSIGNMENTS=57 CHECKS=2605	SAT TT=0.01 ASSIGNMENTS=769 CHECKS=11858	SAT TT=0.318	SAT TT=0.006 ASSIGNMENTS=80 CHECKS=973	SAT TT=0.008 ASSIGNMENTS=51 CHECKS=1416	SAT TT=0.794	SAT TT=0.013 ASSIGNMENTS=103 CHECKS=1825	SAT TT=0.555	SAT TT=0.582
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-50/ normalized-aim-50-1-6-sat-3_ext.xml	SAT TT=0.007	SAT TT=0.755 CHECKS=801 NODES=130	SAT TT=0.736 CHECKS=259 NODES=0	SAT TT=0.063	SAT TT=0.013 CHECKS=2004	SAT TT=0.014 CHECKS=4294	SAT TT=0.398 ASSIGNMENTS=2	SAT TT=0.418 ASSIGNMENTS=4	SAT TT=0.344 CHECKS=211 NODES=51	SAT TT=3.811 CHECKS=13156100 NODES=972600	SAT TT=0.378 CHECKS=55885 NODES=579	SAT TT=0.02 ASSIGNMENTS=48 CHECKS=1390	SAT TT=0.021 ASSIGNMENTS=48 CHECKS=1390	SAT TT=0.868	SAT TT=0.978	SAT TT=0.054 CHECKS=914	SAT TT=0.007 ASSIGNMENTS=58 CHECKS=1462	SAT TT=0.011 ASSIGNMENTS=959 CHECKS=14978	SAT TT=0.343	SAT TT=0.009 ASSIGNMENTS=96 CHECKS=1636	SAT TT=0.008 ASSIGNMENTS=48 CHECKS=1390	SAT TT=0.78	SAT TT=0.016 ASSIGNMENTS=62 CHECKS=1662	SAT TT=0.595	SAT TT=0.564
csp/aim-50/ normalized-aim-50-1-6-sat-4_ext.xml	SAT TT=0.007	SAT TT=0.765 CHECKS=2457 NODES=286	SAT TT=0.722 CHECKS=282 NODES=0	SAT TT=0.057	SAT TT=0.009 CHECKS=415	SAT TT=0.012 CHECKS=2887	SAT TT=0.416 ASSIGNMENTS=1	SAT TT=0.412 ASSIGNMENTS=1	SAT TT=0.342 CHECKS=572 NODES=77	SAT TT=0.462 CHECKS=341987 NODES=48334	SAT TT=0.38 CHECKS=72731 NODES=813	SAT TT=0.021 ASSIGNMENTS=68 CHECKS=2555	SAT TT=0.02 ASSIGNMENTS=68 CHECKS=2555	SAT TT=0.775	SAT TT=1.055	SAT TT=0.039 CHECKS=3290	SAT TT=0.007 ASSIGNMENTS=71 CHECKS=2622	SAT TT=0.016 ASSIGNMENTS=1334 CHECKS=23081	SAT TT=0.323	SAT TT=0.008 ASSIGNMENTS=35 CHECKS=518	SAT TT=0.009 ASSIGNMENTS=68 CHECKS=2555	SAT TT=0.726	SAT TT=0.015 ASSIGNMENTS=52 CHECKS=1636	SAT TT=0.579	SAT TT=0.582
csp/aim-50/ normalized-aim-50-1-6-unsat-1_ext.xml	UNSAT TT=0.006	UNSAT TT=0.737 CHECKS=941 NODES=95	UNSAT TT=0.732 CHECKS=240 NODES=0	UNSAT TT=0.039	UNSAT TT=0.01 CHECKS=239	UNSAT TT=0.018 CHECKS=8453	UNSAT TT=0.38 ASSIGNMENTS=0	UNSAT TT=0.424 ASSIGNMENTS=0	UNSAT TT=0.393 CHECKS=952 NODES=47	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.019 ASSIGNMENTS=44 CHECKS=1225	UNSAT TT=0.019 ASSIGNMENTS=44 CHECKS=1225	UNSAT TT=0.608	UNSAT TT=0.475	UNSAT TT=0.04 CHECKS=1257	UNSAT TT=0.009 ASSIGNMENTS=37 CHECKS=1141	UNSAT TT=0.012 ASSIGNMENTS=829 CHECKS=12395	UNSAT TT=0.32	UNSAT TT=0.006 ASSIGNMENTS=22 CHECKS=311	UNSAT TT=0.007 ASSIGNMENTS=44 CHECKS=1225	UNSAT TT=0.767	UNSAT TT=0.012 ASSIGNMENTS=101 CHECKS=5836	UNSAT TT=0.582	UNSAT TT=0.568
csp/aim-50/ normalized-aim-50-1-6-unsat-2_ext.xml	UNSAT TT=0.009	UNSAT TT=0.807 CHECKS=6668 NODES=749	UNSAT TT=0.81 CHECKS=4868 NODES=561	UNSAT TT=0.218	UNSAT TT=0.024 CHECKS=13259	UNSAT TT=0.031 CHECKS=25479	UNSAT TT=0.51 ASSIGNMENTS=449	UNSAT TT=0.458 ASSIGNMENTS=144	UNSAT TT=0.387 CHECKS=2178 NODES=183	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.022 ASSIGNMENTS=425 CHECKS=10996	UNSAT TT=0.023 ASSIGNMENTS=425 CHECKS=10996	UNSAT TT=0.623	UNSAT TT=0.673	UNSAT TT=0.043 CHECKS=8096	UNSAT TT=0.01 ASSIGNMENTS=548 CHECKS=11986	UNSAT TT=0.025 ASSIGNMENTS=4874 CHECKS=58579	UNSAT TT=0.329	UNSAT TT=0.01 ASSIGNMENTS=329 CHECKS=7318	UNSAT TT=0.009 ASSIGNMENTS=425 CHECKS=10996	UNSAT TT=0.772	UNSAT TT=0.019 ASSIGNMENTS=272 CHECKS=9590	UNSAT TT=0.591	UNSAT TT=0.594
csp/aim-50/ normalized-aim-50-1-6-unsat-3_ext.xml	UNSAT TT=0.007	UNSAT TT=0.733 CHECKS=764 NODES=63	UNSAT TT=0.741 CHECKS=704 NODES=34	UNSAT TT=0.873	UNSAT TT=0.011 CHECKS=202	UNSAT TT=0.041 CHECKS=31111	UNSAT TT=0.4 ASSIGNMENTS=0	UNSAT TT=0.439 ASSIGNMENTS=0	UNSAT TT=0.374 CHECKS=737 NODES=28	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.021 ASSIGNMENTS=72 CHECKS=2689	UNSAT TT=0.021 ASSIGNMENTS=72 CHECKS=2689	UNSAT TT=0.464	UNSAT TT=0.499	UNSAT TT=0.065 CHECKS=2453	UNSAT TT=0.008 ASSIGNMENTS=82 CHECKS=2919	UNSAT TT=0.011 ASSIGNMENTS=355 CHECKS=4198	UNSAT TT=0.32	UNSAT TT=0.008 ASSIGNMENTS=104 CHECKS=1216	UNSAT TT=0.007 ASSIGNMENTS=72 CHECKS=2689	UNSAT TT=0.723	UNSAT TT=0.014 ASSIGNMENTS=23 CHECKS=1135	UNSAT TT=0.588	UNSAT TT=0.589
csp/aim-50/ normalized-aim-50-1-6-unsat-4_ext.xml	UNSAT TT=0.007	UNSAT TT=0.737 CHECKS=755 NODES=100	UNSAT TT=0.816 CHECKS=564 NODES=64	UNSAT TT=0.047	UNSAT TT=0.01 CHECKS=718	UNSAT TT=0.012 CHECKS=3711	UNSAT TT=0.427 ASSIGNMENTS=0	UNSAT TT=0.406 ASSIGNMENTS=0	UNSAT TT=0.376 CHECKS=580 NODES=41	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.018 ASSIGNMENTS=46 CHECKS=1148	UNSAT TT=0.021 ASSIGNMENTS=46 CHECKS=1148	UNSAT TT=0.498	UNSAT TT=0.523	UNSAT TT=0.057 CHECKS=803	UNSAT TT=0.008 ASSIGNMENTS=36 CHECKS=928	UNSAT TT=0.023 ASSIGNMENTS=4581 CHECKS=55443	UNSAT TT=0.341	UNSAT TT=0.007 ASSIGNMENTS=107 CHECKS=1264	UNSAT TT=0.009 ASSIGNMENTS=46 CHECKS=1148	UNSAT TT=0.752	UNSAT TT=0.012 ASSIGNMENTS=8 CHECKS=544	UNSAT TT=0.604	UNSAT TT=0.588
csp/aim-50/ normalized-aim-50-2-0-sat-1_ext.xml	SAT TT=0.008	SAT TT=0.872 CHECKS=975 NODES=138	SAT TT=0.789 CHECKS=1173 NODES=116	SAT TT=0.208	SAT TT=0.012 CHECKS=1194	SAT TT=0.014 CHECKS=5931	SAT TT=0.393 ASSIGNMENTS=1	SAT TT=0.455 ASSIGNMENTS=1	SAT TT=0.394 CHECKS=1432 NODES=141	SAT TT=0.523 CHECKS=675763 NODES=58813	SAT TT=0.386 CHECKS=25855 NODES=240	SAT TT=0.021 ASSIGNMENTS=146 CHECKS=3780	SAT TT=0.021 ASSIGNMENTS=146 CHECKS=3780	SAT TT=0.82	SAT TT=0.855	SAT TT=0.041 CHECKS=3253	SAT TT=0.009 ASSIGNMENTS=112 CHECKS=3026	SAT TT=0.023 ASSIGNMENTS=2792 CHECKS=62123	SAT TT=0.332	SAT TT=0.008 ASSIGNMENTS=134 CHECKS=2470	SAT TT=0.01 ASSIGNMENTS=146 CHECKS=3780	SAT TT=0.759	SAT TT=0.017 ASSIGNMENTS=111 CHECKS=4357	SAT TT=0.609	SAT TT=0.604
csp/aim-50/ normalized-aim-50-2-0-sat-2_ext.xml	SAT TT=0.007	SAT TT=0.852 CHECKS=3854 NODES=447	SAT TT=0.774 CHECKS=2871 NODES=322	SAT TT=0.081	SAT TT=0.012 CHECKS=2288	SAT TT=0.013 CHECKS=5550	SAT TT=0.464 ASSIGNMENTS=53	SAT TT=0.436 ASSIGNMENTS=34	SAT TT=0.352 CHECKS=544 NODES=78	SAT TT=0.481 CHECKS=367759 NODES=17603	SAT TT=0.4 CHECKS=56849 NODES=543	SAT TT=0.02 ASSIGNMENTS=94 CHECKS=3025	SAT TT=0.041 ASSIGNMENTS=94 CHECKS=3025	SAT TT=0.867	SAT TT=1.051	SAT TT=0.042 CHECKS=1464	SAT TT=0.009 ASSIGNMENTS=79 CHECKS=2594	SAT TT=0.017 ASSIGNMENTS=1683 CHECKS=39770	SAT TT=0.33	SAT TT=0.007 ASSIGNMENTS=116 CHECKS=2247	SAT TT=0.009 ASSIGNMENTS=94 CHECKS=3025	SAT TT=0.818	SAT TT=0.016 ASSIGNMENTS=184 CHECKS=5885	SAT TT=0.597	SAT TT=0.584
csp/aim-50/ normalized-aim-50-2-0-sat-3_ext.xml	SAT TT=0.009	SAT TT=0.872 CHECKS=881 NODES=142	SAT TT=0.763 CHECKS=1040 NODES=148	SAT TT=0.071	SAT TT=0.013 CHECKS=4067	SAT TT=0.015 CHECKS=6206	SAT TT=0.443 ASSIGNMENTS=100	SAT TT=0.473 ASSIGNMENTS=65	SAT TT=0.356 CHECKS=716 NODES=78	SAT TT=0.554 CHECKS=602614 NODES=31975	SAT TT=0.42 CHECKS=158615 NODES=1353	SAT TT=0.021 ASSIGNMENTS=75 CHECKS=2280	SAT TT=0.02 ASSIGNMENTS=75 CHECKS=2280	SAT TT=0.854	SAT TT=0.843	SAT TT=0.052 CHECKS=2288	SAT TT=0.009 ASSIGNMENTS=73 CHECKS=2204	SAT TT=0.012 ASSIGNMENTS=312 CHECKS=8475	SAT TT=0.323	SAT TT=0.009 ASSIGNMENTS=102 CHECKS=2205	SAT TT=0.01 ASSIGNMENTS=75 CHECKS=2280	SAT TT=0.748	SAT TT=0.02 ASSIGNMENTS=249 CHECKS=8598	SAT TT=0.599	SAT TT=0.61
csp/aim-50/ normalized-aim-50-2-0-sat-4_ext.xml	SAT TT=0.006	SAT TT=0.724 CHECKS=1267 NODES=155	SAT TT=0.773 CHECKS=1476 NODES=119	SAT TT=0.053	SAT TT=0.011 CHECKS=1430	SAT TT=0.013 CHECKS=5796	SAT TT=0.437 ASSIGNMENTS=5	SAT TT=0.425 ASSIGNMENTS=7	SAT TT=0.39 CHECKS=447 NODES=68	SAT TT=0.42 CHECKS=80401 NODES=3778	SAT TT=0.378 CHECKS=10336 NODES=126	SAT TT=0.019 ASSIGNMENTS=24 CHECKS=895	SAT TT=0.02 ASSIGNMENTS=24 CHECKS=895	SAT TT=1.001	SAT TT=0.797	SAT TT=0.045 CHECKS=1258	SAT TT=0.008 ASSIGNMENTS=44 CHECKS=1272	SAT TT=0.013 ASSIGNMENTS=381 CHECKS=10817	SAT TT=0.33	SAT TT=0.008 ASSIGNMENTS=27 CHECKS=629	SAT TT=0.006 ASSIGNMENTS=24 CHECKS=895	SAT TT=0.742	SAT TT=0.013 ASSIGNMENTS=89 CHECKS=2794	SAT TT=0.609	SAT TT=0.606
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-50/ normalized-aim-50-2-0-unsat-1_ext.xml	UNSAT TT=0.01	UNSAT TT=0.85 CHECKS=1930 NODES=195	UNSAT TT=0.804 CHECKS=1863 NODES=158	UNSAT TT=0.174	UNSAT TT=0.021 CHECKS=8972	UNSAT TT=0.024 CHECKS=20978	UNSAT TT=0.586 ASSIGNMENTS=418	UNSAT TT=0.545 ASSIGNMENTS=233	UNSAT TT=0.412 CHECKS=1335 NODES=84	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.022 ASSIGNMENTS=220 CHECKS=6449	UNSAT TT=0.02 ASSIGNMENTS=220 CHECKS=6449	UNSAT TT=0.512	UNSAT TT=0.509	UNSAT TT=0.051 CHECKS=2903	UNSAT TT=0.012 ASSIGNMENTS=230 CHECKS=6566	UNSAT TT=0.033 ASSIGNMENTS=4355 CHECKS=93427	UNSAT TT=0.324	UNSAT TT=0.01 ASSIGNMENTS=129 CHECKS=2483	UNSAT TT=0.01 ASSIGNMENTS=220 CHECKS=6449	UNSAT TT=0.74	UNSAT TT=0.018 ASSIGNMENTS=193 CHECKS=10384	UNSAT TT=0.634	UNSAT TT=0.62
csp/aim-50/ normalized-aim-50-2-0-unsat-2_ext.xml	UNSAT TT=0.008	UNSAT TT=0.743 CHECKS=1886 NODES=282	UNSAT TT=0.954 CHECKS=2284 NODES=265	UNSAT TT=0.192	UNSAT TT=0.016 CHECKS=4599	UNSAT TT=0.015 CHECKS=6469	UNSAT TT=0.427 ASSIGNMENTS=95	UNSAT TT=0.454 ASSIGNMENTS=16	UNSAT TT=0.361 CHECKS=1060 NODES=71	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.022 ASSIGNMENTS=111 CHECKS=2894	UNSAT TT=0.02 ASSIGNMENTS=111 CHECKS=2894	UNSAT TT=0.471	UNSAT TT=0.65	UNSAT TT=0.061 CHECKS=2530	UNSAT TT=0.01 ASSIGNMENTS=83 CHECKS=2249	UNSAT TT=0.032 ASSIGNMENTS=4064 CHECKS=96877	UNSAT TT=0.322	UNSAT TT=0.011 ASSIGNMENTS=122 CHECKS=2645	UNSAT TT=0.008 ASSIGNMENTS=111 CHECKS=2894	UNSAT TT=0.734	UNSAT TT=0.014 ASSIGNMENTS=120 CHECKS=4430	UNSAT TT=0.593	UNSAT TT=0.605
csp/aim-50/ normalized-aim-50-2-0-unsat-3_ext.xml	UNSAT TT=0.008	UNSAT TT=0.777 CHECKS=2217 NODES=251	UNSAT TT=0.82 CHECKS=2163 NODES=253	UNSAT TT=0.146	UNSAT TT=0.015 CHECKS=3622	UNSAT TT=0.02 CHECKS=13042	UNSAT TT=0.435 ASSIGNMENTS=82	UNSAT TT=0.468 ASSIGNMENTS=131	UNSAT TT=0.386 CHECKS=954 NODES=51	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.022 ASSIGNMENTS=157 CHECKS=4921	UNSAT TT=0.021 ASSIGNMENTS=157 CHECKS=4921	UNSAT TT=0.509	UNSAT TT=0.517	UNSAT TT=0.064 CHECKS=3056	UNSAT TT=0.01 ASSIGNMENTS=174 CHECKS=5493	UNSAT TT=0.032 ASSIGNMENTS=4133 CHECKS=84382	UNSAT TT=0.318	UNSAT TT=0.009 ASSIGNMENTS=125 CHECKS=2453	UNSAT TT=0.008 ASSIGNMENTS=157 CHECKS=4921	UNSAT TT=0.789	UNSAT TT=0.015 ASSIGNMENTS=56 CHECKS=2720	UNSAT TT=0.62	UNSAT TT=0.603
csp/aim-50/ normalized-aim-50-2-0-unsat-4_ext.xml	UNSAT TT=0.008	UNSAT TT=0.795 CHECKS=1880 NODES=238	UNSAT TT=0.825 CHECKS=1227 NODES=130	UNSAT TT=0.199	UNSAT TT=0.017 CHECKS=4459	UNSAT TT=0.016 CHECKS=6916	UNSAT TT=0.449 ASSIGNMENTS=132	UNSAT TT=0.503 ASSIGNMENTS=147	UNSAT TT=0.389 CHECKS=872 NODES=55	? (TO) TT=1800.12	? (TO) TT=1800.02	UNSAT TT=0.024 ASSIGNMENTS=114 CHECKS=3134	UNSAT TT=0.021 ASSIGNMENTS=114 CHECKS=3134	UNSAT TT=0.637	UNSAT TT=0.482	UNSAT TT=0.05 CHECKS=1757	UNSAT TT=0.008 ASSIGNMENTS=121 CHECKS=3225	UNSAT TT=0.028 ASSIGNMENTS=4382 CHECKS=81259	UNSAT TT=0.35	UNSAT TT=0.011 ASSIGNMENTS=196 CHECKS=3789	UNSAT TT=0.01 ASSIGNMENTS=114 CHECKS=3134	UNSAT TT=0.739	UNSAT TT=0.013 ASSIGNMENTS=77 CHECKS=3050	UNSAT TT=0.603	UNSAT TT=0.601
csp/aim-50/ normalized-aim-50-3-4-sat-1_ext.xml	SAT TT=0.008	SAT TT=0.803 CHECKS=702 NODES=73	SAT TT=0.782 CHECKS=870 NODES=58	SAT TT=0.054	SAT TT=0.013 CHECKS=1312	SAT TT=0.013 CHECKS=1102	SAT TT=0.469 ASSIGNMENTS=6	SAT TT=0.518 ASSIGNMENTS=18	SAT TT=0.419 CHECKS=1913 NODES=90	SAT TT=0.407 CHECKS=89249 NODES=2318	SAT TT=0.48 CHECKS=9018 NODES=54	SAT TT=0.022 ASSIGNMENTS=5 CHECKS=468	SAT TT=0.023 ASSIGNMENTS=5 CHECKS=468	SAT TT=1.105	SAT TT=1.088	SAT TT=0.066 CHECKS=1814	SAT TT=0.009 ASSIGNMENTS=5 CHECKS=468	SAT TT=0.011 ASSIGNMENTS=68 CHECKS=4270	SAT TT=0.409	SAT TT=0.011 ASSIGNMENTS=89 CHECKS=3931	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=468	SAT TT=0.863	SAT TT=0.019 ASSIGNMENTS=136 CHECKS=11187	SAT TT=0.628	SAT TT=0.665
csp/aim-50/ normalized-aim-50-3-4-sat-2_ext.xml	SAT TT=0.01	SAT TT=0.919 CHECKS=3802 NODES=274	SAT TT=0.828 CHECKS=4071 NODES=241	SAT TT=0.053	SAT TT=0.019 CHECKS=7001	SAT TT=0.021 CHECKS=13117	SAT TT=0.513 ASSIGNMENTS=70	SAT TT=0.461 ASSIGNMENTS=21	SAT TT=0.373 CHECKS=530 NODES=52	SAT TT=0.437 CHECKS=91486 NODES=2315	SAT TT=0.442 CHECKS=137244 NODES=1014	SAT TT=0.022 ASSIGNMENTS=51 CHECKS=3704	SAT TT=0.022 ASSIGNMENTS=51 CHECKS=3704	SAT TT=0.906	SAT TT=1.167	SAT TT=0.055 CHECKS=7101	SAT TT=0.011 ASSIGNMENTS=63 CHECKS=5922	SAT TT=0.015 ASSIGNMENTS=333 CHECKS=25840	SAT TT=0.41	SAT TT=0.011 ASSIGNMENTS=21 CHECKS=931	SAT TT=0.01 ASSIGNMENTS=51 CHECKS=3704	SAT TT=0.871	SAT TT=0.03 ASSIGNMENTS=132 CHECKS=12635	SAT TT=0.662	SAT TT=0.651
csp/aim-50/ normalized-aim-50-3-4-sat-3_ext.xml	SAT TT=0.009	SAT TT=0.826 CHECKS=1107 NODES=80	SAT TT=0.824 CHECKS=1336 NODES=79	SAT TT=0.053	SAT TT=0.018 CHECKS=4045	SAT TT=0.02 CHECKS=11825	SAT TT=0.52 ASSIGNMENTS=54	SAT TT=0.471 ASSIGNMENTS=24	SAT TT=0.434 CHECKS=2493 NODES=102	SAT TT=0.478 CHECKS=39482 NODES=976	SAT TT=0.43 CHECKS=56821 NODES=506	SAT TT=0.023 ASSIGNMENTS=123 CHECKS=11368	SAT TT=0.024 ASSIGNMENTS=123 CHECKS=11368	SAT TT=1.102	SAT TT=0.958	SAT TT=0.069 CHECKS=3510	SAT TT=0.011 ASSIGNMENTS=73 CHECKS=6572	SAT TT=0.01 ASSIGNMENTS=51 CHECKS=3887	SAT TT=0.371	SAT TT=0.009 ASSIGNMENTS=14 CHECKS=691	SAT TT=0.013 ASSIGNMENTS=123 CHECKS=11368	SAT TT=0.787	SAT TT=0.03 ASSIGNMENTS=139 CHECKS=13576	SAT TT=0.692	SAT TT=0.676
csp/aim-50/ normalized-aim-50-3-4-sat-4_ext.xml	SAT TT=0.01	SAT TT=0.783 CHECKS=1943 NODES=128	SAT TT=0.78 CHECKS=974 NODES=53	SAT TT=0.047	SAT TT=0.016 CHECKS=2349	SAT TT=0.016 CHECKS=4471	SAT TT=0.486 ASSIGNMENTS=27	SAT TT=0.531 ASSIGNMENTS=23	SAT TT=0.406 CHECKS=829 NODES=68	SAT TT=0.396 CHECKS=29535 NODES=722	SAT TT=0.43 CHECKS=34591 NODES=336	SAT TT=0.022 ASSIGNMENTS=16 CHECKS=1416	SAT TT=0.02 ASSIGNMENTS=16 CHECKS=1416	SAT TT=0.886	SAT TT=1.144	SAT TT=0.059 CHECKS=4843	SAT TT=0.011 ASSIGNMENTS=12 CHECKS=1441	SAT TT=0.01 ASSIGNMENTS=84 CHECKS=6231	SAT TT=0.364	SAT TT=0.012 ASSIGNMENTS=79 CHECKS=3690	SAT TT=0.01 ASSIGNMENTS=16 CHECKS=1416	SAT TT=0.832	SAT TT=0.019 ASSIGNMENTS=89 CHECKS=6215	SAT TT=0.642	SAT TT=0.668
csp/aim-50/ normalized-aim-50-6-0-sat-1_ext.xml	SAT TT=0.013	SAT TT=0.837 CHECKS=1164 NODES=72	SAT TT=0.854 CHECKS=2424 NODES=57	SAT TT=0.06	SAT TT=0.016 CHECKS=1797	SAT TT=0.016 CHECKS=2552	SAT TT=0.566 ASSIGNMENTS=1	SAT TT=0.542 ASSIGNMENTS=1	SAT TT=0.459 CHECKS=2475 NODES=73	SAT TT=0.653 CHECKS=203734 NODES=2882	SAT TT=0.443 CHECKS=10561 NODES=23	SAT TT=0.026 ASSIGNMENTS=15 CHECKS=1722	SAT TT=0.025 ASSIGNMENTS=15 CHECKS=1722	SAT TT=1.211	SAT TT=1.374	SAT TT=0.057 CHECKS=1288	SAT TT=0.013 ASSIGNMENTS=11 CHECKS=1547	SAT TT=0.013 ASSIGNMENTS=4 CHECKS=1044	SAT TT=0.488	SAT TT=0.013 ASSIGNMENTS=25 CHECKS=2130	SAT TT=0.013 ASSIGNMENTS=15 CHECKS=1722	SAT TT=0.86	SAT TT=0.023 ASSIGNMENTS=84 CHECKS=12073	SAT TT=0.767	SAT TT=0.767
csp/aim-50/ normalized-aim-50-6-0-sat-2_ext.xml	SAT TT=0.013	SAT TT=0.855 CHECKS=2005 NODES=100	SAT TT=0.807 CHECKS=1471 NODES=0	SAT TT=0.062	SAT TT=37.557 CHECKS=3611	SAT TT=0.019 CHECKS=2469	SAT TT=0.528 ASSIGNMENTS=1	SAT TT=0.55 ASSIGNMENTS=1	SAT TT=0.447 CHECKS=595 NODES=51	SAT TT=0.47 CHECKS=7082 NODES=47	SAT TT=0.47 CHECKS=19811 NODES=112	SAT TT=0.024 ASSIGNMENTS=4 CHECKS=1112	SAT TT=0.023 ASSIGNMENTS=4 CHECKS=1112	SAT TT=1.095	SAT TT=1.221	SAT TT=0.083 CHECKS=794	SAT TT=0.013 ASSIGNMENTS=5 CHECKS=1073	SAT TT=0.011 ASSIGNMENTS=6 CHECKS=1646	SAT TT=0.419	SAT TT=0.015 ASSIGNMENTS=22 CHECKS=1876	SAT TT=0.013 ASSIGNMENTS=4 CHECKS=1112	SAT TT=0.928	SAT TT=0.024 ASSIGNMENTS=58 CHECKS=5545	SAT TT=0.81	SAT TT=0.776
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-50/ normalized-aim-50-6-0-sat-3_ext.xml	SAT TT=0.011	SAT TT=0.857 CHECKS=1587 NODES=78	SAT TT=0.779 CHECKS=626 NODES=0	SAT TT=0.061	SAT TT=0.017 CHECKS=3978	SAT TT=0.016 CHECKS=3352	SAT TT=0.575 ASSIGNMENTS=1	SAT TT=0.575 ASSIGNMENTS=1	SAT TT=0.448 CHECKS=513 NODES=50	SAT TT=0.623 CHECKS=16066 NODES=190	SAT TT=0.461 CHECKS=17584 NODES=103	SAT TT=0.025 ASSIGNMENTS=18 CHECKS=2370	SAT TT=0.024 ASSIGNMENTS=18 CHECKS=2370	SAT TT=1.028	SAT TT=1.206	SAT TT=0.089 CHECKS=3722	SAT TT=0.012 ASSIGNMENTS=16 CHECKS=2268	SAT TT=0.012 ASSIGNMENTS=2 CHECKS=860	SAT TT=0.478	SAT TT=0.012 ASSIGNMENTS=6 CHECKS=1200	SAT TT=0.011 ASSIGNMENTS=18 CHECKS=2370	SAT TT=0.9	SAT TT=0.023 ASSIGNMENTS=59 CHECKS=5750	SAT TT=0.76	SAT TT=0.862
csp/aim-50/ normalized-aim-50-6-0-sat-4_ext.xml	SAT TT=0.011	SAT TT=0.849 CHECKS=1771 NODES=88	SAT TT=0.872 CHECKS=1681 NODES=0	SAT TT=0.062	SAT TT=0.017 CHECKS=2589	SAT TT=0.018 CHECKS=5098	SAT TT=0.536 ASSIGNMENTS=1	SAT TT=0.506 ASSIGNMENTS=1	SAT TT=0.439 CHECKS=596 NODES=51	SAT TT=2.912 CHECKS=9820330 NODES=150048	SAT TT=0.439 CHECKS=22347 NODES=150	SAT TT=0.024 ASSIGNMENTS=14 CHECKS=2724	SAT TT=0.022 ASSIGNMENTS=14 CHECKS=2724	SAT TT=1.202	SAT TT=0.998	SAT TT=0.07 CHECKS=4370	SAT TT=0.012 ASSIGNMENTS=21 CHECKS=3527	SAT TT=0.012 ASSIGNMENTS=15 CHECKS=2665	SAT TT=0.417	SAT TT=0.013 ASSIGNMENTS=8 CHECKS=1200	SAT TT=0.011 ASSIGNMENTS=14 CHECKS=2724	SAT TT=0.855	SAT TT=0.025 ASSIGNMENTS=64 CHECKS=7161	SAT TT=0.749	SAT TT=0.903
csp/bddLarge/ normalized-bdd-21-2713-15-79-10_ext.xml	UNSAT TT=20.161	UNSAT TT=75.449 CHECKS=3377 NODES=1579	? (MO) TT=1.737	? (problem) TT=540.272	? (TO) TT=1800.14	? (TO) TT=1800.18	UNSAT TT=502.74 ASSIGNMENTS=1017	UNSAT TT=932.526 ASSIGNMENTS=1413	UNSAT TT=104.103 CHECKS=96745200 NODES=2174	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=43.467 ASSIGNMENTS=1080 CHECKS=2744120	UNSAT TT=43.568 ASSIGNMENTS=1080 CHECKS=2744120	? (MO) TT=1764.19	? (MO) TT=1775.55	UNSAT TT=20.161 CHECKS=1905990	UNSAT TT=29.044 ASSIGNMENTS=953 CHECKS=2516650	UNSAT TT=138.93 ASSIGNMENTS=5088 CHECKS=11761200	? (MO) TT=9.6	UNSAT TT=31.676 ASSIGNMENTS=990 CHECKS=2587020	UNSAT TT=34.385 ASSIGNMENTS=1080 CHECKS=2744120	? TT=92.272	UNSAT TT=1.681 ASSIGNMENTS=2103 CHECKS=195944	? TT=82.751	? TT=77.592
csp/bddLarge/ normalized-bdd-21-2713-15-79-11_ext.xml	UNSAT TT=17.451	UNSAT TT=73.451 CHECKS=4068 NODES=1788	UNSAT TT=80.089 CHECKS=3913 NODES=1688	? (problem) TT=562.562	? (TO) TT=1800.22	? (TO) TT=1800.22	UNSAT TT=911.868 ASSIGNMENTS=1049	UNSAT TT=948.987 ASSIGNMENTS=1358	UNSAT TT=97.693 CHECKS=95507400 NODES=2241	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=49.223 ASSIGNMENTS=1051 CHECKS=3479530	UNSAT TT=46.629 ASSIGNMENTS=1051 CHECKS=3479530	? (MO) TT=1737.24	? (TO) TT=1800	UNSAT TT=17.451 CHECKS=2083980	UNSAT TT=38.9 ASSIGNMENTS=1045 CHECKS=3517360	UNSAT TT=130.019 ASSIGNMENTS=5016 CHECKS=11739500	? (MO) TT=7.4	UNSAT TT=39.778 ASSIGNMENTS=1092 CHECKS=3604380	UNSAT TT=37.212 ASSIGNMENTS=1051 CHECKS=3479530	? TT=98.06	UNSAT TT=1.684 ASSIGNMENTS=2174 CHECKS=182016	? TT=278.531	? TT=175.473
csp/bddLarge/ normalized-bdd-21-2713-15-79-12_ext.xml	UNSAT TT=23.58	UNSAT TT=76.401 CHECKS=4420 NODES=1946	UNSAT TT=76.343 CHECKS=3818 NODES=1663	? (problem) TT=530.24	? (TO) TT=1800.19	? (TO) TT=1800.18	UNSAT TT=597.324 ASSIGNMENTS=1096	UNSAT TT=918.954 ASSIGNMENTS=1376	UNSAT TT=99.969 CHECKS=101402000 NODES=2194	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=47.555 ASSIGNMENTS=1020 CHECKS=3227590	UNSAT TT=44.215 ASSIGNMENTS=1020 CHECKS=3227590	? (MO) TT=1792.49	? (MO) TT=1749.75	UNSAT TT=23.58 CHECKS=2283190	UNSAT TT=41.345 ASSIGNMENTS=1099 CHECKS=3385670	UNSAT TT=133.813 ASSIGNMENTS=5056 CHECKS=11798900	? (MO) TT=7.58	UNSAT TT=40.519 ASSIGNMENTS=1044 CHECKS=3212260	UNSAT TT=38.918 ASSIGNMENTS=1020 CHECKS=3227590	? TT=87.828	UNSAT TT=2.379 ASSIGNMENTS=2380 CHECKS=388061	? TT=173.51	? TT=171.019
csp/bddLarge/ normalized-bdd-21-2713-15-79-13_ext.xml	SAT TT=1.829	SAT TT=10.945 CHECKS=2800 NODES=84	SAT TT=13.537 CHECKS=2784 NODES=63	? (problem) TT=528.163	SAT TT=1429.09 CHECKS=3023260	SAT TT=154.394 CHECKS=223124	SAT TT=378.668 ASSIGNMENTS=1008	SAT TT=112.528 ASSIGNMENTS=264	SAT TT=129.181 CHECKS=127266000 NODES=3166	SAT TT=173.695 CHECKS=252842000 NODES=4656	SAT TT=4.292 CHECKS=865242 NODES=11	SAT TT=33.92 ASSIGNMENTS=996 CHECKS=2326930	SAT TT=36.259 ASSIGNMENTS=996 CHECKS=2326930	? (TO) TT=1800.09	? (MO) TT=1740.44	SAT TT=4.989 CHECKS=560173	SAT TT=25.485 ASSIGNMENTS=1011 CHECKS=2348490	SAT TT=126.027 ASSIGNMENTS=4913 CHECKS=11824300	? (MO) TT=7.67	SAT TT=1.829 ASSIGNMENTS=23 CHECKS=64014	SAT TT=25.527 ASSIGNMENTS=996 CHECKS=2326930	? TT=88.127	SAT TT=1.812 ASSIGNMENTS=2137 CHECKS=156346	? TT=118.121	? TT=108.251
csp/bddLarge/ normalized-bdd-21-2713-15-79-14_ext.xml	UNSAT TT=20.182	UNSAT TT=76.442 CHECKS=4337 NODES=1797	UNSAT TT=78.339 CHECKS=4293 NODES=1797	? (problem) TT=544.606	? (TO) TT=1800.18	? (TO) TT=1800.22	UNSAT TT=553.099 ASSIGNMENTS=1063	UNSAT TT=1088.96 ASSIGNMENTS=1378	UNSAT TT=96.332 CHECKS=94786000 NODES=2179	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=40.446 ASSIGNMENTS=1064 CHECKS=2658980	UNSAT TT=40.31 ASSIGNMENTS=1064 CHECKS=2658980	? (MO) TT=1730.2	? (TO) TT=1800.07	UNSAT TT=20.182 CHECKS=2077040	UNSAT TT=29.608 ASSIGNMENTS=1045 CHECKS=2543630	UNSAT TT=118.182 ASSIGNMENTS=4753 CHECKS=11415200	? (MO) TT=7.41	UNSAT TT=28.473 ASSIGNMENTS=1036 CHECKS=2370010	UNSAT TT=29.492 ASSIGNMENTS=1064 CHECKS=2658980	? TT=93.322	UNSAT TT=1.807 ASSIGNMENTS=2180 CHECKS=231236	? TT=156.024	? TT=149.998
csp/bddLarge/ normalized-bdd-21-2713-15-79-15_ext.xml	UNSAT TT=18.489	UNSAT TT=75.053 CHECKS=3364 NODES=1552	UNSAT TT=89.695 CHECKS=3657 NODES=1544	? (problem) TT=526.969	? (TO) TT=1800.16	? (TO) TT=1800.16	UNSAT TT=418.5 ASSIGNMENTS=949	UNSAT TT=1090.46 ASSIGNMENTS=1408	UNSAT TT=95.81 CHECKS=90291000 NODES=2275	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=32.96 ASSIGNMENTS=972 CHECKS=2279050	UNSAT TT=34.558 ASSIGNMENTS=972 CHECKS=2279050	? (MO) TT=1795.53	? (MO) TT=1699.29	UNSAT TT=18.489 CHECKS=1939770	UNSAT TT=27.632 ASSIGNMENTS=950 CHECKS=2297690	UNSAT TT=129.538 ASSIGNMENTS=4968 CHECKS=11733700	? (MO) TT=7.59	UNSAT TT=28.547 ASSIGNMENTS=988 CHECKS=2377590	UNSAT TT=26.737 ASSIGNMENTS=972 CHECKS=2279050	? TT=95.974	UNSAT TT=1.578 ASSIGNMENTS=2075 CHECKS=144580	? TT=151.406	? TT=135.077
csp/bddLarge/ normalized-bdd-21-2713-15-79-16_ext.xml	UNSAT TT=20.834	UNSAT TT=75.513 CHECKS=2848 NODES=1647	UNSAT TT=87.346 CHECKS=2839 NODES=1666	? (problem) TT=551.773	? (TO) TT=1800.22	? (TO) TT=1800.14	UNSAT TT=517.709 ASSIGNMENTS=976	UNSAT TT=987.725 ASSIGNMENTS=1403	UNSAT TT=103.609 CHECKS=95101700 NODES=2251	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=39.029 ASSIGNMENTS=993 CHECKS=2558580	UNSAT TT=40.195 ASSIGNMENTS=993 CHECKS=2558580	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=20.834 CHECKS=1878100	UNSAT TT=30.634 ASSIGNMENTS=996 CHECKS=2564460	UNSAT TT=133.136 ASSIGNMENTS=5002 CHECKS=11662400	? (MO) TT=7.6	UNSAT TT=29.869 ASSIGNMENTS=1044 CHECKS=2653780	UNSAT TT=30.352 ASSIGNMENTS=993 CHECKS=2558580	? TT=87.929	UNSAT TT=2.027 ASSIGNMENTS=2094 CHECKS=258122	? TT=134.739	? TT=140.713
csp/bddLarge/ normalized-bdd-21-2713-15-79-17_ext.xml	UNSAT TT=17.901	UNSAT TT=77.791 CHECKS=2796 NODES=1534	UNSAT TT=78.278 CHECKS=2833 NODES=1546	? (problem) TT=535.58	? (TO) TT=1800.16	? (TO) TT=1800.15	UNSAT TT=665.002 ASSIGNMENTS=930	UNSAT TT=1087.51 ASSIGNMENTS=1353	UNSAT TT=126.499 CHECKS=121332000 NODES=3085	? (TO) TT=1800.01	? (TO) TT=1800.09	UNSAT TT=42.007 ASSIGNMENTS=918 CHECKS=2666600	UNSAT TT=38.352 ASSIGNMENTS=918 CHECKS=2666600	? (MO) TT=1774.34	? (MO) TT=1743.5	UNSAT TT=17.901 CHECKS=1868550	UNSAT TT=29.664 ASSIGNMENTS=936 CHECKS=2712710	UNSAT TT=134.993 ASSIGNMENTS=4888 CHECKS=11483900	? (MO) TT=7.01	UNSAT TT=33.097 ASSIGNMENTS=972 CHECKS=2785700	UNSAT TT=30.193 ASSIGNMENTS=918 CHECKS=2666600	? TT=92.833	UNSAT TT=1.544 ASSIGNMENTS=2103 CHECKS=147952	? TT=147.356	? TT=141.49
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddLarge/ normalized-bdd-21-2713-15-79-18_ext.xml	UNSAT TT=17.426	UNSAT TT=73.469 CHECKS=3539 NODES=1698	UNSAT TT=80.459 CHECKS=4097 NODES=1805	? (problem) TT=363.737	? (TO) TT=1800.18	? (TO) TT=1800.17	UNSAT TT=501.132 ASSIGNMENTS=1001	UNSAT TT=911.154 ASSIGNMENTS=1349	UNSAT TT=100.868 CHECKS=90786100 NODES=2209	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=35.383 ASSIGNMENTS=931 CHECKS=2229850	UNSAT TT=36.148 ASSIGNMENTS=931 CHECKS=2229850	? (MO) TT=1786.03	? (TO) TT=1800	UNSAT TT=17.426 CHECKS=1998940	UNSAT TT=28.616 ASSIGNMENTS=997 CHECKS=2507850	UNSAT TT=143.498 ASSIGNMENTS=5280 CHECKS=12357500	? (MO) TT=7.4	UNSAT TT=29.391 ASSIGNMENTS=1048 CHECKS=2608780	UNSAT TT=25.151 ASSIGNMENTS=931 CHECKS=2229850	? TT=91.204	UNSAT TT=1.715 ASSIGNMENTS=2107 CHECKS=146214	? TT=112.317	? TT=107.073
csp/bddLarge/ normalized-bdd-21-2713-15-79-19_ext.xml	SAT TT=12.706	SAT TT=24.235 CHECKS=3185 NODES=321	SAT TT=28.389 CHECKS=3237 NODES=317	? (problem) TT=521.08	SAT TT=562.963 CHECKS=1050710	SAT TT=941.565 CHECKS=1870630	SAT TT=393.514 ASSIGNMENTS=876	SAT TT=1001.32 ASSIGNMENTS=1236	SAT TT=119.394 CHECKS=120110000 NODES=2190	SAT TT=13.143 CHECKS=17534700 NODES=318	SAT TT=39.935 CHECKS=66394700 NODES=1169	SAT TT=36.854 ASSIGNMENTS=884 CHECKS=2219740	SAT TT=36.295 ASSIGNMENTS=884 CHECKS=2219740	? (TO) TT=1800.01	? (MO) TT=1766.44	SAT TT=12.706 CHECKS=1298280	SAT TT=26.447 ASSIGNMENTS=905 CHECKS=2287370	SAT TT=143.58 ASSIGNMENTS=5223 CHECKS=12342200	? (MO) TT=6.89	SAT TT=31.06 ASSIGNMENTS=972 CHECKS=2451620	SAT TT=27.76 ASSIGNMENTS=884 CHECKS=2219740	? TT=95.267	SAT TT=1.799 ASSIGNMENTS=2053 CHECKS=183799	? TT=143.301	? TT=151.378
csp/bddLarge/ normalized-bdd-21-2713-15-79-1_ext.xml	UNSAT TT=21.264	UNSAT TT=79.051 CHECKS=3188 NODES=1542	UNSAT TT=91.595 CHECKS=3075 NODES=1592	? (problem) TT=554.699	? (TO) TT=1800.13	? (TO) TT=1800.15	UNSAT TT=681.082 ASSIGNMENTS=988	UNSAT TT=986.172 ASSIGNMENTS=1474	UNSAT TT=107.558 CHECKS=98932400 NODES=2240	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=40.515 ASSIGNMENTS=975 CHECKS=2814450	UNSAT TT=42.407 ASSIGNMENTS=975 CHECKS=2814450	? (MO) TT=1708.4	? (TO) TT=1800.02	UNSAT TT=21.264 CHECKS=1971060	UNSAT TT=33.669 ASSIGNMENTS=985 CHECKS=2835870	UNSAT TT=140.165 ASSIGNMENTS=4787 CHECKS=11448900	? (MO) TT=7.18	UNSAT TT=34.457 ASSIGNMENTS=1095 CHECKS=3045100	UNSAT TT=33.91 ASSIGNMENTS=975 CHECKS=2814450	? TT=97.517	UNSAT TT=1.606 ASSIGNMENTS=2120 CHECKS=162036	? TT=151.893	? TT=162.59
csp/bddLarge/ normalized-bdd-21-2713-15-79-20_ext.xml	UNSAT TT=20.718	UNSAT TT=88.17 CHECKS=3545 NODES=1668	UNSAT TT=85.059 CHECKS=3548 NODES=1651	? (problem) TT=557.04	? (TO) TT=1800.18	? (TO) TT=1800.15	UNSAT TT=541.651 ASSIGNMENTS=1033	UNSAT TT=1151.26 ASSIGNMENTS=1430	UNSAT TT=105.423 CHECKS=102038000 NODES=2222	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=35.547 ASSIGNMENTS=1042 CHECKS=2604580	UNSAT TT=37.139 ASSIGNMENTS=1042 CHECKS=2604580	? (MO) TT=1753.71	? (MO) TT=1773.83	UNSAT TT=20.718 CHECKS=2070290	UNSAT TT=27.151 ASSIGNMENTS=1041 CHECKS=2600350	UNSAT TT=120.811 ASSIGNMENTS=4747 CHECKS=11343200	? (MO) TT=8.2	UNSAT TT=27.744 ASSIGNMENTS=1078 CHECKS=2664880	UNSAT TT=29.358 ASSIGNMENTS=1042 CHECKS=2604580	? TT=85.767	UNSAT TT=1.738 ASSIGNMENTS=2165 CHECKS=182874	? TT=199.88	? TT=194.024
csp/bddLarge/ normalized-bdd-21-2713-15-79-21_ext.xml	UNSAT TT=18.996	UNSAT TT=70.61 CHECKS=3717 NODES=1633	UNSAT TT=72.345 CHECKS=3676 NODES=1644	? (problem) TT=523.827	? (TO) TT=1800.2	? (TO) TT=1800.15	UNSAT TT=629.111 ASSIGNMENTS=998	UNSAT TT=1171.35 ASSIGNMENTS=1513	UNSAT TT=127.925 CHECKS=132136000 NODES=3066	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=38.647 ASSIGNMENTS=991 CHECKS=2586350	UNSAT TT=36.693 ASSIGNMENTS=991 CHECKS=2586350	? (MO) TT=1707.37	? (TO) TT=1800.05	UNSAT TT=18.996 CHECKS=2045950	UNSAT TT=32.226 ASSIGNMENTS=1026 CHECKS=2612970	UNSAT TT=128.656 ASSIGNMENTS=4740 CHECKS=11184900	? (MO) TT=7.41	UNSAT TT=26.622 ASSIGNMENTS=997 CHECKS=2244880	UNSAT TT=30.417 ASSIGNMENTS=991 CHECKS=2586350	? TT=107.501	UNSAT TT=1.98 ASSIGNMENTS=2248 CHECKS=238372	? TT=169.887	? TT=160.315
csp/bddLarge/ normalized-bdd-21-2713-15-79-22_ext.xml	SAT TT=1.674	SAT TT=20.597 CHECKS=2847 NODES=176	SAT TT=8.439 CHECKS=2713 NODES=0	? (problem) TT=523.495	SAT TT=1014.21 CHECKS=2266570	SAT TT=187.636 CHECKS=359718	SAT TT=12.879 ASSIGNMENTS=12	SAT TT=12.889 ASSIGNMENTS=16	SAT TT=29.545 CHECKS=141102 NODES=21	SAT TT=52.193 CHECKS=70578300 NODES=1297	SAT TT=176.532 CHECKS=84183200 NODES=1476	SAT TT=1.674 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.674 ASSIGNMENTS=11 CHECKS=40695	? (TO) TT=1800.01	? (MO) TT=1758.46	SAT TT=7.559 CHECKS=777147	SAT TT=1.676 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.785 ASSIGNMENTS=12 CHECKS=40695	? (MO) TT=6.81	SAT TT=1.706 ASSIGNMENTS=15 CHECKS=40695	SAT TT=1.675 ASSIGNMENTS=11 CHECKS=40695	? TT=104.144	SAT TT=0.38 ASSIGNMENTS=21 CHECKS=6883	? TT=168.226	? TT=170.135
csp/bddLarge/ normalized-bdd-21-2713-15-79-23_ext.xml	UNSAT TT=22.809	UNSAT TT=74.582 CHECKS=4326 NODES=1854	UNSAT TT=76.905 CHECKS=4041 NODES=1801	? (problem) TT=572.871	? (TO) TT=1800.17	? (TO) TT=1800.15	UNSAT TT=1093.63 ASSIGNMENTS=1162	UNSAT TT=1028.95 ASSIGNMENTS=1505	UNSAT TT=97.584 CHECKS=95862300 NODES=2202	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=44.808 ASSIGNMENTS=1124 CHECKS=3237550	UNSAT TT=48.073 ASSIGNMENTS=1124 CHECKS=3237550	? (MO) TT=1751.48	? (TO) TT=1800.02	UNSAT TT=22.809 CHECKS=2331460	UNSAT TT=44.149 ASSIGNMENTS=1235 CHECKS=3864730	UNSAT TT=138.79 ASSIGNMENTS=5229 CHECKS=12165000	? (MO) TT=7.2	UNSAT TT=34.917 ASSIGNMENTS=1113 CHECKS=3053670	UNSAT TT=39.371 ASSIGNMENTS=1124 CHECKS=3237550	? TT=94.747	UNSAT TT=2.113 ASSIGNMENTS=2360 CHECKS=280553	? TT=141.156	? TT=129.483
csp/bddLarge/ normalized-bdd-21-2713-15-79-24_ext.xml	SAT TT=1.521	SAT TT=63.096 CHECKS=4879 NODES=1171	SAT TT=7.305 CHECKS=2713 NODES=0	? (problem) TT=560.595	SAT TT=184.045 CHECKS=340856	? (TO) TT=1800.15	SAT TT=14.671 ASSIGNMENTS=11	SAT TT=13.35 ASSIGNMENTS=12	SAT TT=29.266 CHECKS=260494 NODES=21	SAT TT=207.989 CHECKS=367836000 NODES=6774	SAT TT=330.506 CHECKS=71950900 NODES=1247	SAT TT=1.64 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.654 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=1794.2	? (MO) TT=1765.67	SAT TT=7.031 CHECKS=700049	SAT TT=1.644 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.661 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=7.88	SAT TT=1.567 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.521 ASSIGNMENTS=10 CHECKS=40695	? TT=93.055	SAT TT=0.386 ASSIGNMENTS=21 CHECKS=5545	? TT=132.094	? TT=124.069
csp/bddLarge/ normalized-bdd-21-2713-15-79-25_ext.xml	UNSAT TT=21.108	UNSAT TT=81.523 CHECKS=1797 NODES=1652	UNSAT TT=96.102 CHECKS=1492 NODES=1642	? (problem) TT=571.979	? (TO) TT=1800.19	? (TO) TT=1800.2	UNSAT TT=421.713 ASSIGNMENTS=1085	UNSAT TT=931.27 ASSIGNMENTS=1341	UNSAT TT=97.406 CHECKS=93518300 NODES=2214	? (TO) TT=1800	? (TO) TT=1800.01	UNSAT TT=40.802 ASSIGNMENTS=1057 CHECKS=2495840	UNSAT TT=38.952 ASSIGNMENTS=1057 CHECKS=2495840	? (MO) TT=1797.16	? (TO) TT=1800.09	UNSAT TT=21.108 CHECKS=1966000	UNSAT TT=31.174 ASSIGNMENTS=1057 CHECKS=2539990	UNSAT TT=138.226 ASSIGNMENTS=4779 CHECKS=11388300	? (MO) TT=7.4	UNSAT TT=32.27 ASSIGNMENTS=1140 CHECKS=2708360	UNSAT TT=29.836 ASSIGNMENTS=1057 CHECKS=2495840	? TT=88.911	UNSAT TT=2.156 ASSIGNMENTS=2213 CHECKS=297305	? TT=160.342	? TT=156.877
csp/bddLarge/ normalized-bdd-21-2713-15-79-26_ext.xml	UNSAT TT=23.759	UNSAT TT=98.128 CHECKS=1368 NODES=1693	UNSAT TT=104.274 CHECKS=1370 NODES=1683	? (problem) TT=533.471	? (TO) TT=1800.22	? (TO) TT=1800.18	UNSAT TT=602.975 ASSIGNMENTS=956	UNSAT TT=1202.17 ASSIGNMENTS=1409	UNSAT TT=107.385 CHECKS=101914000 NODES=2214	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=42.613 ASSIGNMENTS=979 CHECKS=2764020	UNSAT TT=42.652 ASSIGNMENTS=979 CHECKS=2764020	? (MO) TT=1769.31	? (MO) TT=1771.59	UNSAT TT=23.759 CHECKS=2038140	UNSAT TT=31.94 ASSIGNMENTS=939 CHECKS=2658320	UNSAT TT=131.122 ASSIGNMENTS=4930 CHECKS=11677200	? (MO) TT=7.39	UNSAT TT=33.012 ASSIGNMENTS=999 CHECKS=2767690	UNSAT TT=33.678 ASSIGNMENTS=979 CHECKS=2764020	? TT=93.217	UNSAT TT=1.691 ASSIGNMENTS=2097 CHECKS=177503	? TT=167.076	? TT=166.835
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddLarge/ normalized-bdd-21-2713-15-79-27_ext.xml	UNSAT TT=21.921	UNSAT TT=82.754 CHECKS=2387 NODES=1534	UNSAT TT=87.021 CHECKS=2342 NODES=1537	? (problem) TT=531.873	? (TO) TT=1800.24	? (TO) TT=1800.15	UNSAT TT=330.266 ASSIGNMENTS=973	UNSAT TT=1257.88 ASSIGNMENTS=1490	UNSAT TT=130.771 CHECKS=127027000 NODES=3086	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=35.764 ASSIGNMENTS=944 CHECKS=2194040	UNSAT TT=36.166 ASSIGNMENTS=944 CHECKS=2194040	? (TO) TT=1800.05	? (MO) TT=1672.59	UNSAT TT=21.921 CHECKS=1926410	UNSAT TT=27.884 ASSIGNMENTS=976 CHECKS=2287120	UNSAT TT=144.546 ASSIGNMENTS=5284 CHECKS=12327000	? (MO) TT=7.38	UNSAT TT=30.34 ASSIGNMENTS=1012 CHECKS=2360410	UNSAT TT=27.207 ASSIGNMENTS=944 CHECKS=2194040	? TT=90.256	UNSAT TT=1.77 ASSIGNMENTS=2113 CHECKS=227342	? TT=126.605	? TT=134.017
csp/bddLarge/ normalized-bdd-21-2713-15-79-28_ext.xml	UNSAT TT=20.517	UNSAT TT=77.034 CHECKS=4120 NODES=1576	UNSAT TT=82.767 CHECKS=4052 NODES=1582	? (problem) TT=531.038	? (TO) TT=1800.16	? (TO) TT=1800.22	UNSAT TT=413.635 ASSIGNMENTS=1004	UNSAT TT=1060.19 ASSIGNMENTS=1306	UNSAT TT=126.338 CHECKS=135596000 NODES=3184	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=35.451 ASSIGNMENTS=953 CHECKS=2253460	UNSAT TT=34.492 ASSIGNMENTS=953 CHECKS=2253460	? (TO) TT=1800	? (MO) TT=1787.75	UNSAT TT=20.517 CHECKS=2042390	UNSAT TT=26.304 ASSIGNMENTS=959 CHECKS=2307450	UNSAT TT=118.932 ASSIGNMENTS=4754 CHECKS=11379900	? (MO) TT=8.94	UNSAT TT=29.614 ASSIGNMENTS=1037 CHECKS=2460350	UNSAT TT=28.019 ASSIGNMENTS=953 CHECKS=2253460	? TT=97.051	UNSAT TT=1.818 ASSIGNMENTS=2236 CHECKS=223828	? TT=149.407	? TT=149.912
csp/bddLarge/ normalized-bdd-21-2713-15-79-29_ext.xml	UNSAT TT=19.765	UNSAT TT=80.187 CHECKS=2747 NODES=1642	UNSAT TT=84.888 CHECKS=2547 NODES=1654	? (problem) TT=564.747	? (TO) TT=1800.22	? (TO) TT=1800.13	UNSAT TT=820.25 ASSIGNMENTS=1031	UNSAT TT=1099.31 ASSIGNMENTS=1459	UNSAT TT=119.048 CHECKS=124596000 NODES=3110	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=49.585 ASSIGNMENTS=1137 CHECKS=3521360	UNSAT TT=49.579 ASSIGNMENTS=1137 CHECKS=3521360	? (TO) TT=1800.02	? (MO) TT=1677	UNSAT TT=19.765 CHECKS=2134890	UNSAT TT=39.881 ASSIGNMENTS=1137 CHECKS=3490600	UNSAT TT=133.568 ASSIGNMENTS=4952 CHECKS=11626300	? (MO) TT=7.4	UNSAT TT=39.112 ASSIGNMENTS=1140 CHECKS=3542300	UNSAT TT=40.714 ASSIGNMENTS=1137 CHECKS=3521360	? TT=91.676	UNSAT TT=1.833 ASSIGNMENTS=2178 CHECKS=178302	? TT=84.678	? TT=85.312
csp/bddLarge/ normalized-bdd-21-2713-15-79-2_ext.xml	UNSAT TT=21.554	UNSAT TT=89.376 CHECKS=1339 NODES=1571	UNSAT TT=104.163 CHECKS=1345 NODES=1666	? (problem) TT=570.639	? (TO) TT=1800.18	? (TO) TT=1800.17	UNSAT TT=442.809 ASSIGNMENTS=962	UNSAT TT=1194.14 ASSIGNMENTS=1509	UNSAT TT=125.819 CHECKS=133972000 NODES=3131	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=37.628 ASSIGNMENTS=963 CHECKS=2328100	UNSAT TT=37.107 ASSIGNMENTS=963 CHECKS=2328100	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=21.554 CHECKS=1938450	UNSAT TT=29.372 ASSIGNMENTS=962 CHECKS=2328390	UNSAT TT=138.306 ASSIGNMENTS=4973 CHECKS=11741900	? (MO) TT=7.29	UNSAT TT=29.98 ASSIGNMENTS=1034 CHECKS=2295360	UNSAT TT=29.067 ASSIGNMENTS=963 CHECKS=2328100	? TT=90.104	UNSAT TT=1.831 ASSIGNMENTS=2103 CHECKS=202244	? TT=147.454	? TT=148.083
csp/bddLarge/ normalized-bdd-21-2713-15-79-30_ext.xml	UNSAT TT=21.331	UNSAT TT=83.927 CHECKS=2535 NODES=1457	UNSAT TT=96.291 CHECKS=3024 NODES=1471	? (problem) TT=560.038	? (TO) TT=1800.15	? (TO) TT=1800.2	UNSAT TT=225.84 ASSIGNMENTS=914	UNSAT TT=903.81 ASSIGNMENTS=1439	UNSAT TT=100.898 CHECKS=94215000 NODES=2171	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=34.278 ASSIGNMENTS=962 CHECKS=2120180	UNSAT TT=34.163 ASSIGNMENTS=962 CHECKS=2120180	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=21.331 CHECKS=1854620	UNSAT TT=26.104 ASSIGNMENTS=937 CHECKS=2167260	UNSAT TT=120.832 ASSIGNMENTS=4961 CHECKS=11627100	? (MO) TT=6.75	UNSAT TT=26.655 ASSIGNMENTS=992 CHECKS=2235430	UNSAT TT=27.932 ASSIGNMENTS=962 CHECKS=2120180	? TT=91.612	UNSAT TT=1.564 ASSIGNMENTS=2076 CHECKS=141327	? TT=144.477	? TT=149.962
csp/bddLarge/ normalized-bdd-21-2713-15-79-31_ext.xml	SAT TT=1.416	SAT TT=25.094 CHECKS=2948 NODES=295	SAT TT=7.568 CHECKS=2713 NODES=0	? (problem) TT=550.534	SAT TT=835.331 CHECKS=1404870	SAT TT=78.225 CHECKS=96014	SAT TT=14.484 ASSIGNMENTS=12	SAT TT=14.192 ASSIGNMENTS=13	SAT TT=29.282 CHECKS=219837 NODES=21	SAT TT=47.308 CHECKS=62951700 NODES=1156	SAT TT=171.452 CHECKS=266278000 NODES=4392	SAT TT=1.518 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.552 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=1775.42	? (TO) TT=1800.04	SAT TT=10.77 CHECKS=960413	SAT TT=1.416 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.521 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=7.6	SAT TT=1.512 ASSIGNMENTS=12 CHECKS=40695	SAT TT=1.519 ASSIGNMENTS=11 CHECKS=40695	? TT=95.87	SAT TT=0.378 ASSIGNMENTS=21 CHECKS=9428	? TT=139.997	? TT=151.922
csp/bddLarge/ normalized-bdd-21-2713-15-79-32_ext.xml	SAT TT=3.027	SAT TT=11.171 CHECKS=2856 NODES=71	SAT TT=17.687 CHECKS=2931 NODES=136	? (problem) TT=557.038	SAT TT=730.293 CHECKS=1490360	SAT TT=82.244 CHECKS=73361	SAT TT=626.32 ASSIGNMENTS=924	SAT TT=402.452 ASSIGNMENTS=636	SAT TT=116.036 CHECKS=118115000 NODES=2203	SAT TT=156.758 CHECKS=229957000 NODES=4233	SAT TT=5.284 CHECKS=954016 NODES=12	SAT TT=36.966 ASSIGNMENTS=836 CHECKS=2338640	SAT TT=34.601 ASSIGNMENTS=836 CHECKS=2338640	? (MO) TT=1684.51	? (MO) TT=1764.72	SAT TT=3.027 CHECKS=270372	SAT TT=27.435 ASSIGNMENTS=841 CHECKS=2364290	SAT TT=128.792 ASSIGNMENTS=4840 CHECKS=11519000	? (MO) TT=7.2	SAT TT=25.547 ASSIGNMENTS=813 CHECKS=2211900	SAT TT=27.928 ASSIGNMENTS=836 CHECKS=2338640	? TT=90.115	SAT TT=1.888 ASSIGNMENTS=2046 CHECKS=250096	? TT=151.479	? TT=136.284
csp/bddLarge/ normalized-bdd-21-2713-15-79-33_ext.xml	UNSAT TT=22.624	UNSAT TT=81.111 CHECKS=3946 NODES=1895	UNSAT TT=86.823 CHECKS=4783 NODES=2058	? (problem) TT=524.143	? (TO) TT=1800.17	? (TO) TT=1800.13	UNSAT TT=340.465 ASSIGNMENTS=1126	UNSAT TT=1023.77 ASSIGNMENTS=1344	UNSAT TT=97.739 CHECKS=95900300 NODES=2183	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=33.247 ASSIGNMENTS=970 CHECKS=2060490	UNSAT TT=34.564 ASSIGNMENTS=970 CHECKS=2060490	? (MO) TT=1761.8	? (MO) TT=1704.85	UNSAT TT=22.624 CHECKS=2236630	UNSAT TT=28.275 ASSIGNMENTS=1096 CHECKS=2374740	UNSAT TT=134.257 ASSIGNMENTS=4760 CHECKS=11402500	? (MO) TT=7.1	UNSAT TT=30.053 ASSIGNMENTS=1150 CHECKS=2472890	UNSAT TT=25.261 ASSIGNMENTS=970 CHECKS=2060490	? TT=90.335	UNSAT TT=2.036 ASSIGNMENTS=2238 CHECKS=299933	? TT=181.85	? TT=173.487
csp/bddLarge/ normalized-bdd-21-2713-15-79-34_ext.xml	SAT TT=2.241	SAT TT=67.185 CHECKS=4695 NODES=1123	SAT TT=68.939 CHECKS=4700 NODES=1124	? (problem) TT=517.224	? (TO) TT=1800.18	SAT TT=265.753 CHECKS=474798	SAT TT=609.566 ASSIGNMENTS=1066	SAT TT=946.836 ASSIGNMENTS=1070	SAT TT=95.502 CHECKS=92391700 NODES=2211	SAT TT=64.401 CHECKS=93727100 NODES=1722	SAT TT=783.315 CHECKS=1057450000 NODES=17108	SAT TT=48.646 ASSIGNMENTS=1105 CHECKS=3179260	SAT TT=48.076 ASSIGNMENTS=1105 CHECKS=3179260	? (MO) TT=1705.64	? (TO) TT=1800	SAT TT=13.906 CHECKS=1340990	SAT TT=36.212 ASSIGNMENTS=1069 CHECKS=3029320	SAT TT=137.616 ASSIGNMENTS=4952 CHECKS=11539100	? (MO) TT=6.91	SAT TT=2.241 ASSIGNMENTS=23 CHECKS=62038	SAT TT=38.703 ASSIGNMENTS=1105 CHECKS=3179260	? TT=90.337	SAT TT=1.93 ASSIGNMENTS=2218 CHECKS=198321	? TT=185.216	? TT=175.483
csp/bddLarge/ normalized-bdd-21-2713-15-79-35_ext.xml	SAT TT=1.302	SAT TT=69.451 CHECKS=5172 NODES=1378	SAT TT=74.186 CHECKS=4964 NODES=1347	? (problem) TT=527.731	SAT TT=631.137 CHECKS=1280510	SAT TT=675.649 CHECKS=1275640	SAT TT=553.814 ASSIGNMENTS=954	SAT TT=556.58 ASSIGNMENTS=868	SAT TT=96.699 CHECKS=94045200 NODES=2201	SAT TT=147.74 CHECKS=260319000 NODES=4793	? (TO) TT=1800.09	SAT TT=42.673 ASSIGNMENTS=996 CHECKS=2734450	SAT TT=44.302 ASSIGNMENTS=996 CHECKS=2734450	? (TO) TT=1800.02	? (MO) TT=1796.56	SAT TT=1.302 CHECKS=87052	SAT TT=33.955 ASSIGNMENTS=964 CHECKS=2680310	SAT TT=133.788 ASSIGNMENTS=5065 CHECKS=11840400	? (MO) TT=7.5	SAT TT=33.097 ASSIGNMENTS=997 CHECKS=2740220	SAT TT=34.676 ASSIGNMENTS=996 CHECKS=2734450	? TT=87.471	SAT TT=1.681 ASSIGNMENTS=2096 CHECKS=205316	? TT=141.829	? TT=141.975
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddLarge/ normalized-bdd-21-2713-15-79-3_ext.xml	UNSAT TT=20.884	UNSAT TT=71.732 CHECKS=3499 NODES=1584	UNSAT TT=87.981 CHECKS=3032 NODES=1500	? (problem) TT=515.502	? (TO) TT=1800.21	? (TO) TT=1800.16	UNSAT TT=373.027 ASSIGNMENTS=945	UNSAT TT=1136.28 ASSIGNMENTS=1415	UNSAT TT=99.899 CHECKS=99449700 NODES=2183	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=35.265 ASSIGNMENTS=923 CHECKS=2101300	UNSAT TT=32.607 ASSIGNMENTS=923 CHECKS=2101300	? (TO) TT=1800	? (MO) TT=1757.63	UNSAT TT=20.884 CHECKS=1912900	UNSAT TT=27.83 ASSIGNMENTS=955 CHECKS=2188010	UNSAT TT=137.473 ASSIGNMENTS=5229 CHECKS=12318400	? (MO) TT=7.6	UNSAT TT=28.369 ASSIGNMENTS=1016 CHECKS=2276350	UNSAT TT=24.649 ASSIGNMENTS=923 CHECKS=2101300	? TT=89.025	UNSAT TT=1.856 ASSIGNMENTS=2093 CHECKS=192376	? TT=238.94	? TT=232.528
csp/bddLarge/ normalized-bdd-21-2713-15-79-4_ext.xml	SAT TT=1.586	SAT TT=21.646 CHECKS=2932 NODES=226	SAT TT=7.677 CHECKS=2713 NODES=0	? (problem) TT=525.085	SAT TT=772.201 CHECKS=1426610	SAT TT=1181.53 CHECKS=2432610	SAT TT=14.224 ASSIGNMENTS=13	SAT TT=13.406 ASSIGNMENTS=22	SAT TT=31.338 CHECKS=192623 NODES=21	SAT TT=16.492 CHECKS=14935400 NODES=271	SAT TT=123.605 CHECKS=79153300 NODES=1412	SAT TT=1.614 ASSIGNMENTS=12 CHECKS=40695	SAT TT=1.723 ASSIGNMENTS=12 CHECKS=40695	? (MO) TT=1745.33	? (MO) TT=1790.98	SAT TT=5.711 CHECKS=556387	SAT TT=1.706 ASSIGNMENTS=12 CHECKS=40695	SAT TT=1.721 ASSIGNMENTS=12 CHECKS=40695	? (MO) TT=7.07	SAT TT=1.613 ASSIGNMENTS=21 CHECKS=40695	SAT TT=1.586 ASSIGNMENTS=12 CHECKS=40695	? TT=97.744	SAT TT=0.384 ASSIGNMENTS=21 CHECKS=9939	? TT=150.631	? TT=142.071
csp/bddLarge/ normalized-bdd-21-2713-15-79-5_ext.xml	SAT TT=1.335	SAT TT=56.391 CHECKS=3713 NODES=893	SAT TT=7.571 CHECKS=2713 NODES=0	? (problem) TT=523.602	SAT TT=666.73 CHECKS=1414240	SAT TT=881.401 CHECKS=1754550	SAT TT=13.055 ASSIGNMENTS=12	SAT TT=14.067 ASSIGNMENTS=12	SAT TT=29.538 CHECKS=255057 NODES=21	SAT TT=39.547 CHECKS=59021300 NODES=1082	SAT TT=1181.2 CHECKS=1191160000 NODES=18178	SAT TT=1.514 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.521 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=1750.97	? (MO) TT=1743.03	SAT TT=1.335 CHECKS=105438	SAT TT=1.524 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.497 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=7.1	SAT TT=1.465 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.47 ASSIGNMENTS=11 CHECKS=40695	? TT=98.243	SAT TT=0.372 ASSIGNMENTS=21 CHECKS=9361	? TT=217.428	? TT=198.989
csp/bddLarge/ normalized-bdd-21-2713-15-79-6_ext.xml	UNSAT TT=22.888	UNSAT TT=76.181 CHECKS=5316 NODES=2097	UNSAT TT=76.052 CHECKS=4113 NODES=1850	? (problem) TT=571.072	? (TO) TT=1800.12	? (TO) TT=1800.21	UNSAT TT=972.952 ASSIGNMENTS=1218	UNSAT TT=965.503 ASSIGNMENTS=1466	UNSAT TT=97.879 CHECKS=100176000 NODES=2195	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=38.699 ASSIGNMENTS=975 CHECKS=2554150	UNSAT TT=36.126 ASSIGNMENTS=975 CHECKS=2554150	? (MO) TT=1785.81	? (MO) TT=1695.23	UNSAT TT=22.888 CHECKS=2355680	UNSAT TT=33.071 ASSIGNMENTS=1071 CHECKS=2793970	UNSAT TT=151.94 ASSIGNMENTS=5177 CHECKS=12005300	? (MO) TT=7	UNSAT TT=32.418 ASSIGNMENTS=1089 CHECKS=2868430	UNSAT TT=29.988 ASSIGNMENTS=975 CHECKS=2554150	? TT=104.317	UNSAT TT=2.39 ASSIGNMENTS=2339 CHECKS=411939	? TT=150.56	? TT=152.108
csp/bddLarge/ normalized-bdd-21-2713-15-79-7_ext.xml	UNSAT TT=20.045	UNSAT TT=73.817 CHECKS=3979 NODES=1823	UNSAT TT=80.599 CHECKS=3864 NODES=1828	? (problem) TT=571.431	? (TO) TT=1800.21	? (TO) TT=1800.16	UNSAT TT=880.847 ASSIGNMENTS=1112	UNSAT TT=1022.82 ASSIGNMENTS=1421	UNSAT TT=101.629 CHECKS=92677300 NODES=2239	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=47.983 ASSIGNMENTS=1083 CHECKS=3176710	UNSAT TT=48.465 ASSIGNMENTS=1083 CHECKS=3176710	? (TO) TT=1800	? (MO) TT=1688.72	UNSAT TT=20.045 CHECKS=2500500	UNSAT TT=37.42 ASSIGNMENTS=1037 CHECKS=3267150	UNSAT TT=131.437 ASSIGNMENTS=4955 CHECKS=11741300	? (MO) TT=7.6	UNSAT TT=36.206 ASSIGNMENTS=1075 CHECKS=3342090	UNSAT TT=36.466 ASSIGNMENTS=1083 CHECKS=3176710	? TT=93.456	UNSAT TT=1.861 ASSIGNMENTS=2138 CHECKS=206666	? TT=80.34	? TT=80.275
csp/bddLarge/ normalized-bdd-21-2713-15-79-8_ext.xml	SAT TT=1.479	SAT TT=39.424 CHECKS=4801 NODES=526	SAT TT=7.722 CHECKS=2713 NODES=0	? (problem) TT=528.732	SAT TT=646.048 CHECKS=1134900	SAT TT=454.389 CHECKS=715287	SAT TT=12.961 ASSIGNMENTS=11	SAT TT=12.866 ASSIGNMENTS=14	SAT TT=31.814 CHECKS=210120 NODES=21	SAT TT=42.29 CHECKS=74186000 NODES=1363	SAT TT=619.153 CHECKS=821644000 NODES=12224	SAT TT=1.809 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.793 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=1769.14	? (MO) TT=1794.91	SAT TT=15.893 CHECKS=1356620	SAT TT=1.786 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.747 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=7.4	SAT TT=1.479 ASSIGNMENTS=13 CHECKS=40695	SAT TT=1.783 ASSIGNMENTS=10 CHECKS=40695	? TT=100.806	SAT TT=0.376 ASSIGNMENTS=21 CHECKS=6325	? TT=134.363	? TT=142.448
csp/bddLarge/ normalized-bdd-21-2713-15-79-9_ext.xml	UNSAT TT=19.999	UNSAT TT=83.219 CHECKS=3030 NODES=1531	UNSAT TT=91.779 CHECKS=3319 NODES=1552	? (problem) TT=571.444	? (TO) TT=1800.19	? (TO) TT=1800.13	UNSAT TT=556.598 ASSIGNMENTS=978	UNSAT TT=1237.96 ASSIGNMENTS=1447	UNSAT TT=117.461 CHECKS=125061000 NODES=2181	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=36.518 ASSIGNMENTS=1034 CHECKS=2599890	UNSAT TT=39.232 ASSIGNMENTS=1034 CHECKS=2599890	? (MO) TT=1779.2	? (MO) TT=1717.1	UNSAT TT=19.999 CHECKS=1966230	UNSAT TT=30.788 ASSIGNMENTS=997 CHECKS=2518740	UNSAT TT=141.407 ASSIGNMENTS=4864 CHECKS=11536200	? (MO) TT=7.4	UNSAT TT=31.853 ASSIGNMENTS=1044 CHECKS=2608730	UNSAT TT=30.368 ASSIGNMENTS=1034 CHECKS=2599890	? TT=86	UNSAT TT=1.665 ASSIGNMENTS=2129 CHECKS=177514	? TT=135.336	? TT=135.77
csp/bddSmall/ normalized-bdd-21-133-18-78-10_ext.xml	SAT TT=0.714	SAT TT=31.417 CHECKS=11568 NODES=4444	SAT TT=4.436 CHECKS=133 NODES=0	SAT TT=143.153	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=6.573 ASSIGNMENTS=17	SAT TT=6.797 ASSIGNMENTS=22	SAT TT=12.562 CHECKS=10640 NODES=21	SAT TT=9.581 CHECKS=17916700 NODES=4623	SAT TT=2 CHECKS=1295600 NODES=299	SAT TT=0.786 ASSIGNMENTS=16 CHECKS=2394	SAT TT=0.714 ASSIGNMENTS=16 CHECKS=2394	? (MO) TT=597.44	? (MO) TT=557.11	SAT TT=8.114 CHECKS=1016120	SAT TT=0.77 ASSIGNMENTS=16 CHECKS=2394	SAT TT=0.704 ASSIGNMENTS=16 CHECKS=2394	? (MO) TT=6.9	SAT TT=0.793 ASSIGNMENTS=21 CHECKS=2394	SAT TT=0.787 ASSIGNMENTS=16 CHECKS=2394	? TT=100.094	SAT TT=0.999 ASSIGNMENTS=21 CHECKS=775	? TT=95.111	? TT=108.712
csp/bddSmall/ normalized-bdd-21-133-18-78-11_ext.xml	SAT TT=0.801	SAT TT=39.633 CHECKS=26849 NODES=8913	SAT TT=51.35 CHECKS=28653 NODES=9183	SAT TT=227.687	SAT TT=910.008 CHECKS=181944	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.13	SAT TT=74.59 CHECKS=66037600 NODES=24505	SAT TT=2.407 CHECKS=1448240 NODES=370	SAT TT=84.083 CHECKS=122010000 NODES=19217	SAT TT=24.1 ASSIGNMENTS=10143 CHECKS=1645510	SAT TT=22.712 ASSIGNMENTS=10143 CHECKS=1645510	? (MO) TT=581.37	? (MO) TT=541.75	SAT TT=3.245 CHECKS=268178	SAT TT=15.351 ASSIGNMENTS=9960 CHECKS=1647540	SAT TT=23.924 ASSIGNMENTS=16692 CHECKS=2346960	? (MO) TT=7.29	SAT TT=0.801 ASSIGNMENTS=29 CHECKS=4050	SAT TT=15.959 ASSIGNMENTS=10143 CHECKS=1645510	? TT=105.684	SAT TT=7.553 ASSIGNMENTS=18609 CHECKS=1471740	? TT=223.17	? TT=227.275
csp/bddSmall/ normalized-bdd-21-133-18-78-12_ext.xml	UNSAT TT=12.089	UNSAT TT=49.652 CHECKS=80918 NODES=21031	UNSAT TT=61.526 CHECKS=62322 NODES=16438	UNSAT TT=251.288	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.09	UNSAT TT=61.7 CHECKS=62633200 NODES=24042	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=25.876 ASSIGNMENTS=11516 CHECKS=1773070	UNSAT TT=27.005 ASSIGNMENTS=11516 CHECKS=1773070	? (MO) TT=592.97	? (MO) TT=557.54	UNSAT TT=12.089 CHECKS=1464290	UNSAT TT=18.785 ASSIGNMENTS=11986 CHECKS=1778540	UNSAT TT=21.749 ASSIGNMENTS=16635 CHECKS=2347980	? (MO) TT=7.1	UNSAT TT=16.496 ASSIGNMENTS=10496 CHECKS=1486790	UNSAT TT=18.511 ASSIGNMENTS=11516 CHECKS=1773070	? TT=106.065	UNSAT TT=5.743 ASSIGNMENTS=19103 CHECKS=976016	? TT=221.837	? TT=221.075
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-13_ext.xml	UNSAT TT=15.11	UNSAT TT=86.699 CHECKS=62729 NODES=17802	UNSAT TT=93.276 CHECKS=54869 NODES=16026	UNSAT TT=271.282	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.12	UNSAT TT=70.573 CHECKS=63872600 NODES=23912	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=23.505 ASSIGNMENTS=10062 CHECKS=1513130	UNSAT TT=23.537 ASSIGNMENTS=10062 CHECKS=1513130	? (MO) TT=543.38	? (MO) TT=552.42	UNSAT TT=19.475 CHECKS=1320750	UNSAT TT=16.015 ASSIGNMENTS=10652 CHECKS=1582110	UNSAT TT=21.701 ASSIGNMENTS=14811 CHECKS=2110990	? (MO) TT=7.3	UNSAT TT=16.736 ASSIGNMENTS=10564 CHECKS=1543190	UNSAT TT=15.11 ASSIGNMENTS=10062 CHECKS=1513130	? TT=90.725	UNSAT TT=9.541 ASSIGNMENTS=18943 CHECKS=1798090	? TT=125.03	? TT=126.479
csp/bddSmall/ normalized-bdd-21-133-18-78-14_ext.xml	UNSAT TT=12.937	UNSAT TT=55.155 CHECKS=71926 NODES=19555	UNSAT TT=70.867 CHECKS=71691 NODES=19487	UNSAT TT=242.868	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	UNSAT TT=89.287 CHECKS=82401600 NODES=34610	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=23.022 ASSIGNMENTS=10037 CHECKS=1516500	UNSAT TT=25.235 ASSIGNMENTS=10037 CHECKS=1516500	? (MO) TT=595.56	? (MO) TT=568.02	UNSAT TT=12.937 CHECKS=1282110	UNSAT TT=16.472 ASSIGNMENTS=10610 CHECKS=1474700	UNSAT TT=24.076 ASSIGNMENTS=15503 CHECKS=2217940	? (MO) TT=7.01	UNSAT TT=16.64 ASSIGNMENTS=11579 CHECKS=1536460	UNSAT TT=16.798 ASSIGNMENTS=10037 CHECKS=1516500	? TT=79.517	UNSAT TT=7.554 ASSIGNMENTS=19169 CHECKS=1444690	? TT=239.534	? TT=234.845
csp/bddSmall/ normalized-bdd-21-133-18-78-15_ext.xml	UNSAT TT=13.111	UNSAT TT=60.022 CHECKS=56615 NODES=17053	UNSAT TT=68.782 CHECKS=63200 NODES=18124	UNSAT TT=248.323	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.1	UNSAT TT=66.274 CHECKS=65794900 NODES=24053	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=24.985 ASSIGNMENTS=10147 CHECKS=1682160	UNSAT TT=23.332 ASSIGNMENTS=10147 CHECKS=1682160	? (MO) TT=555.51	? (MO) TT=558.69	UNSAT TT=13.111 CHECKS=1322890	UNSAT TT=17.438 ASSIGNMENTS=11469 CHECKS=1762530	UNSAT TT=21.585 ASSIGNMENTS=15567 CHECKS=2236000	? (MO) TT=7.78	UNSAT TT=17.222 ASSIGNMENTS=11661 CHECKS=1765920	UNSAT TT=16.425 ASSIGNMENTS=10147 CHECKS=1682160	? TT=95.284	UNSAT TT=7.372 ASSIGNMENTS=19762 CHECKS=1466590	? TT=122.463	? TT=122.985
csp/bddSmall/ normalized-bdd-21-133-18-78-16_ext.xml	UNSAT TT=15.544	UNSAT TT=58.602 CHECKS=67531 NODES=18434	UNSAT TT=66.19 CHECKS=70573 NODES=18531	UNSAT TT=275.808	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.13	UNSAT TT=64.081 CHECKS=60196900 NODES=24854	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=24.869 ASSIGNMENTS=11172 CHECKS=1573320	UNSAT TT=25.689 ASSIGNMENTS=11172 CHECKS=1573320	? (MO) TT=555.69	? (MO) TT=547.18	UNSAT TT=15.591 CHECKS=1373920	UNSAT TT=17.417 ASSIGNMENTS=10548 CHECKS=1663600	UNSAT TT=23.438 ASSIGNMENTS=15901 CHECKS=2259680	? (MO) TT=7.32	UNSAT TT=15.83 ASSIGNMENTS=10231 CHECKS=1571370	UNSAT TT=15.544 ASSIGNMENTS=11172 CHECKS=1573320	? TT=95.583	UNSAT TT=9.907 ASSIGNMENTS=20868 CHECKS=2298450	? TT=147.18	? TT=142.222
csp/bddSmall/ normalized-bdd-21-133-18-78-17_ext.xml	SAT TT=0.725	SAT TT=33.241 CHECKS=10260 NODES=4826	SAT TT=4.408 CHECKS=133 NODES=0	SAT TT=153.943	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=6.975 ASSIGNMENTS=14	SAT TT=6.953 ASSIGNMENTS=15	SAT TT=12.487 CHECKS=15673 NODES=21	SAT TT=3.259 CHECKS=4355540 NODES=1120	SAT TT=70.471 CHECKS=105941000 NODES=17944	SAT TT=0.796 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.793 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=549.44	? (MO) TT=597.14	SAT TT=5.053 CHECKS=485363	SAT TT=0.79 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.779 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.43	SAT TT=0.725 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.772 ASSIGNMENTS=13 CHECKS=2394	? TT=99.236	SAT TT=0.993 ASSIGNMENTS=21 CHECKS=417	? TT=122.009	? TT=126.753
csp/bddSmall/ normalized-bdd-21-133-18-78-18_ext.xml	SAT TT=0.768	SAT TT=29.54 CHECKS=9000 NODES=4153	SAT TT=4.221 CHECKS=133 NODES=0	SAT TT=133.505	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=7.502 ASSIGNMENTS=15	SAT TT=6.72 ASSIGNMENTS=14	SAT TT=13.25 CHECKS=16276 NODES=21	SAT TT=32.463 CHECKS=77831800 NODES=20092	SAT TT=33.902 CHECKS=48272100 NODES=7918	SAT TT=0.774 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.769 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=594.57	? (MO) TT=588.16	SAT TT=2.428 CHECKS=174515	SAT TT=0.768 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.759 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.4	SAT TT=0.792 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.786 ASSIGNMENTS=15 CHECKS=2394	? TT=91.612	SAT TT=0.967 ASSIGNMENTS=21 CHECKS=717	? TT=217.324	? TT=227.368
csp/bddSmall/ normalized-bdd-21-133-18-78-19_ext.xml	UNSAT TT=11.976	UNSAT TT=55.298 CHECKS=85411 NODES=22034	UNSAT TT=62.258 CHECKS=70291 NODES=19050	UNSAT TT=242.671	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.12	UNSAT TT=62.824 CHECKS=62000600 NODES=24023	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=24.023 ASSIGNMENTS=11246 CHECKS=1675490	UNSAT TT=23.837 ASSIGNMENTS=11246 CHECKS=1675490	? (MO) TT=587.62	? (MO) TT=602.08	UNSAT TT=11.976 CHECKS=1313320	UNSAT TT=12.724 ASSIGNMENTS=10054 CHECKS=1471910	UNSAT TT=22.387 ASSIGNMENTS=15374 CHECKS=2235730	? (MO) TT=7.18	UNSAT TT=14.695 ASSIGNMENTS=10442 CHECKS=1606760	UNSAT TT=16.127 ASSIGNMENTS=11246 CHECKS=1675490	? TT=85.245	UNSAT TT=6.562 ASSIGNMENTS=20063 CHECKS=1244730	? TT=231.844	? TT=254.803
csp/bddSmall/ normalized-bdd-21-133-18-78-1_ext.xml	SAT TT=0.719	SAT TT=33.089 CHECKS=18106 NODES=6241	SAT TT=4.345 CHECKS=133 NODES=0	SAT TT=146.005	? (TO) TT=1800.07	SAT TT=569.106 CHECKS=114108	SAT TT=7.389 ASSIGNMENTS=14	SAT TT=7.363 ASSIGNMENTS=16	SAT TT=13.338 CHECKS=16817 NODES=21	SAT TT=1.695 CHECKS=544442 NODES=136	SAT TT=229.192 CHECKS=257826000 NODES=19620	SAT TT=0.77 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.779 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=600.22	? (MO) TT=553.03	SAT TT=13.331 CHECKS=1161870	SAT TT=0.733 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.73 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=7.89	SAT TT=0.719 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.797 ASSIGNMENTS=13 CHECKS=2394	? TT=81.62	SAT TT=0.955 ASSIGNMENTS=21 CHECKS=590	? TT=98.121	? TT=100.159
csp/bddSmall/ normalized-bdd-21-133-18-78-20_ext.xml	SAT TT=0.731	SAT TT=41.671 CHECKS=38439 NODES=11735	SAT TT=3.951 CHECKS=133 NODES=0	SAT TT=144.413	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT TT=6.598 ASSIGNMENTS=15	SAT TT=7.258 ASSIGNMENTS=16	SAT TT=12.38 CHECKS=10119 NODES=21	SAT TT=5.196 CHECKS=9473980 NODES=2442	SAT TT=103.362 CHECKS=131512000 NODES=14884	SAT TT=0.789 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.794 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=596.18	? (MO) TT=557.43	SAT TT=3.753 CHECKS=381201	SAT TT=0.785 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.724 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=7.54	SAT TT=0.802 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.731 ASSIGNMENTS=14 CHECKS=2394	? TT=84.077	SAT TT=1.051 ASSIGNMENTS=21 CHECKS=467	? TT=238.746	? TT=238.797
csp/bddSmall/ normalized-bdd-21-133-18-78-21_ext.xml	UNSAT TT=14.384	UNSAT TT=58.504 CHECKS=63268 NODES=18664	UNSAT TT=65.704 CHECKS=59131 NODES=17021	UNSAT TT=254.492	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.15	UNSAT TT=69.807 CHECKS=61116800 NODES=24456	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=24.71 ASSIGNMENTS=10706 CHECKS=1579960	UNSAT TT=22.846 ASSIGNMENTS=10706 CHECKS=1579960	? (MO) TT=557.11	? (MO) TT=574.39	UNSAT TT=14.384 CHECKS=1300580	UNSAT TT=15.93 ASSIGNMENTS=10747 CHECKS=1588220	UNSAT TT=22.185 ASSIGNMENTS=15139 CHECKS=2149850	? (MO) TT=6.91	UNSAT TT=16.467 ASSIGNMENTS=10738 CHECKS=1561600	UNSAT TT=14.944 ASSIGNMENTS=10706 CHECKS=1579960	? TT=105.625	UNSAT TT=7.115 ASSIGNMENTS=19450 CHECKS=1444360	? TT=229.884	? TT=227.686
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-22_ext.xml	UNSAT TT=12.404	UNSAT TT=60.515 CHECKS=69110 NODES=18827	UNSAT TT=67.062 CHECKS=62628 NODES=17039	UNSAT TT=235.217	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.14	UNSAT TT=66.403 CHECKS=60842600 NODES=24631	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=23.446 ASSIGNMENTS=10793 CHECKS=1600220	UNSAT TT=23.872 ASSIGNMENTS=10793 CHECKS=1600220	? (MO) TT=548.73	? (MO) TT=549.57	UNSAT TT=12.404 CHECKS=1220260	UNSAT TT=15.949 ASSIGNMENTS=10733 CHECKS=1618230	UNSAT TT=25.586 ASSIGNMENTS=17896 CHECKS=2503990	? (MO) TT=7.99	UNSAT TT=18.216 ASSIGNMENTS=10580 CHECKS=1784720	UNSAT TT=14.781 ASSIGNMENTS=10793 CHECKS=1600220	? TT=97.181	UNSAT TT=6.423 ASSIGNMENTS=18262 CHECKS=1358800	? TT=99.573	? TT=93.276
csp/bddSmall/ normalized-bdd-21-133-18-78-23_ext.xml	SAT TT=0.754	SAT TT=32.66 CHECKS=12478 NODES=4701	SAT TT=4.176 CHECKS=133 NODES=0	SAT TT=149.269	SAT TT=69.429 CHECKS=8047	? (TO) TT=1800.04	SAT TT=6.864 ASSIGNMENTS=15	SAT TT=7.328 ASSIGNMENTS=14	SAT TT=12.74 CHECKS=12991 NODES=21	SAT TT=20.616 CHECKS=43141400 NODES=11130	SAT TT=13.393 CHECKS=20080300 NODES=4961	SAT TT=0.773 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.789 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=548.53	? (MO) TT=588.33	SAT TT=2.171 CHECKS=127107	SAT TT=0.772 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.778 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=7.3	SAT TT=0.754 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.756 ASSIGNMENTS=14 CHECKS=2394	? TT=86.479	SAT TT=1.072 ASSIGNMENTS=21 CHECKS=360	? TT=292.122	? TT=296.447
csp/bddSmall/ normalized-bdd-21-133-18-78-24_ext.xml	UNSAT TT=13.798	UNSAT TT=54.411 CHECKS=68899 NODES=18430	UNSAT TT=67.062 CHECKS=57164 NODES=16641	UNSAT TT=272.993	? (TO) TT=1800.01	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=64.678 CHECKS=56626400 NODES=24515	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=25.874 ASSIGNMENTS=10291 CHECKS=1883190	UNSAT TT=25.933 ASSIGNMENTS=10291 CHECKS=1883190	? (MO) TT=560.1	? (MO) TT=561.91	UNSAT TT=14.311 CHECKS=1442150	UNSAT TT=15.214 ASSIGNMENTS=9579 CHECKS=1579640	UNSAT TT=21.111 ASSIGNMENTS=14879 CHECKS=2140840	? (MO) TT=7.79	UNSAT TT=13.798 ASSIGNMENTS=9266 CHECKS=1466150	UNSAT TT=16.499 ASSIGNMENTS=10291 CHECKS=1883190	? TT=88.236	UNSAT TT=7.636 ASSIGNMENTS=18876 CHECKS=1555390	? TT=262.944	? TT=259.693
csp/bddSmall/ normalized-bdd-21-133-18-78-25_ext.xml	SAT TT=0.717	SAT TT=44.395 CHECKS=17754 NODES=6507	SAT TT=4.215 CHECKS=133 NODES=0	SAT TT=142.159	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=7.31 ASSIGNMENTS=15	SAT TT=7.26 ASSIGNMENTS=18	SAT TT=13.383 CHECKS=11014 NODES=21	SAT TT=12.931 CHECKS=25220700 NODES=6506	SAT TT=1451.47 CHECKS=1415560000 NODES=35730	SAT TT=0.793 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.807 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=561.47	? (MO) TT=556.14	SAT TT=16.122 CHECKS=1247380	SAT TT=0.717 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.778 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=7.93	SAT TT=0.77 ASSIGNMENTS=17 CHECKS=2394	SAT TT=0.727 ASSIGNMENTS=14 CHECKS=2394	? TT=87.429	SAT TT=0.952 ASSIGNMENTS=21 CHECKS=917	? TT=274.729	? TT=296.427
csp/bddSmall/ normalized-bdd-21-133-18-78-26_ext.xml	SAT TT=0.723	SAT TT=24.775 CHECKS=8361 NODES=3300	SAT TT=3.975 CHECKS=133 NODES=0	SAT TT=145.535	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=6.415 ASSIGNMENTS=15	SAT TT=7.21 ASSIGNMENTS=15	SAT TT=12.383 CHECKS=17186 NODES=21	SAT TT=7.71 CHECKS=15585400 NODES=4019	SAT TT=98.444 CHECKS=128900000 NODES=16365	SAT TT=0.737 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.768 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=590.36	? (MO) TT=574.77	SAT TT=5.341 CHECKS=502716	SAT TT=0.792 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.759 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=7.1	SAT TT=0.723 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.758 ASSIGNMENTS=14 CHECKS=2394	? TT=87.596	SAT TT=0.965 ASSIGNMENTS=21 CHECKS=607	? TT=264.571	? TT=239.915
csp/bddSmall/ normalized-bdd-21-133-18-78-27_ext.xml	SAT TT=0.713	SAT TT=26.707 CHECKS=7401 NODES=2951	SAT TT=4.369 CHECKS=133 NODES=0	SAT TT=134.465	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=7.487 ASSIGNMENTS=15	SAT TT=7.358 ASSIGNMENTS=16	SAT TT=12.62 CHECKS=8393 NODES=21	SAT TT=4.743 CHECKS=7221190 NODES=1861	SAT TT=249.066 CHECKS=263496000 NODES=17084	SAT TT=0.713 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.794 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=596.49	? (MO) TT=549.89	SAT TT=0.775 CHECKS=27164	SAT TT=0.783 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.777 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=6.78	SAT TT=0.798 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.787 ASSIGNMENTS=14 CHECKS=2394	? TT=91.623	SAT TT=1.051 ASSIGNMENTS=21 CHECKS=501	? TT=292.533	? TT=277.87
csp/bddSmall/ normalized-bdd-21-133-18-78-28_ext.xml	UNSAT TT=12.778	UNSAT TT=49.741 CHECKS=72626 NODES=20985	UNSAT TT=62.727 CHECKS=68387 NODES=20089	UNSAT TT=252.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.18	UNSAT TT=61.839 CHECKS=60510700 NODES=23937	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=24.121 ASSIGNMENTS=10326 CHECKS=1530210	UNSAT TT=24.674 ASSIGNMENTS=10326 CHECKS=1530210	? (MO) TT=574.22	? (MO) TT=540.41	UNSAT TT=12.778 CHECKS=1366560	UNSAT TT=17.569 ASSIGNMENTS=11822 CHECKS=1778470	UNSAT TT=20.043 ASSIGNMENTS=14997 CHECKS=2178820	? (MO) TT=6.81	UNSAT TT=14.987 ASSIGNMENTS=10020 CHECKS=1443980	UNSAT TT=16.394 ASSIGNMENTS=10326 CHECKS=1530210	? TT=89.438	UNSAT TT=6.846 ASSIGNMENTS=19022 CHECKS=1332520	? TT=93.414	? TT=105.629
csp/bddSmall/ normalized-bdd-21-133-18-78-29_ext.xml	UNSAT TT=12.13	UNSAT TT=63.654 CHECKS=65648 NODES=17331	UNSAT TT=73.221 CHECKS=65288 NODES=16953	UNSAT TT=223.995	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.12	UNSAT TT=68.696 CHECKS=61114500 NODES=24648	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=25.944 ASSIGNMENTS=11498 CHECKS=1641480	UNSAT TT=25.348 ASSIGNMENTS=11498 CHECKS=1641480	? (MO) TT=553.35	? (MO) TT=590.91	UNSAT TT=12.13 CHECKS=1386000	UNSAT TT=16.527 ASSIGNMENTS=11769 CHECKS=1721300	UNSAT TT=19.961 ASSIGNMENTS=14800 CHECKS=2093360	? (MO) TT=7.29	UNSAT TT=15.019 ASSIGNMENTS=10851 CHECKS=1499380	UNSAT TT=17.372 ASSIGNMENTS=11498 CHECKS=1641480	? TT=97.33	UNSAT TT=7.028 ASSIGNMENTS=18668 CHECKS=1419660	? TT=135.204	? TT=131.137
csp/bddSmall/ normalized-bdd-21-133-18-78-2_ext.xml	SAT TT=1.264	SAT TT=32.214 CHECKS=22972 NODES=7545	SAT TT=40.965 CHECKS=26351 NODES=8437	SAT TT=158.923	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=72.653 CHECKS=64942100 NODES=26049	SAT TT=1.774 CHECKS=663297 NODES=166	SAT TT=203.114 CHECKS=223101000 NODES=16656	SAT TT=20.768 ASSIGNMENTS=8312 CHECKS=1292560	SAT TT=22.05 ASSIGNMENTS=8312 CHECKS=1292560	? (MO) TT=555.84	? (MO) TT=572.55	SAT TT=1.264 CHECKS=89502	SAT TT=12.254 ASSIGNMENTS=8245 CHECKS=1242660	SAT TT=0.883 ASSIGNMENTS=94 CHECKS=14021	? (MO) TT=7.05	SAT TT=9.321 ASSIGNMENTS=5863 CHECKS=1049050	SAT TT=13.859 ASSIGNMENTS=8312 CHECKS=1292560	? TT=85.614	SAT TT=1.786 ASSIGNMENTS=1902 CHECKS=171788	? TT=98.403	? TT=98.761
csp/bddSmall/ normalized-bdd-21-133-18-78-30_ext.xml	UNSAT TT=16.415	UNSAT TT=61.912 CHECKS=54050 NODES=16986	UNSAT TT=71.147 CHECKS=58082 NODES=17559	UNSAT TT=250.307	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.11	UNSAT TT=71.227 CHECKS=59540100 NODES=24841	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=25.377 ASSIGNMENTS=11079 CHECKS=1742230	UNSAT TT=25.54 ASSIGNMENTS=11079 CHECKS=1742230	? (MO) TT=559.07	? (MO) TT=583.01	UNSAT TT=18.758 CHECKS=1431650	UNSAT TT=16.415 ASSIGNMENTS=11699 CHECKS=1598120	UNSAT TT=21.7 ASSIGNMENTS=16896 CHECKS=2347340	? (MO) TT=7.46	UNSAT TT=16.997 ASSIGNMENTS=12139 CHECKS=1662080	UNSAT TT=16.925 ASSIGNMENTS=11079 CHECKS=1742230	? TT=80.288	UNSAT TT=10.509 ASSIGNMENTS=22003 CHECKS=1576020	? TT=224.487	? TT=247.41
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-31_ext.xml	UNSAT TT=14.791	UNSAT TT=95.062 CHECKS=59416 NODES=17473	UNSAT TT=106.809 CHECKS=55033 NODES=18090	UNSAT TT=242.139	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=1554.51 ASSIGNMENTS=10289	? (TO) TT=1800.05	UNSAT TT=68.224 CHECKS=58346500 NODES=24228	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=22.982 ASSIGNMENTS=10508 CHECKS=1470000	UNSAT TT=21.747 ASSIGNMENTS=10508 CHECKS=1470000	? (MO) TT=558.83	? (MO) TT=591.98	UNSAT TT=18.057 CHECKS=1374040	UNSAT TT=15.381 ASSIGNMENTS=10624 CHECKS=1470240	UNSAT TT=20.571 ASSIGNMENTS=14711 CHECKS=2073900	? (MO) TT=6.84	UNSAT TT=16.03 ASSIGNMENTS=10964 CHECKS=1515920	UNSAT TT=14.791 ASSIGNMENTS=10508 CHECKS=1470000	? TT=90.919	UNSAT TT=7.92 ASSIGNMENTS=17936 CHECKS=1426550	? TT=262.218	? TT=256.199
csp/bddSmall/ normalized-bdd-21-133-18-78-32_ext.xml	SAT TT=0.72	SAT TT=9.431 CHECKS=551 NODES=316	SAT TT=4.181 CHECKS=133 NODES=0	SAT TT=144.006	? (TO) TT=1800.08	SAT TT=137.203 CHECKS=24194	SAT TT=7.106 ASSIGNMENTS=15	SAT TT=7.295 ASSIGNMENTS=17	SAT TT=13.23 CHECKS=10919 NODES=21	SAT TT=12.541 CHECKS=25508400 NODES=6582	SAT TT=22.129 CHECKS=35857900 NODES=6831	SAT TT=0.779 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.785 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=593.4	? (MO) TT=589.35	SAT TT=3.804 CHECKS=396554	SAT TT=0.72 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.781 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=6.91	SAT TT=0.781 ASSIGNMENTS=16 CHECKS=2394	SAT TT=0.758 ASSIGNMENTS=14 CHECKS=2394	? TT=95.526	SAT TT=1.03 ASSIGNMENTS=21 CHECKS=579	? TT=100.247	? TT=99.489
csp/bddSmall/ normalized-bdd-21-133-18-78-33_ext.xml	UNSAT TT=16.157	UNSAT TT=58.092 CHECKS=58833 NODES=19701	UNSAT TT=62.823 CHECKS=65779 NODES=19303	UNSAT TT=251.674	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.08	UNSAT TT=69.614 CHECKS=65493200 NODES=24400	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=26.887 ASSIGNMENTS=12381 CHECKS=1850770	UNSAT TT=26.966 ASSIGNMENTS=12381 CHECKS=1850770	? (MO) TT=577.3	? (MO) TT=578.12	UNSAT TT=21.246 CHECKS=1332060	UNSAT TT=16.157 ASSIGNMENTS=11345 CHECKS=1605130	UNSAT TT=25.087 ASSIGNMENTS=16918 CHECKS=2396730	? (MO) TT=7.11	UNSAT TT=16.478 ASSIGNMENTS=11335 CHECKS=1520940	UNSAT TT=17.331 ASSIGNMENTS=12381 CHECKS=1850770	? TT=80.257	UNSAT TT=8.136 ASSIGNMENTS=20011 CHECKS=2016650	? TT=163.377	? TT=164.594
csp/bddSmall/ normalized-bdd-21-133-18-78-34_ext.xml	SAT TT=4.658	SAT TT=33.215 CHECKS=22442 NODES=7265	SAT TT=35.779 CHECKS=16011 NODES=5864	SAT TT=153.264	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=900.01 ASSIGNMENTS=6026	? (TO) TT=1800.08	SAT TT=55.574 CHECKS=53835200 NODES=22016	SAT TT=9.887 CHECKS=19526500 NODES=5036	SAT TT=180.709 CHECKS=226250000 NODES=22308	SAT TT=18.784 ASSIGNMENTS=7106 CHECKS=982989	SAT TT=18.697 ASSIGNMENTS=7106 CHECKS=982989	? (MO) TT=607.36	? (MO) TT=597.19	SAT TT=11.356 CHECKS=1107490	SAT TT=8.536 ASSIGNMENTS=6107 CHECKS=855725	SAT TT=9.679 ASSIGNMENTS=7298 CHECKS=1046620	? (MO) TT=7.31	SAT TT=4.658 ASSIGNMENTS=3425 CHECKS=483507	SAT TT=9.61 ASSIGNMENTS=7106 CHECKS=982989	? TT=93.958	SAT TT=7.008 ASSIGNMENTS=18307 CHECKS=1522910	? TT=119.179	? TT=109.337
csp/bddSmall/ normalized-bdd-21-133-18-78-35_ext.xml	UNSAT TT=13.553	UNSAT TT=71.316 CHECKS=59807 NODES=16866	UNSAT TT=75.633 CHECKS=56666 NODES=18545	UNSAT TT=196.748	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=67.369 CHECKS=57562200 NODES=24814	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=22.404 ASSIGNMENTS=11159 CHECKS=1524050	UNSAT TT=23.573 ASSIGNMENTS=11159 CHECKS=1524050	? (MO) TT=548.18	? (MO) TT=564.11	UNSAT TT=13.553 CHECKS=1256280	UNSAT TT=15.873 ASSIGNMENTS=10981 CHECKS=1506470	UNSAT TT=19.84 ASSIGNMENTS=14907 CHECKS=2150450	? (MO) TT=8.09	UNSAT TT=14.543 ASSIGNMENTS=10842 CHECKS=1486900	UNSAT TT=15.578 ASSIGNMENTS=11159 CHECKS=1524050	? TT=90.875	UNSAT TT=5.961 ASSIGNMENTS=19155 CHECKS=1123370	? TT=216.29	? TT=216.235
csp/bddSmall/ normalized-bdd-21-133-18-78-3_ext.xml	SAT TT=0.709	SAT TT=25.143 CHECKS=18934 NODES=5967	SAT TT=4.178 CHECKS=133 NODES=0	SAT TT=148.908	SAT TT=1056.7 CHECKS=223126	SAT TT=367.975 CHECKS=80899	SAT TT=6.593 ASSIGNMENTS=15	SAT TT=7.377 ASSIGNMENTS=15	SAT TT=13.35 CHECKS=11371 NODES=21	SAT TT=35.732 CHECKS=78450700 NODES=20255	SAT TT=186.843 CHECKS=230954000 NODES=22708	SAT TT=0.782 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.797 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=586.49	? (MO) TT=567.8	SAT TT=2.902 CHECKS=296067	SAT TT=0.78 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.762 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.6	SAT TT=0.778 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.709 ASSIGNMENTS=14 CHECKS=2394	? TT=87.334	SAT TT=1.06 ASSIGNMENTS=21 CHECKS=965	? TT=313.581	? TT=311.655
csp/bddSmall/ normalized-bdd-21-133-18-78-4_ext.xml	SAT TT=0.815	SAT TT=28.103 CHECKS=8638 NODES=3826	SAT TT=32.354 CHECKS=13615 NODES=4494	SAT TT=259.118	? (TO) TT=1800.03	SAT TT=458.504 CHECKS=120760	? (TO) TT=1800.1	SAT TT=1640.61 ASSIGNMENTS=5576	SAT TT=66.172 CHECKS=65313800 NODES=24481	SAT TT=12.115 CHECKS=24136800 NODES=6228	SAT TT=113.595 CHECKS=141529000 NODES=18435	SAT TT=23.907 ASSIGNMENTS=10886 CHECKS=1704260	SAT TT=25.224 ASSIGNMENTS=10886 CHECKS=1704260	? (MO) TT=557.78	? (MO) TT=575.58	SAT TT=4.393 CHECKS=385744	SAT TT=11.574 ASSIGNMENTS=7985 CHECKS=1296240	SAT TT=22.367 ASSIGNMENTS=15321 CHECKS=2252060	? (MO) TT=7.6	SAT TT=0.815 ASSIGNMENTS=29 CHECKS=4102	SAT TT=15.737 ASSIGNMENTS=10886 CHECKS=1704260	? TT=88.466	SAT TT=5.102 ASSIGNMENTS=10422 CHECKS=1187820	? TT=239.902	? TT=240.824
csp/bddSmall/ normalized-bdd-21-133-18-78-5_ext.xml	SAT TT=0.723	SAT TT=31.826 CHECKS=23174 NODES=7261	SAT TT=4.335 CHECKS=133 NODES=0	SAT TT=146.667	? (TO) TT=1800.11	SAT TT=1210.76 CHECKS=264689	SAT TT=6.373 ASSIGNMENTS=14	SAT TT=6.91 ASSIGNMENTS=15	SAT TT=12.62 CHECKS=13070 NODES=21	SAT TT=5.479 CHECKS=8566250 NODES=2210	SAT TT=204.982 CHECKS=228402000 NODES=20969	SAT TT=0.742 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.723 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=558.1	? (MO) TT=581.74	SAT TT=4.416 CHECKS=376924	SAT TT=0.776 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.763 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=6.8	SAT TT=0.808 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.777 ASSIGNMENTS=13 CHECKS=2394	? TT=93.341	SAT TT=1.033 ASSIGNMENTS=21 CHECKS=411	? TT=238.441	? TT=246.13
csp/bddSmall/ normalized-bdd-21-133-18-78-6_ext.xml	UNSAT TT=14.88	UNSAT TT=58.165 CHECKS=39854 NODES=15245	UNSAT TT=75.614 CHECKS=36826 NODES=14492	UNSAT TT=284.58	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.06	UNSAT TT=70.985 CHECKS=61066800 NODES=24384	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=24.373 ASSIGNMENTS=11325 CHECKS=1587550	UNSAT TT=24.91 ASSIGNMENTS=11325 CHECKS=1587550	? (MO) TT=548.39	? (MO) TT=578.82	UNSAT TT=18.274 CHECKS=1373470	UNSAT TT=15.86 ASSIGNMENTS=10771 CHECKS=1560070	UNSAT TT=21.542 ASSIGNMENTS=15723 CHECKS=2247850	? (MO) TT=6.8	UNSAT TT=14.88 ASSIGNMENTS=10514 CHECKS=1467170	UNSAT TT=15.696 ASSIGNMENTS=11325 CHECKS=1587550	? TT=81.781	UNSAT TT=7.522 ASSIGNMENTS=18438 CHECKS=1510260	? TT=212.353	? TT=221.729
csp/bddSmall/ normalized-bdd-21-133-18-78-7_ext.xml	SAT TT=0.813	SAT TT=24.206 CHECKS=18492 NODES=6060	SAT TT=30.109 CHECKS=16344 NODES=5691	SAT TT=215.53	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=71.042 CHECKS=64632500 NODES=24477	SAT TT=7.2 CHECKS=12071900 NODES=3113	SAT TT=58.298 CHECKS=81116600 NODES=13809	SAT TT=23.952 ASSIGNMENTS=11935 CHECKS=1731840	SAT TT=23.728 ASSIGNMENTS=11935 CHECKS=1731840	? (MO) TT=587.91	? (MO) TT=589.29	SAT TT=10.423 CHECKS=1170080	SAT TT=14.717 ASSIGNMENTS=10260 CHECKS=1590280	SAT TT=20.27 ASSIGNMENTS=14689 CHECKS=2231340	? (MO) TT=7.11	SAT TT=0.813 ASSIGNMENTS=31 CHECKS=4119	SAT TT=16.372 ASSIGNMENTS=11935 CHECKS=1731840	? TT=85.604	SAT TT=6.664 ASSIGNMENTS=19737 CHECKS=1193090	? TT=109.834	? TT=117.544
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-8_ext.xml	SAT TT=0.716	SAT TT=19.655 CHECKS=4897 NODES=1923	SAT TT=4.354 CHECKS=133 NODES=0	SAT TT=135.041	SAT TT=502.312 CHECKS=108116	? (TO) TT=1800.1	SAT TT=7.098 ASSIGNMENTS=14	SAT TT=6.61 ASSIGNMENTS=19	SAT TT=13.442 CHECKS=10029 NODES=21	SAT TT=50.773 CHECKS=115221000 NODES=29765	SAT TT=323.324 CHECKS=346201000 NODES=22271	SAT TT=0.729 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.771 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=587.22	? (MO) TT=546.07	SAT TT=9.759 CHECKS=922513	SAT TT=0.716 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.72 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.12	SAT TT=0.772 ASSIGNMENTS=18 CHECKS=2394	SAT TT=0.766 ASSIGNMENTS=13 CHECKS=2394	? TT=81.822	SAT TT=1.031 ASSIGNMENTS=21 CHECKS=342	? TT=93.153	? TT=102.929
csp/bddSmall/ normalized-bdd-21-133-18-78-9_ext.xml	SAT TT=0.744	SAT TT=18.886 CHECKS=5197 NODES=2236	SAT TT=4.171 CHECKS=133 NODES=0	SAT TT=221.13	SAT TT=406.132 CHECKS=99353	? (TO) TT=1800.06	? (TO) TT=1800.14	SAT TT=6.751 ASSIGNMENTS=17	SAT TT=12.602 CHECKS=13421 NODES=21	SAT TT=3.132 CHECKS=4255100 NODES=1094	SAT TT=115.992 CHECKS=148509000 NODES=16458	SAT TT=20.033 ASSIGNMENTS=7765 CHECKS=1113110	SAT TT=19.065 ASSIGNMENTS=7765 CHECKS=1113110	? (MO) TT=598.82	? (MO) TT=576.94	SAT TT=3.339 CHECKS=376742	SAT TT=13.69 ASSIGNMENTS=9668 CHECKS=1345280	SAT TT=0.967 ASSIGNMENTS=215 CHECKS=33232	? (MO) TT=7.39	SAT TT=0.744 ASSIGNMENTS=16 CHECKS=2394	SAT TT=11.142 ASSIGNMENTS=7765 CHECKS=1113110	? TT=95.04	SAT TT=1.187 ASSIGNMENTS=222 CHECKS=27801	? TT=104.127	? TT=105.206
csp/dag-half/ normalized-half-n25-d5-e56-r7-11.xml	SAT TT=308.316	? (TO) TT=1800.09	? (TO) TT=1800.08	? (problem) TT=162.158	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.21	? (TO) TT=1800.18	SAT TT=1582.53 CHECKS=2785180000 NODES=3281760	SAT TT=676.028 CHECKS=3008380000 NODES=6609950	? (TO) TT=1800.06	SAT TT=513.531 ASSIGNMENTS=1487580 CHECKS=186631000	SAT TT=781.989 ASSIGNMENTS=1487580 CHECKS=186631000	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=308.316 CHECKS=81926400	SAT TT=509.482 ASSIGNMENTS=1493520 CHECKS=187453000	SAT TT=484.025 ASSIGNMENTS=1486420 CHECKS=186770000	? (MO) TT=42.83	SAT TT=520.44 ASSIGNMENTS=1493730 CHECKS=187439000	SAT TT=505.038 ASSIGNMENTS=1487580 CHECKS=186631000	? (TO) TT=1800.24	? (TO) TT=1800.07	? (MO) TT=12.94	? (MO) TT=13.901
csp/dag-half/ normalized-half-n25-d5-e56-r7-12.xml	SAT TT=75.674	? (TO) TT=1800.1	? (TO) TT=1800.17	? (problem) TT=167.205	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.49	? (TO) TT=1800.02	SAT TT=371.047 CHECKS=1538590000 NODES=3347100	? (TO) TT=1800.01	SAT TT=91.848 ASSIGNMENTS=245954 CHECKS=30807900	SAT TT=378.19 ASSIGNMENTS=245954 CHECKS=30807900	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=124.697 CHECKS=34281000	SAT TT=83.672 ASSIGNMENTS=248086 CHECKS=31128400	SAT TT=107.342 ASSIGNMENTS=337027 CHECKS=42427400	? (MO) TT=45.71	SAT TT=239.786 ASSIGNMENTS=774673 CHECKS=97773500	SAT TT=75.674 ASSIGNMENTS=245954 CHECKS=30807900	? (TO) TT=1800.22	? (TO) TT=1800.11	? (MO) TT=13.861	? (MO) TT=13.659
csp/dag-half/ normalized-half-n25-d5-e56-r7-13.xml	SAT TT=728.091	? (TO) TT=1800.16	? (TO) TT=1800.18	? (problem) TT=153.185	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.21	? (TO) TT=1800.01	SAT TT=728.091 CHECKS=3214990000 NODES=7037520	? (TO) TT=1800.04	SAT TT=929.588 ASSIGNMENTS=2585780 CHECKS=324727000	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=729.686 CHECKS=207623000	SAT TT=837.047 ASSIGNMENTS=2595970 CHECKS=326054000	SAT TT=845.154 ASSIGNMENTS=2487240 CHECKS=312766000	? (MO) TT=48.69	SAT TT=848.883 ASSIGNMENTS=2490630 CHECKS=313309000	SAT TT=858.97 ASSIGNMENTS=2585780 CHECKS=324727000	? (TO) TT=1800.11	? (TO) TT=1800.03	? (MO) TT=14.54	? (MO) TT=13.679
csp/dag-half/ normalized-half-n25-d5-e56-r7-16.xml	SAT TT=98.032	SAT TT=1125.88 CHECKS=2742230 NODES=213114	SAT TT=1595.18 CHECKS=3878370 NODES=294866	? (problem) TT=150.389	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=480.028 ASSIGNMENTS=1365190 CHECKS=165398000	SAT TT=740.208 ASSIGNMENTS=1365190 CHECKS=165398000	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=98.032 CHECKS=25152800	SAT TT=438.337 ASSIGNMENTS=1400520 CHECKS=169671000	SAT TT=336.319 ASSIGNMENTS=1032600 CHECKS=123553000	? (MO) TT=49.26	SAT TT=316.721 ASSIGNMENTS=939626 CHECKS=113901000	SAT TT=443.519 ASSIGNMENTS=1365190 CHECKS=165398000	? (TO) TT=1800.18	SAT TT=1043.04 ASSIGNMENTS=334688 CHECKS=170989000	? (MO) TT=12.979	? (MO) TT=14.83
csp/dag-half/ normalized-half-n25-d5-e56-r7-17.xml	SAT TT=40.662	? (TO) TT=1800.13	? (TO) TT=1800.16	? (problem) TT=164.588	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.21	? (TO) TT=1800.12	SAT TT=806.289 CHECKS=1220860000 NODES=1572910	SAT TT=965.371 CHECKS=4392430000 NODES=9746820	? (TO) TT=1800.04	SAT TT=210.071 ASSIGNMENTS=668650 CHECKS=81029900	SAT TT=503.902 ASSIGNMENTS=668650 CHECKS=81029900	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=495.351 CHECKS=148480000	SAT TT=214.568 ASSIGNMENTS=674529 CHECKS=81883600	SAT TT=35.315 ASSIGNMENTS=95803 CHECKS=11482000	? (MO) TT=45.87	SAT TT=40.662 ASSIGNMENTS=111780 CHECKS=13725100	SAT TT=211.764 ASSIGNMENTS=668650 CHECKS=81029900	? (TO) TT=1800.16	SAT TT=539.288 ASSIGNMENTS=178568 CHECKS=94965000	? (MO) TT=13.88	? (MO) TT=12.87
csp/dag-half/ normalized-half-n25-d5-e56-r7-1.xml	SAT TT=40.572	? (TO) TT=1800.14	? (TO) TT=1800.16	? (problem) TT=167.782	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.16	SAT TT=338.648 CHECKS=498633000 NODES=608460	SAT TT=126.456 CHECKS=447761000 NODES=988037	? (TO) TT=1800.01	SAT TT=55.235 ASSIGNMENTS=117290 CHECKS=14562500	SAT TT=346.12 ASSIGNMENTS=117290 CHECKS=14562500	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=91.178 CHECKS=24388400	SAT TT=40.572 ASSIGNMENTS=119570 CHECKS=14862700	SAT TT=110.799 ASSIGNMENTS=324908 CHECKS=39793400	? (MO) TT=46.59	SAT TT=215.803 ASSIGNMENTS=649684 CHECKS=78876200	SAT TT=42.893 ASSIGNMENTS=117290 CHECKS=14562500	? (TO) TT=1800.2	? (TO) TT=1800.07	? (MO) TT=13.73	? (MO) TT=14.86
csp/dag-half/ normalized-half-n25-d5-e56-r7-21.xml	SAT TT=532.791	? (TO) TT=1800.17	? (TO) TT=1800.14	? (problem) TT=164.338	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=532.791 CHECKS=153461000	? (TO) TT=1800.05	? (TO) TT=1800.05	? (MO) TT=48.32	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.22	? (TO) TT=1800.08	? (MO) TT=12.86	? (MO) TT=13.893
csp/dag-half/ normalized-half-n25-d5-e56-r7-24.xml	SAT TT=149.569	SAT TT=864.025 CHECKS=6857370 NODES=479120	SAT TT=870.579 CHECKS=6642060 NODES=463249	? (problem) TT=164.349	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.2	? (TO) TT=1800.19	? (TO) TT=1800.02	SAT TT=173.449 CHECKS=668821000 NODES=1465980	? (TO) TT=1800.01	SAT TT=310.33 ASSIGNMENTS=995888 CHECKS=123714000	SAT TT=624.338 ASSIGNMENTS=995888 CHECKS=123714000	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=398.592 CHECKS=128278000	SAT TT=301.341 ASSIGNMENTS=940269 CHECKS=116803000	SAT TT=118.905 ASSIGNMENTS=362312 CHECKS=44125800	? (MO) TT=48.92	SAT TT=149.569 ASSIGNMENTS=454518 CHECKS=56459400	SAT TT=319.349 ASSIGNMENTS=995888 CHECKS=123714000	? (TO) TT=1800.16	? (TO) TT=1800.06	? (MO) TT=13.87	? (MO) TT=14.74
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/dag-half/ normalized-half-n25-d5-e56-r7-25.xml	SAT TT=91.25	? (TO) TT=1800.14	? (TO) TT=1800.12	? (problem) TT=168.468	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.18	? (TO) TT=1800.09	SAT TT=324.933 CHECKS=1313900000 NODES=2897410	? (TO) TT=1800.01	SAT TT=391.368 ASSIGNMENTS=1258110 CHECKS=150317000	SAT TT=703.673 ASSIGNMENTS=1258110 CHECKS=150317000	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=91.25 CHECKS=24102800	SAT TT=391.885 ASSIGNMENTS=1263600 CHECKS=150946000	SAT TT=67.162 ASSIGNMENTS=208507 CHECKS=24540600	? (MO) TT=46.7	SAT TT=386.507 ASSIGNMENTS=1181160 CHECKS=144400000	SAT TT=395.637 ASSIGNMENTS=1258110 CHECKS=150317000	SAT TT=480.212	? (TO) TT=1800.05	? (MO) TT=13.685	? (MO) TT=14.66
csp/dag-half/ normalized-half-n25-d5-e56-r7-2.xml	SAT TT=13.322	? (TO) TT=1800.13	? (TO) TT=1800.16	? (problem) TT=166.396	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.12	SAT TT=1700.02 CHECKS=2699870000 NODES=3259260	SAT TT=243.163 CHECKS=942138000 NODES=2071290	? (TO) TT=1800.02	SAT TT=36.611 ASSIGNMENTS=60234 CHECKS=7283950	SAT TT=323.933 ASSIGNMENTS=60234 CHECKS=7283950	SAT TT=868.906	? (TO) TT=1800.05	SAT TT=133.317 CHECKS=37314000	SAT TT=24.809 ASSIGNMENTS=59760 CHECKS=7246990	SAT TT=23.793 ASSIGNMENTS=63491 CHECKS=7515460	? (MO) TT=43.51	SAT TT=13.322 ASSIGNMENTS=25618 CHECKS=3190790	SAT TT=25.007 ASSIGNMENTS=60234 CHECKS=7283950	? (TO) TT=1800.14	? (TO) TT=1800.09	? (MO) TT=13.84	? (MO) TT=13.884
csp/dag-half/ normalized-half-n25-d5-e56-r7-3.xml	SAT TT=21.553	? (TO) TT=1800.12	? (TO) TT=1800.13	? (problem) TT=155.583	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.43	? (TO) TT=1800.17	SAT TT=851.618 CHECKS=1344230000 NODES=1582130	SAT TT=21.553 CHECKS=20907000 NODES=45278	? (TO) TT=1800.09	SAT TT=125.836 ASSIGNMENTS=311651 CHECKS=38911900	SAT TT=414.325 ASSIGNMENTS=311651 CHECKS=38911900	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=308.051 CHECKS=83887100	SAT TT=113.148 ASSIGNMENTS=317479 CHECKS=39682400	SAT TT=37.646 ASSIGNMENTS=96354 CHECKS=11823700	? (MO) TT=46.16	SAT TT=111.296 ASSIGNMENTS=312882 CHECKS=39097100	SAT TT=112.675 ASSIGNMENTS=311651 CHECKS=38911900	? (TO) TT=1800.22	? (TO) TT=1800.05	? (MO) TT=13.78	? (MO) TT=13.898
csp/dag-half/ normalized-half-n25-d5-e56-r7-4.xml	SAT TT=32.435	? (TO) TT=1800.18	? (TO) TT=1800.16	? (problem) TT=165.867	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.19	? (TO) TT=1800	SAT TT=32.435 CHECKS=68955400 NODES=150490	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=671.545 CHECKS=200360000	? (TO) TT=1800.08	? (TO) TT=1800.05	? (MO) TT=45.15	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.18	? (TO) TT=1800.1	? (MO) TT=14.74	? (MO) TT=14.145
csp/dag-half/ normalized-half-n25-d5-e56-r7-5.xml	SAT TT=20.642	? (TO) TT=1800.16	? (TO) TT=1800.17	? (problem) TT=154.276	? (TO) TT=1800.12	? (TO) TT=1800.2	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.03	SAT TT=702.247 CHECKS=2894530000 NODES=6277310	? (TO) TT=1800.06	SAT TT=1607.25 ASSIGNMENTS=4647660 CHECKS=566484000	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=202.792 CHECKS=59796600	SAT TT=1604.78 ASSIGNMENTS=4764390 CHECKS=581201000	SAT TT=1520.69 ASSIGNMENTS=4804690 CHECKS=586695000	? (MO) TT=48.7	SAT TT=20.642 ASSIGNMENTS=47615 CHECKS=5848230	SAT TT=1534.42 ASSIGNMENTS=4647660 CHECKS=566484000	? (TO) TT=1800.18	? (TO) TT=1800.08	? (MO) TT=13.79	? (MO) TT=13.34
csp/dag-half/ normalized-half-n25-d5-e56-r7-7.xml	SAT TT=38.111	? (TO) TT=1800.17	? (TO) TT=1800.15	? (problem) TT=165.277	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.21	SAT TT=1220.55 CHECKS=1913640000 NODES=2239300	SAT TT=91.084 CHECKS=298906000 NODES=653865	? (TO) TT=1800.06	SAT TT=52.797 ASSIGNMENTS=105448 CHECKS=13239700	SAT TT=342.595 ASSIGNMENTS=105448 CHECKS=13239700	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=370.15 CHECKS=100969000	SAT TT=38.111 ASSIGNMENTS=105880 CHECKS=13341200	SAT TT=142.834 ASSIGNMENTS=402193 CHECKS=50033200	? (MO) TT=49.51	SAT TT=653.118 ASSIGNMENTS=2027500 CHECKS=253531000	SAT TT=40.529 ASSIGNMENTS=105448 CHECKS=13239700	? (TO) TT=1800.22	? (TO) TT=1800.1	? (MO) TT=12.91	? (MO) TT=14.74
csp/dag-half/ normalized-half-n25-d5-e56-r7-8.xml	SAT TT=22.895	? (TO) TT=1800.2	? (TO) TT=1800.14	? (problem) TT=158.144	? (TO) TT=1800.21	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.19	SAT TT=1119.14 CHECKS=1825350000 NODES=2213770	SAT TT=22.895 CHECKS=25425600 NODES=55535	? (TO) TT=1800.06	SAT TT=60.514 ASSIGNMENTS=136187 CHECKS=16975900	SAT TT=346.682 ASSIGNMENTS=136187 CHECKS=16975900	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=94.212 CHECKS=25235400	SAT TT=45.256 ASSIGNMENTS=137424 CHECKS=17186200	SAT TT=208.007 ASSIGNMENTS=667386 CHECKS=84586800	? (MO) TT=46.41	SAT TT=58.478 ASSIGNMENTS=166061 CHECKS=20684500	SAT TT=47.651 ASSIGNMENTS=136187 CHECKS=16975900	? (TO) TT=1800.15	SAT TT=1131.7 ASSIGNMENTS=373697 CHECKS=187595000	? (MO) TT=13.876	? (MO) TT=13.911
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-11.xml	UNSAT TT=26.248	UNSAT TT=84.097 CHECKS=43072 NODES=35306	UNSAT TT=99.048 CHECKS=91831 NODES=44218	? (problem) TT=291.472	? (TO) TT=1800.21	? (TO) TT=1800.14	? (TO) TT=1800.21	? (TO) TT=1800.18	UNSAT TT=372.16 CHECKS=1090440000 NODES=64596	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=99.476 ASSIGNMENTS=35306 CHECKS=43072	UNSAT TT=104.444 ASSIGNMENTS=35306 CHECKS=43072	? (problem) TT=116.444	? (problem) TT=100.596	UNSAT TT=26.248 CHECKS=440322	? (TO) TT=1800.12	? (TO) TT=1800.16	? (exit code) TT=39.201	? (TO) TT=1800.08	? (TO) TT=1800.13	? TT=150.002	UNSAT TT=80.913 ASSIGNMENTS=113957 CHECKS=9644100	? (MO) TT=24.31	? (MO) TT=25.83
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-12.xml	UNSAT TT=40.991	UNSAT TT=168.954 CHECKS=1939 NODES=44725	UNSAT TT=150.607 CHECKS=7248 NODES=51402	? (problem) TT=314.009	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.28	? (TO) TT=1800.21	UNSAT TT=342.23 CHECKS=1068820000 NODES=67455	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=193.372 ASSIGNMENTS=44725 CHECKS=1939	UNSAT TT=196.009 ASSIGNMENTS=44725 CHECKS=1939	? (problem) TT=114.985	? (problem) TT=108.174	UNSAT TT=40.991 CHECKS=595917	? (TO) TT=1800.16	? (TO) TT=1800.08	? (exit code) TT=43.495	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=140.419	UNSAT TT=72.772 ASSIGNMENTS=141156 CHECKS=9895740	? (MO) TT=24.861	? (MO) TT=23.828
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-13.xml	UNSAT TT=42.289	UNSAT TT=98.188 CHECKS=3035 NODES=52121	UNSAT TT=97.817 CHECKS=3092 NODES=51952	? (problem) TT=314.873	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.23	UNSAT TT=329.211 CHECKS=943073000 NODES=61799	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=111.386 ASSIGNMENTS=52121 CHECKS=3035	UNSAT TT=105.743 ASSIGNMENTS=52121 CHECKS=3035	? (problem) TT=113.4	? (problem) TT=115.568	UNSAT TT=42.289 CHECKS=595170	? (TO) TT=1800.13	? (TO) TT=1800.08	? (exit code) TT=41.299	? (TO) TT=1800.09	? (TO) TT=1800.13	? TT=84.314	UNSAT TT=80.471 ASSIGNMENTS=106634 CHECKS=7878100	? (MO) TT=21.92	? (MO) TT=23.736
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-14.xml	UNSAT TT=40.138	UNSAT TT=142.676 CHECKS=24466 NODES=39065	UNSAT TT=133.081 CHECKS=23902 NODES=39173	? (problem) TT=292.923	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.24	UNSAT TT=377.463 CHECKS=1295460000 NODES=98824	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=140.811 ASSIGNMENTS=39065 CHECKS=24466	UNSAT TT=155.302 ASSIGNMENTS=39065 CHECKS=24466	? (problem) TT=110.735	? (problem) TT=116.889	UNSAT TT=40.138 CHECKS=602486	? (TO) TT=1800.12	? (TO) TT=1800.16	? (exit code) TT=45.386	? (TO) TT=1800.16	? (TO) TT=1800.11	? TT=164.268	UNSAT TT=55.471 ASSIGNMENTS=136554 CHECKS=5550630	? (MO) TT=23.392	? (MO) TT=23.49
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-15.xml	UNSAT TT=32.026	UNSAT TT=187.075 CHECKS=14847 NODES=37943	UNSAT TT=189.538 CHECKS=14853 NODES=38039	? (problem) TT=314.616	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.17	UNSAT TT=271.456 CHECKS=755958000 NODES=48617	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=214.958 ASSIGNMENTS=37943 CHECKS=14847	UNSAT TT=220.46 ASSIGNMENTS=37943 CHECKS=14847	? (problem) TT=105.065	? (problem) TT=114.16	UNSAT TT=32.026 CHECKS=458932	? (TO) TT=1800.08	? (TO) TT=1800.09	? (exit code) TT=43.744	? (TO) TT=1800.08	? (TO) TT=1800.13	? TT=141.129	UNSAT TT=73.836 ASSIGNMENTS=96898 CHECKS=7291470	? (MO) TT=24.746	? (MO) TT=23.77
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-17.xml	UNSAT TT=36.904	UNSAT TT=159.117 CHECKS=525 NODES=65819	UNSAT TT=134.654 CHECKS=464 NODES=65328	? (problem) TT=315.635	? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.2	UNSAT TT=276.685 CHECKS=752824000 NODES=61313	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=157.531 ASSIGNMENTS=65819 CHECKS=525	UNSAT TT=170.128 ASSIGNMENTS=65819 CHECKS=525	? (problem) TT=119.791	? (problem) TT=120.89	UNSAT TT=36.904 CHECKS=447780	? (TO) TT=1800.15	? (TO) TT=1800.07	? (exit code) TT=46.763	? (TO) TT=1800.07	? (TO) TT=1800.11	? TT=146.021	UNSAT TT=87.69 ASSIGNMENTS=96119 CHECKS=11052700	? (MO) TT=25.939	? (MO) TT=27.014
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-19.xml	UNSAT TT=36.565	UNSAT TT=105.387 CHECKS=524 NODES=35244	UNSAT TT=108.507 CHECKS=547 NODES=35109	? (problem) TT=295.752	? (TO) TT=1800.18	? (TO) TT=1800.19	? (TO) TT=1800.22	? (TO) TT=1800.22	UNSAT TT=326.445 CHECKS=1034200000 NODES=61385	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=122.198 ASSIGNMENTS=35244 CHECKS=524	UNSAT TT=110.163 ASSIGNMENTS=35244 CHECKS=524	? (problem) TT=123.65	? (problem) TT=124.006	UNSAT TT=36.565 CHECKS=572657	? (TO) TT=1800.1	? (TO) TT=1800.13	? (exit code) TT=47.85	? (TO) TT=1800.09	? (TO) TT=1800.06	? TT=154.334	UNSAT TT=71.357 ASSIGNMENTS=92625 CHECKS=8583460	? (MO) TT=26.931	? (MO) TT=22.703
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-21.xml	UNSAT TT=43.103	UNSAT TT=164.095 CHECKS=334 NODES=82832	UNSAT TT=154.458 CHECKS=15291 NODES=50521	? (problem) TT=313.317	? (TO) TT=1800.17	? (TO) TT=1800.21	? (TO) TT=1800.24	? (TO) TT=1800.18	UNSAT TT=340.667 CHECKS=938490000 NODES=71885	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=175.041 ASSIGNMENTS=82832 CHECKS=334	UNSAT TT=171.401 ASSIGNMENTS=82832 CHECKS=334	? (problem) TT=116.192	? (problem) TT=100.488	UNSAT TT=43.103 CHECKS=412254	? (TO) TT=1800.08	? (TO) TT=1800.07	? (exit code) TT=38.878	? (TO) TT=1800.14	? (TO) TT=1800.15	? TT=71.575	UNSAT TT=83.86 ASSIGNMENTS=98877 CHECKS=10610800	? (MO) TT=23.33	? (MO) TT=25.782
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-22.xml	UNSAT TT=33.142	UNSAT TT=99.585 CHECKS=21188 NODES=54102	UNSAT TT=111.883 CHECKS=21318 NODES=54089	? (problem) TT=296.923	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.25	? (TO) TT=1800.21	UNSAT TT=257.175 CHECKS=661532000 NODES=48494	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=110.938 ASSIGNMENTS=54102 CHECKS=21188	UNSAT TT=114.369 ASSIGNMENTS=54102 CHECKS=21188	? (problem) TT=112.427	? (problem) TT=110.798	UNSAT TT=33.142 CHECKS=396876	? (TO) TT=1800.13	? (TO) TT=1800.09	? (exit code) TT=46.648	? (TO) TT=1800.11	? (TO) TT=1800.11	? TT=151.591	UNSAT TT=63.67 ASSIGNMENTS=93084 CHECKS=8020060	? (MO) TT=27.71	? (MO) TT=21.808
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-25.xml	UNSAT TT=30.962	UNSAT TT=174.968 CHECKS=743 NODES=51744	UNSAT TT=170.964 CHECKS=2752 NODES=38066	? (problem) TT=295.8	? (TO) TT=1800.21	? (TO) TT=1800.18	? (TO) TT=1800.26	? (TO) TT=1800.17	UNSAT TT=258.619 CHECKS=680658000 NODES=42210	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=186.189 ASSIGNMENTS=51744 CHECKS=743	UNSAT TT=191.05 ASSIGNMENTS=51744 CHECKS=743	? (problem) TT=122.852	? (problem) TT=123.578	UNSAT TT=30.962 CHECKS=375539	? (TO) TT=1800.12	? (TO) TT=1800.1	? (exit code) TT=40.223	? (TO) TT=1800.08	? (TO) TT=1800.15	? TT=143.664	UNSAT TT=68.329 ASSIGNMENTS=88677 CHECKS=9643050	? (MO) TT=25.855	? (MO) TT=26.938
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-3.xml	UNSAT TT=34.77	UNSAT TT=145.116 CHECKS=7730 NODES=42442	UNSAT TT=243.391 CHECKS=1771 NODES=64539	? (problem) TT=309.471	? (TO) TT=1800.17	? (TO) TT=1800.02	? (TO) TT=1800.25	? (TO) TT=1801.01	UNSAT TT=447.26 CHECKS=1453470000 NODES=91478	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=161.713 ASSIGNMENTS=42442 CHECKS=7730	UNSAT TT=159.339 ASSIGNMENTS=42442 CHECKS=7730	? (problem) TT=113.395	? (problem) TT=107.255	UNSAT TT=34.77 CHECKS=491762	? (TO) TT=1800.1	? (TO) TT=1800.06	? (exit code) TT=45.697	? (TO) TT=1800.12	? (TO) TT=1800.16	? TT=148.956	UNSAT TT=104.672 ASSIGNMENTS=146016 CHECKS=19048600	? (MO) TT=26.71	? (MO) TT=26.69
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-5.xml	UNSAT TT=41.771	UNSAT TT=140.941 CHECKS=7386 NODES=42965	UNSAT TT=124.656 CHECKS=9076 NODES=49567	? (problem) TT=318.34	? (TO) TT=1800.21	? (TO) TT=1800.17	? (TO) TT=1800.27	? (TO) TT=1800.19	UNSAT TT=346.724 CHECKS=1039470000 NODES=65873	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=148.858 ASSIGNMENTS=42965 CHECKS=7386	UNSAT TT=152.611 ASSIGNMENTS=42965 CHECKS=7386	? (problem) TT=105.114	? (problem) TT=117.179	UNSAT TT=41.771 CHECKS=440207	? (TO) TT=1800.11	? (TO) TT=1800.07	? (exit code) TT=48.074	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=113.475	UNSAT TT=101.267 ASSIGNMENTS=99292 CHECKS=15823800	? (MO) TT=21.654	? (MO) TT=25.825
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-6.xml	UNSAT TT=43.342	UNSAT TT=163.938 CHECKS=4563 NODES=44412	UNSAT TT=139.875 CHECKS=1811 NODES=44103	? (problem) TT=293.97	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.26	UNSAT TT=381.615 CHECKS=1148620000 NODES=64665	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=173.683 ASSIGNMENTS=44412 CHECKS=4563	UNSAT TT=178.124 ASSIGNMENTS=44412 CHECKS=4563	? (problem) TT=107.012	? (problem) TT=116.452	UNSAT TT=43.342 CHECKS=571807	? (TO) TT=1800.07	? (TO) TT=1800.15	? (exit code) TT=45.312	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=142.929	UNSAT TT=87.611 ASSIGNMENTS=124538 CHECKS=11166200	? (MO) TT=21.96	? (MO) TT=25.43
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-7.xml	UNSAT TT=36.219	UNSAT TT=75.778 CHECKS=1638 NODES=42749	UNSAT TT=82.4 CHECKS=1072 NODES=42741	? (problem) TT=298.247	? (TO) TT=1800.18	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.2	UNSAT TT=242.082 CHECKS=681372000 NODES=48488	? (TO) TT=1800	? (TO) TT=1800	UNSAT TT=89.998 ASSIGNMENTS=42749 CHECKS=1638	UNSAT TT=90.669 ASSIGNMENTS=42749 CHECKS=1638	? (problem) TT=110.354	? (problem) TT=116.81	UNSAT TT=36.219 CHECKS=446156	? (TO) TT=1800.1	? (TO) TT=1800.12	? (exit code) TT=47.56	? (TO) TT=1800.09	? (TO) TT=1800.12	? TT=153.632	UNSAT TT=102.179 ASSIGNMENTS=95555 CHECKS=14460300	? (MO) TT=27.05	? (MO) TT=21.784
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-9.xml	UNSAT TT=33.623	UNSAT TT=182.033 CHECKS=19851 NODES=54803	UNSAT TT=180.858 CHECKS=4973 NODES=66193	? (problem) TT=292.156	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.19	UNSAT TT=297.49 CHECKS=794206000 NODES=48260	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=181.054 ASSIGNMENTS=54803 CHECKS=19851	UNSAT TT=195.753 ASSIGNMENTS=54803 CHECKS=19851	? (problem) TT=102.21	? (problem) TT=98.322	UNSAT TT=33.623 CHECKS=463124	? (TO) TT=1800.06	? (TO) TT=1800.05	? (exit code) TT=45.493	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=125.187	UNSAT TT=115.401 ASSIGNMENTS=124609 CHECKS=18470600	? (MO) TT=23.675	? (MO) TT=23.31
csp/dubois/ normalized-dubois-100_ext.xml	UNSAT TT=0.817	? (TO) TT=1800.25	? (TO) TT=1800.26	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.894	UNSAT TT=1.244	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=3.038	? (TO) TT=1800.04	UNSAT TT=0.835	UNSAT TT=0.817
csp/dubois/ normalized-dubois-20_ext.xml	UNSAT TT=0.537	UNSAT TT=1.492 CHECKS=79754 NODES=14777	UNSAT TT=2.53 CHECKS=223066 NODES=41135	UNSAT TT=8.116	UNSAT TT=111.592 CHECKS=82774500	UNSAT TT=123.134 CHECKS=77412600	UNSAT TT=119.071 ASSIGNMENTS=2060720	UNSAT TT=118.771 ASSIGNMENTS=2097150	UNSAT TT=126.312 CHECKS=82378100 NODES=4810800	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=13.504 ASSIGNMENTS=162181 CHECKS=910479	UNSAT TT=14.149 ASSIGNMENTS=162181 CHECKS=910479	UNSAT TT=0.769	UNSAT TT=0.628	UNSAT TT=6.55 CHECKS=6479290	UNSAT TT=9.845 ASSIGNMENTS=1687500 CHECKS=18413100	UNSAT TT=13.741 ASSIGNMENTS=2366460 CHECKS=25865200	UNSAT TT=19.749	UNSAT TT=14.551 ASSIGNMENTS=2371060 CHECKS=26616600	UNSAT TT=8.887 ASSIGNMENTS=1522830 CHECKS=16528500	UNSAT TT=1.212	UNSAT TT=79.105 ASSIGNMENTS=10581800 CHECKS=31649500	UNSAT TT=0.543	UNSAT TT=0.537
csp/dubois/ normalized-dubois-21_ext.xml	UNSAT TT=0.531	UNSAT TT=1.316 CHECKS=60451 NODES=13835	UNSAT TT=1.874 CHECKS=117352 NODES=27428	UNSAT TT=19.589	UNSAT TT=156.875 CHECKS=93120100	UNSAT TT=177.694 CHECKS=111909000	UNSAT TT=222.003 ASSIGNMENTS=3559610	UNSAT TT=235.596 ASSIGNMENTS=4194300	UNSAT TT=268.599 CHECKS=188953000 NODES=10522000	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=17.976 ASSIGNMENTS=277132 CHECKS=2038860	UNSAT TT=19.524 ASSIGNMENTS=277132 CHECKS=2038860	UNSAT TT=0.645	UNSAT TT=0.6	UNSAT TT=22.512 CHECKS=19603400	UNSAT TT=19.897 ASSIGNMENTS=3678290 CHECKS=40001600	UNSAT TT=28.389 ASSIGNMENTS=4843760 CHECKS=53416300	UNSAT TT=39.743	UNSAT TT=26.107 ASSIGNMENTS=4293310 CHECKS=47921300	UNSAT TT=17.496 ASSIGNMENTS=3069620 CHECKS=32785900	UNSAT TT=1.124	UNSAT TT=162.893 ASSIGNMENTS=21207200 CHECKS=63164400	UNSAT TT=0.534	UNSAT TT=0.531
csp/dubois/ normalized-dubois-22_ext.xml	UNSAT TT=0.582	UNSAT TT=14.903 CHECKS=2783970 NODES=330521	UNSAT TT=0.925 CHECKS=8758 NODES=3461	UNSAT TT=34.553	UNSAT TT=288.754 CHECKS=162424000	UNSAT TT=282.141 CHECKS=152813000	UNSAT TT=414.813 ASSIGNMENTS=7209780	UNSAT TT=473.178 ASSIGNMENTS=8388610	UNSAT TT=601.854 CHECKS=415573000 NODES=23024300	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=62.481 ASSIGNMENTS=1317360 CHECKS=10745900	UNSAT TT=62.717 ASSIGNMENTS=1317360 CHECKS=10745900	UNSAT TT=0.891	UNSAT TT=0.885	UNSAT TT=28.039 CHECKS=25835400	UNSAT TT=38.934 ASSIGNMENTS=7188430 CHECKS=78642900	UNSAT TT=50.238 ASSIGNMENTS=9240150 CHECKS=102130000	UNSAT TT=77.315	UNSAT TT=61.601 ASSIGNMENTS=9346540 CHECKS=105158000	UNSAT TT=33.821 ASSIGNMENTS=6198340 CHECKS=67915800	UNSAT TT=1.259	UNSAT TT=340.086 ASSIGNMENTS=42675800 CHECKS=127191000	UNSAT TT=0.583	UNSAT TT=0.582
csp/dubois/ normalized-dubois-23_ext.xml	UNSAT TT=0.54	UNSAT TT=1.417 CHECKS=76323 NODES=14859	UNSAT TT=1.284 CHECKS=30171 NODES=9037	UNSAT TT=82.833	UNSAT TT=447.724 CHECKS=361665000	UNSAT TT=704.039 CHECKS=367553000	UNSAT TT=863.056 ASSIGNMENTS=14091600	UNSAT TT=893.06 ASSIGNMENTS=16777200	UNSAT TT=1043.03 CHECKS=654953000 NODES=36701800	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=8.708 ASSIGNMENTS=10880 CHECKS=48338	UNSAT TT=8.527 ASSIGNMENTS=10880 CHECKS=48338	UNSAT TT=0.647	UNSAT TT=0.89	UNSAT TT=62.045 CHECKS=52501500	UNSAT TT=77.676 ASSIGNMENTS=14166800 CHECKS=156837000	UNSAT TT=104.352 ASSIGNMENTS=18958200 CHECKS=212296000	UNSAT TT=156.465	UNSAT TT=110.773 ASSIGNMENTS=16352100 CHECKS=188083000	UNSAT TT=65.181 ASSIGNMENTS=12012200 CHECKS=131400000	UNSAT TT=1.242	UNSAT TT=681.621 ASSIGNMENTS=78797800 CHECKS=232927000	UNSAT TT=0.581	UNSAT TT=0.54
csp/dubois/ normalized-dubois-24_ext.xml	UNSAT TT=0.573	UNSAT TT=1.332 CHECKS=58473 NODES=13714	UNSAT TT=3.055 CHECKS=291176 NODES=53290	UNSAT TT=140.76	UNSAT TT=694.658 CHECKS=586994000	UNSAT TT=858.316 CHECKS=429022000	UNSAT TT=1681.43 ASSIGNMENTS=27119900	UNSAT TT=1776.78 ASSIGNMENTS=33554400	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=63.628 ASSIGNMENTS=1057570 CHECKS=9215080	UNSAT TT=64.343 ASSIGNMENTS=1057570 CHECKS=9215080	UNSAT TT=0.652	UNSAT TT=0.784	UNSAT TT=137.664 CHECKS=112819000	UNSAT TT=155.1 ASSIGNMENTS=28205200 CHECKS=312721000	UNSAT TT=215.589 ASSIGNMENTS=37314900 CHECKS=416630000	UNSAT TT=285.283	UNSAT TT=235.43 ASSIGNMENTS=35960500 CHECKS=402743000	UNSAT TT=128.299 ASSIGNMENTS=23587500 CHECKS=259851000	UNSAT TT=1.194	UNSAT TT=1486.23 ASSIGNMENTS=156501000 CHECKS=465824000	UNSAT TT=0.573	UNSAT TT=0.584
csp/dubois/ normalized-dubois-25_ext.xml	UNSAT TT=0.623	UNSAT TT=1.438 CHECKS=73345 NODES=14550	UNSAT TT=1.963 CHECKS=122661 NODES=26950	UNSAT TT=378.723	UNSAT TT=1347.38 CHECKS=1139950000	UNSAT TT=1321.7 CHECKS=1158650000	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=8.828 ASSIGNMENTS=13512 CHECKS=57824	UNSAT TT=8.418 ASSIGNMENTS=13512 CHECKS=57824	UNSAT TT=0.687	UNSAT TT=0.819	UNSAT TT=275.316 CHECKS=225616000	UNSAT TT=335.506 ASSIGNMENTS=56490800 CHECKS=624941000	UNSAT TT=452.698 ASSIGNMENTS=73362700 CHECKS=837196000	UNSAT TT=607.968	UNSAT TT=498.144 ASSIGNMENTS=70776900 CHECKS=826140000	UNSAT TT=280.304 ASSIGNMENTS=48274100 CHECKS=522890000	UNSAT TT=1.218	? (TO) TT=1800.06	UNSAT TT=0.632	UNSAT TT=0.623
csp/dubois/ normalized-dubois-26_ext.xml	UNSAT TT=0.557	UNSAT TT=1.7 CHECKS=92009 NODES=18382	UNSAT TT=5.276 CHECKS=581958 NODES=101262	UNSAT TT=547.605	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=8.772 ASSIGNMENTS=15141 CHECKS=62500	UNSAT TT=8.941 ASSIGNMENTS=15141 CHECKS=62500	UNSAT TT=0.653	UNSAT TT=0.784	UNSAT TT=295.968 CHECKS=251515000	UNSAT TT=604.083 ASSIGNMENTS=109553000 CHECKS=1224880000	UNSAT TT=830.156 ASSIGNMENTS=147259000 CHECKS=1681680000	UNSAT TT=1112.45	UNSAT TT=890.055 ASSIGNMENTS=143617000 CHECKS=1624040000	UNSAT TT=427.332 ASSIGNMENTS=77631500 CHECKS=859176000	UNSAT TT=1.236	? (TO) TT=1800.11	UNSAT TT=0.557	UNSAT TT=0.56
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/dubois/ normalized-dubois-27_ext.xml	UNSAT TT=0.606	UNSAT TT=1.495 CHECKS=76632 NODES=15235	UNSAT TT=252.345 CHECKS=51084500 NODES=4863130	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=64.921 ASSIGNMENTS=1136300 CHECKS=9738060	UNSAT TT=64.296 ASSIGNMENTS=1136300 CHECKS=9738060	UNSAT TT=0.654	UNSAT TT=0.801	UNSAT TT=535.22 CHECKS=414338000	UNSAT TT=1166.52 ASSIGNMENTS=194651000 CHECKS=2198930000	UNSAT TT=1678.28 ASSIGNMENTS=292557000 CHECKS=3379750000	? (TO) TT=1800.1	UNSAT TT=1665.2 ASSIGNMENTS=268163000 CHECKS=3064200000	UNSAT TT=1054.53 ASSIGNMENTS=179924000 CHECKS=1990070000	UNSAT TT=1.217	? (TO) TT=1800.03	UNSAT TT=0.606	UNSAT TT=0.609
csp/dubois/ normalized-dubois-28_ext.xml	UNSAT TT=0.601	UNSAT TT=1.863 CHECKS=98777 NODES=18994	UNSAT TT=5.022 CHECKS=376282 NODES=78755	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=16.25 ASSIGNMENTS=148908 CHECKS=1035260	UNSAT TT=16.321 ASSIGNMENTS=148908 CHECKS=1035260	UNSAT TT=0.658	UNSAT TT=0.659	UNSAT TT=822.714 CHECKS=620715000	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=1.274	? (TO) TT=1800.04	UNSAT TT=0.601	UNSAT TT=0.613
csp/dubois/ normalized-dubois-29_ext.xml	UNSAT TT=0.611	UNSAT TT=72.794 CHECKS=12118900 NODES=1532710	UNSAT TT=1.407 CHECKS=31895 NODES=10170	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=9.07 ASSIGNMENTS=14831 CHECKS=78980	UNSAT TT=9.268 ASSIGNMENTS=14831 CHECKS=78980	UNSAT TT=0.647	UNSAT TT=0.783	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=1.313	? (TO) TT=1800.02	UNSAT TT=0.615	UNSAT TT=0.611
csp/dubois/ normalized-dubois-30_ext.xml	UNSAT TT=0.574	UNSAT TT=11.585 CHECKS=1495870 NODES=229362	UNSAT TT=2.891 CHECKS=215719 NODES=43233	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=12.425 ASSIGNMENTS=85364 CHECKS=495018	UNSAT TT=12.565 ASSIGNMENTS=85364 CHECKS=495018	UNSAT TT=0.779	UNSAT TT=0.812	UNSAT TT=1423.07 CHECKS=1136600000	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=1.272	? (TO) TT=1800.07	UNSAT TT=0.574	UNSAT TT=0.58
csp/dubois/ normalized-dubois-50_ext.xml	UNSAT TT=0.699	? (TO) TT=1800.22	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=0.903	UNSAT TT=0.908	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=1.646	? (TO) TT=1800.03	UNSAT TT=0.758	UNSAT TT=0.699
csp/jnhSat/ normalized-jnh01_ext.xml	SAT TT=0.036	SAT TT=1.322 CHECKS=31091 NODES=1179	SAT TT=1.378 CHECKS=29690 NODES=982	SAT TT=0.193	SAT TT=0.196 CHECKS=102543	SAT TT=0.097 CHECKS=106043	SAT TT=1.118 ASSIGNMENTS=65	SAT TT=1.171 ASSIGNMENTS=105	SAT TT=0.734 CHECKS=21599 NODES=124	SAT TT=1.048 CHECKS=823868 NODES=1873	SAT TT=0.795 CHECKS=363159 NODES=371	SAT TT=0.048 ASSIGNMENTS=81 CHECKS=46280	SAT TT=0.052 ASSIGNMENTS=81 CHECKS=46280	SAT TT=6.039	SAT TT=5.53	SAT TT=0.654 CHECKS=11779	SAT TT=0.04 ASSIGNMENTS=83 CHECKS=49293	SAT TT=0.067 ASSIGNMENTS=507 CHECKS=226031	SAT TT=0.858	SAT TT=0.036 ASSIGNMENTS=117 CHECKS=32014	SAT TT=0.04 ASSIGNMENTS=81 CHECKS=46280	SAT TT=1.813	SAT TT=0.165 ASSIGNMENTS=281 CHECKS=157118	SAT TT=0.988	SAT TT=1.026
csp/jnhSat/ normalized-jnh07_ext.xml	SAT TT=0.035	SAT TT=1.204 CHECKS=6201 NODES=242	SAT TT=1.287 CHECKS=7581 NODES=243	SAT TT=0.221	SAT TT=0.166 CHECKS=98971	SAT TT=0.078 CHECKS=97954	SAT TT=0.957 ASSIGNMENTS=38	SAT TT=0.887 ASSIGNMENTS=13	SAT TT=0.697 CHECKS=11819 NODES=104	SAT TT=0.796 CHECKS=322174 NODES=820	SAT TT=0.692 CHECKS=154124 NODES=186	SAT TT=0.048 ASSIGNMENTS=53 CHECKS=31765	SAT TT=0.047 ASSIGNMENTS=53 CHECKS=31765	SAT TT=4.704	SAT TT=4.941	SAT TT=0.568 CHECKS=20219	SAT TT=0.035 ASSIGNMENTS=55 CHECKS=35403	SAT TT=0.036 ASSIGNMENTS=66 CHECKS=33652	SAT TT=0.81	SAT TT=0.036 ASSIGNMENTS=94 CHECKS=30366	SAT TT=0.036 ASSIGNMENTS=53 CHECKS=31765	SAT TT=1.64	SAT TT=0.255 ASSIGNMENTS=283 CHECKS=154999	SAT TT=0.999	SAT TT=1.006
csp/jnhSat/ normalized-jnh12_ext.xml	SAT TT=0.037	SAT TT=1.071 CHECKS=3023 NODES=128	SAT TT=1.082 CHECKS=4078 NODES=0	SAT TT=0.182	SAT TT=0.094 CHECKS=38091	SAT TT=0.05 CHECKS=27447	SAT TT=0.836 ASSIGNMENTS=6	SAT TT=0.966 ASSIGNMENTS=5	SAT TT=0.75 CHECKS=47304 NODES=140	SAT TT=1.943 CHECKS=2772330 NODES=7325	SAT TT=0.883 CHECKS=238976 NODES=306	SAT TT=0.048 ASSIGNMENTS=53 CHECKS=41867	SAT TT=0.047 ASSIGNMENTS=53 CHECKS=41867	SAT TT=5.296	SAT TT=4.77	SAT TT=0.533 CHECKS=11806	SAT TT=0.037 ASSIGNMENTS=41 CHECKS=43630	SAT TT=0.038 ASSIGNMENTS=70 CHECKS=50059	SAT TT=0.856	SAT TT=0.038 ASSIGNMENTS=66 CHECKS=31983	SAT TT=0.039 ASSIGNMENTS=53 CHECKS=41867	SAT TT=1.639	SAT TT=0.148 ASSIGNMENTS=202 CHECKS=104956	SAT TT=0.999	SAT TT=1.052
csp/jnhSat/ normalized-jnh17_ext.xml	SAT TT=0.033	SAT TT=1.058 CHECKS=3404 NODES=127	SAT TT=1.115 CHECKS=5121 NODES=139	SAT TT=0.199	SAT TT=0.184 CHECKS=100448	SAT TT=0.084 CHECKS=94569	SAT TT=1.094 ASSIGNMENTS=53	SAT TT=0.878 ASSIGNMENTS=10	SAT TT=0.862 CHECKS=99110 NODES=188	SAT TT=0.782 CHECKS=276778 NODES=711	SAT TT=0.703 CHECKS=138293 NODES=170	SAT TT=0.047 ASSIGNMENTS=42 CHECKS=30167	SAT TT=0.048 ASSIGNMENTS=42 CHECKS=30167	SAT TT=4.727	SAT TT=4.712	SAT TT=0.493 CHECKS=13047	SAT TT=0.042 ASSIGNMENTS=87 CHECKS=67602	SAT TT=0.084 ASSIGNMENTS=587 CHECKS=332863	SAT TT=0.826	SAT TT=0.033 ASSIGNMENTS=87 CHECKS=24537	SAT TT=0.035 ASSIGNMENTS=42 CHECKS=30167	SAT TT=1.626	SAT TT=0.214 ASSIGNMENTS=168 CHECKS=96858	SAT TT=0.997	SAT TT=1.039
csp/jnhSat/ normalized-jnh201_ext.xml	SAT TT=0.031	SAT TT=1.078 CHECKS=4697 NODES=216	SAT TT=1.123 CHECKS=5804 NODES=213	SAT TT=0.165	SAT TT=0.099 CHECKS=39897	SAT TT=0.054 CHECKS=25808	SAT TT=0.889 ASSIGNMENTS=31	SAT TT=0.884 ASSIGNMENTS=29	SAT TT=0.734 CHECKS=28550 NODES=142	SAT TT=0.685 CHECKS=30142 NODES=36	SAT TT=0.669 CHECKS=73505 NODES=61	SAT TT=0.045 ASSIGNMENTS=33 CHECKS=7600	SAT TT=0.045 ASSIGNMENTS=33 CHECKS=7600	SAT TT=6.197	SAT TT=5.424	SAT TT=0.617 CHECKS=14562	SAT TT=0.031 ASSIGNMENTS=37 CHECKS=8277	SAT TT=0.043 ASSIGNMENTS=228 CHECKS=72565	SAT TT=0.772	SAT TT=0.033 ASSIGNMENTS=64 CHECKS=13681	SAT TT=0.034 ASSIGNMENTS=33 CHECKS=7600	SAT TT=1.652	SAT TT=0.089 ASSIGNMENTS=122 CHECKS=48560	SAT TT=0.999	SAT TT=0.979
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhSat/ normalized-jnh204_ext.xml	SAT TT=0.05	SAT TT=1.215 CHECKS=19669 NODES=615	SAT TT=1.249 CHECKS=31825 NODES=577	SAT TT=1.193	SAT TT=0.268 CHECKS=141464	SAT TT=0.215 CHECKS=293895	SAT TT=2.055 ASSIGNMENTS=393	SAT TT=1.75 ASSIGNMENTS=276	SAT TT=1.55 CHECKS=464657 NODES=531	SAT TT=1.13 CHECKS=1155770 NODES=3180	SAT TT=1.445 CHECKS=3152710 NODES=3251	SAT TT=0.062 ASSIGNMENTS=232 CHECKS=154994	SAT TT=0.061 ASSIGNMENTS=232 CHECKS=154994	SAT TT=7.23	SAT TT=7.135	SAT TT=0.624 CHECKS=149060	SAT TT=0.066 ASSIGNMENTS=404 CHECKS=265618	SAT TT=0.316 ASSIGNMENTS=4210 CHECKS=1979940	SAT TT=1.172	SAT TT=0.099 ASSIGNMENTS=803 CHECKS=510988	SAT TT=0.05 ASSIGNMENTS=232 CHECKS=154994	SAT TT=1.788	SAT TT=0.27 ASSIGNMENTS=479 CHECKS=232358	SAT TT=0.986	SAT TT=1.173
csp/jnhSat/ normalized-jnh205_ext.xml	SAT TT=0.036	SAT TT=1.133 CHECKS=10024 NODES=352	SAT TT=1.2 CHECKS=14050 NODES=453	SAT TT=0.178	SAT TT=0.139 CHECKS=64434	SAT TT=0.069 CHECKS=51963	SAT TT=1.18 ASSIGNMENTS=74	SAT TT=1.251 ASSIGNMENTS=79	SAT TT=0.785 CHECKS=61736 NODES=169	SAT TT=0.772 CHECKS=340175 NODES=907	SAT TT=0.902 CHECKS=835144 NODES=1073	SAT TT=0.05 ASSIGNMENTS=73 CHECKS=61932	SAT TT=0.049 ASSIGNMENTS=73 CHECKS=61932	SAT TT=4.648	SAT TT=4.731	SAT TT=0.496 CHECKS=24433	SAT TT=0.036 ASSIGNMENTS=53 CHECKS=37981	SAT TT=0.117 ASSIGNMENTS=1175 CHECKS=590693	SAT TT=1.006	SAT TT=0.036 ASSIGNMENTS=109 CHECKS=48990	SAT TT=0.037 ASSIGNMENTS=73 CHECKS=61932	SAT TT=1.696	SAT TT=0.255 ASSIGNMENTS=314 CHECKS=192645	SAT TT=1.008	SAT TT=0.989
csp/jnhSat/ normalized-jnh207_ext.xml	SAT TT=0.04	SAT TT=1.336 CHECKS=52756 NODES=1139	SAT TT=1.003 CHECKS=1942 NODES=0	SAT TT=0.598	SAT TT=0.248 CHECKS=134296	SAT TT=0.147 CHECKS=198074	SAT TT=1.341 ASSIGNMENTS=123	SAT TT=1.477 ASSIGNMENTS=160	SAT TT=0.644 CHECKS=8724 NODES=100	SAT TT=1.44 CHECKS=1927310 NODES=5219	SAT TT=0.692 CHECKS=215288 NODES=250	SAT TT=0.051 ASSIGNMENTS=103 CHECKS=81780	SAT TT=0.054 ASSIGNMENTS=103 CHECKS=81780	SAT TT=4.719	SAT TT=4.675	SAT TT=0.515 CHECKS=38303	SAT TT=0.044 ASSIGNMENTS=146 CHECKS=123564	SAT TT=0.033 ASSIGNMENTS=50 CHECKS=21688	SAT TT=0.874	SAT TT=0.043 ASSIGNMENTS=183 CHECKS=85892	SAT TT=0.04 ASSIGNMENTS=103 CHECKS=81780	SAT TT=1.849	SAT TT=0.287 ASSIGNMENTS=519 CHECKS=288426	SAT TT=0.995	SAT TT=0.996
csp/jnhSat/ normalized-jnh209_ext.xml	SAT TT=0.032	SAT TT=1.419 CHECKS=28061 NODES=880	SAT TT=1.235 CHECKS=21828 NODES=620	SAT TT=0.192	SAT TT=0.153 CHECKS=71112	SAT TT=0.093 CHECKS=93233	SAT TT=1.062 ASSIGNMENTS=87	SAT TT=1.281 ASSIGNMENTS=155	SAT TT=0.746 CHECKS=48676 NODES=159	SAT TT=1.951 CHECKS=3149640 NODES=8716	SAT TT=0.772 CHECKS=367844 NODES=536	SAT TT=0.047 ASSIGNMENTS=101 CHECKS=55036	SAT TT=0.053 ASSIGNMENTS=101 CHECKS=55036	SAT TT=4.482	SAT TT=4.543	SAT TT=0.518 CHECKS=40046	SAT TT=0.037 ASSIGNMENTS=97 CHECKS=52339	SAT TT=0.065 ASSIGNMENTS=582 CHECKS=248614	SAT TT=0.757	SAT TT=0.032 ASSIGNMENTS=118 CHECKS=28410	SAT TT=0.038 ASSIGNMENTS=101 CHECKS=55036	SAT TT=1.82	SAT TT=0.478 ASSIGNMENTS=845 CHECKS=508130	SAT TT=0.99	SAT TT=1.026
csp/jnhSat/ normalized-jnh210_ext.xml	SAT TT=0.034	SAT TT=1.862 CHECKS=5052 NODES=219	SAT TT=1.116 CHECKS=7633 NODES=249	SAT TT=0.245	SAT TT=0.163 CHECKS=95758	SAT TT=0.075 CHECKS=60919	SAT TT=1.051 ASSIGNMENTS=69	SAT TT=0.858 ASSIGNMENTS=19	SAT TT=0.647 CHECKS=12234 NODES=105	SAT TT=0.693 CHECKS=73642 NODES=171	SAT TT=0.695 CHECKS=223041 NODES=283	SAT TT=0.046 ASSIGNMENTS=65 CHECKS=44178	SAT TT=0.046 ASSIGNMENTS=65 CHECKS=44178	SAT TT=4.556	SAT TT=4.529	SAT TT=0.554 CHECKS=23691	SAT TT=0.036 ASSIGNMENTS=102 CHECKS=58413	SAT TT=0.072 ASSIGNMENTS=614 CHECKS=285558	SAT TT=0.863	SAT TT=0.039 ASSIGNMENTS=127 CHECKS=63899	SAT TT=0.034 ASSIGNMENTS=65 CHECKS=44178	SAT TT=1.615	SAT TT=0.489 ASSIGNMENTS=718 CHECKS=438284	SAT TT=1.03	SAT TT=0.998
csp/jnhSat/ normalized-jnh212_ext.xml	SAT TT=0.055	SAT TT=1.451 CHECKS=50680 NODES=1618	SAT TT=1.598 CHECKS=64441 NODES=1891	SAT TT=5.13	SAT TT=1.112 CHECKS=652227	SAT TT=0.216 CHECKS=284458	SAT TT=2.493 ASSIGNMENTS=450	SAT TT=1.616 ASSIGNMENTS=213	SAT TT=1.126 CHECKS=256839 NODES=321	SAT TT=38.473 CHECKS=89750300 NODES=245335	SAT TT=13.966 CHECKS=59558500 NODES=39669	SAT TT=0.079 ASSIGNMENTS=355 CHECKS=282433	SAT TT=0.083 ASSIGNMENTS=355 CHECKS=282433	SAT TT=4.646	SAT TT=5.357	SAT TT=0.542 CHECKS=73890	SAT TT=0.069 ASSIGNMENTS=386 CHECKS=306256	SAT TT=0.308 ASSIGNMENTS=4364 CHECKS=1950750	SAT TT=1.421	SAT TT=0.055 ASSIGNMENTS=344 CHECKS=199933	SAT TT=0.068 ASSIGNMENTS=355 CHECKS=282433	SAT TT=1.811	SAT TT=1.058 ASSIGNMENTS=1888 CHECKS=1185840	SAT TT=1.014	SAT TT=1.019
csp/jnhSat/ normalized-jnh213_ext.xml	SAT TT=0.033	SAT TT=1.053 CHECKS=1862 NODES=101	SAT TT=1.06 CHECKS=3593 NODES=101	SAT TT=0.165	SAT TT=0.176 CHECKS=107309	SAT TT=0.082 CHECKS=111940	SAT TT=0.995 ASSIGNMENTS=22	SAT TT=0.999 ASSIGNMENTS=15	SAT TT=0.682 CHECKS=21388 NODES=115	SAT TT=0.75 CHECKS=174201 NODES=475	SAT TT=0.857 CHECKS=688716 NODES=949	SAT TT=0.043 ASSIGNMENTS=42 CHECKS=22009	SAT TT=0.043 ASSIGNMENTS=42 CHECKS=22009	SAT TT=4.703	SAT TT=4.598	SAT TT=0.484 CHECKS=14725	SAT TT=0.034 ASSIGNMENTS=25 CHECKS=18408	SAT TT=0.035 ASSIGNMENTS=104 CHECKS=34754	SAT TT=0.809	SAT TT=0.034 ASSIGNMENTS=59 CHECKS=27530	SAT TT=0.033 ASSIGNMENTS=42 CHECKS=22009	SAT TT=1.621	SAT TT=0.146 ASSIGNMENTS=326 CHECKS=140979	SAT TT=1	SAT TT=1.004
csp/jnhSat/ normalized-jnh217_ext.xml	SAT TT=0.034	SAT TT=1.092 CHECKS=8047 NODES=164	SAT TT=1.102 CHECKS=8276 NODES=158	SAT TT=0.263	SAT TT=0.101 CHECKS=36168	SAT TT=0.06 CHECKS=35572	SAT TT=0.919 ASSIGNMENTS=59	SAT TT=0.948 ASSIGNMENTS=67	SAT TT=1.164 CHECKS=243803 NODES=381	SAT TT=0.742 CHECKS=180335 NODES=435	SAT TT=0.789 CHECKS=327359 NODES=387	SAT TT=0.043 ASSIGNMENTS=58 CHECKS=30004	SAT TT=0.044 ASSIGNMENTS=58 CHECKS=30004	SAT TT=4.576	SAT TT=4.58	SAT TT=0.495 CHECKS=15757	SAT TT=0.044 ASSIGNMENTS=59 CHECKS=27360	SAT TT=0.078 ASSIGNMENTS=750 CHECKS=328477	SAT TT=0.748	SAT TT=0.044 ASSIGNMENTS=234 CHECKS=94066	SAT TT=0.034 ASSIGNMENTS=58 CHECKS=30004	SAT TT=1.624	SAT TT=0.123 ASSIGNMENTS=212 CHECKS=72579	SAT TT=1.01	SAT TT=0.984
csp/jnhSat/ normalized-jnh218_ext.xml	SAT TT=0.035	SAT TT=1.055 CHECKS=3122 NODES=133	SAT TT=1.1 CHECKS=5597 NODES=146	SAT TT=0.206	SAT TT=0.151 CHECKS=82239	SAT TT=0.074 CHECKS=74399	SAT TT=1.071 ASSIGNMENTS=69	SAT TT=0.842 ASSIGNMENTS=18	SAT TT=0.692 CHECKS=27465 NODES=123	SAT TT=0.685 CHECKS=131146 NODES=326	SAT TT=0.752 CHECKS=320978 NODES=369	SAT TT=0.046 ASSIGNMENTS=57 CHECKS=37918	SAT TT=0.045 ASSIGNMENTS=57 CHECKS=37918	SAT TT=4.66	SAT TT=4.753	SAT TT=0.5 CHECKS=19497	SAT TT=0.041 ASSIGNMENTS=101 CHECKS=69174	SAT TT=0.041 ASSIGNMENTS=138 CHECKS=71383	SAT TT=0.789	SAT TT=0.035 ASSIGNMENTS=104 CHECKS=36793	SAT TT=0.036 ASSIGNMENTS=57 CHECKS=37918	SAT TT=1.657	SAT TT=0.138 ASSIGNMENTS=261 CHECKS=124379	SAT TT=1.017	SAT TT=0.991
csp/jnhSat/ normalized-jnh220_ext.xml	SAT TT=0.036	SAT TT=1.272 CHECKS=23795 NODES=692	SAT TT=1.489 CHECKS=35268 NODES=1081	SAT TT=0.182	SAT TT=0.145 CHECKS=63624	SAT TT=0.073 CHECKS=62733	SAT TT=1.029 ASSIGNMENTS=69	SAT TT=1.432 ASSIGNMENTS=159	SAT TT=0.748 CHECKS=53790 NODES=155	SAT TT=0.758 CHECKS=299134 NODES=778	SAT TT=1.021 CHECKS=1346650 NODES=1655	SAT TT=0.05 ASSIGNMENTS=90 CHECKS=61962	SAT TT=0.05 ASSIGNMENTS=90 CHECKS=61962	SAT TT=4.716	SAT TT=4.55	SAT TT=1.094 CHECKS=66435	SAT TT=0.036 ASSIGNMENTS=69 CHECKS=48711	SAT TT=0.149 ASSIGNMENTS=1627 CHECKS=768327	SAT TT=0.721	SAT TT=0.039 ASSIGNMENTS=146 CHECKS=48785	SAT TT=0.038 ASSIGNMENTS=90 CHECKS=61962	SAT TT=1.978	SAT TT=0.184 ASSIGNMENTS=361 CHECKS=253075	SAT TT=0.987	SAT TT=0.994
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhSat/ normalized-jnh301_ext.xml	SAT TT=0.048	SAT TT=1.203 CHECKS=12387 NODES=455	SAT TT=1.228 CHECKS=13477 NODES=434	SAT TT=0.37	SAT TT=0.71 CHECKS=384029	SAT TT=0.17 CHECKS=177926	SAT TT=1.707 ASSIGNMENTS=196	SAT TT=1.68 ASSIGNMENTS=255	SAT TT=1.239 CHECKS=249630 NODES=321	SAT TT=2.103 CHECKS=3074680 NODES=6619	SAT TT=1.272 CHECKS=1950170 NODES=1946	SAT TT=0.059 ASSIGNMENTS=123 CHECKS=103239	SAT TT=0.058 ASSIGNMENTS=123 CHECKS=103239	SAT TT=5.912	SAT TT=5.833	SAT TT=0.699 CHECKS=77263	SAT TT=0.056 ASSIGNMENTS=213 CHECKS=164004	SAT TT=0.319 ASSIGNMENTS=3930 CHECKS=1866930	SAT TT=1.123	SAT TT=0.051 ASSIGNMENTS=254 CHECKS=128179	SAT TT=0.048 ASSIGNMENTS=123 CHECKS=103239	SAT TT=1.879	SAT TT=0.244 ASSIGNMENTS=350 CHECKS=170510	SAT TT=1.026	SAT TT=1.05
csp/jnhUnsat/ normalized-jnh02_ext.xml	UNSAT TT=0.035	UNSAT TT=1.035 CHECKS=1536 NODES=45	UNSAT TT=1.095 CHECKS=3055 NODES=0	UNSAT TT=0.177	UNSAT TT=0.057 CHECKS=7983	UNSAT TT=0.048 CHECKS=9366	UNSAT TT=0.701 ASSIGNMENTS=0	UNSAT TT=0.855 ASSIGNMENTS=0	UNSAT TT=0.853 CHECKS=25626 NODES=17	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=0.047 ASSIGNMENTS=12 CHECKS=12920	UNSAT TT=0.045 ASSIGNMENTS=12 CHECKS=12920	UNSAT TT=5.154	UNSAT TT=5.638	UNSAT TT=0.532 CHECKS=7412	UNSAT TT=0.036 ASSIGNMENTS=10 CHECKS=9732	UNSAT TT=0.033 ASSIGNMENTS=11 CHECKS=10834	UNSAT TT=0.673	UNSAT TT=0.037 ASSIGNMENTS=60 CHECKS=26020	UNSAT TT=0.035 ASSIGNMENTS=12 CHECKS=12920	UNSAT TT=1.681	UNSAT TT=0.154 ASSIGNMENTS=148 CHECKS=129267	UNSAT TT=0.978	UNSAT TT=1.028
csp/jnhUnsat/ normalized-jnh04_ext.xml	UNSAT TT=0.043	UNSAT TT=1.388 CHECKS=24129 NODES=451	UNSAT TT=1.305 CHECKS=32481 NODES=481	UNSAT TT=0.608	UNSAT TT=0.088 CHECKS=33333	UNSAT TT=0.061 CHECKS=39366	UNSAT TT=0.81 ASSIGNMENTS=0	UNSAT TT=0.885 ASSIGNMENTS=0	UNSAT TT=0.971 CHECKS=172754 NODES=137	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.049 ASSIGNMENTS=87 CHECKS=72429	UNSAT TT=0.054 ASSIGNMENTS=87 CHECKS=72429	UNSAT TT=4.18	UNSAT TT=4.294	UNSAT TT=0.555 CHECKS=34749	UNSAT TT=0.043 ASSIGNMENTS=134 CHECKS=107345	UNSAT TT=0.289 ASSIGNMENTS=3584 CHECKS=1835560	UNSAT TT=0.716	UNSAT TT=0.047 ASSIGNMENTS=182 CHECKS=115706	UNSAT TT=0.044 ASSIGNMENTS=87 CHECKS=72429	UNSAT TT=1.641	UNSAT TT=0.283 ASSIGNMENTS=253 CHECKS=244562	UNSAT TT=1.316	UNSAT TT=1.242
csp/jnhUnsat/ normalized-jnh05_ext.xml	UNSAT TT=0.034	UNSAT TT=1.148 CHECKS=5463 NODES=202	UNSAT TT=1.164 CHECKS=6102 NODES=97	UNSAT TT=0.174	UNSAT TT=0.096 CHECKS=31442	UNSAT TT=0.052 CHECKS=21812	UNSAT TT=1.131 ASSIGNMENTS=0	UNSAT TT=0.922 ASSIGNMENTS=0	UNSAT TT=0.773 CHECKS=36922 NODES=33	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.047 ASSIGNMENTS=19 CHECKS=17174	UNSAT TT=0.046 ASSIGNMENTS=19 CHECKS=17174	UNSAT TT=4.437	UNSAT TT=4.329	UNSAT TT=0.527 CHECKS=17896	UNSAT TT=0.034 ASSIGNMENTS=21 CHECKS=20230	UNSAT TT=0.043 ASSIGNMENTS=114 CHECKS=70258	UNSAT TT=0.715	UNSAT TT=0.039 ASSIGNMENTS=78 CHECKS=27717	UNSAT TT=0.036 ASSIGNMENTS=19 CHECKS=17174	UNSAT TT=1.819	UNSAT TT=0.162 ASSIGNMENTS=206 CHECKS=137262	UNSAT TT=1.261	UNSAT TT=1.156
csp/jnhUnsat/ normalized-jnh06_ext.xml	UNSAT TT=0.045	UNSAT TT=1.373 CHECKS=51228 NODES=930	UNSAT TT=1.312 CHECKS=19234 NODES=554	UNSAT TT=0.381	UNSAT TT=0.264 CHECKS=127577	UNSAT TT=0.11 CHECKS=102667	UNSAT TT=1.457 ASSIGNMENTS=132	UNSAT TT=1.375 ASSIGNMENTS=148	UNSAT TT=1.059 CHECKS=199841 NODES=177	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.056 ASSIGNMENTS=127 CHECKS=88654	UNSAT TT=0.056 ASSIGNMENTS=127 CHECKS=88654	UNSAT TT=4.988	UNSAT TT=4.084	UNSAT TT=0.519 CHECKS=37057	UNSAT TT=0.046 ASSIGNMENTS=160 CHECKS=116649	UNSAT TT=0.335 ASSIGNMENTS=3954 CHECKS=2018960	UNSAT TT=0.92	UNSAT TT=0.045 ASSIGNMENTS=194 CHECKS=91316	UNSAT TT=0.045 ASSIGNMENTS=127 CHECKS=88654	UNSAT TT=1.915	UNSAT TT=0.479 ASSIGNMENTS=609 CHECKS=450433	UNSAT TT=0.979	UNSAT TT=1
csp/jnhUnsat/ normalized-jnh08_ext.xml	UNSAT TT=0.033	UNSAT TT=1.155 CHECKS=4712 NODES=151	UNSAT TT=1.221 CHECKS=7718 NODES=170	UNSAT TT=0.178	UNSAT TT=0.078 CHECKS=19911	UNSAT TT=0.047 CHECKS=15449	UNSAT TT=0.811 ASSIGNMENTS=0	UNSAT TT=1.032 ASSIGNMENTS=0	UNSAT TT=0.824 CHECKS=63906 NODES=54	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.047 ASSIGNMENTS=16 CHECKS=16134	UNSAT TT=0.047 ASSIGNMENTS=16 CHECKS=16134	UNSAT TT=4.299	UNSAT TT=4.161	UNSAT TT=0.526 CHECKS=13052	UNSAT TT=0.036 ASSIGNMENTS=22 CHECKS=22439	UNSAT TT=0.104 ASSIGNMENTS=988 CHECKS=567717	UNSAT TT=0.641	UNSAT TT=0.037 ASSIGNMENTS=95 CHECKS=39404	UNSAT TT=0.033 ASSIGNMENTS=16 CHECKS=16134	UNSAT TT=1.768	UNSAT TT=0.094 ASSIGNMENTS=146 CHECKS=104271	UNSAT TT=1.005	UNSAT TT=1.04
csp/jnhUnsat/ normalized-jnh09_ext.xml	UNSAT TT=0.038	UNSAT TT=1.262 CHECKS=16683 NODES=595	UNSAT TT=1.334 CHECKS=18844 NODES=715	UNSAT TT=0.422	UNSAT TT=0.072 CHECKS=17836	UNSAT TT=0.056 CHECKS=32338	UNSAT TT=1.071 ASSIGNMENTS=0	UNSAT TT=0.825 ASSIGNMENTS=0	UNSAT TT=1.019 CHECKS=94974 NODES=94	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.054 ASSIGNMENTS=87 CHECKS=58349	UNSAT TT=0.055 ASSIGNMENTS=87 CHECKS=58349	UNSAT TT=4.021	UNSAT TT=5.653	UNSAT TT=0.513 CHECKS=29895	UNSAT TT=0.038 ASSIGNMENTS=97 CHECKS=66023	UNSAT TT=0.125 ASSIGNMENTS=1292 CHECKS=635751	UNSAT TT=0.78	UNSAT TT=0.039 ASSIGNMENTS=136 CHECKS=64108	UNSAT TT=0.04 ASSIGNMENTS=87 CHECKS=58349	UNSAT TT=1.777	UNSAT TT=0.253 ASSIGNMENTS=263 CHECKS=170659	UNSAT TT=1.012	UNSAT TT=1.149
csp/jnhUnsat/ normalized-jnh10_ext.xml	UNSAT TT=0.035	UNSAT TT=1.173 CHECKS=8141 NODES=208	UNSAT TT=1.144 CHECKS=4565 NODES=0	UNSAT TT=0.181	UNSAT TT=0.068 CHECKS=12039	UNSAT TT=0.049 CHECKS=17028	UNSAT TT=0.985 ASSIGNMENTS=0	UNSAT TT=0.791 ASSIGNMENTS=0	UNSAT TT=0.824 CHECKS=62568 NODES=48	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.047 ASSIGNMENTS=16 CHECKS=15721	UNSAT TT=0.044 ASSIGNMENTS=16 CHECKS=15721	UNSAT TT=4.253	UNSAT TT=4.217	UNSAT TT=0.5 CHECKS=10983	UNSAT TT=0.035 ASSIGNMENTS=17 CHECKS=17019	UNSAT TT=0.04 ASSIGNMENTS=60 CHECKS=49794	UNSAT TT=0.902	UNSAT TT=0.036 ASSIGNMENTS=73 CHECKS=32823	UNSAT TT=0.035 ASSIGNMENTS=16 CHECKS=15721	UNSAT TT=1.796	UNSAT TT=0.152 ASSIGNMENTS=185 CHECKS=132702	UNSAT TT=0.972	UNSAT TT=1.13
csp/jnhUnsat/ normalized-jnh11_ext.xml	UNSAT TT=0.038	UNSAT TT=1.277 CHECKS=15730 NODES=459	UNSAT TT=1.313 CHECKS=12325 NODES=300	UNSAT TT=0.554	UNSAT TT=0.113 CHECKS=49562	UNSAT TT=0.072 CHECKS=73107	UNSAT TT=1.155 ASSIGNMENTS=36	UNSAT TT=1.127 ASSIGNMENTS=6	UNSAT TT=0.991 CHECKS=129717 NODES=119	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=0.054 ASSIGNMENTS=80 CHECKS=72218	UNSAT TT=0.055 ASSIGNMENTS=80 CHECKS=72218	UNSAT TT=4.068	UNSAT TT=4.491	UNSAT TT=0.52 CHECKS=15577	UNSAT TT=0.04 ASSIGNMENTS=79 CHECKS=66981	UNSAT TT=0.317 ASSIGNMENTS=3774 CHECKS=1804830	UNSAT TT=0.753	UNSAT TT=0.038 ASSIGNMENTS=85 CHECKS=48160	UNSAT TT=0.043 ASSIGNMENTS=80 CHECKS=72218	UNSAT TT=1.889	UNSAT TT=0.243 ASSIGNMENTS=307 CHECKS=210023	UNSAT TT=1.245	UNSAT TT=1.044
csp/jnhUnsat/ normalized-jnh13_ext.xml	UNSAT TT=0.033	UNSAT TT=1.134 CHECKS=5469 NODES=131	UNSAT TT=1.28 CHECKS=6460 NODES=127	UNSAT TT=0.175	UNSAT TT=0.078 CHECKS=23769	UNSAT TT=0.052 CHECKS=19967	UNSAT TT=1.015 ASSIGNMENTS=0	UNSAT TT=0.774 ASSIGNMENTS=0	UNSAT TT=0.727 CHECKS=41305 NODES=34	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.045 ASSIGNMENTS=13 CHECKS=12733	UNSAT TT=0.048 ASSIGNMENTS=13 CHECKS=12733	UNSAT TT=5.132	UNSAT TT=4.207	UNSAT TT=0.72 CHECKS=8937	UNSAT TT=0.034 ASSIGNMENTS=11 CHECKS=12953	UNSAT TT=0.178 ASSIGNMENTS=1735 CHECKS=970875	UNSAT TT=0.677	UNSAT TT=0.036 ASSIGNMENTS=81 CHECKS=29540	UNSAT TT=0.033 ASSIGNMENTS=13 CHECKS=12733	UNSAT TT=1.761	UNSAT TT=0.109 ASSIGNMENTS=194 CHECKS=130886	UNSAT TT=1.042	UNSAT TT=1.4
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhUnsat/ normalized-jnh14_ext.xml	UNSAT TT=0.035	UNSAT TT=1.22 CHECKS=12072 NODES=414	UNSAT TT=1.402 CHECKS=14474 NODES=430	UNSAT TT=0.34	UNSAT TT=0.084 CHECKS=25450	UNSAT TT=0.048 CHECKS=23438	UNSAT TT=1.022 ASSIGNMENTS=0	UNSAT TT=1.041 ASSIGNMENTS=0	UNSAT TT=0.767 CHECKS=54779 NODES=47	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.048 ASSIGNMENTS=43 CHECKS=28491	UNSAT TT=0.044 ASSIGNMENTS=43 CHECKS=28491	UNSAT TT=4.157	UNSAT TT=5.216	UNSAT TT=0.734 CHECKS=22138	UNSAT TT=0.039 ASSIGNMENTS=70 CHECKS=56452	UNSAT TT=0.201 ASSIGNMENTS=2589 CHECKS=1226600	UNSAT TT=0.841	UNSAT TT=0.041 ASSIGNMENTS=159 CHECKS=57710	UNSAT TT=0.035 ASSIGNMENTS=43 CHECKS=28491	UNSAT TT=1.73	UNSAT TT=0.181 ASSIGNMENTS=216 CHECKS=191911	UNSAT TT=1.034	UNSAT TT=1.164
csp/jnhUnsat/ normalized-jnh15_ext.xml	UNSAT TT=0.034	UNSAT TT=1.386 CHECKS=13652 NODES=401	UNSAT TT=1.19 CHECKS=10088 NODES=168	UNSAT TT=0.237	UNSAT TT=0.101 CHECKS=42017	UNSAT TT=0.057 CHECKS=41576	UNSAT TT=0.902 ASSIGNMENTS=10	UNSAT TT=1.164 ASSIGNMENTS=1	UNSAT TT=0.933 CHECKS=59275 NODES=41	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=0.047 ASSIGNMENTS=47 CHECKS=42509	UNSAT TT=0.05 ASSIGNMENTS=47 CHECKS=42509	UNSAT TT=5.233	UNSAT TT=4.92	UNSAT TT=0.66 CHECKS=26455	UNSAT TT=0.038 ASSIGNMENTS=67 CHECKS=48676	UNSAT TT=0.124 ASSIGNMENTS=1046 CHECKS=613418	UNSAT TT=0.903	UNSAT TT=0.034 ASSIGNMENTS=103 CHECKS=43635	UNSAT TT=0.036 ASSIGNMENTS=47 CHECKS=42509	UNSAT TT=1.773	UNSAT TT=0.284 ASSIGNMENTS=415 CHECKS=271891	UNSAT TT=1.139	UNSAT TT=1.042
csp/jnhUnsat/ normalized-jnh16_ext.xml	UNSAT TT=0.119	UNSAT TT=2.585 CHECKS=234797 NODES=5167	UNSAT TT=2.556 CHECKS=223072 NODES=5339	UNSAT TT=1.715	UNSAT TT=5.649 CHECKS=2992990	UNSAT TT=2.694 CHECKS=3878880	UNSAT TT=4.187 ASSIGNMENTS=854	UNSAT TT=7.674 ASSIGNMENTS=2131	UNSAT TT=5.015 CHECKS=2327160 NODES=1952	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.131 ASSIGNMENTS=736 CHECKS=567811	UNSAT TT=0.132 ASSIGNMENTS=736 CHECKS=567811	UNSAT TT=4.467	UNSAT TT=4.28	UNSAT TT=0.868 CHECKS=315260	UNSAT TT=0.133 ASSIGNMENTS=848 CHECKS=659886	UNSAT TT=0.411 ASSIGNMENTS=4730 CHECKS=2492440	UNSAT TT=1.85	UNSAT TT=0.136 ASSIGNMENTS=904 CHECKS=655316	UNSAT TT=0.119 ASSIGNMENTS=736 CHECKS=567811	UNSAT TT=2.134	UNSAT TT=2.506 ASSIGNMENTS=5010 CHECKS=3581100	UNSAT TT=1.245	UNSAT TT=1.199
csp/jnhUnsat/ normalized-jnh18_ext.xml	UNSAT TT=0.039	UNSAT TT=1.327 CHECKS=23099 NODES=766	UNSAT TT=1.339 CHECKS=19645 NODES=658	UNSAT TT=0.291	UNSAT TT=0.386 CHECKS=199967	UNSAT TT=0.099 CHECKS=97199	UNSAT TT=1.258 ASSIGNMENTS=87	UNSAT TT=1.212 ASSIGNMENTS=68	UNSAT TT=1.992 CHECKS=577392 NODES=463	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.054 ASSIGNMENTS=98 CHECKS=72438	UNSAT TT=0.062 ASSIGNMENTS=98 CHECKS=72438	UNSAT TT=5.174	UNSAT TT=5.815	UNSAT TT=0.777 CHECKS=67027	UNSAT TT=0.049 ASSIGNMENTS=142 CHECKS=105061	UNSAT TT=0.327 ASSIGNMENTS=4082 CHECKS=2138040	UNSAT TT=0.922	UNSAT TT=0.045 ASSIGNMENTS=198 CHECKS=99945	UNSAT TT=0.039 ASSIGNMENTS=98 CHECKS=72438	UNSAT TT=1.949	UNSAT TT=0.344 ASSIGNMENTS=640 CHECKS=424875	UNSAT TT=1.222	UNSAT TT=1.001
csp/jnhUnsat/ normalized-jnh19_ext.xml	UNSAT TT=0.048	UNSAT TT=1.302 CHECKS=19591 NODES=613	UNSAT TT=1.406 CHECKS=29688 NODES=789	UNSAT TT=0.756	UNSAT TT=0.535 CHECKS=273477	UNSAT TT=0.282 CHECKS=365478	UNSAT TT=1.89 ASSIGNMENTS=212	UNSAT TT=1.002 ASSIGNMENTS=22	UNSAT TT=0.839 CHECKS=64946 NODES=51	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.06 ASSIGNMENTS=125 CHECKS=113006	UNSAT TT=0.056 ASSIGNMENTS=125 CHECKS=113006	UNSAT TT=4.338	UNSAT TT=4.584	UNSAT TT=0.605 CHECKS=51156	UNSAT TT=0.048 ASSIGNMENTS=135 CHECKS=118965	UNSAT TT=0.321 ASSIGNMENTS=3828 CHECKS=1983590	UNSAT TT=0.975	UNSAT TT=0.049 ASSIGNMENTS=205 CHECKS=105866	UNSAT TT=0.048 ASSIGNMENTS=125 CHECKS=113006	UNSAT TT=1.69	UNSAT TT=0.415 ASSIGNMENTS=703 CHECKS=497972	UNSAT TT=1.026	UNSAT TT=1.026
csp/jnhUnsat/ normalized-jnh202_ext.xml	UNSAT TT=0.032	UNSAT TT=1.079 CHECKS=839 NODES=31	UNSAT TT=1.064 CHECKS=1666 NODES=0	UNSAT TT=0.173	UNSAT TT=0.063 CHECKS=13861	UNSAT TT=0.046 CHECKS=9985	UNSAT TT=0.699 ASSIGNMENTS=0	UNSAT TT=0.801 ASSIGNMENTS=0	UNSAT TT=0.746 CHECKS=57384 NODES=43	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=0.046 ASSIGNMENTS=18 CHECKS=16686	UNSAT TT=0.045 ASSIGNMENTS=18 CHECKS=16686	UNSAT TT=4.312	UNSAT TT=4.578	UNSAT TT=0.539 CHECKS=23990	UNSAT TT=0.032 ASSIGNMENTS=18 CHECKS=16967	UNSAT TT=0.047 ASSIGNMENTS=116 CHECKS=77073	UNSAT TT=0.661	UNSAT TT=0.033 ASSIGNMENTS=54 CHECKS=19376	UNSAT TT=0.035 ASSIGNMENTS=18 CHECKS=16686	UNSAT TT=1.724	UNSAT TT=0.197 ASSIGNMENTS=318 CHECKS=275028	UNSAT TT=0.972	UNSAT TT=1.22
csp/jnhUnsat/ normalized-jnh203_ext.xml	UNSAT TT=0.036	UNSAT TT=1.261 CHECKS=17212 NODES=557	UNSAT TT=1.206 CHECKS=15095 NODES=455	UNSAT TT=0.188	UNSAT TT=0.168 CHECKS=72551	UNSAT TT=0.087 CHECKS=72213	UNSAT TT=1.155 ASSIGNMENTS=53	UNSAT TT=0.93 ASSIGNMENTS=15	UNSAT TT=1.005 CHECKS=93319 NODES=85	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.048 ASSIGNMENTS=54 CHECKS=41414	UNSAT TT=0.048 ASSIGNMENTS=54 CHECKS=41414	UNSAT TT=4.019	UNSAT TT=4.116	UNSAT TT=0.562 CHECKS=29862	UNSAT TT=0.039 ASSIGNMENTS=67 CHECKS=51762	UNSAT TT=0.341 ASSIGNMENTS=3764 CHECKS=2083950	UNSAT TT=0.783	UNSAT TT=0.039 ASSIGNMENTS=129 CHECKS=61920	UNSAT TT=0.036 ASSIGNMENTS=54 CHECKS=41414	UNSAT TT=1.873	UNSAT TT=0.154 ASSIGNMENTS=371 CHECKS=210375	UNSAT TT=1.2	UNSAT TT=1.21
csp/jnhUnsat/ normalized-jnh206_ext.xml	UNSAT TT=0.047	UNSAT TT=1.322 CHECKS=32441 NODES=884	UNSAT TT=1.237 CHECKS=24232 NODES=585	UNSAT TT=0.235	UNSAT TT=0.202 CHECKS=111475	UNSAT TT=0.097 CHECKS=110724	UNSAT TT=1.379 ASSIGNMENTS=100	UNSAT TT=1.128 ASSIGNMENTS=61	UNSAT TT=1.187 CHECKS=229877 NODES=208	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=0.063 ASSIGNMENTS=151 CHECKS=130802	UNSAT TT=0.063 ASSIGNMENTS=151 CHECKS=130802	UNSAT TT=4.025	UNSAT TT=4.162	UNSAT TT=0.52 CHECKS=45502	UNSAT TT=0.047 ASSIGNMENTS=134 CHECKS=125594	UNSAT TT=0.338 ASSIGNMENTS=4002 CHECKS=1966060	UNSAT TT=0.873	UNSAT TT=0.055 ASSIGNMENTS=282 CHECKS=175550	UNSAT TT=0.047 ASSIGNMENTS=151 CHECKS=130802	UNSAT TT=1.944	UNSAT TT=0.302 ASSIGNMENTS=629 CHECKS=366050	UNSAT TT=0.977	UNSAT TT=1.325
csp/jnhUnsat/ normalized-jnh208_ext.xml	UNSAT TT=0.035	UNSAT TT=1.241 CHECKS=32632 NODES=491	UNSAT TT=1.31 CHECKS=27544 NODES=376	UNSAT TT=0.203	UNSAT TT=0.235 CHECKS=122953	UNSAT TT=0.101 CHECKS=117711	UNSAT TT=1.249 ASSIGNMENTS=62	UNSAT TT=1.108 ASSIGNMENTS=23	UNSAT TT=0.886 CHECKS=99125 NODES=81	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=0.046 ASSIGNMENTS=42 CHECKS=36283	UNSAT TT=0.05 ASSIGNMENTS=42 CHECKS=36283	UNSAT TT=4.662	UNSAT TT=4.264	UNSAT TT=0.61 CHECKS=32416	UNSAT TT=0.038 ASSIGNMENTS=82 CHECKS=62801	UNSAT TT=0.324 ASSIGNMENTS=3537 CHECKS=1831530	UNSAT TT=1.03	UNSAT TT=0.039 ASSIGNMENTS=90 CHECKS=49649	UNSAT TT=0.035 ASSIGNMENTS=42 CHECKS=36283	UNSAT TT=1.762	UNSAT TT=0.261 ASSIGNMENTS=297 CHECKS=198019	UNSAT TT=1.214	UNSAT TT=1.035
csp/jnhUnsat/ normalized-jnh20_ext.xml	UNSAT TT=0.04	UNSAT TT=1.182 CHECKS=10769 NODES=367	UNSAT TT=1.286 CHECKS=12081 NODES=299	UNSAT TT=0.229	UNSAT TT=0.132 CHECKS=49566	UNSAT TT=0.052 CHECKS=21635	UNSAT TT=0.932 ASSIGNMENTS=0	UNSAT TT=0.876 ASSIGNMENTS=0	UNSAT TT=0.811 CHECKS=75999 NODES=69	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=0.047 ASSIGNMENTS=75 CHECKS=65162	UNSAT TT=0.053 ASSIGNMENTS=75 CHECKS=65162	UNSAT TT=4.405	UNSAT TT=4.201	UNSAT TT=0.651 CHECKS=40634	UNSAT TT=0.041 ASSIGNMENTS=82 CHECKS=66046	UNSAT TT=0.074 ASSIGNMENTS=459 CHECKS=287257	UNSAT TT=0.724	UNSAT TT=0.04 ASSIGNMENTS=116 CHECKS=58932	UNSAT TT=0.041 ASSIGNMENTS=75 CHECKS=65162	UNSAT TT=1.919	UNSAT TT=0.26 ASSIGNMENTS=274 CHECKS=193683	UNSAT TT=1.227	UNSAT TT=1.036
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhUnsat/ normalized-jnh211_ext.xml	UNSAT TT=0.032	UNSAT TT=1.181 CHECKS=7129 NODES=230	UNSAT TT=1.288 CHECKS=8411 NODES=214	UNSAT TT=0.18	UNSAT TT=0.064 CHECKS=15066	UNSAT TT=0.055 CHECKS=38037	UNSAT TT=0.764 ASSIGNMENTS=0	UNSAT TT=0.779 ASSIGNMENTS=0	UNSAT TT=0.951 CHECKS=72090 NODES=60	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.043 ASSIGNMENTS=18 CHECKS=14766	UNSAT TT=0.039 ASSIGNMENTS=18 CHECKS=14766	UNSAT TT=5.358	UNSAT TT=4.086	UNSAT TT=0.503 CHECKS=14345	UNSAT TT=0.034 ASSIGNMENTS=33 CHECKS=27475	UNSAT TT=0.078 ASSIGNMENTS=605 CHECKS=330026	UNSAT TT=0.787	UNSAT TT=0.034 ASSIGNMENTS=77 CHECKS=30431	UNSAT TT=0.032 ASSIGNMENTS=18 CHECKS=14766	UNSAT TT=1.652	UNSAT TT=0.098 ASSIGNMENTS=179 CHECKS=113276	UNSAT TT=0.983	UNSAT TT=1.209
csp/jnhUnsat/ normalized-jnh214_ext.xml	UNSAT TT=0.035	UNSAT TT=1.172 CHECKS=9170 NODES=262	UNSAT TT=1.18 CHECKS=12139 NODES=295	UNSAT TT=0.177	UNSAT TT=0.186 CHECKS=97015	UNSAT TT=0.064 CHECKS=44495	UNSAT TT=1.194 ASSIGNMENTS=19	UNSAT TT=1.019 ASSIGNMENTS=29	UNSAT TT=0.991 CHECKS=89520 NODES=84	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.049 ASSIGNMENTS=38 CHECKS=32226	UNSAT TT=0.046 ASSIGNMENTS=38 CHECKS=32226	UNSAT TT=4.031	UNSAT TT=4.251	UNSAT TT=0.489 CHECKS=15525	UNSAT TT=0.037 ASSIGNMENTS=42 CHECKS=35489	UNSAT TT=0.298 ASSIGNMENTS=3636 CHECKS=1645080	UNSAT TT=0.775	UNSAT TT=0.037 ASSIGNMENTS=127 CHECKS=45334	UNSAT TT=0.035 ASSIGNMENTS=38 CHECKS=32226	UNSAT TT=1.782	UNSAT TT=0.139 ASSIGNMENTS=192 CHECKS=94987	UNSAT TT=1.009	UNSAT TT=1.015
csp/jnhUnsat/ normalized-jnh215_ext.xml	UNSAT TT=0.036	UNSAT TT=1.308 CHECKS=13766 NODES=340	UNSAT TT=1.279 CHECKS=20743 NODES=462	UNSAT TT=0.253	UNSAT TT=0.113 CHECKS=50556	UNSAT TT=0.061 CHECKS=45694	UNSAT TT=1.339 ASSIGNMENTS=57	UNSAT TT=1.126 ASSIGNMENTS=11	UNSAT TT=0.795 CHECKS=54326 NODES=48	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.048 ASSIGNMENTS=44 CHECKS=34940	UNSAT TT=0.046 ASSIGNMENTS=44 CHECKS=34940	UNSAT TT=4.133	UNSAT TT=4.027	UNSAT TT=0.502 CHECKS=23878	UNSAT TT=0.04 ASSIGNMENTS=85 CHECKS=69855	UNSAT TT=0.14 ASSIGNMENTS=1600 CHECKS=725167	UNSAT TT=0.699	UNSAT TT=0.045 ASSIGNMENTS=225 CHECKS=101877	UNSAT TT=0.036 ASSIGNMENTS=44 CHECKS=34940	UNSAT TT=1.667	UNSAT TT=0.155 ASSIGNMENTS=237 CHECKS=187196	UNSAT TT=1.304	UNSAT TT=1.016
csp/jnhUnsat/ normalized-jnh216_ext.xml	UNSAT TT=0.043	UNSAT TT=1.277 CHECKS=24390 NODES=691	UNSAT TT=1.254 CHECKS=25895 NODES=685	UNSAT TT=0.221	UNSAT TT=32.34 CHECKS=25177600	UNSAT TT=0.105 CHECKS=113204	UNSAT TT=1.361 ASSIGNMENTS=110	UNSAT TT=1.243 ASSIGNMENTS=69	UNSAT TT=0.984 CHECKS=137369 NODES=125	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.058 ASSIGNMENTS=102 CHECKS=89073	UNSAT TT=0.057 ASSIGNMENTS=102 CHECKS=89073	UNSAT TT=3.99	UNSAT TT=4.925	UNSAT TT=0.575 CHECKS=63985	UNSAT TT=0.046 ASSIGNMENTS=129 CHECKS=110696	UNSAT TT=0.326 ASSIGNMENTS=3795 CHECKS=1807000	UNSAT TT=0.878	UNSAT TT=0.043 ASSIGNMENTS=153 CHECKS=75599	UNSAT TT=0.043 ASSIGNMENTS=102 CHECKS=89073	UNSAT TT=1.769	UNSAT TT=0.314 ASSIGNMENTS=547 CHECKS=343587	UNSAT TT=1.212	UNSAT TT=1.064
csp/jnhUnsat/ normalized-jnh219_ext.xml	UNSAT TT=0.034	UNSAT TT=1.107 CHECKS=8788 NODES=217	UNSAT TT=1.198 CHECKS=11123 NODES=225	UNSAT TT=0.198	UNSAT TT=0.162 CHECKS=66908	UNSAT TT=0.084 CHECKS=83245	UNSAT TT=1.192 ASSIGNMENTS=44	UNSAT TT=1.266 ASSIGNMENTS=30	UNSAT TT=1.146 CHECKS=266407 NODES=242	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=0.045 ASSIGNMENTS=44 CHECKS=39871	UNSAT TT=0.048 ASSIGNMENTS=44 CHECKS=39871	UNSAT TT=4.047	UNSAT TT=4.728	UNSAT TT=0.638 CHECKS=26698	UNSAT TT=0.039 ASSIGNMENTS=53 CHECKS=46395	UNSAT TT=0.305 ASSIGNMENTS=3980 CHECKS=1922970	UNSAT TT=0.964	UNSAT TT=0.039 ASSIGNMENTS=133 CHECKS=58625	UNSAT TT=0.034 ASSIGNMENTS=44 CHECKS=39871	UNSAT TT=1.837	UNSAT TT=0.295 ASSIGNMENTS=688 CHECKS=396942	UNSAT TT=1.08	UNSAT TT=0.98
csp/jnhUnsat/ normalized-jnh302_ext.xml	UNSAT TT=0.032	UNSAT TT=1.011 CHECKS=162 NODES=0	UNSAT TT=1.023 CHECKS=162 NODES=0	UNSAT TT=0.18	UNSAT TT=0.049 CHECKS=2146	UNSAT TT=0.046 CHECKS=2146	UNSAT TT=0.651 ASSIGNMENTS=0	UNSAT TT=0.705 ASSIGNMENTS=0	UNSAT TT=0.691 CHECKS=6021 NODES=0	UNSAT TT=0.799 CHECKS=7728 NODES=0	UNSAT TT=0.965 CHECKS=7728 NODES=0	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=5.073	UNSAT TT=5.294	UNSAT TT=0.553 CHECKS=7934	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.877	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=1.715	UNSAT TT=0.12 ASSIGNMENTS=141 CHECKS=159031	UNSAT TT=1.039	UNSAT TT=1.261
csp/jnhUnsat/ normalized-jnh303_ext.xml	UNSAT TT=0.042	UNSAT TT=1.209 CHECKS=15300 NODES=437	UNSAT TT=1.271 CHECKS=17359 NODES=406	UNSAT TT=0.239	UNSAT TT=0.195 CHECKS=99729	UNSAT TT=0.108 CHECKS=115750	UNSAT TT=1.506 ASSIGNMENTS=69	UNSAT TT=1.37 ASSIGNMENTS=29	UNSAT TT=0.917 CHECKS=131812 NODES=106	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=0.055 ASSIGNMENTS=97 CHECKS=70423	UNSAT TT=0.056 ASSIGNMENTS=97 CHECKS=70423	UNSAT TT=4.498	UNSAT TT=4.883	UNSAT TT=0.781 CHECKS=21767	UNSAT TT=0.044 ASSIGNMENTS=69 CHECKS=62646	UNSAT TT=0.366 ASSIGNMENTS=3774 CHECKS=2269940	UNSAT TT=0.856	UNSAT TT=0.044 ASSIGNMENTS=146 CHECKS=83588	UNSAT TT=0.042 ASSIGNMENTS=97 CHECKS=70423	UNSAT TT=1.82	UNSAT TT=0.297 ASSIGNMENTS=371 CHECKS=249415	UNSAT TT=0.973	UNSAT TT=1.044
csp/jnhUnsat/ normalized-jnh304_ext.xml	UNSAT TT=0.036	UNSAT TT=1.24 CHECKS=10982 NODES=268	UNSAT TT=1.1 CHECKS=3036 NODES=0	UNSAT TT=0.272	UNSAT TT=0.062 CHECKS=9940	UNSAT TT=0.048 CHECKS=6569	UNSAT TT=0.685 ASSIGNMENTS=0	UNSAT TT=0.701 ASSIGNMENTS=0	UNSAT TT=0.719 CHECKS=21410 NODES=10	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.048 ASSIGNMENTS=17 CHECKS=16169	UNSAT TT=0.048 ASSIGNMENTS=17 CHECKS=16169	UNSAT TT=4.432	UNSAT TT=4.528	UNSAT TT=0.531 CHECKS=12509	UNSAT TT=0.038 ASSIGNMENTS=36 CHECKS=29884	UNSAT TT=0.047 ASSIGNMENTS=180 CHECKS=112593	UNSAT TT=0.682	UNSAT TT=0.036 ASSIGNMENTS=92 CHECKS=25652	UNSAT TT=0.036 ASSIGNMENTS=17 CHECKS=16169	UNSAT TT=1.729	UNSAT TT=0.114 ASSIGNMENTS=173 CHECKS=144889	UNSAT TT=1.249	UNSAT TT=1.048
csp/jnhUnsat/ normalized-jnh305_ext.xml	UNSAT TT=0.035	UNSAT TT=1.068 CHECKS=3676 NODES=83	UNSAT TT=1.157 CHECKS=5483 NODES=84	UNSAT TT=0.186	UNSAT TT=0.101 CHECKS=34303	UNSAT TT=0.065 CHECKS=45175	UNSAT TT=0.894 ASSIGNMENTS=0	UNSAT TT=1.024 ASSIGNMENTS=0	UNSAT TT=0.758 CHECKS=27202 NODES=25	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.045 ASSIGNMENTS=12 CHECKS=15011	UNSAT TT=0.046 ASSIGNMENTS=12 CHECKS=15011	UNSAT TT=5.03	UNSAT TT=5.058	UNSAT TT=0.708 CHECKS=12489	UNSAT TT=0.035 ASSIGNMENTS=10 CHECKS=14371	UNSAT TT=0.071 ASSIGNMENTS=376 CHECKS=259006	UNSAT TT=0.936	UNSAT TT=0.037 ASSIGNMENTS=67 CHECKS=37051	UNSAT TT=0.035 ASSIGNMENTS=12 CHECKS=15011	UNSAT TT=1.807	UNSAT TT=0.121 ASSIGNMENTS=184 CHECKS=155306	UNSAT TT=1.028	UNSAT TT=1.194
csp/jnhUnsat/ normalized-jnh306_ext.xml	UNSAT TT=0.068	UNSAT TT=2 CHECKS=148016 NODES=2759	UNSAT TT=2.026 CHECKS=134157 NODES=2445	UNSAT TT=1.244	UNSAT TT=1.857 CHECKS=899573	UNSAT TT=0.813 CHECKS=1196730	UNSAT TT=2.991 ASSIGNMENTS=472	UNSAT TT=2.076 ASSIGNMENTS=260	UNSAT TT=3.178 CHECKS=1212120 NODES=952	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=0.075 ASSIGNMENTS=282 CHECKS=252095	UNSAT TT=0.076 ASSIGNMENTS=282 CHECKS=252095	UNSAT TT=4.615	UNSAT TT=4.235	UNSAT TT=1.11 CHECKS=132359	UNSAT TT=0.09 ASSIGNMENTS=435 CHECKS=403019	UNSAT TT=0.35 ASSIGNMENTS=4074 CHECKS=2275400	UNSAT TT=1.306	UNSAT TT=0.068 ASSIGNMENTS=307 CHECKS=217589	UNSAT TT=0.07 ASSIGNMENTS=282 CHECKS=252095	UNSAT TT=2.138	UNSAT TT=1.172 ASSIGNMENTS=1746 CHECKS=1354690	UNSAT TT=1.146	UNSAT TT=1.002
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhUnsat/ normalized-jnh307_ext.xml	UNSAT TT=0.033	UNSAT TT=1.024 CHECKS=890 NODES=36	UNSAT TT=1.091 CHECKS=529 NODES=0	UNSAT TT=0.17	UNSAT TT=0.053 CHECKS=2811	UNSAT TT=0.047 CHECKS=2811	UNSAT TT=0.822 ASSIGNMENTS=0	UNSAT TT=0.78 ASSIGNMENTS=0	UNSAT TT=0.718 CHECKS=8404 NODES=1	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.047 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=0.044 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=4.242	UNSAT TT=4.336	UNSAT TT=0.623 CHECKS=10100	UNSAT TT=0.033 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=0.035 ASSIGNMENTS=1 CHECKS=3843	UNSAT TT=0.662	UNSAT TT=0.035 ASSIGNMENTS=4 CHECKS=4618	UNSAT TT=0.033 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=1.738	UNSAT TT=0.137 ASSIGNMENTS=129 CHECKS=77539	UNSAT TT=1.031	UNSAT TT=1.555
csp/jnhUnsat/ normalized-jnh309_ext.xml	UNSAT TT=0.035	UNSAT TT=1.198 CHECKS=8979 NODES=193	UNSAT TT=1.117 CHECKS=2007 NODES=0	UNSAT TT=0.21	UNSAT TT=0.071 CHECKS=12234	UNSAT TT=0.052 CHECKS=14749	UNSAT TT=0.968 ASSIGNMENTS=0	UNSAT TT=0.823 ASSIGNMENTS=0	UNSAT TT=0.885 CHECKS=36625 NODES=26	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=0.05 ASSIGNMENTS=16 CHECKS=16323	UNSAT TT=0.049 ASSIGNMENTS=16 CHECKS=16323	UNSAT TT=4.966	UNSAT TT=4.268	UNSAT TT=0.55 CHECKS=25571	UNSAT TT=0.035 ASSIGNMENTS=21 CHECKS=23048	UNSAT TT=0.079 ASSIGNMENTS=460 CHECKS=286282	UNSAT TT=0.747	UNSAT TT=0.039 ASSIGNMENTS=33 CHECKS=21557	UNSAT TT=0.035 ASSIGNMENTS=16 CHECKS=16323	UNSAT TT=1.687	UNSAT TT=0.155 ASSIGNMENTS=129 CHECKS=88276	UNSAT TT=1.195	UNSAT TT=1.055
csp/jnhUnsat/ normalized-jnh310_ext.xml	UNSAT TT=0.034	UNSAT TT=1.058 CHECKS=301 NODES=15	UNSAT TT=1.015 CHECKS=183 NODES=0	UNSAT TT=0.184	UNSAT TT=0.056 CHECKS=4182	UNSAT TT=0.043 CHECKS=3728	UNSAT TT=0.885 ASSIGNMENTS=0	UNSAT TT=0.761 ASSIGNMENTS=0	UNSAT TT=0.727 CHECKS=14626 NODES=13	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.044 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=0.047 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=4.555	UNSAT TT=5.223	UNSAT TT=0.54 CHECKS=2313	UNSAT TT=0.034 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=0.059 ASSIGNMENTS=340 CHECKS=188119	UNSAT TT=0.655	UNSAT TT=0.035 ASSIGNMENTS=38 CHECKS=11240	UNSAT TT=0.036 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=1.748	UNSAT TT=0.08 ASSIGNMENTS=36 CHECKS=30532	UNSAT TT=1.039	UNSAT TT=1.276
csp/lexVg/ normalized-crossword-m1c-lex-vg10-11_ext.xml	UNSAT TT=1.55	UNSAT TT=1.701 CHECKS=0 NODES=221	UNSAT TT=3.236 CHECKS=0 NODES=209	? (TO) TT=1800.09	UNSAT TT=41.101 CHECKS=112511	UNSAT TT=17.807 CHECKS=43417	UNSAT TT=20.787 ASSIGNMENTS=0	UNSAT TT=22.258 ASSIGNMENTS=0	UNSAT TT=2.762 CHECKS=0 NODES=368	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=9.329 ASSIGNMENTS=221 CHECKS=0	UNSAT TT=9.026 ASSIGNMENTS=221 CHECKS=0	UNSAT TT=64.248	UNSAT TT=51.21	UNSAT TT=4.342 CHECKS=36205	UNSAT TT=1.55 ASSIGNMENTS=206 CHECKS=41245	UNSAT TT=18.017 ASSIGNMENTS=3472 CHECKS=462122	UNSAT TT=14.413	UNSAT TT=7.462 ASSIGNMENTS=1645 CHECKS=197688	UNSAT TT=1.631 ASSIGNMENTS=238 CHECKS=43669	? TT=31.591	? (TO) TT=1800.08	UNSAT TT=181.014	? (TO) TT=1800
csp/lexVg/ normalized-crossword-m1c-lex-vg10-12_ext.xml	UNSAT TT=0.371	UNSAT TT=0.943 CHECKS=0 NODES=58	UNSAT TT=1.906 CHECKS=0 NODES=0	? (TO) TT=1800.08	UNSAT TT=9.712 CHECKS=26649	UNSAT TT=8.838 CHECKS=24132	UNSAT TT=4.181 ASSIGNMENTS=0	UNSAT TT=4.548 ASSIGNMENTS=0	UNSAT TT=1.055 CHECKS=0 NODES=74	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=0.421 ASSIGNMENTS=60 CHECKS=9481	UNSAT TT=0.422 ASSIGNMENTS=60 CHECKS=9481	UNSAT TT=34.658	UNSAT TT=27.653	UNSAT TT=0.957 CHECKS=6723	UNSAT TT=0.4 ASSIGNMENTS=60 CHECKS=9433	UNSAT TT=15.501 ASSIGNMENTS=3172 CHECKS=436031	UNSAT TT=7.774	UNSAT TT=1.35 ASSIGNMENTS=279 CHECKS=37352	UNSAT TT=0.371 ASSIGNMENTS=60 CHECKS=9481	? TT=32.877	? (TO) TT=1800.11	UNSAT TT=88.589	UNSAT TT=149.832
csp/lexVg/ normalized-crossword-m1c-lex-vg11-12_ext.xml	UNSAT TT=0.214	UNSAT TT=0.836 CHECKS=0 NODES=23	UNSAT TT=0.877 CHECKS=0 NODES=0	? (TO) TT=1800.14	UNSAT TT=3.369 CHECKS=9260	UNSAT TT=3.622 CHECKS=9134	UNSAT TT=1.993 ASSIGNMENTS=0	UNSAT TT=2.337 ASSIGNMENTS=0	UNSAT TT=0.81 CHECKS=0 NODES=27	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.36 ASSIGNMENTS=40 CHECKS=8217	UNSAT TT=0.338 ASSIGNMENTS=40 CHECKS=8217	UNSAT TT=19.154	UNSAT TT=14.674	UNSAT TT=0.378 CHECKS=2811	UNSAT TT=0.214 ASSIGNMENTS=29 CHECKS=5256	UNSAT TT=1.682 ASSIGNMENTS=343 CHECKS=45212	UNSAT TT=2.263	UNSAT TT=0.422 ASSIGNMENTS=72 CHECKS=10791	UNSAT TT=0.32 ASSIGNMENTS=40 CHECKS=8217	? TT=32.237	? (TO) TT=1800.02	UNSAT TT=51.717	UNSAT TT=60.992
csp/lexVg/ normalized-crossword-m1c-lex-vg11-13_ext.xml	UNSAT TT=0.09	UNSAT TT=0.776 CHECKS=0 NODES=7	UNSAT TT=0.829 CHECKS=0 NODES=0	UNSAT TT=223.836	UNSAT TT=0.656 CHECKS=1168	UNSAT TT=0.883 CHECKS=1644	UNSAT TT=0.792 ASSIGNMENTS=0	UNSAT TT=0.698 ASSIGNMENTS=0	UNSAT TT=0.542 CHECKS=0 NODES=7	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.096 ASSIGNMENTS=6 CHECKS=1652	UNSAT TT=0.1 ASSIGNMENTS=6 CHECKS=1652	UNSAT TT=14.086	UNSAT TT=10.75	UNSAT TT=0.175 CHECKS=967	UNSAT TT=0.09 ASSIGNMENTS=6 CHECKS=1652	UNSAT TT=0.118 ASSIGNMENTS=15 CHECKS=2242	UNSAT TT=1.197	UNSAT TT=0.114 ASSIGNMENTS=15 CHECKS=2098	UNSAT TT=0.09 ASSIGNMENTS=6 CHECKS=1652	? TT=33.724	? (TO) TT=1800.01	UNSAT TT=35.674	UNSAT TT=575.879
csp/lexVg/ normalized-crossword-m1c-lex-vg11-15_ext.xml	UNSAT TT=0.019	UNSAT TT=0.741 CHECKS=0 NODES=0	UNSAT TT=0.795 CHECKS=0 NODES=0	UNSAT TT=20.418	UNSAT TT=0.248 CHECKS=41	UNSAT TT=0.243 CHECKS=41	UNSAT TT=0.481 ASSIGNMENTS=0	UNSAT TT=0.456 ASSIGNMENTS=0	UNSAT TT=0.467 CHECKS=0 NODES=0	UNSAT TT=0.453 CHECKS=0 NODES=0	UNSAT TT=0.431 CHECKS=0 NODES=0	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=11.872	UNSAT TT=9.553	UNSAT TT=0.06 CHECKS=151	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=1.053	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=12	? TT=34.5	? (TO) TT=1800.08	UNSAT TT=34.783	UNSAT TT=47.764
csp/lexVg/ normalized-crossword-m1c-lex-vg12-12_ext.xml	UNSAT TT=0.085	UNSAT TT=0.835 CHECKS=0 NODES=8	UNSAT TT=0.786 CHECKS=0 NODES=0	UNSAT TT=279.771	UNSAT TT=1.212 CHECKS=3480	UNSAT TT=1.121 CHECKS=3878	UNSAT TT=0.88 ASSIGNMENTS=0	UNSAT TT=0.967 ASSIGNMENTS=0	UNSAT TT=0.499 CHECKS=0 NODES=11	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.104 ASSIGNMENTS=11 CHECKS=1916	UNSAT TT=0.103 ASSIGNMENTS=11 CHECKS=1916	UNSAT TT=12.92	UNSAT TT=10.64	UNSAT TT=0.121 CHECKS=1037	UNSAT TT=0.085 ASSIGNMENTS=8 CHECKS=1469	UNSAT TT=0.221 ASSIGNMENTS=38 CHECKS=4969	UNSAT TT=1.154	UNSAT TT=0.153 ASSIGNMENTS=20 CHECKS=3565	UNSAT TT=0.094 ASSIGNMENTS=11 CHECKS=1916	? TT=57.464	? (TO) TT=1800.05	UNSAT TT=38.436	? (TO) TT=1800.04
csp/lexVg/ normalized-crossword-m1c-lex-vg12-13_ext.xml	UNSAT TT=0.031	UNSAT TT=0.754 CHECKS=0 NODES=0	UNSAT TT=0.788 CHECKS=0 NODES=0	UNSAT TT=122.654	UNSAT TT=0.192 CHECKS=66	UNSAT TT=0.187 CHECKS=66	UNSAT TT=0.613 ASSIGNMENTS=0	UNSAT TT=0.575 ASSIGNMENTS=0	UNSAT TT=0.605 CHECKS=0 NODES=0	UNSAT TT=0.453 CHECKS=0 NODES=0	UNSAT TT=0.629 CHECKS=0 NODES=0	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=10.486	UNSAT TT=8.251	UNSAT TT=0.054 CHECKS=223	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=1.028	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=104	? TT=54.929	? (TO) TT=1800.05	UNSAT TT=21.316	UNSAT TT=287.535
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg12-14_ext.xml	UNSAT TT=0.027	UNSAT TT=0.793 CHECKS=0 NODES=0	UNSAT TT=0.91 CHECKS=0 NODES=0	UNSAT TT=52.102	UNSAT TT=0.172 CHECKS=51	UNSAT TT=0.173 CHECKS=51	UNSAT TT=0.48 ASSIGNMENTS=0	UNSAT TT=0.549 ASSIGNMENTS=0	UNSAT TT=0.517 CHECKS=0 NODES=0	UNSAT TT=0.447 CHECKS=0 NODES=0	UNSAT TT=0.437 CHECKS=0 NODES=0	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=8.512	UNSAT TT=7.711	UNSAT TT=0.044 CHECKS=159	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.846	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=55	? TT=53.509	? (TO) TT=1800.04	UNSAT TT=18.139	UNSAT TT=39.923
csp/lexVg/ normalized-crossword-m1c-lex-vg13-13_ext.xml	UNSAT TT=0.026	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=0.762 CHECKS=0 NODES=0	UNSAT TT=66.948	UNSAT TT=0.168 CHECKS=82	UNSAT TT=0.168 CHECKS=82	UNSAT TT=0.442 ASSIGNMENTS=0	UNSAT TT=0.47 ASSIGNMENTS=0	UNSAT TT=0.386 CHECKS=0 NODES=0	UNSAT TT=0.393 CHECKS=0 NODES=0	UNSAT TT=0.439 CHECKS=0 NODES=0	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=7.706	UNSAT TT=6.444	UNSAT TT=0.034 CHECKS=218	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.719	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=53	? TT=53.693	? (TO) TT=1800.08	UNSAT TT=13.599	UNSAT TT=42.119
csp/lexVg/ normalized-crossword-m1c-lex-vg13-15_ext.xml	UNSAT TT=0.019	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=0.743 CHECKS=0 NODES=0	UNSAT TT=8.3	UNSAT TT=0.085 CHECKS=29	UNSAT TT=0.085 CHECKS=29	UNSAT TT=0.53 ASSIGNMENTS=0	UNSAT TT=0.53 ASSIGNMENTS=0	UNSAT TT=0.423 CHECKS=0 NODES=0	UNSAT TT=0.422 CHECKS=0 NODES=0	UNSAT TT=0.419 CHECKS=0 NODES=0	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=6.26	UNSAT TT=5.443	UNSAT TT=0.032 CHECKS=65	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.623	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=14	? TT=51.591	? (TO) TT=1800.07	UNSAT TT=7.693	UNSAT TT=12.517
csp/lexVg/ normalized-crossword-m1c-lex-vg13-16_ext.xml	UNSAT TT=0.017	UNSAT TT=0.723 CHECKS=0 NODES=0	UNSAT TT=0.8 CHECKS=0 NODES=0	UNSAT TT=8.962	UNSAT TT=0.087 CHECKS=29	UNSAT TT=0.085 CHECKS=29	UNSAT TT=0.48 ASSIGNMENTS=0	UNSAT TT=0.433 ASSIGNMENTS=0	UNSAT TT=0.378 CHECKS=0 NODES=0	UNSAT TT=0.377 CHECKS=0 NODES=0	UNSAT TT=0.376 CHECKS=0 NODES=0	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=5.637	UNSAT TT=5.237	UNSAT TT=0.026 CHECKS=82	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.629	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=14	? TT=62.107	? (TO) TT=1800.04	UNSAT TT=7.926	UNSAT TT=12.638
csp/lexVg/ normalized-crossword-m1c-lex-vg13-17_ext.xml	UNSAT TT=0.016	UNSAT TT=0.771 CHECKS=0 NODES=0	UNSAT TT=0.765 CHECKS=0 NODES=0	UNSAT TT=6.71	UNSAT TT=0.09 CHECKS=30	UNSAT TT=0.084 CHECKS=30	UNSAT TT=0.455 ASSIGNMENTS=0	UNSAT TT=0.427 ASSIGNMENTS=0	UNSAT TT=0.402 CHECKS=0 NODES=0	UNSAT TT=0.374 CHECKS=0 NODES=0	UNSAT TT=0.492 CHECKS=0 NODES=0	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=5.989	UNSAT TT=5.188	UNSAT TT=0.025 CHECKS=55	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.599	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=14	? TT=57.387	? (TO) TT=1800.03	UNSAT TT=8.143	UNSAT TT=11.668
csp/lexVg/ normalized-crossword-m1c-lex-vg14-15_ext.xml	UNSAT TT=0.019	UNSAT TT=0.75 CHECKS=0 NODES=0	UNSAT TT=0.793 CHECKS=0 NODES=0	UNSAT TT=4.283	UNSAT TT=0.056 CHECKS=29	UNSAT TT=0.056 CHECKS=29	UNSAT TT=0.471 ASSIGNMENTS=0	UNSAT TT=0.566 ASSIGNMENTS=0	UNSAT TT=0.455 CHECKS=0 NODES=0	UNSAT TT=0.376 CHECKS=0 NODES=0	UNSAT TT=0.392 CHECKS=0 NODES=0	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=4.316	UNSAT TT=4.034	UNSAT TT=0.025 CHECKS=98	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.547	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=15	? (exit code) TT=88.171	? (TO) TT=1800.11	UNSAT TT=5.422	UNSAT TT=6.838
csp/lexVg/ normalized-crossword-m1c-lex-vg14-18_ext.xml	UNSAT TT=0.015	UNSAT TT=0.973 CHECKS=0 NODES=0	UNSAT TT=0.846 CHECKS=0 NODES=0	UNSAT TT=4.796	UNSAT TT=0.061 CHECKS=19	UNSAT TT=0.06 CHECKS=19	UNSAT TT=0.428 ASSIGNMENTS=0	UNSAT TT=0.464 ASSIGNMENTS=0	UNSAT TT=0.421 CHECKS=0 NODES=0	UNSAT TT=0.471 CHECKS=0 NODES=0	UNSAT TT=0.386 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=4.282	UNSAT TT=4.096	UNSAT TT=0.025 CHECKS=30	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.513	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=15	? TT=101.027	? (TO) TT=1800.08	UNSAT TT=4.127	UNSAT TT=6.515
csp/lexVg/ normalized-crossword-m1c-lex-vg15-16_ext.xml	UNSAT TT=0.019	UNSAT TT=0.792 CHECKS=0 NODES=0	UNSAT TT=0.797 CHECKS=0 NODES=0	UNSAT TT=1.342	UNSAT TT=0.034 CHECKS=17	UNSAT TT=0.034 CHECKS=17	UNSAT TT=0.422 ASSIGNMENTS=0	UNSAT TT=0.46 ASSIGNMENTS=0	UNSAT TT=0.371 CHECKS=0 NODES=0	UNSAT TT=0.366 CHECKS=0 NODES=0	UNSAT TT=0.381 CHECKS=0 NODES=0	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=3.638	UNSAT TT=3.334	UNSAT TT=0.023 CHECKS=50	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.476	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=16	? (exit code) TT=82.514	? (TO) TT=1800.02	UNSAT TT=2.36	UNSAT TT=3.774
csp/lexVg/ normalized-crossword-m1c-lex-vg15-17_ext.xml	UNSAT TT=0.016	UNSAT TT=0.748 CHECKS=0 NODES=0	UNSAT TT=0.731 CHECKS=0 NODES=0	UNSAT TT=1.411	UNSAT TT=0.031 CHECKS=18	UNSAT TT=0.029 CHECKS=18	UNSAT TT=0.481 ASSIGNMENTS=0	UNSAT TT=0.443 ASSIGNMENTS=0	UNSAT TT=0.375 CHECKS=0 NODES=0	UNSAT TT=0.359 CHECKS=0 NODES=0	UNSAT TT=0.371 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=3.47	UNSAT TT=2.961	UNSAT TT=0.021 CHECKS=24	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.423	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	? TT=81.753	? (TO) TT=1800.02	UNSAT TT=2.196	UNSAT TT=3.076
csp/lexVg/ normalized-crossword-m1c-lex-vg15-18_ext.xml	UNSAT TT=0.014	UNSAT TT=0.727 CHECKS=0 NODES=0	UNSAT TT=0.832 CHECKS=0 NODES=0	UNSAT TT=1.397	UNSAT TT=0.034 CHECKS=19	UNSAT TT=0.032 CHECKS=19	UNSAT TT=0.43 ASSIGNMENTS=0	UNSAT TT=0.467 ASSIGNMENTS=0	UNSAT TT=0.401 CHECKS=0 NODES=0	UNSAT TT=0.363 CHECKS=0 NODES=0	UNSAT TT=0.347 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=3.505	UNSAT TT=3.147	UNSAT TT=0.024 CHECKS=18	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.428	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=16	? TT=85.732	? (TO) TT=1800.04	UNSAT TT=2.01	UNSAT TT=3.077
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg16-18_ext.xml	UNSAT TT=0.016	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=0.766 CHECKS=0 NODES=0	UNSAT TT=0.605	UNSAT TT=0.025 CHECKS=19	UNSAT TT=0.025 CHECKS=19	UNSAT TT=0.454 ASSIGNMENTS=0	UNSAT TT=0.444 ASSIGNMENTS=0	UNSAT TT=0.415 CHECKS=0 NODES=0	UNSAT TT=0.375 CHECKS=0 NODES=0	UNSAT TT=0.375 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=3.32	UNSAT TT=2.936	UNSAT TT=0.021 CHECKS=5	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.427	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=17	? (exit code) TT=78.15	? (TO) TT=1800.05	UNSAT TT=1.696	UNSAT TT=2.085
csp/lexVg/ normalized-crossword-m1c-lex-vg16-20_ext.xml	UNSAT TT=0.014	UNSAT TT=0.804 CHECKS=0 NODES=0	UNSAT TT=0.768 CHECKS=0 NODES=0	UNSAT TT=0.713	UNSAT TT=0.038 CHECKS=45	UNSAT TT=0.035 CHECKS=45	UNSAT TT=0.496 ASSIGNMENTS=0	UNSAT TT=0.479 ASSIGNMENTS=0	UNSAT TT=0.449 CHECKS=0 NODES=0	UNSAT TT=0.388 CHECKS=0 NODES=0	UNSAT TT=0.383 CHECKS=0 NODES=0	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=3.297	UNSAT TT=3.091	UNSAT TT=0.024 CHECKS=6	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.432	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=17	? TT=99.572	? (TO) TT=1800.05	UNSAT TT=1.466	UNSAT TT=2.051
csp/lexVg/ normalized-crossword-m1c-lex-vg4-5_ext.xml	SAT TT=0.017	SAT TT=0.731 CHECKS=34 NODES=28	SAT TT=0.743 CHECKS=9 NODES=21	SAT TT=2.39	SAT TT=0.247 CHECKS=601	SAT TT=0.191 CHECKS=446	SAT TT=0.906 ASSIGNMENTS=11	SAT TT=0.952 ASSIGNMENTS=10	SAT TT=16.223 CHECKS=11747400 NODES=22	SAT TT=1386.18 CHECKS=8572600000 NODES=-33934500	? (TO) TT=1800.1	SAT TT=0.03 ASSIGNMENTS=7 CHECKS=192	SAT TT=0.03 ASSIGNMENTS=7 CHECKS=192	SAT TT=12.305	SAT TT=15.472	SAT TT=0.036 CHECKS=101	SAT TT=0.018 ASSIGNMENTS=7 CHECKS=192	SAT TT=0.021 ASSIGNMENTS=13 CHECKS=466	SAT TT=0.59	SAT TT=0.032 ASSIGNMENTS=55 CHECKS=1527	SAT TT=0.017 ASSIGNMENTS=7 CHECKS=192	? (MO) TT=33.132	SAT TT=0.489 ASSIGNMENTS=28 CHECKS=2552530	SAT TT=4.352	SAT TT=4.706
csp/lexVg/ normalized-crossword-m1c-lex-vg4-6_ext.xml	SAT TT=0.048	SAT TT=0.899 CHECKS=101 NODES=156	SAT TT=0.862 CHECKS=126 NODES=148	SAT TT=2.814	SAT TT=4.063 CHECKS=28721	SAT TT=0.533 CHECKS=2652	SAT TT=1.382 ASSIGNMENTS=28	SAT TT=1.266 ASSIGNMENTS=11	SAT TT=143.507 CHECKS=395229000 NODES=31	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=0.283 ASSIGNMENTS=359 CHECKS=17565	SAT TT=0.302 ASSIGNMENTS=359 CHECKS=17565	SAT TT=11.639	SAT TT=117.246	SAT TT=0.048 CHECKS=218	SAT TT=0.215 ASSIGNMENTS=233 CHECKS=12157	SAT TT=0.077 ASSIGNMENTS=85 CHECKS=3461	SAT TT=0.749	SAT TT=0.395 ASSIGNMENTS=568 CHECKS=22976	SAT TT=0.288 ASSIGNMENTS=359 CHECKS=17565	? TT=89.73	SAT TT=0.511 ASSIGNMENTS=43 CHECKS=767573	SAT TT=10.841	SAT TT=18.813
csp/lexVg/ normalized-crossword-m1c-lex-vg4-8_ext.xml	SAT TT=6	SAT TT=7.02 CHECKS=17728 NODES=12539	SAT TT=8.65 CHECKS=21002 NODES=14447	? (TO) TT=1800.09	SAT TT=103.668 CHECKS=435754	SAT TT=442.774 CHECKS=2678410	SAT TT=156.672 ASSIGNMENTS=18790	SAT TT=43.101 ASSIGNMENTS=3021	SAT TT=6 CHECKS=62294500 NODES=2113	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=13.961 ASSIGNMENTS=12539 CHECKS=17728	SAT TT=14.033 ASSIGNMENTS=12539 CHECKS=17728	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=27.041 CHECKS=1314950	SAT TT=13.482 ASSIGNMENTS=8925 CHECKS=712766	SAT TT=10.905 ASSIGNMENTS=7987 CHECKS=576957	SAT TT=31.701	SAT TT=52.702 ASSIGNMENTS=33893 CHECKS=2879500	SAT TT=15.466 ASSIGNMENTS=10304 CHECKS=850296	? TT=89.115	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.14
csp/lexVg/ normalized-crossword-m1c-lex-vg5-5_ext.xml	SAT TT=0.02	SAT TT=0.9 CHECKS=41 NODES=40	SAT TT=0.894 CHECKS=11 NODES=0	SAT TT=3.518	SAT TT=0.396 CHECKS=1194	SAT TT=0.397 CHECKS=1131	SAT TT=1.257 ASSIGNMENTS=13	SAT TT=1.385 ASSIGNMENTS=32	SAT TT=39.172 CHECKS=28272600 NODES=25	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=0.03 ASSIGNMENTS=16 CHECKS=616	SAT TT=0.032 ASSIGNMENTS=16 CHECKS=616	SAT TT=16.753	SAT TT=7.432	SAT TT=0.044 CHECKS=1636	SAT TT=0.02 ASSIGNMENTS=16 CHECKS=572	SAT TT=0.015 ASSIGNMENTS=7 CHECKS=202	SAT TT=0.808	SAT TT=0.036 ASSIGNMENTS=41 CHECKS=1426	SAT TT=0.021 ASSIGNMENTS=16 CHECKS=616	? (MO) TT=33.176	SAT TT=0.965 ASSIGNMENTS=50 CHECKS=5442460	SAT TT=7.881	SAT TT=10.453
csp/lexVg/ normalized-crossword-m1c-lex-vg5-6_ext.xml	SAT TT=5.481	SAT TT=14.966 CHECKS=67154 NODES=34824	SAT TT=7.608 CHECKS=27230 NODES=18004	SAT TT=1434.67	SAT TT=288.28 CHECKS=1413740	SAT TT=511.806 CHECKS=2788560	SAT TT=60.654 ASSIGNMENTS=6073	SAT TT=38.659 ASSIGNMENTS=2881	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=21.738 ASSIGNMENTS=34824 CHECKS=67154	SAT TT=20.968 ASSIGNMENTS=34824 CHECKS=67154	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=5.481 CHECKS=300900	SAT TT=39.486 ASSIGNMENTS=31273 CHECKS=2360280	SAT TT=10.026 ASSIGNMENTS=8886 CHECKS=578393	SAT TT=131.506	SAT TT=24.026 ASSIGNMENTS=18289 CHECKS=1333380	SAT TT=31.575 ASSIGNMENTS=23984 CHECKS=1805910	? (MO) TT=33.896	SAT TT=1169.48 ASSIGNMENTS=919 CHECKS=25025400	SAT TT=388.49	SAT TT=100.415
csp/lexVg/ normalized-crossword-m1c-lex-vg5-7_ext.xml	UNSAT TT=113.01	UNSAT TT=113.01 CHECKS=553586 NODES=217904	UNSAT TT=121.249 CHECKS=555619 NODES=222056	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=1042.07 ASSIGNMENTS=86032	UNSAT TT=1353.24 ASSIGNMENTS=73497	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=116.863 ASSIGNMENTS=217904 CHECKS=553586	UNSAT TT=116.706 ASSIGNMENTS=217904 CHECKS=553586	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=248.753 CHECKS=10004200	UNSAT TT=230.921 ASSIGNMENTS=134726 CHECKS=11781500	UNSAT TT=273.408 ASSIGNMENTS=155190 CHECKS=13480400	UNSAT TT=1468.67	UNSAT TT=294.211 ASSIGNMENTS=162921 CHECKS=14358100	UNSAT TT=275.054 ASSIGNMENTS=149956 CHECKS=13027900	? (MO) TT=36.928	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.13
csp/lexVg/ normalized-crossword-m1c-lex-vg5-8_ext.xml	UNSAT TT=54.047	UNSAT TT=54.047 CHECKS=177197 NODES=79365	UNSAT TT=73.236 CHECKS=192182 NODES=96226	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=463.75 ASSIGNMENTS=37211	UNSAT TT=525.961 ASSIGNMENTS=27337	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=61.254 ASSIGNMENTS=79365 CHECKS=177197	UNSAT TT=61.763 ASSIGNMENTS=79365 CHECKS=177197	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=111.967 CHECKS=4011410	UNSAT TT=149.995 ASSIGNMENTS=66894 CHECKS=6523850	UNSAT TT=128.855 ASSIGNMENTS=59690 CHECKS=5669970	UNSAT TT=785.589	UNSAT TT=132.879 ASSIGNMENTS=59941 CHECKS=5923160	UNSAT TT=141.269 ASSIGNMENTS=68671 CHECKS=6687120	? (MO) TT=31.666	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.11
csp/lexVg/ normalized-crossword-m1c-lex-vg5-9_ext.xml	UNSAT TT=24.422	UNSAT TT=26.015 CHECKS=39642 NODES=26821	UNSAT TT=24.422 CHECKS=45677 NODES=26632	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=681.814 CHECKS=2370920	UNSAT TT=99.853 ASSIGNMENTS=6430	UNSAT TT=227.732 ASSIGNMENTS=9209	UNSAT TT=1471.33 CHECKS=19400100000 NODES=32922	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=31.488 ASSIGNMENTS=26821 CHECKS=39642	UNSAT TT=31.45 ASSIGNMENTS=26821 CHECKS=39642	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=73.371 CHECKS=2175040	UNSAT TT=39.676 ASSIGNMENTS=16104 CHECKS=1751530	UNSAT TT=41.817 ASSIGNMENTS=17833 CHECKS=1817980	UNSAT TT=425.674	UNSAT TT=55.295 ASSIGNMENTS=21432 CHECKS=2264480	UNSAT TT=42.57 ASSIGNMENTS=16042 CHECKS=1744540	? (MO) TT=32.274	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg6-10_ext.xml	UNSAT TT=9.73	UNSAT TT=11.104 CHECKS=8326 NODES=6470	UNSAT TT=9.73 CHECKS=7068 NODES=5945	? (TO) TT=1800.11	UNSAT TT=253.363 CHECKS=685443	UNSAT TT=189.733 CHECKS=560726	UNSAT TT=44.96 ASSIGNMENTS=1818	UNSAT TT=170.455 ASSIGNMENTS=4764	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=18.029 ASSIGNMENTS=6470 CHECKS=8326	UNSAT TT=18.838 ASSIGNMENTS=6470 CHECKS=8326	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=28.994 CHECKS=407705	UNSAT TT=16.8 ASSIGNMENTS=4326 CHECKS=580228	UNSAT TT=25.002 ASSIGNMENTS=7420 CHECKS=832156	UNSAT TT=137.664	UNSAT TT=16.611 ASSIGNMENTS=4523 CHECKS=562966	UNSAT TT=17.585 ASSIGNMENTS=4497 CHECKS=604233	? TT=70.152	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.02
csp/lexVg/ normalized-crossword-m1c-lex-vg6-6_ext.xml	SAT TT=0.038	SAT TT=1.792 CHECKS=1191 NODES=1338	SAT TT=2.302 CHECKS=1818 NODES=1929	? (TO) TT=1800.05	SAT TT=5.758 CHECKS=29328	SAT TT=9.541 CHECKS=51071	SAT TT=13.062 ASSIGNMENTS=741	SAT TT=16.543 ASSIGNMENTS=644	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1.115 ASSIGNMENTS=580 CHECKS=52453	SAT TT=1.13 ASSIGNMENTS=580 CHECKS=52453	SAT TT=468.03	SAT TT=84.71	SAT TT=0.618 CHECKS=24183	SAT TT=9.907 ASSIGNMENTS=5182 CHECKS=487622	SAT TT=5.45 ASSIGNMENTS=3669 CHECKS=220267	SAT TT=25.22	SAT TT=0.038 ASSIGNMENTS=18 CHECKS=1051	SAT TT=1.119 ASSIGNMENTS=580 CHECKS=52453	? TT=81.992	SAT TT=344.255 ASSIGNMENTS=861 CHECKS=692529000	SAT TT=168.793	SAT TT=265.099
csp/lexVg/ normalized-crossword-m1c-lex-vg6-8_ext.xml	UNSAT TT=81.531	UNSAT TT=81.531 CHECKS=184004 NODES=86556	UNSAT TT=85.263 CHECKS=165544 NODES=82937	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=382.009 ASSIGNMENTS=21381	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.1	UNSAT TT=94.433 ASSIGNMENTS=86556 CHECKS=184004	UNSAT TT=88.698 ASSIGNMENTS=86556 CHECKS=184004	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=200.206 CHECKS=4343720	UNSAT TT=139.865 ASSIGNMENTS=48746 CHECKS=5602740	UNSAT TT=144.642 ASSIGNMENTS=50798 CHECKS=5777040	UNSAT TT=1588.24	UNSAT TT=155.979 ASSIGNMENTS=50043 CHECKS=5808880	UNSAT TT=147.117 ASSIGNMENTS=50737 CHECKS=5833450	? TT=76.066	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09
csp/lexVg/ normalized-crossword-m1c-lex-vg6-9_ext.xml	UNSAT TT=28.952	UNSAT TT=39.342 CHECKS=56094 NODES=28413	UNSAT TT=28.952 CHECKS=39520 NODES=20961	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=803.118 CHECKS=2408340	UNSAT TT=166.768 ASSIGNMENTS=8020	UNSAT TT=851.778 ASSIGNMENTS=25462	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=43.435 ASSIGNMENTS=28413 CHECKS=56094	UNSAT TT=43.196 ASSIGNMENTS=28413 CHECKS=56094	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=93.842 CHECKS=1681860	UNSAT TT=64.502 ASSIGNMENTS=17705 CHECKS=2225640	UNSAT TT=55.206 ASSIGNMENTS=16800 CHECKS=2007220	UNSAT TT=620.48	UNSAT TT=46.203 ASSIGNMENTS=12884 CHECKS=1590250	UNSAT TT=58.808 ASSIGNMENTS=15940 CHECKS=2046330	? TT=77.226	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04
csp/lexVg/ normalized-crossword-m1c-lex-vg7-10_ext.xml	UNSAT TT=10.191	UNSAT TT=10.191 CHECKS=2573 NODES=5081	UNSAT TT=10.815 CHECKS=4929 NODES=5427	? (TO) TT=1800.03	UNSAT TT=321.609 CHECKS=778394	UNSAT TT=204.588 CHECKS=469694	UNSAT TT=34.439 ASSIGNMENTS=885	UNSAT TT=135.204 ASSIGNMENTS=3112	UNSAT TT=20.883 CHECKS=0 NODES=5397	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=16.559 ASSIGNMENTS=5081 CHECKS=2573	UNSAT TT=17.843 ASSIGNMENTS=5081 CHECKS=2573	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=66.523 CHECKS=802216	UNSAT TT=19.345 ASSIGNMENTS=3904 CHECKS=593591	UNSAT TT=27.061 ASSIGNMENTS=6624 CHECKS=797786	UNSAT TT=171.092	UNSAT TT=13.506 ASSIGNMENTS=3128 CHECKS=416562	UNSAT TT=18.522 ASSIGNMENTS=3720 CHECKS=568056	? TT=76.499	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.02
csp/lexVg/ normalized-crossword-m1c-lex-vg7-8_ext.xml	UNSAT TT=81.69	UNSAT TT=87.174 CHECKS=201289 NODES=72247	UNSAT TT=81.69 CHECKS=201777 NODES=66473	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=1397.94 CHECKS=3717400	UNSAT TT=350.519 ASSIGNMENTS=15347	UNSAT TT=1296.04 ASSIGNMENTS=35283	UNSAT TT=257.786 CHECKS=0 NODES=105887	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=88.609 ASSIGNMENTS=72247 CHECKS=201289	UNSAT TT=88.827 ASSIGNMENTS=72247 CHECKS=201289	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=254.472 CHECKS=4424240	UNSAT TT=250.017 ASSIGNMENTS=61554 CHECKS=8324050	UNSAT TT=142.02 ASSIGNMENTS=35950 CHECKS=4527790	UNSAT TT=1367.69	UNSAT TT=223.413 ASSIGNMENTS=55319 CHECKS=7251720	UNSAT TT=190.978 ASSIGNMENTS=46456 CHECKS=6124340	? TT=91.849	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09
csp/lexVg/ normalized-crossword-m1c-lex-vg7-9_ext.xml	UNSAT TT=30.657	UNSAT TT=30.657 CHECKS=41191 NODES=21224	UNSAT TT=33.966 CHECKS=56096 NODES=21473	? (TO) TT=1800.13	UNSAT TT=914.653 CHECKS=2276300	UNSAT TT=721.99 CHECKS=1838910	UNSAT TT=586.789 ASSIGNMENTS=19560	UNSAT TT=335.795 ASSIGNMENTS=8491	UNSAT TT=93.068 CHECKS=0 NODES=31989	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=37.412 ASSIGNMENTS=21224 CHECKS=41191	UNSAT TT=37.23 ASSIGNMENTS=21224 CHECKS=41191	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=135.989 CHECKS=2042900	UNSAT TT=70.163 ASSIGNMENTS=15252 CHECKS=2164980	UNSAT TT=58.358 ASSIGNMENTS=13817 CHECKS=1746510	UNSAT TT=466.618	UNSAT TT=51.589 ASSIGNMENTS=11677 CHECKS=1591190	UNSAT TT=49.639 ASSIGNMENTS=11558 CHECKS=1636660	? TT=89.817	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.02
csp/lexVg/ normalized-crossword-m1c-lex-vg8-12_ext.xml	UNSAT TT=1.051	UNSAT TT=1.642 CHECKS=33 NODES=220	UNSAT TT=3.16 CHECKS=28 NODES=191	? (TO) TT=1800.05	UNSAT TT=51.803 CHECKS=123458	UNSAT TT=16.962 CHECKS=35104	UNSAT TT=15.986 ASSIGNMENTS=20	UNSAT TT=16.241 ASSIGNMENTS=16	UNSAT TT=2.011 CHECKS=0 NODES=264	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=1.222 ASSIGNMENTS=209 CHECKS=33829	UNSAT TT=1.221 ASSIGNMENTS=209 CHECKS=33829	UNSAT TT=94.475	UNSAT TT=43.092	UNSAT TT=1.968 CHECKS=17670	UNSAT TT=1.051 ASSIGNMENTS=183 CHECKS=29040	UNSAT TT=14.854 ASSIGNMENTS=3437 CHECKS=401250	UNSAT TT=10.053	UNSAT TT=4.622 ASSIGNMENTS=1230 CHECKS=126819	UNSAT TT=1.194 ASSIGNMENTS=209 CHECKS=33829	? TT=33.488	? (TO) TT=1800.07	UNSAT TT=165.665	? (TO) TT=1800.09
csp/lexVg/ normalized-crossword-m1c-lex-vg8-8_ext.xml	UNSAT TT=41.382	UNSAT TT=44.378 CHECKS=57921 NODES=25529	UNSAT TT=41.382 CHECKS=60510 NODES=26356	? (TO) TT=1800.06	UNSAT TT=665.823 CHECKS=2337270	UNSAT TT=1058.7 CHECKS=3496070	UNSAT TT=624.682 ASSIGNMENTS=20986	? (TO) TT=1800.07	UNSAT TT=117.416 CHECKS=0 NODES=37004	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=49.505 ASSIGNMENTS=25047 CHECKS=57145	UNSAT TT=52.717 ASSIGNMENTS=25047 CHECKS=57145	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=117.481 CHECKS=1866740	UNSAT TT=126.588 ASSIGNMENTS=27845 CHECKS=4042700	UNSAT TT=76.948 ASSIGNMENTS=17353 CHECKS=2324880	UNSAT TT=560.966	UNSAT TT=123.224 ASSIGNMENTS=26884 CHECKS=3848170	UNSAT TT=81.442 ASSIGNMENTS=17445 CHECKS=2518560	? TT=32.642	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07
csp/lexVg/ normalized-crossword-m1c-lex-vg8-9_ext.xml	UNSAT TT=16.812	UNSAT TT=16.812 CHECKS=11528 NODES=7482	UNSAT TT=19.493 CHECKS=18281 NODES=8704	? (TO) TT=1800.06	UNSAT TT=497.331 CHECKS=1061760	UNSAT TT=315.34 CHECKS=676415	UNSAT TT=95.673 ASSIGNMENTS=2788	UNSAT TT=654.701 ASSIGNMENTS=12117	UNSAT TT=40.437 CHECKS=0 NODES=9731	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=23.768 ASSIGNMENTS=7482 CHECKS=11528	UNSAT TT=24.03 ASSIGNMENTS=7482 CHECKS=11528	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=68.586 CHECKS=737436	UNSAT TT=30.558 ASSIGNMENTS=5550 CHECKS=869739	UNSAT TT=39.64 ASSIGNMENTS=8434 CHECKS=1100810	UNSAT TT=539.045	UNSAT TT=21.744 ASSIGNMENTS=4366 CHECKS=628606	UNSAT TT=39.919 ASSIGNMENTS=7439 CHECKS=1135480	? TT=24.921	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg9-10_ext.xml	UNSAT TT=5.347	UNSAT TT=5.347 CHECKS=149 NODES=1309	UNSAT TT=5.434 CHECKS=129 NODES=1252	? (TO) TT=1800.09	UNSAT TT=116.417 CHECKS=235006	UNSAT TT=97.733 CHECKS=171745	UNSAT TT=25.666 ASSIGNMENTS=290	UNSAT TT=143.003 ASSIGNMENTS=2171	UNSAT TT=10.453 CHECKS=0 NODES=1606	? (TO) TT=1800	? (TO) TT=1800.1	UNSAT TT=12.375 ASSIGNMENTS=1309 CHECKS=149	UNSAT TT=12.945 ASSIGNMENTS=1309 CHECKS=149	UNSAT TT=535.569	UNSAT TT=464.654	UNSAT TT=18.442 CHECKS=140229	UNSAT TT=6.353 ASSIGNMENTS=969 CHECKS=188303	UNSAT TT=21.078 ASSIGNMENTS=4384 CHECKS=545587	UNSAT TT=59.797	UNSAT TT=11.228 ASSIGNMENTS=2238 CHECKS=305118	UNSAT TT=7.269 ASSIGNMENTS=1047 CHECKS=203531	? TT=31.714	? (TO) TT=1800.04	UNSAT TT=1389.91	? (TO) TT=1800.03
csp/lexVg/ normalized-crossword-m1c-lex-vg9-12_ext.xml	UNSAT TT=0.747	UNSAT TT=1.275 CHECKS=0 NODES=103	UNSAT TT=3.472 CHECKS=0 NODES=109	? (TO) TT=1800.08	UNSAT TT=30.283 CHECKS=75131	UNSAT TT=11.949 CHECKS=25367	UNSAT TT=19.074 ASSIGNMENTS=0	UNSAT TT=18.929 ASSIGNMENTS=0	UNSAT TT=1.757 CHECKS=0 NODES=152	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.942 ASSIGNMENTS=156 CHECKS=25448	UNSAT TT=0.937 ASSIGNMENTS=156 CHECKS=25448	UNSAT TT=57.316	UNSAT TT=44.296	UNSAT TT=2.892 CHECKS=19941	UNSAT TT=0.747 ASSIGNMENTS=118 CHECKS=19036	UNSAT TT=16.836 ASSIGNMENTS=3356 CHECKS=430306	UNSAT TT=10.644	UNSAT TT=5.721 ASSIGNMENTS=1389 CHECKS=146535	UNSAT TT=0.998 ASSIGNMENTS=156 CHECKS=25448	? TT=39.105	? (TO) TT=1800.1	UNSAT TT=155.094	? (TO) TT=1800.07
csp/lexVg/ normalized-crossword-m1c-lex-vg9-9_ext.xml	UNSAT TT=10.384	UNSAT TT=10.384 CHECKS=1840 NODES=3110	UNSAT TT=12.865 CHECKS=2142 NODES=3871	? (TO) TT=1800.09	UNSAT TT=206.949 CHECKS=545607	UNSAT TT=200.06 CHECKS=595263	UNSAT TT=44.966 ASSIGNMENTS=859	UNSAT TT=223.399 ASSIGNMENTS=4120	UNSAT TT=32.394 CHECKS=0 NODES=5241	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=17.56 ASSIGNMENTS=3450 CHECKS=2792	UNSAT TT=17.928 ASSIGNMENTS=3450 CHECKS=2792	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=26.255 CHECKS=274715	UNSAT TT=20.787 ASSIGNMENTS=3398 CHECKS=577238	UNSAT TT=28.083 ASSIGNMENTS=5806 CHECKS=732491	UNSAT TT=155.491	UNSAT TT=16.293 ASSIGNMENTS=3385 CHECKS=478366	UNSAT TT=16.977 ASSIGNMENTS=2892 CHECKS=461466	? TT=38.363	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09
csp/modifiedRenault/ normalized-renault-mod-0_ext.xml	SAT TT=0.586	SAT TT=1.958 CHECKS=3626 NODES=523	SAT TT=1.766 CHECKS=1487 NODES=0	SAT TT=917.438	SAT TT=37.664 CHECKS=101021	SAT TT=6.888 CHECKS=14856	SAT TT=5.155 ASSIGNMENTS=19	SAT TT=5.03 ASSIGNMENTS=35	SAT TT=84.176 CHECKS=101284000 NODES=156	SAT TT=1399 CHECKS=557903000 NODES=-1590470000	? (TO) TT=1800.05	SAT TT=0.598 ASSIGNMENTS=40 CHECKS=1423	SAT TT=0.617 ASSIGNMENTS=40 CHECKS=1423	SAT TT=13.541	SAT TT=10.973	SAT TT=1.053 CHECKS=903	SAT TT=0.615 ASSIGNMENTS=40 CHECKS=1423	SAT TT=0.662 ASSIGNMENTS=134 CHECKS=4246	SAT TT=5.722	SAT TT=1.158 ASSIGNMENTS=501 CHECKS=45371	SAT TT=0.586 ASSIGNMENTS=40 CHECKS=1423	? TT=46.175	SAT TT=1.4 ASSIGNMENTS=202 CHECKS=25542	SAT TT=7.595	SAT TT=8.073
csp/modifiedRenault/ normalized-renault-mod-10_ext.xml	UNSAT TT=0.749	UNSAT TT=1.886 CHECKS=1969 NODES=466	UNSAT TT=2.212 CHECKS=3217 NODES=440	? (TO) TT=1800.07	UNSAT TT=6.491 CHECKS=30544	UNSAT TT=7.508 CHECKS=38433	UNSAT TT=5.156 ASSIGNMENTS=224	UNSAT TT=166.284 ASSIGNMENTS=32934	UNSAT TT=68.165 CHECKS=40090600 NODES=154	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=0.749 ASSIGNMENTS=910 CHECKS=29032	UNSAT TT=0.751 ASSIGNMENTS=910 CHECKS=29032	UNSAT TT=10.281	UNSAT TT=9.332	UNSAT TT=1.313 CHECKS=10769	UNSAT TT=0.774 ASSIGNMENTS=901 CHECKS=28428	UNSAT TT=2.664 ASSIGNMENTS=5421 CHECKS=137844	UNSAT TT=5.138	UNSAT TT=1.162 ASSIGNMENTS=1518 CHECKS=65435	UNSAT TT=0.808 ASSIGNMENTS=910 CHECKS=29032	? TT=129.243	UNSAT TT=1.719 ASSIGNMENTS=88 CHECKS=50227	UNSAT TT=7.577	UNSAT TT=8.504
csp/modifiedRenault/ normalized-renault-mod-11_ext.xml	SAT TT=0.537	SAT TT=1.638 CHECKS=673 NODES=116	SAT TT=1.81 CHECKS=1360 NODES=115	SAT TT=911.968	SAT TT=8.224 CHECKS=22812	SAT TT=6.057 CHECKS=13873	SAT TT=4.188 ASSIGNMENTS=26	SAT TT=4.62 ASSIGNMENTS=91	SAT TT=70.806 CHECKS=39912500 NODES=111	SAT TT=684.737 CHECKS=630211000 NODES=980250000	? (TO) TT=1800.08	SAT TT=0.558 ASSIGNMENTS=22 CHECKS=924	SAT TT=0.553 ASSIGNMENTS=22 CHECKS=924	SAT TT=12.169	SAT TT=11.445	SAT TT=1.059 CHECKS=1630	SAT TT=0.582 ASSIGNMENTS=22 CHECKS=924	SAT TT=0.6 ASSIGNMENTS=148 CHECKS=4412	SAT TT=5.276	SAT TT=0.584 ASSIGNMENTS=53 CHECKS=1669	SAT TT=0.537 ASSIGNMENTS=22 CHECKS=924	? TT=45.094	SAT TT=1.428 ASSIGNMENTS=152 CHECKS=48746	SAT TT=7.434	SAT TT=8.231
csp/modifiedRenault/ normalized-renault-mod-12_ext.xml	UNSAT TT=0.689	UNSAT TT=2.284 CHECKS=5192 NODES=378	UNSAT TT=1.795 CHECKS=1383 NODES=0	? (TO) TT=1800.07	UNSAT TT=22.409 CHECKS=63692	UNSAT TT=8.276 CHECKS=36129	UNSAT TT=4.338 ASSIGNMENTS=0	UNSAT TT=4.366 ASSIGNMENTS=0	UNSAT TT=68.559 CHECKS=39967600 NODES=32	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=0.706 ASSIGNMENTS=148 CHECKS=9814	UNSAT TT=0.719 ASSIGNMENTS=148 CHECKS=9814	UNSAT TT=9.044	UNSAT TT=8.545	UNSAT TT=1.112 CHECKS=16907	UNSAT TT=0.769 ASSIGNMENTS=298 CHECKS=18751	UNSAT TT=3.217 ASSIGNMENTS=4792 CHECKS=178896	UNSAT TT=4.993	UNSAT TT=1.409 ASSIGNMENTS=475 CHECKS=50686	UNSAT TT=0.689 ASSIGNMENTS=148 CHECKS=9814	? TT=61.249	UNSAT TT=1.498 ASSIGNMENTS=294 CHECKS=287261	UNSAT TT=7.535	UNSAT TT=8.295
csp/modifiedRenault/ normalized-renault-mod-13_ext.xml	SAT TT=0.545	SAT TT=1.584 CHECKS=669 NODES=117	SAT TT=1.741 CHECKS=1200 NODES=125	SAT TT=16.185	SAT TT=5.812 CHECKS=14726	SAT TT=5.143 CHECKS=14131	SAT TT=4.148 ASSIGNMENTS=27	SAT TT=4.736 ASSIGNMENTS=60	SAT TT=125.437 CHECKS=243215000 NODES=239	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=0.599 ASSIGNMENTS=42 CHECKS=1620	SAT TT=0.555 ASSIGNMENTS=42 CHECKS=1620	SAT TT=12.962	SAT TT=11.901	SAT TT=1.06 CHECKS=2230	SAT TT=0.587 ASSIGNMENTS=42 CHECKS=1620	SAT TT=1.005 ASSIGNMENTS=1029 CHECKS=32077	SAT TT=5.019	SAT TT=1.049 ASSIGNMENTS=679 CHECKS=43700	SAT TT=0.545 ASSIGNMENTS=42 CHECKS=1620	? TT=56.712	SAT TT=1.484 ASSIGNMENTS=165 CHECKS=26701	SAT TT=8.03	SAT TT=8.516
csp/modifiedRenault/ normalized-renault-mod-14_ext.xml	UNSAT TT=0.661	UNSAT TT=2.037 CHECKS=2983 NODES=243	UNSAT TT=2.349 CHECKS=5227 NODES=302	? (TO) TT=1800.06	UNSAT TT=23.798 CHECKS=62150	UNSAT TT=7.787 CHECKS=29979	UNSAT TT=5.495 ASSIGNMENTS=72	UNSAT TT=8.924 ASSIGNMENTS=574	UNSAT TT=72.756 CHECKS=39978200 NODES=64	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.665 ASSIGNMENTS=278 CHECKS=12018	UNSAT TT=0.663 ASSIGNMENTS=278 CHECKS=12018	UNSAT TT=9.645	UNSAT TT=8.761	UNSAT TT=1.107 CHECKS=11572	UNSAT TT=0.758 ASSIGNMENTS=541 CHECKS=23880	UNSAT TT=2.971 ASSIGNMENTS=5276 CHECKS=160311	UNSAT TT=5.921	UNSAT TT=0.88 ASSIGNMENTS=407 CHECKS=34354	UNSAT TT=0.661 ASSIGNMENTS=278 CHECKS=12018	? TT=74.054	UNSAT TT=1.664 ASSIGNMENTS=402 CHECKS=429170	UNSAT TT=7.707	UNSAT TT=8.421
csp/modifiedRenault/ normalized-renault-mod-16_ext.xml	UNSAT TT=0.728	UNSAT TT=2.308 CHECKS=2463 NODES=805	UNSAT TT=2.328 CHECKS=3123 NODES=798	? (TO) TT=1800.09	UNSAT TT=7.494 CHECKS=38231	UNSAT TT=6.68 CHECKS=43301	UNSAT TT=5.987 ASSIGNMENTS=777	UNSAT TT=95.609 ASSIGNMENTS=54837	UNSAT TT=72.823 CHECKS=40088800 NODES=211	? (TO) TT=1800.1	? (TO) TT=1800	UNSAT TT=0.728 ASSIGNMENTS=1303 CHECKS=48533	UNSAT TT=0.81 ASSIGNMENTS=1303 CHECKS=48533	UNSAT TT=10.047	UNSAT TT=8.767	UNSAT TT=1.142 CHECKS=20062	UNSAT TT=0.787 ASSIGNMENTS=1343 CHECKS=49320	UNSAT TT=2.603 ASSIGNMENTS=5486 CHECKS=158224	UNSAT TT=5.672	UNSAT TT=1.216 ASSIGNMENTS=1537 CHECKS=74974	UNSAT TT=0.761 ASSIGNMENTS=1303 CHECKS=48533	? TT=47.966	UNSAT TT=1.789 ASSIGNMENTS=738 CHECKS=386796	UNSAT TT=7.661	UNSAT TT=8.553
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/modifiedRenault/ normalized-renault-mod-17_ext.xml	UNSAT TT=0.669	UNSAT TT=2.371 CHECKS=6031 NODES=495	UNSAT TT=1.789 CHECKS=797 NODES=0	? (TO) TT=1800.1	UNSAT TT=13.595 CHECKS=37874	UNSAT TT=13.728 CHECKS=48337	UNSAT TT=5.616 ASSIGNMENTS=0	UNSAT TT=5.636 ASSIGNMENTS=0	UNSAT TT=72.26 CHECKS=46176000 NODES=43	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=0.685 ASSIGNMENTS=104 CHECKS=6206	UNSAT TT=0.682 ASSIGNMENTS=104 CHECKS=6206	UNSAT TT=10.219	UNSAT TT=8.764	UNSAT TT=1.291 CHECKS=7008	UNSAT TT=0.745 ASSIGNMENTS=219 CHECKS=11739	UNSAT TT=2.935 ASSIGNMENTS=5053 CHECKS=161976	UNSAT TT=5.202	UNSAT TT=1.287 ASSIGNMENTS=541 CHECKS=56023	UNSAT TT=0.669 ASSIGNMENTS=104 CHECKS=6206	? TT=53.293	UNSAT TT=1.567 ASSIGNMENTS=103 CHECKS=160279	UNSAT TT=7.883	UNSAT TT=8.847
csp/modifiedRenault/ normalized-renault-mod-18_ext.xml	UNSAT TT=0.667	UNSAT TT=2.002 CHECKS=3110 NODES=540	UNSAT TT=2.258 CHECKS=2523 NODES=512	? (TO) TT=1800.12	UNSAT TT=6.563 CHECKS=29093	UNSAT TT=6.656 CHECKS=27980	UNSAT TT=5.227 ASSIGNMENTS=169	UNSAT TT=59.376 ASSIGNMENTS=28546	UNSAT TT=72.67 CHECKS=39992900 NODES=89	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.685 ASSIGNMENTS=565 CHECKS=18446	UNSAT TT=0.685 ASSIGNMENTS=565 CHECKS=18446	UNSAT TT=10.407	UNSAT TT=8.647	UNSAT TT=1.329 CHECKS=8632	UNSAT TT=0.695 ASSIGNMENTS=607 CHECKS=19705	UNSAT TT=2.646 ASSIGNMENTS=5351 CHECKS=145590	UNSAT TT=5.25	UNSAT TT=0.909 ASSIGNMENTS=464 CHECKS=35515	UNSAT TT=0.667 ASSIGNMENTS=565 CHECKS=18446	? TT=56.946	UNSAT TT=1.578 ASSIGNMENTS=262 CHECKS=115516	UNSAT TT=7.676	UNSAT TT=8.01
csp/modifiedRenault/ normalized-renault-mod-19_ext.xml	UNSAT TT=0.626	UNSAT TT=1.856 CHECKS=1700 NODES=532	UNSAT TT=2.546 CHECKS=3886 NODES=487	? (TO) TT=1800.12	UNSAT TT=21.086 CHECKS=61613	UNSAT TT=6.182 CHECKS=21886	UNSAT TT=3.765 ASSIGNMENTS=0	UNSAT TT=3.844 ASSIGNMENTS=0	UNSAT TT=73.141 CHECKS=39994500 NODES=59	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.626 ASSIGNMENTS=169 CHECKS=8262	UNSAT TT=0.667 ASSIGNMENTS=169 CHECKS=8262	UNSAT TT=8.918	UNSAT TT=10.172	UNSAT TT=1.094 CHECKS=9927	UNSAT TT=0.72 ASSIGNMENTS=357 CHECKS=18774	UNSAT TT=2.457 ASSIGNMENTS=5324 CHECKS=137622	UNSAT TT=5.467	UNSAT TT=0.908 ASSIGNMENTS=482 CHECKS=37874	UNSAT TT=0.661 ASSIGNMENTS=169 CHECKS=8262	? TT=51.966	UNSAT TT=1.551 ASSIGNMENTS=169 CHECKS=144994	UNSAT TT=7.676	UNSAT TT=7.957
csp/modifiedRenault/ normalized-renault-mod-1_ext.xml	UNSAT TT=0.649	UNSAT TT=1.85 CHECKS=1408 NODES=63	UNSAT TT=1.789 CHECKS=787 NODES=0	? (TO) TT=1800.09	UNSAT TT=16.162 CHECKS=59393	UNSAT TT=7.117 CHECKS=30527	UNSAT TT=3.813 ASSIGNMENTS=0	UNSAT TT=3.59 ASSIGNMENTS=0	UNSAT TT=84.224 CHECKS=91225600 NODES=42	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.665 ASSIGNMENTS=101 CHECKS=5324	UNSAT TT=0.676 ASSIGNMENTS=101 CHECKS=5324	UNSAT TT=10.231	UNSAT TT=9.49	UNSAT TT=1.239 CHECKS=11261	UNSAT TT=0.766 ASSIGNMENTS=286 CHECKS=13200	UNSAT TT=2.357 ASSIGNMENTS=5127 CHECKS=165726	UNSAT TT=5.293	UNSAT TT=0.888 ASSIGNMENTS=339 CHECKS=29363	UNSAT TT=0.649 ASSIGNMENTS=101 CHECKS=5324	? TT=50.207	UNSAT TT=1.476 ASSIGNMENTS=268 CHECKS=198173	UNSAT TT=7.902	UNSAT TT=8.127
csp/modifiedRenault/ normalized-renault-mod-20_ext.xml	UNSAT TT=0.66	UNSAT TT=2.5 CHECKS=5667 NODES=504	UNSAT TT=2.667 CHECKS=5542 NODES=460	? (TO) TT=1800.13	UNSAT TT=28.31 CHECKS=124829	UNSAT TT=8.153 CHECKS=46720	UNSAT TT=4.066 ASSIGNMENTS=0	UNSAT TT=4.129 ASSIGNMENTS=0	UNSAT TT=119.764 CHECKS=243225000 NODES=57	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.721 ASSIGNMENTS=129 CHECKS=15234	UNSAT TT=0.727 ASSIGNMENTS=129 CHECKS=15234	UNSAT TT=10.551	UNSAT TT=9.609	UNSAT TT=1.125 CHECKS=15273	UNSAT TT=0.725 ASSIGNMENTS=237 CHECKS=23353	UNSAT TT=2.674 ASSIGNMENTS=4933 CHECKS=246583	UNSAT TT=5.546	UNSAT TT=1.017 ASSIGNMENTS=371 CHECKS=48210	UNSAT TT=0.66 ASSIGNMENTS=129 CHECKS=15234	? TT=122.496	UNSAT TT=2.123 ASSIGNMENTS=626 CHECKS=1121500	UNSAT TT=7.603	UNSAT TT=8.355
csp/modifiedRenault/ normalized-renault-mod-21_ext.xml	UNSAT TT=0.648	UNSAT TT=2.037 CHECKS=3583 NODES=248	UNSAT TT=2.326 CHECKS=3930 NODES=235	? (TO) TT=1800.13	UNSAT TT=13.146 CHECKS=67969	UNSAT TT=7.624 CHECKS=42925	UNSAT TT=5.777 ASSIGNMENTS=118	UNSAT TT=12.387 ASSIGNMENTS=1729	UNSAT TT=67.82 CHECKS=40040800 NODES=70	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.648 ASSIGNMENTS=320 CHECKS=19660	UNSAT TT=0.701 ASSIGNMENTS=320 CHECKS=19660	UNSAT TT=10.441	UNSAT TT=10.093	UNSAT TT=1.216 CHECKS=22417	UNSAT TT=0.739 ASSIGNMENTS=585 CHECKS=34379	UNSAT TT=2.959 ASSIGNMENTS=5148 CHECKS=185284	UNSAT TT=5.774	UNSAT TT=1.241 ASSIGNMENTS=479 CHECKS=46920	UNSAT TT=0.684 ASSIGNMENTS=320 CHECKS=19660	? TT=93.144	UNSAT TT=1.529 ASSIGNMENTS=301 CHECKS=240401	UNSAT TT=8.042	UNSAT TT=7.829
csp/modifiedRenault/ normalized-renault-mod-22_ext.xml	UNSAT TT=0.672	UNSAT TT=2.021 CHECKS=1765 NODES=401	UNSAT TT=2.297 CHECKS=2874 NODES=266	? (TO) TT=1800.07	UNSAT TT=20.658 CHECKS=64436	UNSAT TT=8.351 CHECKS=42912	UNSAT TT=8.464 ASSIGNMENTS=0	UNSAT TT=4.721 ASSIGNMENTS=0	UNSAT TT=68.154 CHECKS=39988900 NODES=47	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.672 ASSIGNMENTS=208 CHECKS=16290	UNSAT TT=0.717 ASSIGNMENTS=208 CHECKS=16290	UNSAT TT=11.927	UNSAT TT=8.896	UNSAT TT=1.103 CHECKS=23084	UNSAT TT=0.776 ASSIGNMENTS=364 CHECKS=31816	UNSAT TT=3.25 ASSIGNMENTS=5219 CHECKS=177267	UNSAT TT=5.024	UNSAT TT=1.057 ASSIGNMENTS=571 CHECKS=47708	UNSAT TT=0.712 ASSIGNMENTS=208 CHECKS=16290	? TT=91.479	UNSAT TT=1.48 ASSIGNMENTS=106 CHECKS=107428	UNSAT TT=7.339	UNSAT TT=7.936
csp/modifiedRenault/ normalized-renault-mod-23_ext.xml	UNSAT TT=0.727	UNSAT TT=2.188 CHECKS=6738 NODES=426	UNSAT TT=2.394 CHECKS=6016 NODES=404	? (TO) TT=1800.05	UNSAT TT=19.088 CHECKS=64596	UNSAT TT=12.985 CHECKS=68595	UNSAT TT=3.814 ASSIGNMENTS=0	UNSAT TT=3.847 ASSIGNMENTS=0	UNSAT TT=81.353 CHECKS=94440800 NODES=55	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=0.756 ASSIGNMENTS=213 CHECKS=18567	UNSAT TT=0.727 ASSIGNMENTS=213 CHECKS=18567	UNSAT TT=12.176	UNSAT TT=9.791	UNSAT TT=1.13 CHECKS=27042	UNSAT TT=0.859 ASSIGNMENTS=388 CHECKS=34039	UNSAT TT=2.475 ASSIGNMENTS=5281 CHECKS=192586	UNSAT TT=5.609	UNSAT TT=1.325 ASSIGNMENTS=822 CHECKS=75938	UNSAT TT=0.743 ASSIGNMENTS=213 CHECKS=18567	? TT=93.089	UNSAT TT=1.663 ASSIGNMENTS=367 CHECKS=441179	UNSAT TT=8.334	UNSAT TT=8.49
csp/modifiedRenault/ normalized-renault-mod-24_ext.xml	UNSAT TT=0.692	UNSAT TT=2.429 CHECKS=1356 NODES=140	UNSAT TT=1.901 CHECKS=1182 NODES=0	? (TO) TT=1800.1	UNSAT TT=16.308 CHECKS=58834	UNSAT TT=7.512 CHECKS=31884	UNSAT TT=4.743 ASSIGNMENTS=0	UNSAT TT=4.271 ASSIGNMENTS=0	UNSAT TT=70.045 CHECKS=39963600 NODES=51	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=0.692 ASSIGNMENTS=193 CHECKS=12290	UNSAT TT=0.736 ASSIGNMENTS=193 CHECKS=12290	UNSAT TT=10.855	UNSAT TT=9.894	UNSAT TT=1.196 CHECKS=18642	UNSAT TT=0.764 ASSIGNMENTS=248 CHECKS=17161	UNSAT TT=3.296 ASSIGNMENTS=5094 CHECKS=230564	UNSAT TT=5.303	UNSAT TT=1.052 ASSIGNMENTS=388 CHECKS=35259	UNSAT TT=0.724 ASSIGNMENTS=193 CHECKS=12290	? TT=96.454	UNSAT TT=1.55 ASSIGNMENTS=176 CHECKS=154826	UNSAT TT=7.901	UNSAT TT=8.577
csp/modifiedRenault/ normalized-renault-mod-26_ext.xml	UNSAT TT=0.682	UNSAT TT=2.505 CHECKS=2392 NODES=543	UNSAT TT=2.597 CHECKS=2736 NODES=525	? (TO) TT=1800.09	UNSAT TT=10.824 CHECKS=54195	UNSAT TT=6.777 CHECKS=38132	UNSAT TT=4.278 ASSIGNMENTS=82	UNSAT TT=13.152 ASSIGNMENTS=2319	UNSAT TT=68.897 CHECKS=40044200 NODES=85	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.752 ASSIGNMENTS=411 CHECKS=26129	UNSAT TT=0.7 ASSIGNMENTS=411 CHECKS=26129	UNSAT TT=12.103	UNSAT TT=10.246	UNSAT TT=1.414 CHECKS=15583	UNSAT TT=0.7 ASSIGNMENTS=419 CHECKS=28928	UNSAT TT=2.855 ASSIGNMENTS=5134 CHECKS=191794	UNSAT TT=6.08	UNSAT TT=1.067 ASSIGNMENTS=474 CHECKS=41607	UNSAT TT=0.682 ASSIGNMENTS=411 CHECKS=26129	? TT=101.112	UNSAT TT=1.611 ASSIGNMENTS=209 CHECKS=124708	UNSAT TT=8.778	UNSAT TT=7.986
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/modifiedRenault/ normalized-renault-mod-27_ext.xml	UNSAT TT=0.698	UNSAT TT=1.843 CHECKS=2627 NODES=187	UNSAT TT=1.765 CHECKS=786 NODES=0	? (TO) TT=1800.12	UNSAT TT=11.871 CHECKS=31145	UNSAT TT=14.613 CHECKS=51656	UNSAT TT=4.429 ASSIGNMENTS=0	UNSAT TT=4.492 ASSIGNMENTS=0	UNSAT TT=70.322 CHECKS=39983400 NODES=46	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=0.715 ASSIGNMENTS=109 CHECKS=9336	UNSAT TT=0.722 ASSIGNMENTS=109 CHECKS=9336	UNSAT TT=10.567	UNSAT TT=9.875	UNSAT TT=1.14 CHECKS=10834	UNSAT TT=0.756 ASSIGNMENTS=272 CHECKS=22197	UNSAT TT=1.128 ASSIGNMENTS=1112 CHECKS=43235	UNSAT TT=5.21	UNSAT TT=0.996 ASSIGNMENTS=337 CHECKS=34524	UNSAT TT=0.698 ASSIGNMENTS=109 CHECKS=9336	? TT=94.376	UNSAT TT=1.586 ASSIGNMENTS=75 CHECKS=69916	UNSAT TT=8.424	UNSAT TT=8.327
csp/modifiedRenault/ normalized-renault-mod-28_ext.xml	UNSAT TT=0.659	UNSAT TT=2.112 CHECKS=1712 NODES=224	UNSAT TT=2.071 CHECKS=2589 NODES=215	? (TO) TT=1800.09	UNSAT TT=44.444 CHECKS=119372	UNSAT TT=8.885 CHECKS=41601	UNSAT TT=4.714 ASSIGNMENTS=0	UNSAT TT=4.925 ASSIGNMENTS=0	UNSAT TT=71.084 CHECKS=40034700 NODES=54	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=0.723 ASSIGNMENTS=189 CHECKS=17363	UNSAT TT=0.672 ASSIGNMENTS=189 CHECKS=17363	UNSAT TT=12.031	UNSAT TT=9.828	UNSAT TT=1.212 CHECKS=20421	UNSAT TT=0.821 ASSIGNMENTS=391 CHECKS=34799	UNSAT TT=2.533 ASSIGNMENTS=5158 CHECKS=179476	UNSAT TT=5.591	UNSAT TT=1.99 ASSIGNMENTS=1536 CHECKS=140448	UNSAT TT=0.659 ASSIGNMENTS=189 CHECKS=17363	? (exit code) TT=120.609	UNSAT TT=1.799 ASSIGNMENTS=156 CHECKS=394915	UNSAT TT=8.12	UNSAT TT=9.292
csp/modifiedRenault/ normalized-renault-mod-29_ext.xml	UNSAT TT=0.728	UNSAT TT=1.95 CHECKS=21 NODES=9	UNSAT TT=2.057 CHECKS=1303 NODES=0	? (TO) TT=1800.06	UNSAT TT=8.079 CHECKS=25436	UNSAT TT=7.977 CHECKS=34564	UNSAT TT=3.328 ASSIGNMENTS=0	UNSAT TT=3.15 ASSIGNMENTS=0	UNSAT TT=67.8 CHECKS=39980600 NODES=40	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.728 ASSIGNMENTS=84 CHECKS=10879	UNSAT TT=0.734 ASSIGNMENTS=84 CHECKS=10879	UNSAT TT=10.659	UNSAT TT=9.692	UNSAT TT=1.094 CHECKS=11443	UNSAT TT=0.796 ASSIGNMENTS=124 CHECKS=15453	UNSAT TT=2.82 ASSIGNMENTS=4664 CHECKS=250101	UNSAT TT=5.726	UNSAT TT=0.971 ASSIGNMENTS=204 CHECKS=29409	UNSAT TT=0.728 ASSIGNMENTS=84 CHECKS=10879	? (exit code) TT=105.217	UNSAT TT=1.576 ASSIGNMENTS=126 CHECKS=227519	UNSAT TT=8.199	UNSAT TT=8.569
csp/modifiedRenault/ normalized-renault-mod-30_ext.xml	UNSAT TT=0.844	UNSAT TT=2.769 CHECKS=6588 NODES=609	UNSAT TT=3.453 CHECKS=7982 NODES=568	? (TO) TT=1800.07	UNSAT TT=49.513 CHECKS=174067	UNSAT TT=19.099 CHECKS=86332	UNSAT TT=4.848 ASSIGNMENTS=209	UNSAT TT=5.702 ASSIGNMENTS=397	UNSAT TT=327.083 CHECKS=1089730000 NODES=145	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.904 ASSIGNMENTS=338 CHECKS=33601	UNSAT TT=0.901 ASSIGNMENTS=338 CHECKS=33601	UNSAT TT=10.267	UNSAT TT=9.254	UNSAT TT=1.191 CHECKS=37209	UNSAT TT=0.888 ASSIGNMENTS=572 CHECKS=55353	UNSAT TT=3.736 ASSIGNMENTS=4821 CHECKS=258171	UNSAT TT=5.709	UNSAT TT=1.151 ASSIGNMENTS=502 CHECKS=51791	UNSAT TT=0.844 ASSIGNMENTS=338 CHECKS=33601	? TT=77.893	UNSAT TT=2.4 ASSIGNMENTS=100 CHECKS=918667	UNSAT TT=7.928	UNSAT TT=8.598
csp/modifiedRenault/ normalized-renault-mod-31_ext.xml	SAT TT=0.641	SAT TT=1.889 CHECKS=4320 NODES=503	SAT TT=2.313 CHECKS=5954 NODES=481	SAT TT=1356.4	SAT TT=38.058 CHECKS=151760	SAT TT=9.763 CHECKS=41300	SAT TT=5.458 ASSIGNMENTS=107	SAT TT=8.203 ASSIGNMENTS=1252	SAT TT=153.486 CHECKS=420892000 NODES=246	SAT TT=843.105 CHECKS=2268540000 NODES=888300000	? (TO) TT=1800.03	SAT TT=0.709 ASSIGNMENTS=190 CHECKS=13751	SAT TT=0.661 ASSIGNMENTS=190 CHECKS=13751	SAT TT=12.974	SAT TT=12.138	SAT TT=1.054 CHECKS=10708	SAT TT=0.641 ASSIGNMENTS=178 CHECKS=8365	SAT TT=1.906 ASSIGNMENTS=3611 CHECKS=121754	SAT TT=5.251	SAT TT=1.854 ASSIGNMENTS=496 CHECKS=52086	SAT TT=0.703 ASSIGNMENTS=190 CHECKS=13751	? TT=73.525	SAT TT=1.532 ASSIGNMENTS=180 CHECKS=68523	SAT TT=7.324	SAT TT=8.395
csp/modifiedRenault/ normalized-renault-mod-33_ext.xml	UNSAT TT=0.65	UNSAT TT=2.914 CHECKS=4746 NODES=297	UNSAT TT=3.131 CHECKS=4604 NODES=221	? (TO) TT=1800.12	UNSAT TT=30.581 CHECKS=120695	UNSAT TT=7.187 CHECKS=37114	UNSAT TT=5.214 ASSIGNMENTS=47	UNSAT TT=5.682 ASSIGNMENTS=76	UNSAT TT=85.448 CHECKS=84192500 NODES=144	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.676 ASSIGNMENTS=137 CHECKS=10183	UNSAT TT=0.674 ASSIGNMENTS=137 CHECKS=10183	UNSAT TT=9.851	UNSAT TT=9.03	UNSAT TT=1.171 CHECKS=9681	UNSAT TT=0.693 ASSIGNMENTS=201 CHECKS=14300	UNSAT TT=3.417 ASSIGNMENTS=4752 CHECKS=249865	UNSAT TT=5.333	UNSAT TT=2.077 ASSIGNMENTS=406 CHECKS=42101	UNSAT TT=0.65 ASSIGNMENTS=137 CHECKS=10183	? TT=58.668	UNSAT TT=1.497 ASSIGNMENTS=227 CHECKS=240572	UNSAT TT=7.696	UNSAT TT=7.593
csp/modifiedRenault/ normalized-renault-mod-35_ext.xml	UNSAT TT=0.706	UNSAT TT=2.449 CHECKS=9707 NODES=174	UNSAT TT=1.756 CHECKS=1027 NODES=0	UNSAT TT=15.913	UNSAT TT=2.755 CHECKS=3036	UNSAT TT=2.774 CHECKS=3442	UNSAT TT=2.037 ASSIGNMENTS=0	UNSAT TT=1.949 ASSIGNMENTS=0	UNSAT TT=101.663 CHECKS=158203000 NODES=7	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=0.722 ASSIGNMENTS=37 CHECKS=8271	UNSAT TT=0.715 ASSIGNMENTS=37 CHECKS=8271	UNSAT TT=9.813	UNSAT TT=8.582	UNSAT TT=1.048 CHECKS=14872	UNSAT TT=0.762 ASSIGNMENTS=73 CHECKS=12338	UNSAT TT=0.923 ASSIGNMENTS=277 CHECKS=17921	UNSAT TT=4.874	UNSAT TT=1.448 ASSIGNMENTS=145 CHECKS=25921	UNSAT TT=0.706 ASSIGNMENTS=37 CHECKS=8271	? TT=63.708	UNSAT TT=1.495 ASSIGNMENTS=171 CHECKS=258826	UNSAT TT=8.053	UNSAT TT=8.056
csp/modifiedRenault/ normalized-renault-mod-36_ext.xml	SAT TT=0.674	SAT TT=2.426 CHECKS=6273 NODES=505	SAT TT=2.635 CHECKS=7996 NODES=449	? (TO) TT=1800.11	SAT TT=35.845 CHECKS=118776	SAT TT=7.588 CHECKS=32223	SAT TT=4.471 ASSIGNMENTS=27	SAT TT=5.209 ASSIGNMENTS=31	SAT TT=71.287 CHECKS=51895100 NODES=172	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=0.705 ASSIGNMENTS=157 CHECKS=9629	SAT TT=0.699 ASSIGNMENTS=157 CHECKS=9629	SAT TT=12.389	SAT TT=13.403	SAT TT=1.127 CHECKS=5532	SAT TT=0.702 ASSIGNMENTS=241 CHECKS=12189	SAT TT=3.949 ASSIGNMENTS=4717 CHECKS=210178	SAT TT=5.417	SAT TT=1.339 ASSIGNMENTS=473 CHECKS=56149	SAT TT=0.674 ASSIGNMENTS=157 CHECKS=9629	? TT=58.108	SAT TT=1.48 ASSIGNMENTS=167 CHECKS=34894	SAT TT=7.648	SAT TT=8.351
csp/modifiedRenault/ normalized-renault-mod-37_ext.xml	UNSAT TT=0.679	UNSAT TT=2.265 CHECKS=6446 NODES=351	UNSAT TT=1.782 CHECKS=810 NODES=0	? (TO) TT=1800.11	UNSAT TT=11.244 CHECKS=30827	UNSAT TT=8.159 CHECKS=38646	UNSAT TT=3.963 ASSIGNMENTS=0	UNSAT TT=4.441 ASSIGNMENTS=0	UNSAT TT=70.373 CHECKS=39950600 NODES=30	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=0.762 ASSIGNMENTS=163 CHECKS=12791	UNSAT TT=0.679 ASSIGNMENTS=163 CHECKS=12791	UNSAT TT=9.094	UNSAT TT=8.408	UNSAT TT=1.121 CHECKS=19956	UNSAT TT=0.848 ASSIGNMENTS=327 CHECKS=24777	UNSAT TT=3.049 ASSIGNMENTS=4921 CHECKS=160326	UNSAT TT=4.936	UNSAT TT=1.384 ASSIGNMENTS=407 CHECKS=40166	UNSAT TT=0.723 ASSIGNMENTS=163 CHECKS=12791	? TT=108.576	UNSAT TT=1.573 ASSIGNMENTS=242 CHECKS=202317	UNSAT TT=7.504	UNSAT TT=8.227
csp/modifiedRenault/ normalized-renault-mod-39_ext.xml	UNSAT TT=0.643	UNSAT TT=2.07 CHECKS=2872 NODES=472	UNSAT TT=1.823 CHECKS=1720 NODES=0	? (TO) TT=1800.07	UNSAT TT=21.085 CHECKS=67486	UNSAT TT=13.145 CHECKS=48945	UNSAT TT=4.667 ASSIGNMENTS=0	UNSAT TT=4.902 ASSIGNMENTS=0	UNSAT TT=68.321 CHECKS=40022800 NODES=47	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=0.643 ASSIGNMENTS=148 CHECKS=8994	UNSAT TT=0.717 ASSIGNMENTS=148 CHECKS=8994	UNSAT TT=9.489	UNSAT TT=9.444	UNSAT TT=1.327 CHECKS=13144	UNSAT TT=0.762 ASSIGNMENTS=294 CHECKS=18917	UNSAT TT=3.579 ASSIGNMENTS=4858 CHECKS=181297	UNSAT TT=4.964	UNSAT TT=1.29 ASSIGNMENTS=418 CHECKS=44047	UNSAT TT=0.693 ASSIGNMENTS=148 CHECKS=8994	? TT=50.746	UNSAT TT=1.585 ASSIGNMENTS=184 CHECKS=205978	UNSAT TT=7.76	UNSAT TT=8.082
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/modifiedRenault/ normalized-renault-mod-3_ext.xml	UNSAT TT=0.622	UNSAT TT=1.954 CHECKS=3251 NODES=177	UNSAT TT=1.959 CHECKS=1812 NODES=0	? (TO) TT=1800.12	UNSAT TT=14.39 CHECKS=38040	UNSAT TT=7.86 CHECKS=26893	UNSAT TT=4.717 ASSIGNMENTS=0	UNSAT TT=4.36 ASSIGNMENTS=0	UNSAT TT=71.162 CHECKS=39973900 NODES=54	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.628 ASSIGNMENTS=134 CHECKS=5245	UNSAT TT=0.637 ASSIGNMENTS=134 CHECKS=5245	UNSAT TT=10.532	UNSAT TT=8.621	UNSAT TT=1.071 CHECKS=8929	UNSAT TT=0.694 ASSIGNMENTS=290 CHECKS=12409	UNSAT TT=2.922 ASSIGNMENTS=5059 CHECKS=142238	UNSAT TT=5.008	UNSAT TT=1.017 ASSIGNMENTS=393 CHECKS=37173	UNSAT TT=0.622 ASSIGNMENTS=134 CHECKS=5245	? TT=57.657	UNSAT TT=1.503 ASSIGNMENTS=313 CHECKS=262539	UNSAT TT=7.778	UNSAT TT=8.11
csp/modifiedRenault/ normalized-renault-mod-40_ext.xml	UNSAT TT=0.645	UNSAT TT=1.488 CHECKS=175 NODES=7	UNSAT TT=1.594 CHECKS=1162 NODES=0	? (TO) TT=1800.06	UNSAT TT=11.619 CHECKS=35310	UNSAT TT=7.922 CHECKS=27864	UNSAT TT=3.706 ASSIGNMENTS=0	UNSAT TT=4.028 ASSIGNMENTS=0	UNSAT TT=84.46 CHECKS=81984500 NODES=39	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=0.657 ASSIGNMENTS=117 CHECKS=6941	UNSAT TT=0.658 ASSIGNMENTS=117 CHECKS=6941	UNSAT TT=8.607	UNSAT TT=8.057	UNSAT TT=1.142 CHECKS=7509	UNSAT TT=0.674 ASSIGNMENTS=197 CHECKS=10083	UNSAT TT=1.868 ASSIGNMENTS=4555 CHECKS=122011	UNSAT TT=4.919	UNSAT TT=0.943 ASSIGNMENTS=403 CHECKS=44227	UNSAT TT=0.645 ASSIGNMENTS=117 CHECKS=6941	? TT=81.505	UNSAT TT=1.63 ASSIGNMENTS=156 CHECKS=277918	UNSAT TT=7.702	UNSAT TT=7.455
csp/modifiedRenault/ normalized-renault-mod-41_ext.xml	SAT TT=0.597	SAT TT=1.704 CHECKS=2191 NODES=282	SAT TT=1.81 CHECKS=2636 NODES=273	SAT TT=1577.5	SAT TT=30.891 CHECKS=144874	SAT TT=5.684 CHECKS=28581	SAT TT=3.784 ASSIGNMENTS=127	SAT TT=5.451 ASSIGNMENTS=865	SAT TT=71.078 CHECKS=50154600 NODES=170	SAT TT=211.22 CHECKS=193187000 NODES=337201000	? (TO) TT=1800.04	SAT TT=0.649 ASSIGNMENTS=188 CHECKS=5882	SAT TT=0.612 ASSIGNMENTS=188 CHECKS=5882	SAT TT=13.533	SAT TT=11.443	SAT TT=1.026 CHECKS=8259	SAT TT=0.687 ASSIGNMENTS=255 CHECKS=7089	SAT TT=1.602 ASSIGNMENTS=4992 CHECKS=146347	SAT TT=5.513	SAT TT=0.724 ASSIGNMENTS=363 CHECKS=22038	SAT TT=0.597 ASSIGNMENTS=188 CHECKS=5882	? TT=58.891	SAT TT=1.475 ASSIGNMENTS=148 CHECKS=37258	SAT TT=8.377	SAT TT=8.205
csp/modifiedRenault/ normalized-renault-mod-42_ext.xml	UNSAT TT=0.607	UNSAT TT=2.097 CHECKS=4676 NODES=223	UNSAT TT=1.719 CHECKS=804 NODES=0	? (TO) TT=1800.1	UNSAT TT=11.653 CHECKS=37960	UNSAT TT=6.241 CHECKS=20586	UNSAT TT=4.344 ASSIGNMENTS=0	UNSAT TT=4.529 ASSIGNMENTS=0	UNSAT TT=70 CHECKS=43011200 NODES=36	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.607 ASSIGNMENTS=91 CHECKS=4093	UNSAT TT=0.643 ASSIGNMENTS=91 CHECKS=4093	UNSAT TT=9.475	UNSAT TT=8.46	UNSAT TT=1.084 CHECKS=5470	UNSAT TT=0.713 ASSIGNMENTS=157 CHECKS=8423	UNSAT TT=2.931 ASSIGNMENTS=4886 CHECKS=155509	UNSAT TT=5.047	UNSAT TT=1.034 ASSIGNMENTS=542 CHECKS=44319	UNSAT TT=0.628 ASSIGNMENTS=91 CHECKS=4093	? TT=78.349	UNSAT TT=1.428 ASSIGNMENTS=198 CHECKS=134598	UNSAT TT=7.592	UNSAT TT=8.597
csp/modifiedRenault/ normalized-renault-mod-43_ext.xml	SAT TT=0.594	SAT TT=2.086 CHECKS=3961 NODES=504	SAT TT=2.2 CHECKS=1929 NODES=0	SAT TT=23.22	SAT TT=19.13 CHECKS=67662	SAT TT=9.506 CHECKS=31724	SAT TT=4.053 ASSIGNMENTS=17	SAT TT=4.474 ASSIGNMENTS=35	SAT TT=98.918 CHECKS=164856000 NODES=124	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.608 ASSIGNMENTS=33 CHECKS=1920	SAT TT=0.608 ASSIGNMENTS=33 CHECKS=1920	SAT TT=12.359	SAT TT=11.756	SAT TT=1.043 CHECKS=1146	SAT TT=0.596 ASSIGNMENTS=33 CHECKS=1920	Wrong Cert. TT=0.6 ASSIGNMENTS=27 CHECKS=1465	SAT TT=5.68	SAT TT=0.871 ASSIGNMENTS=122 CHECKS=13740	SAT TT=0.594 ASSIGNMENTS=33 CHECKS=1920	? TT=80.649	SAT TT=1.413 ASSIGNMENTS=114 CHECKS=31298	SAT TT=7.815	SAT TT=7.982
csp/modifiedRenault/ normalized-renault-mod-44_ext.xml	SAT TT=0.551	SAT TT=1.75 CHECKS=700 NODES=108	SAT TT=1.776 CHECKS=1455 NODES=0	SAT TT=15.203	SAT TT=46.879 CHECKS=151943	SAT TT=5.183 CHECKS=11400	SAT TT=4.5 ASSIGNMENTS=32	SAT TT=4.267 ASSIGNMENTS=34	SAT TT=68.709 CHECKS=39909400 NODES=108	SAT TT=95.774 CHECKS=256697000 NODES=80850100	? (TO) TT=1800.04	SAT TT=0.563 ASSIGNMENTS=30 CHECKS=1394	SAT TT=0.603 ASSIGNMENTS=30 CHECKS=1394	SAT TT=12.337	SAT TT=10.625	SAT TT=1.047 CHECKS=769	SAT TT=0.6 ASSIGNMENTS=30 CHECKS=1394	SAT TT=0.58 ASSIGNMENTS=32 CHECKS=1311	SAT TT=5.989	SAT TT=0.723 ASSIGNMENTS=134 CHECKS=9268	SAT TT=0.551 ASSIGNMENTS=30 CHECKS=1394	? TT=78.757	SAT TT=1.401 ASSIGNMENTS=109 CHECKS=20354	SAT TT=7.123	SAT TT=7.823
csp/modifiedRenault/ normalized-renault-mod-46_ext.xml	SAT TT=0.563	SAT TT=1.629 CHECKS=609 NODES=108	SAT TT=1.73 CHECKS=707 NODES=0	SAT TT=14.676	SAT TT=46.599 CHECKS=155637	SAT TT=5.432 CHECKS=11883	SAT TT=4.058 ASSIGNMENTS=29	SAT TT=4.645 ASSIGNMENTS=40	SAT TT=92.075 CHECKS=116118000 NODES=110	SAT TT=118.658 CHECKS=153790000 NODES=165450000	? (TO) TT=1800.06	SAT TT=0.617 ASSIGNMENTS=29 CHECKS=1382	SAT TT=0.61 ASSIGNMENTS=29 CHECKS=1382	SAT TT=12.343	SAT TT=12.191	SAT TT=1.076 CHECKS=831	SAT TT=0.563 ASSIGNMENTS=29 CHECKS=1382	SAT TT=0.602 ASSIGNMENTS=28 CHECKS=1301	SAT TT=4.922	SAT TT=0.711 ASSIGNMENTS=98 CHECKS=5639	SAT TT=0.606 ASSIGNMENTS=29 CHECKS=1382	? TT=87.202	SAT TT=1.404 ASSIGNMENTS=109 CHECKS=21056	SAT TT=7.587	SAT TT=8.022
csp/modifiedRenault/ normalized-renault-mod-47_ext.xml	UNSAT TT=0.664	UNSAT TT=1.627 CHECKS=19 NODES=7	UNSAT TT=1.873 CHECKS=1258 NODES=0	? (TO) TT=1800.06	UNSAT TT=5.864 CHECKS=21704	UNSAT TT=10.681 CHECKS=41826	UNSAT TT=2.685 ASSIGNMENTS=0	UNSAT TT=3.049 ASSIGNMENTS=0	UNSAT TT=100.459 CHECKS=154626000 NODES=16	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=0.706 ASSIGNMENTS=78 CHECKS=7062	UNSAT TT=0.69 ASSIGNMENTS=78 CHECKS=7062	UNSAT TT=8.773	UNSAT TT=9.29	UNSAT TT=1.007 CHECKS=11074	UNSAT TT=0.688 ASSIGNMENTS=179 CHECKS=14162	UNSAT TT=2.24 ASSIGNMENTS=2914 CHECKS=167937	UNSAT TT=4.993	UNSAT TT=0.81 ASSIGNMENTS=128 CHECKS=20626	UNSAT TT=0.664 ASSIGNMENTS=78 CHECKS=7062	? TT=85.286	UNSAT TT=1.606 ASSIGNMENTS=220 CHECKS=208470	UNSAT TT=7.754	UNSAT TT=8.015
csp/modifiedRenault/ normalized-renault-mod-48_ext.xml	SAT TT=0.592	SAT TT=2.329 CHECKS=3437 NODES=215	SAT TT=1.667 CHECKS=761 NODES=0	SAT TT=14.922	SAT TT=18.268 CHECKS=41888	SAT TT=7.31 CHECKS=18846	SAT TT=5.113 ASSIGNMENTS=23	SAT TT=5.244 ASSIGNMENTS=27	SAT TT=69.788 CHECKS=41379900 NODES=143	SAT TT=630.193 CHECKS=659834000 NODES=1043850000	SAT TT=487.752 CHECKS=1318350000 NODES=788164	SAT TT=0.627 ASSIGNMENTS=36 CHECKS=2047	SAT TT=0.611 ASSIGNMENTS=36 CHECKS=2047	SAT TT=12.164	SAT TT=11.996	SAT TT=1.243 CHECKS=2088	SAT TT=0.592 ASSIGNMENTS=36 CHECKS=2047	SAT TT=0.698 ASSIGNMENTS=210 CHECKS=11333	SAT TT=5.78	SAT TT=1.497 ASSIGNMENTS=295 CHECKS=44062	SAT TT=0.594 ASSIGNMENTS=36 CHECKS=2047	? TT=59.101	SAT TT=1.432 ASSIGNMENTS=109 CHECKS=20641	SAT TT=7.905	SAT TT=8.116
csp/modifiedRenault/ normalized-renault-mod-49_ext.xml	SAT TT=0.624	SAT TT=2.014 CHECKS=3357 NODES=425	SAT TT=2.105 CHECKS=3797 NODES=366	SAT TT=15.988	SAT TT=22.682 CHECKS=90177	SAT TT=5.448 CHECKS=16965	SAT TT=4.892 ASSIGNMENTS=84	SAT TT=4.3 ASSIGNMENTS=29	SAT TT=67.659 CHECKS=39983200 NODES=114	SAT TT=877.011 CHECKS=1065020000 NODES=1321950000	? (TO) TT=1800.02	SAT TT=0.632 ASSIGNMENTS=112 CHECKS=3602	SAT TT=0.669 ASSIGNMENTS=112 CHECKS=3602	SAT TT=11.208	SAT TT=11.478	SAT TT=1.061 CHECKS=3838	SAT TT=0.645 ASSIGNMENTS=116 CHECKS=3633	SAT TT=1.669 ASSIGNMENTS=2798 CHECKS=92527	SAT TT=5.34	SAT TT=1.022 ASSIGNMENTS=527 CHECKS=41799	SAT TT=0.624 ASSIGNMENTS=112 CHECKS=3602	? TT=49.9	SAT TT=1.589 ASSIGNMENTS=378 CHECKS=210626	SAT TT=8.689	SAT TT=7.94
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/modifiedRenault/ normalized-renault-mod-4_ext.xml	SAT TT=0.564	SAT TT=1.801 CHECKS=1715 NODES=171	SAT TT=1.734 CHECKS=1067 NODES=0	SAT TT=14.558	SAT TT=12.675 CHECKS=32936	SAT TT=6.182 CHECKS=14063	SAT TT=4.465 ASSIGNMENTS=26	SAT TT=4.451 ASSIGNMENTS=37	SAT TT=68.47 CHECKS=39876300 NODES=114	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=0.609 ASSIGNMENTS=28 CHECKS=1322	SAT TT=0.564 ASSIGNMENTS=28 CHECKS=1322	SAT TT=12.157	SAT TT=11.133	SAT TT=1.112 CHECKS=1305	SAT TT=0.568 ASSIGNMENTS=28 CHECKS=1322	SAT TT=0.64 ASSIGNMENTS=41 CHECKS=1284	SAT TT=5.566	SAT TT=1.05 ASSIGNMENTS=478 CHECKS=34365	SAT TT=0.615 ASSIGNMENTS=28 CHECKS=1322	? TT=48.2	SAT TT=1.423 ASSIGNMENTS=113 CHECKS=21818	SAT TT=7.928	SAT TT=8.177
csp/modifiedRenault/ normalized-renault-mod-5_ext.xml	UNSAT TT=0.641	UNSAT TT=2.218 CHECKS=3925 NODES=344	UNSAT TT=2.108 CHECKS=1891 NODES=0	? (TO) TT=1800.1	UNSAT TT=21.484 CHECKS=60361	UNSAT TT=9.485 CHECKS=28966	UNSAT TT=3.834 ASSIGNMENTS=0	UNSAT TT=3.908 ASSIGNMENTS=0	UNSAT TT=70.983 CHECKS=39980700 NODES=31	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.662 ASSIGNMENTS=116 CHECKS=6288	UNSAT TT=0.662 ASSIGNMENTS=116 CHECKS=6288	UNSAT TT=9.453	UNSAT TT=8.613	UNSAT TT=1.077 CHECKS=12537	UNSAT TT=0.734 ASSIGNMENTS=293 CHECKS=15975	UNSAT TT=2.55 ASSIGNMENTS=4920 CHECKS=141554	UNSAT TT=4.794	UNSAT TT=0.997 ASSIGNMENTS=356 CHECKS=34272	UNSAT TT=0.641 ASSIGNMENTS=116 CHECKS=6288	? TT=66.33	UNSAT TT=1.672 ASSIGNMENTS=229 CHECKS=245928	UNSAT TT=7.828	UNSAT TT=8.189
csp/modifiedRenault/ normalized-renault-mod-9_ext.xml	SAT TT=0.584	SAT TT=2.091 CHECKS=3556 NODES=571	SAT TT=2.277 CHECKS=3714 NODES=537	SAT TT=915.421	SAT TT=6.137 CHECKS=17926	SAT TT=7.846 CHECKS=17407	SAT TT=4.463 ASSIGNMENTS=28	SAT TT=4.802 ASSIGNMENTS=222	SAT TT=69.128 CHECKS=41076000 NODES=161	SAT TT=1651.47 CHECKS=728258000 NODES=-1120970000	? (TO) TT=1800.04	SAT TT=0.602 ASSIGNMENTS=44 CHECKS=1756	SAT TT=0.6 ASSIGNMENTS=44 CHECKS=1756	SAT TT=12.812	SAT TT=10.984	SAT TT=0.996 CHECKS=2421	SAT TT=0.62 ASSIGNMENTS=44 CHECKS=1756	SAT TT=2.784 ASSIGNMENTS=5054 CHECKS=151671	SAT TT=5.512	SAT TT=1.365 ASSIGNMENTS=443 CHECKS=44815	SAT TT=0.584 ASSIGNMENTS=44 CHECKS=1756	? TT=69.38	SAT TT=1.516 ASSIGNMENTS=112 CHECKS=21611	SAT TT=8.019	SAT TT=7.796
csp/ogdVg/ normalized-crossword-m1c-ogd-vg10-10_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (MO) TT=40.13	? (TO) TT=1800.11	? (TO) TT=1800.08	? TT=40.428	? (TO) TT=1800.04	? (TO) TT=1800.18	? (TO) TT=1800.15
csp/ogdVg/ normalized-crossword-m1c-ogd-vg10-11_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (MO) TT=37.05	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=34.472	? (TO) TT=1800.01	? (MO) TT=6.199	? (TO) TT=1800.26
csp/ogdVg/ normalized-crossword-m1c-ogd-vg10-12_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? (MO) TT=36.23	? (TO) TT=1800.04	? (TO) TT=1800.03	? TT=35.852	? (TO) TT=1800.06	? (TO) TT=1800.92	? (TO) TT=1800.18
csp/ogdVg/ normalized-crossword-m1c-ogd-vg10-13_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.03	? (MO) TT=34.91	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=43.803	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.2
csp/ogdVg/ normalized-crossword-m1c-ogd-vg10-14_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	? (MO) TT=31.91	? (TO) TT=1800.01	? (TO) TT=1800.06	? TT=35.561	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.19
csp/ogdVg/ normalized-crossword-m1c-ogd-vg11-11_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	? (MO) TT=37.85	? (TO) TT=1800.04	? (TO) TT=1800.06	? TT=31.551	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.42
csp/ogdVg/ normalized-crossword-m1c-ogd-vg11-12_ext.xml		? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800.19	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (MO) TT=39.44	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=33.193	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.19
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdVg/ normalized-crossword-m1c-ogd-vg11-13_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.07	? (MO) TT=35.26	? (TO) TT=1800.02	? (TO) TT=1800.03	? TT=44.875	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.2
csp/ogdVg/ normalized-crossword-m1c-ogd-vg11-14_ext.xml	UNSAT TT=1512.65	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=1512.65 ASSIGNMENTS=16057 CHECKS=3278980	? (TO) TT=1800.06	? (MO) TT=32.87	UNSAT TT=1689.84 ASSIGNMENTS=19978 CHECKS=4017500	UNSAT TT=1719.67 ASSIGNMENTS=17198 CHECKS=3506410	? TT=37.112	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.21
csp/ogdVg/ normalized-crossword-m1c-ogd-vg11-15_ext.xml	UNSAT TT=518.23	UNSAT TT=979.969 CHECKS=2573 NODES=8237	UNSAT TT=929.901 CHECKS=3002 NODES=7899	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.1	UNSAT TT=1149.16 ASSIGNMENTS=2757	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=1301.97 ASSIGNMENTS=6522 CHECKS=1319550	UNSAT TT=972.559 ASSIGNMENTS=8237 CHECKS=2573	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=518.23 ASSIGNMENTS=6440 CHECKS=1290740	UNSAT TT=786.378 ASSIGNMENTS=10533 CHECKS=1887510	? (MO) TT=33.28	UNSAT TT=617.418 ASSIGNMENTS=8433 CHECKS=1636530	UNSAT TT=572.414 ASSIGNMENTS=6522 CHECKS=1319550	? TT=43.655	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.19
csp/ogdVg/ normalized-crossword-m1c-ogd-vg12-12_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	? (MO) TT=39.78	? (TO) TT=1800.09	? (TO) TT=1800.05	? TT=97.335	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.08
csp/ogdVg/ normalized-crossword-m1c-ogd-vg12-13_ext.xml	UNSAT TT=1417.23	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=1530.36 ASSIGNMENTS=17381 CHECKS=3221680	? (TO) TT=1800.1	? (MO) TT=32.46	? (TO) TT=1800.07	UNSAT TT=1417.23 ASSIGNMENTS=16474 CHECKS=3045320	? TT=78.954	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.19
csp/ogdVg/ normalized-crossword-m1c-ogd-vg12-14_ext.xml	UNSAT TT=669.147	UNSAT TT=1239.15 CHECKS=806 NODES=11735	UNSAT TT=1231.95 CHECKS=1057 NODES=11511	? (TO) TT=1800.18	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=1298.55 ASSIGNMENTS=11735 CHECKS=806	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=724.573 ASSIGNMENTS=8505 CHECKS=1691960	UNSAT TT=1041.51 ASSIGNMENTS=13373 CHECKS=2426480	? (MO) TT=33.5	UNSAT TT=775.6 ASSIGNMENTS=10227 CHECKS=1996470	UNSAT TT=669.147 ASSIGNMENTS=8295 CHECKS=1659000	? TT=97.085	? (TO) TT=1800.07	? (TO) TT=1800.49	? (TO) TT=1800.14
csp/ogdVg/ normalized-crossword-m1c-ogd-vg12-15_ext.xml	UNSAT TT=287.458	UNSAT TT=429.469 CHECKS=33 NODES=4293	UNSAT TT=426.248 CHECKS=40 NODES=3940	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=601.768 ASSIGNMENTS=1269	? (TO) TT=1800.14	UNSAT TT=1100.52 CHECKS=0 NODES=5464	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=424.163 ASSIGNMENTS=4293 CHECKS=33	UNSAT TT=412.483 ASSIGNMENTS=4293 CHECKS=33	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=796.511 CHECKS=694107	UNSAT TT=305.904 ASSIGNMENTS=4107 CHECKS=815376	UNSAT TT=450.663 ASSIGNMENTS=6829 CHECKS=1178890	? (MO) TT=30.52	UNSAT TT=330.881 ASSIGNMENTS=5241 CHECKS=1015330	UNSAT TT=287.458 ASSIGNMENTS=3479 CHECKS=705376	? TT=88.302	? (TO) TT=1800.02	? (TO) TT=1800.21	? (TO) TT=1800.14
csp/ogdVg/ normalized-crossword-m1c-ogd-vg13-13_ext.xml	UNSAT TT=380.573	UNSAT TT=680.515 CHECKS=2148 NODES=8731	UNSAT TT=678.507 CHECKS=264 NODES=8836	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.17	UNSAT TT=1071.35 ASSIGNMENTS=2465	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=604.797 ASSIGNMENTS=7947 CHECKS=2323	UNSAT TT=613.536 ASSIGNMENTS=7947 CHECKS=2323	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=1458.23 CHECKS=1941580	UNSAT TT=380.573 ASSIGNMENTS=6039 CHECKS=1111060	UNSAT TT=791.277 ASSIGNMENTS=11790 CHECKS=1996590	? (MO) TT=34.65	UNSAT TT=608.191 ASSIGNMENTS=10577 CHECKS=1901610	UNSAT TT=419.765 ASSIGNMENTS=6063 CHECKS=1114500	? TT=86.202	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.21
csp/ogdVg/ normalized-crossword-m1c-ogd-vg13-14_ext.xml	UNSAT TT=162.52	UNSAT TT=268.483 CHECKS=42 NODES=3371	UNSAT TT=360.628 CHECKS=44 NODES=3586	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=688.568 ASSIGNMENTS=1522	? (TO) TT=1800.09	UNSAT TT=818.118 CHECKS=0 NODES=5059	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=285.049 ASSIGNMENTS=3371 CHECKS=42	UNSAT TT=280.857 ASSIGNMENTS=3371 CHECKS=42	? (TO) TT=1800.1	UNSAT TT=1788.31	UNSAT TT=793.802 CHECKS=984750	UNSAT TT=186.72 ASSIGNMENTS=2859 CHECKS=525846	UNSAT TT=440.328 ASSIGNMENTS=7395 CHECKS=1283530	? (MO) TT=29.25	UNSAT TT=253.248 ASSIGNMENTS=4817 CHECKS=927999	UNSAT TT=162.52 ASSIGNMENTS=2811 CHECKS=518691	? TT=82.81	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.12
csp/ogdVg/ normalized-crossword-m1c-ogd-vg13-15_ext.xml	UNSAT TT=63.781	UNSAT TT=93.138 CHECKS=0 NODES=1269	UNSAT TT=139.364 CHECKS=0 NODES=1498	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=211.223 ASSIGNMENTS=498	? (TO) TT=1800.13	UNSAT TT=283.088 CHECKS=0 NODES=1748	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=108.445 ASSIGNMENTS=1269 CHECKS=0	UNSAT TT=100.427 ASSIGNMENTS=1269 CHECKS=0	UNSAT TT=742.887	UNSAT TT=663.537	UNSAT TT=206.048 CHECKS=233272	UNSAT TT=63.781 ASSIGNMENTS=1215 CHECKS=227538	UNSAT TT=260.15 ASSIGNMENTS=4885 CHECKS=805937	? (MO) TT=28.03	UNSAT TT=129.861 ASSIGNMENTS=3296 CHECKS=641554	UNSAT TT=68.531 ASSIGNMENTS=1273 CHECKS=231987	? TT=85.028	? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.17
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdVg/ normalized-crossword-m1c-ogd-vg13-16_ext.xml	UNSAT TT=4.545	UNSAT TT=14.879 CHECKS=0 NODES=160	UNSAT TT=49.367 CHECKS=0 NODES=99	? (TO) TT=1800.06	UNSAT TT=309.986 CHECKS=31605	UNSAT TT=363.928 CHECKS=28628	UNSAT TT=76.441 ASSIGNMENTS=45	UNSAT TT=432.115 ASSIGNMENTS=554	UNSAT TT=29.286 CHECKS=0 NODES=202	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=21.958 ASSIGNMENTS=160 CHECKS=0	UNSAT TT=21.11 ASSIGNMENTS=160 CHECKS=0	UNSAT TT=176.18	UNSAT TT=153.466	UNSAT TT=18.774 CHECKS=18544	UNSAT TT=4.545 ASSIGNMENTS=99 CHECKS=21592	UNSAT TT=155.696 ASSIGNMENTS=3544 CHECKS=627492	? (MO) TT=26.82	UNSAT TT=87.54 ASSIGNMENTS=2656 CHECKS=491936	UNSAT TT=5.48 ASSIGNMENTS=116 CHECKS=22862	? TT=89.673	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.1
csp/ogdVg/ normalized-crossword-m1c-ogd-vg14-15_ext.xml	UNSAT TT=35.759	UNSAT TT=39.124 CHECKS=0 NODES=771	UNSAT TT=93.436 CHECKS=0 NODES=1033	? (TO) TT=1800.17	UNSAT TT=645.513 CHECKS=93187	UNSAT TT=1090.35 CHECKS=165861	UNSAT TT=126.418 ASSIGNMENTS=267	? (TO) TT=1800.12	UNSAT TT=137.913 CHECKS=0 NODES=1141	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=47.584 ASSIGNMENTS=771 CHECKS=0	UNSAT TT=49.214 ASSIGNMENTS=771 CHECKS=0	UNSAT TT=817.899	UNSAT TT=959.646	UNSAT TT=196.57 CHECKS=246486	UNSAT TT=35.759 ASSIGNMENTS=785 CHECKS=163768	UNSAT TT=162.593 ASSIGNMENTS=4410 CHECKS=785270	? (MO) TT=24.62	UNSAT TT=120.796 ASSIGNMENTS=3294 CHECKS=718130	UNSAT TT=35.812 ASSIGNMENTS=799 CHECKS=167426	? TT=102.436	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.18
csp/ogdVg/ normalized-crossword-m1c-ogd-vg14-17_ext.xml	UNSAT TT=1.498	UNSAT TT=3.017 CHECKS=0 NODES=39	UNSAT TT=12.433 CHECKS=0 NODES=0	? (TO) TT=1800.09	UNSAT TT=80.385 CHECKS=11658	UNSAT TT=58.901 CHECKS=11341	UNSAT TT=68.38 ASSIGNMENTS=0	UNSAT TT=86.127 ASSIGNMENTS=51	UNSAT TT=10.613 CHECKS=0 NODES=69	? (TO) TT=1800	? (TO) TT=1800.1	UNSAT TT=10.069 ASSIGNMENTS=39 CHECKS=0	UNSAT TT=1.579 ASSIGNMENTS=44 CHECKS=9327	UNSAT TT=141.446	UNSAT TT=113.431	UNSAT TT=11.653 CHECKS=17264	UNSAT TT=1.904 ASSIGNMENTS=53 CHECKS=11269	UNSAT TT=100.213 ASSIGNMENTS=3324 CHECKS=636470	? (MO) TT=23.21	UNSAT TT=4.509 ASSIGNMENTS=176 CHECKS=27329	UNSAT TT=1.498 ASSIGNMENTS=44 CHECKS=9327	? TT=82.806	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/ogdVg/ normalized-crossword-m1c-ogd-vg15-16_ext.xml	UNSAT TT=1.089	UNSAT TT=1.997 CHECKS=0 NODES=38	UNSAT TT=4.383 CHECKS=0 NODES=0	? (TO) TT=1800.14	UNSAT TT=52.729 CHECKS=19297	UNSAT TT=32.462 CHECKS=13101	UNSAT TT=66.345 ASSIGNMENTS=0	UNSAT TT=60.415 ASSIGNMENTS=0	UNSAT TT=6.037 CHECKS=0 NODES=62	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=1.089 ASSIGNMENTS=30 CHECKS=8031	UNSAT TT=1.106 ASSIGNMENTS=30 CHECKS=8031	UNSAT TT=157.003	UNSAT TT=113.356	UNSAT TT=4.699 CHECKS=6148	UNSAT TT=1.152 ASSIGNMENTS=36 CHECKS=8531	UNSAT TT=79.498 ASSIGNMENTS=3305 CHECKS=654744	UNSAT TT=55.665	UNSAT TT=9.049 ASSIGNMENTS=459 CHECKS=74787	UNSAT TT=1.136 ASSIGNMENTS=30 CHECKS=8031	? TT=79.683	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.07
csp/ogdVg/ normalized-crossword-m1c-ogd-vg15-19_ext.xml	UNSAT TT=0.183	UNSAT TT=1.082 CHECKS=0 NODES=0	UNSAT TT=1.269 CHECKS=0 NODES=0	? (TO) TT=1800.18	UNSAT TT=5.31 CHECKS=88	UNSAT TT=5.295 CHECKS=88	UNSAT TT=0.818 ASSIGNMENTS=0	UNSAT TT=0.913 ASSIGNMENTS=0	UNSAT TT=1.809 CHECKS=0 NODES=0	UNSAT TT=1.722 CHECKS=0 NODES=0	UNSAT TT=1.773 CHECKS=0 NODES=0	UNSAT TT=0.214 ASSIGNMENTS=0 CHECKS=453	UNSAT TT=0.193 ASSIGNMENTS=0 CHECKS=453	UNSAT TT=87.539	UNSAT TT=63.788	UNSAT TT=0.81 CHECKS=596	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=453	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=453	UNSAT TT=17.507	UNSAT TT=0.183 ASSIGNMENTS=0 CHECKS=453	UNSAT TT=0.201 ASSIGNMENTS=0 CHECKS=453	? TT=84.723	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.15
csp/ogdVg/ normalized-crossword-m1c-ogd-vg16-16_ext.xml	UNSAT TT=0.278	UNSAT TT=1.045 CHECKS=0 NODES=8	UNSAT TT=1.052 CHECKS=0 NODES=0	? (TO) TT=1800.17	UNSAT TT=5.664 CHECKS=4213	UNSAT TT=4.838 CHECKS=3992	UNSAT TT=1.549 ASSIGNMENTS=0	UNSAT TT=1.646 ASSIGNMENTS=0	UNSAT TT=0.967 CHECKS=0 NODES=11	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.314 ASSIGNMENTS=6 CHECKS=2917	UNSAT TT=0.318 ASSIGNMENTS=6 CHECKS=2917	UNSAT TT=58.762	UNSAT TT=50.741	UNSAT TT=0.619 CHECKS=1511	UNSAT TT=0.278 ASSIGNMENTS=7 CHECKS=3034	UNSAT TT=1.431 ASSIGNMENTS=89 CHECKS=17835	UNSAT TT=5.784	UNSAT TT=0.4 ASSIGNMENTS=22 CHECKS=3517	UNSAT TT=0.304 ASSIGNMENTS=6 CHECKS=2917	? TT=87.061	? (TO) TT=1800.08	UNSAT TT=794.444	? (TO) TT=1800.07
csp/ogdVg/ normalized-crossword-m1c-ogd-vg16-18_ext.xml	UNSAT TT=0.106	UNSAT TT=0.857 CHECKS=0 NODES=0	UNSAT TT=0.846 CHECKS=0 NODES=0	? (TO) TT=1800.08	UNSAT TT=1.039 CHECKS=102	UNSAT TT=1.019 CHECKS=102	UNSAT TT=0.621 ASSIGNMENTS=0	UNSAT TT=0.656 ASSIGNMENTS=0	UNSAT TT=0.864 CHECKS=0 NODES=0	UNSAT TT=0.701 CHECKS=0 NODES=0	UNSAT TT=0.7 CHECKS=0 NODES=0	UNSAT TT=0.123 ASSIGNMENTS=0 CHECKS=539	UNSAT TT=0.119 ASSIGNMENTS=0 CHECKS=539	UNSAT TT=40.317	UNSAT TT=30.401	UNSAT TT=0.143 CHECKS=138	UNSAT TT=0.109 ASSIGNMENTS=0 CHECKS=539	UNSAT TT=0.112 ASSIGNMENTS=0 CHECKS=539	UNSAT TT=4.462	UNSAT TT=0.106 ASSIGNMENTS=0 CHECKS=539	UNSAT TT=0.11 ASSIGNMENTS=0 CHECKS=539	? TT=82.142	? (TO) TT=1800.03	UNSAT TT=411.384	? (TO) TT=1800.1
csp/ogdVg/ normalized-crossword-m1c-ogd-vg16-20_ext.xml	UNSAT TT=0.087	UNSAT TT=1 CHECKS=0 NODES=0	UNSAT TT=0.878 CHECKS=0 NODES=0	UNSAT TT=72.162	UNSAT TT=1.036 CHECKS=57	UNSAT TT=1.042 CHECKS=57	UNSAT TT=0.593 ASSIGNMENTS=0	UNSAT TT=0.72 ASSIGNMENTS=0	UNSAT TT=0.627 CHECKS=0 NODES=0	UNSAT TT=0.736 CHECKS=0 NODES=0	UNSAT TT=0.603 CHECKS=0 NODES=0	UNSAT TT=0.099 ASSIGNMENTS=0 CHECKS=77	UNSAT TT=0.098 ASSIGNMENTS=0 CHECKS=77	UNSAT TT=35.999	UNSAT TT=27.343	UNSAT TT=0.113 CHECKS=77	UNSAT TT=0.091 ASSIGNMENTS=0 CHECKS=77	UNSAT TT=0.087 ASSIGNMENTS=0 CHECKS=77	UNSAT TT=3.953	UNSAT TT=0.087 ASSIGNMENTS=0 CHECKS=77	UNSAT TT=0.088 ASSIGNMENTS=0 CHECKS=77	? TT=74.452	? (TO) TT=1800.05	UNSAT TT=425.284	UNSAT TT=489.767
csp/ogdVg/ normalized-crossword-m1c-ogd-vg4-4_ext.xml	SAT TT=0.01	SAT TT=0.691 CHECKS=9 NODES=16	SAT TT=0.687 CHECKS=9 NODES=0	SAT TT=0.25	SAT TT=0.245 CHECKS=590	SAT TT=0.229 CHECKS=534	SAT TT=0.745 ASSIGNMENTS=15	SAT TT=0.706 ASSIGNMENTS=13	SAT TT=1.251 CHECKS=694140 NODES=16	SAT TT=2.683 CHECKS=19790600 NODES=12900000	SAT TT=15.238 CHECKS=48921900 NODES=3853	SAT TT=0.023 ASSIGNMENTS=12 CHECKS=185	SAT TT=0.024 ASSIGNMENTS=12 CHECKS=185	SAT TT=4.435	SAT TT=3.641	SAT TT=0.023 CHECKS=76	SAT TT=0.01 ASSIGNMENTS=12 CHECKS=185	SAT TT=0.012 ASSIGNMENTS=10 CHECKS=176	SAT TT=0.62	SAT TT=0.012 ASSIGNMENTS=8 CHECKS=135	SAT TT=0.013 ASSIGNMENTS=12 CHECKS=185	SAT TT=14.725	SAT TT=0.032 ASSIGNMENTS=16 CHECKS=23159	SAT TT=2.021	SAT TT=2.51
csp/ogdVg/ normalized-crossword-m1c-ogd-vg4-6_ext.xml	SAT TT=0.066	SAT TT=0.816 CHECKS=10 NODES=25	SAT TT=1.07 CHECKS=26 NODES=32	SAT TT=2.895	SAT TT=1.077 CHECKS=796	SAT TT=0.971 CHECKS=652	SAT TT=1.724 ASSIGNMENTS=13	SAT TT=1.745 ASSIGNMENTS=11	SAT TT=102.039 CHECKS=192408000 NODES=26	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=0.084 ASSIGNMENTS=16 CHECKS=385	SAT TT=0.083 ASSIGNMENTS=16 CHECKS=385	SAT TT=20.325	SAT TT=17.539	SAT TT=0.116 CHECKS=216	SAT TT=0.073 ASSIGNMENTS=16 CHECKS=385	SAT TT=0.077 ASSIGNMENTS=18 CHECKS=523	SAT TT=1.749	SAT TT=0.066 ASSIGNMENTS=20 CHECKS=448	SAT TT=0.071 ASSIGNMENTS=16 CHECKS=385	? TT=109.604	SAT TT=0.243 ASSIGNMENTS=29 CHECKS=250750	SAT TT=46.228	SAT TT=47.527
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdVg/ normalized-crossword-m1c-ogd-vg4-8_ext.xml	SAT TT=0.36	SAT TT=1.038 CHECKS=46 NODES=41	SAT TT=1.406 CHECKS=50 NODES=69	SAT TT=403.61	SAT TT=7.585 CHECKS=1794	SAT TT=5.754 CHECKS=1277	SAT TT=5.99 ASSIGNMENTS=22	SAT TT=9.39 ASSIGNMENTS=35	SAT TT=2.502 CHECKS=558265 NODES=35	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=0.581 ASSIGNMENTS=52 CHECKS=3033	SAT TT=0.546 ASSIGNMENTS=52 CHECKS=3033	SAT TT=168.189	SAT TT=77.766	SAT TT=0.36 CHECKS=3334	SAT TT=0.531 ASSIGNMENTS=48 CHECKS=2783	SAT TT=1.25 ASSIGNMENTS=105 CHECKS=5476	SAT TT=6.164	SAT TT=4.495 ASSIGNMENTS=627 CHECKS=28771	SAT TT=0.588 ASSIGNMENTS=52 CHECKS=3033	? TT=95.061	SAT TT=987.208 ASSIGNMENTS=1085 CHECKS=294168000	SAT TT=1065.92	SAT TT=1072.48
csp/ogdVg/ normalized-crossword-m1c-ogd-vg5-7_ext.xml	SAT TT=0.268	SAT TT=0.976 CHECKS=28 NODES=42	SAT TT=1.801 CHECKS=85 NODES=253	SAT TT=1358.65	SAT TT=7.951 CHECKS=6263	SAT TT=8.496 CHECKS=4312	SAT TT=11.171 ASSIGNMENTS=226	SAT TT=4.579 ASSIGNMENTS=12	SAT TT=31.097 CHECKS=20962400 NODES=66	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=1.13 ASSIGNMENTS=193 CHECKS=12016	SAT TT=1.098 ASSIGNMENTS=193 CHECKS=12016	SAT TT=927.074	SAT TT=1002.72	SAT TT=0.268 CHECKS=2595	SAT TT=0.948 ASSIGNMENTS=156 CHECKS=10360	SAT TT=0.376 ASSIGNMENTS=61 CHECKS=3190	SAT TT=5.024	SAT TT=2.861 ASSIGNMENTS=696 CHECKS=32108	SAT TT=1.113 ASSIGNMENTS=193 CHECKS=12016	? TT=90.888	SAT TT=0.349 ASSIGNMENTS=46 CHECKS=44371	SAT TT=352.155	SAT TT=372.204
csp/ogdVg/ normalized-crossword-m1c-ogd-vg5-8_ext.xml	SAT TT=0.231	SAT TT=1.863 CHECKS=170 NODES=272	SAT TT=1.612 CHECKS=61 NODES=60	SAT TT=1362.19	SAT TT=14.587 CHECKS=4896	SAT TT=27.049 CHECKS=9235	SAT TT=181.325 ASSIGNMENTS=1990	SAT TT=16.779 ASSIGNMENTS=93	SAT TT=33.553 CHECKS=19330300 NODES=58	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=0.255 ASSIGNMENTS=15 CHECKS=579	SAT TT=0.257 ASSIGNMENTS=15 CHECKS=579	? (TO) TT=1800.05	SAT TT=725.525	SAT TT=0.41 CHECKS=3323	SAT TT=0.231 ASSIGNMENTS=15 CHECKS=579	SAT TT=16.626 ASSIGNMENTS=1450 CHECKS=79113	SAT TT=8.181	SAT TT=82.183 ASSIGNMENTS=6546 CHECKS=506737	SAT TT=0.235 ASSIGNMENTS=15 CHECKS=579	? (MO) TT=42.539	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/ogdVg/ normalized-crossword-m1c-ogd-vg6-10_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.02	? TT=82.691	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02
csp/ogdVg/ normalized-crossword-m1c-ogd-vg6-6_ext.xml	SAT TT=0.141	SAT TT=0.911 CHECKS=13 NODES=36	SAT TT=0.842 CHECKS=13 NODES=0	SAT TT=21.019	SAT TT=7.185 CHECKS=9263	SAT TT=3.211 CHECKS=1168	SAT TT=4.186 ASSIGNMENTS=21	SAT TT=3.969 ASSIGNMENTS=14	SAT TT=218.917 CHECKS=671845000 NODES=37	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.181 ASSIGNMENTS=36 CHECKS=1717	SAT TT=0.179 ASSIGNMENTS=36 CHECKS=1717	SAT TT=327.045	SAT TT=51.826	SAT TT=0.141 CHECKS=584	SAT TT=0.323 ASSIGNMENTS=67 CHECKS=3422	SAT TT=1.746 ASSIGNMENTS=451 CHECKS=21794	SAT TT=4.393	SAT TT=2.951 ASSIGNMENTS=844 CHECKS=40139	SAT TT=0.171 ASSIGNMENTS=36 CHECKS=1717	? TT=76.039	SAT TT=11.94 ASSIGNMENTS=128 CHECKS=16203500	SAT TT=131.418	SAT TT=160.795
csp/ogdVg/ normalized-crossword-m1c-ogd-vg6-7_ext.xml	SAT TT=0.431	SAT TT=1.521 CHECKS=82 NODES=276	SAT TT=1.646 CHECKS=53 NODES=60	SAT TT=305.388	SAT TT=287.031 CHECKS=178635	SAT TT=156.207 CHECKS=111363	SAT TT=236.656 ASSIGNMENTS=3885	SAT TT=12.664 ASSIGNMENTS=79	SAT TT=198.167 CHECKS=761548000 NODES=175	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=8.947 ASSIGNMENTS=276 CHECKS=82	SAT TT=8.95 ASSIGNMENTS=276 CHECKS=82	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=0.431 CHECKS=3884	SAT TT=16.602 ASSIGNMENTS=1624 CHECKS=125302	SAT TT=28.844 ASSIGNMENTS=3687 CHECKS=208875	SAT TT=25.203	SAT TT=19.255 ASSIGNMENTS=2061 CHECKS=148616	SAT TT=13.394 ASSIGNMENTS=1437 CHECKS=112167	? TT=91.293	SAT TT=1560.45 ASSIGNMENTS=19086 CHECKS=201007000	SAT TT=441.144	SAT TT=709.33
csp/ogdVg/ normalized-crossword-m1c-ogd-vg6-8_ext.xml	SAT TT=4.418	SAT TT=5.613 CHECKS=6280 NODES=3643	SAT TT=4.418 CHECKS=980 NODES=1160	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=164.195 CHECKS=54840	SAT TT=16.056 ASSIGNMENTS=99	SAT TT=1352.11 ASSIGNMENTS=6159	SAT TT=1510.03 CHECKS=13889200000 NODES=18944	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=13.329 ASSIGNMENTS=3643 CHECKS=6280	SAT TT=13.892 ASSIGNMENTS=3643 CHECKS=6280	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=23.564 CHECKS=635281	SAT TT=49.06 ASSIGNMENTS=2351 CHECKS=185680	SAT TT=957.925 ASSIGNMENTS=44839 CHECKS=3920490	SAT TT=284.547	SAT TT=195.546 ASSIGNMENTS=9679 CHECKS=846691	SAT TT=57.258 ASSIGNMENTS=2939 CHECKS=216796	? TT=100.943	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05
csp/ogdVg/ normalized-crossword-m1c-ogd-vg6-9_ext.xml	SAT TT=36.449	SAT TT=224.14 CHECKS=360767 NODES=175034	SAT TT=193.642 CHECKS=310908 NODES=131717	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800	SAT TT=234.109 ASSIGNMENTS=175034 CHECKS=360767	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=36.449 CHECKS=785238	SAT TT=1365.79 ASSIGNMENTS=44721 CHECKS=3897980	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=1390.37 ASSIGNMENTS=46379 CHECKS=4046340	? TT=100.63	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/ogdVg/ normalized-crossword-m1c-ogd-vg7-10_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=118.79	? (TO) TT=1800.07	? (TO) TT=1800.21	? (TO) TT=1800.02
csp/ogdVg/ normalized-crossword-m1c-ogd-vg7-11_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=120.365	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdVg/ normalized-crossword-m1c-ogd-vg7-7_ext.xml	SAT TT=1.082	SAT TT=5.29 CHECKS=3169 NODES=2303	SAT TT=2.059 CHECKS=15 NODES=134	SAT TT=1454.8	SAT TT=455.258 CHECKS=383399	SAT TT=38.587 CHECKS=19400	? (TO) TT=1800.15	SAT TT=46.698 ASSIGNMENTS=337	SAT TT=9.241 CHECKS=0 NODES=1352	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=13.075 ASSIGNMENTS=2296 CHECKS=3562	SAT TT=13.049 ASSIGNMENTS=2296 CHECKS=3562	? (TO) TT=1800	SAT TT=1001.96	SAT TT=1.082 CHECKS=21133	SAT TT=8.435 ASSIGNMENTS=553 CHECKS=60632	SAT TT=43.142 ASSIGNMENTS=4112 CHECKS=270622	SAT TT=11.535	SAT TT=849.349 ASSIGNMENTS=67661 CHECKS=5853160	SAT TT=9.894 ASSIGNMENTS=595 CHECKS=63657	? TT=80.978	SAT TT=74.075 ASSIGNMENTS=451 CHECKS=1149820	SAT TT=1036.91	? (TO) TT=1800.03
csp/ogdVg/ normalized-crossword-m1c-ogd-vg7-8_ext.xml	SAT TT=702.439	SAT TT=702.439 CHECKS=1229680 NODES=415397	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? TT=82.491	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02
csp/ogdVg/ normalized-crossword-m1c-ogd-vg7-9_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.1	? TT=101.094	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/ogdVg/ normalized-crossword-m1c-ogd-vg8-10_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (MO) TT=34.38	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=39.628	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.2
csp/ogdVg/ normalized-crossword-m1c-ogd-vg8-11_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.09	? (MO) TT=33.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=33.904	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.15
csp/ogdVg/ normalized-crossword-m1c-ogd-vg8-12_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (MO) TT=33.17	? (TO) TT=1800.08	? (TO) TT=1800.08	? TT=33.598	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.15
csp/ogdVg/ normalized-crossword-m1c-ogd-vg8-8_ext.xml	SAT TT=24.369	SAT TT=85.533 CHECKS=36691 NODES=19214	SAT TT=1521.21 CHECKS=1227840 NODES=423141	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.17	SAT TT=63.225 ASSIGNMENTS=108	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=24.369 ASSIGNMENTS=3194 CHECKS=4324	SAT TT=24.756 ASSIGNMENTS=3194 CHECKS=4324	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=737.285 ASSIGNMENTS=19240 CHECKS=2077540	? (TO) TT=1800.04	SAT TT=30.52	SAT TT=758.225 ASSIGNMENTS=20687 CHECKS=2221110	SAT TT=758.685 ASSIGNMENTS=18692 CHECKS=2090520	? TT=35.713	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.03
csp/ogdVg/ normalized-crossword-m1c-ogd-vg9-10_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.02	? (MO) TT=36.71	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=31.35	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.03
csp/ogdVg/ normalized-crossword-m1c-ogd-vg9-12_ext.xml		? (TO) TT=1800.04	? (MO) TT=1.371	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (MO) TT=32.5	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=33.512	? (TO) TT=1800.05	? (TO) TT=1800.19	? (TO) TT=1800.12
csp/ogdVg/ normalized-crossword-m1c-ogd-vg9-13_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.06	? (MO) TT=32.94	? (TO) TT=1800.1	? (TO) TT=1800.04	? TT=38.863	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.13
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdVg/ normalized-crossword-m1c-ogd-vg9-9_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (MO) TT=36.29	? (TO) TT=1800.05	? (TO) TT=1800.04	? TT=28.965	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.02
csp/pret/ normalized-pret-150-25_ext.xml	UNSAT TT=0.655	UNSAT TT=16.476 CHECKS=1957000 NODES=250870	UNSAT TT=75.088 CHECKS=10549000 NODES=1222260	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=24.314 ASSIGNMENTS=250870 CHECKS=1957000	UNSAT TT=23.022 ASSIGNMENTS=250870 CHECKS=1957000	UNSAT TT=0.959	UNSAT TT=0.791	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=1.305	? (TO) TT=1800.08	UNSAT TT=0.655	UNSAT TT=0.698
csp/pret/ normalized-pret-150-40_ext.xml	UNSAT TT=0.657	UNSAT TT=39.513 CHECKS=4869560 NODES=579823	UNSAT TT=135.662 CHECKS=20264500 NODES=2151090	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=43.814 ASSIGNMENTS=579823 CHECKS=4869560	UNSAT TT=46.48 ASSIGNMENTS=579823 CHECKS=4869560	UNSAT TT=0.776	UNSAT TT=1.002	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=1.364	? (TO) TT=1800.09	UNSAT TT=0.657	UNSAT TT=0.68
csp/pret/ normalized-pret-150-60_ext.xml	UNSAT TT=0.648	UNSAT TT=26.542 CHECKS=2650900 NODES=413451	UNSAT TT=17.021 CHECKS=1505670 NODES=248750	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=33.33 ASSIGNMENTS=413451 CHECKS=2650900	UNSAT TT=33.421 ASSIGNMENTS=413451 CHECKS=2650900	UNSAT TT=0.79	UNSAT TT=0.761	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=1.31	? (TO) TT=1800.08	UNSAT TT=0.691	UNSAT TT=0.648
csp/pret/ normalized-pret-150-75_ext.xml	UNSAT TT=0.683	UNSAT TT=56.792 CHECKS=6529300 NODES=917091	? (TO) TT=1800.19	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=63.624 ASSIGNMENTS=917091 CHECKS=6529300	UNSAT TT=63.884 ASSIGNMENTS=917091 CHECKS=6529300	UNSAT TT=0.762	UNSAT TT=0.74	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1788.25	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=1.44	? (TO) TT=1800.06	UNSAT TT=0.708	UNSAT TT=0.683
csp/pret/ normalized-pret-60-25_ext.xml	UNSAT TT=0.532	UNSAT TT=0.994 CHECKS=26773 NODES=5996	UNSAT TT=0.999 CHECKS=9166 NODES=3214	UNSAT TT=14.298	UNSAT TT=148.749 CHECKS=123167000	UNSAT TT=178.469 CHECKS=125587000	UNSAT TT=106.307 ASSIGNMENTS=1759700	UNSAT TT=134.482 ASSIGNMENTS=2097870	UNSAT TT=108.192 CHECKS=75992200 NODES=4473240	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=8.372 ASSIGNMENTS=5996 CHECKS=26773	UNSAT TT=8.491 ASSIGNMENTS=5996 CHECKS=26773	UNSAT TT=0.608	UNSAT TT=0.681	UNSAT TT=32.218 CHECKS=31394700	UNSAT TT=14.902 ASSIGNMENTS=2233420 CHECKS=27921700	UNSAT TT=16.492 ASSIGNMENTS=2328400 CHECKS=30992600	UNSAT TT=27.228	UNSAT TT=14.359 ASSIGNMENTS=2097620 CHECKS=24568900	UNSAT TT=14.086 ASSIGNMENTS=2082170 CHECKS=27862000	UNSAT TT=1.142	UNSAT TT=119.243 ASSIGNMENTS=11902900 CHECKS=46066900	UNSAT TT=0.543	UNSAT TT=0.532
csp/pret/ normalized-pret-60-40_ext.xml	UNSAT TT=0.532	UNSAT TT=6.812 CHECKS=1128880 NODES=145938	UNSAT TT=2.371 CHECKS=202609 NODES=36757	UNSAT TT=13.631	UNSAT TT=154.651 CHECKS=131007000	UNSAT TT=153.79 CHECKS=107612000	UNSAT TT=108.288 ASSIGNMENTS=1786280	UNSAT TT=118.074 ASSIGNMENTS=2097870	UNSAT TT=74.858 CHECKS=53422400 NODES=2913330	? (TO) TT=1800.1	? (TO) TT=1800.01	UNSAT TT=13.049 ASSIGNMENTS=145938 CHECKS=1128880	UNSAT TT=13.348 ASSIGNMENTS=145938 CHECKS=1128880	UNSAT TT=0.604	UNSAT TT=0.602	UNSAT TT=32.318 CHECKS=31394700	UNSAT TT=13.295 ASSIGNMENTS=2021840 CHECKS=26919900	UNSAT TT=17.921 ASSIGNMENTS=2303120 CHECKS=34018600	UNSAT TT=24.84	UNSAT TT=16.021 ASSIGNMENTS=2127050 CHECKS=30136100	UNSAT TT=11.896 ASSIGNMENTS=1924220 CHECKS=22541300	UNSAT TT=1.088	UNSAT TT=107.646 ASSIGNMENTS=11750700 CHECKS=44961000	UNSAT TT=0.535	UNSAT TT=0.532
csp/pret/ normalized-pret-60-60_ext.xml	UNSAT TT=0.524	UNSAT TT=1.269 CHECKS=56760 NODES=14091	UNSAT TT=1.247 CHECKS=54596 NODES=12484	UNSAT TT=13.673	UNSAT TT=83.091 CHECKS=53840200	UNSAT TT=145.452 CHECKS=131118000	UNSAT TT=120.377 ASSIGNMENTS=1971740	UNSAT TT=124.965 ASSIGNMENTS=2066640	UNSAT TT=99.051 CHECKS=66763900 NODES=3902360	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=8.232 ASSIGNMENTS=14091 CHECKS=56760	UNSAT TT=8.973 ASSIGNMENTS=14091 CHECKS=56760	UNSAT TT=0.61	UNSAT TT=0.784	UNSAT TT=31.925 CHECKS=27144700	UNSAT TT=14.238 ASSIGNMENTS=2028550 CHECKS=27031200	UNSAT TT=18.227 ASSIGNMENTS=2286460 CHECKS=34709400	UNSAT TT=23.025	UNSAT TT=14.695 ASSIGNMENTS=2073900 CHECKS=27376900	UNSAT TT=14.166 ASSIGNMENTS=2088260 CHECKS=26854300	UNSAT TT=1.129	UNSAT TT=111.663 ASSIGNMENTS=12040200 CHECKS=49119300	UNSAT TT=0.56	UNSAT TT=0.524
csp/pret/ normalized-pret-60-75_ext.xml	UNSAT TT=0.509	UNSAT TT=1.609 CHECKS=103001 NODES=22469	UNSAT TT=1.683 CHECKS=114581 NODES=23701	UNSAT TT=13.561	UNSAT TT=155.069 CHECKS=99884800	UNSAT TT=148.731 CHECKS=133991000	UNSAT TT=133.421 ASSIGNMENTS=2160460	UNSAT TT=127.654 ASSIGNMENTS=2090600	UNSAT TT=91.467 CHECKS=62716700 NODES=3617560	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=8.442 ASSIGNMENTS=22469 CHECKS=103001	UNSAT TT=8.622 ASSIGNMENTS=22469 CHECKS=103001	UNSAT TT=0.602	UNSAT TT=0.612	UNSAT TT=32.212 CHECKS=32036800	UNSAT TT=12.038 ASSIGNMENTS=2082980 CHECKS=24288200	UNSAT TT=18.398 ASSIGNMENTS=2260760 CHECKS=37719200	UNSAT TT=25.259	UNSAT TT=11.665 ASSIGNMENTS=1726070 CHECKS=21658700	UNSAT TT=13.579 ASSIGNMENTS=2130430 CHECKS=27539900	UNSAT TT=1.077	UNSAT TT=118.378 ASSIGNMENTS=11868400 CHECKS=48695900	UNSAT TT=0.542	UNSAT TT=0.509
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-0_ext.xml	UNSAT TT=0.687	UNSAT TT=1.783 CHECKS=0 NODES=1034	UNSAT TT=1.763 CHECKS=0 NODES=1000	? (TO) TT=1800.05	UNSAT TT=97.561 CHECKS=84652	UNSAT TT=81.938 CHECKS=92836	UNSAT TT=6.805 ASSIGNMENTS=111	UNSAT TT=8.255 ASSIGNMENTS=119	UNSAT TT=2.885 CHECKS=0 NODES=1143	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=10.423 ASSIGNMENTS=858 CHECKS=9363	UNSAT TT=9.303 ASSIGNMENTS=1034 CHECKS=0	UNSAT TT=248.424	UNSAT TT=521.031	UNSAT TT=0.687 CHECKS=6634	UNSAT TT=2.961 ASSIGNMENTS=858 CHECKS=9142	UNSAT TT=11.534 ASSIGNMENTS=4186 CHECKS=39944	UNSAT TT=3.874	UNSAT TT=2.587 ASSIGNMENTS=1037 CHECKS=9700	UNSAT TT=2.881 ASSIGNMENTS=858 CHECKS=9363	? TT=41.071	UNSAT TT=1548.51 ASSIGNMENTS=111148 CHECKS=993417000	UNSAT TT=852.803	UNSAT TT=988.571
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-10_ext.xml	UNSAT TT=0.68	UNSAT TT=1.564 CHECKS=0 NODES=955	UNSAT TT=1.576 CHECKS=0 NODES=955	UNSAT TT=409.533	UNSAT TT=62.664 CHECKS=65415	UNSAT TT=87.083 CHECKS=91031	UNSAT TT=5.997 ASSIGNMENTS=111	UNSAT TT=15.38 ASSIGNMENTS=448	UNSAT TT=1.833 CHECKS=0 NODES=1048	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=10.532 ASSIGNMENTS=783 CHECKS=9214	UNSAT TT=9.084 ASSIGNMENTS=955 CHECKS=0	UNSAT TT=354.85	UNSAT TT=388.111	UNSAT TT=0.68 CHECKS=7548	UNSAT TT=3.024 ASSIGNMENTS=783 CHECKS=9214	UNSAT TT=11.217 ASSIGNMENTS=4194 CHECKS=38331	UNSAT TT=3.857	UNSAT TT=3.305 ASSIGNMENTS=996 CHECKS=10589	UNSAT TT=3.083 ASSIGNMENTS=783 CHECKS=9214	? TT=37.275	UNSAT TT=1106.59 ASSIGNMENTS=111306 CHECKS=664299000	UNSAT TT=866.878	? (TO) TT=1800.03
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-11_ext.xml	UNSAT TT=1.697	UNSAT TT=1.718 CHECKS=0 NODES=994	UNSAT TT=2.058 CHECKS=0 NODES=994	UNSAT TT=137.719	UNSAT TT=102.193 CHECKS=75714	UNSAT TT=92.784 CHECKS=76526	UNSAT TT=6.44 ASSIGNMENTS=111	UNSAT TT=28.637 ASSIGNMENTS=827	UNSAT TT=2.071 CHECKS=0 NODES=1267	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=9.62 ASSIGNMENTS=779 CHECKS=8712	UNSAT TT=9.45 ASSIGNMENTS=994 CHECKS=0	UNSAT TT=189.382	UNSAT TT=470.024	UNSAT TT=1.697 CHECKS=7595	UNSAT TT=2.561 ASSIGNMENTS=779 CHECKS=8712	UNSAT TT=11.008 ASSIGNMENTS=4157 CHECKS=36877	UNSAT TT=8.821	UNSAT TT=2.762 ASSIGNMENTS=997 CHECKS=9581	UNSAT TT=2.394 ASSIGNMENTS=779 CHECKS=8712	? TT=29.038	UNSAT TT=988.95 ASSIGNMENTS=111165 CHECKS=623182000	UNSAT TT=878.643	UNSAT TT=1160.01
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-12_ext.xml	UNSAT TT=0.993	UNSAT TT=1.874 CHECKS=0 NODES=1445	UNSAT TT=2.14 CHECKS=0 NODES=1443	UNSAT TT=845.741	UNSAT TT=92.262 CHECKS=84106	UNSAT TT=88.869 CHECKS=92029	UNSAT TT=6.563 ASSIGNMENTS=111	UNSAT TT=32.592 ASSIGNMENTS=1050	UNSAT TT=1.635 CHECKS=0 NODES=1152	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=9.921 ASSIGNMENTS=750 CHECKS=7936	UNSAT TT=9.376 ASSIGNMENTS=1445 CHECKS=0	UNSAT TT=163.919	UNSAT TT=277.045	UNSAT TT=0.993 CHECKS=7378	UNSAT TT=2.289 ASSIGNMENTS=750 CHECKS=7936	UNSAT TT=9.818 ASSIGNMENTS=4129 CHECKS=35123	UNSAT TT=5.66	UNSAT TT=2.588 ASSIGNMENTS=967 CHECKS=9064	UNSAT TT=2.314 ASSIGNMENTS=750 CHECKS=7936	? TT=35.453	UNSAT TT=34.453 ASSIGNMENTS=112034 CHECKS=19182400	UNSAT TT=925.294	UNSAT TT=889.334
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-13_ext.xml	UNSAT TT=0.742	UNSAT TT=2.34 CHECKS=0 NODES=1727	UNSAT TT=2.097 CHECKS=0 NODES=1727	UNSAT TT=98.91	UNSAT TT=96.824 CHECKS=84944	UNSAT TT=79.726 CHECKS=96184	UNSAT TT=6.241 ASSIGNMENTS=111	UNSAT TT=19.029 ASSIGNMENTS=426	UNSAT TT=2.405 CHECKS=0 NODES=1148	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=10.477 ASSIGNMENTS=820 CHECKS=8646	UNSAT TT=9.143 ASSIGNMENTS=872 CHECKS=0	UNSAT TT=330.711	UNSAT TT=532.987	UNSAT TT=0.742 CHECKS=6946	UNSAT TT=2.708 ASSIGNMENTS=819 CHECKS=8622	UNSAT TT=11.449 ASSIGNMENTS=4193 CHECKS=38215	UNSAT TT=4.249	UNSAT TT=2.892 ASSIGNMENTS=1021 CHECKS=9460	UNSAT TT=2.805 ASSIGNMENTS=820 CHECKS=8646	? TT=31.836	UNSAT TT=148.915 ASSIGNMENTS=111408 CHECKS=101838000	UNSAT TT=1062.68	UNSAT TT=1653.33
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-14_ext.xml	UNSAT TT=0.543	UNSAT TT=1.603 CHECKS=0 NODES=999	UNSAT TT=1.582 CHECKS=0 NODES=999	UNSAT TT=690.455	UNSAT TT=112.003 CHECKS=90764	UNSAT TT=93.372 CHECKS=87869	UNSAT TT=7.745 ASSIGNMENTS=111	UNSAT TT=31.029 ASSIGNMENTS=561	UNSAT TT=2.312 CHECKS=0 NODES=1267	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=10.665 ASSIGNMENTS=825 CHECKS=10188	UNSAT TT=9.013 ASSIGNMENTS=999 CHECKS=0	UNSAT TT=181.698	UNSAT TT=582.025	UNSAT TT=0.543 CHECKS=6684	UNSAT TT=2.488 ASSIGNMENTS=825 CHECKS=10188	UNSAT TT=10.851 ASSIGNMENTS=4228 CHECKS=38861	UNSAT TT=5.505	UNSAT TT=3.403 ASSIGNMENTS=1116 CHECKS=11785	UNSAT TT=2.648 ASSIGNMENTS=825 CHECKS=10188	? TT=39.556	UNSAT TT=575.567 ASSIGNMENTS=112961 CHECKS=372329000	UNSAT TT=818.811	UNSAT TT=795.736
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-15_ext.xml	UNSAT TT=0.638	UNSAT TT=2.008 CHECKS=0 NODES=923	UNSAT TT=2.358 CHECKS=0 NODES=939	UNSAT TT=39.812	UNSAT TT=99.945 CHECKS=80798	UNSAT TT=42.644 CHECKS=43232	UNSAT TT=6.97 ASSIGNMENTS=111	UNSAT TT=185.712 ASSIGNMENTS=4477	UNSAT TT=2.52 CHECKS=0 NODES=1262	? (TO) TT=1800.09	? (TO) TT=1800	UNSAT TT=9.865 ASSIGNMENTS=819 CHECKS=9297	UNSAT TT=9.708 ASSIGNMENTS=923 CHECKS=0	UNSAT TT=305.844	UNSAT TT=550.906	UNSAT TT=0.638 CHECKS=6708	UNSAT TT=2.519 ASSIGNMENTS=818 CHECKS=9175	UNSAT TT=11.486 ASSIGNMENTS=4181 CHECKS=40421	UNSAT TT=5.584	UNSAT TT=2.928 ASSIGNMENTS=1030 CHECKS=10319	UNSAT TT=2.596 ASSIGNMENTS=819 CHECKS=9297	? TT=32.34	UNSAT TT=110.566 ASSIGNMENTS=111496 CHECKS=65326100	UNSAT TT=891.12	UNSAT TT=912.119
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-16_ext.xml	UNSAT TT=0.676	UNSAT TT=1.661 CHECKS=0 NODES=959	UNSAT TT=1.653 CHECKS=0 NODES=1197	? (TO) TT=1800.03	UNSAT TT=98.713 CHECKS=90081	UNSAT TT=74.406 CHECKS=81917	UNSAT TT=8.027 ASSIGNMENTS=111	UNSAT TT=19.029 ASSIGNMENTS=617	UNSAT TT=2.379 CHECKS=0 NODES=1282	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=10.987 ASSIGNMENTS=910 CHECKS=11498	UNSAT TT=8.92 ASSIGNMENTS=959 CHECKS=0	UNSAT TT=139.674	UNSAT TT=222.808	UNSAT TT=0.676 CHECKS=8717	UNSAT TT=3.291 ASSIGNMENTS=888 CHECKS=11094	UNSAT TT=11.31 ASSIGNMENTS=4229 CHECKS=39639	UNSAT TT=9.982	UNSAT TT=3.075 ASSIGNMENTS=1091 CHECKS=11621	UNSAT TT=3.383 ASSIGNMENTS=910 CHECKS=11498	? TT=33.919	UNSAT TT=218.527 ASSIGNMENTS=112957 CHECKS=132832000	UNSAT TT=804.402	UNSAT TT=985.492
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-17_ext.xml	UNSAT TT=0.641	UNSAT TT=1.58 CHECKS=0 NODES=930	UNSAT TT=1.622 CHECKS=0 NODES=930	UNSAT TT=107.804	UNSAT TT=82.185 CHECKS=76311	UNSAT TT=85.375 CHECKS=96474	UNSAT TT=6.655 ASSIGNMENTS=111	UNSAT TT=8.898 ASSIGNMENTS=131	UNSAT TT=1.919 CHECKS=0 NODES=1037	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=9.536 ASSIGNMENTS=757 CHECKS=8087	UNSAT TT=9.257 ASSIGNMENTS=930 CHECKS=0	UNSAT TT=225.623	UNSAT TT=506.88	UNSAT TT=0.641 CHECKS=6823	UNSAT TT=2.428 ASSIGNMENTS=756 CHECKS=8103	UNSAT TT=10.076 ASSIGNMENTS=4218 CHECKS=36020	UNSAT TT=3.704	UNSAT TT=2.697 ASSIGNMENTS=970 CHECKS=8959	UNSAT TT=2.378 ASSIGNMENTS=757 CHECKS=8087	? TT=35.801	UNSAT TT=203.298 ASSIGNMENTS=111114 CHECKS=122445000	UNSAT TT=783.204	UNSAT TT=847.535
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-18_ext.xml	UNSAT TT=0.578	UNSAT TT=1.383 CHECKS=0 NODES=835	UNSAT TT=1.528 CHECKS=0 NODES=835	? (TO) TT=1800.1	UNSAT TT=93.704 CHECKS=88306	UNSAT TT=85.669 CHECKS=91813	UNSAT TT=5.457 ASSIGNMENTS=111	UNSAT TT=20.218 ASSIGNMENTS=487	UNSAT TT=1.984 CHECKS=0 NODES=1056	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=10.378 ASSIGNMENTS=793 CHECKS=8575	UNSAT TT=9.166 ASSIGNMENTS=835 CHECKS=0	UNSAT TT=165.26	UNSAT TT=260.676	UNSAT TT=0.578 CHECKS=6643	UNSAT TT=2.611 ASSIGNMENTS=793 CHECKS=8575	UNSAT TT=10.337 ASSIGNMENTS=4217 CHECKS=36020	UNSAT TT=3.086	UNSAT TT=3.014 ASSIGNMENTS=994 CHECKS=9482	UNSAT TT=2.649 ASSIGNMENTS=793 CHECKS=8575	? TT=31.65	? (TO) TT=1800.02	UNSAT TT=809.883	UNSAT TT=1083.6
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-19_ext.xml	UNSAT TT=0.674	UNSAT TT=1.899 CHECKS=0 NODES=1370	UNSAT TT=2.13 CHECKS=0 NODES=1474	UNSAT TT=189.189	UNSAT TT=103.305 CHECKS=80298	UNSAT TT=88.588 CHECKS=82977	UNSAT TT=5.805 ASSIGNMENTS=111	UNSAT TT=24.691 ASSIGNMENTS=843	UNSAT TT=2.058 CHECKS=0 NODES=1036	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=9.513 ASSIGNMENTS=797 CHECKS=8758	UNSAT TT=9.467 ASSIGNMENTS=1370 CHECKS=0	UNSAT TT=158.294	UNSAT TT=235.035	UNSAT TT=0.674 CHECKS=6327	UNSAT TT=2.501 ASSIGNMENTS=780 CHECKS=8716	UNSAT TT=11.184 ASSIGNMENTS=4121 CHECKS=38789	UNSAT TT=8.054	UNSAT TT=2.569 ASSIGNMENTS=997 CHECKS=9712	UNSAT TT=2.5 ASSIGNMENTS=797 CHECKS=8758	? TT=32.628	UNSAT TT=1534.02 ASSIGNMENTS=111289 CHECKS=993647000	UNSAT TT=1093.92	UNSAT TT=1500.6
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-1_ext.xml	UNSAT TT=0.731	UNSAT TT=2.954 CHECKS=0 NODES=2509	UNSAT TT=2.939 CHECKS=0 NODES=2588	UNSAT TT=71.571	UNSAT TT=99.77 CHECKS=83916	UNSAT TT=89.623 CHECKS=90474	UNSAT TT=5.563 ASSIGNMENTS=111	UNSAT TT=15.895 ASSIGNMENTS=255	UNSAT TT=2.088 CHECKS=0 NODES=1060	? (TO) TT=1800	? (TO) TT=1800.08	UNSAT TT=9.653 ASSIGNMENTS=848 CHECKS=8798	UNSAT TT=10.485 ASSIGNMENTS=2509 CHECKS=0	UNSAT TT=282.682	UNSAT TT=446.772	UNSAT TT=0.731 CHECKS=6817	UNSAT TT=2.597 ASSIGNMENTS=858 CHECKS=9252	UNSAT TT=12.05 ASSIGNMENTS=4297 CHECKS=39761	UNSAT TT=6.834	UNSAT TT=3.006 ASSIGNMENTS=1101 CHECKS=11768	UNSAT TT=2.38 ASSIGNMENTS=848 CHECKS=8798	? TT=35.815	UNSAT TT=12.488 ASSIGNMENTS=113026 CHECKS=6262060	UNSAT TT=875.84	UNSAT TT=885.68
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-2_ext.xml	UNSAT TT=1.158	UNSAT TT=1.216 CHECKS=0 NODES=756	UNSAT TT=1.358 CHECKS=0 NODES=752	UNSAT TT=110.626	UNSAT TT=95.068 CHECKS=87092	UNSAT TT=82.026 CHECKS=92245	UNSAT TT=4.37 ASSIGNMENTS=111	UNSAT TT=17.24 ASSIGNMENTS=345	UNSAT TT=1.872 CHECKS=0 NODES=958	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=9.549 ASSIGNMENTS=724 CHECKS=7052	UNSAT TT=9.002 ASSIGNMENTS=756 CHECKS=0	UNSAT TT=91.282	UNSAT TT=125.435	UNSAT TT=1.158 CHECKS=7001	UNSAT TT=1.879 ASSIGNMENTS=724 CHECKS=7052	UNSAT TT=8.898 ASSIGNMENTS=4193 CHECKS=32554	UNSAT TT=5.189	UNSAT TT=2.299 ASSIGNMENTS=951 CHECKS=8586	UNSAT TT=1.682 ASSIGNMENTS=724 CHECKS=7052	? TT=36.543	UNSAT TT=1309.97 ASSIGNMENTS=111110 CHECKS=841934000	UNSAT TT=803.837	UNSAT TT=986.755
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-3_ext.xml	UNSAT TT=0.64	UNSAT TT=1.551 CHECKS=0 NODES=853	UNSAT TT=1.684 CHECKS=0 NODES=874	? (TO) TT=1800.05	UNSAT TT=98.694 CHECKS=92760	UNSAT TT=93.108 CHECKS=112488	UNSAT TT=7.014 ASSIGNMENTS=111	UNSAT TT=19.734 ASSIGNMENTS=679	UNSAT TT=2.562 CHECKS=0 NODES=1274	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=10.625 ASSIGNMENTS=899 CHECKS=10540	UNSAT TT=9.689 ASSIGNMENTS=853 CHECKS=0	UNSAT TT=181.322	UNSAT TT=348.264	UNSAT TT=0.64 CHECKS=7560	UNSAT TT=2.673 ASSIGNMENTS=902 CHECKS=10428	UNSAT TT=10.814 ASSIGNMENTS=4256 CHECKS=38715	UNSAT TT=5.018	UNSAT TT=3.502 ASSIGNMENTS=1136 CHECKS=12562	UNSAT TT=3.159 ASSIGNMENTS=899 CHECKS=10540	? TT=35.834	? (TO) TT=1800.01	UNSAT TT=1121.42	UNSAT TT=1675.11
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-4_ext.xml	UNSAT TT=0.674	UNSAT TT=1.893 CHECKS=0 NODES=1140	UNSAT TT=1.824 CHECKS=0 NODES=1140	UNSAT TT=1487.26	UNSAT TT=92.26 CHECKS=83398	UNSAT TT=88.72 CHECKS=88194	UNSAT TT=5.563 ASSIGNMENTS=111	UNSAT TT=11.67 ASSIGNMENTS=191	UNSAT TT=1.908 CHECKS=0 NODES=1027	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=9.927 ASSIGNMENTS=743 CHECKS=7756	UNSAT TT=9.678 ASSIGNMENTS=1140 CHECKS=0	UNSAT TT=219.859	UNSAT TT=476.404	UNSAT TT=0.674 CHECKS=6691	UNSAT TT=2.762 ASSIGNMENTS=774 CHECKS=8402	UNSAT TT=10.38 ASSIGNMENTS=4118 CHECKS=37012	UNSAT TT=3.847	UNSAT TT=2.481 ASSIGNMENTS=959 CHECKS=8708	UNSAT TT=2.186 ASSIGNMENTS=743 CHECKS=7756	? TT=33.029	UNSAT TT=450.423 ASSIGNMENTS=111110 CHECKS=346052000	UNSAT TT=863.232	UNSAT TT=914.948
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-5_ext.xml	UNSAT TT=1.002	UNSAT TT=3.467 CHECKS=0 NODES=1474	UNSAT TT=3.461 CHECKS=0 NODES=1542	? (TO) TT=1800.1	UNSAT TT=114.41 CHECKS=91305	UNSAT TT=106.646 CHECKS=96506	UNSAT TT=7.268 ASSIGNMENTS=111	UNSAT TT=19.665 ASSIGNMENTS=413	UNSAT TT=2.298 CHECKS=0 NODES=1375	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=10.489 ASSIGNMENTS=895 CHECKS=11369	UNSAT TT=9.947 ASSIGNMENTS=1474 CHECKS=0	UNSAT TT=284.375	UNSAT TT=732.757	UNSAT TT=1.002 CHECKS=6992	UNSAT TT=2.573 ASSIGNMENTS=863 CHECKS=9314	UNSAT TT=11.471 ASSIGNMENTS=4267 CHECKS=42607	UNSAT TT=10.46	UNSAT TT=3.344 ASSIGNMENTS=1108 CHECKS=12607	UNSAT TT=2.985 ASSIGNMENTS=895 CHECKS=11369	? TT=31.555	? (TO) TT=1800.07	UNSAT TT=1002.13	UNSAT TT=1432.77
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-6_ext.xml	UNSAT TT=0.676	UNSAT TT=2.009 CHECKS=0 NODES=882	UNSAT TT=2.03 CHECKS=0 NODES=871	UNSAT TT=121.364	UNSAT TT=101.019 CHECKS=87241	UNSAT TT=92.62 CHECKS=91176	UNSAT TT=6.833 ASSIGNMENTS=111	UNSAT TT=30.432 ASSIGNMENTS=813	UNSAT TT=1.942 CHECKS=0 NODES=1059	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=9.996 ASSIGNMENTS=815 CHECKS=8334	UNSAT TT=9.257 ASSIGNMENTS=882 CHECKS=0	UNSAT TT=139.348	UNSAT TT=489.974	UNSAT TT=0.676 CHECKS=6109	UNSAT TT=2.252 ASSIGNMENTS=815 CHECKS=8330	UNSAT TT=11.083 ASSIGNMENTS=4280 CHECKS=38745	UNSAT TT=4.996	UNSAT TT=2.995 ASSIGNMENTS=1060 CHECKS=10691	UNSAT TT=2.204 ASSIGNMENTS=815 CHECKS=8334	? TT=35.212	UNSAT TT=30.005 ASSIGNMENTS=113031 CHECKS=14766900	UNSAT TT=912.117	UNSAT TT=1060.66
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-7_ext.xml	UNSAT TT=0.73	UNSAT TT=2.041 CHECKS=0 NODES=2580	UNSAT TT=2.135 CHECKS=0 NODES=2633	? (TO) TT=1800.11	UNSAT TT=94.408 CHECKS=85397	UNSAT TT=70.046 CHECKS=72073	UNSAT TT=5.886 ASSIGNMENTS=111	UNSAT TT=38.272 ASSIGNMENTS=1080	UNSAT TT=2.178 CHECKS=0 NODES=1030	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=9.626 ASSIGNMENTS=762 CHECKS=7913	UNSAT TT=9.522 ASSIGNMENTS=2580 CHECKS=0	UNSAT TT=187.704	UNSAT TT=290.574	UNSAT TT=0.73 CHECKS=6735	UNSAT TT=2.23 ASSIGNMENTS=762 CHECKS=7913	UNSAT TT=10.02 ASSIGNMENTS=4125 CHECKS=37673	UNSAT TT=6.665	UNSAT TT=2.313 ASSIGNMENTS=949 CHECKS=8791	UNSAT TT=2.187 ASSIGNMENTS=762 CHECKS=7913	? TT=32.15	UNSAT TT=1439.49 ASSIGNMENTS=111110 CHECKS=948399000	UNSAT TT=781.079	UNSAT TT=800.169
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-8_ext.xml	UNSAT TT=0.725	UNSAT TT=2.175 CHECKS=0 NODES=1045	UNSAT TT=2.072 CHECKS=0 NODES=1052	? (TO) TT=1800.03	UNSAT TT=116.997 CHECKS=89071	UNSAT TT=111.636 CHECKS=91478	UNSAT TT=8.047 ASSIGNMENTS=112	UNSAT TT=21.348 ASSIGNMENTS=647	UNSAT TT=2.515 CHECKS=0 NODES=1387	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=10.821 ASSIGNMENTS=945 CHECKS=12317	UNSAT TT=9.296 ASSIGNMENTS=1045 CHECKS=0	UNSAT TT=295.363	UNSAT TT=528.905	UNSAT TT=0.725 CHECKS=9155	UNSAT TT=3.826 ASSIGNMENTS=989 CHECKS=12929	UNSAT TT=12.691 ASSIGNMENTS=4309 CHECKS=43520	UNSAT TT=11.509	UNSAT TT=4.142 ASSIGNMENTS=1180 CHECKS=13636	UNSAT TT=3.833 ASSIGNMENTS=945 CHECKS=12317	? TT=32.507	UNSAT TT=417.371 ASSIGNMENTS=113004 CHECKS=268148000	UNSAT TT=952.622	UNSAT TT=941.839
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-9_ext.xml	UNSAT TT=1.065	UNSAT TT=1.438 CHECKS=0 NODES=916	UNSAT TT=1.453 CHECKS=0 NODES=916	UNSAT TT=258.533	UNSAT TT=101.754 CHECKS=80625	UNSAT TT=91.802 CHECKS=88350	UNSAT TT=6.276 ASSIGNMENTS=111	UNSAT TT=26.456 ASSIGNMENTS=848	UNSAT TT=2.616 CHECKS=0 NODES=1259	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=9.972 ASSIGNMENTS=871 CHECKS=9291	UNSAT TT=9.272 ASSIGNMENTS=916 CHECKS=0	UNSAT TT=194.989	UNSAT TT=305.505	UNSAT TT=1.065 CHECKS=7536	UNSAT TT=2.963 ASSIGNMENTS=834 CHECKS=10247	UNSAT TT=11.198 ASSIGNMENTS=4217 CHECKS=40681	UNSAT TT=7.393	UNSAT TT=2.896 ASSIGNMENTS=1034 CHECKS=11129	UNSAT TT=2.438 ASSIGNMENTS=871 CHECKS=9291	? TT=33.739	UNSAT TT=1736.23 ASSIGNMENTS=111301 CHECKS=1006860000	UNSAT TT=1688.06	? (TO) TT=1800.09
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-13_ext.xml	SAT TT=13.027	SAT TT=338.321 CHECKS=2540030 NODES=233472	SAT TT=395.31 CHECKS=2333930 NODES=224781	SAT TT=394.887	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=509.483 ASSIGNMENTS=48630	SAT TT=1393.54 ASSIGNMENTS=90767	SAT TT=50.452 CHECKS=170902000 NODES=135403	SAT TT=86.063 CHECKS=766397000 NODES=2437300	? (TO) TT=1800.09	SAT TT=37.468 ASSIGNMENTS=110865 CHECKS=16008600	SAT TT=37.936 ASSIGNMENTS=110865 CHECKS=16008600	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=13.027 CHECKS=2346640	SAT TT=29.129 ASSIGNMENTS=110455 CHECKS=15960700	SAT TT=31.072 ASSIGNMENTS=116907 CHECKS=16395400	SAT TT=260.383	SAT TT=30.423 ASSIGNMENTS=111111 CHECKS=16050000	SAT TT=29.989 ASSIGNMENTS=110865 CHECKS=16008600	SAT TT=15.813	SAT TT=188.865 ASSIGNMENTS=152874 CHECKS=127269000	SAT TT=105.389	SAT TT=1585.37
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-14_ext.xml	SAT TT=1.327	SAT TT=37.899 CHECKS=158878 NODES=22624	SAT TT=39.859 CHECKS=162902 NODES=22472	SAT TT=92.398	SAT TT=327.919 CHECKS=3153480	SAT TT=262.4 CHECKS=2438960	SAT TT=100.514 ASSIGNMENTS=9382	SAT TT=125.558 ASSIGNMENTS=9417	SAT TT=15.676 CHECKS=44426500 NODES=37003	SAT TT=50.345 CHECKS=412682000 NODES=1302090	SAT TT=584.933 CHECKS=2208080000 NODES=3538850	SAT TT=9.414 ASSIGNMENTS=6069 CHECKS=871573	SAT TT=9.581 ASSIGNMENTS=6069 CHECKS=871573	SAT TT=695.326	? (TO) TT=1800.02	SAT TT=1.968 CHECKS=266822	SAT TT=1.327 ASSIGNMENTS=3935 CHECKS=557946	SAT TT=7.745 ASSIGNMENTS=32565 CHECKS=4094160	SAT TT=30.057	SAT TT=7.924 ASSIGNMENTS=29589 CHECKS=3951370	SAT TT=1.952 ASSIGNMENTS=6069 CHECKS=871573	SAT TT=142.129	SAT TT=7.518 ASSIGNMENTS=240 CHECKS=232909	SAT TT=21.172	SAT TT=18.504
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-15_ext.xml	SAT TT=4.118	SAT TT=73.233 CHECKS=381873 NODES=48121	SAT TT=73.81 CHECKS=383897 NODES=50774	SAT TT=14.62	SAT TT=275.725 CHECKS=2316530	SAT TT=311.679 CHECKS=2799430	SAT TT=34.952 ASSIGNMENTS=3623	SAT TT=431.502 ASSIGNMENTS=18054	SAT TT=7.865 CHECKS=20993700 NODES=16166	SAT TT=109.594 CHECKS=917219000 NODES=2883790	? (TO) TT=1800.09	SAT TT=17.934 ASSIGNMENTS=37101 CHECKS=4712380	SAT TT=17.793 ASSIGNMENTS=37101 CHECKS=4712380	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=11.467 CHECKS=1987770	SAT TT=10.389 ASSIGNMENTS=36293 CHECKS=5039030	SAT TT=1.882 ASSIGNMENTS=7504 CHECKS=834926	SAT TT=16.642	SAT TT=4.118 ASSIGNMENTS=14025 CHECKS=1812510	SAT TT=9.776 ASSIGNMENTS=37101 CHECKS=4712380	SAT TT=251.866	SAT TT=45.902 ASSIGNMENTS=29369 CHECKS=24544500	SAT TT=330.961	SAT TT=289.297
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-17_ext.xml	SAT TT=1.343	SAT TT=59.502 CHECKS=188752 NODES=38541	SAT TT=61.208 CHECKS=196260 NODES=38881	SAT TT=7.097	SAT TT=458.601 CHECKS=4519620	SAT TT=231.252 CHECKS=2233450	SAT TT=12.467 ASSIGNMENTS=1590	SAT TT=108.681 ASSIGNMENTS=9582	SAT TT=7.976 CHECKS=20240600 NODES=15404	SAT TT=328.455 CHECKS=2832080000 NODES=8851790	? (TO) TT=1800.05	SAT TT=1.462 ASSIGNMENTS=6371 CHECKS=684956	SAT TT=1.354 ASSIGNMENTS=6371 CHECKS=684956	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=3.217 CHECKS=462565	SAT TT=1.343 ASSIGNMENTS=5878 CHECKS=642422	SAT TT=1.471 ASSIGNMENTS=7319 CHECKS=703840	SAT TT=13.544	SAT TT=3.935 ASSIGNMENTS=14534 CHECKS=1899900	SAT TT=1.395 ASSIGNMENTS=6371 CHECKS=684956	SAT TT=346.813	SAT TT=24.61 ASSIGNMENTS=14353 CHECKS=15518400	SAT TT=55.831	SAT TT=44.678
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-19_ext.xml	SAT TT=12.411	SAT TT=175.516 CHECKS=1165570 NODES=112693	SAT TT=176.072 CHECKS=1242600 NODES=110632	SAT TT=94.101	SAT TT=1268.61 CHECKS=13142200	SAT TT=1188.67 CHECKS=12538800	SAT TT=162.712 ASSIGNMENTS=16067	SAT TT=176.19 ASSIGNMENTS=10403	SAT TT=30.103 CHECKS=95704500 NODES=79738	SAT TT=940.041 CHECKS=8485590000 NODES=26583900	? (TO) TT=1800.09	SAT TT=21.223 ASSIGNMENTS=57604 CHECKS=7380710	SAT TT=21.353 ASSIGNMENTS=57604 CHECKS=7380710	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=41.893 CHECKS=8172080	SAT TT=15.324 ASSIGNMENTS=64259 CHECKS=8315150	SAT TT=10.51 ASSIGNMENTS=44767 CHECKS=5642600	SAT TT=244.768	SAT TT=13.989 ASSIGNMENTS=59087 CHECKS=7645730	SAT TT=12.411 ASSIGNMENTS=57604 CHECKS=7380710	SAT TT=1746.5	SAT TT=177.821 ASSIGNMENTS=144690 CHECKS=105042000	SAT TT=1682.34	? (TO) TT=1800.06
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-20_ext.xml	SAT TT=3.151	SAT TT=114.725 CHECKS=416408 NODES=65063	SAT TT=149.336 CHECKS=499649 NODES=74262	SAT TT=133.939	SAT TT=399.303 CHECKS=3165710	SAT TT=175.04 CHECKS=1533850	SAT TT=35.833 ASSIGNMENTS=3504	SAT TT=87.131 ASSIGNMENTS=6070	SAT TT=7.522 CHECKS=23278700 NODES=15886	SAT TT=95.488 CHECKS=809627000 NODES=2681370	? (TO) TT=1800.02	SAT TT=11.417 ASSIGNMENTS=10535 CHECKS=1406420	SAT TT=11.464 ASSIGNMENTS=10535 CHECKS=1406420	SAT TT=1647.68	? (TO) TT=1800.02	SAT TT=3.151 CHECKS=444220	SAT TT=3.518 ASSIGNMENTS=10572 CHECKS=1409230	SAT TT=4.002 ASSIGNMENTS=14056 CHECKS=1736300	SAT TT=21.373	SAT TT=3.623 ASSIGNMENTS=10932 CHECKS=1469040	SAT TT=3.466 ASSIGNMENTS=10535 CHECKS=1406420	SAT TT=10.428	SAT TT=25.078 ASSIGNMENTS=13357 CHECKS=12158800	SAT TT=43.083	SAT TT=47.139
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-21_ext.xml	SAT TT=5.508	SAT TT=243.896 CHECKS=1790730 NODES=143542	SAT TT=234.117 CHECKS=1770730 NODES=142367	SAT TT=88.432	SAT TT=1129.95 CHECKS=9765660	SAT TT=315.284 CHECKS=2958490	SAT TT=253.851 ASSIGNMENTS=19456	? (TO) TT=1800.12	SAT TT=11.836 CHECKS=36907300 NODES=23364	SAT TT=1111.2 CHECKS=9510160000 NODES=30013400	? (TO) TT=1800	SAT TT=12.362 ASSIGNMENTS=18907 CHECKS=2409320	SAT TT=13.79 ASSIGNMENTS=18907 CHECKS=2409320	SAT TT=1117.14	SAT TT=348.738	SAT TT=9.972 CHECKS=1811580	SAT TT=6.428 ASSIGNMENTS=21779 CHECKS=2776360	SAT TT=15.376 ASSIGNMENTS=57362 CHECKS=6899710	SAT TT=73.08	SAT TT=7.869 ASSIGNMENTS=29080 CHECKS=3701810	SAT TT=5.508 ASSIGNMENTS=18907 CHECKS=2409320	SAT TT=48.835	SAT TT=26.27 ASSIGNMENTS=16934 CHECKS=15378400	SAT TT=47.027	SAT TT=87.426
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-26_ext.xml	SAT TT=1.797	SAT TT=6.769 CHECKS=13338 NODES=3482	SAT TT=6.728 CHECKS=13518 NODES=3406	SAT TT=511.234	SAT TT=595.546 CHECKS=5599090	SAT TT=20.404 CHECKS=183560	SAT TT=163.024 ASSIGNMENTS=16286	SAT TT=195.384 ASSIGNMENTS=11344	SAT TT=22.422 CHECKS=71883700 NODES=61198	SAT TT=63.492 CHECKS=529673000 NODES=1645820	? (TO) TT=1800.03	SAT TT=10.417 ASSIGNMENTS=9130 CHECKS=1215750	SAT TT=10.413 ASSIGNMENTS=9130 CHECKS=1215750	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=4.459 CHECKS=638697	SAT TT=1.797 ASSIGNMENTS=6585 CHECKS=792605	SAT TT=12.553 ASSIGNMENTS=43557 CHECKS=5957470	SAT TT=62.931	SAT TT=4.287 ASSIGNMENTS=15795 CHECKS=1997930	SAT TT=2.64 ASSIGNMENTS=9130 CHECKS=1215750	SAT TT=196.879	SAT TT=18.025 ASSIGNMENTS=4527 CHECKS=3865410	SAT TT=93.1	SAT TT=94.061
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-27_ext.xml	SAT TT=2.87	? (TO) TT=1800.17	? (TO) TT=1800.12	SAT TT=775.904	SAT TT=443.527 CHECKS=3909950	SAT TT=1292.17 CHECKS=13307800	SAT TT=653.334 ASSIGNMENTS=57230	? (TO) TT=1800.07	SAT TT=42.919 CHECKS=151995000 NODES=110620	SAT TT=189.285 CHECKS=1679800000 NODES=5133190	? (TO) TT=1800.03	SAT TT=41.224 ASSIGNMENTS=113897 CHECKS=15860000	SAT TT=41.905 ASSIGNMENTS=113897 CHECKS=15860000	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=2.87 CHECKS=481612	SAT TT=34.761 ASSIGNMENTS=117469 CHECKS=16266100	SAT TT=22.288 ASSIGNMENTS=76952 CHECKS=10548100	SAT TT=289.806	SAT TT=19.314 ASSIGNMENTS=70869 CHECKS=9813640	SAT TT=30.995 ASSIGNMENTS=113897 CHECKS=15860000	SAT TT=574.672	SAT TT=90.687 ASSIGNMENTS=59443 CHECKS=51577100	SAT TT=67.3	SAT TT=28.913
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-28_ext.xml	SAT TT=1.097	SAT TT=311.257 CHECKS=1506170 NODES=138140	SAT TT=297.849 CHECKS=1498720 NODES=135538	SAT TT=14.033	SAT TT=241.155 CHECKS=2086830	SAT TT=220.495 CHECKS=2254330	SAT TT=12.188 ASSIGNMENTS=1393	SAT TT=195.6 ASSIGNMENTS=11380	SAT TT=6.245 CHECKS=15299000 NODES=12503	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=9.837 ASSIGNMENTS=9534 CHECKS=1274820	SAT TT=10.745 ASSIGNMENTS=9534 CHECKS=1274820	SAT TT=1695.25	? (TO) TT=1800.03	SAT TT=4.898 CHECKS=901967	SAT TT=1.986 ASSIGNMENTS=6632 CHECKS=892337	SAT TT=1.482 ASSIGNMENTS=6592 CHECKS=680749	SAT TT=23.005	SAT TT=1.097 ASSIGNMENTS=3629 CHECKS=465374	SAT TT=2.773 ASSIGNMENTS=9534 CHECKS=1274820	SAT TT=337.735	SAT TT=34.81 ASSIGNMENTS=8546 CHECKS=8862670	SAT TT=286.294	SAT TT=290.188
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-2_ext.xml	SAT TT=4.59	SAT TT=52.849 CHECKS=190066 NODES=20762	SAT TT=49.474 CHECKS=178512 NODES=20158	SAT TT=238.736	SAT TT=207.268 CHECKS=1697800	SAT TT=1536.58 CHECKS=13460900	SAT TT=250.079 ASSIGNMENTS=25193	SAT TT=361.941 ASSIGNMENTS=28785	SAT TT=24.549 CHECKS=84768900 NODES=65478	SAT TT=73.447 CHECKS=659474000 NODES=1992310	? (TO) TT=1800.06	SAT TT=21.382 ASSIGNMENTS=49719 CHECKS=6516470	SAT TT=23.614 ASSIGNMENTS=49719 CHECKS=6516470	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=8.252 CHECKS=1214970	SAT TT=12.983 ASSIGNMENTS=42035 CHECKS=5456490	SAT TT=16.354 ASSIGNMENTS=55963 CHECKS=7273070	SAT TT=101.22	SAT TT=13.295 ASSIGNMENTS=44903 CHECKS=5701570	SAT TT=13.88 ASSIGNMENTS=49719 CHECKS=6516470	SAT TT=4.59	SAT TT=96.911 ASSIGNMENTS=47701 CHECKS=49983400	SAT TT=16.47	SAT TT=162.007
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-31_ext.xml	SAT TT=15.023	SAT TT=150.759 CHECKS=1027420 NODES=103010	SAT TT=195.938 CHECKS=1108280 NODES=113140	SAT TT=409.848	SAT TT=434.638 CHECKS=3859660	? (TO) TT=1800.07	SAT TT=876.302 ASSIGNMENTS=80930	? (TO) TT=1800.11	SAT TT=82.976 CHECKS=281722000 NODES=243977	SAT TT=256.407 CHECKS=2269520000 NODES=6896400	? (TO) TT=1800.08	SAT TT=50.235 ASSIGNMENTS=173354 CHECKS=21757800	SAT TT=160.578 ASSIGNMENTS=103010 CHECKS=1027420	? (TO) TT=1800	? (TO) TT=1800.01	SAT TT=60.07 CHECKS=10121500	SAT TT=46.783 ASSIGNMENTS=186061 CHECKS=23490000	SAT TT=42.489 ASSIGNMENTS=187404 CHECKS=23447200	SAT TT=339.912	SAT TT=20.079 ASSIGNMENTS=84062 CHECKS=10543600	SAT TT=42.816 ASSIGNMENTS=173354 CHECKS=21757800	SAT TT=15.023	SAT TT=353.968 ASSIGNMENTS=246780 CHECKS=198669000	SAT TT=21.239	SAT TT=178.421
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-33_ext.xml	SAT TT=34.143	SAT TT=173.984 CHECKS=1080290 NODES=131116	SAT TT=160.172 CHECKS=1109260 NODES=131445	SAT TT=387.503	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=448.093 ASSIGNMENTS=42118	? (TO) TT=1800.15	SAT TT=65.946 CHECKS=198973000 NODES=168915	SAT TT=225.158 CHECKS=1864390000 NODES=5701400	? (TO) TT=1800.06	SAT TT=42.981 ASSIGNMENTS=140268 CHECKS=20216600	SAT TT=42.448 ASSIGNMENTS=140268 CHECKS=20216600	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=51.176 CHECKS=9902410	SAT TT=87.466 ASSIGNMENTS=343394 CHECKS=49215800	SAT TT=86.569 ASSIGNMENTS=347065 CHECKS=49419400	SAT TT=488.596	SAT TT=89.704 ASSIGNMENTS=360508 CHECKS=51206700	SAT TT=34.143 ASSIGNMENTS=140268 CHECKS=20216600	SAT TT=1286.1	SAT TT=357.134 ASSIGNMENTS=301362 CHECKS=234001000	SAT TT=311.928	SAT TT=365.502
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-34_ext.xml	SAT TT=21.093	SAT TT=81.207 CHECKS=373230 NODES=41825	SAT TT=85.635 CHECKS=408879 NODES=45163	SAT TT=319.613	? (TO) TT=1800.09	SAT TT=1670.62 CHECKS=16282300	SAT TT=272.532 ASSIGNMENTS=25794	SAT TT=1455.13 ASSIGNMENTS=83357	SAT TT=49.678 CHECKS=171786000 NODES=127640	SAT TT=143.912 CHECKS=1180450000 NODES=3540980	? (TO) TT=1800.01	SAT TT=31.336 ASSIGNMENTS=85730 CHECKS=11049100	SAT TT=84.741 ASSIGNMENTS=41825 CHECKS=373230	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=60.285 CHECKS=11458000	SAT TT=23.149 ASSIGNMENTS=85953 CHECKS=11043000	SAT TT=24.673 ASSIGNMENTS=89968 CHECKS=11727200	SAT TT=132.914	SAT TT=21.093 ASSIGNMENTS=79996 CHECKS=10221500	SAT TT=24.157 ASSIGNMENTS=85730 CHECKS=11049100	SAT TT=1101.27	SAT TT=9.239 ASSIGNMENTS=3502 CHECKS=2728200	SAT TT=811.65	SAT TT=1730.92
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-36_ext.xml	SAT TT=6.402	SAT TT=392.18 CHECKS=2306000 NODES=221118	SAT TT=395.206 CHECKS=2342320 NODES=219150	SAT TT=444.524	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=223.982 ASSIGNMENTS=18172	SAT TT=1172.81 ASSIGNMENTS=84329	SAT TT=80.285 CHECKS=245092000 NODES=206472	SAT TT=88.961 CHECKS=741269000 NODES=2201450	? (TO) TT=1800.03	SAT TT=46.291 ASSIGNMENTS=152114 CHECKS=21911800	SAT TT=48.013 ASSIGNMENTS=152114 CHECKS=21911800	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=6.402 CHECKS=1005880	SAT TT=43.176 ASSIGNMENTS=160617 CHECKS=22315100	SAT TT=41.467 ASSIGNMENTS=167802 CHECKS=23095600	SAT TT=318.642	SAT TT=43.171 ASSIGNMENTS=162442 CHECKS=22492600	SAT TT=38.853 ASSIGNMENTS=152114 CHECKS=21911800	SAT TT=938.242	SAT TT=341.378 ASSIGNMENTS=235086 CHECKS=187739000	SAT TT=467.969	SAT TT=1674.19
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-37_ext.xml	SAT TT=38.277	SAT TT=702.939 CHECKS=4637970 NODES=478836	SAT TT=664.704 CHECKS=4602100 NODES=479606	SAT TT=158.048	? (TO) TT=1800.05	SAT TT=1509.57 CHECKS=15366700	SAT TT=564.314 ASSIGNMENTS=44618	SAT TT=109.449 ASSIGNMENTS=8259	SAT TT=55.323 CHECKS=185548000 NODES=145561	SAT TT=1294.99 CHECKS=10726400000 NODES=33350100	? (TO) TT=1800.08	SAT TT=54.775 ASSIGNMENTS=172327 CHECKS=26090600	SAT TT=55.141 ASSIGNMENTS=172327 CHECKS=26090600	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=182.808 CHECKS=34245800	SAT TT=47.342 ASSIGNMENTS=187150 CHECKS=28697900	SAT TT=22.346 ASSIGNMENTS=82724 CHECKS=12836400	SAT TT=182.98	SAT TT=38.277 ASSIGNMENTS=152115 CHECKS=22861200	SAT TT=46.333 ASSIGNMENTS=172327 CHECKS=26090600	SAT TT=1500.73	SAT TT=195.932 ASSIGNMENTS=125474 CHECKS=107171000	? (TO) TT=1800.08	SAT TT=555.301
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-38_ext.xml	SAT TT=3.277	SAT TT=49.606 CHECKS=190689 NODES=22262	SAT TT=49.289 CHECKS=193293 NODES=22504	SAT TT=10.228	SAT TT=321.258 CHECKS=2698360	SAT TT=735.427 CHECKS=6517260	SAT TT=33.426 ASSIGNMENTS=3474	SAT TT=64.345 ASSIGNMENTS=4962	SAT TT=6.978 CHECKS=19649100 NODES=14162	SAT TT=748.375 CHECKS=6623690000 NODES=21954200	SAT TT=429.378 CHECKS=1549790000 NODES=2601880	SAT TT=11.1 ASSIGNMENTS=12195 CHECKS=1405490	SAT TT=11.079 ASSIGNMENTS=12195 CHECKS=1405490	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=7.672 CHECKS=1128800	SAT TT=3.337 ASSIGNMENTS=12073 CHECKS=1391010	SAT TT=2.483 ASSIGNMENTS=10946 CHECKS=1134000	SAT TT=6.837	SAT TT=3.277 ASSIGNMENTS=11509 CHECKS=1328420	SAT TT=3.351 ASSIGNMENTS=12195 CHECKS=1405490	SAT TT=77.014	SAT TT=4.009 ASSIGNMENTS=453 CHECKS=278562	SAT TT=43.198	SAT TT=18.078
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-39_ext.xml	SAT TT=14.545	SAT TT=133.489 CHECKS=925198 NODES=108502	SAT TT=141.17 CHECKS=905563 NODES=106170	SAT TT=217.494	SAT TT=1338.53 CHECKS=14058600	SAT TT=1713.42 CHECKS=16687000	SAT TT=396.162 ASSIGNMENTS=26513	? (TO) TT=1800.11	SAT TT=78.77 CHECKS=277465000 NODES=216295	SAT TT=30.105 CHECKS=252692000 NODES=792872	? (TO) TT=1800.05	SAT TT=22.519 ASSIGNMENTS=53378 CHECKS=7482470	SAT TT=22.204 ASSIGNMENTS=53378 CHECKS=7482470	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=17.437 CHECKS=3894460	SAT TT=29.216 ASSIGNMENTS=110281 CHECKS=15738900	SAT TT=59.06 ASSIGNMENTS=219658 CHECKS=29966800	SAT TT=185.349	SAT TT=52.29 ASSIGNMENTS=190794 CHECKS=26743900	SAT TT=14.545 ASSIGNMENTS=53378 CHECKS=7482470	SAT TT=850.253	SAT TT=395.306 ASSIGNMENTS=264086 CHECKS=210857000	SAT TT=162.705	SAT TT=857.284
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-40_ext.xml	SAT TT=20.071	SAT TT=185.889 CHECKS=1355040 NODES=134302	SAT TT=193.929 CHECKS=1282610 NODES=129809	SAT TT=187.25	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=977.977 ASSIGNMENTS=78667	SAT TT=460.905 ASSIGNMENTS=27862	SAT TT=34.977 CHECKS=112828000 NODES=101211	SAT TT=1001.21 CHECKS=9193410000 NODES=28325800	? (TO) TT=1800.01	SAT TT=32.082 ASSIGNMENTS=98233 CHECKS=13801100	SAT TT=31.629 ASSIGNMENTS=98233 CHECKS=13801100	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=36.177 CHECKS=6834110	SAT TT=28.791 ASSIGNMENTS=107470 CHECKS=15458000	SAT TT=26.717 ASSIGNMENTS=102464 CHECKS=14475100	SAT TT=287.561	SAT TT=20.071 ASSIGNMENTS=80856 CHECKS=11146700	SAT TT=22.887 ASSIGNMENTS=98233 CHECKS=13801100	SAT TT=164.376	SAT TT=10.035 ASSIGNMENTS=3285 CHECKS=2779970	SAT TT=305.493	? (TO) TT=1800.13
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-41_ext.xml	SAT TT=23.512	SAT TT=190.327 CHECKS=1095980 NODES=118898	SAT TT=185.835 CHECKS=1109130 NODES=116988	SAT TT=271.511	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=154.814 ASSIGNMENTS=12938	SAT TT=162.92 ASSIGNMENTS=10451	SAT TT=24.481 CHECKS=77610600 NODES=59808	SAT TT=279.985 CHECKS=2349460000 NODES=7285270	? (TO) TT=1800.08	SAT TT=37.077 ASSIGNMENTS=111895 CHECKS=15843700	SAT TT=36.901 ASSIGNMENTS=111895 CHECKS=15843700	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=25.462 CHECKS=4767140	SAT TT=27.346 ASSIGNMENTS=103447 CHECKS=14593900	SAT TT=47.148 ASSIGNMENTS=182432 CHECKS=26042400	SAT TT=247.997	SAT TT=23.512 ASSIGNMENTS=92002 CHECKS=12517500	SAT TT=28.709 ASSIGNMENTS=111895 CHECKS=15843700	SAT TT=975.366	SAT TT=549.133 ASSIGNMENTS=263432 CHECKS=204678000	? (TO) TT=1800.02	SAT TT=481.837
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-46_ext.xml	SAT TT=0.679	SAT TT=20.264 CHECKS=67825 NODES=8430	SAT TT=20.213 CHECKS=65256 NODES=8349	SAT TT=269.958	SAT TT=201.728 CHECKS=1602850	SAT TT=131.816 CHECKS=1212420	SAT TT=59.107 ASSIGNMENTS=5388	SAT TT=38.236 ASSIGNMENTS=3067	SAT TT=8.584 CHECKS=24652900 NODES=22011	SAT TT=6.087 CHECKS=38412900 NODES=127636	? (TO) TT=1800.02	SAT TT=9.741 ASSIGNMENTS=7345 CHECKS=881946	SAT TT=28.212 ASSIGNMENTS=8430 CHECKS=67825	? (TO) TT=1800.08	SAT TT=992.664	SAT TT=0.679 CHECKS=34167	SAT TT=1.639 ASSIGNMENTS=6179 CHECKS=740064	SAT TT=1.382 ASSIGNMENTS=6151 CHECKS=624916	SAT TT=12.721	SAT TT=1.724 ASSIGNMENTS=5430 CHECKS=712204	SAT TT=2.015 ASSIGNMENTS=7345 CHECKS=881946	SAT TT=15.057	SAT TT=2.182 ASSIGNMENTS=1083 CHECKS=899847	SAT TT=30.22	SAT TT=6.658
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-48_ext.xml	SAT TT=10.979	SAT TT=471.778 CHECKS=4127500 NODES=318012	SAT TT=492.63 CHECKS=3702180 NODES=306238	SAT TT=95.463	SAT TT=853.118 CHECKS=8649900	SAT TT=561.014 CHECKS=5000560	SAT TT=601.828 ASSIGNMENTS=53666	SAT TT=1191.85 ASSIGNMENTS=49473	SAT TT=48.595 CHECKS=154479000 NODES=122448	SAT TT=380.15 CHECKS=3137640000 NODES=9818550	? (TO) TT=1800.03	SAT TT=24.812 ASSIGNMENTS=69455 CHECKS=9260920	SAT TT=25.046 ASSIGNMENTS=69455 CHECKS=9260920	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=34.471 CHECKS=6567990	SAT TT=21.563 ASSIGNMENTS=81928 CHECKS=11445100	SAT TT=21.551 ASSIGNMENTS=83190 CHECKS=11512500	SAT TT=132.092	SAT TT=10.979 ASSIGNMENTS=42590 CHECKS=5794630	SAT TT=17.112 ASSIGNMENTS=69455 CHECKS=9260920	SAT TT=1171.49	SAT TT=195.094 ASSIGNMENTS=137425 CHECKS=110294000	SAT TT=1432.13	SAT TT=1045.34
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-49_ext.xml	SAT TT=5.895	SAT TT=448.021 CHECKS=3116910 NODES=326760	SAT TT=455.275 CHECKS=3098100 NODES=335559	SAT TT=29.637	SAT TT=884.061 CHECKS=8517080	SAT TT=386.163 CHECKS=3788770	SAT TT=90.575 ASSIGNMENTS=8245	SAT TT=937.565 ASSIGNMENTS=55025	SAT TT=64.359 CHECKS=207302000 NODES=170893	SAT TT=60.385 CHECKS=488463000 NODES=1575330	? (TO) TT=1800.08	SAT TT=14.663 ASSIGNMENTS=26332 CHECKS=3495680	SAT TT=15.061 ASSIGNMENTS=26332 CHECKS=3495680	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=5.895 CHECKS=968994	SAT TT=7.088 ASSIGNMENTS=26816 CHECKS=3559290	SAT TT=29.207 ASSIGNMENTS=121957 CHECKS=15537500	SAT TT=50.394	SAT TT=9.311 ASSIGNMENTS=36511 CHECKS=4809550	SAT TT=6.864 ASSIGNMENTS=26332 CHECKS=3495680	SAT TT=26.999	SAT TT=87.051 ASSIGNMENTS=74199 CHECKS=54207000	SAT TT=222.841	SAT TT=134.343
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-50_ext.xml	SAT TT=28.358	SAT TT=38.805 CHECKS=192299 NODES=32940	SAT TT=62.115 CHECKS=347673 NODES=47675	SAT TT=1329.39	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=144.487 ASSIGNMENTS=7348	SAT TT=28.392 CHECKS=94487100 NODES=80806	SAT TT=728.379 CHECKS=6619350000 NODES=20021400	? (TO) TT=1800.03	SAT TT=44.151 ASSIGNMENTS=144771 CHECKS=19605500	SAT TT=44.733 ASSIGNMENTS=144771 CHECKS=19605500	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=144.983 CHECKS=29123300	SAT TT=28.358 ASSIGNMENTS=107865 CHECKS=14992700	SAT TT=111.813 ASSIGNMENTS=449009 CHECKS=59964400	SAT TT=109.036	SAT TT=32.607 ASSIGNMENTS=129417 CHECKS=18398600	SAT TT=36.164 ASSIGNMENTS=144771 CHECKS=19605500	SAT TT=81.021	SAT TT=363.339 ASSIGNMENTS=7266 CHECKS=5159950	SAT TT=206.129	? (TO) TT=1800.06
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-9_ext.xml	SAT TT=10.731	SAT TT=200.679 CHECKS=782784 NODES=97925	SAT TT=222.289 CHECKS=778299 NODES=97271	SAT TT=134.202	SAT TT=934.072 CHECKS=7961230	SAT TT=688.504 CHECKS=6569870	SAT TT=128.551 ASSIGNMENTS=13412	SAT TT=159.582 ASSIGNMENTS=12571	SAT TT=11.417 CHECKS=33821500 NODES=23921	SAT TT=84.29 CHECKS=692231000 NODES=2097440	? (TO) TT=1800.07	SAT TT=22.918 ASSIGNMENTS=54106 CHECKS=7356090	SAT TT=23.043 ASSIGNMENTS=54106 CHECKS=7356090	? (TO) TT=1800	? (TO) TT=1800	SAT TT=14.815 CHECKS=2290860	SAT TT=10.731 ASSIGNMENTS=35573 CHECKS=4921910	SAT TT=8.334 ASSIGNMENTS=30462 CHECKS=3979100	SAT TT=88.146	SAT TT=13.595 ASSIGNMENTS=49528 CHECKS=6994460	SAT TT=15.171 ASSIGNMENTS=54106 CHECKS=7356090	SAT TT=175.692	SAT TT=81.603 ASSIGNMENTS=31403 CHECKS=30565200	SAT TT=29.825	SAT TT=186.967
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-12_ext.xml	SAT TT=6.622	SAT TT=363.183 CHECKS=2189160 NODES=214124	SAT TT=298.847 CHECKS=1694470 NODES=179502	SAT TT=76.157	SAT TT=456.976 CHECKS=4287760	SAT TT=337.304 CHECKS=3321120	SAT TT=75.829 ASSIGNMENTS=7816	SAT TT=218.058 ASSIGNMENTS=14273	SAT TT=33.434 CHECKS=100050000 NODES=85254	SAT TT=222.827 CHECKS=1837480000 NODES=5693880	? (TO) TT=1800.06	SAT TT=21.316 ASSIGNMENTS=53610 CHECKS=6598100	SAT TT=21.2 ASSIGNMENTS=53610 CHECKS=6598100	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT TT=34.439 CHECKS=6958890	SAT TT=16.272 ASSIGNMENTS=55736 CHECKS=7679470	SAT TT=7.378 ASSIGNMENTS=30082 CHECKS=3924270	SAT TT=116.756	SAT TT=14.211 ASSIGNMENTS=54911 CHECKS=7203760	SAT TT=12.266 ASSIGNMENTS=53610 CHECKS=6598100	SAT TT=155.297	SAT TT=166.399 ASSIGNMENTS=116470 CHECKS=88599800	SAT TT=116.848	SAT TT=6.622
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-13_ext.xml	SAT TT=1.904	SAT TT=185.541 CHECKS=1114090 NODES=124481	SAT TT=173.314 CHECKS=1138070 NODES=126729	SAT TT=285.955	SAT TT=222.028 CHECKS=2027170	? (TO) TT=1800.07	SAT TT=327.027 ASSIGNMENTS=30834	? (TO) TT=1800.14	SAT TT=43.029 CHECKS=135676000 NODES=106668	SAT TT=21.852 CHECKS=186889000 NODES=594208	? (TO) TT=1800.06	SAT TT=26.416 ASSIGNMENTS=68349 CHECKS=9806860	SAT TT=26.485 ASSIGNMENTS=68349 CHECKS=9806860	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=1.904 CHECKS=291720	SAT TT=18.577 ASSIGNMENTS=68664 CHECKS=9850570	SAT TT=19.117 ASSIGNMENTS=71782 CHECKS=10071800	SAT TT=157.261	SAT TT=18.778 ASSIGNMENTS=69020 CHECKS=9849450	SAT TT=16.881 ASSIGNMENTS=68349 CHECKS=9806860	SAT TT=51.643	SAT TT=113.427 ASSIGNMENTS=13411 CHECKS=12943300	SAT TT=422.251	SAT TT=572.688
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-16_ext.xml	UNSAT TT=117.418	UNSAT TT=833.171 CHECKS=7437860 NODES=703761	UNSAT TT=844.929 CHECKS=7479160 NODES=702520	UNSAT TT=604.865	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.08	UNSAT TT=200.354 CHECKS=647115000 NODES=520823	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=136.556 ASSIGNMENTS=486579 CHECKS=69166500	UNSAT TT=794.356 ASSIGNMENTS=703761 CHECKS=7437860	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=153.184 CHECKS=30638700	UNSAT TT=123.266 ASSIGNMENTS=457428 CHECKS=65977000	UNSAT TT=112.038 ASSIGNMENTS=458369 CHECKS=66019600	UNSAT TT=895.256	UNSAT TT=117.418 ASSIGNMENTS=460547 CHECKS=63758000	UNSAT TT=125.393 ASSIGNMENTS=486579 CHECKS=69166500	? (TO) TT=1800.11	UNSAT TT=1134.1 ASSIGNMENTS=501909 CHECKS=475402000	? (TO) TT=1800.06	? (TO) TT=1800.12
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-17_ext.xml	SAT TT=18.208	SAT TT=118.382 CHECKS=352976 NODES=65358	SAT TT=118.227 CHECKS=353139 NODES=65167	SAT TT=61.389	SAT TT=1523.43 CHECKS=16051900	SAT TT=449.878 CHECKS=4623320	SAT TT=275.094 ASSIGNMENTS=25842	SAT TT=585.198 ASSIGNMENTS=24181	SAT TT=45.612 CHECKS=161373000 NODES=127939	SAT TT=95.187 CHECKS=784265000 NODES=2449630	? (TO) TT=1800.02	SAT TT=34.958 ASSIGNMENTS=111825 CHECKS=14319000	SAT TT=112.099 ASSIGNMENTS=65358 CHECKS=352976	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=18.208 CHECKS=2936220	SAT TT=26.697 ASSIGNMENTS=104520 CHECKS=13633700	SAT TT=26.273 ASSIGNMENTS=103355 CHECKS=13611300	SAT TT=250.094	SAT TT=26.443 ASSIGNMENTS=104685 CHECKS=14659100	SAT TT=27.534 ASSIGNMENTS=111825 CHECKS=14319000	SAT TT=123.399	SAT TT=196.316 ASSIGNMENTS=120796 CHECKS=108548000	SAT TT=84.496	SAT TT=58.922
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-18_ext.xml	UNSAT TT=13.627	UNSAT TT=130.9 CHECKS=556332 NODES=59184	UNSAT TT=124.203 CHECKS=545409 NODES=59418	UNSAT TT=1088.89	UNSAT TT=999.336 CHECKS=8728910	UNSAT TT=991.169 CHECKS=8565950	UNSAT TT=229.782 ASSIGNMENTS=15453	UNSAT TT=170.99 ASSIGNMENTS=9256	UNSAT TT=25.694 CHECKS=92755300 NODES=54138	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=21.544 ASSIGNMENTS=42014 CHECKS=5896870	UNSAT TT=21.684 ASSIGNMENTS=42014 CHECKS=5896870	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=17.054 CHECKS=2646230	UNSAT TT=15.786 ASSIGNMENTS=47859 CHECKS=6655450	UNSAT TT=10.92 ASSIGNMENTS=40564 CHECKS=5350570	UNSAT TT=68.475	UNSAT TT=14.007 ASSIGNMENTS=46085 CHECKS=6400270	UNSAT TT=13.627 ASSIGNMENTS=42014 CHECKS=5896870	UNSAT TT=202.555	UNSAT TT=55.821 ASSIGNMENTS=35825 CHECKS=35850700	UNSAT TT=179.937	UNSAT TT=173.951
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-1_ext.xml	SAT TT=5.721	SAT TT=160.426 CHECKS=621835 NODES=88969	SAT TT=143.131 CHECKS=652393 NODES=84700	SAT TT=217.933	SAT TT=924.052 CHECKS=8284210	SAT TT=1798.63 CHECKS=17631000	SAT TT=242.409 ASSIGNMENTS=18827	? (TO) TT=1800.05	SAT TT=36.925 CHECKS=110050000 NODES=92671	SAT TT=5.721 CHECKS=34976200 NODES=108423	? (TO) TT=1800.07	SAT TT=21.606 ASSIGNMENTS=55298 CHECKS=7704520	SAT TT=22.068 ASSIGNMENTS=55298 CHECKS=7704520	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=21.173 CHECKS=3427340	SAT TT=14.286 ASSIGNMENTS=56562 CHECKS=7895890	SAT TT=13.108 ASSIGNMENTS=53615 CHECKS=7133020	SAT TT=99.427	SAT TT=14.78 ASSIGNMENTS=58233 CHECKS=7972290	SAT TT=13.83 ASSIGNMENTS=55298 CHECKS=7704520	SAT TT=182.127	SAT TT=49.107 ASSIGNMENTS=29996 CHECKS=25263700	SAT TT=416.27	SAT TT=1320.7
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-20_ext.xml	SAT TT=0.479	SAT TT=363.31 CHECKS=1479710 NODES=174684	SAT TT=324.064 CHECKS=1307280 NODES=158599	SAT TT=259.939	SAT TT=660.01 CHECKS=5407230	SAT TT=18.559 CHECKS=136418	SAT TT=82.821 ASSIGNMENTS=6868	SAT TT=123.019 ASSIGNMENTS=7751	SAT TT=11.311 CHECKS=38860700 NODES=26226	SAT TT=49.202 CHECKS=421078000 NODES=1395660	? (TO) TT=1800	SAT TT=9.751 ASSIGNMENTS=6190 CHECKS=830662	SAT TT=9.682 ASSIGNMENTS=6190 CHECKS=830662	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=0.479 CHECKS=10921	SAT TT=5.201 ASSIGNMENTS=16201 CHECKS=2150130	SAT TT=5.343 ASSIGNMENTS=21271 CHECKS=2421430	SAT TT=38.466	SAT TT=5.278 ASSIGNMENTS=15674 CHECKS=2180110	SAT TT=2.061 ASSIGNMENTS=6190 CHECKS=830662	SAT TT=124.163	SAT TT=4.202 ASSIGNMENTS=2508 CHECKS=2458310	SAT TT=105.547	SAT TT=5.906
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-24_ext.xml	SAT TT=23.739	SAT TT=351.127 CHECKS=2037280 NODES=199257	SAT TT=347.809 CHECKS=2027320 NODES=201359	SAT TT=92.721	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT TT=122.106 ASSIGNMENTS=10812	SAT TT=1394.9 ASSIGNMENTS=86742	SAT TT=85.771 CHECKS=277209000 NODES=228591	SAT TT=512.32 CHECKS=4709690000 NODES=14160800	? (TO) TT=1800.02	SAT TT=38.934 ASSIGNMENTS=111102 CHECKS=15736600	SAT TT=39.156 ASSIGNMENTS=111102 CHECKS=15736600	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=45.303 CHECKS=7728420	SAT TT=23.739 ASSIGNMENTS=85907 CHECKS=11807200	SAT TT=24.27 ASSIGNMENTS=90260 CHECKS=12154300	SAT TT=48.375	SAT TT=49.905 ASSIGNMENTS=183718 CHECKS=24853400	SAT TT=31.354 ASSIGNMENTS=111102 CHECKS=15736600	SAT TT=426.393	SAT TT=157.472 ASSIGNMENTS=54067 CHECKS=48743500	SAT TT=1054.61	SAT TT=751.372
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-29_ext.xml	SAT TT=8.074	SAT TT=115.246 CHECKS=471852 NODES=65088	SAT TT=109.938 CHECKS=472954 NODES=63621	SAT TT=418.957	SAT TT=970.919 CHECKS=9477920	SAT TT=1523.12 CHECKS=15327900	SAT TT=246.059 ASSIGNMENTS=20214	SAT TT=632.763 ASSIGNMENTS=26091	SAT TT=8.074 CHECKS=24624200 NODES=17139	SAT TT=17.173 CHECKS=132305000 NODES=428279	? (TO) TT=1800.04	SAT TT=24.442 ASSIGNMENTS=56512 CHECKS=8323060	SAT TT=24.743 ASSIGNMENTS=56512 CHECKS=8323060	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=8.743 CHECKS=1391130	SAT TT=18.546 ASSIGNMENTS=62480 CHECKS=9228670	SAT TT=16.403 ASSIGNMENTS=55475 CHECKS=8048100	SAT TT=73.224	SAT TT=18.761 ASSIGNMENTS=64524 CHECKS=9448730	SAT TT=16.636 ASSIGNMENTS=56512 CHECKS=8323060	SAT TT=160.148	SAT TT=46.384 ASSIGNMENTS=22115 CHECKS=21010900	SAT TT=92.7	SAT TT=321.189
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-2_ext.xml	UNSAT TT=20.353	UNSAT TT=191.594 CHECKS=813583 NODES=73055	UNSAT TT=188.198 CHECKS=803442 NODES=72060	UNSAT TT=245.796	UNSAT TT=1425.09 CHECKS=10886200	UNSAT TT=1354.4 CHECKS=10128100	UNSAT TT=252.684 ASSIGNMENTS=26692	? (TO) TT=1800.37	UNSAT TT=32.094 CHECKS=101536000 NODES=78269	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=28.435 ASSIGNMENTS=70786 CHECKS=9233930	UNSAT TT=29.41 ASSIGNMENTS=70786 CHECKS=9233930	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=27.057 CHECKS=3704390	UNSAT TT=21.258 ASSIGNMENTS=71247 CHECKS=9402740	UNSAT TT=22 ASSIGNMENTS=75954 CHECKS=9717350	UNSAT TT=138.9	UNSAT TT=20.353 ASSIGNMENTS=67488 CHECKS=8752720	UNSAT TT=20.799 ASSIGNMENTS=70786 CHECKS=9233930	UNSAT TT=326.885	UNSAT TT=122.99 ASSIGNMENTS=81118 CHECKS=82925500	UNSAT TT=233.088	UNSAT TT=268.405
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-30_ext.xml	UNSAT TT=29.726	? (TO) TT=1800.12	? (TO) TT=1800.06	UNSAT TT=638.201	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=457.654 ASSIGNMENTS=36609	? (TO) TT=1800.08	UNSAT TT=52.626 CHECKS=178271000 NODES=113838	? (TO) TT=1800.09	? (TO) TT=1800	UNSAT TT=40.118 ASSIGNMENTS=105662 CHECKS=15513100	UNSAT TT=40.49 ASSIGNMENTS=105662 CHECKS=15513100	? (TO) TT=1800	? (TO) TT=1800.01	UNSAT TT=41.254 CHECKS=6755490	UNSAT TT=29.726 ASSIGNMENTS=98415 CHECKS=14037300	UNSAT TT=32.413 ASSIGNMENTS=103807 CHECKS=15234400	UNSAT TT=294.099	UNSAT TT=30.541 ASSIGNMENTS=101583 CHECKS=14396300	UNSAT TT=31.768 ASSIGNMENTS=105662 CHECKS=15513100	UNSAT TT=879.929	UNSAT TT=195.641 ASSIGNMENTS=108641 CHECKS=111872000	UNSAT TT=742.052	UNSAT TT=866.057
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-32_ext.xml	SAT TT=2.057	SAT TT=41.669 CHECKS=197377 NODES=30327	SAT TT=46.488 CHECKS=201368 NODES=30927	SAT TT=7.698	SAT TT=183.894 CHECKS=1531800	SAT TT=266.207 CHECKS=2624720	SAT TT=22.064 ASSIGNMENTS=2177	SAT TT=296.425 ASSIGNMENTS=16727	SAT TT=5.42 CHECKS=12565700 NODES=10889	SAT TT=319.145 CHECKS=2878600000 NODES=9453320	? (TO) TT=1800.06	SAT TT=10.849 ASSIGNMENTS=13570 CHECKS=1770420	SAT TT=48.987 ASSIGNMENTS=30327 CHECKS=197377	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=5.247 CHECKS=788113	SAT TT=2.057 ASSIGNMENTS=7944 CHECKS=1018320	SAT TT=1.062 ASSIGNMENTS=5174 CHECKS=461528	SAT TT=25.587	SAT TT=2.217 ASSIGNMENTS=8731 CHECKS=1098760	SAT TT=3.718 ASSIGNMENTS=13570 CHECKS=1770420	SAT TT=84.41	SAT TT=1.614 ASSIGNMENTS=246 CHECKS=189489	SAT TT=18.553	SAT TT=6.945
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-35_ext.xml	UNSAT TT=14.923	UNSAT TT=177.933 CHECKS=1229840 NODES=95282	UNSAT TT=180.691 CHECKS=1239280 NODES=99435	UNSAT TT=145.585	UNSAT TT=1594.31 CHECKS=15486700	UNSAT TT=1466.12 CHECKS=12984200	UNSAT TT=280.378 ASSIGNMENTS=28467	UNSAT TT=660.541 ASSIGNMENTS=27366	UNSAT TT=38.371 CHECKS=134376000 NODES=94189	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=24.043 ASSIGNMENTS=62576 CHECKS=7695370	UNSAT TT=170.135 ASSIGNMENTS=95282 CHECKS=1229840	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=29.718 CHECKS=4814120	UNSAT TT=16.999 ASSIGNMENTS=64431 CHECKS=8009630	UNSAT TT=16.182 ASSIGNMENTS=68546 CHECKS=8131340	UNSAT TT=225.412	UNSAT TT=16.168 ASSIGNMENTS=66161 CHECKS=8040780	UNSAT TT=14.923 ASSIGNMENTS=62576 CHECKS=7695370	UNSAT TT=866.154	UNSAT TT=142.079 ASSIGNMENTS=75920 CHECKS=62549100	UNSAT TT=401.376	UNSAT TT=567.157
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-38_ext.xml	UNSAT TT=5.807	UNSAT TT=53.413 CHECKS=215499 NODES=25908	UNSAT TT=60.237 CHECKS=212357 NODES=25941	UNSAT TT=123.316	UNSAT TT=485.288 CHECKS=4543830	UNSAT TT=384.991 CHECKS=3245650	UNSAT TT=81.624 ASSIGNMENTS=8210	UNSAT TT=65.005 ASSIGNMENTS=5235	UNSAT TT=11.811 CHECKS=40126300 NODES=28501	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=14.409 ASSIGNMENTS=24247 CHECKS=2910300	UNSAT TT=14.359 ASSIGNMENTS=24247 CHECKS=2910300	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=8.877 CHECKS=1317180	UNSAT TT=5.807 ASSIGNMENTS=22552 CHECKS=2586670	UNSAT TT=5.394 ASSIGNMENTS=22856 CHECKS=2503030	UNSAT TT=41.103	UNSAT TT=7.227 ASSIGNMENTS=26108 CHECKS=3026200	UNSAT TT=6.707 ASSIGNMENTS=24247 CHECKS=2910300	UNSAT TT=78.01	UNSAT TT=43.614 ASSIGNMENTS=21566 CHECKS=19933100	UNSAT TT=56.431	UNSAT TT=63.612
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-39_ext.xml	UNSAT TT=67.973	UNSAT TT=1363.79 CHECKS=13209800 NODES=1051130	UNSAT TT=1536.39 CHECKS=13788500 NODES=1053120	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=1688.88 ASSIGNMENTS=109966	? (TO) TT=1800.13	UNSAT TT=111.655 CHECKS=398504000 NODES=315598	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=72.782 ASSIGNMENTS=255175 CHECKS=36260000	UNSAT TT=78.592 ASSIGNMENTS=255175 CHECKS=36260000	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=97.215 CHECKS=20283200	UNSAT TT=67.973 ASSIGNMENTS=259399 CHECKS=37254100	UNSAT TT=70.33 ASSIGNMENTS=257884 CHECKS=36468200	UNSAT TT=574.627	UNSAT TT=72.67 ASSIGNMENTS=258653 CHECKS=37191000	UNSAT TT=70.86 ASSIGNMENTS=255175 CHECKS=36260000	? (TO) TT=1800.11	UNSAT TT=650.736 ASSIGNMENTS=391673 CHECKS=300469000	? (TO) TT=1800.03	? (TO) TT=1800.09
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-3_ext.xml	UNSAT TT=53.99	UNSAT TT=451.068 CHECKS=2603780 NODES=257898	UNSAT TT=462.118 CHECKS=2638640 NODES=256866	UNSAT TT=429.481	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=1038.48 ASSIGNMENTS=101388	UNSAT TT=689.809 ASSIGNMENTS=48468	UNSAT TT=117.943 CHECKS=408418000 NODES=348597	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=69.115 ASSIGNMENTS=260176 CHECKS=35732800	UNSAT TT=73.657 ASSIGNMENTS=260176 CHECKS=35732800	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=97.953 CHECKS=18327100	UNSAT TT=55.71 ASSIGNMENTS=236597 CHECKS=27828000	UNSAT TT=54.023 ASSIGNMENTS=240937 CHECKS=28254000	UNSAT TT=432.879	UNSAT TT=53.99 ASSIGNMENTS=231953 CHECKS=26592600	UNSAT TT=64.902 ASSIGNMENTS=260176 CHECKS=35732800	? (TO) TT=1800.68	UNSAT TT=330.757 ASSIGNMENTS=289055 CHECKS=211540000	? (TO) TT=1800.06	? (TO) TT=1800.13
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-41_ext.xml	SAT TT=4.577	SAT TT=344.527 CHECKS=2384140 NODES=216906	SAT TT=369.092 CHECKS=2472970 NODES=233846	SAT TT=823.406	SAT TT=163.579 CHECKS=1330060	? (TO) TT=1800.04	SAT TT=76.577 ASSIGNMENTS=5804	SAT TT=395.322 ASSIGNMENTS=16596	SAT TT=15.853 CHECKS=48097500 NODES=38713	SAT TT=521.448 CHECKS=4718830000 NODES=14643800	? (TO) TT=1800.08	SAT TT=12.484 ASSIGNMENTS=15952 CHECKS=2435100	SAT TT=12.642 ASSIGNMENTS=15952 CHECKS=2435100	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=37.779 CHECKS=7127880	SAT TT=4.626 ASSIGNMENTS=16195 CHECKS=2450860	SAT TT=17.184 ASSIGNMENTS=63350 CHECKS=9216630	SAT TT=26.018	SAT TT=29.65 ASSIGNMENTS=104093 CHECKS=15987000	SAT TT=4.577 ASSIGNMENTS=15952 CHECKS=2435100	SAT TT=1438.76	SAT TT=31.257 ASSIGNMENTS=5715 CHECKS=4154870	? (TO) TT=1800.05	SAT TT=1209.76
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-43_ext.xml	UNSAT TT=4.81	UNSAT TT=563.699 CHECKS=4068710 NODES=305123	UNSAT TT=549.332 CHECKS=4034440 NODES=304687	UNSAT TT=76.9	UNSAT TT=474.619 CHECKS=4620100	UNSAT TT=417.128 CHECKS=4188780	UNSAT TT=81.677 ASSIGNMENTS=9308	UNSAT TT=146.347 ASSIGNMENTS=9163	UNSAT TT=11.905 CHECKS=37927500 NODES=25739	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=12.28 ASSIGNMENTS=17885 CHECKS=2151410	UNSAT TT=558.824 ASSIGNMENTS=305123 CHECKS=4068710	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=6.338 CHECKS=1203520	UNSAT TT=4.81 ASSIGNMENTS=18446 CHECKS=2201190	UNSAT TT=6.289 ASSIGNMENTS=24706 CHECKS=2847740	UNSAT TT=30.351	UNSAT TT=5.272 ASSIGNMENTS=18908 CHECKS=2284210	UNSAT TT=4.823 ASSIGNMENTS=17885 CHECKS=2151410	UNSAT TT=131.312	UNSAT TT=44.315 ASSIGNMENTS=37251 CHECKS=29528600	UNSAT TT=115.974	UNSAT TT=93.167
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-44_ext.xml	UNSAT TT=16.422	UNSAT TT=496.627 CHECKS=3173140 NODES=300530	UNSAT TT=500.128 CHECKS=3122440 NODES=298726	UNSAT TT=166.139	UNSAT TT=1379.74 CHECKS=12707800	UNSAT TT=1520.16 CHECKS=14071700	UNSAT TT=314.88 ASSIGNMENTS=25135	UNSAT TT=963.24 ASSIGNMENTS=65938	UNSAT TT=30.902 CHECKS=109830000 NODES=83156	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=25.266 ASSIGNMENTS=62513 CHECKS=8026530	UNSAT TT=467.693 ASSIGNMENTS=300530 CHECKS=3173140	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=24.318 CHECKS=4020290	UNSAT TT=17.41 ASSIGNMENTS=61667 CHECKS=8073300	UNSAT TT=17.819 ASSIGNMENTS=61149 CHECKS=8198580	UNSAT TT=119.128	UNSAT TT=16.422 ASSIGNMENTS=63842 CHECKS=8229290	UNSAT TT=16.984 ASSIGNMENTS=62513 CHECKS=8026530	UNSAT TT=393.673	UNSAT TT=112.784 ASSIGNMENTS=79627 CHECKS=69152900	UNSAT TT=306.755	UNSAT TT=377.648
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-45_ext.xml	UNSAT TT=16.229	UNSAT TT=247.54 CHECKS=1203630 NODES=126228	UNSAT TT=260.811 CHECKS=1300780 NODES=135178	UNSAT TT=208.585	UNSAT TT=1278.74 CHECKS=11384500	UNSAT TT=1415.92 CHECKS=12175900	UNSAT TT=224.903 ASSIGNMENTS=12873	UNSAT TT=208.278 ASSIGNMENTS=10229	UNSAT TT=26.997 CHECKS=85455800 NODES=58529	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=24.242 ASSIGNMENTS=51288 CHECKS=7521620	UNSAT TT=24.467 ASSIGNMENTS=51288 CHECKS=7521620	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=23.05 CHECKS=3745910	UNSAT TT=16.487 ASSIGNMENTS=52753 CHECKS=7656360	UNSAT TT=14.49 ASSIGNMENTS=53506 CHECKS=7017530	UNSAT TT=101.656	UNSAT TT=16.901 ASSIGNMENTS=53017 CHECKS=7680850	UNSAT TT=16.229 ASSIGNMENTS=51288 CHECKS=7521620	UNSAT TT=296.435	UNSAT TT=105.239 ASSIGNMENTS=72248 CHECKS=60444300	UNSAT TT=196.769	UNSAT TT=219.067
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-47_ext.xml	SAT TT=15.225	SAT TT=21.088 CHECKS=86550 NODES=13119	SAT TT=23.519 CHECKS=88283 NODES=13705	SAT TT=29.179	SAT TT=668.727 CHECKS=6120980	SAT TT=1169.92 CHECKS=11141000	SAT TT=91.076 ASSIGNMENTS=9896	SAT TT=182.52 ASSIGNMENTS=12086	SAT TT=15.225 CHECKS=50678000 NODES=40996	SAT TT=518.695 CHECKS=4670210000 NODES=14393100	? (TO) TT=1800.08	SAT TT=29.998 ASSIGNMENTS=83717 CHECKS=10993600	SAT TT=30.353 ASSIGNMENTS=83717 CHECKS=10993600	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=64.386 CHECKS=12030400	SAT TT=23.237 ASSIGNMENTS=90068 CHECKS=11569100	SAT TT=24.216 ASSIGNMENTS=97474 CHECKS=12911500	SAT TT=105.138	SAT TT=24.27 ASSIGNMENTS=95611 CHECKS=13047000	SAT TT=22.047 ASSIGNMENTS=83717 CHECKS=10993600	SAT TT=238.232	SAT TT=3.599 ASSIGNMENTS=264 CHECKS=179878	SAT TT=207.208	SAT TT=196.701
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-49_ext.xml	SAT TT=23.162	SAT TT=461.365 CHECKS=3419990 NODES=350432	SAT TT=424.376 CHECKS=2972600 NODES=312744	SAT TT=151.627	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=799.517 ASSIGNMENTS=69861	SAT TT=445.183 ASSIGNMENTS=28400	SAT TT=94.903 CHECKS=309977000 NODES=249275	SAT TT=1433.8 CHECKS=12876300000 NODES=41573100	? (TO) TT=1800.03	SAT TT=60.577 ASSIGNMENTS=204211 CHECKS=27863600	SAT TT=60.707 ASSIGNMENTS=204211 CHECKS=27863600	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=118.974 CHECKS=21136400	SAT TT=23.162 ASSIGNMENTS=92390 CHECKS=11832200	SAT TT=44.007 ASSIGNMENTS=178729 CHECKS=22781400	SAT TT=344	SAT TT=24.014 ASSIGNMENTS=96212 CHECKS=12296800	SAT TT=51.604 ASSIGNMENTS=204211 CHECKS=27863600	? (TO) TT=1800.12	SAT TT=145.811 ASSIGNMENTS=76976 CHECKS=60853400	SAT TT=1147.78	SAT TT=1150.55
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-4_ext.xml	SAT TT=2.879	SAT TT=839.47 CHECKS=3610250 NODES=435071	SAT TT=865.074 CHECKS=3591940 NODES=436382	SAT TT=108.257	SAT TT=930.371 CHECKS=9331280	SAT TT=775.946 CHECKS=7718260	SAT TT=264.217 ASSIGNMENTS=22824	SAT TT=766.715 ASSIGNMENTS=31568	SAT TT=3.879 CHECKS=6355050 NODES=5336	SAT TT=128.386 CHECKS=1087490000 NODES=3392360	? (TO) TT=1800.07	SAT TT=13.456 ASSIGNMENTS=20999 CHECKS=3058230	SAT TT=13.225 ASSIGNMENTS=20999 CHECKS=3058230	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=31.182 CHECKS=6406330	SAT TT=5.044 ASSIGNMENTS=19267 CHECKS=2802990	SAT TT=5.876 ASSIGNMENTS=24014 CHECKS=3264310	SAT TT=29.4	SAT TT=2.879 ASSIGNMENTS=10731 CHECKS=1541390	SAT TT=5.51 ASSIGNMENTS=20999 CHECKS=3058230	SAT TT=468.712	SAT TT=86.524 ASSIGNMENTS=53876 CHECKS=44026600	SAT TT=561.944	SAT TT=133.791
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-6_ext.xml	UNSAT TT=9.703	UNSAT TT=716.651 CHECKS=3662910 NODES=372345	UNSAT TT=764.905 CHECKS=3714460 NODES=392500	UNSAT TT=96.513	UNSAT TT=869.304 CHECKS=7536960	UNSAT TT=936.193 CHECKS=8117110	UNSAT TT=193.382 ASSIGNMENTS=14512	UNSAT TT=474.067 ASSIGNMENTS=26431	UNSAT TT=20.797 CHECKS=68839700 NODES=42529	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=17.897 ASSIGNMENTS=31503 CHECKS=4330880	UNSAT TT=18.153 ASSIGNMENTS=31503 CHECKS=4330880	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=12.515 CHECKS=2009250	UNSAT TT=9.703 ASSIGNMENTS=29893 CHECKS=4158980	UNSAT TT=9.884 ASSIGNMENTS=33097 CHECKS=4385950	UNSAT TT=76.048	UNSAT TT=10.167 ASSIGNMENTS=30675 CHECKS=4349160	UNSAT TT=10.03 ASSIGNMENTS=31503 CHECKS=4330880	UNSAT TT=218.769	UNSAT TT=90.967 ASSIGNMENTS=53223 CHECKS=44188000	UNSAT TT=120.959	UNSAT TT=175.442
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-7_ext.xml	SAT TT=1.83	SAT TT=497.083 CHECKS=3207590 NODES=254309	SAT TT=495.171 CHECKS=3055150 NODES=239741	SAT TT=1240.29	? (TO) TT=1800.01	SAT TT=1352.75 CHECKS=13292100	SAT TT=249.967 ASSIGNMENTS=24938	SAT TT=276.603 ASSIGNMENTS=16647	SAT TT=30.019 CHECKS=106011000 NODES=77061	SAT TT=105.573 CHECKS=873610000 NODES=2800650	? (TO) TT=1800.1	SAT TT=22.069 ASSIGNMENTS=49062 CHECKS=7196390	SAT TT=22.075 ASSIGNMENTS=49062 CHECKS=7196390	? (TO) TT=1800.07	SAT TT=1582.62	SAT TT=1.83 CHECKS=316131	SAT TT=14.241 ASSIGNMENTS=48723 CHECKS=7143290	SAT TT=25.482 ASSIGNMENTS=86414 CHECKS=13464600	SAT TT=131.388	SAT TT=14.699 ASSIGNMENTS=50830 CHECKS=7188610	SAT TT=14.604 ASSIGNMENTS=49062 CHECKS=7196390	SAT TT=851.241	SAT TT=68.13 ASSIGNMENTS=26506 CHECKS=23103900	SAT TT=47.32	SAT TT=123.466
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-10_ext.xml	SAT TT=1175.69	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT TT=1663 CHECKS=5779840000 NODES=3811780	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=1392.03 ASSIGNMENTS=3594500 CHECKS=595561000	SAT TT=1437.01 ASSIGNMENTS=3594500 CHECKS=595561000	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=1258.89 CHECKS=198157000	SAT TT=1200.24 ASSIGNMENTS=3551390 CHECKS=589466000	SAT TT=1060.79 ASSIGNMENTS=3308160 CHECKS=555674000	? (TO) TT=1800.08	SAT TT=1175.69 ASSIGNMENTS=3658490 CHECKS=609397000	SAT TT=1216.69 ASSIGNMENTS=3594500 CHECKS=595561000	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-11_ext.xml	SAT TT=49.784	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=459.482 CHECKS=1579280000 NODES=861058	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=174.862 ASSIGNMENTS=342393 CHECKS=55194200	SAT TT=363.208 ASSIGNMENTS=342393 CHECKS=55194200	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=49.784 CHECKS=6376950	SAT TT=84.156 ASSIGNMENTS=244398 CHECKS=39832700	SAT TT=459.896 ASSIGNMENTS=1239750 CHECKS=198103000	? (TO) TT=1800.04	SAT TT=434.274 ASSIGNMENTS=1081330 CHECKS=184858000	SAT TT=126.25 ASSIGNMENTS=342393 CHECKS=55194200	? (TO) TT=1800.17	SAT TT=336.38 ASSIGNMENTS=104569 CHECKS=124461000	? (TO) TT=1800	? (TO) TT=1800.08
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-13_ext.xml	SAT TT=438.384	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.14	SAT TT=790.624 CHECKS=2744030000 NODES=1993470	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=555.579 ASSIGNMENTS=1607010 CHECKS=251029000	SAT TT=588.333 ASSIGNMENTS=1607010 CHECKS=251029000	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=994.102 CHECKS=129947000	SAT TT=530.893 ASSIGNMENTS=1628140 CHECKS=251808000	SAT TT=521.688 ASSIGNMENTS=1737890 CHECKS=263692000	? (TO) TT=1800.03	SAT TT=438.384 ASSIGNMENTS=1277280 CHECKS=206297000	SAT TT=535.56 ASSIGNMENTS=1607010 CHECKS=251029000	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-1_ext.xml	SAT TT=315.984	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.17	SAT TT=1334.14 CHECKS=4597960000 NODES=3070580	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=379.195 ASSIGNMENTS=1118160 CHECKS=195820000	SAT TT=422.148 ASSIGNMENTS=1118160 CHECKS=195820000	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=315.984 ASSIGNMENTS=1008780 CHECKS=179527000	SAT TT=347.359 ASSIGNMENTS=1038290 CHECKS=183563000	? (TO) TT=1800.07	SAT TT=337.36 ASSIGNMENTS=1013180 CHECKS=180278000	SAT TT=372.976 ASSIGNMENTS=1118160 CHECKS=195820000	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.12
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-20_ext.xml	SAT TT=104.09	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=1240.26 ASSIGNMENTS=69864	? (TO) TT=1800.13	SAT TT=255.613 CHECKS=853529000 NODES=478705	SAT TT=1512.46 CHECKS=14457000000 NODES=34063100	? (TO) TT=1800.08	SAT TT=187.547 ASSIGNMENTS=373262 CHECKS=63173500	SAT TT=178.339 ASSIGNMENTS=373262 CHECKS=63173500	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=104.09 CHECKS=17040900	SAT TT=150.946 ASSIGNMENTS=401635 CHECKS=66231000	SAT TT=162.26 ASSIGNMENTS=429689 CHECKS=70467800	SAT TT=1432.45	SAT TT=161.034 ASSIGNMENTS=429838 CHECKS=70602800	SAT TT=130.92 ASSIGNMENTS=373262 CHECKS=63173500	? (TO) TT=1800.17	SAT TT=800.219 ASSIGNMENTS=314840 CHECKS=360018000	? (TO) TT=1800	? (TO) TT=1800.07
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-21_ext.xml	SAT TT=43.043	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=639.023 ASSIGNMENTS=33084	SAT TT=881.896 ASSIGNMENTS=31176	SAT TT=304.446 CHECKS=1147240000 NODES=614931	SAT TT=255.211 CHECKS=2215460000 NODES=5537430	? (TO) TT=1800.08	SAT TT=85.124 ASSIGNMENTS=178497 CHECKS=26841900	SAT TT=144.151 ASSIGNMENTS=178497 CHECKS=26841900	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=43.043 CHECKS=6061610	SAT TT=62.03 ASSIGNMENTS=185535 CHECKS=27644400	SAT TT=210.066 ASSIGNMENTS=559854 CHECKS=88333400	SAT TT=667.448	SAT TT=193.689 ASSIGNMENTS=540033 CHECKS=83963200	SAT TT=58.99 ASSIGNMENTS=178497 CHECKS=26841900	SAT TT=295.224	SAT TT=621.029 ASSIGNMENTS=159811 CHECKS=194078000	? (TO) TT=1800.03	SAT TT=895.104
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-23_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.19	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-28_ext.xml	SAT TT=5.386	SAT TT=30.577 CHECKS=48404 NODES=8486	SAT TT=41.704 CHECKS=67071 NODES=10147	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=878.487 CHECKS=5282720	SAT TT=86.146 ASSIGNMENTS=5521	SAT TT=592.377 ASSIGNMENTS=29010	SAT TT=31.32 CHECKS=109525000 NODES=63890	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=39.996 ASSIGNMENTS=8486 CHECKS=48404	SAT TT=37.597 ASSIGNMENTS=8486 CHECKS=48404	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=37.281 CHECKS=4635370	SAT TT=5.696 ASSIGNMENTS=15048 CHECKS=2297700	SAT TT=27.917 ASSIGNMENTS=82956 CHECKS=11893200	SAT TT=57.089	SAT TT=13.708 ASSIGNMENTS=38096 CHECKS=5773710	SAT TT=5.386 ASSIGNMENTS=14563 CHECKS=2207210	SAT TT=221.7	SAT TT=1527.46 ASSIGNMENTS=553897 CHECKS=737512000	SAT TT=1274.65	? (TO) TT=1800.12
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-30_ext.xml	SAT TT=520.741	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=1340.13 ASSIGNMENTS=3618260 CHECKS=606083000	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=520.741 CHECKS=76471700	SAT TT=1194.61 ASSIGNMENTS=3378650 CHECKS=577106000	SAT TT=1164.94 ASSIGNMENTS=3420700 CHECKS=582879000	? (TO) TT=1800.03	SAT TT=1226.86 ASSIGNMENTS=3407870 CHECKS=583347000	SAT TT=1182.6 ASSIGNMENTS=3618260 CHECKS=606083000	? (TO) TT=1800.18	SAT TT=610.951 ASSIGNMENTS=261864 CHECKS=264345000	? (TO) TT=1800.01	? (TO) TT=1800.05
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-31_ext.xml	SAT TT=41.487	? (TO) TT=1800.08	? (TO) TT=1800.15	SAT TT=1764.24	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=80.016 ASSIGNMENTS=5712	? (TO) TT=1800.06	SAT TT=618.56 CHECKS=2313590000 NODES=1335260	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=66.511 ASSIGNMENTS=120660 CHECKS=20011500	SAT TT=124.138 ASSIGNMENTS=120660 CHECKS=20011500	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=72.069 CHECKS=11269500	SAT TT=41.487 ASSIGNMENTS=113087 CHECKS=18671800	SAT TT=259.71 ASSIGNMENTS=742152 CHECKS=117390000	SAT TT=297.565	SAT TT=249.123 ASSIGNMENTS=749100 CHECKS=119042000	SAT TT=43.551 ASSIGNMENTS=120660 CHECKS=20011500	SAT TT=1011.34	SAT TT=379.814 ASSIGNMENTS=193316 CHECKS=186480000	? (TO) TT=1800.02	? (TO) TT=1800.11
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-32_ext.xml	SAT TT=28.434	SAT TT=753.537 CHECKS=4163700 NODES=353411	SAT TT=877.236 CHECKS=4524170 NODES=368064	? (TO) TT=1800.12	SAT TT=239.951 CHECKS=1180250	? (TO) TT=1800.03	SAT TT=441.255 ASSIGNMENTS=31533	? (TO) TT=1800.18	SAT TT=188.59 CHECKS=621256000 NODES=407417	? (TO) TT=1800	? (TO) TT=1800	SAT TT=36.03 ASSIGNMENTS=87234 CHECKS=15754200	SAT TT=72.442 ASSIGNMENTS=87234 CHECKS=15754200	? (TO) TT=1800.01	? (TO) TT=1800	SAT TT=400.078 CHECKS=67135700	SAT TT=30.796 ASSIGNMENTS=87874 CHECKS=15500800	SAT TT=23.167 ASSIGNMENTS=68005 CHECKS=11943000	SAT TT=613.591	SAT TT=937.348 ASSIGNMENTS=2880300 CHECKS=510628000	SAT TT=28.434 ASSIGNMENTS=87234 CHECKS=15754200	? (TO) TT=1800.15	SAT TT=450.024 ASSIGNMENTS=108999 CHECKS=106957000	? (TO) TT=1800.1	? (TO) TT=1800.15
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-34_ext.xml	SAT TT=195.03	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=1780.51 ASSIGNMENTS=130071	? (TO) TT=1800.13	SAT TT=762.384 CHECKS=2720890000 NODES=1689170	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=486.768 ASSIGNMENTS=1380260 CHECKS=228372000	SAT TT=548.507 ASSIGNMENTS=1380260 CHECKS=228372000	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=725.684 CHECKS=98500400	SAT TT=195.03 ASSIGNMENTS=493929 CHECKS=85066300	SAT TT=304.859 ASSIGNMENTS=838806 CHECKS=144092000	? (TO) TT=1800.06	SAT TT=229.444 ASSIGNMENTS=628886 CHECKS=103720000	SAT TT=467.405 ASSIGNMENTS=1380260 CHECKS=228372000	SAT TT=933.528	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-35_ext.xml	SAT TT=3.588	SAT TT=38.759 CHECKS=63974 NODES=12597	SAT TT=37.939 CHECKS=60518 NODES=12009	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.13	SAT TT=271.405 CHECKS=957750000 NODES=493397	SAT TT=688.812 CHECKS=6385440000 NODES=15610900	? (TO) TT=1800.01	SAT TT=45.411 ASSIGNMENTS=12597 CHECKS=63974	SAT TT=47.16 ASSIGNMENTS=12597 CHECKS=63974	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=85.445 CHECKS=11709600	SAT TT=28.86 ASSIGNMENTS=75890 CHECKS=12291700	SAT TT=26.182 ASSIGNMENTS=71481 CHECKS=11721800	SAT TT=357.767	SAT TT=3.588 ASSIGNMENTS=9954 CHECKS=1497860	SAT TT=26.218 ASSIGNMENTS=75687 CHECKS=12214700	SAT TT=115.57	SAT TT=83.37 ASSIGNMENTS=26532 CHECKS=29364800	? (TO) TT=1800.07	? (TO) TT=1800.07
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-39_ext.xml	SAT TT=877.917	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=1353.97 ASSIGNMENTS=3116320 CHECKS=515620000	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=877.917 ASSIGNMENTS=2681600 CHECKS=448175000	SAT TT=312.346 ASSIGNMENTS=993825 CHECKS=159059000	? (TO) TT=1800.1	SAT TT=1113.92 ASSIGNMENTS=3208300 CHECKS=530132000	SAT TT=1036.67 ASSIGNMENTS=3116320 CHECKS=515620000	? (TO) TT=1800.19	SAT TT=697.934 ASSIGNMENTS=331448 CHECKS=327548000	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-3_ext.xml	SAT TT=333.966	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.09	SAT TT=651.981 CHECKS=2104920000 NODES=1412540	SAT TT=691.466 CHECKS=6515270000 NODES=16190400	? (TO) TT=1800.08	SAT TT=695.224 ASSIGNMENTS=1862400 CHECKS=291695000	SAT TT=753.7 ASSIGNMENTS=1862400 CHECKS=291695000	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=457.031 CHECKS=64749100	SAT TT=688.729 ASSIGNMENTS=1935400 CHECKS=304166000	SAT TT=697.053 ASSIGNMENTS=1940180 CHECKS=303002000	? (TO) TT=1800.05	SAT TT=670.374 ASSIGNMENTS=1890630 CHECKS=296777000	SAT TT=611.297 ASSIGNMENTS=1862400 CHECKS=291695000	SAT TT=333.966	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.14
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-40_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-42_ext.xml	SAT TT=94.539	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=976.551 ASSIGNMENTS=65257	? (TO) TT=1800.09	SAT TT=164.08 CHECKS=549363000 NODES=301050	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=336.601 ASSIGNMENTS=644331 CHECKS=113958000	SAT TT=338.839 ASSIGNMENTS=644331 CHECKS=113958000	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=94.539 CHECKS=13923000	SAT TT=261.868 ASSIGNMENTS=650221 CHECKS=115021000	SAT TT=260.436 ASSIGNMENTS=651434 CHECKS=114754000	? (TO) TT=1800.04	SAT TT=258.795 ASSIGNMENTS=646850 CHECKS=114359000	SAT TT=255.456 ASSIGNMENTS=644331 CHECKS=113958000	SAT TT=510.255	SAT TT=1198.72 ASSIGNMENTS=434179 CHECKS=454732000	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-43_ext.xml	SAT TT=533.821	SAT TT=1016.46 CHECKS=3170160 NODES=321504	SAT TT=1013.21 CHECKS=3237580 NODES=331577	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=1017.02 ASSIGNMENTS=3116420 CHECKS=493669000	SAT TT=1067.02 ASSIGNMENTS=3116420 CHECKS=493669000	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=533.821 CHECKS=73773000	SAT TT=992.684 ASSIGNMENTS=2958140 CHECKS=469462000	SAT TT=40.362 ASSIGNMENTS=122834 CHECKS=19446100	SAT TT=1221.71	SAT TT=1092.96 ASSIGNMENTS=3326820 CHECKS=523937000	SAT TT=996.186 ASSIGNMENTS=3116420 CHECKS=493669000	SAT TT=1519.74	SAT TT=311.455 ASSIGNMENTS=115732 CHECKS=107620000	? (TO) TT=1800.09	? (TO) TT=1800.14
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-45_ext.xml	SAT TT=85.557	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=750.965	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=1491.19 ASSIGNMENTS=83761	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=123.765 ASSIGNMENTS=240069 CHECKS=42010600	SAT TT=125.293 ASSIGNMENTS=240069 CHECKS=42010600	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=194.473 CHECKS=24216200	SAT TT=86.11 ASSIGNMENTS=234164 CHECKS=40939900	SAT TT=89.883 ASSIGNMENTS=247287 CHECKS=43028900	SAT TT=900.844	SAT TT=274.461 ASSIGNMENTS=742410 CHECKS=130222000	SAT TT=85.557 ASSIGNMENTS=240069 CHECKS=42010600	? (TO) TT=1800.21	SAT TT=178.466 ASSIGNMENTS=61759 CHECKS=73087500	? (TO) TT=1800.06	? (TO) TT=1800.11
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-47_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-50_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.14
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-5_ext.xml	SAT TT=177.164	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.13	SAT TT=212.602 CHECKS=774504000 NODES=467066	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=207.029 ASSIGNMENTS=505351 CHECKS=85203100	SAT TT=223.513 ASSIGNMENTS=505351 CHECKS=85203100	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=219.722 CHECKS=31374900	SAT TT=292.553 ASSIGNMENTS=867409 CHECKS=146853000	SAT TT=319.046 ASSIGNMENTS=866525 CHECKS=147383000	? (TO) TT=1800.05	SAT TT=200.336 ASSIGNMENTS=554002 CHECKS=94919600	SAT TT=177.164 ASSIGNMENTS=505351 CHECKS=85203100	? (TO) TT=1800.19	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-7_ext.xml	SAT TT=24.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.16	SAT TT=509.956 CHECKS=1895100000 NODES=1035350	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=105.515 ASSIGNMENTS=249609 CHECKS=42580200	SAT TT=140.667 ASSIGNMENTS=249609 CHECKS=42580200	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=293.849 CHECKS=43375600	SAT TT=92.739 ASSIGNMENTS=252230 CHECKS=42969700	SAT TT=28.449 ASSIGNMENTS=75386 CHECKS=12609200	? (TO) TT=1800.02	SAT TT=24.05 ASSIGNMENTS=65297 CHECKS=11074200	SAT TT=96.377 ASSIGNMENTS=249609 CHECKS=42580200	? (TO) TT=1800.14	SAT TT=1367.67 ASSIGNMENTS=422765 CHECKS=502169000	? (TO) TT=1800.04	? (TO) TT=1800.1
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-8_ext.xml	SAT TT=116.382	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=716.398 ASSIGNMENTS=43074	? (TO) TT=1800.07	SAT TT=211.953 CHECKS=723271000 NODES=470591	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=143.309 ASSIGNMENTS=387874 CHECKS=63962400	SAT TT=178.96 ASSIGNMENTS=387874 CHECKS=63962400	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=498.845 CHECKS=76018700	SAT TT=144.763 ASSIGNMENTS=405251 CHECKS=69066400	SAT TT=114.012 ASSIGNMENTS=329939 CHECKS=54726400	SAT TT=364.737	SAT TT=116.382 ASSIGNMENTS=320758 CHECKS=55187000	SAT TT=133.624 ASSIGNMENTS=387874 CHECKS=63962400	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.1
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-9_ext.xml	SAT TT=63.86	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.11	SAT TT=401.95 CHECKS=1425760000 NODES=910089	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=66.191 ASSIGNMENTS=195241 CHECKS=31680000	SAT TT=336.823 ASSIGNMENTS=195241 CHECKS=31680000	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=242.707 CHECKS=42648300	SAT TT=180.333 ASSIGNMENTS=574365 CHECKS=87947600	SAT TT=182.952 ASSIGNMENTS=581346 CHECKS=88805100	SAT TT=647.586	SAT TT=195.215 ASSIGNMENTS=601097 CHECKS=93827000	SAT TT=63.86 ASSIGNMENTS=195241 CHECKS=31680000	? (TO) TT=1800.18	SAT TT=530.011 ASSIGNMENTS=143816 CHECKS=175217000	? (TO) TT=1800.05	SAT TT=104.732
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-10_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-14_ext.xml	UNSAT TT=1189.87	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.12	UNSAT TT=1765.64 CHECKS=6136160000 NODES=3646260	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=1525.82 ASSIGNMENTS=3915160 CHECKS=656935000	UNSAT TT=1406.64 ASSIGNMENTS=3915160 CHECKS=656935000	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=1189.87 ASSIGNMENTS=3049140 CHECKS=516583000	UNSAT TT=1125.2 ASSIGNMENTS=3184090 CHECKS=526693000	? (TO) TT=1800.02	UNSAT TT=1486.2 ASSIGNMENTS=4180400 CHECKS=695794000	UNSAT TT=1381.81 ASSIGNMENTS=3915160 CHECKS=656935000	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.05
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-15_ext.xml	SAT TT=289.926	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.12	SAT TT=788.218 CHECKS=2546840000 NODES=1635000	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=380.516 ASSIGNMENTS=1151690 CHECKS=190838000	SAT TT=415.522 ASSIGNMENTS=1151690 CHECKS=190838000	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=413.906 CHECKS=62954300	SAT TT=938.068 ASSIGNMENTS=2995670 CHECKS=504376000	SAT TT=389.745 ASSIGNMENTS=1185320 CHECKS=197072000	? (TO) TT=1800.07	SAT TT=289.926 ASSIGNMENTS=899664 CHECKS=150957000	SAT TT=365.27 ASSIGNMENTS=1151690 CHECKS=190838000	? (TO) TT=1800.2	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-16_ext.xml	SAT TT=66.915	SAT TT=972.124 CHECKS=2902020 NODES=236999	SAT TT=1067.22 CHECKS=2887300 NODES=236735	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=1082.52 ASSIGNMENTS=73395	? (TO) TT=1800.09	SAT TT=133.604 CHECKS=487121000 NODES=270124	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=174.029 ASSIGNMENTS=187751 CHECKS=30917200	SAT TT=156.77 ASSIGNMENTS=187751 CHECKS=30917200	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=173.001 CHECKS=20553600	SAT TT=66.915 ASSIGNMENTS=176358 CHECKS=29362400	SAT TT=89.452 ASSIGNMENTS=225328 CHECKS=35702800	SAT TT=471.946	SAT TT=203.786 ASSIGNMENTS=504525 CHECKS=81862900	SAT TT=75.633 ASSIGNMENTS=187751 CHECKS=30917200	? (TO) TT=1800.19	SAT TT=810.717 ASSIGNMENTS=273813 CHECKS=337352000	? (TO) TT=1800.07	SAT TT=189.566
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-17_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.1
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-18_ext.xml	SAT TT=14.714	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.14	SAT TT=424.938 ASSIGNMENTS=18895	SAT TT=399.236 CHECKS=1489680000 NODES=848448	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=58.412 ASSIGNMENTS=94297 CHECKS=14487400	SAT TT=76.097 ASSIGNMENTS=94297 CHECKS=14487400	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=184.299 CHECKS=28440000	SAT TT=127.146 ASSIGNMENTS=408926 CHECKS=61332100	SAT TT=31.551 ASSIGNMENTS=96046 CHECKS=14440600	SAT TT=1447.27	SAT TT=14.714 ASSIGNMENTS=48479 CHECKS=7507920	SAT TT=31.357 ASSIGNMENTS=94297 CHECKS=14487400	? (TO) TT=1800.14	SAT TT=78.22 ASSIGNMENTS=32743 CHECKS=31455200	? (TO) TT=1800.03	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-19_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.15
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-1_ext.xml	SAT TT=332.942	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	SAT TT=1330.41 CHECKS=4598550000 NODES=3128980	SAT TT=332.942 CHECKS=2985180000 NODES=7072490	? (TO) TT=1800.09	SAT TT=1100.08 ASSIGNMENTS=2092760 CHECKS=344888000	SAT TT=662.567 ASSIGNMENTS=2092760 CHECKS=344888000	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=525.14 ASSIGNMENTS=1727640 CHECKS=297323000	SAT TT=688.96 ASSIGNMENTS=2306620 CHECKS=386398000	? (TO) TT=1800.06	SAT TT=649.594 ASSIGNMENTS=2194430 CHECKS=367924000	SAT TT=615.048 ASSIGNMENTS=2092760 CHECKS=344888000	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.15
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-22_ext.xml	UNSAT TT=187.488	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=369.447 CHECKS=1381200000 NODES=733306	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=216.8 ASSIGNMENTS=530504 CHECKS=84727100	UNSAT TT=251.973 ASSIGNMENTS=530504 CHECKS=84727100	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=297.299 CHECKS=40688100	UNSAT TT=195.117 ASSIGNMENTS=529432 CHECKS=85026100	UNSAT TT=206.876 ASSIGNMENTS=532257 CHECKS=85159800	? (TO) TT=1800.05	UNSAT TT=194.776 ASSIGNMENTS=529864 CHECKS=85010000	UNSAT TT=187.488 ASSIGNMENTS=530504 CHECKS=84727100	? (TO) TT=1800.18	UNSAT TT=1653.39 ASSIGNMENTS=726126 CHECKS=799419000	? (TO) TT=1800.09	? (TO) TT=1800.14
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-32_ext.xml	UNSAT TT=1261.2	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.12	UNSAT TT=1759.56 CHECKS=5843610000 NODES=4007370	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=1368.95 ASSIGNMENTS=4144990 CHECKS=733601000	UNSAT TT=1376.95 ASSIGNMENTS=4144990 CHECKS=733601000	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=1240.94 ASSIGNMENTS=3789800 CHECKS=670223000	? (TO) TT=1800.02	UNSAT TT=1261.2 ASSIGNMENTS=3830900 CHECKS=674816000	UNSAT TT=1356.29 ASSIGNMENTS=4144990 CHECKS=733601000	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-35_ext.xml	SAT TT=256.786	? (TO) TT=1800.15	? (TO) TT=1800.14	SAT TT=449.17	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=779.044 ASSIGNMENTS=47434	? (TO) TT=1800.12	SAT TT=315.929 CHECKS=1113100000 NODES=583763	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=526.616 ASSIGNMENTS=1183130 CHECKS=195661000	SAT TT=528.667 ASSIGNMENTS=1183130 CHECKS=195661000	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=256.786 CHECKS=37686700	SAT TT=434.302 ASSIGNMENTS=1185350 CHECKS=196537000	SAT TT=435.145 ASSIGNMENTS=1168950 CHECKS=196607000	? (TO) TT=1800.05	SAT TT=452.858 ASSIGNMENTS=1198910 CHECKS=204562000	SAT TT=427.237 ASSIGNMENTS=1183130 CHECKS=195661000	? (TO) TT=1800.19	? (TO) TT=1800.1	SAT TT=289.492	? (TO) TT=1800.06
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-36_ext.xml	UNSAT TT=1121.56	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=1691.62 ASSIGNMENTS=4159170 CHECKS=787159000	UNSAT TT=1634.31 ASSIGNMENTS=4159170 CHECKS=787159000	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=1461.17 ASSIGNMENTS=3792260 CHECKS=714179000	UNSAT TT=1592.97 ASSIGNMENTS=4247310 CHECKS=797716000	? (TO) TT=1800.08	UNSAT TT=1121.56 ASSIGNMENTS=3201970 CHECKS=576994000	UNSAT TT=1597.75 ASSIGNMENTS=4159170 CHECKS=787159000	? (TO) TT=1800.19	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.09
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-37_ext.xml	UNSAT TT=1782.01	? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=1782.01 ASSIGNMENTS=5480910 CHECKS=891859000	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.09
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-38_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.12
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-39_ext.xml		? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.09
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-42_ext.xml	UNSAT TT=315.777	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.15	UNSAT TT=528.133 CHECKS=1954180000 NODES=1059700	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=347.313 ASSIGNMENTS=847601 CHECKS=149271000	UNSAT TT=376.032 ASSIGNMENTS=847601 CHECKS=149271000	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=424.838 CHECKS=67321200	UNSAT TT=318.094 ASSIGNMENTS=850407 CHECKS=150091000	UNSAT TT=340.508 ASSIGNMENTS=848415 CHECKS=149978000	? (TO) TT=1800.09	UNSAT TT=315.777 ASSIGNMENTS=852188 CHECKS=150195000	UNSAT TT=330.71 ASSIGNMENTS=847601 CHECKS=149271000	? (TO) TT=1800.18	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-43_ext.xml	UNSAT TT=1403.18	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=1767.77 ASSIGNMENTS=4377020 CHECKS=694205000	UNSAT TT=1760.92 ASSIGNMENTS=4377020 CHECKS=694205000	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=1583.26 ASSIGNMENTS=4585220 CHECKS=724624000	UNSAT TT=1523.95 ASSIGNMENTS=4556530 CHECKS=722177000	? (TO) TT=1800	UNSAT TT=1496.99 ASSIGNMENTS=4593320 CHECKS=724089000	UNSAT TT=1403.18 ASSIGNMENTS=4377020 CHECKS=694205000	? (TO) TT=1800.21	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.11
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-45_ext.xml		? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-47_ext.xml	SAT TT=52.958	SAT TT=52.958 CHECKS=147886 NODES=24765	SAT TT=529.503 CHECKS=2368040 NODES=256801	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.14
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-4_ext.xml	UNSAT TT=147.772	? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.13	UNSAT TT=299.819 CHECKS=991049000 NODES=544085	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=206.123 ASSIGNMENTS=406014 CHECKS=72071500	UNSAT TT=209.829 ASSIGNMENTS=406014 CHECKS=72071500	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=254.99 CHECKS=31567800	UNSAT TT=160.03 ASSIGNMENTS=395435 CHECKS=69895200	UNSAT TT=155.521 ASSIGNMENTS=412359 CHECKS=71974700	UNSAT TT=1177.36	UNSAT TT=147.772 ASSIGNMENTS=361794 CHECKS=67325200	UNSAT TT=152.936 ASSIGNMENTS=406014 CHECKS=72071500	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.15
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-50_ext.xml	SAT TT=1089.38	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=1625.55 ASSIGNMENTS=4903370 CHECKS=869579000	SAT TT=1654.44 ASSIGNMENTS=4903370 CHECKS=869579000	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1089.38 ASSIGNMENTS=3285180 CHECKS=577832000	SAT TT=1104.62 ASSIGNMENTS=3385860 CHECKS=596940000	? (TO) TT=1800.01	SAT TT=1540.77 ASSIGNMENTS=4785960 CHECKS=844026000	SAT TT=1630.13 ASSIGNMENTS=4903370 CHECKS=869579000	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-6_ext.xml	SAT TT=828.509	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800	SAT TT=1117.58 ASSIGNMENTS=3766050 CHECKS=566313000	SAT TT=1379 ASSIGNMENTS=3766050 CHECKS=566313000	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=1612.42 CHECKS=233360000	SAT TT=828.509 ASSIGNMENTS=2731230 CHECKS=415852000	SAT TT=1126.11 ASSIGNMENTS=3752140 CHECKS=569880000	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=1106.22 ASSIGNMENTS=3766050 CHECKS=566313000	? (TO) TT=1800.22	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-7_ext.xml	SAT TT=100.636	? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT TT=367.809 CHECKS=1375380000 NODES=745600	SAT TT=878.014 CHECKS=8213690000 NODES=20393600	? (TO) TT=1800.01	SAT TT=369.099 ASSIGNMENTS=885299 CHECKS=147139000	SAT TT=372.209 ASSIGNMENTS=885299 CHECKS=147139000	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=100.636 CHECKS=16745600	SAT TT=378.166 ASSIGNMENTS=1037930 CHECKS=175382000	SAT TT=341.346 ASSIGNMENTS=907454 CHECKS=151378000	? (TO) TT=1800.03	SAT TT=131.922 ASSIGNMENTS=377309 CHECKS=64405800	SAT TT=304.083 ASSIGNMENTS=885299 CHECKS=147139000	SAT TT=1764.21	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.14
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-8_ext.xml	UNSAT TT=942.283	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.11	UNSAT TT=1374.35 CHECKS=4481680000 NODES=2870580	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=1050.26 ASSIGNMENTS=2911150 CHECKS=497891000	UNSAT TT=1087.82 ASSIGNMENTS=2911150 CHECKS=497891000	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=1349.61 CHECKS=201136000	UNSAT TT=942.283 ASSIGNMENTS=2656040 CHECKS=453383000	UNSAT TT=878.716 ASSIGNMENTS=2694510 CHECKS=458665000	? (TO) TT=1800	UNSAT TT=1010.75 ASSIGNMENTS=2871650 CHECKS=490675000	UNSAT TT=1021.54 ASSIGNMENTS=2911150 CHECKS=497891000	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-9_ext.xml	UNSAT TT=877.378	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=1530.55 CHECKS=5116150000 NODES=3293440	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=877.378 ASSIGNMENTS=2843290 CHECKS=428631000	UNSAT TT=1123.14 ASSIGNMENTS=2843290 CHECKS=428631000	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=1358.89 CHECKS=222572000	UNSAT TT=990.703 ASSIGNMENTS=3017250 CHECKS=491382000	UNSAT TT=856.491 ASSIGNMENTS=2829260 CHECKS=434348000	? (TO) TT=1800.01	UNSAT TT=902.623 ASSIGNMENTS=2766420 CHECKS=420676000	UNSAT TT=901.235 ASSIGNMENTS=2843290 CHECKS=428631000	? (TO) TT=1800.2	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.13
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-10_ext.xml	SAT TT=1604.78	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=1604.78 CHECKS=158321000	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.22	? (TO) TT=1800.11	? (MO) TT=8.38	? (MO) TT=8.38
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-13_ext.xml	SAT TT=1037.51	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=1037.51 CHECKS=115463000	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.05	? (MO) TT=8.44	? (MO) TT=8.432
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-14_ext.xml	SAT TT=235.303	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=235.303 CHECKS=26220500	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.08	? (MO) TT=8.457	? (MO) TT=8.447
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-16_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.16	? (TO) TT=1800.04	? (MO) TT=7.434	? (MO) TT=7.89
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-1_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.11	? (MO) TT=8.07	? (MO) TT=8.24
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-20_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.09	? (MO) TT=8.289	? (MO) TT=7.432
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-21_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.03	? (MO) TT=7.96	? (MO) TT=8.22
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-22_ext.xml	SAT TT=54.867	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=963.567 ASSIGNMENTS=39216	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=977.917 ASSIGNMENTS=124179 CHECKS=22991600	SAT TT=550.681 ASSIGNMENTS=124179 CHECKS=22991600	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=57.027 ASSIGNMENTS=124404 CHECKS=22921900	SAT TT=56.335 ASSIGNMENTS=127682 CHECKS=23355900	SAT TT=201.613	SAT TT=55.388 ASSIGNMENTS=124881 CHECKS=22962600	SAT TT=54.867 ASSIGNMENTS=124179 CHECKS=22991600	? (TO) TT=1800.17	? (TO) TT=1800.1	? (MO) TT=8.54	? (MO) TT=8.23
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-23_ext.xml	SAT TT=57.859	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.07	SAT TT=601.857 CHECKS=1878940000 NODES=1201950	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=67.571 ASSIGNMENTS=150099 CHECKS=29024200	SAT TT=99.54 ASSIGNMENTS=150099 CHECKS=29024200	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=60.118 ASSIGNMENTS=153202 CHECKS=29644700	SAT TT=844.183 ASSIGNMENTS=2263920 CHECKS=426756000	SAT TT=1094.27	SAT TT=993.49 ASSIGNMENTS=2924690 CHECKS=543912000	SAT TT=57.859 ASSIGNMENTS=150099 CHECKS=29024200	? (TO) TT=1800.18	? (TO) TT=1800.09	? (MO) TT=8.22	? (MO) TT=8.42
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-24_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.22	? (TO) TT=1800.03	? (MO) TT=8.36	? (MO) TT=8.41
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-25_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.04	? (MO) TT=8.45	? (MO) TT=8.43
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-27_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.03	? (MO) TT=8.16	? (MO) TT=8.31
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-28_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.04	? (MO) TT=8.438	? (MO) TT=8.44
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-30_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.09	? (MO) TT=8.17	? (MO) TT=8.35
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-31_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.1	? (MO) TT=7.99	? (MO) TT=8.31
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-32_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.19	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.17	? (TO) TT=1800.1	? (MO) TT=8.42	? (MO) TT=8.25
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-34_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.07	? (MO) TT=7.429	? (MO) TT=8.33
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-35_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.33	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.11	? (MO) TT=7.419	? (MO) TT=8.33
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-37_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.1	? (MO) TT=8.05	? (MO) TT=7.405
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-38_ext.xml		? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.02	? (MO) TT=8.26	? (MO) TT=8.06
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-3_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.03	? (MO) TT=8.451	? (MO) TT=8.41
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-40_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.23	? (TO) TT=1800.03	? (MO) TT=8.497	? (MO) TT=8.472
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-42_ext.xml		? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.01	? (MO) TT=8.23	? (MO) TT=8.468
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-43_ext.xml	SAT TT=318.281	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1639.41 CHECKS=5601330000 NODES=2578980	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=963.11 ASSIGNMENTS=1936310 CHECKS=359969000	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=318.281 CHECKS=32849000	SAT TT=863.978 ASSIGNMENTS=1801230 CHECKS=337345000	SAT TT=788.75 ASSIGNMENTS=1838630 CHECKS=330111000	? (TO) TT=1800.09	SAT TT=770.022 ASSIGNMENTS=1775630 CHECKS=321548000	SAT TT=890.767 ASSIGNMENTS=1936310 CHECKS=359969000	? (TO) TT=1800.23	? (TO) TT=1800.09	? (MO) TT=8.43	? (MO) TT=7.439
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-44_ext.xml		? (TO) TT=1800.11	? (MO) TT=2.327	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.18	? (TO) TT=1800.03	? (MO) TT=8.12	? (MO) TT=8.15
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-46_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.21	? (TO) TT=1800.03	? (MO) TT=8.316	? (MO) TT=8.43
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-48_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.02	? (MO) TT=7.605	? (MO) TT=7.572
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-50_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.2	? (TO) TT=1800.1	? (MO) TT=8.33	? (MO) TT=8.03
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-7_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.09	? (MO) TT=8.576	? (MO) TT=8.41
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-10_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.07	? (MO) TT=8.21	? (MO) TT=8.45
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-14_ext.xml	SAT TT=925.489	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800	SAT TT=1194.54 CHECKS=135863000	SAT TT=925.489 ASSIGNMENTS=2449140 CHECKS=443719000	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=929.382 ASSIGNMENTS=2354090 CHECKS=427465000	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.09	? (MO) TT=8.472	? (MO) TT=8.35
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-16_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.1	? (MO) TT=8.406	? (MO) TT=7.88
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-17_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.19	? (TO) TT=1800.08	? (MO) TT=7.153	? (MO) TT=8.453
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-18_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.07	? (MO) TT=8.45	? (MO) TT=8.434
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-1_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.11	? (MO) TT=8.3	? (MO) TT=8.18
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-20_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.05	? (MO) TT=8.36	? (MO) TT=8.444
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-23_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.02	? (MO) TT=7.414	? (MO) TT=8.32
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-24_ext.xml		? (TO) TT=1800.18	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.09	? (MO) TT=8.44	? (MO) TT=8.41
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-25_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.03	? (MO) TT=7.397	? (MO) TT=8.02
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-27_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.03	? (MO) TT=8.33	? (MO) TT=8.11
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-29_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.09	? (MO) TT=8.31	? (MO) TT=8.33
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-30_ext.xml		? (TO) TT=1800.16	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.04	? (MO) TT=8.28	? (MO) TT=8.465
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-31_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.21	? (TO) TT=1800.03	? (MO) TT=8.34	? (MO) TT=8.04
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-32_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (MO) TT=8.25	? (MO) TT=7.506
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-35_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.18	? (TO) TT=1800.02	? (MO) TT=7.432	? (MO) TT=7.407
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-36_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.2	? (TO) TT=1800.02	? (MO) TT=8.43	? (MO) TT=8.22
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-37_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.03	? (MO) TT=8.33	? (MO) TT=8.43
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-38_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.15	? (TO) TT=1800.09	? (MO) TT=7.433	? (MO) TT=7.13
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-39_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.06	? (MO) TT=8.06	? (MO) TT=8.429
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-3_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (MO) TT=8.22	? (MO) TT=8.75
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-40_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (MO) TT=8.43	? (MO) TT=8.472
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-41_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.07	? (MO) TT=8.45	? (MO) TT=8.467
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-42_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.06	? (MO) TT=8.39	? (MO) TT=8.31
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-44_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.21	? (TO) TT=1800.05	? (MO) TT=8.31	? (MO) TT=8.24
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-46_ext.xml	SAT TT=61.869	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=1403.9 ASSIGNMENTS=55223	? (TO) TT=1800.07	SAT TT=1343.81 CHECKS=4751880000 NODES=2689730	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=399.069 ASSIGNMENTS=165494 CHECKS=27374700	SAT TT=107.731 ASSIGNMENTS=165494 CHECKS=27374700	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=1340.23 CHECKS=177438000	SAT TT=62.344 ASSIGNMENTS=165592 CHECKS=27349400	SAT TT=97.071 ASSIGNMENTS=268923 CHECKS=41704800	SAT TT=1119.37	? (TO) TT=1800.08	SAT TT=61.869 ASSIGNMENTS=165494 CHECKS=27374700	? (TO) TT=1800.19	? (TO) TT=1800.07	? (MO) TT=8.36	? (MO) TT=8.34
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-5_ext.xml	SAT TT=1363.81	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.12	SAT TT=1402.77 ASSIGNMENTS=3053280 CHECKS=587551000	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=1439.78 ASSIGNMENTS=3401940 CHECKS=658018000	? (TO) TT=1800.03	SAT TT=1641.72 ASSIGNMENTS=3757630 CHECKS=719308000	SAT TT=1363.81 ASSIGNMENTS=3053280 CHECKS=587551000	? (TO) TT=1800.22	? (TO) TT=1800.07	? (MO) TT=8.33	? (MO) TT=8.504
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-6_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.54	? (TO) TT=1800.02	? (MO) TT=8.25	? (MO) TT=8.32
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-8_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.11	? (MO) TT=8.34	? (MO) TT=8.464
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-9_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.07	? (MO) TT=7.416	? (MO) TT=7.431
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-0_ext.xml	SAT TT=3.394	SAT TT=329.207 CHECKS=1176560 NODES=224141	SAT TT=318.215 CHECKS=1120340 NODES=224438	? (problem) TT=114.274	? (TO) TT=1800.15	? (TO) TT=1800.16	SAT TT=327.407 ASSIGNMENTS=2597	? (TO) TT=1800.09	SAT TT=23.651 CHECKS=23160500 NODES=28171	SAT TT=100.97 CHECKS=350475000 NODES=1472490	? (TO) TT=1800.04	SAT TT=4.313 ASSIGNMENTS=5921 CHECKS=286125	SAT TT=4.03 ASSIGNMENTS=5921 CHECKS=286125	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=13.419 CHECKS=1242050	SAT TT=3.945 ASSIGNMENTS=5993 CHECKS=290030	SAT TT=4.485 ASSIGNMENTS=8139 CHECKS=315015	SAT TT=52.719	SAT TT=3.394 ASSIGNMENTS=1984 CHECKS=89869	SAT TT=4.288 ASSIGNMENTS=5921 CHECKS=286125	? TT=111.227	SAT TT=583.169 ASSIGNMENTS=528049 CHECKS=145131000	? (MO) TT=12.65	? (MO) TT=12.58
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-10_ext.xml	SAT TT=5.034	SAT TT=56.319 CHECKS=146630 NODES=29957	SAT TT=63.596 CHECKS=148681 NODES=30781	? (problem) TT=115.866	? (TO) TT=1800.12	? (TO) TT=1800.18	SAT TT=731.316 ASSIGNMENTS=3866	SAT TT=1716.44 ASSIGNMENTS=13267	SAT TT=57.101 CHECKS=103722000 NODES=127459	SAT TT=72.474 CHECKS=259651000 NODES=1115260	? (TO) TT=1800	SAT TT=14.45 ASSIGNMENTS=9486 CHECKS=470011	SAT TT=65.831 ASSIGNMENTS=29957 CHECKS=146630	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=9.849 CHECKS=608585	SAT TT=5.194 ASSIGNMENTS=9802 CHECKS=508678	SAT TT=10.639 ASSIGNMENTS=40177 CHECKS=1927700	SAT TT=51.516	SAT TT=5.209 ASSIGNMENTS=10508 CHECKS=538070	SAT TT=5.034 ASSIGNMENTS=9486 CHECKS=470011	? TT=81.852	SAT TT=109.859 ASSIGNMENTS=71126 CHECKS=24464800	? (MO) TT=12.759	? (MO) TT=13.891
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-11_ext.xml	SAT TT=11.876	SAT TT=548.54 CHECKS=3066570 NODES=570182	SAT TT=423.776 CHECKS=1912130 NODES=329400	? (problem) TT=122.757	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=23.426 CHECKS=24004600 NODES=27935	SAT TT=214.91 CHECKS=876959000 NODES=3706290	? (TO) TT=1800.04	SAT TT=22.11 ASSIGNMENTS=40960 CHECKS=1974070	SAT TT=313.453 ASSIGNMENTS=40960 CHECKS=1974070	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=24.877 CHECKS=2427610	SAT TT=11.876 ASSIGNMENTS=41262 CHECKS=1994870	SAT TT=4.59 ASSIGNMENTS=10202 CHECKS=421211	SAT TT=56.762	SAT TT=38.376 ASSIGNMENTS=178307 CHECKS=8584150	SAT TT=11.958 ASSIGNMENTS=40960 CHECKS=1974070	? TT=111.585	SAT TT=411.363 ASSIGNMENTS=268983 CHECKS=84676900	? (MO) TT=13.903	? (MO) TT=12.71
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-12_ext.xml	SAT TT=8.698	SAT TT=26.432 CHECKS=165677 NODES=36903	SAT TT=44.992 CHECKS=317404 NODES=65121	? (problem) TT=112.301	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.18	SAT TT=54.383 CHECKS=103145000 NODES=136930	SAT TT=151.69 CHECKS=581015000 NODES=2459340	? (TO) TT=1800.06	SAT TT=25.249 ASSIGNMENTS=65514 CHECKS=3028190	SAT TT=34.693 ASSIGNMENTS=36903 CHECKS=165677	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=8.698 CHECKS=692658	SAT TT=15.007 ASSIGNMENTS=65960 CHECKS=3061760	SAT TT=15.349 ASSIGNMENTS=69350 CHECKS=3148200	SAT TT=95.568	SAT TT=11.951 ASSIGNMENTS=46176 CHECKS=2202850	SAT TT=14.107 ASSIGNMENTS=65514 CHECKS=3028190	? TT=84.399	SAT TT=54.305 ASSIGNMENTS=37555 CHECKS=8801440	? (MO) TT=12.781	? (MO) TT=11.818
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-13_ext.xml	SAT TT=15.754	SAT TT=505.438 CHECKS=8788570 NODES=1607820	SAT TT=500.622 CHECKS=8820780 NODES=1609430	? (problem) TT=117.811	? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=197.834 CHECKS=460367000 NODES=695733	SAT TT=100.211 CHECKS=372395000 NODES=1579560	? (TO) TT=1800.01	SAT TT=58.929 ASSIGNMENTS=288049 CHECKS=14110400	SAT TT=348.817 ASSIGNMENTS=288049 CHECKS=14110400	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=15.754 CHECKS=1725270	SAT TT=52.575 ASSIGNMENTS=287249 CHECKS=14058800	SAT TT=49.942 ASSIGNMENTS=291110 CHECKS=14182200	SAT TT=292.344	SAT TT=66.422 ASSIGNMENTS=372378 CHECKS=18208600	SAT TT=48.19 ASSIGNMENTS=288049 CHECKS=14110400	? TT=85.565	SAT TT=612.156 ASSIGNMENTS=460640 CHECKS=134843000	? (MO) TT=11.784	? (MO) TT=11.798
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-14_ext.xml	SAT TT=5.4	SAT TT=257.357 CHECKS=997437 NODES=200497	SAT TT=257.416 CHECKS=1019320 NODES=200720	? (problem) TT=119.971	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=374.168 CHECKS=942542000 NODES=1331260	SAT TT=320.772 CHECKS=1339510000 NODES=5793260	SAT TT=464.454 CHECKS=954174000 NODES=2272000	SAT TT=25.218 ASSIGNMENTS=54484 CHECKS=2748170	SAT TT=270.513 ASSIGNMENTS=200497 CHECKS=997437	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=22.173 CHECKS=1733690	SAT TT=15.024 ASSIGNMENTS=54281 CHECKS=2746570	SAT TT=30.125 ASSIGNMENTS=122689 CHECKS=6101690	SAT TT=138.071	SAT TT=5.4 ASSIGNMENTS=11274 CHECKS=554440	SAT TT=14.953 ASSIGNMENTS=54484 CHECKS=2748170	? TT=86.8	SAT TT=598.884 ASSIGNMENTS=226299 CHECKS=115480000	? (MO) TT=12.79	? (MO) TT=12.964
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-15_ext.xml	SAT TT=9.328	SAT TT=66.125 CHECKS=449037 NODES=96317	SAT TT=64.762 CHECKS=446555 NODES=96584	? (problem) TT=112.271	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.13	SAT TT=52.026 CHECKS=102174000 NODES=133837	SAT TT=63.827 CHECKS=220687000 NODES=940492	? (TO) TT=1800.06	SAT TT=22.827 ASSIGNMENTS=49412 CHECKS=2401560	SAT TT=75.905 ASSIGNMENTS=96317 CHECKS=449037	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=24.187 CHECKS=2547350	SAT TT=12.351 ASSIGNMENTS=49303 CHECKS=2396350	SAT TT=12.956 ASSIGNMENTS=53243 CHECKS=2500560	SAT TT=83.703	SAT TT=9.328 ASSIGNMENTS=34126 CHECKS=1654520	SAT TT=12.41 ASSIGNMENTS=49412 CHECKS=2401560	? TT=78.82	SAT TT=154.465 ASSIGNMENTS=82716 CHECKS=24890000	? (MO) TT=13.914	? (MO) TT=12.8
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-16_ext.xml	SAT TT=4.346	SAT TT=160.44 CHECKS=180038 NODES=42903	SAT TT=149.123 CHECKS=157543 NODES=37947	? (problem) TT=123.401	? (TO) TT=1800.14	? (TO) TT=1800.17	SAT TT=745.167 ASSIGNMENTS=6069	? (TO) TT=1800.1	SAT TT=26.084 CHECKS=30589600 NODES=44210	SAT TT=141.438 CHECKS=511162000 NODES=2127360	? (TO) TT=1800.05	SAT TT=14.966 ASSIGNMENTS=8097 CHECKS=357165	SAT TT=4.346 ASSIGNMENTS=8097 CHECKS=357165	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=16.834 CHECKS=1842190	SAT TT=6.153 ASSIGNMENTS=15937 CHECKS=741951	SAT TT=12.747 ASSIGNMENTS=52996 CHECKS=2509000	SAT TT=54.423	SAT TT=9.004 ASSIGNMENTS=31597 CHECKS=1424710	SAT TT=4.607 ASSIGNMENTS=8097 CHECKS=357165	? TT=82.194	SAT TT=371.055 ASSIGNMENTS=318762 CHECKS=115626000	? (MO) TT=12.737	? (MO) TT=12.95
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-17_ext.xml	SAT TT=8.735	SAT TT=105.104 CHECKS=761395 NODES=165804	SAT TT=104.925 CHECKS=766781 NODES=165613	? (problem) TT=119.944	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.19	? (TO) TT=1800.11	SAT TT=52.39 CHECKS=93619300 NODES=133926	SAT TT=311.564 CHECKS=1185440000 NODES=5030160	SAT TT=1151.77 CHECKS=2422860000 NODES=5078820	SAT TT=21.221 ASSIGNMENTS=39188 CHECKS=1849360	SAT TT=112.771 ASSIGNMENTS=165804 CHECKS=761395	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=8.735 CHECKS=480448	SAT TT=9.894 ASSIGNMENTS=38668 CHECKS=1837660	SAT TT=11.143 ASSIGNMENTS=42127 CHECKS=1939410	SAT TT=110.108	SAT TT=18.058 ASSIGNMENTS=76803 CHECKS=3645540	SAT TT=10.648 ASSIGNMENTS=39188 CHECKS=1849360	? TT=108.509	SAT TT=108.204 ASSIGNMENTS=64898 CHECKS=20507700	? (MO) TT=12.84	? (MO) TT=12.776
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-18_ext.xml	SAT TT=6.293	SAT TT=82.493 CHECKS=691926 NODES=133766	SAT TT=92.281 CHECKS=692036 NODES=134027	? (problem) TT=121.941	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.16	SAT TT=65.417 CHECKS=128393000 NODES=190591	SAT TT=54.408 CHECKS=166013000 NODES=727316	SAT TT=1404.77 CHECKS=3048910000 NODES=6985040	SAT TT=21.293 ASSIGNMENTS=44644 CHECKS=1988000	SAT TT=93.505 ASSIGNMENTS=133766 CHECKS=691926	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=25.42 CHECKS=2731650	SAT TT=10.96 ASSIGNMENTS=44893 CHECKS=2002810	SAT TT=11.558 ASSIGNMENTS=49383 CHECKS=2106090	SAT TT=101.07	SAT TT=6.293 ASSIGNMENTS=16705 CHECKS=810528	SAT TT=9.866 ASSIGNMENTS=44644 CHECKS=1988000	? TT=71.764	SAT TT=43.507 ASSIGNMENTS=27905 CHECKS=7722190	? (MO) TT=12.72	? (MO) TT=12.72
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-19_ext.xml	SAT TT=8.578	SAT TT=1041.03 CHECKS=2451140 NODES=524717	SAT TT=1058.93 CHECKS=2459380 NODES=525599	? (problem) TT=121.506	SAT TT=1181.78 CHECKS=252601	SAT TT=1543.81 CHECKS=323727	SAT TT=1519.1 ASSIGNMENTS=14577	? (TO) TT=1800.18	SAT TT=24.25 CHECKS=23441300 NODES=36996	SAT TT=68.823 CHECKS=211493000 NODES=877728	SAT TT=1186.78 CHECKS=2754630000 NODES=5628070	SAT TT=20.469 ASSIGNMENTS=35493 CHECKS=1682940	SAT TT=310.095 ASSIGNMENTS=35493 CHECKS=1682940	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=18.667 CHECKS=1865690	SAT TT=10.033 ASSIGNMENTS=35956 CHECKS=1684140	SAT TT=6.285 ASSIGNMENTS=17458 CHECKS=747152	SAT TT=110.319	SAT TT=8.578 ASSIGNMENTS=25758 CHECKS=1209070	SAT TT=9.258 ASSIGNMENTS=35493 CHECKS=1682940	? TT=79.903	SAT TT=201.213 ASSIGNMENTS=130041 CHECKS=39248800	? (MO) TT=11.794	? (MO) TT=12.81
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-1_ext.xml	SAT TT=3.316	SAT TT=230.553 CHECKS=196173 NODES=63661	SAT TT=247.921 CHECKS=195661 NODES=63576	? (problem) TT=115.042	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.12	SAT TT=146.131 CHECKS=324158000 NODES=434447	SAT TT=92.901 CHECKS=350267000 NODES=1480150	SAT TT=1138.02 CHECKS=2502400000 NODES=5001700	SAT TT=29.303 ASSIGNMENTS=73833 CHECKS=3623290	SAT TT=246.826 ASSIGNMENTS=63661 CHECKS=196173	? (TO) TT=1800	? (TO) TT=1800.04	SAT TT=37.657 CHECKS=3385550	SAT TT=19.048 ASSIGNMENTS=74582 CHECKS=3649620	SAT TT=11.179 ASSIGNMENTS=38980 CHECKS=1842210	SAT TT=154.409	SAT TT=3.316 ASSIGNMENTS=1924 CHECKS=95164	SAT TT=18.69 ASSIGNMENTS=73833 CHECKS=3623290	? TT=79.186	SAT TT=110.977 ASSIGNMENTS=43053 CHECKS=14885800	? (MO) TT=12.71	? (MO) TT=12.777
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-2_ext.xml	SAT TT=6.574	SAT TT=28.141 CHECKS=11529 NODES=3898	SAT TT=23.24 CHECKS=11473 NODES=3942	? (problem) TT=112.546	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=1502.07 ASSIGNMENTS=14551	? (TO) TT=1800.2	SAT TT=41.297 CHECKS=70752900 NODES=94783	SAT TT=41.223 CHECKS=110759000 NODES=474708	? (TO) TT=1800.03	SAT TT=20.72 ASSIGNMENTS=30994 CHECKS=1540440	SAT TT=35.495 ASSIGNMENTS=3898 CHECKS=11529	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=6.574 CHECKS=158891	SAT TT=10.316 ASSIGNMENTS=31196 CHECKS=1545070	SAT TT=9.173 ASSIGNMENTS=27978 CHECKS=1313110	SAT TT=96.447	SAT TT=7.876 ASSIGNMENTS=20426 CHECKS=1005180	SAT TT=10.261 ASSIGNMENTS=30994 CHECKS=1540440	? TT=100.393	SAT TT=22.467 ASSIGNMENTS=5513 CHECKS=2460270	? (MO) TT=12.75	? (MO) TT=13.76
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-3_ext.xml	SAT TT=12.97	SAT TT=143.99 CHECKS=502155 NODES=92389	SAT TT=148.571 CHECKS=484287 NODES=91195	? (problem) TT=123.09	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.13	SAT TT=71.149 CHECKS=145087000 NODES=200298	SAT TT=147.262 CHECKS=552697000 NODES=2354870	? (TO) TT=1800.04	SAT TT=27.753 ASSIGNMENTS=64016 CHECKS=3043790	SAT TT=153.346 ASSIGNMENTS=92389 CHECKS=502155	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=19.762 CHECKS=1267880	SAT TT=15.378 ASSIGNMENTS=64108 CHECKS=3045130	SAT TT=17.215 ASSIGNMENTS=69253 CHECKS=3194410	SAT TT=110.908	SAT TT=12.97 ASSIGNMENTS=50533 CHECKS=2433820	SAT TT=16.546 ASSIGNMENTS=64016 CHECKS=3043790	? TT=89.095	SAT TT=26.127 ASSIGNMENTS=5523 CHECKS=2416860	? (MO) TT=12.787	? (MO) TT=13.873
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-4_ext.xml	SAT TT=5.604	SAT TT=87.089 CHECKS=1252240 NODES=225823	SAT TT=85.707 CHECKS=1265050 NODES=225935	? (problem) TT=119.879	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=927.969 ASSIGNMENTS=7283	? (TO) TT=1800.17	SAT TT=68.625 CHECKS=124007000 NODES=201754	SAT TT=63.609 CHECKS=193629000 NODES=833849	? (TO) TT=1800.07	SAT TT=16.034 ASSIGNMENTS=15491 CHECKS=711874	SAT TT=88.32 ASSIGNMENTS=225823 CHECKS=1252240	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=20.29 CHECKS=2803380	SAT TT=5.604 ASSIGNMENTS=15407 CHECKS=710287	SAT TT=6.063 ASSIGNMENTS=20500 CHECKS=875391	SAT TT=62.85	SAT TT=8.643 ASSIGNMENTS=32576 CHECKS=1504750	SAT TT=5.77 ASSIGNMENTS=15491 CHECKS=711874	? TT=81.819	SAT TT=196.058 ASSIGNMENTS=149966 CHECKS=39098800	? (MO) TT=13.66	? (MO) TT=12.79
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-5_ext.xml	SAT TT=11.298	SAT TT=37.461 CHECKS=183071 NODES=40698	SAT TT=40.749 CHECKS=245501 NODES=53242	? (problem) TT=122.366	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.17	SAT TT=205.497 CHECKS=448398000 NODES=680792	SAT TT=326.022 CHECKS=1350070000 NODES=5624540	SAT TT=1694.16 CHECKS=3876760000 NODES=8097100	SAT TT=22.394 ASSIGNMENTS=51520 CHECKS=2307780	SAT TT=45.475 ASSIGNMENTS=40698 CHECKS=183071	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=12.972 CHECKS=1059420	SAT TT=11.298 ASSIGNMENTS=52077 CHECKS=2348660	SAT TT=12.185 ASSIGNMENTS=57737 CHECKS=2535210	SAT TT=100.967	SAT TT=33.116 ASSIGNMENTS=178323 CHECKS=7842940	SAT TT=11.779 ASSIGNMENTS=51520 CHECKS=2307780	? TT=81.948	SAT TT=230.125 ASSIGNMENTS=77967 CHECKS=24695200	? (MO) TT=12.809	? (MO) TT=12.653
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-6_ext.xml	SAT TT=5.206	SAT TT=172.82 CHECKS=256472 NODES=60001	SAT TT=144.273 CHECKS=242310 NODES=61410	? (problem) TT=122.392	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.13	SAT TT=56.497 CHECKS=101255000 NODES=135630	SAT TT=111.337 CHECKS=431250000 NODES=1882880	SAT TT=1005.2 CHECKS=2076880000 NODES=4913730	SAT TT=24.548 ASSIGNMENTS=49602 CHECKS=2508420	SAT TT=182.17 ASSIGNMENTS=60001 CHECKS=256472	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=5.206 CHECKS=5336	SAT TT=12.925 ASSIGNMENTS=49233 CHECKS=2481750	SAT TT=12.819 ASSIGNMENTS=43585 CHECKS=2164070	SAT TT=138.349	SAT TT=12.434 ASSIGNMENTS=40037 CHECKS=2077240	SAT TT=12.961 ASSIGNMENTS=49602 CHECKS=2508420	? TT=78.673	SAT TT=83.508 ASSIGNMENTS=32734 CHECKS=14180300	? (MO) TT=12.818	? (MO) TT=12.58
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-7_ext.xml	SAT TT=3.51	SAT TT=56.042 CHECKS=122359 NODES=37700	SAT TT=120.582 CHECKS=138349 NODES=40144	? (problem) TT=121.934	SAT TT=1218.38 CHECKS=268210	SAT TT=1025.76 CHECKS=206142	SAT TT=679.513 ASSIGNMENTS=4812	? (TO) TT=1800.14	SAT TT=16.918 CHECKS=5973940 NODES=8241	SAT TT=22.096 CHECKS=31561200 NODES=138449	? (TO) TT=1800.08	SAT TT=4.443 ASSIGNMENTS=6050 CHECKS=285357	SAT TT=4.056 ASSIGNMENTS=6050 CHECKS=285357	? (TO) TT=1800.06	SAT TT=1039.06	SAT TT=5.842 CHECKS=81470	SAT TT=3.966 ASSIGNMENTS=5925 CHECKS=272414	SAT TT=4.061 ASSIGNMENTS=5943 CHECKS=209583	SAT TT=50.928	SAT TT=3.51 ASSIGNMENTS=2838 CHECKS=129629	SAT TT=4.428 ASSIGNMENTS=6050 CHECKS=285357	? TT=110.985	SAT TT=28.342 ASSIGNMENTS=12166 CHECKS=2785460	? (MO) TT=13.874	? (MO) TT=12.67
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-8_ext.xml	SAT TT=11.096	SAT TT=250.023 CHECKS=290272 NODES=57650	SAT TT=395.242 CHECKS=417594 NODES=86349	? (problem) TT=120.33	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.21	SAT TT=153.228 CHECKS=339131000 NODES=444915	SAT TT=32.033 CHECKS=80371800 NODES=335665	? (TO) TT=1800.07	SAT TT=44.137 ASSIGNMENTS=165752 CHECKS=7924260	SAT TT=259.488 ASSIGNMENTS=57650 CHECKS=290272	? (TO) TT=1800.01	SAT TT=1496.79	SAT TT=45.187 CHECKS=5752510	SAT TT=36.892 ASSIGNMENTS=166684 CHECKS=7980180	SAT TT=32.281 ASSIGNMENTS=138879 CHECKS=6646260	SAT TT=299.118	SAT TT=11.096 ASSIGNMENTS=38513 CHECKS=1854140	SAT TT=34.081 ASSIGNMENTS=165752 CHECKS=7924260	? TT=111.674	SAT TT=99.361 ASSIGNMENTS=53656 CHECKS=21419700	? (MO) TT=11.79	? (MO) TT=13.67
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-9_ext.xml	SAT TT=13.206	SAT TT=79.359 CHECKS=130471 NODES=33526	SAT TT=77.03 CHECKS=134487 NODES=33804	? (problem) TT=121.737	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.16	SAT TT=53.474 CHECKS=100819000 NODES=133816	SAT TT=45.215 CHECKS=123964000 NODES=516915	SAT TT=1614.83 CHECKS=3735890000 NODES=7775790	SAT TT=25.783 ASSIGNMENTS=53924 CHECKS=2724760	SAT TT=87.43 ASSIGNMENTS=33526 CHECKS=130471	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=25.251 CHECKS=2267320	SAT TT=15.791 ASSIGNMENTS=55162 CHECKS=2813780	SAT TT=13.314 ASSIGNMENTS=47196 CHECKS=2290590	SAT TT=158.508	SAT TT=13.206 ASSIGNMENTS=45695 CHECKS=2299620	SAT TT=15.058 ASSIGNMENTS=53924 CHECKS=2724760	? TT=101.009	SAT TT=33.504 ASSIGNMENTS=8009 CHECKS=2868490	? (MO) TT=12.77	? (MO) TT=11.883
csp/renault/ normalized-renault_ext.xml	SAT TT=0.548	SAT TT=1.578 CHECKS=313 NODES=101	SAT TT=1.806 CHECKS=377 NODES=0	SAT TT=15.428	SAT TT=5.948 CHECKS=11142	SAT TT=4.777 CHECKS=8696	SAT TT=4.408 ASSIGNMENTS=16	SAT TT=4.319 ASSIGNMENTS=36	SAT TT=69.752 CHECKS=39909200 NODES=101	SAT TT=62.978 CHECKS=47007700 NODES=101700000	SAT TT=306.893 CHECKS=735698000 NODES=60086	SAT TT=0.548 ASSIGNMENTS=18 CHECKS=741	SAT TT=0.583 ASSIGNMENTS=18 CHECKS=741	SAT TT=10.791	SAT TT=10.169	SAT TT=1.12 CHECKS=643	SAT TT=0.581 ASSIGNMENTS=18 CHECKS=741	SAT TT=0.607 ASSIGNMENTS=27 CHECKS=1061	SAT TT=5.03	SAT TT=0.582 ASSIGNMENTS=23 CHECKS=653	SAT TT=0.573 ASSIGNMENTS=18 CHECKS=741	? TT=87.525	SAT TT=1.418 ASSIGNMENTS=101 CHECKS=19797	SAT TT=7.865	SAT TT=7.652
csp/renault/ normalized-renault-mgd_ext.xml	SAT TT=0.539	SAT TT=1.547 CHECKS=383 NODES=101	SAT TT=1.622 CHECKS=642 NODES=0	SAT TT=15.491	SAT TT=5.46 CHECKS=11086	SAT TT=5.709 CHECKS=10432	SAT TT=4.364 ASSIGNMENTS=16	SAT TT=3.804 ASSIGNMENTS=36	SAT TT=70.942 CHECKS=39908900 NODES=101	SAT TT=237.327 CHECKS=79510000 NODES=490800000	SAT TT=676.776 CHECKS=1568950000 NODES=153877	SAT TT=0.549 ASSIGNMENTS=18 CHECKS=685	SAT TT=0.581 ASSIGNMENTS=18 CHECKS=685	SAT TT=10.734	SAT TT=9.999	SAT TT=1.095 CHECKS=580	SAT TT=0.571 ASSIGNMENTS=18 CHECKS=685	SAT TT=0.587 ASSIGNMENTS=31 CHECKS=1046	SAT TT=4.735	SAT TT=0.539 ASSIGNMENTS=23 CHECKS=599	SAT TT=0.573 ASSIGNMENTS=18 CHECKS=685	? TT=78.148	SAT TT=1.42 ASSIGNMENTS=101 CHECKS=19875	SAT TT=7.112	SAT TT=8.015
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ssa/ normalized-ssa-0432-003_ext.xml	UNSAT TT=0.069	UNSAT TT=14.831 CHECKS=3962210 NODES=47470	UNSAT TT=13.494 CHECKS=3353500 NODES=45882	UNSAT TT=0.479	UNSAT TT=0.069 CHECKS=39061	UNSAT TT=0.083 CHECKS=86528	UNSAT TT=1.578 ASSIGNMENTS=2464	UNSAT TT=0.99 ASSIGNMENTS=241	UNSAT TT=6.449 CHECKS=1505610 NODES=14940	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=9.762 ASSIGNMENTS=69734 CHECKS=7643670	UNSAT TT=20.704 ASSIGNMENTS=47470 CHECKS=3962210	UNSAT TT=1.06	UNSAT TT=1.212	UNSAT TT=0.201 CHECKS=126359	UNSAT TT=2.561 ASSIGNMENTS=78762 CHECKS=8544620	UNSAT TT=1.608 ASSIGNMENTS=41583 CHECKS=5732890	UNSAT TT=0.63	UNSAT TT=3.023 ASSIGNMENTS=86800 CHECKS=9053980	UNSAT TT=2.174 ASSIGNMENTS=69734 CHECKS=7643670	UNSAT TT=1.636	UNSAT TT=11.052 ASSIGNMENTS=77646 CHECKS=3061590	UNSAT TT=1.173	UNSAT TT=1.313
csp/ssa/ normalized-ssa-2670-130_ext.xml	UNSAT TT=1.389	UNSAT TT=41.019 CHECKS=10649900 NODES=168953	UNSAT TT=34.069 CHECKS=9962120 NODES=158051	? (TO) TT=1800.06	UNSAT TT=15.611 CHECKS=10482600	UNSAT TT=14.447 CHECKS=11802000	UNSAT TT=15.861 ASSIGNMENTS=29626	UNSAT TT=1751.31 ASSIGNMENTS=2457260	UNSAT TT=133.999 CHECKS=15995000 NODES=97475	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=9.405 ASSIGNMENTS=21081 CHECKS=4510680	UNSAT TT=1.524 ASSIGNMENTS=21081 CHECKS=4510680	UNSAT TT=1.924	UNSAT TT=1.919	UNSAT TT=2.609 CHECKS=1875930	UNSAT TT=1.965 ASSIGNMENTS=26389 CHECKS=5465440	UNSAT TT=2.3 ASSIGNMENTS=31397 CHECKS=6696580	UNSAT TT=3.291	UNSAT TT=2.498 ASSIGNMENTS=26130 CHECKS=6655050	UNSAT TT=1.491 ASSIGNMENTS=21081 CHECKS=4510680	UNSAT TT=3.366	UNSAT TT=0.534 ASSIGNMENTS=164 CHECKS=24212	UNSAT TT=1.389	UNSAT TT=1.538
csp/ssa/ normalized-ssa-2670-141_ext.xml	SAT TT=0.013	SAT TT=1.079 CHECKS=855 NODES=391	SAT TT=1.047 CHECKS=853 NODES=0	SAT TT=0.067	SAT TT=0.162 CHECKS=19139	SAT TT=0.17 CHECKS=19366	SAT TT=0.652 ASSIGNMENTS=295	SAT TT=0.683 ASSIGNMENTS=296	SAT TT=0.449 CHECKS=372 NODES=391	SAT TT=0.448 CHECKS=2371 NODES=40	SAT TT=0.479 CHECKS=6649 NODES=46	SAT TT=0.025 ASSIGNMENTS=294 CHECKS=483	SAT TT=0.026 ASSIGNMENTS=294 CHECKS=483	SAT TT=1.468	SAT TT=1.351	SAT TT=0.035 CHECKS=407	SAT TT=0.013 ASSIGNMENTS=294 CHECKS=483	SAT TT=0.012 ASSIGNMENTS=291 CHECKS=483	SAT TT=0.485	SAT TT=0.015 ASSIGNMENTS=296 CHECKS=483	SAT TT=0.014 ASSIGNMENTS=294 CHECKS=483	SAT TT=0.976	SAT TT=0.03 ASSIGNMENTS=392 CHECKS=1036	SAT TT=0.888	SAT TT=0.877
csp/ssa/ normalized-ssa-6288-047_ext.xml	SAT TT=0.855	SAT TT=23.677 CHECKS=117930 NODES=14349	SAT TT=64.259 CHECKS=227589 NODES=14367	SAT TT=393	SAT TT=23.197 CHECKS=1018450	SAT TT=26.633 CHECKS=992168	SAT TT=9.293 ASSIGNMENTS=2859	SAT TT=67.677 ASSIGNMENTS=714	SAT TT=221.012 CHECKS=155056 NODES=14463	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=0.954 ASSIGNMENTS=1838 CHECKS=116086	SAT TT=0.97 ASSIGNMENTS=1838 CHECKS=116086	SAT TT=166.181	SAT TT=172.92	SAT TT=2.296 CHECKS=66575	SAT TT=0.855 ASSIGNMENTS=1837 CHECKS=118799	SAT TT=1.997 ASSIGNMENTS=34558 CHECKS=2065300	SAT TT=7.143	SAT TT=3.293 ASSIGNMENTS=6279 CHECKS=357497	SAT TT=0.914 ASSIGNMENTS=1838 CHECKS=116086	SAT TT=7.135	? (MO) TT=5.217	SAT TT=4.665	SAT TT=4.744
csp/ssa/ normalized-ssa-7552-038_ext.xml	SAT TT=0.077	SAT TT=1.929 CHECKS=32181 NODES=2043	SAT TT=2.052 CHECKS=20699 NODES=0	SAT TT=3.85	SAT TT=1.767 CHECKS=1819150	SAT TT=1.284 CHECKS=1807530	SAT TT=1.803 ASSIGNMENTS=158	SAT TT=2.596 ASSIGNMENTS=242	SAT TT=1.886 CHECKS=15271 NODES=1590	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=0.099 ASSIGNMENTS=159 CHECKS=11687	SAT TT=0.098 ASSIGNMENTS=159 CHECKS=11687	SAT TT=3.659	SAT TT=4.006	SAT TT=0.189 CHECKS=23352	SAT TT=0.077 ASSIGNMENTS=177 CHECKS=16608	SAT TT=0.081 ASSIGNMENTS=269 CHECKS=35949	SAT TT=1.361	SAT TT=0.093 ASSIGNMENTS=202 CHECKS=11621	SAT TT=0.092 ASSIGNMENTS=159 CHECKS=11687	SAT TT=3.556	SAT TT=0.594 ASSIGNMENTS=1539 CHECKS=25249	SAT TT=1.761	SAT TT=1.487
csp/ssa/ normalized-ssa-7552-158_ext.xml	SAT TT=0.063	SAT TT=2.878 CHECKS=7005 NODES=1364	SAT TT=1.573 CHECKS=7085 NODES=0	SAT TT=0.329	SAT TT=1.35 CHECKS=1420320	SAT TT=0.943 CHECKS=1423000	SAT TT=1.604 ASSIGNMENTS=123	SAT TT=1.909 ASSIGNMENTS=101	SAT TT=1.246 CHECKS=5417 NODES=1363	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=0.079 ASSIGNMENTS=113 CHECKS=5669	SAT TT=0.079 ASSIGNMENTS=113 CHECKS=5669	SAT TT=2.981	SAT TT=3.061	SAT TT=0.124 CHECKS=4437	SAT TT=0.063 ASSIGNMENTS=113 CHECKS=5673	SAT TT=0.069 ASSIGNMENTS=569 CHECKS=25359	SAT TT=1.164	SAT TT=0.081 ASSIGNMENTS=337 CHECKS=17359	SAT TT=0.065 ASSIGNMENTS=113 CHECKS=5669	SAT TT=2.965	Wrong UNSAT TT=0.425 ASSIGNMENTS=86 CHECKS=10359	SAT TT=1.351	SAT TT=1.369
csp/ssa/ normalized-ssa-7552-159_ext.xml	SAT TT=0.062	SAT TT=2.821 CHECKS=7115 NODES=1366	SAT TT=1.832 CHECKS=11019 NODES=0	SAT TT=0.338	SAT TT=1.22 CHECKS=1219660	SAT TT=0.93 CHECKS=1196450	SAT TT=1.52 ASSIGNMENTS=133	SAT TT=1.987 ASSIGNMENTS=112	SAT TT=1.276 CHECKS=7102 NODES=1369	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=0.082 ASSIGNMENTS=125 CHECKS=6217	SAT TT=0.082 ASSIGNMENTS=125 CHECKS=6217	SAT TT=3.258	SAT TT=3.318	SAT TT=0.125 CHECKS=4429	SAT TT=0.062 ASSIGNMENTS=129 CHECKS=6595	SAT TT=0.063 ASSIGNMENTS=113 CHECKS=4674	SAT TT=1.348	SAT TT=0.084 ASSIGNMENTS=418 CHECKS=19041	SAT TT=0.068 ASSIGNMENTS=125 CHECKS=6217	SAT TT=2.972	SAT TT=0.482 ASSIGNMENTS=1472 CHECKS=28528	SAT TT=1.664	SAT TT=1.681
csp/ssa/ normalized-ssa-7552-160_ext.xml	SAT TT=0.034	SAT TT=2.288 CHECKS=3156 NODES=1303	SAT TT=1.777 CHECKS=2699 NODES=0	SAT TT=0.154	SAT TT=0.557 CHECKS=16428	SAT TT=0.582 CHECKS=16987	SAT TT=0.824 ASSIGNMENTS=475	SAT TT=1.105 ASSIGNMENTS=539	SAT TT=0.793 CHECKS=1910 NODES=757	SAT TT=0.696 CHECKS=10634 NODES=63	SAT TT=0.764 CHECKS=42674 NODES=53	SAT TT=0.046 ASSIGNMENTS=472 CHECKS=2173	SAT TT=0.044 ASSIGNMENTS=472 CHECKS=2173	SAT TT=2.08	SAT TT=2.146	SAT TT=0.079 CHECKS=1976	SAT TT=0.034 ASSIGNMENTS=472 CHECKS=2173	SAT TT=0.031 ASSIGNMENTS=531 CHECKS=2173	SAT TT=0.683	SAT TT=0.039 ASSIGNMENTS=492 CHECKS=2173	SAT TT=0.037 ASSIGNMENTS=472 CHECKS=2173	SAT TT=1.822	SAT TT=0.15 ASSIGNMENTS=757 CHECKS=4681	SAT TT=1.158	SAT TT=1.148
csp/travellingSalesman-20/ normalized-tsp-20-142_ext.xml	SAT TT=10.242	SAT TT=10.242 CHECKS=9218830 NODES=15329	SAT TT=20.578 CHECKS=21333800 NODES=34447	SAT TT=53.443	? (TO) TT=1800.02	SAT TT=675.219 CHECKS=5830190	SAT TT=75.984 ASSIGNMENTS=6158	SAT TT=21.665 ASSIGNMENTS=99	SAT TT=94.388 CHECKS=416661000 NODES=9376	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=25.065 ASSIGNMENTS=13319 CHECKS=7040200	SAT TT=16.777 ASSIGNMENTS=15329 CHECKS=9218830	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=32.703 CHECKS=6168390	SAT TT=23.967 ASSIGNMENTS=19287 CHECKS=10293700	SAT TT=8.719 ASSIGNMENTS=7688 CHECKS=3634910	? (problem) TT=3.36	SAT TT=77.149 ASSIGNMENTS=53190 CHECKS=28084900	SAT TT=17.69 ASSIGNMENTS=13319 CHECKS=7040200	? TT=324.053	SAT TT=975.861 ASSIGNMENTS=9951 CHECKS=897751000	SAT TT=185.403	SAT TT=489.51
csp/travellingSalesman-20/ normalized-tsp-20-190_ext.xml	SAT TT=1.151	SAT TT=3.439 CHECKS=2188490 NODES=5756	SAT TT=4.076 CHECKS=2730900 NODES=6575	SAT TT=9.297	SAT TT=60.96 CHECKS=1787300	SAT TT=73.666 CHECKS=1937770	SAT TT=11.547 ASSIGNMENTS=1959	SAT TT=9.963 ASSIGNMENTS=1679	SAT TT=59.944 CHECKS=9677140 NODES=305	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=1.236 ASSIGNMENTS=2099 CHECKS=739623	SAT TT=1.151 ASSIGNMENTS=2099 CHECKS=739623	SAT TT=664.347	SAT TT=887.381	SAT TT=3.369 CHECKS=801590	SAT TT=1.424 ASSIGNMENTS=2362 CHECKS=865825	SAT TT=4.023 ASSIGNMENTS=7277 CHECKS=2487280	? (problem) TT=2.491	SAT TT=8.117 ASSIGNMENTS=14641 CHECKS=5384060	SAT TT=1.216 ASSIGNMENTS=2099 CHECKS=739623	? TT=709.602	SAT TT=363.049 ASSIGNMENTS=10233 CHECKS=444469000	SAT TT=73.262	SAT TT=91.892
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/travellingSalesman-20/ normalized-tsp-20-193_ext.xml	SAT TT=2.552	SAT TT=54.53 CHECKS=62746000 NODES=67406	SAT TT=2.552 CHECKS=1511900 NODES=1281	SAT TT=540.98	SAT TT=1712.83 CHECKS=27330400	? (TO) TT=1800.05	SAT TT=33.015 ASSIGNMENTS=71	SAT TT=46.048 ASSIGNMENTS=978	SAT TT=126.635 CHECKS=855654000 NODES=10435	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=60.142 ASSIGNMENTS=67406 CHECKS=62746000	SAT TT=60.494 ASSIGNMENTS=67406 CHECKS=62746000	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=7.362 CHECKS=1140660	SAT TT=4.821 ASSIGNMENTS=2295 CHECKS=1368850	SAT TT=14.805 ASSIGNMENTS=8925 CHECKS=4463300	? (exit code) TT=4.655	SAT TT=140.605 ASSIGNMENTS=68223 CHECKS=33556500	SAT TT=46.212 ASSIGNMENTS=22866 CHECKS=12811200	? TT=389.161	? (TO) TT=1800.1	SAT TT=194.551	SAT TT=205.286
csp/travellingSalesman-20/ normalized-tsp-20-1_ext.xml	SAT TT=0.181	SAT TT=1.236 CHECKS=150571 NODES=313	SAT TT=1.698 CHECKS=728854 NODES=300	SAT TT=1.819	SAT TT=51.398 CHECKS=1149590	SAT TT=9.095 CHECKS=54257	SAT TT=4.438 ASSIGNMENTS=24	SAT TT=4.799 ASSIGNMENTS=77	SAT TT=61.6 CHECKS=9497300 NODES=209	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=0.225 ASSIGNMENTS=193 CHECKS=101838	SAT TT=0.226 ASSIGNMENTS=193 CHECKS=101838	SAT TT=497.808	SAT TT=391.411	SAT TT=0.498 CHECKS=65472	SAT TT=0.181 ASSIGNMENTS=163 CHECKS=81350	SAT TT=1.14 ASSIGNMENTS=1617 CHECKS=584545	? (problem) TT=2.523	SAT TT=1.65 ASSIGNMENTS=1666 CHECKS=798510	SAT TT=0.213 ASSIGNMENTS=193 CHECKS=101838	? TT=429.417	SAT TT=335.035 ASSIGNMENTS=310 CHECKS=467160000	SAT TT=51.467	SAT TT=75.115
csp/travellingSalesman-20/ normalized-tsp-20-29_ext.xml	SAT TT=0.061	SAT TT=1.07 CHECKS=55615 NODES=114	SAT TT=1.571 CHECKS=415924 NODES=82	SAT TT=1.018	SAT TT=21.622 CHECKS=697377	SAT TT=4.491 CHECKS=37365	SAT TT=3.057 ASSIGNMENTS=8	SAT TT=3.24 ASSIGNMENTS=14	SAT TT=61.109 CHECKS=7274290 NODES=106	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=0.078 ASSIGNMENTS=35 CHECKS=22156	SAT TT=0.077 ASSIGNMENTS=35 CHECKS=22156	SAT TT=308.944	SAT TT=400.892	SAT TT=0.26 CHECKS=28746	SAT TT=0.061 ASSIGNMENTS=36 CHECKS=22435	SAT TT=0.403 ASSIGNMENTS=716 CHECKS=274860	? (problem) TT=1.851	SAT TT=1.482 ASSIGNMENTS=2706 CHECKS=1013960	SAT TT=0.066 ASSIGNMENTS=35 CHECKS=22156	? TT=926.379	SAT TT=136.002 ASSIGNMENTS=227 CHECKS=277677000	SAT TT=30.113	SAT TT=51.681
csp/travellingSalesman-20/ normalized-tsp-20-2_ext.xml	SAT TT=0.498	SAT TT=2.875 CHECKS=1411860 NODES=2851	SAT TT=4.368 CHECKS=3093010 NODES=6051	SAT TT=6.885	SAT TT=244.535 CHECKS=6732120	SAT TT=53.079 CHECKS=603545	SAT TT=10.327 ASSIGNMENTS=41	SAT TT=32.294 ASSIGNMENTS=5829	SAT TT=68.168 CHECKS=81058300 NODES=3196	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=0.512 ASSIGNMENTS=412 CHECKS=202419	SAT TT=0.508 ASSIGNMENTS=412 CHECKS=202419	SAT TT=1579.05	SAT TT=971.699	SAT TT=8.669 CHECKS=1915480	SAT TT=2.898 ASSIGNMENTS=2591 CHECKS=1192980	SAT TT=3.556 ASSIGNMENTS=4241 CHECKS=1467260	? (problem) TT=3.457	SAT TT=19.667 ASSIGNMENTS=18942 CHECKS=8008830	SAT TT=0.498 ASSIGNMENTS=412 CHECKS=202419	? TT=318.289	SAT TT=747.122 ASSIGNMENTS=3799 CHECKS=600519000	SAT TT=79.588	SAT TT=186.015
csp/travellingSalesman-20/ normalized-tsp-20-30_ext.xml	SAT TT=0.084	SAT TT=1.02 CHECKS=87176 NODES=128	SAT TT=1.382 CHECKS=579593 NODES=106	SAT TT=1.557	SAT TT=52.268 CHECKS=899367	SAT TT=8.865 CHECKS=40889	SAT TT=7.596 ASSIGNMENTS=155	SAT TT=7.515 ASSIGNMENTS=65	SAT TT=61.734 CHECKS=7791010 NODES=90	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=0.14 ASSIGNMENTS=90 CHECKS=47102	SAT TT=0.136 ASSIGNMENTS=90 CHECKS=47102	SAT TT=527.82	SAT TT=606.612	SAT TT=0.31 CHECKS=26705	SAT TT=0.084 ASSIGNMENTS=48 CHECKS=27579	SAT TT=2.179 ASSIGNMENTS=3453 CHECKS=1222830	? (problem) TT=2.248	SAT TT=10.869 ASSIGNMENTS=13649 CHECKS=5999530	SAT TT=0.124 ASSIGNMENTS=90 CHECKS=47102	? (exit code) TT=689.05	SAT TT=165.595 ASSIGNMENTS=237 CHECKS=342440000	SAT TT=43.26	SAT TT=67.13
csp/travellingSalesman-20/ normalized-tsp-20-366_ext.xml	SAT TT=0.847	SAT TT=14.939 CHECKS=12285300 NODES=26549	SAT TT=11.497 CHECKS=8946030 NODES=19124	SAT TT=49.665	SAT TT=303.318 CHECKS=8828180	SAT TT=104.221 CHECKS=1367690	SAT TT=14.989 ASSIGNMENTS=75	SAT TT=21.281 ASSIGNMENTS=1455	SAT TT=65.125 CHECKS=47412300 NODES=1804	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=0.847 ASSIGNMENTS=777 CHECKS=353892	SAT TT=0.849 ASSIGNMENTS=777 CHECKS=353892	SAT TT=1618.04	? (TO) TT=1800.05	SAT TT=9.699 CHECKS=2002110	SAT TT=1.03 ASSIGNMENTS=928 CHECKS=433979	SAT TT=0.464 ASSIGNMENTS=553 CHECKS=179499	? (problem) TT=3.335	SAT TT=9.532 ASSIGNMENTS=6967 CHECKS=3323480	SAT TT=0.849 ASSIGNMENTS=777 CHECKS=353892	? TT=384.203	SAT TT=508.933 ASSIGNMENTS=1495 CHECKS=25274100	SAT TT=87.488	SAT TT=125.738
csp/travellingSalesman-20/ normalized-tsp-20-453_ext.xml	SAT TT=4.835	SAT TT=23.8 CHECKS=22762500 NODES=43000	SAT TT=12.865 CHECKS=11750700 NODES=23906	SAT TT=4.835	SAT TT=1769.17 CHECKS=57999700	SAT TT=222.626 CHECKS=2756500	SAT TT=24.083 ASSIGNMENTS=925	SAT TT=20.584 ASSIGNMENTS=77	SAT TT=125.594 CHECKS=763309000 NODES=28370	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=42.632 ASSIGNMENTS=30270 CHECKS=14294500	SAT TT=31.129 ASSIGNMENTS=43000 CHECKS=22762500	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=101.894 CHECKS=20811900	SAT TT=12.007 ASSIGNMENTS=11596 CHECKS=5647870	SAT TT=28.356 ASSIGNMENTS=26938 CHECKS=12274800	? (problem) TT=3.347	SAT TT=52.416 ASSIGNMENTS=37820 CHECKS=18129100	SAT TT=35.201 ASSIGNMENTS=30270 CHECKS=14294500	? TT=539.362	SAT TT=1562.8 ASSIGNMENTS=24862 CHECKS=822640000	SAT TT=107.608	SAT TT=403.189
csp/travellingSalesman-20/ normalized-tsp-20-68_ext.xml	SAT TT=0.037	SAT TT=0.915 CHECKS=27423 NODES=63	SAT TT=1.022 CHECKS=25468 NODES=0	SAT TT=0.465	SAT TT=0.953 CHECKS=43123	SAT TT=0.644 CHECKS=9589	SAT TT=0.726 ASSIGNMENTS=2	SAT TT=0.831 ASSIGNMENTS=2	SAT TT=60.859 CHECKS=3907940 NODES=67	SAT TT=35.719 CHECKS=29836800 NODES=76501000	? (TO) TT=1800.07	SAT TT=0.045 ASSIGNMENTS=8 CHECKS=5214	SAT TT=0.049 ASSIGNMENTS=8 CHECKS=5214	SAT TT=222.764	SAT TT=221.204	SAT TT=0.159 CHECKS=7000	SAT TT=0.037 ASSIGNMENTS=8 CHECKS=5214	SAT TT=0.036 ASSIGNMENTS=14 CHECKS=5487	? (problem) TT=1.533	SAT TT=0.041 ASSIGNMENTS=18 CHECKS=10103	SAT TT=0.038 ASSIGNMENTS=8 CHECKS=5214	SAT TT=848.183	SAT TT=31.856 ASSIGNMENTS=76 CHECKS=120644000	SAT TT=16.538	SAT TT=20.333
csp/travellingSalesman-20/ normalized-tsp-20-727_ext.xml	SAT TT=0.534	SAT TT=1.569 CHECKS=455443 NODES=842	SAT TT=1.674 CHECKS=502572 NODES=844	SAT TT=5.058	SAT TT=49.545 CHECKS=543202	SAT TT=70.492 CHECKS=564513	SAT TT=14.12 ASSIGNMENTS=260	SAT TT=31.844 ASSIGNMENTS=4049	SAT TT=69.235 CHECKS=93199500 NODES=2674	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=1.116 ASSIGNMENTS=831 CHECKS=387852	SAT TT=1.128 ASSIGNMENTS=831 CHECKS=387852	? (TO) TT=1800.03	SAT TT=600.775	SAT TT=2.555 CHECKS=438262	SAT TT=0.534 ASSIGNMENTS=368 CHECKS=189577	SAT TT=4.221 ASSIGNMENTS=4028 CHECKS=1499020	? (exit code) TT=5.079	SAT TT=28.301 ASSIGNMENTS=21220 CHECKS=9339350	SAT TT=1.106 ASSIGNMENTS=831 CHECKS=387852	? TT=358.587	SAT TT=1034.99 ASSIGNMENTS=7769 CHECKS=854726000	SAT TT=152.243	SAT TT=299.586
csp/travellingSalesman-20/ normalized-tsp-20-75_ext.xml	SAT TT=2.21	SAT TT=3.759 CHECKS=2698900 NODES=3331	SAT TT=4.407 CHECKS=3738990 NODES=4646	SAT TT=73.535	SAT TT=601.043 CHECKS=14335900	SAT TT=719.874 CHECKS=6059460	SAT TT=21.146 ASSIGNMENTS=691	SAT TT=87.787 ASSIGNMENTS=12780	SAT TT=106.194 CHECKS=595741000 NODES=9695	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=9.507 ASSIGNMENTS=1817 CHECKS=952951	SAT TT=10.817 ASSIGNMENTS=3331 CHECKS=2698900	SAT TT=1421.2	? (TO) TT=1800	SAT TT=2.306 CHECKS=386199	SAT TT=3.225 ASSIGNMENTS=2465 CHECKS=1300540	SAT TT=6.744 ASSIGNMENTS=6131 CHECKS=2685810	? (problem) TT=3.385	SAT TT=57.926 ASSIGNMENTS=42050 CHECKS=20724000	SAT TT=2.21 ASSIGNMENTS=1817 CHECKS=952951	? TT=375.49	SAT TT=913.522 ASSIGNMENTS=2278 CHECKS=742750000	SAT TT=226.043	SAT TT=258.672
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/travellingSalesman-20/ normalized-tsp-20-76_ext.xml	SAT TT=1.483	SAT TT=2.685 CHECKS=1311540 NODES=3635	SAT TT=2.225 CHECKS=988345 NODES=1822	SAT TT=3.659	SAT TT=96.672 CHECKS=2429350	SAT TT=76.205 CHECKS=1074660	SAT TT=16.031 ASSIGNMENTS=1399	SAT TT=18.445 ASSIGNMENTS=1622	SAT TT=69.064 CHECKS=80899200 NODES=4671	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=10.923 ASSIGNMENTS=3539 CHECKS=1619760	SAT TT=10.034 ASSIGNMENTS=3635 CHECKS=1311540	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=17.342 CHECKS=3696110	SAT TT=1.483 ASSIGNMENTS=1551 CHECKS=646622	SAT TT=4.069 ASSIGNMENTS=4828 CHECKS=1736260	? (problem) TT=3.435	SAT TT=18.76 ASSIGNMENTS=17805 CHECKS=8010070	SAT TT=3.617 ASSIGNMENTS=3539 CHECKS=1619760	? (TO) TT=1802.16	SAT TT=839.087 ASSIGNMENTS=5073 CHECKS=513133000	SAT TT=97.944	SAT TT=453.966
csp/travellingSalesman-20/ normalized-tsp-20-8_ext.xml	SAT TT=0.062	SAT TT=1.267 CHECKS=137754 NODES=286	SAT TT=1.117 CHECKS=273165 NODES=0	SAT TT=0.792	SAT TT=40.93 CHECKS=1095950	SAT TT=8.458 CHECKS=126197	SAT TT=4.603 ASSIGNMENTS=16	SAT TT=4.909 ASSIGNMENTS=40	SAT TT=61.489 CHECKS=6093430 NODES=78	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.08 ASSIGNMENTS=42 CHECKS=25297	SAT TT=0.076 ASSIGNMENTS=42 CHECKS=25297	SAT TT=319.669	SAT TT=350.046	SAT TT=0.315 CHECKS=34882	SAT TT=0.062 ASSIGNMENTS=40 CHECKS=24174	SAT TT=0.604 ASSIGNMENTS=1201 CHECKS=414812	? (problem) TT=1.953	SAT TT=2.04 ASSIGNMENTS=2881 CHECKS=1225080	SAT TT=0.067 ASSIGNMENTS=42 CHECKS=25297	? (TO) TT=1800.18	SAT TT=129.223 ASSIGNMENTS=183 CHECKS=292563000	SAT TT=30.283	SAT TT=60.079
csp/travellingSalesman-20/ normalized-tsp-20-901_ext.xml	SAT TT=4.18	SAT TT=7.178 CHECKS=5921700 NODES=9633	SAT TT=7.123 CHECKS=5920580 NODES=8752	SAT TT=16.594	SAT TT=567.789 CHECKS=15155300	SAT TT=50.539 CHECKS=432921	SAT TT=21.538 ASSIGNMENTS=691	SAT TT=44.929 ASSIGNMENTS=2222	SAT TT=81.998 CHECKS=257332000 NODES=7478	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=12.038 ASSIGNMENTS=3548 CHECKS=1892880	SAT TT=14.475 ASSIGNMENTS=9633 CHECKS=5921700	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=16.911 CHECKS=2928260	SAT TT=5.582 ASSIGNMENTS=4510 CHECKS=2307920	SAT TT=9.234 ASSIGNMENTS=8237 CHECKS=3818210	? (problem) TT=3.85	SAT TT=40.4 ASSIGNMENTS=27731 CHECKS=13489700	SAT TT=4.18 ASSIGNMENTS=3548 CHECKS=1892880	? TT=386.497	SAT TT=1755.52 ASSIGNMENTS=23498 CHECKS=1111920000	SAT TT=162.054	SAT TT=170.213
csp/travellingSalesman-25/ normalized-tsp-25-13_ext.xml	SAT TT=0.601	SAT TT=2.191 CHECKS=1079220 NODES=1423	SAT TT=2.539 CHECKS=1798740 NODES=1559	SAT TT=5.87	SAT TT=53.293 CHECKS=2379720	SAT TT=22.963 CHECKS=556130	SAT TT=9.261 ASSIGNMENTS=457	SAT TT=7.441 ASSIGNMENTS=88	SAT TT=63.501 CHECKS=30946800 NODES=996	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=0.64 ASSIGNMENTS=586 CHECKS=507534	SAT TT=0.649 ASSIGNMENTS=586 CHECKS=507534	SAT TT=525.698	SAT TT=982.817	SAT TT=3.929 CHECKS=1044070	SAT TT=0.601 ASSIGNMENTS=537 CHECKS=498017	SAT TT=1.718 ASSIGNMENTS=2726 CHECKS=1477440	? (problem) TT=2.535	SAT TT=12.748 ASSIGNMENTS=17546 CHECKS=10955700	SAT TT=0.637 ASSIGNMENTS=586 CHECKS=507534	? TT=277.68	SAT TT=515.728 ASSIGNMENTS=2167 CHECKS=427624000	SAT TT=101.243	SAT TT=204.16
csp/travellingSalesman-25/ normalized-tsp-25-163_ext.xml	SAT TT=30.541	SAT TT=233.006 CHECKS=253863000 NODES=278834	SAT TT=225.334 CHECKS=245694000 NODES=276748	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=199.114 ASSIGNMENTS=15783	SAT TT=1219.7 ASSIGNMENTS=127815	SAT TT=69.97 CHECKS=101620000 NODES=1822	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=232.574 ASSIGNMENTS=278834 CHECKS=253863000	SAT TT=227.297 ASSIGNMENTS=278834 CHECKS=253863000	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=30.541 CHECKS=6163350	SAT TT=102.723 ASSIGNMENTS=54066 CHECKS=37747700	SAT TT=117.664 ASSIGNMENTS=69322 CHECKS=47735500	? (exit code) TT=6.382	SAT TT=238.5 ASSIGNMENTS=130859 CHECKS=93535300	SAT TT=71.373 ASSIGNMENTS=39660 CHECKS=28357600	? (TO) TT=1802.19	? (TO) TT=1800.06	SAT TT=974.008	SAT TT=674.203
csp/travellingSalesman-25/ normalized-tsp-25-190_ext.xml	SAT TT=8.242	SAT TT=84.627 CHECKS=92426700 NODES=133713	SAT TT=78.199 CHECKS=91213500 NODES=130982	SAT TT=305.656	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=220.4 ASSIGNMENTS=34096	SAT TT=31.949 ASSIGNMENTS=1055	SAT TT=97.439 CHECKS=379382000 NODES=14056	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=15.967 ASSIGNMENTS=7136 CHECKS=4386280	SAT TT=85.524 ASSIGNMENTS=133713 CHECKS=92426700	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=251.611 CHECKS=51777300	SAT TT=48.065 ASSIGNMENTS=40657 CHECKS=25303500	SAT TT=53.75 ASSIGNMENTS=51168 CHECKS=32026800	? (problem) TT=3.697	SAT TT=124.375 ASSIGNMENTS=103237 CHECKS=65835200	SAT TT=8.242 ASSIGNMENTS=7136 CHECKS=4386280	? TT=300.691	? (TO) TT=1800.07	SAT TT=1152.68	SAT TT=1001.65
csp/travellingSalesman-25/ normalized-tsp-25-312_ext.xml	SAT TT=28.665	SAT TT=34.638 CHECKS=33646900 NODES=46902	SAT TT=28.665 CHECKS=27625300 NODES=41092	SAT TT=113.687	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=343.335 ASSIGNMENTS=48477	SAT TT=65.812 ASSIGNMENTS=3518	SAT TT=110.582 CHECKS=512206000 NODES=17119	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=40.883 ASSIGNMENTS=28169 CHECKS=18077500	SAT TT=38.304 ASSIGNMENTS=46902 CHECKS=33646900	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=84.161 CHECKS=18173900	SAT TT=77.782 ASSIGNMENTS=59683 CHECKS=39108800	SAT TT=104.706 ASSIGNMENTS=82081 CHECKS=53555400	? (problem) TT=4.45	SAT TT=108.21 ASSIGNMENTS=81072 CHECKS=54531000	SAT TT=36.418 ASSIGNMENTS=28169 CHECKS=18077500	? TT=310.35	? (TO) TT=1800.1	SAT TT=919.528	SAT TT=553.232
csp/travellingSalesman-25/ normalized-tsp-25-38_ext.xml	SAT TT=1.25	SAT TT=4.636 CHECKS=4367910 NODES=4658	SAT TT=2.077 CHECKS=1372170 NODES=759	SAT TT=8.603	SAT TT=48.842 CHECKS=1211410	SAT TT=87.543 CHECKS=1725220	SAT TT=15.036 ASSIGNMENTS=585	SAT TT=18.07 ASSIGNMENTS=1200	SAT TT=66.748 CHECKS=60173900 NODES=2439	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=1.34 ASSIGNMENTS=1363 CHECKS=1044830	SAT TT=1.355 ASSIGNMENTS=1363 CHECKS=1044830	SAT TT=622.083	SAT TT=956.936	SAT TT=12.118 CHECKS=2881900	SAT TT=1.487 ASSIGNMENTS=1471 CHECKS=1137290	SAT TT=2.857 ASSIGNMENTS=4006 CHECKS=2111720	? (problem) TT=2.59	SAT TT=20.493 ASSIGNMENTS=25748 CHECKS=16179300	SAT TT=1.25 ASSIGNMENTS=1363 CHECKS=1044830	? TT=379.382	SAT TT=630 ASSIGNMENTS=3563 CHECKS=523083000	SAT TT=108.604	SAT TT=111.123
csp/travellingSalesman-25/ normalized-tsp-25-3_ext.xml	SAT TT=0.957	SAT TT=2.566 CHECKS=1555160 NODES=2427	SAT TT=2.754 CHECKS=1630700 NODES=2176	SAT TT=19.438	SAT TT=169.158 CHECKS=6890250	SAT TT=29.659 CHECKS=545588	SAT TT=11.818 ASSIGNMENTS=315	SAT TT=11.903 ASSIGNMENTS=306	SAT TT=62.491 CHECKS=17013400 NODES=369	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=1.306 ASSIGNMENTS=1138 CHECKS=958470	SAT TT=1.318 ASSIGNMENTS=1138 CHECKS=958470	SAT TT=1083.22	SAT TT=995.618	SAT TT=7.618 CHECKS=1912290	SAT TT=0.957 ASSIGNMENTS=812 CHECKS=640423	SAT TT=3.629 ASSIGNMENTS=4239 CHECKS=2406170	? (problem) TT=2.91	SAT TT=22.268 ASSIGNMENTS=23031 CHECKS=15955700	SAT TT=1.392 ASSIGNMENTS=1138 CHECKS=958470	? TT=290.914	SAT TT=603.501 ASSIGNMENTS=3637 CHECKS=412463000	SAT TT=103.758	SAT TT=65.753
csp/travellingSalesman-25/ normalized-tsp-25-456_ext.xml	SAT TT=46.001	SAT TT=479.281 CHECKS=416315000 NODES=786780	SAT TT=119.892 CHECKS=103716000 NODES=201812	SAT TT=48.808	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=227.317 ASSIGNMENTS=23374	SAT TT=501.047 ASSIGNMENTS=56787	SAT TT=119.883 CHECKS=633761000 NODES=18153	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=53.805 ASSIGNMENTS=27953 CHECKS=19009000	SAT TT=288.549 ASSIGNMENTS=27953 CHECKS=19009000	? (TO) TT=1800.08	SAT TT=1316.55	SAT TT=189.929 CHECKS=34704300	SAT TT=57.267 ASSIGNMENTS=36279 CHECKS=23174800	SAT TT=98.152 ASSIGNMENTS=67970 CHECKS=41768600	? (problem) TT=4.198	SAT TT=88.537 ASSIGNMENTS=54605 CHECKS=36191600	SAT TT=46.001 ASSIGNMENTS=27953 CHECKS=19009000	? TT=498.581	? (TO) TT=1800.07	SAT TT=677.635	SAT TT=491.277
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/travellingSalesman-25/ normalized-tsp-25-48_ext.xml	SAT TT=6.998	SAT TT=150.584 CHECKS=166718000 NODES=200370	SAT TT=297.661 CHECKS=324799000 NODES=412625	? (TO) TT=1800.1	SAT TT=974.08 CHECKS=28519400	? (TO) TT=1800.08	SAT TT=745.284 ASSIGNMENTS=113458	SAT TT=685.334 ASSIGNMENTS=79258	SAT TT=231.719 CHECKS=1649490000 NODES=66348	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=154.565 ASSIGNMENTS=200370 CHECKS=166718000	SAT TT=145.812 ASSIGNMENTS=200370 CHECKS=166718000	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=288.794 CHECKS=55720800	SAT TT=15.667 ASSIGNMENTS=13915 CHECKS=8292820	SAT TT=226.105 ASSIGNMENTS=166815 CHECKS=97254200	? (problem) TT=4.309	SAT TT=158.234 ASSIGNMENTS=119858 CHECKS=75254300	SAT TT=6.998 ASSIGNMENTS=5528 CHECKS=3262660	? TT=297.374	? (TO) TT=1800.1	SAT TT=541.317	SAT TT=780.969
csp/travellingSalesman-25/ normalized-tsp-25-523_ext.xml	SAT TT=3.199	SAT TT=42.131 CHECKS=41220300 NODES=70107	SAT TT=112.781 CHECKS=111180000 NODES=186041	SAT TT=57.901	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=202.175 ASSIGNMENTS=34627	SAT TT=135.822 ASSIGNMENTS=20459	SAT TT=712.675 CHECKS=6284450000 NODES=369813	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=34.09 ASSIGNMENTS=24701 CHECKS=14158200	SAT TT=49.232 ASSIGNMENTS=70107 CHECKS=41220300	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=257.594 CHECKS=58240800	SAT TT=3.199 ASSIGNMENTS=2781 CHECKS=1685930	SAT TT=19.931 ASSIGNMENTS=19492 CHECKS=11381800	? (problem) TT=3.977	SAT TT=107.332 ASSIGNMENTS=99763 CHECKS=59854400	SAT TT=26.292 ASSIGNMENTS=24701 CHECKS=14158200	? TT=344.602	? (TO) TT=1800.12	SAT TT=1655.33	SAT TT=908.703
csp/travellingSalesman-25/ normalized-tsp-25-54_ext.xml	SAT TT=0.512	SAT TT=1.416 CHECKS=412071 NODES=432	SAT TT=1.883 CHECKS=947880 NODES=134	SAT TT=4.494	SAT TT=38.083 CHECKS=1432860	SAT TT=19.789 CHECKS=315283	SAT TT=5.535 ASSIGNMENTS=24	SAT TT=5.212 ASSIGNMENTS=55	SAT TT=63.363 CHECKS=26943500 NODES=1326	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=0.664 ASSIGNMENTS=640 CHECKS=417477	SAT TT=0.657 ASSIGNMENTS=640 CHECKS=417477	SAT TT=471.178	SAT TT=714.616	SAT TT=2.542 CHECKS=623993	SAT TT=0.52 ASSIGNMENTS=486 CHECKS=364152	SAT TT=0.442 ASSIGNMENTS=658 CHECKS=330094	? (problem) TT=2.534	SAT TT=6.606 ASSIGNMENTS=10828 CHECKS=5522150	SAT TT=0.597 ASSIGNMENTS=640 CHECKS=417477	? (exit code) TT=303.238	SAT TT=188.524 ASSIGNMENTS=108 CHECKS=5415000	SAT TT=67.067	SAT TT=67.766
csp/travellingSalesman-25/ normalized-tsp-25-561_ext.xml	SAT TT=4.074	SAT TT=4.074 CHECKS=3005660 NODES=4342	SAT TT=21.122 CHECKS=26034100 NODES=31070	SAT TT=90.067	? (TO) TT=1800.02	SAT TT=832.061 CHECKS=11624000	SAT TT=43.493 ASSIGNMENTS=1756	SAT TT=75.279 ASSIGNMENTS=7125	SAT TT=70.478 CHECKS=104823000 NODES=3032	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=15.15 ASSIGNMENTS=5831 CHECKS=3568410	SAT TT=11.491 ASSIGNMENTS=4342 CHECKS=3005660	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=52.256 CHECKS=11261500	SAT TT=5.045 ASSIGNMENTS=3879 CHECKS=2625400	SAT TT=17.359 ASSIGNMENTS=13591 CHECKS=9336340	? (problem) TT=4.063	SAT TT=49.235 ASSIGNMENTS=28744 CHECKS=21876400	SAT TT=7.169 ASSIGNMENTS=5831 CHECKS=3568410	? TT=360.515	SAT TT=1688.72 ASSIGNMENTS=1895 CHECKS=680034000	SAT TT=329.202	SAT TT=213.395
csp/travellingSalesman-25/ normalized-tsp-25-66_ext.xml	SAT TT=0.317	SAT TT=1.966 CHECKS=720062 NODES=1185	SAT TT=1.626 CHECKS=434240 NODES=361	SAT TT=3.146	SAT TT=54.164 CHECKS=2249880	SAT TT=28.646 CHECKS=871493	SAT TT=10.624 ASSIGNMENTS=530	SAT TT=10.395 ASSIGNMENTS=105	SAT TT=62.007 CHECKS=14287800 NODES=520	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=0.509 ASSIGNMENTS=625 CHECKS=392033	SAT TT=0.511 ASSIGNMENTS=625 CHECKS=392033	SAT TT=357.282	SAT TT=344.788	SAT TT=3.495 CHECKS=1070320	SAT TT=2.46 ASSIGNMENTS=3110 CHECKS=2093820	SAT TT=1.552 ASSIGNMENTS=2587 CHECKS=1249550	? (problem) TT=2.003	SAT TT=16.845 ASSIGNMENTS=22087 CHECKS=12976700	SAT TT=0.495 ASSIGNMENTS=625 CHECKS=392033	? (exit code) TT=479.173	SAT TT=172.768 ASSIGNMENTS=264 CHECKS=375958000	SAT TT=32.277	SAT TT=71.388
csp/travellingSalesman-25/ normalized-tsp-25-681_ext.xml	SAT TT=45.928	SAT TT=45.928 CHECKS=43862700 NODES=66094	SAT TT=79.278 CHECKS=77594100 NODES=116988	SAT TT=276.753	SAT TT=569.302 CHECKS=23597100	? (TO) TT=1800.05	SAT TT=141.997 ASSIGNMENTS=17903	SAT TT=82.457 ASSIGNMENTS=7372	SAT TT=322.927 CHECKS=2663680000 NODES=118028	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=75.263 ASSIGNMENTS=57891 CHECKS=40450000	SAT TT=49.947 ASSIGNMENTS=66094 CHECKS=43862700	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=115.048 CHECKS=24357600	SAT TT=61.643 ASSIGNMENTS=48393 CHECKS=34319000	SAT TT=65.293 ASSIGNMENTS=56215 CHECKS=38340000	? (problem) TT=4.539	SAT TT=84.272 ASSIGNMENTS=67197 CHECKS=45101800	SAT TT=66.883 ASSIGNMENTS=57891 CHECKS=40450000	? TT=500.417	? (TO) TT=1800.05	SAT TT=518.846	SAT TT=1333.29
csp/travellingSalesman-25/ normalized-tsp-25-715_ext.xml	SAT TT=184.488	SAT TT=446.391 CHECKS=454181000 NODES=568001	SAT TT=271.525 CHECKS=284879000 NODES=338824	SAT TT=568.085	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=682.113 ASSIGNMENTS=65222	? (TO) TT=1800.13	SAT TT=227.11 CHECKS=1920630000 NODES=41304	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=196.048 ASSIGNMENTS=114025 CHECKS=85295500	SAT TT=417.469 ASSIGNMENTS=114025 CHECKS=85295500	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=398.841 CHECKS=77697700	SAT TT=346.066 ASSIGNMENTS=222639 CHECKS=158463000	SAT TT=40.029 ASSIGNMENTS=25261 CHECKS=19380400	? (problem) TT=3.81	SAT TT=248.577 ASSIGNMENTS=144009 CHECKS=113010000	SAT TT=184.488 ASSIGNMENTS=114025 CHECKS=85295500	? TT=384.098	? (TO) TT=1800.08	SAT TT=1113.77	SAT TT=480.475
csp/travellingSalesman-25/ normalized-tsp-25-843_ext.xml	SAT TT=17.836	SAT TT=28.987 CHECKS=27667000 NODES=40479	SAT TT=33.106 CHECKS=31827200 NODES=46706	SAT TT=17.836	SAT TT=503.377 CHECKS=23112300	SAT TT=841.778 CHECKS=15113300	SAT TT=41.96 ASSIGNMENTS=3536	SAT TT=71.354 ASSIGNMENTS=4920	SAT TT=79.303 CHECKS=189322000 NODES=5868	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=39.324 ASSIGNMENTS=27437 CHECKS=18693900	SAT TT=34.453 ASSIGNMENTS=40479 CHECKS=27667000	SAT TT=1750.43	SAT TT=1573.32	SAT TT=187.681 CHECKS=37074400	SAT TT=20.125 ASSIGNMENTS=16360 CHECKS=11354100	SAT TT=36.722 ASSIGNMENTS=32898 CHECKS=21889700	? (problem) TT=2.789	SAT TT=73.339 ASSIGNMENTS=56871 CHECKS=40028800	SAT TT=29.816 ASSIGNMENTS=27437 CHECKS=18693900	? TT=304.725	SAT TT=960.188 ASSIGNMENTS=10516 CHECKS=774436000	SAT TT=205.76	SAT TT=133.742
csp/ukVg/ normalized-crossword-m1c-uk-vg10-10_ext.xml		? (TO) TT=1800.6	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.05	? TT=31.162	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.12
csp/ukVg/ normalized-crossword-m1c-uk-vg10-11_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? TT=35.157	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.16
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukVg/ normalized-crossword-m1c-uk-vg10-13_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.06	? TT=31.954	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.03
csp/ukVg/ normalized-crossword-m1c-uk-vg11-11_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? TT=33.008	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08
csp/ukVg/ normalized-crossword-m1c-uk-vg11-12_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	? TT=31.497	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.14
csp/ukVg/ normalized-crossword-m1c-uk-vg11-13_ext.xml	UNSAT TT=1649.07	UNSAT TT=1649.07 CHECKS=152751 NODES=150905	UNSAT TT=1674.24 CHECKS=156403 NODES=148863	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=1653.12 ASSIGNMENTS=150905 CHECKS=152751	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=35.679	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08
csp/ukVg/ normalized-crossword-m1c-uk-vg11-14_ext.xml	UNSAT TT=508.719	UNSAT TT=543.041 CHECKS=79294 NODES=33832	UNSAT TT=571.055 CHECKS=82460 NODES=34640	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=508.719 ASSIGNMENTS=33832 CHECKS=79294	UNSAT TT=549.733 ASSIGNMENTS=33832 CHECKS=79294	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=1056.8 ASSIGNMENTS=27370 CHECKS=6778740	UNSAT TT=917.131 ASSIGNMENTS=26842 CHECKS=6095480	? (TO) TT=1800.07	UNSAT TT=755.616 ASSIGNMENTS=23182 CHECKS=5251280	UNSAT TT=671.838 ASSIGNMENTS=16800 CHECKS=4301810	? TT=33.808	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.19
csp/ukVg/ normalized-crossword-m1c-uk-vg11-15_ext.xml	UNSAT TT=170.271	UNSAT TT=181.952 CHECKS=17600 NODES=10428	UNSAT TT=209.726 CHECKS=17664 NODES=10421	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=512.519 ASSIGNMENTS=2560	? (TO) TT=1800.11	UNSAT TT=506.182 CHECKS=0 NODES=9296	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=206.757 ASSIGNMENTS=10428 CHECKS=17600	UNSAT TT=192.501 ASSIGNMENTS=10428 CHECKS=17600	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=361.343 CHECKS=919661	UNSAT TT=222.192 ASSIGNMENTS=6231 CHECKS=1600700	UNSAT TT=271.865 ASSIGNMENTS=9617 CHECKS=2006630	? (TO) TT=1800.09	UNSAT TT=238.24 ASSIGNMENTS=8604 CHECKS=1952030	UNSAT TT=170.271 ASSIGNMENTS=5212 CHECKS=1311370	? TT=73.429	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02
csp/ukVg/ normalized-crossword-m1c-uk-vg12-14_ext.xml	UNSAT TT=305.384	UNSAT TT=305.384 CHECKS=30734 NODES=20719	UNSAT TT=317.247 CHECKS=28212 NODES=20620	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.17	UNSAT TT=1114.73 CHECKS=0 NODES=23442	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=323.076 ASSIGNMENTS=20719 CHECKS=30734	UNSAT TT=309.248 ASSIGNMENTS=20719 CHECKS=30734	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=1587.08 CHECKS=2752970	UNSAT TT=486.914 ASSIGNMENTS=14506 CHECKS=3844850	UNSAT TT=536.793 ASSIGNMENTS=17024 CHECKS=4058120	? (TO) TT=1800.07	UNSAT TT=526.095 ASSIGNMENTS=17273 CHECKS=4131640	UNSAT TT=500.137 ASSIGNMENTS=14964 CHECKS=3859320	? TT=86.233	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.19
csp/ukVg/ normalized-crossword-m1c-uk-vg12-16_ext.xml	UNSAT TT=38.795	UNSAT TT=38.795 CHECKS=5 NODES=2209	UNSAT TT=42.263 CHECKS=0 NODES=2398	? (TO) TT=1800.09	UNSAT TT=467.097 CHECKS=264717	UNSAT TT=408.287 CHECKS=234527	UNSAT TT=168.867 ASSIGNMENTS=707	UNSAT TT=939.667 ASSIGNMENTS=2877	UNSAT TT=102.551 CHECKS=0 NODES=2366	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=42.333 ASSIGNMENTS=2209 CHECKS=5	UNSAT TT=42.616 ASSIGNMENTS=2209 CHECKS=5	UNSAT TT=1462.49	? (TO) TT=1800.06	UNSAT TT=257.618 CHECKS=343782	UNSAT TT=53.41 ASSIGNMENTS=2067 CHECKS=519786	UNSAT TT=127.349 ASSIGNMENTS=5267 CHECKS=1073550	UNSAT TT=1368.84	UNSAT TT=73.76 ASSIGNMENTS=3582 CHECKS=752543	UNSAT TT=70.839 ASSIGNMENTS=2511 CHECKS=639936	? TT=87.237	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.15
csp/ukVg/ normalized-crossword-m1c-uk-vg13-17_ext.xml	UNSAT TT=10.203	UNSAT TT=10.203 CHECKS=0 NODES=665	UNSAT TT=13.982 CHECKS=0 NODES=657	? (TO) TT=1800.11	UNSAT TT=254.979 CHECKS=122994	UNSAT TT=129.931 CHECKS=105244	UNSAT TT=85.207 ASSIGNMENTS=182	UNSAT TT=258.596 ASSIGNMENTS=668	UNSAT TT=36.997 CHECKS=0 NODES=1012	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=17.5 ASSIGNMENTS=665 CHECKS=0	UNSAT TT=17.989 ASSIGNMENTS=665 CHECKS=0	UNSAT TT=416.052	UNSAT TT=526.803	UNSAT TT=53.044 CHECKS=111322	UNSAT TT=14.532 ASSIGNMENTS=559 CHECKS=150201	UNSAT TT=82.749 ASSIGNMENTS=3869 CHECKS=784609	UNSAT TT=167.471	UNSAT TT=58.73 ASSIGNMENTS=3026 CHECKS=625114	UNSAT TT=15.049 ASSIGNMENTS=638 CHECKS=164400	? TT=86.224	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02
csp/ukVg/ normalized-crossword-m1c-uk-vg14-14_ext.xml	UNSAT TT=79.57	UNSAT TT=79.991 CHECKS=480 NODES=5840	UNSAT TT=79.57 CHECKS=963 NODES=5662	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=1604.1 CHECKS=1478390	UNSAT TT=402.103 ASSIGNMENTS=2468	UNSAT TT=614.57 ASSIGNMENTS=3039	UNSAT TT=283.494 CHECKS=0 NODES=7549	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=83.72 ASSIGNMENTS=5922 CHECKS=420	UNSAT TT=83.038 ASSIGNMENTS=5922 CHECKS=420	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=336.901 CHECKS=799726	UNSAT TT=111.984 ASSIGNMENTS=4499 CHECKS=1232550	UNSAT TT=183.889 ASSIGNMENTS=8276 CHECKS=1908730	? (TO) TT=1800.05	UNSAT TT=140.591 ASSIGNMENTS=6277 CHECKS=1508090	UNSAT TT=130.215 ASSIGNMENTS=5342 CHECKS=1451260	? TT=76.966	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukVg/ normalized-crossword-m1c-uk-vg14-15_ext.xml	UNSAT TT=29.205	UNSAT TT=34.985 CHECKS=3 NODES=2576	UNSAT TT=29.205 CHECKS=18 NODES=2138	? (TO) TT=1800.18	UNSAT TT=396.224 CHECKS=274500	UNSAT TT=912.039 CHECKS=443023	UNSAT TT=155.406 ASSIGNMENTS=682	UNSAT TT=706.428 ASSIGNMENTS=2952	UNSAT TT=80.269 CHECKS=0 NODES=2410	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=40.873 ASSIGNMENTS=2576 CHECKS=3	UNSAT TT=40.616 ASSIGNMENTS=2576 CHECKS=3	UNSAT TT=1614.61	? (TO) TT=1800.08	UNSAT TT=174.172 CHECKS=311632	UNSAT TT=68.42 ASSIGNMENTS=2566 CHECKS=748872	UNSAT TT=113.346 ASSIGNMENTS=5186 CHECKS=1153980	UNSAT TT=662.595	UNSAT TT=89.852 ASSIGNMENTS=4155 CHECKS=1026320	UNSAT TT=68.147 ASSIGNMENTS=2609 CHECKS=722854	? TT=81.513	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.08
csp/ukVg/ normalized-crossword-m1c-uk-vg14-17_ext.xml	UNSAT TT=7.038	UNSAT TT=7.038 CHECKS=0 NODES=513	UNSAT TT=12.065 CHECKS=0 NODES=487	? (TO) TT=1800.16	UNSAT TT=164.038 CHECKS=108823	UNSAT TT=127.567 CHECKS=77190	UNSAT TT=77.465 ASSIGNMENTS=108	UNSAT TT=144.509 ASSIGNMENTS=318	UNSAT TT=27.853 CHECKS=0 NODES=763	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=13.912 ASSIGNMENTS=513 CHECKS=0	UNSAT TT=14.363 ASSIGNMENTS=513 CHECKS=0	UNSAT TT=222.155	UNSAT TT=324.394	UNSAT TT=39.93 CHECKS=93400	UNSAT TT=11.404 ASSIGNMENTS=423 CHECKS=122354	UNSAT TT=77.165 ASSIGNMENTS=3730 CHECKS=818417	UNSAT TT=104.578	UNSAT TT=57.626 ASSIGNMENTS=3191 CHECKS=638545	UNSAT TT=10.07 ASSIGNMENTS=395 CHECKS=108025	? TT=83.552	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800
csp/ukVg/ normalized-crossword-m1c-uk-vg14-18_ext.xml	UNSAT TT=3.549	UNSAT TT=3.549 CHECKS=0 NODES=177	UNSAT TT=42.943 CHECKS=0 NODES=151	? (TO) TT=1800.14	UNSAT TT=102.556 CHECKS=72154	UNSAT TT=45.157 CHECKS=39108	UNSAT TT=66.714 ASSIGNMENTS=14	UNSAT TT=65.483 ASSIGNMENTS=14	UNSAT TT=13.385 CHECKS=0 NODES=313	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=10.699 ASSIGNMENTS=177 CHECKS=0	UNSAT TT=11.018 ASSIGNMENTS=177 CHECKS=0	UNSAT TT=146.397	UNSAT TT=132.575	UNSAT TT=13.268 CHECKS=32202	UNSAT TT=4.51 ASSIGNMENTS=163 CHECKS=49317	UNSAT TT=75.601 ASSIGNMENTS=3483 CHECKS=802072	UNSAT TT=103.107	UNSAT TT=47.335 ASSIGNMENTS=2916 CHECKS=520984	UNSAT TT=4.913 ASSIGNMENTS=187 CHECKS=53046	? TT=77.251	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.07
csp/ukVg/ normalized-crossword-m1c-uk-vg15-17_ext.xml	UNSAT TT=3.382	UNSAT TT=3.382 CHECKS=0 NODES=264	UNSAT TT=13.866 CHECKS=0 NODES=192	? (TO) TT=1800.11	UNSAT TT=56.107 CHECKS=60784	UNSAT TT=51.633 CHECKS=43935	UNSAT TT=80.027 ASSIGNMENTS=67	UNSAT TT=74.524 ASSIGNMENTS=44	UNSAT TT=10.247 CHECKS=0 NODES=365	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=10.936 ASSIGNMENTS=264 CHECKS=0	UNSAT TT=10.923 ASSIGNMENTS=264 CHECKS=0	UNSAT TT=163.562	UNSAT TT=193.365	UNSAT TT=17.343 CHECKS=41821	UNSAT TT=5.138 ASSIGNMENTS=188 CHECKS=61515	UNSAT TT=72.085 ASSIGNMENTS=3535 CHECKS=825732	UNSAT TT=82.475	UNSAT TT=53.06 ASSIGNMENTS=3367 CHECKS=664354	UNSAT TT=3.587 ASSIGNMENTS=122 CHECKS=40673	? TT=75.479	? (TO) TT=1800.02	UNSAT TT=920.155	? (TO) TT=1800.04
csp/ukVg/ normalized-crossword-m1c-uk-vg15-18_ext.xml	UNSAT TT=1.63	UNSAT TT=1.63 CHECKS=0 NODES=87	UNSAT TT=6.733 CHECKS=0 NODES=0	? (TO) TT=1800.16	UNSAT TT=59.197 CHECKS=61585	UNSAT TT=20.441 CHECKS=19258	UNSAT TT=25.651 ASSIGNMENTS=0	UNSAT TT=23.81 ASSIGNMENTS=0	UNSAT TT=3.55 CHECKS=0 NODES=132	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=8.675 ASSIGNMENTS=87 CHECKS=0	UNSAT TT=8.586 ASSIGNMENTS=87 CHECKS=0	UNSAT TT=86.55	UNSAT TT=78.449	UNSAT TT=6.36 CHECKS=11709	UNSAT TT=2.115 ASSIGNMENTS=79 CHECKS=23691	UNSAT TT=66.358 ASSIGNMENTS=3313 CHECKS=828342	UNSAT TT=38.467	UNSAT TT=11.554 ASSIGNMENTS=573 CHECKS=137755	UNSAT TT=2.299 ASSIGNMENTS=87 CHECKS=27655	? TT=84.275	? (TO) TT=1800.01	UNSAT TT=907.757	? (TO) TT=1800.01
csp/ukVg/ normalized-crossword-m1c-uk-vg15-19_ext.xml	UNSAT TT=0.888	UNSAT TT=1.372 CHECKS=0 NODES=25	UNSAT TT=1.585 CHECKS=0 NODES=0	? (TO) TT=1800.08	UNSAT TT=33.463 CHECKS=31841	UNSAT TT=15.913 CHECKS=16600	UNSAT TT=6.142 ASSIGNMENTS=0	UNSAT TT=6.517 ASSIGNMENTS=0	UNSAT TT=2.625 CHECKS=0 NODES=68	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=1.208 ASSIGNMENTS=38 CHECKS=12742	UNSAT TT=1.134 ASSIGNMENTS=38 CHECKS=12742	UNSAT TT=75.577	UNSAT TT=64.012	UNSAT TT=3.674 CHECKS=7968	UNSAT TT=0.888 ASSIGNMENTS=28 CHECKS=9863	UNSAT TT=27.619 ASSIGNMENTS=1377 CHECKS=333190	UNSAT TT=11.21	UNSAT TT=1.864 ASSIGNMENTS=88 CHECKS=19550	UNSAT TT=1.194 ASSIGNMENTS=38 CHECKS=12742	? TT=104.661	? (TO) TT=1800.02	UNSAT TT=844.553	? (TO) TT=1800.1
csp/ukVg/ normalized-crossword-m1c-uk-vg16-16_ext.xml	UNSAT TT=3.384	UNSAT TT=3.384 CHECKS=0 NODES=328	UNSAT TT=9.339 CHECKS=0 NODES=254	? (TO) TT=1800.16	UNSAT TT=78.065 CHECKS=120959	UNSAT TT=40.329 CHECKS=67675	UNSAT TT=71.617 ASSIGNMENTS=43	UNSAT TT=85.056 ASSIGNMENTS=86	UNSAT TT=10.397 CHECKS=0 NODES=532	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=10.52 ASSIGNMENTS=325 CHECKS=0	UNSAT TT=10.516 ASSIGNMENTS=325 CHECKS=0	UNSAT TT=211.536	UNSAT TT=204.513	UNSAT TT=11.289 CHECKS=39904	UNSAT TT=8.187 ASSIGNMENTS=308 CHECKS=100733	UNSAT TT=71.562 ASSIGNMENTS=3594 CHECKS=858302	UNSAT TT=75.162	UNSAT TT=63.421 ASSIGNMENTS=3726 CHECKS=778362	UNSAT TT=8.236 ASSIGNMENTS=336 CHECKS=106580	? TT=81.072	? (TO) TT=1800.02	UNSAT TT=907.752	? (TO) TT=1800.05
csp/ukVg/ normalized-crossword-m1c-uk-vg16-17_ext.xml	UNSAT TT=2.626	UNSAT TT=2.626 CHECKS=0 NODES=207	UNSAT TT=18.425 CHECKS=0 NODES=116	? (TO) TT=1800.18	UNSAT TT=42.553 CHECKS=62397	UNSAT TT=29.109 CHECKS=47982	UNSAT TT=69.328 ASSIGNMENTS=7	UNSAT TT=64.868 ASSIGNMENTS=15	UNSAT TT=4.586 CHECKS=0 NODES=217	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=9.616 ASSIGNMENTS=207 CHECKS=0	UNSAT TT=10.023 ASSIGNMENTS=207 CHECKS=0	UNSAT TT=186.349	UNSAT TT=101.223	UNSAT TT=7.96 CHECKS=23759	UNSAT TT=3.243 ASSIGNMENTS=126 CHECKS=41897	UNSAT TT=64.577 ASSIGNMENTS=3407 CHECKS=832445	UNSAT TT=94.13	UNSAT TT=28.156 ASSIGNMENTS=1587 CHECKS=341492	UNSAT TT=3.503 ASSIGNMENTS=134 CHECKS=41365	? TT=68.994	? (TO) TT=1800.01	UNSAT TT=478.273	? (TO) TT=1800.05
csp/ukVg/ normalized-crossword-m1c-uk-vg16-18_ext.xml	UNSAT TT=0.812	UNSAT TT=1.288 CHECKS=0 NODES=31	UNSAT TT=1.278 CHECKS=0 NODES=0	? (TO) TT=1800.12	UNSAT TT=24.851 CHECKS=32026	UNSAT TT=10.055 CHECKS=13711	UNSAT TT=14.41 ASSIGNMENTS=0	UNSAT TT=14.343 ASSIGNMENTS=0	UNSAT TT=1.721 CHECKS=0 NODES=61	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=0.879 ASSIGNMENTS=25 CHECKS=10417	UNSAT TT=0.946 ASSIGNMENTS=25 CHECKS=10417	UNSAT TT=66.746	UNSAT TT=51.674	UNSAT TT=3.055 CHECKS=6923	UNSAT TT=0.812 ASSIGNMENTS=21 CHECKS=8924	UNSAT TT=69.264 ASSIGNMENTS=3169 CHECKS=806347	UNSAT TT=13.511	UNSAT TT=1.49 ASSIGNMENTS=65 CHECKS=18205	UNSAT TT=0.967 ASSIGNMENTS=25 CHECKS=10417	? TT=70.643	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/ukVg/ normalized-crossword-m1c-uk-vg16-19_ext.xml	UNSAT TT=0.472	UNSAT TT=1.064 CHECKS=0 NODES=19	UNSAT TT=1.07 CHECKS=0 NODES=0	? (TO) TT=1800.14	UNSAT TT=5.74 CHECKS=5136	UNSAT TT=8.379 CHECKS=7750	UNSAT TT=2.93 ASSIGNMENTS=0	UNSAT TT=2.881 ASSIGNMENTS=0	UNSAT TT=0.929 CHECKS=0 NODES=18	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=0.483 ASSIGNMENTS=12 CHECKS=4481	UNSAT TT=0.487 ASSIGNMENTS=12 CHECKS=4481	UNSAT TT=58.166	UNSAT TT=55.002	UNSAT TT=1.558 CHECKS=4042	UNSAT TT=0.472 ASSIGNMENTS=11 CHECKS=4508	UNSAT TT=3.155 ASSIGNMENTS=153 CHECKS=38817	UNSAT TT=4.781	UNSAT TT=0.957 ASSIGNMENTS=39 CHECKS=10003	UNSAT TT=0.473 ASSIGNMENTS=12 CHECKS=4481	? TT=77.604	? (TO) TT=1800.02	UNSAT TT=326.949	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukVg/ normalized-crossword-m1c-uk-vg4-4_ext.xml	SAT TT=0.016	SAT TT=0.69 CHECKS=9 NODES=16	SAT TT=0.727 CHECKS=9 NODES=0	SAT TT=0.39	SAT TT=0.344 CHECKS=401	SAT TT=0.388 CHECKS=468	SAT TT=0.804 ASSIGNMENTS=15	SAT TT=1.038 ASSIGNMENTS=12	SAT TT=1.005 CHECKS=372458 NODES=16	SAT TT=0.926 CHECKS=4281270 NODES=2550060	SAT TT=2.792 CHECKS=8260180 NODES=2638	SAT TT=0.03 ASSIGNMENTS=14 CHECKS=152	SAT TT=0.029 ASSIGNMENTS=14 CHECKS=152	SAT TT=7.601	SAT TT=5.896	SAT TT=0.029 CHECKS=56	SAT TT=0.016 ASSIGNMENTS=14 CHECKS=152	SAT TT=0.016 ASSIGNMENTS=12 CHECKS=181	SAT TT=0.937	SAT TT=0.016 ASSIGNMENTS=9 CHECKS=121	SAT TT=0.018 ASSIGNMENTS=14 CHECKS=152	SAT TT=13.736	SAT TT=0.036 ASSIGNMENTS=16 CHECKS=14574	SAT TT=2.576	SAT TT=3.818
csp/ukVg/ normalized-crossword-m1c-uk-vg4-6_ext.xml	SAT TT=0.106	SAT TT=0.853 CHECKS=10 NODES=24	SAT TT=0.886 CHECKS=10 NODES=25	SAT TT=3.634	SAT TT=1.471 CHECKS=1082	SAT TT=1.426 CHECKS=956	SAT TT=2.029 ASSIGNMENTS=16	SAT TT=1.947 ASSIGNMENTS=12	SAT TT=102.866 CHECKS=210186000 NODES=25	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=0.128 ASSIGNMENTS=39 CHECKS=1400	SAT TT=0.119 ASSIGNMENTS=39 CHECKS=1400	SAT TT=28.204	SAT TT=24.313	SAT TT=0.112 CHECKS=182	SAT TT=0.106 ASSIGNMENTS=38 CHECKS=1356	SAT TT=0.065 ASSIGNMENTS=11 CHECKS=251	SAT TT=2.141	SAT TT=0.115 ASSIGNMENTS=47 CHECKS=1079	SAT TT=0.118 ASSIGNMENTS=39 CHECKS=1400	? TT=82.949	SAT TT=0.438 ASSIGNMENTS=24 CHECKS=982254	SAT TT=75.095	SAT TT=80.714
csp/ukVg/ normalized-crossword-m1c-uk-vg4-7_ext.xml	SAT TT=0.176	SAT TT=0.945 CHECKS=11 NODES=31	SAT TT=1.183 CHECKS=11 NODES=28	SAT TT=4.031	SAT TT=2.417 CHECKS=1361	SAT TT=2.882 CHECKS=1570	SAT TT=3.417 ASSIGNMENTS=28	SAT TT=2.878 ASSIGNMENTS=19	SAT TT=1.514 CHECKS=191343 NODES=32	? (TO) TT=1800	? (TO) TT=1800.1	SAT TT=0.459 ASSIGNMENTS=90 CHECKS=5083	SAT TT=0.462 ASSIGNMENTS=90 CHECKS=5083	SAT TT=51.223	SAT TT=76.373	SAT TT=0.176 CHECKS=423	SAT TT=0.36 ASSIGNMENTS=80 CHECKS=4299	SAT TT=0.1 ASSIGNMENTS=10 CHECKS=349	SAT TT=3.502	SAT TT=0.217 ASSIGNMENTS=64 CHECKS=1742	SAT TT=0.467 ASSIGNMENTS=90 CHECKS=5083	? TT=79.239	SAT TT=0.302 ASSIGNMENTS=52 CHECKS=78618	SAT TT=279.089	SAT TT=291.974
csp/ukVg/ normalized-crossword-m1c-uk-vg5-5_ext.xml	SAT TT=0.046	SAT TT=0.99 CHECKS=11 NODES=25	SAT TT=1.048 CHECKS=11 NODES=0	SAT TT=3.91	SAT TT=1.713 CHECKS=1839	SAT TT=1.637 CHECKS=1407	SAT TT=1.606 ASSIGNMENTS=12	SAT TT=1.645 ASSIGNMENTS=21	SAT TT=40.173 CHECKS=11506900 NODES=26	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=0.058 ASSIGNMENTS=16 CHECKS=438	SAT TT=0.059 ASSIGNMENTS=16 CHECKS=438	SAT TT=27.144	SAT TT=32.925	SAT TT=0.064 CHECKS=124	SAT TT=0.05 ASSIGNMENTS=16 CHECKS=438	SAT TT=0.035 ASSIGNMENTS=11 CHECKS=230	SAT TT=2.055	SAT TT=0.046 ASSIGNMENTS=19 CHECKS=468	SAT TT=0.046 ASSIGNMENTS=16 CHECKS=438	? (MO) TT=40.019	SAT TT=0.116 ASSIGNMENTS=30 CHECKS=122481	SAT TT=27.455	SAT TT=32.772
csp/ukVg/ normalized-crossword-m1c-uk-vg5-6_ext.xml	SAT TT=0.133	SAT TT=0.945 CHECKS=11 NODES=32	SAT TT=1.016 CHECKS=11 NODES=31	SAT TT=5.697	SAT TT=2.307 CHECKS=1543	SAT TT=2.255 CHECKS=1705	SAT TT=3.724 ASSIGNMENTS=55	SAT TT=2.858 ASSIGNMENTS=17	SAT TT=154.892 CHECKS=426171000 NODES=72	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=0.572 ASSIGNMENTS=180 CHECKS=10013	SAT TT=0.542 ASSIGNMENTS=180 CHECKS=10013	SAT TT=420.064	SAT TT=267.772	SAT TT=0.156 CHECKS=163	SAT TT=0.133 ASSIGNMENTS=30 CHECKS=1320	SAT TT=1.288 ASSIGNMENTS=501 CHECKS=21554	SAT TT=3.049	SAT TT=1.419 ASSIGNMENTS=641 CHECKS=23131	SAT TT=0.515 ASSIGNMENTS=180 CHECKS=10013	? (exit code) TT=146.12	SAT TT=3.084 ASSIGNMENTS=38 CHECKS=1336660	SAT TT=99.8	SAT TT=138.289
csp/ukVg/ normalized-crossword-m1c-uk-vg5-7_ext.xml	SAT TT=0.699	SAT TT=0.96 CHECKS=47 NODES=42	SAT TT=1.236 CHECKS=34 NODES=42	SAT TT=1416.94	SAT TT=149.309 CHECKS=100172	SAT TT=90.296 CHECKS=76471	SAT TT=9.738 ASSIGNMENTS=129	SAT TT=5.609 ASSIGNMENTS=61	SAT TT=38.877 CHECKS=103680000 NODES=1215	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=1.266 ASSIGNMENTS=221 CHECKS=14388	SAT TT=1.255 ASSIGNMENTS=221 CHECKS=14388	SAT TT=528.822	SAT TT=701.316	SAT TT=0.699 CHECKS=15528	SAT TT=2.414 ASSIGNMENTS=400 CHECKS=25462	SAT TT=18.262 ASSIGNMENTS=4083 CHECKS=205746	SAT TT=19.161	SAT TT=62.832 ASSIGNMENTS=10805 CHECKS=791637	SAT TT=1.293 ASSIGNMENTS=221 CHECKS=14388	? (MO) TT=31.629	SAT TT=14.934 ASSIGNMENTS=296 CHECKS=17648200	SAT TT=730.148	SAT TT=1049.96
csp/ukVg/ normalized-crossword-m1c-uk-vg5-8_ext.xml	SAT TT=2.561	SAT TT=4.463 CHECKS=8876 NODES=5219	SAT TT=2.561 CHECKS=1635 NODES=1448	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=320.102 ASSIGNMENTS=4577	SAT TT=1160.08 ASSIGNMENTS=11417	SAT TT=77.62 CHECKS=547313000 NODES=9607	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=11.508 ASSIGNMENTS=5219 CHECKS=8876	SAT TT=11.748 ASSIGNMENTS=5219 CHECKS=8876	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=7.914 CHECKS=228306	SAT TT=117.387 ASSIGNMENTS=11429 CHECKS=876022	SAT TT=195.878 ASSIGNMENTS=20812 CHECKS=1619500	SAT TT=22.647	SAT TT=34.063 ASSIGNMENTS=3934 CHECKS=266765	SAT TT=130.186 ASSIGNMENTS=12322 CHECKS=942620	? (MO) TT=33.028	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.04
csp/ukVg/ normalized-crossword-m1c-uk-vg5-9_ext.xml	SAT TT=16.074	SAT TT=16.074 CHECKS=32744 NODES=21532	SAT TT=72.609 CHECKS=147081 NODES=89910	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=1507.41 ASSIGNMENTS=15801	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=467.044 ASSIGNMENTS=36518 CHECKS=3189880	SAT TT=22.854 ASSIGNMENTS=21532 CHECKS=32744	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=194.45 CHECKS=5392520	SAT TT=496.763 ASSIGNMENTS=38187 CHECKS=3325500	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=503.565 ASSIGNMENTS=36518 CHECKS=3189880	? TT=89.432	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.01
csp/ukVg/ normalized-crossword-m1c-uk-vg6-10_ext.xml		? (TO) TT=1800.22	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=81.915	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.06
csp/ukVg/ normalized-crossword-m1c-uk-vg6-6_ext.xml	SAT TT=0.459	SAT TT=1.148 CHECKS=69 NODES=137	SAT TT=1.094 CHECKS=65 NODES=79	SAT TT=7.007	SAT TT=4.526 CHECKS=2460	SAT TT=8.974 CHECKS=9014	SAT TT=21.65 ASSIGNMENTS=580	SAT TT=3.005 ASSIGNMENTS=10	SAT TT=183.148 CHECKS=575147000 NODES=38	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=8.137 ASSIGNMENTS=465 CHECKS=227	SAT TT=8.399 ASSIGNMENTS=465 CHECKS=227	? (TO) TT=1800.09	SAT TT=365.629	SAT TT=0.459 CHECKS=11234	SAT TT=8.232 ASSIGNMENTS=1565 CHECKS=111821	SAT TT=11.573 ASSIGNMENTS=2598 CHECKS=128071	SAT TT=4.699	SAT TT=2.047 ASSIGNMENTS=720 CHECKS=27902	SAT TT=6.409 ASSIGNMENTS=1300 CHECKS=90211	? TT=78.021	SAT TT=82.958 ASSIGNMENTS=714 CHECKS=18200700	SAT TT=392.25	SAT TT=547.982
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukVg/ normalized-crossword-m1c-uk-vg6-7_ext.xml	SAT TT=5.381	SAT TT=5.381 CHECKS=3796 NODES=3533	SAT TT=24.408 CHECKS=77241 NODES=39109	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=1210.34 ASSIGNMENTS=10632	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=10.556 ASSIGNMENTS=3533 CHECKS=3796	SAT TT=11.216 ASSIGNMENTS=3533 CHECKS=3796	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=54.733 CHECKS=1573290	SAT TT=552.86 ASSIGNMENTS=58244 CHECKS=5050430	? (TO) TT=1800.01	SAT TT=528.423	? (TO) TT=1800.07	? (TO) TT=1800.03	? TT=52.165	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04
csp/ukVg/ normalized-crossword-m1c-uk-vg6-8_ext.xml	SAT TT=1256.66	SAT TT=1256.66 CHECKS=3690100 NODES=1339970	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.03	? TT=74.485	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.1
csp/ukVg/ normalized-crossword-m1c-uk-vg7-10_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? TT=81.377	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05
csp/ukVg/ normalized-crossword-m1c-uk-vg7-7_ext.xml	SAT TT=2.745	SAT TT=54.917 CHECKS=106087 NODES=51269	SAT TT=60.657 CHECKS=128699 NODES=54631	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=680.342 CHECKS=516489	? (TO) TT=1800.16	SAT TT=64.423 ASSIGNMENTS=585	SAT TT=718.124 CHECKS=0 NODES=281683	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=80.814 ASSIGNMENTS=64644 CHECKS=139493	SAT TT=78.154 ASSIGNMENTS=64644 CHECKS=139493	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=2.745 CHECKS=47438	? (TO) TT=1800.02	SAT TT=468.604 ASSIGNMENTS=34130 CHECKS=3237800	SAT TT=10.18	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=103.181	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08
csp/ukVg/ normalized-crossword-m1c-uk-vg7-8_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.08	? TT=93.692	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.01
csp/ukVg/ normalized-crossword-m1c-uk-vg7-9_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? TT=85.873	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1
csp/ukVg/ normalized-crossword-m1c-uk-vg8-10_ext.xml		? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=29.433	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08
csp/ukVg/ normalized-crossword-m1c-uk-vg8-11_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=31.915	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.01
csp/ukVg/ normalized-crossword-m1c-uk-vg8-12_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=29.554	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.05
csp/ukVg/ normalized-crossword-m1c-uk-vg9-10_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=31.887	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.23
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukVg/ normalized-crossword-m1c-uk-vg9-11_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1969.92	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.11	? TT=28.901	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.21
csp/ukVg/ normalized-crossword-m1c-uk-vg9-12_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=26.447	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05
csp/ukVg/ normalized-crossword-m1c-uk-vg9-13_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.03	? TT=34.185	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.09
csp/ukVg/ normalized-crossword-m1c-uk-vg9-9_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.09	? TT=31.022	? (TO) TT=1800.06	? (TO) TT=1800.22	? (TO) TT=1800.14
csp/varDimacs/ normalized-bf-0432-007_ext.xml	SAT TT=0.056	SAT TT=1.876 CHECKS=6817 NODES=970	SAT TT=1.541 CHECKS=10254 NODES=0	SAT TT=0.291	SAT TT=0.285 CHECKS=206777	SAT TT=0.209 CHECKS=205195	SAT TT=1.131 ASSIGNMENTS=120	SAT TT=1.294 ASSIGNMENTS=152	SAT TT=1.22 CHECKS=5273 NODES=971	SAT TT=3.403 CHECKS=2297330 NODES=150829	SAT TT=1.372 CHECKS=390545 NODES=431	SAT TT=0.078 ASSIGNMENTS=117 CHECKS=4640	SAT TT=0.068 ASSIGNMENTS=117 CHECKS=4640	SAT TT=2.535	SAT TT=2.849	SAT TT=0.113 CHECKS=3655	SAT TT=0.056 ASSIGNMENTS=117 CHECKS=4640	SAT TT=0.06 ASSIGNMENTS=136 CHECKS=4702	SAT TT=0.92	SAT TT=0.059 ASSIGNMENTS=134 CHECKS=4640	SAT TT=0.056 ASSIGNMENTS=117 CHECKS=4640	SAT TT=2.121	SAT TT=0.332 ASSIGNMENTS=972 CHECKS=13329	SAT TT=1.322	SAT TT=1.835
csp/varDimacs/ normalized-bf-1355-075_ext.xml	SAT TT=0.078	SAT TT=2.762 CHECKS=6117 NODES=1818	SAT TT=2.616 CHECKS=6163 NODES=0	SAT TT=0.368	SAT TT=1.381 CHECKS=86913	SAT TT=1.442 CHECKS=89213	SAT TT=1.465 ASSIGNMENTS=1108	SAT TT=2.855 ASSIGNMENTS=1335	SAT TT=1.757 CHECKS=4623 NODES=1818	SAT TT=1.473 CHECKS=27467 NODES=205	SAT TT=1.453 CHECKS=365956 NODES=233	SAT TT=0.1 ASSIGNMENTS=1129 CHECKS=5504	SAT TT=0.099 ASSIGNMENTS=1129 CHECKS=5504	SAT TT=3.395	SAT TT=3.387	SAT TT=0.217 CHECKS=4944	SAT TT=0.078 ASSIGNMENTS=1129 CHECKS=5504	SAT TT=0.074 ASSIGNMENTS=1239 CHECKS=5504	SAT TT=0.966	SAT TT=0.102 ASSIGNMENTS=1146 CHECKS=5504	SAT TT=0.087 ASSIGNMENTS=1129 CHECKS=5504	SAT TT=2.88	SAT TT=0.639 ASSIGNMENTS=1818 CHECKS=11948	SAT TT=1.847	SAT TT=1.45
csp/varDimacs/ normalized-bf-1355-638_ext.xml	SAT TT=0.018	SAT TT=1.231 CHECKS=1678 NODES=532	SAT TT=1.158 CHECKS=1343 NODES=0	SAT TT=0.091	SAT TT=0.225 CHECKS=14973	SAT TT=0.244 CHECKS=14817	SAT TT=0.67 ASSIGNMENTS=288	SAT TT=0.793 ASSIGNMENTS=531	SAT TT=0.542 CHECKS=776 NODES=532	SAT TT=0.496 CHECKS=3878 NODES=4	SAT TT=0.537 CHECKS=4920 NODES=6	SAT TT=0.029 ASSIGNMENTS=288 CHECKS=800	SAT TT=0.032 ASSIGNMENTS=288 CHECKS=800	SAT TT=1.603	SAT TT=1.623	SAT TT=0.046 CHECKS=800	SAT TT=0.018 ASSIGNMENTS=288 CHECKS=800	SAT TT=0.018 ASSIGNMENTS=360 CHECKS=800	SAT TT=0.501	SAT TT=0.02 ASSIGNMENTS=321 CHECKS=800	SAT TT=0.019 ASSIGNMENTS=288 CHECKS=800	SAT TT=1.112	SAT TT=0.053 ASSIGNMENTS=532 CHECKS=1380	SAT TT=1.222	SAT TT=1.088
csp/varDimacs/ normalized-bf-2670-001_ext.xml	SAT TT=0.049	SAT TT=2.659 CHECKS=4470 NODES=1244	SAT TT=1.824 CHECKS=7213 NODES=0	SAT TT=0.236	SAT TT=0.625 CHECKS=184762	SAT TT=0.644 CHECKS=176694	SAT TT=1.198 ASSIGNMENTS=371	SAT TT=1.296 ASSIGNMENTS=381	SAT TT=1.187 CHECKS=3217 NODES=1245	SAT TT=5.974 CHECKS=4512490 NODES=300591	SAT TT=1.181 CHECKS=230659 NODES=270	SAT TT=0.059 ASSIGNMENTS=366 CHECKS=3080	SAT TT=0.064 ASSIGNMENTS=366 CHECKS=3080	SAT TT=2.462	SAT TT=2.837	SAT TT=0.082 CHECKS=2125	SAT TT=0.049 ASSIGNMENTS=366 CHECKS=3080	SAT TT=0.046 ASSIGNMENTS=356 CHECKS=3075	SAT TT=1.095	SAT TT=0.054 ASSIGNMENTS=499 CHECKS=4382	SAT TT=0.051 ASSIGNMENTS=366 CHECKS=3080	SAT TT=2.161	SAT TT=0.311 ASSIGNMENTS=1246 CHECKS=6522	SAT TT=1.421	SAT TT=1.31
csp/varDimacs/ normalized-hole-06_ext.xml	UNSAT TT=0.014	UNSAT TT=0.779 CHECKS=1063 NODES=59	UNSAT TT=0.809 CHECKS=1305 NODES=37	UNSAT TT=0.054	UNSAT TT=0.016 CHECKS=3030	UNSAT TT=0.014 CHECKS=2770	UNSAT TT=0.652 ASSIGNMENTS=961	UNSAT TT=0.742 ASSIGNMENTS=1308	UNSAT TT=0.572 CHECKS=52280 NODES=2581	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.028 ASSIGNMENTS=957 CHECKS=37516	UNSAT TT=0.03 ASSIGNMENTS=957 CHECKS=37516	UNSAT TT=0.586	UNSAT TT=0.792	UNSAT TT=0.069 CHECKS=97166	UNSAT TT=0.017 ASSIGNMENTS=999 CHECKS=39159	UNSAT TT=0.039 ASSIGNMENTS=5904 CHECKS=135253	UNSAT TT=0.354	UNSAT TT=0.018 ASSIGNMENTS=1350 CHECKS=50889	UNSAT TT=0.017 ASSIGNMENTS=957 CHECKS=37516	UNSAT TT=1.111	UNSAT TT=0.101 ASSIGNMENTS=4312 CHECKS=139382	UNSAT TT=0.591	UNSAT TT=0.626
csp/varDimacs/ normalized-hole-07_ext.xml	UNSAT TT=0.021	UNSAT TT=0.905 CHECKS=2028 NODES=99	UNSAT TT=0.864 CHECKS=2591 NODES=80	UNSAT TT=0.243	UNSAT TT=0.021 CHECKS=4506	UNSAT TT=0.021 CHECKS=5418	UNSAT TT=1.648 ASSIGNMENTS=7482	UNSAT TT=2.193 ASSIGNMENTS=10277	UNSAT TT=1.749 CHECKS=405626 NODES=18657	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.119 ASSIGNMENTS=7681 CHECKS=361895	UNSAT TT=0.107 ASSIGNMENTS=7681 CHECKS=361895	UNSAT TT=0.908	UNSAT TT=0.769	UNSAT TT=0.814 CHECKS=1431910	UNSAT TT=0.092 ASSIGNMENTS=7317 CHECKS=345794	UNSAT TT=0.127 ASSIGNMENTS=14802 CHECKS=519119	UNSAT TT=0.579	UNSAT TT=0.122 ASSIGNMENTS=9693 CHECKS=450256	UNSAT TT=0.096 ASSIGNMENTS=7681 CHECKS=361895	UNSAT TT=1.271	UNSAT TT=1.09 ASSIGNMENTS=37832 CHECKS=1340760	UNSAT TT=0.776	UNSAT TT=0.764
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/varDimacs/ normalized-hole-08_ext.xml	UNSAT TT=0.027	UNSAT TT=0.875 CHECKS=3187 NODES=135	UNSAT TT=0.994 CHECKS=4977 NODES=155	UNSAT TT=2.743	UNSAT TT=0.027 CHECKS=3704	UNSAT TT=0.028 CHECKS=8420	UNSAT TT=12.096 ASSIGNMENTS=70072	UNSAT TT=15.331 ASSIGNMENTS=94447	UNSAT TT=14.751 CHECKS=3410600 NODES=148586	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=1.063 ASSIGNMENTS=71191 CHECKS=3925030	UNSAT TT=1.062 ASSIGNMENTS=71191 CHECKS=3925030	UNSAT TT=4.083	UNSAT TT=0.897	UNSAT TT=11.61 CHECKS=18367500	UNSAT TT=0.913 ASSIGNMENTS=69085 CHECKS=3813590	UNSAT TT=0.976 ASSIGNMENTS=78597 CHECKS=4024450	UNSAT TT=1.989	UNSAT TT=1.156 ASSIGNMENTS=82172 CHECKS=4501850	UNSAT TT=0.954 ASSIGNMENTS=71191 CHECKS=3925030	UNSAT TT=1.733	UNSAT TT=11.924 ASSIGNMENTS=334930 CHECKS=12225300	UNSAT TT=1.352	UNSAT TT=1.892
csp/varDimacs/ normalized-hole-09_ext.xml	UNSAT TT=0.038	UNSAT TT=0.963 CHECKS=6415 NODES=239	UNSAT TT=1.016 CHECKS=19112 NODES=500	UNSAT TT=40.735	UNSAT TT=0.039 CHECKS=11335	UNSAT TT=0.038 CHECKS=15145	UNSAT TT=148.821 ASSIGNMENTS=777211	UNSAT TT=195.656 ASSIGNMENTS=985147	UNSAT TT=177.532 CHECKS=38057000 NODES=1577550	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=18.478 ASSIGNMENTS=715860 CHECKS=44828500	UNSAT TT=18.476 ASSIGNMENTS=715860 CHECKS=44828500	UNSAT TT=189.036	UNSAT TT=1.436	UNSAT TT=149.96 CHECKS=236616000	UNSAT TT=10.79 ASSIGNMENTS=719138 CHECKS=44880400	UNSAT TT=12.863 ASSIGNMENTS=888577 CHECKS=52786200	UNSAT TT=20.23	UNSAT TT=12.174 ASSIGNMENTS=795704 CHECKS=48120400	UNSAT TT=9.983 ASSIGNMENTS=715860 CHECKS=44828500	UNSAT TT=3.222	UNSAT TT=146.409 ASSIGNMENTS=4125000 CHECKS=164531000	UNSAT TT=5.656	UNSAT TT=18.116
csp/varDimacs/ normalized-hole-10_ext.xml	UNSAT TT=0.051	UNSAT TT=1.069 CHECKS=14042 NODES=445	UNSAT TT=1.177 CHECKS=27659 NODES=688	UNSAT TT=629.498	UNSAT TT=0.057 CHECKS=20182	UNSAT TT=0.051 CHECKS=18608	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=148.247 ASSIGNMENTS=8280720 CHECKS=580867000	UNSAT TT=148.522 ASSIGNMENTS=8280720 CHECKS=580867000	? (TO) TT=1800.05	UNSAT TT=2.557	? (TO) TT=1800.1	UNSAT TT=146.981 ASSIGNMENTS=8735530 CHECKS=606514000	UNSAT TT=160.841 ASSIGNMENTS=10378100 CHECKS=704735000	UNSAT TT=230.271	UNSAT TT=186.653 ASSIGNMENTS=10840100 CHECKS=727304000	UNSAT TT=140.25 ASSIGNMENTS=8280720 CHECKS=580867000	UNSAT TT=28.67	UNSAT TT=1791.38 ASSIGNMENTS=50856700 CHECKS=2167480000	UNSAT TT=68.662	UNSAT TT=345.117
csp/wordsVg/ normalized-crossword-m1c-words-vg10-10_ext.xml	UNSAT TT=12.172	UNSAT TT=12.172 CHECKS=444 NODES=2355	UNSAT TT=12.89 CHECKS=624 NODES=2425	? (TO) TT=1800.06	UNSAT TT=396.931 CHECKS=556355	UNSAT TT=158.644 CHECKS=271973	UNSAT TT=66.186 ASSIGNMENTS=888	UNSAT TT=179.316 ASSIGNMENTS=1883	UNSAT TT=37.106 CHECKS=0 NODES=2833	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=20.535 ASSIGNMENTS=2572 CHECKS=399	UNSAT TT=20.091 ASSIGNMENTS=2572 CHECKS=399	UNSAT TT=1359.99	UNSAT TT=1084.31	UNSAT TT=47.573 CHECKS=315477	UNSAT TT=18.318 ASSIGNMENTS=1990 CHECKS=388412	UNSAT TT=38.354 ASSIGNMENTS=5465 CHECKS=759391	UNSAT TT=195.076	UNSAT TT=24.451 ASSIGNMENTS=3293 CHECKS=484948	UNSAT TT=20.34 ASSIGNMENTS=2231 CHECKS=443768	? TT=29.601	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.05
csp/wordsVg/ normalized-crossword-m1c-words-vg10-12_ext.xml	UNSAT TT=1.274	UNSAT TT=2.402 CHECKS=28 NODES=269	UNSAT TT=3.357 CHECKS=0 NODES=255	? (TO) TT=1800.13	UNSAT TT=63.249 CHECKS=90622	UNSAT TT=29.592 CHECKS=34744	UNSAT TT=36.986 ASSIGNMENTS=22	UNSAT TT=37.036 ASSIGNMENTS=10	UNSAT TT=6.226 CHECKS=0 NODES=483	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=1.3 ASSIGNMENTS=122 CHECKS=24854	UNSAT TT=1.274 ASSIGNMENTS=122 CHECKS=24854	UNSAT TT=127.379	UNSAT TT=93.979	UNSAT TT=6.585 CHECKS=29983	UNSAT TT=2.293 ASSIGNMENTS=243 CHECKS=44095	UNSAT TT=24.794 ASSIGNMENTS=3581 CHECKS=510438	UNSAT TT=27.947	UNSAT TT=12.295 ASSIGNMENTS=1842 CHECKS=247245	UNSAT TT=1.275 ASSIGNMENTS=122 CHECKS=24854	? TT=31.676	? (TO) TT=1800.02	UNSAT TT=1177.75	? (TO) TT=1800.09
csp/wordsVg/ normalized-crossword-m1c-words-vg10-14_ext.xml	UNSAT TT=0.239	UNSAT TT=1.183 CHECKS=0 NODES=15	UNSAT TT=1.037 CHECKS=0 NODES=0	? (TO) TT=1800.1	UNSAT TT=10.131 CHECKS=13603	UNSAT TT=6.208 CHECKS=8493	UNSAT TT=4.667 ASSIGNMENTS=0	UNSAT TT=4.891 ASSIGNMENTS=0	UNSAT TT=1.116 CHECKS=0 NODES=24	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.254 ASSIGNMENTS=18 CHECKS=4771	UNSAT TT=0.257 ASSIGNMENTS=18 CHECKS=4771	UNSAT TT=38.626	UNSAT TT=30.151	UNSAT TT=1.091 CHECKS=3925	UNSAT TT=0.239 ASSIGNMENTS=15 CHECKS=4360	UNSAT TT=5.953 ASSIGNMENTS=808 CHECKS=115363	UNSAT TT=4.411	UNSAT TT=0.444 ASSIGNMENTS=54 CHECKS=8945	UNSAT TT=0.245 ASSIGNMENTS=18 CHECKS=4771	? TT=33.512	? (TO) TT=1800.06	UNSAT TT=268.98	UNSAT TT=280.426
csp/wordsVg/ normalized-crossword-m1c-words-vg11-13_ext.xml	UNSAT TT=0.307	UNSAT TT=1.094 CHECKS=0 NODES=29	UNSAT TT=1.388 CHECKS=0 NODES=0	? (TO) TT=1800.07	UNSAT TT=17.265 CHECKS=25379	UNSAT TT=6.947 CHECKS=10724	UNSAT TT=7.261 ASSIGNMENTS=0	UNSAT TT=7.164 ASSIGNMENTS=0	UNSAT TT=1.15 CHECKS=0 NODES=49	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.423 ASSIGNMENTS=31 CHECKS=7704	UNSAT TT=0.425 ASSIGNMENTS=31 CHECKS=7704	UNSAT TT=35.874	UNSAT TT=26.937	UNSAT TT=1.194 CHECKS=5838	UNSAT TT=0.307 ASSIGNMENTS=23 CHECKS=5323	UNSAT TT=15.931 ASSIGNMENTS=2230 CHECKS=338585	UNSAT TT=7.377	UNSAT TT=2.081 ASSIGNMENTS=299 CHECKS=41597	UNSAT TT=0.411 ASSIGNMENTS=31 CHECKS=7704	? TT=30.737	? (TO) TT=1800.06	UNSAT TT=353.938	? (TO) TT=1800.04
csp/wordsVg/ normalized-crossword-m1c-words-vg11-14_ext.xml	UNSAT TT=0.099	UNSAT TT=0.887 CHECKS=0 NODES=5	UNSAT TT=0.918 CHECKS=0 NODES=0	UNSAT TT=376.223	UNSAT TT=5.55 CHECKS=6351	UNSAT TT=3.258 CHECKS=3448	UNSAT TT=1.386 ASSIGNMENTS=0	UNSAT TT=1.363 ASSIGNMENTS=0	UNSAT TT=0.756 CHECKS=0 NODES=10	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.127 ASSIGNMENTS=8 CHECKS=1506	UNSAT TT=0.128 ASSIGNMENTS=8 CHECKS=1506	UNSAT TT=25.941	UNSAT TT=20.396	UNSAT TT=0.406 CHECKS=1314	UNSAT TT=0.099 ASSIGNMENTS=5 CHECKS=1441	UNSAT TT=0.533 ASSIGNMENTS=65 CHECKS=9670	UNSAT TT=2.991	UNSAT TT=0.303 ASSIGNMENTS=33 CHECKS=5148	UNSAT TT=0.12 ASSIGNMENTS=8 CHECKS=1506	? TT=32.117	? (TO) TT=1800.06	UNSAT TT=173.817	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg11-15_ext.xml	UNSAT TT=0.053	UNSAT TT=0.99 CHECKS=0 NODES=0	UNSAT TT=0.823 CHECKS=0 NODES=0	UNSAT TT=101.607	UNSAT TT=0.718 CHECKS=93	UNSAT TT=0.713 CHECKS=93	UNSAT TT=0.557 ASSIGNMENTS=0	UNSAT TT=0.51 ASSIGNMENTS=0	UNSAT TT=0.631 CHECKS=0 NODES=0	UNSAT TT=0.862 CHECKS=0 NODES=0	UNSAT TT=0.66 CHECKS=0 NODES=0	UNSAT TT=0.066 ASSIGNMENTS=0 CHECKS=357	UNSAT TT=0.069 ASSIGNMENTS=0 CHECKS=357	UNSAT TT=23.44	UNSAT TT=18.886	UNSAT TT=0.241 CHECKS=664	UNSAT TT=0.055 ASSIGNMENTS=0 CHECKS=357	UNSAT TT=0.055 ASSIGNMENTS=0 CHECKS=357	UNSAT TT=2.396	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=357	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=357	? TT=32.248	? (TO) TT=1800.06	UNSAT TT=168.63	UNSAT TT=428.884
csp/wordsVg/ normalized-crossword-m1c-words-vg12-13_ext.xml	UNSAT TT=0.13	UNSAT TT=0.854 CHECKS=0 NODES=6	UNSAT TT=0.887 CHECKS=0 NODES=0	? (TO) TT=1800.08	UNSAT TT=3.643 CHECKS=4275	UNSAT TT=4.11 CHECKS=5036	UNSAT TT=1.495 ASSIGNMENTS=0	UNSAT TT=1.666 ASSIGNMENTS=0	UNSAT TT=0.672 CHECKS=0 NODES=12	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.158 ASSIGNMENTS=10 CHECKS=2195	UNSAT TT=0.158 ASSIGNMENTS=10 CHECKS=2195	UNSAT TT=23.852	UNSAT TT=18.682	UNSAT TT=0.301 CHECKS=1198	UNSAT TT=0.13 ASSIGNMENTS=6 CHECKS=1935	UNSAT TT=0.853 ASSIGNMENTS=100 CHECKS=16127	UNSAT TT=3.367	UNSAT TT=0.343 ASSIGNMENTS=30 CHECKS=6295	UNSAT TT=0.144 ASSIGNMENTS=10 CHECKS=2195	? (exit code) TT=77.999	? (TO) TT=1800.05	UNSAT TT=191.747	? (TO) TT=1800.01
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsVg/ normalized-crossword-m1c-words-vg12-15_ext.xml	UNSAT TT=0.039	UNSAT TT=0.769 CHECKS=0 NODES=0	UNSAT TT=0.832 CHECKS=0 NODES=0	UNSAT TT=66.932	UNSAT TT=0.468 CHECKS=43	UNSAT TT=0.537 CHECKS=43	UNSAT TT=0.475 ASSIGNMENTS=0	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.517 CHECKS=0 NODES=0	UNSAT TT=0.674 CHECKS=0 NODES=0	UNSAT TT=0.66 CHECKS=0 NODES=0	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=58	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=58	UNSAT TT=16.157	UNSAT TT=14.507	UNSAT TT=0.068 CHECKS=70	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=58	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=58	UNSAT TT=1.866	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=58	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=58	? TT=69.507	? (TO) TT=1800.09	UNSAT TT=122.934	UNSAT TT=210.892
csp/wordsVg/ normalized-crossword-m1c-words-vg12-16_ext.xml	UNSAT TT=0.028	UNSAT TT=0.792 CHECKS=0 NODES=0	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=23.98	UNSAT TT=0.44 CHECKS=29	UNSAT TT=0.421 CHECKS=29	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.521 ASSIGNMENTS=0	UNSAT TT=0.647 CHECKS=0 NODES=0	UNSAT TT=0.487 CHECKS=0 NODES=0	UNSAT TT=0.787 CHECKS=0 NODES=0	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=13	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=13	UNSAT TT=16.299	UNSAT TT=14.727	UNSAT TT=0.062 CHECKS=76	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=13	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=13	UNSAT TT=1.889	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=13	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=13	? (exit code) TT=83.74	? (TO) TT=1800.04	UNSAT TT=92.183	UNSAT TT=125.154
csp/wordsVg/ normalized-crossword-m1c-words-vg13-13_ext.xml	UNSAT TT=0.069	UNSAT TT=0.826 CHECKS=0 NODES=6	UNSAT TT=0.816 CHECKS=0 NODES=0	UNSAT TT=568.889	UNSAT TT=1.153 CHECKS=1783	UNSAT TT=1.035 CHECKS=1435	UNSAT TT=0.732 ASSIGNMENTS=0	UNSAT TT=0.743 ASSIGNMENTS=0	UNSAT TT=0.798 CHECKS=0 NODES=4	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.092 ASSIGNMENTS=3 CHECKS=1042	UNSAT TT=0.088 ASSIGNMENTS=3 CHECKS=1042	UNSAT TT=19.48	UNSAT TT=15.405	UNSAT TT=0.152 CHECKS=866	UNSAT TT=0.069 ASSIGNMENTS=2 CHECKS=824	UNSAT TT=0.14 ASSIGNMENTS=18 CHECKS=2354	UNSAT TT=2.101	UNSAT TT=0.154 ASSIGNMENTS=19 CHECKS=2325	UNSAT TT=0.073 ASSIGNMENTS=3 CHECKS=1042	? TT=62.275	? (TO) TT=1800.11	UNSAT TT=118.866	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg13-16_ext.xml	UNSAT TT=0.034	UNSAT TT=0.765 CHECKS=0 NODES=0	UNSAT TT=0.782 CHECKS=0 NODES=0	UNSAT TT=16.932	UNSAT TT=0.297 CHECKS=29	UNSAT TT=0.294 CHECKS=29	UNSAT TT=0.549 ASSIGNMENTS=0	UNSAT TT=0.653 ASSIGNMENTS=0	UNSAT TT=0.572 CHECKS=0 NODES=0	UNSAT TT=0.458 CHECKS=0 NODES=0	UNSAT TT=0.555 CHECKS=0 NODES=0	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=30	UNSAT TT=0.049 ASSIGNMENTS=0 CHECKS=30	UNSAT TT=12.203	UNSAT TT=11.306	UNSAT TT=0.049 CHECKS=83	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=30	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=30	UNSAT TT=1.327	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=30	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=30	? TT=108.571	? (TO) TT=1800.03	UNSAT TT=50.915	UNSAT TT=78.127
csp/wordsVg/ normalized-crossword-m1c-words-vg13-17_ext.xml	UNSAT TT=0.033	UNSAT TT=0.804 CHECKS=0 NODES=0	UNSAT TT=0.752 CHECKS=0 NODES=0	UNSAT TT=18.398	UNSAT TT=0.329 CHECKS=30	UNSAT TT=0.288 CHECKS=30	UNSAT TT=0.465 ASSIGNMENTS=0	UNSAT TT=0.603 ASSIGNMENTS=0	UNSAT TT=0.459 CHECKS=0 NODES=0	UNSAT TT=0.456 CHECKS=0 NODES=0	UNSAT TT=0.445 CHECKS=0 NODES=0	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=31	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=31	UNSAT TT=12.814	UNSAT TT=9.976	UNSAT TT=0.045 CHECKS=55	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=31	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=31	UNSAT TT=1.49	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=31	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=31	? TT=82.639	? (TO) TT=1800.09	UNSAT TT=50.075	UNSAT TT=76.339
csp/wordsVg/ normalized-crossword-m1c-words-vg14-14_ext.xml	UNSAT TT=0.035	UNSAT TT=0.915 CHECKS=0 NODES=0	UNSAT TT=0.774 CHECKS=0 NODES=0	UNSAT TT=118.394	UNSAT TT=0.361 CHECKS=98	UNSAT TT=0.363 CHECKS=98	UNSAT TT=0.512 ASSIGNMENTS=0	UNSAT TT=0.461 ASSIGNMENTS=0	UNSAT TT=0.442 CHECKS=0 NODES=0	UNSAT TT=0.42 CHECKS=0 NODES=0	UNSAT TT=0.436 CHECKS=0 NODES=0	UNSAT TT=0.049 ASSIGNMENTS=0 CHECKS=57	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=57	UNSAT TT=11.373	UNSAT TT=9.512	UNSAT TT=0.052 CHECKS=291	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=57	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=57	UNSAT TT=1.232	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=57	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=57	? TT=80.729	? (TO) TT=1800.04	UNSAT TT=43.788	UNSAT TT=77.833
csp/wordsVg/ normalized-crossword-m1c-words-vg14-16_ext.xml	UNSAT TT=0.026	UNSAT TT=0.904 CHECKS=0 NODES=0	UNSAT TT=0.903 CHECKS=0 NODES=0	UNSAT TT=16.945	UNSAT TT=0.182 CHECKS=30	UNSAT TT=0.179 CHECKS=30	UNSAT TT=0.464 ASSIGNMENTS=0	UNSAT TT=0.467 ASSIGNMENTS=0	UNSAT TT=0.451 CHECKS=0 NODES=0	UNSAT TT=0.459 CHECKS=0 NODES=0	UNSAT TT=0.41 CHECKS=0 NODES=0	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=9.247	UNSAT TT=7.763	UNSAT TT=0.035 CHECKS=97	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=1.103	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=15	? TT=108.428	? (TO) TT=1800.07	UNSAT TT=22.311	UNSAT TT=32.982
csp/wordsVg/ normalized-crossword-m1c-words-vg14-17_ext.xml	UNSAT TT=0.026	UNSAT TT=0.76 CHECKS=0 NODES=0	UNSAT TT=0.781 CHECKS=0 NODES=0	UNSAT TT=16.327	UNSAT TT=0.171 CHECKS=31	UNSAT TT=0.173 CHECKS=31	UNSAT TT=0.458 ASSIGNMENTS=0	UNSAT TT=0.452 ASSIGNMENTS=0	UNSAT TT=0.432 CHECKS=0 NODES=0	UNSAT TT=0.409 CHECKS=0 NODES=0	UNSAT TT=0.433 CHECKS=0 NODES=0	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=9.541	UNSAT TT=8.016	UNSAT TT=0.037 CHECKS=64	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.941	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=15	? TT=89.863	? (TO) TT=1800.05	UNSAT TT=22.494	UNSAT TT=33.116
csp/wordsVg/ normalized-crossword-m1c-words-vg14-18_ext.xml	UNSAT TT=0.025	UNSAT TT=0.759 CHECKS=0 NODES=0	UNSAT TT=0.788 CHECKS=0 NODES=0	UNSAT TT=15.821	UNSAT TT=0.194 CHECKS=32	UNSAT TT=0.184 CHECKS=32	UNSAT TT=0.556 ASSIGNMENTS=0	UNSAT TT=0.532 ASSIGNMENTS=0	UNSAT TT=0.434 CHECKS=0 NODES=0	UNSAT TT=0.43 CHECKS=0 NODES=0	UNSAT TT=0.431 CHECKS=0 NODES=0	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=9.22	UNSAT TT=7.502	UNSAT TT=0.03 CHECKS=54	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=1.062	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=15	? TT=80.81	? (TO) TT=1800.09	UNSAT TT=22.551	UNSAT TT=31.529
csp/wordsVg/ normalized-crossword-m1c-words-vg15-15_ext.xml	UNSAT TT=0.024	UNSAT TT=0.878 CHECKS=0 NODES=0	UNSAT TT=0.786 CHECKS=0 NODES=0	UNSAT TT=14.499	UNSAT TT=0.202 CHECKS=61	UNSAT TT=0.201 CHECKS=61	UNSAT TT=0.461 ASSIGNMENTS=0	UNSAT TT=0.447 ASSIGNMENTS=0	UNSAT TT=0.412 CHECKS=0 NODES=0	UNSAT TT=0.403 CHECKS=0 NODES=0	UNSAT TT=0.471 CHECKS=0 NODES=0	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=8.256	UNSAT TT=7.704	UNSAT TT=0.031 CHECKS=107	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.929	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=15	? TT=84.554	? (TO) TT=1800.01	UNSAT TT=19.613	UNSAT TT=28.02
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsVg/ normalized-crossword-m1c-words-vg15-16_ext.xml	UNSAT TT=0.026	UNSAT TT=0.793 CHECKS=0 NODES=0	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=11.076	UNSAT TT=0.124 CHECKS=31	UNSAT TT=0.123 CHECKS=31	UNSAT TT=0.548 ASSIGNMENTS=0	UNSAT TT=0.445 ASSIGNMENTS=0	UNSAT TT=0.443 CHECKS=0 NODES=0	UNSAT TT=0.487 CHECKS=0 NODES=0	UNSAT TT=0.521 CHECKS=0 NODES=0	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=6.892	UNSAT TT=6.277	UNSAT TT=0.032 CHECKS=60	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.868	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=16	? TT=82.058	? (TO) TT=1800.04	UNSAT TT=12.818	UNSAT TT=21.692
csp/wordsVg/ normalized-crossword-m1c-words-vg15-19_ext.xml	UNSAT TT=0.016	UNSAT TT=0.81 CHECKS=0 NODES=0	UNSAT TT=0.798 CHECKS=0 NODES=0	UNSAT TT=8.53	UNSAT TT=0.12 CHECKS=20	UNSAT TT=0.115 CHECKS=20	UNSAT TT=0.529 ASSIGNMENTS=0	UNSAT TT=0.536 ASSIGNMENTS=0	UNSAT TT=0.396 CHECKS=0 NODES=0	UNSAT TT=0.411 CHECKS=0 NODES=0	UNSAT TT=0.41 CHECKS=0 NODES=0	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=7.108	UNSAT TT=5.989	UNSAT TT=0.025 CHECKS=13	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.735	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=16	? TT=79.532	? (TO) TT=1800.05	UNSAT TT=11.325	UNSAT TT=17.094
csp/wordsVg/ normalized-crossword-m1c-words-vg4-4_ext.xml	SAT TT=0.011	SAT TT=0.806 CHECKS=9 NODES=16	SAT TT=0.818 CHECKS=9 NODES=0	SAT TT=0.232	SAT TT=0.19 CHECKS=485	SAT TT=0.217 CHECKS=580	SAT TT=0.964 ASSIGNMENTS=8	SAT TT=0.714 ASSIGNMENTS=13	SAT TT=1.264 CHECKS=969108 NODES=16	SAT TT=4.428 CHECKS=37403000 NODES=21000000	SAT TT=49.586 CHECKS=138264000 NODES=8795	SAT TT=0.025 ASSIGNMENTS=10 CHECKS=179	SAT TT=0.024 ASSIGNMENTS=10 CHECKS=179	SAT TT=4.324	SAT TT=3.86	SAT TT=0.021 CHECKS=89	SAT TT=0.012 ASSIGNMENTS=10 CHECKS=179	SAT TT=0.011 ASSIGNMENTS=8 CHECKS=193	SAT TT=0.507	SAT TT=0.011 ASSIGNMENTS=6 CHECKS=145	SAT TT=0.012 ASSIGNMENTS=10 CHECKS=179	SAT TT=30.552	SAT TT=0.029 ASSIGNMENTS=16 CHECKS=22445	SAT TT=1.652	SAT TT=2.169
csp/wordsVg/ normalized-crossword-m1c-words-vg4-6_ext.xml	SAT TT=0.037	SAT TT=0.914 CHECKS=20 NODES=31	SAT TT=0.788 CHECKS=10 NODES=24	SAT TT=5.522	SAT TT=0.483 CHECKS=1233	SAT TT=0.993 CHECKS=4312	SAT TT=1.336 ASSIGNMENTS=16	SAT TT=1.625 ASSIGNMENTS=22	SAT TT=201.178 CHECKS=714908000 NODES=65	? (TO) TT=1800	? (TO) TT=1800.04	SAT TT=0.051 ASSIGNMENTS=21 CHECKS=925	SAT TT=0.049 ASSIGNMENTS=21 CHECKS=925	SAT TT=24.336	SAT TT=89.032	SAT TT=0.057 CHECKS=218	SAT TT=0.04 ASSIGNMENTS=21 CHECKS=925	SAT TT=0.091 ASSIGNMENTS=83 CHECKS=3631	SAT TT=1.143	SAT TT=0.054 ASSIGNMENTS=49 CHECKS=1545	SAT TT=0.037 ASSIGNMENTS=21 CHECKS=925	? TT=88.422	SAT TT=0.549 ASSIGNMENTS=31 CHECKS=1275210	SAT TT=18.231	SAT TT=20.028
csp/wordsVg/ normalized-crossword-m1c-words-vg4-8_ext.xml	SAT TT=0.974	SAT TT=1.84 CHECKS=1545 NODES=1546	SAT TT=1.712 CHECKS=1975 NODES=1646	SAT TT=484.152	SAT TT=11.128 CHECKS=40259	SAT TT=9.851 CHECKS=33180	SAT TT=7.951 ASSIGNMENTS=436	SAT TT=3.219 ASSIGNMENTS=39	SAT TT=3.652 CHECKS=28784600 NODES=936	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.116 ASSIGNMENTS=542 CHECKS=42666	SAT TT=1.114 ASSIGNMENTS=542 CHECKS=42666	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.974 CHECKS=43766	SAT TT=4.415 ASSIGNMENTS=2016 CHECKS=164176	SAT TT=1.781 ASSIGNMENTS=1099 CHECKS=59647	SAT TT=7.324	SAT TT=1.033 ASSIGNMENTS=683 CHECKS=36816	SAT TT=1.099 ASSIGNMENTS=542 CHECKS=42666	? TT=87.035	? (TO) TT=1800.08	SAT TT=279.292	? (TO) TT=1800.13
csp/wordsVg/ normalized-crossword-m1c-words-vg5-7_ext.xml	SAT TT=3.18	SAT TT=3.18 CHECKS=4205 NODES=3991	SAT TT=16.22 CHECKS=74393 NODES=29537	? (TO) TT=1800.03	SAT TT=1233.7 CHECKS=4034100	SAT TT=679.765 CHECKS=2142610	SAT TT=124.473 ASSIGNMENTS=8385	SAT TT=1248.51 ASSIGNMENTS=48797	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=10.52 ASSIGNMENTS=3991 CHECKS=4205	SAT TT=10.1 ASSIGNMENTS=3991 CHECKS=4205	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=26.911 CHECKS=1061090	SAT TT=76.013 ASSIGNMENTS=30776 CHECKS=2636340	SAT TT=30.819 ASSIGNMENTS=13285 CHECKS=997653	SAT TT=935.789	SAT TT=292.342 ASSIGNMENTS=120850 CHECKS=10029800	SAT TT=53.217 ASSIGNMENTS=23732 CHECKS=1976390	? (MO) TT=33.837	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11
csp/wordsVg/ normalized-crossword-m1c-words-vg5-8_ext.xml	UNSAT TT=307.298	UNSAT TT=307.298 CHECKS=1191930 NODES=431363	UNSAT TT=357.151 CHECKS=1360750 NODES=539564	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=824.685 ASSIGNMENTS=212436 CHECKS=19484800	UNSAT TT=813.226 ASSIGNMENTS=212436 CHECKS=19484800	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=701.392 CHECKS=22958800	UNSAT TT=528.036 ASSIGNMENTS=185261 CHECKS=17560200	UNSAT TT=606.044 ASSIGNMENTS=200284 CHECKS=19178800	? (TO) TT=1800.04	UNSAT TT=577.449 ASSIGNMENTS=187959 CHECKS=17787200	UNSAT TT=607.972 ASSIGNMENTS=212436 CHECKS=19484800	? (MO) TT=31.078	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800
csp/wordsVg/ normalized-crossword-m1c-words-vg5-9_ext.xml	UNSAT TT=138.233	UNSAT TT=162.747 CHECKS=395997 NODES=180738	UNSAT TT=138.233 CHECKS=296146 NODES=149872	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=750.89 ASSIGNMENTS=38664	UNSAT TT=821.525 ASSIGNMENTS=28579	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.03	UNSAT TT=159.848 ASSIGNMENTS=180738 CHECKS=395997	UNSAT TT=162.573 ASSIGNMENTS=180738 CHECKS=395997	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=403.078 CHECKS=10695600	UNSAT TT=255.868 ASSIGNMENTS=72007 CHECKS=7473690	UNSAT TT=230.804 ASSIGNMENTS=66358 CHECKS=6728890	? (TO) TT=1800.02	UNSAT TT=224.855 ASSIGNMENTS=63104 CHECKS=6593790	UNSAT TT=202.435 ASSIGNMENTS=57395 CHECKS=6080460	? (MO) TT=31.734	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09
csp/wordsVg/ normalized-crossword-m1c-words-vg6-10_ext.xml	UNSAT TT=68.176	UNSAT TT=74.684 CHECKS=80827 NODES=46555	UNSAT TT=69.459 CHECKS=63229 NODES=38966	? (TO) TT=1800.08	UNSAT TT=1255.31 CHECKS=2136320	UNSAT TT=913.349 CHECKS=1526180	UNSAT TT=157.28 ASSIGNMENTS=5391	UNSAT TT=918.097 ASSIGNMENTS=17271	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=80.856 ASSIGNMENTS=46555 CHECKS=80827	UNSAT TT=81.429 ASSIGNMENTS=46555 CHECKS=80827	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=219.464 CHECKS=2848640	UNSAT TT=85.97 ASSIGNMENTS=15932 CHECKS=2176830	UNSAT TT=85.72 ASSIGNMENTS=16531 CHECKS=2010940	UNSAT TT=874.653	UNSAT TT=68.176 ASSIGNMENTS=14219 CHECKS=1795420	UNSAT TT=72.915 ASSIGNMENTS=13221 CHECKS=1767860	? TT=74.011	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg6-6_ext.xml	SAT TT=0.329	SAT TT=0.984 CHECKS=344 NODES=235	SAT TT=1.155 CHECKS=110 NODES=139	SAT TT=922.487	SAT TT=15.876 CHECKS=54494	SAT TT=3.341 CHECKS=9718	SAT TT=4.33 ASSIGNMENTS=135	SAT TT=8.528 ASSIGNMENTS=284	SAT TT=607.591 CHECKS=3562100000 NODES=373	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=0.89 ASSIGNMENTS=375 CHECKS=25267	SAT TT=0.935 ASSIGNMENTS=375 CHECKS=25267	SAT TT=195.146	SAT TT=129.62	SAT TT=0.329 CHECKS=12398	SAT TT=0.632 ASSIGNMENTS=263 CHECKS=17852	SAT TT=7.361 ASSIGNMENTS=3892 CHECKS=225798	SAT TT=14.558	SAT TT=1.202 ASSIGNMENTS=772 CHECKS=39992	SAT TT=0.871 ASSIGNMENTS=375 CHECKS=25267	? TT=78.757	SAT TT=1.93 ASSIGNMENTS=40 CHECKS=5034760	SAT TT=605.979	SAT TT=395.396
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsVg/ normalized-crossword-m1c-words-vg6-7_ext.xml	UNSAT TT=1005.97	UNSAT TT=1005.97 CHECKS=3474640 NODES=1224090	UNSAT TT=1028.96 CHECKS=3544520 NODES=1241430	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=76.462	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg7-10_ext.xml	UNSAT TT=61.528	UNSAT TT=61.528 CHECKS=48414 NODES=29536	UNSAT TT=62.877 CHECKS=46695 NODES=25763	? (TO) TT=1800.11	UNSAT TT=1767.78 CHECKS=2260520	UNSAT TT=1174.03 CHECKS=1702450	UNSAT TT=599.454 ASSIGNMENTS=14881	UNSAT TT=805.409 ASSIGNMENTS=13360	UNSAT TT=180.598 CHECKS=0 NODES=28641	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=69.717 ASSIGNMENTS=29536 CHECKS=48414	UNSAT TT=67.65 ASSIGNMENTS=29536 CHECKS=48414	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=313.011 CHECKS=2834840	UNSAT TT=120.43 ASSIGNMENTS=18632 CHECKS=2703850	UNSAT TT=128.536 ASSIGNMENTS=20404 CHECKS=2816800	UNSAT TT=943.241	UNSAT TT=104.145 ASSIGNMENTS=16293 CHECKS=2396050	UNSAT TT=117.566 ASSIGNMENTS=18216 CHECKS=2689390	? TT=86.202	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/wordsVg/ normalized-crossword-m1c-words-vg7-11_ext.xml	UNSAT TT=17.7	UNSAT TT=18.683 CHECKS=5627 NODES=6585	UNSAT TT=17.7 CHECKS=3807 NODES=5779	? (TO) TT=1800.04	UNSAT TT=268.487 CHECKS=398580	UNSAT TT=237.829 CHECKS=361626	UNSAT TT=53.081 ASSIGNMENTS=1231	UNSAT TT=154.36 ASSIGNMENTS=2138	UNSAT TT=56.137 CHECKS=0 NODES=7468	? (TO) TT=1800.01	? (TO) TT=1800.09	UNSAT TT=26.322 ASSIGNMENTS=6585 CHECKS=5627	UNSAT TT=27.567 ASSIGNMENTS=6585 CHECKS=5627	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=70.242 CHECKS=569138	UNSAT TT=27.848 ASSIGNMENTS=4119 CHECKS=656014	UNSAT TT=41.782 ASSIGNMENTS=6904 CHECKS=872345	UNSAT TT=275.404	UNSAT TT=30.875 ASSIGNMENTS=4658 CHECKS=672887	UNSAT TT=27.376 ASSIGNMENTS=3794 CHECKS=588277	? TT=89.713	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg7-7_ext.xml	SAT TT=42.386	SAT TT=89.503 CHECKS=245428 NODES=81118	SAT TT=86.625 CHECKS=254815 NODES=80512	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=343.776 ASSIGNMENTS=13195	SAT TT=1516.06 ASSIGNMENTS=38642	SAT TT=72.1 CHECKS=0 NODES=34780	? (TO) TT=1800.01	? (TO) TT=1800.13	SAT TT=62.636 ASSIGNMENTS=56255 CHECKS=191430	SAT TT=64.281 ASSIGNMENTS=56255 CHECKS=191430	? (TO) TT=1800	? (TO) TT=1800	SAT TT=644.918 CHECKS=12405900	SAT TT=228.488 ASSIGNMENTS=47786 CHECKS=5146290	SAT TT=330.483 ASSIGNMENTS=70519 CHECKS=7328750	? (TO) TT=1800.05	SAT TT=42.386 ASSIGNMENTS=9246 CHECKS=1009290	SAT TT=146.834 ASSIGNMENTS=32967 CHECKS=3586880	? TT=87.722	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.04
csp/wordsVg/ normalized-crossword-m1c-words-vg7-8_ext.xml	UNSAT TT=482.525	UNSAT TT=482.525 CHECKS=1306110 NODES=362557	UNSAT TT=540.328 CHECKS=1456270 NODES=402965	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.12	UNSAT TT=1575.42 CHECKS=0 NODES=459316	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=1525.7 CHECKS=24583200	UNSAT TT=1011.57 ASSIGNMENTS=176374 CHECKS=21345000	UNSAT TT=1041.51 ASSIGNMENTS=190386 CHECKS=23437500	? (TO) TT=1800.05	UNSAT TT=1103.11 ASSIGNMENTS=187539 CHECKS=23116300	UNSAT TT=874.042 ASSIGNMENTS=163505 CHECKS=19945100	? TT=88.319	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05
csp/wordsVg/ normalized-crossword-m1c-words-vg7-9_ext.xml	UNSAT TT=205.883	UNSAT TT=229.929 CHECKS=341501 NODES=117941	UNSAT TT=205.883 CHECKS=309939 NODES=104461	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=601.414 ASSIGNMENTS=18012	? (TO) TT=1800.12	UNSAT TT=695.471 CHECKS=0 NODES=152135	? (TO) TT=1800	? (TO) TT=1800.09	UNSAT TT=553.936 ASSIGNMENTS=67552 CHECKS=9134720	UNSAT TT=585.674 ASSIGNMENTS=67552 CHECKS=9134720	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=604.447 CHECKS=6786270	UNSAT TT=530.53 ASSIGNMENTS=81405 CHECKS=11396800	UNSAT TT=390.686 ASSIGNMENTS=60537 CHECKS=8012880	? (TO) TT=1800.09	UNSAT TT=353.875 ASSIGNMENTS=59728 CHECKS=7867780	UNSAT TT=433.659 ASSIGNMENTS=67552 CHECKS=9134720	? TT=86.172	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.04
csp/wordsVg/ normalized-crossword-m1c-words-vg8-11_ext.xml	UNSAT TT=14.987	UNSAT TT=14.987 CHECKS=5427 NODES=3503	UNSAT TT=16.36 CHECKS=4384 NODES=3675	? (TO) TT=1800.05	UNSAT TT=151.909 CHECKS=213522	UNSAT TT=226.321 CHECKS=288234	UNSAT TT=68.522 ASSIGNMENTS=1139	UNSAT TT=108.321 ASSIGNMENTS=1355	UNSAT TT=64.987 CHECKS=0 NODES=7168	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=20.923 ASSIGNMENTS=3503 CHECKS=5427	UNSAT TT=21.123 ASSIGNMENTS=3503 CHECKS=5427	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=54.614 CHECKS=321395	UNSAT TT=17.807 ASSIGNMENTS=2270 CHECKS=383933	UNSAT TT=40.622 ASSIGNMENTS=5935 CHECKS=770052	UNSAT TT=224.578	UNSAT TT=27.874 ASSIGNMENTS=3911 CHECKS=568179	UNSAT TT=18.03 ASSIGNMENTS=2331 CHECKS=385833	? TT=30.182	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08
csp/wordsVg/ normalized-crossword-m1c-words-vg8-12_ext.xml	UNSAT TT=2.994	UNSAT TT=4.533 CHECKS=319 NODES=859	UNSAT TT=5.223 CHECKS=262 NODES=860	? (TO) TT=1800.04	UNSAT TT=81.204 CHECKS=111491	UNSAT TT=47.421 CHECKS=75110	UNSAT TT=27.659 ASSIGNMENTS=214	UNSAT TT=38.474 ASSIGNMENTS=283	UNSAT TT=18.832 CHECKS=0 NODES=1276	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=11.966 ASSIGNMENTS=859 CHECKS=319	UNSAT TT=12.689 ASSIGNMENTS=859 CHECKS=319	UNSAT TT=538.073	UNSAT TT=372.307	UNSAT TT=6.247 CHECKS=39626	UNSAT TT=2.994 ASSIGNMENTS=328 CHECKS=61768	UNSAT TT=25.34 ASSIGNMENTS=4172 CHECKS=530408	UNSAT TT=34.749	UNSAT TT=10.763 ASSIGNMENTS=1718 CHECKS=230100	UNSAT TT=3.039 ASSIGNMENTS=328 CHECKS=62934	? TT=27.252	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800
csp/wordsVg/ normalized-crossword-m1c-words-vg8-8_ext.xml	UNSAT TT=256.285	UNSAT TT=256.285 CHECKS=426947 NODES=134285	UNSAT TT=303.051 CHECKS=519285 NODES=150321	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=1532.94 ASSIGNMENTS=42898	? (TO) TT=1800.14	UNSAT TT=945.495 CHECKS=0 NODES=187913	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=715.543 ASSIGNMENTS=86725 CHECKS=11935100	UNSAT TT=739.616 ASSIGNMENTS=86725 CHECKS=11935100	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=595.667 CHECKS=7742600	UNSAT TT=586.258 ASSIGNMENTS=85013 CHECKS=11811600	UNSAT TT=571.922 ASSIGNMENTS=84026 CHECKS=11362200	? (TO) TT=1800.08	UNSAT TT=526.102 ASSIGNMENTS=82817 CHECKS=11378900	UNSAT TT=559.285 ASSIGNMENTS=86725 CHECKS=11935100	? TT=27.985	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg8-9_ext.xml	UNSAT TT=157.179	UNSAT TT=157.179 CHECKS=203242 NODES=68003	UNSAT TT=206.856 CHECKS=219348 NODES=84429	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=1211.58 ASSIGNMENTS=29613	? (TO) TT=1800.08	UNSAT TT=502.983 CHECKS=0 NODES=79532	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=161.908 ASSIGNMENTS=68003 CHECKS=203242	UNSAT TT=375.816 ASSIGNMENTS=33324 CHECKS=4975340	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=279.881 CHECKS=2741370	UNSAT TT=230.623 ASSIGNMENTS=30065 CHECKS=4530170	UNSAT TT=233.677 ASSIGNMENTS=31296 CHECKS=4457640	? (TO) TT=1800.08	UNSAT TT=215.221 ASSIGNMENTS=28633 CHECKS=4184700	UNSAT TT=236.248 ASSIGNMENTS=33324 CHECKS=4975340	? TT=35.786	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsVg/ normalized-crossword-m1c-words-vg9-10_ext.xml	UNSAT TT=25.952	UNSAT TT=25.952 CHECKS=3137 NODES=5749	UNSAT TT=26.456 CHECKS=3604 NODES=5760	? (TO) TT=1800.07	UNSAT TT=731.397 CHECKS=730952	UNSAT TT=384.645 CHECKS=481514	UNSAT TT=97.258 ASSIGNMENTS=1737	UNSAT TT=1654.54 ASSIGNMENTS=17873	UNSAT TT=83.236 CHECKS=0 NODES=7129	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=31.387 ASSIGNMENTS=5749 CHECKS=3137	UNSAT TT=31.94 ASSIGNMENTS=5749 CHECKS=3137	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=124.13 CHECKS=796497	UNSAT TT=47.702 ASSIGNMENTS=5299 CHECKS=909166	UNSAT TT=55.867 ASSIGNMENTS=7798 CHECKS=1107920	UNSAT TT=344.076	UNSAT TT=45.792 ASSIGNMENTS=5835 CHECKS=879127	UNSAT TT=68.572 ASSIGNMENTS=8274 CHECKS=1297820	? TT=31.916	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03
csp/wordsVg/ normalized-crossword-m1c-words-vg9-11_ext.xml	UNSAT TT=9.688	UNSAT TT=9.688 CHECKS=628 NODES=1930	UNSAT TT=11.253 CHECKS=706 NODES=1898	? (TO) TT=1800.12	UNSAT TT=331.904 CHECKS=360313	UNSAT TT=122.437 CHECKS=151365	UNSAT TT=46.97 ASSIGNMENTS=486	UNSAT TT=84.602 ASSIGNMENTS=897	UNSAT TT=29.583 CHECKS=0 NODES=2185	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=17.041 ASSIGNMENTS=1930 CHECKS=628	UNSAT TT=16.863 ASSIGNMENTS=1930 CHECKS=628	UNSAT TT=948.661	UNSAT TT=1110.34	UNSAT TT=31.108 CHECKS=162880	UNSAT TT=12.807 ASSIGNMENTS=1424 CHECKS=241581	UNSAT TT=35.179 ASSIGNMENTS=4847 CHECKS=657431	UNSAT TT=113.591	UNSAT TT=18.707 ASSIGNMENTS=2778 CHECKS=406946	UNSAT TT=15.741 ASSIGNMENTS=1788 CHECKS=312446	? TT=29.779	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07
csp/wordsVg/ normalized-crossword-m1c-words-vg9-12_ext.xml	UNSAT TT=3.542	UNSAT TT=3.855 CHECKS=72 NODES=593	UNSAT TT=5.1 CHECKS=100 NODES=588	? (TO) TT=1800.14	UNSAT TT=103.125 CHECKS=123784	UNSAT TT=64.532 CHECKS=69241	UNSAT TT=30.268 ASSIGNMENTS=119	UNSAT TT=36.959 ASSIGNMENTS=133	UNSAT TT=10.905 CHECKS=0 NODES=780	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=11.015 ASSIGNMENTS=593 CHECKS=72	UNSAT TT=11.386 ASSIGNMENTS=593 CHECKS=72	UNSAT TT=353.65	UNSAT TT=261.355	UNSAT TT=13.454 CHECKS=62134	UNSAT TT=3.542 ASSIGNMENTS=396 CHECKS=70514	UNSAT TT=26.578 ASSIGNMENTS=3882 CHECKS=499662	UNSAT TT=31.826	UNSAT TT=11.595 ASSIGNMENTS=1776 CHECKS=242355	UNSAT TT=5.186 ASSIGNMENTS=599 CHECKS=102215	? TT=24.807	? (TO) TT=1800.03	UNSAT TT=1550.59	? (TO) TT=1800.07
csp/wordsVg/ normalized-crossword-m1c-words-vg9-13_ext.xml	UNSAT TT=1.217	UNSAT TT=1.769 CHECKS=0 NODES=161	UNSAT TT=4.298 CHECKS=0 NODES=161	? (TO) TT=1800.1	UNSAT TT=62.482 CHECKS=83238	UNSAT TT=28.338 CHECKS=30748	UNSAT TT=25.693 ASSIGNMENTS=0	UNSAT TT=25.182 ASSIGNMENTS=0	UNSAT TT=4.139 CHECKS=0 NODES=214	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=1.241 ASSIGNMENTS=120 CHECKS=24524	UNSAT TT=1.227 ASSIGNMENTS=120 CHECKS=24524	UNSAT TT=124.56	UNSAT TT=77.744	UNSAT TT=5.52 CHECKS=22357	UNSAT TT=1.308 ASSIGNMENTS=138 CHECKS=25506	UNSAT TT=24.231 ASSIGNMENTS=3439 CHECKS=457977	UNSAT TT=16.551	UNSAT TT=8.597 ASSIGNMENTS=1554 CHECKS=181939	UNSAT TT=1.217 ASSIGNMENTS=120 CHECKS=24524	? TT=24.597	? (TO) TT=1800.03	UNSAT TT=567.205	? (TO) TT=1800.02

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	545	541	322	386	391	477	441	544	210	135	586	587	323	326	576	570	406	565	569	218	370	347
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	545	541	322	386	391	477	441	544	210	135	586	587	323	326	576	570	406	565	569	218	370	347
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	37	14	2	5	4	0	0	3	6	0	17	9	0	0	120	133	0	122	138	3	8	15
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0