CSP 2008 Competition: results by benchmark

Results by benchmark for category all categories

This page displays the results of the different solvers for each benchmark for category all categories

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
mddc-solv 2008-06-09
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
spider 2008-06-14
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-100/ normalized-aim-100-1-6-sat-1_ext.xml	SAT TT=0.009	SAT TT=0.837 CHECKS=1705 NODES=236	SAT TT=0.854 CHECKS=3280 NODES=357	SAT TT=30.865	SAT TT=0.013 CHECKS=1438	SAT TT=0.017 CHECKS=4422	SAT TT=0.509 ASSIGNMENTS=15	SAT TT=0.467 ASSIGNMENTS=8	SAT TT=0.423 CHECKS=809 NODES=151	? (TO) TT=1800.04	SAT TT=0.443 CHECKS=153439 NODES=1104	SAT TT=0.022 ASSIGNMENTS=81 CHECKS=2550	SAT TT=0.023 ASSIGNMENTS=81 CHECKS=2550	SAT TT=0.971	SAT TT=1.179	SAT TT=0.057 CHECKS=4633	SAT TT=0.009 ASSIGNMENTS=80 CHECKS=2661	SAT TT=0.035 ASSIGNMENTS=5759 CHECKS=89684	SAT TT=0.431	SAT TT=0.013 ASSIGNMENTS=353 CHECKS=12552	SAT TT=0.011 ASSIGNMENTS=81 CHECKS=2550	SAT TT=0.973	SAT TT=0.025 ASSIGNMENTS=105 CHECKS=1900	SAT TT=0.743	SAT TT=0.742
csp/aim-100/ normalized-aim-100-1-6-sat-2_ext.xml	SAT TT=0.013	SAT TT=0.836 CHECKS=6717 NODES=839	SAT TT=0.862 CHECKS=3778 NODES=490	SAT TT=154.458	SAT TT=0.023 CHECKS=7555	SAT TT=0.041 CHECKS=31706	SAT TT=0.501 ASSIGNMENTS=33	SAT TT=0.479 ASSIGNMENTS=17	SAT TT=0.496 CHECKS=2236 NODES=308	? (TO) TT=1800.05	SAT TT=0.419 CHECKS=145002 NODES=943	SAT TT=0.024 ASSIGNMENTS=274 CHECKS=7201	SAT TT=0.025 ASSIGNMENTS=274 CHECKS=7201	SAT TT=1.1	SAT TT=0.909	SAT TT=0.046 CHECKS=9881	SAT TT=0.013 ASSIGNMENTS=407 CHECKS=10178	SAT TT=0.031 ASSIGNMENTS=5908 CHECKS=85589	SAT TT=0.427	SAT TT=0.013 ASSIGNMENTS=357 CHECKS=8522	SAT TT=0.013 ASSIGNMENTS=274 CHECKS=7201	SAT TT=0.873	SAT TT=0.026 ASSIGNMENTS=227 CHECKS=5363	SAT TT=0.661	SAT TT=0.694
csp/aim-100/ normalized-aim-100-1-6-sat-3_ext.xml	SAT TT=0.011	SAT TT=0.837 CHECKS=5946 NODES=929	SAT TT=0.968 CHECKS=7737 NODES=937	SAT TT=110.652	SAT TT=0.014 CHECKS=3166	SAT TT=0.038 CHECKS=30860	SAT TT=0.527 ASSIGNMENTS=273	SAT TT=0.553 ASSIGNMENTS=327	SAT TT=0.449 CHECKS=1065 NODES=174	? (TO) TT=1800.06	SAT TT=2.144 CHECKS=12091200 NODES=73135	SAT TT=0.022 ASSIGNMENTS=203 CHECKS=5090	SAT TT=0.022 ASSIGNMENTS=203 CHECKS=5090	SAT TT=0.906	SAT TT=0.975	SAT TT=0.045 CHECKS=10042	SAT TT=0.012 ASSIGNMENTS=413 CHECKS=10441	SAT TT=0.03 ASSIGNMENTS=6055 CHECKS=77553	SAT TT=0.346	SAT TT=0.012 ASSIGNMENTS=372 CHECKS=6794	SAT TT=0.011 ASSIGNMENTS=203 CHECKS=5090	SAT TT=0.902	SAT TT=0.041 ASSIGNMENTS=540 CHECKS=25724	SAT TT=0.645	SAT TT=0.689
csp/aim-100/ normalized-aim-100-1-6-sat-4_ext.xml	SAT TT=0.011	SAT TT=0.77 CHECKS=1103 NODES=215	SAT TT=0.819 CHECKS=1526 NODES=212	SAT TT=1.302	SAT TT=0.022 CHECKS=7911	SAT TT=0.02 CHECKS=7522	SAT TT=0.528 ASSIGNMENTS=230	SAT TT=0.552 ASSIGNMENTS=79	SAT TT=0.4 CHECKS=1190 NODES=177	? (TO) TT=1800.05	SAT TT=0.501 CHECKS=298671 NODES=1688	SAT TT=0.023 ASSIGNMENTS=168 CHECKS=4432	SAT TT=0.023 ASSIGNMENTS=168 CHECKS=4432	SAT TT=0.929	SAT TT=1.105	SAT TT=0.039 CHECKS=2257	SAT TT=0.012 ASSIGNMENTS=186 CHECKS=4657	SAT TT=0.032 ASSIGNMENTS=5793 CHECKS=86640	SAT TT=0.354	SAT TT=0.011 ASSIGNMENTS=265 CHECKS=4661	SAT TT=0.011 ASSIGNMENTS=168 CHECKS=4432	SAT TT=0.805	SAT TT=0.024 ASSIGNMENTS=317 CHECKS=15269	SAT TT=0.696	SAT TT=0.648
csp/aim-100/ normalized-aim-100-1-6-unsat-1_ext.xml	UNSAT TT=0.023	UNSAT TT=1.061 CHECKS=54585 NODES=5225	UNSAT TT=1.07 CHECKS=50025 NODES=4694	? (TO) TT=1800.04	UNSAT TT=0.102 CHECKS=61774	UNSAT TT=0.089 CHECKS=64928	UNSAT TT=1.032 ASSIGNMENTS=5914	UNSAT TT=0.82 ASSIGNMENTS=1391	UNSAT TT=0.456 CHECKS=7064 NODES=589	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=0.041 ASSIGNMENTS=2886 CHECKS=60434	UNSAT TT=0.04 ASSIGNMENTS=2886 CHECKS=60434	UNSAT TT=0.565	UNSAT TT=0.696	UNSAT TT=0.07 CHECKS=26332	UNSAT TT=0.024 ASSIGNMENTS=2881 CHECKS=63131	UNSAT TT=0.031 ASSIGNMENTS=8029 CHECKS=90757	UNSAT TT=0.445	UNSAT TT=0.023 ASSIGNMENTS=2017 CHECKS=35977	UNSAT TT=0.025 ASSIGNMENTS=2886 CHECKS=60434	UNSAT TT=0.821	UNSAT TT=0.066 ASSIGNMENTS=887 CHECKS=32392	UNSAT TT=0.66	UNSAT TT=0.648
csp/aim-100/ normalized-aim-100-1-6-unsat-2_ext.xml	UNSAT TT=0.015	UNSAT TT=0.962 CHECKS=19505 NODES=1835	UNSAT TT=0.926 CHECKS=19461 NODES=1768	UNSAT TT=201.423	UNSAT TT=0.058 CHECKS=29844	UNSAT TT=0.171 CHECKS=131979	UNSAT TT=0.712 ASSIGNMENTS=1705	UNSAT TT=0.607 ASSIGNMENTS=388	UNSAT TT=0.525 CHECKS=5820 NODES=494	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=0.04 ASSIGNMENTS=2271 CHECKS=56365	UNSAT TT=0.037 ASSIGNMENTS=2271 CHECKS=56365	UNSAT TT=0.572	UNSAT TT=0.57	UNSAT TT=0.069 CHECKS=25720	UNSAT TT=0.028 ASSIGNMENTS=2350 CHECKS=61699	UNSAT TT=0.038 ASSIGNMENTS=7613 CHECKS=107465	UNSAT TT=0.366	UNSAT TT=0.015 ASSIGNMENTS=620 CHECKS=13227	UNSAT TT=0.023 ASSIGNMENTS=2271 CHECKS=56365	UNSAT TT=0.799	UNSAT TT=0.059 ASSIGNMENTS=1466 CHECKS=65779	UNSAT TT=0.65	UNSAT TT=0.678
csp/aim-100/ normalized-aim-100-1-6-unsat-3_ext.xml	UNSAT TT=0.068	UNSAT TT=1.089 CHECKS=71698 NODES=6813	UNSAT TT=1.282 CHECKS=105326 NODES=9372	? (TO) TT=1800.08	UNSAT TT=0.448 CHECKS=317483	UNSAT TT=0.226 CHECKS=192589	UNSAT TT=2.701 ASSIGNMENTS=27877	UNSAT TT=0.713 ASSIGNMENTS=1207	UNSAT TT=0.898 CHECKS=114616 NODES=7084	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.09 ASSIGNMENTS=10409 CHECKS=226716	UNSAT TT=0.094 ASSIGNMENTS=10409 CHECKS=226716	UNSAT TT=0.715	UNSAT TT=0.557	UNSAT TT=0.127 CHECKS=72138	UNSAT TT=0.068 ASSIGNMENTS=9660 CHECKS=213423	UNSAT TT=0.067 ASSIGNMENTS=13197 CHECKS=210238	UNSAT TT=0.618	UNSAT TT=0.084 ASSIGNMENTS=10146 CHECKS=239740	UNSAT TT=0.07 ASSIGNMENTS=10409 CHECKS=226716	UNSAT TT=0.817	UNSAT TT=0.617 ASSIGNMENTS=21358 CHECKS=700509	UNSAT TT=0.668	UNSAT TT=0.689
csp/aim-100/ normalized-aim-100-1-6-unsat-4_ext.xml	UNSAT TT=0.028	UNSAT TT=1.012 CHECKS=28155 NODES=3311	UNSAT TT=1.02 CHECKS=33338 NODES=3713	? (TO) TT=1800.1	UNSAT TT=0.145 CHECKS=87309	UNSAT TT=0.15 CHECKS=118548	UNSAT TT=1.276 ASSIGNMENTS=8856	UNSAT TT=1.814 ASSIGNMENTS=11034	UNSAT TT=0.47 CHECKS=6361 NODES=596	? (TO) TT=1800.09	? (TO) TT=1800	UNSAT TT=0.076 ASSIGNMENTS=8133 CHECKS=178844	UNSAT TT=0.077 ASSIGNMENTS=8133 CHECKS=178844	UNSAT TT=0.705	UNSAT TT=0.564	UNSAT TT=0.071 CHECKS=21643	UNSAT TT=0.037 ASSIGNMENTS=5255 CHECKS=118129	UNSAT TT=0.034 ASSIGNMENTS=8264 CHECKS=82592	UNSAT TT=0.441	UNSAT TT=0.028 ASSIGNMENTS=2732 CHECKS=52884	UNSAT TT=0.052 ASSIGNMENTS=8133 CHECKS=178844	UNSAT TT=0.868	UNSAT TT=0.085 ASSIGNMENTS=2108 CHECKS=68085	UNSAT TT=0.666	UNSAT TT=0.705
csp/aim-100/ normalized-aim-100-2-0-sat-1_ext.xml	SAT TT=0.013	SAT TT=0.868 CHECKS=6443 NODES=838	SAT TT=0.929 CHECKS=8534 NODES=938	SAT TT=193.579	SAT TT=0.066 CHECKS=40312	SAT TT=0.036 CHECKS=23149	SAT TT=0.638 ASSIGNMENTS=707	SAT TT=0.834 ASSIGNMENTS=1272	SAT TT=0.537 CHECKS=3027 NODES=272	SAT TT=18.447 CHECKS=66901000 NODES=3076570	SAT TT=0.59 CHECKS=1001320 NODES=5272	SAT TT=0.024 ASSIGNMENTS=490 CHECKS=12713	SAT TT=0.026 ASSIGNMENTS=490 CHECKS=12713	SAT TT=1.076	SAT TT=0.94	SAT TT=0.049 CHECKS=11863	SAT TT=0.015 ASSIGNMENTS=561 CHECKS=19429	SAT TT=0.043 ASSIGNMENTS=5316 CHECKS=136211	SAT TT=0.392	SAT TT=0.013 ASSIGNMENTS=450 CHECKS=9729	SAT TT=0.013 ASSIGNMENTS=490 CHECKS=12713	SAT TT=0.827	SAT TT=0.065 ASSIGNMENTS=1130 CHECKS=63380	SAT TT=0.735	SAT TT=0.708
csp/aim-100/ normalized-aim-100-2-0-sat-2_ext.xml	SAT TT=0.016	SAT TT=0.96 CHECKS=26691 NODES=2591	SAT TT=1.025 CHECKS=25652 NODES=2414	SAT TT=54.542	SAT TT=0.178 CHECKS=151621	SAT TT=0.136 CHECKS=154655	SAT TT=0.896 ASSIGNMENTS=2354	SAT TT=1.103 ASSIGNMENTS=3374	SAT TT=0.525 CHECKS=19967 NODES=928	SAT TT=604.591 CHECKS=2285100000 NODES=100912000	SAT TT=1532.64 CHECKS=11544600000 NODES=31098400	SAT TT=0.031 ASSIGNMENTS=822 CHECKS=33873	SAT TT=0.03 ASSIGNMENTS=822 CHECKS=33873	SAT TT=1.025	SAT TT=1.244	SAT TT=0.065 CHECKS=32651	SAT TT=0.016 ASSIGNMENTS=800 CHECKS=32848	SAT TT=0.044 ASSIGNMENTS=5354 CHECKS=142545	SAT TT=0.406	SAT TT=0.016 ASSIGNMENTS=585 CHECKS=17249	SAT TT=0.019 ASSIGNMENTS=822 CHECKS=33873	SAT TT=0.876	SAT TT=0.076 ASSIGNMENTS=639 CHECKS=29969	SAT TT=0.673	SAT TT=0.796
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-100/ normalized-aim-100-2-0-sat-3_ext.xml	SAT TT=0.013	SAT TT=0.859 CHECKS=5023 NODES=570	SAT TT=0.822 CHECKS=1673 NODES=233	SAT TT=2.442	SAT TT=0.015 CHECKS=4055	SAT TT=0.118 CHECKS=147710	SAT TT=0.591 ASSIGNMENTS=338	SAT TT=0.485 ASSIGNMENTS=7	SAT TT=0.524 CHECKS=2766 NODES=256	SAT TT=439.907 CHECKS=1594820000 NODES=77786100	? (TO) TT=1800.04	SAT TT=0.034 ASSIGNMENTS=968 CHECKS=42795	SAT TT=0.033 ASSIGNMENTS=968 CHECKS=42795	SAT TT=1.124	SAT TT=1.032	SAT TT=0.077 CHECKS=12697	SAT TT=0.023 ASSIGNMENTS=1443 CHECKS=55357	SAT TT=0.046 ASSIGNMENTS=5382 CHECKS=136304	SAT TT=0.441	SAT TT=0.013 ASSIGNMENTS=563 CHECKS=15966	SAT TT=0.02 ASSIGNMENTS=968 CHECKS=42795	SAT TT=1.007	SAT TT=0.055 ASSIGNMENTS=724 CHECKS=31913	SAT TT=0.748	SAT TT=0.719
csp/aim-100/ normalized-aim-100-2-0-sat-4_ext.xml	SAT TT=0.015	SAT TT=0.923 CHECKS=8479 NODES=977	SAT TT=0.891 CHECKS=10400 NODES=1197	SAT TT=332.479	SAT TT=0.089 CHECKS=63789	SAT TT=0.058 CHECKS=65978	SAT TT=0.574 ASSIGNMENTS=279	SAT TT=0.682 ASSIGNMENTS=768	SAT TT=0.424 CHECKS=2819 NODES=255	SAT TT=796.756 CHECKS=3027680000 NODES=143701000	SAT TT=0.515 CHECKS=173781 NODES=1221	SAT TT=0.026 ASSIGNMENTS=271 CHECKS=12723	SAT TT=0.019 ASSIGNMENTS=271 CHECKS=12723	SAT TT=1.04	SAT TT=1.096	SAT TT=0.065 CHECKS=19179	SAT TT=0.015 ASSIGNMENTS=445 CHECKS=23246	SAT TT=0.045 ASSIGNMENTS=5460 CHECKS=141277	SAT TT=0.417	SAT TT=0.025 ASSIGNMENTS=1439 CHECKS=58079	SAT TT=0.015 ASSIGNMENTS=271 CHECKS=12723	SAT TT=0.891	SAT TT=0.033 ASSIGNMENTS=247 CHECKS=7456	SAT TT=0.676	SAT TT=0.713
csp/aim-100/ normalized-aim-100-2-0-unsat-1_ext.xml	UNSAT TT=0.011	UNSAT TT=0.812 CHECKS=1576 NODES=238	UNSAT TT=0.803 CHECKS=1036 NODES=147	UNSAT TT=388.858	UNSAT TT=0.024 CHECKS=6978	UNSAT TT=0.025 CHECKS=10526	UNSAT TT=0.533 ASSIGNMENTS=203	UNSAT TT=0.664 ASSIGNMENTS=120	UNSAT TT=0.435 CHECKS=1422 NODES=89	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.025 ASSIGNMENTS=181 CHECKS=6009	UNSAT TT=0.025 ASSIGNMENTS=181 CHECKS=6009	UNSAT TT=0.804	UNSAT TT=0.601	UNSAT TT=0.04 CHECKS=2754	UNSAT TT=0.013 ASSIGNMENTS=173 CHECKS=5951	UNSAT TT=0.041 ASSIGNMENTS=5820 CHECKS=122320	UNSAT TT=0.397	UNSAT TT=0.012 ASSIGNMENTS=228 CHECKS=3612	UNSAT TT=0.011 ASSIGNMENTS=181 CHECKS=6009	UNSAT TT=0.876	UNSAT TT=0.023 ASSIGNMENTS=74 CHECKS=3047	UNSAT TT=0.74	UNSAT TT=0.741
csp/aim-100/ normalized-aim-100-2-0-unsat-2_ext.xml	UNSAT TT=0.013	UNSAT TT=0.99 CHECKS=8547 NODES=869	UNSAT TT=0.945 CHECKS=15082 NODES=1327	? (TO) TT=1800.07	UNSAT TT=0.079 CHECKS=49886	UNSAT TT=0.135 CHECKS=119309	UNSAT TT=0.671 ASSIGNMENTS=957	UNSAT TT=0.602 ASSIGNMENTS=371	UNSAT TT=0.481 CHECKS=7666 NODES=439	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.027 ASSIGNMENTS=872 CHECKS=26851	UNSAT TT=0.029 ASSIGNMENTS=872 CHECKS=26851	UNSAT TT=0.615	UNSAT TT=0.739	UNSAT TT=0.059 CHECKS=15480	UNSAT TT=0.017 ASSIGNMENTS=875 CHECKS=27836	UNSAT TT=0.043 ASSIGNMENTS=5835 CHECKS=130309	UNSAT TT=0.393	UNSAT TT=0.013 ASSIGNMENTS=427 CHECKS=8833	UNSAT TT=0.018 ASSIGNMENTS=872 CHECKS=26851	UNSAT TT=0.872	UNSAT TT=0.032 ASSIGNMENTS=263 CHECKS=13063	UNSAT TT=0.74	UNSAT TT=0.711
csp/aim-100/ normalized-aim-100-2-0-unsat-3_ext.xml	UNSAT TT=0.014	UNSAT TT=0.875 CHECKS=5497 NODES=672	UNSAT TT=0.88 CHECKS=4609 NODES=485	? (TO) TT=1800.05	UNSAT TT=0.098 CHECKS=61315	UNSAT TT=0.075 CHECKS=60036	UNSAT TT=0.765 ASSIGNMENTS=1532	UNSAT TT=1.178 ASSIGNMENTS=3895	UNSAT TT=0.439 CHECKS=1450 NODES=118	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.027 ASSIGNMENTS=718 CHECKS=17966	UNSAT TT=0.027 ASSIGNMENTS=718 CHECKS=17966	UNSAT TT=0.607	UNSAT TT=0.716	UNSAT TT=0.055 CHECKS=14314	UNSAT TT=0.016 ASSIGNMENTS=781 CHECKS=21279	UNSAT TT=0.043 ASSIGNMENTS=5849 CHECKS=128601	UNSAT TT=0.426	UNSAT TT=0.014 ASSIGNMENTS=311 CHECKS=5465	UNSAT TT=0.014 ASSIGNMENTS=718 CHECKS=17966	UNSAT TT=0.813	UNSAT TT=0.033 ASSIGNMENTS=428 CHECKS=20560	UNSAT TT=0.71	UNSAT TT=0.708
csp/aim-100/ normalized-aim-100-2-0-unsat-4_ext.xml	UNSAT TT=0.013	UNSAT TT=0.87 CHECKS=4386 NODES=605	UNSAT TT=0.871 CHECKS=4646 NODES=533	? (TO) TT=1800.07	UNSAT TT=0.057 CHECKS=28397	UNSAT TT=0.048 CHECKS=33238	UNSAT TT=0.678 ASSIGNMENTS=1228	UNSAT TT=0.748 ASSIGNMENTS=860	UNSAT TT=0.438 CHECKS=1931 NODES=160	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=0.027 ASSIGNMENTS=1286 CHECKS=26574	UNSAT TT=0.03 ASSIGNMENTS=1286 CHECKS=26574	UNSAT TT=0.595	UNSAT TT=0.592	UNSAT TT=0.061 CHECKS=12185	UNSAT TT=0.015 ASSIGNMENTS=693 CHECKS=17969	UNSAT TT=0.047 ASSIGNMENTS=6023 CHECKS=128980	UNSAT TT=0.394	UNSAT TT=0.013 ASSIGNMENTS=392 CHECKS=8781	UNSAT TT=0.017 ASSIGNMENTS=1286 CHECKS=26574	UNSAT TT=0.868	UNSAT TT=0.029 ASSIGNMENTS=316 CHECKS=20565	UNSAT TT=0.728	UNSAT TT=0.734
csp/aim-100/ normalized-aim-100-3-4-sat-1_ext.xml	SAT TT=0.017	SAT TT=0.943 CHECKS=6661 NODES=482	SAT TT=0.983 CHECKS=4564 NODES=260	SAT TT=0.096	SAT TT=0.04 CHECKS=20518	SAT TT=0.059 CHECKS=47645	SAT TT=0.588 ASSIGNMENTS=72	SAT TT=0.65 ASSIGNMENTS=43	SAT TT=0.49 CHECKS=6534 NODES=225	SAT TT=0.598 CHECKS=513932 NODES=13417	SAT TT=0.752 CHECKS=1443200 NODES=6733	SAT TT=0.031 ASSIGNMENTS=294 CHECKS=39044	SAT TT=0.034 ASSIGNMENTS=294 CHECKS=39044	SAT TT=1.109	SAT TT=1.333	SAT TT=0.073 CHECKS=26182	SAT TT=0.017 ASSIGNMENTS=146 CHECKS=12809	SAT TT=0.023 ASSIGNMENTS=502 CHECKS=47403	SAT TT=0.522	SAT TT=0.018 ASSIGNMENTS=288 CHECKS=24805	SAT TT=0.022 ASSIGNMENTS=294 CHECKS=39044	SAT TT=1.08	SAT TT=0.036 ASSIGNMENTS=356 CHECKS=32039	SAT TT=0.804	SAT TT=0.932
csp/aim-100/ normalized-aim-100-3-4-sat-2_ext.xml	SAT TT=0.016	SAT TT=0.941 CHECKS=15528 NODES=937	SAT TT=0.981 CHECKS=6237 NODES=487	SAT TT=0.138	SAT TT=0.045 CHECKS=25461	SAT TT=0.18 CHECKS=214568	SAT TT=0.757 ASSIGNMENTS=456	SAT TT=0.762 ASSIGNMENTS=225	SAT TT=0.5 CHECKS=5724 NODES=223	SAT TT=0.519 CHECKS=66552 NODES=1641	SAT TT=0.507 CHECKS=67361 NODES=597	SAT TT=0.027 ASSIGNMENTS=76 CHECKS=6737	SAT TT=0.027 ASSIGNMENTS=76 CHECKS=6737	SAT TT=1.25	SAT TT=1.214	SAT TT=0.078 CHECKS=22749	SAT TT=0.016 ASSIGNMENTS=112 CHECKS=11424	SAT TT=0.107 ASSIGNMENTS=4400 CHECKS=410169	SAT TT=0.528	SAT TT=0.018 ASSIGNMENTS=238 CHECKS=13364	SAT TT=0.016 ASSIGNMENTS=76 CHECKS=6737	SAT TT=1.007	SAT TT=0.037 ASSIGNMENTS=127 CHECKS=10643	SAT TT=0.879	SAT TT=0.921
csp/aim-100/ normalized-aim-100-3-4-sat-3_ext.xml	SAT TT=0.017	SAT TT=0.946 CHECKS=8184 NODES=554	SAT TT=1.105 CHECKS=6108 NODES=383	SAT TT=0.404	SAT TT=0.049 CHECKS=27040	SAT TT=0.079 CHECKS=81656	SAT TT=0.668 ASSIGNMENTS=237	SAT TT=0.854 ASSIGNMENTS=407	SAT TT=0.498 CHECKS=12536 NODES=319	SAT TT=1.883 CHECKS=5109430 NODES=135596	SAT TT=0.605 CHECKS=884700 NODES=4991	SAT TT=0.029 ASSIGNMENTS=213 CHECKS=24325	SAT TT=0.03 ASSIGNMENTS=213 CHECKS=24325	SAT TT=1.368	SAT TT=1.116	SAT TT=0.073 CHECKS=18507	SAT TT=0.017 ASSIGNMENTS=179 CHECKS=19251	SAT TT=0.101 ASSIGNMENTS=4148 CHECKS=370323	SAT TT=0.513	SAT TT=0.017 ASSIGNMENTS=195 CHECKS=12246	SAT TT=0.018 ASSIGNMENTS=213 CHECKS=24325	SAT TT=1.064	SAT TT=0.045 ASSIGNMENTS=306 CHECKS=35529	SAT TT=0.82	SAT TT=0.8
csp/aim-100/ normalized-aim-100-3-4-sat-4_ext.xml	SAT TT=0.015	SAT TT=1.043 CHECKS=12276 NODES=818	SAT TT=0.999 CHECKS=14267 NODES=951	SAT TT=0.122	SAT TT=0.038 CHECKS=16731	SAT TT=0.085 CHECKS=97262	SAT TT=0.753 ASSIGNMENTS=223	SAT TT=0.623 ASSIGNMENTS=78	SAT TT=0.501 CHECKS=3037 NODES=152	SAT TT=0.591 CHECKS=462611 NODES=12097	SAT TT=0.5 CHECKS=42780 NODES=370	SAT TT=0.027 ASSIGNMENTS=85 CHECKS=8617	SAT TT=0.028 ASSIGNMENTS=85 CHECKS=8617	SAT TT=1.115	SAT TT=1.184	SAT TT=0.062 CHECKS=7732	SAT TT=0.016 ASSIGNMENTS=102 CHECKS=11081	SAT TT=0.087 ASSIGNMENTS=4132 CHECKS=349463	SAT TT=0.442	SAT TT=0.023 ASSIGNMENTS=432 CHECKS=38569	SAT TT=0.015 ASSIGNMENTS=85 CHECKS=8617	SAT TT=0.961	SAT TT=0.057 ASSIGNMENTS=347 CHECKS=41517	SAT TT=0.831	SAT TT=0.872
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-100/ normalized-aim-100-6-0-sat-1_ext.xml	SAT TT=0.016	SAT TT=0.965 CHECKS=2044 NODES=127	SAT TT=0.982 CHECKS=2530 NODES=0	SAT TT=0.111	SAT TT=0.028 CHECKS=6997	SAT TT=0.033 CHECKS=12271	SAT TT=0.605 ASSIGNMENTS=1	SAT TT=0.622 ASSIGNMENTS=1	SAT TT=0.548 CHECKS=3151 NODES=123	SAT TT=3.935 CHECKS=10146500 NODES=150955	SAT TT=0.588 CHECKS=46368 NODES=200	SAT TT=0.032 ASSIGNMENTS=23 CHECKS=7338	SAT TT=0.033 ASSIGNMENTS=23 CHECKS=7338	SAT TT=1.338	SAT TT=1.222	SAT TT=0.067 CHECKS=4888	SAT TT=0.016 ASSIGNMENTS=17 CHECKS=3926	SAT TT=0.02 ASSIGNMENTS=32 CHECKS=9463	SAT TT=0.523	SAT TT=0.02 ASSIGNMENTS=66 CHECKS=5961	SAT TT=0.018 ASSIGNMENTS=23 CHECKS=7338	SAT TT=1.076	SAT TT=0.043 ASSIGNMENTS=146 CHECKS=24760	SAT TT=0.969	SAT TT=1.051
csp/aim-100/ normalized-aim-100-6-0-sat-2_ext.xml	SAT TT=0.018	SAT TT=1.039 CHECKS=4821 NODES=226	SAT TT=1.02 CHECKS=5772 NODES=210	SAT TT=0.118	SAT TT=0.041 CHECKS=15112	SAT TT=0.032 CHECKS=10693	SAT TT=0.792 ASSIGNMENTS=1	SAT TT=0.624 ASSIGNMENTS=1	SAT TT=0.694 CHECKS=2725 NODES=115	SAT TT=0.808 CHECKS=23695 NODES=236	SAT TT=0.598 CHECKS=63307 NODES=347	SAT TT=0.032 ASSIGNMENTS=27 CHECKS=6514	SAT TT=0.032 ASSIGNMENTS=27 CHECKS=6514	SAT TT=1.435	SAT TT=1.296	SAT TT=0.073 CHECKS=4909	SAT TT=0.02 ASSIGNMENTS=18 CHECKS=5475	SAT TT=0.024 ASSIGNMENTS=128 CHECKS=26139	SAT TT=0.56	SAT TT=0.018 ASSIGNMENTS=31 CHECKS=4629	SAT TT=0.021 ASSIGNMENTS=27 CHECKS=6514	SAT TT=1.14	SAT TT=0.043 ASSIGNMENTS=154 CHECKS=23821	SAT TT=0.904	SAT TT=1.104
csp/aim-100/ normalized-aim-100-6-0-sat-3_ext.xml	SAT TT=0.019	SAT TT=0.92 CHECKS=1876 NODES=116	SAT TT=0.938 CHECKS=3048 NODES=0	SAT TT=0.089	SAT TT=0.029 CHECKS=6762	SAT TT=0.031 CHECKS=11254	SAT TT=0.782 ASSIGNMENTS=1	SAT TT=0.633 ASSIGNMENTS=1	SAT TT=0.598 CHECKS=4664 NODES=146	SAT TT=3.681 CHECKS=10094400 NODES=150168	SAT TT=0.593 CHECKS=46215 NODES=171	SAT TT=0.032 ASSIGNMENTS=30 CHECKS=7329	SAT TT=0.033 ASSIGNMENTS=30 CHECKS=7329	SAT TT=1.445	SAT TT=1.222	SAT TT=0.068 CHECKS=5839	SAT TT=0.019 ASSIGNMENTS=22 CHECKS=6290	SAT TT=0.021 ASSIGNMENTS=72 CHECKS=13300	SAT TT=0.631	SAT TT=0.02 ASSIGNMENTS=65 CHECKS=5689	SAT TT=0.019 ASSIGNMENTS=30 CHECKS=7329	SAT TT=1.114	SAT TT=0.044 ASSIGNMENTS=172 CHECKS=29147	SAT TT=0.898	SAT TT=0.864
csp/aim-100/ normalized-aim-100-6-0-sat-4_ext.xml	SAT TT=0.017	SAT TT=1.004 CHECKS=3682 NODES=177	SAT TT=1.05 CHECKS=7157 NODES=289	SAT TT=0.121	SAT TT=0.034 CHECKS=11086	SAT TT=0.026 CHECKS=4382	SAT TT=0.78 ASSIGNMENTS=1	SAT TT=0.719 ASSIGNMENTS=1	SAT TT=0.632 CHECKS=7841 NODES=182	SAT TT=6.771 CHECKS=20423200 NODES=300527	SAT TT=0.593 CHECKS=34954 NODES=70	SAT TT=0.03 ASSIGNMENTS=4 CHECKS=1706	SAT TT=0.031 ASSIGNMENTS=4 CHECKS=1706	SAT TT=1.352	SAT TT=1.318	SAT TT=0.072 CHECKS=1088	SAT TT=0.019 ASSIGNMENTS=4 CHECKS=1706	SAT TT=0.021 ASSIGNMENTS=57 CHECKS=12723	SAT TT=0.525	SAT TT=0.017 ASSIGNMENTS=19 CHECKS=2722	SAT TT=0.018 ASSIGNMENTS=4 CHECKS=1706	SAT TT=1.131	SAT TT=0.054 ASSIGNMENTS=200 CHECKS=39342	SAT TT=0.911	SAT TT=0.927
csp/aim-200/ normalized-aim-200-1-6-sat-1_ext.xml	SAT TT=0.021	SAT TT=1.023 CHECKS=11029 NODES=1166	SAT TT=1.009 CHECKS=11207 NODES=1361	? (TO) TT=1800.1	SAT TT=0.025 CHECKS=5722	SAT TT=0.204 CHECKS=165656	SAT TT=0.641 ASSIGNMENTS=109	SAT TT=0.743 ASSIGNMENTS=19	SAT TT=0.603 CHECKS=8905 NODES=650	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=0.037 ASSIGNMENTS=1258 CHECKS=41486	SAT TT=0.039 ASSIGNMENTS=1258 CHECKS=41486	SAT TT=1.269	SAT TT=1.478	SAT TT=0.071 CHECKS=11265	SAT TT=0.021 ASSIGNMENTS=609 CHECKS=20957	SAT TT=0.05 ASSIGNMENTS=9439 CHECKS=133351	SAT TT=0.498	SAT TT=0.036 ASSIGNMENTS=1849 CHECKS=77436	SAT TT=0.024 ASSIGNMENTS=1258 CHECKS=41486	SAT TT=1.097	SAT TT=0.097 ASSIGNMENTS=1397 CHECKS=86627	SAT TT=0.945	SAT TT=1.021
csp/aim-200/ normalized-aim-200-1-6-sat-2_ext.xml	SAT TT=0.026	SAT TT=1.038 CHECKS=21578 NODES=2333	SAT TT=1.121 CHECKS=27461 NODES=2783	? (TO) TT=1800.1	SAT TT=0.026 CHECKS=7575	SAT TT=0.128 CHECKS=90276	SAT TT=0.853 ASSIGNMENTS=1705	SAT TT=1.215 ASSIGNMENTS=2429	SAT TT=0.661 CHECKS=19083 NODES=1445	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.044 ASSIGNMENTS=1785 CHECKS=71585	SAT TT=0.047 ASSIGNMENTS=1785 CHECKS=71585	SAT TT=1.26	SAT TT=1.469	SAT TT=0.112 CHECKS=63908	SAT TT=0.027 ASSIGNMENTS=1700 CHECKS=57651	SAT TT=0.047 ASSIGNMENTS=8708 CHECKS=122936	SAT TT=0.512	SAT TT=0.04 ASSIGNMENTS=2623 CHECKS=85927	SAT TT=0.03 ASSIGNMENTS=1785 CHECKS=71585	SAT TT=1.222	SAT TT=0.102 ASSIGNMENTS=530 CHECKS=35411	SAT TT=0.819	SAT TT=0.82
csp/aim-200/ normalized-aim-200-1-6-sat-3_ext.xml	SAT TT=0.023	SAT TT=1.179 CHECKS=32189 NODES=2509	SAT TT=1.069 CHECKS=15908 NODES=1648	? (TO) TT=1800.03	SAT TT=0.025 CHECKS=8897	SAT TT=0.146 CHECKS=106726	SAT TT=0.849 ASSIGNMENTS=1238	SAT TT=1.042 ASSIGNMENTS=1571	SAT TT=0.623 CHECKS=15885 NODES=959	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=0.045 ASSIGNMENTS=1565 CHECKS=70607	SAT TT=0.044 ASSIGNMENTS=1565 CHECKS=70607	SAT TT=1.481	SAT TT=1.238	SAT TT=0.116 CHECKS=76676	SAT TT=0.031 ASSIGNMENTS=1334 CHECKS=71623	SAT TT=0.042 ASSIGNMENTS=8616 CHECKS=102589	SAT TT=0.503	SAT TT=0.023 ASSIGNMENTS=986 CHECKS=25428	SAT TT=0.033 ASSIGNMENTS=1565 CHECKS=70607	SAT TT=1.179	SAT TT=0.132 ASSIGNMENTS=527 CHECKS=25946	SAT TT=0.954	SAT TT=1.016
csp/aim-200/ normalized-aim-200-1-6-sat-4_ext.xml	SAT TT=0.018	SAT TT=0.964 CHECKS=7397 NODES=1227	SAT TT=0.992 CHECKS=8749 NODES=1302	? (TO) TT=1800.08	SAT TT=0.832 CHECKS=539750	SAT TT=0.222 CHECKS=158736	SAT TT=0.809 ASSIGNMENTS=1357	SAT TT=1.338 ASSIGNMENTS=3798	SAT TT=0.632 CHECKS=7270 NODES=805	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=0.357 ASSIGNMENTS=41221 CHECKS=1176040	SAT TT=0.358 ASSIGNMENTS=41221 CHECKS=1176040	SAT TT=1.212	SAT TT=1.349	SAT TT=0.137 CHECKS=59179	SAT TT=0.05 ASSIGNMENTS=3998 CHECKS=144523	SAT TT=0.053 ASSIGNMENTS=9562 CHECKS=142737	SAT TT=0.512	SAT TT=0.018 ASSIGNMENTS=754 CHECKS=15506	SAT TT=0.303 ASSIGNMENTS=41221 CHECKS=1176040	SAT TT=1.168	SAT TT=0.174 ASSIGNMENTS=615 CHECKS=26419	SAT TT=0.896	SAT TT=1.013
csp/aim-200/ normalized-aim-200-1-6-unsat-1_ext.xml	UNSAT TT=0.1	UNSAT TT=1.264 CHECKS=67766 NODES=6260	UNSAT TT=1.451 CHECKS=110235 NODES=9963	? (TO) TT=1800.04	UNSAT TT=0.256 CHECKS=120605	UNSAT TT=0.205 CHECKS=104252	UNSAT TT=4.365 ASSIGNMENTS=39464	UNSAT TT=0.72 ASSIGNMENTS=388	UNSAT TT=1.024 CHECKS=37586 NODES=2541	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=0.312 ASSIGNMENTS=27682 CHECKS=850312	UNSAT TT=0.31 ASSIGNMENTS=27682 CHECKS=850312	UNSAT TT=0.861	UNSAT TT=0.726	UNSAT TT=0.15 CHECKS=62782	UNSAT TT=0.1 ASSIGNMENTS=11794 CHECKS=290551	UNSAT TT=0.075 ASSIGNMENTS=14419 CHECKS=218094	UNSAT TT=0.664	UNSAT TT=0.102 ASSIGNMENTS=8725 CHECKS=213659	UNSAT TT=0.263 ASSIGNMENTS=27682 CHECKS=850312	UNSAT TT=1.03	UNSAT TT=0.916 ASSIGNMENTS=14738 CHECKS=706070	UNSAT TT=0.918	UNSAT TT=0.819
csp/aim-200/ normalized-aim-200-1-6-unsat-2_ext.xml	UNSAT TT=0.093	UNSAT TT=3.051 CHECKS=677790 NODES=48377	UNSAT TT=2.433 CHECKS=421570 NODES=31169	? (TO) TT=1800.03	UNSAT TT=3.092 CHECKS=1519030	UNSAT TT=1.667 CHECKS=770360	UNSAT TT=37.926 ASSIGNMENTS=461040	UNSAT TT=0.801 ASSIGNMENTS=874	UNSAT TT=1.841 CHECKS=144456 NODES=8846	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.978 ASSIGNMENTS=108309 CHECKS=2758150	UNSAT TT=1.067 ASSIGNMENTS=108309 CHECKS=2758150	UNSAT TT=0.828	UNSAT TT=0.813	UNSAT TT=0.143 CHECKS=67087	UNSAT TT=1.139 ASSIGNMENTS=149653 CHECKS=3776660	UNSAT TT=0.073 ASSIGNMENTS=14253 CHECKS=194678	UNSAT TT=1.602	UNSAT TT=0.093 ASSIGNMENTS=7273 CHECKS=175856	UNSAT TT=0.908 ASSIGNMENTS=108309 CHECKS=2758150	UNSAT TT=1.058	UNSAT TT=1.673 ASSIGNMENTS=35817 CHECKS=1422050	UNSAT TT=0.83	UNSAT TT=0.863
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-200/ normalized-aim-200-1-6-unsat-3_ext.xml	UNSAT TT=0.276	UNSAT TT=1.389 CHECKS=104910 NODES=9817	UNSAT TT=1.507 CHECKS=130883 NODES=11569	? (TO) TT=1800.09	UNSAT TT=0.422 CHECKS=170407	UNSAT TT=78.245 CHECKS=35596400	UNSAT TT=7.519 ASSIGNMENTS=84406	UNSAT TT=2.227 ASSIGNMENTS=10764	UNSAT TT=2.588 CHECKS=216789 NODES=16453	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=0.703 ASSIGNMENTS=73965 CHECKS=1857130	UNSAT TT=0.698 ASSIGNMENTS=73965 CHECKS=1857130	UNSAT TT=0.865	UNSAT TT=0.87	UNSAT TT=0.276 CHECKS=139662	UNSAT TT=0.507 ASSIGNMENTS=66263 CHECKS=1642260	UNSAT TT=0.109 ASSIGNMENTS=19351 CHECKS=326320	UNSAT TT=1.324	UNSAT TT=0.294 ASSIGNMENTS=27068 CHECKS=612829	UNSAT TT=0.593 ASSIGNMENTS=73965 CHECKS=1857130	UNSAT TT=1.103	UNSAT TT=3.412 ASSIGNMENTS=62281 CHECKS=2719140	UNSAT TT=0.912	UNSAT TT=0.896
csp/aim-200/ normalized-aim-200-1-6-unsat-4_ext.xml	UNSAT TT=0.05	UNSAT TT=1.056 CHECKS=15911 NODES=1987	UNSAT TT=1.538 CHECKS=11586 NODES=1400	? (TO) TT=1800.05	UNSAT TT=0.178 CHECKS=77417	UNSAT TT=0.318 CHECKS=180038	UNSAT TT=1.119 ASSIGNMENTS=5150	UNSAT TT=1.109 ASSIGNMENTS=2687	UNSAT TT=0.681 CHECKS=16675 NODES=1360	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=0.086 ASSIGNMENTS=7381 CHECKS=203222	UNSAT TT=0.091 ASSIGNMENTS=7381 CHECKS=203222	UNSAT TT=0.674	UNSAT TT=0.683	UNSAT TT=0.087 CHECKS=31357	UNSAT TT=0.083 ASSIGNMENTS=10013 CHECKS=256527	UNSAT TT=0.05 ASSIGNMENTS=12665 CHECKS=137656	UNSAT TT=0.56	UNSAT TT=0.05 ASSIGNMENTS=4130 CHECKS=90804	UNSAT TT=0.071 ASSIGNMENTS=7381 CHECKS=203222	UNSAT TT=0.959	UNSAT TT=0.24 ASSIGNMENTS=4722 CHECKS=221193	UNSAT TT=0.825	UNSAT TT=0.821
csp/aim-200/ normalized-aim-200-2-0-sat-1_ext.xml	SAT TT=0.046	SAT TT=2.502 CHECKS=509422 NODES=31016	SAT TT=1.179 CHECKS=33816 NODES=3318	? (TO) TT=1800.09	SAT TT=0.046 CHECKS=28612	SAT TT=18.735 CHECKS=16294500	SAT TT=7.138 ASSIGNMENTS=47554	SAT TT=29.794 ASSIGNMENTS=202059	SAT TT=0.812 CHECKS=37256 NODES=2001	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=0.709 ASSIGNMENTS=58735 CHECKS=2402750	SAT TT=0.653 ASSIGNMENTS=58735 CHECKS=2402750	SAT TT=1.503	SAT TT=1.287	SAT TT=0.37 CHECKS=292603	SAT TT=0.603 ASSIGNMENTS=54680 CHECKS=2571650	SAT TT=0.102 ASSIGNMENTS=12374 CHECKS=350327	SAT TT=0.531	SAT TT=0.091 ASSIGNMENTS=6849 CHECKS=246887	SAT TT=0.591 ASSIGNMENTS=58735 CHECKS=2402750	SAT TT=1.268	SAT TT=0.475 ASSIGNMENTS=8167 CHECKS=384294	SAT TT=0.935	SAT TT=0.936
csp/aim-200/ normalized-aim-200-2-0-sat-2_ext.xml	SAT TT=0.032	SAT TT=1.385 CHECKS=90938 NODES=7751	SAT TT=1.349 CHECKS=33199 NODES=3333	? (TO) TT=1800.07	SAT TT=0.032 CHECKS=17918	SAT TT=6.167 CHECKS=5789110	SAT TT=0.892 ASSIGNMENTS=1436	SAT TT=3.513 ASSIGNMENTS=19117	SAT TT=0.781 CHECKS=8773 NODES=742	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=0.307 ASSIGNMENTS=23234 CHECKS=1092160	SAT TT=0.31 ASSIGNMENTS=23234 CHECKS=1092160	SAT TT=1.207	SAT TT=1.204	SAT TT=0.251 CHECKS=190932	SAT TT=0.521 ASSIGNMENTS=41838 CHECKS=2010540	SAT TT=0.097 ASSIGNMENTS=9997 CHECKS=325862	SAT TT=0.533	SAT TT=0.069 ASSIGNMENTS=4727 CHECKS=180051	SAT TT=0.271 ASSIGNMENTS=23234 CHECKS=1092160	SAT TT=1.112	SAT TT=0.968 ASSIGNMENTS=14745 CHECKS=862607	SAT TT=0.894	SAT TT=0.895
csp/aim-200/ normalized-aim-200-2-0-sat-3_ext.xml	SAT TT=0.032	SAT TT=1.125 CHECKS=14497 NODES=1701	SAT TT=1.042 CHECKS=7096 NODES=925	? (TO) TT=1800.05	SAT TT=0.255 CHECKS=168239	SAT TT=0.316 CHECKS=226718	SAT TT=1.743 ASSIGNMENTS=6899	SAT TT=1.063 ASSIGNMENTS=1944	SAT TT=0.606 CHECKS=9252 NODES=730	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.091 ASSIGNMENTS=5275 CHECKS=225910	SAT TT=0.089 ASSIGNMENTS=5275 CHECKS=225910	SAT TT=1.203	SAT TT=1.613	SAT TT=0.171 CHECKS=142569	SAT TT=0.085 ASSIGNMENTS=6760 CHECKS=300611	SAT TT=0.061 ASSIGNMENTS=7833 CHECKS=194761	SAT TT=0.665	SAT TT=0.032 ASSIGNMENTS=1322 CHECKS=42443	SAT TT=0.071 ASSIGNMENTS=5275 CHECKS=225910	SAT TT=1.115	SAT TT=0.151 ASSIGNMENTS=2780 CHECKS=157815	SAT TT=0.942	SAT TT=0.875
csp/aim-200/ normalized-aim-200-2-0-sat-4_ext.xml	SAT TT=0.175	SAT TT=2.376 CHECKS=376081 NODES=28342	SAT TT=1.705 CHECKS=196506 NODES=16455	? (TO) TT=1800.04	SAT TT=4.083 CHECKS=2413160	SAT TT=2.077 CHECKS=1719160	SAT TT=46.733 ASSIGNMENTS=353502	? (TO) TT=1800.06	SAT TT=1.91 CHECKS=196169 NODES=8579	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=0.206 ASSIGNMENTS=14504 CHECKS=662745	SAT TT=0.206 ASSIGNMENTS=14504 CHECKS=662745	SAT TT=1.448	SAT TT=1.523	SAT TT=0.711 CHECKS=712031	SAT TT=0.285 ASSIGNMENTS=26656 CHECKS=1104880	SAT TT=0.094 ASSIGNMENTS=11292 CHECKS=324048	SAT TT=0.499	SAT TT=0.262 ASSIGNMENTS=15794 CHECKS=829886	SAT TT=0.175 ASSIGNMENTS=14504 CHECKS=662745	SAT TT=1.414	SAT TT=0.793 ASSIGNMENTS=9140 CHECKS=390879	SAT TT=0.873	SAT TT=0.969
csp/aim-200/ normalized-aim-200-2-0-unsat-1_ext.xml	UNSAT TT=0.124	UNSAT TT=1.496 CHECKS=100732 NODES=8897	UNSAT TT=1.127 CHECKS=30931 NODES=3274	? (TO) TT=1800.09	UNSAT TT=0.492 CHECKS=220768	UNSAT TT=0.183 CHECKS=107427	UNSAT TT=3.701 ASSIGNMENTS=30063	UNSAT TT=11.176 ASSIGNMENTS=66909	UNSAT TT=0.664 CHECKS=8545 NODES=667	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.194 ASSIGNMENTS=18507 CHECKS=542051	UNSAT TT=0.192 ASSIGNMENTS=18507 CHECKS=542051	UNSAT TT=0.76	UNSAT TT=0.76	UNSAT TT=0.146 CHECKS=69081	UNSAT TT=0.175 ASSIGNMENTS=19989 CHECKS=615076	UNSAT TT=0.084 ASSIGNMENTS=11603 CHECKS=254715	UNSAT TT=0.95	UNSAT TT=0.124 ASSIGNMENTS=10621 CHECKS=276575	UNSAT TT=0.155 ASSIGNMENTS=18507 CHECKS=542051	UNSAT TT=1.129	UNSAT TT=0.136 ASSIGNMENTS=1919 CHECKS=101622	UNSAT TT=0.94	UNSAT TT=1.054
csp/aim-200/ normalized-aim-200-2-0-unsat-2_ext.xml	UNSAT TT=0.046	UNSAT TT=1.146 CHECKS=26963 NODES=2887	UNSAT TT=1.199 CHECKS=34097 NODES=3269	? (TO) TT=1800.11	UNSAT TT=0.224 CHECKS=87525	UNSAT TT=0.357 CHECKS=181892	UNSAT TT=1.433 ASSIGNMENTS=4914	UNSAT TT=4.173 ASSIGNMENTS=19399	UNSAT TT=0.93 CHECKS=31031 NODES=2304	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.062 ASSIGNMENTS=3620 CHECKS=111557	UNSAT TT=0.061 ASSIGNMENTS=3620 CHECKS=111557	UNSAT TT=0.979	UNSAT TT=0.776	UNSAT TT=0.13 CHECKS=49335	UNSAT TT=0.073 ASSIGNMENTS=6305 CHECKS=214256	UNSAT TT=0.075 ASSIGNMENTS=10094 CHECKS=221725	UNSAT TT=0.584	UNSAT TT=0.046 ASSIGNMENTS=2686 CHECKS=74315	UNSAT TT=0.046 ASSIGNMENTS=3620 CHECKS=111557	UNSAT TT=1.125	UNSAT TT=0.157 ASSIGNMENTS=2646 CHECKS=145444	UNSAT TT=0.952	UNSAT TT=0.957
csp/aim-200/ normalized-aim-200-2-0-unsat-3_ext.xml	UNSAT TT=0.023	UNSAT TT=0.964 CHECKS=3008 NODES=498	UNSAT TT=1.008 CHECKS=2641 NODES=396	? (TO) TT=1800.06	UNSAT TT=0.176 CHECKS=79911	UNSAT TT=0.189 CHECKS=110388	UNSAT TT=1.082 ASSIGNMENTS=2556	UNSAT TT=2.867 ASSIGNMENTS=11250	UNSAT TT=0.742 CHECKS=16718 NODES=1263	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.057 ASSIGNMENTS=3802 CHECKS=120210	UNSAT TT=0.061 ASSIGNMENTS=3802 CHECKS=120210	UNSAT TT=0.747	UNSAT TT=0.751	UNSAT TT=0.095 CHECKS=30919	UNSAT TT=0.03 ASSIGNMENTS=1966 CHECKS=68850	UNSAT TT=0.068 ASSIGNMENTS=8470 CHECKS=193920	UNSAT TT=0.576	UNSAT TT=0.023 ASSIGNMENTS=862 CHECKS=17811	UNSAT TT=0.046 ASSIGNMENTS=3802 CHECKS=120210	UNSAT TT=1.065	UNSAT TT=0.059 ASSIGNMENTS=566 CHECKS=29479	UNSAT TT=0.951	UNSAT TT=0.898
csp/aim-200/ normalized-aim-200-2-0-unsat-4_ext.xml	UNSAT TT=0.027	UNSAT TT=1.121 CHECKS=17162 NODES=1811	UNSAT TT=1.147 CHECKS=17871 NODES=1904	? (TO) TT=1800.02	UNSAT TT=0.173 CHECKS=84008	UNSAT TT=0.153 CHECKS=81889	UNSAT TT=1.032 ASSIGNMENTS=3557	UNSAT TT=3.432 ASSIGNMENTS=17814	UNSAT TT=0.603 CHECKS=3927 NODES=321	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=0.055 ASSIGNMENTS=3197 CHECKS=87383	UNSAT TT=0.05 ASSIGNMENTS=3197 CHECKS=87383	UNSAT TT=0.771	UNSAT TT=0.764	UNSAT TT=0.1 CHECKS=35971	UNSAT TT=0.041 ASSIGNMENTS=3174 CHECKS=90460	UNSAT TT=0.061 ASSIGNMENTS=8835 CHECKS=190029	UNSAT TT=0.711	UNSAT TT=0.027 ASSIGNMENTS=1056 CHECKS=25418	UNSAT TT=0.039 ASSIGNMENTS=3197 CHECKS=87383	UNSAT TT=1.055	UNSAT TT=0.072 ASSIGNMENTS=438 CHECKS=23736	UNSAT TT=0.921	UNSAT TT=0.897
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-200/ normalized-aim-200-3-4-sat-1_ext.xml	SAT TT=0.116	SAT TT=1.438 CHECKS=93593 NODES=5310	SAT TT=1.421 CHECKS=73136 NODES=4319	SAT TT=413.578	SAT TT=0.518 CHECKS=369488	SAT TT=0.492 CHECKS=467978	SAT TT=1.556 ASSIGNMENTS=1852	SAT TT=10.808 ASSIGNMENTS=31820	SAT TT=0.715 CHECKS=10639 NODES=442	SAT TT=352.153 CHECKS=1088850000 NODES=28182200	SAT TT=1.366 CHECKS=4638590 NODES=16290	SAT TT=0.14 ASSIGNMENTS=3560 CHECKS=486082	SAT TT=0.139 ASSIGNMENTS=3560 CHECKS=486082	SAT TT=1.529	SAT TT=1.409	SAT TT=0.462 CHECKS=418968	SAT TT=0.233 ASSIGNMENTS=7498 CHECKS=1105960	SAT TT=0.176 ASSIGNMENTS=7192 CHECKS=692968	SAT TT=0.769	SAT TT=0.183 ASSIGNMENTS=4164 CHECKS=691528	SAT TT=0.116 ASSIGNMENTS=3560 CHECKS=486082	SAT TT=1.397	SAT TT=1.176 ASSIGNMENTS=8014 CHECKS=1132020	SAT TT=1.049	SAT TT=1.157
csp/aim-200/ normalized-aim-200-3-4-sat-2_ext.xml	SAT TT=0.034	SAT TT=1.338 CHECKS=40974 NODES=2306	SAT TT=1.666 CHECKS=112624 NODES=5354	SAT TT=107.806	SAT TT=1.966 CHECKS=1477930	SAT TT=13.628 CHECKS=12124700	SAT TT=1.235 ASSIGNMENTS=1220	SAT TT=6.407 ASSIGNMENTS=16146	SAT TT=2.126 CHECKS=253720 NODES=4472	SAT TT=166.171 CHECKS=502942000 NODES=13125200	SAT TT=0.649 CHECKS=195193 NODES=1584	SAT TT=0.044 ASSIGNMENTS=437 CHECKS=56321	SAT TT=0.047 ASSIGNMENTS=437 CHECKS=56321	SAT TT=1.463	SAT TT=1.35	SAT TT=0.165 CHECKS=117131	SAT TT=0.051 ASSIGNMENTS=943 CHECKS=135046	SAT TT=0.197 ASSIGNMENTS=7621 CHECKS=864733	SAT TT=0.71	SAT TT=0.034 ASSIGNMENTS=514 CHECKS=51939	SAT TT=0.034 ASSIGNMENTS=437 CHECKS=56321	SAT TT=1.515	SAT TT=0.262 ASSIGNMENTS=557 CHECKS=73910	SAT TT=1.182	SAT TT=1.196
csp/aim-200/ normalized-aim-200-3-4-sat-3_ext.xml	SAT TT=0.045	SAT TT=3.706 CHECKS=798771 NODES=33688	SAT TT=1.442 CHECKS=91923 NODES=5269	SAT TT=60.547	SAT TT=0.523 CHECKS=387775	SAT TT=19.96 CHECKS=20156900	SAT TT=1.18 ASSIGNMENTS=810	SAT TT=1.378 ASSIGNMENTS=1644	SAT TT=0.751 CHECKS=24165 NODES=722	SAT TT=216.284 CHECKS=622232000 NODES=16217800	SAT TT=0.666 CHECKS=395939 NODES=2427	SAT TT=0.081 ASSIGNMENTS=1137 CHECKS=202171	SAT TT=0.073 ASSIGNMENTS=1137 CHECKS=202171	SAT TT=1.317	SAT TT=1.322	SAT TT=0.217 CHECKS=183005	SAT TT=0.055 ASSIGNMENTS=883 CHECKS=168949	SAT TT=0.279 ASSIGNMENTS=9229 CHECKS=1203210	SAT TT=0.619	SAT TT=0.045 ASSIGNMENTS=1158 CHECKS=115570	SAT TT=0.062 ASSIGNMENTS=1137 CHECKS=202171	SAT TT=1.416	SAT TT=0.965 ASSIGNMENTS=3868 CHECKS=631658	SAT TT=0.922	SAT TT=1.094
csp/aim-200/ normalized-aim-200-3-4-sat-4_ext.xml	SAT TT=0.055	SAT TT=1.184 CHECKS=10487 NODES=924	SAT TT=1.327 CHECKS=24349 NODES=1947	SAT TT=311.112	SAT TT=0.335 CHECKS=230256	SAT TT=0.551 CHECKS=559767	SAT TT=15.809 ASSIGNMENTS=42294	SAT TT=6.634 ASSIGNMENTS=18009	SAT TT=0.758 CHECKS=25332 NODES=607	SAT TT=281.764 CHECKS=874114000 NODES=22651800	? (TO) TT=1800.03	SAT TT=0.084 ASSIGNMENTS=1574 CHECKS=247251	SAT TT=0.087 ASSIGNMENTS=1574 CHECKS=247251	SAT TT=1.63	SAT TT=1.492	SAT TT=0.416 CHECKS=419268	SAT TT=0.223 ASSIGNMENTS=6134 CHECKS=985469	SAT TT=0.135 ASSIGNMENTS=5594 CHECKS=561550	SAT TT=0.665	SAT TT=0.055 ASSIGNMENTS=1203 CHECKS=140078	SAT TT=0.072 ASSIGNMENTS=1574 CHECKS=247251	SAT TT=1.281	SAT TT=0.212 ASSIGNMENTS=742 CHECKS=106897	SAT TT=1.065	SAT TT=1.054
csp/aim-200/ normalized-aim-200-6-0-sat-1_ext.xml	SAT TT=0.036	SAT TT=1.345 CHECKS=9742 NODES=442	SAT TT=1.097 CHECKS=4705 NODES=0	SAT TT=0.523	SAT TT=0.111 CHECKS=45356	SAT TT=0.196 CHECKS=159928	SAT TT=0.935 ASSIGNMENTS=8	SAT TT=0.788 ASSIGNMENTS=2	SAT TT=0.803 CHECKS=3850 NODES=223	SAT TT=5.497 CHECKS=10526400 NODES=152155	SAT TT=0.823 CHECKS=149257 NODES=667	SAT TT=0.057 ASSIGNMENTS=158 CHECKS=62878	SAT TT=0.058 ASSIGNMENTS=158 CHECKS=62878	SAT TT=1.688	SAT TT=1.588	SAT TT=0.22 CHECKS=147498	SAT TT=0.04 ASSIGNMENTS=124 CHECKS=39264	SAT TT=0.15 ASSIGNMENTS=2367 CHECKS=624995	SAT TT=0.672	SAT TT=0.036 ASSIGNMENTS=26 CHECKS=5553	SAT TT=0.044 ASSIGNMENTS=158 CHECKS=62878	SAT TT=1.758	SAT TT=0.105 ASSIGNMENTS=385 CHECKS=60565	SAT TT=0.995	SAT TT=1.02
csp/aim-200/ normalized-aim-200-6-0-sat-2_ext.xml	SAT TT=0.052	SAT TT=1.216 CHECKS=11440 NODES=519	SAT TT=1.158 CHECKS=8092 NODES=383	SAT TT=31.235	SAT TT=0.533 CHECKS=356619	SAT TT=0.197 CHECKS=155651	SAT TT=1.283 ASSIGNMENTS=411	SAT TT=0.783 ASSIGNMENTS=39	SAT TT=0.926 CHECKS=29892 NODES=447	SAT TT=4.999 CHECKS=10526500 NODES=150831	SAT TT=0.769 CHECKS=119405 NODES=156	SAT TT=0.092 ASSIGNMENTS=721 CHECKS=279403	SAT TT=0.096 ASSIGNMENTS=721 CHECKS=279403	SAT TT=1.499	SAT TT=1.737	SAT TT=0.105 CHECKS=26070	SAT TT=0.073 ASSIGNMENTS=614 CHECKS=250029	SAT TT=0.208 ASSIGNMENTS=4241 CHECKS=1039110	SAT TT=0.729	SAT TT=0.052 ASSIGNMENTS=566 CHECKS=121971	SAT TT=0.085 ASSIGNMENTS=721 CHECKS=279403	SAT TT=1.866	SAT TT=0.189 ASSIGNMENTS=748 CHECKS=223057	SAT TT=0.973	SAT TT=1.068
csp/aim-200/ normalized-aim-200-6-0-sat-3_ext.xml	SAT TT=0.034	SAT TT=1.231 CHECKS=15252 NODES=617	SAT TT=1.189 CHECKS=6741 NODES=321	SAT TT=59.204	SAT TT=0.08 CHECKS=35355	SAT TT=0.548 CHECKS=483646	SAT TT=0.806 ASSIGNMENTS=14	SAT TT=0.853 ASSIGNMENTS=4	SAT TT=0.785 CHECKS=9732 NODES=253	SAT TT=9.23 CHECKS=20811000 NODES=300337	SAT TT=0.827 CHECKS=130517 NODES=310	SAT TT=0.049 ASSIGNMENTS=74 CHECKS=24294	SAT TT=0.05 ASSIGNMENTS=74 CHECKS=24294	SAT TT=1.755	SAT TT=1.581	SAT TT=0.125 CHECKS=48290	SAT TT=0.045 ASSIGNMENTS=235 CHECKS=83036	SAT TT=0.047 ASSIGNMENTS=256 CHECKS=70039	SAT TT=0.67	SAT TT=0.04 ASSIGNMENTS=272 CHECKS=27161	SAT TT=0.034 ASSIGNMENTS=74 CHECKS=24294	SAT TT=1.914	SAT TT=0.129 ASSIGNMENTS=266 CHECKS=31352	SAT TT=1.07	SAT TT=1.234
csp/aim-200/ normalized-aim-200-6-0-sat-4_ext.xml	SAT TT=0.04	SAT TT=1.452 CHECKS=63138 NODES=2466	SAT TT=1.201 CHECKS=5346 NODES=0	SAT TT=11.757	SAT TT=0.209 CHECKS=106012	SAT TT=0.363 CHECKS=295753	SAT TT=0.996 ASSIGNMENTS=306	SAT TT=0.744 ASSIGNMENTS=28	SAT TT=0.976 CHECKS=28293 NODES=456	SAT TT=23.469 CHECKS=51751700 NODES=750589	SAT TT=0.818 CHECKS=120736 NODES=229	SAT TT=0.068 ASSIGNMENTS=420 CHECKS=151332	SAT TT=0.067 ASSIGNMENTS=420 CHECKS=151332	SAT TT=1.589	SAT TT=1.49	SAT TT=0.427 CHECKS=357619	SAT TT=0.129 ASSIGNMENTS=1323 CHECKS=533288	SAT TT=0.237 ASSIGNMENTS=4339 CHECKS=1104890	SAT TT=0.662	SAT TT=0.04 ASSIGNMENTS=300 CHECKS=37101	SAT TT=0.061 ASSIGNMENTS=420 CHECKS=151332	SAT TT=1.91	SAT TT=0.257 ASSIGNMENTS=341 CHECKS=76300	SAT TT=1.226	SAT TT=1.019
csp/aim-50/ normalized-aim-50-1-6-sat-1_ext.xml	SAT TT=0.007	SAT TT=0.745 CHECKS=2808 NODES=322	SAT TT=0.771 CHECKS=1463 NODES=207	SAT TT=0.086	SAT TT=0.009 CHECKS=1187	SAT TT=0.021 CHECKS=17728	SAT TT=0.434 ASSIGNMENTS=7	SAT TT=0.405 ASSIGNMENTS=3	SAT TT=0.392 CHECKS=1226 NODES=130	SAT TT=127.314 CHECKS=468919000 NODES=81600600	SAT TT=0.373 CHECKS=127074 NODES=1243	SAT TT=0.023 ASSIGNMENTS=309 CHECKS=9070	SAT TT=0.023 ASSIGNMENTS=309 CHECKS=9070	SAT TT=0.782	SAT TT=0.861	SAT TT=0.034 CHECKS=2062	SAT TT=0.009 ASSIGNMENTS=312 CHECKS=7820	SAT TT=0.021 ASSIGNMENTS=4316 CHECKS=62439	SAT TT=0.322	SAT TT=0.007 ASSIGNMENTS=77 CHECKS=964	SAT TT=0.011 ASSIGNMENTS=309 CHECKS=9070	SAT TT=0.737	SAT TT=0.015 ASSIGNMENTS=124 CHECKS=2506	SAT TT=0.59	SAT TT=0.607
csp/aim-50/ normalized-aim-50-1-6-sat-2_ext.xml	SAT TT=0.006	SAT TT=0.766 CHECKS=792 NODES=132	SAT TT=0.68 CHECKS=325 NODES=0	SAT TT=0.136	SAT TT=0.012 CHECKS=958	SAT TT=0.011 CHECKS=2502	SAT TT=0.427 ASSIGNMENTS=1	SAT TT=0.436 ASSIGNMENTS=1	SAT TT=0.366 CHECKS=1717 NODES=118	SAT TT=2.881 CHECKS=8895340 NODES=1800060	SAT TT=0.347 CHECKS=25091 NODES=284	SAT TT=0.02 ASSIGNMENTS=51 CHECKS=1416	SAT TT=0.02 ASSIGNMENTS=51 CHECKS=1416	SAT TT=0.974	SAT TT=0.796	SAT TT=0.034 CHECKS=1167	SAT TT=0.008 ASSIGNMENTS=57 CHECKS=2605	SAT TT=0.01 ASSIGNMENTS=769 CHECKS=11858	SAT TT=0.318	SAT TT=0.006 ASSIGNMENTS=80 CHECKS=973	SAT TT=0.008 ASSIGNMENTS=51 CHECKS=1416	SAT TT=0.794	SAT TT=0.013 ASSIGNMENTS=103 CHECKS=1825	SAT TT=0.555	SAT TT=0.582
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-50/ normalized-aim-50-1-6-sat-3_ext.xml	SAT TT=0.007	SAT TT=0.755 CHECKS=801 NODES=130	SAT TT=0.736 CHECKS=259 NODES=0	SAT TT=0.063	SAT TT=0.013 CHECKS=2004	SAT TT=0.014 CHECKS=4294	SAT TT=0.398 ASSIGNMENTS=2	SAT TT=0.418 ASSIGNMENTS=4	SAT TT=0.344 CHECKS=211 NODES=51	SAT TT=3.811 CHECKS=13156100 NODES=972600	SAT TT=0.378 CHECKS=55885 NODES=579	SAT TT=0.02 ASSIGNMENTS=48 CHECKS=1390	SAT TT=0.021 ASSIGNMENTS=48 CHECKS=1390	SAT TT=0.868	SAT TT=0.978	SAT TT=0.054 CHECKS=914	SAT TT=0.007 ASSIGNMENTS=58 CHECKS=1462	SAT TT=0.011 ASSIGNMENTS=959 CHECKS=14978	SAT TT=0.343	SAT TT=0.009 ASSIGNMENTS=96 CHECKS=1636	SAT TT=0.008 ASSIGNMENTS=48 CHECKS=1390	SAT TT=0.78	SAT TT=0.016 ASSIGNMENTS=62 CHECKS=1662	SAT TT=0.595	SAT TT=0.564
csp/aim-50/ normalized-aim-50-1-6-sat-4_ext.xml	SAT TT=0.007	SAT TT=0.765 CHECKS=2457 NODES=286	SAT TT=0.722 CHECKS=282 NODES=0	SAT TT=0.057	SAT TT=0.009 CHECKS=415	SAT TT=0.012 CHECKS=2887	SAT TT=0.416 ASSIGNMENTS=1	SAT TT=0.412 ASSIGNMENTS=1	SAT TT=0.342 CHECKS=572 NODES=77	SAT TT=0.462 CHECKS=341987 NODES=48334	SAT TT=0.38 CHECKS=72731 NODES=813	SAT TT=0.021 ASSIGNMENTS=68 CHECKS=2555	SAT TT=0.02 ASSIGNMENTS=68 CHECKS=2555	SAT TT=0.775	SAT TT=1.055	SAT TT=0.039 CHECKS=3290	SAT TT=0.007 ASSIGNMENTS=71 CHECKS=2622	SAT TT=0.016 ASSIGNMENTS=1334 CHECKS=23081	SAT TT=0.323	SAT TT=0.008 ASSIGNMENTS=35 CHECKS=518	SAT TT=0.009 ASSIGNMENTS=68 CHECKS=2555	SAT TT=0.726	SAT TT=0.015 ASSIGNMENTS=52 CHECKS=1636	SAT TT=0.579	SAT TT=0.582
csp/aim-50/ normalized-aim-50-1-6-unsat-1_ext.xml	UNSAT TT=0.006	UNSAT TT=0.737 CHECKS=941 NODES=95	UNSAT TT=0.732 CHECKS=240 NODES=0	UNSAT TT=0.039	UNSAT TT=0.01 CHECKS=239	UNSAT TT=0.018 CHECKS=8453	UNSAT TT=0.38 ASSIGNMENTS=0	UNSAT TT=0.424 ASSIGNMENTS=0	UNSAT TT=0.393 CHECKS=952 NODES=47	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.019 ASSIGNMENTS=44 CHECKS=1225	UNSAT TT=0.019 ASSIGNMENTS=44 CHECKS=1225	UNSAT TT=0.608	UNSAT TT=0.475	UNSAT TT=0.04 CHECKS=1257	UNSAT TT=0.009 ASSIGNMENTS=37 CHECKS=1141	UNSAT TT=0.012 ASSIGNMENTS=829 CHECKS=12395	UNSAT TT=0.32	UNSAT TT=0.006 ASSIGNMENTS=22 CHECKS=311	UNSAT TT=0.007 ASSIGNMENTS=44 CHECKS=1225	UNSAT TT=0.767	UNSAT TT=0.012 ASSIGNMENTS=101 CHECKS=5836	UNSAT TT=0.582	UNSAT TT=0.568
csp/aim-50/ normalized-aim-50-1-6-unsat-2_ext.xml	UNSAT TT=0.009	UNSAT TT=0.807 CHECKS=6668 NODES=749	UNSAT TT=0.81 CHECKS=4868 NODES=561	UNSAT TT=0.218	UNSAT TT=0.024 CHECKS=13259	UNSAT TT=0.031 CHECKS=25479	UNSAT TT=0.51 ASSIGNMENTS=449	UNSAT TT=0.458 ASSIGNMENTS=144	UNSAT TT=0.387 CHECKS=2178 NODES=183	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.022 ASSIGNMENTS=425 CHECKS=10996	UNSAT TT=0.023 ASSIGNMENTS=425 CHECKS=10996	UNSAT TT=0.623	UNSAT TT=0.673	UNSAT TT=0.043 CHECKS=8096	UNSAT TT=0.01 ASSIGNMENTS=548 CHECKS=11986	UNSAT TT=0.025 ASSIGNMENTS=4874 CHECKS=58579	UNSAT TT=0.329	UNSAT TT=0.01 ASSIGNMENTS=329 CHECKS=7318	UNSAT TT=0.009 ASSIGNMENTS=425 CHECKS=10996	UNSAT TT=0.772	UNSAT TT=0.019 ASSIGNMENTS=272 CHECKS=9590	UNSAT TT=0.591	UNSAT TT=0.594
csp/aim-50/ normalized-aim-50-1-6-unsat-3_ext.xml	UNSAT TT=0.007	UNSAT TT=0.733 CHECKS=764 NODES=63	UNSAT TT=0.741 CHECKS=704 NODES=34	UNSAT TT=0.873	UNSAT TT=0.011 CHECKS=202	UNSAT TT=0.041 CHECKS=31111	UNSAT TT=0.4 ASSIGNMENTS=0	UNSAT TT=0.439 ASSIGNMENTS=0	UNSAT TT=0.374 CHECKS=737 NODES=28	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.021 ASSIGNMENTS=72 CHECKS=2689	UNSAT TT=0.021 ASSIGNMENTS=72 CHECKS=2689	UNSAT TT=0.464	UNSAT TT=0.499	UNSAT TT=0.065 CHECKS=2453	UNSAT TT=0.008 ASSIGNMENTS=82 CHECKS=2919	UNSAT TT=0.011 ASSIGNMENTS=355 CHECKS=4198	UNSAT TT=0.32	UNSAT TT=0.008 ASSIGNMENTS=104 CHECKS=1216	UNSAT TT=0.007 ASSIGNMENTS=72 CHECKS=2689	UNSAT TT=0.723	UNSAT TT=0.014 ASSIGNMENTS=23 CHECKS=1135	UNSAT TT=0.588	UNSAT TT=0.589
csp/aim-50/ normalized-aim-50-1-6-unsat-4_ext.xml	UNSAT TT=0.007	UNSAT TT=0.737 CHECKS=755 NODES=100	UNSAT TT=0.816 CHECKS=564 NODES=64	UNSAT TT=0.047	UNSAT TT=0.01 CHECKS=718	UNSAT TT=0.012 CHECKS=3711	UNSAT TT=0.427 ASSIGNMENTS=0	UNSAT TT=0.406 ASSIGNMENTS=0	UNSAT TT=0.376 CHECKS=580 NODES=41	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.018 ASSIGNMENTS=46 CHECKS=1148	UNSAT TT=0.021 ASSIGNMENTS=46 CHECKS=1148	UNSAT TT=0.498	UNSAT TT=0.523	UNSAT TT=0.057 CHECKS=803	UNSAT TT=0.008 ASSIGNMENTS=36 CHECKS=928	UNSAT TT=0.023 ASSIGNMENTS=4581 CHECKS=55443	UNSAT TT=0.341	UNSAT TT=0.007 ASSIGNMENTS=107 CHECKS=1264	UNSAT TT=0.009 ASSIGNMENTS=46 CHECKS=1148	UNSAT TT=0.752	UNSAT TT=0.012 ASSIGNMENTS=8 CHECKS=544	UNSAT TT=0.604	UNSAT TT=0.588
csp/aim-50/ normalized-aim-50-2-0-sat-1_ext.xml	SAT TT=0.008	SAT TT=0.872 CHECKS=975 NODES=138	SAT TT=0.789 CHECKS=1173 NODES=116	SAT TT=0.208	SAT TT=0.012 CHECKS=1194	SAT TT=0.014 CHECKS=5931	SAT TT=0.393 ASSIGNMENTS=1	SAT TT=0.455 ASSIGNMENTS=1	SAT TT=0.394 CHECKS=1432 NODES=141	SAT TT=0.523 CHECKS=675763 NODES=58813	SAT TT=0.386 CHECKS=25855 NODES=240	SAT TT=0.021 ASSIGNMENTS=146 CHECKS=3780	SAT TT=0.021 ASSIGNMENTS=146 CHECKS=3780	SAT TT=0.82	SAT TT=0.855	SAT TT=0.041 CHECKS=3253	SAT TT=0.009 ASSIGNMENTS=112 CHECKS=3026	SAT TT=0.023 ASSIGNMENTS=2792 CHECKS=62123	SAT TT=0.332	SAT TT=0.008 ASSIGNMENTS=134 CHECKS=2470	SAT TT=0.01 ASSIGNMENTS=146 CHECKS=3780	SAT TT=0.759	SAT TT=0.017 ASSIGNMENTS=111 CHECKS=4357	SAT TT=0.609	SAT TT=0.604
csp/aim-50/ normalized-aim-50-2-0-sat-2_ext.xml	SAT TT=0.007	SAT TT=0.852 CHECKS=3854 NODES=447	SAT TT=0.774 CHECKS=2871 NODES=322	SAT TT=0.081	SAT TT=0.012 CHECKS=2288	SAT TT=0.013 CHECKS=5550	SAT TT=0.464 ASSIGNMENTS=53	SAT TT=0.436 ASSIGNMENTS=34	SAT TT=0.352 CHECKS=544 NODES=78	SAT TT=0.481 CHECKS=367759 NODES=17603	SAT TT=0.4 CHECKS=56849 NODES=543	SAT TT=0.02 ASSIGNMENTS=94 CHECKS=3025	SAT TT=0.041 ASSIGNMENTS=94 CHECKS=3025	SAT TT=0.867	SAT TT=1.051	SAT TT=0.042 CHECKS=1464	SAT TT=0.009 ASSIGNMENTS=79 CHECKS=2594	SAT TT=0.017 ASSIGNMENTS=1683 CHECKS=39770	SAT TT=0.33	SAT TT=0.007 ASSIGNMENTS=116 CHECKS=2247	SAT TT=0.009 ASSIGNMENTS=94 CHECKS=3025	SAT TT=0.818	SAT TT=0.016 ASSIGNMENTS=184 CHECKS=5885	SAT TT=0.597	SAT TT=0.584
csp/aim-50/ normalized-aim-50-2-0-sat-3_ext.xml	SAT TT=0.009	SAT TT=0.872 CHECKS=881 NODES=142	SAT TT=0.763 CHECKS=1040 NODES=148	SAT TT=0.071	SAT TT=0.013 CHECKS=4067	SAT TT=0.015 CHECKS=6206	SAT TT=0.443 ASSIGNMENTS=100	SAT TT=0.473 ASSIGNMENTS=65	SAT TT=0.356 CHECKS=716 NODES=78	SAT TT=0.554 CHECKS=602614 NODES=31975	SAT TT=0.42 CHECKS=158615 NODES=1353	SAT TT=0.021 ASSIGNMENTS=75 CHECKS=2280	SAT TT=0.02 ASSIGNMENTS=75 CHECKS=2280	SAT TT=0.854	SAT TT=0.843	SAT TT=0.052 CHECKS=2288	SAT TT=0.009 ASSIGNMENTS=73 CHECKS=2204	SAT TT=0.012 ASSIGNMENTS=312 CHECKS=8475	SAT TT=0.323	SAT TT=0.009 ASSIGNMENTS=102 CHECKS=2205	SAT TT=0.01 ASSIGNMENTS=75 CHECKS=2280	SAT TT=0.748	SAT TT=0.02 ASSIGNMENTS=249 CHECKS=8598	SAT TT=0.599	SAT TT=0.61
csp/aim-50/ normalized-aim-50-2-0-sat-4_ext.xml	SAT TT=0.006	SAT TT=0.724 CHECKS=1267 NODES=155	SAT TT=0.773 CHECKS=1476 NODES=119	SAT TT=0.053	SAT TT=0.011 CHECKS=1430	SAT TT=0.013 CHECKS=5796	SAT TT=0.437 ASSIGNMENTS=5	SAT TT=0.425 ASSIGNMENTS=7	SAT TT=0.39 CHECKS=447 NODES=68	SAT TT=0.42 CHECKS=80401 NODES=3778	SAT TT=0.378 CHECKS=10336 NODES=126	SAT TT=0.019 ASSIGNMENTS=24 CHECKS=895	SAT TT=0.02 ASSIGNMENTS=24 CHECKS=895	SAT TT=1.001	SAT TT=0.797	SAT TT=0.045 CHECKS=1258	SAT TT=0.008 ASSIGNMENTS=44 CHECKS=1272	SAT TT=0.013 ASSIGNMENTS=381 CHECKS=10817	SAT TT=0.33	SAT TT=0.008 ASSIGNMENTS=27 CHECKS=629	SAT TT=0.006 ASSIGNMENTS=24 CHECKS=895	SAT TT=0.742	SAT TT=0.013 ASSIGNMENTS=89 CHECKS=2794	SAT TT=0.609	SAT TT=0.606
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-50/ normalized-aim-50-2-0-unsat-1_ext.xml	UNSAT TT=0.01	UNSAT TT=0.85 CHECKS=1930 NODES=195	UNSAT TT=0.804 CHECKS=1863 NODES=158	UNSAT TT=0.174	UNSAT TT=0.021 CHECKS=8972	UNSAT TT=0.024 CHECKS=20978	UNSAT TT=0.586 ASSIGNMENTS=418	UNSAT TT=0.545 ASSIGNMENTS=233	UNSAT TT=0.412 CHECKS=1335 NODES=84	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.022 ASSIGNMENTS=220 CHECKS=6449	UNSAT TT=0.02 ASSIGNMENTS=220 CHECKS=6449	UNSAT TT=0.512	UNSAT TT=0.509	UNSAT TT=0.051 CHECKS=2903	UNSAT TT=0.012 ASSIGNMENTS=230 CHECKS=6566	UNSAT TT=0.033 ASSIGNMENTS=4355 CHECKS=93427	UNSAT TT=0.324	UNSAT TT=0.01 ASSIGNMENTS=129 CHECKS=2483	UNSAT TT=0.01 ASSIGNMENTS=220 CHECKS=6449	UNSAT TT=0.74	UNSAT TT=0.018 ASSIGNMENTS=193 CHECKS=10384	UNSAT TT=0.634	UNSAT TT=0.62
csp/aim-50/ normalized-aim-50-2-0-unsat-2_ext.xml	UNSAT TT=0.008	UNSAT TT=0.743 CHECKS=1886 NODES=282	UNSAT TT=0.954 CHECKS=2284 NODES=265	UNSAT TT=0.192	UNSAT TT=0.016 CHECKS=4599	UNSAT TT=0.015 CHECKS=6469	UNSAT TT=0.427 ASSIGNMENTS=95	UNSAT TT=0.454 ASSIGNMENTS=16	UNSAT TT=0.361 CHECKS=1060 NODES=71	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.022 ASSIGNMENTS=111 CHECKS=2894	UNSAT TT=0.02 ASSIGNMENTS=111 CHECKS=2894	UNSAT TT=0.471	UNSAT TT=0.65	UNSAT TT=0.061 CHECKS=2530	UNSAT TT=0.01 ASSIGNMENTS=83 CHECKS=2249	UNSAT TT=0.032 ASSIGNMENTS=4064 CHECKS=96877	UNSAT TT=0.322	UNSAT TT=0.011 ASSIGNMENTS=122 CHECKS=2645	UNSAT TT=0.008 ASSIGNMENTS=111 CHECKS=2894	UNSAT TT=0.734	UNSAT TT=0.014 ASSIGNMENTS=120 CHECKS=4430	UNSAT TT=0.593	UNSAT TT=0.605
csp/aim-50/ normalized-aim-50-2-0-unsat-3_ext.xml	UNSAT TT=0.008	UNSAT TT=0.777 CHECKS=2217 NODES=251	UNSAT TT=0.82 CHECKS=2163 NODES=253	UNSAT TT=0.146	UNSAT TT=0.015 CHECKS=3622	UNSAT TT=0.02 CHECKS=13042	UNSAT TT=0.435 ASSIGNMENTS=82	UNSAT TT=0.468 ASSIGNMENTS=131	UNSAT TT=0.386 CHECKS=954 NODES=51	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.022 ASSIGNMENTS=157 CHECKS=4921	UNSAT TT=0.021 ASSIGNMENTS=157 CHECKS=4921	UNSAT TT=0.509	UNSAT TT=0.517	UNSAT TT=0.064 CHECKS=3056	UNSAT TT=0.01 ASSIGNMENTS=174 CHECKS=5493	UNSAT TT=0.032 ASSIGNMENTS=4133 CHECKS=84382	UNSAT TT=0.318	UNSAT TT=0.009 ASSIGNMENTS=125 CHECKS=2453	UNSAT TT=0.008 ASSIGNMENTS=157 CHECKS=4921	UNSAT TT=0.789	UNSAT TT=0.015 ASSIGNMENTS=56 CHECKS=2720	UNSAT TT=0.62	UNSAT TT=0.603
csp/aim-50/ normalized-aim-50-2-0-unsat-4_ext.xml	UNSAT TT=0.008	UNSAT TT=0.795 CHECKS=1880 NODES=238	UNSAT TT=0.825 CHECKS=1227 NODES=130	UNSAT TT=0.199	UNSAT TT=0.017 CHECKS=4459	UNSAT TT=0.016 CHECKS=6916	UNSAT TT=0.449 ASSIGNMENTS=132	UNSAT TT=0.503 ASSIGNMENTS=147	UNSAT TT=0.389 CHECKS=872 NODES=55	? (TO) TT=1800.12	? (TO) TT=1800.02	UNSAT TT=0.024 ASSIGNMENTS=114 CHECKS=3134	UNSAT TT=0.021 ASSIGNMENTS=114 CHECKS=3134	UNSAT TT=0.637	UNSAT TT=0.482	UNSAT TT=0.05 CHECKS=1757	UNSAT TT=0.008 ASSIGNMENTS=121 CHECKS=3225	UNSAT TT=0.028 ASSIGNMENTS=4382 CHECKS=81259	UNSAT TT=0.35	UNSAT TT=0.011 ASSIGNMENTS=196 CHECKS=3789	UNSAT TT=0.01 ASSIGNMENTS=114 CHECKS=3134	UNSAT TT=0.739	UNSAT TT=0.013 ASSIGNMENTS=77 CHECKS=3050	UNSAT TT=0.603	UNSAT TT=0.601
csp/aim-50/ normalized-aim-50-3-4-sat-1_ext.xml	SAT TT=0.008	SAT TT=0.803 CHECKS=702 NODES=73	SAT TT=0.782 CHECKS=870 NODES=58	SAT TT=0.054	SAT TT=0.013 CHECKS=1312	SAT TT=0.013 CHECKS=1102	SAT TT=0.469 ASSIGNMENTS=6	SAT TT=0.518 ASSIGNMENTS=18	SAT TT=0.419 CHECKS=1913 NODES=90	SAT TT=0.407 CHECKS=89249 NODES=2318	SAT TT=0.48 CHECKS=9018 NODES=54	SAT TT=0.022 ASSIGNMENTS=5 CHECKS=468	SAT TT=0.023 ASSIGNMENTS=5 CHECKS=468	SAT TT=1.105	SAT TT=1.088	SAT TT=0.066 CHECKS=1814	SAT TT=0.009 ASSIGNMENTS=5 CHECKS=468	SAT TT=0.011 ASSIGNMENTS=68 CHECKS=4270	SAT TT=0.409	SAT TT=0.011 ASSIGNMENTS=89 CHECKS=3931	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=468	SAT TT=0.863	SAT TT=0.019 ASSIGNMENTS=136 CHECKS=11187	SAT TT=0.628	SAT TT=0.665
csp/aim-50/ normalized-aim-50-3-4-sat-2_ext.xml	SAT TT=0.01	SAT TT=0.919 CHECKS=3802 NODES=274	SAT TT=0.828 CHECKS=4071 NODES=241	SAT TT=0.053	SAT TT=0.019 CHECKS=7001	SAT TT=0.021 CHECKS=13117	SAT TT=0.513 ASSIGNMENTS=70	SAT TT=0.461 ASSIGNMENTS=21	SAT TT=0.373 CHECKS=530 NODES=52	SAT TT=0.437 CHECKS=91486 NODES=2315	SAT TT=0.442 CHECKS=137244 NODES=1014	SAT TT=0.022 ASSIGNMENTS=51 CHECKS=3704	SAT TT=0.022 ASSIGNMENTS=51 CHECKS=3704	SAT TT=0.906	SAT TT=1.167	SAT TT=0.055 CHECKS=7101	SAT TT=0.011 ASSIGNMENTS=63 CHECKS=5922	SAT TT=0.015 ASSIGNMENTS=333 CHECKS=25840	SAT TT=0.41	SAT TT=0.011 ASSIGNMENTS=21 CHECKS=931	SAT TT=0.01 ASSIGNMENTS=51 CHECKS=3704	SAT TT=0.871	SAT TT=0.03 ASSIGNMENTS=132 CHECKS=12635	SAT TT=0.662	SAT TT=0.651
csp/aim-50/ normalized-aim-50-3-4-sat-3_ext.xml	SAT TT=0.009	SAT TT=0.826 CHECKS=1107 NODES=80	SAT TT=0.824 CHECKS=1336 NODES=79	SAT TT=0.053	SAT TT=0.018 CHECKS=4045	SAT TT=0.02 CHECKS=11825	SAT TT=0.52 ASSIGNMENTS=54	SAT TT=0.471 ASSIGNMENTS=24	SAT TT=0.434 CHECKS=2493 NODES=102	SAT TT=0.478 CHECKS=39482 NODES=976	SAT TT=0.43 CHECKS=56821 NODES=506	SAT TT=0.023 ASSIGNMENTS=123 CHECKS=11368	SAT TT=0.024 ASSIGNMENTS=123 CHECKS=11368	SAT TT=1.102	SAT TT=0.958	SAT TT=0.069 CHECKS=3510	SAT TT=0.011 ASSIGNMENTS=73 CHECKS=6572	SAT TT=0.01 ASSIGNMENTS=51 CHECKS=3887	SAT TT=0.371	SAT TT=0.009 ASSIGNMENTS=14 CHECKS=691	SAT TT=0.013 ASSIGNMENTS=123 CHECKS=11368	SAT TT=0.787	SAT TT=0.03 ASSIGNMENTS=139 CHECKS=13576	SAT TT=0.692	SAT TT=0.676
csp/aim-50/ normalized-aim-50-3-4-sat-4_ext.xml	SAT TT=0.01	SAT TT=0.783 CHECKS=1943 NODES=128	SAT TT=0.78 CHECKS=974 NODES=53	SAT TT=0.047	SAT TT=0.016 CHECKS=2349	SAT TT=0.016 CHECKS=4471	SAT TT=0.486 ASSIGNMENTS=27	SAT TT=0.531 ASSIGNMENTS=23	SAT TT=0.406 CHECKS=829 NODES=68	SAT TT=0.396 CHECKS=29535 NODES=722	SAT TT=0.43 CHECKS=34591 NODES=336	SAT TT=0.022 ASSIGNMENTS=16 CHECKS=1416	SAT TT=0.02 ASSIGNMENTS=16 CHECKS=1416	SAT TT=0.886	SAT TT=1.144	SAT TT=0.059 CHECKS=4843	SAT TT=0.011 ASSIGNMENTS=12 CHECKS=1441	SAT TT=0.01 ASSIGNMENTS=84 CHECKS=6231	SAT TT=0.364	SAT TT=0.012 ASSIGNMENTS=79 CHECKS=3690	SAT TT=0.01 ASSIGNMENTS=16 CHECKS=1416	SAT TT=0.832	SAT TT=0.019 ASSIGNMENTS=89 CHECKS=6215	SAT TT=0.642	SAT TT=0.668
csp/aim-50/ normalized-aim-50-6-0-sat-1_ext.xml	SAT TT=0.013	SAT TT=0.837 CHECKS=1164 NODES=72	SAT TT=0.854 CHECKS=2424 NODES=57	SAT TT=0.06	SAT TT=0.016 CHECKS=1797	SAT TT=0.016 CHECKS=2552	SAT TT=0.566 ASSIGNMENTS=1	SAT TT=0.542 ASSIGNMENTS=1	SAT TT=0.459 CHECKS=2475 NODES=73	SAT TT=0.653 CHECKS=203734 NODES=2882	SAT TT=0.443 CHECKS=10561 NODES=23	SAT TT=0.026 ASSIGNMENTS=15 CHECKS=1722	SAT TT=0.025 ASSIGNMENTS=15 CHECKS=1722	SAT TT=1.211	SAT TT=1.374	SAT TT=0.057 CHECKS=1288	SAT TT=0.013 ASSIGNMENTS=11 CHECKS=1547	SAT TT=0.013 ASSIGNMENTS=4 CHECKS=1044	SAT TT=0.488	SAT TT=0.013 ASSIGNMENTS=25 CHECKS=2130	SAT TT=0.013 ASSIGNMENTS=15 CHECKS=1722	SAT TT=0.86	SAT TT=0.023 ASSIGNMENTS=84 CHECKS=12073	SAT TT=0.767	SAT TT=0.767
csp/aim-50/ normalized-aim-50-6-0-sat-2_ext.xml	SAT TT=0.013	SAT TT=0.855 CHECKS=2005 NODES=100	SAT TT=0.807 CHECKS=1471 NODES=0	SAT TT=0.062	SAT TT=37.557 CHECKS=3611	SAT TT=0.019 CHECKS=2469	SAT TT=0.528 ASSIGNMENTS=1	SAT TT=0.55 ASSIGNMENTS=1	SAT TT=0.447 CHECKS=595 NODES=51	SAT TT=0.47 CHECKS=7082 NODES=47	SAT TT=0.47 CHECKS=19811 NODES=112	SAT TT=0.024 ASSIGNMENTS=4 CHECKS=1112	SAT TT=0.023 ASSIGNMENTS=4 CHECKS=1112	SAT TT=1.095	SAT TT=1.221	SAT TT=0.083 CHECKS=794	SAT TT=0.013 ASSIGNMENTS=5 CHECKS=1073	SAT TT=0.011 ASSIGNMENTS=6 CHECKS=1646	SAT TT=0.419	SAT TT=0.015 ASSIGNMENTS=22 CHECKS=1876	SAT TT=0.013 ASSIGNMENTS=4 CHECKS=1112	SAT TT=0.928	SAT TT=0.024 ASSIGNMENTS=58 CHECKS=5545	SAT TT=0.81	SAT TT=0.776
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-50/ normalized-aim-50-6-0-sat-3_ext.xml	SAT TT=0.011	SAT TT=0.857 CHECKS=1587 NODES=78	SAT TT=0.779 CHECKS=626 NODES=0	SAT TT=0.061	SAT TT=0.017 CHECKS=3978	SAT TT=0.016 CHECKS=3352	SAT TT=0.575 ASSIGNMENTS=1	SAT TT=0.575 ASSIGNMENTS=1	SAT TT=0.448 CHECKS=513 NODES=50	SAT TT=0.623 CHECKS=16066 NODES=190	SAT TT=0.461 CHECKS=17584 NODES=103	SAT TT=0.025 ASSIGNMENTS=18 CHECKS=2370	SAT TT=0.024 ASSIGNMENTS=18 CHECKS=2370	SAT TT=1.028	SAT TT=1.206	SAT TT=0.089 CHECKS=3722	SAT TT=0.012 ASSIGNMENTS=16 CHECKS=2268	SAT TT=0.012 ASSIGNMENTS=2 CHECKS=860	SAT TT=0.478	SAT TT=0.012 ASSIGNMENTS=6 CHECKS=1200	SAT TT=0.011 ASSIGNMENTS=18 CHECKS=2370	SAT TT=0.9	SAT TT=0.023 ASSIGNMENTS=59 CHECKS=5750	SAT TT=0.76	SAT TT=0.862
csp/aim-50/ normalized-aim-50-6-0-sat-4_ext.xml	SAT TT=0.011	SAT TT=0.849 CHECKS=1771 NODES=88	SAT TT=0.872 CHECKS=1681 NODES=0	SAT TT=0.062	SAT TT=0.017 CHECKS=2589	SAT TT=0.018 CHECKS=5098	SAT TT=0.536 ASSIGNMENTS=1	SAT TT=0.506 ASSIGNMENTS=1	SAT TT=0.439 CHECKS=596 NODES=51	SAT TT=2.912 CHECKS=9820330 NODES=150048	SAT TT=0.439 CHECKS=22347 NODES=150	SAT TT=0.024 ASSIGNMENTS=14 CHECKS=2724	SAT TT=0.022 ASSIGNMENTS=14 CHECKS=2724	SAT TT=1.202	SAT TT=0.998	SAT TT=0.07 CHECKS=4370	SAT TT=0.012 ASSIGNMENTS=21 CHECKS=3527	SAT TT=0.012 ASSIGNMENTS=15 CHECKS=2665	SAT TT=0.417	SAT TT=0.013 ASSIGNMENTS=8 CHECKS=1200	SAT TT=0.011 ASSIGNMENTS=14 CHECKS=2724	SAT TT=0.855	SAT TT=0.025 ASSIGNMENTS=64 CHECKS=7161	SAT TT=0.749	SAT TT=0.903
csp/allIntervalSeries/ normalized-series-100.xml	SAT TT=0.759	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=1.26	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.03	? (MO) TT=1221.49	No data	? (TO) TT=1800.05	SAT TT=4.225 ASSIGNMENTS=774 CHECKS=646882	? (TO) TT=1800.07	SAT TT=0.759 ASSIGNMENTS=1 CHECKS=54843	? (TO) TT=1800.02	? TT=140.01	No data	? (TO) TT=1800.06	? (TO) TT=1800.06
csp/allIntervalSeries/ normalized-series-10.xml	SAT TT=0.009	SAT TT=0.931 CHECKS=108808 NODES=447	SAT TT=0.902 CHECKS=90998 NODES=255	SAT TT=0.038	SAT TT=0.163 CHECKS=385886	SAT TT=0.249 CHECKS=972583	SAT TT=0.885 ASSIGNMENTS=60	SAT TT=0.783 ASSIGNMENTS=4	SAT TT=0.7 CHECKS=76601 NODES=255	SAT TT=1.075 CHECKS=1842810 NODES=17623	SAT TT=0.697 CHECKS=14838 NODES=58	SAT TT=0.135 ASSIGNMENTS=1577 CHECKS=148870	SAT TT=0.126 ASSIGNMENTS=1577 CHECKS=148870	SAT TT=1.521	SAT TT=1.34	No data	SAT TT=0.116 ASSIGNMENTS=1413 CHECKS=141957	SAT TT=0.01 ASSIGNMENTS=15 CHECKS=1335	SAT TT=0.56	SAT TT=0.009 ASSIGNMENTS=1 CHECKS=528	SAT TT=0.013 ASSIGNMENTS=44 CHECKS=4486	SAT TT=2.591	No data	SAT TT=0.879	SAT TT=0.905
csp/allIntervalSeries/ normalized-series-12.xml	SAT TT=0.011	SAT TT=1.159 CHECKS=503774 NODES=1618	SAT TT=2.304 CHECKS=2364350 NODES=7549	SAT TT=0.044	SAT TT=3.242 CHECKS=14991800	SAT TT=5.181 CHECKS=22998500	SAT TT=1.093 ASSIGNMENTS=532	SAT TT=0.922 ASSIGNMENTS=24	SAT TT=3.425 CHECKS=4641930 NODES=10563	SAT TT=5.435 CHECKS=22957200 NODES=154803	? (TO) TT=1800.02	SAT TT=7.066 ASSIGNMENTS=94 CHECKS=10289	SAT TT=9.438 ASSIGNMENTS=6501 CHECKS=2065960	SAT TT=2.599	SAT TT=1.955	No data	SAT TT=2.29 ASSIGNMENTS=24656 CHECKS=2896690	SAT TT=0.012 ASSIGNMENTS=9 CHECKS=1094	SAT TT=10.128	SAT TT=0.011 ASSIGNMENTS=1 CHECKS=767	SAT TT=0.019 ASSIGNMENTS=94 CHECKS=10289	SAT TT=3.375	No data	SAT TT=2.168	SAT TT=0.824
csp/allIntervalSeries/ normalized-series-15.xml	SAT TT=0.015	SAT TT=69.795 CHECKS=129056000 NODES=342327	SAT TT=64.78 CHECKS=129145000 NODES=342327	SAT TT=0.052	SAT TT=115.591 CHECKS=509513000	SAT TT=22.237 CHECKS=94409100	SAT TT=1.397 ASSIGNMENTS=1106	SAT TT=1.084 ASSIGNMENTS=56	SAT TT=345.999 CHECKS=723681000 NODES=1099340	SAT TT=73.429 CHECKS=437560000 NODES=1911200	? (TO) TT=1800.08	SAT TT=8.942 ASSIGNMENTS=1106	SAT TT=363.23 ASSIGNMENTS=1639580 CHECKS=770219000	SAT TT=32.124	SAT TT=5.566	No data	SAT TT=8.622 ASSIGNMENTS=71133 CHECKS=10765900	SAT TT=0.106 ASSIGNMENTS=928 CHECKS=119954	? (TO) TT=1800.09	SAT TT=0.015 ASSIGNMENTS=1 CHECKS=1208	SAT TT=0.151 ASSIGNMENTS=1220 CHECKS=174310	SAT TT=337.443	No data	SAT TT=65.561	SAT TT=3.613
csp/allIntervalSeries/ normalized-series-16.xml	SAT TT=0.015	SAT TT=192.347 CHECKS=386221000 NODES=775841	SAT TT=193.628 CHECKS=386377000 NODES=775841	SAT TT=0.052	SAT TT=20.218 CHECKS=93087300	SAT TT=564.099 CHECKS=2790740000	SAT TT=1.079 ASSIGNMENTS=42	SAT TT=1.114 ASSIGNMENTS=6	SAT TT=1755.05 CHECKS=3789000000 NODES=4952830	SAT TT=103.969 CHECKS=584581000 NODES=2250530	? (TO) TT=1800.08	SAT TT=8.387 ASSIGNMENTS=42	SAT TT=511.855 ASSIGNMENTS=1323 CHECKS=166289	SAT TT=293.332	SAT TT=4.222	No data	SAT TT=0.863 ASSIGNMENTS=6550 CHECKS=1002750	SAT TT=0.019 ASSIGNMENTS=42 CHECKS=5917	? (TO) TT=1800.05	SAT TT=0.015 ASSIGNMENTS=1 CHECKS=1377	SAT TT=0.151 ASSIGNMENTS=1323 CHECKS=166289	? (TO) TT=1800.19	No data	SAT TT=3.945	SAT TT=30.232
csp/allIntervalSeries/ normalized-series-18.xml	SAT TT=0.016	? (TO) TT=1800.08	? (TO) TT=1800.14	SAT TT=0.065	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=2.631 ASSIGNMENTS=4139	SAT TT=1.316 ASSIGNMENTS=91	? (TO) TT=1800.03	SAT TT=955.655 CHECKS=5617760000 NODES=17170000	? (TO) TT=1800.08	SAT TT=10.211 ASSIGNMENTS=4139	SAT TT=512.382 ASSIGNMENTS=3463 CHECKS=566291	SAT TT=190.383	SAT TT=13.327	No data	SAT TT=457.807 ASSIGNMENTS=2807590 CHECKS=528970000	SAT TT=0.019 ASSIGNMENTS=1 CHECKS=1748	? (TO) TT=1800.1	SAT TT=0.016 ASSIGNMENTS=1 CHECKS=1748	SAT TT=0.454 ASSIGNMENTS=3463 CHECKS=566291	? (TO) TT=1800.16	No data	SAT TT=327.544	SAT TT=115.297
csp/allIntervalSeries/ normalized-series-20.xml	SAT TT=0.022	? (TO) TT=1800.11	SAT TT=338.246 CHECKS=688420000 NODES=942071	SAT TT=0.071	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=1.657 ASSIGNMENTS=1440	SAT TT=1.205 ASSIGNMENTS=19	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=9.206 ASSIGNMENTS=1440	SAT TT=513.083 ASSIGNMENTS=6771 CHECKS=1368540	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	SAT TT=13.884 ASSIGNMENTS=87320 CHECKS=17166300	SAT TT=0.172 ASSIGNMENTS=1067 CHECKS=189121	? (TO) TT=1800.09	SAT TT=0.022 ASSIGNMENTS=1 CHECKS=2163	SAT TT=1.204 ASSIGNMENTS=6771 CHECKS=1368540	? (TO) TT=1800.17	No data	? (TO) TT=1800.13	SAT TT=1024.22
csp/allIntervalSeries/ normalized-series-25.xml	SAT TT=0.031	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=0.103	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1507.95 ASSIGNMENTS=1826070	SAT TT=1.89 ASSIGNMENTS=111	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=1524.27 ASSIGNMENTS=1826070	SAT TT=515.015 ASSIGNMENTS=11798 CHECKS=3002610	? (TO) TT=1800.06	? (TO) TT=1800.1	No data	SAT TT=186.661 ASSIGNMENTS=853357 CHECKS=207638000	SAT TT=0.159 ASSIGNMENTS=525 CHECKS=125961	? (TO) TT=1800.12	SAT TT=0.031 ASSIGNMENTS=1 CHECKS=3393	SAT TT=2.687 ASSIGNMENTS=11798 CHECKS=3002610	? (TO) TT=1800.2	No data	? (TO) TT=1800.05	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allIntervalSeries/ normalized-series-30.xml	SAT TT=0.039	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=0.135	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=2.259 ASSIGNMENTS=459	SAT TT=2.019 ASSIGNMENTS=12	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=9.521 ASSIGNMENTS=459	SAT TT=512.894 ASSIGNMENTS=2578 CHECKS=713222	? (TO) TT=1800.04	? (TO) TT=1800.07	No data	SAT TT=9.658 ASSIGNMENTS=19341 CHECKS=6642560	SAT TT=0.769 ASSIGNMENTS=2170 CHECKS=581724	? (TO) TT=1800.11	SAT TT=0.039 ASSIGNMENTS=1 CHECKS=4898	SAT TT=0.843 ASSIGNMENTS=2578 CHECKS=713222	? (TO) TT=1800.2	No data	? (TO) TT=1800.05	? (TO) TT=1800.06
csp/allIntervalSeries/ normalized-series-35.xml	SAT TT=0.061	? (TO) TT=1800.15	? (TO) TT=1800.04	SAT TT=0.163	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.13	SAT TT=2.067 ASSIGNMENTS=64	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800	No data	? (TO) TT=1800.01	SAT TT=0.233 ASSIGNMENTS=361 CHECKS=115179	? (TO) TT=1800.09	SAT TT=0.061 ASSIGNMENTS=1 CHECKS=6678	? (TO) TT=1800.08	? (TO) TT=1800.2	No data	? (TO) TT=1800.06	? (TO) TT=1800.05
csp/allIntervalSeries/ normalized-series-70.xml	SAT TT=0.276	? (TO) TT=1800.06	? (TO) TT=1800.16	SAT TT=0.604	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.02	? (MO) TT=1057.9	No data	? (TO) TT=1800.04	SAT TT=6.169 ASSIGNMENTS=2289 CHECKS=1375520	? (TO) TT=1800.12	SAT TT=0.276 ASSIGNMENTS=1 CHECKS=26838	? (TO) TT=1800.07	? TT=63.443	No data	? (TO) TT=1800.01	? (TO) TT=1800.1
csp/allIntervalSeries/ normalized-series-80.xml	SAT TT=0.409	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=0.857	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=19.625 ASSIGNMENTS=2704	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (MO) TT=1151.8	No data	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=0.409 ASSIGNMENTS=1 CHECKS=35073	? (TO) TT=1800.03	? TT=124.445	No data	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/allIntervalSeries/ normalized-series-8.xml	SAT TT=0.008	SAT TT=0.758 CHECKS=3074 NODES=26	SAT TT=0.786 CHECKS=19140 NODES=107	SAT TT=0.03	SAT TT=0.045 CHECKS=45074	SAT TT=0.023 CHECKS=53567	SAT TT=0.706 ASSIGNMENTS=12	SAT TT=0.727 ASSIGNMENTS=4	SAT TT=0.594 CHECKS=15712 NODES=95	SAT TT=0.59 CHECKS=85743 NODES=1229	SAT TT=0.606 CHECKS=7654 NODES=48	SAT TT=0.025 ASSIGNMENTS=96 CHECKS=7794	SAT TT=0.026 ASSIGNMENTS=96 CHECKS=7794	SAT TT=1.282	SAT TT=1.198	No data	SAT TT=0.014 ASSIGNMENTS=91 CHECKS=7519	SAT TT=0.01 ASSIGNMENTS=17 CHECKS=920	SAT TT=0.371	SAT TT=0.009 ASSIGNMENTS=1 CHECKS=333	SAT TT=0.008 ASSIGNMENTS=11 CHECKS=998	SAT TT=2.117	No data	SAT TT=0.575	SAT TT=0.696
csp/allIntervalSeries/ normalized-series-90.xml	SAT TT=0.526	? (TO) TT=1800.06	? (TO) TT=1800.12	SAT TT=1.076	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (MO) TT=1511.74	No data	? (TO) TT=1800.08	SAT TT=7.14 ASSIGNMENTS=2154 CHECKS=1572860	? (TO) TT=1800.05	SAT TT=0.526 ASSIGNMENTS=1 CHECKS=44408	? (TO) TT=1800.08	? TT=123.138	No data	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/allIntervalSeries/ normalized-series-9.xml	SAT TT=0.007	SAT TT=0.852 CHECKS=28486 NODES=197	SAT TT=0.85 CHECKS=59094 NODES=258	SAT TT=0.035	SAT TT=0.127 CHECKS=252484	SAT TT=0.089 CHECKS=305730	SAT TT=0.781 ASSIGNMENTS=35	SAT TT=0.745 ASSIGNMENTS=7	SAT TT=0.769 CHECKS=151825 NODES=741	SAT TT=0.725 CHECKS=343553 NODES=3987	SAT TT=10.878 CHECKS=69966000 NODES=95857	SAT TT=0.047 ASSIGNMENTS=444 CHECKS=37662	SAT TT=0.048 ASSIGNMENTS=444 CHECKS=37662	SAT TT=1.338	SAT TT=1.362	No data	SAT TT=0.03 ASSIGNMENTS=366 CHECKS=31863	SAT TT=0.013 ASSIGNMENTS=50 CHECKS=4023	SAT TT=0.406	SAT TT=0.007 ASSIGNMENTS=1 CHECKS=425	SAT TT=0.01 ASSIGNMENTS=9 CHECKS=1285	SAT TT=1.894	No data	SAT TT=0.654	SAT TT=0.63
csp/allsquares/ normalized-squares-10-10.xml	SAT TT=0.026	? TT=0.903	? TT=0.855	SAT TT=0.46	SAT TT=0.727 CHECKS=164427	SAT TT=0.255 CHECKS=154527	SAT TT=1.216 ASSIGNMENTS=17	SAT TT=1.433 ASSIGNMENTS=20	No data	No data	No data	SAT TT=0.04 ASSIGNMENTS=25 CHECKS=8352	SAT TT=0.038 ASSIGNMENTS=25 CHECKS=8352	No data	No data	No data	SAT TT=0.026 ASSIGNMENTS=18 CHECKS=6836	SAT TT=0.03 ASSIGNMENTS=47 CHECKS=17524	? (exit code) TT=0.531	SAT TT=0.213 ASSIGNMENTS=1306 CHECKS=360033	SAT TT=0.027 ASSIGNMENTS=25 CHECKS=8353	? TT=2.381	No data	SAT TT=1.22	SAT TT=1.599
csp/allsquares/ normalized-squares-11-11.xml	SAT TT=0.03	? TT=0.847	? TT=0.844	SAT TT=1158.8	SAT TT=0.978 CHECKS=251586	SAT TT=0.225 CHECKS=118247	SAT TT=1.318 ASSIGNMENTS=20	SAT TT=1.536 ASSIGNMENTS=21	No data	No data	No data	SAT TT=0.043 ASSIGNMENTS=26 CHECKS=10371	SAT TT=0.045 ASSIGNMENTS=26 CHECKS=10371	No data	No data	No data	SAT TT=0.03 ASSIGNMENTS=20 CHECKS=8737	SAT TT=0.033 ASSIGNMENTS=40 CHECKS=10721	? (exit code) TT=0.569	SAT TT=0.043 ASSIGNMENTS=138 CHECKS=14464	SAT TT=0.032 ASSIGNMENTS=26 CHECKS=10361	? TT=2.807	No data	SAT TT=1.518	SAT TT=1.762
csp/allsquares/ normalized-squares-12-12.xml	SAT TT=0.036	? TT=0.889	? TT=0.916	? (TO) TT=1800.09	SAT TT=0.95 CHECKS=157703	SAT TT=0.587 CHECKS=284867	SAT TT=1.463 ASSIGNMENTS=20	SAT TT=1.733 ASSIGNMENTS=25	No data	No data	No data	SAT TT=0.048 ASSIGNMENTS=27 CHECKS=12296	SAT TT=0.048 ASSIGNMENTS=27 CHECKS=12296	No data	No data	No data	SAT TT=0.036 ASSIGNMENTS=29 CHECKS=11812	SAT TT=0.048 ASSIGNMENTS=92 CHECKS=40323	? (exit code) TT=0.524	SAT TT=0.087 ASSIGNMENTS=295 CHECKS=75984	SAT TT=0.037 ASSIGNMENTS=27 CHECKS=12296	? TT=2.877	No data	SAT TT=1.862	SAT TT=2.017
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-13-13.xml	SAT TT=0.044	? TT=0.968	? TT=1.068	SAT TT=1338.97	SAT TT=1.564 CHECKS=371572	SAT TT=0.861 CHECKS=394761	SAT TT=1.549 ASSIGNMENTS=22	SAT TT=1.895 ASSIGNMENTS=28	No data	No data	No data	SAT TT=0.057 ASSIGNMENTS=30 CHECKS=15401	SAT TT=0.055 ASSIGNMENTS=30 CHECKS=15401	No data	No data	No data	SAT TT=0.046 ASSIGNMENTS=33 CHECKS=14808	SAT TT=0.084 ASSIGNMENTS=281 CHECKS=134758	? (exit code) TT=0.602	SAT TT=0.135 ASSIGNMENTS=464 CHECKS=158488	SAT TT=0.044 ASSIGNMENTS=30 CHECKS=15402	? TT=3.504	No data	SAT TT=1.898	SAT TT=2.755
csp/allsquares/ normalized-squares-14-14.xml	SAT TT=0.051	? TT=0.999	? TT=1.141	? (TO) TT=1800.11	SAT TT=8.927 CHECKS=9859980	SAT TT=1.576 CHECKS=807176	SAT TT=1.886 ASSIGNMENTS=23	SAT TT=1.889 ASSIGNMENTS=30	No data	No data	No data	SAT TT=0.064 ASSIGNMENTS=33 CHECKS=18941	SAT TT=0.064 ASSIGNMENTS=33 CHECKS=18941	No data	No data	No data	SAT TT=0.054 ASSIGNMENTS=35 CHECKS=18128	SAT TT=0.054 ASSIGNMENTS=36 CHECKS=26750	? (exit code) TT=0.615	SAT TT=0.189 ASSIGNMENTS=395 CHECKS=238430	SAT TT=0.051 ASSIGNMENTS=33 CHECKS=18942	? TT=3.751	No data	SAT TT=1.933	SAT TT=3.25
csp/allsquares/ normalized-squares-15-15.xml	SAT TT=0.072	? TT=1.176	? TT=1.176	SAT TT=1340.21	SAT TT=2.422 CHECKS=1193690	SAT TT=1.673 CHECKS=735506	SAT TT=2.143 ASSIGNMENTS=116	SAT TT=2.076 ASSIGNMENTS=29	No data	No data	No data	SAT TT=0.084 ASSIGNMENTS=69 CHECKS=43128	SAT TT=0.08 ASSIGNMENTS=69 CHECKS=43128	No data	No data	No data	SAT TT=0.102 ASSIGNMENTS=192 CHECKS=148958	SAT TT=0.164 ASSIGNMENTS=477 CHECKS=291107	? (exit code) TT=0.415	SAT TT=2.632 ASSIGNMENTS=6749 CHECKS=2890200	SAT TT=0.072 ASSIGNMENTS=76 CHECKS=45774	? TT=4.644	No data	SAT TT=2.568	SAT TT=4.207
csp/allsquares/ normalized-squares-16-16.xml	SAT TT=1.606	? TT=1.124	? TT=1.196	SAT TT=1345.67	? (TO) TT=1800.11	SAT TT=441.93 CHECKS=271392000	SAT TT=7.198 ASSIGNMENTS=3518	SAT TT=2.982 ASSIGNMENTS=644	No data	No data	No data	SAT TT=8.952 ASSIGNMENTS=2085 CHECKS=3836690	SAT TT=8.686 ASSIGNMENTS=2085 CHECKS=3836690	No data	No data	No data	SAT TT=2.092 ASSIGNMENTS=3671 CHECKS=5710140	SAT TT=2.965 ASSIGNMENTS=8878 CHECKS=7771260	? (exit code) TT=0.62	SAT TT=105.031 ASSIGNMENTS=125029 CHECKS=231010000	SAT TT=1.606 ASSIGNMENTS=2085 CHECKS=3836690	? TT=5.639	No data	SAT TT=2.904	SAT TT=4.889
csp/allsquares/ normalized-squares-17-17.xml	SAT TT=2.544	? TT=1.211	? TT=1.28	SAT TT=1349.81	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=2.544 ASSIGNMENTS=345	SAT TT=245.195 ASSIGNMENTS=118078	No data	No data	No data	SAT TT=19.356 ASSIGNMENTS=12856 CHECKS=24916400	SAT TT=18.768 ASSIGNMENTS=12856 CHECKS=24916400	No data	No data	No data	SAT TT=21.678 ASSIGNMENTS=30007 CHECKS=47136800	SAT TT=4.3 ASSIGNMENTS=9433 CHECKS=9578080	? (exit code) TT=0.686	SAT TT=315.266 ASSIGNMENTS=371137 CHECKS=613994000	SAT TT=11.179 ASSIGNMENTS=12856 CHECKS=24916400	? TT=7.896	No data	SAT TT=3.591	SAT TT=6.878
csp/allsquares/ normalized-squares-18-18.xml	SAT TT=1.249	? TT=1.289	? TT=1.288	SAT TT=1345.02	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=9.502 ASSIGNMENTS=4461	SAT TT=1426.5 ASSIGNMENTS=417690	No data	No data	No data	SAT TT=1.249 ASSIGNMENTS=2359 CHECKS=2612060	SAT TT=1.348 ASSIGNMENTS=2359 CHECKS=2612060	No data	No data	No data	SAT TT=5.589 ASSIGNMENTS=7184 CHECKS=11904600	SAT TT=5.215 ASSIGNMENTS=10355 CHECKS=10537200	? (exit code) TT=0.44	SAT TT=161.752 ASSIGNMENTS=164092 CHECKS=259915000	SAT TT=37.89 ASSIGNMENTS=47361 CHECKS=69118000	? TT=8.638	No data	SAT TT=4.578	SAT TT=7.945
csp/allsquares/ normalized-squares-19-19.xml	SAT TT=13.899	? TT=1.47	? TT=1.412	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.1	SAT TT=32.908 ASSIGNMENTS=18975	? (TO) TT=1800.07	No data	No data	No data	SAT TT=135.083 ASSIGNMENTS=110688 CHECKS=192957000	SAT TT=132.876 ASSIGNMENTS=110688 CHECKS=192957000	No data	No data	No data	SAT TT=84.222 ASSIGNMENTS=66683 CHECKS=149081000	SAT TT=37.588 ASSIGNMENTS=33753 CHECKS=66361300	? (exit code) TT=0.717	SAT TT=884.867 ASSIGNMENTS=509242 CHECKS=1182770000	SAT TT=119.813 ASSIGNMENTS=110688 CHECKS=192957000	? TT=11.04	No data	SAT TT=25.384	SAT TT=13.899
csp/allsquares/ normalized-squares-20-20.xml	SAT TT=6.734	? TT=1.552	? TT=1.554	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=1278.01 ASSIGNMENTS=1088810	? (TO) TT=1800.11	No data	No data	No data	SAT TT=147.321 ASSIGNMENTS=111914 CHECKS=246693000	SAT TT=153.787 ASSIGNMENTS=111914 CHECKS=246693000	No data	No data	No data	SAT TT=139.875 ASSIGNMENTS=110439 CHECKS=224651000	SAT TT=744.468 ASSIGNMENTS=545008 CHECKS=1117940000	? (exit code) TT=0.727	SAT TT=771.309 ASSIGNMENTS=462808 CHECKS=1063180000	SAT TT=147.743 ASSIGNMENTS=111914 CHECKS=246693000	? TT=14.328	No data	SAT TT=6.734	SAT TT=13.653
csp/allsquares/ normalized-squares-21-21.xml	SAT TT=29.692	? TT=1.691	? TT=1.687	SAT TT=1351.22	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.12	No data	No data	No data	SAT TT=351.29 ASSIGNMENTS=240563 CHECKS=459067000	SAT TT=347.62 ASSIGNMENTS=240563 CHECKS=459067000	No data	No data	No data	SAT TT=161.767 ASSIGNMENTS=92794 CHECKS=238589000	SAT TT=429.572 ASSIGNMENTS=279921 CHECKS=568725000	? (exit code) TT=0.472	? (TO) TT=1800.08	SAT TT=346.911 ASSIGNMENTS=240563 CHECKS=459067000	? TT=18.025	No data	SAT TT=65.959	SAT TT=29.692
csp/allsquares/ normalized-squares-22-22.xml	SAT TT=268.547	? TT=1.893	? TT=1.877	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.15	No data	No data	No data	SAT TT=388.702 ASSIGNMENTS=211898 CHECKS=471170000	SAT TT=386.623 ASSIGNMENTS=211898 CHECKS=471170000	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.03	? (exit code) TT=0.76	? (TO) TT=1800.09	SAT TT=357.59 ASSIGNMENTS=211898 CHECKS=471170000	? TT=20.968	No data	SAT TT=268.547	SAT TT=486.31
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-2-2.xml	SAT TT=0.005	? TT=0.642	? TT=0.569	SAT TT=0.026	SAT TT=0.008 CHECKS=191	SAT TT=0.009 CHECKS=210	SAT TT=0.48 ASSIGNMENTS=2	SAT TT=0.61 ASSIGNMENTS=3	No data	No data	No data	SAT TT=0.019 ASSIGNMENTS=1 CHECKS=46	SAT TT=0.019 ASSIGNMENTS=1 CHECKS=46	No data	No data	No data	SAT TT=0.005 ASSIGNMENTS=1 CHECKS=46	SAT TT=0.008 ASSIGNMENTS=2 CHECKS=49	? (exit code) TT=0.191	SAT TT=0.007 ASSIGNMENTS=1 CHECKS=46	SAT TT=0.005 ASSIGNMENTS=1 CHECKS=46	? TT=0.907	No data	SAT TT=0.49	SAT TT=0.476
csp/allsquares/ normalized-squares-23-23.xml	SAT TT=424.381	? TT=2.029	? TT=2.036	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.04	? (exit code) TT=1.034	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=26.973	No data	SAT TT=424.381	SAT TT=867.627
csp/allsquares/ normalized-squares-24-24.xml	SAT TT=30.729	? TT=2.321	? TT=2.302	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	No data	No data	No data	SAT TT=212.445 ASSIGNMENTS=105979 CHECKS=355261000	? (TO) TT=1800.01	? (exit code) TT=0.554	? (TO) TT=1800.02	SAT TT=1017.5 ASSIGNMENTS=510581 CHECKS=1416400000	? TT=33.747	No data	SAT TT=43.762	SAT TT=30.729
csp/allsquares/ normalized-squares-25-25.xml	SAT TT=177.971	? TT=2.685	? TT=2.475	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.11	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.07	? (exit code) TT=0.846	? (TO) TT=1800.08	? (TO) TT=1800.02	? TT=41.009	No data	SAT TT=267.101	SAT TT=177.971
csp/allsquares/ normalized-squares-26-26.xml	SAT TT=11.424	? TT=2.468	? TT=2.645	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=11.424 ASSIGNMENTS=4096	? (TO) TT=1800.14	No data	No data	No data	SAT TT=18.141 ASSIGNMENTS=4096	SAT TT=1026.79 ASSIGNMENTS=4096	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.05	? (exit code) TT=0.82	? (TO) TT=1800.08	? (TO) TT=1800.05	? TT=50.418	No data	SAT TT=18.541	SAT TT=44.394
csp/allsquares/ normalized-squares-27-27.xml	SAT TT=219.941	? TT=2.171	? TT=2.241	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.14	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.07	? (exit code) TT=0.521	? (TO) TT=1800.1	? (TO) TT=1800.06	? TT=61.371	No data	SAT TT=219.941	SAT TT=489.652
csp/allsquares/ normalized-squares-28-28.xml	SAT TT=66.947	? TT=2.091	? TT=1.926	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.08	SAT TT=139.912 ASSIGNMENTS=88693 CHECKS=276034000	? (exit code) TT=0.84	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=77.649	No data	SAT TT=118.323	SAT TT=66.947
csp/allsquares/ normalized-squares-29-29.xml	SAT TT=1015.17	? TT=1.744	? TT=1.758	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.11	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.04	? (exit code) TT=0.939	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=169.094	No data	SAT TT=1015.17	? (TO) TT=1800.02
csp/allsquares/ normalized-squares-30-30.xml	SAT TT=341.973	? TT=1.879	? TT=1.703	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.22	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.09	? (exit code) TT=0.585	? (TO) TT=1800.1	? (TO) TT=1800.1	? TT=710.032	No data	SAT TT=1749.98	SAT TT=341.973
csp/allsquares/ normalized-squares-31-31.xml	SAT TT=353.916	? TT=1.872	? TT=1.857	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.05	? (exit code) TT=0.961	? (TO) TT=1800.02	? (TO) TT=1800.08	? (MO) TT=90.582	No data	SAT TT=885.136	SAT TT=353.916
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-32-32.xml	SAT TT=474.828	? TT=2.092	? TT=1.878	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.05	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.11	? (exit code) TT=1.175	? (TO) TT=1800.04	? (TO) TT=1800.07	? (MO) TT=118.345	No data	SAT TT=1349.87	SAT TT=474.828
csp/allsquares/ normalized-squares-33-33.xml	SAT TT=542.258	? TT=2.084	? TT=2.085	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.09	? (exit code) TT=0.53	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=233.51	No data	SAT TT=1759.2	SAT TT=542.258
csp/allsquares/ normalized-squares-3-3.xml	SAT TT=0.005	? TT=0.609	? TT=0.598	SAT TT=0.029	SAT TT=0.018 CHECKS=3072	SAT TT=0.009 CHECKS=1396	SAT TT=0.58 ASSIGNMENTS=6	SAT TT=0.609 ASSIGNMENTS=5	No data	No data	No data	SAT TT=0.02 ASSIGNMENTS=4 CHECKS=245	SAT TT=0.02 ASSIGNMENTS=4 CHECKS=245	No data	No data	No data	SAT TT=0.008 ASSIGNMENTS=4 CHECKS=245	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=253	? (exit code) TT=0.179	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=241	SAT TT=0.005 ASSIGNMENTS=4 CHECKS=245	? TT=0.9	No data	SAT TT=0.526	SAT TT=0.554
csp/allsquares/ normalized-squares-34-34.xml		? TT=2.045	? TT=2.038	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.06	? (exit code) TT=1.242	? (TO) TT=1800.04	? (TO) TT=1800.06	? (MO) TT=106.499	No data	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/allsquares/ normalized-squares-35-35.xml		? TT=2.016	? TT=2.022	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.12	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.06	? (exit code) TT=1.076	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1802.17	No data	? (TO) TT=1800.32	? (TO) TT=1800.06
csp/allsquares/ normalized-squares-36-36.xml		? TT=1.926	? TT=2.2	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.13	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.07	? (exit code) TT=0.637	? (TO) TT=1800.09	? (TO) TT=1800.02	? TT=202.725	No data	? (TO) TT=1800.27	? (TO) TT=1800.05
csp/allsquares/ normalized-squares-37-37.xml		? TT=2.08	? TT=1.946	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.09	? (exit code) TT=1.096	? (TO) TT=1800.06	? (TO) TT=1800.04	? TT=229.329	No data	? (TO) TT=1800.33	? (TO) TT=1800.3
csp/allsquares/ normalized-squares-38-38.xml		? TT=1.956	? TT=1.963	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	? (exit code) TT=1.138	? (TO) TT=1800.02	? (TO) TT=1800.08	? (MO) TT=108.77	No data	? (MO) TT=55.763	? (TO) TT=1800.18
csp/allsquares/ normalized-squares-4-4.xml	SAT TT=0.007	? TT=0.606	? TT=0.644	SAT TT=0.033	SAT TT=0.038 CHECKS=2979	SAT TT=0.013 CHECKS=5931	SAT TT=0.641 ASSIGNMENTS=7	SAT TT=0.669 ASSIGNMENTS=7	No data	No data	No data	SAT TT=0.02 ASSIGNMENTS=5 CHECKS=529	SAT TT=0.018 ASSIGNMENTS=5 CHECKS=529	No data	No data	No data	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=529	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=574	? (exit code) TT=0.286	SAT TT=0.011 ASSIGNMENTS=15 CHECKS=608	SAT TT=0.007 ASSIGNMENTS=6 CHECKS=529	? TT=1.019	No data	SAT TT=0.714	SAT TT=0.716
csp/allsquares/ normalized-squares-5-5.xml	SAT TT=0.01	? TT=0.689	? TT=0.649	SAT TT=0.039	SAT TT=0.084 CHECKS=6906	SAT TT=0.032 CHECKS=21882	SAT TT=0.819 ASSIGNMENTS=8	SAT TT=0.807 ASSIGNMENTS=8	No data	No data	No data	SAT TT=0.021 ASSIGNMENTS=7 CHECKS=959	SAT TT=0.021 ASSIGNMENTS=7 CHECKS=959	No data	No data	No data	SAT TT=0.01 ASSIGNMENTS=7 CHECKS=959	SAT TT=0.01 ASSIGNMENTS=12 CHECKS=1155	? (exit code) TT=0.29	SAT TT=0.012 ASSIGNMENTS=17 CHECKS=889	SAT TT=0.011 ASSIGNMENTS=7 CHECKS=959	? TT=1.719	No data	SAT TT=0.769	SAT TT=0.904
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-6-6.xml	SAT TT=0.012	? TT=0.684	? TT=0.709	SAT TT=0.044	SAT TT=0.161 CHECKS=11392	SAT TT=0.031 CHECKS=20429	SAT TT=0.869 ASSIGNMENTS=11	SAT TT=0.989 ASSIGNMENTS=10	No data	No data	No data	SAT TT=0.024 ASSIGNMENTS=9 CHECKS=1603	SAT TT=0.024 ASSIGNMENTS=9 CHECKS=1603	No data	No data	No data	SAT TT=0.013 ASSIGNMENTS=9 CHECKS=1603	SAT TT=0.013 ASSIGNMENTS=17 CHECKS=1707	? (exit code) TT=0.252	SAT TT=0.013 ASSIGNMENTS=31 CHECKS=1776	SAT TT=0.012 ASSIGNMENTS=10 CHECKS=1603	? TT=1.673	No data	SAT TT=0.806	SAT TT=0.925
csp/allsquares/ normalized-squares-7-7.xml	SAT TT=0.014	? TT=0.692	? TT=0.668	SAT TT=0.05	SAT TT=0.259 CHECKS=32212	SAT TT=0.046 CHECKS=29555	SAT TT=0.905 ASSIGNMENTS=11	SAT TT=0.95 ASSIGNMENTS=12	No data	No data	No data	SAT TT=0.025 ASSIGNMENTS=10 CHECKS=2376	SAT TT=0.025 ASSIGNMENTS=10 CHECKS=2376	No data	No data	No data	SAT TT=0.015 ASSIGNMENTS=10 CHECKS=2376	SAT TT=0.014 ASSIGNMENTS=18 CHECKS=2739	? (exit code) TT=0.383	SAT TT=0.016 ASSIGNMENTS=54 CHECKS=3631	SAT TT=0.014 ASSIGNMENTS=10 CHECKS=2376	? TT=1.846	No data	SAT TT=0.913	SAT TT=0.938
csp/allsquares/ normalized-squares-8-8.xml	SAT TT=0.016	? TT=0.797	? TT=0.736	SAT TT=0.061	SAT TT=0.466 CHECKS=131200	SAT TT=0.074 CHECKS=46781	SAT TT=1.031 ASSIGNMENTS=12	SAT TT=1.157 ASSIGNMENTS=15	No data	No data	No data	SAT TT=0.029 ASSIGNMENTS=10 CHECKS=3573	SAT TT=0.029 ASSIGNMENTS=10 CHECKS=3573	No data	No data	No data	SAT TT=0.017 ASSIGNMENTS=10 CHECKS=3527	SAT TT=0.018 ASSIGNMENTS=12 CHECKS=3536	? (exit code) TT=0.436	SAT TT=0.022 ASSIGNMENTS=68 CHECKS=8493	SAT TT=0.016 ASSIGNMENTS=11 CHECKS=3527	? TT=2.064	No data	SAT TT=0.935	SAT TT=1.016
csp/allsquares/ normalized-squares-9-9.xml	SAT TT=0.021	? TT=0.737	? TT=0.745	SAT TT=0.086	SAT TT=0.551 CHECKS=147320	SAT TT=0.198 CHECKS=143946	SAT TT=1.204 ASSIGNMENTS=15	SAT TT=1.253 ASSIGNMENTS=17	No data	No data	No data	SAT TT=0.031 ASSIGNMENTS=19 CHECKS=5239	SAT TT=0.034 ASSIGNMENTS=19 CHECKS=5239	No data	No data	No data	SAT TT=0.021 ASSIGNMENTS=14 CHECKS=5142	SAT TT=0.022 ASSIGNMENTS=22 CHECKS=8931	? (exit code) TT=0.359	SAT TT=0.033 ASSIGNMENTS=133 CHECKS=19193	SAT TT=0.021 ASSIGNMENTS=17 CHECKS=5400	? TT=2.135	No data	SAT TT=1.196	SAT TT=1.116
csp/allsquaresUnsat/ normalized-squaresUnsat-10-10.xml	UNSAT TT=0.028	? TT=0.842	? TT=0.801	UNSAT TT=144.791	UNSAT TT=2.387 CHECKS=1745340	UNSAT TT=2.957 CHECKS=2574600	UNSAT TT=1.104 ASSIGNMENTS=0	UNSAT TT=1.109 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.038 ASSIGNMENTS=13 CHECKS=11406	UNSAT TT=0.039 ASSIGNMENTS=13 CHECKS=11406	No data	No data	No data	UNSAT TT=0.04 ASSIGNMENTS=84 CHECKS=44203	UNSAT TT=0.582 ASSIGNMENTS=4941 CHECKS=1657480	? (exit code) TT=0.533	UNSAT TT=0.042 ASSIGNMENTS=145 CHECKS=29681	UNSAT TT=0.028 ASSIGNMENTS=13 CHECKS=11406	? TT=2.406	No data	UNSAT TT=1.157	UNSAT TT=1.524
csp/allsquaresUnsat/ normalized-squaresUnsat-11-11.xml	UNSAT TT=0.039	? TT=0.945	? TT=0.898	UNSAT TT=1789.63	UNSAT TT=5.609 CHECKS=3934750	UNSAT TT=6.678 CHECKS=5397490	UNSAT TT=1.304 ASSIGNMENTS=0	UNSAT TT=1.234 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.043 ASSIGNMENTS=11 CHECKS=11735	UNSAT TT=0.044 ASSIGNMENTS=11 CHECKS=11735	No data	No data	No data	UNSAT TT=0.04 ASSIGNMENTS=59 CHECKS=41721	UNSAT TT=0.646 ASSIGNMENTS=5291 CHECKS=1983410	? (exit code) TT=0.566	UNSAT TT=0.298 ASSIGNMENTS=1786 CHECKS=403268	UNSAT TT=0.039 ASSIGNMENTS=50 CHECKS=26440	? TT=2.518	No data	UNSAT TT=1.376	UNSAT TT=1.591
csp/allsquaresUnsat/ normalized-squaresUnsat-12-12.xml	UNSAT TT=0.041	? TT=0.941	? TT=0.869	UNSAT TT=1345.04	UNSAT TT=8.406 CHECKS=6015970	UNSAT TT=9.924 CHECKS=7311620	UNSAT TT=1.218 ASSIGNMENTS=0	UNSAT TT=1.243 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.048 ASSIGNMENTS=19 CHECKS=14649	UNSAT TT=0.05 ASSIGNMENTS=19 CHECKS=14649	No data	No data	No data	UNSAT TT=0.048 ASSIGNMENTS=51 CHECKS=38810	UNSAT TT=0.796 ASSIGNMENTS=5811 CHECKS=2226820	? (exit code) TT=0.389	UNSAT TT=0.411 ASSIGNMENTS=2170 CHECKS=530746	UNSAT TT=0.041 ASSIGNMENTS=29 CHECKS=19176	? TT=2.812	No data	UNSAT TT=1.498	UNSAT TT=2.366
csp/allsquaresUnsat/ normalized-squaresUnsat-13-13.xml	UNSAT TT=0.042	? TT=0.951	? TT=1.05	UNSAT TT=1344.95	UNSAT TT=16.32 CHECKS=10257700	UNSAT TT=16.92 CHECKS=11278300	UNSAT TT=1.339 ASSIGNMENTS=0	UNSAT TT=1.331 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.054 ASSIGNMENTS=19 CHECKS=16161	UNSAT TT=0.053 ASSIGNMENTS=19 CHECKS=16161	No data	No data	No data	UNSAT TT=0.05 ASSIGNMENTS=43 CHECKS=42246	UNSAT TT=0.672 ASSIGNMENTS=4732 CHECKS=1966700	? (exit code) TT=0.684	UNSAT TT=0.185 ASSIGNMENTS=724 CHECKS=191981	UNSAT TT=0.042 ASSIGNMENTS=19 CHECKS=16286	? TT=3.303	No data	UNSAT TT=1.565	UNSAT TT=2.564
csp/allsquaresUnsat/ normalized-squaresUnsat-14-14.xml	UNSAT TT=0.051	? TT=1.004	? TT=0.986	? (TO) TT=1800.02	UNSAT TT=31.416 CHECKS=18151600	UNSAT TT=34.403 CHECKS=21077700	UNSAT TT=1.574 ASSIGNMENTS=0	UNSAT TT=1.611 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.063 ASSIGNMENTS=19 CHECKS=17825	UNSAT TT=0.064 ASSIGNMENTS=19 CHECKS=17825	No data	No data	No data	UNSAT TT=0.077 ASSIGNMENTS=104 CHECKS=74750	UNSAT TT=0.651 ASSIGNMENTS=3001 CHECKS=1447650	? (exit code) TT=0.684	UNSAT TT=0.12 ASSIGNMENTS=260 CHECKS=119424	UNSAT TT=0.051 ASSIGNMENTS=26 CHECKS=22403	? TT=3.697	No data	UNSAT TT=1.975	UNSAT TT=3.043
csp/allsquaresUnsat/ normalized-squaresUnsat-15-15.xml	UNSAT TT=0.06	? TT=1.061	? TT=1.066	UNSAT TT=1343.45	UNSAT TT=1.086 CHECKS=982	UNSAT TT=0.06 CHECKS=982	UNSAT TT=1.335 ASSIGNMENTS=0	UNSAT TT=1.428 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.071 ASSIGNMENTS=19 CHECKS=19530	UNSAT TT=0.072 ASSIGNMENTS=19 CHECKS=19530	No data	No data	No data	UNSAT TT=0.07 ASSIGNMENTS=38 CHECKS=45955	UNSAT TT=1.277 ASSIGNMENTS=6843 CHECKS=3277530	? (exit code) TT=0.42	UNSAT TT=0.158 ASSIGNMENTS=344 CHECKS=110887	UNSAT TT=0.064 ASSIGNMENTS=26 CHECKS=24464	? TT=4.462	No data	UNSAT TT=2.618	UNSAT TT=3.726
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-16-16.xml	UNSAT TT=0.064	? TT=1.249	? TT=1.119	UNSAT TT=1345.01	UNSAT TT=1.232 CHECKS=1106	UNSAT TT=0.065 CHECKS=1106	UNSAT TT=1.428 ASSIGNMENTS=0	UNSAT TT=1.597 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.081 ASSIGNMENTS=19 CHECKS=21276	UNSAT TT=0.082 ASSIGNMENTS=19 CHECKS=21276	No data	No data	No data	UNSAT TT=0.082 ASSIGNMENTS=40 CHECKS=51044	UNSAT TT=1.61 ASSIGNMENTS=7330 CHECKS=3696930	? (exit code) TT=0.65	UNSAT TT=0.805 ASSIGNMENTS=1149 CHECKS=453440	UNSAT TT=0.064 ASSIGNMENTS=20 CHECKS=24076	? TT=5.466	No data	UNSAT TT=2.549	UNSAT TT=4.445
csp/allsquaresUnsat/ normalized-squaresUnsat-17-17.xml	UNSAT TT=0.076	? TT=1.324	? TT=1.193	UNSAT TT=1352.53	UNSAT TT=1.458 CHECKS=1238	UNSAT TT=0.076 CHECKS=1238	UNSAT TT=1.533 ASSIGNMENTS=0	UNSAT TT=1.338 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=17.438 ASSIGNMENTS=10642 CHECKS=19776700	UNSAT TT=16.786 ASSIGNMENTS=10642 CHECKS=19776700	No data	No data	No data	UNSAT TT=19.168 ASSIGNMENTS=25918 CHECKS=40754600	UNSAT TT=34.395 ASSIGNMENTS=47618 CHECKS=76834000	? (exit code) TT=0.846	UNSAT TT=334.904 ASSIGNMENTS=399963 CHECKS=596071000	UNSAT TT=10.466 ASSIGNMENTS=10642 CHECKS=19776700	? TT=6.721	No data	UNSAT TT=6.479	UNSAT TT=9.461
csp/allsquaresUnsat/ normalized-squaresUnsat-18-18.xml	UNSAT TT=48.241	? TT=1.29	? TT=1.365	UNSAT TT=1584.82	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.16	No data	No data	No data	UNSAT TT=213.202 ASSIGNMENTS=183848 CHECKS=378246000	UNSAT TT=202.911 ASSIGNMENTS=183848 CHECKS=378246000	No data	No data	No data	UNSAT TT=246.526 ASSIGNMENTS=256838 CHECKS=500899000	UNSAT TT=152.011 ASSIGNMENTS=145952 CHECKS=264378000	? (exit code) TT=0.449	UNSAT TT=484.343 ASSIGNMENTS=397120 CHECKS=706295000	UNSAT TT=187.797 ASSIGNMENTS=183848 CHECKS=378246000	? TT=9.19	No data	UNSAT TT=64.219	UNSAT TT=48.241
csp/allsquaresUnsat/ normalized-squaresUnsat-19-19.xml	UNSAT TT=0.102	? TT=1.425	? TT=1.402	UNSAT TT=1489.26	UNSAT TT=1.835 CHECKS=1506	UNSAT TT=0.102 CHECKS=1506	UNSAT TT=1.422 ASSIGNMENTS=0	UNSAT TT=1.559 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=146.681 ASSIGNMENTS=101469 CHECKS=217456000	UNSAT TT=146.874 ASSIGNMENTS=101469 CHECKS=217456000	No data	No data	No data	UNSAT TT=152.378 ASSIGNMENTS=132277 CHECKS=269853000	UNSAT TT=105.22 ASSIGNMENTS=96427 CHECKS=147682000	? (exit code) TT=0.728	UNSAT TT=529.969 ASSIGNMENTS=363851 CHECKS=712207000	UNSAT TT=134.102 ASSIGNMENTS=101469 CHECKS=217456000	? TT=10.632	No data	UNSAT TT=43.34	UNSAT TT=41.562
csp/allsquaresUnsat/ normalized-squaresUnsat-20-20.xml	UNSAT TT=0.107	? TT=1.617	? TT=1.495	? (TO) TT=1800.02	UNSAT TT=2.077 CHECKS=1662	UNSAT TT=0.107 CHECKS=1662	UNSAT TT=1.547 ASSIGNMENTS=0	UNSAT TT=1.841 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=1362.46 ASSIGNMENTS=972280 CHECKS=1949310000	UNSAT TT=1016.42 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=1663.26 ASSIGNMENTS=1211670 CHECKS=2380190000	UNSAT TT=233.569 ASSIGNMENTS=158054 CHECKS=348657000	? (exit code) TT=0.739	UNSAT TT=1018.17 ASSIGNMENTS=588256 CHECKS=1099680000	UNSAT TT=1355.48 ASSIGNMENTS=972280 CHECKS=1949310000	? TT=14.071	No data	UNSAT TT=117.254	UNSAT TT=141.548
csp/allsquaresUnsat/ normalized-squaresUnsat-21-21.xml	UNSAT TT=0.13	? TT=1.757	? TT=1.695	? (TO) TT=1800.05	UNSAT TT=2.196 CHECKS=1806	UNSAT TT=0.13 CHECKS=1806	UNSAT TT=1.949 ASSIGNMENTS=0	UNSAT TT=1.617 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=1665.15 ASSIGNMENTS=0	UNSAT TT=1017.49 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.1	UNSAT TT=1438.28 ASSIGNMENTS=844124 CHECKS=1853250000	? (exit code) TT=0.44	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=17.748	No data	UNSAT TT=217.067	UNSAT TT=270.054
csp/allsquaresUnsat/ normalized-squaresUnsat-22-22.xml	UNSAT TT=0.146	? TT=1.828	? TT=1.82	? (TO) TT=1800.06	UNSAT TT=2.626 CHECKS=1978	UNSAT TT=0.146 CHECKS=1978	UNSAT TT=1.641 ASSIGNMENTS=0	UNSAT TT=2.198 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=1017.24 ASSIGNMENTS=0	UNSAT TT=1017.05 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.08	? (exit code) TT=0.77	? (TO) TT=1800.11	? (TO) TT=1800.1	? TT=21.811	No data	UNSAT TT=343.792	UNSAT TT=335.978
csp/allsquaresUnsat/ normalized-squaresUnsat-2-2.xml	UNSAT TT=0.006	? TT=0.593	? TT=0.553	UNSAT TT=0.026	UNSAT TT=0.01 CHECKS=53	UNSAT TT=0.008 CHECKS=53	UNSAT TT=0.506 ASSIGNMENTS=0	UNSAT TT=0.513 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=15	No data	No data	No data	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=15	? (exit code) TT=0.193	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=15	? TT=0.906	No data	UNSAT TT=0.488	UNSAT TT=0.504
csp/allsquaresUnsat/ normalized-squaresUnsat-23-23.xml	UNSAT TT=0.168	? TT=2.011	? TT=2.009	? (TO) TT=1800.04	UNSAT TT=2.701 CHECKS=2138	UNSAT TT=0.168 CHECKS=2138	UNSAT TT=1.689 ASSIGNMENTS=0	UNSAT TT=1.827 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=890.69 ASSIGNMENTS=0	UNSAT TT=1016.83 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.06	? (exit code) TT=0.807	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=26.041	No data	UNSAT TT=402.254	UNSAT TT=469.765
csp/allsquaresUnsat/ normalized-squaresUnsat-24-24.xml		? TT=2.515	? TT=2.276	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.14	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.07	? (exit code) TT=0.497	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=33.356	No data	? (TO) TT=1800.07	? (TO) TT=1800.02
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-25-25.xml	UNSAT TT=0.192	? TT=2.533	? TT=2.484	? (TO) TT=1800.07	UNSAT TT=3.294 CHECKS=2502	UNSAT TT=0.192 CHECKS=2502	UNSAT TT=2.044 ASSIGNMENTS=0	UNSAT TT=2.224 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=891.527 ASSIGNMENTS=0	UNSAT TT=1016.9 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.05	? (exit code) TT=0.796	? (TO) TT=1800.02	? (TO) TT=1800.05	? TT=40.292	No data	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/allsquaresUnsat/ normalized-squaresUnsat-26-26.xml		? TT=2.475	? TT=2.436	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.17	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.11	? (exit code) TT=1.073	? (TO) TT=1800	? (TO) TT=1800.02	? TT=49.053	No data	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-27-27.xml	UNSAT TT=0.256	? TT=2.292	? TT=2.583	? (TO) TT=1800.05	UNSAT TT=4.331 CHECKS=2918	UNSAT TT=0.256 CHECKS=2918	UNSAT TT=2.226 ASSIGNMENTS=0	UNSAT TT=2.106 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=9.804 ASSIGNMENTS=0	UNSAT TT=1017.87 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	? (exit code) TT=0.511	? (TO) TT=1800.06	? (TO) TT=1800.03	? TT=57.082	No data	? (TO) TT=1800.06	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-28-28.xml		? TT=2.179	? TT=2.216	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.15	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (exit code) TT=1.115	? (TO) TT=1800.05	? (TO) TT=1800.1	? TT=73.045	No data	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/allsquaresUnsat/ normalized-squaresUnsat-29-29.xml	UNSAT TT=0.313	? TT=1.998	? TT=1.923	? (TO) TT=1800.03	UNSAT TT=5.162 CHECKS=3366	UNSAT TT=0.313 CHECKS=3366	UNSAT TT=2.201 ASSIGNMENTS=0	UNSAT TT=2.43 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=9.919 ASSIGNMENTS=0	UNSAT TT=1017.56 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (exit code) TT=0.934	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=130.964	No data	? (TO) TT=1800.03	? (TO) TT=1800.07
csp/allsquaresUnsat/ normalized-squaresUnsat-30-30.xml	UNSAT TT=0.349	? TT=1.724	? TT=1.735	? (TO) TT=1800.03	UNSAT TT=5.732 CHECKS=3602	UNSAT TT=0.349 CHECKS=3602	UNSAT TT=2.453 ASSIGNMENTS=0	UNSAT TT=2.552 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=10.332 ASSIGNMENTS=0	UNSAT TT=1017.9 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.08	? (exit code) TT=0.508	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=453.483	No data	? (TO) TT=1800.05	? (TO) TT=1800.02
csp/allsquaresUnsat/ normalized-squaresUnsat-31-31.xml	UNSAT TT=0.383	? TT=1.773	? TT=1.881	? (TO) TT=1800.05	UNSAT TT=6.299 CHECKS=3846	UNSAT TT=0.383 CHECKS=3846	UNSAT TT=2.676 ASSIGNMENTS=0	UNSAT TT=2.767 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=10.099 ASSIGNMENTS=0	UNSAT TT=1018.17 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.04	? (exit code) TT=0.964	? (TO) TT=1800.04	? (TO) TT=1800.05	? (MO) TT=97.302	No data	? (TO) TT=1800.12	? (TO) TT=1800.1
csp/allsquaresUnsat/ normalized-squaresUnsat-32-32.xml		? TT=1.948	? TT=1.825	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.09	? (exit code) TT=1.182	? (TO) TT=1800.04	? (TO) TT=1800.11	? (MO) TT=91.645	No data	? (TO) TT=1800.09	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-33-33.xml		? TT=2.102	? TT=1.988	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.08	? (exit code) TT=0.541	? (TO) TT=1800.03	? (TO) TT=1800.07	? (MO) TT=112.026	No data	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/allsquaresUnsat/ normalized-squaresUnsat-3-3.xml	UNSAT TT=0.006	? TT=0.631	? TT=0.563	UNSAT TT=0.03	UNSAT TT=0.012 CHECKS=92	UNSAT TT=0.01 CHECKS=92	UNSAT TT=0.511 ASSIGNMENTS=0	UNSAT TT=0.503 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=22	No data	No data	No data	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=22	? (exit code) TT=0.186	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=22	? TT=0.979	No data	UNSAT TT=0.535	UNSAT TT=0.53
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-34-34.xml		? TT=2.128	? TT=2.046	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.11	? (exit code) TT=1.114	? (TO) TT=1800.04	? (TO) TT=1800.07	? (MO) TT=107.77	No data	? (TO) TT=1800.09	? (TO) TT=1800.02
csp/allsquaresUnsat/ normalized-squaresUnsat-35-35.xml	UNSAT TT=0.547	? TT=1.967	? TT=2.063	? (TO) TT=1800.1	UNSAT TT=7.996 CHECKS=4902	UNSAT TT=0.547 CHECKS=4902	UNSAT TT=2.703 ASSIGNMENTS=0	UNSAT TT=2.734 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=10.504 ASSIGNMENTS=0	UNSAT TT=1018.23 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.07	? (exit code) TT=1.068	? (TO) TT=1800.03	? (TO) TT=1800.11	? (MO) TT=101.483	No data	? (TO) TT=1800.22	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-36-36.xml	UNSAT TT=0.596	? TT=2.129	? TT=1.942	? (TO) TT=1800.07	UNSAT TT=8.625 CHECKS=5186	UNSAT TT=0.596 CHECKS=5186	UNSAT TT=2.892 ASSIGNMENTS=0	UNSAT TT=3.057 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=10.856 ASSIGNMENTS=0	UNSAT TT=1018.62 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	? (exit code) TT=0.635	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1802.14	No data	? (TO) TT=1800.13	? (TO) TT=1800.09
csp/allsquaresUnsat/ normalized-squaresUnsat-37-37.xml	UNSAT TT=0.641	? TT=1.975	? TT=2.107	? (TO) TT=1800.11	UNSAT TT=8.323 CHECKS=5478	UNSAT TT=0.641 CHECKS=5478	UNSAT TT=3.066 ASSIGNMENTS=0	UNSAT TT=3.41 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=10.728 ASSIGNMENTS=0	UNSAT TT=1018.24 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.07	? (exit code) TT=1.36	? (TO) TT=1800.03	? (TO) TT=1800.04	? TT=400.357	No data	? (TO) TT=1800.32	? (TO) TT=1800.01
csp/allsquaresUnsat/ normalized-squaresUnsat-38-38.xml		? TT=1.945	? TT=1.966	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.08	? (exit code) TT=1.354	? (TO) TT=1800.11	? (TO) TT=1800.01	? TT=208.941	No data	? (MO) TT=59.215	? (TO) TT=1800.2
csp/allsquaresUnsat/ normalized-squaresUnsat-4-4.xml	UNSAT TT=0.006	? TT=0.61	? TT=0.6	UNSAT TT=0.032	UNSAT TT=0.028 CHECKS=120	UNSAT TT=0.01 CHECKS=120	UNSAT TT=0.551 ASSIGNMENTS=0	UNSAT TT=0.754 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=160	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=160	No data	No data	No data	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=160	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=160	? (exit code) TT=0.265	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=160	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=160	? TT=0.972	No data	UNSAT TT=0.668	UNSAT TT=0.66
csp/allsquaresUnsat/ normalized-squaresUnsat-5-5.xml	UNSAT TT=0.008	? TT=0.687	? TT=0.614	UNSAT TT=0.037	UNSAT TT=0.055 CHECKS=175	UNSAT TT=0.01 CHECKS=175	UNSAT TT=0.602 ASSIGNMENTS=0	UNSAT TT=0.598 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=266	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=266	No data	No data	No data	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=266	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=266	? (exit code) TT=0.284	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=266	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=266	? TT=1.531	No data	UNSAT TT=0.73	UNSAT TT=0.731
csp/allsquaresUnsat/ normalized-squaresUnsat-6-6.xml	UNSAT TT=0.01	? TT=0.655	? TT=0.749	UNSAT TT=0.043	UNSAT TT=0.124 CHECKS=219	UNSAT TT=0.013 CHECKS=219	UNSAT TT=0.7 ASSIGNMENTS=0	UNSAT TT=0.709 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=399	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=399	No data	No data	No data	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=399	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=399	? (exit code) TT=0.249	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=399	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=399	? TT=1.653	No data	UNSAT TT=0.846	UNSAT TT=0.863
csp/allsquaresUnsat/ normalized-squaresUnsat-7-7.xml	UNSAT TT=0.012	? TT=0.669	? TT=0.675	UNSAT TT=0.047	UNSAT TT=0.206 CHECKS=290	UNSAT TT=0.014 CHECKS=290	UNSAT TT=0.689 ASSIGNMENTS=0	UNSAT TT=0.703 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=563	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=563	No data	No data	No data	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=563	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=563	? (exit code) TT=0.38	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=563	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=563	? TT=1.795	No data	UNSAT TT=1.075	UNSAT TT=0.947
csp/allsquaresUnsat/ normalized-squaresUnsat-8-8.xml	UNSAT TT=0.017	? TT=0.76	? TT=0.711	UNSAT TT=0.06	UNSAT TT=0.259 CHECKS=350	UNSAT TT=0.018 CHECKS=350	UNSAT TT=0.764 ASSIGNMENTS=0	UNSAT TT=0.898 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=754	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=754	No data	No data	No data	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	? (exit code) TT=0.475	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	? TT=1.959	No data	UNSAT TT=0.981	UNSAT TT=0.965
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-9-9.xml	UNSAT TT=0.025	? TT=0.826	? TT=0.751	UNSAT TT=1.675	UNSAT TT=0.616 CHECKS=188089	UNSAT TT=0.199 CHECKS=141270	UNSAT TT=1.024 ASSIGNMENTS=0	UNSAT TT=0.986 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.036 ASSIGNMENTS=12 CHECKS=10492	UNSAT TT=0.035 ASSIGNMENTS=12 CHECKS=10492	No data	No data	No data	UNSAT TT=0.034 ASSIGNMENTS=67 CHECKS=40428	UNSAT TT=0.098 ASSIGNMENTS=709 CHECKS=234513	? (exit code) TT=0.325	UNSAT TT=0.047 ASSIGNMENTS=253 CHECKS=49485	UNSAT TT=0.025 ASSIGNMENTS=21 CHECKS=12542	? TT=2.305	No data	UNSAT TT=1.072	UNSAT TT=1.111
csp/bddLarge/ normalized-bdd-21-2713-15-79-10_ext.xml	UNSAT TT=20.161	UNSAT TT=75.449 CHECKS=3377 NODES=1579	? (MO) TT=1.737	? (problem) TT=540.272	? (TO) TT=1800.14	? (TO) TT=1800.18	UNSAT TT=502.74 ASSIGNMENTS=1017	UNSAT TT=932.526 ASSIGNMENTS=1413	UNSAT TT=104.103 CHECKS=96745200 NODES=2174	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=43.467 ASSIGNMENTS=1080 CHECKS=2744120	UNSAT TT=43.568 ASSIGNMENTS=1080 CHECKS=2744120	? (MO) TT=1764.19	? (MO) TT=1775.55	UNSAT TT=20.161 CHECKS=1905990	UNSAT TT=29.044 ASSIGNMENTS=953 CHECKS=2516650	UNSAT TT=138.93 ASSIGNMENTS=5088 CHECKS=11761200	? (MO) TT=9.6	UNSAT TT=31.676 ASSIGNMENTS=990 CHECKS=2587020	UNSAT TT=34.385 ASSIGNMENTS=1080 CHECKS=2744120	? TT=92.272	UNSAT TT=1.681 ASSIGNMENTS=2103 CHECKS=195944	? TT=82.751	? TT=77.592
csp/bddLarge/ normalized-bdd-21-2713-15-79-11_ext.xml	UNSAT TT=17.451	UNSAT TT=73.451 CHECKS=4068 NODES=1788	UNSAT TT=80.089 CHECKS=3913 NODES=1688	? (problem) TT=562.562	? (TO) TT=1800.22	? (TO) TT=1800.22	UNSAT TT=911.868 ASSIGNMENTS=1049	UNSAT TT=948.987 ASSIGNMENTS=1358	UNSAT TT=97.693 CHECKS=95507400 NODES=2241	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=49.223 ASSIGNMENTS=1051 CHECKS=3479530	UNSAT TT=46.629 ASSIGNMENTS=1051 CHECKS=3479530	? (MO) TT=1737.24	? (TO) TT=1800	UNSAT TT=17.451 CHECKS=2083980	UNSAT TT=38.9 ASSIGNMENTS=1045 CHECKS=3517360	UNSAT TT=130.019 ASSIGNMENTS=5016 CHECKS=11739500	? (MO) TT=7.4	UNSAT TT=39.778 ASSIGNMENTS=1092 CHECKS=3604380	UNSAT TT=37.212 ASSIGNMENTS=1051 CHECKS=3479530	? TT=98.06	UNSAT TT=1.684 ASSIGNMENTS=2174 CHECKS=182016	? TT=278.531	? TT=175.473
csp/bddLarge/ normalized-bdd-21-2713-15-79-12_ext.xml	UNSAT TT=23.58	UNSAT TT=76.401 CHECKS=4420 NODES=1946	UNSAT TT=76.343 CHECKS=3818 NODES=1663	? (problem) TT=530.24	? (TO) TT=1800.19	? (TO) TT=1800.18	UNSAT TT=597.324 ASSIGNMENTS=1096	UNSAT TT=918.954 ASSIGNMENTS=1376	UNSAT TT=99.969 CHECKS=101402000 NODES=2194	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=47.555 ASSIGNMENTS=1020 CHECKS=3227590	UNSAT TT=44.215 ASSIGNMENTS=1020 CHECKS=3227590	? (MO) TT=1792.49	? (MO) TT=1749.75	UNSAT TT=23.58 CHECKS=2283190	UNSAT TT=41.345 ASSIGNMENTS=1099 CHECKS=3385670	UNSAT TT=133.813 ASSIGNMENTS=5056 CHECKS=11798900	? (MO) TT=7.58	UNSAT TT=40.519 ASSIGNMENTS=1044 CHECKS=3212260	UNSAT TT=38.918 ASSIGNMENTS=1020 CHECKS=3227590	? TT=87.828	UNSAT TT=2.379 ASSIGNMENTS=2380 CHECKS=388061	? TT=173.51	? TT=171.019
csp/bddLarge/ normalized-bdd-21-2713-15-79-13_ext.xml	SAT TT=1.829	SAT TT=10.945 CHECKS=2800 NODES=84	SAT TT=13.537 CHECKS=2784 NODES=63	? (problem) TT=528.163	SAT TT=1429.09 CHECKS=3023260	SAT TT=154.394 CHECKS=223124	SAT TT=378.668 ASSIGNMENTS=1008	SAT TT=112.528 ASSIGNMENTS=264	SAT TT=129.181 CHECKS=127266000 NODES=3166	SAT TT=173.695 CHECKS=252842000 NODES=4656	SAT TT=4.292 CHECKS=865242 NODES=11	SAT TT=33.92 ASSIGNMENTS=996 CHECKS=2326930	SAT TT=36.259 ASSIGNMENTS=996 CHECKS=2326930	? (TO) TT=1800.09	? (MO) TT=1740.44	SAT TT=4.989 CHECKS=560173	SAT TT=25.485 ASSIGNMENTS=1011 CHECKS=2348490	SAT TT=126.027 ASSIGNMENTS=4913 CHECKS=11824300	? (MO) TT=7.67	SAT TT=1.829 ASSIGNMENTS=23 CHECKS=64014	SAT TT=25.527 ASSIGNMENTS=996 CHECKS=2326930	? TT=88.127	SAT TT=1.812 ASSIGNMENTS=2137 CHECKS=156346	? TT=118.121	? TT=108.251
csp/bddLarge/ normalized-bdd-21-2713-15-79-14_ext.xml	UNSAT TT=20.182	UNSAT TT=76.442 CHECKS=4337 NODES=1797	UNSAT TT=78.339 CHECKS=4293 NODES=1797	? (problem) TT=544.606	? (TO) TT=1800.18	? (TO) TT=1800.22	UNSAT TT=553.099 ASSIGNMENTS=1063	UNSAT TT=1088.96 ASSIGNMENTS=1378	UNSAT TT=96.332 CHECKS=94786000 NODES=2179	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=40.446 ASSIGNMENTS=1064 CHECKS=2658980	UNSAT TT=40.31 ASSIGNMENTS=1064 CHECKS=2658980	? (MO) TT=1730.2	? (TO) TT=1800.07	UNSAT TT=20.182 CHECKS=2077040	UNSAT TT=29.608 ASSIGNMENTS=1045 CHECKS=2543630	UNSAT TT=118.182 ASSIGNMENTS=4753 CHECKS=11415200	? (MO) TT=7.41	UNSAT TT=28.473 ASSIGNMENTS=1036 CHECKS=2370010	UNSAT TT=29.492 ASSIGNMENTS=1064 CHECKS=2658980	? TT=93.322	UNSAT TT=1.807 ASSIGNMENTS=2180 CHECKS=231236	? TT=156.024	? TT=149.998
csp/bddLarge/ normalized-bdd-21-2713-15-79-15_ext.xml	UNSAT TT=18.489	UNSAT TT=75.053 CHECKS=3364 NODES=1552	UNSAT TT=89.695 CHECKS=3657 NODES=1544	? (problem) TT=526.969	? (TO) TT=1800.16	? (TO) TT=1800.16	UNSAT TT=418.5 ASSIGNMENTS=949	UNSAT TT=1090.46 ASSIGNMENTS=1408	UNSAT TT=95.81 CHECKS=90291000 NODES=2275	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=32.96 ASSIGNMENTS=972 CHECKS=2279050	UNSAT TT=34.558 ASSIGNMENTS=972 CHECKS=2279050	? (MO) TT=1795.53	? (MO) TT=1699.29	UNSAT TT=18.489 CHECKS=1939770	UNSAT TT=27.632 ASSIGNMENTS=950 CHECKS=2297690	UNSAT TT=129.538 ASSIGNMENTS=4968 CHECKS=11733700	? (MO) TT=7.59	UNSAT TT=28.547 ASSIGNMENTS=988 CHECKS=2377590	UNSAT TT=26.737 ASSIGNMENTS=972 CHECKS=2279050	? TT=95.974	UNSAT TT=1.578 ASSIGNMENTS=2075 CHECKS=144580	? TT=151.406	? TT=135.077
csp/bddLarge/ normalized-bdd-21-2713-15-79-16_ext.xml	UNSAT TT=20.834	UNSAT TT=75.513 CHECKS=2848 NODES=1647	UNSAT TT=87.346 CHECKS=2839 NODES=1666	? (problem) TT=551.773	? (TO) TT=1800.22	? (TO) TT=1800.14	UNSAT TT=517.709 ASSIGNMENTS=976	UNSAT TT=987.725 ASSIGNMENTS=1403	UNSAT TT=103.609 CHECKS=95101700 NODES=2251	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=39.029 ASSIGNMENTS=993 CHECKS=2558580	UNSAT TT=40.195 ASSIGNMENTS=993 CHECKS=2558580	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=20.834 CHECKS=1878100	UNSAT TT=30.634 ASSIGNMENTS=996 CHECKS=2564460	UNSAT TT=133.136 ASSIGNMENTS=5002 CHECKS=11662400	? (MO) TT=7.6	UNSAT TT=29.869 ASSIGNMENTS=1044 CHECKS=2653780	UNSAT TT=30.352 ASSIGNMENTS=993 CHECKS=2558580	? TT=87.929	UNSAT TT=2.027 ASSIGNMENTS=2094 CHECKS=258122	? TT=134.739	? TT=140.713
csp/bddLarge/ normalized-bdd-21-2713-15-79-17_ext.xml	UNSAT TT=17.901	UNSAT TT=77.791 CHECKS=2796 NODES=1534	UNSAT TT=78.278 CHECKS=2833 NODES=1546	? (problem) TT=535.58	? (TO) TT=1800.16	? (TO) TT=1800.15	UNSAT TT=665.002 ASSIGNMENTS=930	UNSAT TT=1087.51 ASSIGNMENTS=1353	UNSAT TT=126.499 CHECKS=121332000 NODES=3085	? (TO) TT=1800.01	? (TO) TT=1800.09	UNSAT TT=42.007 ASSIGNMENTS=918 CHECKS=2666600	UNSAT TT=38.352 ASSIGNMENTS=918 CHECKS=2666600	? (MO) TT=1774.34	? (MO) TT=1743.5	UNSAT TT=17.901 CHECKS=1868550	UNSAT TT=29.664 ASSIGNMENTS=936 CHECKS=2712710	UNSAT TT=134.993 ASSIGNMENTS=4888 CHECKS=11483900	? (MO) TT=7.01	UNSAT TT=33.097 ASSIGNMENTS=972 CHECKS=2785700	UNSAT TT=30.193 ASSIGNMENTS=918 CHECKS=2666600	? TT=92.833	UNSAT TT=1.544 ASSIGNMENTS=2103 CHECKS=147952	? TT=147.356	? TT=141.49
csp/bddLarge/ normalized-bdd-21-2713-15-79-18_ext.xml	UNSAT TT=17.426	UNSAT TT=73.469 CHECKS=3539 NODES=1698	UNSAT TT=80.459 CHECKS=4097 NODES=1805	? (problem) TT=363.737	? (TO) TT=1800.18	? (TO) TT=1800.17	UNSAT TT=501.132 ASSIGNMENTS=1001	UNSAT TT=911.154 ASSIGNMENTS=1349	UNSAT TT=100.868 CHECKS=90786100 NODES=2209	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=35.383 ASSIGNMENTS=931 CHECKS=2229850	UNSAT TT=36.148 ASSIGNMENTS=931 CHECKS=2229850	? (MO) TT=1786.03	? (TO) TT=1800	UNSAT TT=17.426 CHECKS=1998940	UNSAT TT=28.616 ASSIGNMENTS=997 CHECKS=2507850	UNSAT TT=143.498 ASSIGNMENTS=5280 CHECKS=12357500	? (MO) TT=7.4	UNSAT TT=29.391 ASSIGNMENTS=1048 CHECKS=2608780	UNSAT TT=25.151 ASSIGNMENTS=931 CHECKS=2229850	? TT=91.204	UNSAT TT=1.715 ASSIGNMENTS=2107 CHECKS=146214	? TT=112.317	? TT=107.073
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddLarge/ normalized-bdd-21-2713-15-79-19_ext.xml	SAT TT=12.706	SAT TT=24.235 CHECKS=3185 NODES=321	SAT TT=28.389 CHECKS=3237 NODES=317	? (problem) TT=521.08	SAT TT=562.963 CHECKS=1050710	SAT TT=941.565 CHECKS=1870630	SAT TT=393.514 ASSIGNMENTS=876	SAT TT=1001.32 ASSIGNMENTS=1236	SAT TT=119.394 CHECKS=120110000 NODES=2190	SAT TT=13.143 CHECKS=17534700 NODES=318	SAT TT=39.935 CHECKS=66394700 NODES=1169	SAT TT=36.854 ASSIGNMENTS=884 CHECKS=2219740	SAT TT=36.295 ASSIGNMENTS=884 CHECKS=2219740	? (TO) TT=1800.01	? (MO) TT=1766.44	SAT TT=12.706 CHECKS=1298280	SAT TT=26.447 ASSIGNMENTS=905 CHECKS=2287370	SAT TT=143.58 ASSIGNMENTS=5223 CHECKS=12342200	? (MO) TT=6.89	SAT TT=31.06 ASSIGNMENTS=972 CHECKS=2451620	SAT TT=27.76 ASSIGNMENTS=884 CHECKS=2219740	? TT=95.267	SAT TT=1.799 ASSIGNMENTS=2053 CHECKS=183799	? TT=143.301	? TT=151.378
csp/bddLarge/ normalized-bdd-21-2713-15-79-1_ext.xml	UNSAT TT=21.264	UNSAT TT=79.051 CHECKS=3188 NODES=1542	UNSAT TT=91.595 CHECKS=3075 NODES=1592	? (problem) TT=554.699	? (TO) TT=1800.13	? (TO) TT=1800.15	UNSAT TT=681.082 ASSIGNMENTS=988	UNSAT TT=986.172 ASSIGNMENTS=1474	UNSAT TT=107.558 CHECKS=98932400 NODES=2240	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=40.515 ASSIGNMENTS=975 CHECKS=2814450	UNSAT TT=42.407 ASSIGNMENTS=975 CHECKS=2814450	? (MO) TT=1708.4	? (TO) TT=1800.02	UNSAT TT=21.264 CHECKS=1971060	UNSAT TT=33.669 ASSIGNMENTS=985 CHECKS=2835870	UNSAT TT=140.165 ASSIGNMENTS=4787 CHECKS=11448900	? (MO) TT=7.18	UNSAT TT=34.457 ASSIGNMENTS=1095 CHECKS=3045100	UNSAT TT=33.91 ASSIGNMENTS=975 CHECKS=2814450	? TT=97.517	UNSAT TT=1.606 ASSIGNMENTS=2120 CHECKS=162036	? TT=151.893	? TT=162.59
csp/bddLarge/ normalized-bdd-21-2713-15-79-20_ext.xml	UNSAT TT=20.718	UNSAT TT=88.17 CHECKS=3545 NODES=1668	UNSAT TT=85.059 CHECKS=3548 NODES=1651	? (problem) TT=557.04	? (TO) TT=1800.18	? (TO) TT=1800.15	UNSAT TT=541.651 ASSIGNMENTS=1033	UNSAT TT=1151.26 ASSIGNMENTS=1430	UNSAT TT=105.423 CHECKS=102038000 NODES=2222	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=35.547 ASSIGNMENTS=1042 CHECKS=2604580	UNSAT TT=37.139 ASSIGNMENTS=1042 CHECKS=2604580	? (MO) TT=1753.71	? (MO) TT=1773.83	UNSAT TT=20.718 CHECKS=2070290	UNSAT TT=27.151 ASSIGNMENTS=1041 CHECKS=2600350	UNSAT TT=120.811 ASSIGNMENTS=4747 CHECKS=11343200	? (MO) TT=8.2	UNSAT TT=27.744 ASSIGNMENTS=1078 CHECKS=2664880	UNSAT TT=29.358 ASSIGNMENTS=1042 CHECKS=2604580	? TT=85.767	UNSAT TT=1.738 ASSIGNMENTS=2165 CHECKS=182874	? TT=199.88	? TT=194.024
csp/bddLarge/ normalized-bdd-21-2713-15-79-21_ext.xml	UNSAT TT=18.996	UNSAT TT=70.61 CHECKS=3717 NODES=1633	UNSAT TT=72.345 CHECKS=3676 NODES=1644	? (problem) TT=523.827	? (TO) TT=1800.2	? (TO) TT=1800.15	UNSAT TT=629.111 ASSIGNMENTS=998	UNSAT TT=1171.35 ASSIGNMENTS=1513	UNSAT TT=127.925 CHECKS=132136000 NODES=3066	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=38.647 ASSIGNMENTS=991 CHECKS=2586350	UNSAT TT=36.693 ASSIGNMENTS=991 CHECKS=2586350	? (MO) TT=1707.37	? (TO) TT=1800.05	UNSAT TT=18.996 CHECKS=2045950	UNSAT TT=32.226 ASSIGNMENTS=1026 CHECKS=2612970	UNSAT TT=128.656 ASSIGNMENTS=4740 CHECKS=11184900	? (MO) TT=7.41	UNSAT TT=26.622 ASSIGNMENTS=997 CHECKS=2244880	UNSAT TT=30.417 ASSIGNMENTS=991 CHECKS=2586350	? TT=107.501	UNSAT TT=1.98 ASSIGNMENTS=2248 CHECKS=238372	? TT=169.887	? TT=160.315
csp/bddLarge/ normalized-bdd-21-2713-15-79-22_ext.xml	SAT TT=1.674	SAT TT=20.597 CHECKS=2847 NODES=176	SAT TT=8.439 CHECKS=2713 NODES=0	? (problem) TT=523.495	SAT TT=1014.21 CHECKS=2266570	SAT TT=187.636 CHECKS=359718	SAT TT=12.879 ASSIGNMENTS=12	SAT TT=12.889 ASSIGNMENTS=16	SAT TT=29.545 CHECKS=141102 NODES=21	SAT TT=52.193 CHECKS=70578300 NODES=1297	SAT TT=176.532 CHECKS=84183200 NODES=1476	SAT TT=1.674 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.674 ASSIGNMENTS=11 CHECKS=40695	? (TO) TT=1800.01	? (MO) TT=1758.46	SAT TT=7.559 CHECKS=777147	SAT TT=1.676 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.785 ASSIGNMENTS=12 CHECKS=40695	? (MO) TT=6.81	SAT TT=1.706 ASSIGNMENTS=15 CHECKS=40695	SAT TT=1.675 ASSIGNMENTS=11 CHECKS=40695	? TT=104.144	SAT TT=0.38 ASSIGNMENTS=21 CHECKS=6883	? TT=168.226	? TT=170.135
csp/bddLarge/ normalized-bdd-21-2713-15-79-23_ext.xml	UNSAT TT=22.809	UNSAT TT=74.582 CHECKS=4326 NODES=1854	UNSAT TT=76.905 CHECKS=4041 NODES=1801	? (problem) TT=572.871	? (TO) TT=1800.17	? (TO) TT=1800.15	UNSAT TT=1093.63 ASSIGNMENTS=1162	UNSAT TT=1028.95 ASSIGNMENTS=1505	UNSAT TT=97.584 CHECKS=95862300 NODES=2202	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=44.808 ASSIGNMENTS=1124 CHECKS=3237550	UNSAT TT=48.073 ASSIGNMENTS=1124 CHECKS=3237550	? (MO) TT=1751.48	? (TO) TT=1800.02	UNSAT TT=22.809 CHECKS=2331460	UNSAT TT=44.149 ASSIGNMENTS=1235 CHECKS=3864730	UNSAT TT=138.79 ASSIGNMENTS=5229 CHECKS=12165000	? (MO) TT=7.2	UNSAT TT=34.917 ASSIGNMENTS=1113 CHECKS=3053670	UNSAT TT=39.371 ASSIGNMENTS=1124 CHECKS=3237550	? TT=94.747	UNSAT TT=2.113 ASSIGNMENTS=2360 CHECKS=280553	? TT=141.156	? TT=129.483
csp/bddLarge/ normalized-bdd-21-2713-15-79-24_ext.xml	SAT TT=1.521	SAT TT=63.096 CHECKS=4879 NODES=1171	SAT TT=7.305 CHECKS=2713 NODES=0	? (problem) TT=560.595	SAT TT=184.045 CHECKS=340856	? (TO) TT=1800.15	SAT TT=14.671 ASSIGNMENTS=11	SAT TT=13.35 ASSIGNMENTS=12	SAT TT=29.266 CHECKS=260494 NODES=21	SAT TT=207.989 CHECKS=367836000 NODES=6774	SAT TT=330.506 CHECKS=71950900 NODES=1247	SAT TT=1.64 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.654 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=1794.2	? (MO) TT=1765.67	SAT TT=7.031 CHECKS=700049	SAT TT=1.644 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.661 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=7.88	SAT TT=1.567 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.521 ASSIGNMENTS=10 CHECKS=40695	? TT=93.055	SAT TT=0.386 ASSIGNMENTS=21 CHECKS=5545	? TT=132.094	? TT=124.069
csp/bddLarge/ normalized-bdd-21-2713-15-79-25_ext.xml	UNSAT TT=21.108	UNSAT TT=81.523 CHECKS=1797 NODES=1652	UNSAT TT=96.102 CHECKS=1492 NODES=1642	? (problem) TT=571.979	? (TO) TT=1800.19	? (TO) TT=1800.2	UNSAT TT=421.713 ASSIGNMENTS=1085	UNSAT TT=931.27 ASSIGNMENTS=1341	UNSAT TT=97.406 CHECKS=93518300 NODES=2214	? (TO) TT=1800	? (TO) TT=1800.01	UNSAT TT=40.802 ASSIGNMENTS=1057 CHECKS=2495840	UNSAT TT=38.952 ASSIGNMENTS=1057 CHECKS=2495840	? (MO) TT=1797.16	? (TO) TT=1800.09	UNSAT TT=21.108 CHECKS=1966000	UNSAT TT=31.174 ASSIGNMENTS=1057 CHECKS=2539990	UNSAT TT=138.226 ASSIGNMENTS=4779 CHECKS=11388300	? (MO) TT=7.4	UNSAT TT=32.27 ASSIGNMENTS=1140 CHECKS=2708360	UNSAT TT=29.836 ASSIGNMENTS=1057 CHECKS=2495840	? TT=88.911	UNSAT TT=2.156 ASSIGNMENTS=2213 CHECKS=297305	? TT=160.342	? TT=156.877
csp/bddLarge/ normalized-bdd-21-2713-15-79-26_ext.xml	UNSAT TT=23.759	UNSAT TT=98.128 CHECKS=1368 NODES=1693	UNSAT TT=104.274 CHECKS=1370 NODES=1683	? (problem) TT=533.471	? (TO) TT=1800.22	? (TO) TT=1800.18	UNSAT TT=602.975 ASSIGNMENTS=956	UNSAT TT=1202.17 ASSIGNMENTS=1409	UNSAT TT=107.385 CHECKS=101914000 NODES=2214	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=42.613 ASSIGNMENTS=979 CHECKS=2764020	UNSAT TT=42.652 ASSIGNMENTS=979 CHECKS=2764020	? (MO) TT=1769.31	? (MO) TT=1771.59	UNSAT TT=23.759 CHECKS=2038140	UNSAT TT=31.94 ASSIGNMENTS=939 CHECKS=2658320	UNSAT TT=131.122 ASSIGNMENTS=4930 CHECKS=11677200	? (MO) TT=7.39	UNSAT TT=33.012 ASSIGNMENTS=999 CHECKS=2767690	UNSAT TT=33.678 ASSIGNMENTS=979 CHECKS=2764020	? TT=93.217	UNSAT TT=1.691 ASSIGNMENTS=2097 CHECKS=177503	? TT=167.076	? TT=166.835
csp/bddLarge/ normalized-bdd-21-2713-15-79-27_ext.xml	UNSAT TT=21.921	UNSAT TT=82.754 CHECKS=2387 NODES=1534	UNSAT TT=87.021 CHECKS=2342 NODES=1537	? (problem) TT=531.873	? (TO) TT=1800.24	? (TO) TT=1800.15	UNSAT TT=330.266 ASSIGNMENTS=973	UNSAT TT=1257.88 ASSIGNMENTS=1490	UNSAT TT=130.771 CHECKS=127027000 NODES=3086	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=35.764 ASSIGNMENTS=944 CHECKS=2194040	UNSAT TT=36.166 ASSIGNMENTS=944 CHECKS=2194040	? (TO) TT=1800.05	? (MO) TT=1672.59	UNSAT TT=21.921 CHECKS=1926410	UNSAT TT=27.884 ASSIGNMENTS=976 CHECKS=2287120	UNSAT TT=144.546 ASSIGNMENTS=5284 CHECKS=12327000	? (MO) TT=7.38	UNSAT TT=30.34 ASSIGNMENTS=1012 CHECKS=2360410	UNSAT TT=27.207 ASSIGNMENTS=944 CHECKS=2194040	? TT=90.256	UNSAT TT=1.77 ASSIGNMENTS=2113 CHECKS=227342	? TT=126.605	? TT=134.017
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddLarge/ normalized-bdd-21-2713-15-79-28_ext.xml	UNSAT TT=20.517	UNSAT TT=77.034 CHECKS=4120 NODES=1576	UNSAT TT=82.767 CHECKS=4052 NODES=1582	? (problem) TT=531.038	? (TO) TT=1800.16	? (TO) TT=1800.22	UNSAT TT=413.635 ASSIGNMENTS=1004	UNSAT TT=1060.19 ASSIGNMENTS=1306	UNSAT TT=126.338 CHECKS=135596000 NODES=3184	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=35.451 ASSIGNMENTS=953 CHECKS=2253460	UNSAT TT=34.492 ASSIGNMENTS=953 CHECKS=2253460	? (TO) TT=1800	? (MO) TT=1787.75	UNSAT TT=20.517 CHECKS=2042390	UNSAT TT=26.304 ASSIGNMENTS=959 CHECKS=2307450	UNSAT TT=118.932 ASSIGNMENTS=4754 CHECKS=11379900	? (MO) TT=8.94	UNSAT TT=29.614 ASSIGNMENTS=1037 CHECKS=2460350	UNSAT TT=28.019 ASSIGNMENTS=953 CHECKS=2253460	? TT=97.051	UNSAT TT=1.818 ASSIGNMENTS=2236 CHECKS=223828	? TT=149.407	? TT=149.912
csp/bddLarge/ normalized-bdd-21-2713-15-79-29_ext.xml	UNSAT TT=19.765	UNSAT TT=80.187 CHECKS=2747 NODES=1642	UNSAT TT=84.888 CHECKS=2547 NODES=1654	? (problem) TT=564.747	? (TO) TT=1800.22	? (TO) TT=1800.13	UNSAT TT=820.25 ASSIGNMENTS=1031	UNSAT TT=1099.31 ASSIGNMENTS=1459	UNSAT TT=119.048 CHECKS=124596000 NODES=3110	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=49.585 ASSIGNMENTS=1137 CHECKS=3521360	UNSAT TT=49.579 ASSIGNMENTS=1137 CHECKS=3521360	? (TO) TT=1800.02	? (MO) TT=1677	UNSAT TT=19.765 CHECKS=2134890	UNSAT TT=39.881 ASSIGNMENTS=1137 CHECKS=3490600	UNSAT TT=133.568 ASSIGNMENTS=4952 CHECKS=11626300	? (MO) TT=7.4	UNSAT TT=39.112 ASSIGNMENTS=1140 CHECKS=3542300	UNSAT TT=40.714 ASSIGNMENTS=1137 CHECKS=3521360	? TT=91.676	UNSAT TT=1.833 ASSIGNMENTS=2178 CHECKS=178302	? TT=84.678	? TT=85.312
csp/bddLarge/ normalized-bdd-21-2713-15-79-2_ext.xml	UNSAT TT=21.554	UNSAT TT=89.376 CHECKS=1339 NODES=1571	UNSAT TT=104.163 CHECKS=1345 NODES=1666	? (problem) TT=570.639	? (TO) TT=1800.18	? (TO) TT=1800.17	UNSAT TT=442.809 ASSIGNMENTS=962	UNSAT TT=1194.14 ASSIGNMENTS=1509	UNSAT TT=125.819 CHECKS=133972000 NODES=3131	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=37.628 ASSIGNMENTS=963 CHECKS=2328100	UNSAT TT=37.107 ASSIGNMENTS=963 CHECKS=2328100	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=21.554 CHECKS=1938450	UNSAT TT=29.372 ASSIGNMENTS=962 CHECKS=2328390	UNSAT TT=138.306 ASSIGNMENTS=4973 CHECKS=11741900	? (MO) TT=7.29	UNSAT TT=29.98 ASSIGNMENTS=1034 CHECKS=2295360	UNSAT TT=29.067 ASSIGNMENTS=963 CHECKS=2328100	? TT=90.104	UNSAT TT=1.831 ASSIGNMENTS=2103 CHECKS=202244	? TT=147.454	? TT=148.083
csp/bddLarge/ normalized-bdd-21-2713-15-79-30_ext.xml	UNSAT TT=21.331	UNSAT TT=83.927 CHECKS=2535 NODES=1457	UNSAT TT=96.291 CHECKS=3024 NODES=1471	? (problem) TT=560.038	? (TO) TT=1800.15	? (TO) TT=1800.2	UNSAT TT=225.84 ASSIGNMENTS=914	UNSAT TT=903.81 ASSIGNMENTS=1439	UNSAT TT=100.898 CHECKS=94215000 NODES=2171	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=34.278 ASSIGNMENTS=962 CHECKS=2120180	UNSAT TT=34.163 ASSIGNMENTS=962 CHECKS=2120180	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=21.331 CHECKS=1854620	UNSAT TT=26.104 ASSIGNMENTS=937 CHECKS=2167260	UNSAT TT=120.832 ASSIGNMENTS=4961 CHECKS=11627100	? (MO) TT=6.75	UNSAT TT=26.655 ASSIGNMENTS=992 CHECKS=2235430	UNSAT TT=27.932 ASSIGNMENTS=962 CHECKS=2120180	? TT=91.612	UNSAT TT=1.564 ASSIGNMENTS=2076 CHECKS=141327	? TT=144.477	? TT=149.962
csp/bddLarge/ normalized-bdd-21-2713-15-79-31_ext.xml	SAT TT=1.416	SAT TT=25.094 CHECKS=2948 NODES=295	SAT TT=7.568 CHECKS=2713 NODES=0	? (problem) TT=550.534	SAT TT=835.331 CHECKS=1404870	SAT TT=78.225 CHECKS=96014	SAT TT=14.484 ASSIGNMENTS=12	SAT TT=14.192 ASSIGNMENTS=13	SAT TT=29.282 CHECKS=219837 NODES=21	SAT TT=47.308 CHECKS=62951700 NODES=1156	SAT TT=171.452 CHECKS=266278000 NODES=4392	SAT TT=1.518 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.552 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=1775.42	? (TO) TT=1800.04	SAT TT=10.77 CHECKS=960413	SAT TT=1.416 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.521 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=7.6	SAT TT=1.512 ASSIGNMENTS=12 CHECKS=40695	SAT TT=1.519 ASSIGNMENTS=11 CHECKS=40695	? TT=95.87	SAT TT=0.378 ASSIGNMENTS=21 CHECKS=9428	? TT=139.997	? TT=151.922
csp/bddLarge/ normalized-bdd-21-2713-15-79-32_ext.xml	SAT TT=3.027	SAT TT=11.171 CHECKS=2856 NODES=71	SAT TT=17.687 CHECKS=2931 NODES=136	? (problem) TT=557.038	SAT TT=730.293 CHECKS=1490360	SAT TT=82.244 CHECKS=73361	SAT TT=626.32 ASSIGNMENTS=924	SAT TT=402.452 ASSIGNMENTS=636	SAT TT=116.036 CHECKS=118115000 NODES=2203	SAT TT=156.758 CHECKS=229957000 NODES=4233	SAT TT=5.284 CHECKS=954016 NODES=12	SAT TT=36.966 ASSIGNMENTS=836 CHECKS=2338640	SAT TT=34.601 ASSIGNMENTS=836 CHECKS=2338640	? (MO) TT=1684.51	? (MO) TT=1764.72	SAT TT=3.027 CHECKS=270372	SAT TT=27.435 ASSIGNMENTS=841 CHECKS=2364290	SAT TT=128.792 ASSIGNMENTS=4840 CHECKS=11519000	? (MO) TT=7.2	SAT TT=25.547 ASSIGNMENTS=813 CHECKS=2211900	SAT TT=27.928 ASSIGNMENTS=836 CHECKS=2338640	? TT=90.115	SAT TT=1.888 ASSIGNMENTS=2046 CHECKS=250096	? TT=151.479	? TT=136.284
csp/bddLarge/ normalized-bdd-21-2713-15-79-33_ext.xml	UNSAT TT=22.624	UNSAT TT=81.111 CHECKS=3946 NODES=1895	UNSAT TT=86.823 CHECKS=4783 NODES=2058	? (problem) TT=524.143	? (TO) TT=1800.17	? (TO) TT=1800.13	UNSAT TT=340.465 ASSIGNMENTS=1126	UNSAT TT=1023.77 ASSIGNMENTS=1344	UNSAT TT=97.739 CHECKS=95900300 NODES=2183	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=33.247 ASSIGNMENTS=970 CHECKS=2060490	UNSAT TT=34.564 ASSIGNMENTS=970 CHECKS=2060490	? (MO) TT=1761.8	? (MO) TT=1704.85	UNSAT TT=22.624 CHECKS=2236630	UNSAT TT=28.275 ASSIGNMENTS=1096 CHECKS=2374740	UNSAT TT=134.257 ASSIGNMENTS=4760 CHECKS=11402500	? (MO) TT=7.1	UNSAT TT=30.053 ASSIGNMENTS=1150 CHECKS=2472890	UNSAT TT=25.261 ASSIGNMENTS=970 CHECKS=2060490	? TT=90.335	UNSAT TT=2.036 ASSIGNMENTS=2238 CHECKS=299933	? TT=181.85	? TT=173.487
csp/bddLarge/ normalized-bdd-21-2713-15-79-34_ext.xml	SAT TT=2.241	SAT TT=67.185 CHECKS=4695 NODES=1123	SAT TT=68.939 CHECKS=4700 NODES=1124	? (problem) TT=517.224	? (TO) TT=1800.18	SAT TT=265.753 CHECKS=474798	SAT TT=609.566 ASSIGNMENTS=1066	SAT TT=946.836 ASSIGNMENTS=1070	SAT TT=95.502 CHECKS=92391700 NODES=2211	SAT TT=64.401 CHECKS=93727100 NODES=1722	SAT TT=783.315 CHECKS=1057450000 NODES=17108	SAT TT=48.646 ASSIGNMENTS=1105 CHECKS=3179260	SAT TT=48.076 ASSIGNMENTS=1105 CHECKS=3179260	? (MO) TT=1705.64	? (TO) TT=1800	SAT TT=13.906 CHECKS=1340990	SAT TT=36.212 ASSIGNMENTS=1069 CHECKS=3029320	SAT TT=137.616 ASSIGNMENTS=4952 CHECKS=11539100	? (MO) TT=6.91	SAT TT=2.241 ASSIGNMENTS=23 CHECKS=62038	SAT TT=38.703 ASSIGNMENTS=1105 CHECKS=3179260	? TT=90.337	SAT TT=1.93 ASSIGNMENTS=2218 CHECKS=198321	? TT=185.216	? TT=175.483
csp/bddLarge/ normalized-bdd-21-2713-15-79-35_ext.xml	SAT TT=1.302	SAT TT=69.451 CHECKS=5172 NODES=1378	SAT TT=74.186 CHECKS=4964 NODES=1347	? (problem) TT=527.731	SAT TT=631.137 CHECKS=1280510	SAT TT=675.649 CHECKS=1275640	SAT TT=553.814 ASSIGNMENTS=954	SAT TT=556.58 ASSIGNMENTS=868	SAT TT=96.699 CHECKS=94045200 NODES=2201	SAT TT=147.74 CHECKS=260319000 NODES=4793	? (TO) TT=1800.09	SAT TT=42.673 ASSIGNMENTS=996 CHECKS=2734450	SAT TT=44.302 ASSIGNMENTS=996 CHECKS=2734450	? (TO) TT=1800.02	? (MO) TT=1796.56	SAT TT=1.302 CHECKS=87052	SAT TT=33.955 ASSIGNMENTS=964 CHECKS=2680310	SAT TT=133.788 ASSIGNMENTS=5065 CHECKS=11840400	? (MO) TT=7.5	SAT TT=33.097 ASSIGNMENTS=997 CHECKS=2740220	SAT TT=34.676 ASSIGNMENTS=996 CHECKS=2734450	? TT=87.471	SAT TT=1.681 ASSIGNMENTS=2096 CHECKS=205316	? TT=141.829	? TT=141.975
csp/bddLarge/ normalized-bdd-21-2713-15-79-3_ext.xml	UNSAT TT=20.884	UNSAT TT=71.732 CHECKS=3499 NODES=1584	UNSAT TT=87.981 CHECKS=3032 NODES=1500	? (problem) TT=515.502	? (TO) TT=1800.21	? (TO) TT=1800.16	UNSAT TT=373.027 ASSIGNMENTS=945	UNSAT TT=1136.28 ASSIGNMENTS=1415	UNSAT TT=99.899 CHECKS=99449700 NODES=2183	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=35.265 ASSIGNMENTS=923 CHECKS=2101300	UNSAT TT=32.607 ASSIGNMENTS=923 CHECKS=2101300	? (TO) TT=1800	? (MO) TT=1757.63	UNSAT TT=20.884 CHECKS=1912900	UNSAT TT=27.83 ASSIGNMENTS=955 CHECKS=2188010	UNSAT TT=137.473 ASSIGNMENTS=5229 CHECKS=12318400	? (MO) TT=7.6	UNSAT TT=28.369 ASSIGNMENTS=1016 CHECKS=2276350	UNSAT TT=24.649 ASSIGNMENTS=923 CHECKS=2101300	? TT=89.025	UNSAT TT=1.856 ASSIGNMENTS=2093 CHECKS=192376	? TT=238.94	? TT=232.528
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddLarge/ normalized-bdd-21-2713-15-79-4_ext.xml	SAT TT=1.586	SAT TT=21.646 CHECKS=2932 NODES=226	SAT TT=7.677 CHECKS=2713 NODES=0	? (problem) TT=525.085	SAT TT=772.201 CHECKS=1426610	SAT TT=1181.53 CHECKS=2432610	SAT TT=14.224 ASSIGNMENTS=13	SAT TT=13.406 ASSIGNMENTS=22	SAT TT=31.338 CHECKS=192623 NODES=21	SAT TT=16.492 CHECKS=14935400 NODES=271	SAT TT=123.605 CHECKS=79153300 NODES=1412	SAT TT=1.614 ASSIGNMENTS=12 CHECKS=40695	SAT TT=1.723 ASSIGNMENTS=12 CHECKS=40695	? (MO) TT=1745.33	? (MO) TT=1790.98	SAT TT=5.711 CHECKS=556387	SAT TT=1.706 ASSIGNMENTS=12 CHECKS=40695	SAT TT=1.721 ASSIGNMENTS=12 CHECKS=40695	? (MO) TT=7.07	SAT TT=1.613 ASSIGNMENTS=21 CHECKS=40695	SAT TT=1.586 ASSIGNMENTS=12 CHECKS=40695	? TT=97.744	SAT TT=0.384 ASSIGNMENTS=21 CHECKS=9939	? TT=150.631	? TT=142.071
csp/bddLarge/ normalized-bdd-21-2713-15-79-5_ext.xml	SAT TT=1.335	SAT TT=56.391 CHECKS=3713 NODES=893	SAT TT=7.571 CHECKS=2713 NODES=0	? (problem) TT=523.602	SAT TT=666.73 CHECKS=1414240	SAT TT=881.401 CHECKS=1754550	SAT TT=13.055 ASSIGNMENTS=12	SAT TT=14.067 ASSIGNMENTS=12	SAT TT=29.538 CHECKS=255057 NODES=21	SAT TT=39.547 CHECKS=59021300 NODES=1082	SAT TT=1181.2 CHECKS=1191160000 NODES=18178	SAT TT=1.514 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.521 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=1750.97	? (MO) TT=1743.03	SAT TT=1.335 CHECKS=105438	SAT TT=1.524 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.497 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=7.1	SAT TT=1.465 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.47 ASSIGNMENTS=11 CHECKS=40695	? TT=98.243	SAT TT=0.372 ASSIGNMENTS=21 CHECKS=9361	? TT=217.428	? TT=198.989
csp/bddLarge/ normalized-bdd-21-2713-15-79-6_ext.xml	UNSAT TT=22.888	UNSAT TT=76.181 CHECKS=5316 NODES=2097	UNSAT TT=76.052 CHECKS=4113 NODES=1850	? (problem) TT=571.072	? (TO) TT=1800.12	? (TO) TT=1800.21	UNSAT TT=972.952 ASSIGNMENTS=1218	UNSAT TT=965.503 ASSIGNMENTS=1466	UNSAT TT=97.879 CHECKS=100176000 NODES=2195	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=38.699 ASSIGNMENTS=975 CHECKS=2554150	UNSAT TT=36.126 ASSIGNMENTS=975 CHECKS=2554150	? (MO) TT=1785.81	? (MO) TT=1695.23	UNSAT TT=22.888 CHECKS=2355680	UNSAT TT=33.071 ASSIGNMENTS=1071 CHECKS=2793970	UNSAT TT=151.94 ASSIGNMENTS=5177 CHECKS=12005300	? (MO) TT=7	UNSAT TT=32.418 ASSIGNMENTS=1089 CHECKS=2868430	UNSAT TT=29.988 ASSIGNMENTS=975 CHECKS=2554150	? TT=104.317	UNSAT TT=2.39 ASSIGNMENTS=2339 CHECKS=411939	? TT=150.56	? TT=152.108
csp/bddLarge/ normalized-bdd-21-2713-15-79-7_ext.xml	UNSAT TT=20.045	UNSAT TT=73.817 CHECKS=3979 NODES=1823	UNSAT TT=80.599 CHECKS=3864 NODES=1828	? (problem) TT=571.431	? (TO) TT=1800.21	? (TO) TT=1800.16	UNSAT TT=880.847 ASSIGNMENTS=1112	UNSAT TT=1022.82 ASSIGNMENTS=1421	UNSAT TT=101.629 CHECKS=92677300 NODES=2239	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=47.983 ASSIGNMENTS=1083 CHECKS=3176710	UNSAT TT=48.465 ASSIGNMENTS=1083 CHECKS=3176710	? (TO) TT=1800	? (MO) TT=1688.72	UNSAT TT=20.045 CHECKS=2500500	UNSAT TT=37.42 ASSIGNMENTS=1037 CHECKS=3267150	UNSAT TT=131.437 ASSIGNMENTS=4955 CHECKS=11741300	? (MO) TT=7.6	UNSAT TT=36.206 ASSIGNMENTS=1075 CHECKS=3342090	UNSAT TT=36.466 ASSIGNMENTS=1083 CHECKS=3176710	? TT=93.456	UNSAT TT=1.861 ASSIGNMENTS=2138 CHECKS=206666	? TT=80.34	? TT=80.275
csp/bddLarge/ normalized-bdd-21-2713-15-79-8_ext.xml	SAT TT=1.479	SAT TT=39.424 CHECKS=4801 NODES=526	SAT TT=7.722 CHECKS=2713 NODES=0	? (problem) TT=528.732	SAT TT=646.048 CHECKS=1134900	SAT TT=454.389 CHECKS=715287	SAT TT=12.961 ASSIGNMENTS=11	SAT TT=12.866 ASSIGNMENTS=14	SAT TT=31.814 CHECKS=210120 NODES=21	SAT TT=42.29 CHECKS=74186000 NODES=1363	SAT TT=619.153 CHECKS=821644000 NODES=12224	SAT TT=1.809 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.793 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=1769.14	? (MO) TT=1794.91	SAT TT=15.893 CHECKS=1356620	SAT TT=1.786 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.747 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=7.4	SAT TT=1.479 ASSIGNMENTS=13 CHECKS=40695	SAT TT=1.783 ASSIGNMENTS=10 CHECKS=40695	? TT=100.806	SAT TT=0.376 ASSIGNMENTS=21 CHECKS=6325	? TT=134.363	? TT=142.448
csp/bddLarge/ normalized-bdd-21-2713-15-79-9_ext.xml	UNSAT TT=19.999	UNSAT TT=83.219 CHECKS=3030 NODES=1531	UNSAT TT=91.779 CHECKS=3319 NODES=1552	? (problem) TT=571.444	? (TO) TT=1800.19	? (TO) TT=1800.13	UNSAT TT=556.598 ASSIGNMENTS=978	UNSAT TT=1237.96 ASSIGNMENTS=1447	UNSAT TT=117.461 CHECKS=125061000 NODES=2181	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=36.518 ASSIGNMENTS=1034 CHECKS=2599890	UNSAT TT=39.232 ASSIGNMENTS=1034 CHECKS=2599890	? (MO) TT=1779.2	? (MO) TT=1717.1	UNSAT TT=19.999 CHECKS=1966230	UNSAT TT=30.788 ASSIGNMENTS=997 CHECKS=2518740	UNSAT TT=141.407 ASSIGNMENTS=4864 CHECKS=11536200	? (MO) TT=7.4	UNSAT TT=31.853 ASSIGNMENTS=1044 CHECKS=2608730	UNSAT TT=30.368 ASSIGNMENTS=1034 CHECKS=2599890	? TT=86	UNSAT TT=1.665 ASSIGNMENTS=2129 CHECKS=177514	? TT=135.336	? TT=135.77
csp/bddSmall/ normalized-bdd-21-133-18-78-10_ext.xml	SAT TT=0.714	SAT TT=31.417 CHECKS=11568 NODES=4444	SAT TT=4.436 CHECKS=133 NODES=0	SAT TT=143.153	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=6.573 ASSIGNMENTS=17	SAT TT=6.797 ASSIGNMENTS=22	SAT TT=12.562 CHECKS=10640 NODES=21	SAT TT=9.581 CHECKS=17916700 NODES=4623	SAT TT=2 CHECKS=1295600 NODES=299	SAT TT=0.786 ASSIGNMENTS=16 CHECKS=2394	SAT TT=0.714 ASSIGNMENTS=16 CHECKS=2394	? (MO) TT=597.44	? (MO) TT=557.11	SAT TT=8.114 CHECKS=1016120	SAT TT=0.77 ASSIGNMENTS=16 CHECKS=2394	SAT TT=0.704 ASSIGNMENTS=16 CHECKS=2394	? (MO) TT=6.9	SAT TT=0.793 ASSIGNMENTS=21 CHECKS=2394	SAT TT=0.787 ASSIGNMENTS=16 CHECKS=2394	? TT=100.094	SAT TT=0.999 ASSIGNMENTS=21 CHECKS=775	? TT=95.111	? TT=108.712
csp/bddSmall/ normalized-bdd-21-133-18-78-11_ext.xml	SAT TT=0.801	SAT TT=39.633 CHECKS=26849 NODES=8913	SAT TT=51.35 CHECKS=28653 NODES=9183	SAT TT=227.687	SAT TT=910.008 CHECKS=181944	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.13	SAT TT=74.59 CHECKS=66037600 NODES=24505	SAT TT=2.407 CHECKS=1448240 NODES=370	SAT TT=84.083 CHECKS=122010000 NODES=19217	SAT TT=24.1 ASSIGNMENTS=10143 CHECKS=1645510	SAT TT=22.712 ASSIGNMENTS=10143 CHECKS=1645510	? (MO) TT=581.37	? (MO) TT=541.75	SAT TT=3.245 CHECKS=268178	SAT TT=15.351 ASSIGNMENTS=9960 CHECKS=1647540	SAT TT=23.924 ASSIGNMENTS=16692 CHECKS=2346960	? (MO) TT=7.29	SAT TT=0.801 ASSIGNMENTS=29 CHECKS=4050	SAT TT=15.959 ASSIGNMENTS=10143 CHECKS=1645510	? TT=105.684	SAT TT=7.553 ASSIGNMENTS=18609 CHECKS=1471740	? TT=223.17	? TT=227.275
csp/bddSmall/ normalized-bdd-21-133-18-78-12_ext.xml	UNSAT TT=12.089	UNSAT TT=49.652 CHECKS=80918 NODES=21031	UNSAT TT=61.526 CHECKS=62322 NODES=16438	UNSAT TT=251.288	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.09	UNSAT TT=61.7 CHECKS=62633200 NODES=24042	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=25.876 ASSIGNMENTS=11516 CHECKS=1773070	UNSAT TT=27.005 ASSIGNMENTS=11516 CHECKS=1773070	? (MO) TT=592.97	? (MO) TT=557.54	UNSAT TT=12.089 CHECKS=1464290	UNSAT TT=18.785 ASSIGNMENTS=11986 CHECKS=1778540	UNSAT TT=21.749 ASSIGNMENTS=16635 CHECKS=2347980	? (MO) TT=7.1	UNSAT TT=16.496 ASSIGNMENTS=10496 CHECKS=1486790	UNSAT TT=18.511 ASSIGNMENTS=11516 CHECKS=1773070	? TT=106.065	UNSAT TT=5.743 ASSIGNMENTS=19103 CHECKS=976016	? TT=221.837	? TT=221.075
csp/bddSmall/ normalized-bdd-21-133-18-78-13_ext.xml	UNSAT TT=15.11	UNSAT TT=86.699 CHECKS=62729 NODES=17802	UNSAT TT=93.276 CHECKS=54869 NODES=16026	UNSAT TT=271.282	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.12	UNSAT TT=70.573 CHECKS=63872600 NODES=23912	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=23.505 ASSIGNMENTS=10062 CHECKS=1513130	UNSAT TT=23.537 ASSIGNMENTS=10062 CHECKS=1513130	? (MO) TT=543.38	? (MO) TT=552.42	UNSAT TT=19.475 CHECKS=1320750	UNSAT TT=16.015 ASSIGNMENTS=10652 CHECKS=1582110	UNSAT TT=21.701 ASSIGNMENTS=14811 CHECKS=2110990	? (MO) TT=7.3	UNSAT TT=16.736 ASSIGNMENTS=10564 CHECKS=1543190	UNSAT TT=15.11 ASSIGNMENTS=10062 CHECKS=1513130	? TT=90.725	UNSAT TT=9.541 ASSIGNMENTS=18943 CHECKS=1798090	? TT=125.03	? TT=126.479
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-14_ext.xml	UNSAT TT=12.937	UNSAT TT=55.155 CHECKS=71926 NODES=19555	UNSAT TT=70.867 CHECKS=71691 NODES=19487	UNSAT TT=242.868	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	UNSAT TT=89.287 CHECKS=82401600 NODES=34610	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=23.022 ASSIGNMENTS=10037 CHECKS=1516500	UNSAT TT=25.235 ASSIGNMENTS=10037 CHECKS=1516500	? (MO) TT=595.56	? (MO) TT=568.02	UNSAT TT=12.937 CHECKS=1282110	UNSAT TT=16.472 ASSIGNMENTS=10610 CHECKS=1474700	UNSAT TT=24.076 ASSIGNMENTS=15503 CHECKS=2217940	? (MO) TT=7.01	UNSAT TT=16.64 ASSIGNMENTS=11579 CHECKS=1536460	UNSAT TT=16.798 ASSIGNMENTS=10037 CHECKS=1516500	? TT=79.517	UNSAT TT=7.554 ASSIGNMENTS=19169 CHECKS=1444690	? TT=239.534	? TT=234.845
csp/bddSmall/ normalized-bdd-21-133-18-78-15_ext.xml	UNSAT TT=13.111	UNSAT TT=60.022 CHECKS=56615 NODES=17053	UNSAT TT=68.782 CHECKS=63200 NODES=18124	UNSAT TT=248.323	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.1	UNSAT TT=66.274 CHECKS=65794900 NODES=24053	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=24.985 ASSIGNMENTS=10147 CHECKS=1682160	UNSAT TT=23.332 ASSIGNMENTS=10147 CHECKS=1682160	? (MO) TT=555.51	? (MO) TT=558.69	UNSAT TT=13.111 CHECKS=1322890	UNSAT TT=17.438 ASSIGNMENTS=11469 CHECKS=1762530	UNSAT TT=21.585 ASSIGNMENTS=15567 CHECKS=2236000	? (MO) TT=7.78	UNSAT TT=17.222 ASSIGNMENTS=11661 CHECKS=1765920	UNSAT TT=16.425 ASSIGNMENTS=10147 CHECKS=1682160	? TT=95.284	UNSAT TT=7.372 ASSIGNMENTS=19762 CHECKS=1466590	? TT=122.463	? TT=122.985
csp/bddSmall/ normalized-bdd-21-133-18-78-16_ext.xml	UNSAT TT=15.544	UNSAT TT=58.602 CHECKS=67531 NODES=18434	UNSAT TT=66.19 CHECKS=70573 NODES=18531	UNSAT TT=275.808	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.13	UNSAT TT=64.081 CHECKS=60196900 NODES=24854	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=24.869 ASSIGNMENTS=11172 CHECKS=1573320	UNSAT TT=25.689 ASSIGNMENTS=11172 CHECKS=1573320	? (MO) TT=555.69	? (MO) TT=547.18	UNSAT TT=15.591 CHECKS=1373920	UNSAT TT=17.417 ASSIGNMENTS=10548 CHECKS=1663600	UNSAT TT=23.438 ASSIGNMENTS=15901 CHECKS=2259680	? (MO) TT=7.32	UNSAT TT=15.83 ASSIGNMENTS=10231 CHECKS=1571370	UNSAT TT=15.544 ASSIGNMENTS=11172 CHECKS=1573320	? TT=95.583	UNSAT TT=9.907 ASSIGNMENTS=20868 CHECKS=2298450	? TT=147.18	? TT=142.222
csp/bddSmall/ normalized-bdd-21-133-18-78-17_ext.xml	SAT TT=0.725	SAT TT=33.241 CHECKS=10260 NODES=4826	SAT TT=4.408 CHECKS=133 NODES=0	SAT TT=153.943	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=6.975 ASSIGNMENTS=14	SAT TT=6.953 ASSIGNMENTS=15	SAT TT=12.487 CHECKS=15673 NODES=21	SAT TT=3.259 CHECKS=4355540 NODES=1120	SAT TT=70.471 CHECKS=105941000 NODES=17944	SAT TT=0.796 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.793 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=549.44	? (MO) TT=597.14	SAT TT=5.053 CHECKS=485363	SAT TT=0.79 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.779 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.43	SAT TT=0.725 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.772 ASSIGNMENTS=13 CHECKS=2394	? TT=99.236	SAT TT=0.993 ASSIGNMENTS=21 CHECKS=417	? TT=122.009	? TT=126.753
csp/bddSmall/ normalized-bdd-21-133-18-78-18_ext.xml	SAT TT=0.768	SAT TT=29.54 CHECKS=9000 NODES=4153	SAT TT=4.221 CHECKS=133 NODES=0	SAT TT=133.505	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=7.502 ASSIGNMENTS=15	SAT TT=6.72 ASSIGNMENTS=14	SAT TT=13.25 CHECKS=16276 NODES=21	SAT TT=32.463 CHECKS=77831800 NODES=20092	SAT TT=33.902 CHECKS=48272100 NODES=7918	SAT TT=0.774 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.769 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=594.57	? (MO) TT=588.16	SAT TT=2.428 CHECKS=174515	SAT TT=0.768 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.759 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.4	SAT TT=0.792 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.786 ASSIGNMENTS=15 CHECKS=2394	? TT=91.612	SAT TT=0.967 ASSIGNMENTS=21 CHECKS=717	? TT=217.324	? TT=227.368
csp/bddSmall/ normalized-bdd-21-133-18-78-19_ext.xml	UNSAT TT=11.976	UNSAT TT=55.298 CHECKS=85411 NODES=22034	UNSAT TT=62.258 CHECKS=70291 NODES=19050	UNSAT TT=242.671	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.12	UNSAT TT=62.824 CHECKS=62000600 NODES=24023	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=24.023 ASSIGNMENTS=11246 CHECKS=1675490	UNSAT TT=23.837 ASSIGNMENTS=11246 CHECKS=1675490	? (MO) TT=587.62	? (MO) TT=602.08	UNSAT TT=11.976 CHECKS=1313320	UNSAT TT=12.724 ASSIGNMENTS=10054 CHECKS=1471910	UNSAT TT=22.387 ASSIGNMENTS=15374 CHECKS=2235730	? (MO) TT=7.18	UNSAT TT=14.695 ASSIGNMENTS=10442 CHECKS=1606760	UNSAT TT=16.127 ASSIGNMENTS=11246 CHECKS=1675490	? TT=85.245	UNSAT TT=6.562 ASSIGNMENTS=20063 CHECKS=1244730	? TT=231.844	? TT=254.803
csp/bddSmall/ normalized-bdd-21-133-18-78-1_ext.xml	SAT TT=0.719	SAT TT=33.089 CHECKS=18106 NODES=6241	SAT TT=4.345 CHECKS=133 NODES=0	SAT TT=146.005	? (TO) TT=1800.07	SAT TT=569.106 CHECKS=114108	SAT TT=7.389 ASSIGNMENTS=14	SAT TT=7.363 ASSIGNMENTS=16	SAT TT=13.338 CHECKS=16817 NODES=21	SAT TT=1.695 CHECKS=544442 NODES=136	SAT TT=229.192 CHECKS=257826000 NODES=19620	SAT TT=0.77 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.779 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=600.22	? (MO) TT=553.03	SAT TT=13.331 CHECKS=1161870	SAT TT=0.733 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.73 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=7.89	SAT TT=0.719 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.797 ASSIGNMENTS=13 CHECKS=2394	? TT=81.62	SAT TT=0.955 ASSIGNMENTS=21 CHECKS=590	? TT=98.121	? TT=100.159
csp/bddSmall/ normalized-bdd-21-133-18-78-20_ext.xml	SAT TT=0.731	SAT TT=41.671 CHECKS=38439 NODES=11735	SAT TT=3.951 CHECKS=133 NODES=0	SAT TT=144.413	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT TT=6.598 ASSIGNMENTS=15	SAT TT=7.258 ASSIGNMENTS=16	SAT TT=12.38 CHECKS=10119 NODES=21	SAT TT=5.196 CHECKS=9473980 NODES=2442	SAT TT=103.362 CHECKS=131512000 NODES=14884	SAT TT=0.789 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.794 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=596.18	? (MO) TT=557.43	SAT TT=3.753 CHECKS=381201	SAT TT=0.785 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.724 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=7.54	SAT TT=0.802 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.731 ASSIGNMENTS=14 CHECKS=2394	? TT=84.077	SAT TT=1.051 ASSIGNMENTS=21 CHECKS=467	? TT=238.746	? TT=238.797
csp/bddSmall/ normalized-bdd-21-133-18-78-21_ext.xml	UNSAT TT=14.384	UNSAT TT=58.504 CHECKS=63268 NODES=18664	UNSAT TT=65.704 CHECKS=59131 NODES=17021	UNSAT TT=254.492	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.15	UNSAT TT=69.807 CHECKS=61116800 NODES=24456	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=24.71 ASSIGNMENTS=10706 CHECKS=1579960	UNSAT TT=22.846 ASSIGNMENTS=10706 CHECKS=1579960	? (MO) TT=557.11	? (MO) TT=574.39	UNSAT TT=14.384 CHECKS=1300580	UNSAT TT=15.93 ASSIGNMENTS=10747 CHECKS=1588220	UNSAT TT=22.185 ASSIGNMENTS=15139 CHECKS=2149850	? (MO) TT=6.91	UNSAT TT=16.467 ASSIGNMENTS=10738 CHECKS=1561600	UNSAT TT=14.944 ASSIGNMENTS=10706 CHECKS=1579960	? TT=105.625	UNSAT TT=7.115 ASSIGNMENTS=19450 CHECKS=1444360	? TT=229.884	? TT=227.686
csp/bddSmall/ normalized-bdd-21-133-18-78-22_ext.xml	UNSAT TT=12.404	UNSAT TT=60.515 CHECKS=69110 NODES=18827	UNSAT TT=67.062 CHECKS=62628 NODES=17039	UNSAT TT=235.217	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.14	UNSAT TT=66.403 CHECKS=60842600 NODES=24631	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=23.446 ASSIGNMENTS=10793 CHECKS=1600220	UNSAT TT=23.872 ASSIGNMENTS=10793 CHECKS=1600220	? (MO) TT=548.73	? (MO) TT=549.57	UNSAT TT=12.404 CHECKS=1220260	UNSAT TT=15.949 ASSIGNMENTS=10733 CHECKS=1618230	UNSAT TT=25.586 ASSIGNMENTS=17896 CHECKS=2503990	? (MO) TT=7.99	UNSAT TT=18.216 ASSIGNMENTS=10580 CHECKS=1784720	UNSAT TT=14.781 ASSIGNMENTS=10793 CHECKS=1600220	? TT=97.181	UNSAT TT=6.423 ASSIGNMENTS=18262 CHECKS=1358800	? TT=99.573	? TT=93.276
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-23_ext.xml	SAT TT=0.754	SAT TT=32.66 CHECKS=12478 NODES=4701	SAT TT=4.176 CHECKS=133 NODES=0	SAT TT=149.269	SAT TT=69.429 CHECKS=8047	? (TO) TT=1800.04	SAT TT=6.864 ASSIGNMENTS=15	SAT TT=7.328 ASSIGNMENTS=14	SAT TT=12.74 CHECKS=12991 NODES=21	SAT TT=20.616 CHECKS=43141400 NODES=11130	SAT TT=13.393 CHECKS=20080300 NODES=4961	SAT TT=0.773 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.789 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=548.53	? (MO) TT=588.33	SAT TT=2.171 CHECKS=127107	SAT TT=0.772 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.778 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=7.3	SAT TT=0.754 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.756 ASSIGNMENTS=14 CHECKS=2394	? TT=86.479	SAT TT=1.072 ASSIGNMENTS=21 CHECKS=360	? TT=292.122	? TT=296.447
csp/bddSmall/ normalized-bdd-21-133-18-78-24_ext.xml	UNSAT TT=13.798	UNSAT TT=54.411 CHECKS=68899 NODES=18430	UNSAT TT=67.062 CHECKS=57164 NODES=16641	UNSAT TT=272.993	? (TO) TT=1800.01	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=64.678 CHECKS=56626400 NODES=24515	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=25.874 ASSIGNMENTS=10291 CHECKS=1883190	UNSAT TT=25.933 ASSIGNMENTS=10291 CHECKS=1883190	? (MO) TT=560.1	? (MO) TT=561.91	UNSAT TT=14.311 CHECKS=1442150	UNSAT TT=15.214 ASSIGNMENTS=9579 CHECKS=1579640	UNSAT TT=21.111 ASSIGNMENTS=14879 CHECKS=2140840	? (MO) TT=7.79	UNSAT TT=13.798 ASSIGNMENTS=9266 CHECKS=1466150	UNSAT TT=16.499 ASSIGNMENTS=10291 CHECKS=1883190	? TT=88.236	UNSAT TT=7.636 ASSIGNMENTS=18876 CHECKS=1555390	? TT=262.944	? TT=259.693
csp/bddSmall/ normalized-bdd-21-133-18-78-25_ext.xml	SAT TT=0.717	SAT TT=44.395 CHECKS=17754 NODES=6507	SAT TT=4.215 CHECKS=133 NODES=0	SAT TT=142.159	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=7.31 ASSIGNMENTS=15	SAT TT=7.26 ASSIGNMENTS=18	SAT TT=13.383 CHECKS=11014 NODES=21	SAT TT=12.931 CHECKS=25220700 NODES=6506	SAT TT=1451.47 CHECKS=1415560000 NODES=35730	SAT TT=0.793 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.807 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=561.47	? (MO) TT=556.14	SAT TT=16.122 CHECKS=1247380	SAT TT=0.717 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.778 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=7.93	SAT TT=0.77 ASSIGNMENTS=17 CHECKS=2394	SAT TT=0.727 ASSIGNMENTS=14 CHECKS=2394	? TT=87.429	SAT TT=0.952 ASSIGNMENTS=21 CHECKS=917	? TT=274.729	? TT=296.427
csp/bddSmall/ normalized-bdd-21-133-18-78-26_ext.xml	SAT TT=0.723	SAT TT=24.775 CHECKS=8361 NODES=3300	SAT TT=3.975 CHECKS=133 NODES=0	SAT TT=145.535	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=6.415 ASSIGNMENTS=15	SAT TT=7.21 ASSIGNMENTS=15	SAT TT=12.383 CHECKS=17186 NODES=21	SAT TT=7.71 CHECKS=15585400 NODES=4019	SAT TT=98.444 CHECKS=128900000 NODES=16365	SAT TT=0.737 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.768 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=590.36	? (MO) TT=574.77	SAT TT=5.341 CHECKS=502716	SAT TT=0.792 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.759 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=7.1	SAT TT=0.723 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.758 ASSIGNMENTS=14 CHECKS=2394	? TT=87.596	SAT TT=0.965 ASSIGNMENTS=21 CHECKS=607	? TT=264.571	? TT=239.915
csp/bddSmall/ normalized-bdd-21-133-18-78-27_ext.xml	SAT TT=0.713	SAT TT=26.707 CHECKS=7401 NODES=2951	SAT TT=4.369 CHECKS=133 NODES=0	SAT TT=134.465	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=7.487 ASSIGNMENTS=15	SAT TT=7.358 ASSIGNMENTS=16	SAT TT=12.62 CHECKS=8393 NODES=21	SAT TT=4.743 CHECKS=7221190 NODES=1861	SAT TT=249.066 CHECKS=263496000 NODES=17084	SAT TT=0.713 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.794 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=596.49	? (MO) TT=549.89	SAT TT=0.775 CHECKS=27164	SAT TT=0.783 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.777 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=6.78	SAT TT=0.798 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.787 ASSIGNMENTS=14 CHECKS=2394	? TT=91.623	SAT TT=1.051 ASSIGNMENTS=21 CHECKS=501	? TT=292.533	? TT=277.87
csp/bddSmall/ normalized-bdd-21-133-18-78-28_ext.xml	UNSAT TT=12.778	UNSAT TT=49.741 CHECKS=72626 NODES=20985	UNSAT TT=62.727 CHECKS=68387 NODES=20089	UNSAT TT=252.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.18	UNSAT TT=61.839 CHECKS=60510700 NODES=23937	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=24.121 ASSIGNMENTS=10326 CHECKS=1530210	UNSAT TT=24.674 ASSIGNMENTS=10326 CHECKS=1530210	? (MO) TT=574.22	? (MO) TT=540.41	UNSAT TT=12.778 CHECKS=1366560	UNSAT TT=17.569 ASSIGNMENTS=11822 CHECKS=1778470	UNSAT TT=20.043 ASSIGNMENTS=14997 CHECKS=2178820	? (MO) TT=6.81	UNSAT TT=14.987 ASSIGNMENTS=10020 CHECKS=1443980	UNSAT TT=16.394 ASSIGNMENTS=10326 CHECKS=1530210	? TT=89.438	UNSAT TT=6.846 ASSIGNMENTS=19022 CHECKS=1332520	? TT=93.414	? TT=105.629
csp/bddSmall/ normalized-bdd-21-133-18-78-29_ext.xml	UNSAT TT=12.13	UNSAT TT=63.654 CHECKS=65648 NODES=17331	UNSAT TT=73.221 CHECKS=65288 NODES=16953	UNSAT TT=223.995	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.12	UNSAT TT=68.696 CHECKS=61114500 NODES=24648	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=25.944 ASSIGNMENTS=11498 CHECKS=1641480	UNSAT TT=25.348 ASSIGNMENTS=11498 CHECKS=1641480	? (MO) TT=553.35	? (MO) TT=590.91	UNSAT TT=12.13 CHECKS=1386000	UNSAT TT=16.527 ASSIGNMENTS=11769 CHECKS=1721300	UNSAT TT=19.961 ASSIGNMENTS=14800 CHECKS=2093360	? (MO) TT=7.29	UNSAT TT=15.019 ASSIGNMENTS=10851 CHECKS=1499380	UNSAT TT=17.372 ASSIGNMENTS=11498 CHECKS=1641480	? TT=97.33	UNSAT TT=7.028 ASSIGNMENTS=18668 CHECKS=1419660	? TT=135.204	? TT=131.137
csp/bddSmall/ normalized-bdd-21-133-18-78-2_ext.xml	SAT TT=1.264	SAT TT=32.214 CHECKS=22972 NODES=7545	SAT TT=40.965 CHECKS=26351 NODES=8437	SAT TT=158.923	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=72.653 CHECKS=64942100 NODES=26049	SAT TT=1.774 CHECKS=663297 NODES=166	SAT TT=203.114 CHECKS=223101000 NODES=16656	SAT TT=20.768 ASSIGNMENTS=8312 CHECKS=1292560	SAT TT=22.05 ASSIGNMENTS=8312 CHECKS=1292560	? (MO) TT=555.84	? (MO) TT=572.55	SAT TT=1.264 CHECKS=89502	SAT TT=12.254 ASSIGNMENTS=8245 CHECKS=1242660	SAT TT=0.883 ASSIGNMENTS=94 CHECKS=14021	? (MO) TT=7.05	SAT TT=9.321 ASSIGNMENTS=5863 CHECKS=1049050	SAT TT=13.859 ASSIGNMENTS=8312 CHECKS=1292560	? TT=85.614	SAT TT=1.786 ASSIGNMENTS=1902 CHECKS=171788	? TT=98.403	? TT=98.761
csp/bddSmall/ normalized-bdd-21-133-18-78-30_ext.xml	UNSAT TT=16.415	UNSAT TT=61.912 CHECKS=54050 NODES=16986	UNSAT TT=71.147 CHECKS=58082 NODES=17559	UNSAT TT=250.307	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.11	UNSAT TT=71.227 CHECKS=59540100 NODES=24841	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=25.377 ASSIGNMENTS=11079 CHECKS=1742230	UNSAT TT=25.54 ASSIGNMENTS=11079 CHECKS=1742230	? (MO) TT=559.07	? (MO) TT=583.01	UNSAT TT=18.758 CHECKS=1431650	UNSAT TT=16.415 ASSIGNMENTS=11699 CHECKS=1598120	UNSAT TT=21.7 ASSIGNMENTS=16896 CHECKS=2347340	? (MO) TT=7.46	UNSAT TT=16.997 ASSIGNMENTS=12139 CHECKS=1662080	UNSAT TT=16.925 ASSIGNMENTS=11079 CHECKS=1742230	? TT=80.288	UNSAT TT=10.509 ASSIGNMENTS=22003 CHECKS=1576020	? TT=224.487	? TT=247.41
csp/bddSmall/ normalized-bdd-21-133-18-78-31_ext.xml	UNSAT TT=14.791	UNSAT TT=95.062 CHECKS=59416 NODES=17473	UNSAT TT=106.809 CHECKS=55033 NODES=18090	UNSAT TT=242.139	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=1554.51 ASSIGNMENTS=10289	? (TO) TT=1800.05	UNSAT TT=68.224 CHECKS=58346500 NODES=24228	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=22.982 ASSIGNMENTS=10508 CHECKS=1470000	UNSAT TT=21.747 ASSIGNMENTS=10508 CHECKS=1470000	? (MO) TT=558.83	? (MO) TT=591.98	UNSAT TT=18.057 CHECKS=1374040	UNSAT TT=15.381 ASSIGNMENTS=10624 CHECKS=1470240	UNSAT TT=20.571 ASSIGNMENTS=14711 CHECKS=2073900	? (MO) TT=6.84	UNSAT TT=16.03 ASSIGNMENTS=10964 CHECKS=1515920	UNSAT TT=14.791 ASSIGNMENTS=10508 CHECKS=1470000	? TT=90.919	UNSAT TT=7.92 ASSIGNMENTS=17936 CHECKS=1426550	? TT=262.218	? TT=256.199
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-32_ext.xml	SAT TT=0.72	SAT TT=9.431 CHECKS=551 NODES=316	SAT TT=4.181 CHECKS=133 NODES=0	SAT TT=144.006	? (TO) TT=1800.08	SAT TT=137.203 CHECKS=24194	SAT TT=7.106 ASSIGNMENTS=15	SAT TT=7.295 ASSIGNMENTS=17	SAT TT=13.23 CHECKS=10919 NODES=21	SAT TT=12.541 CHECKS=25508400 NODES=6582	SAT TT=22.129 CHECKS=35857900 NODES=6831	SAT TT=0.779 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.785 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=593.4	? (MO) TT=589.35	SAT TT=3.804 CHECKS=396554	SAT TT=0.72 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.781 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=6.91	SAT TT=0.781 ASSIGNMENTS=16 CHECKS=2394	SAT TT=0.758 ASSIGNMENTS=14 CHECKS=2394	? TT=95.526	SAT TT=1.03 ASSIGNMENTS=21 CHECKS=579	? TT=100.247	? TT=99.489
csp/bddSmall/ normalized-bdd-21-133-18-78-33_ext.xml	UNSAT TT=16.157	UNSAT TT=58.092 CHECKS=58833 NODES=19701	UNSAT TT=62.823 CHECKS=65779 NODES=19303	UNSAT TT=251.674	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.08	UNSAT TT=69.614 CHECKS=65493200 NODES=24400	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=26.887 ASSIGNMENTS=12381 CHECKS=1850770	UNSAT TT=26.966 ASSIGNMENTS=12381 CHECKS=1850770	? (MO) TT=577.3	? (MO) TT=578.12	UNSAT TT=21.246 CHECKS=1332060	UNSAT TT=16.157 ASSIGNMENTS=11345 CHECKS=1605130	UNSAT TT=25.087 ASSIGNMENTS=16918 CHECKS=2396730	? (MO) TT=7.11	UNSAT TT=16.478 ASSIGNMENTS=11335 CHECKS=1520940	UNSAT TT=17.331 ASSIGNMENTS=12381 CHECKS=1850770	? TT=80.257	UNSAT TT=8.136 ASSIGNMENTS=20011 CHECKS=2016650	? TT=163.377	? TT=164.594
csp/bddSmall/ normalized-bdd-21-133-18-78-34_ext.xml	SAT TT=4.658	SAT TT=33.215 CHECKS=22442 NODES=7265	SAT TT=35.779 CHECKS=16011 NODES=5864	SAT TT=153.264	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=900.01 ASSIGNMENTS=6026	? (TO) TT=1800.08	SAT TT=55.574 CHECKS=53835200 NODES=22016	SAT TT=9.887 CHECKS=19526500 NODES=5036	SAT TT=180.709 CHECKS=226250000 NODES=22308	SAT TT=18.784 ASSIGNMENTS=7106 CHECKS=982989	SAT TT=18.697 ASSIGNMENTS=7106 CHECKS=982989	? (MO) TT=607.36	? (MO) TT=597.19	SAT TT=11.356 CHECKS=1107490	SAT TT=8.536 ASSIGNMENTS=6107 CHECKS=855725	SAT TT=9.679 ASSIGNMENTS=7298 CHECKS=1046620	? (MO) TT=7.31	SAT TT=4.658 ASSIGNMENTS=3425 CHECKS=483507	SAT TT=9.61 ASSIGNMENTS=7106 CHECKS=982989	? TT=93.958	SAT TT=7.008 ASSIGNMENTS=18307 CHECKS=1522910	? TT=119.179	? TT=109.337
csp/bddSmall/ normalized-bdd-21-133-18-78-35_ext.xml	UNSAT TT=13.553	UNSAT TT=71.316 CHECKS=59807 NODES=16866	UNSAT TT=75.633 CHECKS=56666 NODES=18545	UNSAT TT=196.748	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=67.369 CHECKS=57562200 NODES=24814	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=22.404 ASSIGNMENTS=11159 CHECKS=1524050	UNSAT TT=23.573 ASSIGNMENTS=11159 CHECKS=1524050	? (MO) TT=548.18	? (MO) TT=564.11	UNSAT TT=13.553 CHECKS=1256280	UNSAT TT=15.873 ASSIGNMENTS=10981 CHECKS=1506470	UNSAT TT=19.84 ASSIGNMENTS=14907 CHECKS=2150450	? (MO) TT=8.09	UNSAT TT=14.543 ASSIGNMENTS=10842 CHECKS=1486900	UNSAT TT=15.578 ASSIGNMENTS=11159 CHECKS=1524050	? TT=90.875	UNSAT TT=5.961 ASSIGNMENTS=19155 CHECKS=1123370	? TT=216.29	? TT=216.235
csp/bddSmall/ normalized-bdd-21-133-18-78-3_ext.xml	SAT TT=0.709	SAT TT=25.143 CHECKS=18934 NODES=5967	SAT TT=4.178 CHECKS=133 NODES=0	SAT TT=148.908	SAT TT=1056.7 CHECKS=223126	SAT TT=367.975 CHECKS=80899	SAT TT=6.593 ASSIGNMENTS=15	SAT TT=7.377 ASSIGNMENTS=15	SAT TT=13.35 CHECKS=11371 NODES=21	SAT TT=35.732 CHECKS=78450700 NODES=20255	SAT TT=186.843 CHECKS=230954000 NODES=22708	SAT TT=0.782 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.797 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=586.49	? (MO) TT=567.8	SAT TT=2.902 CHECKS=296067	SAT TT=0.78 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.762 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.6	SAT TT=0.778 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.709 ASSIGNMENTS=14 CHECKS=2394	? TT=87.334	SAT TT=1.06 ASSIGNMENTS=21 CHECKS=965	? TT=313.581	? TT=311.655
csp/bddSmall/ normalized-bdd-21-133-18-78-4_ext.xml	SAT TT=0.815	SAT TT=28.103 CHECKS=8638 NODES=3826	SAT TT=32.354 CHECKS=13615 NODES=4494	SAT TT=259.118	? (TO) TT=1800.03	SAT TT=458.504 CHECKS=120760	? (TO) TT=1800.1	SAT TT=1640.61 ASSIGNMENTS=5576	SAT TT=66.172 CHECKS=65313800 NODES=24481	SAT TT=12.115 CHECKS=24136800 NODES=6228	SAT TT=113.595 CHECKS=141529000 NODES=18435	SAT TT=23.907 ASSIGNMENTS=10886 CHECKS=1704260	SAT TT=25.224 ASSIGNMENTS=10886 CHECKS=1704260	? (MO) TT=557.78	? (MO) TT=575.58	SAT TT=4.393 CHECKS=385744	SAT TT=11.574 ASSIGNMENTS=7985 CHECKS=1296240	SAT TT=22.367 ASSIGNMENTS=15321 CHECKS=2252060	? (MO) TT=7.6	SAT TT=0.815 ASSIGNMENTS=29 CHECKS=4102	SAT TT=15.737 ASSIGNMENTS=10886 CHECKS=1704260	? TT=88.466	SAT TT=5.102 ASSIGNMENTS=10422 CHECKS=1187820	? TT=239.902	? TT=240.824
csp/bddSmall/ normalized-bdd-21-133-18-78-5_ext.xml	SAT TT=0.723	SAT TT=31.826 CHECKS=23174 NODES=7261	SAT TT=4.335 CHECKS=133 NODES=0	SAT TT=146.667	? (TO) TT=1800.11	SAT TT=1210.76 CHECKS=264689	SAT TT=6.373 ASSIGNMENTS=14	SAT TT=6.91 ASSIGNMENTS=15	SAT TT=12.62 CHECKS=13070 NODES=21	SAT TT=5.479 CHECKS=8566250 NODES=2210	SAT TT=204.982 CHECKS=228402000 NODES=20969	SAT TT=0.742 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.723 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=558.1	? (MO) TT=581.74	SAT TT=4.416 CHECKS=376924	SAT TT=0.776 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.763 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=6.8	SAT TT=0.808 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.777 ASSIGNMENTS=13 CHECKS=2394	? TT=93.341	SAT TT=1.033 ASSIGNMENTS=21 CHECKS=411	? TT=238.441	? TT=246.13
csp/bddSmall/ normalized-bdd-21-133-18-78-6_ext.xml	UNSAT TT=14.88	UNSAT TT=58.165 CHECKS=39854 NODES=15245	UNSAT TT=75.614 CHECKS=36826 NODES=14492	UNSAT TT=284.58	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.06	UNSAT TT=70.985 CHECKS=61066800 NODES=24384	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=24.373 ASSIGNMENTS=11325 CHECKS=1587550	UNSAT TT=24.91 ASSIGNMENTS=11325 CHECKS=1587550	? (MO) TT=548.39	? (MO) TT=578.82	UNSAT TT=18.274 CHECKS=1373470	UNSAT TT=15.86 ASSIGNMENTS=10771 CHECKS=1560070	UNSAT TT=21.542 ASSIGNMENTS=15723 CHECKS=2247850	? (MO) TT=6.8	UNSAT TT=14.88 ASSIGNMENTS=10514 CHECKS=1467170	UNSAT TT=15.696 ASSIGNMENTS=11325 CHECKS=1587550	? TT=81.781	UNSAT TT=7.522 ASSIGNMENTS=18438 CHECKS=1510260	? TT=212.353	? TT=221.729
csp/bddSmall/ normalized-bdd-21-133-18-78-7_ext.xml	SAT TT=0.813	SAT TT=24.206 CHECKS=18492 NODES=6060	SAT TT=30.109 CHECKS=16344 NODES=5691	SAT TT=215.53	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=71.042 CHECKS=64632500 NODES=24477	SAT TT=7.2 CHECKS=12071900 NODES=3113	SAT TT=58.298 CHECKS=81116600 NODES=13809	SAT TT=23.952 ASSIGNMENTS=11935 CHECKS=1731840	SAT TT=23.728 ASSIGNMENTS=11935 CHECKS=1731840	? (MO) TT=587.91	? (MO) TT=589.29	SAT TT=10.423 CHECKS=1170080	SAT TT=14.717 ASSIGNMENTS=10260 CHECKS=1590280	SAT TT=20.27 ASSIGNMENTS=14689 CHECKS=2231340	? (MO) TT=7.11	SAT TT=0.813 ASSIGNMENTS=31 CHECKS=4119	SAT TT=16.372 ASSIGNMENTS=11935 CHECKS=1731840	? TT=85.604	SAT TT=6.664 ASSIGNMENTS=19737 CHECKS=1193090	? TT=109.834	? TT=117.544
csp/bddSmall/ normalized-bdd-21-133-18-78-8_ext.xml	SAT TT=0.716	SAT TT=19.655 CHECKS=4897 NODES=1923	SAT TT=4.354 CHECKS=133 NODES=0	SAT TT=135.041	SAT TT=502.312 CHECKS=108116	? (TO) TT=1800.1	SAT TT=7.098 ASSIGNMENTS=14	SAT TT=6.61 ASSIGNMENTS=19	SAT TT=13.442 CHECKS=10029 NODES=21	SAT TT=50.773 CHECKS=115221000 NODES=29765	SAT TT=323.324 CHECKS=346201000 NODES=22271	SAT TT=0.729 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.771 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=587.22	? (MO) TT=546.07	SAT TT=9.759 CHECKS=922513	SAT TT=0.716 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.72 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.12	SAT TT=0.772 ASSIGNMENTS=18 CHECKS=2394	SAT TT=0.766 ASSIGNMENTS=13 CHECKS=2394	? TT=81.822	SAT TT=1.031 ASSIGNMENTS=21 CHECKS=342	? TT=93.153	? TT=102.929
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-9_ext.xml	SAT TT=0.744	SAT TT=18.886 CHECKS=5197 NODES=2236	SAT TT=4.171 CHECKS=133 NODES=0	SAT TT=221.13	SAT TT=406.132 CHECKS=99353	? (TO) TT=1800.06	? (TO) TT=1800.14	SAT TT=6.751 ASSIGNMENTS=17	SAT TT=12.602 CHECKS=13421 NODES=21	SAT TT=3.132 CHECKS=4255100 NODES=1094	SAT TT=115.992 CHECKS=148509000 NODES=16458	SAT TT=20.033 ASSIGNMENTS=7765 CHECKS=1113110	SAT TT=19.065 ASSIGNMENTS=7765 CHECKS=1113110	? (MO) TT=598.82	? (MO) TT=576.94	SAT TT=3.339 CHECKS=376742	SAT TT=13.69 ASSIGNMENTS=9668 CHECKS=1345280	SAT TT=0.967 ASSIGNMENTS=215 CHECKS=33232	? (MO) TT=7.39	SAT TT=0.744 ASSIGNMENTS=16 CHECKS=2394	SAT TT=11.142 ASSIGNMENTS=7765 CHECKS=1113110	? TT=95.04	SAT TT=1.187 ASSIGNMENTS=222 CHECKS=27801	? TT=104.127	? TT=105.206
csp/BH-4-13/ normalized-BlackHole-4-13-e-0_ext.xml	UNSAT TT=0.179	UNSAT TT=1.315 CHECKS=59584 NODES=0	UNSAT TT=1.301 CHECKS=59584 NODES=0	UNSAT TT=0.632	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=1.527 ASSIGNMENTS=0	UNSAT TT=1.857 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.197 ASSIGNMENTS=0 CHECKS=13846	UNSAT TT=0.189 ASSIGNMENTS=0 CHECKS=13846	? (TO) TT=1800.06	? (MO) TT=1501.33	No data	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13846	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13846	? (TO) TT=1800.06	UNSAT TT=0.179 ASSIGNMENTS=0 CHECKS=13846	UNSAT TT=0.181 ASSIGNMENTS=0 CHECKS=13846	? (TO) TT=1800.2	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.05
csp/BH-4-13/ normalized-BlackHole-4-13-e-1_ext.xml	UNSAT TT=0.186	UNSAT TT=1.277 CHECKS=59585 NODES=0	UNSAT TT=1.406 CHECKS=59585 NODES=0	UNSAT TT=0.625	? (TO) TT=1800.05	? (TO) TT=1800.12	UNSAT TT=1.833 ASSIGNMENTS=0	UNSAT TT=1.86 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.198 ASSIGNMENTS=0 CHECKS=13950	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=13950	? (TO) TT=1800.04	? (MO) TT=1771.6	No data	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=13950	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13950	? (TO) TT=1800.08	UNSAT TT=0.198 ASSIGNMENTS=0 CHECKS=13950	UNSAT TT=0.201 ASSIGNMENTS=0 CHECKS=13950	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.13
csp/BH-4-13/ normalized-BlackHole-4-13-e-2_ext.xml	UNSAT TT=0.185	UNSAT TT=1.357 CHECKS=59488 NODES=0	UNSAT TT=1.272 CHECKS=59488 NODES=0	UNSAT TT=0.635	? (TO) TT=1800.11	? (TO) TT=1800.07	UNSAT TT=1.651 ASSIGNMENTS=0	UNSAT TT=1.551 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=0.195 ASSIGNMENTS=0 CHECKS=14006	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=14006	? (TO) TT=1800.08	? (MO) TT=1454.74	No data	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=14006	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=14006	? (TO) TT=1800.05	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=14006	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=14006	? (TO) TT=1800.21	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/BH-4-13/ normalized-BlackHole-4-13-e-3_ext.xml	UNSAT TT=0.184	UNSAT TT=1.368 CHECKS=59488 NODES=0	UNSAT TT=1.357 CHECKS=59488 NODES=0	UNSAT TT=0.591	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=1.579 ASSIGNMENTS=0	UNSAT TT=1.722 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13900	UNSAT TT=0.19 ASSIGNMENTS=0 CHECKS=13900	? (TO) TT=1800.07	? (TO) TT=1800.03	No data	UNSAT TT=0.189 ASSIGNMENTS=0 CHECKS=13900	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13900	? (TO) TT=1800.1	UNSAT TT=0.184 ASSIGNMENTS=0 CHECKS=13900	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=13900	? (TO) TT=1800.2	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.05
csp/BH-4-13/ normalized-BlackHole-4-13-m-0_ext.xml	UNSAT TT=0.185	UNSAT TT=1.395 CHECKS=59488 NODES=0	UNSAT TT=1.281 CHECKS=59488 NODES=0	UNSAT TT=1341.56	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=1.933 ASSIGNMENTS=0	UNSAT TT=1.66 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=13847	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=13847	? (TO) TT=1800.01	? (TO) TT=1800.02	No data	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13847	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13847	? (TO) TT=1800.08	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13847	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=13847	? (TO) TT=1800.27	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.12
csp/BH-4-13/ normalized-BlackHole-4-13-m-1_ext.xml	UNSAT TT=0.184	UNSAT TT=1.277 CHECKS=59488 NODES=0	UNSAT TT=1.313 CHECKS=59488 NODES=0	UNSAT TT=1339.46	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=1.601 ASSIGNMENTS=0	UNSAT TT=1.568 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=0.202 ASSIGNMENTS=0 CHECKS=14005	UNSAT TT=0.197 ASSIGNMENTS=0 CHECKS=14005	? (TO) TT=1800.06	? (MO) TT=1543.57	No data	UNSAT TT=0.184 ASSIGNMENTS=0 CHECKS=14005	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=14005	? (TO) TT=1800	UNSAT TT=0.192 ASSIGNMENTS=0 CHECKS=14005	UNSAT TT=0.192 ASSIGNMENTS=0 CHECKS=14005	? (TO) TT=1800.23	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.14
csp/BH-4-13/ normalized-BlackHole-4-13-m-2_ext.xml	UNSAT TT=0.186	UNSAT TT=1.393 CHECKS=59489 NODES=0	UNSAT TT=1.271 CHECKS=59489 NODES=0	UNSAT TT=0.63	? (TO) TT=1800.12	? (TO) TT=1800.06	UNSAT TT=1.638 ASSIGNMENTS=0	UNSAT TT=1.857 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.1	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=14108	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=14108	? (TO) TT=1800.05	? (TO) TT=1800.07	No data	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=14108	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=14108	? (TO) TT=1800.07	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=14108	UNSAT TT=0.189 ASSIGNMENTS=0 CHECKS=14108	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/BH-4-4/ normalized-BlackHole-4-4-e-0_ext.xml	UNSAT TT=0.016	UNSAT TT=0.777 CHECKS=5952 NODES=0	UNSAT TT=0.84 CHECKS=5952 NODES=0	UNSAT TT=0.07	UNSAT TT=5.102 CHECKS=3152700	UNSAT TT=2.781 CHECKS=2102480	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.598 ASSIGNMENTS=0	UNSAT TT=1.718 CHECKS=81673 NODES=5880	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=1.235	UNSAT TT=1.4	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=2.527	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=1.94	UNSAT TT=420.986 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.057	UNSAT TT=1.311
csp/BH-4-4/ normalized-BlackHole-4-4-e-1_ext.xml	UNSAT TT=0.016	UNSAT TT=0.843 CHECKS=5952 NODES=0	UNSAT TT=0.827 CHECKS=5952 NODES=0	UNSAT TT=0.077	UNSAT TT=5.426 CHECKS=3127470	UNSAT TT=2.546 CHECKS=2112960	UNSAT TT=0.555 ASSIGNMENTS=0	UNSAT TT=0.65 ASSIGNMENTS=0	UNSAT TT=1.788 CHECKS=79133 NODES=5623	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=1.532	UNSAT TT=1.361	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=2.537	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=2.012	UNSAT TT=429.179 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=0.978	UNSAT TT=1.041
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-4/ normalized-BlackHole-4-4-e-2_ext.xml	UNSAT TT=0.015	UNSAT TT=0.84 CHECKS=5952 NODES=0	UNSAT TT=0.829 CHECKS=5952 NODES=0	UNSAT TT=0.073	UNSAT TT=4.623 CHECKS=2635430	UNSAT TT=2.742 CHECKS=2122950	UNSAT TT=0.594 ASSIGNMENTS=0	UNSAT TT=0.574 ASSIGNMENTS=0	UNSAT TT=1.703 CHECKS=80971 NODES=5841	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=1.275	UNSAT TT=1.33	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=2.542	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=1.934	UNSAT TT=419.059 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.075	UNSAT TT=1.088
csp/BH-4-4/ normalized-BlackHole-4-4-e-3_ext.xml	UNSAT TT=0.015	UNSAT TT=0.926 CHECKS=5952 NODES=0	UNSAT TT=0.857 CHECKS=5952 NODES=0	UNSAT TT=0.075	UNSAT TT=5.107 CHECKS=3119390	UNSAT TT=2.793 CHECKS=2122970	UNSAT TT=0.555 ASSIGNMENTS=0	UNSAT TT=0.557 ASSIGNMENTS=0	UNSAT TT=1.905 CHECKS=80874 NODES=5840	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=1.524	UNSAT TT=1.508	No data	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=2.472	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=2.037	UNSAT TT=450.57 ASSIGNMENTS=1231830 CHECKS=890535000	UNSAT TT=0.97	UNSAT TT=1.281
csp/BH-4-4/ normalized-BlackHole-4-4-e-4_ext.xml	UNSAT TT=0.016	UNSAT TT=0.828 CHECKS=5952 NODES=0	UNSAT TT=0.801 CHECKS=5952 NODES=0	UNSAT TT=0.076	UNSAT TT=5.433 CHECKS=3141050	UNSAT TT=2.79 CHECKS=2122930	UNSAT TT=0.69 ASSIGNMENTS=0	UNSAT TT=0.558 ASSIGNMENTS=0	UNSAT TT=1.715 CHECKS=81605 NODES=5880	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=1.641	UNSAT TT=1.336	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=2.505	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=1.798	UNSAT TT=450.615 ASSIGNMENTS=1231830 CHECKS=890535000	UNSAT TT=1.061	UNSAT TT=0.982
csp/BH-4-4/ normalized-BlackHole-4-4-e-5_ext.xml	UNSAT TT=0.016	UNSAT TT=0.795 CHECKS=5952 NODES=0	UNSAT TT=0.778 CHECKS=5952 NODES=0	UNSAT TT=0.076	UNSAT TT=5.431 CHECKS=3130040	UNSAT TT=2.769 CHECKS=2114300	UNSAT TT=0.556 ASSIGNMENTS=0	UNSAT TT=0.578 ASSIGNMENTS=0	UNSAT TT=1.863 CHECKS=81626 NODES=5880	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.671	UNSAT TT=1.263	No data	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=2.552	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.778	UNSAT TT=448.105 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=0.975	UNSAT TT=0.976
csp/BH-4-4/ normalized-BlackHole-4-4-e-6_ext.xml	UNSAT TT=0.016	UNSAT TT=0.823 CHECKS=5952 NODES=0	UNSAT TT=0.79 CHECKS=5952 NODES=0	UNSAT TT=0.075	UNSAT TT=5.077 CHECKS=3183010	UNSAT TT=2.768 CHECKS=2140010	UNSAT TT=0.557 ASSIGNMENTS=0	UNSAT TT=0.562 ASSIGNMENTS=0	UNSAT TT=1.976 CHECKS=80410 NODES=5889	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=1.691	UNSAT TT=1.54	No data	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=2.653	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=2.085	UNSAT TT=453.138 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.104	UNSAT TT=1.327
csp/BH-4-4/ normalized-BlackHole-4-4-e-7_ext.xml	UNSAT TT=0.017	UNSAT TT=0.833 CHECKS=5952 NODES=0	UNSAT TT=0.788 CHECKS=5952 NODES=0	UNSAT TT=0.075	UNSAT TT=5.441 CHECKS=3081900	UNSAT TT=2.591 CHECKS=2153790	UNSAT TT=0.591 ASSIGNMENTS=0	UNSAT TT=0.629 ASSIGNMENTS=0	UNSAT TT=1.828 CHECKS=79569 NODES=5836	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.393	UNSAT TT=1.406	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=2.536	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.803	UNSAT TT=418.115 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.309	UNSAT TT=1.047
csp/BH-4-4/ normalized-BlackHole-4-4-e-8_ext.xml	UNSAT TT=0.016	UNSAT TT=0.826 CHECKS=5952 NODES=0	UNSAT TT=0.924 CHECKS=5952 NODES=0	UNSAT TT=0.07	UNSAT TT=5.004 CHECKS=3080150	UNSAT TT=2.767 CHECKS=2122160	UNSAT TT=0.556 ASSIGNMENTS=0	UNSAT TT=0.561 ASSIGNMENTS=0	UNSAT TT=1.707 CHECKS=80400 NODES=5890	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=1.511	UNSAT TT=1.385	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=2.508	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=2.066	UNSAT TT=448.144 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.197	UNSAT TT=1.029
csp/BH-4-4/ normalized-BlackHole-4-4-e-9_ext.xml	UNSAT TT=0.016	UNSAT TT=0.817 CHECKS=5952 NODES=0	UNSAT TT=0.86 CHECKS=5952 NODES=0	UNSAT TT=0.076	UNSAT TT=5.096 CHECKS=3096090	UNSAT TT=2.734 CHECKS=2132950	UNSAT TT=0.565 ASSIGNMENTS=0	UNSAT TT=0.73 ASSIGNMENTS=0	UNSAT TT=1.845 CHECKS=81620 NODES=5882	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=1.404	UNSAT TT=1.28	No data	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=2.366	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=1.978	UNSAT TT=437.595 ASSIGNMENTS=1231830 CHECKS=890535000	UNSAT TT=0.978	UNSAT TT=1.025
csp/BH-4-7/ normalized-BlackHole-4-7-e-0_ext.xml	UNSAT TT=0.042	UNSAT TT=0.957 CHECKS=10265 NODES=0	UNSAT TT=0.924 CHECKS=10265 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.718 ASSIGNMENTS=0	UNSAT TT=0.749 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.09	? (TO) TT=1800.07	No data	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.11	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.2	? (TO) TT=1800.02	UNSAT TT=792.95	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-e-1_ext.xml	UNSAT TT=0.041	UNSAT TT=0.979 CHECKS=10265 NODES=0	UNSAT TT=0.923 CHECKS=10265 NODES=0	UNSAT TT=0.174	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=0.739 ASSIGNMENTS=0	UNSAT TT=0.723 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.05	? (TO) TT=1800.02	No data	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.02	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.18	? (TO) TT=1800.09	UNSAT TT=894.724	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-7/ normalized-BlackHole-4-7-e-2_ext.xml	UNSAT TT=0.044	UNSAT TT=0.936 CHECKS=10313 NODES=0	UNSAT TT=1.002 CHECKS=10313 NODES=0	UNSAT TT=0.165	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.72 ASSIGNMENTS=0	UNSAT TT=0.736 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.055 ASSIGNMENTS=0 CHECKS=4043	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=4043	? (TO) TT=1800.01	? (TO) TT=1800.06	No data	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4043	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=4043	? (TO) TT=1800.09	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4043	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4043	? (TO) TT=1800.14	? (TO) TT=1800.11	UNSAT TT=1359.03	? (TO) TT=1800.04
csp/BH-4-7/ normalized-BlackHole-4-7-e-3_ext.xml	UNSAT TT=0.042	UNSAT TT=0.967 CHECKS=10264 NODES=0	UNSAT TT=1 CHECKS=10264 NODES=0	UNSAT TT=74.257	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.732 ASSIGNMENTS=0	UNSAT TT=0.737 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.09	? (TO) TT=1800.07	No data	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.08	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.22	? (TO) TT=1800.06	UNSAT TT=842.823	? (TO) TT=1800.07
csp/BH-4-7/ normalized-BlackHole-4-7-e-4_ext.xml	UNSAT TT=0.045	UNSAT TT=1.094 CHECKS=10312 NODES=0	UNSAT TT=0.91 CHECKS=10312 NODES=0	UNSAT TT=0.174	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.815 ASSIGNMENTS=0	UNSAT TT=0.941 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.07	? (TO) TT=1800.06	No data	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.11	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.1	? (TO) TT=1800.05	UNSAT TT=797.83	? (TO) TT=1800.09
csp/BH-4-7/ normalized-BlackHole-4-7-e-5_ext.xml	UNSAT TT=0.043	UNSAT TT=0.952 CHECKS=10264 NODES=0	UNSAT TT=0.92 CHECKS=10264 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=0.959 ASSIGNMENTS=0	UNSAT TT=0.768 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4042	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=4042	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4042	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4042	? (TO) TT=1800.1	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4042	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4042	? (TO) TT=1800.16	? (TO) TT=1800.02	UNSAT TT=1190.02	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-e-6_ext.xml	UNSAT TT=0.043	UNSAT TT=0.992 CHECKS=10264 NODES=0	UNSAT TT=0.971 CHECKS=10264 NODES=0	UNSAT TT=0.177	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.717 ASSIGNMENTS=0	UNSAT TT=0.909 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.06	? (TO) TT=1800.04	No data	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.13	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=1571.33	? (TO) TT=1800.08
csp/BH-4-7/ normalized-BlackHole-4-7-e-7_ext.xml	UNSAT TT=0.041	UNSAT TT=0.91 CHECKS=10265 NODES=0	UNSAT TT=0.933 CHECKS=10265 NODES=0	UNSAT TT=0.175	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.928 ASSIGNMENTS=0	UNSAT TT=0.943 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.05	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.14	? (TO) TT=1800.05	UNSAT TT=820.818	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-e-8_ext.xml	UNSAT TT=0.04	UNSAT TT=0.967 CHECKS=10264 NODES=0	UNSAT TT=0.917 CHECKS=10264 NODES=0	UNSAT TT=0.165	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.798 ASSIGNMENTS=0	UNSAT TT=0.75 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.05	? (TO) TT=1800.02	No data	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.1	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.14	? (TO) TT=1800.03	UNSAT TT=827.602	? (TO) TT=1800.05
csp/BH-4-7/ normalized-BlackHole-4-7-e-9_ext.xml	UNSAT TT=0.041	UNSAT TT=1.004 CHECKS=10312 NODES=0	UNSAT TT=0.912 CHECKS=10312 NODES=0	UNSAT TT=0.174	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.931 ASSIGNMENTS=0	UNSAT TT=0.939 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.09	? (TO) TT=1800.08	No data	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.03	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.19	? (TO) TT=1800.03	UNSAT TT=883.361	? (TO) TT=1800.05
csp/BH-4-7/ normalized-BlackHole-4-7-h-0_ext.xml	UNSAT TT=0.042	UNSAT TT=0.929 CHECKS=10264 NODES=0	UNSAT TT=0.923 CHECKS=10264 NODES=0	UNSAT TT=0.177	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.71 ASSIGNMENTS=0	UNSAT TT=0.781 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.11	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.17	? (TO) TT=1800.05	UNSAT TT=1692.7	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-h-1_ext.xml	UNSAT TT=0.042	UNSAT TT=1.081 CHECKS=10264 NODES=0	UNSAT TT=0.925 CHECKS=10264 NODES=0	UNSAT TT=68.847	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.802 ASSIGNMENTS=0	UNSAT TT=0.982 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.06	? (TO) TT=1800.07	No data	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.04	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.14	? (TO) TT=1800.08	UNSAT TT=690.887	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-7/ normalized-BlackHole-4-7-h-2_ext.xml	UNSAT TT=0.044	UNSAT TT=0.963 CHECKS=10265 NODES=0	UNSAT TT=1.002 CHECKS=10265 NODES=0	UNSAT TT=0.176	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=0.929 ASSIGNMENTS=0	UNSAT TT=0.95 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=4014	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4014	? (TO) TT=1800.02	? (TO) TT=1800.03	No data	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4014	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4014	? (TO) TT=1800.11	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4014	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4014	? (TO) TT=1800.17	? (TO) TT=1800.02	UNSAT TT=887.297	? (TO) TT=1800.12
csp/BH-4-7/ normalized-BlackHole-4-7-h-3_ext.xml	UNSAT TT=0.04	UNSAT TT=0.976 CHECKS=10265 NODES=0	UNSAT TT=1.078 CHECKS=10265 NODES=0	UNSAT TT=0.176	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.753 ASSIGNMENTS=0	UNSAT TT=0.774 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.05	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=960.49	? (TO) TT=1800.05
csp/BH-4-7/ normalized-BlackHole-4-7-h-4_ext.xml	UNSAT TT=0.042	UNSAT TT=0.976 CHECKS=10312 NODES=0	UNSAT TT=0.959 CHECKS=10312 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.708 ASSIGNMENTS=0	UNSAT TT=0.948 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.04	? (TO) TT=1800.08	No data	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.12	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.12	? (TO) TT=1800.06	UNSAT TT=763.982	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-h-5_ext.xml	UNSAT TT=0.045	UNSAT TT=1.003 CHECKS=10264 NODES=0	UNSAT TT=0.917 CHECKS=10264 NODES=0	UNSAT TT=0.177	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.935 ASSIGNMENTS=0	UNSAT TT=0.946 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.1	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.17	? (TO) TT=1800.08	UNSAT TT=996.538	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-h-6_ext.xml	UNSAT TT=0.041	UNSAT TT=1.065 CHECKS=10313 NODES=0	UNSAT TT=0.913 CHECKS=10313 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.945 ASSIGNMENTS=0	UNSAT TT=0.944 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3984	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3984	? (TO) TT=1800.07	? (TO) TT=1800.03	No data	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3984	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3984	? (TO) TT=1800.08	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=3984	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3984	? (TO) TT=1800.13	? (TO) TT=1800.09	UNSAT TT=831.31	? (TO) TT=1800.11
csp/BH-4-7/ normalized-BlackHole-4-7-h-7_ext.xml	UNSAT TT=0.046	UNSAT TT=1.012 CHECKS=10312 NODES=0	UNSAT TT=1.022 CHECKS=10312 NODES=0	UNSAT TT=0.164	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.707 ASSIGNMENTS=0	UNSAT TT=0.952 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.08	? (TO) TT=1800.07	No data	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.07	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=1374.78	? (TO) TT=1800.07
csp/BH-4-7/ normalized-BlackHole-4-7-h-8_ext.xml	UNSAT TT=0.045	UNSAT TT=0.982 CHECKS=10313 NODES=0	UNSAT TT=0.918 CHECKS=10313 NODES=0	UNSAT TT=0.175	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.924 ASSIGNMENTS=0	UNSAT TT=0.945 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.05	? (TO) TT=1800.02	No data	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.08	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.13	? (TO) TT=1800.05	UNSAT TT=556.01	? (TO) TT=1800.06
csp/BH-4-7/ normalized-BlackHole-4-7-h-9_ext.xml	UNSAT TT=0.043	UNSAT TT=1.108 CHECKS=10264 NODES=0	UNSAT TT=0.914 CHECKS=10264 NODES=0	UNSAT TT=74.22	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.92 ASSIGNMENTS=0	UNSAT TT=0.783 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.052 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.08	? (TO) TT=1800.09	No data	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.07	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.19	? (TO) TT=1800.09	UNSAT TT=794.336	? (TO) TT=1800.1
csp/bibd10-11/ normalized-bibd-10-120-36-3-8_glb.xml	SAT TT=21.153	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.15	No data	No data	No data	? (TO) TT=1800	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? TT=6.151	No data	SAT TT=29.399	SAT TT=21.153
csp/bibd10-11/ normalized-bibd-10-30-9-3-2_glb.xml	SAT TT=0.104	SAT TT=723.966 CHECKS=109759000 NODES=2889730	SAT TT=72.094 CHECKS=7950540 NODES=278290	SAT TT=3.29	SAT TT=15.525 CHECKS=2472780	SAT TT=19.371 CHECKS=4553240	SAT TT=39.83 ASSIGNMENTS=102877	SAT TT=37.398 ASSIGNMENTS=102877	No data	No data	No data	SAT TT=0.12 ASSIGNMENTS=272 CHECKS=21118	SAT TT=0.119 ASSIGNMENTS=272 CHECKS=21118	No data	No data	No data	SAT TT=0.106 ASSIGNMENTS=330 CHECKS=26648	? (TO) TT=1800.06	SAT TT=1.211	SAT TT=0.305 ASSIGNMENTS=3695 CHECKS=264240	SAT TT=0.104 ASSIGNMENTS=186 CHECKS=6883	? TT=3.558	No data	SAT TT=3.351	SAT TT=4.313
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd10-11/ normalized-bibd-10-60-18-3-4_glb.xml	SAT TT=0.233	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.13	SAT TT=977.381 CHECKS=96017400	? (TO) TT=1800.14	? (TO) TT=1800.11	No data	No data	No data	SAT TT=0.534 ASSIGNMENTS=6638 CHECKS=576362	SAT TT=0.497 ASSIGNMENTS=6638 CHECKS=576362	No data	No data	No data	SAT TT=0.33 ASSIGNMENTS=2533 CHECKS=232268	? (TO) TT=1800.1	SAT TT=3.246	SAT TT=8.057 ASSIGNMENTS=48223 CHECKS=4971410	SAT TT=0.233 ASSIGNMENTS=605 CHECKS=38199	? TT=4.839	No data	SAT TT=7.121	SAT TT=7.625
csp/bibd10-11/ normalized-bibd-10-90-27-3-6_glb.xml	SAT TT=0.509	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=35.836 CHECKS=2350580	? (TO) TT=1800.09	? (TO) TT=1800.12	No data	No data	No data	SAT TT=368.908 ASSIGNMENTS=3374 CHECKS=259943	SAT TT=675.111 ASSIGNMENTS=3374 CHECKS=259943	No data	No data	No data	SAT TT=2.641 ASSIGNMENTS=35752 CHECKS=3651970	SAT TT=1.158 ASSIGNMENTS=165092 CHECKS=1831780	SAT TT=613.928	SAT TT=22.16 ASSIGNMENTS=126231 CHECKS=13222700	SAT TT=0.509 ASSIGNMENTS=3374 CHECKS=259943	? TT=5.211	No data	SAT TT=13.746	SAT TT=12.49
csp/bibd10-11/ normalized-bibd-11-110-30-3-6_glb.xml	SAT TT=11.467	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.14	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.07	SAT TT=11.467 ASSIGNMENTS=395622 CHECKS=18522800	? (TO) TT=1800.06	SAT TT=1408.18 ASSIGNMENTS=4600210 CHECKS=560875000	? (TO) TT=1800.08	? TT=6.242	No data	SAT TT=149.712	SAT TT=29.065
csp/bibd10-11/ normalized-bibd-11-55-15-3-3_glb.xml	SAT TT=0.364	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	No data	No data	No data	SAT TT=0.532 ASSIGNMENTS=6640 CHECKS=495336	SAT TT=0.53 ASSIGNMENTS=6640 CHECKS=495336	No data	No data	No data	SAT TT=0.364 ASSIGNMENTS=3693 CHECKS=266337	? (TO) TT=1800.04	SAT TT=12.032	SAT TT=4.382 ASSIGNMENTS=31955 CHECKS=3649540	? (TO) TT=1800.1	? TT=4.657	No data	SAT TT=6.579	SAT TT=9.842
csp/bibd12-13/ normalized-bibd-12-132-33-3-6_glb.xml	SAT TT=29	? (TO) TT=1800.09	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.17	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	? TT=7.101	No data	SAT TT=309.765	SAT TT=29
csp/bibd12-13/ normalized-bibd-12-44-11-3-2_glb.xml	SAT TT=0.26	? (TO) TT=1800.16	SAT TT=1288.14 CHECKS=215793000 NODES=2312320	SAT TT=108.413	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	No data	No data	No data	SAT TT=0.338 ASSIGNMENTS=2621 CHECKS=194100	SAT TT=0.351 ASSIGNMENTS=2621 CHECKS=194100	No data	No data	No data	SAT TT=0.327 ASSIGNMENTS=2658 CHECKS=217704	SAT TT=30.944 ASSIGNMENTS=704301 CHECKS=81939300	SAT TT=1.957	SAT TT=4.091 ASSIGNMENTS=33798 CHECKS=3425580	SAT TT=0.26 ASSIGNMENTS=686 CHECKS=59493	? TT=4.909	No data	SAT TT=5.998	SAT TT=8.49
csp/bibd12-13/ normalized-bibd-12-88-22-3-4_glb.xml	SAT TT=10.057	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=67.423 CHECKS=4485680	? (TO) TT=1800.07	? (TO) TT=1800.12	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.04	No data	No data	No data	SAT TT=29.741 ASSIGNMENTS=354353 CHECKS=39366900	? (TO) TT=1800.09	SAT TT=10.057	SAT TT=61.92 ASSIGNMENTS=194330 CHECKS=26122000	? (TO) TT=1800.06	? TT=6.138	No data	SAT TT=28.086	SAT TT=19.531
csp/bibd12-13/ normalized-bibd-13-104-24-3-4_glb.xml	SAT TT=23.442	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=407.822 CHECKS=18513700	? (TO) TT=1800.08	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.03	? TT=6.62	No data	SAT TT=167.034	SAT TT=23.442
csp/bibd12-13/ normalized-bibd-13-26-6-3-1_glb.xml	SAT TT=0.16	SAT TT=7.836 CHECKS=392839 NODES=8814	SAT TT=199.569 CHECKS=14738900 NODES=495323	SAT TT=11.72	SAT TT=18.987 CHECKS=2453470	SAT TT=12.334 CHECKS=2490340	SAT TT=54.837 ASSIGNMENTS=84247	SAT TT=52.862 ASSIGNMENTS=84247	No data	No data	No data	SAT TT=0.183 ASSIGNMENTS=707 CHECKS=54023	SAT TT=0.183 ASSIGNMENTS=707 CHECKS=54023	No data	No data	No data	SAT TT=0.16 ASSIGNMENTS=686 CHECKS=59214	SAT TT=1303.38 ASSIGNMENTS=25891600 CHECKS=4041350000	SAT TT=1.758	SAT TT=1.417 ASSIGNMENTS=15474 CHECKS=1918200	SAT TT=0.161 ASSIGNMENTS=244 CHECKS=13099	? TT=3.957	No data	SAT TT=4.043	SAT TT=4.546
csp/bibd12-13/ normalized-bibd-13-52-12-3-2_glb.xml	SAT TT=0.938	? (TO) TT=1800.16	? (TO) TT=1800.18	SAT TT=800.117	? (TO) TT=1800.07	SAT TT=146.969 CHECKS=12437800	? (TO) TT=1800.1	? (TO) TT=1800.14	No data	No data	No data	SAT TT=0.938 ASSIGNMENTS=10516 CHECKS=1175410	SAT TT=0.938 ASSIGNMENTS=10516 CHECKS=1175410	No data	No data	No data	SAT TT=1.732 ASSIGNMENTS=24811 CHECKS=2231020	? (TO) TT=1800.04	SAT TT=2.758	SAT TT=6.46 ASSIGNMENTS=38073 CHECKS=4480870	SAT TT=590.666 ASSIGNMENTS=6738700 CHECKS=804298000	? TT=5.664	No data	SAT TT=9.305	SAT TT=10.62
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd12-13/ normalized-bibd-13-78-18-3-3_glb.xml	SAT TT=25.354	? (TO) TT=1800.18	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=61.537 CHECKS=3239740	? (TO) TT=1800.11	? (TO) TT=1800.13	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.1	No data	No data	No data	SAT TT=30.774 ASSIGNMENTS=489695 CHECKS=41055900	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=45.829 ASSIGNMENTS=161298 CHECKS=22615600	? (TO) TT=1800.05	? TT=6.272	No data	SAT TT=25.354	SAT TT=79.565
csp/bibd6/ normalized-bibd-6-100-50-3-20_glb.xml	SAT TT=0.145	SAT TT=5.682 CHECKS=46762 NODES=7452	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=60.266 CHECKS=6299730	SAT TT=76.783 CHECKS=8497670	? (TO) TT=1800.07	? (TO) TT=1800.13	No data	No data	No data	SAT TT=368.47 ASSIGNMENTS=623 CHECKS=28068	SAT TT=674.154 ASSIGNMENTS=623 CHECKS=28068	No data	No data	No data	? (TO) TT=1800.04	SAT TT=28.643 ASSIGNMENTS=781021 CHECKS=42627200	SAT TT=21.47	? (TO) TT=1800.11	SAT TT=0.145 ASSIGNMENTS=623 CHECKS=28068	? TT=3.632	No data	SAT TT=113.607	SAT TT=7.496
csp/bibd6/ normalized-bibd-6-10-5-3-2_glb.xml	SAT TT=0.017	SAT TT=1.095 CHECKS=2794 NODES=440	SAT TT=1.205 CHECKS=17312 NODES=1613	SAT TT=0.075	SAT TT=0.096 CHECKS=9868	SAT TT=0.04 CHECKS=5055	SAT TT=0.825 ASSIGNMENTS=74	SAT TT=0.886 ASSIGNMENTS=74	No data	No data	No data	SAT TT=0.03 ASSIGNMENTS=24 CHECKS=720	SAT TT=0.03 ASSIGNMENTS=24 CHECKS=720	No data	No data	No data	SAT TT=0.018 ASSIGNMENTS=24 CHECKS=720	SAT TT=0.024 ASSIGNMENTS=545 CHECKS=20936	SAT TT=0.542	SAT TT=0.019 ASSIGNMENTS=268 CHECKS=8775	SAT TT=0.017 ASSIGNMENTS=24 CHECKS=720	? TT=1.119	No data	SAT TT=1.277	SAT TT=1.284
csp/bibd6/ normalized-bibd-6-20-10-3-4_glb.xml	SAT TT=0.028	SAT TT=1.864 CHECKS=5680 NODES=832	SAT TT=2.921 CHECKS=130244 NODES=10142	SAT TT=0.429	SAT TT=0.369 CHECKS=70107	SAT TT=0.229 CHECKS=55893	SAT TT=1.735 ASSIGNMENTS=3135	SAT TT=1.542 ASSIGNMENTS=3135	No data	No data	No data	SAT TT=0.041 ASSIGNMENTS=62 CHECKS=2035	SAT TT=0.039 ASSIGNMENTS=62 CHECKS=2035	No data	No data	No data	SAT TT=0.03 ASSIGNMENTS=62 CHECKS=2035	SAT TT=0.12 ASSIGNMENTS=13120 CHECKS=283293	SAT TT=0.724	SAT TT=0.028 ASSIGNMENTS=52 CHECKS=1440	SAT TT=0.029 ASSIGNMENTS=84 CHECKS=3877	? TT=1.73	No data	SAT TT=1.514	SAT TT=1.999
csp/bibd6/ normalized-bibd-6-30-15-3-6_glb.xml	SAT TT=0.082	SAT TT=3.2 CHECKS=9898 NODES=1527	SAT TT=3.256 CHECKS=43947 NODES=5537	SAT TT=105.615	SAT TT=0.82 CHECKS=171996	SAT TT=0.611 CHECKS=137634	SAT TT=4.232 ASSIGNMENTS=20540	SAT TT=4.205 ASSIGNMENTS=20540	No data	No data	No data	SAT TT=0.284 ASSIGNMENTS=9635 CHECKS=572445	SAT TT=0.284 ASSIGNMENTS=9635 CHECKS=572445	No data	No data	No data	SAT TT=0.267 ASSIGNMENTS=9950 CHECKS=595078	SAT TT=9.563 ASSIGNMENTS=323773 CHECKS=29408500	SAT TT=0.847	SAT TT=0.082 ASSIGNMENTS=1438 CHECKS=69881	SAT TT=0.311 ASSIGNMENTS=11914 CHECKS=739122	? TT=2.077	No data	SAT TT=2.175	SAT TT=2.041
csp/bibd6/ normalized-bibd-6-40-20-3-8_glb.xml	SAT TT=0.06	SAT TT=6.187 CHECKS=10479 NODES=1748	SAT TT=448.664 CHECKS=52963300 NODES=3487080	? (TO) TT=1800.03	SAT TT=9.36 CHECKS=2057880	SAT TT=3.493 CHECKS=782573	SAT TT=3.37 ASSIGNMENTS=12310	SAT TT=3.639 ASSIGNMENTS=12310	No data	No data	No data	SAT TT=0.067 ASSIGNMENTS=272 CHECKS=15748	SAT TT=0.07 ASSIGNMENTS=272 CHECKS=15748	No data	No data	No data	SAT TT=0.06 ASSIGNMENTS=275 CHECKS=16422	SAT TT=1.052 ASSIGNMENTS=47078 CHECKS=2578880	SAT TT=1.164	SAT TT=0.232 ASSIGNMENTS=4800 CHECKS=283923	SAT TT=0.813 ASSIGNMENTS=23484 CHECKS=1867720	? TT=2.216	No data	SAT TT=2.342	SAT TT=2.707
csp/bibd6/ normalized-bibd-6-50-25-3-10_glb.xml	SAT TT=0.074	SAT TT=12.777 CHECKS=19849 NODES=3419	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=13.371 CHECKS=2692130	SAT TT=4.295 CHECKS=779543	SAT TT=2.786 ASSIGNMENTS=5051	SAT TT=2.826 ASSIGNMENTS=5051	No data	No data	No data	SAT TT=0.196 ASSIGNMENTS=2728 CHECKS=243038	SAT TT=0.193 ASSIGNMENTS=2728 CHECKS=243038	No data	No data	No data	SAT TT=0.159 ASSIGNMENTS=2728 CHECKS=243038	SAT TT=0.277 ASSIGNMENTS=33082 CHECKS=542137	SAT TT=1.047	SAT TT=1.204 ASSIGNMENTS=23249 CHECKS=1586990	SAT TT=0.074 ASSIGNMENTS=402 CHECKS=19997	? TT=2.503	No data	SAT TT=3.064	SAT TT=2.94
csp/bibd6/ normalized-bibd-6-60-30-3-12_glb.xml	SAT TT=1.132	SAT TT=20 CHECKS=16299 NODES=2887	SAT TT=18.768 CHECKS=565247 NODES=19954	? (TO) TT=1800.06	SAT TT=14.793 CHECKS=2304870	SAT TT=23.755 CHECKS=3943900	? (TO) TT=1800.12	? (TO) TT=1800.12	No data	No data	No data	SAT TT=9.959 ASSIGNMENTS=59948 CHECKS=4536220	SAT TT=360.193 ASSIGNMENTS=1832390 CHECKS=65255500	No data	No data	No data	? (TO) TT=1800.1	SAT TT=3.723 ASSIGNMENTS=104134 CHECKS=7917050	SAT TT=1.132	? (TO) TT=1800.03	SAT TT=2.191 ASSIGNMENTS=59948 CHECKS=4536220	? TT=2.834	No data	SAT TT=2.669	SAT TT=3.376
csp/bibd6/ normalized-bibd-6-70-35-3-14_glb.xml	SAT TT=0.091	SAT TT=36.01 CHECKS=18935 NODES=3157	? (TO) TT=1800.13	? (TO) TT=1800.12	SAT TT=36.904 CHECKS=5708050	SAT TT=41.456 CHECKS=6101730	SAT TT=77.36 ASSIGNMENTS=267550	SAT TT=83.456 ASSIGNMENTS=267550	No data	No data	No data	SAT TT=7.603 ASSIGNMENTS=321 CHECKS=12417	SAT TT=674.152 ASSIGNMENTS=321 CHECKS=12417	No data	No data	No data	? (TO) TT=1800.09	SAT TT=773.342 ASSIGNMENTS=13978100 CHECKS=1590520000	SAT TT=1.373	SAT TT=3.362 ASSIGNMENTS=36156 CHECKS=3103070	SAT TT=0.091 ASSIGNMENTS=321 CHECKS=12417	? TT=3.146	No data	SAT TT=3.161	SAT TT=4.336
csp/bibd6/ normalized-bibd-6-80-40-3-16_glb.xml	SAT TT=0.105	SAT TT=4.149 CHECKS=26033 NODES=4524	? (TO) TT=1800.17	? (TO) TT=1800.05	SAT TT=11.218 CHECKS=1367770	SAT TT=45.7 CHECKS=6134450	? (TO) TT=1800.09	? (TO) TT=1800.08	No data	No data	No data	SAT TT=367.771 ASSIGNMENTS=286 CHECKS=10490	SAT TT=673.67 ASSIGNMENTS=286 CHECKS=10490	No data	No data	No data	SAT TT=256.839 ASSIGNMENTS=10116200 CHECKS=440831000	SAT TT=14.713 ASSIGNMENTS=340188 CHECKS=24217700	SAT TT=2.407	SAT TT=2.767 ASSIGNMENTS=30151 CHECKS=2745450	SAT TT=0.105 ASSIGNMENTS=286 CHECKS=10490	? TT=3.059	No data	SAT TT=7.464	SAT TT=5.607
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd6/ normalized-bibd-6-90-45-3-18_glb.xml	SAT TT=1.295	SAT TT=4.099 CHECKS=16396 NODES=3777	SAT TT=676.199 CHECKS=85573200 NODES=1415260	? (TO) TT=1800.09	SAT TT=105.604 CHECKS=12362100	SAT TT=182.167 CHECKS=21784700	? (TO) TT=1800.13	? (TO) TT=1800.11	No data	No data	No data	SAT TT=369.213 ASSIGNMENTS=15562 CHECKS=1716710	SAT TT=675.973 ASSIGNMENTS=15562 CHECKS=1716710	No data	No data	No data	? (TO) TT=1800.11	SAT TT=90.771 ASSIGNMENTS=1259360 CHECKS=141450000	SAT TT=5.814	? (TO) TT=1800.1	SAT TT=1.295 ASSIGNMENTS=15562 CHECKS=1716710	? TT=3.674	No data	SAT TT=48.7	SAT TT=5.721
csp/bibd7/ normalized-bibd-7-07-3-3-1_glb.xml	SAT TT=0.016	SAT TT=1.047 CHECKS=1719 NODES=233	SAT TT=1.091 CHECKS=2464 NODES=216	SAT TT=0.071	SAT TT=0.083 CHECKS=3577	SAT TT=0.047 CHECKS=8159	SAT TT=0.881 ASSIGNMENTS=29	SAT TT=0.824 ASSIGNMENTS=29	No data	No data	No data	SAT TT=0.03 ASSIGNMENTS=23 CHECKS=911	SAT TT=0.028 ASSIGNMENTS=23 CHECKS=911	No data	No data	No data	SAT TT=0.016 ASSIGNMENTS=23 CHECKS=911	SAT TT=0.019 ASSIGNMENTS=111 CHECKS=4968	SAT TT=0.622	SAT TT=0.019 ASSIGNMENTS=69 CHECKS=2031	SAT TT=0.016 ASSIGNMENTS=23 CHECKS=939	? TT=1.2	No data	SAT TT=1.447	SAT TT=1.195
csp/bibd7/ normalized-bibd-7-14-6-3-2_glb.xml	SAT TT=0.026	SAT TT=1.516 CHECKS=32569 NODES=1640	SAT TT=1.671 CHECKS=39651 NODES=2182	SAT TT=0.128	SAT TT=0.3 CHECKS=61353	SAT TT=0.172 CHECKS=48698	SAT TT=1.143 ASSIGNMENTS=325	SAT TT=1.177 ASSIGNMENTS=325	No data	No data	No data	SAT TT=0.038 ASSIGNMENTS=53 CHECKS=2300	SAT TT=0.038 ASSIGNMENTS=53 CHECKS=2300	No data	No data	No data	SAT TT=0.027 ASSIGNMENTS=51 CHECKS=2299	SAT TT=0.026 ASSIGNMENTS=68 CHECKS=1372	SAT TT=0.712	SAT TT=0.03 ASSIGNMENTS=110 CHECKS=3128	SAT TT=0.03 ASSIGNMENTS=171 CHECKS=12297	? TT=1.694	No data	SAT TT=1.52	SAT TT=1.66
csp/bibd7/ normalized-bibd-7-21-9-3-3_glb.xml	SAT TT=0.035	SAT TT=2.131 CHECKS=57506 NODES=3420	SAT TT=2.307 CHECKS=99781 NODES=5313	SAT TT=0.469	SAT TT=0.674 CHECKS=155722	SAT TT=0.452 CHECKS=115293	SAT TT=1.455 ASSIGNMENTS=1058	SAT TT=1.37 ASSIGNMENTS=1058	No data	No data	No data	SAT TT=0.058 ASSIGNMENTS=417 CHECKS=15349	SAT TT=0.057 ASSIGNMENTS=417 CHECKS=15349	No data	No data	No data	SAT TT=0.088 ASSIGNMENTS=3788 CHECKS=146645	SAT TT=0.312 ASSIGNMENTS=25419 CHECKS=907503	SAT TT=1.074	SAT TT=0.069 ASSIGNMENTS=1345 CHECKS=59358	SAT TT=0.035 ASSIGNMENTS=80 CHECKS=2836	? TT=1.909	No data	SAT TT=1.687	SAT TT=1.833
csp/bibd7/ normalized-bibd-7-28-12-3-4_glb.xml	SAT TT=0.048	SAT TT=2.814 CHECKS=34640 NODES=4038	SAT TT=28.574 CHECKS=4774700 NODES=169506	SAT TT=10.583	SAT TT=1.176 CHECKS=226301	SAT TT=0.745 CHECKS=188058	SAT TT=1.893 ASSIGNMENTS=1115	SAT TT=1.663 ASSIGNMENTS=1115	No data	No data	No data	SAT TT=0.996 ASSIGNMENTS=62169 CHECKS=2205400	SAT TT=1.085 ASSIGNMENTS=62169 CHECKS=2205400	No data	No data	No data	SAT TT=1.017 ASSIGNMENTS=62594 CHECKS=2345940	? (TO) TT=1800.02	SAT TT=1.055	SAT TT=0.2 ASSIGNMENTS=3968 CHECKS=305085	SAT TT=0.048 ASSIGNMENTS=98 CHECKS=2972	? TT=2.349	No data	SAT TT=2.28	SAT TT=2.216
csp/bibd7/ normalized-bibd-7-35-15-3-5_glb.xml	SAT TT=0.062	SAT TT=311.658 CHECKS=77787000 NODES=1115990	SAT TT=11.648 CHECKS=2419940 NODES=30363	SAT TT=424.115	SAT TT=1.435 CHECKS=237386	SAT TT=2.4 CHECKS=624761	SAT TT=1.817 ASSIGNMENTS=1173	SAT TT=1.727 ASSIGNMENTS=1173	No data	No data	No data	SAT TT=7.116 ASSIGNMENTS=294 CHECKS=17010	SAT TT=7.94 ASSIGNMENTS=294 CHECKS=17010	No data	No data	No data	SAT TT=15.976 ASSIGNMENTS=877418 CHECKS=37314900	? (TO) TT=1800	SAT TT=1.179	SAT TT=0.304 ASSIGNMENTS=5621 CHECKS=388512	SAT TT=0.062 ASSIGNMENTS=294 CHECKS=17010	? TT=2.499	No data	SAT TT=2.196	SAT TT=2.419
csp/bibd7/ normalized-bibd-7-42-18-3-6_glb.xml	SAT TT=1.002	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.06	SAT TT=9.224 CHECKS=2070440	SAT TT=1.186 CHECKS=212203	SAT TT=2.04 ASSIGNMENTS=1228	SAT TT=1.944 ASSIGNMENTS=1228	No data	No data	No data	SAT TT=11.361 ASSIGNMENTS=103369 CHECKS=7276900	SAT TT=10.469 ASSIGNMENTS=103369 CHECKS=7276900	No data	No data	No data	SAT TT=72.958 ASSIGNMENTS=3188800 CHECKS=162715000	? (TO) TT=1800.07	SAT TT=1.002	SAT TT=1.65 ASSIGNMENTS=28568 CHECKS=1917350	SAT TT=3.396 ASSIGNMENTS=103369 CHECKS=7276900	? TT=2.97	No data	SAT TT=2.896	SAT TT=3.034
csp/bibd7/ normalized-bibd-7-49-21-3-7_glb.xml	SAT TT=0.393	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.03	SAT TT=26.21 CHECKS=4502970	SAT TT=1.724 CHECKS=313068	SAT TT=2.185 ASSIGNMENTS=1274	SAT TT=2.532 ASSIGNMENTS=1274	No data	No data	No data	SAT TT=8.109 ASSIGNMENTS=7900 CHECKS=675074	SAT TT=12.403 ASSIGNMENTS=1778 CHECKS=9354	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=1.313	SAT TT=0.548 ASSIGNMENTS=6979 CHECKS=515398	SAT TT=0.393 ASSIGNMENTS=7900 CHECKS=675074	? TT=3.182	No data	SAT TT=3.794	SAT TT=3.425
csp/bibd7/ normalized-bibd-7-56-24-3-8_glb.xml	SAT TT=0.152	SAT TT=22.952 CHECKS=3998430 NODES=55162	? (TO) TT=1800.15	? (TO) TT=1800.11	SAT TT=27.427 CHECKS=3470550	SAT TT=2.265 CHECKS=330601	SAT TT=3.08 ASSIGNMENTS=1318	SAT TT=2.833 ASSIGNMENTS=1318	No data	No data	No data	SAT TT=7.647 ASSIGNMENTS=1592 CHECKS=106704	SAT TT=8.854 ASSIGNMENTS=2022 CHECKS=10479	No data	No data	No data	? (TO) TT=1800.01	SAT TT=1.385 ASSIGNMENTS=85591 CHECKS=2681420	SAT TT=1.4	SAT TT=52.764 ASSIGNMENTS=799256 CHECKS=56559600	SAT TT=0.152 ASSIGNMENTS=1592 CHECKS=106704	? TT=2.987	No data	SAT TT=3.344	SAT TT=3.754
csp/bibd7/ normalized-bibd-7-63-27-3-9_glb.xml	SAT TT=0.13	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=18.197 CHECKS=2478930	SAT TT=3.259 CHECKS=450309	SAT TT=3.128 ASSIGNMENTS=1364	SAT TT=3.367 ASSIGNMENTS=1364	No data	No data	No data	SAT TT=7.122 ASSIGNMENTS=740 CHECKS=53457	SAT TT=8.937 ASSIGNMENTS=2229 CHECKS=11599	No data	No data	No data	SAT TT=322.356 ASSIGNMENTS=7978280 CHECKS=654406000	SAT TT=1210.53 ASSIGNMENTS=28155400 CHECKS=2866900000	SAT TT=1.255	SAT TT=2.465 ASSIGNMENTS=27536 CHECKS=2020620	SAT TT=0.13 ASSIGNMENTS=740 CHECKS=53457	? TT=3.586	No data	SAT TT=4.527	SAT TT=4.409
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd7/ normalized-bibd-7-70-30-3-10_glb.xml	SAT TT=1.243	? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.1	SAT TT=30.246 CHECKS=3472150	SAT TT=3.489 CHECKS=463738	SAT TT=3.112 ASSIGNMENTS=1408	SAT TT=3.363 ASSIGNMENTS=1408	No data	No data	No data	SAT TT=9.083 ASSIGNMENTS=2469 CHECKS=12814	SAT TT=10.085 ASSIGNMENTS=2469 CHECKS=12814	No data	No data	No data	SAT TT=10.877 ASSIGNMENTS=297389 CHECKS=21473500	SAT TT=40.549 ASSIGNMENTS=1098250 CHECKS=84972500	SAT TT=1.243	SAT TT=29.125 ASSIGNMENTS=302858 CHECKS=26035900	SAT TT=8.348 ASSIGNMENTS=171688 CHECKS=15588600	? TT=3.512	No data	SAT TT=953.226	SAT TT=5.469
csp/bibd7/ normalized-bibd-7-77-33-3-11_glb.xml	SAT TT=0.913	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=32.223 CHECKS=3143010	SAT TT=40.138 CHECKS=4402440	SAT TT=4.188 ASSIGNMENTS=1454	SAT TT=3.623 ASSIGNMENTS=1454	No data	No data	No data	SAT TT=9.446 ASSIGNMENTS=2709 CHECKS=14006	SAT TT=10.065 ASSIGNMENTS=2709 CHECKS=14006	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=1.624	? (TO) TT=1800.07	SAT TT=0.913 ASSIGNMENTS=15815 CHECKS=1208930	? TT=3.729	No data	SAT TT=6.041	SAT TT=5.425
csp/bibd7/ normalized-bibd-7-84-36-3-12_glb.xml	SAT TT=0.227	? (TO) TT=1800.15	SAT TT=1499.78 CHECKS=199945000 NODES=2220580	? (TO) TT=1800.06	SAT TT=16.726 CHECKS=1428580	SAT TT=39.286 CHECKS=5013330	SAT TT=4.002 ASSIGNMENTS=1496	SAT TT=3.994 ASSIGNMENTS=1496	No data	No data	No data	SAT TT=9.748 ASSIGNMENTS=2949 CHECKS=15196	SAT TT=9.507 ASSIGNMENTS=2949 CHECKS=15196	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=1.704	SAT TT=1163.06 ASSIGNMENTS=10205300 CHECKS=910157000	SAT TT=0.227 ASSIGNMENTS=1643 CHECKS=117182	? TT=3.843	No data	SAT TT=10.634	SAT TT=8.065
csp/bibd7/ normalized-bibd-7-91-39-3-13_glb.xml	SAT TT=0.213	? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.05	SAT TT=33.643 CHECKS=3294560	SAT TT=40.129 CHECKS=3631280	SAT TT=3.973 ASSIGNMENTS=1542	SAT TT=4.227 ASSIGNMENTS=1542	No data	No data	No data	SAT TT=9.362 ASSIGNMENTS=3188 CHECKS=16384	SAT TT=10.12 ASSIGNMENTS=3188 CHECKS=16384	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=1.523	? (TO) TT=1800.08	SAT TT=0.213 ASSIGNMENTS=1294 CHECKS=106767	? TT=4.027	No data	SAT TT=10.716	SAT TT=7.125
csp/bibd7/ normalized-bibd-7-98-42-3-14_glb.xml	SAT TT=0.272	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=43.78 CHECKS=4800760	SAT TT=5.056 ASSIGNMENTS=1588	SAT TT=4.674 ASSIGNMENTS=1588	No data	No data	No data	SAT TT=10.294 ASSIGNMENTS=3370 CHECKS=17483	SAT TT=10.14 ASSIGNMENTS=3370 CHECKS=17483	No data	No data	No data	? (TO) TT=1800.02	SAT TT=174.78 ASSIGNMENTS=3104970 CHECKS=324341000	SAT TT=1.814	SAT TT=9.232 ASSIGNMENTS=76148 CHECKS=7817730	SAT TT=0.272 ASSIGNMENTS=2664 CHECKS=139611	? TT=4.091	No data	SAT TT=6.654	SAT TT=8.16
csp/bibd8/ normalized-bibd-8-14-7-4-3_glb.xml	SAT TT=0.046	SAT TT=1.578 CHECKS=29418 NODES=1633	SAT TT=2.957 CHECKS=10438 NODES=761	SAT TT=0.165	SAT TT=0.635 CHECKS=156588	SAT TT=0.454 CHECKS=151413	SAT TT=1.476 ASSIGNMENTS=665	SAT TT=1.199 ASSIGNMENTS=665	No data	No data	No data	SAT TT=0.06 ASSIGNMENTS=336 CHECKS=41465	SAT TT=0.061 ASSIGNMENTS=336 CHECKS=41465	No data	No data	No data	SAT TT=0.046 ASSIGNMENTS=331 CHECKS=35214	SAT TT=21.917 ASSIGNMENTS=761594 CHECKS=74014000	SAT TT=0.747	SAT TT=0.073 ASSIGNMENTS=1017 CHECKS=85432	SAT TT=0.051 ASSIGNMENTS=626 CHECKS=63104	? TT=1.763	No data	SAT TT=1.604	SAT TT=1.946
csp/bibd8/ normalized-bibd-8-28-14-4-6_glb.xml	SAT TT=0.071	SAT TT=3.546 CHECKS=105912 NODES=4399	? (TO) TT=1800.09	SAT TT=29.635	? (TO) TT=1800.09	SAT TT=55.44 CHECKS=14017800	SAT TT=5.863 ASSIGNMENTS=16673	SAT TT=5.759 ASSIGNMENTS=16673	No data	No data	No data	SAT TT=1.471 ASSIGNMENTS=41974 CHECKS=3519580	SAT TT=1.466 ASSIGNMENTS=41974 CHECKS=3519580	No data	No data	No data	SAT TT=2.152 ASSIGNMENTS=56543 CHECKS=5610440	? (TO) TT=1800.04	SAT TT=1.36	SAT TT=0.155 ASSIGNMENTS=2045 CHECKS=145907	SAT TT=0.071 ASSIGNMENTS=227 CHECKS=20992	? TT=2.509	No data	SAT TT=2.514	SAT TT=2.917
csp/bibd8/ normalized-bibd-8-42-21-4-9_glb.xml	SAT TT=0.156	SAT TT=114.529 CHECKS=21583500 NODES=321610	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.11	No data	No data	No data	SAT TT=7.754 ASSIGNMENTS=1654 CHECKS=144137	SAT TT=7.749 ASSIGNMENTS=1654 CHECKS=144137	No data	No data	No data	SAT TT=334.851 ASSIGNMENTS=8429860 CHECKS=762093000	? (TO) TT=1800.03	SAT TT=105.003	SAT TT=9.872 ASSIGNMENTS=127888 CHECKS=10155000	SAT TT=0.156 ASSIGNMENTS=1654 CHECKS=144137	? TT=2.955	No data	SAT TT=3.763	SAT TT=5.361
csp/bibd8/ normalized-bibd-8-56-28-4-12_glb.xml	SAT TT=3.384	SAT TT=8.316 CHECKS=318842 NODES=18791	? (TO) TT=1800.17	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.11	No data	No data	No data	SAT TT=11.106 ASSIGNMENTS=59651 CHECKS=7118020	SAT TT=677.581 ASSIGNMENTS=59651 CHECKS=7118020	No data	No data	No data	? (TO) TT=1800.06	SAT TT=99.462 ASSIGNMENTS=2520650 CHECKS=221254000	? (TO) TT=1800.11	SAT TT=47.54 ASSIGNMENTS=279777 CHECKS=25351600	SAT TT=3.384 ASSIGNMENTS=59651 CHECKS=7118020	? TT=3.946	No data	SAT TT=10.36	SAT TT=6.124
csp/bibd8/ normalized-bibd-8-70-35-4-15_glb.xml	SAT TT=0.334	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07	No data	No data	No data	SAT TT=295.907 ASSIGNMENTS=3522 CHECKS=367591	SAT TT=674.364 ASSIGNMENTS=3522 CHECKS=367591	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=1302.61 ASSIGNMENTS=9685250 CHECKS=985236000	SAT TT=0.334 ASSIGNMENTS=3522 CHECKS=367591	? TT=4.399	No data	SAT TT=232.861	SAT TT=17.66
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd8/ normalized-bibd-8-84-42-4-18_glb.xml	SAT TT=14.725	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.14	No data	No data	No data	SAT TT=500.797 ASSIGNMENTS=1303030 CHECKS=222039000	SAT TT=792.696 ASSIGNMENTS=1303030 CHECKS=222039000	No data	No data	No data	? (TO) TT=1800.01	SAT TT=806.14 ASSIGNMENTS=13590100 CHECKS=1386400000	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=118.781 ASSIGNMENTS=1303030 CHECKS=222039000	? TT=4.411	No data	SAT TT=520.019	SAT TT=14.725
csp/bibd8/ normalized-bibd-8-98-49-4-21_glb.xml	SAT TT=34.245	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=4.841	No data	? (TO) TT=1800.06	SAT TT=34.245
csp/bibd9/ normalized-bibd-9-108-36-3-9_glb.xml	SAT TT=14.398	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=291.811 CHECKS=22342100	? (TO) TT=1800.11	SAT TT=22.891 ASSIGNMENTS=13222	SAT TT=23.559 ASSIGNMENTS=13222	No data	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.02	SAT TT=14.398 ASSIGNMENTS=334519 CHECKS=27771600	? (TO) TT=1800.09	SAT TT=1588.93 ASSIGNMENTS=7647320 CHECKS=700686000	? (TO) TT=1800.04	? TT=5.483	No data	SAT TT=167.193	SAT TT=30.128
csp/bibd9/ normalized-bibd-9-120-40-3-10_glb.xml	SAT TT=0.871	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.14	No data	No data	No data	SAT TT=368.595 ASSIGNMENTS=7085 CHECKS=530573	SAT TT=675.34 ASSIGNMENTS=7085 CHECKS=530573	No data	No data	No data	? (TO) TT=1800.07	SAT TT=99.973 ASSIGNMENTS=1586200 CHECKS=158553000	? (TO) TT=1800.12	? (TO) TT=1800.04	SAT TT=0.871 ASSIGNMENTS=7085 CHECKS=530573	? TT=5.349	No data	SAT TT=115.747	SAT TT=45.02
csp/bibd9/ normalized-bibd-9-12-4-3-1_glb.xml	SAT TT=0.037	SAT TT=2.348 CHECKS=11964 NODES=821	SAT TT=2.191 CHECKS=32263 NODES=1906	SAT TT=0.158	SAT TT=0.631 CHECKS=190577	SAT TT=0.477 CHECKS=167456	SAT TT=1.307 ASSIGNMENTS=115	SAT TT=1.456 ASSIGNMENTS=115	No data	No data	No data	SAT TT=0.045 ASSIGNMENTS=58 CHECKS=2378	SAT TT=0.048 ASSIGNMENTS=58 CHECKS=2378	No data	No data	No data	SAT TT=0.037 ASSIGNMENTS=58 CHECKS=2378	SAT TT=0.169 ASSIGNMENTS=14335 CHECKS=423238	SAT TT=0.933	SAT TT=0.037 ASSIGNMENTS=150 CHECKS=8323	SAT TT=0.038 ASSIGNMENTS=69 CHECKS=4002	? TT=1.957	No data	SAT TT=1.715	SAT TT=2.189
csp/bibd9/ normalized-bibd-9-24-8-3-2_glb.xml	SAT TT=0.07	SAT TT=2.712 CHECKS=74694 NODES=2952	SAT TT=2.801 CHECKS=66623 NODES=3702	SAT TT=0.671	SAT TT=6.911 CHECKS=1617110	SAT TT=1.283 CHECKS=341177	SAT TT=2.741 ASSIGNMENTS=4025	SAT TT=2.778 ASSIGNMENTS=4025	No data	No data	No data	SAT TT=0.084 ASSIGNMENTS=308 CHECKS=18117	SAT TT=0.079 ASSIGNMENTS=308 CHECKS=18117	No data	No data	No data	SAT TT=0.07 ASSIGNMENTS=243 CHECKS=13195	SAT TT=214.547 ASSIGNMENTS=6643700 CHECKS=727034000	SAT TT=0.999	SAT TT=0.152 ASSIGNMENTS=2309 CHECKS=133863	SAT TT=0.076 ASSIGNMENTS=262 CHECKS=21306	? TT=2.937	No data	SAT TT=2.489	SAT TT=2.766
csp/bibd9/ normalized-bibd-9-36-12-3-3_glb.xml	SAT TT=0.106	? (TO) TT=1800.16	SAT TT=5.571 CHECKS=339061 NODES=11710	SAT TT=233.001	SAT TT=41.459 CHECKS=6901980	SAT TT=54.671 CHECKS=10793900	SAT TT=130.377 ASSIGNMENTS=356835	SAT TT=115.796 ASSIGNMENTS=356835	No data	No data	No data	SAT TT=0.12 ASSIGNMENTS=420 CHECKS=26450	SAT TT=0.12 ASSIGNMENTS=420 CHECKS=26450	No data	No data	No data	SAT TT=0.106 ASSIGNMENTS=375 CHECKS=19837	? (TO) TT=1800.06	SAT TT=268.519	SAT TT=0.579 ASSIGNMENTS=5796 CHECKS=452272	SAT TT=0.795 ASSIGNMENTS=16527 CHECKS=1751210	? TT=3.375	No data	SAT TT=3.71	SAT TT=3.952
csp/bibd9/ normalized-bibd-9-48-16-3-4_glb.xml	SAT TT=0.15	? (TO) TT=1800.07	SAT TT=565.36 CHECKS=69659400 NODES=1518290	? (TO) TT=1800.07	SAT TT=45.564 CHECKS=5967360	SAT TT=66.57 CHECKS=10584200	SAT TT=60.627 ASSIGNMENTS=134470	SAT TT=56.191 ASSIGNMENTS=134470	No data	No data	No data	SAT TT=22.253 ASSIGNMENTS=294382 CHECKS=26675700	SAT TT=202.702 ASSIGNMENTS=866829 CHECKS=21414100	No data	No data	No data	SAT TT=0.15 ASSIGNMENTS=564 CHECKS=33303	SAT TT=0.394 ASSIGNMENTS=70345 CHECKS=771266	SAT TT=2.522	SAT TT=1.479 ASSIGNMENTS=15704 CHECKS=1252640	SAT TT=14.732 ASSIGNMENTS=294382 CHECKS=26675700	? TT=4.133	No data	SAT TT=3.933	SAT TT=4.986
csp/bibd9/ normalized-bibd-9-60-20-3-5_glb.xml	SAT TT=1.151	SAT TT=7.73 CHECKS=135085 NODES=8870	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=10.653 ASSIGNMENTS=5569	SAT TT=8.909 ASSIGNMENTS=5569	No data	No data	No data	SAT TT=163.225 ASSIGNMENTS=2484140 CHECKS=241989000	SAT TT=127.187 ASSIGNMENTS=437888 CHECKS=11860600	No data	No data	No data	SAT TT=39.873 ASSIGNMENTS=711468 CHECKS=71066000	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=1.151 ASSIGNMENTS=7762 CHECKS=767877	SAT TT=144.648 ASSIGNMENTS=2484140 CHECKS=241989000	? TT=4.198	No data	SAT TT=4.192	SAT TT=6.504
csp/bibd9/ normalized-bibd-9-72-24-3-6_glb.xml	SAT TT=6.305	SAT TT=1302.45 CHECKS=218612000 NODES=1459850	? (TO) TT=1800.16	? (TO) TT=1800.06	SAT TT=52 CHECKS=5525590	? (TO) TT=1800.08	SAT TT=12.21 ASSIGNMENTS=11878	SAT TT=11.478 ASSIGNMENTS=11878	No data	No data	No data	SAT TT=311.361 ASSIGNMENTS=240509 CHECKS=25565200	SAT TT=691.011 ASSIGNMENTS=240509 CHECKS=25565200	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=1077.09	SAT TT=22.735 ASSIGNMENTS=143663 CHECKS=16548800	SAT TT=15.905 ASSIGNMENTS=240509 CHECKS=25565200	? TT=4.444	No data	SAT TT=6.305	SAT TT=8.582
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd9/ normalized-bibd-9-84-28-3-7_glb.xml	SAT TT=1.794	SAT TT=112.244 CHECKS=9809070 NODES=156280	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=13.793 ASSIGNMENTS=6301	SAT TT=13.592 ASSIGNMENTS=6301	No data	No data	No data	SAT TT=382.144 ASSIGNMENTS=208582 CHECKS=19630600	SAT TT=686.701 ASSIGNMENTS=208582 CHECKS=19630600	No data	No data	No data	SAT TT=1.794 ASSIGNMENTS=26304 CHECKS=2289120	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=298.891 ASSIGNMENTS=1870190 CHECKS=175327000	SAT TT=12.92 ASSIGNMENTS=208582 CHECKS=19630600	? TT=4.936	No data	SAT TT=9.769	SAT TT=9.569
csp/bibd9/ normalized-bibd-9-96-32-3-8_glb.xml	SAT TT=0.406	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.09	SAT TT=359.146 CHECKS=20042200	SAT TT=1300.31 CHECKS=133010000	SAT TT=30.167 ASSIGNMENTS=14183	SAT TT=30.303 ASSIGNMENTS=14183	No data	No data	No data	SAT TT=368.575 ASSIGNMENTS=2562 CHECKS=126677	SAT TT=676.529 ASSIGNMENTS=2562 CHECKS=126677	No data	No data	No data	? (TO) TT=1800.11	SAT TT=69.628 ASSIGNMENTS=978404 CHECKS=121245000	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=0.406 ASSIGNMENTS=2562 CHECKS=126677	? TT=5.624	No data	SAT TT=32.364	SAT TT=12.968
csp/bibdVariousK/ normalized-bibd-10-15-6-4-2_glb.xml	SAT TT=0.055	SAT TT=8.371 CHECKS=1071520 NODES=45275	SAT TT=2.44 CHECKS=98265 NODES=2725	SAT TT=0.341	SAT TT=3.696 CHECKS=1060730	SAT TT=0.907 CHECKS=293522	SAT TT=1.905 ASSIGNMENTS=2103	SAT TT=2.143 ASSIGNMENTS=2103	No data	No data	No data	SAT TT=0.065 ASSIGNMENTS=116 CHECKS=8968	SAT TT=0.067 ASSIGNMENTS=116 CHECKS=8968	No data	No data	No data	SAT TT=0.055 ASSIGNMENTS=144 CHECKS=11869	SAT TT=28.382 ASSIGNMENTS=906311 CHECKS=91250100	SAT TT=1.226	SAT TT=0.061 ASSIGNMENTS=294 CHECKS=14109	SAT TT=0.095 ASSIGNMENTS=1078 CHECKS=123262	? TT=2.434	No data	SAT TT=2.215	SAT TT=2.763
csp/bibdVariousK/ normalized-bibd-10-18-9-5-4_glb.xml	SAT TT=0.078	SAT TT=45.947 CHECKS=6929210 NODES=262761	SAT TT=29.861 CHECKS=5683630 NODES=155132	SAT TT=0.525	SAT TT=1.64 CHECKS=302509	SAT TT=152.915 CHECKS=48281600	SAT TT=6.145 ASSIGNMENTS=21703	SAT TT=6.391 ASSIGNMENTS=21703	No data	No data	No data	SAT TT=0.079 ASSIGNMENTS=383 CHECKS=32136	SAT TT=0.085 ASSIGNMENTS=383 CHECKS=32136	No data	No data	No data	SAT TT=0.078 ASSIGNMENTS=511 CHECKS=43639	? (TO) TT=1800.05	SAT TT=0.996	SAT TT=0.268 ASSIGNMENTS=3522 CHECKS=317321	SAT TT=0.219 ASSIGNMENTS=4745 CHECKS=426734	? TT=2.752	No data	SAT TT=2.763	SAT TT=2.93
csp/bibdVariousK/ normalized-bibd-11-11-5-5-2_glb.xml	SAT TT=0.049	SAT TT=1.926 CHECKS=33309 NODES=1311	SAT TT=2.482 CHECKS=47962 NODES=2196	SAT TT=0.2	SAT TT=0.81 CHECKS=186374	SAT TT=0.467 CHECKS=153862	SAT TT=1.377 ASSIGNMENTS=165	SAT TT=1.353 ASSIGNMENTS=165	No data	No data	No data	SAT TT=0.061 ASSIGNMENTS=54 CHECKS=4969	SAT TT=0.06 ASSIGNMENTS=54 CHECKS=4969	No data	No data	No data	SAT TT=0.049 ASSIGNMENTS=61 CHECKS=5277	SAT TT=0.465 ASSIGNMENTS=22610 CHECKS=1355340	SAT TT=1.112	SAT TT=0.078 ASSIGNMENTS=772 CHECKS=46017	SAT TT=0.053 ASSIGNMENTS=129 CHECKS=16455	? TT=2.338	No data	SAT TT=2.047	SAT TT=2.456
csp/bibdVariousK/ normalized-bibd-11-22-10-5-4_glb.xml	SAT TT=0.319	SAT TT=798.467 CHECKS=125798000 NODES=3344730	SAT TT=7.627 CHECKS=1448000 NODES=15589	SAT TT=1.692	? (TO) TT=1800.11	? (TO) TT=1800.06	SAT TT=30.544 ASSIGNMENTS=104280	SAT TT=29.054 ASSIGNMENTS=104280	No data	No data	No data	SAT TT=0.327 ASSIGNMENTS=6037 CHECKS=565287	SAT TT=0.319 ASSIGNMENTS=6037 CHECKS=565287	No data	No data	No data	SAT TT=1.353 ASSIGNMENTS=35789 CHECKS=3429870	? (TO) TT=1800.03	SAT TT=1.261	SAT TT=0.417 ASSIGNMENTS=4561 CHECKS=487995	SAT TT=0.499 ASSIGNMENTS=11252 CHECKS=1055430	? TT=2.988	No data	SAT TT=2.673	SAT TT=4.733
csp/bibdVariousK/ normalized-bibd-12-22-11-6-5_glb.xml	SAT TT=0.171	SAT TT=408.848 CHECKS=52060500 NODES=1540310	? (TO) TT=1800.13	SAT TT=2.737	SAT TT=20.694 CHECKS=2300710	SAT TT=19.967 CHECKS=4242880	SAT TT=47.569 ASSIGNMENTS=108490	SAT TT=53.18 ASSIGNMENTS=108490	No data	No data	No data	SAT TT=8.219 ASSIGNMENTS=1869 CHECKS=199414	SAT TT=8.135 ASSIGNMENTS=1869 CHECKS=199414	No data	No data	No data	SAT TT=40.452 ASSIGNMENTS=885487 CHECKS=108857000	? (TO) TT=1800.05	SAT TT=5.101	SAT TT=0.934 ASSIGNMENTS=10043 CHECKS=1199410	SAT TT=0.171 ASSIGNMENTS=1869 CHECKS=199414	? TT=3.347	No data	SAT TT=7.042	SAT TT=10.59
csp/bibdVariousK/ normalized-bibd-13-13-4-4-1_glb.xml	SAT TT=0.078	SAT TT=2.393 CHECKS=36768 NODES=1746	SAT TT=5.405 CHECKS=179926 NODES=12686	SAT TT=0.346	SAT TT=4.909 CHECKS=1398930	SAT TT=2.897 CHECKS=979719	SAT TT=2.147 ASSIGNMENTS=215	SAT TT=1.716 ASSIGNMENTS=215	No data	No data	No data	SAT TT=0.087 ASSIGNMENTS=82 CHECKS=5407	SAT TT=0.087 ASSIGNMENTS=82 CHECKS=5407	No data	No data	No data	SAT TT=0.078 ASSIGNMENTS=82 CHECKS=5407	SAT TT=0.367 ASSIGNMENTS=30505 CHECKS=935746	SAT TT=1.002	SAT TT=0.083 ASSIGNMENTS=161 CHECKS=7200	SAT TT=0.079 ASSIGNMENTS=109 CHECKS=13780	? TT=2.89	No data	SAT TT=2.765	SAT TT=3.121
csp/bibdVariousK/ normalized-bibd-13-26-8-4-2_glb.xml	SAT TT=0.431	SAT TT=7.704 CHECKS=564591 NODES=8297	SAT TT=115.002 CHECKS=14535800 NODES=263626	SAT TT=1.216	SAT TT=12.2 CHECKS=1110670	SAT TT=5.237 CHECKS=943043	SAT TT=5.065 ASSIGNMENTS=1999	SAT TT=5.122 ASSIGNMENTS=1999	No data	No data	No data	SAT TT=0.537 ASSIGNMENTS=6358 CHECKS=949515	SAT TT=0.54 ASSIGNMENTS=6358 CHECKS=949515	No data	No data	No data	SAT TT=0.525 ASSIGNMENTS=6710 CHECKS=961162	? (TO) TT=1800.1	SAT TT=1.457	SAT TT=1.343 ASSIGNMENTS=11961 CHECKS=1820670	SAT TT=0.431 ASSIGNMENTS=4204 CHECKS=631910	? TT=4.179	No data	SAT TT=4.261	SAT TT=7.075
csp/bibdVariousK/ normalized-bibd-14-26-13-7-6_glb.xml	SAT TT=26.222	? (TO) TT=1800.16	? (TO) TT=1800.04	SAT TT=26.222	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.1	No data	No data	No data	SAT TT=74.611 ASSIGNMENTS=1137880 CHECKS=170945000	SAT TT=74.915 ASSIGNMENTS=1137880 CHECKS=170945000	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.12	SAT TT=28.629 ASSIGNMENTS=242577 CHECKS=32072600	SAT TT=60.691 ASSIGNMENTS=1137880 CHECKS=170945000	? TT=4.547	No data	SAT TT=41.384	SAT TT=345.198
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibdVariousK/ normalized-bibd-15-15-7-7-3_glb.xml	SAT TT=0.203	SAT TT=45.592 CHECKS=6693710 NODES=159504	? (TO) TT=1800.16	SAT TT=0.568	SAT TT=3.943 CHECKS=577552	SAT TT=6.532 CHECKS=1487960	SAT TT=6.281 ASSIGNMENTS=4230	SAT TT=6.118 ASSIGNMENTS=4230	No data	No data	No data	SAT TT=8.264 ASSIGNMENTS=1743 CHECKS=251439	SAT TT=8.031 ASSIGNMENTS=1743 CHECKS=251439	No data	No data	No data	SAT TT=0.216 ASSIGNMENTS=2744 CHECKS=321799	? (TO) TT=1800.03	SAT TT=1.348	SAT TT=0.522 ASSIGNMENTS=4547 CHECKS=642747	SAT TT=0.203 ASSIGNMENTS=1743 CHECKS=251439	? TT=3.543	No data	SAT TT=3.476	SAT TT=3.632
csp/bibdVariousK/ normalized-bibd-15-21-7-5-2_glb.xml		? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=4.25	No data	? (TO) TT=1800.01	? (TO) TT=1800.01
csp/bibdVariousK/ normalized-bibd-15-35-7-3-1_glb.xml	SAT TT=0.297	SAT TT=12.115 CHECKS=498982 NODES=9543	? (TO) TT=1800.14	SAT TT=2.14	SAT TT=431.927 CHECKS=56524300	SAT TT=105.935 CHECKS=13664200	SAT TT=56.518 ASSIGNMENTS=27234	SAT TT=56.754 ASSIGNMENTS=27234	No data	No data	No data	SAT TT=0.311 ASSIGNMENTS=546 CHECKS=40407	SAT TT=0.314 ASSIGNMENTS=546 CHECKS=40407	No data	No data	No data	SAT TT=0.303 ASSIGNMENTS=548 CHECKS=45046	? (TO) TT=1800.06	SAT TT=2.359	SAT TT=3.099 ASSIGNMENTS=20498 CHECKS=2034390	SAT TT=0.297 ASSIGNMENTS=625 CHECKS=76648	? TT=5.644	No data	SAT TT=6.16	SAT TT=8.034
csp/bibdVariousK/ normalized-bibd-15-45-24-8-12_glb.xml	SAT TT=717.186	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.16	No data	No data	No data	SAT TT=762.586 ASSIGNMENTS=6870490 CHECKS=1069540000	SAT TT=744.143 ASSIGNMENTS=6870490 CHECKS=1069540000	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=764.403 ASSIGNMENTS=6870490 CHECKS=1069540000	? TT=5.988	No data	? (TO) TT=1800.05	? (TO) TT=1800.05
csp/bibdVariousK/ normalized-bibd-15-70-14-3-2_glb.xml	SAT TT=1.074	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.12	SAT TT=221.719 CHECKS=12321900	? (TO) TT=1800.12	? (TO) TT=1800.15	No data	No data	No data	SAT TT=1.827 ASSIGNMENTS=13972 CHECKS=1691190	SAT TT=1.63 ASSIGNMENTS=13972 CHECKS=1691190	No data	No data	No data	SAT TT=1.074 ASSIGNMENTS=5813 CHECKS=688149	? (TO) TT=1800.07	SAT TT=5.208	? (TO) TT=1800.09	? (TO) TT=1800.02	? TT=6.343	No data	SAT TT=35.086	SAT TT=19.995
csp/bibdVariousK/ normalized-bibd-15-75-40-8-20_glb.xml		? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.14	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=6.035	No data	? (TO) TT=1800.02	? (TO) TT=1800.05
csp/bibdVariousK/ normalized-bibd-16-16-6-6-2_glb.xml	SAT TT=0.152	SAT TT=73.421 CHECKS=8815960 NODES=173623	SAT TT=1231.89 CHECKS=142994000 NODES=3067590	SAT TT=12.643	SAT TT=17.516 CHECKS=2173460	SAT TT=5.276 CHECKS=1190140	SAT TT=6.687 ASSIGNMENTS=7723	SAT TT=7.279 ASSIGNMENTS=7723	No data	No data	No data	SAT TT=0.159 ASSIGNMENTS=165 CHECKS=18708	SAT TT=0.152 ASSIGNMENTS=165 CHECKS=18708	No data	No data	No data	SAT TT=0.158 ASSIGNMENTS=339 CHECKS=51718	? (TO) TT=1800.06	SAT TT=147.284	SAT TT=0.515 ASSIGNMENTS=3410 CHECKS=684970	SAT TT=0.228 ASSIGNMENTS=1493 CHECKS=243560	? TT=3.876	No data	SAT TT=3.953	SAT TT=4.537
csp/bibdVariousK/ normalized-bibd-16-20-5-4-1_glb.xml	SAT TT=0.199	SAT TT=6.156 CHECKS=216795 NODES=5734	SAT TT=648.254 CHECKS=51318800 NODES=1651900	SAT TT=0.774	SAT TT=27.926 CHECKS=5688060	SAT TT=9.09 CHECKS=2148840	SAT TT=4.136 ASSIGNMENTS=1015	SAT TT=4.587 ASSIGNMENTS=1015	No data	No data	No data	SAT TT=0.228 ASSIGNMENTS=437 CHECKS=99614	SAT TT=0.227 ASSIGNMENTS=437 CHECKS=99614	No data	No data	No data	SAT TT=0.199 ASSIGNMENTS=342 CHECKS=60978	SAT TT=0.679 ASSIGNMENTS=76486 CHECKS=1506930	SAT TT=1.688	SAT TT=1.208 ASSIGNMENTS=7758 CHECKS=1626410	SAT TT=0.558 ASSIGNMENTS=5469 CHECKS=1077860	? TT=4.479	No data	SAT TT=4.118	SAT TT=4.773
csp/bibdVariousK/ normalized-bibd-16-24-9-6-3_glb.xml	SAT TT=0.399	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=2.61	? (TO) TT=1800.12	SAT TT=10.862 CHECKS=1313800	SAT TT=116.588 ASSIGNMENTS=78620	SAT TT=151.006 ASSIGNMENTS=78620	No data	No data	No data	SAT TT=7.447 ASSIGNMENTS=2522 CHECKS=462620	SAT TT=8.364 ASSIGNMENTS=2522 CHECKS=462620	No data	No data	No data	SAT TT=56.773 ASSIGNMENTS=938751 CHECKS=147812000	? (TO) TT=1800.07	SAT TT=1.834	SAT TT=2.08 ASSIGNMENTS=10375 CHECKS=1692080	SAT TT=0.399 ASSIGNMENTS=2522 CHECKS=462620	? TT=4.586	No data	SAT TT=42.336	SAT TT=14.494
csp/bibdVariousK/ normalized-bibd-16-80-15-3-2_glb.xml	SAT TT=7.905	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.16	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.09	No data	No data	No data	SAT TT=36.123 ASSIGNMENTS=302269 CHECKS=34118400	? (TO) TT=1800.06	SAT TT=7.905	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=6.697	No data	SAT TT=35.684	SAT TT=27.411
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibdVariousK/ normalized-bibd-19-19-9-9-4_glb.xml	SAT TT=0.739	? (TO) TT=1800.06	? (TO) TT=1800.13	SAT TT=1.96	SAT TT=17.105 CHECKS=1737900	SAT TT=14.27 CHECKS=1619630	SAT TT=148.528 ASSIGNMENTS=82955	SAT TT=149.537 ASSIGNMENTS=82955	No data	No data	No data	SAT TT=0.743 ASSIGNMENTS=6963 CHECKS=1190440	SAT TT=0.739 ASSIGNMENTS=6963 CHECKS=1190440	No data	No data	No data	SAT TT=99.275 ASSIGNMENTS=1386960 CHECKS=228854000	? (TO) TT=1800.09	SAT TT=2.164	SAT TT=3.82 ASSIGNMENTS=11199 CHECKS=1736870	SAT TT=0.873 ASSIGNMENTS=8278 CHECKS=1474170	? TT=5.529	No data	SAT TT=37.976	SAT TT=39.253
csp/bibdVariousK/ normalized-bibd-19-57-9-3-1_glb.xml	SAT TT=7.185	? (TO) TT=1800.17	? (TO) TT=1800.17	SAT TT=52.3	? (TO) TT=1800.1	SAT TT=136.736 CHECKS=5687450	? (TO) TT=1800.11	? (TO) TT=1800.09	No data	No data	No data	SAT TT=163.954 ASSIGNMENTS=667115 CHECKS=178388000	SAT TT=816.734 ASSIGNMENTS=667115 CHECKS=178388000	No data	No data	No data	SAT TT=1272.85 ASSIGNMENTS=11049200 CHECKS=2137530000	? (TO) TT=1800.03	SAT TT=7.185	? (TO) TT=1800.07	SAT TT=154.017 ASSIGNMENTS=667115 CHECKS=178388000	? TT=6.818	No data	SAT TT=17.235	SAT TT=805.807
csp/bibdVariousK/ normalized-bibd-21-21-5-5-1_glb.xml	SAT TT=0.335	? (TO) TT=1800.08	SAT TT=596.449 CHECKS=43867700 NODES=770759	SAT TT=1.388	SAT TT=65.474 CHECKS=11765700	SAT TT=10.368 CHECKS=1405540	SAT TT=9.343 ASSIGNMENTS=1732	SAT TT=7.827 ASSIGNMENTS=1732	No data	No data	No data	SAT TT=0.335 ASSIGNMENTS=253 CHECKS=27497	SAT TT=0.339 ASSIGNMENTS=253 CHECKS=27497	No data	No data	No data	SAT TT=0.391 ASSIGNMENTS=584 CHECKS=143586	? (TO) TT=1800.03	SAT TT=2.307	SAT TT=159.922 ASSIGNMENTS=722974 CHECKS=220218000	SAT TT=0.556 ASSIGNMENTS=2075 CHECKS=601484	? TT=5.352	No data	SAT TT=6.936	SAT TT=7.663
csp/bibdVariousK/ normalized-bibd-21-28-8-6-2_glb.xml		? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.03	? TT=6.315	No data	? (TO) TT=1800.09	? (TO) TT=1800
csp/bibdVariousK/ normalized-bibd-22-22-7-7-2_glb.xml		? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	No data	No data	No data	? (TO) TT=1800.14	? (TO) TT=1800	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=6.136	No data	? (TO) TT=1800.06	? (TO) TT=1800.04
csp/bibdVariousK/ normalized-bibd-25-25-9-9-3_glb.xml	SAT TT=1.365	? (TO) TT=1800.15	? (TO) TT=1800.08	SAT TT=9.97	? (TO) TT=1800.13	? (TO) TT=1800.03	SAT TT=577.039 ASSIGNMENTS=141154	SAT TT=579.181 ASSIGNMENTS=141154	No data	No data	No data	SAT TT=1.426 ASSIGNMENTS=7791 CHECKS=1692470	SAT TT=1.365 ASSIGNMENTS=7791 CHECKS=1692470	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=520.464 ASSIGNMENTS=1603970 CHECKS=391247000	SAT TT=176.577 ASSIGNMENTS=1263490 CHECKS=337356000	? TT=5.865	No data	SAT TT=630.377	SAT TT=849.669
csp/bibdVariousK/ normalized-bibd-25-30-6-5-1_glb.xml	SAT TT=0.989	SAT TT=60.18 CHECKS=1947270 NODES=24047	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.09	SAT TT=191.712 ASSIGNMENTS=44735	SAT TT=172.719 ASSIGNMENTS=44735	No data	No data	No data	SAT TT=0.989 ASSIGNMENTS=1882 CHECKS=736936	SAT TT=0.991 ASSIGNMENTS=1882 CHECKS=736936	No data	No data	No data	SAT TT=117.894 ASSIGNMENTS=684454 CHECKS=288611000	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=6.393	No data	SAT TT=55.076	SAT TT=28.891
csp/bibdVariousK/ normalized-bibd-31-31-6-6-1_glb.xml	SAT TT=1.41	? (TO) TT=1800.17	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	No data	No data	No data	SAT TT=1.41 ASSIGNMENTS=932 CHECKS=306772	SAT TT=1.41 ASSIGNMENTS=932 CHECKS=306772	No data	No data	No data	SAT TT=932.354 ASSIGNMENTS=3000640 CHECKS=1718230000	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=1.825 ASSIGNMENTS=2010 CHECKS=707826	? TT=7.739	No data	SAT TT=134.334	SAT TT=65.163
csp/bibdVariousK/ normalized-bibd-7-210-60-2-10_glb.xml	SAT TT=0.708	SAT TT=18.051 CHECKS=212834 NODES=17675	? (TO) TT=1800.12	? (TO) TT=1800.1	SAT TT=34.293 CHECKS=1289420	SAT TT=369.071 CHECKS=12347500	SAT TT=22.307 ASSIGNMENTS=6948	SAT TT=23.05 ASSIGNMENTS=6948	No data	No data	No data	SAT TT=764.51 ASSIGNMENTS=3025 CHECKS=188602	SAT TT=1502.64 ASSIGNMENTS=3025 CHECKS=188602	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=3.329	SAT TT=2.452 ASSIGNMENTS=10035 CHECKS=449325	SAT TT=0.708 ASSIGNMENTS=3025 CHECKS=188602	? TT=5.48	No data	SAT TT=11.846	SAT TT=20.956
csp/bibdVariousK/ normalized-bibd-8-56-21-3-6_glb.xml	SAT TT=0.138	SAT TT=260.701 CHECKS=55128300 NODES=616940	SAT TT=175.886 CHECKS=34236000 NODES=230831	? (TO) TT=1800.11	SAT TT=43.128 CHECKS=6077700	SAT TT=60.501 CHECKS=8364800	? (TO) TT=1800.08	? (TO) TT=1800.13	No data	No data	No data	SAT TT=1.486 ASSIGNMENTS=32282 CHECKS=2722100	SAT TT=1.487 ASSIGNMENTS=32282 CHECKS=2722100	No data	No data	No data	SAT TT=1.397 ASSIGNMENTS=32439 CHECKS=2736920	SAT TT=484.511 ASSIGNMENTS=12931800 CHECKS=1050490000	SAT TT=25.625	SAT TT=0.525 ASSIGNMENTS=4410 CHECKS=265577	SAT TT=0.138 ASSIGNMENTS=505 CHECKS=29146	? TT=4.082	No data	SAT TT=11.447	SAT TT=5.013
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibdVariousK/ normalized-bibd-9-18-8-4-3_glb.xml	SAT TT=0.058	SAT TT=2.306 CHECKS=139820 NODES=4302	SAT TT=2.878 CHECKS=109912 NODES=3300	SAT TT=0.332	SAT TT=7.715 CHECKS=2287710	SAT TT=9.806 CHECKS=3384320	SAT TT=3.98 ASSIGNMENTS=13065	SAT TT=3.857 ASSIGNMENTS=13065	No data	No data	No data	SAT TT=0.068 ASSIGNMENTS=193 CHECKS=15804	SAT TT=0.064 ASSIGNMENTS=193 CHECKS=15804	No data	No data	No data	SAT TT=0.382 ASSIGNMENTS=8326 CHECKS=927274	SAT TT=0.476 ASSIGNMENTS=30636 CHECKS=1317700	SAT TT=0.86	SAT TT=0.288 ASSIGNMENTS=4585 CHECKS=458650	SAT TT=0.058 ASSIGNMENTS=141 CHECKS=14754	? TT=2.236	No data	SAT TT=2.066	SAT TT=2.579
csp/bmc/ normalized-bmc-ibm-01-02.xml	SAT TT=4.363	SAT TT=29.73 CHECKS=241772 NODES=9685	SAT TT=94.841 CHECKS=434684 NODES=9685	SAT TT=14.316	SAT TT=34.04 CHECKS=27432000	SAT TT=23.305 CHECKS=4974480	SAT TT=43.209 ASSIGNMENTS=3047	SAT TT=114.175 ASSIGNMENTS=3680	SAT TT=1029.42 CHECKS=269743 NODES=12023	? (TO) TT=1800.08	SAT TT=829.557 CHECKS=42754500 NODES=847	SAT TT=4.363 ASSIGNMENTS=2982 CHECKS=552844	SAT TT=4.591 ASSIGNMENTS=2982 CHECKS=552844	? (TO) TT=1800.05	? (TO) TT=1800.04	No data	SAT TT=4.68 ASSIGNMENTS=2982 CHECKS=552844	SAT TT=6.708 ASSIGNMENTS=7449 CHECKS=2648600	? (exit code) TT=48.71	SAT TT=542.22 ASSIGNMENTS=179610 CHECKS=389595000	SAT TT=5.099 ASSIGNMENTS=2974 CHECKS=550099	? (TO) TT=1800.12	No data	SAT TT=18.558	SAT TT=20.983
csp/bmc/ normalized-bmc-ibm-01-04.xml	SAT TT=4.88	SAT TT=46.524 CHECKS=277843 NODES=9685	SAT TT=109.15 CHECKS=471661 NODES=9685	SAT TT=14.386	SAT TT=33.861 CHECKS=27276700	SAT TT=26.365 CHECKS=5819680	SAT TT=45.716 ASSIGNMENTS=3047	SAT TT=116.267 ASSIGNMENTS=3594	SAT TT=1079.35 CHECKS=460897 NODES=12023	? (TO) TT=1800.09	SAT TT=1531.44 CHECKS=50592700 NODES=1043	SAT TT=5.337 ASSIGNMENTS=2984 CHECKS=831891	SAT TT=5.142 ASSIGNMENTS=2984 CHECKS=831891	? (problem) TT=618.021	? (problem) TT=615.144	No data	SAT TT=4.88 ASSIGNMENTS=2984 CHECKS=831891	SAT TT=9.558 ASSIGNMENTS=12112 CHECKS=4800940	? (exit code) TT=57.1	SAT TT=755.923 ASSIGNMENTS=216803 CHECKS=463569000	SAT TT=5.072 ASSIGNMENTS=2965 CHECKS=829131	? (TO) TT=1800.08	No data	SAT TT=29.75	SAT TT=31.996
csp/bmc/ normalized-bmc-ibm-01-08.xml	SAT TT=5.184	SAT TT=44.953 CHECKS=296181 NODES=9685	SAT TT=111.373 CHECKS=493586 NODES=9685	SAT TT=13.705	SAT TT=39.282 CHECKS=27589300	SAT TT=24.12 CHECKS=5768100	SAT TT=43.929 ASSIGNMENTS=3047	SAT TT=118.807 ASSIGNMENTS=3466	SAT TT=999.342 CHECKS=755074 NODES=12023	? (TO) TT=1800.04	SAT TT=1044.62 CHECKS=47338100 NODES=940	SAT TT=5.184 ASSIGNMENTS=2964 CHECKS=908579	SAT TT=5.315 ASSIGNMENTS=2964 CHECKS=908579	? (problem) TT=275.489	? (problem) TT=265.126	No data	SAT TT=5.25 ASSIGNMENTS=2964 CHECKS=908579	SAT TT=5.438 ASSIGNMENTS=3221 CHECKS=1190170	? (exit code) TT=59.388	SAT TT=660.8 ASSIGNMENTS=197964 CHECKS=460048000	SAT TT=5.38 ASSIGNMENTS=2942 CHECKS=904546	? (TO) TT=1800.16	No data	SAT TT=47.927	SAT TT=34.211
csp/bmc/ normalized-bmc-ibm-02-02.xml	SAT TT=1.061	SAT TT=4.745 CHECKS=36650 NODES=2810	SAT TT=8.058 CHECKS=80150 NODES=2810	SAT TT=2.764	SAT TT=3.107 CHECKS=2923840	SAT TT=2.447 CHECKS=2583460	SAT TT=9.431 ASSIGNMENTS=524	SAT TT=13.655 ASSIGNMENTS=948	SAT TT=35.609 CHECKS=44487 NODES=3231	SAT TT=48.242 CHECKS=20323500 NODES=150399	SAT TT=29.265 CHECKS=3201460 NODES=301	SAT TT=1.076 ASSIGNMENTS=518 CHECKS=113645	SAT TT=1.14 ASSIGNMENTS=518 CHECKS=113645	Wrong UNSAT TT=23.492	Wrong UNSAT TT=14.86	No data	SAT TT=1.061 ASSIGNMENTS=518 CHECKS=113645	SAT TT=1.064 ASSIGNMENTS=623 CHECKS=116517	Wrong Cert. TT=7.664	SAT TT=1.397 ASSIGNMENTS=977 CHECKS=306968	SAT TT=1.119 ASSIGNMENTS=516 CHECKS=113632	SAT TT=22.403	No data	SAT TT=3.75	SAT TT=3.821
csp/bmc/ normalized-bmc-ibm-02-04.xml	SAT TT=0.959	SAT TT=5.754 CHECKS=42126 NODES=2810	SAT TT=9.114 CHECKS=88133 NODES=2810	SAT TT=2.792	SAT TT=3.265 CHECKS=2893460	SAT TT=2.899 CHECKS=2903340	SAT TT=8.706 ASSIGNMENTS=524	SAT TT=12.488 ASSIGNMENTS=948	SAT TT=93.781 CHECKS=125768 NODES=3231	SAT TT=29.959 CHECKS=236362 NODES=505	SAT TT=29.64 CHECKS=3296770 NODES=293	SAT TT=1.086 ASSIGNMENTS=533 CHECKS=124256	SAT TT=0.959 ASSIGNMENTS=533 CHECKS=124256	? (TO) TT=1800.05	? (TO) TT=1800.05	No data	SAT TT=1.038 ASSIGNMENTS=533 CHECKS=124256	SAT TT=1.098 ASSIGNMENTS=637 CHECKS=126390	Wrong Cert. TT=7.908	SAT TT=1.354 ASSIGNMENTS=1161 CHECKS=340866	SAT TT=1.069 ASSIGNMENTS=523 CHECKS=124238	? (TO) TT=1800.16	No data	SAT TT=5.414	SAT TT=5.485
csp/bmc/ normalized-bmc-ibm-02-08.xml	SAT TT=1.282	SAT TT=5.867 CHECKS=52577 NODES=2810	SAT TT=9.073 CHECKS=101579 NODES=2810	SAT TT=2.557	SAT TT=3.294 CHECKS=2932360	SAT TT=2.659 CHECKS=2907560	SAT TT=8.76 ASSIGNMENTS=524	SAT TT=13.139 ASSIGNMENTS=948	SAT TT=143.797 CHECKS=251544 NODES=3231	SAT TT=126.996 CHECKS=39298300 NODES=300418	SAT TT=86.334 CHECKS=3272800 NODES=280	SAT TT=1.329 ASSIGNMENTS=516 CHECKS=187140	SAT TT=1.371 ASSIGNMENTS=516 CHECKS=187140	? (TO) TT=1800.01	? (TO) TT=1800.04	No data	SAT TT=1.282 ASSIGNMENTS=516 CHECKS=187140	SAT TT=1.304 ASSIGNMENTS=562 CHECKS=188841	Wrong Cert. TT=8.018	SAT TT=1.497 ASSIGNMENTS=777 CHECKS=278312	SAT TT=1.373 ASSIGNMENTS=515 CHECKS=187129	? (TO) TT=1800.15	No data	SAT TT=6.106	SAT TT=5.86
csp/bmc/ normalized-bmc-ibm-03-02.xml	SAT TT=5.86	SAT TT=56.183 CHECKS=436936 NODES=14957	SAT TT=108.559 CHECKS=520289 NODES=14957	SAT TT=18.366	SAT TT=65.854 CHECKS=28934900	SAT TT=35.799 CHECKS=6301210	SAT TT=61.849 ASSIGNMENTS=3635	SAT TT=156.548 ASSIGNMENTS=4517	SAT TT=1577.42 CHECKS=315108 NODES=19685	? TT=1148.04 CHECKS=362170 NODES=0	? TT=1142.38 CHECKS=356782 NODES=0	SAT TT=5.86 ASSIGNMENTS=3795 CHECKS=504719	SAT TT=6.09 ASSIGNMENTS=3795 CHECKS=504719	Wrong UNSAT TT=505.806	Wrong UNSAT TT=325.438	No data	SAT TT=5.904 ASSIGNMENTS=3808 CHECKS=506554	SAT TT=6.462 ASSIGNMENTS=11113 CHECKS=1282160	? (exit code) TT=89.294	SAT TT=537.923 ASSIGNMENTS=239824 CHECKS=281075000	SAT TT=6.06 ASSIGNMENTS=3918 CHECKS=622129	? (TO) TT=1800.15	No data	SAT TT=20.108	SAT TT=21.912
csp/bmc/ normalized-bmc-ibm-03-04.xml	SAT TT=5.803	SAT TT=99.273 CHECKS=462760 NODES=14957	SAT TT=150.182 CHECKS=546529 NODES=14957	SAT TT=18.885	SAT TT=55.328 CHECKS=28679600	SAT TT=78.729 CHECKS=6617540	SAT TT=57.921 ASSIGNMENTS=3635	SAT TT=157.57 ASSIGNMENTS=4513	SAT TT=1670.73 CHECKS=542517 NODES=19685	? TT=1196.46 CHECKS=776607 NODES=0	? TT=1160.09 CHECKS=778964 NODES=0	SAT TT=6.243 ASSIGNMENTS=3808 CHECKS=639451	SAT TT=5.803 ASSIGNMENTS=3808 CHECKS=639451	? (MO) TT=558.09	? (MO) TT=581.01	No data	SAT TT=6.34 ASSIGNMENTS=3794 CHECKS=641318	SAT TT=21.207 ASSIGNMENTS=94022 CHECKS=13293500	? (exit code) TT=92.785	SAT TT=642.025 ASSIGNMENTS=241310 CHECKS=290346000	SAT TT=6.376 ASSIGNMENTS=3936 CHECKS=756906	? (TO) TT=1800.15	No data	SAT TT=28.599	SAT TT=31.118
csp/bmc/ normalized-bmc-ibm-03-08.xml	SAT TT=6.544	SAT TT=106.126 CHECKS=498560 NODES=14957	SAT TT=150.697 CHECKS=584119 NODES=14957	SAT TT=19.367	SAT TT=51.997 CHECKS=28710300	SAT TT=47.166 CHECKS=6581710	SAT TT=59.177 ASSIGNMENTS=3635	SAT TT=163.291 ASSIGNMENTS=4835	SAT TT=1671.12 CHECKS=864394 NODES=19685	? TT=1476.18 CHECKS=1565200 NODES=0	? TT=1560.13 CHECKS=1561190 NODES=0	SAT TT=6.568 ASSIGNMENTS=3819 CHECKS=858711	SAT TT=20.247 ASSIGNMENTS=3965 CHECKS=1201170	? (problem) TT=789.303	? (problem) TT=737.069	No data	SAT TT=6.544 ASSIGNMENTS=3828 CHECKS=897010	SAT TT=40.231 ASSIGNMENTS=142633 CHECKS=28031200	? (exit code) TT=104.685	SAT TT=835.428 ASSIGNMENTS=184947 CHECKS=391541000	SAT TT=7.395 ASSIGNMENTS=3965 CHECKS=1201170	? (TO) TT=1800.13	No data	SAT TT=33.989	SAT TT=36.581
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bmc/ normalized-bmc-ibm-03-16.xml	SAT TT=6.98	SAT TT=104.135 CHECKS=360610 NODES=14930	SAT TT=158.387 CHECKS=452966 NODES=14930	SAT TT=19.451	SAT TT=49.237 CHECKS=28654000	SAT TT=50.234 CHECKS=6544100	SAT TT=57.243 ASSIGNMENTS=3635	SAT TT=160.242 ASSIGNMENTS=4474	SAT TT=1692.16 CHECKS=1483520 NODES=19685	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=20.352 ASSIGNMENTS=3955 CHECKS=1265710	SAT TT=21.55 ASSIGNMENTS=3955 CHECKS=1265710	? (problem) TT=424.216	? (problem) TT=395.496	No data	SAT TT=6.98 ASSIGNMENTS=3823 CHECKS=950673	SAT TT=30.546 ASSIGNMENTS=90097 CHECKS=19382900	? (exit code) TT=95.755	SAT TT=1390.51 ASSIGNMENTS=404901 CHECKS=806402000	SAT TT=7.431 ASSIGNMENTS=3955 CHECKS=1265710	? (TO) TT=1800.12	No data	SAT TT=33.914	SAT TT=33.878
csp/bmc/ normalized-bmc-ibm-04-04.xml	SAT TT=12.94	? TT=160.859	? TT=157.898	SAT TT=43.594	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=135.249 ASSIGNMENTS=5470	? (MO) TT=153.949	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=31.672 ASSIGNMENTS=5364 CHECKS=1433340	SAT TT=30.985 ASSIGNMENTS=5364 CHECKS=1433340	? (problem) TT=1097.55	? (problem) TT=1174.09	No data	SAT TT=12.94 ASSIGNMENTS=5384 CHECKS=1419310	SAT TT=46.786 ASSIGNMENTS=74837 CHECKS=31673100	? (exit code) TT=789.348	? (TO) TT=1800.11	SAT TT=13.02 ASSIGNMENTS=5364 CHECKS=1433340	? (TO) TT=1800.14	No data	SAT TT=115.65	SAT TT=87.319
csp/bmc/ normalized-bmc-ibm-04-16.xml	SAT TT=14.673	? TT=157.649	? TT=157.92	SAT TT=44.017	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=123.756 ASSIGNMENTS=5470	SAT TT=252.862 ASSIGNMENTS=5467	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=31.779 ASSIGNMENTS=5243 CHECKS=1897450	SAT TT=32.391 ASSIGNMENTS=5243 CHECKS=1897450	? (problem) TT=1018.97	? (problem) TT=1033.43	No data	SAT TT=14.765 ASSIGNMENTS=5237 CHECKS=1886310	SAT TT=69.62 ASSIGNMENTS=75978 CHECKS=41013900	? (MO) TT=5.78	? (TO) TT=1800.12	SAT TT=14.673 ASSIGNMENTS=5243 CHECKS=1897450	? (TO) TT=1800.17	No data	SAT TT=212.199	SAT TT=92.351
csp/bmc/ normalized-bmc-ibm-05-02.xml	SAT TT=3.129	SAT TT=27.091 CHECKS=147611 NODES=9396	SAT TT=21.288 CHECKS=159500 NODES=0	SAT TT=10.783	SAT TT=26.531 CHECKS=14047600	SAT TT=21.191 CHECKS=6387210	SAT TT=30.562 ASSIGNMENTS=3109	SAT TT=110.528 ASSIGNMENTS=4111	SAT TT=478.908 CHECKS=178374 NODES=9396	SAT TT=390.93 CHECKS=550424 NODES=764	SAT TT=393.976 CHECKS=24153000 NODES=644	SAT TT=3.197 ASSIGNMENTS=3215 CHECKS=260135	SAT TT=3.246 ASSIGNMENTS=3215 CHECKS=260135	? (TO) TT=1800.01	? (TO) TT=1800.07	No data	SAT TT=3.495 ASSIGNMENTS=3215 CHECKS=260135	SAT TT=3.129 ASSIGNMENTS=3205 CHECKS=242080	? (exit code) TT=33.219	SAT TT=58.428 ASSIGNMENTS=58730 CHECKS=26600500	SAT TT=3.152 ASSIGNMENTS=3229 CHECKS=261404	? (TO) TT=1800.12	No data	SAT TT=10.228	SAT TT=10.498
csp/bmc/ normalized-bmc-ibm-07-08.xml	UNSAT TT=2.231	UNSAT TT=13.522 CHECKS=49 NODES=0	UNSAT TT=14.913 CHECKS=49 NODES=0	UNSAT TT=9.367	UNSAT TT=4.583 CHECKS=133933	UNSAT TT=2.231 CHECKS=133933	UNSAT TT=25.012 ASSIGNMENTS=0	UNSAT TT=24.619 ASSIGNMENTS=0	UNSAT TT=448.335 CHECKS=259635 NODES=0	UNSAT TT=531.494 CHECKS=483036 NODES=0	UNSAT TT=617.988 CHECKS=483036 NODES=0	UNSAT TT=3.126 ASSIGNMENTS=0 CHECKS=127236	UNSAT TT=2.979 ASSIGNMENTS=0 CHECKS=127236	? (problem) TT=808.092	? (problem) TT=783.441	No data	UNSAT TT=3.098 ASSIGNMENTS=0 CHECKS=127236	UNSAT TT=3.248 ASSIGNMENTS=0 CHECKS=127236	? (exit code) TT=35.409	UNSAT TT=3.108 ASSIGNMENTS=0 CHECKS=127236	UNSAT TT=3.073 ASSIGNMENTS=0 CHECKS=127236	? (TO) TT=1800.11	No data	UNSAT TT=16.09	UNSAT TT=19.227
csp/bmc/ normalized-bmc-ibm-07-16.xml	UNSAT TT=2.312	UNSAT TT=13.534 CHECKS=49 NODES=0	UNSAT TT=15.139 CHECKS=49 NODES=0	UNSAT TT=10.158	UNSAT TT=4.519 CHECKS=133933	UNSAT TT=2.312 CHECKS=133933	UNSAT TT=25.216 ASSIGNMENTS=0	UNSAT TT=25.549 ASSIGNMENTS=0	UNSAT TT=447.693 CHECKS=585551 NODES=0	UNSAT TT=574.736 CHECKS=986939 NODES=0	UNSAT TT=602.167 CHECKS=986939 NODES=0	UNSAT TT=3.531 ASSIGNMENTS=0 CHECKS=155836	UNSAT TT=3.296 ASSIGNMENTS=0 CHECKS=155836	? (problem) TT=517.363	? (problem) TT=517.87	No data	UNSAT TT=3.229 ASSIGNMENTS=0 CHECKS=155836	UNSAT TT=3.216 ASSIGNMENTS=0 CHECKS=155836	? (exit code) TT=36.753	UNSAT TT=3.373 ASSIGNMENTS=0 CHECKS=155836	UNSAT TT=3.538 ASSIGNMENTS=0 CHECKS=155836	? (TO) TT=1800.13	No data	UNSAT TT=15.974	UNSAT TT=19.774
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-13_glb.xml	SAT TT=0.011	SAT TT=0.795 CHECKS=605 NODES=473	SAT TT=0.985 CHECKS=104 NODES=124	SAT TT=0.044	SAT TT=0.015 CHECKS=1084	SAT TT=0.012 CHECKS=1270	SAT TT=0.566 ASSIGNMENTS=4	SAT TT=0.515 ASSIGNMENTS=4	No data	No data	No data	SAT TT=0.023 ASSIGNMENTS=29 CHECKS=3051	SAT TT=0.023 ASSIGNMENTS=29 CHECKS=3051	No data	No data	No data	SAT TT=0.011 ASSIGNMENTS=39 CHECKS=3739	SAT TT=0.16 ASSIGNMENTS=4003 CHECKS=297875	SAT TT=0.368	SAT TT=0.02 ASSIGNMENTS=240 CHECKS=14646	SAT TT=0.016 ASSIGNMENTS=97 CHECKS=12613	SAT TT=1.181	No data	SAT TT=1.134	SAT TT=1.102
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-31_glb.xml	SAT TT=0.022	SAT TT=0.866 CHECKS=350 NODES=448	SAT TT=0.807 CHECKS=103 NODES=181	SAT TT=0.051	SAT TT=0.046 CHECKS=15542	SAT TT=0.024 CHECKS=4648	SAT TT=0.708 ASSIGNMENTS=11	SAT TT=0.738 ASSIGNMENTS=9	No data	No data	No data	SAT TT=0.045 ASSIGNMENTS=412 CHECKS=42094	SAT TT=0.045 ASSIGNMENTS=412 CHECKS=42094	No data	No data	No data	SAT TT=0.022 ASSIGNMENTS=227 CHECKS=24344	SAT TT=0.045 ASSIGNMENTS=941 CHECKS=67526	SAT TT=0.407	SAT TT=0.029 ASSIGNMENTS=396 CHECKS=29043	SAT TT=0.022 ASSIGNMENTS=233 CHECKS=23280	SAT TT=1.005	No data	SAT TT=1.051	SAT TT=1.179
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-33_glb.xml	SAT TT=0.012	SAT TT=0.927 CHECKS=1309 NODES=751	SAT TT=0.941 CHECKS=1218 NODES=763	SAT TT=0.049	SAT TT=0.15 CHECKS=72043	SAT TT=0.173 CHECKS=86937	SAT TT=0.91 ASSIGNMENTS=7	SAT TT=0.853 ASSIGNMENTS=7	No data	No data	No data	SAT TT=0.025 ASSIGNMENTS=66 CHECKS=5560	SAT TT=0.024 ASSIGNMENTS=66 CHECKS=5560	No data	No data	No data	SAT TT=0.012 ASSIGNMENTS=55 CHECKS=5105	SAT TT=0.166 ASSIGNMENTS=4017 CHECKS=296163	SAT TT=0.432	SAT TT=0.041 ASSIGNMENTS=635 CHECKS=52962	SAT TT=0.035 ASSIGNMENTS=398 CHECKS=45862	SAT TT=1.282	No data	SAT TT=1.264	SAT TT=1.073
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-63_glb.xml	SAT TT=0.026	SAT TT=0.842 CHECKS=1816 NODES=849	SAT TT=0.977 CHECKS=907 NODES=669	SAT TT=0.046	SAT TT=0.05 CHECKS=22866	SAT TT=0.051 CHECKS=22331	SAT TT=0.711 ASSIGNMENTS=4	SAT TT=0.691 ASSIGNMENTS=6	No data	No data	No data	SAT TT=0.045 ASSIGNMENTS=417 CHECKS=52336	SAT TT=0.046 ASSIGNMENTS=417 CHECKS=52336	No data	No data	No data	SAT TT=0.037 ASSIGNMENTS=494 CHECKS=58735	SAT TT=0.165 ASSIGNMENTS=4205 CHECKS=314230	SAT TT=0.37	SAT TT=0.026 ASSIGNMENTS=350 CHECKS=25978	SAT TT=0.039 ASSIGNMENTS=457 CHECKS=62340	SAT TT=1.12	No data	SAT TT=1.136	SAT TT=1.158
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-67_glb.xml	SAT TT=0.015	SAT TT=0.831 CHECKS=1875 NODES=908	SAT TT=0.862 CHECKS=30 NODES=0	SAT TT=0.062	SAT TT=0.018 CHECKS=3678	SAT TT=0.015 CHECKS=1862	SAT TT=0.538 ASSIGNMENTS=2	SAT TT=0.545 ASSIGNMENTS=4	No data	No data	No data	SAT TT=0.036 ASSIGNMENTS=225 CHECKS=30433	SAT TT=0.039 ASSIGNMENTS=225 CHECKS=30433	No data	No data	No data	SAT TT=0.032 ASSIGNMENTS=313 CHECKS=48192	SAT TT=0.173 ASSIGNMENTS=3812 CHECKS=314521	SAT TT=0.367	SAT TT=0.023 ASSIGNMENTS=308 CHECKS=19180	SAT TT=0.028 ASSIGNMENTS=287 CHECKS=37196	SAT TT=1.068	No data	SAT TT=1.135	SAT TT=1.174
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-75_glb.xml	SAT TT=0.013	SAT TT=0.794 CHECKS=831 NODES=611	SAT TT=0.794 CHECKS=30 NODES=109	SAT TT=0.049	SAT TT=0.041 CHECKS=13519	SAT TT=0.056 CHECKS=18452	SAT TT=0.857 ASSIGNMENTS=20	SAT TT=0.914 ASSIGNMENTS=7	No data	No data	No data	SAT TT=0.024 ASSIGNMENTS=63 CHECKS=4047	SAT TT=0.021 ASSIGNMENTS=63 CHECKS=4047	No data	No data	No data	SAT TT=0.013 ASSIGNMENTS=97 CHECKS=6552	SAT TT=0.054 ASSIGNMENTS=1380 CHECKS=83090	SAT TT=0.391	SAT TT=0.022 ASSIGNMENTS=345 CHECKS=15863	SAT TT=0.013 ASSIGNMENTS=50 CHECKS=5097	SAT TT=0.99	No data	SAT TT=1.329	SAT TT=1.352
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-82_glb.xml	SAT TT=0.014	SAT TT=0.843 CHECKS=1451 NODES=754	SAT TT=0.805 CHECKS=281 NODES=283	SAT TT=0.047	SAT TT=0.02 CHECKS=3223	SAT TT=0.026 CHECKS=5864	SAT TT=0.751 ASSIGNMENTS=8	SAT TT=0.829 ASSIGNMENTS=14	No data	No data	No data	SAT TT=0.026 ASSIGNMENTS=106 CHECKS=7593	SAT TT=0.025 ASSIGNMENTS=106 CHECKS=7593	No data	No data	No data	SAT TT=0.015 ASSIGNMENTS=133 CHECKS=9470	SAT TT=0.014 ASSIGNMENTS=105 CHECKS=8546	SAT TT=0.384	SAT TT=0.039 ASSIGNMENTS=682 CHECKS=48368	SAT TT=0.023 ASSIGNMENTS=264 CHECKS=26101	SAT TT=1.04	No data	SAT TT=1.09	SAT TT=1.082
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-83_glb.xml	SAT TT=0.047	SAT TT=0.824 CHECKS=949 NODES=599	SAT TT=0.946 CHECKS=1836 NODES=987	SAT TT=0.047	SAT TT=0.104 CHECKS=34417	SAT TT=0.072 CHECKS=25778	SAT TT=0.937 ASSIGNMENTS=12	SAT TT=0.778 ASSIGNMENTS=10	No data	No data	No data	SAT TT=0.056 ASSIGNMENTS=586 CHECKS=69930	SAT TT=0.058 ASSIGNMENTS=586 CHECKS=69930	No data	No data	No data	SAT TT=0.171 ASSIGNMENTS=2621 CHECKS=312912	SAT TT=0.191 ASSIGNMENTS=4210 CHECKS=363591	SAT TT=0.393	SAT TT=0.133 ASSIGNMENTS=1795 CHECKS=203463	SAT TT=0.078 ASSIGNMENTS=1015 CHECKS=135933	SAT TT=1.081	No data	SAT TT=1.089	SAT TT=1.122
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-98_glb.xml	SAT TT=0.015	SAT TT=0.899 CHECKS=804 NODES=444	SAT TT=0.815 CHECKS=86 NODES=127	SAT TT=0.046	SAT TT=0.051 CHECKS=24996	SAT TT=0.057 CHECKS=26060	SAT TT=0.695 ASSIGNMENTS=5	SAT TT=0.661 ASSIGNMENTS=5	No data	No data	No data	SAT TT=0.026 ASSIGNMENTS=98 CHECKS=10798	SAT TT=0.026 ASSIGNMENTS=98 CHECKS=10798	No data	No data	No data	SAT TT=0.015 ASSIGNMENTS=86 CHECKS=8090	SAT TT=0.158 ASSIGNMENTS=4090 CHECKS=326420	SAT TT=0.348	SAT TT=0.023 ASSIGNMENTS=309 CHECKS=16923	SAT TT=0.024 ASSIGNMENTS=353 CHECKS=34721	SAT TT=0.971	No data	SAT TT=1.09	SAT TT=1.125
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-99_glb.xml	SAT TT=0.016	SAT TT=0.872 CHECKS=663 NODES=553	SAT TT=0.827 CHECKS=453 NODES=390	SAT TT=0.045	SAT TT=0.017 CHECKS=3084	SAT TT=0.021 CHECKS=3953	SAT TT=0.726 ASSIGNMENTS=12	SAT TT=0.827 ASSIGNMENTS=11	No data	No data	No data	SAT TT=0.058 ASSIGNMENTS=589 CHECKS=71306	SAT TT=0.061 ASSIGNMENTS=589 CHECKS=71306	No data	No data	No data	SAT TT=0.042 ASSIGNMENTS=619 CHECKS=61863	SAT TT=0.164 ASSIGNMENTS=4554 CHECKS=284551	SAT TT=0.37	SAT TT=0.032 ASSIGNMENTS=422 CHECKS=28156	SAT TT=0.016 ASSIGNMENTS=113 CHECKS=11789	SAT TT=0.979	No data	SAT TT=1.096	SAT TT=1.093
csp/bqwh-15-106/ normalized-bqwh-15-106-24_ext.xml	SAT TT=0.039	SAT TT=1.145 CHECKS=100396 NODES=1144	SAT TT=1.191 CHECKS=109962 NODES=1098	SAT TT=0.234	SAT TT=0.142 CHECKS=128871	SAT TT=0.666 CHECKS=888959	SAT TT=1.102 ASSIGNMENTS=10	SAT TT=1.113 ASSIGNMENTS=11	SAT TT=0.852 CHECKS=22442 NODES=535	SAT TT=0.799 CHECKS=792967 NODES=18806	SAT TT=1.334 CHECKS=4545710 NODES=15610	SAT TT=0.195 ASSIGNMENTS=2010 CHECKS=473556	SAT TT=0.183 ASSIGNMENTS=2010 CHECKS=473556	SAT TT=1.702	SAT TT=1.416	No data	SAT TT=0.226 ASSIGNMENTS=2460 CHECKS=665843	SAT TT=0.322 ASSIGNMENTS=5654 CHECKS=957091	SAT TT=0.787	SAT TT=0.039 ASSIGNMENTS=316 CHECKS=44265	SAT TT=0.18 ASSIGNMENTS=2010 CHECKS=473556	SAT TT=1.619	SAT TT=0.875 ASSIGNMENTS=532 CHECKS=71428	SAT TT=1.061	SAT TT=1.026
csp/bqwh-15-106/ normalized-bqwh-15-106-26_ext.xml	SAT TT=0.048	SAT TT=1.179 CHECKS=158828 NODES=1486	SAT TT=1.222 CHECKS=123121 NODES=1168	SAT TT=0.212	SAT TT=0.048 CHECKS=27155	SAT TT=0.048 CHECKS=31076	SAT TT=1.084 ASSIGNMENTS=43	SAT TT=1.138 ASSIGNMENTS=16	SAT TT=0.978 CHECKS=84995 NODES=1514	SAT TT=0.816 CHECKS=840414 NODES=19834	? (TO) TT=1800.05	SAT TT=0.097 ASSIGNMENTS=659 CHECKS=172553	SAT TT=0.09 ASSIGNMENTS=659 CHECKS=172553	SAT TT=1.464	SAT TT=1.669	No data	SAT TT=0.063 ASSIGNMENTS=449 CHECKS=110598	SAT TT=0.229 ASSIGNMENTS=4031 CHECKS=608822	SAT TT=0.821	SAT TT=0.146 ASSIGNMENTS=1347 CHECKS=356917	SAT TT=0.083 ASSIGNMENTS=659 CHECKS=172553	SAT TT=1.442	SAT TT=0.136 ASSIGNMENTS=521 CHECKS=57840	SAT TT=1.008	SAT TT=1.373
csp/bqwh-15-106/ normalized-bqwh-15-106-28_ext.xml	SAT TT=0.037	SAT TT=1.101 CHECKS=55628 NODES=707	SAT TT=1.076 CHECKS=22366 NODES=0	SAT TT=0.233	SAT TT=0.211 CHECKS=224297	SAT TT=0.078 CHECKS=74568	SAT TT=0.845 ASSIGNMENTS=5	SAT TT=0.916 ASSIGNMENTS=5	SAT TT=0.914 CHECKS=50617 NODES=1173	SAT TT=0.68 CHECKS=124533 NODES=2734	SAT TT=0.79 CHECKS=758569 NODES=3923	SAT TT=0.053 ASSIGNMENTS=209 CHECKS=51803	SAT TT=0.054 ASSIGNMENTS=209 CHECKS=51803	SAT TT=1.507	SAT TT=1.717	No data	SAT TT=0.04 ASSIGNMENTS=206 CHECKS=45369	SAT TT=0.233 ASSIGNMENTS=4320 CHECKS=617494	SAT TT=0.605	SAT TT=0.051 ASSIGNMENTS=485 CHECKS=75484	SAT TT=0.037 ASSIGNMENTS=209 CHECKS=51803	SAT TT=1.535	SAT TT=0.157 ASSIGNMENTS=1046 CHECKS=135716	SAT TT=1.062	SAT TT=1.068
csp/bqwh-15-106/ normalized-bqwh-15-106-2_ext.xml	SAT TT=0.029	SAT TT=1.401 CHECKS=298547 NODES=2964	SAT TT=1.095 CHECKS=65050 NODES=687	SAT TT=0.134	SAT TT=0.083 CHECKS=68061	SAT TT=0.042 CHECKS=24112	SAT TT=1.028 ASSIGNMENTS=14	SAT TT=1.084 ASSIGNMENTS=20	SAT TT=1.879 CHECKS=234609 NODES=5231	SAT TT=0.785 CHECKS=708557 NODES=16990	SAT TT=0.668 CHECKS=413156 NODES=2022	SAT TT=0.044 ASSIGNMENTS=80 CHECKS=16593	SAT TT=0.042 ASSIGNMENTS=80 CHECKS=16593	SAT TT=1.444	SAT TT=1.593	No data	SAT TT=0.029 ASSIGNMENTS=69 CHECKS=15647	SAT TT=0.303 ASSIGNMENTS=5637 CHECKS=890572	SAT TT=0.655	SAT TT=0.051 ASSIGNMENTS=441 CHECKS=76168	SAT TT=0.029 ASSIGNMENTS=80 CHECKS=16593	SAT TT=1.714	SAT TT=1.465 ASSIGNMENTS=11890 CHECKS=2074690	SAT TT=1.025	SAT TT=1.054
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bqwh-15-106/ normalized-bqwh-15-106-51_ext.xml	SAT TT=0.036	SAT TT=1.106 CHECKS=73534 NODES=876	SAT TT=1.102 CHECKS=54740 NODES=431	SAT TT=0.288	SAT TT=0.171 CHECKS=155758	SAT TT=0.125 CHECKS=125583	SAT TT=1.147 ASSIGNMENTS=9	SAT TT=1.081 ASSIGNMENTS=9	SAT TT=0.665 CHECKS=8118 NODES=219	SAT TT=0.708 CHECKS=225571 NODES=5089	SAT TT=1.004 CHECKS=1551240 NODES=5649	SAT TT=0.067 ASSIGNMENTS=398 CHECKS=94326	SAT TT=0.068 ASSIGNMENTS=398 CHECKS=94326	SAT TT=1.468	SAT TT=1.662	No data	SAT TT=0.036 ASSIGNMENTS=140 CHECKS=33205	SAT TT=0.231 ASSIGNMENTS=4413 CHECKS=648137	SAT TT=0.624	SAT TT=0.041 ASSIGNMENTS=346 CHECKS=57116	SAT TT=0.052 ASSIGNMENTS=398 CHECKS=94326	SAT TT=1.528	SAT TT=0.059 ASSIGNMENTS=227 CHECKS=21228	SAT TT=1.242	SAT TT=1.067
csp/bqwh-15-106/ normalized-bqwh-15-106-52_ext.xml	SAT TT=0.03	SAT TT=1.411 CHECKS=319800 NODES=3226	SAT TT=1.074 CHECKS=35172 NODES=392	SAT TT=0.243	SAT TT=0.07 CHECKS=50343	SAT TT=0.146 CHECKS=181531	SAT TT=1.044 ASSIGNMENTS=11	SAT TT=1.059 ASSIGNMENTS=7	SAT TT=0.925 CHECKS=53239 NODES=1180	SAT TT=1.018 CHECKS=973881 NODES=22892	SAT TT=0.64 CHECKS=247236 NODES=1304	SAT TT=0.037 ASSIGNMENTS=27 CHECKS=7318	SAT TT=0.036 ASSIGNMENTS=27 CHECKS=7318	SAT TT=1.599	SAT TT=1.689	No data	SAT TT=0.03 ASSIGNMENTS=70 CHECKS=17163	SAT TT=0.306 ASSIGNMENTS=4963 CHECKS=841076	SAT TT=0.614	SAT TT=0.109 ASSIGNMENTS=1109 CHECKS=266851	SAT TT=0.03 ASSIGNMENTS=27 CHECKS=7318	SAT TT=1.66	SAT TT=0.098 ASSIGNMENTS=796 CHECKS=77988	SAT TT=1.149	SAT TT=1.022
csp/bqwh-15-106/ normalized-bqwh-15-106-7_ext.xml	SAT TT=0.049	SAT TT=1.37 CHECKS=251056 NODES=2553	SAT TT=1.211 CHECKS=78254 NODES=855	SAT TT=0.185	SAT TT=0.488 CHECKS=518036	SAT TT=0.5 CHECKS=667494	SAT TT=1.079 ASSIGNMENTS=48	SAT TT=1.311 ASSIGNMENTS=8	SAT TT=0.985 CHECKS=75899 NODES=1793	SAT TT=1.147 CHECKS=1828330 NODES=43827	? (TO) TT=1800.09	SAT TT=0.061 ASSIGNMENTS=372 CHECKS=85935	SAT TT=0.066 ASSIGNMENTS=372 CHECKS=85935	SAT TT=1.436	SAT TT=1.73	No data	SAT TT=0.049 ASSIGNMENTS=336 CHECKS=69647	SAT TT=0.4 ASSIGNMENTS=6446 CHECKS=1181050	SAT TT=0.685	SAT TT=0.142 ASSIGNMENTS=1752 CHECKS=354930	SAT TT=0.053 ASSIGNMENTS=372 CHECKS=85935	SAT TT=1.685	SAT TT=0.211 ASSIGNMENTS=830 CHECKS=93256	SAT TT=1.073	SAT TT=1.068
csp/bqwh-15-106/ normalized-bqwh-15-106-81_ext.xml	SAT TT=0.038	SAT TT=1.228 CHECKS=135966 NODES=1415	SAT TT=1.096 CHECKS=45539 NODES=433	SAT TT=0.202	SAT TT=0.669 CHECKS=765030	SAT TT=0.103 CHECKS=93482	SAT TT=1.164 ASSIGNMENTS=5	SAT TT=1.121 ASSIGNMENTS=7	SAT TT=1.304 CHECKS=124758 NODES=2649	SAT TT=0.683 CHECKS=138637 NODES=3093	SAT TT=0.789 CHECKS=857106 NODES=3798	SAT TT=0.109 ASSIGNMENTS=917 CHECKS=212840	SAT TT=0.102 ASSIGNMENTS=917 CHECKS=212840	SAT TT=1.799	SAT TT=1.551	No data	SAT TT=0.038 ASSIGNMENTS=175 CHECKS=37852	SAT TT=0.322 ASSIGNMENTS=5296 CHECKS=900062	SAT TT=1.08	SAT TT=0.071 ASSIGNMENTS=730 CHECKS=152727	SAT TT=0.09 ASSIGNMENTS=917 CHECKS=212840	SAT TT=1.662	SAT TT=0.978 ASSIGNMENTS=4431 CHECKS=812661	SAT TT=1.181	SAT TT=1.077
csp/bqwh-15-106/ normalized-bqwh-15-106-85_ext.xml	SAT TT=0.065	SAT TT=1.043 CHECKS=21842 NODES=330	SAT TT=1.012 CHECKS=19434 NODES=227	SAT TT=0.468	SAT TT=0.479 CHECKS=518289	SAT TT=0.185 CHECKS=206141	SAT TT=1.068 ASSIGNMENTS=2	SAT TT=1.101 ASSIGNMENTS=8	SAT TT=1.478 CHECKS=135956 NODES=2913	SAT TT=0.684 CHECKS=155310 NODES=3528	? (TO) TT=1800.04	SAT TT=0.091 ASSIGNMENTS=702 CHECKS=167198	SAT TT=0.095 ASSIGNMENTS=702 CHECKS=167198	SAT TT=1.451	SAT TT=1.535	No data	SAT TT=0.065 ASSIGNMENTS=531 CHECKS=116375	SAT TT=0.271 ASSIGNMENTS=4244 CHECKS=723496	SAT TT=0.636	SAT TT=0.107 ASSIGNMENTS=992 CHECKS=256985	SAT TT=0.077 ASSIGNMENTS=702 CHECKS=167198	SAT TT=1.846	SAT TT=0.508 ASSIGNMENTS=1470 CHECKS=253802	SAT TT=1.053	SAT TT=1.267
csp/bqwh-15-106/ normalized-bqwh-15-106-97_ext.xml	SAT TT=0.051	SAT TT=1.184 CHECKS=99563 NODES=1227	SAT TT=1.224 CHECKS=45180 NODES=526	SAT TT=0.154	SAT TT=0.175 CHECKS=169337	SAT TT=0.158 CHECKS=179270	SAT TT=1.033 ASSIGNMENTS=8	SAT TT=1.061 ASSIGNMENTS=6	SAT TT=0.657 CHECKS=13421 NODES=335	SAT TT=0.854 CHECKS=363920 NODES=8658	? (TO) TT=1800.07	SAT TT=0.081 ASSIGNMENTS=500 CHECKS=124762	SAT TT=0.078 ASSIGNMENTS=500 CHECKS=124762	SAT TT=1.693	SAT TT=1.549	No data	SAT TT=0.051 ASSIGNMENTS=332 CHECKS=73138	SAT TT=0.21 ASSIGNMENTS=4065 CHECKS=601033	SAT TT=0.655	SAT TT=0.088 ASSIGNMENTS=905 CHECKS=175586	SAT TT=0.063 ASSIGNMENTS=500 CHECKS=124762	SAT TT=1.598	SAT TT=0.094 ASSIGNMENTS=553 CHECKS=65832	SAT TT=1.022	SAT TT=1.048
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-0_glb.xml	SAT TT=0.032	SAT TT=1.125 CHECKS=8200 NODES=3370	SAT TT=0.963 CHECKS=1707 NODES=911	SAT TT=0.072	SAT TT=0.032 CHECKS=6410	SAT TT=0.109 CHECKS=32391	SAT TT=1.099 ASSIGNMENTS=51	SAT TT=1.114 ASSIGNMENTS=21	No data	No data	No data	SAT TT=0.077 ASSIGNMENTS=729 CHECKS=94465	SAT TT=0.075 ASSIGNMENTS=729 CHECKS=94465	No data	No data	No data	SAT TT=0.043 ASSIGNMENTS=540 CHECKS=58273	SAT TT=0.255 ASSIGNMENTS=5357 CHECKS=485477	SAT TT=0.456	SAT TT=0.042 ASSIGNMENTS=572 CHECKS=42287	SAT TT=0.334 ASSIGNMENTS=4125 CHECKS=610270	SAT TT=1.832	No data	SAT TT=1.347	SAT TT=1.513
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-14_glb.xml	SAT TT=0.033	SAT TT=2.037 CHECKS=46818 NODES=14371	SAT TT=1.569 CHECKS=21560 NODES=7151	SAT TT=0.315	SAT TT=0.034 CHECKS=10457	SAT TT=0.033 CHECKS=9951	SAT TT=0.795 ASSIGNMENTS=3	SAT TT=0.796 ASSIGNMENTS=5	No data	No data	No data	SAT TT=0.557 ASSIGNMENTS=6973 CHECKS=1000420	SAT TT=0.535 ASSIGNMENTS=6973 CHECKS=1000420	No data	No data	No data	SAT TT=0.705 ASSIGNMENTS=10076 CHECKS=1433040	SAT TT=0.871 ASSIGNMENTS=14860 CHECKS=1850530	SAT TT=0.419	SAT TT=2.839 ASSIGNMENTS=33027 CHECKS=4457020	SAT TT=0.803 ASSIGNMENTS=10657 CHECKS=1666760	SAT TT=1.604	No data	SAT TT=1.324	SAT TT=1.321
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-2_glb.xml	SAT TT=0.054	SAT TT=1.516 CHECKS=23233 NODES=8227	SAT TT=4.688 CHECKS=210427 NODES=50965	SAT TT=0.073	SAT TT=0.054 CHECKS=14796	SAT TT=0.161 CHECKS=50028	SAT TT=0.997 ASSIGNMENTS=21	SAT TT=1.096 ASSIGNMENTS=57	No data	No data	No data	SAT TT=0.422 ASSIGNMENTS=5596 CHECKS=775727	SAT TT=0.431 ASSIGNMENTS=5596 CHECKS=775727	No data	No data	No data	SAT TT=0.072 ASSIGNMENTS=1027 CHECKS=129429	SAT TT=0.97 ASSIGNMENTS=15796 CHECKS=1924050	SAT TT=0.451	SAT TT=47.082 ASSIGNMENTS=542471 CHECKS=73789300	SAT TT=0.412 ASSIGNMENTS=6621 CHECKS=854464	SAT TT=1.68	No data	SAT TT=1.343	SAT TT=1.433
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-37_glb.xml	SAT TT=0.03	SAT TT=1.155 CHECKS=9137 NODES=3380	SAT TT=1.078 CHECKS=1291 NODES=824	SAT TT=0.204	SAT TT=0.131 CHECKS=69241	SAT TT=0.165 CHECKS=79226	SAT TT=0.985 ASSIGNMENTS=4	SAT TT=1.223 ASSIGNMENTS=3	No data	No data	No data	SAT TT=0.227 ASSIGNMENTS=3055 CHECKS=396741	SAT TT=0.234 ASSIGNMENTS=3055 CHECKS=396741	No data	No data	No data	SAT TT=0.091 ASSIGNMENTS=1053 CHECKS=147109	SAT TT=0.333 ASSIGNMENTS=6833 CHECKS=613945	SAT TT=0.468	SAT TT=0.932 ASSIGNMENTS=9362 CHECKS=1351360	SAT TT=0.03 ASSIGNMENTS=326 CHECKS=35440	SAT TT=1.63	No data	SAT TT=1.311	SAT TT=1.419
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-40_glb.xml	SAT TT=0.032	SAT TT=1.052 CHECKS=5783 NODES=3281	SAT TT=0.96 CHECKS=1098 NODES=704	SAT TT=0.12	SAT TT=0.042 CHECKS=12005	SAT TT=0.046 CHECKS=12438	SAT TT=0.984 ASSIGNMENTS=50	SAT TT=0.978 ASSIGNMENTS=17	No data	No data	No data	SAT TT=0.046 ASSIGNMENTS=452 CHECKS=42336	SAT TT=0.047 ASSIGNMENTS=452 CHECKS=42336	No data	No data	No data	SAT TT=0.171 ASSIGNMENTS=2480 CHECKS=307072	SAT TT=0.387 ASSIGNMENTS=8952 CHECKS=772976	SAT TT=0.48	SAT TT=0.079 ASSIGNMENTS=1107 CHECKS=90985	SAT TT=0.032 ASSIGNMENTS=285 CHECKS=37150	SAT TT=1.797	No data	SAT TT=1.214	SAT TT=1.602
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-47_glb.xml	SAT TT=0.06	SAT TT=2.802 CHECKS=100871 NODES=25432	SAT TT=1.597 CHECKS=36628 NODES=9699	SAT TT=0.783	SAT TT=0.073 CHECKS=25326	SAT TT=0.06 CHECKS=20080	SAT TT=1.089 ASSIGNMENTS=3	SAT TT=0.957 ASSIGNMENTS=3	No data	No data	No data	SAT TT=8.541 ASSIGNMENTS=3	SAT TT=8.524 ASSIGNMENTS=3	No data	No data	No data	SAT TT=2.935 ASSIGNMENTS=39543 CHECKS=5759730	SAT TT=1.779 ASSIGNMENTS=29320 CHECKS=3779510	SAT TT=0.445	SAT TT=1.082 ASSIGNMENTS=12425 CHECKS=1708670	SAT TT=1.493 ASSIGNMENTS=22097 CHECKS=3156010	SAT TT=1.722	No data	SAT TT=1.233	SAT TT=1.476
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-64_glb.xml	SAT TT=0.034	SAT TT=0.811 CHECKS=577 NODES=421	SAT TT=1.834 CHECKS=31564 NODES=10411	SAT TT=0.351	SAT TT=0.051 CHECKS=14407	SAT TT=0.061 CHECKS=16291	SAT TT=0.935 ASSIGNMENTS=6	SAT TT=1.003 ASSIGNMENTS=11	No data	No data	No data	SAT TT=0.07 ASSIGNMENTS=645 CHECKS=88705	SAT TT=0.072 ASSIGNMENTS=645 CHECKS=88705	No data	No data	No data	SAT TT=0.034 ASSIGNMENTS=290 CHECKS=39106	SAT TT=0.208 ASSIGNMENTS=5575 CHECKS=410786	SAT TT=0.489	SAT TT=0.404 ASSIGNMENTS=5230 CHECKS=618761	SAT TT=2.73 ASSIGNMENTS=42387 CHECKS=5744570	SAT TT=1.819	No data	SAT TT=1.477	SAT TT=1.457
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-65_glb.xml	SAT TT=0.021	SAT TT=0.834 CHECKS=483 NODES=395	SAT TT=1.34 CHECKS=8037 NODES=3198	SAT TT=0.125	SAT TT=0.022 CHECKS=4510	SAT TT=0.021 CHECKS=4259	SAT TT=0.605 ASSIGNMENTS=2	SAT TT=0.64 ASSIGNMENTS=2	No data	No data	No data	SAT TT=0.464 ASSIGNMENTS=5236 CHECKS=861749	SAT TT=0.449 ASSIGNMENTS=5236 CHECKS=861749	No data	No data	No data	SAT TT=0.338 ASSIGNMENTS=3910 CHECKS=649668	SAT TT=0.28 ASSIGNMENTS=5656 CHECKS=549370	SAT TT=0.406	SAT TT=0.453 ASSIGNMENTS=5252 CHECKS=734925	SAT TT=0.177 ASSIGNMENTS=2243 CHECKS=337703	SAT TT=1.39	No data	SAT TT=1.423	SAT TT=1.249
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-89_glb.xml	SAT TT=0.03	SAT TT=0.92 CHECKS=1822 NODES=1168	SAT TT=1.012 CHECKS=425 NODES=369	SAT TT=0.534	SAT TT=0.184 CHECKS=68187	SAT TT=0.174 CHECKS=66523	SAT TT=1.075 ASSIGNMENTS=7	SAT TT=1.082 ASSIGNMENTS=11	No data	No data	No data	SAT TT=0.03 ASSIGNMENTS=168 CHECKS=14460	SAT TT=0.032 ASSIGNMENTS=168 CHECKS=14460	No data	No data	No data	SAT TT=0.039 ASSIGNMENTS=534 CHECKS=50005	SAT TT=0.229 ASSIGNMENTS=5783 CHECKS=456240	SAT TT=0.456	SAT TT=1.651 ASSIGNMENTS=23564 CHECKS=2666620	SAT TT=0.195 ASSIGNMENTS=3214 CHECKS=393093	SAT TT=1.486	No data	SAT TT=1.347	SAT TT=1.329
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-91_glb.xml	SAT TT=0.146	SAT TT=2.734 CHECKS=86161 NODES=25073	SAT TT=1.521 CHECKS=19571 NODES=6672	SAT TT=0.188	SAT TT=0.146 CHECKS=72860	SAT TT=0.151 CHECKS=73186	SAT TT=0.941 ASSIGNMENTS=4	SAT TT=1.091 ASSIGNMENTS=7	No data	No data	No data	SAT TT=0.305 ASSIGNMENTS=3730 CHECKS=553543	SAT TT=0.299 ASSIGNMENTS=3730 CHECKS=553543	No data	No data	No data	SAT TT=0.25 ASSIGNMENTS=3243 CHECKS=476810	SAT TT=0.896 ASSIGNMENTS=13992 CHECKS=1781910	SAT TT=0.525	SAT TT=0.508 ASSIGNMENTS=5410 CHECKS=812856	SAT TT=0.186 ASSIGNMENTS=2697 CHECKS=376476	SAT TT=1.714	No data	SAT TT=1.278	SAT TT=1.323
csp/bqwh-18-141/ normalized-bqwh-18-141-11_ext.xml	SAT TT=0.054	SAT TT=1.506 CHECKS=284208 NODES=2838	SAT TT=1.138 CHECKS=29756 NODES=316	SAT TT=0.173	SAT TT=0.138 CHECKS=115672	SAT TT=0.062 CHECKS=36064	SAT TT=1.265 ASSIGNMENTS=28	SAT TT=1.337 ASSIGNMENTS=23	SAT TT=2.269 CHECKS=239529 NODES=4254	SAT TT=1.183 CHECKS=1116660 NODES=22495	SAT TT=0.871 CHECKS=376575 NODES=1723	SAT TT=0.071 ASSIGNMENTS=230 CHECKS=77161	SAT TT=0.072 ASSIGNMENTS=230 CHECKS=77161	SAT TT=1.929	SAT TT=1.81	No data	SAT TT=0.054 ASSIGNMENTS=195 CHECKS=57662	SAT TT=0.334 ASSIGNMENTS=4912 CHECKS=845070	SAT TT=1.11	SAT TT=0.092 ASSIGNMENTS=733 CHECKS=156330	SAT TT=0.059 ASSIGNMENTS=230 CHECKS=77161	SAT TT=2.26	SAT TT=0.259 ASSIGNMENTS=1391 CHECKS=223636	SAT TT=1.189	SAT TT=1.477
csp/bqwh-18-141/ normalized-bqwh-18-141-19_ext.xml	SAT TT=0.223	SAT TT=2.523 CHECKS=1408250 NODES=10026	SAT TT=1.568 CHECKS=357886 NODES=3075	SAT TT=0.389	SAT TT=1.739 CHECKS=1804600	SAT TT=0.241 CHECKS=241010	SAT TT=1.369 ASSIGNMENTS=7	SAT TT=1.464 ASSIGNMENTS=6	SAT TT=1.215 CHECKS=90831 NODES=1502	SAT TT=0.905 CHECKS=482275 NODES=9192	? (TO) TT=1800.09	SAT TT=0.247 ASSIGNMENTS=2055 CHECKS=718290	SAT TT=0.25 ASSIGNMENTS=2055 CHECKS=718290	SAT TT=1.765	SAT TT=1.769	No data	SAT TT=0.343 ASSIGNMENTS=3253 CHECKS=1004950	SAT TT=0.408 ASSIGNMENTS=5494 CHECKS=1321650	SAT TT=1.26	SAT TT=0.223 ASSIGNMENTS=1674 CHECKS=623176	SAT TT=0.232 ASSIGNMENTS=2055 CHECKS=718290	SAT TT=1.91	SAT TT=0.846 ASSIGNMENTS=1785 CHECKS=384816	SAT TT=1.132	SAT TT=1.615
csp/bqwh-18-141/ normalized-bqwh-18-141-21_ext.xml	SAT TT=0.046	SAT TT=1.565 CHECKS=448647 NODES=4069	SAT TT=2.257 CHECKS=1073330 NODES=8263	SAT TT=0.182	SAT TT=0.086 CHECKS=50960	SAT TT=0.046 CHECKS=14102	SAT TT=1.37 ASSIGNMENTS=4	SAT TT=1.558 ASSIGNMENTS=6	SAT TT=0.916 CHECKS=25933 NODES=575	SAT TT=1.032 CHECKS=1208490 NODES=24522	SAT TT=1.132 CHECKS=2215980 NODES=8030	SAT TT=0.443 ASSIGNMENTS=3999 CHECKS=1190110	SAT TT=0.444 ASSIGNMENTS=3999 CHECKS=1190110	SAT TT=1.754	SAT TT=1.678	No data	SAT TT=0.414 ASSIGNMENTS=3871 CHECKS=1147500	SAT TT=0.299 ASSIGNMENTS=4678 CHECKS=786868	SAT TT=1.314	SAT TT=0.219 ASSIGNMENTS=1947 CHECKS=546992	SAT TT=0.42 ASSIGNMENTS=3999 CHECKS=1190110	SAT TT=2.314	SAT TT=2.064 ASSIGNMENTS=8440 CHECKS=2015210	SAT TT=1.376	SAT TT=1.409
csp/bqwh-18-141/ normalized-bqwh-18-141-3_ext.xml	SAT TT=0.258	SAT TT=16.573 CHECKS=16551100 NODES=129906	SAT TT=13.396 CHECKS=13254000 NODES=107724	SAT TT=2.999	SAT TT=2.862 CHECKS=3074660	SAT TT=0.258 CHECKS=280755	SAT TT=1.504 ASSIGNMENTS=71	SAT TT=1.592 ASSIGNMENTS=69	SAT TT=3.039 CHECKS=351226 NODES=6716	SAT TT=1.718 CHECKS=3412370 NODES=68716	? (TO) TT=1800.06	SAT TT=0.319 ASSIGNMENTS=2775 CHECKS=853391	SAT TT=0.317 ASSIGNMENTS=2775 CHECKS=853391	SAT TT=1.882	SAT TT=1.859	No data	SAT TT=0.747 ASSIGNMENTS=7458 CHECKS=2197000	SAT TT=0.406 ASSIGNMENTS=6142 CHECKS=1143690	SAT TT=1.705	SAT TT=6.23 ASSIGNMENTS=63495 CHECKS=19093000	SAT TT=0.305 ASSIGNMENTS=2775 CHECKS=853391	SAT TT=2.096	SAT TT=1.936 ASSIGNMENTS=9626 CHECKS=1770000	SAT TT=1.451	SAT TT=1.43
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bqwh-18-141/ normalized-bqwh-18-141-42_ext.xml	SAT TT=0.243	SAT TT=7.257 CHECKS=6569900 NODES=44702	SAT TT=6.586 CHECKS=5771170 NODES=40818	SAT TT=2.277	SAT TT=2.144 CHECKS=2304000	SAT TT=0.552 CHECKS=611698	SAT TT=1.616 ASSIGNMENTS=73	SAT TT=1.759 ASSIGNMENTS=85	SAT TT=8.51 CHECKS=1425510 NODES=24447	SAT TT=5.161 CHECKS=17067300 NODES=348295	? (TO) TT=1800.02	SAT TT=0.288 ASSIGNMENTS=2245 CHECKS=724251	SAT TT=0.289 ASSIGNMENTS=2245 CHECKS=724251	SAT TT=1.75	SAT TT=1.862	No data	SAT TT=0.243 ASSIGNMENTS=1947 CHECKS=634476	SAT TT=1.427 ASSIGNMENTS=15919 CHECKS=4122020	SAT TT=5.59	SAT TT=0.427 ASSIGNMENTS=3876 CHECKS=1142500	SAT TT=0.272 ASSIGNMENTS=2245 CHECKS=724251	SAT TT=2.585	SAT TT=2.47 ASSIGNMENTS=275 CHECKS=43049	SAT TT=1.468	SAT TT=1.165
csp/bqwh-18-141/ normalized-bqwh-18-141-72_ext.xml	SAT TT=0.106	SAT TT=2.14 CHECKS=1143180 NODES=8627	SAT TT=1.37 CHECKS=224404 NODES=1812	SAT TT=0.334	SAT TT=0.303 CHECKS=330761	SAT TT=0.42 CHECKS=469573	SAT TT=1.449 ASSIGNMENTS=8	SAT TT=1.344 ASSIGNMENTS=7	SAT TT=1.022 CHECKS=45793 NODES=880	SAT TT=0.739 CHECKS=146737 NODES=2993	? (TO) TT=1800.06	SAT TT=0.334 ASSIGNMENTS=2781 CHECKS=883301	SAT TT=0.311 ASSIGNMENTS=2781 CHECKS=883301	SAT TT=1.782	SAT TT=1.693	No data	SAT TT=0.184 ASSIGNMENTS=1486 CHECKS=458969	SAT TT=0.34 ASSIGNMENTS=5100 CHECKS=976793	SAT TT=1.088	SAT TT=0.106 ASSIGNMENTS=779 CHECKS=213187	SAT TT=0.319 ASSIGNMENTS=2781 CHECKS=883301	SAT TT=2.357	SAT TT=0.523 ASSIGNMENTS=2242 CHECKS=537472	SAT TT=1.246	SAT TT=1.266
csp/bqwh-18-141/ normalized-bqwh-18-141-73_ext.xml	SAT TT=0.098	SAT TT=1.981 CHECKS=739890 NODES=6134	SAT TT=2.168 CHECKS=881477 NODES=6902	SAT TT=0.999	SAT TT=0.429 CHECKS=425415	SAT TT=0.098 CHECKS=75655	SAT TT=1.388 ASSIGNMENTS=58	SAT TT=1.435 ASSIGNMENTS=52	SAT TT=9.209 CHECKS=1288590 NODES=25863	SAT TT=1.214 CHECKS=1145820 NODES=22455	? (TO) TT=1800.07	SAT TT=8.28 ASSIGNMENTS=58	SAT TT=9.242 ASSIGNMENTS=58	SAT TT=1.945	SAT TT=1.851	No data	SAT TT=0.668 ASSIGNMENTS=5872 CHECKS=1952910	SAT TT=2.723 ASSIGNMENTS=28945 CHECKS=8429730	SAT TT=25.672	SAT TT=2.064 ASSIGNMENTS=21270 CHECKS=6577230	SAT TT=2.887 ASSIGNMENTS=34143 CHECKS=9395700	SAT TT=2.431	SAT TT=0.839 ASSIGNMENTS=5161 CHECKS=851609	SAT TT=1.18	SAT TT=1.154
csp/bqwh-18-141/ normalized-bqwh-18-141-78_ext.xml	SAT TT=0.129	SAT TT=1.545 CHECKS=361033 NODES=3455	SAT TT=1.494 CHECKS=224455 NODES=1778	SAT TT=0.523	SAT TT=0.359 CHECKS=397093	SAT TT=0.172 CHECKS=180165	SAT TT=1.182 ASSIGNMENTS=4	SAT TT=1.212 ASSIGNMENTS=3	SAT TT=0.96 CHECKS=43239 NODES=861	SAT TT=1.471 CHECKS=2511080 NODES=53055	? (TO) TT=1800.06	SAT TT=0.179 ASSIGNMENTS=1498 CHECKS=449369	SAT TT=0.181 ASSIGNMENTS=1498 CHECKS=449369	SAT TT=1.919	SAT TT=1.753	No data	SAT TT=0.138 ASSIGNMENTS=1137 CHECKS=359250	SAT TT=0.43 ASSIGNMENTS=5476 CHECKS=1151360	SAT TT=1.035	SAT TT=0.143 ASSIGNMENTS=1329 CHECKS=346124	SAT TT=0.168 ASSIGNMENTS=1498 CHECKS=449369	SAT TT=2.002	SAT TT=0.129 ASSIGNMENTS=551 CHECKS=56083	SAT TT=1.38	SAT TT=1.188
csp/bqwh-18-141/ normalized-bqwh-18-141-83_ext.xml	SAT TT=0.042	SAT TT=2.013 CHECKS=910266 NODES=7763	SAT TT=2.071 CHECKS=880500 NODES=7704	SAT TT=0.696	SAT TT=0.323 CHECKS=342669	SAT TT=0.63 CHECKS=832846	SAT TT=1.503 ASSIGNMENTS=5	SAT TT=1.291 ASSIGNMENTS=10	SAT TT=0.961 CHECKS=36427 NODES=766	SAT TT=0.832 CHECKS=338050 NODES=7083	SAT TT=0.873 CHECKS=741497 NODES=2607	SAT TT=0.055 ASSIGNMENTS=116 CHECKS=35089	SAT TT=0.057 ASSIGNMENTS=116 CHECKS=35089	SAT TT=1.749	SAT TT=1.758	No data	SAT TT=0.046 ASSIGNMENTS=128 CHECKS=40030	SAT TT=0.293 ASSIGNMENTS=4745 CHECKS=742269	SAT TT=0.779	SAT TT=0.094 ASSIGNMENTS=819 CHECKS=178013	SAT TT=0.042 ASSIGNMENTS=116 CHECKS=35089	SAT TT=2.061	SAT TT=0.1 ASSIGNMENTS=513 CHECKS=57747	SAT TT=1.546	SAT TT=1.363
csp/bqwh-18-141/ normalized-bqwh-18-141-8_ext.xml	SAT TT=0.056	SAT TT=1.156 CHECKS=72926 NODES=868	SAT TT=1.28 CHECKS=61774 NODES=685	SAT TT=0.189	SAT TT=0.104 CHECKS=69526	SAT TT=0.056 CHECKS=21517	SAT TT=1.496 ASSIGNMENTS=90	SAT TT=1.382 ASSIGNMENTS=12	SAT TT=0.917 CHECKS=26245 NODES=602	SAT TT=1.355 CHECKS=2566000 NODES=49976	? (TO) TT=1800.01	SAT TT=0.086 ASSIGNMENTS=473 CHECKS=120522	SAT TT=0.09 ASSIGNMENTS=473 CHECKS=120522	SAT TT=1.94	SAT TT=1.831	No data	SAT TT=0.339 ASSIGNMENTS=2985 CHECKS=915924	SAT TT=0.362 ASSIGNMENTS=5209 CHECKS=969287	SAT TT=0.83	SAT TT=0.09 ASSIGNMENTS=673 CHECKS=158725	SAT TT=0.078 ASSIGNMENTS=473 CHECKS=120522	SAT TT=2.395	SAT TT=0.138 ASSIGNMENTS=797 CHECKS=87718	SAT TT=1.371	SAT TT=1.178
csp/CabinetStart1/ normalized-cabinet-5561.xml	UNSAT TT=0.284	? (TO) TT=1800.16	? (TO) TT=1800.11	UNSAT TT=0.284	UNSAT TT=11.406 CHECKS=7114500	UNSAT TT=8.056 CHECKS=3302880	UNSAT TT=11.558 ASSIGNMENTS=38275	? (TO) TT=1800.12	No data	No data	No data	UNSAT TT=0.689 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.742 ASSIGNMENTS=8892 CHECKS=473596	No data	No data	No data	UNSAT TT=0.772 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.71 ASSIGNMENTS=10816 CHECKS=466154	? (exit code) TT=0.406	UNSAT TT=2.365 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.386 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.214	No data	? TT=306.179	? TT=282.416
csp/CabinetStart1/ normalized-cabinet-5562.xml	UNSAT TT=0.291	? (TO) TT=1800.12	? (TO) TT=1800.12	UNSAT TT=0.291	UNSAT TT=12.538 CHECKS=7450330	UNSAT TT=8.038 CHECKS=3304980	UNSAT TT=12.619 ASSIGNMENTS=38275	? (TO) TT=1800.07	No data	No data	No data	UNSAT TT=0.732 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.73 ASSIGNMENTS=8892 CHECKS=473596	No data	No data	No data	UNSAT TT=0.781 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.697 ASSIGNMENTS=10368 CHECKS=459846	? (exit code) TT=0.543	UNSAT TT=2.522 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.579 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.164	No data	? (TO) TT=286.024	? TT=305.102
csp/CabinetStart1/ normalized-cabinet-5563.xml	UNSAT TT=0.268	? (TO) TT=1800.14	? (TO) TT=1800.15	UNSAT TT=0.268	UNSAT TT=11.552 CHECKS=7146360	UNSAT TT=8.675 CHECKS=3324820	UNSAT TT=12.489 ASSIGNMENTS=38275	? (TO) TT=1800.07	No data	No data	No data	UNSAT TT=0.697 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.688 ASSIGNMENTS=8892 CHECKS=473596	No data	No data	No data	UNSAT TT=0.782 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.706 ASSIGNMENTS=10512 CHECKS=461168	? (exit code) TT=0.387	UNSAT TT=2.518 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.55 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.426	No data	? TT=282.761	? TT=302.893
csp/CabinetStart1/ normalized-cabinet-5564.xml	UNSAT TT=0.29	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.29	UNSAT TT=11.323 CHECKS=7123220	UNSAT TT=8.055 CHECKS=3295750	UNSAT TT=11.598 ASSIGNMENTS=38275	? (TO) TT=1800.14	No data	No data	No data	UNSAT TT=0.696 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.694 ASSIGNMENTS=8892 CHECKS=473596	No data	No data	No data	UNSAT TT=0.724 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.706 ASSIGNMENTS=11376 CHECKS=504429	? (exit code) TT=0.372	UNSAT TT=2.367 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.391 ASSIGNMENTS=28555 CHECKS=1785950	? TT=2.83	No data	? TT=294.244	? TT=284.202
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/CabinetStart1/ normalized-cabinet-5565.xml	UNSAT TT=0.289	? (MO) TT=1.135	? (TO) TT=1800.11	UNSAT TT=0.289	UNSAT TT=11.441 CHECKS=7124910	UNSAT TT=7.967 CHECKS=3289840	UNSAT TT=12.569 ASSIGNMENTS=38275	? (TO) TT=1800.08	No data	No data	No data	UNSAT TT=0.683 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.682 ASSIGNMENTS=8892 CHECKS=473596	No data	No data	No data	UNSAT TT=0.785 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.715 ASSIGNMENTS=10925 CHECKS=469228	? (exit code) TT=0.389	UNSAT TT=2.54 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.554 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.247	No data	? TT=283.717	? TT=306.186
csp/CabinetStart1/ normalized-cabinet-5566.xml	UNSAT TT=0.287	? (TO) TT=1800.09	? (TO) TT=1800.14	UNSAT TT=0.287	UNSAT TT=12.568 CHECKS=7429590	UNSAT TT=8.695 CHECKS=3282580	UNSAT TT=12.547 ASSIGNMENTS=38275	? (TO) TT=1800.1	No data	No data	No data	UNSAT TT=0.692 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.734 ASSIGNMENTS=8892 CHECKS=473596	No data	No data	No data	UNSAT TT=0.724 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.644 ASSIGNMENTS=10666 CHECKS=457138	? (exit code) TT=0.502	UNSAT TT=2.361 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.565 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.27	No data	? TT=283.275	? TT=305.846
csp/CabinetStart1/ normalized-cabinet-5567.xml	UNSAT TT=0.269	? (TO) TT=1800.1	? (TO) TT=1800.15	UNSAT TT=0.269	UNSAT TT=11.37 CHECKS=7121260	UNSAT TT=8.224 CHECKS=3318140	UNSAT TT=11.614 ASSIGNMENTS=38275	? (TO) TT=1800.08	No data	No data	No data	UNSAT TT=0.697 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.692 ASSIGNMENTS=8892 CHECKS=473596	No data	No data	No data	UNSAT TT=0.726 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.702 ASSIGNMENTS=10857 CHECKS=498040	? (exit code) TT=0.471	UNSAT TT=2.393 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.399 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.673	No data	? TT=305.484	? (TO) TT=286.193
csp/CabinetStart1/ normalized-cabinet-5568.xml	UNSAT TT=0.288	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=0.288	UNSAT TT=12.211 CHECKS=7116520	UNSAT TT=8.676 CHECKS=3297890	UNSAT TT=11.558 ASSIGNMENTS=38275	? (TO) TT=1800.08	No data	No data	No data	UNSAT TT=0.736 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.734 ASSIGNMENTS=8892 CHECKS=473596	No data	No data	No data	UNSAT TT=0.776 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.666 ASSIGNMENTS=10190 CHECKS=441920	? (exit code) TT=0.47	UNSAT TT=2.53 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.585 ASSIGNMENTS=28555 CHECKS=1785950	? TT=2.971	No data	? TT=304.841	? TT=305.267
csp/CabinetStart1/ normalized-cabinet-5569.xml	UNSAT TT=0.269	? (TO) TT=1800.11	? (TO) TT=1800.13	UNSAT TT=0.269	UNSAT TT=12.502 CHECKS=7437300	UNSAT TT=8.69 CHECKS=3292880	UNSAT TT=13.861 ASSIGNMENTS=38275	? (TO) TT=1800.1	No data	No data	No data	UNSAT TT=0.742 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.742 ASSIGNMENTS=8892 CHECKS=473596	No data	No data	No data	UNSAT TT=0.774 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.694 ASSIGNMENTS=10495 CHECKS=457235	? (exit code) TT=0.498	UNSAT TT=2.551 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.578 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.318	No data	? TT=293.134	? TT=304.502
csp/CabinetStart1/ normalized-cabinet-5570.xml	UNSAT TT=0.27	? (TO) TT=1800.12	? (TO) TT=1800.1	UNSAT TT=0.27	UNSAT TT=12.398 CHECKS=7111560	UNSAT TT=8.672 CHECKS=3297890	UNSAT TT=11.529 ASSIGNMENTS=38275	? (TO) TT=1800.08	No data	No data	No data	UNSAT TT=0.685 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.688 ASSIGNMENTS=8892 CHECKS=473596	No data	No data	No data	UNSAT TT=0.774 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.623 ASSIGNMENTS=9716 CHECKS=412116	? (exit code) TT=0.383	UNSAT TT=2.547 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.396 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.221	No data	? TT=285.791	? TT=307.043
csp/CabinetStart1/ normalized-cabinet-5571.xml	UNSAT TT=0.292	? (TO) TT=1800.13	? (TO) TT=1800.12	UNSAT TT=0.292	UNSAT TT=11.817 CHECKS=7455390	UNSAT TT=8.059 CHECKS=3302380	UNSAT TT=12.004 ASSIGNMENTS=39462	? (TO) TT=1800.09	No data	No data	No data	UNSAT TT=0.669 ASSIGNMENTS=8441 CHECKS=466270	UNSAT TT=0.672 ASSIGNMENTS=8441 CHECKS=466270	No data	No data	No data	UNSAT TT=0.672 ASSIGNMENTS=9066 CHECKS=447718	UNSAT TT=0.79 ASSIGNMENTS=12450 CHECKS=570527	? (exit code) TT=0.373	UNSAT TT=2.667 ASSIGNMENTS=78487 CHECKS=1811980	UNSAT TT=2.745 ASSIGNMENTS=34187 CHECKS=2035180	? TT=3.452	No data	? TT=325.627	? TT=308.704
csp/CabinetStart1/ normalized-cabinet-5572.xml	UNSAT TT=0.269	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.269	UNSAT TT=11.692 CHECKS=7450440	UNSAT TT=8.136 CHECKS=3322040	UNSAT TT=12.087 ASSIGNMENTS=39460	? (TO) TT=1800.15	No data	No data	No data	UNSAT TT=0.664 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.672 ASSIGNMENTS=8441 CHECKS=466394	No data	No data	No data	UNSAT TT=0.771 ASSIGNMENTS=9925 CHECKS=518843	UNSAT TT=0.788 ASSIGNMENTS=12596 CHECKS=555689	? (exit code) TT=0.484	UNSAT TT=2.645 ASSIGNMENTS=78487 CHECKS=1812240	UNSAT TT=3.117 ASSIGNMENTS=41547 CHECKS=2288640	? TT=3.011	No data	? TT=289.438	? TT=307.678
csp/CabinetStart1/ normalized-cabinet-5573.xml	UNSAT TT=0.271	? (TO) TT=1800.07	? (MO) TT=0.96	UNSAT TT=0.271	UNSAT TT=12.588 CHECKS=7455190	UNSAT TT=8.488 CHECKS=3270480	UNSAT TT=12.024 ASSIGNMENTS=39462	? (TO) TT=1800.06	No data	No data	No data	UNSAT TT=0.722 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.723 ASSIGNMENTS=8441 CHECKS=466394	No data	No data	No data	UNSAT TT=0.729 ASSIGNMENTS=9925 CHECKS=518843	UNSAT TT=0.607 ASSIGNMENTS=9751 CHECKS=436963	? (exit code) TT=0.403	UNSAT TT=2.849 ASSIGNMENTS=78487 CHECKS=1812240	UNSAT TT=3.359 ASSIGNMENTS=41547 CHECKS=2288640	? TT=3.06	No data	? TT=313	? TT=286.233
csp/CabinetStart1/ normalized-cabinet-5574.xml	UNSAT TT=0.287	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.287	UNSAT TT=12.553 CHECKS=7432830	UNSAT TT=8.511 CHECKS=3276460	UNSAT TT=12.668 ASSIGNMENTS=39462	? (TO) TT=1800.09	No data	No data	No data	UNSAT TT=0.668 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.673 ASSIGNMENTS=8441 CHECKS=466394	No data	No data	No data	UNSAT TT=0.725 ASSIGNMENTS=9925 CHECKS=518843	UNSAT TT=0.718 ASSIGNMENTS=11044 CHECKS=514701	? (exit code) TT=0.377	UNSAT TT=2.865 ASSIGNMENTS=78487 CHECKS=1812240	UNSAT TT=3.366 ASSIGNMENTS=41547 CHECKS=2288640	? TT=3.157	No data	? TT=303.073	? TT=284.079
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/CabinetStart1/ normalized-cabinet-5575.xml	UNSAT TT=0.291	? (TO) TT=1800.08	? (TO) TT=1800.11	UNSAT TT=0.291	UNSAT TT=12.684 CHECKS=7461890	UNSAT TT=8.661 CHECKS=3294400	UNSAT TT=12.711 ASSIGNMENTS=39462	? (TO) TT=1800.14	No data	No data	No data	UNSAT TT=0.678 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.672 ASSIGNMENTS=8441 CHECKS=466394	No data	No data	No data	UNSAT TT=0.781 ASSIGNMENTS=9925 CHECKS=518843	UNSAT TT=0.726 ASSIGNMENTS=11115 CHECKS=478572	? (exit code) TT=0.482	UNSAT TT=2.854 ASSIGNMENTS=78487 CHECKS=1812240	UNSAT TT=3.341 ASSIGNMENTS=41547 CHECKS=2288640	? TT=3.205	No data	? TT=698.232	? TT=308.5
csp/CabinetStart1/ normalized-cabinet-5576.xml	UNSAT TT=0.269	? (TO) TT=1800.12	? (TO) TT=1800.14	UNSAT TT=0.269	UNSAT TT=11.758 CHECKS=7454600	UNSAT TT=8.632 CHECKS=3298300	UNSAT TT=12.766 ASSIGNMENTS=40031	? (TO) TT=1800.15	No data	No data	No data	UNSAT TT=0.85 ASSIGNMENTS=10710 CHECKS=537435	UNSAT TT=0.849 ASSIGNMENTS=10710 CHECKS=537435	No data	No data	No data	UNSAT TT=0.686 ASSIGNMENTS=8731 CHECKS=451879	UNSAT TT=0.798 ASSIGNMENTS=11218 CHECKS=535326	? (exit code) TT=0.445	UNSAT TT=2.085 ASSIGNMENTS=38593 CHECKS=1326990	UNSAT TT=3.111 ASSIGNMENTS=36670 CHECKS=2147730	? TT=3.144	No data	? TT=288.126	? TT=303.94
csp/CabinetStart1/ normalized-cabinet-5577.xml	UNSAT TT=0.29	? (TO) TT=1800.13	? (TO) TT=1800.13	UNSAT TT=0.29	UNSAT TT=12.673 CHECKS=7443820	UNSAT TT=8.069 CHECKS=3287870	UNSAT TT=12.009 ASSIGNMENTS=40201	? (TO) TT=1800.11	No data	No data	No data	UNSAT TT=0.823 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.823 ASSIGNMENTS=10301 CHECKS=519830	No data	No data	No data	UNSAT TT=0.692 ASSIGNMENTS=8811 CHECKS=455213	UNSAT TT=0.693 ASSIGNMENTS=10364 CHECKS=461392	? (exit code) TT=0.447	UNSAT TT=2.355 ASSIGNMENTS=34962 CHECKS=1517420	UNSAT TT=1.912 ASSIGNMENTS=25517 CHECKS=1413600	? TT=3.428	No data	? TT=302.09	? TT=307.88
csp/CabinetStart1/ normalized-cabinet-5578.xml	UNSAT TT=0.29	? (TO) TT=1800.13	? (TO) TT=1800.13	UNSAT TT=0.29	UNSAT TT=12.659 CHECKS=7457420	UNSAT TT=8.547 CHECKS=3270660	UNSAT TT=11.635 ASSIGNMENTS=39137	? (TO) TT=1800.07	No data	No data	No data	UNSAT TT=0.759 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.822 ASSIGNMENTS=10301 CHECKS=519830	No data	No data	No data	UNSAT TT=0.644 ASSIGNMENTS=8811 CHECKS=455213	UNSAT TT=0.611 ASSIGNMENTS=10517 CHECKS=442125	? (exit code) TT=0.393	UNSAT TT=2.324 ASSIGNMENTS=34962 CHECKS=1517420	UNSAT TT=2.038 ASSIGNMENTS=25517 CHECKS=1413600	? TT=2.991	No data	? TT=289.782	? TT=307.153
csp/CabinetStart1/ normalized-cabinet-5579.xml	UNSAT TT=0.272	? (TO) TT=1800.12	? (TO) TT=1800.12	UNSAT TT=0.272	UNSAT TT=11.841 CHECKS=7447800	UNSAT TT=8.682 CHECKS=3291720	UNSAT TT=11.9 ASSIGNMENTS=40137	? (TO) TT=1800.15	No data	No data	No data	UNSAT TT=0.82 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.816 ASSIGNMENTS=10301 CHECKS=519830	No data	No data	No data	UNSAT TT=0.687 ASSIGNMENTS=8811 CHECKS=455213	UNSAT TT=0.792 ASSIGNMENTS=11906 CHECKS=529763	? (exit code) TT=0.401	UNSAT TT=2.363 ASSIGNMENTS=34962 CHECKS=1517420	UNSAT TT=2.053 ASSIGNMENTS=25517 CHECKS=1413600	? TT=3.202	No data	? TT=286.458	? TT=309.661
csp/CabinetStart1/ normalized-cabinet-5580.xml	UNSAT TT=0.27	? (TO) TT=1800.14	? (TO) TT=1800.16	UNSAT TT=0.27	UNSAT TT=11.838 CHECKS=7430890	UNSAT TT=8.113 CHECKS=3291660	UNSAT TT=11.958 ASSIGNMENTS=39267	? (TO) TT=1800.17	No data	No data	No data	UNSAT TT=0.762 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.756 ASSIGNMENTS=10301 CHECKS=519830	No data	No data	No data	UNSAT TT=0.637 ASSIGNMENTS=8811 CHECKS=455213	UNSAT TT=0.645 ASSIGNMENTS=11030 CHECKS=461402	? (exit code) TT=0.376	UNSAT TT=2.168 ASSIGNMENTS=34962 CHECKS=1517420	UNSAT TT=1.922 ASSIGNMENTS=25517 CHECKS=1413600	? TT=3.037	No data	? TT=286.938	? TT=287.011
csp/CabinetStart1/ normalized-cabinet-5581.xml	SAT TT=0.025	? (TO) TT=1800.12	? (TO) TT=1800.08	SAT TT=0.061	SAT TT=10.84 CHECKS=6305790	SAT TT=6.716 CHECKS=1948630	SAT TT=6.965 ASSIGNMENTS=6049	? (TO) TT=1800.14	No data	No data	No data	SAT TT=0.043 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.034 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.036 ASSIGNMENTS=159 CHECKS=6886	? (exit code) TT=0.506	SAT TT=0.806 ASSIGNMENTS=19526 CHECKS=497102	SAT TT=0.025 ASSIGNMENTS=16 CHECKS=1481	? TT=3.049	No data	? TT=300.825	? TT=290.904
csp/CabinetStart1/ normalized-cabinet-5582.xml	SAT TT=0.023	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=0.061	SAT TT=10.616 CHECKS=6301260	SAT TT=7.053 CHECKS=1939440	SAT TT=7.574 ASSIGNMENTS=6052	? (TO) TT=1800.07	No data	No data	No data	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.025 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.063 ASSIGNMENTS=755 CHECKS=29306	? (exit code) TT=0.459	SAT TT=0.037 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.023 ASSIGNMENTS=17 CHECKS=1476	? TT=2.908	No data	? TT=308.122	? TT=289.31
csp/CabinetStart1/ normalized-cabinet-5583.xml	SAT TT=0.026	? (TO) TT=1800.12	? (TO) TT=1800.08	SAT TT=0.063	SAT TT=11.338 CHECKS=6297920	SAT TT=7.08 CHECKS=1945670	SAT TT=6.896 ASSIGNMENTS=6049	? (TO) TT=1800.15	No data	No data	No data	SAT TT=0.04 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.033 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.027 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.035 ASSIGNMENTS=171 CHECKS=6827	? (exit code) TT=0.402	SAT TT=0.039 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.026 ASSIGNMENTS=17 CHECKS=1476	? TT=3.007	No data	? (TO) TT=279.433	? (TO) TT=282.599
csp/CabinetStart1/ normalized-cabinet-5584.xml	SAT TT=0.023	? (TO) TT=1800.17	? (TO) TT=1800.12	SAT TT=0.06	SAT TT=10.619 CHECKS=6302680	SAT TT=6.57 CHECKS=1941980	SAT TT=6.889 ASSIGNMENTS=6049	SAT TT=1207.97 ASSIGNMENTS=963829	No data	No data	No data	SAT TT=0.039 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.04 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=264 CHECKS=10386	? (exit code) TT=0.497	SAT TT=0.038 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.023 ASSIGNMENTS=17 CHECKS=1476	? TT=2.836	No data	? TT=309.925	? TT=289.202
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/CabinetStart1/ normalized-cabinet-5585.xml	SAT TT=0.026	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=0.064	SAT TT=11.508 CHECKS=6334000	SAT TT=6.572 CHECKS=1941020	SAT TT=7.55 ASSIGNMENTS=6049	SAT TT=1543.41 ASSIGNMENTS=1698160	No data	No data	No data	SAT TT=0.041 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.039 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.035 ASSIGNMENTS=170 CHECKS=6878	? (exit code) TT=0.494	SAT TT=0.039 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.026 ASSIGNMENTS=17 CHECKS=1476	? TT=3.105	No data	? TT=344.632	? TT=309.957
csp/CabinetStart1/ normalized-cabinet-5586.xml	SAT TT=0.024	? (TO) TT=1800.14	? (TO) TT=1800.16	SAT TT=0.062	SAT TT=11.575 CHECKS=6312880	SAT TT=7.05 CHECKS=1935290	SAT TT=7.794 ASSIGNMENTS=6049	SAT TT=911.331 ASSIGNMENTS=1400040	No data	No data	No data	SAT TT=0.041 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.044 ASSIGNMENTS=294 CHECKS=12512	? (exit code) TT=0.383	SAT TT=0.037 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.024 ASSIGNMENTS=17 CHECKS=1476	? TT=3.413	No data	? TT=537.529	? TT=310.182
csp/CabinetStart1/ normalized-cabinet-5587.xml	SAT TT=0.024	? (TO) TT=1800.16	? (TO) TT=1800.08	SAT TT=0.059	SAT TT=11.335 CHECKS=6293510	SAT TT=6.54 CHECKS=1952360	SAT TT=7.58 ASSIGNMENTS=6049	? (TO) TT=1800.1	No data	No data	No data	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.024 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.027 ASSIGNMENTS=68 CHECKS=3386	? (exit code) TT=0.402	SAT TT=0.037 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.028 ASSIGNMENTS=17 CHECKS=1476	? TT=3.155	No data	? TT=292.916	? TT=287.529
csp/CabinetStart1/ normalized-cabinet-5588.xml	SAT TT=0.025	? (TO) TT=1800.12	? (TO) TT=1800.07	SAT TT=0.06	SAT TT=11.481 CHECKS=6314090	SAT TT=7.168 CHECKS=1925680	SAT TT=7.646 ASSIGNMENTS=6049	? (TO) TT=1800.13	No data	No data	No data	SAT TT=0.04 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.025 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=162 CHECKS=7229	? (exit code) TT=0.503	SAT TT=0.037 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.027 ASSIGNMENTS=17 CHECKS=1476	? TT=3.08	No data	? TT=290.288	? TT=310.364
csp/CabinetStart1/ normalized-cabinet-5589.xml	SAT TT=0.026	? (TO) TT=1800.18	? (TO) TT=1800.14	SAT TT=0.065	SAT TT=10.887 CHECKS=6320890	SAT TT=6.478 CHECKS=1931750	SAT TT=8.227 ASSIGNMENTS=6049	? (TO) TT=1800.09	No data	No data	No data	SAT TT=0.041 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.027 ASSIGNMENTS=37 CHECKS=2134	? (exit code) TT=0.401	SAT TT=0.042 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.026 ASSIGNMENTS=17 CHECKS=1476	? TT=3.121	No data	? TT=282.97	? TT=310.92
csp/CabinetStart1/ normalized-cabinet-5590.xml	SAT TT=0.022	? (TO) TT=1800.13	? (TO) TT=1800.15	SAT TT=0.065	SAT TT=11.475 CHECKS=6288070	SAT TT=7.027 CHECKS=1958730	SAT TT=7.533 ASSIGNMENTS=6049	SAT TT=41.465 ASSIGNMENTS=27035	No data	No data	No data	SAT TT=0.044 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.022 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.033 ASSIGNMENTS=85 CHECKS=3407	? (exit code) TT=0.493	SAT TT=0.038 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.025 ASSIGNMENTS=17 CHECKS=1476	? TT=3.22	No data	? TT=291.099	? TT=288.976
csp/CabinetStart1/ normalized-cabinet-5591.xml	SAT TT=0.023	? (TO) TT=1800.08	? (TO) TT=1800.17	SAT TT=0.064	SAT TT=11.674 CHECKS=6306340	SAT TT=6.903 CHECKS=1908830	SAT TT=7.377 ASSIGNMENTS=6049	SAT TT=40.046 ASSIGNMENTS=27004	No data	No data	No data	SAT TT=0.04 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.036 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.06 ASSIGNMENTS=635 CHECKS=22805	? (exit code) TT=0.376	SAT TT=0.038 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.026 ASSIGNMENTS=17 CHECKS=1476	? TT=3.216	No data	? TT=307.996	? TT=311.433
csp/CabinetStart1/ normalized-cabinet-5592.xml	SAT TT=0.023	? (TO) TT=1800.14	? (TO) TT=1800.1	SAT TT=0.059	SAT TT=12.522 CHECKS=6318360	SAT TT=7.207 CHECKS=1934820	SAT TT=7.373 ASSIGNMENTS=6049	? (TO) TT=1800.14	No data	No data	No data	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=169 CHECKS=6990	? (exit code) TT=0.401	SAT TT=0.038 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.027 ASSIGNMENTS=17 CHECKS=1476	? TT=3.26	No data	? TT=514.882	? TT=301.651
csp/CabinetStart1/ normalized-cabinet-5593.xml	SAT TT=0.026	? (TO) TT=1800.16	? (TO) TT=1800.17	SAT TT=0.063	SAT TT=6.926 CHECKS=1932440	SAT TT=7.21 CHECKS=1956130	SAT TT=7.13 ASSIGNMENTS=6049	? (TO) TT=1800.07	No data	No data	No data	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.031 ASSIGNMENTS=79 CHECKS=3763	? (exit code) TT=0.408	SAT TT=0.039 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.033 ASSIGNMENTS=17 CHECKS=1476	? TT=3.208	No data	? TT=289.768	? TT=300.662
csp/CabinetStart1/ normalized-cabinet-5594.xml	SAT TT=0.029	? (TO) TT=1800.14	? (TO) TT=1800.12	SAT TT=0.065	SAT TT=10.877 CHECKS=6309110	SAT TT=7.098 CHECKS=1943840	SAT TT=6.89 ASSIGNMENTS=6049	SAT TT=815.095 ASSIGNMENTS=961156	No data	No data	No data	SAT TT=0.035 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.039 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.029 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.035 ASSIGNMENTS=165 CHECKS=6524	? (exit code) TT=0.394	SAT TT=0.046 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.031 ASSIGNMENTS=17 CHECKS=1476	? TT=3.718	No data	? TT=278.632	? TT=288.086
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/CabinetStart1/ normalized-cabinet-5595.xml	SAT TT=0.026	? (TO) TT=1800.07	? (TO) TT=1800.14	SAT TT=0.062	SAT TT=10.823 CHECKS=6292590	SAT TT=6.472 CHECKS=1928350	SAT TT=7.368 ASSIGNMENTS=6049	? (TO) TT=1800.09	No data	No data	No data	SAT TT=0.043 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.042 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.046 ASSIGNMENTS=412 CHECKS=16340	? (exit code) TT=0.436	SAT TT=0.038 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.033 ASSIGNMENTS=17 CHECKS=1476	? TT=3.199	No data	? TT=306.01	? TT=293.023
csp/CabinetStart1/ normalized-cabinet-5596.xml	SAT TT=0.023	? (TO) TT=1800.19	? (TO) TT=1800.17	SAT TT=0.057	SAT TT=7.023 CHECKS=1945790	SAT TT=1.208 CHECKS=601531	SAT TT=6.983 ASSIGNMENTS=6049	? (TO) TT=1800.11	No data	No data	No data	SAT TT=0.053 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.027 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.057 ASSIGNMENTS=354 CHECKS=13900	? (exit code) TT=0.392	SAT TT=0.048 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.023 ASSIGNMENTS=17 CHECKS=1476	? TT=3.613	No data	? TT=294.481	? TT=286.281
csp/CabinetStart1/ normalized-cabinet-5597.xml	SAT TT=0.025	? (TO) TT=1800.15	? (TO) TT=1800.09	SAT TT=0.062	SAT TT=11.502 CHECKS=6298900	SAT TT=7.221 CHECKS=1943420	SAT TT=7.587 ASSIGNMENTS=6049	? (TO) TT=1800.17	No data	No data	No data	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.025 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.028 ASSIGNMENTS=70 CHECKS=3418	? (exit code) TT=0.415	SAT TT=0.035 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.027 ASSIGNMENTS=17 CHECKS=1476	? TT=2.8	No data	? TT=289.985	? TT=315.195
csp/CabinetStart1/ normalized-cabinet-5598.xml	SAT TT=0.026	? (TO) TT=1800.18	? (TO) TT=1800.16	SAT TT=0.058	SAT TT=11.634 CHECKS=6316010	SAT TT=7.012 CHECKS=1933150	SAT TT=7.603 ASSIGNMENTS=6049	? (TO) TT=1800.09	No data	No data	No data	SAT TT=0.042 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.039 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.034 ASSIGNMENTS=123 CHECKS=6207	? (exit code) TT=0.493	SAT TT=0.041 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.026 ASSIGNMENTS=17 CHECKS=1476	? TT=3.169	No data	? TT=302.984	? TT=312.256
csp/CabinetStart1/ normalized-cabinet-5599.xml	SAT TT=0.023	? (MO) TT=0.908	? (TO) TT=1800.1	SAT TT=0.062	SAT TT=6.721 CHECKS=1957880	SAT TT=7.037 CHECKS=1944160	SAT TT=6.911 ASSIGNMENTS=6049	? (TO) TT=1800.15	No data	No data	No data	SAT TT=0.044 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.044 ASSIGNMENTS=313 CHECKS=12973	? (exit code) TT=0.424	SAT TT=0.035 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.023 ASSIGNMENTS=17 CHECKS=1476	? TT=3.312	No data	? TT=293.623	? TT=311.925
csp/CabinetStart1/ normalized-cabinet-5600.xml	SAT TT=0.027	? (TO) TT=1800.15	? (TO) TT=1800.15	SAT TT=0.059	SAT TT=10.735 CHECKS=6302160	SAT TT=6.938 CHECKS=1922710	SAT TT=7.531 ASSIGNMENTS=6049	? (TO) TT=1800.11	No data	No data	No data	SAT TT=0.041 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	No data	No data	No data	SAT TT=0.027 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=196 CHECKS=7555	? (exit code) TT=0.489	SAT TT=0.037 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.027 ASSIGNMENTS=17 CHECKS=1476	? TT=3.24	No data	? TT=310.159	? TT=312.2
csp/chessboardColoration/ normalized-cc-10-10-3.xml	SAT TT=6.211	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.11	SAT TT=53.314 CHECKS=10347600 NODES=45500	SAT TT=6.211 CHECKS=5068940 NODES=6872	SAT TT=7.255 CHECKS=6273520 NODES=4189	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=6.254	SAT TT=317.459	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=601.332 ASSIGNMENTS=848702 CHECKS=589533000	? (TO) TT=1800.1	SAT TT=27.442	No data	SAT TT=43.644	SAT TT=156.883
csp/chessboardColoration/ normalized-cc-12-12-2.xml	UNSAT TT=2.717	UNSAT TT=4.249 CHECKS=5614 NODES=241	UNSAT TT=4.332 CHECKS=12150 NODES=51	UNSAT TT=44.694	UNSAT TT=2.717 CHECKS=36232	UNSAT TT=4.616 CHECKS=510235	UNSAT TT=18.938 ASSIGNMENTS=9227	UNSAT TT=20.52 ASSIGNMENTS=9227	UNSAT TT=21.663 CHECKS=301067 NODES=6850	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=11.157 ASSIGNMENTS=2587 CHECKS=1865140	UNSAT TT=11.948 ASSIGNMENTS=3385 CHECKS=91917	UNSAT TT=7.321	UNSAT TT=7.034	No data	UNSAT TT=2.989 ASSIGNMENTS=3028 CHECKS=1734300	UNSAT TT=5.904 ASSIGNMENTS=5665 CHECKS=3443600	? (TO) TT=1800.13	UNSAT TT=5.756 ASSIGNMENTS=6617 CHECKS=3162580	UNSAT TT=3.118 ASSIGNMENTS=2587 CHECKS=1865140	UNSAT TT=5.502	No data	UNSAT TT=3.852	UNSAT TT=4.649
csp/chessboardColoration/ normalized-cc-12-12-3.xml		? (TO) TT=1800.19	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.04	No data	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.2	No data	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/chessboardColoration/ normalized-cc-15-15-2.xml	UNSAT TT=6.48	UNSAT TT=10.489 CHECKS=6910 NODES=262	UNSAT TT=10.507 CHECKS=29782 NODES=63	UNSAT TT=203.091	UNSAT TT=8.145 CHECKS=122259	UNSAT TT=35.263 CHECKS=3460010	UNSAT TT=53.382 ASSIGNMENTS=12745	UNSAT TT=54.227 ASSIGNMENTS=12745	UNSAT TT=77.255 CHECKS=220005 NODES=5056	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=18.027 ASSIGNMENTS=5663 CHECKS=4971690	UNSAT TT=18.157 ASSIGNMENTS=3406 CHECKS=94710	UNSAT TT=18.576	UNSAT TT=16.046	No data	UNSAT TT=6.48 ASSIGNMENTS=3477 CHECKS=3145880	UNSAT TT=12.259 ASSIGNMENTS=6246 CHECKS=5816370	? (TO) TT=1800.07	UNSAT TT=9.982 ASSIGNMENTS=5885 CHECKS=4680700	UNSAT TT=9.509 ASSIGNMENTS=5663 CHECKS=4971690	UNSAT TT=7.761	No data	UNSAT TT=8.643	UNSAT TT=11.217
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/chessboardColoration/ normalized-cc-15-15-3.xml		? (MO) TT=9.142	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07	No data	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.23	No data	? (TO) TT=1800.04	? (TO) TT=1800.03
csp/chessboardColoration/ normalized-cc-20-20-2.xml	UNSAT TT=12.75	UNSAT TT=33.961 CHECKS=9410 NODES=297	UNSAT TT=36.618 CHECKS=95702 NODES=83	? (TO) TT=1800.07	UNSAT TT=144.111 CHECKS=37764000	UNSAT TT=333.737 CHECKS=140789000	UNSAT TT=36.973 ASSIGNMENTS=2197	UNSAT TT=40.637 ASSIGNMENTS=2197	UNSAT TT=782.591 CHECKS=215760 NODES=4918	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=22.429 ASSIGNMENTS=2290 CHECKS=5212680	UNSAT TT=35.684 ASSIGNMENTS=3441 CHECKS=99485	UNSAT TT=66.316	UNSAT TT=54.483	No data	UNSAT TT=17.508 ASSIGNMENTS=4624 CHECKS=8640020	UNSAT TT=41.518 ASSIGNMENTS=9486 CHECKS=16818000	? (TO) TT=1800.01	UNSAT TT=24.02 ASSIGNMENTS=5560 CHECKS=9550420	UNSAT TT=14.107 ASSIGNMENTS=2290 CHECKS=5212680	UNSAT TT=12.75	No data	UNSAT TT=25.474	UNSAT TT=31.26
csp/chessboardColoration/ normalized-cc-20-20-3.xml		? (TO) TT=1800.26	? (TO) TT=1800.34	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.07	No data	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.17	No data	? (TO) TT=1800.08	? (TO) TT=1800.08
csp/chessboardColoration/ normalized-cc-5-5-2.xml	UNSAT TT=0.027	UNSAT TT=0.92 CHECKS=896 NODES=64	UNSAT TT=1.661 CHECKS=441 NODES=27	UNSAT TT=0.09	UNSAT TT=0.053 CHECKS=3071	UNSAT TT=0.027 CHECKS=5157	UNSAT TT=2.453 ASSIGNMENTS=5615	UNSAT TT=2.384 ASSIGNMENTS=5615	UNSAT TT=1.159 CHECKS=215134 NODES=3021	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=0.137 ASSIGNMENTS=1111 CHECKS=97184	UNSAT TT=0.125 ASSIGNMENTS=1111 CHECKS=97184	UNSAT TT=1.119	UNSAT TT=0.944	No data	UNSAT TT=0.098 ASSIGNMENTS=998 CHECKS=84392	UNSAT TT=0.349 ASSIGNMENTS=4722 CHECKS=319252	UNSAT TT=4.854	UNSAT TT=0.276 ASSIGNMENTS=2955 CHECKS=214303	UNSAT TT=0.282 ASSIGNMENTS=2950 CHECKS=243957	UNSAT TT=1.815	No data	UNSAT TT=0.971	UNSAT TT=1.095
csp/chessboardColoration/ normalized-cc-5-5-3.xml	SAT TT=0.012	SAT TT=0.914 CHECKS=381 NODES=27	SAT TT=0.865 CHECKS=408 NODES=0	SAT TT=0.065	SAT TT=29.989 CHECKS=18779000	SAT TT=0.025 CHECKS=2879	SAT TT=0.685 ASSIGNMENTS=23	SAT TT=0.749 ASSIGNMENTS=23	SAT TT=0.714 CHECKS=435 NODES=31	SAT TT=0.82 CHECKS=3202 NODES=2	SAT TT=0.723 CHECKS=2897 NODES=0	SAT TT=0.025 ASSIGNMENTS=23 CHECKS=865	SAT TT=0.023 ASSIGNMENTS=23 CHECKS=865	SAT TT=1.355	SAT TT=1.342	No data	SAT TT=0.012 ASSIGNMENTS=23 CHECKS=865	SAT TT=0.013 ASSIGNMENTS=20 CHECKS=643	SAT TT=0.548	SAT TT=0.015 ASSIGNMENTS=63 CHECKS=1760	SAT TT=0.014 ASSIGNMENTS=23 CHECKS=586	SAT TT=1.537	No data	SAT TT=0.867	SAT TT=0.878
csp/chessboardColoration/ normalized-cc-6-6-2.xml	UNSAT TT=0.055	UNSAT TT=1.041 CHECKS=887 NODES=59	UNSAT TT=1.045 CHECKS=926 NODES=30	UNSAT TT=0.2	UNSAT TT=0.114 CHECKS=3468	UNSAT TT=0.055 CHECKS=9848	UNSAT TT=2.818 ASSIGNMENTS=4354	UNSAT TT=3.173 ASSIGNMENTS=4354	UNSAT TT=1.572 CHECKS=217766 NODES=3138	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.208 ASSIGNMENTS=1105 CHECKS=148266	UNSAT TT=0.223 ASSIGNMENTS=1105 CHECKS=148266	UNSAT TT=1.205	UNSAT TT=1.169	No data	UNSAT TT=0.216 ASSIGNMENTS=1205 CHECKS=150030	UNSAT TT=0.736 ASSIGNMENTS=4802 CHECKS=591958	UNSAT TT=11.312	UNSAT TT=0.536 ASSIGNMENTS=3074 CHECKS=423175	UNSAT TT=0.549 ASSIGNMENTS=3042 CHECKS=413083	UNSAT TT=2.199	No data	UNSAT TT=1.242	UNSAT TT=1.489
csp/chessboardColoration/ normalized-cc-7-7-2.xml	UNSAT TT=0.26	UNSAT TT=1.389 CHECKS=2259 NODES=113	UNSAT TT=1.292 CHECKS=1771 NODES=35	UNSAT TT=0.304	UNSAT TT=0.26 CHECKS=15303	UNSAT TT=3.315 CHECKS=2371980	UNSAT TT=5.211 ASSIGNMENTS=5697	UNSAT TT=5.151 ASSIGNMENTS=5697	UNSAT TT=2.353 CHECKS=217772 NODES=4948	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=0.531 ASSIGNMENTS=2388 CHECKS=347779	UNSAT TT=0.536 ASSIGNMENTS=2388 CHECKS=347779	UNSAT TT=1.624	UNSAT TT=1.723	No data	UNSAT TT=0.62 ASSIGNMENTS=3113 CHECKS=430894	UNSAT TT=1.264 ASSIGNMENTS=5803 CHECKS=944336	UNSAT TT=26.355	UNSAT TT=0.881 ASSIGNMENTS=3112 CHECKS=595197	UNSAT TT=0.902 ASSIGNMENTS=3105 CHECKS=638351	UNSAT TT=2.553	No data	UNSAT TT=1.424	UNSAT TT=1.832
csp/chessboardColoration/ normalized-cc-8-8-2.xml	UNSAT TT=0.216	UNSAT TT=1.702 CHECKS=9546 NODES=450	UNSAT TT=1.694 CHECKS=2511 NODES=35	UNSAT TT=0.92	UNSAT TT=0.468 CHECKS=26715	UNSAT TT=0.216 CHECKS=29811	UNSAT TT=6.412 ASSIGNMENTS=5697	UNSAT TT=6.278 ASSIGNMENTS=5697	UNSAT TT=3.357 CHECKS=212474 NODES=4885	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.663 ASSIGNMENTS=2226 CHECKS=461689	UNSAT TT=0.689 ASSIGNMENTS=2226 CHECKS=461689	UNSAT TT=2.258	UNSAT TT=2.219	No data	UNSAT TT=0.772 ASSIGNMENTS=2400 CHECKS=503872	UNSAT TT=1.571 ASSIGNMENTS=5077 CHECKS=1185400	UNSAT TT=77.142	UNSAT TT=1.315 ASSIGNMENTS=3108 CHECKS=871327	UNSAT TT=1.212 ASSIGNMENTS=2988 CHECKS=865761	UNSAT TT=3.388	No data	UNSAT TT=1.637	UNSAT TT=1.923
csp/chessboardColoration/ normalized-cc-8-8-3.xml	SAT TT=0.068	SAT TT=1.801 CHECKS=35112 NODES=583	SAT TT=2.178 CHECKS=124855 NODES=2024	SAT TT=203.372	SAT TT=23.023 CHECKS=8782280	SAT TT=19.563 CHECKS=12540200	SAT TT=1.644 ASSIGNMENTS=227	SAT TT=1.998 ASSIGNMENTS=227	SAT TT=1.555 CHECKS=11384 NODES=192	SAT TT=1.451 CHECKS=32963 NODES=22	SAT TT=1.467 CHECKS=38629 NODES=14	SAT TT=7.491 ASSIGNMENTS=44 CHECKS=5675	SAT TT=9.256 ASSIGNMENTS=310 CHECKS=19118	SAT TT=3.656	SAT TT=3.462	No data	? (TO) TT=1800.1	SAT TT=0.07 ASSIGNMENTS=105 CHECKS=14763	? (TO) TT=1800.09	SAT TT=0.098 ASSIGNMENTS=229 CHECKS=24018	SAT TT=0.068 ASSIGNMENTS=44 CHECKS=5675	SAT TT=3.448	No data	SAT TT=1.776	SAT TT=1.777
csp/chessboardColoration/ normalized-cc-9-9-2.xml	UNSAT TT=0.385	UNSAT TT=2.005 CHECKS=4471 NODES=220	UNSAT TT=2.164 CHECKS=3929 NODES=39	UNSAT TT=1.303	UNSAT TT=0.74 CHECKS=18085	UNSAT TT=0.385 CHECKS=49236	UNSAT TT=9.303 ASSIGNMENTS=5653	UNSAT TT=8.498 ASSIGNMENTS=5653	UNSAT TT=6.026 CHECKS=291629 NODES=6632	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.938 ASSIGNMENTS=2121 CHECKS=572385	UNSAT TT=0.967 ASSIGNMENTS=2121 CHECKS=572385	UNSAT TT=3.004	UNSAT TT=3.026	No data	UNSAT TT=0.989 ASSIGNMENTS=2450 CHECKS=618519	UNSAT TT=2.353 ASSIGNMENTS=5074 CHECKS=1622540	UNSAT TT=76.23	UNSAT TT=1.752 ASSIGNMENTS=2877 CHECKS=1087410	UNSAT TT=1.514 ASSIGNMENTS=2765 CHECKS=1026030	UNSAT TT=4.093	No data	UNSAT TT=1.959	UNSAT TT=2.567
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/chessboardColoration/ normalized-cc-9-9-3.xml	SAT TT=0.2	SAT TT=7.436 CHECKS=1268460 NODES=16368	SAT TT=130.294 CHECKS=35584800 NODES=345696	? (TO) TT=1800.06	SAT TT=32.491 CHECKS=10906600	? (TO) TT=1800.09	SAT TT=4.421 ASSIGNMENTS=1480	SAT TT=3.948 ASSIGNMENTS=1480	SAT TT=3.584 CHECKS=488835 NODES=2590	SAT TT=1.975 CHECKS=121936 NODES=146	SAT TT=2.13 CHECKS=74353 NODES=23	SAT TT=7.796 ASSIGNMENTS=391 CHECKS=134218	SAT TT=11.273 ASSIGNMENTS=4763 CHECKS=569419	SAT TT=4.798	SAT TT=4.58	No data	? (TO) TT=1800.09	SAT TT=0.883 ASSIGNMENTS=2758 CHECKS=663122	? (TO) TT=1800.07	SAT TT=0.2 ASSIGNMENTS=333 CHECKS=78196	SAT TT=0.246 ASSIGNMENTS=391 CHECKS=134218	SAT TT=4.908	No data	SAT TT=3.373	SAT TT=3.743
csp/cjss/ normalized-ft06x2-54.xml	UNSAT TT=3.277	? TT=0.64	? TT=0.635	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=1139.59 CHECKS=426796000	? (TO) TT=1800.03	? (TO) TT=1800.11	No data	No data	No data	UNSAT TT=632.041 ASSIGNMENTS=905883 CHECKS=1753910000	UNSAT TT=666.989 ASSIGNMENTS=905883 CHECKS=1753910000	No data	No data	No data	UNSAT TT=456.612 ASSIGNMENTS=608537 CHECKS=1228740000	UNSAT TT=290.169 ASSIGNMENTS=419689 CHECKS=797346000	? (exit code) TT=0.262	UNSAT TT=911.449 ASSIGNMENTS=1158090 CHECKS=2193450000	UNSAT TT=672.608 ASSIGNMENTS=905883 CHECKS=1753910000	? TT=2.184	No data	UNSAT TT=3.277	UNSAT TT=3.737
csp/cjss/ normalized-ft06x2-55.xml	SAT TT=2.567	? TT=0.629	? TT=0.632	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1751.04 CHECKS=644056000	SAT TT=262.589 ASSIGNMENTS=261438	? (TO) TT=1800.1	No data	No data	No data	SAT TT=20.305 ASSIGNMENTS=20109 CHECKS=30608300	SAT TT=20.16 ASSIGNMENTS=20109 CHECKS=30608300	No data	No data	No data	SAT TT=532.763 ASSIGNMENTS=661201 CHECKS=1520070000	SAT TT=43.993 ASSIGNMENTS=70949 CHECKS=122017000	? (exit code) TT=0.249	SAT TT=6.54 ASSIGNMENTS=8683 CHECKS=13029400	SAT TT=12.56 ASSIGNMENTS=20109 CHECKS=30608300	? TT=2.276	No data	SAT TT=2.567	SAT TT=3.19
csp/cjss/ normalized-ft06x3-54.xml	UNSAT TT=112.238	? TT=0.695	? TT=0.721	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.14	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.06	? (exit code) TT=0.27	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=2.576	No data	UNSAT TT=119.279	UNSAT TT=112.238
csp/cjss/ normalized-ft06x3-55.xml	SAT TT=3.2	? TT=0.674	? TT=0.716	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	? (exit code) TT=0.286	SAT TT=22.595 ASSIGNMENTS=125238 CHECKS=63478500	? (TO) TT=1800.05	? TT=2.413	No data	SAT TT=3.2	SAT TT=4.154
csp/cjss/ normalized-ft10x2-837.xml		? TT=6.844	? TT=6.733	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	? (exit code) TT=0.448	? (TO) TT=1800.15	? (TO) TT=1800.16	? TT=154.766	No data	? (TO) TT=1800.06	? (TO) TT=1800.09
csp/cjss/ normalized-ft10x3-838.xml		? TT=7.55	? TT=7.018	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.16	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.14	? (TO) TT=1800.11	? (exit code) TT=0.378	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=196.677	No data	? TT=361.4	? TT=360.371
csp/cjss/ normalized-la03x2-593.xml		? TT=2.927	? TT=2.463	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.08	? (exit code) TT=0.357	? (TO) TT=1800.1	? (TO) TT=1800.1	? TT=35.177	No data	? (TO) TT=1800	? (TO) TT=1800.09
csp/cjss/ normalized-la03x3-590.xml		? TT=2.54	? TT=2.521	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.05	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.09	? (exit code) TT=0.3	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=50.704	No data	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/cjss/ normalized-la04x2-572.xml		? TT=2.814	? TT=2.291	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.06	? (exit code) TT=0.407	? (TO) TT=1800.13	? (TO) TT=1800.12	? TT=35.263	No data	? (TO) TT=1800.03	? (TO) TT=1800
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/cjss/ normalized-la04x3-570.xml		? TT=2.35	? TT=2.91	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.09	? (exit code) TT=0.29	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=47.058	No data	? (TO) TT=1800.02	? (TO) TT=1800.06
csp/coloring/ normalized-dsjc-125-1-4-ext.xml	UNSAT TT=0.025	UNSAT TT=1.029 CHECKS=44992 NODES=217	UNSAT TT=0.963 CHECKS=39816 NODES=142	UNSAT TT=0.125	UNSAT TT=0.082 CHECKS=39193	UNSAT TT=0.041 CHECKS=6524	UNSAT TT=0.64 ASSIGNMENTS=0	UNSAT TT=0.631 ASSIGNMENTS=0	UNSAT TT=0.602 CHECKS=6527 NODES=97	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.037 ASSIGNMENTS=27 CHECKS=16146	UNSAT TT=0.037 ASSIGNMENTS=27 CHECKS=16146	UNSAT TT=0.826	UNSAT TT=0.862	No data	UNSAT TT=0.025 ASSIGNMENTS=21 CHECKS=14815	UNSAT TT=0.183 ASSIGNMENTS=4192 CHECKS=1013730	UNSAT TT=0.58	UNSAT TT=0.036 ASSIGNMENTS=390 CHECKS=90966	UNSAT TT=0.026 ASSIGNMENTS=27 CHECKS=16146	UNSAT TT=1.345	UNSAT TT=0.053 ASSIGNMENTS=50 CHECKS=37896	UNSAT TT=0.921	UNSAT TT=1.269
csp/coloring/ normalized-dsjc-125-1-5-ext.xml	SAT TT=0.045	SAT TT=1.178 CHECKS=247766 NODES=1812	SAT TT=1.125 CHECKS=159392 NODES=1149	SAT TT=0.13	SAT TT=0.12 CHECKS=61069	SAT TT=0.048 CHECKS=16747	SAT TT=1.014 ASSIGNMENTS=62	SAT TT=0.839 ASSIGNMENTS=85	SAT TT=1.005 CHECKS=51367 NODES=800	SAT TT=0.906 CHECKS=1480500 NODES=23086	SAT TT=0.853 CHECKS=1565040 NODES=4099	SAT TT=0.082 ASSIGNMENTS=612 CHECKS=244964	SAT TT=0.082 ASSIGNMENTS=612 CHECKS=244964	SAT TT=1.557	SAT TT=1.643	No data	SAT TT=0.077 ASSIGNMENTS=746 CHECKS=296500	SAT TT=0.181 ASSIGNMENTS=6405 CHECKS=762341	SAT TT=5.737	SAT TT=0.045 ASSIGNMENTS=647 CHECKS=117453	SAT TT=0.064 ASSIGNMENTS=612 CHECKS=244964	SAT TT=1.503	SAT TT=0.208 ASSIGNMENTS=449 CHECKS=89541	SAT TT=0.962	SAT TT=1.03
csp/coloring/ normalized-geom-30a-3-ext.xml	UNSAT TT=0.007	UNSAT TT=0.807 CHECKS=6 NODES=0	UNSAT TT=0.701 CHECKS=6 NODES=0	UNSAT TT=0.032	UNSAT TT=0.01 CHECKS=740	UNSAT TT=0.009 CHECKS=398	UNSAT TT=0.387 ASSIGNMENTS=0	UNSAT TT=0.373 ASSIGNMENTS=0	UNSAT TT=0.363 CHECKS=288 NODES=16	? (TO) TT=1800	? (TO) TT=1800.09	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.507	UNSAT TT=0.475	No data	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.323	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.758	UNSAT TT=0.01 ASSIGNMENTS=6 CHECKS=870	UNSAT TT=0.559	UNSAT TT=0.598
csp/coloring/ normalized-geom-30a-4-ext.xml	UNSAT TT=0.006	UNSAT TT=0.686 CHECKS=8 NODES=0	UNSAT TT=0.68 CHECKS=8 NODES=0	UNSAT TT=0.033	UNSAT TT=0.017 CHECKS=5418	UNSAT TT=0.011 CHECKS=821	UNSAT TT=0.362 ASSIGNMENTS=0	UNSAT TT=0.395 ASSIGNMENTS=0	UNSAT TT=0.341 CHECKS=723 NODES=41	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.651	UNSAT TT=0.677	No data	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.32	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.726	UNSAT TT=0.013 ASSIGNMENTS=28 CHECKS=4094	UNSAT TT=0.63	UNSAT TT=0.544
csp/coloring/ normalized-geom-30a-5-ext.xml	UNSAT TT=0.007	UNSAT TT=0.745 CHECKS=10 NODES=0	UNSAT TT=0.703 CHECKS=10 NODES=0	UNSAT TT=0.034	UNSAT TT=0.035 CHECKS=19850	UNSAT TT=0.013 CHECKS=3378	UNSAT TT=0.388 ASSIGNMENTS=0	UNSAT TT=0.397 ASSIGNMENTS=0	UNSAT TT=0.363 CHECKS=2141 NODES=168	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.567	UNSAT TT=0.694	No data	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.313	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.944	UNSAT TT=0.02 ASSIGNMENTS=145 CHECKS=18345	UNSAT TT=0.583	UNSAT TT=0.613
csp/coloring/ normalized-geom-30a-6-ext.xml	SAT TT=0.006	SAT TT=0.737 CHECKS=533 NODES=30	SAT TT=0.719 CHECKS=523 NODES=0	SAT TT=0.032	SAT TT=0.015 CHECKS=2193	SAT TT=0.012 CHECKS=502	SAT TT=0.444 ASSIGNMENTS=24	SAT TT=0.453 ASSIGNMENTS=25	SAT TT=0.357 CHECKS=374 NODES=30	SAT TT=0.335 CHECKS=2448 NODES=10	SAT TT=0.339 CHECKS=3237 NODES=11	SAT TT=0.02 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.021 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.918	SAT TT=0.882	No data	SAT TT=0.006 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.008 ASSIGNMENTS=27 CHECKS=443	SAT TT=0.302	SAT TT=0.009 ASSIGNMENTS=26 CHECKS=451	SAT TT=0.008 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.744	SAT TT=0.01 ASSIGNMENTS=30 CHECKS=1742	SAT TT=0.592	SAT TT=0.566
csp/coloring/ normalized-geom-40-2-ext.xml	UNSAT TT=0.006	UNSAT TT=0.679 CHECKS=0 NODES=0	UNSAT TT=0.688 CHECKS=0 NODES=0	UNSAT TT=0.031	UNSAT TT=0.01 CHECKS=95	UNSAT TT=0.01 CHECKS=95	UNSAT TT=0.372 ASSIGNMENTS=0	UNSAT TT=0.436 ASSIGNMENTS=0	UNSAT TT=0.337 CHECKS=30 NODES=1	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.484	UNSAT TT=0.477	No data	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.299	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.718	UNSAT TT=0.011 ASSIGNMENTS=1 CHECKS=26	UNSAT TT=0.564	UNSAT TT=0.545
csp/coloring/ normalized-geom-40-3-ext.xml	UNSAT TT=0.006	UNSAT TT=0.674 CHECKS=0 NODES=0	UNSAT TT=0.676 CHECKS=0 NODES=0	UNSAT TT=0.031	UNSAT TT=0.012 CHECKS=256	UNSAT TT=0.009 CHECKS=155	UNSAT TT=0.384 ASSIGNMENTS=0	UNSAT TT=0.397 ASSIGNMENTS=0	UNSAT TT=0.332 CHECKS=117 NODES=7	? (TO) TT=1800.1	? (TO) TT=1800.02	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.512	UNSAT TT=0.642	No data	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.289	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.711	UNSAT TT=0.01 ASSIGNMENTS=6 CHECKS=383	UNSAT TT=0.561	UNSAT TT=0.581
csp/coloring/ normalized-geom-40-4-ext.xml	UNSAT TT=0.008	UNSAT TT=0.693 CHECKS=8 NODES=0	UNSAT TT=0.778 CHECKS=8 NODES=0	UNSAT TT=0.035	UNSAT TT=0.012 CHECKS=311	UNSAT TT=0.009 CHECKS=200	UNSAT TT=0.367 ASSIGNMENTS=0	UNSAT TT=0.411 ASSIGNMENTS=0	UNSAT TT=0.35 CHECKS=431 NODES=46	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.526	UNSAT TT=0.678	No data	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.308	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.72	UNSAT TT=0.012 ASSIGNMENTS=28 CHECKS=1635	UNSAT TT=0.599	UNSAT TT=0.607
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/coloring/ normalized-geom-40-5-ext.xml	UNSAT TT=0.005	UNSAT TT=0.746 CHECKS=10 NODES=0	UNSAT TT=0.676 CHECKS=10 NODES=0	UNSAT TT=0.032	UNSAT TT=0.013 CHECKS=2625	UNSAT TT=0.012 CHECKS=480	UNSAT TT=0.406 ASSIGNMENTS=0	UNSAT TT=0.371 ASSIGNMENTS=0	UNSAT TT=0.364 CHECKS=1122 NODES=169	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.755	UNSAT TT=0.532	No data	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.313	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.819	UNSAT TT=0.015 ASSIGNMENTS=149 CHECKS=5135	UNSAT TT=0.576	UNSAT TT=0.614
csp/coloring/ normalized-geom-40-6-ext.xml	SAT TT=0.006	SAT TT=0.712 CHECKS=504 NODES=40	SAT TT=0.73 CHECKS=518 NODES=0	SAT TT=0.034	SAT TT=0.022 CHECKS=6041	SAT TT=0.012 CHECKS=1072	SAT TT=0.546 ASSIGNMENTS=35	SAT TT=0.476 ASSIGNMENTS=35	SAT TT=0.34 CHECKS=386 NODES=40	SAT TT=0.341 CHECKS=2340 NODES=11	SAT TT=0.322 CHECKS=2820 NODES=10	SAT TT=0.019 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.02 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.872	SAT TT=1.053	No data	SAT TT=0.006 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.009 ASSIGNMENTS=39 CHECKS=333	SAT TT=0.339	SAT TT=0.008 ASSIGNMENTS=37 CHECKS=336	SAT TT=0.008 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.726	SAT TT=0.011 ASSIGNMENTS=40 CHECKS=1358	SAT TT=0.545	SAT TT=0.613
csp/coloring/ normalized-le-450-5a-2-ext.xml	UNSAT TT=0.149	UNSAT TT=1.577 CHECKS=0 NODES=0	UNSAT TT=1.556 CHECKS=0 NODES=0	UNSAT TT=0.586	UNSAT TT=0.205 CHECKS=5770	UNSAT TT=0.188 CHECKS=5778	UNSAT TT=1.237 ASSIGNMENTS=0	UNSAT TT=1.257 ASSIGNMENTS=0	UNSAT TT=6.052 CHECKS=134 NODES=1	? (TO) TT=1800.08	Wrong Cert. TT=1714 CHECKS=6999240000 NODES=641436	UNSAT TT=0.156 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.162 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.369	UNSAT TT=2.115	No data	UNSAT TT=0.149 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.15 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.171	UNSAT TT=0.15 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.152 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.722	UNSAT TT=0.528 ASSIGNMENTS=1 CHECKS=198	UNSAT TT=1.577	UNSAT TT=1.67
csp/coloring/ normalized-le-450-5a-3-ext.xml	UNSAT TT=0.154	UNSAT TT=1.378 CHECKS=0 NODES=0	UNSAT TT=1.452 CHECKS=0 NODES=0	UNSAT TT=0.664	UNSAT TT=0.729 CHECKS=300996	UNSAT TT=0.237 CHECKS=18117	UNSAT TT=0.99 ASSIGNMENTS=0	UNSAT TT=1.216 ASSIGNMENTS=0	UNSAT TT=5.803 CHECKS=1855 NODES=16	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.286	UNSAT TT=1.863	No data	UNSAT TT=0.157 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.157 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.736	UNSAT TT=0.155 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.154 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.684	UNSAT TT=0.53 ASSIGNMENTS=6 CHECKS=14253	UNSAT TT=1.656	UNSAT TT=1.789
csp/coloring/ normalized-le-450-5a-4-ext.xml	UNSAT TT=0.15	UNSAT TT=1.553 CHECKS=0 NODES=0	UNSAT TT=1.528 CHECKS=0 NODES=0	UNSAT TT=0.624	UNSAT TT=1.018 CHECKS=352263	UNSAT TT=0.431 CHECKS=31362	UNSAT TT=1.102 ASSIGNMENTS=0	UNSAT TT=1.063 ASSIGNMENTS=0	UNSAT TT=6.672 CHECKS=12651 NODES=111	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.173 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.168 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=2.287	UNSAT TT=2.148	No data	UNSAT TT=0.166 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.167 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=1.608	UNSAT TT=0.15 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.165 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=3.686	UNSAT TT=0.631 ASSIGNMENTS=115 CHECKS=291880	UNSAT TT=1.887	UNSAT TT=2.085
csp/coloring/ normalized-le-450-5a-5-ext.xml	SAT TT=0.553	SAT TT=1.771 CHECKS=110856 NODES=595	SAT TT=2.033 CHECKS=184794 NODES=581	SAT TT=1.105	SAT TT=6.867 CHECKS=2289410	SAT TT=3.262 CHECKS=474073	SAT TT=5.541 ASSIGNMENTS=13	SAT TT=5.664 ASSIGNMENTS=18	SAT TT=8.744 CHECKS=190382 NODES=1194	? (TO) TT=1800.01	SAT TT=26.852 CHECKS=116016000 NODES=45720	SAT TT=0.587 ASSIGNMENTS=483 CHECKS=2323620	SAT TT=0.602 ASSIGNMENTS=483 CHECKS=2323620	SAT TT=4.176	SAT TT=4.24	No data	SAT TT=0.714 ASSIGNMENTS=540 CHECKS=2813410	SAT TT=4.285 ASSIGNMENTS=4474 CHECKS=18796100	SAT TT=24.058	SAT TT=0.595 ASSIGNMENTS=1778 CHECKS=1926740	SAT TT=0.553 ASSIGNMENTS=483 CHECKS=2323620	SAT TT=4.518	SAT TT=1.792 ASSIGNMENTS=1035 CHECKS=1236950	SAT TT=2.15	SAT TT=2.306
csp/coloring/ normalized-myciel-5g-3-ext.xml	UNSAT TT=0.012	UNSAT TT=0.776 CHECKS=2004 NODES=8	UNSAT TT=0.796 CHECKS=4330 NODES=0	UNSAT TT=0.05	UNSAT TT=0.025 CHECKS=8502	UNSAT TT=0.019 CHECKS=3832	UNSAT TT=0.47 ASSIGNMENTS=0	UNSAT TT=0.485 ASSIGNMENTS=0	UNSAT TT=0.419 CHECKS=3076 NODES=38	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.023 ASSIGNMENTS=19 CHECKS=4816	UNSAT TT=0.023 ASSIGNMENTS=19 CHECKS=4816	UNSAT TT=0.643	UNSAT TT=0.767	No data	UNSAT TT=0.012 ASSIGNMENTS=19 CHECKS=4640	UNSAT TT=0.018 ASSIGNMENTS=175 CHECKS=27510	UNSAT TT=0.366	UNSAT TT=0.015 ASSIGNMENTS=99 CHECKS=13796	UNSAT TT=0.012 ASSIGNMENTS=19 CHECKS=4816	UNSAT TT=0.892	UNSAT TT=0.019 ASSIGNMENTS=26 CHECKS=10566	UNSAT TT=0.76	UNSAT TT=0.734
csp/coloring/ normalized-myciel-5g-4-ext.xml	UNSAT TT=0.049	UNSAT TT=0.925 CHECKS=53921 NODES=442	UNSAT TT=0.934 CHECKS=64809 NODES=527	UNSAT TT=0.104	UNSAT TT=0.125 CHECKS=98352	UNSAT TT=0.065 CHECKS=66999	UNSAT TT=0.579 ASSIGNMENTS=122	UNSAT TT=0.564 ASSIGNMENTS=122	UNSAT TT=0.773 CHECKS=90367 NODES=2704	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=0.063 ASSIGNMENTS=1387 CHECKS=246604	UNSAT TT=0.064 ASSIGNMENTS=1387 CHECKS=246604	UNSAT TT=0.712	UNSAT TT=0.728	No data	UNSAT TT=0.052 ASSIGNMENTS=1295 CHECKS=235294	UNSAT TT=0.122 ASSIGNMENTS=5278 CHECKS=544267	UNSAT TT=0.669	UNSAT TT=0.049 ASSIGNMENTS=1259 CHECKS=207545	UNSAT TT=0.054 ASSIGNMENTS=1387 CHECKS=246604	UNSAT TT=2.095	UNSAT TT=0.577 ASSIGNMENTS=4317 CHECKS=879438	UNSAT TT=0.759	UNSAT TT=0.81
csp/coloring/ normalized-myciel-5g-5-ext.xml	UNSAT TT=22.193	UNSAT TT=27.413 CHECKS=34788100 NODES=397254	UNSAT TT=30.607 CHECKS=39853800 NODES=458975	UNSAT TT=666.797	UNSAT TT=110.814 CHECKS=116359000	UNSAT TT=89.79 CHECKS=125270000	UNSAT TT=47.285 ASSIGNMENTS=574723	UNSAT TT=51.432 ASSIGNMENTS=574723	UNSAT TT=422.62 CHECKS=96524000 NODES=4328700	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=49.341 ASSIGNMENTS=2177120 CHECKS=192910000	UNSAT TT=49.679 ASSIGNMENTS=2177120 CHECKS=192910000	UNSAT TT=181.241	UNSAT TT=211.144	No data	UNSAT TT=39.629 ASSIGNMENTS=2237490 CHECKS=197792000	UNSAT TT=37.626 ASSIGNMENTS=1982710 CHECKS=176954000	UNSAT TT=346.871	UNSAT TT=52.163 ASSIGNMENTS=2631860 CHECKS=235108000	UNSAT TT=40.565 ASSIGNMENTS=2177120 CHECKS=192910000	UNSAT TT=1634.05	UNSAT TT=1076.15 ASSIGNMENTS=14289000 CHECKS=1449620000	UNSAT TT=22.193	UNSAT TT=163.314
csp/coloring/ normalized-myciel-5g-6-ext.xml	SAT TT=0.011	SAT TT=0.847 CHECKS=1356 NODES=47	SAT TT=0.79 CHECKS=1353 NODES=0	SAT TT=0.049	SAT TT=0.038 CHECKS=10217	SAT TT=0.025 CHECKS=6875	SAT TT=0.663 ASSIGNMENTS=45	SAT TT=0.549 ASSIGNMENTS=45	SAT TT=0.416 CHECKS=1047 NODES=47	SAT TT=0.478 CHECKS=7462 NODES=21	SAT TT=0.417 CHECKS=11352 NODES=22	SAT TT=0.023 ASSIGNMENTS=46 CHECKS=1168	SAT TT=0.023 ASSIGNMENTS=46 CHECKS=1168	SAT TT=1.317	SAT TT=1.223	No data	SAT TT=0.011 ASSIGNMENTS=46 CHECKS=1168	SAT TT=0.013 ASSIGNMENTS=44 CHECKS=1262	SAT TT=0.483	SAT TT=0.012 ASSIGNMENTS=46 CHECKS=1280	SAT TT=0.011 ASSIGNMENTS=46 CHECKS=1168	SAT TT=0.879	SAT TT=0.017 ASSIGNMENTS=47 CHECKS=5185	SAT TT=0.722	SAT TT=0.792
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/coloring/ normalized-queens-5-5-3-ext.xml	UNSAT TT=0.01	UNSAT TT=0.715 CHECKS=6 NODES=0	UNSAT TT=0.747 CHECKS=6 NODES=0	UNSAT TT=0.039	UNSAT TT=0.017 CHECKS=4354	UNSAT TT=0.015 CHECKS=434	UNSAT TT=0.417 ASSIGNMENTS=0	UNSAT TT=0.394 ASSIGNMENTS=0	UNSAT TT=0.348 CHECKS=325 NODES=5	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.576	UNSAT TT=0.547	No data	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.328	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.786	UNSAT TT=0.014 ASSIGNMENTS=6 CHECKS=2410	UNSAT TT=0.638	UNSAT TT=0.634
csp/coloring/ normalized-queens-5-5-4-ext.xml	UNSAT TT=0.01	UNSAT TT=0.752 CHECKS=8 NODES=0	UNSAT TT=0.809 CHECKS=8 NODES=0	UNSAT TT=0.04	UNSAT TT=0.038 CHECKS=18958	UNSAT TT=0.015 CHECKS=1623	UNSAT TT=0.397 ASSIGNMENTS=0	UNSAT TT=0.404 ASSIGNMENTS=0	UNSAT TT=0.393 CHECKS=1113 NODES=26	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.608	UNSAT TT=0.613	No data	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.352	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.787	UNSAT TT=0.016 ASSIGNMENTS=28 CHECKS=12272	UNSAT TT=0.71	UNSAT TT=0.672
csp/coloring/ normalized-queens-5-5-5-ext.xml	SAT TT=0.009	SAT TT=0.779 CHECKS=800 NODES=25	SAT TT=0.762 CHECKS=821 NODES=0	SAT TT=0.041	SAT TT=0.034 CHECKS=13724	SAT TT=0.015 CHECKS=1328	SAT TT=0.552 ASSIGNMENTS=2	SAT TT=0.531 ASSIGNMENTS=2	SAT TT=0.355 CHECKS=524 NODES=25	SAT TT=0.465 CHECKS=7590 NODES=63	SAT TT=0.384 CHECKS=7570 NODES=23	SAT TT=0.022 ASSIGNMENTS=5 CHECKS=1199	SAT TT=0.021 ASSIGNMENTS=5 CHECKS=1199	SAT TT=1.02	SAT TT=1.226	No data	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=1199	SAT TT=0.009 ASSIGNMENTS=6 CHECKS=1460	SAT TT=0.334	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=1255	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=1199	SAT TT=0.768	SAT TT=0.014 ASSIGNMENTS=25 CHECKS=3251	SAT TT=0.621	SAT TT=0.727
csp/compet02/ normalized-patat-02-comp-10.xml	SAT TT=134.588	? (TO) TT=1800.18	? (TO) TT=1800.24	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.24	? (TO) TT=1800.15	No data	No data	No data	SAT TT=692.986 ASSIGNMENTS=84246 CHECKS=1344450000	SAT TT=1293.95 ASSIGNMENTS=84246 CHECKS=1344450000	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=710.655 ASSIGNMENTS=84246 CHECKS=1344450000	? (TO) TT=1800.22	No data	? (TO) TT=1800.26	SAT TT=134.588
csp/compet02/ normalized-patat-02-comp-11.xml	SAT TT=77.463	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.09	No data	No data	No data	SAT TT=259.776 ASSIGNMENTS=138287 CHECKS=555645000	SAT TT=839.563 ASSIGNMENTS=138287 CHECKS=555645000	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=265.54 ASSIGNMENTS=138287 CHECKS=555645000	? (TO) TT=1800.22	No data	? (TO) TT=1800.1	SAT TT=77.463
csp/compet02/ normalized-patat-02-comp-12.xml	SAT TT=26.185	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.12	No data	No data	No data	SAT TT=36.579 ASSIGNMENTS=6853 CHECKS=54223200	SAT TT=613.154 ASSIGNMENTS=6853 CHECKS=54223200	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=122.375 ASSIGNMENTS=35475 CHECKS=242051000	SAT TT=26.185 ASSIGNMENTS=6853 CHECKS=54223200	? (TO) TT=1800.15	No data	? (TO) TT=1800.1	SAT TT=79.482
csp/compet02/ normalized-patat-02-comp-13.xml	SAT TT=87.969	SAT TT=1327.07 CHECKS=808815000 NODES=92749	SAT TT=1467.43 CHECKS=752048000 NODES=77379	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.18	No data	No data	No data	SAT TT=135.36 ASSIGNMENTS=58873 CHECKS=262448000	SAT TT=723.911 ASSIGNMENTS=58873 CHECKS=262448000	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=1390.29 ASSIGNMENTS=463455 CHECKS=2779750000	SAT TT=126.682 ASSIGNMENTS=58873 CHECKS=262448000	? (TO) TT=1800.23	No data	? (TO) TT=1800.12	SAT TT=87.969
csp/compet02/ normalized-patat-02-comp-14.xml	SAT TT=58.726	? (TO) TT=1800.18	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.19	No data	No data	No data	SAT TT=64.249 ASSIGNMENTS=4674 CHECKS=114248000	SAT TT=647.87 ASSIGNMENTS=4674 CHECKS=114248000	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=940.265 ASSIGNMENTS=140527 CHECKS=2066530000	SAT TT=58.726 ASSIGNMENTS=4674 CHECKS=114248000	SAT TT=1437.58	No data	SAT TT=1250	SAT TT=108.1
csp/compet02/ normalized-patat-02-comp-15.xml	SAT TT=35.759	SAT TT=1137.45 CHECKS=753690000 NODES=58620	SAT TT=1291.45 CHECKS=944055000 NODES=61033	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.08	No data	No data	No data	SAT TT=44.948 ASSIGNMENTS=8509 CHECKS=78292300	SAT TT=622.022 ASSIGNMENTS=8509 CHECKS=78292300	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=1538.51 ASSIGNMENTS=692073 CHECKS=3505520000	SAT TT=35.759 ASSIGNMENTS=8509 CHECKS=78292300	SAT TT=571.687	No data	SAT TT=117.464	SAT TT=74.036
csp/compet02/ normalized-patat-02-comp-16.xml	SAT TT=93.319	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.08	No data	No data	No data	SAT TT=593.586 ASSIGNMENTS=113917 CHECKS=1175080000	SAT TT=1134.15 ASSIGNMENTS=113917 CHECKS=1175080000	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.03	SAT TT=572.637 ASSIGNMENTS=113917 CHECKS=1175080000	? (TO) TT=1800.16	No data	? (TO) TT=1800.13	SAT TT=93.319
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/compet02/ normalized-patat-02-comp-17.xml	SAT TT=4.208	SAT TT=4.208 CHECKS=203750 NODES=701	SAT TT=7.197 CHECKS=753287 NODES=1321	? (TO) TT=1800.02	SAT TT=551.247 CHECKS=56347400	SAT TT=35.985 CHECKS=15863600	? (TO) TT=1800.16	? (TO) TT=1800.11	No data	No data	No data	SAT TT=19.105 ASSIGNMENTS=35191 CHECKS=17468500	SAT TT=11.934 ASSIGNMENTS=700 CHECKS=203676	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=12.793 ASSIGNMENTS=35191 CHECKS=17468500	SAT TT=48.554	No data	SAT TT=21.29	SAT TT=58.944
csp/compet02/ normalized-patat-02-comp-18.xml	SAT TT=58.771	SAT TT=642.684 CHECKS=265005000 NODES=87433	SAT TT=812.173 CHECKS=353601000 NODES=117232	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.1	No data	No data	No data	SAT TT=98.957 ASSIGNMENTS=82584 CHECKS=200948000	SAT TT=671.211 ASSIGNMENTS=82584 CHECKS=200948000	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=974.014 ASSIGNMENTS=1046680 CHECKS=2463870000	SAT TT=87.382 ASSIGNMENTS=82584 CHECKS=200948000	? (TO) TT=1800.26	No data	? (TO) TT=1800.07	SAT TT=58.771
csp/compet02/ normalized-patat-02-comp-19.xml	SAT TT=121.312	? (TO) TT=1800.21	? (TO) TT=1800.19	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.46	No data	No data	No data	SAT TT=131.284 ASSIGNMENTS=20467 CHECKS=234105000	SAT TT=716.911 ASSIGNMENTS=20467 CHECKS=234105000	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=1202.43 ASSIGNMENTS=217261 CHECKS=2546930000	SAT TT=121.312 ASSIGNMENTS=20467 CHECKS=234105000	? (TO) TT=1800.22	No data	? (TO) TT=1800.2	SAT TT=152.128
csp/compet02/ normalized-patat-02-comp-1.xml	SAT TT=80.874	? (TO) TT=1800.21	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.13	No data	No data	No data	SAT TT=219.409 ASSIGNMENTS=104575 CHECKS=454103000	SAT TT=795.316 ASSIGNMENTS=104575 CHECKS=454103000	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=194.779 ASSIGNMENTS=104575 CHECKS=454103000	? (TO) TT=1800.21	No data	SAT TT=604.875	SAT TT=80.874
csp/compet02/ normalized-patat-02-comp-20.xml	SAT TT=115.765	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.16	No data	No data	No data	SAT TT=390.815 ASSIGNMENTS=42542 CHECKS=765043000	SAT TT=946.44 ASSIGNMENTS=42542 CHECKS=765043000	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=393.952 ASSIGNMENTS=42542 CHECKS=765043000	? (TO) TT=1800.38	No data	SAT TT=1340.7	SAT TT=115.765
csp/compet02/ normalized-patat-02-comp-2.xml	SAT TT=53.35	SAT TT=808.007 CHECKS=299921000 NODES=57280	SAT TT=627.033 CHECKS=203021000 NODES=40232	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.15	No data	No data	No data	SAT TT=58.378 ASSIGNMENTS=24100 CHECKS=111248000	SAT TT=644.269 ASSIGNMENTS=24100 CHECKS=111248000	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=1213.83 ASSIGNMENTS=359442 CHECKS=2406700000	SAT TT=53.35 ASSIGNMENTS=24100 CHECKS=111248000	? (TO) TT=1800.23	No data	SAT TT=534.13	SAT TT=64.55
csp/compet02/ normalized-patat-02-comp-3.xml	SAT TT=82.25	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.2	No data	No data	No data	SAT TT=183.08 ASSIGNMENTS=60977 CHECKS=335861000	SAT TT=750.984 ASSIGNMENTS=60977 CHECKS=335861000	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=894.441 ASSIGNMENTS=319269 CHECKS=1890540000	SAT TT=151.029 ASSIGNMENTS=60977 CHECKS=335861000	? (TO) TT=1800.19	No data	? (TO) TT=1800.14	SAT TT=82.25
csp/compet02/ normalized-patat-02-comp-4.xml	SAT TT=96.841	? (TO) TT=1800.18	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.11	No data	No data	No data	SAT TT=96.841 ASSIGNMENTS=16165 CHECKS=196125000	SAT TT=687.867 ASSIGNMENTS=16165 CHECKS=196125000	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=97.039 ASSIGNMENTS=16165 CHECKS=196125000	? (TO) TT=1800.24	No data	SAT TT=941.351	SAT TT=105.118
csp/compet02/ normalized-patat-02-comp-5.xml	SAT TT=19.167	SAT TT=506.75 CHECKS=359389000 NODES=46435	SAT TT=543.617 CHECKS=374466000 NODES=55990	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.14	No data	No data	No data	SAT TT=27.08 ASSIGNMENTS=5744 CHECKS=43689400	SAT TT=485.644 ASSIGNMENTS=46427 CHECKS=359389000	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=179.91 ASSIGNMENTS=91967 CHECKS=387997000	SAT TT=19.167 ASSIGNMENTS=5744 CHECKS=43689400	SAT TT=290.227	No data	SAT TT=25.382	SAT TT=61.555
csp/compet02/ normalized-patat-02-comp-6.xml	SAT TT=118.276	? (TO) TT=1800.23	? (MO) TT=11.965	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.18	No data	No data	No data	SAT TT=203.776 ASSIGNMENTS=24672 CHECKS=382082000	SAT TT=769.533 ASSIGNMENTS=24672 CHECKS=382082000	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=1246.69 ASSIGNMENTS=194898 CHECKS=2565580000	SAT TT=178.667 ASSIGNMENTS=24672 CHECKS=382082000	? (TO) TT=1800.15	No data	SAT TT=1389.13	SAT TT=118.276
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/compet02/ normalized-patat-02-comp-7.xml	SAT TT=28.608	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	No data	No data	No data	SAT TT=43.295 ASSIGNMENTS=9034 CHECKS=61085600	SAT TT=619.01 ASSIGNMENTS=9034 CHECKS=61085600	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=668.211 ASSIGNMENTS=185111 CHECKS=1327920000	SAT TT=28.608 ASSIGNMENTS=9034 CHECKS=61085600	SAT TT=1261.71	No data	SAT TT=1345.61	SAT TT=105.455
csp/compet02/ normalized-patat-02-comp-8.xml	SAT TT=111.339	? (TO) TT=1800.18	? (TO) TT=1800.22	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.16	No data	No data	No data	SAT TT=502.63 ASSIGNMENTS=139601 CHECKS=890948000	SAT TT=1038.26 ASSIGNMENTS=139601 CHECKS=890948000	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=433.424 ASSIGNMENTS=139601 CHECKS=890948000	? (TO) TT=1800.21	No data	? (TO) TT=1800.21	SAT TT=111.339
csp/compet02/ normalized-patat-02-comp-9.xml	SAT TT=108.522	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.56	No data	No data	No data	SAT TT=139.079 ASSIGNMENTS=39218 CHECKS=264211000	SAT TT=709.006 ASSIGNMENTS=39218 CHECKS=264211000	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=1619.29 ASSIGNMENTS=139259 CHECKS=3226830000	SAT TT=121.335 ASSIGNMENTS=39218 CHECKS=264211000	? (TO) TT=1802.2	No data	? (TO) TT=1800.12	SAT TT=108.522
csp/compet08/ normalized-patat-08-comp-10.xml	SAT TT=1.68	SAT TT=40.109 CHECKS=4472790 NODES=4074	SAT TT=11.868 CHECKS=1821520 NODES=400	? (TO) TT=1800.1	SAT TT=54.27 CHECKS=4875970	SAT TT=20.187 CHECKS=3019170	? (TO) TT=1800.16	? (TO) TT=1800.17	No data	No data	No data	SAT TT=1.716 ASSIGNMENTS=495 CHECKS=1177090	SAT TT=2.055 ASSIGNMENTS=495 CHECKS=1177090	No data	No data	No data	SAT TT=2.025 ASSIGNMENTS=583 CHECKS=1493780	SAT TT=19.867 ASSIGNMENTS=62294 CHECKS=27272000	? (TO) TT=1800.09	SAT TT=419.434 ASSIGNMENTS=74541 CHECKS=336582000	SAT TT=1.68 ASSIGNMENTS=495 CHECKS=1177120	SAT TT=273.877	No data	SAT TT=86.484	SAT TT=112.281
csp/compet08/ normalized-patat-08-comp-11.xml	SAT TT=6.158	SAT TT=31.406 CHECKS=4692210 NODES=2919	SAT TT=35.457 CHECKS=6886030 NODES=2919	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.32	? (TO) TT=1800.14	No data	No data	No data	SAT TT=14.402 ASSIGNMENTS=1941 CHECKS=8182670	SAT TT=36.168 ASSIGNMENTS=2919 CHECKS=4692210	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=37.738 ASSIGNMENTS=16959 CHECKS=52534400	SAT TT=6.158 ASSIGNMENTS=1941 CHECKS=8182670	SAT TT=416.181	No data	SAT TT=91.105	SAT TT=120.096
csp/compet08/ normalized-patat-08-comp-12.xml	SAT TT=70.648	SAT TT=375.454 CHECKS=102136000 NODES=25564	SAT TT=242.452 CHECKS=69648000 NODES=13641	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.2	No data	No data	No data	SAT TT=92.454 ASSIGNMENTS=17376 CHECKS=132872000	SAT TT=344.985 ASSIGNMENTS=25564 CHECKS=102136000	No data	No data	No data	? (TO) TT=1800.11	SAT TT=96.854 ASSIGNMENTS=48703 CHECKS=142565000	? (TO) TT=1800.05	SAT TT=70.648 ASSIGNMENTS=25904 CHECKS=118730000	SAT TT=88.791 ASSIGNMENTS=17376 CHECKS=132872000	? (TO) TT=1800.1	No data	SAT TT=172.851	SAT TT=137.686
csp/compet08/ normalized-patat-08-comp-13.xml	SAT TT=11.438	SAT TT=110.813 CHECKS=26200300 NODES=10815	SAT TT=208.905 CHECKS=59178400 NODES=19170	? (TO) TT=1800.03	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.45	No data	No data	No data	SAT TT=21.316 ASSIGNMENTS=3472 CHECKS=15885400	SAT TT=113.58 ASSIGNMENTS=10815 CHECKS=26200300	No data	No data	No data	? (TO) TT=1800.03	SAT TT=65.153 ASSIGNMENTS=45129 CHECKS=104727000	? (TO) TT=1800.08	SAT TT=59.829 ASSIGNMENTS=27896 CHECKS=97781400	SAT TT=11.438 ASSIGNMENTS=3472 CHECKS=15885400	SAT TT=1191.88	No data	SAT TT=91.213	SAT TT=138.781
csp/compet08/ normalized-patat-08-comp-14.xml	SAT TT=143.661	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	No data	No data	No data	SAT TT=726.095 ASSIGNMENTS=72370 CHECKS=201719000	SAT TT=733.155 ASSIGNMENTS=72370 CHECKS=201719000	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=233.838 ASSIGNMENTS=143690 CHECKS=283600000	SAT TT=143.661 ASSIGNMENTS=72370 CHECKS=201719000	? (TO) TT=1800.18	No data	? (TO) TT=1800.03	SAT TT=168.193
csp/compet08/ normalized-patat-08-comp-15.xml	SAT TT=0.982	SAT TT=4.43 CHECKS=40242 NODES=1027	SAT TT=10.326 CHECKS=237524 NODES=4484	SAT TT=0.982	SAT TT=372.537 CHECKS=80784700	SAT TT=92.412 CHECKS=18466700	SAT TT=146.961 ASSIGNMENTS=1213	? (TO) TT=1800.06	No data	No data	No data	SAT TT=11.373 ASSIGNMENTS=1027 CHECKS=40242	SAT TT=10.65 ASSIGNMENTS=1027 CHECKS=40242	No data	No data	No data	SAT TT=9.839 ASSIGNMENTS=5948 CHECKS=12719200	SAT TT=5.814 ASSIGNMENTS=25245 CHECKS=6592620	? (TO) TT=1800.08	SAT TT=11.281 ASSIGNMENTS=9916 CHECKS=11706100	SAT TT=1.044 ASSIGNMENTS=690 CHECKS=1105840	SAT TT=16.013	No data	SAT TT=43.605	SAT TT=44.627
csp/compet08/ normalized-patat-08-comp-16.xml		? (TO) TT=1800.16	? (TO) TT=1800.21	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.05	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.26	No data	? TT=129.916	? TT=144.883
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/compet08/ normalized-patat-08-comp-1.xml		? (TO) TT=1800.19	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.16	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.19	No data	? TT=236.659	? TT=215.385
csp/compet08/ normalized-patat-08-comp-2.xml		? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.18	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.21	No data	? (TO) TT=1800.14	? (TO) TT=1800.09
csp/compet08/ normalized-patat-08-comp-3.xml	SAT TT=21.456	? (TO) TT=1800.09	SAT TT=170.485 CHECKS=14354600 NODES=16755	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.1	No data	No data	No data	SAT TT=29.066 ASSIGNMENTS=4645 CHECKS=27233800	SAT TT=607.954 ASSIGNMENTS=4645 CHECKS=27233800	No data	No data	No data	? (TO) TT=1800.02	SAT TT=35.024 ASSIGNMENTS=25346 CHECKS=35904700	? (TO) TT=1800.11	SAT TT=58.951 ASSIGNMENTS=19407 CHECKS=79247000	SAT TT=21.456 ASSIGNMENTS=4645 CHECKS=27233800	SAT TT=135.524	No data	SAT TT=94.946	SAT TT=138.493
csp/compet08/ normalized-patat-08-comp-4.xml	SAT TT=133.767	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.18	No data	No data	No data	SAT TT=1052.03 ASSIGNMENTS=173060 CHECKS=1164580000	SAT TT=1663.61 ASSIGNMENTS=173060 CHECKS=1164580000	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.06	SAT TT=1100.25 ASSIGNMENTS=173060 CHECKS=1164580000	? (TO) TT=1800.18	No data	? (TO) TT=1800.03	SAT TT=133.767
csp/compet08/ normalized-patat-08-comp-5.xml	SAT TT=57.047	? (TO) TT=1800.21	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.12	No data	No data	No data	SAT TT=66.263 ASSIGNMENTS=8100 CHECKS=90123900	SAT TT=651.429 ASSIGNMENTS=8100 CHECKS=90123900	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.09	SAT TT=794.575 ASSIGNMENTS=115106 CHECKS=1203800000	SAT TT=57.047 ASSIGNMENTS=8100 CHECKS=90123900	? (TO) TT=1800.19	No data	SAT TT=474.855	SAT TT=178.162
csp/compet08/ normalized-patat-08-comp-6.xml	SAT TT=148.249	? (TO) TT=1800.13	SAT TT=1327.2 CHECKS=392426000 NODES=69848	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.49	? (TO) TT=1800.11	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=1402.25 ASSIGNMENTS=194941 CHECKS=2063610000	? (TO) TT=1800.11	? (TO) TT=1800.17	No data	? (TO) TT=1800.03	SAT TT=148.249
csp/compet08/ normalized-patat-08-comp-7.xml	SAT TT=7.703	SAT TT=27.343 CHECKS=972732 NODES=10794	SAT TT=258.025 CHECKS=15164400 NODES=121326	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=88.107 CHECKS=22813100	SAT TT=240.311 ASSIGNMENTS=3580	? (TO) TT=1800.12	No data	No data	No data	SAT TT=34.978 ASSIGNMENTS=10794 CHECKS=972732	SAT TT=33.434 ASSIGNMENTS=10794 CHECKS=972732	No data	No data	No data	SAT TT=7.703 ASSIGNMENTS=3699 CHECKS=10423400	SAT TT=365.843 ASSIGNMENTS=163208 CHECKS=406517000	? (TO) TT=1800.04	SAT TT=35.498 ASSIGNMENTS=17617 CHECKS=33312300	SAT TT=29.984 ASSIGNMENTS=12717 CHECKS=42440800	SAT TT=20.636	No data	SAT TT=37.686	SAT TT=47.454
csp/compet08/ normalized-patat-08-comp-8.xml	SAT TT=0.885	SAT TT=6.316 CHECKS=71895 NODES=1793	SAT TT=5.707 CHECKS=80973 NODES=419	? (TO) TT=1800.1	SAT TT=14.183 CHECKS=1449550	SAT TT=25.981 CHECKS=6206090	? (TO) TT=1800.12	? (TO) TT=1800.11	No data	No data	No data	SAT TT=12.312 ASSIGNMENTS=1793 CHECKS=71895	SAT TT=12.602 ASSIGNMENTS=1793 CHECKS=71895	No data	No data	No data	SAT TT=5.669 ASSIGNMENTS=5469 CHECKS=5811230	SAT TT=6.128 ASSIGNMENTS=29278 CHECKS=8316910	? (TO) TT=1800.04	SAT TT=6.125 ASSIGNMENTS=8113 CHECKS=4643160	SAT TT=0.885 ASSIGNMENTS=742 CHECKS=672528	SAT TT=17.614	No data	SAT TT=33.727	SAT TT=46.678
csp/compet08/ normalized-patat-08-comp-9.xml		? (TO) TT=1800.09	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.17	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.26	No data	? TT=449.991	? TT=467.154
csp/composed-25-10-20/ normalized-composed-25-10-20-2_ext.xml	SAT TT=0.052	SAT TT=1.044 CHECKS=94780 NODES=527	SAT TT=1.108 CHECKS=243885 NODES=110	SAT TT=0.637	SAT TT=1.486 CHECKS=568907	SAT TT=0.614 CHECKS=131936	SAT TT=1.062 ASSIGNMENTS=48	SAT TT=0.844 ASSIGNMENTS=48	SAT TT=0.724 CHECKS=9029 NODES=150	SAT TT=0.788 CHECKS=125432 NODES=831	SAT TT=0.758 CHECKS=201238 NODES=446	SAT TT=0.068 ASSIGNMENTS=468 CHECKS=30191	SAT TT=0.065 ASSIGNMENTS=468 CHECKS=30191	SAT TT=2.419	SAT TT=2.33	No data	SAT TT=0.058 ASSIGNMENTS=489 CHECKS=31777	SAT TT=0.084 ASSIGNMENTS=1669 CHECKS=175712	SAT TT=0.786	SAT TT=0.062 ASSIGNMENTS=822 CHECKS=105285	SAT TT=0.052 ASSIGNMENTS=468 CHECKS=30191	SAT TT=2.774	SAT TT=0.121 ASSIGNMENTS=135 CHECKS=31404	SAT TT=1.186	SAT TT=1.338
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-25-10-20/ normalized-composed-25-10-20-3_ext.xml	SAT TT=0.053	SAT TT=1.096 CHECKS=32520 NODES=262	SAT TT=1.228 CHECKS=385480 NODES=165	? (TO) TT=1800.1	SAT TT=1.825 CHECKS=728350	SAT TT=0.617 CHECKS=153413	SAT TT=1.048 ASSIGNMENTS=43	SAT TT=0.843 ASSIGNMENTS=43	SAT TT=0.781 CHECKS=15485 NODES=277	SAT TT=0.906 CHECKS=179215 NODES=1644	SAT TT=0.838 CHECKS=420946 NODES=897	SAT TT=0.066 ASSIGNMENTS=412 CHECKS=28502	SAT TT=0.065 ASSIGNMENTS=412 CHECKS=28502	SAT TT=2.663	SAT TT=2.394	No data	SAT TT=0.054 ASSIGNMENTS=543 CHECKS=40277	SAT TT=0.07 ASSIGNMENTS=1074 CHECKS=127336	SAT TT=0.73	SAT TT=0.069 ASSIGNMENTS=815 CHECKS=103798	SAT TT=0.053 ASSIGNMENTS=412 CHECKS=28502	SAT TT=2.911	SAT TT=0.148 ASSIGNMENTS=143 CHECKS=33084	SAT TT=1.451	SAT TT=1.365
csp/composed-25-10-20/ normalized-composed-25-10-20-4_ext.xml	SAT TT=0.045	SAT TT=1.047 CHECKS=65176 NODES=364	SAT TT=1.208 CHECKS=351310 NODES=464	SAT TT=79.985	SAT TT=0.508 CHECKS=145094	SAT TT=0.791 CHECKS=174398	SAT TT=0.862 ASSIGNMENTS=37	SAT TT=0.905 ASSIGNMENTS=37	SAT TT=0.789 CHECKS=17839 NODES=350	SAT TT=0.92 CHECKS=215186 NODES=2245	SAT TT=0.77 CHECKS=538053 NODES=795	SAT TT=0.055 ASSIGNMENTS=64 CHECKS=5497	SAT TT=0.059 ASSIGNMENTS=64 CHECKS=5497	SAT TT=2.28	SAT TT=2.24	No data	SAT TT=0.045 ASSIGNMENTS=66 CHECKS=5656	SAT TT=0.163 ASSIGNMENTS=4954 CHECKS=614678	SAT TT=0.779	SAT TT=0.069 ASSIGNMENTS=801 CHECKS=103671	SAT TT=0.048 ASSIGNMENTS=64 CHECKS=5497	SAT TT=2.945	SAT TT=0.105 ASSIGNMENTS=138 CHECKS=31096	SAT TT=1.285	SAT TT=1.729
csp/composed-25-10-20/ normalized-composed-25-10-20-5_ext.xml	SAT TT=0.048	SAT TT=0.983 CHECKS=11695 NODES=115	SAT TT=1.131 CHECKS=224939 NODES=195	SAT TT=1.59	SAT TT=1.936 CHECKS=755036	SAT TT=0.641 CHECKS=144125	SAT TT=0.896 ASSIGNMENTS=51	SAT TT=0.853 ASSIGNMENTS=51	SAT TT=0.744 CHECKS=14762 NODES=258	SAT TT=0.794 CHECKS=115440 NODES=1004	SAT TT=0.752 CHECKS=168979 NODES=297	SAT TT=0.063 ASSIGNMENTS=212 CHECKS=14881	SAT TT=0.063 ASSIGNMENTS=212 CHECKS=14881	SAT TT=2.499	SAT TT=2.308	No data	SAT TT=0.051 ASSIGNMENTS=224 CHECKS=15923	SAT TT=0.053 ASSIGNMENTS=262 CHECKS=28343	SAT TT=0.765	SAT TT=0.064 ASSIGNMENTS=822 CHECKS=108352	SAT TT=0.048 ASSIGNMENTS=212 CHECKS=14881	SAT TT=2.992	SAT TT=0.12 ASSIGNMENTS=129 CHECKS=29630	SAT TT=1.567	SAT TT=1.346
csp/composed-25-10-20/ normalized-composed-25-10-20-7_ext.xml	SAT TT=0.048	SAT TT=1.029 CHECKS=11266 NODES=110	SAT TT=1.103 CHECKS=173954 NODES=112	SAT TT=0.55	SAT TT=1.987 CHECKS=726918	SAT TT=0.754 CHECKS=166666	SAT TT=0.846 ASSIGNMENTS=70	SAT TT=1.078 ASSIGNMENTS=70	SAT TT=0.788 CHECKS=14580 NODES=256	SAT TT=0.771 CHECKS=50804 NODES=248	SAT TT=0.798 CHECKS=128888 NODES=192	SAT TT=0.057 ASSIGNMENTS=96 CHECKS=7209	SAT TT=0.061 ASSIGNMENTS=96 CHECKS=7209	SAT TT=2.279	SAT TT=2.449	No data	SAT TT=0.052 ASSIGNMENTS=84 CHECKS=6524	SAT TT=0.135 ASSIGNMENTS=3846 CHECKS=440807	SAT TT=0.755	SAT TT=0.067 ASSIGNMENTS=812 CHECKS=105662	SAT TT=0.048 ASSIGNMENTS=96 CHECKS=7209	SAT TT=2.997	SAT TT=0.108 ASSIGNMENTS=128 CHECKS=30298	SAT TT=1.275	SAT TT=1.733
csp/composed-25-1-25/ normalized-composed-25-1-25-1_ext.xml	UNSAT TT=0.02	UNSAT TT=0.809 CHECKS=1788 NODES=3	UNSAT TT=0.839 CHECKS=1745 NODES=0	UNSAT TT=0.168	UNSAT TT=0.046 CHECKS=6637	UNSAT TT=0.033 CHECKS=1217	UNSAT TT=0.693 ASSIGNMENTS=0	UNSAT TT=0.624 ASSIGNMENTS=0	UNSAT TT=0.572 CHECKS=3036 NODES=32	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.033 ASSIGNMENTS=54 CHECKS=6935	UNSAT TT=0.034 ASSIGNMENTS=54 CHECKS=6935	UNSAT TT=0.989	UNSAT TT=1.094	No data	UNSAT TT=0.022 ASSIGNMENTS=99 CHECKS=12791	UNSAT TT=0.033 ASSIGNMENTS=594 CHECKS=63961	UNSAT TT=0.641	UNSAT TT=0.025 ASSIGNMENTS=217 CHECKS=32567	UNSAT TT=0.02 ASSIGNMENTS=54 CHECKS=6935	UNSAT TT=1.769	UNSAT TT=0.038 ASSIGNMENTS=4 CHECKS=2573	UNSAT TT=1.09	UNSAT TT=1.016
csp/composed-25-1-25/ normalized-composed-25-1-25-2_ext.xml	UNSAT TT=0.021	UNSAT TT=0.891 CHECKS=2824 NODES=6	UNSAT TT=0.953 CHECKS=6638 NODES=0	UNSAT TT=0.174	UNSAT TT=0.076 CHECKS=18119	UNSAT TT=0.034 CHECKS=2600	UNSAT TT=0.806 ASSIGNMENTS=0	UNSAT TT=0.687 ASSIGNMENTS=0	UNSAT TT=0.581 CHECKS=3233 NODES=28	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=0.034 ASSIGNMENTS=109 CHECKS=8911	UNSAT TT=0.033 ASSIGNMENTS=109 CHECKS=8911	UNSAT TT=1.229	UNSAT TT=0.996	No data	UNSAT TT=0.023 ASSIGNMENTS=150 CHECKS=12416	UNSAT TT=0.046 ASSIGNMENTS=978 CHECKS=123605	UNSAT TT=0.518	UNSAT TT=0.024 ASSIGNMENTS=196 CHECKS=26831	UNSAT TT=0.021 ASSIGNMENTS=109 CHECKS=8911	UNSAT TT=1.857	UNSAT TT=0.044 ASSIGNMENTS=5 CHECKS=2503	UNSAT TT=0.992	UNSAT TT=1.021
csp/composed-25-1-25/ normalized-composed-25-1-25-3_ext.xml	UNSAT TT=0.023	UNSAT TT=0.861 CHECKS=2121 NODES=5	UNSAT TT=0.846 CHECKS=5064 NODES=0	UNSAT TT=0.173	UNSAT TT=0.072 CHECKS=16749	UNSAT TT=0.032 CHECKS=2282	UNSAT TT=0.669 ASSIGNMENTS=0	UNSAT TT=0.713 ASSIGNMENTS=0	UNSAT TT=0.542 CHECKS=2346 NODES=20	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=0.033 ASSIGNMENTS=69 CHECKS=7780	UNSAT TT=0.033 ASSIGNMENTS=69 CHECKS=7780	UNSAT TT=0.988	UNSAT TT=1.17	No data	UNSAT TT=0.023 ASSIGNMENTS=149 CHECKS=15056	UNSAT TT=0.034 ASSIGNMENTS=531 CHECKS=67496	UNSAT TT=0.508	UNSAT TT=0.024 ASSIGNMENTS=100 CHECKS=18174	UNSAT TT=0.023 ASSIGNMENTS=69 CHECKS=7780	UNSAT TT=1.777	UNSAT TT=0.041 ASSIGNMENTS=3 CHECKS=1736	UNSAT TT=0.96	UNSAT TT=0.99
csp/composed-25-1-25/ normalized-composed-25-1-25-6_ext.xml	UNSAT TT=0.022	UNSAT TT=0.808 CHECKS=2689 NODES=7	UNSAT TT=1.066 CHECKS=6045 NODES=0	UNSAT TT=0.159	UNSAT TT=0.079 CHECKS=19810	UNSAT TT=0.033 CHECKS=2714	UNSAT TT=0.618 ASSIGNMENTS=0	UNSAT TT=0.664 ASSIGNMENTS=0	UNSAT TT=0.539 CHECKS=2921 NODES=31	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=0.034 ASSIGNMENTS=85 CHECKS=7885	UNSAT TT=0.034 ASSIGNMENTS=85 CHECKS=7885	UNSAT TT=1.109	UNSAT TT=0.908	No data	UNSAT TT=0.022 ASSIGNMENTS=147 CHECKS=14236	UNSAT TT=0.049 ASSIGNMENTS=1239 CHECKS=145284	UNSAT TT=0.66	UNSAT TT=0.023 ASSIGNMENTS=198 CHECKS=26473	UNSAT TT=0.022 ASSIGNMENTS=85 CHECKS=7885	UNSAT TT=1.838	UNSAT TT=0.038 ASSIGNMENTS=6 CHECKS=3126	UNSAT TT=1.095	UNSAT TT=0.993
csp/composed-25-1-25/ normalized-composed-25-1-25-8_ext.xml	UNSAT TT=0.021	UNSAT TT=0.873 CHECKS=1996 NODES=4	UNSAT TT=0.868 CHECKS=4024 NODES=0	UNSAT TT=0.169	UNSAT TT=0.042 CHECKS=4883	UNSAT TT=0.034 CHECKS=2711	UNSAT TT=0.621 ASSIGNMENTS=0	UNSAT TT=0.669 ASSIGNMENTS=0	UNSAT TT=0.571 CHECKS=3132 NODES=25	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=0.032 ASSIGNMENTS=61 CHECKS=6411	UNSAT TT=0.034 ASSIGNMENTS=61 CHECKS=6411	UNSAT TT=1.116	UNSAT TT=0.97	No data	UNSAT TT=0.022 ASSIGNMENTS=87 CHECKS=9974	UNSAT TT=0.054 ASSIGNMENTS=1440 CHECKS=175058	UNSAT TT=0.648	UNSAT TT=0.021 ASSIGNMENTS=157 CHECKS=21820	UNSAT TT=0.022 ASSIGNMENTS=61 CHECKS=6411	UNSAT TT=1.662	UNSAT TT=0.039 ASSIGNMENTS=5 CHECKS=2729	UNSAT TT=1.04	UNSAT TT=0.989
csp/composed-25-1-2/ normalized-composed-25-1-2-0_ext.xml	UNSAT TT=0.02	UNSAT TT=0.802 CHECKS=1657 NODES=4	UNSAT TT=0.834 CHECKS=4458 NODES=0	UNSAT TT=0.164	UNSAT TT=0.041 CHECKS=5707	UNSAT TT=0.03 CHECKS=1478	UNSAT TT=0.606 ASSIGNMENTS=0	UNSAT TT=0.695 ASSIGNMENTS=0	UNSAT TT=0.568 CHECKS=2741 NODES=31	? (TO) TT=1800	? (TO) TT=1800	UNSAT TT=0.033 ASSIGNMENTS=117 CHECKS=7189	UNSAT TT=0.033 ASSIGNMENTS=117 CHECKS=7189	UNSAT TT=0.965	UNSAT TT=0.918	No data	UNSAT TT=0.021 ASSIGNMENTS=166 CHECKS=9909	UNSAT TT=0.05 ASSIGNMENTS=2015 CHECKS=142789	UNSAT TT=0.507	UNSAT TT=0.022 ASSIGNMENTS=207 CHECKS=23608	UNSAT TT=0.02 ASSIGNMENTS=117 CHECKS=7189	UNSAT TT=1.636	UNSAT TT=0.035 ASSIGNMENTS=6 CHECKS=949	UNSAT TT=0.945	UNSAT TT=1.122
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-25-1-2/ normalized-composed-25-1-2-6_ext.xml	UNSAT TT=0.022	UNSAT TT=0.81 CHECKS=2153 NODES=7	UNSAT TT=0.82 CHECKS=6829 NODES=0	UNSAT TT=0.155	UNSAT TT=0.058 CHECKS=12965	UNSAT TT=0.031 CHECKS=1806	UNSAT TT=0.638 ASSIGNMENTS=0	UNSAT TT=0.624 ASSIGNMENTS=0	UNSAT TT=0.538 CHECKS=2697 NODES=31	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.033 ASSIGNMENTS=140 CHECKS=9379	UNSAT TT=0.034 ASSIGNMENTS=140 CHECKS=9379	UNSAT TT=0.967	UNSAT TT=0.912	No data	UNSAT TT=0.023 ASSIGNMENTS=185 CHECKS=12365	UNSAT TT=0.035 ASSIGNMENTS=1100 CHECKS=77179	UNSAT TT=0.734	UNSAT TT=0.022 ASSIGNMENTS=193 CHECKS=21883	UNSAT TT=0.022 ASSIGNMENTS=140 CHECKS=9379	UNSAT TT=1.668	UNSAT TT=0.036 ASSIGNMENTS=8 CHECKS=1106	UNSAT TT=1.007	UNSAT TT=0.965
csp/composed-25-1-2/ normalized-composed-25-1-2-7_ext.xml	UNSAT TT=0.02	UNSAT TT=0.785 CHECKS=1807 NODES=5	UNSAT TT=0.94 CHECKS=7699 NODES=0	UNSAT TT=0.152	UNSAT TT=0.067 CHECKS=15940	UNSAT TT=0.031 CHECKS=1763	UNSAT TT=0.602 ASSIGNMENTS=0	UNSAT TT=0.616 ASSIGNMENTS=0	UNSAT TT=0.529 CHECKS=2808 NODES=34	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=0.032 ASSIGNMENTS=140 CHECKS=8252	UNSAT TT=0.034 ASSIGNMENTS=140 CHECKS=8252	UNSAT TT=0.939	UNSAT TT=1.2	No data	UNSAT TT=0.02 ASSIGNMENTS=183 CHECKS=10858	UNSAT TT=0.035 ASSIGNMENTS=1230 CHECKS=86619	UNSAT TT=0.481	UNSAT TT=0.021 ASSIGNMENTS=215 CHECKS=23310	UNSAT TT=0.021 ASSIGNMENTS=140 CHECKS=8252	UNSAT TT=1.667	UNSAT TT=0.037 ASSIGNMENTS=7 CHECKS=977	UNSAT TT=0.934	UNSAT TT=0.949
csp/composed-25-1-2/ normalized-composed-25-1-2-8_ext.xml	UNSAT TT=0.021	UNSAT TT=0.946 CHECKS=1977 NODES=4	UNSAT TT=0.959 CHECKS=6449 NODES=0	UNSAT TT=0.164	UNSAT TT=0.063 CHECKS=11893	UNSAT TT=0.029 CHECKS=1034	UNSAT TT=0.651 ASSIGNMENTS=0	UNSAT TT=0.62 ASSIGNMENTS=0	UNSAT TT=0.6 CHECKS=2665 NODES=30	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.033 ASSIGNMENTS=124 CHECKS=7439	UNSAT TT=0.033 ASSIGNMENTS=124 CHECKS=7439	UNSAT TT=1.168	UNSAT TT=1.11	No data	UNSAT TT=0.021 ASSIGNMENTS=181 CHECKS=11012	UNSAT TT=0.032 ASSIGNMENTS=824 CHECKS=59481	UNSAT TT=0.517	UNSAT TT=0.021 ASSIGNMENTS=204 CHECKS=22768	UNSAT TT=0.023 ASSIGNMENTS=124 CHECKS=7439	UNSAT TT=1.78	UNSAT TT=0.037 ASSIGNMENTS=5 CHECKS=891	UNSAT TT=1.053	UNSAT TT=0.975
csp/composed-25-1-2/ normalized-composed-25-1-2-9_ext.xml	UNSAT TT=0.02	UNSAT TT=0.84 CHECKS=1957 NODES=7	UNSAT TT=0.819 CHECKS=7145 NODES=0	UNSAT TT=0.162	UNSAT TT=0.066 CHECKS=13700	UNSAT TT=0.032 CHECKS=1825	UNSAT TT=0.617 ASSIGNMENTS=0	UNSAT TT=0.617 ASSIGNMENTS=0	UNSAT TT=0.532 CHECKS=2842 NODES=31	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=0.033 ASSIGNMENTS=138 CHECKS=7748	UNSAT TT=0.033 ASSIGNMENTS=138 CHECKS=7748	UNSAT TT=0.936	UNSAT TT=0.953	No data	UNSAT TT=0.021 ASSIGNMENTS=230 CHECKS=12987	UNSAT TT=0.03 ASSIGNMENTS=668 CHECKS=44608	UNSAT TT=0.611	UNSAT TT=0.021 ASSIGNMENTS=220 CHECKS=24330	UNSAT TT=0.02 ASSIGNMENTS=138 CHECKS=7748	UNSAT TT=1.651	UNSAT TT=0.043 ASSIGNMENTS=6 CHECKS=868	UNSAT TT=0.925	UNSAT TT=0.963
csp/composed-25-1-40/ normalized-composed-25-1-40-0_ext.xml	UNSAT TT=0.022	UNSAT TT=0.852 CHECKS=2608 NODES=4	UNSAT TT=0.809 CHECKS=2919 NODES=0	UNSAT TT=0.163	UNSAT TT=0.074 CHECKS=20999	UNSAT TT=0.036 CHECKS=2693	UNSAT TT=0.761 ASSIGNMENTS=0	UNSAT TT=0.633 ASSIGNMENTS=0	UNSAT TT=0.54 CHECKS=3284 NODES=23	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.034 ASSIGNMENTS=69 CHECKS=8300	UNSAT TT=0.034 ASSIGNMENTS=69 CHECKS=8300	UNSAT TT=1.009	UNSAT TT=0.93	No data	UNSAT TT=0.023 ASSIGNMENTS=109 CHECKS=14171	UNSAT TT=0.052 ASSIGNMENTS=1322 CHECKS=186886	UNSAT TT=0.519	UNSAT TT=0.022 ASSIGNMENTS=152 CHECKS=25789	UNSAT TT=0.022 ASSIGNMENTS=69 CHECKS=8300	UNSAT TT=1.665	UNSAT TT=0.038 ASSIGNMENTS=7 CHECKS=5120	UNSAT TT=1.259	UNSAT TT=1.004
csp/composed-25-1-40/ normalized-composed-25-1-40-2_ext.xml	UNSAT TT=0.023	UNSAT TT=0.805 CHECKS=3096 NODES=6	UNSAT TT=0.826 CHECKS=6925 NODES=0	UNSAT TT=0.173	UNSAT TT=0.081 CHECKS=20289	UNSAT TT=0.034 CHECKS=1323	UNSAT TT=0.618 ASSIGNMENTS=0	UNSAT TT=0.629 ASSIGNMENTS=0	UNSAT TT=0.538 CHECKS=3314 NODES=29	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=0.033 ASSIGNMENTS=87 CHECKS=9314	UNSAT TT=0.034 ASSIGNMENTS=87 CHECKS=9314	UNSAT TT=1.183	UNSAT TT=0.919	No data	UNSAT TT=0.025 ASSIGNMENTS=129 CHECKS=15763	UNSAT TT=0.037 ASSIGNMENTS=785 CHECKS=103843	UNSAT TT=0.517	UNSAT TT=0.024 ASSIGNMENTS=150 CHECKS=22448	UNSAT TT=0.023 ASSIGNMENTS=87 CHECKS=9314	UNSAT TT=1.798	UNSAT TT=0.037 ASSIGNMENTS=7 CHECKS=4114	UNSAT TT=0.982	UNSAT TT=1.296
csp/composed-25-1-40/ normalized-composed-25-1-40-3_ext.xml	UNSAT TT=0.022	UNSAT TT=0.811 CHECKS=2561 NODES=5	UNSAT TT=0.816 CHECKS=3829 NODES=0	UNSAT TT=0.176	UNSAT TT=0.044 CHECKS=6256	UNSAT TT=0.033 CHECKS=1609	UNSAT TT=0.809 ASSIGNMENTS=0	UNSAT TT=0.642 ASSIGNMENTS=0	UNSAT TT=0.789 CHECKS=2307 NODES=18	? (TO) TT=1800.1	? (TO) TT=1800	UNSAT TT=0.035 ASSIGNMENTS=60 CHECKS=8959	UNSAT TT=0.033 ASSIGNMENTS=60 CHECKS=8959	UNSAT TT=0.931	UNSAT TT=0.922	No data	UNSAT TT=0.024 ASSIGNMENTS=127 CHECKS=22099	UNSAT TT=0.052 ASSIGNMENTS=1071 CHECKS=170496	UNSAT TT=0.478	UNSAT TT=0.022 ASSIGNMENTS=77 CHECKS=14575	UNSAT TT=0.023 ASSIGNMENTS=60 CHECKS=8959	UNSAT TT=1.69	UNSAT TT=0.048 ASSIGNMENTS=4 CHECKS=3161	UNSAT TT=1.12	UNSAT TT=1.003
csp/composed-25-1-40/ normalized-composed-25-1-40-4_ext.xml	UNSAT TT=0.021	UNSAT TT=0.81 CHECKS=2413 NODES=5	UNSAT TT=0.825 CHECKS=6054 NODES=0	UNSAT TT=0.176	UNSAT TT=0.047 CHECKS=7088	UNSAT TT=0.035 CHECKS=3082	UNSAT TT=0.798 ASSIGNMENTS=0	UNSAT TT=0.633 ASSIGNMENTS=0	UNSAT TT=0.552 CHECKS=3458 NODES=25	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=0.034 ASSIGNMENTS=63 CHECKS=9430	UNSAT TT=0.034 ASSIGNMENTS=63 CHECKS=9430	UNSAT TT=0.999	UNSAT TT=1.06	No data	UNSAT TT=0.021 ASSIGNMENTS=108 CHECKS=14464	UNSAT TT=0.042 ASSIGNMENTS=960 CHECKS=130925	UNSAT TT=0.484	UNSAT TT=0.024 ASSIGNMENTS=136 CHECKS=23277	UNSAT TT=0.021 ASSIGNMENTS=63 CHECKS=9430	UNSAT TT=1.669	UNSAT TT=0.041 ASSIGNMENTS=7 CHECKS=4591	UNSAT TT=1.087	UNSAT TT=0.997
csp/composed-25-1-40/ normalized-composed-25-1-40-5_ext.xml	UNSAT TT=0.02	UNSAT TT=0.805 CHECKS=2585 NODES=6	UNSAT TT=0.859 CHECKS=2758 NODES=0	UNSAT TT=0.164	UNSAT TT=0.047 CHECKS=7304	UNSAT TT=0.031 CHECKS=1056	UNSAT TT=0.625 ASSIGNMENTS=0	UNSAT TT=0.662 ASSIGNMENTS=0	UNSAT TT=0.541 CHECKS=3038 NODES=17	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=0.034 ASSIGNMENTS=39 CHECKS=6423	UNSAT TT=0.032 ASSIGNMENTS=39 CHECKS=6423	UNSAT TT=0.997	UNSAT TT=1.057	No data	UNSAT TT=0.022 ASSIGNMENTS=68 CHECKS=12604	UNSAT TT=0.039 ASSIGNMENTS=637 CHECKS=97538	UNSAT TT=0.626	UNSAT TT=0.024 ASSIGNMENTS=78 CHECKS=14356	UNSAT TT=0.02 ASSIGNMENTS=39 CHECKS=6423	UNSAT TT=1.797	UNSAT TT=0.041 ASSIGNMENTS=6 CHECKS=3717	UNSAT TT=0.974	UNSAT TT=1.222
csp/composed-25-1-80/ normalized-composed-25-1-80-0_ext.xml	UNSAT TT=0.023	UNSAT TT=0.813 CHECKS=3403 NODES=4	UNSAT TT=0.827 CHECKS=3737 NODES=0	UNSAT TT=0.189	UNSAT TT=0.05 CHECKS=8570	UNSAT TT=0.037 CHECKS=1865	UNSAT TT=0.823 ASSIGNMENTS=0	UNSAT TT=0.686 ASSIGNMENTS=0	UNSAT TT=0.595 CHECKS=3507 NODES=21	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.036 ASSIGNMENTS=56 CHECKS=11778	UNSAT TT=0.036 ASSIGNMENTS=56 CHECKS=11778	UNSAT TT=1.253	UNSAT TT=0.995	No data	UNSAT TT=0.028 ASSIGNMENTS=92 CHECKS=20520	UNSAT TT=0.043 ASSIGNMENTS=638 CHECKS=119040	UNSAT TT=0.528	UNSAT TT=0.025 ASSIGNMENTS=82 CHECKS=18397	UNSAT TT=0.023 ASSIGNMENTS=56 CHECKS=11778	UNSAT TT=1.728	UNSAT TT=0.048 ASSIGNMENTS=5 CHECKS=5819	UNSAT TT=1.168	UNSAT TT=1.081
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-25-1-80/ normalized-composed-25-1-80-2_ext.xml	UNSAT TT=0.023	UNSAT TT=0.873 CHECKS=3909 NODES=6	UNSAT TT=0.828 CHECKS=8069 NODES=0	UNSAT TT=0.174	UNSAT TT=0.048 CHECKS=9236	UNSAT TT=0.036 CHECKS=3520	UNSAT TT=0.824 ASSIGNMENTS=0	UNSAT TT=0.644 ASSIGNMENTS=0	UNSAT TT=0.556 CHECKS=4210 NODES=24	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=0.033 ASSIGNMENTS=57 CHECKS=10966	UNSAT TT=0.035 ASSIGNMENTS=57 CHECKS=10966	UNSAT TT=1.019	UNSAT TT=0.989	No data	UNSAT TT=0.025 ASSIGNMENTS=123 CHECKS=23941	UNSAT TT=0.05 ASSIGNMENTS=869 CHECKS=163457	UNSAT TT=0.563	UNSAT TT=0.026 ASSIGNMENTS=131 CHECKS=28954	UNSAT TT=0.023 ASSIGNMENTS=57 CHECKS=10966	UNSAT TT=1.733	UNSAT TT=0.049 ASSIGNMENTS=5 CHECKS=5913	UNSAT TT=1.15	UNSAT TT=1.183
csp/composed-25-1-80/ normalized-composed-25-1-80-7_ext.xml	UNSAT TT=0.026	UNSAT TT=0.834 CHECKS=4073 NODES=6	UNSAT TT=0.806 CHECKS=3584 NODES=0	UNSAT TT=0.183	UNSAT TT=0.091 CHECKS=26444	UNSAT TT=0.04 CHECKS=3681	UNSAT TT=0.821 ASSIGNMENTS=0	UNSAT TT=0.733 ASSIGNMENTS=0	UNSAT TT=0.564 CHECKS=3680 NODES=23	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.038 ASSIGNMENTS=77 CHECKS=12718	UNSAT TT=0.037 ASSIGNMENTS=77 CHECKS=12718	UNSAT TT=0.948	UNSAT TT=1.149	No data	UNSAT TT=0.027 ASSIGNMENTS=151 CHECKS=25908	UNSAT TT=0.056 ASSIGNMENTS=1161 CHECKS=232847	UNSAT TT=0.541	UNSAT TT=0.028 ASSIGNMENTS=135 CHECKS=29871	UNSAT TT=0.026 ASSIGNMENTS=77 CHECKS=12718	UNSAT TT=1.738	UNSAT TT=0.046 ASSIGNMENTS=6 CHECKS=6327	UNSAT TT=1.015	UNSAT TT=0.982
csp/composed-25-1-80/ normalized-composed-25-1-80-8_ext.xml	UNSAT TT=0.022	UNSAT TT=0.848 CHECKS=3064 NODES=4	UNSAT TT=0.834 CHECKS=4175 NODES=0	UNSAT TT=0.177	UNSAT TT=0.099 CHECKS=30903	UNSAT TT=0.033 CHECKS=1358	UNSAT TT=0.645 ASSIGNMENTS=0	UNSAT TT=0.663 ASSIGNMENTS=0	UNSAT TT=0.574 CHECKS=3587 NODES=23	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.034 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=0.035 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=1.009	UNSAT TT=0.967	No data	UNSAT TT=0.022 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=0.064 ASSIGNMENTS=1216 CHECKS=247400	UNSAT TT=0.574	UNSAT TT=0.025 ASSIGNMENTS=52 CHECKS=10486	UNSAT TT=0.024 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=1.886	UNSAT TT=0.048 ASSIGNMENTS=7 CHECKS=7658	UNSAT TT=1.311	UNSAT TT=1.007
csp/composed-25-1-80/ normalized-composed-25-1-80-9_ext.xml	UNSAT TT=0.024	UNSAT TT=0.81 CHECKS=4729 NODES=8	UNSAT TT=0.852 CHECKS=6657 NODES=0	UNSAT TT=0.189	UNSAT TT=0.062 CHECKS=14835	UNSAT TT=0.04 CHECKS=4278	UNSAT TT=0.632 ASSIGNMENTS=0	UNSAT TT=0.701 ASSIGNMENTS=0	UNSAT TT=0.571 CHECKS=3417 NODES=24	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.038 ASSIGNMENTS=75 CHECKS=13828	UNSAT TT=0.037 ASSIGNMENTS=75 CHECKS=13828	UNSAT TT=1.171	UNSAT TT=1.016	No data	UNSAT TT=0.029 ASSIGNMENTS=179 CHECKS=41164	UNSAT TT=0.064 ASSIGNMENTS=1230 CHECKS=252489	UNSAT TT=0.5	UNSAT TT=0.024 ASSIGNMENTS=75 CHECKS=16749	UNSAT TT=0.026 ASSIGNMENTS=75 CHECKS=13828	UNSAT TT=1.738	UNSAT TT=0.046 ASSIGNMENTS=6 CHECKS=5725	UNSAT TT=0.951	UNSAT TT=1.06
csp/composed-75-1-25/ normalized-composed-75-1-25-2_ext.xml	UNSAT TT=0.051	UNSAT TT=0.946 CHECKS=2223 NODES=6	UNSAT TT=0.95 CHECKS=12138 NODES=0	UNSAT TT=0.399	UNSAT TT=0.215 CHECKS=54998	UNSAT TT=0.08 CHECKS=5385	UNSAT TT=0.748 ASSIGNMENTS=0	UNSAT TT=0.812 ASSIGNMENTS=0	UNSAT TT=0.748 CHECKS=6488 NODES=50	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.064 ASSIGNMENTS=248 CHECKS=26215	UNSAT TT=0.063 ASSIGNMENTS=248 CHECKS=26215	UNSAT TT=1.406	UNSAT TT=1.38	No data	UNSAT TT=0.051 ASSIGNMENTS=304 CHECKS=31909	UNSAT TT=0.152 ASSIGNMENTS=4853 CHECKS=586337	UNSAT TT=0.653	UNSAT TT=0.056 ASSIGNMENTS=470 CHECKS=68700	UNSAT TT=0.052 ASSIGNMENTS=248 CHECKS=26215	UNSAT TT=2.512	UNSAT TT=0.099 ASSIGNMENTS=6 CHECKS=3286	UNSAT TT=1.536	UNSAT TT=1.259
csp/composed-75-1-25/ normalized-composed-75-1-25-4_ext.xml	UNSAT TT=0.047	UNSAT TT=0.993 CHECKS=2300 NODES=6	UNSAT TT=1.1 CHECKS=1981 NODES=0	UNSAT TT=0.405	UNSAT TT=0.122 CHECKS=16988	UNSAT TT=0.077 CHECKS=5168	UNSAT TT=0.775 ASSIGNMENTS=0	UNSAT TT=0.788 ASSIGNMENTS=0	UNSAT TT=0.705 CHECKS=6264 NODES=54	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=0.063 ASSIGNMENTS=212 CHECKS=17958	UNSAT TT=0.062 ASSIGNMENTS=212 CHECKS=17958	UNSAT TT=1.435	UNSAT TT=1.378	No data	UNSAT TT=0.051 ASSIGNMENTS=214 CHECKS=19167	UNSAT TT=0.154 ASSIGNMENTS=5113 CHECKS=582357	UNSAT TT=0.655	UNSAT TT=0.06 ASSIGNMENTS=553 CHECKS=79081	UNSAT TT=0.047 ASSIGNMENTS=212 CHECKS=17958	UNSAT TT=2.518	UNSAT TT=0.096 ASSIGNMENTS=6 CHECKS=3075	UNSAT TT=1.319	UNSAT TT=1.466
csp/composed-75-1-25/ normalized-composed-75-1-25-5_ext.xml	UNSAT TT=0.048	UNSAT TT=0.976 CHECKS=2104 NODES=5	UNSAT TT=0.987 CHECKS=20212 NODES=0	UNSAT TT=0.401	UNSAT TT=0.211 CHECKS=53887	UNSAT TT=0.076 CHECKS=2534	UNSAT TT=0.753 ASSIGNMENTS=0	UNSAT TT=0.824 ASSIGNMENTS=0	UNSAT TT=0.867 CHECKS=6594 NODES=48	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.063 ASSIGNMENTS=204 CHECKS=19561	UNSAT TT=0.059 ASSIGNMENTS=204 CHECKS=19561	UNSAT TT=1.641	UNSAT TT=1.403	No data	UNSAT TT=0.054 ASSIGNMENTS=272 CHECKS=24806	UNSAT TT=0.175 ASSIGNMENTS=6252 CHECKS=692225	UNSAT TT=0.659	UNSAT TT=0.056 ASSIGNMENTS=532 CHECKS=80384	UNSAT TT=0.048 ASSIGNMENTS=204 CHECKS=19561	UNSAT TT=2.369	UNSAT TT=0.098 ASSIGNMENTS=7 CHECKS=2357	UNSAT TT=1.388	UNSAT TT=1.442
csp/composed-75-1-25/ normalized-composed-75-1-25-6_ext.xml	UNSAT TT=0.049	UNSAT TT=0.983 CHECKS=1998 NODES=4	UNSAT TT=1 CHECKS=19651 NODES=0	UNSAT TT=0.401	UNSAT TT=0.214 CHECKS=55945	UNSAT TT=0.075 CHECKS=5312	UNSAT TT=0.772 ASSIGNMENTS=0	UNSAT TT=0.776 ASSIGNMENTS=0	UNSAT TT=0.754 CHECKS=6411 NODES=40	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=0.061 ASSIGNMENTS=345 CHECKS=24299	UNSAT TT=0.064 ASSIGNMENTS=345 CHECKS=24299	UNSAT TT=1.433	UNSAT TT=1.394	No data	UNSAT TT=0.049 ASSIGNMENTS=344 CHECKS=24991	UNSAT TT=0.166 ASSIGNMENTS=6230 CHECKS=691261	UNSAT TT=0.66	UNSAT TT=0.053 ASSIGNMENTS=514 CHECKS=68300	UNSAT TT=0.049 ASSIGNMENTS=345 CHECKS=24299	UNSAT TT=2.308	UNSAT TT=0.095 ASSIGNMENTS=8 CHECKS=3043	UNSAT TT=1.382	UNSAT TT=1.394
csp/composed-75-1-25/ normalized-composed-75-1-25-9_ext.xml	UNSAT TT=0.049	UNSAT TT=1.079 CHECKS=2301 NODES=5	UNSAT TT=1.003 CHECKS=13015 NODES=0	UNSAT TT=0.402	UNSAT TT=0.198 CHECKS=51657	UNSAT TT=0.082 CHECKS=11771	UNSAT TT=0.753 ASSIGNMENTS=0	UNSAT TT=0.998 ASSIGNMENTS=0	UNSAT TT=0.743 CHECKS=6760 NODES=63	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.065 ASSIGNMENTS=257 CHECKS=19768	UNSAT TT=0.06 ASSIGNMENTS=257 CHECKS=19768	UNSAT TT=1.413	UNSAT TT=1.409	No data	UNSAT TT=0.051 ASSIGNMENTS=329 CHECKS=25050	UNSAT TT=0.176 ASSIGNMENTS=6351 CHECKS=691833	UNSAT TT=0.825	UNSAT TT=0.055 ASSIGNMENTS=537 CHECKS=82350	UNSAT TT=0.049 ASSIGNMENTS=257 CHECKS=19768	UNSAT TT=2.328	UNSAT TT=0.092 ASSIGNMENTS=7 CHECKS=3052	UNSAT TT=1.174	UNSAT TT=1.347
csp/composed-75-1-2/ normalized-composed-75-1-2-0_ext.xml	UNSAT TT=0.047	UNSAT TT=0.942 CHECKS=1852 NODES=5	UNSAT TT=1.127 CHECKS=17117 NODES=0	UNSAT TT=0.399	UNSAT TT=0.199 CHECKS=49100	UNSAT TT=0.075 CHECKS=4898	UNSAT TT=0.802 ASSIGNMENTS=0	UNSAT TT=0.997 ASSIGNMENTS=0	UNSAT TT=0.705 CHECKS=8367 NODES=94	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=0.059 ASSIGNMENTS=258 CHECKS=17659	UNSAT TT=0.061 ASSIGNMENTS=258 CHECKS=17659	UNSAT TT=1.68	UNSAT TT=1.575	No data	UNSAT TT=0.05 ASSIGNMENTS=279 CHECKS=19618	UNSAT TT=0.107 ASSIGNMENTS=3874 CHECKS=355491	UNSAT TT=0.6	UNSAT TT=0.052 ASSIGNMENTS=555 CHECKS=66796	UNSAT TT=0.047 ASSIGNMENTS=258 CHECKS=17659	UNSAT TT=2.457	UNSAT TT=0.098 ASSIGNMENTS=5 CHECKS=957	UNSAT TT=1.182	UNSAT TT=1.472
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-75-1-2/ normalized-composed-75-1-2-1_ext.xml	UNSAT TT=0.047	UNSAT TT=0.94 CHECKS=1801 NODES=5	UNSAT TT=1.011 CHECKS=17108 NODES=0	UNSAT TT=0.396	UNSAT TT=0.192 CHECKS=45987	UNSAT TT=0.078 CHECKS=4860	UNSAT TT=0.87 ASSIGNMENTS=0	UNSAT TT=0.752 ASSIGNMENTS=0	UNSAT TT=0.947 CHECKS=6473 NODES=56	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=0.062 ASSIGNMENTS=402 CHECKS=23171	UNSAT TT=0.061 ASSIGNMENTS=402 CHECKS=23171	UNSAT TT=1.538	UNSAT TT=1.361	No data	UNSAT TT=0.049 ASSIGNMENTS=413 CHECKS=23658	UNSAT TT=0.151 ASSIGNMENTS=6633 CHECKS=584150	UNSAT TT=0.65	UNSAT TT=0.054 ASSIGNMENTS=527 CHECKS=72323	UNSAT TT=0.047 ASSIGNMENTS=402 CHECKS=23171	UNSAT TT=2.307	UNSAT TT=0.091 ASSIGNMENTS=8 CHECKS=1063	UNSAT TT=1.39	UNSAT TT=1.431
csp/composed-75-1-2/ normalized-composed-75-1-2-2_ext.xml	UNSAT TT=0.047	UNSAT TT=0.974 CHECKS=1888 NODES=6	UNSAT TT=1.147 CHECKS=19142 NODES=0	UNSAT TT=0.393	UNSAT TT=0.198 CHECKS=47297	UNSAT TT=0.079 CHECKS=4813	UNSAT TT=0.824 ASSIGNMENTS=0	UNSAT TT=0.97 ASSIGNMENTS=0	UNSAT TT=0.953 CHECKS=6242 NODES=62	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.061 ASSIGNMENTS=335 CHECKS=21110	UNSAT TT=0.061 ASSIGNMENTS=335 CHECKS=21110	UNSAT TT=1.404	UNSAT TT=1.499	No data	UNSAT TT=0.05 ASSIGNMENTS=364 CHECKS=23340	UNSAT TT=0.109 ASSIGNMENTS=4024 CHECKS=358778	UNSAT TT=0.716	UNSAT TT=0.056 ASSIGNMENTS=579 CHECKS=77807	UNSAT TT=0.047 ASSIGNMENTS=335 CHECKS=21110	UNSAT TT=2.483	UNSAT TT=0.097 ASSIGNMENTS=6 CHECKS=977	UNSAT TT=1.226	UNSAT TT=1.434
csp/composed-75-1-2/ normalized-composed-75-1-2-5_ext.xml	UNSAT TT=0.047	UNSAT TT=0.943 CHECKS=1528 NODES=5	UNSAT TT=0.99 CHECKS=17462 NODES=0	UNSAT TT=0.394	UNSAT TT=0.114 CHECKS=14512	UNSAT TT=0.074 CHECKS=4787	UNSAT TT=0.819 ASSIGNMENTS=0	UNSAT TT=0.812 ASSIGNMENTS=0	UNSAT TT=0.738 CHECKS=6352 NODES=51	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=0.06 ASSIGNMENTS=387 CHECKS=24082	UNSAT TT=0.062 ASSIGNMENTS=387 CHECKS=24082	UNSAT TT=1.402	UNSAT TT=1.483	No data	UNSAT TT=0.047 ASSIGNMENTS=388 CHECKS=23947	UNSAT TT=0.144 ASSIGNMENTS=6082 CHECKS=529241	UNSAT TT=0.639	UNSAT TT=0.055 ASSIGNMENTS=562 CHECKS=73130	UNSAT TT=0.05 ASSIGNMENTS=387 CHECKS=24082	UNSAT TT=2.484	UNSAT TT=0.093 ASSIGNMENTS=7 CHECKS=1019	UNSAT TT=1.361	UNSAT TT=1.43
csp/composed-75-1-2/ normalized-composed-75-1-2-7_ext.xml	UNSAT TT=0.047	UNSAT TT=0.998 CHECKS=1673 NODES=4	UNSAT TT=1.102 CHECKS=17171 NODES=0	UNSAT TT=0.399	UNSAT TT=0.218 CHECKS=57838	UNSAT TT=0.071 CHECKS=2268	UNSAT TT=0.958 ASSIGNMENTS=0	UNSAT TT=0.97 ASSIGNMENTS=0	UNSAT TT=0.904 CHECKS=6066 NODES=68	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.061 ASSIGNMENTS=366 CHECKS=21831	UNSAT TT=0.062 ASSIGNMENTS=366 CHECKS=21831	UNSAT TT=1.321	UNSAT TT=1.381	No data	UNSAT TT=0.047 ASSIGNMENTS=389 CHECKS=22732	UNSAT TT=0.155 ASSIGNMENTS=6524 CHECKS=593423	UNSAT TT=0.641	UNSAT TT=0.054 ASSIGNMENTS=590 CHECKS=79866	UNSAT TT=0.048 ASSIGNMENTS=366 CHECKS=21831	UNSAT TT=2.476	UNSAT TT=0.093 ASSIGNMENTS=7 CHECKS=1051	UNSAT TT=1.201	UNSAT TT=1.353
csp/composed-75-1-40/ normalized-composed-75-1-40-1_ext.xml	UNSAT TT=0.049	UNSAT TT=0.978 CHECKS=2367 NODES=5	UNSAT TT=0.963 CHECKS=18242 NODES=0	UNSAT TT=0.404	UNSAT TT=0.227 CHECKS=59123	UNSAT TT=0.072 CHECKS=2486	UNSAT TT=0.987 ASSIGNMENTS=0	UNSAT TT=0.826 ASSIGNMENTS=0	UNSAT TT=0.758 CHECKS=6854 NODES=39	? (TO) TT=1800	? (TO) TT=1800.08	UNSAT TT=0.065 ASSIGNMENTS=292 CHECKS=24789	UNSAT TT=0.059 ASSIGNMENTS=292 CHECKS=24789	UNSAT TT=1.426	UNSAT TT=1.512	No data	UNSAT TT=0.052 ASSIGNMENTS=307 CHECKS=26165	UNSAT TT=0.184 ASSIGNMENTS=6210 CHECKS=748357	UNSAT TT=0.675	UNSAT TT=0.058 ASSIGNMENTS=500 CHECKS=83243	UNSAT TT=0.049 ASSIGNMENTS=292 CHECKS=24789	UNSAT TT=2.331	UNSAT TT=0.101 ASSIGNMENTS=8 CHECKS=4165	UNSAT TT=1.129	UNSAT TT=1.264
csp/composed-75-1-40/ normalized-composed-75-1-40-2_ext.xml	UNSAT TT=0.05	UNSAT TT=0.938 CHECKS=2453 NODES=6	UNSAT TT=1.029 CHECKS=11787 NODES=0	UNSAT TT=0.407	UNSAT TT=0.129 CHECKS=20089	UNSAT TT=0.081 CHECKS=5532	UNSAT TT=0.804 ASSIGNMENTS=0	UNSAT TT=1.001 ASSIGNMENTS=0	UNSAT TT=0.799 CHECKS=6663 NODES=40	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.062 ASSIGNMENTS=227 CHECKS=23545	UNSAT TT=0.066 ASSIGNMENTS=227 CHECKS=23545	UNSAT TT=1.459	UNSAT TT=1.369	No data	UNSAT TT=0.052 ASSIGNMENTS=259 CHECKS=27119	UNSAT TT=0.205 ASSIGNMENTS=5936 CHECKS=878926	UNSAT TT=0.659	UNSAT TT=0.053 ASSIGNMENTS=359 CHECKS=58059	UNSAT TT=0.05 ASSIGNMENTS=227 CHECKS=23545	UNSAT TT=2.496	UNSAT TT=0.1 ASSIGNMENTS=6 CHECKS=4554	UNSAT TT=1.206	UNSAT TT=1.372
csp/composed-75-1-40/ normalized-composed-75-1-40-5_ext.xml	UNSAT TT=0.049	UNSAT TT=0.946 CHECKS=2565 NODES=5	UNSAT TT=1.111 CHECKS=8496 NODES=0	UNSAT TT=0.379	UNSAT TT=0.129 CHECKS=20493	UNSAT TT=0.079 CHECKS=5540	UNSAT TT=0.78 ASSIGNMENTS=0	UNSAT TT=0.907 ASSIGNMENTS=0	UNSAT TT=0.758 CHECKS=7403 NODES=40	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.06 ASSIGNMENTS=192 CHECKS=20622	UNSAT TT=0.058 ASSIGNMENTS=192 CHECKS=20622	UNSAT TT=1.422	UNSAT TT=1.396	No data	UNSAT TT=0.05 ASSIGNMENTS=206 CHECKS=24405	UNSAT TT=0.204 ASSIGNMENTS=5940 CHECKS=826891	UNSAT TT=0.815	UNSAT TT=0.059 ASSIGNMENTS=564 CHECKS=95606	UNSAT TT=0.049 ASSIGNMENTS=192 CHECKS=20622	UNSAT TT=2.356	UNSAT TT=0.101 ASSIGNMENTS=7 CHECKS=4342	UNSAT TT=1.16	UNSAT TT=1.456
csp/composed-75-1-40/ normalized-composed-75-1-40-6_ext.xml	UNSAT TT=0.048	UNSAT TT=0.945 CHECKS=2961 NODES=6	UNSAT TT=1.027 CHECKS=13797 NODES=0	UNSAT TT=0.402	UNSAT TT=0.223 CHECKS=59180	UNSAT TT=0.076 CHECKS=3007	UNSAT TT=0.754 ASSIGNMENTS=0	UNSAT TT=0.831 ASSIGNMENTS=0	UNSAT TT=0.759 CHECKS=6946 NODES=41	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.061 ASSIGNMENTS=179 CHECKS=19905	UNSAT TT=0.061 ASSIGNMENTS=179 CHECKS=19905	UNSAT TT=1.577	UNSAT TT=1.386	No data	UNSAT TT=0.048 ASSIGNMENTS=238 CHECKS=28730	UNSAT TT=0.133 ASSIGNMENTS=3361 CHECKS=469964	UNSAT TT=0.661	UNSAT TT=0.06 ASSIGNMENTS=590 CHECKS=86812	UNSAT TT=0.05 ASSIGNMENTS=179 CHECKS=19905	UNSAT TT=2.514	UNSAT TT=0.091 ASSIGNMENTS=6 CHECKS=3968	UNSAT TT=1.397	UNSAT TT=1.261
csp/composed-75-1-40/ normalized-composed-75-1-40-9_ext.xml	UNSAT TT=0.05	UNSAT TT=0.963 CHECKS=2778 NODES=5	UNSAT TT=0.968 CHECKS=14100 NODES=0	UNSAT TT=0.409	UNSAT TT=0.135 CHECKS=23434	UNSAT TT=0.082 CHECKS=5660	UNSAT TT=0.76 ASSIGNMENTS=0	UNSAT TT=0.99 ASSIGNMENTS=0	UNSAT TT=0.77 CHECKS=6978 NODES=63	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.064 ASSIGNMENTS=254 CHECKS=23092	UNSAT TT=0.063 ASSIGNMENTS=254 CHECKS=23092	UNSAT TT=1.431	UNSAT TT=1.374	No data	UNSAT TT=0.052 ASSIGNMENTS=272 CHECKS=27389	UNSAT TT=0.194 ASSIGNMENTS=6127 CHECKS=787308	UNSAT TT=0.656	UNSAT TT=0.053 ASSIGNMENTS=353 CHECKS=59456	UNSAT TT=0.05 ASSIGNMENTS=254 CHECKS=23092	UNSAT TT=2.446	UNSAT TT=0.099 ASSIGNMENTS=8 CHECKS=3659	UNSAT TT=1.184	UNSAT TT=1.446
csp/composed-75-1-80/ normalized-composed-75-1-80-1_ext.xml	UNSAT TT=0.049	UNSAT TT=1.109 CHECKS=3548 NODES=6	UNSAT TT=1.023 CHECKS=12036 NODES=0	UNSAT TT=0.417	UNSAT TT=0.232 CHECKS=61937	UNSAT TT=0.084 CHECKS=6114	UNSAT TT=0.826 ASSIGNMENTS=0	UNSAT TT=0.791 ASSIGNMENTS=0	UNSAT TT=0.776 CHECKS=5267 NODES=30	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.065 ASSIGNMENTS=181 CHECKS=25346	UNSAT TT=0.06 ASSIGNMENTS=181 CHECKS=25346	UNSAT TT=1.588	UNSAT TT=1.306	No data	UNSAT TT=0.053 ASSIGNMENTS=215 CHECKS=34722	UNSAT TT=0.155 ASSIGNMENTS=3438 CHECKS=598000	UNSAT TT=0.669	UNSAT TT=0.049 ASSIGNMENTS=173 CHECKS=32381	UNSAT TT=0.051 ASSIGNMENTS=181 CHECKS=25346	UNSAT TT=2.672	UNSAT TT=0.104 ASSIGNMENTS=8 CHECKS=7474	UNSAT TT=1.386	UNSAT TT=1.235
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-75-1-80/ normalized-composed-75-1-80-3_ext.xml	UNSAT TT=0.047	UNSAT TT=0.944 CHECKS=3487 NODES=6	UNSAT TT=1.104 CHECKS=6399 NODES=0	UNSAT TT=0.416	UNSAT TT=0.247 CHECKS=69188	UNSAT TT=0.09 CHECKS=8103	UNSAT TT=0.774 ASSIGNMENTS=0	UNSAT TT=0.816 ASSIGNMENTS=0	UNSAT TT=0.722 CHECKS=4469 NODES=31	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=0.056 ASSIGNMENTS=114 CHECKS=19207	UNSAT TT=0.06 ASSIGNMENTS=114 CHECKS=19207	UNSAT TT=1.363	UNSAT TT=1.524	No data	UNSAT TT=0.047 ASSIGNMENTS=122 CHECKS=25767	UNSAT TT=0.069 ASSIGNMENTS=815 CHECKS=157633	UNSAT TT=0.63	UNSAT TT=0.049 ASSIGNMENTS=158 CHECKS=29975	UNSAT TT=0.048 ASSIGNMENTS=114 CHECKS=19207	UNSAT TT=2.486	UNSAT TT=0.104 ASSIGNMENTS=5 CHECKS=7797	UNSAT TT=1.359	UNSAT TT=1.228
csp/composed-75-1-80/ normalized-composed-75-1-80-6_ext.xml	UNSAT TT=0.05	UNSAT TT=0.981 CHECKS=3918 NODES=6	UNSAT TT=0.962 CHECKS=8245 NODES=0	UNSAT TT=0.39	UNSAT TT=0.216 CHECKS=64176	UNSAT TT=0.078 CHECKS=6342	UNSAT TT=0.776 ASSIGNMENTS=0	UNSAT TT=0.948 ASSIGNMENTS=0	UNSAT TT=0.843 CHECKS=5346 NODES=28	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=0.058 ASSIGNMENTS=137 CHECKS=22217	UNSAT TT=0.057 ASSIGNMENTS=137 CHECKS=22217	UNSAT TT=1.385	UNSAT TT=1.404	No data	UNSAT TT=0.052 ASSIGNMENTS=172 CHECKS=26930	UNSAT TT=0.161 ASSIGNMENTS=3825 CHECKS=727874	UNSAT TT=0.629	UNSAT TT=0.053 ASSIGNMENTS=203 CHECKS=39726	UNSAT TT=0.05 ASSIGNMENTS=137 CHECKS=22217	UNSAT TT=2.702	UNSAT TT=0.105 ASSIGNMENTS=7 CHECKS=7103	UNSAT TT=1.392	UNSAT TT=1.305
csp/composed-75-1-80/ normalized-composed-75-1-80-8_ext.xml	UNSAT TT=0.045	UNSAT TT=0.956 CHECKS=2943 NODES=3	UNSAT TT=1.015 CHECKS=8962 NODES=0	UNSAT TT=0.392	UNSAT TT=0.241 CHECKS=74686	UNSAT TT=0.086 CHECKS=7160	UNSAT TT=0.767 ASSIGNMENTS=0	UNSAT TT=0.813 ASSIGNMENTS=0	UNSAT TT=0.779 CHECKS=5973 NODES=32	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.059 ASSIGNMENTS=80 CHECKS=18864	UNSAT TT=0.06 ASSIGNMENTS=80 CHECKS=18864	UNSAT TT=1.452	UNSAT TT=1.347	No data	UNSAT TT=0.05 ASSIGNMENTS=101 CHECKS=27615	UNSAT TT=0.171 ASSIGNMENTS=3589 CHECKS=710950	UNSAT TT=0.834	UNSAT TT=0.045 ASSIGNMENTS=118 CHECKS=24676	UNSAT TT=0.047 ASSIGNMENTS=80 CHECKS=18864	UNSAT TT=2.691	UNSAT TT=0.115 ASSIGNMENTS=8 CHECKS=8407	UNSAT TT=1.315	UNSAT TT=1.385
csp/composed-75-1-80/ normalized-composed-75-1-80-9_ext.xml	UNSAT TT=0.046	UNSAT TT=0.973 CHECKS=3562 NODES=5	UNSAT TT=0.944 CHECKS=10216 NODES=0	UNSAT TT=0.415	UNSAT TT=0.223 CHECKS=59283	UNSAT TT=0.075 CHECKS=3521	UNSAT TT=0.773 ASSIGNMENTS=0	UNSAT TT=0.78 ASSIGNMENTS=0	UNSAT TT=0.783 CHECKS=4457 NODES=24	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.063 ASSIGNMENTS=150 CHECKS=23040	UNSAT TT=0.061 ASSIGNMENTS=150 CHECKS=23040	UNSAT TT=1.337	UNSAT TT=1.398	No data	UNSAT TT=0.052 ASSIGNMENTS=232 CHECKS=34355	UNSAT TT=0.199 ASSIGNMENTS=5068 CHECKS=949522	UNSAT TT=0.668	UNSAT TT=0.046 ASSIGNMENTS=115 CHECKS=22510	UNSAT TT=0.051 ASSIGNMENTS=150 CHECKS=23040	UNSAT TT=2.685	UNSAT TT=0.096 ASSIGNMENTS=8 CHECKS=7375	UNSAT TT=1.144	UNSAT TT=1.285
csp/costasArray/ normalized-costasArray-10.xml	SAT TT=0.011	SAT TT=0.833 CHECKS=32729 NODES=66	SAT TT=0.938 CHECKS=282491 NODES=160	SAT TT=0.037	SAT TT=0.122 CHECKS=7825	SAT TT=0.018 CHECKS=6358	SAT TT=1.227 ASSIGNMENTS=12	SAT TT=1.094 ASSIGNMENTS=7	No data	No data	No data	SAT TT=0.024 ASSIGNMENTS=17 CHECKS=3021	SAT TT=0.021 ASSIGNMENTS=17 CHECKS=3021	No data	No data	No data	SAT TT=0.011 ASSIGNMENTS=17 CHECKS=3021	SAT TT=0.014 ASSIGNMENTS=61 CHECKS=7715	SAT TT=0.388	SAT TT=0.098 ASSIGNMENTS=619 CHECKS=73290	SAT TT=0.012 ASSIGNMENTS=12 CHECKS=2230	SAT TT=3.687	No data	SAT TT=1.065	SAT TT=0.994
csp/costasArray/ normalized-costasArray-11.xml	SAT TT=0.016	SAT TT=1.024 CHECKS=430029 NODES=346	SAT TT=1.089 CHECKS=507038 NODES=241	SAT TT=0.04	SAT TT=0.144 CHECKS=66321	SAT TT=0.071 CHECKS=65629	SAT TT=1.666 ASSIGNMENTS=111	SAT TT=1.46 ASSIGNMENTS=9	No data	No data	No data	SAT TT=0.085 ASSIGNMENTS=384 CHECKS=79578	SAT TT=0.089 ASSIGNMENTS=384 CHECKS=79578	No data	No data	No data	SAT TT=0.058 ASSIGNMENTS=272 CHECKS=57112	SAT TT=0.198 ASSIGNMENTS=1505 CHECKS=228845	SAT TT=0.453	SAT TT=0.075 ASSIGNMENTS=341 CHECKS=46140	SAT TT=0.016 ASSIGNMENTS=30 CHECKS=5651	SAT TT=4.204	No data	SAT TT=1.273	SAT TT=1.442
csp/costasArray/ normalized-costasArray-12.xml	SAT TT=0.046	SAT TT=1.363 CHECKS=994220 NODES=595	SAT TT=1.01 CHECKS=528725 NODES=114	SAT TT=0.046	SAT TT=0.193 CHECKS=88241	SAT TT=0.098 CHECKS=88238	SAT TT=2.051 ASSIGNMENTS=516	SAT TT=1.652 ASSIGNMENTS=19	No data	No data	No data	SAT TT=0.067 ASSIGNMENTS=201 CHECKS=50613	SAT TT=0.069 ASSIGNMENTS=201 CHECKS=50613	No data	No data	No data	SAT TT=0.049 ASSIGNMENTS=181 CHECKS=46589	SAT TT=0.061 ASSIGNMENTS=316 CHECKS=57495	SAT TT=0.479	SAT TT=0.297 ASSIGNMENTS=1317 CHECKS=229344	SAT TT=0.077 ASSIGNMENTS=293 CHECKS=72354	SAT TT=6.223	No data	SAT TT=1.102	SAT TT=1.64
csp/costasArray/ normalized-costasArray-13.xml	SAT TT=0.058	SAT TT=3.553 CHECKS=5253070 NODES=2745	SAT TT=1.63 CHECKS=1707190 NODES=541	SAT TT=0.167	SAT TT=0.308 CHECKS=177217	SAT TT=0.191 CHECKS=184901	SAT TT=3.739 ASSIGNMENTS=1578	SAT TT=2.097 ASSIGNMENTS=112	No data	No data	No data	SAT TT=0.231 ASSIGNMENTS=824 CHECKS=228581	SAT TT=0.218 ASSIGNMENTS=824 CHECKS=228581	No data	No data	No data	SAT TT=0.058 ASSIGNMENTS=148 CHECKS=43778	SAT TT=0.463 ASSIGNMENTS=2456 CHECKS=501267	SAT TT=0.468	SAT TT=0.49 ASSIGNMENTS=1828 CHECKS=380489	SAT TT=0.384 ASSIGNMENTS=1510 CHECKS=399635	SAT TT=12.374	No data	SAT TT=1.339	SAT TT=1.701
csp/costasArray/ normalized-costasArray-14.xml	SAT TT=0.207	SAT TT=1.212 CHECKS=909507 NODES=299	SAT TT=1.987 CHECKS=2760210 NODES=631	SAT TT=0.207	SAT TT=1.775 CHECKS=1678670	SAT TT=2.504 CHECKS=2608430	SAT TT=3.235 ASSIGNMENTS=554	SAT TT=2.982 ASSIGNMENTS=446	No data	No data	No data	SAT TT=0.766 ASSIGNMENTS=2376 CHECKS=775620	SAT TT=0.716 ASSIGNMENTS=2376 CHECKS=775620	No data	No data	No data	SAT TT=1.459 ASSIGNMENTS=4542 CHECKS=1487410	SAT TT=0.371 ASSIGNMENTS=1598 CHECKS=377568	SAT TT=0.763	SAT TT=0.921 ASSIGNMENTS=2869 CHECKS=723258	SAT TT=1.959 ASSIGNMENTS=6765 CHECKS=2089690	SAT TT=6.597	No data	SAT TT=2.74	SAT TT=4.461
csp/costasArray/ normalized-costasArray-15.xml	SAT TT=2.107	SAT TT=96.256 CHECKS=203540000 NODES=72743	SAT TT=17.421 CHECKS=35723600 NODES=11389	SAT TT=3.011	SAT TT=12.501 CHECKS=12844900	SAT TT=8.241 CHECKS=8703210	SAT TT=7.535 ASSIGNMENTS=3437	SAT TT=8.572 ASSIGNMENTS=3626	No data	No data	No data	SAT TT=14.842 ASSIGNMENTS=3437	SAT TT=98.519 ASSIGNMENTS=72743 CHECKS=203540000	No data	No data	No data	SAT TT=20.617 ASSIGNMENTS=56153 CHECKS=20841800	SAT TT=2.107 ASSIGNMENTS=6765 CHECKS=2130540	SAT TT=23.449	SAT TT=2.296 ASSIGNMENTS=6236 CHECKS=1859300	SAT TT=3.148 ASSIGNMENTS=9498 CHECKS=3236820	SAT TT=11.39	No data	SAT TT=2.8	SAT TT=45.389
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/costasArray/ normalized-costasArray-16.xml	SAT TT=2.038	SAT TT=39.386 CHECKS=87667300 NODES=24445	SAT TT=328.925 CHECKS=680982000 NODES=201749	SAT TT=6.065	SAT TT=5.838 CHECKS=5805990	SAT TT=8.664 CHECKS=9110420	SAT TT=31.844 ASSIGNMENTS=21059	SAT TT=62.53 ASSIGNMENTS=35369	No data	No data	No data	SAT TT=38.865 ASSIGNMENTS=21059	SAT TT=46.029 ASSIGNMENTS=24445 CHECKS=87667300	No data	No data	No data	SAT TT=22.864 ASSIGNMENTS=54410 CHECKS=22512900	SAT TT=4.119 ASSIGNMENTS=10595 CHECKS=4113600	SAT TT=12.761	SAT TT=30.027 ASSIGNMENTS=80687 CHECKS=29031000	SAT TT=2.038 ASSIGNMENTS=4878 CHECKS=1985480	SAT TT=189.949	No data	SAT TT=44.477	SAT TT=14.215
csp/costasArray/ normalized-costasArray-17.xml	SAT TT=13.833	SAT TT=563.132 CHECKS=1313960000 NODES=307706	SAT TT=1346.44 CHECKS=3178030000 NODES=737113	SAT TT=55.331	SAT TT=95.622 CHECKS=84111600	SAT TT=278.657 CHECKS=317420000	SAT TT=171.314 ASSIGNMENTS=190327	SAT TT=13.833 ASSIGNMENTS=9519	No data	No data	No data	SAT TT=178.976 ASSIGNMENTS=190327	SAT TT=560.795 ASSIGNMENTS=307706 CHECKS=1313960000	No data	No data	No data	SAT TT=662.907 ASSIGNMENTS=1491870 CHECKS=704411000	SAT TT=33.107 ASSIGNMENTS=67649 CHECKS=31996400	SAT TT=701.482	SAT TT=99.354 ASSIGNMENTS=226261 CHECKS=92982000	SAT TT=40.834 ASSIGNMENTS=81754 CHECKS=37742600	? (TO) TT=1800.13	No data	SAT TT=41.068	SAT TT=148.646
csp/costasArray/ normalized-costasArray-18.xml	SAT TT=55.982	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=55.982	? (TO) TT=1800.08	SAT TT=669.142 CHECKS=771810000	SAT TT=117.758 ASSIGNMENTS=106218	SAT TT=271.5 ASSIGNMENTS=188683	No data	No data	No data	SAT TT=125.27 ASSIGNMENTS=106218	SAT TT=800.169 ASSIGNMENTS=215964 CHECKS=114674000	No data	No data	No data	SAT TT=188.427 ASSIGNMENTS=342712 CHECKS=179206000	SAT TT=226.905 ASSIGNMENTS=413268 CHECKS=215508000	SAT TT=768.693	? (TO) TT=1800.1	SAT TT=129.089 ASSIGNMENTS=215964 CHECKS=114674000	SAT TT=1091.62	No data	SAT TT=265.22	? (TO) TT=1800.05
csp/costasArray/ normalized-costasArray-19.xml	SAT TT=270.332	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.05	SAT TT=270.332 CHECKS=278323000	? (TO) TT=1800.04	? (TO) TT=1800.14	SAT TT=293.928 ASSIGNMENTS=176754	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.05	SAT TT=1103.56 ASSIGNMENTS=1946030 CHECKS=1129800000	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.19	No data	? (TO) TT=1800.04	? (TO) TT=1800.05
csp/costasArray/ normalized-costasArray-20.xml		? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.15	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.16	No data	? (TO) TT=1800.05	? (TO) TT=1800.08
csp/dag-half/ normalized-half-n25-d5-e56-r7-11.xml	SAT TT=308.316	? (TO) TT=1800.09	? (TO) TT=1800.08	? (problem) TT=162.158	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.21	? (TO) TT=1800.18	SAT TT=1582.53 CHECKS=2785180000 NODES=3281760	SAT TT=676.028 CHECKS=3008380000 NODES=6609950	? (TO) TT=1800.06	SAT TT=513.531 ASSIGNMENTS=1487580 CHECKS=186631000	SAT TT=781.989 ASSIGNMENTS=1487580 CHECKS=186631000	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=308.316 CHECKS=81926400	SAT TT=509.482 ASSIGNMENTS=1493520 CHECKS=187453000	SAT TT=484.025 ASSIGNMENTS=1486420 CHECKS=186770000	? (MO) TT=42.83	SAT TT=520.44 ASSIGNMENTS=1493730 CHECKS=187439000	SAT TT=505.038 ASSIGNMENTS=1487580 CHECKS=186631000	? (TO) TT=1800.24	? (TO) TT=1800.07	? (MO) TT=12.94	? (MO) TT=13.901
csp/dag-half/ normalized-half-n25-d5-e56-r7-12.xml	SAT TT=75.674	? (TO) TT=1800.1	? (TO) TT=1800.17	? (problem) TT=167.205	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.49	? (TO) TT=1800.02	SAT TT=371.047 CHECKS=1538590000 NODES=3347100	? (TO) TT=1800.01	SAT TT=91.848 ASSIGNMENTS=245954 CHECKS=30807900	SAT TT=378.19 ASSIGNMENTS=245954 CHECKS=30807900	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=124.697 CHECKS=34281000	SAT TT=83.672 ASSIGNMENTS=248086 CHECKS=31128400	SAT TT=107.342 ASSIGNMENTS=337027 CHECKS=42427400	? (MO) TT=45.71	SAT TT=239.786 ASSIGNMENTS=774673 CHECKS=97773500	SAT TT=75.674 ASSIGNMENTS=245954 CHECKS=30807900	? (TO) TT=1800.22	? (TO) TT=1800.11	? (MO) TT=13.861	? (MO) TT=13.659
csp/dag-half/ normalized-half-n25-d5-e56-r7-13.xml	SAT TT=728.091	? (TO) TT=1800.16	? (TO) TT=1800.18	? (problem) TT=153.185	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.21	? (TO) TT=1800.01	SAT TT=728.091 CHECKS=3214990000 NODES=7037520	? (TO) TT=1800.04	SAT TT=929.588 ASSIGNMENTS=2585780 CHECKS=324727000	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=729.686 CHECKS=207623000	SAT TT=837.047 ASSIGNMENTS=2595970 CHECKS=326054000	SAT TT=845.154 ASSIGNMENTS=2487240 CHECKS=312766000	? (MO) TT=48.69	SAT TT=848.883 ASSIGNMENTS=2490630 CHECKS=313309000	SAT TT=858.97 ASSIGNMENTS=2585780 CHECKS=324727000	? (TO) TT=1800.11	? (TO) TT=1800.03	? (MO) TT=14.54	? (MO) TT=13.679
csp/dag-half/ normalized-half-n25-d5-e56-r7-16.xml	SAT TT=98.032	SAT TT=1125.88 CHECKS=2742230 NODES=213114	SAT TT=1595.18 CHECKS=3878370 NODES=294866	? (problem) TT=150.389	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=480.028 ASSIGNMENTS=1365190 CHECKS=165398000	SAT TT=740.208 ASSIGNMENTS=1365190 CHECKS=165398000	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=98.032 CHECKS=25152800	SAT TT=438.337 ASSIGNMENTS=1400520 CHECKS=169671000	SAT TT=336.319 ASSIGNMENTS=1032600 CHECKS=123553000	? (MO) TT=49.26	SAT TT=316.721 ASSIGNMENTS=939626 CHECKS=113901000	SAT TT=443.519 ASSIGNMENTS=1365190 CHECKS=165398000	? (TO) TT=1800.18	SAT TT=1043.04 ASSIGNMENTS=334688 CHECKS=170989000	? (MO) TT=12.979	? (MO) TT=14.83
csp/dag-half/ normalized-half-n25-d5-e56-r7-17.xml	SAT TT=40.662	? (TO) TT=1800.13	? (TO) TT=1800.16	? (problem) TT=164.588	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.21	? (TO) TT=1800.12	SAT TT=806.289 CHECKS=1220860000 NODES=1572910	SAT TT=965.371 CHECKS=4392430000 NODES=9746820	? (TO) TT=1800.04	SAT TT=210.071 ASSIGNMENTS=668650 CHECKS=81029900	SAT TT=503.902 ASSIGNMENTS=668650 CHECKS=81029900	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=495.351 CHECKS=148480000	SAT TT=214.568 ASSIGNMENTS=674529 CHECKS=81883600	SAT TT=35.315 ASSIGNMENTS=95803 CHECKS=11482000	? (MO) TT=45.87	SAT TT=40.662 ASSIGNMENTS=111780 CHECKS=13725100	SAT TT=211.764 ASSIGNMENTS=668650 CHECKS=81029900	? (TO) TT=1800.16	SAT TT=539.288 ASSIGNMENTS=178568 CHECKS=94965000	? (MO) TT=13.88	? (MO) TT=12.87
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/dag-half/ normalized-half-n25-d5-e56-r7-1.xml	SAT TT=40.572	? (TO) TT=1800.14	? (TO) TT=1800.16	? (problem) TT=167.782	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.16	SAT TT=338.648 CHECKS=498633000 NODES=608460	SAT TT=126.456 CHECKS=447761000 NODES=988037	? (TO) TT=1800.01	SAT TT=55.235 ASSIGNMENTS=117290 CHECKS=14562500	SAT TT=346.12 ASSIGNMENTS=117290 CHECKS=14562500	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=91.178 CHECKS=24388400	SAT TT=40.572 ASSIGNMENTS=119570 CHECKS=14862700	SAT TT=110.799 ASSIGNMENTS=324908 CHECKS=39793400	? (MO) TT=46.59	SAT TT=215.803 ASSIGNMENTS=649684 CHECKS=78876200	SAT TT=42.893 ASSIGNMENTS=117290 CHECKS=14562500	? (TO) TT=1800.2	? (TO) TT=1800.07	? (MO) TT=13.73	? (MO) TT=14.86
csp/dag-half/ normalized-half-n25-d5-e56-r7-21.xml	SAT TT=532.791	? (TO) TT=1800.17	? (TO) TT=1800.14	? (problem) TT=164.338	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=532.791 CHECKS=153461000	? (TO) TT=1800.05	? (TO) TT=1800.05	? (MO) TT=48.32	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.22	? (TO) TT=1800.08	? (MO) TT=12.86	? (MO) TT=13.893
csp/dag-half/ normalized-half-n25-d5-e56-r7-24.xml	SAT TT=149.569	SAT TT=864.025 CHECKS=6857370 NODES=479120	SAT TT=870.579 CHECKS=6642060 NODES=463249	? (problem) TT=164.349	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.2	? (TO) TT=1800.19	? (TO) TT=1800.02	SAT TT=173.449 CHECKS=668821000 NODES=1465980	? (TO) TT=1800.01	SAT TT=310.33 ASSIGNMENTS=995888 CHECKS=123714000	SAT TT=624.338 ASSIGNMENTS=995888 CHECKS=123714000	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=398.592 CHECKS=128278000	SAT TT=301.341 ASSIGNMENTS=940269 CHECKS=116803000	SAT TT=118.905 ASSIGNMENTS=362312 CHECKS=44125800	? (MO) TT=48.92	SAT TT=149.569 ASSIGNMENTS=454518 CHECKS=56459400	SAT TT=319.349 ASSIGNMENTS=995888 CHECKS=123714000	? (TO) TT=1800.16	? (TO) TT=1800.06	? (MO) TT=13.87	? (MO) TT=14.74
csp/dag-half/ normalized-half-n25-d5-e56-r7-25.xml	SAT TT=91.25	? (TO) TT=1800.14	? (TO) TT=1800.12	? (problem) TT=168.468	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.18	? (TO) TT=1800.09	SAT TT=324.933 CHECKS=1313900000 NODES=2897410	? (TO) TT=1800.01	SAT TT=391.368 ASSIGNMENTS=1258110 CHECKS=150317000	SAT TT=703.673 ASSIGNMENTS=1258110 CHECKS=150317000	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=91.25 CHECKS=24102800	SAT TT=391.885 ASSIGNMENTS=1263600 CHECKS=150946000	SAT TT=67.162 ASSIGNMENTS=208507 CHECKS=24540600	? (MO) TT=46.7	SAT TT=386.507 ASSIGNMENTS=1181160 CHECKS=144400000	SAT TT=395.637 ASSIGNMENTS=1258110 CHECKS=150317000	SAT TT=480.212	? (TO) TT=1800.05	? (MO) TT=13.685	? (MO) TT=14.66
csp/dag-half/ normalized-half-n25-d5-e56-r7-2.xml	SAT TT=13.322	? (TO) TT=1800.13	? (TO) TT=1800.16	? (problem) TT=166.396	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.12	SAT TT=1700.02 CHECKS=2699870000 NODES=3259260	SAT TT=243.163 CHECKS=942138000 NODES=2071290	? (TO) TT=1800.02	SAT TT=36.611 ASSIGNMENTS=60234 CHECKS=7283950	SAT TT=323.933 ASSIGNMENTS=60234 CHECKS=7283950	SAT TT=868.906	? (TO) TT=1800.05	SAT TT=133.317 CHECKS=37314000	SAT TT=24.809 ASSIGNMENTS=59760 CHECKS=7246990	SAT TT=23.793 ASSIGNMENTS=63491 CHECKS=7515460	? (MO) TT=43.51	SAT TT=13.322 ASSIGNMENTS=25618 CHECKS=3190790	SAT TT=25.007 ASSIGNMENTS=60234 CHECKS=7283950	? (TO) TT=1800.14	? (TO) TT=1800.09	? (MO) TT=13.84	? (MO) TT=13.884
csp/dag-half/ normalized-half-n25-d5-e56-r7-3.xml	SAT TT=21.553	? (TO) TT=1800.12	? (TO) TT=1800.13	? (problem) TT=155.583	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.43	? (TO) TT=1800.17	SAT TT=851.618 CHECKS=1344230000 NODES=1582130	SAT TT=21.553 CHECKS=20907000 NODES=45278	? (TO) TT=1800.09	SAT TT=125.836 ASSIGNMENTS=311651 CHECKS=38911900	SAT TT=414.325 ASSIGNMENTS=311651 CHECKS=38911900	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=308.051 CHECKS=83887100	SAT TT=113.148 ASSIGNMENTS=317479 CHECKS=39682400	SAT TT=37.646 ASSIGNMENTS=96354 CHECKS=11823700	? (MO) TT=46.16	SAT TT=111.296 ASSIGNMENTS=312882 CHECKS=39097100	SAT TT=112.675 ASSIGNMENTS=311651 CHECKS=38911900	? (TO) TT=1800.22	? (TO) TT=1800.05	? (MO) TT=13.78	? (MO) TT=13.898
csp/dag-half/ normalized-half-n25-d5-e56-r7-4.xml	SAT TT=32.435	? (TO) TT=1800.18	? (TO) TT=1800.16	? (problem) TT=165.867	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.19	? (TO) TT=1800	SAT TT=32.435 CHECKS=68955400 NODES=150490	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=671.545 CHECKS=200360000	? (TO) TT=1800.08	? (TO) TT=1800.05	? (MO) TT=45.15	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.18	? (TO) TT=1800.1	? (MO) TT=14.74	? (MO) TT=14.145
csp/dag-half/ normalized-half-n25-d5-e56-r7-5.xml	SAT TT=20.642	? (TO) TT=1800.16	? (TO) TT=1800.17	? (problem) TT=154.276	? (TO) TT=1800.12	? (TO) TT=1800.2	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.03	SAT TT=702.247 CHECKS=2894530000 NODES=6277310	? (TO) TT=1800.06	SAT TT=1607.25 ASSIGNMENTS=4647660 CHECKS=566484000	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=202.792 CHECKS=59796600	SAT TT=1604.78 ASSIGNMENTS=4764390 CHECKS=581201000	SAT TT=1520.69 ASSIGNMENTS=4804690 CHECKS=586695000	? (MO) TT=48.7	SAT TT=20.642 ASSIGNMENTS=47615 CHECKS=5848230	SAT TT=1534.42 ASSIGNMENTS=4647660 CHECKS=566484000	? (TO) TT=1800.18	? (TO) TT=1800.08	? (MO) TT=13.79	? (MO) TT=13.34
csp/dag-half/ normalized-half-n25-d5-e56-r7-7.xml	SAT TT=38.111	? (TO) TT=1800.17	? (TO) TT=1800.15	? (problem) TT=165.277	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.21	SAT TT=1220.55 CHECKS=1913640000 NODES=2239300	SAT TT=91.084 CHECKS=298906000 NODES=653865	? (TO) TT=1800.06	SAT TT=52.797 ASSIGNMENTS=105448 CHECKS=13239700	SAT TT=342.595 ASSIGNMENTS=105448 CHECKS=13239700	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=370.15 CHECKS=100969000	SAT TT=38.111 ASSIGNMENTS=105880 CHECKS=13341200	SAT TT=142.834 ASSIGNMENTS=402193 CHECKS=50033200	? (MO) TT=49.51	SAT TT=653.118 ASSIGNMENTS=2027500 CHECKS=253531000	SAT TT=40.529 ASSIGNMENTS=105448 CHECKS=13239700	? (TO) TT=1800.22	? (TO) TT=1800.1	? (MO) TT=12.91	? (MO) TT=14.74
csp/dag-half/ normalized-half-n25-d5-e56-r7-8.xml	SAT TT=22.895	? (TO) TT=1800.2	? (TO) TT=1800.14	? (problem) TT=158.144	? (TO) TT=1800.21	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.19	SAT TT=1119.14 CHECKS=1825350000 NODES=2213770	SAT TT=22.895 CHECKS=25425600 NODES=55535	? (TO) TT=1800.06	SAT TT=60.514 ASSIGNMENTS=136187 CHECKS=16975900	SAT TT=346.682 ASSIGNMENTS=136187 CHECKS=16975900	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=94.212 CHECKS=25235400	SAT TT=45.256 ASSIGNMENTS=137424 CHECKS=17186200	SAT TT=208.007 ASSIGNMENTS=667386 CHECKS=84586800	? (MO) TT=46.41	SAT TT=58.478 ASSIGNMENTS=166061 CHECKS=20684500	SAT TT=47.651 ASSIGNMENTS=136187 CHECKS=16975900	? (TO) TT=1800.15	SAT TT=1131.7 ASSIGNMENTS=373697 CHECKS=187595000	? (MO) TT=13.876	? (MO) TT=13.911
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-11.xml	UNSAT TT=26.248	UNSAT TT=84.097 CHECKS=43072 NODES=35306	UNSAT TT=99.048 CHECKS=91831 NODES=44218	? (problem) TT=291.472	? (TO) TT=1800.21	? (TO) TT=1800.14	? (TO) TT=1800.21	? (TO) TT=1800.18	UNSAT TT=372.16 CHECKS=1090440000 NODES=64596	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=99.476 ASSIGNMENTS=35306 CHECKS=43072	UNSAT TT=104.444 ASSIGNMENTS=35306 CHECKS=43072	? (problem) TT=116.444	? (problem) TT=100.596	UNSAT TT=26.248 CHECKS=440322	? (TO) TT=1800.12	? (TO) TT=1800.16	? (exit code) TT=39.201	? (TO) TT=1800.08	? (TO) TT=1800.13	? TT=150.002	UNSAT TT=80.913 ASSIGNMENTS=113957 CHECKS=9644100	? (MO) TT=24.31	? (MO) TT=25.83
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-12.xml	UNSAT TT=40.991	UNSAT TT=168.954 CHECKS=1939 NODES=44725	UNSAT TT=150.607 CHECKS=7248 NODES=51402	? (problem) TT=314.009	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.28	? (TO) TT=1800.21	UNSAT TT=342.23 CHECKS=1068820000 NODES=67455	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=193.372 ASSIGNMENTS=44725 CHECKS=1939	UNSAT TT=196.009 ASSIGNMENTS=44725 CHECKS=1939	? (problem) TT=114.985	? (problem) TT=108.174	UNSAT TT=40.991 CHECKS=595917	? (TO) TT=1800.16	? (TO) TT=1800.08	? (exit code) TT=43.495	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=140.419	UNSAT TT=72.772 ASSIGNMENTS=141156 CHECKS=9895740	? (MO) TT=24.861	? (MO) TT=23.828
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-13.xml	UNSAT TT=42.289	UNSAT TT=98.188 CHECKS=3035 NODES=52121	UNSAT TT=97.817 CHECKS=3092 NODES=51952	? (problem) TT=314.873	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.23	UNSAT TT=329.211 CHECKS=943073000 NODES=61799	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=111.386 ASSIGNMENTS=52121 CHECKS=3035	UNSAT TT=105.743 ASSIGNMENTS=52121 CHECKS=3035	? (problem) TT=113.4	? (problem) TT=115.568	UNSAT TT=42.289 CHECKS=595170	? (TO) TT=1800.13	? (TO) TT=1800.08	? (exit code) TT=41.299	? (TO) TT=1800.09	? (TO) TT=1800.13	? TT=84.314	UNSAT TT=80.471 ASSIGNMENTS=106634 CHECKS=7878100	? (MO) TT=21.92	? (MO) TT=23.736
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-14.xml	UNSAT TT=40.138	UNSAT TT=142.676 CHECKS=24466 NODES=39065	UNSAT TT=133.081 CHECKS=23902 NODES=39173	? (problem) TT=292.923	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.24	UNSAT TT=377.463 CHECKS=1295460000 NODES=98824	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=140.811 ASSIGNMENTS=39065 CHECKS=24466	UNSAT TT=155.302 ASSIGNMENTS=39065 CHECKS=24466	? (problem) TT=110.735	? (problem) TT=116.889	UNSAT TT=40.138 CHECKS=602486	? (TO) TT=1800.12	? (TO) TT=1800.16	? (exit code) TT=45.386	? (TO) TT=1800.16	? (TO) TT=1800.11	? TT=164.268	UNSAT TT=55.471 ASSIGNMENTS=136554 CHECKS=5550630	? (MO) TT=23.392	? (MO) TT=23.49
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-15.xml	UNSAT TT=32.026	UNSAT TT=187.075 CHECKS=14847 NODES=37943	UNSAT TT=189.538 CHECKS=14853 NODES=38039	? (problem) TT=314.616	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.17	UNSAT TT=271.456 CHECKS=755958000 NODES=48617	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=214.958 ASSIGNMENTS=37943 CHECKS=14847	UNSAT TT=220.46 ASSIGNMENTS=37943 CHECKS=14847	? (problem) TT=105.065	? (problem) TT=114.16	UNSAT TT=32.026 CHECKS=458932	? (TO) TT=1800.08	? (TO) TT=1800.09	? (exit code) TT=43.744	? (TO) TT=1800.08	? (TO) TT=1800.13	? TT=141.129	UNSAT TT=73.836 ASSIGNMENTS=96898 CHECKS=7291470	? (MO) TT=24.746	? (MO) TT=23.77
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-17.xml	UNSAT TT=36.904	UNSAT TT=159.117 CHECKS=525 NODES=65819	UNSAT TT=134.654 CHECKS=464 NODES=65328	? (problem) TT=315.635	? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.2	UNSAT TT=276.685 CHECKS=752824000 NODES=61313	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=157.531 ASSIGNMENTS=65819 CHECKS=525	UNSAT TT=170.128 ASSIGNMENTS=65819 CHECKS=525	? (problem) TT=119.791	? (problem) TT=120.89	UNSAT TT=36.904 CHECKS=447780	? (TO) TT=1800.15	? (TO) TT=1800.07	? (exit code) TT=46.763	? (TO) TT=1800.07	? (TO) TT=1800.11	? TT=146.021	UNSAT TT=87.69 ASSIGNMENTS=96119 CHECKS=11052700	? (MO) TT=25.939	? (MO) TT=27.014
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-19.xml	UNSAT TT=36.565	UNSAT TT=105.387 CHECKS=524 NODES=35244	UNSAT TT=108.507 CHECKS=547 NODES=35109	? (problem) TT=295.752	? (TO) TT=1800.18	? (TO) TT=1800.19	? (TO) TT=1800.22	? (TO) TT=1800.22	UNSAT TT=326.445 CHECKS=1034200000 NODES=61385	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=122.198 ASSIGNMENTS=35244 CHECKS=524	UNSAT TT=110.163 ASSIGNMENTS=35244 CHECKS=524	? (problem) TT=123.65	? (problem) TT=124.006	UNSAT TT=36.565 CHECKS=572657	? (TO) TT=1800.1	? (TO) TT=1800.13	? (exit code) TT=47.85	? (TO) TT=1800.09	? (TO) TT=1800.06	? TT=154.334	UNSAT TT=71.357 ASSIGNMENTS=92625 CHECKS=8583460	? (MO) TT=26.931	? (MO) TT=22.703
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-21.xml	UNSAT TT=43.103	UNSAT TT=164.095 CHECKS=334 NODES=82832	UNSAT TT=154.458 CHECKS=15291 NODES=50521	? (problem) TT=313.317	? (TO) TT=1800.17	? (TO) TT=1800.21	? (TO) TT=1800.24	? (TO) TT=1800.18	UNSAT TT=340.667 CHECKS=938490000 NODES=71885	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=175.041 ASSIGNMENTS=82832 CHECKS=334	UNSAT TT=171.401 ASSIGNMENTS=82832 CHECKS=334	? (problem) TT=116.192	? (problem) TT=100.488	UNSAT TT=43.103 CHECKS=412254	? (TO) TT=1800.08	? (TO) TT=1800.07	? (exit code) TT=38.878	? (TO) TT=1800.14	? (TO) TT=1800.15	? TT=71.575	UNSAT TT=83.86 ASSIGNMENTS=98877 CHECKS=10610800	? (MO) TT=23.33	? (MO) TT=25.782
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-22.xml	UNSAT TT=33.142	UNSAT TT=99.585 CHECKS=21188 NODES=54102	UNSAT TT=111.883 CHECKS=21318 NODES=54089	? (problem) TT=296.923	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.25	? (TO) TT=1800.21	UNSAT TT=257.175 CHECKS=661532000 NODES=48494	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=110.938 ASSIGNMENTS=54102 CHECKS=21188	UNSAT TT=114.369 ASSIGNMENTS=54102 CHECKS=21188	? (problem) TT=112.427	? (problem) TT=110.798	UNSAT TT=33.142 CHECKS=396876	? (TO) TT=1800.13	? (TO) TT=1800.09	? (exit code) TT=46.648	? (TO) TT=1800.11	? (TO) TT=1800.11	? TT=151.591	UNSAT TT=63.67 ASSIGNMENTS=93084 CHECKS=8020060	? (MO) TT=27.71	? (MO) TT=21.808
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-25.xml	UNSAT TT=30.962	UNSAT TT=174.968 CHECKS=743 NODES=51744	UNSAT TT=170.964 CHECKS=2752 NODES=38066	? (problem) TT=295.8	? (TO) TT=1800.21	? (TO) TT=1800.18	? (TO) TT=1800.26	? (TO) TT=1800.17	UNSAT TT=258.619 CHECKS=680658000 NODES=42210	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=186.189 ASSIGNMENTS=51744 CHECKS=743	UNSAT TT=191.05 ASSIGNMENTS=51744 CHECKS=743	? (problem) TT=122.852	? (problem) TT=123.578	UNSAT TT=30.962 CHECKS=375539	? (TO) TT=1800.12	? (TO) TT=1800.1	? (exit code) TT=40.223	? (TO) TT=1800.08	? (TO) TT=1800.15	? TT=143.664	UNSAT TT=68.329 ASSIGNMENTS=88677 CHECKS=9643050	? (MO) TT=25.855	? (MO) TT=26.938
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-3.xml	UNSAT TT=34.77	UNSAT TT=145.116 CHECKS=7730 NODES=42442	UNSAT TT=243.391 CHECKS=1771 NODES=64539	? (problem) TT=309.471	? (TO) TT=1800.17	? (TO) TT=1800.02	? (TO) TT=1800.25	? (TO) TT=1801.01	UNSAT TT=447.26 CHECKS=1453470000 NODES=91478	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=161.713 ASSIGNMENTS=42442 CHECKS=7730	UNSAT TT=159.339 ASSIGNMENTS=42442 CHECKS=7730	? (problem) TT=113.395	? (problem) TT=107.255	UNSAT TT=34.77 CHECKS=491762	? (TO) TT=1800.1	? (TO) TT=1800.06	? (exit code) TT=45.697	? (TO) TT=1800.12	? (TO) TT=1800.16	? TT=148.956	UNSAT TT=104.672 ASSIGNMENTS=146016 CHECKS=19048600	? (MO) TT=26.71	? (MO) TT=26.69
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-5.xml	UNSAT TT=41.771	UNSAT TT=140.941 CHECKS=7386 NODES=42965	UNSAT TT=124.656 CHECKS=9076 NODES=49567	? (problem) TT=318.34	? (TO) TT=1800.21	? (TO) TT=1800.17	? (TO) TT=1800.27	? (TO) TT=1800.19	UNSAT TT=346.724 CHECKS=1039470000 NODES=65873	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=148.858 ASSIGNMENTS=42965 CHECKS=7386	UNSAT TT=152.611 ASSIGNMENTS=42965 CHECKS=7386	? (problem) TT=105.114	? (problem) TT=117.179	UNSAT TT=41.771 CHECKS=440207	? (TO) TT=1800.11	? (TO) TT=1800.07	? (exit code) TT=48.074	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=113.475	UNSAT TT=101.267 ASSIGNMENTS=99292 CHECKS=15823800	? (MO) TT=21.654	? (MO) TT=25.825
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-6.xml	UNSAT TT=43.342	UNSAT TT=163.938 CHECKS=4563 NODES=44412	UNSAT TT=139.875 CHECKS=1811 NODES=44103	? (problem) TT=293.97	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.26	UNSAT TT=381.615 CHECKS=1148620000 NODES=64665	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=173.683 ASSIGNMENTS=44412 CHECKS=4563	UNSAT TT=178.124 ASSIGNMENTS=44412 CHECKS=4563	? (problem) TT=107.012	? (problem) TT=116.452	UNSAT TT=43.342 CHECKS=571807	? (TO) TT=1800.07	? (TO) TT=1800.15	? (exit code) TT=45.312	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=142.929	UNSAT TT=87.611 ASSIGNMENTS=124538 CHECKS=11166200	? (MO) TT=21.96	? (MO) TT=25.43
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-7.xml	UNSAT TT=36.219	UNSAT TT=75.778 CHECKS=1638 NODES=42749	UNSAT TT=82.4 CHECKS=1072 NODES=42741	? (problem) TT=298.247	? (TO) TT=1800.18	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.2	UNSAT TT=242.082 CHECKS=681372000 NODES=48488	? (TO) TT=1800	? (TO) TT=1800	UNSAT TT=89.998 ASSIGNMENTS=42749 CHECKS=1638	UNSAT TT=90.669 ASSIGNMENTS=42749 CHECKS=1638	? (problem) TT=110.354	? (problem) TT=116.81	UNSAT TT=36.219 CHECKS=446156	? (TO) TT=1800.1	? (TO) TT=1800.12	? (exit code) TT=47.56	? (TO) TT=1800.09	? (TO) TT=1800.12	? TT=153.632	UNSAT TT=102.179 ASSIGNMENTS=95555 CHECKS=14460300	? (MO) TT=27.05	? (MO) TT=21.784
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-9.xml	UNSAT TT=33.623	UNSAT TT=182.033 CHECKS=19851 NODES=54803	UNSAT TT=180.858 CHECKS=4973 NODES=66193	? (problem) TT=292.156	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.19	UNSAT TT=297.49 CHECKS=794206000 NODES=48260	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=181.054 ASSIGNMENTS=54803 CHECKS=19851	UNSAT TT=195.753 ASSIGNMENTS=54803 CHECKS=19851	? (problem) TT=102.21	? (problem) TT=98.322	UNSAT TT=33.623 CHECKS=463124	? (TO) TT=1800.06	? (TO) TT=1800.05	? (exit code) TT=45.493	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=125.187	UNSAT TT=115.401 ASSIGNMENTS=124609 CHECKS=18470600	? (MO) TT=23.675	? (MO) TT=23.31
csp/domino/ normalized-domino-1000-100.xml	SAT TT=0.052	? (MO) TT=0.897	SAT TT=1.999 CHECKS=8219800 NODES=1000	SAT TT=0.247	SAT TT=2.452 CHECKS=396013	SAT TT=0.188 CHECKS=362367	SAT TT=1.486 ASSIGNMENTS=1	SAT TT=1.33 ASSIGNMENTS=1	SAT TT=4.175 CHECKS=607204 NODES=1000	SAT TT=2.623 CHECKS=813003 NODES=0	SAT TT=2.503 CHECKS=813003 NODES=0	SAT TT=0.067 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.065 ASSIGNMENTS=1 CHECKS=14	SAT TT=102	SAT TT=99.986	No data	SAT TT=0.052 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.057 ASSIGNMENTS=4 CHECKS=254	SAT TT=1.003	SAT TT=0.057 ASSIGNMENTS=99 CHECKS=1295	SAT TT=0.056 ASSIGNMENTS=1 CHECKS=14	SAT TT=10.788	No data	SAT TT=2.613	SAT TT=4.09
csp/domino/ normalized-domino-1000-300.xml	SAT TT=0.051	SAT TT=4.121 CHECKS=165489000 NODES=1000	SAT TT=4.216 CHECKS=165489000 NODES=1000	SAT TT=0.283	SAT TT=3.251 CHECKS=1678790	SAT TT=0.786 CHECKS=1572070	SAT TT=1.528 ASSIGNMENTS=1	SAT TT=1.24 ASSIGNMENTS=1	SAT TT=21.158 CHECKS=4560550 NODES=1000	SAT TT=5.881 CHECKS=6111000 NODES=0	SAT TT=5.853 CHECKS=6111000 NODES=0	SAT TT=0.068 ASSIGNMENTS=1 CHECKS=622	SAT TT=0.067 ASSIGNMENTS=1 CHECKS=622	? (MO) TT=788.1	? (MO) TT=819.22	No data	SAT TT=0.051 ASSIGNMENTS=1 CHECKS=622	SAT TT=0.051 ASSIGNMENTS=2 CHECKS=632	SAT TT=0.964	SAT TT=0.057 ASSIGNMENTS=299 CHECKS=3895	SAT TT=0.054 ASSIGNMENTS=1 CHECKS=14	SAT TT=63.341	No data	SAT TT=3.985	SAT TT=9.66
csp/domino/ normalized-domino-1000-800.xml	SAT TT=0.052	SAT TT=10.148 CHECKS=21070700 NODES=1000	SAT TT=11.117 CHECKS=21070700 NODES=1000	SAT TT=0.414	SAT TT=4.678 CHECKS=4245970	SAT TT=2.275 CHECKS=4216470	SAT TT=1.22 ASSIGNMENTS=1	SAT TT=1.568 ASSIGNMENTS=1	SAT TT=82.357 CHECKS=34870200 NODES=1000	SAT TT=22.054 CHECKS=40776000 NODES=0	SAT TT=23.046 CHECKS=40776000 NODES=0	SAT TT=0.067 ASSIGNMENTS=1 CHECKS=1622	SAT TT=0.068 ASSIGNMENTS=1 CHECKS=1622	? (TO) TT=1800.01	? (TO) TT=1800.04	No data	SAT TT=0.056 ASSIGNMENTS=1 CHECKS=1622	SAT TT=0.057 ASSIGNMENTS=1 CHECKS=1617	SAT TT=1.05	SAT TT=0.056 ASSIGNMENTS=799 CHECKS=10395	SAT TT=0.052 ASSIGNMENTS=1 CHECKS=14	SAT TT=417.584	No data	SAT TT=9.211	SAT TT=23.433
csp/domino/ normalized-domino-100-100.xml	SAT TT=0.009	SAT TT=0.94 CHECKS=821805 NODES=100	SAT TT=0.899 CHECKS=821805 NODES=0	SAT TT=0.045	SAT TT=0.265 CHECKS=46790	SAT TT=0.042 CHECKS=50761	SAT TT=0.885 ASSIGNMENTS=1	SAT TT=0.689 ASSIGNMENTS=1	SAT TT=0.928 CHECKS=60904 NODES=100	SAT TT=0.775 CHECKS=81303 NODES=0	SAT TT=0.699 CHECKS=81303 NODES=0	SAT TT=0.021 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.022 ASSIGNMENTS=1 CHECKS=14	SAT TT=11.538	SAT TT=10.498	No data	SAT TT=0.009 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.01 ASSIGNMENTS=2 CHECKS=234	SAT TT=0.383	SAT TT=0.013 ASSIGNMENTS=99 CHECKS=1295	SAT TT=0.01 ASSIGNMENTS=1 CHECKS=14	SAT TT=3.444	No data	SAT TT=0.828	SAT TT=1.094
csp/domino/ normalized-domino-100-300.xml	SAT TT=0.009	SAT TT=1.066 CHECKS=16547500 NODES=100	SAT TT=1.056 CHECKS=16547500 NODES=0	SAT TT=0.051	SAT TT=0.356 CHECKS=148256	SAT TT=0.119 CHECKS=146065	SAT TT=0.677 ASSIGNMENTS=1	SAT TT=0.665 ASSIGNMENTS=1	SAT TT=2.498 CHECKS=457450 NODES=100	SAT TT=1.035 CHECKS=611103 NODES=0	SAT TT=1.041 CHECKS=611103 NODES=0	SAT TT=0.021 ASSIGNMENTS=1 CHECKS=622	SAT TT=0.021 ASSIGNMENTS=1 CHECKS=622	SAT TT=73.72	SAT TT=79.692	No data	SAT TT=0.01 ASSIGNMENTS=1 CHECKS=622	SAT TT=0.011 ASSIGNMENTS=2 CHECKS=27	SAT TT=0.383	SAT TT=0.009 ASSIGNMENTS=299 CHECKS=3895	SAT TT=0.009 ASSIGNMENTS=1 CHECKS=14	SAT TT=8.27	No data	SAT TT=1.053	SAT TT=1.646
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/domino/ normalized-domino-2000-2000.xml	SAT TT=0.127	SAT TT=95.796 CHECKS=256674000 NODES=2000	SAT TT=101.963 CHECKS=256674000 NODES=2000	SAT TT=1.312	SAT TT=19.056 CHECKS=24541300	SAT TT=9.623 CHECKS=13508000	SAT TT=2.063 ASSIGNMENTS=1	SAT TT=2.297 ASSIGNMENTS=1	SAT TT=309.85 CHECKS=500240000 NODES=2000	SAT TT=227.705 CHECKS=505892000 NODES=0	SAT TT=238.123 CHECKS=505892000 NODES=0	SAT TT=0.135 ASSIGNMENTS=1 CHECKS=4022	SAT TT=0.133 ASSIGNMENTS=1 CHECKS=4022	? (TO) TT=1800.06	? (TO) TT=1800.02	No data	SAT TT=0.136 ASSIGNMENTS=1 CHECKS=4022	SAT TT=0.132 ASSIGNMENTS=1 CHECKS=4017	SAT TT=1.587	SAT TT=0.142 ASSIGNMENTS=1999 CHECKS=25995	SAT TT=0.127 ASSIGNMENTS=1 CHECKS=14	? TT=69.951	No data	SAT TT=45.803	SAT TT=120.777
csp/domino/ normalized-domino-500-100.xml	SAT TT=0.025	SAT TT=1.276 CHECKS=4109800 NODES=500	SAT TT=1.324 CHECKS=4109800 NODES=0	SAT TT=0.143	SAT TT=1.307 CHECKS=226885	SAT TT=0.121 CHECKS=218536	SAT TT=1.345 ASSIGNMENTS=1	SAT TT=1.212 ASSIGNMENTS=1	SAT TT=2.319 CHECKS=303704 NODES=500	SAT TT=1.649 CHECKS=406503 NODES=0	SAT TT=1.614 CHECKS=406503 NODES=0	SAT TT=0.039 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.039 ASSIGNMENTS=1 CHECKS=14	SAT TT=51.756	SAT TT=48.275	No data	SAT TT=0.027 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.025 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.769	SAT TT=0.028 ASSIGNMENTS=99 CHECKS=1295	SAT TT=0.025 ASSIGNMENTS=1 CHECKS=14	SAT TT=6.918	No data	SAT TT=1.568	SAT TT=2.602
csp/domino/ normalized-domino-500-200.xml	SAT TT=0.026	SAT TT=1.683 CHECKS=26167200 NODES=500	SAT TT=1.717 CHECKS=26167200 NODES=500	SAT TT=0.132	SAT TT=1.398 CHECKS=498405	SAT TT=0.254 CHECKS=493533	SAT TT=0.956 ASSIGNMENTS=1	SAT TT=1.088 ASSIGNMENTS=1	SAT TT=5.524 CHECKS=1064220 NODES=500	SAT TT=2.247 CHECKS=1425000 NODES=0	SAT TT=2.235 CHECKS=1425000 NODES=0	SAT TT=0.039 ASSIGNMENTS=1 CHECKS=422	SAT TT=0.039 ASSIGNMENTS=1 CHECKS=422	SAT TT=187.595	SAT TT=182.769	No data	SAT TT=0.028 ASSIGNMENTS=1 CHECKS=422	SAT TT=0.031 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.893	SAT TT=0.028 ASSIGNMENTS=199 CHECKS=2595	SAT TT=0.026 ASSIGNMENTS=1 CHECKS=14	SAT TT=16.147	No data	SAT TT=2.235	SAT TT=3.959
csp/domino/ normalized-domino-500-500.xml	SAT TT=0.027	SAT TT=3.314 CHECKS=4138360 NODES=500	SAT TT=3.355 CHECKS=4138360 NODES=500	SAT TT=0.186	SAT TT=1.926 CHECKS=1348840	SAT TT=0.755 CHECKS=1320220	SAT TT=1.197 ASSIGNMENTS=1	SAT TT=1.04 ASSIGNMENTS=1	SAT TT=26.181 CHECKS=6083640 NODES=500	SAT TT=5.727 CHECKS=8152500 NODES=0	SAT TT=5.784 CHECKS=8152500 NODES=0	SAT TT=0.04 ASSIGNMENTS=1 CHECKS=1022	SAT TT=0.039 ASSIGNMENTS=1 CHECKS=1022	? (MO) TT=1055.97	? (MO) TT=1046.51	No data	SAT TT=0.027 ASSIGNMENTS=1 CHECKS=1022	SAT TT=0.029 ASSIGNMENTS=1 CHECKS=1022	SAT TT=0.757	SAT TT=0.03 ASSIGNMENTS=499 CHECKS=6495	SAT TT=0.027 ASSIGNMENTS=1 CHECKS=14	SAT TT=86.609	No data	SAT TT=3.373	SAT TT=7.977
csp/domino/ normalized-domino-800-100.xml	SAT TT=0.042	SAT TT=1.679 CHECKS=6575800 NODES=800	SAT TT=1.681 CHECKS=6575800 NODES=800	SAT TT=0.203	SAT TT=2.099 CHECKS=337227	SAT TT=0.15 CHECKS=306659	SAT TT=1.329 ASSIGNMENTS=1	SAT TT=1.33 ASSIGNMENTS=1	SAT TT=3.538 CHECKS=485804 NODES=800	SAT TT=2.145 CHECKS=650403 NODES=0	SAT TT=2.228 CHECKS=650403 NODES=0	SAT TT=0.056 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.055 ASSIGNMENTS=1 CHECKS=14	SAT TT=79.289	SAT TT=78.386	No data	SAT TT=0.044 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.042 ASSIGNMENTS=1 CHECKS=222	SAT TT=1.106	SAT TT=0.044 ASSIGNMENTS=99 CHECKS=1295	SAT TT=0.044 ASSIGNMENTS=1 CHECKS=14	SAT TT=9.478	No data	SAT TT=2.183	SAT TT=3.658
csp/driver/ normalized-driverlogw-01c-sat_ext.xml	SAT TT=0.01	SAT TT=0.771 CHECKS=1271 NODES=71	SAT TT=0.736 CHECKS=1242 NODES=0	SAT TT=0.047	SAT TT=0.018 CHECKS=4665	SAT TT=0.016 CHECKS=3190	SAT TT=0.509 ASSIGNMENTS=24	SAT TT=0.518 ASSIGNMENTS=24	SAT TT=0.378 CHECKS=733 NODES=71	SAT TT=0.412 CHECKS=3422 NODES=31	SAT TT=0.389 CHECKS=6207 NODES=19	SAT TT=0.023 ASSIGNMENTS=24 CHECKS=535	SAT TT=0.023 ASSIGNMENTS=24 CHECKS=535	SAT TT=0.998	SAT TT=1.01	No data	SAT TT=0.01 ASSIGNMENTS=24 CHECKS=535	SAT TT=0.011 ASSIGNMENTS=20 CHECKS=512	SAT TT=0.386	SAT TT=0.01 ASSIGNMENTS=23 CHECKS=460	SAT TT=0.01 ASSIGNMENTS=24 CHECKS=535	SAT TT=0.844	SAT TT=0.019 ASSIGNMENTS=71 CHECKS=1442	SAT TT=0.699	SAT TT=0.688
csp/driver/ normalized-driverlogw-02c-sat_ext.xml	SAT TT=0.136	SAT TT=2.307 CHECKS=1742190 NODES=4000	SAT TT=3.196 CHECKS=2504230 NODES=4111	SAT TT=0.477	SAT TT=4.127 CHECKS=3171710	SAT TT=1.333 CHECKS=1153110	SAT TT=1.573 ASSIGNMENTS=65	SAT TT=1.774 ASSIGNMENTS=65	SAT TT=3.114 CHECKS=35400 NODES=423	SAT TT=5.566 CHECKS=9618040 NODES=59971	SAT TT=4.35 CHECKS=7845390 NODES=3763	SAT TT=0.139 ASSIGNMENTS=180 CHECKS=117043	SAT TT=0.142 ASSIGNMENTS=180 CHECKS=117043	SAT TT=2.919	SAT TT=3.028	No data	SAT TT=0.143 ASSIGNMENTS=201 CHECKS=150798	SAT TT=0.781 ASSIGNMENTS=9610 CHECKS=2701420	SAT TT=1.352	SAT TT=0.447 ASSIGNMENTS=1308 CHECKS=1602120	SAT TT=0.136 ASSIGNMENTS=180 CHECKS=117043	SAT TT=3.679	SAT TT=0.897 ASSIGNMENTS=1248 CHECKS=609322	SAT TT=1.567	SAT TT=1.728
csp/driver/ normalized-driverlogw-04c-sat_ext.xml	SAT TT=0.118	SAT TT=1.635 CHECKS=420610 NODES=884	SAT TT=1.865 CHECKS=563609 NODES=627	SAT TT=0.52	? (TO) TT=1800.05	SAT TT=1.208 CHECKS=1017290	SAT TT=1.173 ASSIGNMENTS=31	SAT TT=1.18 ASSIGNMENTS=31	SAT TT=2.69 CHECKS=24260 NODES=292	SAT TT=2.716 CHECKS=479876 NODES=2435	SAT TT=2.669 CHECKS=851220 NODES=355	SAT TT=0.129 ASSIGNMENTS=95 CHECKS=64460	SAT TT=0.131 ASSIGNMENTS=95 CHECKS=64460	SAT TT=2.928	SAT TT=2.808	No data	SAT TT=0.124 ASSIGNMENTS=97 CHECKS=66005	SAT TT=0.145 ASSIGNMENTS=458 CHECKS=150402	SAT TT=1.136	SAT TT=0.285 ASSIGNMENTS=591 CHECKS=754943	SAT TT=0.118 ASSIGNMENTS=95 CHECKS=64460	SAT TT=4.484	SAT TT=0.415 ASSIGNMENTS=539 CHECKS=390557	SAT TT=1.495	SAT TT=1.625
csp/driver/ normalized-driverlogw-05c-sat_ext.xml	SAT TT=0.174	SAT TT=1.939 CHECKS=517412 NODES=1333	SAT TT=1.71 CHECKS=216933 NODES=0	SAT TT=0.733	SAT TT=18.462 CHECKS=10742900	SAT TT=3.754 CHECKS=2207510	SAT TT=3.474 ASSIGNMENTS=95	SAT TT=3.633 ASSIGNMENTS=95	SAT TT=5.845 CHECKS=38628 NODES=378	SAT TT=8.709 CHECKS=10323200 NODES=41956	SAT TT=6 CHECKS=1051790 NODES=289	SAT TT=0.183 ASSIGNMENTS=74 CHECKS=59750	SAT TT=0.179 ASSIGNMENTS=74 CHECKS=59750	SAT TT=3.677	SAT TT=3.603	No data	SAT TT=0.196 ASSIGNMENTS=117 CHECKS=133099	SAT TT=0.736 ASSIGNMENTS=5825 CHECKS=2512870	SAT TT=1.874	SAT TT=0.603 ASSIGNMENTS=873 CHECKS=1787770	SAT TT=0.174 ASSIGNMENTS=74 CHECKS=59750	SAT TT=4.455	SAT TT=0.927 ASSIGNMENTS=1279 CHECKS=418105	SAT TT=2.115	SAT TT=1.861
csp/driver/ normalized-driverlogw-08cc-sat_ext.xml	SAT TT=0.359	SAT TT=2.762 CHECKS=2027910 NODES=2613	SAT TT=3.832 CHECKS=4430730 NODES=2706	SAT TT=1.308	SAT TT=30.815 CHECKS=15004800	SAT TT=6.917 CHECKS=2820000	SAT TT=6.203 ASSIGNMENTS=76	SAT TT=6.139 ASSIGNMENTS=76	SAT TT=13.984 CHECKS=76029 NODES=489	SAT TT=17.597 CHECKS=13907500 NODES=47630	SAT TT=20.227 CHECKS=20735900 NODES=5463	SAT TT=0.365 ASSIGNMENTS=174 CHECKS=476259	SAT TT=0.367 ASSIGNMENTS=174 CHECKS=476259	SAT TT=5.484	SAT TT=4.615	No data	SAT TT=0.53 ASSIGNMENTS=470 CHECKS=1122820	SAT TT=2.093 ASSIGNMENTS=9657 CHECKS=6612560	SAT TT=3.392	SAT TT=1.383 ASSIGNMENTS=1191 CHECKS=4009560	SAT TT=0.359 ASSIGNMENTS=174 CHECKS=476259	SAT TT=5.288	SAT TT=2.164 ASSIGNMENTS=1141 CHECKS=648302	SAT TT=2.208	SAT TT=2.282
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/driver/ normalized-driverlogw-08c-sat_ext.xml	SAT TT=0.351	SAT TT=3.349 CHECKS=3976790 NODES=3591	SAT TT=4.645 CHECKS=5487000 NODES=3194	SAT TT=1.269	SAT TT=31.053 CHECKS=17547300	SAT TT=5.419 CHECKS=2209600	SAT TT=6.107 ASSIGNMENTS=76	SAT TT=6.154 ASSIGNMENTS=76	SAT TT=14.138 CHECKS=76056 NODES=489	SAT TT=57.988 CHECKS=134653000 NODES=490165	SAT TT=15.427 CHECKS=6441340 NODES=2234	SAT TT=0.366 ASSIGNMENTS=174 CHECKS=476259	SAT TT=0.363 ASSIGNMENTS=174 CHECKS=476259	SAT TT=5.097	SAT TT=4.959	No data	SAT TT=0.516 ASSIGNMENTS=470 CHECKS=1122820	SAT TT=2.111 ASSIGNMENTS=9682 CHECKS=6424930	SAT TT=3.491	SAT TT=1.407 ASSIGNMENTS=1191 CHECKS=4009560	SAT TT=0.351 ASSIGNMENTS=174 CHECKS=476259	SAT TT=5.217	SAT TT=2.209 ASSIGNMENTS=1141 CHECKS=648251	SAT TT=2.264	SAT TT=2.23
csp/driver/ normalized-driverlogw-09-sat_ext.xml	SAT TT=2.291	SAT TT=152.666 CHECKS=35571000 NODES=27204	SAT TT=143.575 CHECKS=33533600 NODES=23806	SAT TT=42.351	SAT TT=80.622 CHECKS=34515400	SAT TT=93.872 CHECKS=41022300	SAT TT=15.952 ASSIGNMENTS=345	SAT TT=17.887 ASSIGNMENTS=345	SAT TT=141.088 CHECKS=1964450 NODES=6371	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=34.14 ASSIGNMENTS=28499 CHECKS=36491500	SAT TT=37.224 ASSIGNMENTS=28499 CHECKS=36491500	SAT TT=10.527	SAT TT=9.623	No data	SAT TT=2.291 ASSIGNMENTS=1581 CHECKS=5209070	SAT TT=7.406 ASSIGNMENTS=14916 CHECKS=17398700	SAT TT=8.216	SAT TT=6.433 ASSIGNMENTS=2328 CHECKS=14564800	SAT TT=2.975 ASSIGNMENTS=2280 CHECKS=6973980	SAT TT=6.641	SAT TT=39.181 ASSIGNMENTS=22420 CHECKS=20207800	SAT TT=3.539	SAT TT=3.934
csp/dubois/ normalized-dubois-100_ext.xml	UNSAT TT=0.817	? (TO) TT=1800.25	? (TO) TT=1800.26	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.894	UNSAT TT=1.244	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=3.038	? (TO) TT=1800.04	UNSAT TT=0.835	UNSAT TT=0.817
csp/dubois/ normalized-dubois-20_ext.xml	UNSAT TT=0.537	UNSAT TT=1.492 CHECKS=79754 NODES=14777	UNSAT TT=2.53 CHECKS=223066 NODES=41135	UNSAT TT=8.116	UNSAT TT=111.592 CHECKS=82774500	UNSAT TT=123.134 CHECKS=77412600	UNSAT TT=119.071 ASSIGNMENTS=2060720	UNSAT TT=118.771 ASSIGNMENTS=2097150	UNSAT TT=126.312 CHECKS=82378100 NODES=4810800	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=13.504 ASSIGNMENTS=162181 CHECKS=910479	UNSAT TT=14.149 ASSIGNMENTS=162181 CHECKS=910479	UNSAT TT=0.769	UNSAT TT=0.628	UNSAT TT=6.55 CHECKS=6479290	UNSAT TT=9.845 ASSIGNMENTS=1687500 CHECKS=18413100	UNSAT TT=13.741 ASSIGNMENTS=2366460 CHECKS=25865200	UNSAT TT=19.749	UNSAT TT=14.551 ASSIGNMENTS=2371060 CHECKS=26616600	UNSAT TT=8.887 ASSIGNMENTS=1522830 CHECKS=16528500	UNSAT TT=1.212	UNSAT TT=79.105 ASSIGNMENTS=10581800 CHECKS=31649500	UNSAT TT=0.543	UNSAT TT=0.537
csp/dubois/ normalized-dubois-21_ext.xml	UNSAT TT=0.531	UNSAT TT=1.316 CHECKS=60451 NODES=13835	UNSAT TT=1.874 CHECKS=117352 NODES=27428	UNSAT TT=19.589	UNSAT TT=156.875 CHECKS=93120100	UNSAT TT=177.694 CHECKS=111909000	UNSAT TT=222.003 ASSIGNMENTS=3559610	UNSAT TT=235.596 ASSIGNMENTS=4194300	UNSAT TT=268.599 CHECKS=188953000 NODES=10522000	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=17.976 ASSIGNMENTS=277132 CHECKS=2038860	UNSAT TT=19.524 ASSIGNMENTS=277132 CHECKS=2038860	UNSAT TT=0.645	UNSAT TT=0.6	UNSAT TT=22.512 CHECKS=19603400	UNSAT TT=19.897 ASSIGNMENTS=3678290 CHECKS=40001600	UNSAT TT=28.389 ASSIGNMENTS=4843760 CHECKS=53416300	UNSAT TT=39.743	UNSAT TT=26.107 ASSIGNMENTS=4293310 CHECKS=47921300	UNSAT TT=17.496 ASSIGNMENTS=3069620 CHECKS=32785900	UNSAT TT=1.124	UNSAT TT=162.893 ASSIGNMENTS=21207200 CHECKS=63164400	UNSAT TT=0.534	UNSAT TT=0.531
csp/dubois/ normalized-dubois-22_ext.xml	UNSAT TT=0.582	UNSAT TT=14.903 CHECKS=2783970 NODES=330521	UNSAT TT=0.925 CHECKS=8758 NODES=3461	UNSAT TT=34.553	UNSAT TT=288.754 CHECKS=162424000	UNSAT TT=282.141 CHECKS=152813000	UNSAT TT=414.813 ASSIGNMENTS=7209780	UNSAT TT=473.178 ASSIGNMENTS=8388610	UNSAT TT=601.854 CHECKS=415573000 NODES=23024300	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=62.481 ASSIGNMENTS=1317360 CHECKS=10745900	UNSAT TT=62.717 ASSIGNMENTS=1317360 CHECKS=10745900	UNSAT TT=0.891	UNSAT TT=0.885	UNSAT TT=28.039 CHECKS=25835400	UNSAT TT=38.934 ASSIGNMENTS=7188430 CHECKS=78642900	UNSAT TT=50.238 ASSIGNMENTS=9240150 CHECKS=102130000	UNSAT TT=77.315	UNSAT TT=61.601 ASSIGNMENTS=9346540 CHECKS=105158000	UNSAT TT=33.821 ASSIGNMENTS=6198340 CHECKS=67915800	UNSAT TT=1.259	UNSAT TT=340.086 ASSIGNMENTS=42675800 CHECKS=127191000	UNSAT TT=0.583	UNSAT TT=0.582
csp/dubois/ normalized-dubois-23_ext.xml	UNSAT TT=0.54	UNSAT TT=1.417 CHECKS=76323 NODES=14859	UNSAT TT=1.284 CHECKS=30171 NODES=9037	UNSAT TT=82.833	UNSAT TT=447.724 CHECKS=361665000	UNSAT TT=704.039 CHECKS=367553000	UNSAT TT=863.056 ASSIGNMENTS=14091600	UNSAT TT=893.06 ASSIGNMENTS=16777200	UNSAT TT=1043.03 CHECKS=654953000 NODES=36701800	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=8.708 ASSIGNMENTS=10880 CHECKS=48338	UNSAT TT=8.527 ASSIGNMENTS=10880 CHECKS=48338	UNSAT TT=0.647	UNSAT TT=0.89	UNSAT TT=62.045 CHECKS=52501500	UNSAT TT=77.676 ASSIGNMENTS=14166800 CHECKS=156837000	UNSAT TT=104.352 ASSIGNMENTS=18958200 CHECKS=212296000	UNSAT TT=156.465	UNSAT TT=110.773 ASSIGNMENTS=16352100 CHECKS=188083000	UNSAT TT=65.181 ASSIGNMENTS=12012200 CHECKS=131400000	UNSAT TT=1.242	UNSAT TT=681.621 ASSIGNMENTS=78797800 CHECKS=232927000	UNSAT TT=0.581	UNSAT TT=0.54
csp/dubois/ normalized-dubois-24_ext.xml	UNSAT TT=0.573	UNSAT TT=1.332 CHECKS=58473 NODES=13714	UNSAT TT=3.055 CHECKS=291176 NODES=53290	UNSAT TT=140.76	UNSAT TT=694.658 CHECKS=586994000	UNSAT TT=858.316 CHECKS=429022000	UNSAT TT=1681.43 ASSIGNMENTS=27119900	UNSAT TT=1776.78 ASSIGNMENTS=33554400	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=63.628 ASSIGNMENTS=1057570 CHECKS=9215080	UNSAT TT=64.343 ASSIGNMENTS=1057570 CHECKS=9215080	UNSAT TT=0.652	UNSAT TT=0.784	UNSAT TT=137.664 CHECKS=112819000	UNSAT TT=155.1 ASSIGNMENTS=28205200 CHECKS=312721000	UNSAT TT=215.589 ASSIGNMENTS=37314900 CHECKS=416630000	UNSAT TT=285.283	UNSAT TT=235.43 ASSIGNMENTS=35960500 CHECKS=402743000	UNSAT TT=128.299 ASSIGNMENTS=23587500 CHECKS=259851000	UNSAT TT=1.194	UNSAT TT=1486.23 ASSIGNMENTS=156501000 CHECKS=465824000	UNSAT TT=0.573	UNSAT TT=0.584
csp/dubois/ normalized-dubois-25_ext.xml	UNSAT TT=0.623	UNSAT TT=1.438 CHECKS=73345 NODES=14550	UNSAT TT=1.963 CHECKS=122661 NODES=26950	UNSAT TT=378.723	UNSAT TT=1347.38 CHECKS=1139950000	UNSAT TT=1321.7 CHECKS=1158650000	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=8.828 ASSIGNMENTS=13512 CHECKS=57824	UNSAT TT=8.418 ASSIGNMENTS=13512 CHECKS=57824	UNSAT TT=0.687	UNSAT TT=0.819	UNSAT TT=275.316 CHECKS=225616000	UNSAT TT=335.506 ASSIGNMENTS=56490800 CHECKS=624941000	UNSAT TT=452.698 ASSIGNMENTS=73362700 CHECKS=837196000	UNSAT TT=607.968	UNSAT TT=498.144 ASSIGNMENTS=70776900 CHECKS=826140000	UNSAT TT=280.304 ASSIGNMENTS=48274100 CHECKS=522890000	UNSAT TT=1.218	? (TO) TT=1800.06	UNSAT TT=0.632	UNSAT TT=0.623
csp/dubois/ normalized-dubois-26_ext.xml	UNSAT TT=0.557	UNSAT TT=1.7 CHECKS=92009 NODES=18382	UNSAT TT=5.276 CHECKS=581958 NODES=101262	UNSAT TT=547.605	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=8.772 ASSIGNMENTS=15141 CHECKS=62500	UNSAT TT=8.941 ASSIGNMENTS=15141 CHECKS=62500	UNSAT TT=0.653	UNSAT TT=0.784	UNSAT TT=295.968 CHECKS=251515000	UNSAT TT=604.083 ASSIGNMENTS=109553000 CHECKS=1224880000	UNSAT TT=830.156 ASSIGNMENTS=147259000 CHECKS=1681680000	UNSAT TT=1112.45	UNSAT TT=890.055 ASSIGNMENTS=143617000 CHECKS=1624040000	UNSAT TT=427.332 ASSIGNMENTS=77631500 CHECKS=859176000	UNSAT TT=1.236	? (TO) TT=1800.11	UNSAT TT=0.557	UNSAT TT=0.56
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/dubois/ normalized-dubois-27_ext.xml	UNSAT TT=0.606	UNSAT TT=1.495 CHECKS=76632 NODES=15235	UNSAT TT=252.345 CHECKS=51084500 NODES=4863130	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=64.921 ASSIGNMENTS=1136300 CHECKS=9738060	UNSAT TT=64.296 ASSIGNMENTS=1136300 CHECKS=9738060	UNSAT TT=0.654	UNSAT TT=0.801	UNSAT TT=535.22 CHECKS=414338000	UNSAT TT=1166.52 ASSIGNMENTS=194651000 CHECKS=2198930000	UNSAT TT=1678.28 ASSIGNMENTS=292557000 CHECKS=3379750000	? (TO) TT=1800.1	UNSAT TT=1665.2 ASSIGNMENTS=268163000 CHECKS=3064200000	UNSAT TT=1054.53 ASSIGNMENTS=179924000 CHECKS=1990070000	UNSAT TT=1.217	? (TO) TT=1800.03	UNSAT TT=0.606	UNSAT TT=0.609
csp/dubois/ normalized-dubois-28_ext.xml	UNSAT TT=0.601	UNSAT TT=1.863 CHECKS=98777 NODES=18994	UNSAT TT=5.022 CHECKS=376282 NODES=78755	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=16.25 ASSIGNMENTS=148908 CHECKS=1035260	UNSAT TT=16.321 ASSIGNMENTS=148908 CHECKS=1035260	UNSAT TT=0.658	UNSAT TT=0.659	UNSAT TT=822.714 CHECKS=620715000	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=1.274	? (TO) TT=1800.04	UNSAT TT=0.601	UNSAT TT=0.613
csp/dubois/ normalized-dubois-29_ext.xml	UNSAT TT=0.611	UNSAT TT=72.794 CHECKS=12118900 NODES=1532710	UNSAT TT=1.407 CHECKS=31895 NODES=10170	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=9.07 ASSIGNMENTS=14831 CHECKS=78980	UNSAT TT=9.268 ASSIGNMENTS=14831 CHECKS=78980	UNSAT TT=0.647	UNSAT TT=0.783	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=1.313	? (TO) TT=1800.02	UNSAT TT=0.615	UNSAT TT=0.611
csp/dubois/ normalized-dubois-30_ext.xml	UNSAT TT=0.574	UNSAT TT=11.585 CHECKS=1495870 NODES=229362	UNSAT TT=2.891 CHECKS=215719 NODES=43233	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=12.425 ASSIGNMENTS=85364 CHECKS=495018	UNSAT TT=12.565 ASSIGNMENTS=85364 CHECKS=495018	UNSAT TT=0.779	UNSAT TT=0.812	UNSAT TT=1423.07 CHECKS=1136600000	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=1.272	? (TO) TT=1800.07	UNSAT TT=0.574	UNSAT TT=0.58
csp/dubois/ normalized-dubois-50_ext.xml	UNSAT TT=0.699	? (TO) TT=1800.22	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=0.903	UNSAT TT=0.908	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=1.646	? (TO) TT=1800.03	UNSAT TT=0.758	UNSAT TT=0.699
csp/ehi-85/ normalized-ehi-85-297-27_ext.xml	UNSAT TT=0.117	UNSAT TT=2.884 CHECKS=3285910 NODES=3193	UNSAT TT=1.264 CHECKS=36905 NODES=0	UNSAT TT=0.476	UNSAT TT=2.05 CHECKS=266353	UNSAT TT=0.565 CHECKS=6912	UNSAT TT=1.141 ASSIGNMENTS=0	UNSAT TT=0.97 ASSIGNMENTS=0	UNSAT TT=3.067 CHECKS=7188 NODES=5	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.139 ASSIGNMENTS=40 CHECKS=53540	UNSAT TT=0.126 ASSIGNMENTS=40 CHECKS=53540	UNSAT TT=4.837	UNSAT TT=4.281	No data	UNSAT TT=0.267 ASSIGNMENTS=275 CHECKS=649240	UNSAT TT=1.299 ASSIGNMENTS=2191 CHECKS=4715440	UNSAT TT=1.645	UNSAT TT=0.117 ASSIGNMENTS=5 CHECKS=9371	UNSAT TT=0.124 ASSIGNMENTS=40 CHECKS=53540	UNSAT TT=4.059	UNSAT TT=2.306 ASSIGNMENTS=3 CHECKS=6698	UNSAT TT=2.043	UNSAT TT=2.695
csp/ehi-85/ normalized-ehi-85-297-30_ext.xml	UNSAT TT=0.117	UNSAT TT=1.694 CHECKS=869721 NODES=638	UNSAT TT=1.386 CHECKS=89206 NODES=0	UNSAT TT=113.315	UNSAT TT=0.641 CHECKS=16582	UNSAT TT=0.568 CHECKS=9590	UNSAT TT=1.164 ASSIGNMENTS=0	UNSAT TT=1.176 ASSIGNMENTS=0	UNSAT TT=3.156 CHECKS=12777 NODES=6	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.159 ASSIGNMENTS=71 CHECKS=185987	UNSAT TT=0.172 ASSIGNMENTS=71 CHECKS=185987	UNSAT TT=4.979	UNSAT TT=3.92	No data	UNSAT TT=0.321 ASSIGNMENTS=413 CHECKS=983353	UNSAT TT=0.984 ASSIGNMENTS=1687 CHECKS=3505690	UNSAT TT=1.519	UNSAT TT=0.117 ASSIGNMENTS=15 CHECKS=17557	UNSAT TT=0.155 ASSIGNMENTS=71 CHECKS=185987	UNSAT TT=4.023	UNSAT TT=1.506 ASSIGNMENTS=4 CHECKS=23638	UNSAT TT=2.236	UNSAT TT=2.24
csp/ehi-85/ normalized-ehi-85-297-55_ext.xml	UNSAT TT=0.113	UNSAT TT=2.441 CHECKS=2418180 NODES=2647	UNSAT TT=1.397 CHECKS=123287 NODES=0	UNSAT TT=174.964	UNSAT TT=1.756 CHECKS=218889	UNSAT TT=0.607 CHECKS=9329	UNSAT TT=1.167 ASSIGNMENTS=0	UNSAT TT=1.165 ASSIGNMENTS=0	UNSAT TT=2.813 CHECKS=6773 NODES=4	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.199 ASSIGNMENTS=149 CHECKS=319842	UNSAT TT=0.202 ASSIGNMENTS=149 CHECKS=319842	UNSAT TT=4.401	UNSAT TT=4.392	No data	UNSAT TT=0.28 ASSIGNMENTS=361 CHECKS=712175	UNSAT TT=1.803 ASSIGNMENTS=3270 CHECKS=6926100	UNSAT TT=1.713	UNSAT TT=0.113 ASSIGNMENTS=8 CHECKS=13223	UNSAT TT=0.189 ASSIGNMENTS=149 CHECKS=319842	UNSAT TT=4.315	UNSAT TT=1.203 ASSIGNMENTS=4 CHECKS=13836	UNSAT TT=2.319	UNSAT TT=2.653
csp/ehi-85/ normalized-ehi-85-297-78_ext.xml	UNSAT TT=0.116	UNSAT TT=1.785 CHECKS=1322880 NODES=951	UNSAT TT=1.278 CHECKS=25156 NODES=0	UNSAT TT=0.481	UNSAT TT=0.684 CHECKS=20921	UNSAT TT=0.532 CHECKS=7925	UNSAT TT=0.916 ASSIGNMENTS=0	UNSAT TT=0.909 ASSIGNMENTS=0	UNSAT TT=2.747 CHECKS=9420 NODES=9	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.169 ASSIGNMENTS=99 CHECKS=168372	UNSAT TT=0.163 ASSIGNMENTS=99 CHECKS=168372	UNSAT TT=4.797	UNSAT TT=4.208	No data	UNSAT TT=0.354 ASSIGNMENTS=357 CHECKS=998078	UNSAT TT=1.799 ASSIGNMENTS=3047 CHECKS=6753030	UNSAT TT=1.596	UNSAT TT=0.116 ASSIGNMENTS=5 CHECKS=10548	UNSAT TT=0.15 ASSIGNMENTS=99 CHECKS=168372	UNSAT TT=3.915	UNSAT TT=0.509 ASSIGNMENTS=4 CHECKS=13540	UNSAT TT=2.081	UNSAT TT=2.476
csp/ehi-85/ normalized-ehi-85-297-96_ext.xml	UNSAT TT=0.114	UNSAT TT=1.774 CHECKS=1016450 NODES=987	UNSAT TT=1.272 CHECKS=13771 NODES=0	UNSAT TT=0.488	UNSAT TT=0.655 CHECKS=15148	UNSAT TT=0.619 CHECKS=10155	UNSAT TT=1.06 ASSIGNMENTS=0	UNSAT TT=0.969 ASSIGNMENTS=0	UNSAT TT=2.785 CHECKS=7433 NODES=4	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=0.13 ASSIGNMENTS=4 CHECKS=8886	UNSAT TT=0.129 ASSIGNMENTS=4 CHECKS=8886	UNSAT TT=4.858	UNSAT TT=3.981	No data	UNSAT TT=0.119 ASSIGNMENTS=4 CHECKS=8925	UNSAT TT=1.935 ASSIGNMENTS=3569 CHECKS=7550430	UNSAT TT=1.628	UNSAT TT=0.115 ASSIGNMENTS=9 CHECKS=14698	UNSAT TT=0.114 ASSIGNMENTS=4 CHECKS=8886	UNSAT TT=3.896	UNSAT TT=0.8 ASSIGNMENTS=3 CHECKS=17099	UNSAT TT=2.054	UNSAT TT=2.501
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ehi-90/ normalized-ehi-90-315-51_ext.xml	UNSAT TT=0.121	UNSAT TT=2.365 CHECKS=2305600 NODES=2598	UNSAT TT=1.267 CHECKS=13957 NODES=0	UNSAT TT=0.477	UNSAT TT=0.657 CHECKS=15653	UNSAT TT=0.606 CHECKS=9327	UNSAT TT=0.904 ASSIGNMENTS=0	UNSAT TT=0.923 ASSIGNMENTS=0	UNSAT TT=3.124 CHECKS=8151 NODES=8	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.204 ASSIGNMENTS=136 CHECKS=288941	UNSAT TT=0.199 ASSIGNMENTS=136 CHECKS=288941	UNSAT TT=4.572	UNSAT TT=4.557	No data	UNSAT TT=0.247 ASSIGNMENTS=298 CHECKS=607334	UNSAT TT=2.26 ASSIGNMENTS=3655 CHECKS=8660490	UNSAT TT=1.638	UNSAT TT=0.121 ASSIGNMENTS=4 CHECKS=10599	UNSAT TT=0.177 ASSIGNMENTS=136 CHECKS=288941	UNSAT TT=4.065	UNSAT TT=1.051 ASSIGNMENTS=5 CHECKS=14051	UNSAT TT=2.456	UNSAT TT=2.286
csp/ehi-90/ normalized-ehi-90-315-54_ext.xml	UNSAT TT=0.12	UNSAT TT=1.718 CHECKS=1007030 NODES=764	UNSAT TT=1.325 CHECKS=8062 NODES=0	UNSAT TT=0.506	UNSAT TT=0.647 CHECKS=15589	UNSAT TT=0.594 CHECKS=11232	UNSAT TT=0.947 ASSIGNMENTS=0	UNSAT TT=0.908 ASSIGNMENTS=0	UNSAT TT=3.004 CHECKS=5566 NODES=6	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=0.192 ASSIGNMENTS=136 CHECKS=317649	UNSAT TT=0.193 ASSIGNMENTS=136 CHECKS=317649	UNSAT TT=4.621	UNSAT TT=4.449	No data	UNSAT TT=0.444 ASSIGNMENTS=534 CHECKS=1286630	UNSAT TT=1.884 ASSIGNMENTS=3315 CHECKS=7238890	UNSAT TT=1.466	UNSAT TT=0.12 ASSIGNMENTS=5 CHECKS=9936	UNSAT TT=0.184 ASSIGNMENTS=136 CHECKS=317649	UNSAT TT=3.824	UNSAT TT=1.363 ASSIGNMENTS=17 CHECKS=40585	UNSAT TT=2.183	UNSAT TT=2.731
csp/ehi-90/ normalized-ehi-90-315-65_ext.xml	UNSAT TT=0.12	UNSAT TT=1.987 CHECKS=1482220 NODES=1255	UNSAT TT=1.306 CHECKS=16111 NODES=0	UNSAT TT=0.505	UNSAT TT=0.643 CHECKS=10958	UNSAT TT=0.564 CHECKS=8441	UNSAT TT=0.953 ASSIGNMENTS=0	UNSAT TT=0.957 ASSIGNMENTS=0	UNSAT TT=3.205 CHECKS=7211 NODES=4	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=0.134 ASSIGNMENTS=4 CHECKS=10425	UNSAT TT=0.136 ASSIGNMENTS=4 CHECKS=10425	UNSAT TT=4.571	UNSAT TT=4.284	No data	UNSAT TT=0.272 ASSIGNMENTS=277 CHECKS=622360	UNSAT TT=0.686 ASSIGNMENTS=1149 CHECKS=2491840	UNSAT TT=1.646	UNSAT TT=0.12 ASSIGNMENTS=5 CHECKS=10432	UNSAT TT=0.122 ASSIGNMENTS=4 CHECKS=10425	UNSAT TT=3.994	UNSAT TT=1.589 ASSIGNMENTS=4 CHECKS=15331	UNSAT TT=2.144	UNSAT TT=2.437
csp/ehi-90/ normalized-ehi-90-315-71_ext.xml	UNSAT TT=0.121	UNSAT TT=2.521 CHECKS=2640420 NODES=2648	UNSAT TT=1.259 CHECKS=11438 NODES=0	UNSAT TT=0.502	UNSAT TT=0.65 CHECKS=18297	UNSAT TT=0.552 CHECKS=8734	UNSAT TT=0.883 ASSIGNMENTS=0	UNSAT TT=0.968 ASSIGNMENTS=0	UNSAT TT=3.071 CHECKS=5925 NODES=5	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.159 ASSIGNMENTS=53 CHECKS=108868	UNSAT TT=0.156 ASSIGNMENTS=53 CHECKS=108868	UNSAT TT=4.592	UNSAT TT=4.417	No data	UNSAT TT=0.325 ASSIGNMENTS=327 CHECKS=913000	UNSAT TT=1.124 ASSIGNMENTS=1792 CHECKS=4009430	UNSAT TT=1.59	UNSAT TT=0.121 ASSIGNMENTS=5 CHECKS=10324	UNSAT TT=0.139 ASSIGNMENTS=53 CHECKS=108868	UNSAT TT=4.203	UNSAT TT=1.619 ASSIGNMENTS=5 CHECKS=16829	UNSAT TT=2.24	UNSAT TT=2.611
csp/ehi-90/ normalized-ehi-90-315-95_ext.xml	UNSAT TT=0.114	UNSAT TT=1.996 CHECKS=877654 NODES=1509	UNSAT TT=1.37 CHECKS=66886 NODES=0	UNSAT TT=34.105	UNSAT TT=0.61 CHECKS=15631	UNSAT TT=0.556 CHECKS=6983	UNSAT TT=0.879 ASSIGNMENTS=0	UNSAT TT=0.953 ASSIGNMENTS=0	UNSAT TT=3.118 CHECKS=6624 NODES=4	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.134 ASSIGNMENTS=23 CHECKS=18243	UNSAT TT=0.13 ASSIGNMENTS=23 CHECKS=18243	UNSAT TT=4.547	UNSAT TT=4.613	No data	UNSAT TT=0.129 ASSIGNMENTS=71 CHECKS=41844	UNSAT TT=1.017 ASSIGNMENTS=1621 CHECKS=3669060	UNSAT TT=1.511	UNSAT TT=0.114 ASSIGNMENTS=4 CHECKS=9430	UNSAT TT=0.125 ASSIGNMENTS=23 CHECKS=18243	UNSAT TT=3.853	UNSAT TT=2.05 ASSIGNMENTS=3 CHECKS=8570	UNSAT TT=2.159	UNSAT TT=2.525
csp/fapp/fapp01/ normalized-fapp01-0200-10.xml	SAT TT=2.432	SAT TT=10.236 CHECKS=509828 NODES=200	SAT TT=10.31 CHECKS=603822 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=5.863 ASSIGNMENTS=155	SAT TT=5.807 ASSIGNMENTS=155	SAT TT=18.154 CHECKS=1045660 NODES=427	SAT TT=14.224 CHECKS=23030900 NODES=6856	SAT TT=12.099 CHECKS=3334850 NODES=591	SAT TT=16.817 ASSIGNMENTS=200 CHECKS=509828	SAT TT=17.103 ASSIGNMENTS=200 CHECKS=509828	? (problem) TT=0.577	? (problem) TT=0.579	No data	SAT TT=2.461 ASSIGNMENTS=418 CHECKS=35520	SAT TT=91.132 ASSIGNMENTS=7543 CHECKS=1512450	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=2.432 ASSIGNMENTS=288 CHECKS=31525	SAT TT=137.591	No data	SAT TT=149.969	SAT TT=75.418
csp/fapp/fapp01/ normalized-fapp01-0200-2.xml	UNSAT TT=9.95	UNSAT TT=10.453 CHECKS=153025 NODES=0	UNSAT TT=9.95 CHECKS=153025 NODES=0	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.19	? (TO) TT=1800.17	UNSAT TT=22.344 CHECKS=9956950 NODES=2675	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=17.535 ASSIGNMENTS=0 CHECKS=153025	UNSAT TT=17.658 ASSIGNMENTS=0 CHECKS=153025	? (problem) TT=0.439	? (problem) TT=0.454	No data	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=160.765	No data	UNSAT TT=26.677	UNSAT TT=54.013
csp/fapp/fapp01/ normalized-fapp01-0200-8.xml	SAT TT=6.562	SAT TT=10.894 CHECKS=616036 NODES=200	SAT TT=10.701 CHECKS=1003130 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=6.788 ASSIGNMENTS=243	SAT TT=6.654 ASSIGNMENTS=243	SAT TT=20.63 CHECKS=5118480 NODES=2183	? (TO) TT=1800.01	SAT TT=11.962 CHECKS=3760060 NODES=693	SAT TT=17.05 ASSIGNMENTS=200 CHECKS=616036	SAT TT=18.338 ASSIGNMENTS=200 CHECKS=616036	? (problem) TT=0.492	SAT TT=608.366	No data	SAT TT=13.894 ASSIGNMENTS=1904 CHECKS=286789	SAT TT=90.181 ASSIGNMENTS=6362 CHECKS=1572420	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=6.562 ASSIGNMENTS=885 CHECKS=116262	SAT TT=141.143	No data	SAT TT=145.2	SAT TT=90.3
csp/fapp/fapp02/ normalized-fapp02-0250-0.xml	UNSAT TT=1.994	UNSAT TT=17.88 CHECKS=28617 NODES=0	UNSAT TT=17.834 CHECKS=28617 NODES=0	UNSAT TT=1.994	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=16.566 ASSIGNMENTS=157	UNSAT TT=17.745 ASSIGNMENTS=157	UNSAT TT=30.681 CHECKS=1811210 NODES=249	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=23.9 ASSIGNMENTS=0 CHECKS=28617	UNSAT TT=24.438 ASSIGNMENTS=0 CHECKS=28617	? (problem) TT=0.45	? (problem) TT=0.577	No data	UNSAT TT=14.794 ASSIGNMENTS=169 CHECKS=100956	UNSAT TT=122.36 ASSIGNMENTS=4369 CHECKS=1408090	UNSAT TT=136.821	UNSAT TT=486.704 ASSIGNMENTS=5748 CHECKS=4531650	UNSAT TT=7.873 ASSIGNMENTS=86 CHECKS=37881	UNSAT TT=247.085	No data	UNSAT TT=38.859	UNSAT TT=79.722
csp/fapp/fapp02/ normalized-fapp02-0250-3.xml	SAT TT=17.484	SAT TT=18.558 CHECKS=5487510 NODES=660	SAT TT=17.484 CHECKS=1608080 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=25.176 ASSIGNMENTS=660 CHECKS=5487510	SAT TT=25.57 ASSIGNMENTS=660 CHECKS=5487510	? (problem) TT=0.575	? (TO) TT=1800.01	No data	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=474.405	No data	SAT TT=341.373	SAT TT=220.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp02/ normalized-fapp02-0250-9.xml	SAT TT=13.973	SAT TT=17.875 CHECKS=1020020 NODES=252	SAT TT=19.367 CHECKS=3970030 NODES=252	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=15.183 ASSIGNMENTS=666	SAT TT=16.591 ASSIGNMENTS=666	SAT TT=33.716 CHECKS=6619340 NODES=1638	? (TO) TT=1800	SAT TT=30.103 CHECKS=48793800 NODES=8922	SAT TT=24.477 ASSIGNMENTS=252 CHECKS=1020020	SAT TT=25.014 ASSIGNMENTS=252 CHECKS=1020020	? (problem) TT=0.44	? (problem) TT=0.582	No data	SAT TT=42.657 ASSIGNMENTS=5513 CHECKS=1443140	SAT TT=217.393 ASSIGNMENTS=11874 CHECKS=3201240	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=13.973 ASSIGNMENTS=1335 CHECKS=233024	SAT TT=260.497	No data	SAT TT=403.726	SAT TT=156.903
csp/fapp/fapp03/ normalized-fapp03-0300-0.xml	UNSAT TT=1.197	UNSAT TT=22.338 CHECKS=16362 NODES=0	UNSAT TT=21.979 CHECKS=11673 NODES=0	UNSAT TT=1.197	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=15.438 ASSIGNMENTS=3	UNSAT TT=15.055 ASSIGNMENTS=3	UNSAT TT=56.661 CHECKS=1059530 NODES=47	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=31.826 ASSIGNMENTS=0 CHECKS=11673	UNSAT TT=31.821 ASSIGNMENTS=0 CHECKS=11673	? (problem) TT=0.595	? (problem) TT=0.479	No data	UNSAT TT=8.472 ASSIGNMENTS=23 CHECKS=33873	UNSAT TT=229.247 ASSIGNMENTS=3885 CHECKS=1940160	UNSAT TT=817.88	UNSAT TT=829.438 ASSIGNMENTS=6060 CHECKS=5641460	UNSAT TT=5.371 ASSIGNMENTS=27 CHECKS=10404	? TT=380.23	No data	UNSAT TT=51.131	UNSAT TT=135.899
csp/fapp/fapp03/ normalized-fapp03-0300-4.xml	UNSAT TT=11.852	UNSAT TT=22.239 CHECKS=45927 NODES=0	UNSAT TT=22.287 CHECKS=56387 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=11.852 ASSIGNMENTS=11	UNSAT TT=12.14 ASSIGNMENTS=11	UNSAT TT=50.136 CHECKS=839687 NODES=65	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=31.182 ASSIGNMENTS=0 CHECKS=41775	UNSAT TT=30.007 ASSIGNMENTS=0 CHECKS=41775	? (problem) TT=0.448	? (problem) TT=0.447	No data	UNSAT TT=80.313 ASSIGNMENTS=971 CHECKS=1150040	UNSAT TT=243.623 ASSIGNMENTS=4652 CHECKS=2271150	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=12.056 ASSIGNMENTS=138 CHECKS=69678	? TT=335.06	No data	UNSAT TT=52.068	UNSAT TT=128.538
csp/fapp/fapp03/ normalized-fapp03-0300-7.xml	SAT TT=27.393	SAT TT=27.393 CHECKS=27150600 NODES=2571	SAT TT=30.406 CHECKS=27304700 NODES=2494	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=111.536 ASSIGNMENTS=5276	SAT TT=110.592 ASSIGNMENTS=5276	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=35.432 ASSIGNMENTS=2475 CHECKS=26092700	SAT TT=35.326 ASSIGNMENTS=2475 CHECKS=26080000	? (problem) TT=0.596	? (TO) TT=1800.08	No data	SAT TT=363.381 ASSIGNMENTS=52421 CHECKS=21609700	SAT TT=329.065 ASSIGNMENTS=10171 CHECKS=4564700	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.06	? TT=744.49	No data	SAT TT=964.751	SAT TT=385.458
csp/fapp/fapp04/ normalized-fapp04-0300-0.xml	UNSAT TT=6.461	UNSAT TT=21.836 CHECKS=130470 NODES=0	UNSAT TT=21.945 CHECKS=136039 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=12.871 ASSIGNMENTS=13	UNSAT TT=12.866 ASSIGNMENTS=13	UNSAT TT=51.153 CHECKS=1743780 NODES=223	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=30.801 ASSIGNMENTS=0 CHECKS=114257	UNSAT TT=30.949 ASSIGNMENTS=0 CHECKS=114257	? (problem) TT=0.449	? (problem) TT=563.846	No data	UNSAT TT=7.907 ASSIGNMENTS=117 CHECKS=21951	UNSAT TT=202.067 ASSIGNMENTS=4576 CHECKS=1303920	? (TO) TT=1800.11	? (TO) TT=1800.06	UNSAT TT=6.461 ASSIGNMENTS=54 CHECKS=15256	? TT=972.788	No data	UNSAT TT=49.811	UNSAT TT=120.045
csp/fapp/fapp04/ normalized-fapp04-0300-5.xml	SAT TT=24.214	SAT TT=24.681 CHECKS=7018200 NODES=303	SAT TT=24.214 CHECKS=6630470 NODES=303	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	SAT TT=155.869 CHECKS=353973000 NODES=33652	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=32.051 ASSIGNMENTS=301 CHECKS=6292900	SAT TT=32.802 ASSIGNMENTS=301 CHECKS=6291610	? (problem) TT=0.449	? (problem) TT=0.45	No data	SAT TT=1231.85 ASSIGNMENTS=114597 CHECKS=24795100	SAT TT=1261.2 ASSIGNMENTS=53012 CHECKS=18772100	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=610.226 ASSIGNMENTS=37496 CHECKS=8916950	? TT=711.431	No data	SAT TT=1099.34	SAT TT=300.795
csp/fapp/fapp04/ normalized-fapp04-0300-6.xml	SAT TT=25.935	SAT TT=25.935 CHECKS=14061100 NODES=688	SAT TT=26.226 CHECKS=12592000 NODES=571	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.13	SAT TT=227.979 CHECKS=543836000 NODES=85583	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=33.1 ASSIGNMENTS=384 CHECKS=7942480	SAT TT=33.052 ASSIGNMENTS=384 CHECKS=7956210	? (problem) TT=0.574	? (problem) TT=0.453	No data	SAT TT=1684.01 ASSIGNMENTS=195372 CHECKS=34426900	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=335.873 ASSIGNMENTS=19743 CHECKS=4100000	? TT=555.881	No data	SAT TT=1282.26	SAT TT=319.265
csp/fapp/fapp05/ normalized-fapp05-0350-1.xml	UNSAT TT=22.35	UNSAT TT=22.533 CHECKS=317504 NODES=0	UNSAT TT=22.35 CHECKS=316272 NODES=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.22	UNSAT TT=107.749 CHECKS=109373000 NODES=9781	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=33.452 ASSIGNMENTS=0 CHECKS=295425	UNSAT TT=33.784 ASSIGNMENTS=0 CHECKS=295425	? (problem) TT=0.451	? (problem) TT=0.426	No data	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=60.562	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=682.429	No data	UNSAT TT=81.134	UNSAT TT=202.479
csp/fapp/fapp05/ normalized-fapp05-0350-5.xml	UNSAT TT=22.549	UNSAT TT=22.549 CHECKS=600118 NODES=0	UNSAT TT=22.79 CHECKS=623131 NODES=0	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.21	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=33.426 ASSIGNMENTS=0 CHECKS=578297	UNSAT TT=33.844 ASSIGNMENTS=0 CHECKS=599784	? (problem) TT=0.592	? (problem) TT=0.582	No data	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=53.71	? (TO) TT=1800.08	? (TO) TT=1800.02	? TT=341.936	No data	UNSAT TT=89.211	UNSAT TT=196.394
csp/fapp/fapp05/ normalized-fapp05-0350-6.xml	UNSAT TT=22.557	UNSAT TT=22.693 CHECKS=635661 NODES=0	UNSAT TT=22.557 CHECKS=614079 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=33.041 ASSIGNMENTS=0 CHECKS=593533	UNSAT TT=32.864 ASSIGNMENTS=0 CHECKS=614079	? (problem) TT=0.417	? (problem) TT=0.417	No data	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=52.152	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=361.521	No data	UNSAT TT=121.544	UNSAT TT=188.846
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp06/ normalized-fapp06-0500-0.xml	UNSAT TT=15.646	UNSAT TT=23.35 CHECKS=68156 NODES=0	UNSAT TT=23.322 CHECKS=68156 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=22.752 ASSIGNMENTS=47	UNSAT TT=22.765 ASSIGNMENTS=47	UNSAT TT=108.225 CHECKS=2546970 NODES=185	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=37.967 ASSIGNMENTS=0 CHECKS=68156	UNSAT TT=38.232 ASSIGNMENTS=0 CHECKS=68156	? (problem) TT=0.448	? (problem) TT=0.594	No data	UNSAT TT=53.138 ASSIGNMENTS=314 CHECKS=366433	UNSAT TT=374.933 ASSIGNMENTS=4827 CHECKS=2086840	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=15.646 ASSIGNMENTS=32 CHECKS=26024	? TT=411.282	No data	UNSAT TT=99.112	UNSAT TT=249.105
csp/fapp/fapp06/ normalized-fapp06-0500-4.xml	UNSAT TT=23.433	UNSAT TT=23.654 CHECKS=499244 NODES=0	UNSAT TT=23.433 CHECKS=492091 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.14	UNSAT TT=104.4 CHECKS=7144040 NODES=1644	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=35.828 ASSIGNMENTS=0 CHECKS=491742	UNSAT TT=36.06 ASSIGNMENTS=0 CHECKS=491742	? (problem) TT=0.448	? (problem) TT=0.586	No data	UNSAT TT=382.551 ASSIGNMENTS=30706 CHECKS=2600560	UNSAT TT=740.305 ASSIGNMENTS=33848 CHECKS=5772890	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=53.323 ASSIGNMENTS=1834 CHECKS=274363	? TT=426.333	No data	UNSAT TT=102.18	UNSAT TT=251.959
csp/fapp/fapp06/ normalized-fapp06-0500-9.xml	SAT TT=32.804	SAT TT=33.79 CHECKS=24646300 NODES=892	SAT TT=32.804 CHECKS=24645600 NODES=890	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.19	SAT TT=289.119 CHECKS=343325000 NODES=38162	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=45.115 ASSIGNMENTS=1174 CHECKS=27142700	SAT TT=47.136 ASSIGNMENTS=1727 CHECKS=33099500	? (problem) TT=0.481	? (problem) TT=0.595	No data	SAT TT=509.265 ASSIGNMENTS=35955 CHECKS=6778100	SAT TT=557.666 ASSIGNMENTS=15353 CHECKS=4523690	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.06	? TT=1592.48	No data	? (MO) TT=99.772	SAT TT=809.405
csp/fapp/fapp07/ normalized-fapp07-0600-6.xml	UNSAT TT=17.54	UNSAT TT=25.06 CHECKS=741026 NODES=0	UNSAT TT=25.553 CHECKS=748825 NODES=0	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=24.679 ASSIGNMENTS=99	UNSAT TT=24.716 ASSIGNMENTS=99	UNSAT TT=130.667 CHECKS=8361780 NODES=863	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=36.518 ASSIGNMENTS=0 CHECKS=737757	UNSAT TT=37.834 ASSIGNMENTS=0 CHECKS=737415	? (problem) TT=0.577	? (problem) TT=0.582	No data	UNSAT TT=28.124 ASSIGNMENTS=270 CHECKS=90835	UNSAT TT=399.943 ASSIGNMENTS=5979 CHECKS=3486390	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=17.54 ASSIGNMENTS=181 CHECKS=55218	? TT=355.284	No data	? (MO) TT=102.38	UNSAT TT=272.64
csp/fapp/fapp07/ normalized-fapp07-0600-7.xml	UNSAT TT=15.721	UNSAT TT=25.471 CHECKS=698967 NODES=0	UNSAT TT=25.135 CHECKS=696525 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=31.606 ASSIGNMENTS=151	UNSAT TT=32.742 ASSIGNMENTS=151	UNSAT TT=136.277 CHECKS=9689550 NODES=816	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=36.86 ASSIGNMENTS=0 CHECKS=691651	UNSAT TT=38.221 ASSIGNMENTS=0 CHECKS=705735	? (problem) TT=0.43	? (problem) TT=0.441	No data	UNSAT TT=30.296 ASSIGNMENTS=402 CHECKS=110474	UNSAT TT=436.946 ASSIGNMENTS=6170 CHECKS=3611270	? (TO) TT=1800.01	? (TO) TT=1800.11	UNSAT TT=15.721 ASSIGNMENTS=294 CHECKS=54575	? TT=332.67	No data	? (MO) TT=104.1	UNSAT TT=283.226
csp/fapp/fapp07/ normalized-fapp07-0600-8.xml	UNSAT TT=22.167	UNSAT TT=24.924 CHECKS=656562 NODES=0	UNSAT TT=25.294 CHECKS=657079 NODES=0	UNSAT TT=204.229	? (TO) TT=1800.14	? (TO) TT=1800.1	UNSAT TT=30.607 ASSIGNMENTS=159	UNSAT TT=28.805 ASSIGNMENTS=159	UNSAT TT=122.792 CHECKS=2948410 NODES=1378	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=36.212 ASSIGNMENTS=0 CHECKS=651455	UNSAT TT=36.292 ASSIGNMENTS=0 CHECKS=656381	? (problem) TT=0.426	? (problem) TT=0.762	No data	UNSAT TT=32.833 ASSIGNMENTS=543 CHECKS=128330	UNSAT TT=496.402 ASSIGNMENTS=12047 CHECKS=4689790	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=22.167 ASSIGNMENTS=342 CHECKS=81711	? TT=312.55	No data	? (MO) TT=102.23	UNSAT TT=273.56
csp/fapp/fapp08/ normalized-fapp08-0700-0.xml	UNSAT TT=17.553	UNSAT TT=24.495 CHECKS=29426 NODES=0	UNSAT TT=24.189 CHECKS=29478 NODES=0	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=596.502 CHECKS=3300580	UNSAT TT=19.691 ASSIGNMENTS=9	UNSAT TT=19.638 ASSIGNMENTS=9	UNSAT TT=113.178 CHECKS=11002700 NODES=2723	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=38.89 ASSIGNMENTS=0 CHECKS=29478	UNSAT TT=38.591 ASSIGNMENTS=0 CHECKS=29478	? (problem) TT=0.437	? (problem) TT=0.664	No data	UNSAT TT=71.447 ASSIGNMENTS=1142 CHECKS=275001	UNSAT TT=302.917 ASSIGNMENTS=5728 CHECKS=1677000	? (TO) TT=1800.09	? (TO) TT=1800.12	UNSAT TT=17.553 ASSIGNMENTS=132 CHECKS=44225	? TT=1325.6	No data	UNSAT TT=100.996	UNSAT TT=229.632
csp/fapp/fapp08/ normalized-fapp08-0700-10.xml	SAT TT=23.692	SAT TT=32.441 CHECKS=20025900 NODES=703	SAT TT=32.484 CHECKS=20025000 NODES=703	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=372.206 ASSIGNMENTS=27703	SAT TT=383.751 ASSIGNMENTS=27703	SAT TT=125.081 CHECKS=46338500 NODES=7813	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=42.518 ASSIGNMENTS=703 CHECKS=19766800	SAT TT=41.478 ASSIGNMENTS=700 CHECKS=18990500	? (problem) TT=0.439	? (problem) TT=0.453	No data	SAT TT=23.692 ASSIGNMENTS=1604 CHECKS=196576	SAT TT=490.187 ASSIGNMENTS=19704 CHECKS=4094470	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=70.675 ASSIGNMENTS=5427 CHECKS=696634	? TT=792.959	No data	? (MO) TT=103.752	SAT TT=760.074
csp/fapp/fapp08/ normalized-fapp08-0700-4.xml	UNSAT TT=24.203	UNSAT TT=24.203 CHECKS=588429 NODES=0	UNSAT TT=24.272 CHECKS=588429 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.2	? (TO) TT=1800.13	UNSAT TT=100.83 CHECKS=6031720 NODES=2625	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=37.012 ASSIGNMENTS=0 CHECKS=588429	UNSAT TT=35.402 ASSIGNMENTS=0 CHECKS=578287	? (problem) TT=0.464	? (problem) TT=0.469	No data	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.1	UNSAT TT=959.946 ASSIGNMENTS=142742 CHECKS=7471780	? TT=789.127	No data	UNSAT TT=95.394	UNSAT TT=230.149
csp/fapp/fapp09/ normalized-fapp09-0800-0.xml	UNSAT TT=17.343	UNSAT TT=26.583 CHECKS=190575 NODES=0	UNSAT TT=25.775 CHECKS=185955 NODES=0	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=554.413 ASSIGNMENTS=12976	UNSAT TT=556.74 ASSIGNMENTS=12976	UNSAT TT=120.03 CHECKS=4552890 NODES=548	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=39.85 ASSIGNMENTS=0 CHECKS=184450	UNSAT TT=41.474 ASSIGNMENTS=0 CHECKS=186519	? (problem) TT=0.427	? (problem) TT=1195.52	No data	UNSAT TT=23.406 ASSIGNMENTS=438 CHECKS=104475	UNSAT TT=651.388 ASSIGNMENTS=20150 CHECKS=6178930	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=17.343 ASSIGNMENTS=301 CHECKS=62649	? TT=450.694	No data	UNSAT TT=83.881	UNSAT TT=177.812
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp09/ normalized-fapp09-0800-4.xml	SAT TT=32.3	SAT TT=39.155 CHECKS=18880800 NODES=2522	SAT TT=32.3 CHECKS=10874800 NODES=812	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.19	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=48.938 ASSIGNMENTS=1859 CHECKS=15146600	SAT TT=42.654 ASSIGNMENTS=812 CHECKS=10874000	? (problem) TT=0.445	? (problem) TT=0.589	No data	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	? TT=1064.49	No data	? (TO) TT=1800.19	SAT TT=792.038
csp/fapp/fapp09/ normalized-fapp09-0800-8.xml	SAT TT=13.936	SAT TT=31.464 CHECKS=12277900 NODES=801	SAT TT=31.45 CHECKS=12300700 NODES=801	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.18	SAT TT=167.178 CHECKS=64794500 NODES=12009	? (TO) TT=1800.07	SAT TT=78.316 CHECKS=21014000 NODES=1674	SAT TT=41.465 ASSIGNMENTS=802 CHECKS=12157700	SAT TT=42.804 ASSIGNMENTS=801 CHECKS=12220200	? (problem) TT=0.435	? (problem) TT=0.567	No data	SAT TT=15.64 ASSIGNMENTS=752 CHECKS=101234	SAT TT=364.242 ASSIGNMENTS=11623 CHECKS=2938500	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=13.936 ASSIGNMENTS=963 CHECKS=109366	? TT=397.012	No data	? (TO) TT=1800.15	SAT TT=586.213
csp/fapp/fapp10/ normalized-fapp10-0900-0.xml	UNSAT TT=3.304	UNSAT TT=26.735 CHECKS=294809 NODES=0	UNSAT TT=26.627 CHECKS=294809 NODES=0	UNSAT TT=3.304	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=150.167 ASSIGNMENTS=651	UNSAT TT=149.17 ASSIGNMENTS=651	UNSAT TT=152.839 CHECKS=32144200 NODES=440	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=52.773 ASSIGNMENTS=0 CHECKS=293330	UNSAT TT=51.171 ASSIGNMENTS=0 CHECKS=256410	? (problem) TT=0.439	? (problem) TT=0.451	No data	UNSAT TT=177.557 ASSIGNMENTS=2088 CHECKS=491684	UNSAT TT=592.054 ASSIGNMENTS=5422 CHECKS=2627870	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=29.405 ASSIGNMENTS=389 CHECKS=54642	? TT=433.024	No data	? (MO) TT=150.14	? (MO) TT=310.886
csp/fapp/fapp10/ normalized-fapp10-0900-10.xml	SAT TT=52.5	SAT TT=53.307 CHECKS=60265700 NODES=1904	SAT TT=52.5 CHECKS=59856800 NODES=1904	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.23	? (TO) TT=1800.19	SAT TT=477.382 CHECKS=485069000 NODES=26005	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=58.673 ASSIGNMENTS=905 CHECKS=45853600	SAT TT=58.811 ASSIGNMENTS=905 CHECKS=45848900	? (problem) TT=0.44	? (problem) TT=0.442	No data	SAT TT=181.421 ASSIGNMENTS=12056 CHECKS=5200560	SAT TT=722.269 ASSIGNMENTS=10349 CHECKS=4836620	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=102.871 ASSIGNMENTS=4669 CHECKS=919358	? TT=683.331	No data	? (MO) TT=153.11	? (MO) TT=339.84
csp/fapp/fapp10/ normalized-fapp10-0900-9.xml	SAT TT=55.309	SAT TT=67.679 CHECKS=81188700 NODES=3513	SAT TT=55.309 CHECKS=60989000 NODES=2141	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.14	SAT TT=559.3 CHECKS=572095000 NODES=40805	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=66.599 ASSIGNMENTS=1872 CHECKS=59243300	SAT TT=66.925 ASSIGNMENTS=1872 CHECKS=59243300	? (problem) TT=0.446	? (problem) TT=0.647	No data	SAT TT=152.956 ASSIGNMENTS=5165 CHECKS=2201010	SAT TT=1690.6 ASSIGNMENTS=128532 CHECKS=13676100	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=127.789 ASSIGNMENTS=7094 CHECKS=1087640	? TT=350.002	No data	? (MO) TT=143.192	? (MO) TT=314.53
csp/fapp/fapp11/ normalized-fapp11-1000-1.xml	UNSAT TT=27.31	UNSAT TT=27.31 CHECKS=1849040 NODES=0	UNSAT TT=28.086 CHECKS=1849560 NODES=0	UNSAT TT=73.245	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.17	UNSAT TT=166.361 CHECKS=51643400 NODES=40	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=62.724 ASSIGNMENTS=0 CHECKS=1848430	UNSAT TT=61.75 ASSIGNMENTS=0 CHECKS=1848430	? (problem) TT=0.465	? (problem) TT=0.617	No data	UNSAT TT=972.802 ASSIGNMENTS=3080 CHECKS=2271950	UNSAT TT=673.593 ASSIGNMENTS=3412 CHECKS=2628560	UNSAT TT=1307.2	? (TO) TT=1800.1	UNSAT TT=400.487 ASSIGNMENTS=1603 CHECKS=985145	? TT=419.901	No data	? (MO) TT=241.249	? (MO) TT=403.283
csp/fapp/fapp11/ normalized-fapp11-1000-3.xml	UNSAT TT=27.02	UNSAT TT=27.02 CHECKS=1575160 NODES=0	UNSAT TT=27.57 CHECKS=1575160 NODES=0	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=335.728 ASSIGNMENTS=2471	UNSAT TT=326.354 ASSIGNMENTS=2471	UNSAT TT=170.873 CHECKS=62435200 NODES=193	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=59.565 ASSIGNMENTS=0 CHECKS=1575160	UNSAT TT=57.745 ASSIGNMENTS=0 CHECKS=1574610	? (problem) TT=0.477	? (problem) TT=0.478	No data	UNSAT TT=1074.92 ASSIGNMENTS=11869 CHECKS=4164580	UNSAT TT=713.418 ASSIGNMENTS=6147 CHECKS=2932610	UNSAT TT=1519.42	? (TO) TT=1800.06	UNSAT TT=172.649 ASSIGNMENTS=1228 CHECKS=580159	? TT=582.376	No data	? (MO) TT=252.804	? (MO) TT=398.339
csp/fapp/fapp11/ normalized-fapp11-1000-6.xml	UNSAT TT=27.246	UNSAT TT=27.955 CHECKS=1405800 NODES=0	UNSAT TT=27.246 CHECKS=1405800 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.23	? (TO) TT=1800.22	UNSAT TT=176.255 CHECKS=59339800 NODES=165	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=57.188 ASSIGNMENTS=0 CHECKS=1405100	UNSAT TT=57.511 ASSIGNMENTS=0 CHECKS=1405100	? (problem) TT=0.443	? (problem) TT=0.478	No data	UNSAT TT=278.058 ASSIGNMENTS=7753 CHECKS=989157	? (TO) TT=1800.06	UNSAT TT=1211.06	? (TO) TT=1800.03	UNSAT TT=82.321 ASSIGNMENTS=1322 CHECKS=224872	? TT=381.496	No data	? (MO) TT=239.755	? (MO) TT=404.74
csp/fapp/fapp12/ normalized-fapp12-1500-0.xml	UNSAT TT=29.357	UNSAT TT=30.203 CHECKS=874658 NODES=0	UNSAT TT=29.357 CHECKS=874658 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.24	UNSAT TT=231.914 CHECKS=16679400 NODES=0	UNSAT TT=240.434 CHECKS=17651900 NODES=0	UNSAT TT=278.989 CHECKS=17655400 NODES=0	UNSAT TT=85.645 ASSIGNMENTS=0 CHECKS=874658	UNSAT TT=90.468 ASSIGNMENTS=0 CHECKS=874658	? (problem) TT=0.44	? (problem) TT=0.58	No data	UNSAT TT=64.884 ASSIGNMENTS=12 CHECKS=37670	UNSAT TT=605.386 ASSIGNMENTS=1774 CHECKS=2147160	UNSAT TT=1779.97	? (TO) TT=1800.08	UNSAT TT=65.95 ASSIGNMENTS=12 CHECKS=37631	? TT=709.369	No data	? TT=392.266	? TT=417.99
csp/fapp/fapp12/ normalized-fapp12-1500-10.xml	SAT TT=1072.47	SAT TT=1072.47 CHECKS=2710230000 NODES=16896	SAT TT=1157.62 CHECKS=2712340000 NODES=16896	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.22	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=1259.39 ASSIGNMENTS=18052 CHECKS=3099210000	SAT TT=1275.33 ASSIGNMENTS=18799 CHECKS=3106840000	? (problem) TT=0.594	? (problem) TT=0.574	No data	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=543.885	No data	? TT=422.086	? TT=419.488
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp12/ normalized-fapp12-1500-9.xml	SAT TT=203.296	SAT TT=285.524 CHECKS=561995000 NODES=9933	SAT TT=267.255 CHECKS=561970000 NODES=9933	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.2	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=317.161 ASSIGNMENTS=12620 CHECKS=576084000	SAT TT=312.075 ASSIGNMENTS=12620 CHECKS=576079000	? (problem) TT=0.454	? (problem) TT=0.445	No data	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.07	? TT=733.303	No data	? TT=422.452	? TT=420.96
csp/fapp/fapp13/ normalized-fapp13-2000-4.xml		? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.23	? (TO) TT=1800.18	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (problem) TT=0.474	? (problem) TT=0.6	No data	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=310.908	No data	? TT=366.346	? TT=378.384
csp/fapp/fapp13/ normalized-fapp13-2000-6.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1831.68	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.24	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.01	? (problem) TT=0.468	? (problem) TT=0.422	No data	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=1239.51	No data	? TT=368.87	? TT=376.978
csp/fapp/fapp13/ normalized-fapp13-2000-9.xml	SAT TT=53.788	SAT TT=59.144 CHECKS=61518000 NODES=3329	SAT TT=53.788 CHECKS=48414900 NODES=2020	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.23	? (TO) TT=1800.06	? (TO) TT=1775.88	? (TO) TT=1800.02	SAT TT=75.251 ASSIGNMENTS=3331 CHECKS=61480900	SAT TT=65.478 ASSIGNMENTS=2024 CHECKS=47763000	? (problem) TT=0.436	? (problem) TT=0.762	No data	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=1213.35	No data	? TT=362.158	? TT=381.569
csp/fapp/fapp14/ normalized-fapp14-2500-0.xml	UNSAT TT=35.704	UNSAT TT=36.02 CHECKS=404591 NODES=0	UNSAT TT=35.704 CHECKS=404591 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.22	UNSAT TT=395.794 CHECKS=606433 NODES=0	UNSAT TT=519.522 CHECKS=1637490 NODES=0	UNSAT TT=484.704 CHECKS=1560980 NODES=0	UNSAT TT=139.001 ASSIGNMENTS=0 CHECKS=395664	UNSAT TT=142.868 ASSIGNMENTS=0 CHECKS=404591	? (problem) TT=0.419	? (problem) TT=0.413	No data	UNSAT TT=326.024 ASSIGNMENTS=598 CHECKS=421741	UNSAT TT=711.483 ASSIGNMENTS=1682 CHECKS=1890210	UNSAT TT=43.461	? (TO) TT=1800.08	UNSAT TT=210.401 ASSIGNMENTS=335 CHECKS=208866	? TT=420.712	No data	? TT=527.789	? TT=528.564
csp/fapp/fapp14/ normalized-fapp14-2500-2.xml	UNSAT TT=36.864	UNSAT TT=36.864 CHECKS=2491180 NODES=0	UNSAT TT=37.132 CHECKS=2491180 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.18	? (TO) TT=1800.23	UNSAT TT=412.396 CHECKS=9720230 NODES=0	UNSAT TT=490.118 CHECKS=10197700 NODES=0	UNSAT TT=508.549 CHECKS=10193900 NODES=0	UNSAT TT=123.261 ASSIGNMENTS=0 CHECKS=2482640	UNSAT TT=117.641 ASSIGNMENTS=0 CHECKS=2491180	? (problem) TT=0.457	? (problem) TT=0.582	No data	? (TO) TT=1800.03	UNSAT TT=692.919 ASSIGNMENTS=2523 CHECKS=1881240	UNSAT TT=50.14	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=396.977	No data	? TT=550.442	? TT=489.221
csp/fapp/fapp14/ normalized-fapp14-2500-9.xml	SAT TT=415.716	SAT TT=511.534 CHECKS=1141320000 NODES=22541	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.22	? (TO) TT=1800.24	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=1010.77 ASSIGNMENTS=47660 CHECKS=1953880000	SAT TT=415.716 ASSIGNMENTS=14255 CHECKS=721391000	? (problem) TT=0.453	? (problem) TT=0.45	No data	? (TO) TT=1800.02	? (TO) TT=1800.08	Wrong UNSAT TT=47.336	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=372.957	No data	? TT=503.614	? TT=493.271
csp/fapp/fapp15/ normalized-fapp15-3000-0.xml	UNSAT TT=30.699	UNSAT TT=31.476 CHECKS=213034 NODES=0	UNSAT TT=30.699 CHECKS=212940 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.04	UNSAT TT=48.158 ASSIGNMENTS=1008	UNSAT TT=51.503 ASSIGNMENTS=1008	UNSAT TT=320.189 CHECKS=12299900 NODES=179	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=66.712 ASSIGNMENTS=0 CHECKS=212940	UNSAT TT=68.555 ASSIGNMENTS=0 CHECKS=212940	? (problem) TT=0.442	? (problem) TT=0.446	No data	UNSAT TT=31.577 ASSIGNMENTS=8 CHECKS=66823	UNSAT TT=608.69 ASSIGNMENTS=6569 CHECKS=4567700	UNSAT TT=34.071	? (TO) TT=1800.14	UNSAT TT=36.603 ASSIGNMENTS=8 CHECKS=66823	? TT=309.894	No data	? TT=346.959	? TT=335.57
csp/fapp/fapp15/ normalized-fapp15-3000-2.xml	UNSAT TT=31.212	UNSAT TT=31.212 CHECKS=1107370 NODES=0	UNSAT TT=31.309 CHECKS=1107370 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=85.662 ASSIGNMENTS=2612	UNSAT TT=85.119 ASSIGNMENTS=2612	UNSAT TT=441.841 CHECKS=22740100 NODES=3343	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=57.954 ASSIGNMENTS=0 CHECKS=1107370	UNSAT TT=56.087 ASSIGNMENTS=0 CHECKS=1107370	? (problem) TT=0.576	? (problem) TT=0.576	No data	UNSAT TT=454.018 ASSIGNMENTS=10523 CHECKS=2428640	UNSAT TT=889.156 ASSIGNMENTS=22811 CHECKS=7818960	UNSAT TT=33.958	? (TO) TT=1800.07	UNSAT TT=712.028 ASSIGNMENTS=12845 CHECKS=3537120	? TT=1214.88	No data	? TT=572.235	? TT=333.034
csp/fapp/fapp15/ normalized-fapp15-3000-8.xml	SAT TT=68.918	SAT TT=181.505 CHECKS=322191000 NODES=10241	SAT TT=68.918 CHECKS=88376000 NODES=3497	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.21	? (TO) TT=1800.21	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=91.724 ASSIGNMENTS=3497 CHECKS=88172100	SAT TT=93.619 ASSIGNMENTS=3497 CHECKS=88237200	? (problem) TT=0.569	? (problem) TT=0.428	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	Wrong UNSAT TT=34.22	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=1404.61	No data	? TT=347.811	? TT=361.929
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp16/ normalized-fapp16-0260-10.xml	UNSAT TT=1.069	UNSAT TT=21.563 CHECKS=51072 NODES=0	UNSAT TT=21.594 CHECKS=51072 NODES=0	UNSAT TT=1.069	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=15.949 ASSIGNMENTS=65	UNSAT TT=15.837 ASSIGNMENTS=65	UNSAT TT=55.52 CHECKS=2165850 NODES=59	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=32.488 ASSIGNMENTS=0 CHECKS=47493	UNSAT TT=32.58 ASSIGNMENTS=0 CHECKS=47493	? (problem) TT=0.587	? (problem) TT=0.576	No data	UNSAT TT=11.632 ASSIGNMENTS=99 CHECKS=93134	UNSAT TT=114.758 ASSIGNMENTS=3962 CHECKS=1359710	? (TO) TT=1800.09	UNSAT TT=1241.66 ASSIGNMENTS=10476 CHECKS=5170210	UNSAT TT=14.349 ASSIGNMENTS=384 CHECKS=119497	? TT=422.768	No data	UNSAT TT=41.63	UNSAT TT=93.829
csp/fapp/fapp16/ normalized-fapp16-0260-7.xml	UNSAT TT=1.006	UNSAT TT=21.359 CHECKS=49074 NODES=0	UNSAT TT=21.528 CHECKS=50858 NODES=0	UNSAT TT=1.006	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=14.998 ASSIGNMENTS=69	UNSAT TT=16.024 ASSIGNMENTS=69	UNSAT TT=54.658 CHECKS=2355760 NODES=69	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=33.038 ASSIGNMENTS=0 CHECKS=50849	UNSAT TT=33.117 ASSIGNMENTS=0 CHECKS=49074	? (problem) TT=0.584	? (problem) TT=0.59	No data	UNSAT TT=23.197 ASSIGNMENTS=470 CHECKS=326090	UNSAT TT=123.051 ASSIGNMENTS=4071 CHECKS=1365400	? (TO) TT=1800.05	UNSAT TT=1097.03 ASSIGNMENTS=9960 CHECKS=4920140	UNSAT TT=12.284 ASSIGNMENTS=176 CHECKS=90470	? TT=404.459	No data	UNSAT TT=42.087	UNSAT TT=92.441
csp/fapp/fapp16/ normalized-fapp16-0260-8.xml	UNSAT TT=1.081	UNSAT TT=21.559 CHECKS=53030 NODES=0	UNSAT TT=21.701 CHECKS=53636 NODES=0	UNSAT TT=1.081	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=15.848 ASSIGNMENTS=65	UNSAT TT=14.684 ASSIGNMENTS=65	UNSAT TT=53.528 CHECKS=2358290 NODES=69	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=32.279 ASSIGNMENTS=0 CHECKS=49070	UNSAT TT=33.866 ASSIGNMENTS=0 CHECKS=49067	? (problem) TT=0.415	? (problem) TT=0.463	No data	UNSAT TT=20.728 ASSIGNMENTS=352 CHECKS=274473	UNSAT TT=139.603 ASSIGNMENTS=3972 CHECKS=1572330	? (TO) TT=1800.07	UNSAT TT=1092.67 ASSIGNMENTS=9960 CHECKS=4947720	UNSAT TT=10.399 ASSIGNMENTS=96 CHECKS=76869	? (TO) TT=1802.2	No data	UNSAT TT=43.937	UNSAT TT=82.112
csp/fapp/fapp17/ normalized-fapp17-0300-0.xml	UNSAT TT=1.011	UNSAT TT=20.755 CHECKS=91335 NODES=0	UNSAT TT=20.838 CHECKS=91335 NODES=0	UNSAT TT=1.011	? (TO) TT=1800.12	? (TO) TT=1800.03	UNSAT TT=21.103 ASSIGNMENTS=95	UNSAT TT=19.571 ASSIGNMENTS=95	UNSAT TT=59.031 CHECKS=4995480 NODES=398	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=31.769 ASSIGNMENTS=0 CHECKS=91335	UNSAT TT=31.654 ASSIGNMENTS=0 CHECKS=91335	? (problem) TT=0.423	? (problem) TT=0.439	No data	UNSAT TT=12.363 ASSIGNMENTS=77 CHECKS=23445	UNSAT TT=183.765 ASSIGNMENTS=4732 CHECKS=1105530	UNSAT TT=898.862	? (TO) TT=1800.04	UNSAT TT=24.167 ASSIGNMENTS=338 CHECKS=94211	? TT=419.923	No data	UNSAT TT=58.927	UNSAT TT=142.304
csp/fapp/fapp17/ normalized-fapp17-0300-1.xml	UNSAT TT=1.013	UNSAT TT=19.249 CHECKS=91331 NODES=0	UNSAT TT=20.811 CHECKS=91331 NODES=0	UNSAT TT=1.013	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=21.398 ASSIGNMENTS=95	UNSAT TT=19.652 ASSIGNMENTS=95	UNSAT TT=57.554 CHECKS=4994020 NODES=398	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=32.007 ASSIGNMENTS=0 CHECKS=91331	UNSAT TT=34.141 ASSIGNMENTS=0 CHECKS=91331	? (problem) TT=0.455	? (problem) TT=0.456	No data	UNSAT TT=12.145 ASSIGNMENTS=77 CHECKS=23445	UNSAT TT=160.65 ASSIGNMENTS=4547 CHECKS=1040410	UNSAT TT=917.655	? (TO) TT=1800.1	UNSAT TT=23.858 ASSIGNMENTS=338 CHECKS=94211	? TT=920.708	No data	UNSAT TT=55.407	UNSAT TT=143.989
csp/fapp/fapp17/ normalized-fapp17-0300-4.xml	SAT TT=1.134	SAT TT=22.126 CHECKS=302678 NODES=300	SAT TT=21.971 CHECKS=305981 NODES=300	SAT TT=1.134	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=18.151 ASSIGNMENTS=272	SAT TT=16.797 ASSIGNMENTS=272	SAT TT=68.009 CHECKS=16731500 NODES=1799	SAT TT=35.236 CHECKS=15266600 NODES=1357	SAT TT=38.107 CHECKS=10937800 NODES=583	SAT TT=34.539 ASSIGNMENTS=300 CHECKS=315911	SAT TT=34.927 ASSIGNMENTS=300 CHECKS=315956	? (problem) TT=0.405	? (problem) TT=0.555	No data	SAT TT=12.661 ASSIGNMENTS=286 CHECKS=38159	SAT TT=171.907 ASSIGNMENTS=4747 CHECKS=1035010	Wrong UNSAT TT=853.934	? (TO) TT=1800.07	SAT TT=10.313 ASSIGNMENTS=271 CHECKS=31361	? TT=461.054	No data	SAT TT=167.822	SAT TT=204.387
csp/fapp/fapp18/ normalized-fapp18-0350-4.xml	UNSAT TT=0.973	UNSAT TT=21.283 CHECKS=65039 NODES=0	UNSAT TT=21.308 CHECKS=65039 NODES=0	UNSAT TT=0.973	UNSAT TT=38.737 CHECKS=9957	UNSAT TT=0.373 CHECKS=9957	UNSAT TT=11.97 ASSIGNMENTS=0	UNSAT TT=12.87 ASSIGNMENTS=0	UNSAT TT=58.963 CHECKS=259247 NODES=0	UNSAT TT=30.011 CHECKS=679649 NODES=0	UNSAT TT=27.881 CHECKS=679649 NODES=0	UNSAT TT=6.408 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=6.556 ASSIGNMENTS=0 CHECKS=6154	? (problem) TT=0.455	? (problem) TT=0.421	No data	UNSAT TT=7.062 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=6.194 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=22.812	UNSAT TT=6.421 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=6.244 ASSIGNMENTS=0 CHECKS=6154	? TT=411.35	No data	UNSAT TT=56.572	UNSAT TT=140.927
csp/fapp/fapp18/ normalized-fapp18-0350-5.xml	UNSAT TT=0.988	UNSAT TT=21.48 CHECKS=63301 NODES=0	UNSAT TT=21.488 CHECKS=63150 NODES=0	UNSAT TT=0.988	UNSAT TT=39.185 CHECKS=9957	UNSAT TT=0.369 CHECKS=9957	UNSAT TT=13.172 ASSIGNMENTS=0	UNSAT TT=13.502 ASSIGNMENTS=0	UNSAT TT=55.159 CHECKS=259245 NODES=0	UNSAT TT=30.882 CHECKS=679643 NODES=0	UNSAT TT=31.433 CHECKS=679643 NODES=0	UNSAT TT=5.966 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=6.34 ASSIGNMENTS=0 CHECKS=6154	? (problem) TT=0.585	? (problem) TT=0.581	No data	UNSAT TT=6.363 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=6.133 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=23.456	UNSAT TT=6.597 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=5.691 ASSIGNMENTS=0 CHECKS=6154	? TT=470.907	No data	UNSAT TT=55.806	UNSAT TT=140.446
csp/fapp/fapp18/ normalized-fapp18-0350-6.xml	UNSAT TT=0.971	UNSAT TT=21.418 CHECKS=134009 NODES=0	UNSAT TT=21.594 CHECKS=132621 NODES=0	UNSAT TT=0.971	UNSAT TT=36.352 CHECKS=10711	UNSAT TT=0.343 CHECKS=10711	UNSAT TT=12.978 ASSIGNMENTS=0	UNSAT TT=13.065 ASSIGNMENTS=0	UNSAT TT=58.935 CHECKS=683027 NODES=0	UNSAT TT=29.804 CHECKS=1075860 NODES=0	UNSAT TT=29.589 CHECKS=1075860 NODES=0	UNSAT TT=6.256 ASSIGNMENTS=0 CHECKS=6137	UNSAT TT=6.273 ASSIGNMENTS=0 CHECKS=6137	? (problem) TT=0.581	? (problem) TT=0.585	No data	UNSAT TT=5.668 ASSIGNMENTS=0 CHECKS=6137	UNSAT TT=6.991 ASSIGNMENTS=0 CHECKS=6137	UNSAT TT=23.185	UNSAT TT=6.193 ASSIGNMENTS=0 CHECKS=6137	UNSAT TT=6.413 ASSIGNMENTS=0 CHECKS=6137	? TT=1383.54	No data	UNSAT TT=64.856	UNSAT TT=145.995
csp/fapp/fapp19/ normalized-fapp19-0350-2.xml	UNSAT TT=1.689	UNSAT TT=22.885 CHECKS=248605 NODES=0	UNSAT TT=23.244 CHECKS=248605 NODES=0	UNSAT TT=1.689	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=108.259 ASSIGNMENTS=583	UNSAT TT=106.51 ASSIGNMENTS=583	UNSAT TT=128.879 CHECKS=795836 NODES=0	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=97.596 ASSIGNMENTS=0 CHECKS=152696	UNSAT TT=95.646 ASSIGNMENTS=0 CHECKS=254715	? (problem) TT=0.441	? (problem) TT=0.438	No data	UNSAT TT=324.262 ASSIGNMENTS=4437 CHECKS=707543	UNSAT TT=684.497 ASSIGNMENTS=1893 CHECKS=869014	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=222.408 ASSIGNMENTS=549 CHECKS=274864	? TT=0.954	No data	? (MO) TT=197.15	? (MO) TT=386.272
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp19/ normalized-fapp19-0350-3.xml	UNSAT TT=1.862	UNSAT TT=23.073 CHECKS=293799 NODES=0	UNSAT TT=23.18 CHECKS=293799 NODES=0	UNSAT TT=1.862	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=279.07 ASSIGNMENTS=2633	UNSAT TT=280.456 ASSIGNMENTS=2633	UNSAT TT=128.579 CHECKS=1096120 NODES=0	UNSAT TT=243.057 CHECKS=1606350 NODES=0	UNSAT TT=247.093 CHECKS=1606350 NODES=0	UNSAT TT=87.679 ASSIGNMENTS=0 CHECKS=188151	UNSAT TT=94.098 ASSIGNMENTS=0 CHECKS=188151	? (problem) TT=0.424	? (problem) TT=0.605	No data	UNSAT TT=286.537 ASSIGNMENTS=839 CHECKS=621954	UNSAT TT=1302.46 ASSIGNMENTS=5329 CHECKS=2748710	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=222.171 ASSIGNMENTS=547 CHECKS=351327	? TT=0.935	No data	? (MO) TT=212.96	? (MO) TT=381.058
csp/fapp/fapp19/ normalized-fapp19-0350-5.xml	UNSAT TT=1.728	UNSAT TT=23.213 CHECKS=386572 NODES=0	UNSAT TT=23.148 CHECKS=386572 NODES=0	UNSAT TT=1.728	? (TO) TT=1800.12	? (TO) TT=1800.1	UNSAT TT=94.51 ASSIGNMENTS=298	UNSAT TT=94.861 ASSIGNMENTS=298	UNSAT TT=150.343 CHECKS=73714100 NODES=252	UNSAT TT=241.099 CHECKS=4041050 NODES=0	UNSAT TT=244.381 CHECKS=4041050 NODES=0	UNSAT TT=96.684 ASSIGNMENTS=0 CHECKS=249898	UNSAT TT=91.105 ASSIGNMENTS=0 CHECKS=249898	? (problem) TT=0.584	? (problem) TT=0.448	No data	UNSAT TT=87.336 ASSIGNMENTS=108 CHECKS=27049	UNSAT TT=893.216 ASSIGNMENTS=2372 CHECKS=1473200	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=134.572 ASSIGNMENTS=334 CHECKS=106947	? TT=0.971	No data	? (MO) TT=210.35	? (MO) TT=385.14
csp/fapp/fapp20/ normalized-fapp20-0420-2.xml	UNSAT TT=1.369	UNSAT TT=21.615 CHECKS=60344 NODES=0	UNSAT TT=21.527 CHECKS=59798 NODES=0	UNSAT TT=1.369	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=44.071 ASSIGNMENTS=1829	UNSAT TT=44.008 ASSIGNMENTS=1829	UNSAT TT=69.526 CHECKS=4254880 NODES=663	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=35.9 ASSIGNMENTS=0 CHECKS=54328	UNSAT TT=35.991 ASSIGNMENTS=0 CHECKS=54328	? (problem) TT=0.432	? (problem) TT=0.435	No data	UNSAT TT=107.867 ASSIGNMENTS=1987 CHECKS=581188	UNSAT TT=193.11 ASSIGNMENTS=5371 CHECKS=1008910	UNSAT TT=203.473	? (TO) TT=1800.04	UNSAT TT=28.35 ASSIGNMENTS=550 CHECKS=111797	? TT=721.253	No data	UNSAT TT=62.43	UNSAT TT=146.504
csp/fapp/fapp20/ normalized-fapp20-0420-5.xml	UNSAT TT=1.393	UNSAT TT=22.038 CHECKS=67595 NODES=0	UNSAT TT=22.232 CHECKS=65881 NODES=0	UNSAT TT=1.393	? (TO) TT=1800.12	? (TO) TT=1800.03	UNSAT TT=27.558 ASSIGNMENTS=505	UNSAT TT=28.19 ASSIGNMENTS=505	UNSAT TT=118.597 CHECKS=125876000 NODES=13745	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=37.455 ASSIGNMENTS=0 CHECKS=67596	UNSAT TT=36.997 ASSIGNMENTS=0 CHECKS=67596	? (problem) TT=0.449	? (problem) TT=0.446	No data	UNSAT TT=39.581 ASSIGNMENTS=950 CHECKS=223724	UNSAT TT=194.094 ASSIGNMENTS=5360 CHECKS=1012520	UNSAT TT=189.766	? (TO) TT=1800.03	UNSAT TT=30.332 ASSIGNMENTS=550 CHECKS=112545	? TT=1618.41	No data	UNSAT TT=70.78	UNSAT TT=147.679
csp/fapp/fapp20/ normalized-fapp20-0420-7.xml	UNSAT TT=1.381	UNSAT TT=22.103 CHECKS=65375 NODES=0	UNSAT TT=22.282 CHECKS=65456 NODES=0	UNSAT TT=1.381	? (TO) TT=1800.13	? (TO) TT=1800.08	UNSAT TT=27.652 ASSIGNMENTS=505	UNSAT TT=27.448 ASSIGNMENTS=505	UNSAT TT=153.205 CHECKS=160636000 NODES=29569	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=35.674 ASSIGNMENTS=0 CHECKS=65375	UNSAT TT=35.325 ASSIGNMENTS=0 CHECKS=65375	? (problem) TT=0.577	? (problem) TT=570.706	No data	UNSAT TT=38.386 ASSIGNMENTS=950 CHECKS=224836	UNSAT TT=197.162 ASSIGNMENTS=5452 CHECKS=1036320	UNSAT TT=201.245	? (TO) TT=1800.05	UNSAT TT=28.013 ASSIGNMENTS=550 CHECKS=112829	? TT=397.754	No data	UNSAT TT=69.452	UNSAT TT=159.796
csp/fapp/fapp21/ normalized-fapp21-0500-5.xml	SAT TT=21.768	SAT TT=21.768 CHECKS=823489 NODES=500	SAT TT=21.81 CHECKS=869253 NODES=500	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.21	? (TO) TT=1800.17	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=31.783 ASSIGNMENTS=500 CHECKS=766860	SAT TT=32.239 ASSIGNMENTS=500 CHECKS=766860	? (problem) TT=0.567	? (problem) TT=0.578	No data	SAT TT=691.923 ASSIGNMENTS=61905 CHECKS=2821430	SAT TT=281.516 ASSIGNMENTS=29345 CHECKS=1340370	Wrong UNSAT TT=120.356	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=810.244	No data	SAT TT=288.792	SAT TT=261.691
csp/fapp/fapp21/ normalized-fapp21-0500-6.xml	SAT TT=21.607	SAT TT=21.783 CHECKS=942290 NODES=500	SAT TT=21.607 CHECKS=784456 NODES=500	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1001.56 ASSIGNMENTS=140929	SAT TT=1078.84 ASSIGNMENTS=140929	SAT TT=1177.32 CHECKS=2774580000 NODES=751487	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=33.342 ASSIGNMENTS=500 CHECKS=874935	SAT TT=33.801 ASSIGNMENTS=500 CHECKS=990034	? (problem) TT=0.495	? (problem) TT=0.424	No data	SAT TT=1256.21 ASSIGNMENTS=207460 CHECKS=8804110	? (TO) TT=1800.06	Wrong UNSAT TT=119.565	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=976.221	No data	SAT TT=246.303	SAT TT=265.678
csp/fapp/fapp21/ normalized-fapp21-0500-7.xml	SAT TT=21.749	SAT TT=21.792 CHECKS=921553 NODES=500	SAT TT=21.749 CHECKS=919013 NODES=500	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.16	SAT TT=1414.1 CHECKS=4269480000 NODES=902415	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=33.464 ASSIGNMENTS=500 CHECKS=963800	SAT TT=32.737 ASSIGNMENTS=500 CHECKS=936460	? (problem) TT=0.436	? (problem) TT=0.442	No data	? (TO) TT=1800.04	? (TO) TT=1800.06	Wrong UNSAT TT=111.471	? (TO) TT=1800.05	SAT TT=504.034 ASSIGNMENTS=58130 CHECKS=2347850	? TT=363.875	No data	SAT TT=288.646	SAT TT=278.277
csp/fapp/fapp22/ normalized-fapp22-1750-0.xml	UNSAT TT=8.748	UNSAT TT=30.706 CHECKS=338746 NODES=0	UNSAT TT=30.098 CHECKS=363035 NODES=0	UNSAT TT=8.748	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=125.171 ASSIGNMENTS=369	UNSAT TT=115.127 ASSIGNMENTS=369	UNSAT TT=277.861 CHECKS=641601 NODES=0	UNSAT TT=452.141 CHECKS=810381 NODES=0	UNSAT TT=482.188 CHECKS=820657 NODES=0	UNSAT TT=400.568 ASSIGNMENTS=0 CHECKS=358632	UNSAT TT=427.376 ASSIGNMENTS=0 CHECKS=358632	? (problem) TT=0.438	? (problem) TT=0.61	No data	UNSAT TT=539.767 ASSIGNMENTS=227 CHECKS=196084	UNSAT TT=724.406 ASSIGNMENTS=705 CHECKS=382894	UNSAT TT=32.519	? (TO) TT=1800.03	UNSAT TT=537.68 ASSIGNMENTS=2831 CHECKS=464931	? TT=0.766	No data	? TT=742.814	? TT=743.495
csp/fapp/fapp22/ normalized-fapp22-1750-10.xml	SAT TT=36.294	SAT TT=36.294 CHECKS=9267580 NODES=1750	SAT TT=37.143 CHECKS=9269920 NODES=1750	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.18	SAT TT=284.899 CHECKS=9578020 NODES=1750	SAT TT=547.877 CHECKS=10370900 NODES=648	SAT TT=566.175 CHECKS=16506800 NODES=637	SAT TT=435.138 ASSIGNMENTS=1750 CHECKS=9260380	SAT TT=428.45 ASSIGNMENTS=1750 CHECKS=9278020	? (problem) TT=0.616	? (problem) TT=0.464	No data	? (TO) TT=1800.1	SAT TT=1473.8 ASSIGNMENTS=191233 CHECKS=8365990	Wrong UNSAT TT=32.969	? (TO) TT=1800.05	? (TO) TT=1800.03	? TT=0.837	No data	? TT=774.726	? TT=763.005
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp22/ normalized-fapp22-1750-6.xml	UNSAT TT=8.738	UNSAT TT=31.483 CHECKS=59746 NODES=0	UNSAT TT=30.624 CHECKS=59746 NODES=0	UNSAT TT=8.738	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=213.607 ASSIGNMENTS=2209	UNSAT TT=214.049 ASSIGNMENTS=2209	UNSAT TT=277.725 CHECKS=500339 NODES=0	UNSAT TT=466.028 CHECKS=514137 NODES=0	UNSAT TT=471.184 CHECKS=514653 NODES=0	UNSAT TT=426.269 ASSIGNMENTS=0 CHECKS=41031	UNSAT TT=427.928 ASSIGNMENTS=0 CHECKS=41543	? (problem) TT=0.45	? (problem) TT=0.58	No data	UNSAT TT=779.036 ASSIGNMENTS=2489 CHECKS=1156160	UNSAT TT=907.015 ASSIGNMENTS=2291 CHECKS=686609	UNSAT TT=30.794	? (TO) TT=1800.07	UNSAT TT=486.689 ASSIGNMENTS=722 CHECKS=322011	? TT=0.811	No data	? TT=773.311	? TT=808.599
csp/fapp/fapp23/ normalized-fapp23-1800-2.xml	UNSAT TT=17.562	UNSAT TT=35.173 CHECKS=786088 NODES=0	UNSAT TT=34.952 CHECKS=786103 NODES=0	UNSAT TT=17.562	UNSAT TT=73.771 CHECKS=7518540	UNSAT TT=36.681 CHECKS=927696	UNSAT TT=55.691 ASSIGNMENTS=0	UNSAT TT=58.451 ASSIGNMENTS=0	UNSAT TT=754.128 CHECKS=474485 NODES=0	UNSAT TT=906.285 CHECKS=552627 NODES=0	UNSAT TT=832.556 CHECKS=552627 NODES=0	UNSAT TT=132.27 ASSIGNMENTS=0 CHECKS=190727	UNSAT TT=138.349 ASSIGNMENTS=0 CHECKS=190727	? (problem) TT=0.581	? (problem) TT=0.46	No data	UNSAT TT=129.965 ASSIGNMENTS=0 CHECKS=190727	UNSAT TT=136.312 ASSIGNMENTS=0 CHECKS=190727	UNSAT TT=66.606	UNSAT TT=125.19 ASSIGNMENTS=0 CHECKS=190727	UNSAT TT=130.063 ASSIGNMENTS=0 CHECKS=190727	? (TO) TT=1802.17	No data	? TT=509.517	? TT=477.864
csp/fapp/fapp23/ normalized-fapp23-1800-4.xml	UNSAT TT=17.811	UNSAT TT=36.028 CHECKS=789237 NODES=0	UNSAT TT=36.778 CHECKS=785308 NODES=0	UNSAT TT=17.811	UNSAT TT=70.821 CHECKS=5701440	? (TO) TT=1800.08	UNSAT TT=56.033 ASSIGNMENTS=0	UNSAT TT=51.334 ASSIGNMENTS=0	UNSAT TT=730.741 CHECKS=473717 NODES=0	? (TO) TT=875	? (TO) TT=882.95	UNSAT TT=140.563 ASSIGNMENTS=0 CHECKS=324708	UNSAT TT=130.487 ASSIGNMENTS=0 CHECKS=324708	? (problem) TT=0.474	? (problem) TT=0.608	No data	UNSAT TT=139.764 ASSIGNMENTS=0 CHECKS=324708	UNSAT TT=137.658 ASSIGNMENTS=0 CHECKS=324708	UNSAT TT=66.293	UNSAT TT=134.018 ASSIGNMENTS=0 CHECKS=324708	UNSAT TT=140.555 ASSIGNMENTS=0 CHECKS=324708	? TT=416.965	No data	? TT=529.713	? TT=512.545
csp/fapp/fapp23/ normalized-fapp23-1800-9.xml	SAT TT=37.915	SAT TT=37.915 CHECKS=2321360 NODES=1800	SAT TT=38.618 CHECKS=2329420 NODES=1800	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.05	SAT TT=59.94 ASSIGNMENTS=1340	SAT TT=59.89 ASSIGNMENTS=1340	SAT TT=761.868 CHECKS=2372230 NODES=1800	? (TO) TT=980.3	? (TO) TT=952.74	SAT TT=191.556 ASSIGNMENTS=1800 CHECKS=2326670	SAT TT=179.606 ASSIGNMENTS=1800 CHECKS=2336430	? (problem) TT=0.595	? (problem) TT=0.451	No data	SAT TT=144.161 ASSIGNMENTS=905 CHECKS=621531	SAT TT=145.513 ASSIGNMENTS=13058 CHECKS=2142790	Wrong UNSAT TT=65.625	SAT TT=169.489 ASSIGNMENTS=60573 CHECKS=13090500	SAT TT=144.34 ASSIGNMENTS=940 CHECKS=623561	? TT=451.994	No data	? TT=505.105	? TT=531.543
csp/fapp/fapp24/ normalized-fapp24-2000-1.xml	UNSAT TT=8.112	UNSAT TT=24.96 CHECKS=94159 NODES=0	UNSAT TT=25.152 CHECKS=103650 NODES=0	UNSAT TT=8.112	? (TO) TT=1800.13	? (TO) TT=1800.11	UNSAT TT=47.33 ASSIGNMENTS=671	UNSAT TT=42.964 ASSIGNMENTS=671	UNSAT TT=343.002 CHECKS=54381600 NODES=250	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=93.669 ASSIGNMENTS=0 CHECKS=82101	UNSAT TT=91.937 ASSIGNMENTS=0 CHECKS=82101	? (problem) TT=0.459	? (problem) TT=0.458	No data	UNSAT TT=354.321 ASSIGNMENTS=846 CHECKS=598265	UNSAT TT=754.375 ASSIGNMENTS=4873 CHECKS=2510490	UNSAT TT=1679.91	? (TO) TT=1800.1	UNSAT TT=134.205 ASSIGNMENTS=217 CHECKS=167969	? TT=417.218	No data	? TT=495.533	? TT=467.545
csp/fapp/fapp24/ normalized-fapp24-2000-2.xml	UNSAT TT=8.719	UNSAT TT=25.9 CHECKS=111735 NODES=0	UNSAT TT=25.73 CHECKS=111735 NODES=0	UNSAT TT=8.719	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=47.472 ASSIGNMENTS=671	UNSAT TT=43.067 ASSIGNMENTS=671	UNSAT TT=286.592 CHECKS=32991100 NODES=52	UNSAT TT=212.19 CHECKS=3103200 NODES=0	UNSAT TT=210.045 CHECKS=3103200 NODES=0	UNSAT TT=94.077 ASSIGNMENTS=0 CHECKS=111735	UNSAT TT=102.138 ASSIGNMENTS=0 CHECKS=111735	? (problem) TT=0.425	? (problem) TT=0.585	No data	UNSAT TT=368.102 ASSIGNMENTS=846 CHECKS=598265	UNSAT TT=747.201 ASSIGNMENTS=5147 CHECKS=2615680	UNSAT TT=1714.11	? (TO) TT=1800.08	UNSAT TT=138.172 ASSIGNMENTS=217 CHECKS=167969	? TT=1467.21	No data	? TT=445.024	? TT=465.473
csp/fapp/fapp24/ normalized-fapp24-2000-7.xml	SAT TT=28.33	SAT TT=29.043 CHECKS=2575070 NODES=2000	SAT TT=28.33 CHECKS=2558380 NODES=2000	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.07	SAT TT=49.554 ASSIGNMENTS=4053	SAT TT=46.636 ASSIGNMENTS=4053	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=104.063 ASSIGNMENTS=2000 CHECKS=2561810	SAT TT=101.984 ASSIGNMENTS=2000 CHECKS=2560820	? (problem) TT=0.57	? (problem) TT=0.585	No data	SAT TT=101.11 ASSIGNMENTS=2556 CHECKS=258446	SAT TT=631.069 ASSIGNMENTS=8488 CHECKS=2431550	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=107.598 ASSIGNMENTS=1823 CHECKS=246767	? TT=402.076	No data	? TT=466.298	? TT=478.093
csp/fapp/fapp25/ normalized-fapp25-2230-0.xml	UNSAT TT=5.062	UNSAT TT=24.543 CHECKS=165883 NODES=0	UNSAT TT=24.544 CHECKS=165883 NODES=0	UNSAT TT=5.062	UNSAT TT=45.292 CHECKS=2047800	UNSAT TT=5.273 CHECKS=630863	UNSAT TT=34.78 ASSIGNMENTS=1	UNSAT TT=34.055 ASSIGNMENTS=1	UNSAT TT=167.68 CHECKS=8547990 NODES=0	UNSAT TT=107.745 CHECKS=9708830 NODES=0	UNSAT TT=114.509 CHECKS=9708830 NODES=0	UNSAT TT=56.577 ASSIGNMENTS=0 CHECKS=54523	UNSAT TT=53.984 ASSIGNMENTS=0 CHECKS=54523	? (problem) TT=0.583	? (problem) TT=593.591	No data	UNSAT TT=54.314 ASSIGNMENTS=0 CHECKS=54523	UNSAT TT=51.959 ASSIGNMENTS=0 CHECKS=54523	UNSAT TT=20.957	UNSAT TT=54.751 ASSIGNMENTS=0 CHECKS=54523	UNSAT TT=54.638 ASSIGNMENTS=0 CHECKS=54523	? TT=366.207	No data	? TT=463.682	? TT=466.788
csp/fapp/fapp25/ normalized-fapp25-2230-2.xml	UNSAT TT=4.998	UNSAT TT=25.224 CHECKS=2052920 NODES=0	UNSAT TT=25.621 CHECKS=2110580 NODES=0	UNSAT TT=4.998	UNSAT TT=44.331 CHECKS=216868	? (TO) TT=1800.1	UNSAT TT=35.136 ASSIGNMENTS=48	UNSAT TT=35.05 ASSIGNMENTS=48	UNSAT TT=177.675 CHECKS=8665700 NODES=0	UNSAT TT=126.137 CHECKS=9660360 NODES=0	UNSAT TT=125.132 CHECKS=9660360 NODES=0	UNSAT TT=54.665 ASSIGNMENTS=0 CHECKS=54202	UNSAT TT=57.469 ASSIGNMENTS=0 CHECKS=54202	? (problem) TT=0.579	? (problem) TT=0.471	No data	UNSAT TT=54.537 ASSIGNMENTS=0 CHECKS=54202	UNSAT TT=51.008 ASSIGNMENTS=0 CHECKS=54202	UNSAT TT=20.847	UNSAT TT=51.091 ASSIGNMENTS=0 CHECKS=54202	UNSAT TT=54.301 ASSIGNMENTS=0 CHECKS=54202	? TT=349.054	No data	? TT=457.193	? TT=433.716
csp/fapp/fapp25/ normalized-fapp25-2230-4.xml	SAT TT=28.939	SAT TT=29.277 CHECKS=7810920 NODES=2230	SAT TT=28.939 CHECKS=7802130 NODES=2230	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.21	? (TO) TT=1800.21	SAT TT=235.441 CHECKS=25144900 NODES=4618	SAT TT=134.668 CHECKS=25797700 NODES=4914	SAT TT=140.858 CHECKS=34505200 NODES=855	SAT TT=95.523 ASSIGNMENTS=2230 CHECKS=7810180	SAT TT=95.437 ASSIGNMENTS=2230 CHECKS=7805720	? (problem) TT=0.413	? (problem) TT=0.555	No data	SAT TT=55.985 ASSIGNMENTS=3545 CHECKS=275397	SAT TT=71.274 ASSIGNMENTS=26109 CHECKS=1488000	Wrong UNSAT TT=20.904	SAT TT=465.272 ASSIGNMENTS=694510 CHECKS=45718700	SAT TT=55.854 ASSIGNMENTS=2346 CHECKS=243533	? TT=366.45	No data	? TT=466.208	? TT=455.422
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp26/ normalized-fapp26-2300-10.xml	SAT TT=29.892	SAT TT=30.414 CHECKS=3766720 NODES=2300	SAT TT=29.892 CHECKS=3769220 NODES=2300	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.23	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=94.759 ASSIGNMENTS=2300 CHECKS=3768070	SAT TT=90.139 ASSIGNMENTS=2300 CHECKS=3765790	? (problem) TT=0.601	? (problem) TT=0.455	No data	? (TO) TT=1800.06	? (TO) TT=1800.04	Wrong UNSAT TT=26.594	? (TO) TT=1800.1	? (TO) TT=1800.1	? TT=393.935	No data	? TT=496.837	? TT=468.886
csp/fapp/fapp26/ normalized-fapp26-2300-4.xml	UNSAT TT=7.495	UNSAT TT=26.587 CHECKS=937741 NODES=0	UNSAT TT=26.638 CHECKS=937741 NODES=0	UNSAT TT=7.495	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.18	UNSAT TT=261.956 CHECKS=91372200 NODES=429	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=91.773 ASSIGNMENTS=0 CHECKS=942312	UNSAT TT=87.006 ASSIGNMENTS=0 CHECKS=939296	? (problem) TT=0.448	? (problem) TT=0.583	No data	? (TO) TT=1800.09	UNSAT TT=965.585 ASSIGNMENTS=15568 CHECKS=3699280	UNSAT TT=28.322	? (TO) TT=1800.11	UNSAT TT=1398.76 ASSIGNMENTS=27298 CHECKS=4234850	? TT=408.171	No data	? TT=486.433	? TT=510.094
csp/fapp/fapp26/ normalized-fapp26-2300-8.xml	SAT TT=29.51	SAT TT=29.51 CHECKS=3539790 NODES=2300	SAT TT=29.718 CHECKS=3539380 NODES=2300	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.2	? (TO) TT=1800.25	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=93.375 ASSIGNMENTS=2300 CHECKS=3538920	SAT TT=97.408 ASSIGNMENTS=2300 CHECKS=3535360	? (problem) TT=0.479	? (problem) TT=0.445	No data	? (TO) TT=1800.04	? (TO) TT=1800.04	Wrong UNSAT TT=24.802	? (TO) TT=1800.11	? (TO) TT=1800.08	? TT=977.753	No data	? TT=479.309	? TT=492.849
csp/fapp/fapp27/ normalized-fapp27-2550-10.xml	SAT TT=31.712	SAT TT=33.639 CHECKS=22271500 NODES=2550	SAT TT=31.712 CHECKS=21932400 NODES=2550	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.23	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=60.143 ASSIGNMENTS=2550 CHECKS=22253300	SAT TT=60.227 ASSIGNMENTS=2550 CHECKS=21987800	? (problem) TT=461.33	? (problem) TT=0.429	No data	? (TO) TT=1800.03	? (TO) TT=1800.05	Wrong UNSAT TT=11.57	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=390.855	No data	? TT=420.66	? TT=416.07
csp/fapp/fapp27/ normalized-fapp27-2550-3.xml	UNSAT TT=22.787	UNSAT TT=22.787 CHECKS=535609 NODES=0	UNSAT TT=22.953 CHECKS=555096 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.24	? (TO) TT=1800.21	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=49.999 ASSIGNMENTS=0 CHECKS=535609	UNSAT TT=49.305 ASSIGNMENTS=0 CHECKS=535609	? (problem) TT=0.593	? (problem) TT=0.424	No data	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=10.636	? (TO) TT=1800.07	UNSAT TT=229.25 ASSIGNMENTS=30980 CHECKS=1036290	? TT=408.839	No data	? TT=429.206	? TT=417.567
csp/fapp/fapp27/ normalized-fapp27-2550-7.xml	SAT TT=32	SAT TT=32.065 CHECKS=20475000 NODES=2551	SAT TT=32 CHECKS=20473500 NODES=2551	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.2	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=55.632 ASSIGNMENTS=2551 CHECKS=20035700	SAT TT=57.052 ASSIGNMENTS=2551 CHECKS=20009300	? (problem) TT=0.469	? (problem) TT=0.644	No data	? (TO) TT=1800.02	? (TO) TT=1800.07	Wrong UNSAT TT=11.269	? (TO) TT=1800.14	? (TO) TT=1800.08	? TT=1039.28	No data	? TT=444.608	? TT=402.845
csp/fapp/fapp28/ normalized-fapp28-2800-10.xml	SAT TT=48.941	SAT TT=50.723 CHECKS=43944400 NODES=2802	SAT TT=48.941 CHECKS=43941100 NODES=2802	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.24	SAT TT=286.491 CHECKS=50975500 NODES=2801	SAT TT=460.014 CHECKS=80877800 NODES=153231	SAT TT=436.837 CHECKS=58829700 NODES=1070	SAT TT=518.374 ASSIGNMENTS=2802 CHECKS=43958800	SAT TT=485.414 ASSIGNMENTS=2802 CHECKS=43953300	? (problem) TT=0.598	? (problem) TT=0.441	No data	? (TO) TT=1800.05	? (TO) TT=1800.05	Wrong UNSAT TT=29.337	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=0.886	No data	? TT=1131.99	? TT=1040.2
csp/fapp/fapp28/ normalized-fapp28-2800-5.xml	SAT TT=44.85	SAT TT=44.85 CHECKS=35049200 NODES=2800	SAT TT=47.72 CHECKS=35048600 NODES=2800	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.27	SAT TT=297.094 CHECKS=38833600 NODES=2800	SAT TT=1410.51 CHECKS=1211510000 NODES=1803300	SAT TT=430.371 CHECKS=45067000 NODES=691	SAT TT=544.549 ASSIGNMENTS=2800 CHECKS=35062900	SAT TT=527.457 ASSIGNMENTS=2800 CHECKS=35049200	? (problem) TT=0.432	? (problem) TT=0.568	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	Wrong UNSAT TT=30.927	? (TO) TT=1800.07	? (TO) TT=1800.03	? TT=0.854	No data	? TT=1046.79	? TT=1044
csp/fapp/fapp28/ normalized-fapp28-2800-6.xml	SAT TT=45.953	SAT TT=45.953 CHECKS=36212400 NODES=2800	SAT TT=48.489 CHECKS=36217300 NODES=2800	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.24	? (TO) TT=1800.24	SAT TT=293.697 CHECKS=39743100 NODES=2801	SAT TT=613.664 CHECKS=264288000 NODES=302500	SAT TT=427.841 CHECKS=45241900 NODES=659	SAT TT=482.583 ASSIGNMENTS=2800 CHECKS=36222800	SAT TT=483.318 ASSIGNMENTS=2800 CHECKS=36231600	? (problem) TT=0.443	? (problem) TT=0.444	No data	? (TO) TT=1800.08	? (TO) TT=1800.1	Wrong UNSAT TT=25.145	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=0.932	No data	? TT=1028.1	? TT=1115.1
csp/fapp/fapp29/ normalized-fapp29-2900-1.xml	UNSAT TT=16.226	UNSAT TT=39.921 CHECKS=1188900 NODES=0	UNSAT TT=37.981 CHECKS=1190080 NODES=0	UNSAT TT=16.226	UNSAT TT=76.26 CHECKS=117301	UNSAT TT=42.512 CHECKS=117301	UNSAT TT=93.607 ASSIGNMENTS=0	UNSAT TT=90.935 ASSIGNMENTS=0	? TT=714.378	? (TO) TT=952.83	? (TO) TT=1010.3	UNSAT TT=221.877 ASSIGNMENTS=0 CHECKS=26170	UNSAT TT=244.713 ASSIGNMENTS=0 CHECKS=26170	? (problem) TT=0.428	? (problem) TT=0.421	No data	UNSAT TT=226.761 ASSIGNMENTS=0 CHECKS=26170	UNSAT TT=239.994 ASSIGNMENTS=0 CHECKS=26170	UNSAT TT=325.531	UNSAT TT=239.708 ASSIGNMENTS=0 CHECKS=26170	UNSAT TT=223.055 ASSIGNMENTS=0 CHECKS=26170	? TT=0.912	No data	? TT=911.879	? TT=795.601
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp29/ normalized-fapp29-2900-3.xml	UNSAT TT=17.532	UNSAT TT=40.638 CHECKS=2048040 NODES=0	UNSAT TT=40.168 CHECKS=2048040 NODES=0	UNSAT TT=17.532	UNSAT TT=72.784 CHECKS=117297	UNSAT TT=42.846 CHECKS=117297	UNSAT TT=87.982 ASSIGNMENTS=0	UNSAT TT=94.417 ASSIGNMENTS=0	? TT=768.348	? (TO) TT=920.09	? (TO) TT=946.14	UNSAT TT=293.2 ASSIGNMENTS=0 CHECKS=38032	UNSAT TT=319.38 ASSIGNMENTS=0 CHECKS=38032	? (problem) TT=0.603	? (problem) TT=0.444	No data	UNSAT TT=323.441 ASSIGNMENTS=0 CHECKS=38032	UNSAT TT=315.465 ASSIGNMENTS=0 CHECKS=38032	UNSAT TT=304.592	UNSAT TT=323.136 ASSIGNMENTS=0 CHECKS=38032	UNSAT TT=311.213 ASSIGNMENTS=0 CHECKS=38032	? TT=0.929	No data	? TT=788.517	? TT=820.753
csp/fapp/fapp29/ normalized-fapp29-2900-6.xml	SAT TT=21.955	SAT TT=50.606 CHECKS=6359000 NODES=2900	SAT TT=44.593 CHECKS=6358640 NODES=2900	SAT TT=21.955	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=132.748 ASSIGNMENTS=2827	SAT TT=132.813 ASSIGNMENTS=2827	? TT=754.325	? (TO) TT=951.79	? (TO) TT=992.92	SAT TT=498.622 ASSIGNMENTS=2900 CHECKS=6357900	SAT TT=521.161 ASSIGNMENTS=2900 CHECKS=6362330	? (problem) TT=0.445	? (problem) TT=0.614	No data	SAT TT=452.93 ASSIGNMENTS=155 CHECKS=222572	SAT TT=449.827 ASSIGNMENTS=154 CHECKS=219120	Wrong UNSAT TT=285.232	SAT TT=425.697 ASSIGNMENTS=157 CHECKS=222872	SAT TT=446.85 ASSIGNMENTS=155 CHECKS=222444	? TT=0.922	No data	? TT=837.81	? TT=807.714
csp/fapp/fapp30/ normalized-fapp30-3000-10.xml	SAT TT=91.177	SAT TT=91.177 CHECKS=104858000 NODES=3000	SAT TT=98.724 CHECKS=105023000 NODES=3000	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.28	? TT=987.488	? (TO) TT=1163.41	? (TO) TT=1238.81	SAT TT=1180.74 ASSIGNMENTS=3000 CHECKS=104798000	SAT TT=1091.79 ASSIGNMENTS=3000 CHECKS=104799000	? (problem) TT=0.572	? (problem) TT=0.593	No data	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=0.776	No data	? TT=910.013	? TT=843.061
csp/fapp/fapp30/ normalized-fapp30-3000-1.xml	UNSAT TT=18.269	UNSAT TT=40.692 CHECKS=47789 NODES=0	UNSAT TT=39.769 CHECKS=47789 NODES=0	UNSAT TT=18.269	? (TO) TT=1800.08	? (TO) TT=1800.15	UNSAT TT=177.905 ASSIGNMENTS=4363	UNSAT TT=191.342 ASSIGNMENTS=4363	? TT=877.318	? (TO) TT=1140.86	? (TO) TT=1138.28	UNSAT TT=1100.95 ASSIGNMENTS=0 CHECKS=47789	UNSAT TT=1113.73 ASSIGNMENTS=0 CHECKS=47789	? (problem) TT=0.453	? (problem) TT=0.56	No data	UNSAT TT=1431.04 ASSIGNMENTS=8780 CHECKS=747186	UNSAT TT=1692.08 ASSIGNMENTS=7497 CHECKS=823907	? (TO) TT=1800.07	? (TO) TT=1800.14	UNSAT TT=1120.55 ASSIGNMENTS=377 CHECKS=92375	? TT=0.832	No data	? TT=818.266	? TT=869.335
csp/fapp/fapp30/ normalized-fapp30-3000-5.xml	UNSAT TT=17.117	UNSAT TT=41.005 CHECKS=48778 NODES=0	UNSAT TT=38.854 CHECKS=48778 NODES=0	UNSAT TT=17.117	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.17	? TT=976.085	? (TO) TT=1163.6	? (TO) TT=1174.72	UNSAT TT=1049.16 ASSIGNMENTS=0 CHECKS=48778	UNSAT TT=1010.52 ASSIGNMENTS=0 CHECKS=48778	? (problem) TT=0.419	? (problem) TT=0.422	No data	UNSAT TT=1080.59 ASSIGNMENTS=3948 CHECKS=263741	UNSAT TT=1377.81 ASSIGNMENTS=3571 CHECKS=417217	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=1502.04 ASSIGNMENTS=16829 CHECKS=625821	? TT=0.808	No data	? TT=818.379	? TT=827.101
csp/fapp/fapp31/ normalized-fapp31-0400-6.xml	SAT TT=114.448	SAT TT=114.448 CHECKS=229439000 NODES=579	SAT TT=127.651 CHECKS=230468000 NODES=579	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.19	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=161.351 ASSIGNMENTS=579 CHECKS=228646000	SAT TT=179.55 ASSIGNMENTS=579 CHECKS=229454000	? (problem) TT=0.58	? (problem) TT=0.613	No data	? (TO) TT=1800.09	? (TO) TT=1800.04	Wrong UNSAT TT=4.134	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=0.797	No data	SAT TT=617.477	SAT TT=409.6
csp/fapp/fapp31/ normalized-fapp31-0400-7.xml	SAT TT=152.754	SAT TT=156.682 CHECKS=302419000 NODES=575	SAT TT=152.754 CHECKS=302419000 NODES=575	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.18	SAT TT=904.917 CHECKS=2185220000 NODES=65763	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=192.196 ASSIGNMENTS=575 CHECKS=300834000	SAT TT=194.882 ASSIGNMENTS=575 CHECKS=301073000	? (problem) TT=0.624	? (problem) TT=0.577	No data	? (TO) TT=1800.1	? (TO) TT=1800.06	Wrong UNSAT TT=4.479	? (TO) TT=1800.1	? (TO) TT=1800.05	? TT=0.805	No data	SAT TT=579.433	SAT TT=398.674
csp/fapp/fapp31/ normalized-fapp31-0400-9.xml	SAT TT=144.181	SAT TT=144.181 CHECKS=306631000 NODES=568	SAT TT=152.23 CHECKS=307282000 NODES=568	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.19	SAT TT=1421.48 CHECKS=3851390000 NODES=70800	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=204.111 ASSIGNMENTS=568 CHECKS=306239000	SAT TT=207.736 ASSIGNMENTS=568 CHECKS=306633000	? (problem) TT=0.445	? (problem) TT=0.44	No data	? (TO) TT=1800.07	? (TO) TT=1800.11	Wrong UNSAT TT=4.162	? (TO) TT=1800.09	? (TO) TT=1800.07	? TT=0.828	No data	SAT TT=741.89	SAT TT=381.123
csp/fapp/fapp32/ normalized-fapp32-0550-1.xml	UNSAT TT=26.171	UNSAT TT=26.171 CHECKS=1919080 NODES=0	UNSAT TT=26.53 CHECKS=1919080 NODES=0	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.09	UNSAT TT=1195.83 ASSIGNMENTS=1390	UNSAT TT=1217.44 ASSIGNMENTS=1390	UNSAT TT=142.982 CHECKS=3078800 NODES=0	UNSAT TT=375.427 CHECKS=2556630 NODES=0	UNSAT TT=363.848 CHECKS=3513850 NODES=0	UNSAT TT=265.908 ASSIGNMENTS=0 CHECKS=1919080	UNSAT TT=255.441 ASSIGNMENTS=0 CHECKS=1919080	? (problem) TT=0.573	? (problem) TT=0.448	No data	? (TO) TT=1800.08	UNSAT TT=1730 ASSIGNMENTS=5424 CHECKS=2205760	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=0.824	No data	? (MO) TT=562.416	? (MO) TT=692.399
csp/fapp/fapp32/ normalized-fapp32-0550-5.xml	UNSAT TT=26.545	? (MO) TT=23.035	UNSAT TT=26.545 CHECKS=1883380 NODES=0	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.25	? (TO) TT=1800.19	UNSAT TT=144.292 CHECKS=4251520 NODES=0	UNSAT TT=363.068 CHECKS=4236640 NODES=0	UNSAT TT=354.252 CHECKS=3600670 NODES=0	UNSAT TT=242.32 ASSIGNMENTS=0 CHECKS=1883380	UNSAT TT=258.359 ASSIGNMENTS=0 CHECKS=1883380	? (problem) TT=0.439	? (problem) TT=0.579	No data	? (TO) TT=1800.08	UNSAT TT=1289.1 ASSIGNMENTS=4527 CHECKS=1489190	? (TO) TT=1800.03	? (TO) TT=1800.12	UNSAT TT=1036.62 ASSIGNMENTS=2140 CHECKS=1134710	? TT=0.793	No data	? (MO) TT=531.079	? (MO) TT=690.526
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp32/ normalized-fapp32-0550-8.xml	SAT TT=35.15	SAT TT=36.019 CHECKS=12106500 NODES=551	SAT TT=35.15 CHECKS=12112700 NODES=551	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.22	? (TO) TT=1800.21	SAT TT=151.439 CHECKS=17679100 NODES=554	SAT TT=457.722 CHECKS=152098000 NODES=150918	SAT TT=388.623 CHECKS=22713700 NODES=668	SAT TT=277.661 ASSIGNMENTS=551 CHECKS=12112700	SAT TT=268.753 ASSIGNMENTS=551 CHECKS=12114300	? (problem) TT=0.445	? (problem) TT=0.436	No data	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=1514.18 ASSIGNMENTS=2362 CHECKS=5683680	? TT=0.783	No data	? (MO) TT=527.318	? (MO) TT=694.381
csp/fapp/fapp33/ normalized-fapp33-0650-10.xml	SAT TT=29.653	SAT TT=30.027 CHECKS=6981000 NODES=654	SAT TT=29.653 CHECKS=6981430 NODES=654	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.25	? (TO) TT=1800.16	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=70.342 ASSIGNMENTS=654 CHECKS=6946900	SAT TT=71.3 ASSIGNMENTS=654 CHECKS=6946900	? (problem) TT=0.592	? (problem) TT=0.609	No data	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	? TT=550.293	No data	? (MO) TT=200.797	? (MO) TT=357.3
csp/fapp/fapp33/ normalized-fapp33-0650-1.xml	UNSAT TT=24.591	UNSAT TT=24.591 CHECKS=220301 NODES=0	UNSAT TT=24.872 CHECKS=220301 NODES=0	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.03	UNSAT TT=34.845 ASSIGNMENTS=5	UNSAT TT=35.138 ASSIGNMENTS=5	UNSAT TT=136.03 CHECKS=8149610 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=69.722 ASSIGNMENTS=0 CHECKS=213883	UNSAT TT=68.755 ASSIGNMENTS=0 CHECKS=220301	? (problem) TT=0.418	? (problem) TT=0.451	No data	UNSAT TT=45.868 ASSIGNMENTS=18 CHECKS=26979	UNSAT TT=608.018 ASSIGNMENTS=3194 CHECKS=1274760	? (TO) TT=1800.06	UNSAT TT=1084.05 ASSIGNMENTS=3983 CHECKS=1627930	UNSAT TT=44.133 ASSIGNMENTS=16 CHECKS=20734	? TT=460.955	No data	? (MO) TT=200.734	? (MO) TT=383.63
csp/fapp/fapp33/ normalized-fapp33-0650-3.xml	UNSAT TT=24.612	UNSAT TT=24.612 CHECKS=248366 NODES=0	UNSAT TT=24.813 CHECKS=248366 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=37.213 ASSIGNMENTS=7	UNSAT TT=38.212 ASSIGNMENTS=7	UNSAT TT=133.771 CHECKS=387255 NODES=0	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=67.906 ASSIGNMENTS=0 CHECKS=241982	UNSAT TT=69.713 ASSIGNMENTS=0 CHECKS=241982	? (problem) TT=0.451	? (problem) TT=0.444	No data	UNSAT TT=45.508 ASSIGNMENTS=15 CHECKS=22813	UNSAT TT=617.786 ASSIGNMENTS=3388 CHECKS=1405470	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=49.646 ASSIGNMENTS=19 CHECKS=26436	? TT=491.717	No data	? (MO) TT=202.436	? (MO) TT=366.05
csp/fapp/fapp34/ normalized-fapp34-0750-0.xml	UNSAT TT=25.167	UNSAT TT=25.25 CHECKS=1302480 NODES=0	UNSAT TT=25.167 CHECKS=1302480 NODES=0	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.24	? (TO) TT=1800.18	UNSAT TT=134.837 CHECKS=3003690 NODES=0	UNSAT TT=279.219 CHECKS=6352610 NODES=0	UNSAT TT=264.31 CHECKS=7989820 NODES=0	UNSAT TT=80.426 ASSIGNMENTS=0 CHECKS=1302730	UNSAT TT=80.94 ASSIGNMENTS=0 CHECKS=1302730	? (problem) TT=0.411	? (problem) TT=0.417	No data	? (TO) TT=1800.12	UNSAT TT=1564.58 ASSIGNMENTS=8694 CHECKS=2552100	UNSAT TT=348.781	? (TO) TT=1800.07	UNSAT TT=667.905 ASSIGNMENTS=3105 CHECKS=793840	? TT=0.882	No data	? (MO) TT=241.225	? (MO) TT=440.5
csp/fapp/fapp34/ normalized-fapp34-0750-4.xml	SAT TT=28.645	SAT TT=28.645 CHECKS=6429710 NODES=750	SAT TT=28.742 CHECKS=6438840 NODES=750	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.23	? (TO) TT=1800.17	SAT TT=165.003 CHECKS=29706100 NODES=3962	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=87.985 ASSIGNMENTS=750 CHECKS=6428720	SAT TT=85.857 ASSIGNMENTS=750 CHECKS=6436050	? (problem) TT=0.602	? (problem) TT=0.615	No data	? (TO) TT=1800.05	? (TO) TT=1800.08	Wrong UNSAT TT=260.887	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=0.889	No data	? (MO) TT=221.313	? (MO) TT=401.417
csp/fapp/fapp34/ normalized-fapp34-0750-9.xml	SAT TT=29.225	SAT TT=29.225 CHECKS=8902030 NODES=750	SAT TT=29.551 CHECKS=8895260 NODES=750	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.23	SAT TT=186.057 CHECKS=32468800 NODES=6256	? (TO) TT=1800.1	SAT TT=278.749 CHECKS=43815600 NODES=1687	SAT TT=85.078 ASSIGNMENTS=750 CHECKS=8889800	SAT TT=85.356 ASSIGNMENTS=750 CHECKS=8889800	? (problem) TT=0.446	? (problem) TT=0.438	No data	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.08	? TT=0.964	No data	? (MO) TT=239.79	? (MO) TT=456.4
csp/fapp/fapp35/ normalized-fapp35-1500-3.xml	UNSAT TT=30.412	UNSAT TT=30.412 CHECKS=2478420 NODES=0	UNSAT TT=30.712 CHECKS=2478420 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.22	UNSAT TT=203.113 CHECKS=1200720 NODES=0	UNSAT TT=412.047 CHECKS=1186700 NODES=0	UNSAT TT=391.828 CHECKS=1161650 NODES=0	UNSAT TT=259.656 ASSIGNMENTS=0 CHECKS=2478420	UNSAT TT=255.162 ASSIGNMENTS=0 CHECKS=2478420	? (problem) TT=0.608	? (problem) TT=0.459	No data	UNSAT TT=343.365 ASSIGNMENTS=229 CHECKS=87697	UNSAT TT=677.568 ASSIGNMENTS=616 CHECKS=421825	UNSAT TT=21.632	? (TO) TT=1800.03	UNSAT TT=302.701 ASSIGNMENTS=195 CHECKS=66144	? TT=0.805	No data	? TT=735.109	? TT=733.884
csp/fapp/fapp35/ normalized-fapp35-1500-4.xml	UNSAT TT=31.037	UNSAT TT=31.037 CHECKS=2524260 NODES=0	UNSAT TT=31.715 CHECKS=2524260 NODES=0	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.14	UNSAT TT=211.536 CHECKS=1316600 NODES=0	UNSAT TT=413.796 CHECKS=1304870 NODES=0	UNSAT TT=399.291 CHECKS=1304870 NODES=0	UNSAT TT=264.383 ASSIGNMENTS=0 CHECKS=2524260	UNSAT TT=266.303 ASSIGNMENTS=0 CHECKS=2524260	? (problem) TT=0.451	? (problem) TT=0.584	No data	UNSAT TT=347.358 ASSIGNMENTS=240 CHECKS=88267	UNSAT TT=681.319 ASSIGNMENTS=661 CHECKS=428201	UNSAT TT=25.526	? (TO) TT=1800.07	UNSAT TT=287.93 ASSIGNMENTS=191 CHECKS=64053	? TT=0.802	No data	? TT=784.025	? TT=730.874
csp/fapp/fapp35/ normalized-fapp35-1500-9.xml	SAT TT=57.031	SAT TT=57.031 CHECKS=24395000 NODES=1501	SAT TT=60.335 CHECKS=24392600 NODES=1501	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.18	SAT TT=231.84 CHECKS=33922200 NODES=1876	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=286.862 ASSIGNMENTS=1501 CHECKS=24395300	SAT TT=273.515 ASSIGNMENTS=1501 CHECKS=24395000	? (problem) TT=0.446	? (problem) TT=0.615	No data	? (TO) TT=1800.11	? (TO) TT=1800.05	Wrong UNSAT TT=21.426	? (TO) TT=1800.04	? (TO) TT=1800.09	? TT=0.794	No data	? TT=764.841	? TT=684.25
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp36/ normalized-fapp36-2000-10.xml	SAT TT=37.094	SAT TT=37.564 CHECKS=17354000 NODES=2000	SAT TT=37.094 CHECKS=17360800 NODES=2000	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=120.927 ASSIGNMENTS=2000 CHECKS=17345800	SAT TT=124.545 ASSIGNMENTS=2000 CHECKS=17345300	? (problem) TT=0.418	? (problem) TT=0.425	No data	? (TO) TT=1800.05	? (TO) TT=1800.03	Wrong UNSAT TT=19.576	? (TO) TT=1800.12	? (TO) TT=1800.02	? TT=375.224	No data	? TT=614.382	? TT=585.416
csp/fapp/fapp36/ normalized-fapp36-2000-3.xml	UNSAT TT=28.107	UNSAT TT=28.447 CHECKS=207354 NODES=0	UNSAT TT=28.107 CHECKS=207354 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=37.464 ASSIGNMENTS=5	UNSAT TT=36.65 ASSIGNMENTS=5	UNSAT TT=174.756 CHECKS=4089450 NODES=0	UNSAT TT=291.136 CHECKS=17144300 NODES=0	? (TO) TT=1800.06	UNSAT TT=108.585 ASSIGNMENTS=0 CHECKS=207354	UNSAT TT=119.976 ASSIGNMENTS=0 CHECKS=207354	? (problem) TT=0.435	? (problem) TT=0.496	No data	UNSAT TT=89.366 ASSIGNMENTS=17 CHECKS=30812	UNSAT TT=630.425 ASSIGNMENTS=3383 CHECKS=928660	UNSAT TT=19.133	? (TO) TT=1800.1	UNSAT TT=94.624 ASSIGNMENTS=32 CHECKS=37244	? TT=956.804	No data	? TT=585.986	? TT=573.289
csp/fapp/fapp36/ normalized-fapp36-2000-6.xml	UNSAT TT=27.624	UNSAT TT=27.624 CHECKS=238659 NODES=0	UNSAT TT=28.216 CHECKS=238659 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.33	? (TO) TT=1800.24	UNSAT TT=174.048 CHECKS=562760 NODES=0	UNSAT TT=328.866 CHECKS=22787100 NODES=0	? (TO) TT=1800.02	UNSAT TT=117.808 ASSIGNMENTS=0 CHECKS=238659	UNSAT TT=112.278 ASSIGNMENTS=0 CHECKS=238659	? (problem) TT=0.46	? (problem) TT=0.608	No data	UNSAT TT=443.232 ASSIGNMENTS=2958 CHECKS=577185	UNSAT TT=844.615 ASSIGNMENTS=6423 CHECKS=1531920	UNSAT TT=18.756	? (TO) TT=1800.05	UNSAT TT=300.343 ASSIGNMENTS=1979 CHECKS=333547	? TT=663.424	No data	? TT=588.021	? TT=564.982
csp/fapp/fapp37/ normalized-fapp37-2250-1.xml	UNSAT TT=41.15	UNSAT TT=41.15 CHECKS=786436 NODES=0	UNSAT TT=41.313 CHECKS=786436 NODES=0	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.14	? (problem) TT=112.465	? (problem) TT=113.737	? TT=367.849	? (TO) TT=627.61	? (TO) TT=633.44	UNSAT TT=757.197 ASSIGNMENTS=0 CHECKS=786436	UNSAT TT=812.561 ASSIGNMENTS=0 CHECKS=786436	? (problem) TT=0.582	? (problem) TT=0.571	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=57.955	? (TO) TT=1800.12	? (TO) TT=1800.09	? TT=0.877	No data	? TT=1149.87	? TT=1032.15
csp/fapp/fapp37/ normalized-fapp37-2250-2.xml	UNSAT TT=40.887	UNSAT TT=40.887 CHECKS=2118760 NODES=0	UNSAT TT=42.066 CHECKS=2118760 NODES=0	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.14	? (problem) TT=106.672	? (problem) TT=112.78	? TT=354.792	? (TO) TT=623.6	? (TO) TT=623.68	UNSAT TT=810.812 ASSIGNMENTS=0 CHECKS=2118760	UNSAT TT=848.84 ASSIGNMENTS=0 CHECKS=2118760	? (problem) TT=0.612	? (problem) TT=0.452	No data	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=69.247	? (TO) TT=1800.12	? (TO) TT=1800.02	? TT=0.893	No data	? TT=1030.02	? TT=1008.11
csp/fapp/fapp37/ normalized-fapp37-2250-5.xml	SAT TT=55.601	SAT TT=56.291 CHECKS=25166200 NODES=2250	SAT TT=55.601 CHECKS=25166200 NODES=2250	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.1	? (problem) TT=105.752	? (problem) TT=112.517	? TT=356.214	? (TO) TT=639.96	? (TO) TT=620.82	SAT TT=749.923 ASSIGNMENTS=2250 CHECKS=25166900	SAT TT=823.952 ASSIGNMENTS=2250 CHECKS=25166900	? (problem) TT=0.444	? (problem) TT=0.626	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	Wrong UNSAT TT=68.303	? (TO) TT=1800.07	? (TO) TT=1800.08	? TT=0.873	No data	? TT=1078.06	? TT=1005.04
csp/fapp/fapp38/ normalized-fapp38-2500-3.xml	SAT TT=66.206	SAT TT=66.206 CHECKS=38549700 NODES=2501	SAT TT=71.951 CHECKS=38554200 NODES=2501	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (problem) TT=92.479	? (problem) TT=91.332	? TT=790.689	? (TO) TT=1065.71	? (TO) TT=1029.53	SAT TT=711.004 ASSIGNMENTS=2501 CHECKS=38540000	SAT TT=753.005 ASSIGNMENTS=2501 CHECKS=38541700	? (problem) TT=0.572	? (problem) TT=0.624	No data	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? TT=0.82	No data	? TT=658.63	? TT=747.462
csp/fapp/fapp38/ normalized-fapp38-2500-6.xml	SAT TT=70.038	SAT TT=70.038 CHECKS=45327900 NODES=2505	? (MO) TT=34.824	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.04	? (problem) TT=86.399	? (problem) TT=89.067	? TT=797.293	? (TO) TT=1080.63	? (TO) TT=1046.45	SAT TT=709.557 ASSIGNMENTS=2505 CHECKS=45314300	SAT TT=694.741 ASSIGNMENTS=2505 CHECKS=45302200	? (problem) TT=0.585	? (problem) TT=0.602	No data	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.1	? TT=0.794	No data	? TT=701.589	? TT=717.556
csp/fapp/fapp38/ normalized-fapp38-2500-9.xml	SAT TT=75.16	SAT TT=78.65 CHECKS=60950000 NODES=4587	SAT TT=75.16 CHECKS=60940400 NODES=4587	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.12	? (problem) TT=85.237	? (problem) TT=89.252	? TT=878.564	? (TO) TT=1047.53	? (TO) TT=1051.27	SAT TT=671.41 ASSIGNMENTS=4587 CHECKS=60942100	SAT TT=679.306 ASSIGNMENTS=4587 CHECKS=60942100	? (problem) TT=0.448	? (problem) TT=0.624	No data	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=0.768	No data	? TT=715.233	? TT=672.465
csp/fapp/fapp39/ normalized-fapp39-2750-5.xml	SAT TT=1265	SAT TT=1355.76 CHECKS=2545130000 NODES=3810	SAT TT=1426.19 CHECKS=2544800000 NODES=3810	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.22	? (TO) TT=1800.19	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=1295.94 ASSIGNMENTS=3810 CHECKS=2540110000	SAT TT=1265 ASSIGNMENTS=3810 CHECKS=2540100000	? (problem) TT=0.428	? (problem) TT=0.421	No data	? (TO) TT=1800.03	? (TO) TT=1800.09	Wrong UNSAT TT=25.894	? (TO) TT=1800.09	? (TO) TT=1800.11	? TT=0.776	No data	? TT=664.648	? TT=647.761
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp39/ normalized-fapp39-2750-6.xml	SAT TT=1499.85	SAT TT=1661.98 CHECKS=3090810000 NODES=4101	SAT TT=1738.17 CHECKS=3090650000 NODES=4101	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.24	? (TO) TT=1800.28	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=1499.85 ASSIGNMENTS=4101 CHECKS=3080200000	SAT TT=1579.99 ASSIGNMENTS=4101 CHECKS=3080430000	? (problem) TT=0.47	? (problem) TT=0.601	No data	? (TO) TT=1800.09	? (TO) TT=1800.09	Wrong UNSAT TT=24.912	? (TO) TT=1800.1	? (TO) TT=1800.08	? TT=0.816	No data	? TT=643.626	? TT=650.326
csp/fapp/fapp39/ normalized-fapp39-2750-9.xml		? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.21	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.08	? (problem) TT=0.552	? (problem) TT=0.45	No data	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=24.914	? (TO) TT=1800.09	? (TO) TT=1800.11	? TT=0.803	No data	? TT=622.692	? TT=646.443
csp/fapp/fapp40/ normalized-fapp40-3000-2.xml	UNSAT TT=43.006	UNSAT TT=44.349 CHECKS=4768650 NODES=0	UNSAT TT=43.006 CHECKS=4768650 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.12	? (problem) TT=83.419	? (problem) TT=77.724	? TT=664.799	? (TO) TT=843.74	? (TO) TT=844.28	UNSAT TT=692.994 ASSIGNMENTS=0 CHECKS=4768650	UNSAT TT=686.689 ASSIGNMENTS=0 CHECKS=4768650	? (problem) TT=0.458	? (problem) TT=0.451	No data	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=56.632	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=0.812	No data	? TT=650.389	? TT=655.208
csp/fapp/fapp40/ normalized-fapp40-3000-3.xml	UNSAT TT=44.642	UNSAT TT=44.642 CHECKS=4570620 NODES=0	UNSAT TT=44.88 CHECKS=4570620 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.12	? (problem) TT=89.69	? (problem) TT=84.367	? TT=572.058	? (TO) TT=866.23	? (TO) TT=854.51	UNSAT TT=645.201 ASSIGNMENTS=0 CHECKS=4570620	UNSAT TT=625.197 ASSIGNMENTS=0 CHECKS=4570620	? (problem) TT=0.422	? (problem) TT=0.422	No data	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=60.008	? (TO) TT=1800.17	? (TO) TT=1800.12	? TT=0.815	No data	? TT=640.526	? TT=611.91
csp/fapp/fapp40/ normalized-fapp40-3000-7.xml	SAT TT=72.287	SAT TT=78.214 CHECKS=61172000 NODES=3004	SAT TT=72.287 CHECKS=61181600 NODES=3004	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.05	? (problem) TT=83.158	? (problem) TT=76.663	? TT=587.281	? (TO) TT=887.26	? (TO) TT=825.86	SAT TT=651.993 ASSIGNMENTS=3004 CHECKS=61192800	SAT TT=684.029 ASSIGNMENTS=3004 CHECKS=61181600	? (problem) TT=0.451	? (problem) TT=0.458	No data	? (TO) TT=1800.12	? (TO) TT=1800.05	Wrong UNSAT TT=56.881	? (TO) TT=1800.13	? (TO) TT=1800.12	? TT=0.839	No data	? TT=694.72	? TT=612.659
csp/fischer/ normalized-fischer-10-13-fair.xml		? TT=8.573	? TT=8.522	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.18	? TT=186.293	? (TO) TT=184.03	? (TO) TT=181.75	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	No data	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.09	? TT=4.474	No data	? (MO) TT=1333.45	? (MO) TT=1453.95
csp/fischer/ normalized-fischer-10-3-fair.xml	UNSAT TT=1.303	? TT=8.385	? TT=8.24	UNSAT TT=3.793	UNSAT TT=3.849 CHECKS=595113	UNSAT TT=1.557 CHECKS=750206	? (TO) TT=1800.12	? (TO) TT=1800.14	? TT=14.437	? (TO) TT=14.33	? (TO) TT=15.35	UNSAT TT=10.189 ASSIGNMENTS=5701 CHECKS=2348860	UNSAT TT=9.687 ASSIGNMENTS=5701 CHECKS=2348860	? (TO) TT=1800.06	? (TO) TT=1800	No data	UNSAT TT=1.303 ASSIGNMENTS=3271 CHECKS=1063190	UNSAT TT=7.046 ASSIGNMENTS=7621 CHECKS=23277400	? (TO) TT=1800.09	UNSAT TT=2.801 ASSIGNMENTS=5759 CHECKS=3650820	UNSAT TT=2.002 ASSIGNMENTS=5701 CHECKS=2348860	? TT=2.57	No data	UNSAT TT=160.569	UNSAT TT=269.585
csp/fischer/ normalized-fischer-10-4-fair.xml	UNSAT TT=8.629	? TT=8.551	? TT=11.688	UNSAT TT=37.466	UNSAT TT=9.773 CHECKS=7435810	UNSAT TT=8.629 CHECKS=6218900	? (TO) TT=1800.08	? (TO) TT=1800.13	? TT=22.087	? (TO) TT=22.84	? (TO) TT=21.48	UNSAT TT=82.879 ASSIGNMENTS=162418 CHECKS=100197000	UNSAT TT=77.143 ASSIGNMENTS=162418 CHECKS=100197000	? (TO) TT=1800.08	? (TO) TT=1800.05	No data	UNSAT TT=12.218 ASSIGNMENTS=25643 CHECKS=16144800	UNSAT TT=14.39 ASSIGNMENTS=25332 CHECKS=30644600	? (TO) TT=1800.07	UNSAT TT=33.095 ASSIGNMENTS=55030 CHECKS=35295200	UNSAT TT=78.077 ASSIGNMENTS=162418 CHECKS=100197000	? TT=3.254	No data	? (MO) TT=195.02	UNSAT TT=362.817
csp/fischer/ normalized-fischer-10-7-fair.xml		? TT=8.868	? TT=9.425	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.16	? TT=60.352	? (TO) TT=60.95	? (TO) TT=60.39	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	No data	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=3.542	No data	? (MO) TT=445.02	? (MO) TT=560.75
csp/fischer/ normalized-fischer-10-9-fair.xml		? TT=10.062	? TT=10.159	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.08	? TT=93.049	? (TO) TT=94.9	? (TO) TT=93.37	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	No data	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=3.619	No data	? (MO) TT=706.661	? (MO) TT=814.34
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fischer/ normalized-fischer-11-10-fair.xml		? TT=8.531	? TT=8.632	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.16	? TT=141.302	? (TO) TT=141.57	? (TO) TT=145.12	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800	No data	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=4.094	No data	? (MO) TT=1126.64	? (MO) TT=1160.38
csp/fischer/ normalized-fischer-11-14-fair.xml		? TT=8.846	? TT=9.45	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.22	? (TO) TT=1800.14	? TT=276.799	? (TO) TT=281.1	? (TO) TT=277.61	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	No data	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.12	? TT=3.508	No data	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/fischer/ normalized-fischer-11-1-fair.xml	SAT TT=0.267	? TT=8.741	? TT=13.012	SAT TT=1.113	SAT TT=5.554 CHECKS=615038	SAT TT=3.805 CHECKS=2605130	? (TO) TT=1800.07	SAT TT=430.434 ASSIGNMENTS=23909	? TT=6.752	? (TO) TT=6.52	? (TO) TT=6.62	SAT TT=0.368 ASSIGNMENTS=72 CHECKS=406552	SAT TT=0.35 ASSIGNMENTS=72 CHECKS=406552	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	SAT TT=0.338 ASSIGNMENTS=72 CHECKS=406552	SAT TT=0.267 ASSIGNMENTS=59 CHECKS=90667	SAT TT=375.693	SAT TT=9.248 ASSIGNMENTS=30171 CHECKS=529275	SAT TT=0.309 ASSIGNMENTS=64 CHECKS=224645	? TT=2.213	No data	SAT TT=66.714	SAT TT=117.263
csp/fischer/ normalized-fischer-11-8-fair.xml		? TT=11.755	? TT=10.847	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.11	? TT=94.002	? (TO) TT=94.92	? (TO) TT=96.64	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.03	No data	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? TT=3.872	No data	? (MO) TT=738.7	? (MO) TT=810.45
csp/fischer/ normalized-fischer-1-3-fair.xml	UNSAT TT=0.047	? TT=18.857	? TT=19.291	UNSAT TT=0.224	UNSAT TT=1.546 CHECKS=6764	UNSAT TT=0.047 CHECKS=5081	UNSAT TT=1544.87 ASSIGNMENTS=2236150	UNSAT TT=18.489 ASSIGNMENTS=11668	? TT=138.808	? (TO) TT=133.61	? (TO) TT=134.97	UNSAT TT=0.065 ASSIGNMENTS=6 CHECKS=4020	UNSAT TT=0.061 ASSIGNMENTS=6 CHECKS=4020	? (TO) TT=1800.03	? (TO) TT=1800.06	No data	UNSAT TT=0.051 ASSIGNMENTS=4 CHECKS=3903	UNSAT TT=0.053 ASSIGNMENTS=18 CHECKS=10371	? (TO) TT=1800.11	UNSAT TT=0.056 ASSIGNMENTS=37 CHECKS=9037	UNSAT TT=0.051 ASSIGNMENTS=6 CHECKS=4020	? TT=33.926	No data	UNSAT TT=5.351	UNSAT TT=16.177
csp/fischer/ normalized-fischer-3-7-fair.xml	UNSAT TT=3.771	? TT=8.697	? TT=8.809	UNSAT TT=107.473	UNSAT TT=244.222 CHECKS=97671000	UNSAT TT=28.176 CHECKS=18782900	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=10.863	? (TO) TT=8.7	? (TO) TT=10.38	UNSAT TT=11.599 ASSIGNMENTS=6232 CHECKS=10829900	UNSAT TT=11.673 ASSIGNMENTS=6232 CHECKS=10829900	? (TO) TT=1800.06	? (TO) TT=1800.04	No data	? (TO) TT=1800.08	UNSAT TT=22.516 ASSIGNMENTS=40623 CHECKS=80133700	? (TO) TT=1800.12	UNSAT TT=248.404 ASSIGNMENTS=567020 CHECKS=391439000	UNSAT TT=3.771 ASSIGNMENTS=6232 CHECKS=10829900	? TT=3.032	No data	UNSAT TT=96.688	UNSAT TT=132.693
csp/fischer/ normalized-fischer-3-8-fair.xml	SAT TT=2.434	? TT=8.956	? TT=8.93	SAT TT=393.921	SAT TT=278.73 CHECKS=104795000	SAT TT=33.395 CHECKS=22408600	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=10.047	? (TO) TT=9.85	? (TO) TT=9.34	SAT TT=10.083 ASSIGNMENTS=2875 CHECKS=5245520	SAT TT=10.465 ASSIGNMENTS=2875 CHECKS=5245520	? (TO) TT=1800.03	? (TO) TT=1800.08	No data	? (TO) TT=1800.11	SAT TT=3.729 ASSIGNMENTS=6768 CHECKS=12788300	? (TO) TT=1800.13	SAT TT=6.223 ASSIGNMENTS=5488 CHECKS=21236500	SAT TT=2.434 ASSIGNMENTS=2875 CHECKS=5245520	? TT=3.251	No data	SAT TT=144.583	SAT TT=170.417
csp/fischer/ normalized-fischer-4-3-fair.xml	UNSAT TT=0.217	? TT=11.948	? TT=8.89	UNSAT TT=0.811	UNSAT TT=4.881 CHECKS=204944	UNSAT TT=0.514 CHECKS=236277	? (TO) TT=1800.08	? (TO) TT=1800.17	? TT=6.472	? (TO) TT=7.03	? (TO) TT=6.31	UNSAT TT=0.256 ASSIGNMENTS=112 CHECKS=59002	UNSAT TT=0.233 ASSIGNMENTS=112 CHECKS=59002	? (TO) TT=1800.03	? (TO) TT=1800.01	No data	UNSAT TT=0.231 ASSIGNMENTS=181 CHECKS=56491	UNSAT TT=3.005 ASSIGNMENTS=4296 CHECKS=12293300	? (TO) TT=1800.11	UNSAT TT=0.295 ASSIGNMENTS=163 CHECKS=371817	UNSAT TT=0.217 ASSIGNMENTS=139 CHECKS=62790	? TT=2.297	No data	UNSAT TT=35.012	UNSAT TT=71.104
csp/fischer/ normalized-fischer-4-5-fair.xml	UNSAT TT=0.671	? TT=10.282	? TT=9.118	UNSAT TT=9.143	UNSAT TT=36.97 CHECKS=20987900	UNSAT TT=3.611 CHECKS=5038490	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=8.496	? (TO) TT=8.16	? (TO) TT=8.34	UNSAT TT=0.697 ASSIGNMENTS=1141 CHECKS=735989	UNSAT TT=0.671 ASSIGNMENTS=1141 CHECKS=735989	? (TO) TT=1800.01	? (TO) TT=1800.08	No data	UNSAT TT=0.714 ASSIGNMENTS=1293 CHECKS=723542	UNSAT TT=3.152 ASSIGNMENTS=5951 CHECKS=12005700	? (TO) TT=1800.1	UNSAT TT=26.045 ASSIGNMENTS=60371 CHECKS=16227800	UNSAT TT=0.809 ASSIGNMENTS=1515 CHECKS=979529	? TT=2.987	No data	UNSAT TT=79.357	UNSAT TT=115.514
csp/fischer/ normalized-fischer-4-7-fair.xml	UNSAT TT=9.967	? TT=11.144	? TT=8.372	UNSAT TT=741.046	UNSAT TT=232.195 CHECKS=97493600	UNSAT TT=73.521 CHECKS=41031000	? (TO) TT=1800.09	? (TO) TT=1800.13	? TT=11.435	? (TO) TT=11.39	? (TO) TT=12.13	UNSAT TT=32.662 ASSIGNMENTS=37687 CHECKS=75980000	UNSAT TT=35.511 ASSIGNMENTS=37687 CHECKS=75980000	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	UNSAT TT=9.967 ASSIGNMENTS=13801 CHECKS=28876400	UNSAT TT=31.76 ASSIGNMENTS=45463 CHECKS=96490500	? (TO) TT=1800.1	UNSAT TT=24.947 ASSIGNMENTS=35301 CHECKS=63197700	UNSAT TT=26.709 ASSIGNMENTS=37687 CHECKS=75980000	? TT=2.645	No data	UNSAT TT=146.316	UNSAT TT=241.585
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fischer/ normalized-fischer-5-7-fair.xml	UNSAT TT=35.801	? TT=8.737	? TT=9.728	? (TO) TT=1800.07	UNSAT TT=287.455 CHECKS=107568000	UNSAT TT=171.928 CHECKS=83777100	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=16.55	? (TO) TT=18.59	? (TO) TT=16.5	UNSAT TT=168.788 ASSIGNMENTS=216764 CHECKS=381172000	UNSAT TT=157.893 ASSIGNMENTS=216764 CHECKS=381172000	? (TO) TT=1800.01	? (TO) TT=1800.02	No data	UNSAT TT=35.801 ASSIGNMENTS=48166 CHECKS=85378200	UNSAT TT=40.134 ASSIGNMENTS=57924 CHECKS=121142000	? (TO) TT=1800.11	UNSAT TT=190.743 ASSIGNMENTS=226285 CHECKS=416922000	UNSAT TT=150.655 ASSIGNMENTS=216764 CHECKS=381172000	? TT=2.649	No data	UNSAT TT=198.9	UNSAT TT=298.366
csp/fischer/ normalized-fischer-6-11-fair.xml	SAT TT=57.416	? TT=9.065	? TT=8.95	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.15	? TT=56.905	? (TO) TT=57.48	? (TO) TT=56.71	SAT TT=217.742 ASSIGNMENTS=97133 CHECKS=639333000	SAT TT=213.87 ASSIGNMENTS=97133 CHECKS=639333000	? (TO) TT=1800.08	? (TO) TT=1800.02	No data	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=837.111 ASSIGNMENTS=435897 CHECKS=1940240000	SAT TT=207.135 ASSIGNMENTS=97133 CHECKS=639333000	? TT=3.736	No data	? (MO) TT=378.22	? (MO) TT=530.755
csp/fischer/ normalized-fischer-6-4-fair.xml	UNSAT TT=0.899	? TT=9.157	? TT=10.562	UNSAT TT=2.012	UNSAT TT=5.776 CHECKS=2966720	UNSAT TT=2.685 CHECKS=2830600	? (TO) TT=1800.11	? (TO) TT=1800.14	? TT=11.69	? (TO) TT=11.04	? (TO) TT=10.5	UNSAT TT=1.011 ASSIGNMENTS=2019 CHECKS=1056780	UNSAT TT=1.023 ASSIGNMENTS=2019 CHECKS=1056780	? (TO) TT=1800.04	? (TO) TT=1800.08	No data	UNSAT TT=0.899 ASSIGNMENTS=1440 CHECKS=644124	UNSAT TT=4.748 ASSIGNMENTS=6571 CHECKS=15436700	? (TO) TT=1800.06	UNSAT TT=1.015 ASSIGNMENTS=1425 CHECKS=758630	UNSAT TT=0.945 ASSIGNMENTS=1858 CHECKS=1033880	? TT=3.209	No data	UNSAT TT=102.584	UNSAT TT=171.396
csp/fischer/ normalized-fischer-6-5-fair.xml	UNSAT TT=3.389	? TT=9.063	? TT=9.249	UNSAT TT=154.066	UNSAT TT=15.592 CHECKS=14647100	UNSAT TT=4.637 CHECKS=5646940	? (TO) TT=1800.14	? (TO) TT=1800.1	? TT=14.585	? (TO) TT=12.93	? (TO) TT=13.88	UNSAT TT=19.167 ASSIGNMENTS=26633 CHECKS=18768600	UNSAT TT=20.392 ASSIGNMENTS=26633 CHECKS=18768600	? (TO) TT=1800.09	? (TO) TT=1800.09	No data	UNSAT TT=3.389 ASSIGNMENTS=7340 CHECKS=4785990	UNSAT TT=6.601 ASSIGNMENTS=11722 CHECKS=19471500	? (TO) TT=1800.06	UNSAT TT=14.018 ASSIGNMENTS=25574 CHECKS=18226400	UNSAT TT=11.44 ASSIGNMENTS=26633 CHECKS=18768600	? TT=2.534	No data	UNSAT TT=184.09	UNSAT TT=224.696
csp/fischer/ normalized-fischer-6-7-fair.xml	UNSAT TT=119.743	? TT=10.142	? TT=12.806	? (TO) TT=1800.05	UNSAT TT=406.253 CHECKS=137578000	UNSAT TT=536.647 CHECKS=221728000	? (TO) TT=1800.15	? (TO) TT=1800.12	? TT=22.073	? (TO) TT=21.68	? (TO) TT=21.59	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800	No data	UNSAT TT=119.743 ASSIGNMENTS=144660 CHECKS=254227000	UNSAT TT=121.475 ASSIGNMENTS=158668 CHECKS=279944000	? (TO) TT=1800.03	UNSAT TT=438.638 ASSIGNMENTS=487363 CHECKS=744092000	? (TO) TT=1800.07	? TT=3.193	No data	UNSAT TT=345.985	UNSAT TT=383.907
csp/fischer/ normalized-fischer-7-12-fair.xml	SAT TT=1403.18	? TT=8.409	? TT=12.273	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.16	? TT=76.597	? (TO) TT=76.55	? (TO) TT=75.38	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	No data	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=1403.18 ASSIGNMENTS=549108 CHECKS=2282700000	? (TO) TT=1800.08	? TT=3.701	No data	? (MO) TT=587.561	? (MO) TT=667.26
csp/fischer/ normalized-fischer-7-3-fair.xml	UNSAT TT=0.535	? TT=8.428	? TT=10.713	UNSAT TT=1.515	UNSAT TT=3.654 CHECKS=279351	UNSAT TT=1.465 CHECKS=798091	? (TO) TT=1800.16	? (TO) TT=1800.07	? TT=8.713	? (TO) TT=8.27	? (TO) TT=8.39	UNSAT TT=0.546 ASSIGNMENTS=704 CHECKS=259497	UNSAT TT=0.535 ASSIGNMENTS=704 CHECKS=259497	? (TO) TT=1800.01	? (TO) TT=1800.09	No data	UNSAT TT=0.549 ASSIGNMENTS=777 CHECKS=228418	UNSAT TT=4.566 ASSIGNMENTS=5483 CHECKS=17690900	? (TO) TT=1800.12	UNSAT TT=0.992 ASSIGNMENTS=1011 CHECKS=717541	UNSAT TT=0.575 ASSIGNMENTS=907 CHECKS=338071	? TT=3.16	No data	UNSAT TT=84.829	UNSAT TT=156.302
csp/fischer/ normalized-fischer-7-4-fair.xml	UNSAT TT=1.476	? TT=8.604	? TT=8.645	UNSAT TT=2.869	UNSAT TT=6.846 CHECKS=3903290	UNSAT TT=7.716 CHECKS=3155140	? (TO) TT=1800.12	? (TO) TT=1800.32	? TT=13.155	? (TO) TT=13.94	? (TO) TT=14.07	UNSAT TT=9.769 ASSIGNMENTS=3262 CHECKS=1681260	UNSAT TT=1.908 ASSIGNMENTS=4698 CHECKS=2510770	? (TO) TT=1800.05	? (TO) TT=1800.04	No data	UNSAT TT=1.476 ASSIGNMENTS=2780 CHECKS=1322900	UNSAT TT=5.667 ASSIGNMENTS=9327 CHECKS=18040100	? (TO) TT=1800.04	UNSAT TT=99.116 ASSIGNMENTS=127928 CHECKS=68389800	UNSAT TT=2.597 ASSIGNMENTS=3262 CHECKS=1681260	? TT=2.573	No data	UNSAT TT=157.091	UNSAT TT=218.708
csp/fischer/ normalized-fischer-8-11-fair.xml		? TT=10.287	? TT=8.935	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.18	? TT=95.659	? (TO) TT=90.72	? (TO) TT=89.81	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.11	? TT=4.115	No data	? (MO) TT=639.262	? (MO) TT=822.97
csp/fischer/ normalized-fischer-8-3-fair.xml	UNSAT TT=0.625	? TT=11.882	? TT=9.592	UNSAT TT=1.903	UNSAT TT=3.635 CHECKS=411782	UNSAT TT=1.057 CHECKS=500543	? (TO) TT=1800.13	? (TO) TT=1800.11	? TT=10.043	? (TO) TT=12.29	? (TO) TT=12.17	UNSAT TT=0.92 ASSIGNMENTS=1862 CHECKS=704939	UNSAT TT=0.812 ASSIGNMENTS=1862 CHECKS=704939	? (TO) TT=1800.09	? (TO) TT=1800.08	No data	UNSAT TT=0.625 ASSIGNMENTS=1116 CHECKS=368377	UNSAT TT=4.65 ASSIGNMENTS=6196 CHECKS=17507800	? (TO) TT=1800.12	UNSAT TT=1.392 ASSIGNMENTS=2406 CHECKS=1351640	UNSAT TT=1.076 ASSIGNMENTS=2698 CHECKS=1008890	? TT=3.509	No data	UNSAT TT=101.627	UNSAT TT=179.364
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fischer/ normalized-fischer-9-1-fair.xml	SAT TT=0.248	? TT=9.779	? TT=10.426	SAT TT=0.858	SAT TT=50.08 CHECKS=10428800	SAT TT=4.845 CHECKS=3024060	? (TO) TT=1800.1	SAT TT=17.555 ASSIGNMENTS=2254	? TT=6.171	? (TO) TT=5.45	? (TO) TT=5.47	SAT TT=0.274 ASSIGNMENTS=126 CHECKS=297862	SAT TT=0.276 ASSIGNMENTS=126 CHECKS=297862	? (TO) TT=1800.04	? (TO) TT=1800.08	No data	SAT TT=0.267 ASSIGNMENTS=126 CHECKS=297862	SAT TT=0.248 ASSIGNMENTS=117 CHECKS=168746	SAT TT=57.813	SAT TT=2.559 ASSIGNMENTS=10017 CHECKS=188061	SAT TT=0.259 ASSIGNMENTS=126 CHECKS=218936	? TT=2.004	No data	SAT TT=46.24	SAT TT=96.158
csp/fischer/ normalized-fischer-9-2-fair.xml	UNSAT TT=2.713	? TT=8.487	? TT=8.403	UNSAT TT=57.475	UNSAT TT=6.186 CHECKS=1600900	UNSAT TT=2.713 CHECKS=1589810	? (TO) TT=1800.16	? (TO) TT=1800.06	? TT=9.194	? (TO) TT=8.78	? (TO) TT=9.26	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	No data	UNSAT TT=1291.43 ASSIGNMENTS=7473280 CHECKS=1320930000	UNSAT TT=14.985 ASSIGNMENTS=28689 CHECKS=59924100	? (TO) TT=1800.08	UNSAT TT=5.422 ASSIGNMENTS=7502 CHECKS=10509300	? (TO) TT=1800.02	? TT=2.898	No data	UNSAT TT=76.46	UNSAT TT=164.58
csp/fischer/ normalized-fischer-9-4-fair.xml	UNSAT TT=5.672	? TT=8.883	? TT=10.321	UNSAT TT=15.213	UNSAT TT=8.973 CHECKS=6207910	UNSAT TT=5.672 CHECKS=4780150	? (TO) TT=1800.12	? (TO) TT=1800.09	? TT=17.785	? (TO) TT=17.39	? (TO) TT=18.12	UNSAT TT=25.756 ASSIGNMENTS=40097 CHECKS=23634500	UNSAT TT=24.505 ASSIGNMENTS=40097 CHECKS=23634500	? (TO) TT=1800.07	? (TO) TT=1800	No data	UNSAT TT=8.405 ASSIGNMENTS=17044 CHECKS=11217400	UNSAT TT=10.866 ASSIGNMENTS=21214 CHECKS=25730400	? (TO) TT=1800.04	UNSAT TT=9.05 ASSIGNMENTS=14040 CHECKS=9230950	UNSAT TT=16.866 ASSIGNMENTS=40097 CHECKS=23634500	? TT=2.837	No data	UNSAT TT=212.554	UNSAT TT=305.81
csp/fischer/ normalized-fischer-9-6-fair.xml	UNSAT TT=125.751	? TT=8.488	? TT=8.554	? (TO) TT=1800.09	UNSAT TT=125.751 CHECKS=61394200	UNSAT TT=358.86 CHECKS=111003000	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=38.227	? (TO) TT=38.14	? (TO) TT=37.94	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	No data	UNSAT TT=334.426 ASSIGNMENTS=415556 CHECKS=518887000	UNSAT TT=382.529 ASSIGNMENTS=404784 CHECKS=511161000	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.01	? TT=3.319	No data	? (MO) TT=293.34	? (MO) TT=425.74
csp/frb30-15/ normalized-frb30-15-2_ext.xml	SAT TT=0.48	SAT TT=1.176 CHECKS=1297170 NODES=1277	SAT TT=1.227 CHECKS=1322770 NODES=1268	SAT TT=1.118	SAT TT=4.227 CHECKS=1528470	SAT TT=12.847 CHECKS=5075230	SAT TT=3.55 ASSIGNMENTS=4256	SAT TT=6.611 ASSIGNMENTS=4256	SAT TT=3.175 CHECKS=730474 NODES=9587	SAT TT=0.746 CHECKS=1117400 NODES=3869	? (TO) TT=1800.01	SAT TT=0.772 ASSIGNMENTS=8366 CHECKS=3192600	SAT TT=0.767 ASSIGNMENTS=8366 CHECKS=3192600	SAT TT=3.906	SAT TT=8.538	No data	SAT TT=0.48 ASSIGNMENTS=5794 CHECKS=2176340	SAT TT=0.791 ASSIGNMENTS=10173 CHECKS=3325610	SAT TT=7.818	SAT TT=0.759 ASSIGNMENTS=8492 CHECKS=3243040	SAT TT=0.742 ASSIGNMENTS=8366 CHECKS=3192600	SAT TT=7.679	SAT TT=6.992 ASSIGNMENTS=3908 CHECKS=5281080	SAT TT=2.372	SAT TT=4.91
csp/frb30-15/ normalized-frb30-15-3_ext.xml	SAT TT=0.232	SAT TT=1.436 CHECKS=2200670 NODES=2076	SAT TT=1.374 CHECKS=2245180 NODES=2116	SAT TT=0.873	SAT TT=8.603 CHECKS=2986530	SAT TT=1.246 CHECKS=447432	SAT TT=3.11 ASSIGNMENTS=3205	SAT TT=2.925 ASSIGNMENTS=3205	SAT TT=1.391 CHECKS=255344 NODES=3153	SAT TT=0.847 CHECKS=1484340 NODES=5241	? (TO) TT=1800.01	SAT TT=0.618 ASSIGNMENTS=6409 CHECKS=2506560	SAT TT=0.611 ASSIGNMENTS=6409 CHECKS=2506560	SAT TT=3.224	SAT TT=3.781	No data	SAT TT=0.251 ASSIGNMENTS=2502 CHECKS=981803	SAT TT=0.232 ASSIGNMENTS=3601 CHECKS=870854	SAT TT=2.914	SAT TT=0.564 ASSIGNMENTS=6040 CHECKS=2325810	SAT TT=0.55 ASSIGNMENTS=6409 CHECKS=2506560	SAT TT=10.667	SAT TT=1.787 ASSIGNMENTS=902 CHECKS=1402030	SAT TT=3.212	SAT TT=2.107
csp/frb30-15/ normalized-frb30-15-3-mgd_ext.xml	SAT TT=0.104	SAT TT=1.485 CHECKS=2050380 NODES=1974	SAT TT=1.56 CHECKS=2357120 NODES=2190	SAT TT=0.844	SAT TT=7.032 CHECKS=2593850	SAT TT=0.756 CHECKS=239356	SAT TT=2.013 ASSIGNMENTS=1872	SAT TT=2.193 ASSIGNMENTS=1872	SAT TT=0.625 CHECKS=20868 NODES=190	SAT TT=1.414 CHECKS=4458570 NODES=20899	? (TO) TT=1800.03	SAT TT=0.117 ASSIGNMENTS=946 CHECKS=358327	SAT TT=0.124 ASSIGNMENTS=946 CHECKS=358327	SAT TT=3.446	SAT TT=3.781	No data	SAT TT=0.104 ASSIGNMENTS=829 CHECKS=311856	SAT TT=0.225 ASSIGNMENTS=3494 CHECKS=796360	SAT TT=1.298	SAT TT=0.124 ASSIGNMENTS=1188 CHECKS=412758	SAT TT=0.114 ASSIGNMENTS=946 CHECKS=358327	SAT TT=3.645	SAT TT=4.139 ASSIGNMENTS=2754 CHECKS=4194390	SAT TT=1.174	SAT TT=1.375
csp/frb30-15/ normalized-frb30-15-4_ext.xml	SAT TT=0.535	SAT TT=1.471 CHECKS=2149640 NODES=2044	SAT TT=1.476 CHECKS=2001490 NODES=1873	SAT TT=0.569	SAT TT=13.818 CHECKS=4880750	SAT TT=7.603 CHECKS=3098850	SAT TT=2.69 ASSIGNMENTS=3280	SAT TT=2.671 ASSIGNMENTS=3280	SAT TT=1.934 CHECKS=385312 NODES=4958	SAT TT=0.795 CHECKS=1387120 NODES=4912	SAT TT=1.094 CHECKS=2253980 NODES=4524	SAT TT=0.563 ASSIGNMENTS=5722 CHECKS=2187620	SAT TT=0.549 ASSIGNMENTS=5722 CHECKS=2187620	SAT TT=3.375	SAT TT=5.238	No data	SAT TT=0.569 ASSIGNMENTS=6310 CHECKS=2346240	SAT TT=0.626 ASSIGNMENTS=8407 CHECKS=2575520	SAT TT=5.152	SAT TT=0.538 ASSIGNMENTS=6574 CHECKS=2432320	SAT TT=0.535 ASSIGNMENTS=5722 CHECKS=2187620	SAT TT=5.162	SAT TT=3.59 ASSIGNMENTS=1245 CHECKS=1766670	SAT TT=2.1	SAT TT=1.962
csp/frb30-15/ normalized-frb30-15-5-mgd_ext.xml	SAT TT=0.076	SAT TT=1.641 CHECKS=3631220 NODES=3306	SAT TT=1.642 CHECKS=3560470 NODES=3191	SAT TT=0.575	SAT TT=23.173 CHECKS=8382770	SAT TT=1.881 CHECKS=583739	SAT TT=1.315 ASSIGNMENTS=867	SAT TT=1.311 ASSIGNMENTS=867	SAT TT=1.028 CHECKS=159171 NODES=1547	SAT TT=0.951 CHECKS=2146380 NODES=10447	? (TO) TT=1800.03	SAT TT=0.086 ASSIGNMENTS=515 CHECKS=198122	SAT TT=0.087 ASSIGNMENTS=515 CHECKS=198122	SAT TT=2.669	SAT TT=2.176	No data	SAT TT=0.167 ASSIGNMENTS=1652 CHECKS=656748	SAT TT=0.33 ASSIGNMENTS=4633 CHECKS=1235290	SAT TT=2.201	SAT TT=0.161 ASSIGNMENTS=1668 CHECKS=610834	SAT TT=0.076 ASSIGNMENTS=515 CHECKS=198122	SAT TT=4.008	SAT TT=1.455 ASSIGNMENTS=1473 CHECKS=2469010	SAT TT=1.161	SAT TT=1.591
csp/frb35-17/ normalized-frb35-17-1_ext.xml	SAT TT=1.414	SAT TT=4.267 CHECKS=17982000 NODES=13236	SAT TT=4.222 CHECKS=17404500 NODES=12846	SAT TT=1.711	SAT TT=20.617 CHECKS=6364460	SAT TT=10.276 CHECKS=3036390	SAT TT=5.716 ASSIGNMENTS=6144	SAT TT=5.852 ASSIGNMENTS=6144	SAT TT=5.297 CHECKS=1370210 NODES=14470	SAT TT=2.361 CHECKS=13076700 NODES=38829	? (TO) TT=1800.04	SAT TT=1.505 ASSIGNMENTS=14573 CHECKS=6635520	SAT TT=9.1 ASSIGNMENTS=14573 CHECKS=6635520	SAT TT=12.389	SAT TT=77.162	No data	SAT TT=1.414 ASSIGNMENTS=13166 CHECKS=5972560	SAT TT=1.427 ASSIGNMENTS=14626 CHECKS=5926340	SAT TT=26.611	SAT TT=1.445 ASSIGNMENTS=13301 CHECKS=6010240	SAT TT=1.583 ASSIGNMENTS=14573 CHECKS=6635520	SAT TT=56.176	SAT TT=14.269 ASSIGNMENTS=7192 CHECKS=13335200	SAT TT=14.802	SAT TT=15.327
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb35-17/ normalized-frb35-17-1-mgd_ext.xml	SAT TT=0.455	SAT TT=4.074 CHECKS=16945800 NODES=12506	SAT TT=4.231 CHECKS=17529200 NODES=12965	SAT TT=2.011	SAT TT=13.679 CHECKS=4191500	SAT TT=14.89 CHECKS=3985110	SAT TT=8.823 ASSIGNMENTS=9389	SAT TT=8.923 ASSIGNMENTS=9389	SAT TT=2.899 CHECKS=925837 NODES=7788	SAT TT=6.556 CHECKS=43404000 NODES=171674	? (TO) TT=1800.02	SAT TT=1.436 ASSIGNMENTS=11853 CHECKS=5633610	SAT TT=1.435 ASSIGNMENTS=11853 CHECKS=5633610	SAT TT=14.304	SAT TT=47.528	No data	SAT TT=1.032 ASSIGNMENTS=9529 CHECKS=4391920	SAT TT=1.053 ASSIGNMENTS=10522 CHECKS=4107470	SAT TT=19.22	SAT TT=0.455 ASSIGNMENTS=3877 CHECKS=1665750	SAT TT=1.422 ASSIGNMENTS=11853 CHECKS=5633610	SAT TT=24.086	SAT TT=15.484 ASSIGNMENTS=12733 CHECKS=24512300	SAT TT=10.009	SAT TT=19.222
csp/frb35-17/ normalized-frb35-17-2_ext.xml	SAT TT=1.292	SAT TT=6.764 CHECKS=32619000 NODES=26172	SAT TT=7.012 CHECKS=30940000 NODES=24648	SAT TT=1.292	SAT TT=109.451 CHECKS=34546600	SAT TT=71.819 CHECKS=23712600	SAT TT=23.19 ASSIGNMENTS=30811	SAT TT=21.731 ASSIGNMENTS=30811	SAT TT=16.052 CHECKS=4642070 NODES=53894	SAT TT=32.967 CHECKS=239608000 NODES=719505	? (TO) TT=1800.08	SAT TT=9.625 ASSIGNMENTS=26903 CHECKS=11724300	SAT TT=10.263 ASSIGNMENTS=26903 CHECKS=11724300	SAT TT=10.045	SAT TT=122.021	No data	SAT TT=6.453 ASSIGNMENTS=63528 CHECKS=27836600	SAT TT=1.626 ASSIGNMENTS=18543 CHECKS=7393470	SAT TT=119.057	SAT TT=1.646 ASSIGNMENTS=15967 CHECKS=6859800	SAT TT=2.796 ASSIGNMENTS=26903 CHECKS=11724300	SAT TT=217.797	SAT TT=41.848 ASSIGNMENTS=28391 CHECKS=45506800	SAT TT=22.863	SAT TT=4.26
csp/frb35-17/ normalized-frb35-17-2-mgd_ext.xml	SAT TT=1.04	SAT TT=7.054 CHECKS=31423100 NODES=25353	SAT TT=7.378 CHECKS=33449100 NODES=26916	SAT TT=1.206	SAT TT=144.091 CHECKS=44230300	SAT TT=95.396 CHECKS=24573400	SAT TT=14.69 ASSIGNMENTS=19103	SAT TT=14.864 ASSIGNMENTS=19103	SAT TT=12.415 CHECKS=4583950 NODES=43269	SAT TT=11.06 CHECKS=73984900 NODES=294981	? (TO) TT=1800.02	SAT TT=1.424 ASSIGNMENTS=13720 CHECKS=5967700	SAT TT=1.404 ASSIGNMENTS=13720 CHECKS=5967700	SAT TT=146.405	SAT TT=33.868	No data	SAT TT=1.66 ASSIGNMENTS=15533 CHECKS=6716900	SAT TT=1.407 ASSIGNMENTS=15433 CHECKS=6100480	SAT TT=37.496	SAT TT=1.04 ASSIGNMENTS=9896 CHECKS=4141940	SAT TT=1.507 ASSIGNMENTS=13720 CHECKS=5967700	SAT TT=170.818	SAT TT=12.521 ASSIGNMENTS=10627 CHECKS=17243600	SAT TT=71.743	SAT TT=41.51
csp/frb35-17/ normalized-frb35-17-5_ext.xml	SAT TT=0.369	SAT TT=17.705 CHECKS=89886200 NODES=68293	SAT TT=16.402 CHECKS=89154700 NODES=67925	SAT TT=5.24	SAT TT=22.799 CHECKS=7397240	SAT TT=107.386 CHECKS=35261300	SAT TT=22.693 ASSIGNMENTS=29214	SAT TT=23.09 ASSIGNMENTS=29214	SAT TT=12.484 CHECKS=3462450 NODES=38369	SAT TT=3.645 CHECKS=20069400 NODES=60271	? (TO) TT=1800.06	SAT TT=9.848 ASSIGNMENTS=22150 CHECKS=10223400	SAT TT=9.46 ASSIGNMENTS=22150 CHECKS=10223400	SAT TT=34.783	SAT TT=194.048	No data	SAT TT=3.725 ASSIGNMENTS=35072 CHECKS=16211400	SAT TT=0.465 ASSIGNMENTS=5323 CHECKS=1795740	SAT TT=35.136	SAT TT=2.086 ASSIGNMENTS=19113 CHECKS=8798110	SAT TT=2.434 ASSIGNMENTS=22150 CHECKS=10223400	SAT TT=393.296	SAT TT=0.369 ASSIGNMENTS=224 CHECKS=269523	SAT TT=56.455	SAT TT=76.906
csp/frb40-19/ normalized-frb40-19-1_ext.xml	SAT TT=1.284	SAT TT=1.473 CHECKS=1486350 NODES=1112	SAT TT=1.284 CHECKS=1395190 NODES=997	SAT TT=9.429	SAT TT=444.893 CHECKS=113052000	SAT TT=476.993 CHECKS=135474000	SAT TT=28.796 ASSIGNMENTS=31770	SAT TT=29.867 ASSIGNMENTS=31770	SAT TT=29.909 CHECKS=8685270 NODES=81694	SAT TT=2.871 CHECKS=16974000 NODES=44106	? (TO) TT=1800.06	SAT TT=17.506 ASSIGNMENTS=79447 CHECKS=41005000	SAT TT=8.907 ASSIGNMENTS=1112 CHECKS=1486350	SAT TT=32.975	SAT TT=4.168	No data	SAT TT=10.181 ASSIGNMENTS=81156 CHECKS=41923900	SAT TT=10.059 ASSIGNMENTS=81824 CHECKS=41651600	SAT TT=73.093	SAT TT=9.4 ASSIGNMENTS=78925 CHECKS=40697200	SAT TT=9.914 ASSIGNMENTS=79447 CHECKS=41005000	SAT TT=276.901	SAT TT=116.309 ASSIGNMENTS=50335 CHECKS=104712000	SAT TT=46.349	SAT TT=40.14
csp/frb40-19/ normalized-frb40-19-1-mgd_ext.xml	SAT TT=1.265	SAT TT=1.462 CHECKS=2543180 NODES=1893	SAT TT=1.265 CHECKS=1047030 NODES=744	SAT TT=9.971	SAT TT=703.803 CHECKS=189262000	SAT TT=29.645 CHECKS=5676960	SAT TT=29.123 ASSIGNMENTS=30271	SAT TT=29.503 ASSIGNMENTS=30271	SAT TT=15.225 CHECKS=5281000 NODES=40765	SAT TT=2.509 CHECKS=13794700 NODES=45990	? (TO) TT=1800.03	SAT TT=12.722 ASSIGNMENTS=44231 CHECKS=23776100	SAT TT=8.661 ASSIGNMENTS=1893 CHECKS=2543180	SAT TT=56.419	SAT TT=132.725	No data	SAT TT=5.454 ASSIGNMENTS=43261 CHECKS=23091600	SAT TT=5.362 ASSIGNMENTS=41197 CHECKS=21070800	SAT TT=53.618	SAT TT=5.451 ASSIGNMENTS=43164 CHECKS=23027900	SAT TT=6.021 ASSIGNMENTS=44231 CHECKS=23776100	SAT TT=68.325	SAT TT=79.653 ASSIGNMENTS=49268 CHECKS=103013000	SAT TT=8.493	SAT TT=35.889
csp/frb40-19/ normalized-frb40-19-2_ext.xml	SAT TT=1.401	SAT TT=1.401 CHECKS=1968880 NODES=1491	SAT TT=1.492 CHECKS=2250610 NODES=1749	SAT TT=35.332	SAT TT=412.852 CHECKS=109540000	SAT TT=139.972 CHECKS=36091400	SAT TT=51.201 ASSIGNMENTS=62844	SAT TT=54.55 ASSIGNMENTS=62844	SAT TT=29.252 CHECKS=7789540 NODES=73522	SAT TT=51.095 CHECKS=365420000 NODES=951552	? (TO) TT=1800.04	SAT TT=22.778 ASSIGNMENTS=122062 CHECKS=62635700	SAT TT=9.219 ASSIGNMENTS=1491 CHECKS=1968880	SAT TT=67.686	SAT TT=383.43	No data	SAT TT=14.262 ASSIGNMENTS=123409 CHECKS=63059400	SAT TT=8.142 ASSIGNMENTS=66182 CHECKS=33546700	SAT TT=108.797	SAT TT=9.856 ASSIGNMENTS=78210 CHECKS=40268900	SAT TT=15.19 ASSIGNMENTS=122062 CHECKS=62635700	SAT TT=333.918	SAT TT=168.113 ASSIGNMENTS=137602 CHECKS=273439000	SAT TT=80.349	SAT TT=194.22
csp/frb40-19/ normalized-frb40-19-2-mgd_ext.xml	SAT TT=1.833	SAT TT=2.053 CHECKS=4801120 NODES=3785	SAT TT=1.908 CHECKS=3823490 NODES=2909	SAT TT=11.158	SAT TT=344.771 CHECKS=88365000	SAT TT=161.67 CHECKS=32992300	SAT TT=16.038 ASSIGNMENTS=17329	SAT TT=17.402 ASSIGNMENTS=17329	SAT TT=24.206 CHECKS=8871590 NODES=69356	SAT TT=27.059 CHECKS=184894000 NODES=610905	? (TO) TT=1800	SAT TT=18.743 ASSIGNMENTS=87455 CHECKS=46217800	SAT TT=9.836 ASSIGNMENTS=3785 CHECKS=4801120	SAT TT=97.854	SAT TT=226.271	No data	SAT TT=11.777 ASSIGNMENTS=88457 CHECKS=46753900	SAT TT=10.891 ASSIGNMENTS=89318 CHECKS=46667200	SAT TT=37.788	SAT TT=1.833 ASSIGNMENTS=14154 CHECKS=6941560	SAT TT=11.657 ASSIGNMENTS=87455 CHECKS=46217800	SAT TT=485.443	SAT TT=122.091 ASSIGNMENTS=48051 CHECKS=95391700	SAT TT=113.424	SAT TT=118.982
csp/frb40-19/ normalized-frb40-19-4-mgd_ext.xml	SAT TT=11.577	SAT TT=77.087 CHECKS=461083000 NODES=305197	SAT TT=80.622 CHECKS=451112000 NODES=297888	SAT TT=11.577	SAT TT=553.672 CHECKS=156444000	SAT TT=548.543 CHECKS=118406000	SAT TT=23.744 ASSIGNMENTS=24644	SAT TT=23.428 ASSIGNMENTS=24644	SAT TT=28.12 CHECKS=9476980 NODES=76187	SAT TT=21.197 CHECKS=152218000 NODES=494901	? (TO) TT=1800.01	SAT TT=33.728 ASSIGNMENTS=199268 CHECKS=103528000	SAT TT=84.116 ASSIGNMENTS=305197 CHECKS=461083000	SAT TT=1688.18	SAT TT=204.461	No data	SAT TT=27.784 ASSIGNMENTS=213490 CHECKS=110685000	SAT TT=26.586 ASSIGNMENTS=201173 CHECKS=103774000	SAT TT=163.345	SAT TT=25.784 ASSIGNMENTS=196827 CHECKS=102505000	SAT TT=25.79 ASSIGNMENTS=199268 CHECKS=103528000	SAT TT=1395.18	SAT TT=306.9 ASSIGNMENTS=221577 CHECKS=455603000	SAT TT=183.355	SAT TT=192.929
csp/frb45-21/ normalized-frb45-21-1-mgd_ext.xml	SAT TT=6.494	SAT TT=6.494 CHECKS=30155700 NODES=19236	SAT TT=11.591 CHECKS=59132800 NODES=36674	SAT TT=850.839	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=1393.89 ASSIGNMENTS=1528250	SAT TT=1419.21 ASSIGNMENTS=1528250	SAT TT=1445.67 CHECKS=453893000 NODES=3615300	SAT TT=76.666 CHECKS=591535000 NODES=1628720	? (TO) TT=1800.1	SAT TT=13.345 ASSIGNMENTS=19236 CHECKS=30155700	SAT TT=13.666 ASSIGNMENTS=19236 CHECKS=30155700	? (TO) TT=1800.02	? (TO) TT=1800.05	No data	SAT TT=343.817 ASSIGNMENTS=2424200 CHECKS=1408590000	SAT TT=545.998 ASSIGNMENTS=3944080 CHECKS=2290690000	? (TO) TT=1800.12	SAT TT=732.982 ASSIGNMENTS=5262120 CHECKS=3087180000	SAT TT=726.1 ASSIGNMENTS=5272420 CHECKS=3090050000	? (TO) TT=1800.6	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.11
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb45-21/ normalized-frb45-21-2_ext.xml	SAT TT=56.465	SAT TT=281.714 CHECKS=1630410000 NODES=992992	SAT TT=267.357 CHECKS=1643270000 NODES=1001220	SAT TT=162.023	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=364.334 ASSIGNMENTS=415146	SAT TT=370.812 ASSIGNMENTS=415146	SAT TT=62.15 CHECKS=15563400 NODES=143904	SAT TT=93.128 CHECKS=734694000 NODES=1675070	? (TO) TT=1800.05	SAT TT=287.579 ASSIGNMENTS=992992 CHECKS=1630410000	SAT TT=266.698 ASSIGNMENTS=992992 CHECKS=1630410000	? (TO) TT=1800.08	? (TO) TT=1800.03	No data	SAT TT=157.098 ASSIGNMENTS=1136460 CHECKS=634265000	SAT TT=74.146 ASSIGNMENTS=539450 CHECKS=299255000	? (TO) TT=1800.11	SAT TT=175.98 ASSIGNMENTS=1258950 CHECKS=701831000	SAT TT=171.932 ASSIGNMENTS=1255070 CHECKS=699122000	? (TO) TT=1800.13	SAT TT=1622.18 ASSIGNMENTS=1446710 CHECKS=2843190000	SAT TT=56.465	SAT TT=754.475
csp/frb45-21/ normalized-frb45-21-3_ext.xml	SAT TT=148.506	SAT TT=181.416 CHECKS=1051930000 NODES=646600	SAT TT=174.114 CHECKS=1006020000 NODES=617234	SAT TT=148.506	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=487.654 ASSIGNMENTS=540035	SAT TT=491.026 ASSIGNMENTS=540035	SAT TT=1029.22 CHECKS=276126000 NODES=2527100	SAT TT=544.747 CHECKS=3873220000 NODES=8840730	? (TO) TT=1800.06	SAT TT=175.484 ASSIGNMENTS=646600 CHECKS=1051930000	SAT TT=175.45 ASSIGNMENTS=646600 CHECKS=1051930000	? (TO) TT=1800.1	? (TO) TT=1800.03	No data	SAT TT=323.165 ASSIGNMENTS=2494740 CHECKS=1396940000	SAT TT=350.881 ASSIGNMENTS=2492820 CHECKS=1395820000	? (TO) TT=1800.1	SAT TT=371.761 ASSIGNMENTS=2688050 CHECKS=1496940000	SAT TT=306.679 ASSIGNMENTS=2298810 CHECKS=1279990000	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.15	? (TO) TT=1800.04
csp/frb45-21/ normalized-frb45-21-4-mgd_ext.xml	SAT TT=33.995	SAT TT=464.625 CHECKS=2713320000 NODES=1581910	SAT TT=475.64 CHECKS=2712720000 NODES=1581220	SAT TT=212.315	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=468.567 ASSIGNMENTS=457995	SAT TT=456.294 ASSIGNMENTS=457995	SAT TT=258.271 CHECKS=86349900 NODES=637252	SAT TT=33.995 CHECKS=254471000 NODES=729987	? (TO) TT=1800.07	SAT TT=510.08 ASSIGNMENTS=740055 CHECKS=432669000	SAT TT=533.522 ASSIGNMENTS=740055 CHECKS=432669000	? (TO) TT=1800.05	? (TO) TT=1800.09	No data	SAT TT=116.442 ASSIGNMENTS=813570 CHECKS=476930000	SAT TT=115.028 ASSIGNMENTS=809045 CHECKS=471841000	SAT TT=594.335	SAT TT=100.864 ASSIGNMENTS=703434 CHECKS=410663000	SAT TT=111.353 ASSIGNMENTS=740055 CHECKS=432669000	? (TO) TT=1800.16	SAT TT=1410.35 ASSIGNMENTS=771186 CHECKS=1766350000	? (TO) TT=1800.14	? (TO) TT=1800.1
csp/frb45-21/ normalized-frb45-21-5_ext.xml	SAT TT=51.605	SAT TT=1205.42 CHECKS=7698180000 NODES=4608170	SAT TT=1192.99 CHECKS=7596680000 NODES=4566800	SAT TT=310.574	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=1417.99 ASSIGNMENTS=1634200	SAT TT=1379.45 ASSIGNMENTS=1634200	SAT TT=1715.49 CHECKS=447491000 NODES=4066110	SAT TT=1439.2 CHECKS=11194400000 NODES=25467000	? (TO) TT=1800.09	SAT TT=1217.77 ASSIGNMENTS=4608170 CHECKS=7698180000	SAT TT=616.419 ASSIGNMENTS=1626250 CHECKS=917646000	? (TO) TT=1800.1	? (TO) TT=1800.05	No data	SAT TT=146.384 ASSIGNMENTS=1131400 CHECKS=639110000	SAT TT=51.605 ASSIGNMENTS=395471 CHECKS=221508000	? (TO) TT=1800.06	SAT TT=228.028 ASSIGNMENTS=1635840 CHECKS=922834000	SAT TT=211.723 ASSIGNMENTS=1626250 CHECKS=917646000	? (TO) TT=1800.1	SAT TT=303.121 ASSIGNMENTS=134246 CHECKS=285696000	SAT TT=1169.44	? (TO) TT=1800.1
csp/frb50-23/ normalized-frb50-23-1_ext.xml	SAT TT=146.492	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=146.492 CHECKS=1173860000 NODES=2373200	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	No data	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=695.497 ASSIGNMENTS=4795790 CHECKS=2908190000	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.11
csp/frb50-23/ normalized-frb50-23-2_ext.xml	SAT TT=723.997	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=723.997 CHECKS=5766420000 NODES=11594900	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	No data	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.23	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.13
csp/frb50-23/ normalized-frb50-23-3-mgd_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800	No data	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/frb50-23/ normalized-frb50-23-4_ext.xml	SAT TT=31.085	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.01	SAT TT=31.085 CHECKS=244381000 NODES=496298	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	No data	SAT TT=1092.62 ASSIGNMENTS=7048760 CHECKS=4249560000	SAT TT=1217.49 ASSIGNMENTS=8344290 CHECKS=837528000	? (TO) TT=1800.12	SAT TT=53.65 ASSIGNMENTS=352179 CHECKS=210349000	SAT TT=1013.87 ASSIGNMENTS=7063340 CHECKS=4262920000	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.1
csp/frb50-23/ normalized-frb50-23-5-mgd_ext.xml	SAT TT=114.342	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.09	SAT TT=114.342 CHECKS=827626000 NODES=2125900	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	SAT TT=873.609 ASSIGNMENTS=5087140 CHECKS=3257300000	SAT TT=857.956 ASSIGNMENTS=5080320 CHECKS=3251550000	? (TO) TT=1800.09	SAT TT=497.023 ASSIGNMENTS=3112150 CHECKS=1970790000	SAT TT=892.124 ASSIGNMENTS=5637970 CHECKS=3604650000	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/frb53-24/ normalized-frb53-24-1_ext.xml	SAT TT=321.702	SAT TT=342.275 CHECKS=2177490000 NODES=1127960	SAT TT=321.702 CHECKS=2106410000 NODES=1085060	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=359.785 ASSIGNMENTS=1127960 CHECKS=2177490000	SAT TT=347.514 ASSIGNMENTS=1127960 CHECKS=2177490000	? (TO) TT=1800.1	? (TO) TT=1800.01	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb53-24/ normalized-frb53-24-2-mgd_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.06	No data	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/frb53-24/ normalized-frb53-24-3-mgd_ext.xml	SAT TT=166.74	SAT TT=1232.69 CHECKS=7918130000 NODES=4090410	SAT TT=166.74 CHECKS=970369000 NODES=524253	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=483.531 CHECKS=3459900000 NODES=8210420	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	No data	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.1
csp/frb53-24/ normalized-frb53-24-5_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	No data	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/frb53-24/ normalized-frb53-24-5-mgd_ext.xml	SAT TT=357.979	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=357.979 CHECKS=2528940000 NODES=5884320	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.02	No data	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.08
csp/frb56-25/ normalized-frb56-25-2_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.07
csp/frb56-25/ normalized-frb56-25-2-mgd_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.06	No data	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/frb56-25/ normalized-frb56-25-4_ext.xml	SAT TT=1708.24	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.02	SAT TT=1708.24 CHECKS=13675700000 NODES=24792100	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	No data	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06
csp/frb56-25/ normalized-frb56-25-4-mgd_ext.xml	SAT TT=799.497	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=799.497 CHECKS=6301600000 NODES=13590800	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800	No data	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07
csp/frb56-25/ normalized-frb56-25-5-mgd_ext.xml	SAT TT=198.782	? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=198.782 CHECKS=1553000000 NODES=3433000	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1
csp/frb59-26/ normalized-frb59-26-2_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.06	No data	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.14
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb59-26/ normalized-frb59-26-3_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	No data	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.11
csp/frb59-26/ normalized-frb59-26-3-mgd_ext.xml		? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	No data	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.15
csp/frb59-26/ normalized-frb59-26-4-mgd_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	No data	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1
csp/frb59-26/ normalized-frb59-26-5-mgd_ext.xml	SAT TT=60.642	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.08	SAT TT=60.642 CHECKS=442901000 NODES=937734	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07
csp/geom/ normalized-geo50-20-d4-75-18_ext.xml	SAT TT=0.081	SAT TT=1.266 CHECKS=68641 NODES=97	SAT TT=0.991 CHECKS=89174 NODES=58	SAT TT=1.231	SAT TT=0.483 CHECKS=48545	SAT TT=0.278 CHECKS=17437	SAT TT=1.107 ASSIGNMENTS=62	SAT TT=1.113 ASSIGNMENTS=62	SAT TT=0.913 CHECKS=36939 NODES=234	SAT TT=0.782 CHECKS=218585 NODES=474	SAT TT=1.368 CHECKS=4832670 NODES=7293	SAT TT=0.094 ASSIGNMENTS=110 CHECKS=53835	SAT TT=0.095 ASSIGNMENTS=110 CHECKS=53835	SAT TT=4.098	SAT TT=3.394	No data	SAT TT=0.081 ASSIGNMENTS=103 CHECKS=48110	SAT TT=0.435 ASSIGNMENTS=4975 CHECKS=1398780	SAT TT=2.128	SAT TT=0.148 ASSIGNMENTS=1125 CHECKS=357505	SAT TT=0.081 ASSIGNMENTS=110 CHECKS=53835	SAT TT=3.515	SAT TT=0.257 ASSIGNMENTS=62 CHECKS=80140	SAT TT=1.734	SAT TT=1.899
csp/geom/ normalized-geo50-20-d4-75-40_ext.xml	SAT TT=0.057	SAT TT=0.963 CHECKS=17947 NODES=54	SAT TT=0.99 CHECKS=53787 NODES=52	SAT TT=1.025	SAT TT=0.274 CHECKS=12365	SAT TT=0.184 CHECKS=2024	SAT TT=0.831 ASSIGNMENTS=31	SAT TT=0.807 ASSIGNMENTS=31	SAT TT=0.746 CHECKS=10454 NODES=69	SAT TT=0.737 CHECKS=65689 NODES=100	SAT TT=0.929 CHECKS=114498 NODES=138	SAT TT=0.073 ASSIGNMENTS=33 CHECKS=4305	SAT TT=0.072 ASSIGNMENTS=33 CHECKS=4305	SAT TT=3.298	SAT TT=3.113	No data	SAT TT=0.057 ASSIGNMENTS=33 CHECKS=4305	SAT TT=0.061 ASSIGNMENTS=21 CHECKS=3718	SAT TT=0.989	SAT TT=0.066 ASSIGNMENTS=104 CHECKS=26390	SAT TT=0.061 ASSIGNMENTS=33 CHECKS=4305	SAT TT=2.387	SAT TT=0.15 ASSIGNMENTS=50 CHECKS=44682	SAT TT=1.542	SAT TT=1.782
csp/geom/ normalized-geo50-20-d4-75-42_ext.xml	SAT TT=0.067	SAT TT=0.937 CHECKS=18396 NODES=50	SAT TT=1.045 CHECKS=63541 NODES=50	SAT TT=1.196	SAT TT=0.313 CHECKS=21426	SAT TT=0.21 CHECKS=5152	SAT TT=1.038 ASSIGNMENTS=31	SAT TT=0.885 ASSIGNMENTS=31	SAT TT=0.964 CHECKS=15810 NODES=99	SAT TT=0.812 CHECKS=95424 NODES=183	SAT TT=0.806 CHECKS=95470 NODES=99	SAT TT=0.079 ASSIGNMENTS=42 CHECKS=9017	SAT TT=0.074 ASSIGNMENTS=42 CHECKS=9017	SAT TT=3.75	SAT TT=2.91	No data	SAT TT=0.069 ASSIGNMENTS=42 CHECKS=9434	SAT TT=0.268 ASSIGNMENTS=4339 CHECKS=874003	SAT TT=0.852	SAT TT=0.126 ASSIGNMENTS=1144 CHECKS=281803	SAT TT=0.067 ASSIGNMENTS=42 CHECKS=9017	SAT TT=2.667	SAT TT=0.16 ASSIGNMENTS=100 CHECKS=72018	SAT TT=1.825	SAT TT=1.819
csp/geom/ normalized-geo50-20-d4-75-45_ext.xml	SAT TT=0.069	SAT TT=1.077 CHECKS=628215 NODES=487	SAT TT=1.173 CHECKS=108918 NODES=81	SAT TT=1.185	SAT TT=1.094 CHECKS=191078	SAT TT=0.331 CHECKS=29852	SAT TT=0.943 ASSIGNMENTS=185	SAT TT=1.024 ASSIGNMENTS=185	SAT TT=1.002 CHECKS=65734 NODES=557	SAT TT=0.788 CHECKS=359377 NODES=822	SAT TT=0.808 CHECKS=185624 NODES=287	SAT TT=0.083 ASSIGNMENTS=106 CHECKS=32570	SAT TT=0.083 ASSIGNMENTS=106 CHECKS=32570	SAT TT=3.53	SAT TT=7.458	No data	SAT TT=0.079 ASSIGNMENTS=222 CHECKS=79863	SAT TT=0.315 ASSIGNMENTS=4708 CHECKS=1024100	SAT TT=1.187	SAT TT=0.16 ASSIGNMENTS=1395 CHECKS=421629	SAT TT=0.069 ASSIGNMENTS=106 CHECKS=32570	SAT TT=4.51	SAT TT=0.233 ASSIGNMENTS=82 CHECKS=126800	SAT TT=1.655	SAT TT=2.206
csp/geom/ normalized-geo50-20-d4-75-49_ext.xml	SAT TT=0.07	SAT TT=0.963 CHECKS=56150 NODES=83	SAT TT=1.049 CHECKS=124721 NODES=91	SAT TT=1.269	SAT TT=0.389 CHECKS=28976	SAT TT=0.225 CHECKS=5981	SAT TT=0.85 ASSIGNMENTS=54	SAT TT=0.85 ASSIGNMENTS=54	SAT TT=0.865 CHECKS=37777 NODES=338	SAT TT=1.193 CHECKS=3438000 NODES=9335	SAT TT=0.802 CHECKS=347199 NODES=553	SAT TT=0.082 ASSIGNMENTS=69 CHECKS=21485	SAT TT=0.086 ASSIGNMENTS=69 CHECKS=21485	SAT TT=3.919	SAT TT=3.486	No data	SAT TT=0.07 ASSIGNMENTS=64 CHECKS=18153	SAT TT=0.325 ASSIGNMENTS=4391 CHECKS=1032260	SAT TT=1.383	SAT TT=0.13 ASSIGNMENTS=1125 CHECKS=308038	SAT TT=0.075 ASSIGNMENTS=69 CHECKS=21485	SAT TT=2.886	SAT TT=0.283 ASSIGNMENTS=55 CHECKS=54416	SAT TT=1.879	SAT TT=1.897
csp/geom/ normalized-geo50-20-d4-75-5_ext.xml	SAT TT=0.065	SAT TT=0.966 CHECKS=21864 NODES=57	SAT TT=0.972 CHECKS=93282 NODES=72	SAT TT=1.096	SAT TT=0.37 CHECKS=37136	SAT TT=0.218 CHECKS=10452	SAT TT=0.883 ASSIGNMENTS=75	SAT TT=1.109 ASSIGNMENTS=75	SAT TT=0.759 CHECKS=13455 NODES=98	SAT TT=0.76 CHECKS=391035 NODES=1032	SAT TT=0.724 CHECKS=92963 NODES=114	SAT TT=0.081 ASSIGNMENTS=117 CHECKS=29885	SAT TT=0.079 ASSIGNMENTS=117 CHECKS=29885	SAT TT=3.19	SAT TT=3.185	No data	SAT TT=0.065 ASSIGNMENTS=99 CHECKS=23863	SAT TT=0.181 ASSIGNMENTS=2871 CHECKS=457140	SAT TT=0.996	SAT TT=0.117 ASSIGNMENTS=1133 CHECKS=240310	SAT TT=0.066 ASSIGNMENTS=117 CHECKS=29885	SAT TT=2.937	SAT TT=0.197 ASSIGNMENTS=88 CHECKS=83049	SAT TT=1.821	SAT TT=1.739
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/geom/ normalized-geo50-20-d4-75-61_ext.xml	SAT TT=0.061	SAT TT=0.954 CHECKS=38010 NODES=91	SAT TT=1.03 CHECKS=97739 NODES=92	SAT TT=1.047	SAT TT=0.324 CHECKS=26359	SAT TT=0.202 CHECKS=5972	SAT TT=1.039 ASSIGNMENTS=44	SAT TT=0.865 ASSIGNMENTS=44	SAT TT=0.789 CHECKS=11221 NODES=76	SAT TT=0.784 CHECKS=176540 NODES=412	SAT TT=0.778 CHECKS=345412 NODES=608	SAT TT=0.075 ASSIGNMENTS=47 CHECKS=11763	SAT TT=0.074 ASSIGNMENTS=47 CHECKS=11763	SAT TT=3.453	SAT TT=2.81	No data	SAT TT=0.066 ASSIGNMENTS=47 CHECKS=12102	SAT TT=0.216 ASSIGNMENTS=3897 CHECKS=652392	SAT TT=1.02	SAT TT=0.075 ASSIGNMENTS=374 CHECKS=97387	SAT TT=0.061 ASSIGNMENTS=47 CHECKS=11763	SAT TT=2.625	SAT TT=0.169 ASSIGNMENTS=87 CHECKS=98809	SAT TT=1.852	SAT TT=2.043
csp/geom/ normalized-geo50-20-d4-75-76_ext.xml	SAT TT=0.055	SAT TT=0.955 CHECKS=15975 NODES=50	SAT TT=0.927 CHECKS=50973 NODES=50	SAT TT=1.057	SAT TT=0.274 CHECKS=13171	SAT TT=0.18 CHECKS=2113	SAT TT=0.831 ASSIGNMENTS=35	SAT TT=0.841 ASSIGNMENTS=35	SAT TT=0.889 CHECKS=10428 NODES=79	SAT TT=0.722 CHECKS=73141 NODES=138	SAT TT=0.773 CHECKS=67642 NODES=73	SAT TT=0.072 ASSIGNMENTS=32 CHECKS=3782	SAT TT=0.071 ASSIGNMENTS=32 CHECKS=3782	SAT TT=3.385	SAT TT=2.817	No data	SAT TT=0.061 ASSIGNMENTS=32 CHECKS=3782	SAT TT=0.061 ASSIGNMENTS=29 CHECKS=4008	SAT TT=0.797	SAT TT=0.062 ASSIGNMENTS=183 CHECKS=29602	SAT TT=0.055 ASSIGNMENTS=32 CHECKS=3782	SAT TT=2.373	SAT TT=0.151 ASSIGNMENTS=53 CHECKS=46198	SAT TT=1.599	SAT TT=1.922
csp/geom/ normalized-geo50-20-d4-75-94_ext.xml	UNSAT TT=33.347	UNSAT TT=117.775 CHECKS=760436000 NODES=317038	UNSAT TT=117.55 CHECKS=758397000 NODES=316376	UNSAT TT=207.383	UNSAT TT=931.035 CHECKS=182508000	UNSAT TT=396.495 CHECKS=77508800	UNSAT TT=125.408 ASSIGNMENTS=100194	UNSAT TT=125.617 ASSIGNMENTS=100194	UNSAT TT=98.615 CHECKS=27324700 NODES=201897	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=118.475 ASSIGNMENTS=317038 CHECKS=760436000	UNSAT TT=116.389 ASSIGNMENTS=317038 CHECKS=760436000	? (TO) TT=1800.08	? (TO) TT=1800.09	No data	UNSAT TT=33.347 ASSIGNMENTS=196882 CHECKS=133720000	UNSAT TT=33.477 ASSIGNMENTS=198475 CHECKS=134262000	UNSAT TT=1354.74	UNSAT TT=33.612 ASSIGNMENTS=197273 CHECKS=133647000	UNSAT TT=33.943 ASSIGNMENTS=200233 CHECKS=136053000	? (TO) TT=1800.2	UNSAT TT=573.984 ASSIGNMENTS=210104 CHECKS=748427000	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/geom/ normalized-geo50-20-d4-75-9_ext.xml	SAT TT=0.299	SAT TT=1.17 CHECKS=302609 NODES=244	SAT TT=1.26 CHECKS=432669 NODES=267	SAT TT=3.934	SAT TT=13.154 CHECKS=2891450	SAT TT=6.423 CHECKS=1253930	SAT TT=7.53 ASSIGNMENTS=6872	SAT TT=8.305 ASSIGNMENTS=6872	SAT TT=2.806 CHECKS=634910 NODES=4999	SAT TT=1.545 CHECKS=5144880 NODES=13132	? (TO) TT=1800.07	SAT TT=0.773 ASSIGNMENTS=5119 CHECKS=2820590	SAT TT=0.822 ASSIGNMENTS=5119 CHECKS=2820590	SAT TT=10.023	SAT TT=20.472	No data	SAT TT=1.008 ASSIGNMENTS=7007 CHECKS=3885630	SAT TT=1.772 ASSIGNMENTS=14132 CHECKS=6607620	SAT TT=20.917	SAT TT=0.299 ASSIGNMENTS=2109 CHECKS=947107	SAT TT=0.811 ASSIGNMENTS=5119 CHECKS=2820590	SAT TT=3.138	SAT TT=0.672 ASSIGNMENTS=58 CHECKS=82264	SAT TT=1.897	SAT TT=6.247
csp/golombRulerArity3/ normalized-ruler-17-6-a3.xml	SAT TT=0.01	SAT TT=0.922 CHECKS=71934 NODES=39	SAT TT=1.141 CHECKS=472694 NODES=193	SAT TT=0.051	SAT TT=32.071 CHECKS=189270000	SAT TT=3.218 CHECKS=18839000	SAT TT=0.889 ASSIGNMENTS=44	SAT TT=0.873 ASSIGNMENTS=6	SAT TT=0.792 CHECKS=68106 NODES=37	SAT TT=4.183 CHECKS=17628100 NODES=78437	SAT TT=0.775 CHECKS=181419 NODES=438	SAT TT=0.022 ASSIGNMENTS=9 CHECKS=1335	SAT TT=0.022 ASSIGNMENTS=9 CHECKS=1335	SAT TT=1.941	SAT TT=2.004	No data	SAT TT=0.011 ASSIGNMENTS=12 CHECKS=1687	SAT TT=0.01 ASSIGNMENTS=54 CHECKS=4956	SAT TT=0.417	SAT TT=0.022 ASSIGNMENTS=248 CHECKS=18720	SAT TT=0.012 ASSIGNMENTS=41 CHECKS=4762	SAT TT=3.63	No data	SAT TT=0.732	SAT TT=0.756
csp/golombRulerArity3/ normalized-ruler-17-7-a3.xml	UNSAT TT=0.013	UNSAT TT=0.871 CHECKS=748 NODES=0	UNSAT TT=0.845 CHECKS=748 NODES=0	UNSAT TT=0.056	UNSAT TT=0.219 CHECKS=1011840	UNSAT TT=0.04 CHECKS=131682	UNSAT TT=0.851 ASSIGNMENTS=0	UNSAT TT=0.939 ASSIGNMENTS=0	UNSAT TT=1.013 CHECKS=206955 NODES=105	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.165	UNSAT TT=2.045	No data	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.507	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.14	No data	UNSAT TT=0.906	UNSAT TT=0.987
csp/golombRulerArity3/ normalized-ruler-25-7-a3.xml	SAT TT=0.016	SAT TT=1.069 CHECKS=561726 NODES=95	SAT TT=2.548 CHECKS=5037270 NODES=1650	SAT TT=0.222	SAT TT=32.001 CHECKS=203766000	SAT TT=3.361 CHECKS=20990600	SAT TT=2.164 ASSIGNMENTS=1036	SAT TT=1.127 ASSIGNMENTS=7	SAT TT=1.636 CHECKS=1255470 NODES=766	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=0.054 ASSIGNMENTS=482 CHECKS=69702	SAT TT=0.053 ASSIGNMENTS=482 CHECKS=69702	SAT TT=5.024	SAT TT=3.657	No data	SAT TT=0.027 ASSIGNMENTS=277 CHECKS=47129	SAT TT=0.026 ASSIGNMENTS=198 CHECKS=24863	SAT TT=0.583	SAT TT=0.029 ASSIGNMENTS=248 CHECKS=27416	SAT TT=0.016 ASSIGNMENTS=51 CHECKS=8195	SAT TT=7.741	No data	SAT TT=0.94	SAT TT=1.093
csp/golombRulerArity3/ normalized-ruler-25-8-a3.xml	UNSAT TT=0.019	UNSAT TT=0.935 CHECKS=9749 NODES=0	UNSAT TT=0.978 CHECKS=9749 NODES=0	UNSAT TT=0.077	UNSAT TT=30.568 CHECKS=222081000	UNSAT TT=4.039 CHECKS=25736200	UNSAT TT=0.959 ASSIGNMENTS=0	UNSAT TT=1.034 ASSIGNMENTS=0	UNSAT TT=2.405 CHECKS=2898580 NODES=1023	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=5.225	UNSAT TT=5.366	No data	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.846	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=21.933	No data	UNSAT TT=1.296	UNSAT TT=1.64
csp/golombRulerArity3/ normalized-ruler-34-8-a3.xml	SAT TT=0.075	SAT TT=10.579 CHECKS=28958300 NODES=10435	SAT TT=20.538 CHECKS=60744900 NODES=19252	SAT TT=4.59	SAT TT=30.507 CHECKS=220464000	SAT TT=0.841 CHECKS=4430220	SAT TT=9.933 ASSIGNMENTS=9698	SAT TT=1.54 ASSIGNMENTS=201	SAT TT=8.995 CHECKS=17106600 NODES=7420	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=0.075 ASSIGNMENTS=434 CHECKS=100669	SAT TT=0.075 ASSIGNMENTS=434 CHECKS=100669	SAT TT=38.122	SAT TT=17.069	No data	SAT TT=0.075 ASSIGNMENTS=593 CHECKS=139770	SAT TT=0.34 ASSIGNMENTS=1923 CHECKS=420336	SAT TT=0.688	SAT TT=0.62 ASSIGNMENTS=5113 CHECKS=853030	SAT TT=2.02 ASSIGNMENTS=18266 CHECKS=3375350	SAT TT=156.138	No data	SAT TT=1.842	SAT TT=6.921
csp/golombRulerArity3/ normalized-ruler-34-9-a3.xml	UNSAT TT=0.027	UNSAT TT=1.058 CHECKS=23204 NODES=0	UNSAT TT=1.052 CHECKS=23204 NODES=0	UNSAT TT=0.11	UNSAT TT=43.426 CHECKS=279038000	UNSAT TT=11.989 CHECKS=68180900	UNSAT TT=1.427 ASSIGNMENTS=0	UNSAT TT=1.357 ASSIGNMENTS=0	UNSAT TT=17.947 CHECKS=40363200 NODES=10627	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=42.179	UNSAT TT=49.095	No data	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.16	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=323.549	No data	UNSAT TT=4.342	UNSAT TT=5.091
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/golombRulerArity3/ normalized-ruler-44-10-a3.xml	UNSAT TT=0.038	UNSAT TT=1.261 CHECKS=48509 NODES=0	UNSAT TT=1.214 CHECKS=48509 NODES=0	UNSAT TT=0.157	UNSAT TT=149.162 CHECKS=880503000	UNSAT TT=234.877 CHECKS=1165490000	UNSAT TT=1.434 ASSIGNMENTS=0	UNSAT TT=1.359 ASSIGNMENTS=0	UNSAT TT=70.374 CHECKS=185049000 NODES=21303	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=369.002	UNSAT TT=679.142	No data	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=5.798	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.18	No data	UNSAT TT=53.285	UNSAT TT=57.955
csp/golombRulerArity3/ normalized-ruler-44-9-a3.xml	SAT TT=2.18	SAT TT=101.28 CHECKS=338387000 NODES=85284	SAT TT=306.261 CHECKS=912202000 NODES=192760	SAT TT=99.291	SAT TT=160.481 CHECKS=877464000	SAT TT=16.79 CHECKS=93274300	SAT TT=18.087 ASSIGNMENTS=10804	SAT TT=8.453 ASSIGNMENTS=6288	SAT TT=68.181 CHECKS=181104000 NODES=40844	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=106.611 ASSIGNMENTS=85284 CHECKS=338387000	SAT TT=107.545 ASSIGNMENTS=85284 CHECKS=338387000	SAT TT=98.214	SAT TT=235.778	No data	SAT TT=2.18 ASSIGNMENTS=15098 CHECKS=3514780	SAT TT=9.054 ASSIGNMENTS=56230 CHECKS=13240100	SAT TT=2.142	SAT TT=4.541 ASSIGNMENTS=27756 CHECKS=5983490	SAT TT=17.005 ASSIGNMENTS=105241 CHECKS=25440700	? (TO) TT=1800.1	No data	SAT TT=3.605	SAT TT=2.544
csp/golombRulerArity3/ normalized-ruler-55-10-a3.xml	SAT TT=2.627	SAT TT=1518.81 CHECKS=5030680000 NODES=852882	SAT TT=1327.63 CHECKS=4471290000 NODES=815642	SAT TT=1344.27	SAT TT=50.615 CHECKS=312405000	SAT TT=632.905 CHECKS=3374480000	SAT TT=54.158 ASSIGNMENTS=26592	SAT TT=2.627 ASSIGNMENTS=224	SAT TT=212.74 CHECKS=512964000 NODES=82676	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=645.054 ASSIGNMENTS=674738 CHECKS=190649000	SAT TT=643.845 ASSIGNMENTS=674738 CHECKS=190649000	? (TO) TT=1800.03	? (TO) TT=1800.1	No data	SAT TT=17.958 ASSIGNMENTS=75790 CHECKS=25578000	SAT TT=61.987 ASSIGNMENTS=308935 CHECKS=91791700	SAT TT=12.364	SAT TT=33.134 ASSIGNMENTS=171486 CHECKS=48062100	SAT TT=141.823 ASSIGNMENTS=674738 CHECKS=190649000	? (TO) TT=1802.19	No data	SAT TT=80.313	SAT TT=321.18
csp/golombRulerArity3/ normalized-ruler-55-11-a3.xml	UNSAT TT=0.059	? (MO) TT=1.03	? (TO) TT=1800.11	UNSAT TT=0.322	UNSAT TT=651.041 CHECKS=3187240000	UNSAT TT=276.773 CHECKS=1419050000	UNSAT TT=1.898 ASSIGNMENTS=0	UNSAT TT=1.743 ASSIGNMENTS=0	UNSAT TT=758.361 CHECKS=1851230000 NODES=180844	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=0.068 ASSIGNMENTS=1 CHECKS=5347	UNSAT TT=0.073 ASSIGNMENTS=1 CHECKS=5347	? (TO) TT=1800.08	? (TO) TT=1800.08	No data	UNSAT TT=0.059 ASSIGNMENTS=1 CHECKS=5347	UNSAT TT=0.072 ASSIGNMENTS=34 CHECKS=20215	UNSAT TT=49.138	UNSAT TT=0.18 ASSIGNMENTS=185 CHECKS=83910	UNSAT TT=0.641 ASSIGNMENTS=426 CHECKS=303910	? (exit code) TT=229.978	No data	UNSAT TT=576.074	UNSAT TT=663.534
csp/golombRulerArity3/ normalized-ruler-67-11-a3.xml	UNSAT TT=481.664	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.14	UNSAT TT=739.711 ASSIGNMENTS=344041	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=1173.04 ASSIGNMENTS=3748360 CHECKS=1707990000	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.06	No data	UNSAT TT=481.664 ASSIGNMENTS=1419520 CHECKS=701771000	UNSAT TT=663.864 ASSIGNMENTS=1946100 CHECKS=920254000	UNSAT TT=491.775	? (TO) TT=1800.01	UNSAT TT=1196.01 ASSIGNMENTS=3748360 CHECKS=1707990000	? TT=137.905	No data	? (TO) TT=1800.06	? (TO) TT=1800.08
csp/golombRulerArity3/ normalized-ruler-67-12-a3.xml	UNSAT TT=0.216	? (TO) TT=1800.12	? (TO) TT=1800.13	UNSAT TT=310.414	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=2.542 ASSIGNMENTS=0	UNSAT TT=2.649 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.382 ASSIGNMENTS=158 CHECKS=165599	UNSAT TT=0.384 ASSIGNMENTS=158 CHECKS=165599	? (TO) TT=1800.03	? (TO) TT=1800.05	No data	UNSAT TT=0.303 ASSIGNMENTS=116 CHECKS=122632	UNSAT TT=1.586 ASSIGNMENTS=1839 CHECKS=1228210	UNSAT TT=454.412	UNSAT TT=1.785 ASSIGNMENTS=1148 CHECKS=644305	UNSAT TT=0.216 ASSIGNMENTS=62 CHECKS=76810	? TT=122.391	No data	? (TO) TT=1800.04	? (TO) TT=1800.12
csp/golombRulerArity3/ normalized-ruler-70-12-a3.xml	UNSAT TT=2.633	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	UNSAT TT=2.614 ASSIGNMENTS=0	UNSAT TT=2.633 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=479.399 ASSIGNMENTS=983931 CHECKS=605767000	UNSAT TT=938.648 ASSIGNMENTS=983931 CHECKS=605767000	? (TO) TT=1800.07	? (TO) TT=1800.09	No data	UNSAT TT=306.759 ASSIGNMENTS=758155 CHECKS=458500000	UNSAT TT=408.825 ASSIGNMENTS=987631 CHECKS=542072000	UNSAT TT=581.574	? (TO) TT=1800.09	UNSAT TT=432.31 ASSIGNMENTS=983931 CHECKS=605767000	? (MO) TT=81.524	No data	? (TO) TT=1800.05	? (TO) TT=1800.1
csp/golombRulerArity3/ normalized-ruler-70-13-a3.xml	UNSAT TT=0.109	UNSAT TT=1.557 CHECKS=186374 NODES=0	UNSAT TT=1.606 CHECKS=186374 NODES=0	UNSAT TT=0.409	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=2.441 ASSIGNMENTS=0	UNSAT TT=2.214 ASSIGNMENTS=0	UNSAT TT=1730.48 CHECKS=5479830000 NODES=120218	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=0.115 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.126 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.05	? (TO) TT=1800.07	No data	UNSAT TT=0.109 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.111 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=702.199	UNSAT TT=0.111 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.114 ASSIGNMENTS=0 CHECKS=1	? TT=121.619	No data	? (TO) TT=1800.03	? (TO) TT=1800.12
csp/golombRulerArity4/ normalized-ruler-17-6-a4.xml	SAT TT=0.015	SAT TT=0.857 CHECKS=6556 NODES=10	SAT TT=0.804 CHECKS=15322 NODES=12	SAT TT=0.041	SAT TT=0.019 CHECKS=21000	SAT TT=0.015 CHECKS=20440	SAT TT=0.876 ASSIGNMENTS=159	SAT TT=0.803 ASSIGNMENTS=33	SAT TT=1.826 CHECKS=30378 NODES=151	SAT TT=1.204 CHECKS=375267 NODES=504	SAT TT=0.815 CHECKS=86307 NODES=93	SAT TT=0.035 ASSIGNMENTS=52 CHECKS=25072	SAT TT=0.036 ASSIGNMENTS=52 CHECKS=25072	SAT TT=7.232	SAT TT=7.27	No data	SAT TT=0.125 ASSIGNMENTS=399 CHECKS=180087	SAT TT=0.304 ASSIGNMENTS=3599 CHECKS=539305	SAT TT=0.445	SAT TT=0.37 ASSIGNMENTS=3182 CHECKS=560361	SAT TT=0.037 ASSIGNMENTS=124 CHECKS=60616	SAT TT=9.911	No data	SAT TT=1.057	SAT TT=2.043
csp/golombRulerArity4/ normalized-ruler-17-7-a4.xml	UNSAT TT=0.064	UNSAT TT=1.088 CHECKS=167936 NODES=285	UNSAT TT=1.126 CHECKS=186965 NODES=290	UNSAT TT=0.064	UNSAT TT=32.135 CHECKS=199230000	UNSAT TT=0.083 CHECKS=271584	UNSAT TT=1.243 ASSIGNMENTS=271	UNSAT TT=1.066 ASSIGNMENTS=150	UNSAT TT=3.706 CHECKS=83261 NODES=200	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.185 ASSIGNMENTS=268 CHECKS=250493	UNSAT TT=0.172 ASSIGNMENTS=268 CHECKS=250493	UNSAT TT=14.574	UNSAT TT=13.128	No data	UNSAT TT=0.247 ASSIGNMENTS=342 CHECKS=313200	UNSAT TT=0.343 ASSIGNMENTS=3245 CHECKS=579763	UNSAT TT=0.643	UNSAT TT=13.25 ASSIGNMENTS=82632 CHECKS=27788100	UNSAT TT=0.15 ASSIGNMENTS=256 CHECKS=243327	UNSAT TT=21.605	No data	UNSAT TT=1.811	UNSAT TT=2.982
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/golombRulerArity4/ normalized-ruler-25-7-a4.xml	SAT TT=0.062	SAT TT=0.962 CHECKS=64052 NODES=55	SAT TT=1.016 CHECKS=121496 NODES=138	SAT TT=0.062	SAT TT=0.874 CHECKS=3446860	SAT TT=0.624 CHECKS=2417890	SAT TT=1.21 ASSIGNMENTS=248	SAT TT=1.072 ASSIGNMENTS=46	SAT TT=12.425 CHECKS=231236 NODES=520	SAT TT=1.589 CHECKS=677417 NODES=326	SAT TT=1.385 CHECKS=105646 NODES=27	SAT TT=0.269 ASSIGNMENTS=441 CHECKS=358265	SAT TT=0.293 ASSIGNMENTS=441 CHECKS=358265	SAT TT=47.807	SAT TT=33.464	No data	SAT TT=2.519 ASSIGNMENTS=3332 CHECKS=2844560	SAT TT=3.159 ASSIGNMENTS=7421 CHECKS=4052060	SAT TT=0.642	SAT TT=36.49 ASSIGNMENTS=193090 CHECKS=69831200	SAT TT=2.806 ASSIGNMENTS=4521 CHECKS=3598020	SAT TT=75.282	No data	SAT TT=3.272	SAT TT=11.247
csp/golombRulerArity4/ normalized-ruler-25-8-a4.xml	UNSAT TT=0.167	UNSAT TT=3.228 CHECKS=2205720 NODES=1924	UNSAT TT=2.941 CHECKS=1732700 NODES=1571	UNSAT TT=0.167	UNSAT TT=5.102 CHECKS=19713900	UNSAT TT=7.647 CHECKS=31201300	UNSAT TT=4.001 ASSIGNMENTS=2675	UNSAT TT=2.341 ASSIGNMENTS=1043	UNSAT TT=22.018 CHECKS=933192 NODES=1235	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=10.752 ASSIGNMENTS=1924 CHECKS=2205720	UNSAT TT=10.883 ASSIGNMENTS=1924 CHECKS=2205720	UNSAT TT=110.984	UNSAT TT=112.156	No data	UNSAT TT=3.891 ASSIGNMENTS=2323 CHECKS=3879680	UNSAT TT=3.469 ASSIGNMENTS=4952 CHECKS=3753680	UNSAT TT=0.739	UNSAT TT=131.548 ASSIGNMENTS=454104 CHECKS=258182000	UNSAT TT=2.784 ASSIGNMENTS=2119 CHECKS=3283420	UNSAT TT=137.678	No data	UNSAT TT=23.456	UNSAT TT=42.059
csp/golombRulerArity4/ normalized-ruler-34-8-a4.xml	SAT TT=0.171	SAT TT=1.302 CHECKS=285828 NODES=221	SAT TT=1.486 CHECKS=429803 NODES=408	SAT TT=0.171	SAT TT=38.665 CHECKS=194940000	SAT TT=6.829 CHECKS=25613600	SAT TT=3.337 ASSIGNMENTS=1714	SAT TT=3.093 ASSIGNMENTS=1714	SAT TT=76.302 CHECKS=12241200 NODES=20022	SAT TT=7.284 CHECKS=9428430 NODES=2152	SAT TT=3.759 CHECKS=2601190 NODES=550	SAT TT=8.397 ASSIGNMENTS=221 CHECKS=285828	SAT TT=8.94 ASSIGNMENTS=221 CHECKS=285828	SAT TT=416.736	SAT TT=100.33	No data	SAT TT=3.914 ASSIGNMENTS=2339 CHECKS=3610100	SAT TT=47.726 ASSIGNMENTS=32077 CHECKS=42293600	SAT TT=0.723	SAT TT=288.439 ASSIGNMENTS=735982 CHECKS=482836000	SAT TT=11.873 ASSIGNMENTS=7804 CHECKS=11220800	SAT TT=502.436	No data	SAT TT=16.031	SAT TT=41.31
csp/golombRulerArity4/ normalized-ruler-34-9-a4.xml	UNSAT TT=1.607	UNSAT TT=30.542 CHECKS=27699300 NODES=16325	UNSAT TT=26.796 CHECKS=25650800 NODES=15770	UNSAT TT=1.607	UNSAT TT=95.692 CHECKS=400410000	UNSAT TT=103.372 CHECKS=374609000	UNSAT TT=32.469 ASSIGNMENTS=21235	UNSAT TT=32.768 ASSIGNMENTS=21235	UNSAT TT=74.057 CHECKS=10035600 NODES=8731	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=35.791 ASSIGNMENTS=16325 CHECKS=27699300	UNSAT TT=38.519 ASSIGNMENTS=16325 CHECKS=27699300	UNSAT TT=922.554	UNSAT TT=1653.62	No data	UNSAT TT=41.325 ASSIGNMENTS=10874 CHECKS=29474600	UNSAT TT=61.034 ASSIGNMENTS=18485 CHECKS=42834300	UNSAT TT=1.148	UNSAT TT=1210.33 ASSIGNMENTS=1765970 CHECKS=1623110000	UNSAT TT=28.926 ASSIGNMENTS=10112 CHECKS=24333200	UNSAT TT=922.127	No data	UNSAT TT=238.561	UNSAT TT=632.384
csp/golombRulerArity4/ normalized-ruler-44-10-a4.xml	UNSAT TT=8.721	UNSAT TT=242.735 CHECKS=235085000 NODES=82017	UNSAT TT=165.991 CHECKS=137337000 NODES=52987	UNSAT TT=8.721	UNSAT TT=240.374 CHECKS=871265000	UNSAT TT=122.873 CHECKS=475470000	UNSAT TT=629.815 ASSIGNMENTS=229488	UNSAT TT=637.048 ASSIGNMENTS=229488	UNSAT TT=161.465 CHECKS=82702700 NODES=39955	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=257.504 ASSIGNMENTS=82017 CHECKS=235085000	UNSAT TT=250.999 ASSIGNMENTS=82017 CHECKS=235085000	? (TO) TT=1800.01	? (TO) TT=1800.04	No data	UNSAT TT=302.217 ASSIGNMENTS=46039 CHECKS=166675000	UNSAT TT=543.122 ASSIGNMENTS=71448 CHECKS=280312000	UNSAT TT=4.986	? (TO) TT=1800.09	UNSAT TT=440.378 ASSIGNMENTS=62868 CHECKS=225770000	? (TO) TT=1801.9	No data	? (TO) TT=1800.02	? (TO) TT=1800.08
csp/golombRulerArity4/ normalized-ruler-44-9-a4.xml	SAT TT=3.076	SAT TT=7.169 CHECKS=5585320 NODES=3629	SAT TT=5.018 CHECKS=3567980 NODES=2377	SAT TT=3.076	SAT TT=150.526 CHECKS=550404000	SAT TT=84.71 CHECKS=305916000	SAT TT=93.246 ASSIGNMENTS=38459	SAT TT=102.311 ASSIGNMENTS=38459	SAT TT=191.33 CHECKS=107111000 NODES=105570	SAT TT=76.216 CHECKS=124061000 NODES=14410	? (TO) TT=1800.07	SAT TT=13.696 ASSIGNMENTS=3629 CHECKS=5585320	SAT TT=14.446 ASSIGNMENTS=3629 CHECKS=5585320	? (TO) TT=1800.04	? (TO) TT=1800.01	No data	SAT TT=36.506 ASSIGNMENTS=11429 CHECKS=26049900	SAT TT=431.533 ASSIGNMENTS=114754 CHECKS=263194000	SAT TT=2.166	? (TO) TT=1800.03	SAT TT=641.168 ASSIGNMENTS=187356 CHECKS=435448000	? (TO) TT=1802.2	No data	SAT TT=127.626	SAT TT=1716.08
csp/golombRulerArity4/ normalized-ruler-55-10-a4.xml	SAT TT=10.948	SAT TT=22.868 CHECKS=18865400 NODES=8611	SAT TT=10.948 CHECKS=7960140 NODES=3105	SAT TT=53.028	SAT TT=1034.9 CHECKS=3735620000	SAT TT=866.744 CHECKS=2908610000	SAT TT=180.562 ASSIGNMENTS=66901	SAT TT=183.187 ASSIGNMENTS=66901	SAT TT=191.182 CHECKS=105709000 NODES=40275	SAT TT=1034.52 CHECKS=1759330000 NODES=112358	? (TO) TT=1800.09	SAT TT=28.671 ASSIGNMENTS=8611 CHECKS=18865400	SAT TT=29.087 ASSIGNMENTS=8611 CHECKS=18865400	? (MO) TT=764.52	? (MO) TT=726.7	No data	SAT TT=256.806 ASSIGNMENTS=40183 CHECKS=138122000	SAT TT=328.621 ASSIGNMENTS=49815 CHECKS=163775000	SAT TT=11.704	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.88	No data	? (TO) TT=1800.1	? (TO) TT=1800.08
csp/golombRulerArity4/ normalized-ruler-55-11-a4.xml	UNSAT TT=126.19	? (TO) TT=1800.16	UNSAT TT=1568.97 CHECKS=1326640000 NODES=340090	UNSAT TT=126.19	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.14	UNSAT TT=720.487 ASSIGNMENTS=208157	UNSAT TT=957.629 CHECKS=761886000 NODES=260086	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.04	? (MO) TT=1098.55	? (MO) TT=1205.89	No data	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=17.956	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1801.04	No data	? (TO) TT=1800.27	? (TO) TT=1800.11
csp/golombRulerArity4/ normalized-ruler-67-11-a4.xml		? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	No data	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=427.536	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1801.28	No data	? (MO) TT=62.96	? (MO) TT=258.11
csp/golombRulerArity4/ normalized-ruler-67-12-a4.xml	UNSAT TT=427.269	? (TO) TT=1800.16	? (TO) TT=1800.12	UNSAT TT=427.269	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=156.998	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1801.76	No data	? (MO) TT=87.96	? (MO) TT=258.87
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/golombRulerArity4/ normalized-ruler-70-12-a4.xml		? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	No data	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=455.772	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.54	No data	? (MO) TT=89.48	? (MO) TT=284.33
csp/golombRulerArity4/ normalized-ruler-70-13-a4.xml	UNSAT TT=860.676	? (TO) TT=1800.09	? (TO) TT=1800.14	UNSAT TT=860.676	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.05	No data	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=166.862	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1801.72	No data	? (MO) TT=131.149	? (MO) TT=296.602
csp/graceful/ normalized-graceful--K4-P2.xml	SAT TT=0.022	SAT TT=4.034 CHECKS=8857960 NODES=4514	SAT TT=3.123 CHECKS=6251660 NODES=3627	? (TO) TT=1800.11	SAT TT=0.446 CHECKS=1994830	SAT TT=0.61 CHECKS=2677860	SAT TT=0.906 ASSIGNMENTS=40	SAT TT=0.857 ASSIGNMENTS=17	SAT TT=1.208 CHECKS=753993 NODES=1071	SAT TT=5.363 CHECKS=25780700 NODES=95296	? (TO) TT=1800.09	SAT TT=0.163 ASSIGNMENTS=995 CHECKS=128318	SAT TT=0.163 ASSIGNMENTS=995 CHECKS=128318	SAT TT=5.051	SAT TT=2.235	No data	SAT TT=0.142 ASSIGNMENTS=1048 CHECKS=120877	SAT TT=0.033 ASSIGNMENTS=212 CHECKS=21967	SAT TT=1339.6	SAT TT=0.117 ASSIGNMENTS=806 CHECKS=85848	SAT TT=0.022 ASSIGNMENTS=97 CHECKS=11849	SAT TT=4.143	No data	SAT TT=0.808	SAT TT=1.287
csp/graphColoring/ hos/ normalized-abb313GPIA-10.xml	SAT TT=2.59	SAT TT=25.714 CHECKS=3719600 NODES=10698	SAT TT=31.269 CHECKS=3809820 NODES=9861	SAT TT=10.871	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.19	SAT TT=136.865 ASSIGNMENTS=1508	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=2.59 ASSIGNMENTS=1575 CHECKS=331753	SAT TT=2.752 ASSIGNMENTS=1575 CHECKS=331753	SAT TT=68.61	SAT TT=59.885	No data	SAT TT=2.636 ASSIGNMENTS=1279 CHECKS=163978	SAT TT=6.002 ASSIGNMENTS=45060 CHECKS=4140570	SAT TT=24.594	SAT TT=4.22 ASSIGNMENTS=13694 CHECKS=1809400	SAT TT=2.811 ASSIGNMENTS=3634 CHECKS=876273	SAT TT=27.322	No data	SAT TT=22.223	SAT TT=27.426
csp/graphColoring/ hos/ normalized-abb313GPIA-5.xml	UNSAT TT=2.494	UNSAT TT=20.153 CHECKS=20 NODES=0	UNSAT TT=20.854 CHECKS=20 NODES=0	UNSAT TT=11.089	UNSAT TT=58.284 CHECKS=56794500	UNSAT TT=67.999 CHECKS=64664100	UNSAT TT=30.083 ASSIGNMENTS=0	UNSAT TT=27.748 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=2.568 ASSIGNMENTS=0 CHECKS=131	UNSAT TT=2.494 ASSIGNMENTS=0 CHECKS=131	UNSAT TT=36.349	UNSAT TT=34.794	No data	UNSAT TT=2.704 ASSIGNMENTS=0 CHECKS=131	UNSAT TT=2.67 ASSIGNMENTS=0 CHECKS=131	UNSAT TT=12.79	UNSAT TT=2.667 ASSIGNMENTS=0 CHECKS=131	UNSAT TT=2.704 ASSIGNMENTS=0 CHECKS=131	UNSAT TT=12.359	No data	UNSAT TT=13.946	UNSAT TT=19.494
csp/graphColoring/ hos/ normalized-abb313GPIA-9.xml	SAT TT=10.017	SAT TT=175.8 CHECKS=131529000 NODES=118319	SAT TT=87.897 CHECKS=50651400 NODES=50781	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=18.536 ASSIGNMENTS=24318 CHECKS=21062600	SAT TT=423.965 ASSIGNMENTS=281036 CHECKS=357749000	SAT TT=60.529	SAT TT=63.612	No data	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=24.958 ASSIGNMENTS=43593 CHECKS=36664200	SAT TT=10.017 ASSIGNMENTS=24318 CHECKS=21062600	SAT TT=140.23	No data	SAT TT=63.989	SAT TT=41.402
csp/graphColoring/ hos/ normalized-ash331GPIA-3.xml	UNSAT TT=0.168	UNSAT TT=1.886 CHECKS=23837 NODES=55	UNSAT TT=2.396 CHECKS=112493 NODES=55	UNSAT TT=0.704	UNSAT TT=0.351 CHECKS=195694	UNSAT TT=0.196 CHECKS=182727	UNSAT TT=2.621 ASSIGNMENTS=0	UNSAT TT=2.874 ASSIGNMENTS=0	UNSAT TT=6.212 CHECKS=25457 NODES=152	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.184 ASSIGNMENTS=11 CHECKS=6101	UNSAT TT=0.195 ASSIGNMENTS=11 CHECKS=6101	UNSAT TT=2.606	UNSAT TT=2.386	No data	UNSAT TT=0.168 ASSIGNMENTS=11 CHECKS=7299	UNSAT TT=0.307 ASSIGNMENTS=5497 CHECKS=340507	UNSAT TT=1.277	UNSAT TT=0.226 ASSIGNMENTS=1047 CHECKS=44765	UNSAT TT=0.182 ASSIGNMENTS=11 CHECKS=6096	UNSAT TT=4.913	No data	UNSAT TT=1.774	UNSAT TT=2.006
csp/graphColoring/ hos/ normalized-ash608GPIA-3.xml	UNSAT TT=0.351	UNSAT TT=3.071 CHECKS=19241 NODES=79	UNSAT TT=3.432 CHECKS=165182 NODES=61	UNSAT TT=1.402	UNSAT TT=0.74 CHECKS=366537	UNSAT TT=0.423 CHECKS=357806	UNSAT TT=4.149 ASSIGNMENTS=0	UNSAT TT=4.408 ASSIGNMENTS=0	UNSAT TT=18.02 CHECKS=3894 NODES=39	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=0.363 ASSIGNMENTS=16 CHECKS=10188	UNSAT TT=0.379 ASSIGNMENTS=16 CHECKS=10188	UNSAT TT=4.872	UNSAT TT=4.258	No data	UNSAT TT=0.366 ASSIGNMENTS=23 CHECKS=13269	UNSAT TT=0.573 ASSIGNMENTS=7132 CHECKS=412913	UNSAT TT=2.056	UNSAT TT=0.476 ASSIGNMENTS=1790 CHECKS=86445	UNSAT TT=0.351 ASSIGNMENTS=13 CHECKS=9814	UNSAT TT=6.12	No data	UNSAT TT=2.743	UNSAT TT=2.862
csp/graphColoring/ hos/ normalized-ash608GPIA-4.xml	SAT TT=0.376	SAT TT=3.889 CHECKS=86128 NODES=2026	SAT TT=4.374 CHECKS=165943 NODES=2539	SAT TT=1.513	SAT TT=14.787 CHECKS=6234660	SAT TT=31.851 CHECKS=11470200	SAT TT=4.741 ASSIGNMENTS=587	SAT TT=4.17 ASSIGNMENTS=587	SAT TT=19 CHECKS=35340 NODES=1817	SAT TT=23.143 CHECKS=8627770 NODES=151282	SAT TT=18.218 CHECKS=5191100 NODES=1021	SAT TT=0.399 ASSIGNMENTS=643 CHECKS=26934	SAT TT=0.393 ASSIGNMENTS=643 CHECKS=26934	SAT TT=7.271	SAT TT=7.807	No data	SAT TT=0.392 ASSIGNMENTS=815 CHECKS=42341	SAT TT=0.773 ASSIGNMENTS=25001 CHECKS=846190	SAT TT=2.588	SAT TT=0.572 ASSIGNMENTS=3930 CHECKS=84551	SAT TT=0.376 ASSIGNMENTS=516 CHECKS=18434	SAT TT=6.079	No data	SAT TT=3.105	SAT TT=3.275
csp/graphColoring/ hos/ normalized-ash958GPIA-3.xml	UNSAT TT=0.626	UNSAT TT=4.202 CHECKS=33075 NODES=83	UNSAT TT=5.528 CHECKS=271921 NODES=81	UNSAT TT=2.873	UNSAT TT=1.234 CHECKS=553776	UNSAT TT=0.649 CHECKS=550158	UNSAT TT=6.536 ASSIGNMENTS=0	UNSAT TT=6.556 ASSIGNMENTS=0	UNSAT TT=48.619 CHECKS=3639 NODES=39	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.655 ASSIGNMENTS=12 CHECKS=14563	UNSAT TT=0.643 ASSIGNMENTS=12 CHECKS=14563	UNSAT TT=7.421	UNSAT TT=7.322	No data	UNSAT TT=0.634 ASSIGNMENTS=14 CHECKS=17227	UNSAT TT=0.961 ASSIGNMENTS=8696 CHECKS=448022	UNSAT TT=2.845	UNSAT TT=0.864 ASSIGNMENTS=2831 CHECKS=132361	UNSAT TT=0.626 ASSIGNMENTS=11 CHECKS=14581	UNSAT TT=6.034	No data	UNSAT TT=3.614	UNSAT TT=4.069
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ hos/ normalized-ash958GPIA-4.xml	SAT TT=0.627	SAT TT=5.186 CHECKS=102365 NODES=2610	SAT TT=6.432 CHECKS=254765 NODES=4400	? (TO) TT=1800.06	SAT TT=37.361 CHECKS=27292400	SAT TT=63.878 CHECKS=46472800	SAT TT=6.372 ASSIGNMENTS=912	SAT TT=6.647 ASSIGNMENTS=912	SAT TT=58.957 CHECKS=87107 NODES=4737	? (TO) TT=1800.03	SAT TT=51.293 CHECKS=12322300 NODES=1486	SAT TT=0.702 ASSIGNMENTS=847 CHECKS=28923	SAT TT=0.69 ASSIGNMENTS=847 CHECKS=28923	SAT TT=13.111	SAT TT=13.71	No data	SAT TT=0.627 ASSIGNMENTS=844 CHECKS=28921	SAT TT=1.381 ASSIGNMENTS=33488 CHECKS=1018380	SAT TT=3.204	SAT TT=1.244 ASSIGNMENTS=6202 CHECKS=151569	SAT TT=0.696 ASSIGNMENTS=1173 CHECKS=50276	SAT TT=6.805	No data	SAT TT=4.206	SAT TT=4.249
csp/graphColoring/ hos/ normalized-will199GPIA-6.xml	UNSAT TT=0.759	UNSAT TT=4.044 CHECKS=1956360 NODES=2165	UNSAT TT=3.956 CHECKS=1986750 NODES=2194	UNSAT TT=1.074	UNSAT TT=340.343 CHECKS=1333920000	UNSAT TT=236.395 CHECKS=951878000	UNSAT TT=41.737 ASSIGNMENTS=4286	UNSAT TT=890.97 ASSIGNMENTS=126781	UNSAT TT=22.412 CHECKS=167965 NODES=2642	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=0.935 ASSIGNMENTS=2051 CHECKS=868277	UNSAT TT=0.889 ASSIGNMENTS=2051 CHECKS=868277	UNSAT TT=4.429	UNSAT TT=4.574	No data	UNSAT TT=0.766 ASSIGNMENTS=1929 CHECKS=790256	UNSAT TT=2.158 ASSIGNMENTS=18133 CHECKS=2532790	UNSAT TT=2.119	UNSAT TT=1.535 ASSIGNMENTS=5588 CHECKS=906046	UNSAT TT=0.759 ASSIGNMENTS=1705 CHECKS=685214	UNSAT TT=7.462	No data	UNSAT TT=2.486	UNSAT TT=3.35
csp/graphColoring/ hos/ normalized-will199GPIA-7.xml	SAT TT=0.312	SAT TT=2.974 CHECKS=40402 NODES=701	SAT TT=2.672 CHECKS=40625 NODES=0	SAT TT=1.118	SAT TT=2.574 CHECKS=487215	SAT TT=2.989 CHECKS=588728	SAT TT=12.674 ASSIGNMENTS=984	SAT TT=14.375 ASSIGNMENTS=976	SAT TT=22.206 CHECKS=126263 NODES=4895	SAT TT=13.838 CHECKS=340498 NODES=780	SAT TT=13.45 CHECKS=2725440 NODES=522	SAT TT=0.321 ASSIGNMENTS=683 CHECKS=14345	SAT TT=0.322 ASSIGNMENTS=683 CHECKS=14345	SAT TT=7.02	SAT TT=6.417	No data	SAT TT=0.312 ASSIGNMENTS=684 CHECKS=14345	SAT TT=0.639 ASSIGNMENTS=33788 CHECKS=713417	SAT TT=1.957	SAT TT=0.514 ASSIGNMENTS=5269 CHECKS=108421	SAT TT=0.312 ASSIGNMENTS=713 CHECKS=15018	SAT TT=6.026	No data	SAT TT=2.873	SAT TT=3.781
csp/graphColoring/insertion/ full-insertion/ normalized-1-fullins-3-3.xml	UNSAT TT=0.007	UNSAT TT=0.745 CHECKS=833 NODES=16	UNSAT TT=0.763 CHECKS=1268 NODES=0	UNSAT TT=0.035	UNSAT TT=0.016 CHECKS=1110	UNSAT TT=0.011 CHECKS=1147	UNSAT TT=0.589 ASSIGNMENTS=0	UNSAT TT=0.587 ASSIGNMENTS=0	UNSAT TT=0.776 CHECKS=1317 NODES=35	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=0.022 ASSIGNMENTS=13 CHECKS=643	UNSAT TT=0.02 ASSIGNMENTS=13 CHECKS=643	UNSAT TT=0.828	UNSAT TT=0.643	No data	UNSAT TT=0.007 ASSIGNMENTS=21 CHECKS=869	UNSAT TT=0.012 ASSIGNMENTS=138 CHECKS=4665	UNSAT TT=0.342	UNSAT TT=0.008 ASSIGNMENTS=85 CHECKS=1677	UNSAT TT=0.01 ASSIGNMENTS=13 CHECKS=589	UNSAT TT=1.07	No data	UNSAT TT=0.647	UNSAT TT=0.616
csp/graphColoring/insertion/ full-insertion/ normalized-1-fullins-4-4.xml	UNSAT TT=0.04	UNSAT TT=1.316 CHECKS=120965 NODES=633	UNSAT TT=1.371 CHECKS=116994 NODES=592	? (TO) TT=1800.05	UNSAT TT=23.019 CHECKS=92881000	UNSAT TT=32.259 CHECKS=137883000	UNSAT TT=2.069 ASSIGNMENTS=5230	UNSAT TT=2.066 ASSIGNMENTS=5230	UNSAT TT=1.297 CHECKS=22568 NODES=288	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=0.059 ASSIGNMENTS=576 CHECKS=61201	UNSAT TT=0.06 ASSIGNMENTS=576 CHECKS=61201	UNSAT TT=1.249	UNSAT TT=1.158	No data	UNSAT TT=0.051 ASSIGNMENTS=708 CHECKS=73647	UNSAT TT=0.161 ASSIGNMENTS=6348 CHECKS=377846	UNSAT TT=0.645	UNSAT TT=0.047 ASSIGNMENTS=663 CHECKS=46423	UNSAT TT=0.04 ASSIGNMENTS=408 CHECKS=41512	UNSAT TT=2.507	No data	UNSAT TT=1.127	UNSAT TT=1.267
csp/graphColoring/insertion/ full-insertion/ normalized-1-fullins-4-5.xml	SAT TT=0.026	SAT TT=1.03 CHECKS=2507 NODES=93	SAT TT=1.083 CHECKS=2888 NODES=0	SAT TT=0.097	SAT TT=0.056 CHECKS=25112	SAT TT=0.032 CHECKS=24990	SAT TT=1.354 ASSIGNMENTS=85	SAT TT=1.222 ASSIGNMENTS=85	SAT TT=1.22 CHECKS=2304 NODES=93	SAT TT=1.234 CHECKS=17191 NODES=55	SAT TT=1.131 CHECKS=39673 NODES=50	SAT TT=0.04 ASSIGNMENTS=89 CHECKS=1186	SAT TT=0.038 ASSIGNMENTS=89 CHECKS=1186	SAT TT=1.818	SAT TT=1.653	No data	SAT TT=0.026 ASSIGNMENTS=89 CHECKS=1186	SAT TT=0.03 ASSIGNMENTS=289 CHECKS=5983	SAT TT=0.683	SAT TT=0.028 ASSIGNMENTS=425 CHECKS=5837	SAT TT=0.027 ASSIGNMENTS=89 CHECKS=1186	SAT TT=2.073	No data	SAT TT=1.313	SAT TT=1.287
csp/graphColoring/insertion/ full-insertion/ normalized-1-fullins-5-4.xml	UNSAT TT=0.216	UNSAT TT=2.747 CHECKS=637358 NODES=905	UNSAT TT=2.748 CHECKS=636092 NODES=855	UNSAT TT=1791.97	UNSAT TT=24.376 CHECKS=73561400	UNSAT TT=35.185 CHECKS=101037000	UNSAT TT=7.8 ASSIGNMENTS=13367	UNSAT TT=8.265 ASSIGNMENTS=13367	UNSAT TT=4.175 CHECKS=81811 NODES=374	? (TO) TT=1800	? (TO) TT=1800.08	UNSAT TT=0.244 ASSIGNMENTS=698 CHECKS=303026	UNSAT TT=0.22 ASSIGNMENTS=698 CHECKS=303026	UNSAT TT=2.432	UNSAT TT=2.217	No data	UNSAT TT=0.249 ASSIGNMENTS=831 CHECKS=390146	UNSAT TT=0.738 ASSIGNMENTS=8514 CHECKS=1846020	UNSAT TT=1.401	UNSAT TT=0.216 ASSIGNMENTS=1280 CHECKS=171305	UNSAT TT=0.216 ASSIGNMENTS=534 CHECKS=255367	UNSAT TT=4.695	No data	UNSAT TT=2.048	UNSAT TT=2.412
csp/graphColoring/insertion/ full-insertion/ normalized-1-fullins-5-5.xml	UNSAT TT=6.824	UNSAT TT=50.374 CHECKS=68552800 NODES=101774	UNSAT TT=49.262 CHECKS=67665600 NODES=97543	? (TO) TT=1800.12	UNSAT TT=109.699 CHECKS=560659000	UNSAT TT=170.522 CHECKS=846559000	? (TO) TT=1800.07	? (TO) TT=1800.12	UNSAT TT=99.27 CHECKS=10204700 NODES=58405	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=15.732 ASSIGNMENTS=82916 CHECKS=26386700	UNSAT TT=125.776 ASSIGNMENTS=288001 CHECKS=193361000	UNSAT TT=6.223	UNSAT TT=83.274	No data	UNSAT TT=10.079 ASSIGNMENTS=88990 CHECKS=29536200	UNSAT TT=8.186 ASSIGNMENTS=91597 CHECKS=25891800	UNSAT TT=8.008	UNSAT TT=20.177 ASSIGNMENTS=150361 CHECKS=48389500	UNSAT TT=9.216 ASSIGNMENTS=82916 CHECKS=26386700	UNSAT TT=44.507	No data	UNSAT TT=6.824	UNSAT TT=11.715
csp/graphColoring/insertion/ full-insertion/ normalized-2-fullins-3-4.xml	UNSAT TT=0.014	UNSAT TT=0.86 CHECKS=11365 NODES=142	UNSAT TT=0.872 CHECKS=12245 NODES=103	UNSAT TT=0.05	UNSAT TT=3.434 CHECKS=10505200	UNSAT TT=5.035 CHECKS=15135900	UNSAT TT=0.785 ASSIGNMENTS=0	UNSAT TT=0.737 ASSIGNMENTS=0	UNSAT TT=0.802 CHECKS=2970 NODES=85	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=0.025 ASSIGNMENTS=94 CHECKS=3392	UNSAT TT=0.023 ASSIGNMENTS=94 CHECKS=3392	UNSAT TT=0.801	UNSAT TT=0.822	No data	UNSAT TT=0.014 ASSIGNMENTS=85 CHECKS=3182	UNSAT TT=0.05 ASSIGNMENTS=4980 CHECKS=83092	UNSAT TT=0.437	UNSAT TT=0.014 ASSIGNMENTS=243 CHECKS=3343	UNSAT TT=0.015 ASSIGNMENTS=80 CHECKS=2673	UNSAT TT=1.528	No data	UNSAT TT=0.77	UNSAT TT=0.809
csp/graphColoring/insertion/ full-insertion/ normalized-2-fullins-3-5.xml	SAT TT=0.012	SAT TT=0.815 CHECKS=1040 NODES=52	SAT TT=0.804 CHECKS=1108 NODES=0	SAT TT=0.048	SAT TT=0.023 CHECKS=6001	SAT TT=0.017 CHECKS=7174	SAT TT=0.824 ASSIGNMENTS=47	SAT TT=0.832 ASSIGNMENTS=45	SAT TT=0.834 CHECKS=997 NODES=60	SAT TT=0.834 CHECKS=5587 NODES=31	SAT TT=0.794 CHECKS=12237 NODES=39	SAT TT=0.024 ASSIGNMENTS=51 CHECKS=421	SAT TT=0.024 ASSIGNMENTS=51 CHECKS=421	SAT TT=1.446	SAT TT=1.351	No data	SAT TT=0.014 ASSIGNMENTS=51 CHECKS=421	SAT TT=0.014 ASSIGNMENTS=114 CHECKS=1000	SAT TT=0.464	SAT TT=0.012 ASSIGNMENTS=173 CHECKS=1221	SAT TT=0.013 ASSIGNMENTS=51 CHECKS=422	SAT TT=1.54	No data	SAT TT=0.779	SAT TT=0.814
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/insertion/ full-insertion/ normalized-2-fullins-4-5.xml	UNSAT TT=0.2	UNSAT TT=2.439 CHECKS=1432930 NODES=4870	UNSAT TT=2.625 CHECKS=1401560 NODES=4849	UNSAT TT=1675.38	UNSAT TT=23.474 CHECKS=46417100	UNSAT TT=36.25 CHECKS=79762200	UNSAT TT=1.827 ASSIGNMENTS=0	UNSAT TT=1.701 ASSIGNMENTS=0	UNSAT TT=3.578 CHECKS=253936 NODES=2987	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.41 ASSIGNMENTS=6332 CHECKS=647669	UNSAT TT=0.38 ASSIGNMENTS=6332 CHECKS=647669	UNSAT TT=1.665	UNSAT TT=1.745	No data	UNSAT TT=0.407 ASSIGNMENTS=6496 CHECKS=712633	UNSAT TT=0.357 ASSIGNMENTS=13926 CHECKS=678825	UNSAT TT=1.227	UNSAT TT=0.429 ASSIGNMENTS=5476 CHECKS=496036	UNSAT TT=0.2 ASSIGNMENTS=2843 CHECKS=293774	UNSAT TT=3.963	No data	UNSAT TT=1.4	UNSAT TT=1.69
csp/graphColoring/insertion/ full-insertion/ normalized-3-fullins-4-6.xml	UNSAT TT=1.512	UNSAT TT=18.457 CHECKS=23804800 NODES=57810	UNSAT TT=17.731 CHECKS=22803600 NODES=52291	? (TO) TT=1800.08	UNSAT TT=47.194 CHECKS=142004000	UNSAT TT=79.496 CHECKS=268827000	UNSAT TT=2.467 ASSIGNMENTS=0	UNSAT TT=2.703 ASSIGNMENTS=0	UNSAT TT=32.908 CHECKS=2419870 NODES=22627	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=9.439 ASSIGNMENTS=20560 CHECKS=2792950	UNSAT TT=46.106 ASSIGNMENTS=143192 CHECKS=59155700	UNSAT TT=4.065	UNSAT TT=4.979	No data	UNSAT TT=5.532 ASSIGNMENTS=81976 CHECKS=10659600	UNSAT TT=1.512 ASSIGNMENTS=39242 CHECKS=2873570	UNSAT TT=5.154	UNSAT TT=5.364 ASSIGNMENTS=29349 CHECKS=3659660	UNSAT TT=1.658 ASSIGNMENTS=20560 CHECKS=2792950	UNSAT TT=13.518	No data	UNSAT TT=2.924	UNSAT TT=4.541
csp/graphColoring/insertion/ full-insertion/ normalized-4-fullins-4-7.xml	UNSAT TT=3.805	UNSAT TT=265.184 CHECKS=381224000 NODES=673036	UNSAT TT=271.061 CHECKS=359940000 NODES=689260	? (TO) TT=1800.08	UNSAT TT=381.117 CHECKS=1634120000	UNSAT TT=108.711 CHECKS=487468000	UNSAT TT=3.805 ASSIGNMENTS=0	UNSAT TT=4.37 ASSIGNMENTS=0	UNSAT TT=946.645 CHECKS=38503000 NODES=315133	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=33.018 ASSIGNMENTS=238621 CHECKS=40566800	UNSAT TT=626.875 ASSIGNMENTS=1765370 CHECKS=949945000	UNSAT TT=39.539	UNSAT TT=129.559	No data	UNSAT TT=76.564 ASSIGNMENTS=815476 CHECKS=125775000	UNSAT TT=16.575 ASSIGNMENTS=203362 CHECKS=27257600	UNSAT TT=46.306	UNSAT TT=67.578 ASSIGNMENTS=377943 CHECKS=52401600	UNSAT TT=24.974 ASSIGNMENTS=238621 CHECKS=40566800	UNSAT TT=254.554	No data	UNSAT TT=13.969	UNSAT TT=13.908
csp/graphColoring/insertion/ full-insertion/ normalized-4-fullins-5-6.xml	UNSAT TT=5.557	UNSAT TT=124.83 CHECKS=54092900 NODES=13286	UNSAT TT=139.001 CHECKS=46355600 NODES=11129	UNSAT TT=27.117	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=36.623 ASSIGNMENTS=0	UNSAT TT=37.152 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=140.339 ASSIGNMENTS=16723 CHECKS=77108300	UNSAT TT=141.5 ASSIGNMENTS=16723 CHECKS=77108300	UNSAT TT=82.186	UNSAT TT=72.036	No data	UNSAT TT=14.866 ASSIGNMENTS=9625 CHECKS=6792920	UNSAT TT=21.256 ASSIGNMENTS=71836 CHECKS=11812700	UNSAT TT=18.597	UNSAT TT=59.843 ASSIGNMENTS=56528 CHECKS=23803100	UNSAT TT=5.557 ASSIGNMENTS=3376 CHECKS=2320690	UNSAT TT=20.321	No data	UNSAT TT=16.369	UNSAT TT=24.646
csp/graphColoring/insertion/ full-insertion/ normalized-5-fullins-3-6.xml	UNSAT TT=0.034	UNSAT TT=1.07 CHECKS=24 NODES=0	UNSAT TT=1.06 CHECKS=24 NODES=0	UNSAT TT=0.131	UNSAT TT=0.117 CHECKS=203031	UNSAT TT=0.087 CHECKS=204281	UNSAT TT=1.209 ASSIGNMENTS=0	UNSAT TT=1.15 ASSIGNMENTS=0	UNSAT TT=1.817 CHECKS=26653 NODES=856	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.309	UNSAT TT=1.355	No data	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.729	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.767	No data	UNSAT TT=1.194	UNSAT TT=1.279
csp/graphColoring/insertion/ full-insertion/ normalized-5-fullins-4-8.xml	UNSAT TT=5.788	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	UNSAT TT=5.788 ASSIGNMENTS=0	UNSAT TT=6.777 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=293.366 ASSIGNMENTS=1991740 CHECKS=444586000	UNSAT TT=1040.29 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.08	No data	UNSAT TT=498.749 ASSIGNMENTS=3694330 CHECKS=777646000	UNSAT TT=224.536 ASSIGNMENTS=1639780 CHECKS=313210000	UNSAT TT=792.3	UNSAT TT=836.233 ASSIGNMENTS=2870200 CHECKS=571275000	UNSAT TT=293.091 ASSIGNMENTS=1991740 CHECKS=444586000	? (TO) TT=1800.09	No data	UNSAT TT=119.27	UNSAT TT=101.963
csp/graphColoring/insertion/ k-insertion/ normalized-1-insertions-4-3.xml	UNSAT TT=0.019	UNSAT TT=1.007 CHECKS=16660 NODES=185	UNSAT TT=0.936 CHECKS=16999 NODES=152	UNSAT TT=0.057	UNSAT TT=0.041 CHECKS=64110	UNSAT TT=0.028 CHECKS=66031	UNSAT TT=0.937 ASSIGNMENTS=43	UNSAT TT=0.973 ASSIGNMENTS=43	UNSAT TT=0.915 CHECKS=21151 NODES=464	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.031 ASSIGNMENTS=189 CHECKS=14993	UNSAT TT=0.029 ASSIGNMENTS=189 CHECKS=14993	UNSAT TT=1.045	UNSAT TT=0.863	No data	UNSAT TT=0.019 ASSIGNMENTS=162 CHECKS=11959	UNSAT TT=0.118 ASSIGNMENTS=3908 CHECKS=276704	UNSAT TT=0.481	UNSAT TT=0.022 ASSIGNMENTS=366 CHECKS=23758	UNSAT TT=0.021 ASSIGNMENTS=191 CHECKS=15173	UNSAT TT=1.627	No data	UNSAT TT=0.884	UNSAT TT=0.834
csp/graphColoring/insertion/ k-insertion/ normalized-1-insertions-6-6.xml		? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800	No data	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.23	No data	? (TO) TT=1800.08	? (TO) TT=1800.01
csp/graphColoring/insertion/ k-insertion/ normalized-2-insertions-3-3.xml	UNSAT TT=0.062	UNSAT TT=1.063 CHECKS=153378 NODES=3478	UNSAT TT=1.093 CHECKS=141439 NODES=3400	UNSAT TT=0.09	UNSAT TT=0.113 CHECKS=390216	UNSAT TT=0.107 CHECKS=390321	UNSAT TT=1.079 ASSIGNMENTS=6116	UNSAT TT=1.152 ASSIGNMENTS=6116	UNSAT TT=1.171 CHECKS=233902 NODES=16015	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.104 ASSIGNMENTS=9381 CHECKS=172090	UNSAT TT=0.103 ASSIGNMENTS=9381 CHECKS=172090	UNSAT TT=0.806	UNSAT TT=0.668	No data	UNSAT TT=0.062 ASSIGNMENTS=7042 CHECKS=130640	UNSAT TT=0.097 ASSIGNMENTS=12401 CHECKS=211332	UNSAT TT=0.379	UNSAT TT=0.139 ASSIGNMENTS=14313 CHECKS=256554	UNSAT TT=0.183 ASSIGNMENTS=23130 CHECKS=415299	UNSAT TT=1.434	No data	UNSAT TT=0.663	UNSAT TT=0.649
csp/graphColoring/insertion/ k-insertion/ normalized-2-insertions-4-4.xml		? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.11	No data	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.19	No data	? (TO) TT=1800.12	? (TO) TT=1800.04
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/insertion/ k-insertion/ normalized-2-insertions-5-4.xml		? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.03	No data	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.16	No data	? (TO) TT=1800.01	? (TO) TT=1800.05
csp/graphColoring/insertion/ k-insertion/ normalized-2-insertions-5-5.xml		? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.05	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.18	No data	? (TO) TT=1800.02	? (TO) TT=1800.09
csp/graphColoring/insertion/ k-insertion/ normalized-3-insertions-4-3.xml	UNSAT TT=2.162	UNSAT TT=87.828 CHECKS=80326800 NODES=491185	UNSAT TT=97.186 CHECKS=87911800 NODES=555376	? (TO) TT=1800.02	UNSAT TT=97.167 CHECKS=325546000	UNSAT TT=70.778 CHECKS=267595000	UNSAT TT=397.974 ASSIGNMENTS=2829360	UNSAT TT=410.596 ASSIGNMENTS=2829360	UNSAT TT=826.3 CHECKS=131907000 NODES=2167910	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=47.645 ASSIGNMENTS=903274 CHECKS=89515700	UNSAT TT=72.74 ASSIGNMENTS=568854 CHECKS=70144600	UNSAT TT=1.885	UNSAT TT=1.838	No data	UNSAT TT=24.399 ASSIGNMENTS=561669 CHECKS=61886200	UNSAT TT=38.392 ASSIGNMENTS=878133 CHECKS=94444800	UNSAT TT=16.92	UNSAT TT=110.263 ASSIGNMENTS=1686090 CHECKS=183161000	UNSAT TT=37.246 ASSIGNMENTS=903274 CHECKS=89515700	UNSAT TT=5.316	No data	UNSAT TT=2.226	UNSAT TT=2.162
csp/graphColoring/insertion/ k-insertion/ normalized-3-insertions-5-3.xml	UNSAT TT=7.584	UNSAT TT=680.088 CHECKS=514149000 NODES=489423	UNSAT TT=674.555 CHECKS=531502000 NODES=519565	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.02	UNSAT TT=1515.67 ASSIGNMENTS=1842280	UNSAT TT=1563.25 ASSIGNMENTS=1842280	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=390.65 ASSIGNMENTS=373453 CHECKS=372979000	UNSAT TT=392.338 ASSIGNMENTS=373453 CHECKS=372979000	UNSAT TT=7.727	UNSAT TT=6.055	No data	UNSAT TT=334.641 ASSIGNMENTS=1071840 CHECKS=920981000	UNSAT TT=303.571 ASSIGNMENTS=977387 CHECKS=860103000	UNSAT TT=28.217	UNSAT TT=724.315 ASSIGNMENTS=1667420 CHECKS=1141660000	UNSAT TT=1016.9 ASSIGNMENTS=3460460 CHECKS=2626730000	UNSAT TT=15.055	No data	UNSAT TT=7.764	UNSAT TT=7.584
csp/graphColoring/insertion/ k-insertion/ normalized-3-insertions-5-4.xml		? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.01	No data	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.19	No data	? (TO) TT=1800.04	? (TO) TT=1800.14
csp/graphColoring/insertion/ k-insertion/ normalized-3-insertions-5-5.xml		? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	No data	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.17	No data	? (TO) TT=1800.05	? (TO) TT=1800.09
csp/graphColoring/insertion/ k-insertion/ normalized-3-insertions-5-6.xml	SAT TT=0.496	SAT TT=463.239 CHECKS=55154 NODES=1406	SAT TT=4.389 CHECKS=56232 NODES=0	SAT TT=2.001	SAT TT=2.612 CHECKS=414394	SAT TT=2.182 CHECKS=433124	SAT TT=5.583 ASSIGNMENTS=1402	SAT TT=5.852 ASSIGNMENTS=1402	SAT TT=29.981 CHECKS=45834 NODES=1406	SAT TT=30.187 CHECKS=315370 NODES=632	SAT TT=30.574 CHECKS=4967900 NODES=641	SAT TT=0.515 ASSIGNMENTS=1401 CHECKS=19390	SAT TT=0.541 ASSIGNMENTS=1401 CHECKS=19390	SAT TT=10.443	SAT TT=10.317	No data	SAT TT=0.512 ASSIGNMENTS=1401 CHECKS=19390	SAT TT=0.496 ASSIGNMENTS=1294 CHECKS=19493	SAT TT=2.508	SAT TT=0.517 ASSIGNMENTS=1405 CHECKS=19390	SAT TT=0.509 ASSIGNMENTS=1403 CHECKS=19390	SAT TT=6.348	No data	SAT TT=3.222	SAT TT=4.248
csp/graphColoring/insertion/ k-insertion/ normalized-4-insertions-3-4.xml	SAT TT=0.011	SAT TT=0.949 CHECKS=704 NODES=79	SAT TT=0.835 CHECKS=709 NODES=0	SAT TT=0.05	SAT TT=0.02 CHECKS=3814	SAT TT=0.013 CHECKS=3578	SAT TT=0.866 ASSIGNMENTS=77	SAT TT=0.872 ASSIGNMENTS=77	SAT TT=0.797 CHECKS=535 NODES=79	SAT TT=0.909 CHECKS=3248 NODES=26	SAT TT=0.807 CHECKS=6420 NODES=29	SAT TT=0.024 ASSIGNMENTS=78 CHECKS=312	SAT TT=0.024 ASSIGNMENTS=78 CHECKS=312	SAT TT=1.308	SAT TT=1.348	No data	SAT TT=0.012 ASSIGNMENTS=78 CHECKS=312	SAT TT=0.014 ASSIGNMENTS=71 CHECKS=312	SAT TT=0.5	SAT TT=0.011 ASSIGNMENTS=78 CHECKS=312	SAT TT=0.011 ASSIGNMENTS=74 CHECKS=312	SAT TT=1.349	No data	SAT TT=0.887	SAT TT=0.798
csp/graphColoring/insertion/ k-insertion/ normalized-4-insertions-4-3.xml	UNSAT TT=6.636	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=1225.24 CHECKS=3594070000	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=4.231	UNSAT TT=5.595	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=23.951	No data	UNSAT TT=8.632	UNSAT TT=6.636
csp/graphColoring/insertion/ k-insertion/ normalized-4-insertions-4-4.xml		? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.03	No data	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.22	No data	? (TO) TT=1800.19	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15a-05.xml	UNSAT TT=0.314	UNSAT TT=2.661 CHECKS=0 NODES=0	UNSAT TT=2.555 CHECKS=0 NODES=0	UNSAT TT=1.134	UNSAT TT=25.918 CHECKS=34156500	UNSAT TT=36.788 CHECKS=39259800	UNSAT TT=3.934 ASSIGNMENTS=0	UNSAT TT=3.614 ASSIGNMENTS=0	UNSAT TT=21.035 CHECKS=21708 NODES=211	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=0.33 ASSIGNMENTS=0 CHECKS=10	UNSAT TT=0.332 ASSIGNMENTS=0 CHECKS=10	UNSAT TT=4.2	UNSAT TT=3.956	No data	UNSAT TT=0.314 ASSIGNMENTS=0 CHECKS=10	UNSAT TT=0.315 ASSIGNMENTS=0 CHECKS=10	UNSAT TT=2.169	UNSAT TT=0.321 ASSIGNMENTS=0 CHECKS=10	UNSAT TT=0.32 ASSIGNMENTS=0 CHECKS=10	UNSAT TT=6.612	No data	UNSAT TT=2.819	UNSAT TT=3.834
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15a-08.xml	UNSAT TT=0.312	UNSAT TT=2.553 CHECKS=0 NODES=0	UNSAT TT=2.542 CHECKS=0 NODES=0	UNSAT TT=1.049	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=4.143 ASSIGNMENTS=0	UNSAT TT=3.868 ASSIGNMENTS=0	UNSAT TT=236.73 CHECKS=4130360 NODES=46131	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.328 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.327 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=17.977	UNSAT TT=6.557	No data	UNSAT TT=0.315 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.316 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=7.704	UNSAT TT=0.317 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.312 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=24.809	No data	UNSAT TT=3.298	UNSAT TT=5.357
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15a-12.xml	UNSAT TT=0.306	UNSAT TT=2.727 CHECKS=0 NODES=0	UNSAT TT=2.656 CHECKS=0 NODES=0	UNSAT TT=1.119	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=4.238 ASSIGNMENTS=0	UNSAT TT=4.089 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=0.328 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.324 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.05	? (TO) TT=1800.02	No data	UNSAT TT=0.308 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.306 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	UNSAT TT=0.32 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.317 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.07	No data	UNSAT TT=145.005	UNSAT TT=567.476
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15b-08.xml	UNSAT TT=0.308	UNSAT TT=2.697 CHECKS=0 NODES=0	UNSAT TT=2.676 CHECKS=0 NODES=0	UNSAT TT=1.112	UNSAT TT=194.313 CHECKS=684387000	UNSAT TT=240.242 CHECKS=828221000	UNSAT TT=3.876 ASSIGNMENTS=0	UNSAT TT=3.765 ASSIGNMENTS=0	UNSAT TT=226.578 CHECKS=4117500 NODES=45844	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.333 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.327 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=11.872	UNSAT TT=8.851	No data	UNSAT TT=0.308 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.314 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=6.177	UNSAT TT=0.319 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.308 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=25.096	No data	UNSAT TT=3.372	UNSAT TT=6.764
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15b-10.xml	UNSAT TT=0.297	UNSAT TT=2.779 CHECKS=0 NODES=0	UNSAT TT=2.735 CHECKS=0 NODES=0	UNSAT TT=1.123	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=3.902 ASSIGNMENTS=0	UNSAT TT=3.9 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=0.333 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.33 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.04	UNSAT TT=1620.39	No data	UNSAT TT=0.312 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.311 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=649.968	UNSAT TT=0.297 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.299 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.16	No data	UNSAT TT=5.457	UNSAT TT=20.72
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15b-13.xml	UNSAT TT=0.311	UNSAT TT=2.782 CHECKS=0 NODES=0	UNSAT TT=2.714 CHECKS=0 NODES=0	UNSAT TT=1.13	? (TO) TT=1800.11	? (TO) TT=1800.04	UNSAT TT=3.626 ASSIGNMENTS=0	UNSAT TT=3.876 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.33 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.325 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	UNSAT TT=0.312 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.311 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	UNSAT TT=0.314 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.314 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.2	No data	UNSAT TT=1142.45	UNSAT TT=774.114
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15b-15.xml	SAT TT=0.403	SAT TT=5.126 CHECKS=2084990 NODES=5524	SAT TT=5.954 CHECKS=2210610 NODES=5524	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=750.06 ASSIGNMENTS=205124	SAT TT=44.738 ASSIGNMENTS=444	SAT TT=348.445 CHECKS=10833300 NODES=78081	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=8.158 ASSIGNMENTS=1566 CHECKS=96860	SAT TT=13.156 ASSIGNMENTS=5524 CHECKS=2084990	SAT TT=9.806	SAT TT=10.1	No data	SAT TT=381.306 ASSIGNMENTS=6254950 CHECKS=496383000	SAT TT=3.351 ASSIGNMENTS=38652 CHECKS=4879250	? (TO) TT=1800.06	SAT TT=1.206 ASSIGNMENTS=9851 CHECKS=593617	SAT TT=0.403 ASSIGNMENTS=1566 CHECKS=96860	SAT TT=48.452	No data	SAT TT=5.724	SAT TT=8.717
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15c-13.xml	UNSAT TT=0.66	UNSAT TT=4.476 CHECKS=0 NODES=0	UNSAT TT=4.393 CHECKS=0 NODES=0	UNSAT TT=2.25	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=7.255 ASSIGNMENTS=0	UNSAT TT=7.439 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.683 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.686 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	? (TO) TT=1800.03	No data	UNSAT TT=0.666 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.667 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	UNSAT TT=0.662 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.66 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.19	No data	UNSAT TT=791.751	? (TO) TT=1800.05
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15c-14.xml	UNSAT TT=0.619	UNSAT TT=4.554 CHECKS=0 NODES=0	UNSAT TT=4.635 CHECKS=0 NODES=0	UNSAT TT=2.274	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=7.237 ASSIGNMENTS=0	UNSAT TT=7.467 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.11	UNSAT TT=0.681 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.702 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	? (TO) TT=1800.04	No data	UNSAT TT=0.679 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.677 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.07	UNSAT TT=0.619 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.619 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.2	No data	? (TO) TT=1800.03	? (TO) TT=1800.05
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15d-05.xml	UNSAT TT=0.672	UNSAT TT=3.99 CHECKS=0 NODES=0	UNSAT TT=4.235 CHECKS=0 NODES=0	UNSAT TT=2.108	UNSAT TT=39.808 CHECKS=47279600	UNSAT TT=57.519 CHECKS=67760200	UNSAT TT=6.55 ASSIGNMENTS=0	UNSAT TT=6.54 ASSIGNMENTS=0	UNSAT TT=105.925 CHECKS=39518 NODES=188	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.688 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.706 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=7.664	UNSAT TT=6.78	No data	UNSAT TT=0.672 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.686 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=3.196	UNSAT TT=0.689 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.686 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=7.909	No data	UNSAT TT=4.464	UNSAT TT=5.946
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15d-08.xml	UNSAT TT=0.621	UNSAT TT=4.157 CHECKS=0 NODES=0	UNSAT TT=4.386 CHECKS=0 NODES=0	UNSAT TT=2.296	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=6.821 ASSIGNMENTS=0	UNSAT TT=6.653 ASSIGNMENTS=0	UNSAT TT=739.144 CHECKS=9879990 NODES=46934	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.689 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.694 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=16.076	UNSAT TT=9.211	No data	UNSAT TT=0.669 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.621 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=10.99	UNSAT TT=0.639 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.633 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=40.663	No data	UNSAT TT=4.343	UNSAT TT=6.672
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15d-10.xml	UNSAT TT=0.617	UNSAT TT=4.086 CHECKS=0 NODES=0	UNSAT TT=4.082 CHECKS=0 NODES=0	UNSAT TT=2.303	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=6.583 ASSIGNMENTS=0	UNSAT TT=7.7 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.636 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.693 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.05	? (TO) TT=1800.09	No data	UNSAT TT=0.649 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.65 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=512.533	UNSAT TT=0.617 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.657 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.15	No data	UNSAT TT=9.328	UNSAT TT=36.006
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15d-12.xml	UNSAT TT=0.669	UNSAT TT=4.115 CHECKS=0 NODES=0	UNSAT TT=4.499 CHECKS=0 NODES=0	UNSAT TT=2.291	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=7.442 ASSIGNMENTS=0	UNSAT TT=7.199 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=0.674 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.674 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	? (TO) TT=1800.07	No data	UNSAT TT=0.669 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.67 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	UNSAT TT=0.675 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.67 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	No data	UNSAT TT=224.067	UNSAT TT=943.358
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25a-15.xml	UNSAT TT=0.313	UNSAT TT=2.851 CHECKS=0 NODES=0	UNSAT TT=2.806 CHECKS=0 NODES=0	UNSAT TT=1.048	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=3.666 ASSIGNMENTS=0	UNSAT TT=3.771 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.339 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.329 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	UNSAT TT=0.314 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.316 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	UNSAT TT=0.317 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.313 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.16	No data	? (TO) TT=1800.02	? (TO) TT=1800.09
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25a-23.xml	UNSAT TT=0.295	UNSAT TT=2.79 CHECKS=0 NODES=0	UNSAT TT=2.78 CHECKS=0 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=3.893 ASSIGNMENTS=0	UNSAT TT=4.148 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=0.329 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.331 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	? (TO) TT=1800.01	No data	UNSAT TT=0.295 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.302 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	UNSAT TT=0.322 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.32 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.14	No data	? (TO) TT=1800.03	? (TO) TT=1800.05
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25a-25.xml	SAT TT=0.301	SAT TT=2.936 CHECKS=144881 NODES=450	SAT TT=2.918 CHECKS=143472 NODES=0	SAT TT=1.168	SAT TT=1.016 CHECKS=439497	SAT TT=0.668 CHECKS=393052	SAT TT=65.242 ASSIGNMENTS=414	SAT TT=70.142 ASSIGNMENTS=3071	SAT TT=26.373 CHECKS=199116 NODES=2299	SAT TT=20.855 CHECKS=1775620 NODES=648	SAT TT=20.295 CHECKS=2703950 NODES=307	SAT TT=0.314 ASSIGNMENTS=435 CHECKS=17098	SAT TT=0.337 ASSIGNMENTS=435 CHECKS=17098	SAT TT=16.282	SAT TT=12.075	No data	SAT TT=0.301 ASSIGNMENTS=435 CHECKS=17098	SAT TT=0.327 ASSIGNMENTS=1622 CHECKS=47395	SAT TT=1.877	SAT TT=0.752 ASSIGNMENTS=11160 CHECKS=367967	SAT TT=0.302 ASSIGNMENTS=435 CHECKS=17105	SAT TT=16.202	No data	SAT TT=3.907	SAT TT=7.944
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25b-15.xml	UNSAT TT=0.286	UNSAT TT=2.568 CHECKS=0 NODES=0	UNSAT TT=2.562 CHECKS=0 NODES=0	UNSAT TT=1.142	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=4.006 ASSIGNMENTS=0	UNSAT TT=3.993 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.33 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.331 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800	? (TO) TT=1800.06	No data	UNSAT TT=0.29 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.286 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.07	UNSAT TT=0.311 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.314 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.2	No data	? (TO) TT=1800.06	? (TO) TT=1800.14
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25b-24.xml	UNSAT TT=0.299	UNSAT TT=2.928 CHECKS=0 NODES=0	UNSAT TT=2.621 CHECKS=0 NODES=0	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.11	UNSAT TT=4.027 ASSIGNMENTS=0	UNSAT TT=4.084 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=0.325 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.326 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.09	? (TO) TT=1800.01	No data	UNSAT TT=0.299 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.299 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	UNSAT TT=0.319 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.317 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.14	No data	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25c-05.xml	UNSAT TT=0.642	UNSAT TT=4.111 CHECKS=0 NODES=0	UNSAT TT=4.299 CHECKS=0 NODES=0	UNSAT TT=2.204	UNSAT TT=49.492 CHECKS=54184900	UNSAT TT=73.163 CHECKS=78958400	UNSAT TT=6.673 ASSIGNMENTS=0	UNSAT TT=7.203 ASSIGNMENTS=0	UNSAT TT=111.814 CHECKS=39907 NODES=182	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.711 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.704 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=7.976	UNSAT TT=6.396	No data	UNSAT TT=0.644 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.645 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.234	UNSAT TT=0.702 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.642 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=7.79	No data	UNSAT TT=4.608	UNSAT TT=5.675
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25c-25.xml		? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (MO) TT=553.3	No data	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.2	No data	? (TO) TT=1800.06	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25d-05.xml	UNSAT TT=0.684	UNSAT TT=4.397 CHECKS=0 NODES=0	UNSAT TT=4.477 CHECKS=0 NODES=0	UNSAT TT=2.329	UNSAT TT=32.525 CHECKS=43789100	UNSAT TT=44.602 CHECKS=60098000	UNSAT TT=7.099 ASSIGNMENTS=0	UNSAT TT=7.732 ASSIGNMENTS=0	UNSAT TT=126.812 CHECKS=37803 NODES=163	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.684 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.716 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=8.137	UNSAT TT=6.422	No data	UNSAT TT=0.708 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.703 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=3.277	UNSAT TT=0.706 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.695 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=7.244	No data	UNSAT TT=4.24	UNSAT TT=5.884
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25d-20.xml	UNSAT TT=0.65	UNSAT TT=4.481 CHECKS=0 NODES=0	UNSAT TT=4.53 CHECKS=0 NODES=0	UNSAT TT=2.363	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=7.736 ASSIGNMENTS=0	UNSAT TT=7.234 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=0.702 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.699 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.03	? (TO) TT=1800.05	No data	UNSAT TT=0.65 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.658 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.07	UNSAT TT=0.682 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.68 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.22	No data	? (TO) TT=1800.07	? (TO) TT=1800.05
csp/graphColoring/leighton/ leighton-5/ normalized-lei450-05a-04.xml	UNSAT TT=0.215	UNSAT TT=2.078 CHECKS=0 NODES=0	UNSAT TT=2.159 CHECKS=0 NODES=0	UNSAT TT=0.806	UNSAT TT=1.542 CHECKS=1569850	UNSAT TT=1.758 CHECKS=2139220	UNSAT TT=2.953 ASSIGNMENTS=0	UNSAT TT=2.923 ASSIGNMENTS=0	UNSAT TT=9.337 CHECKS=12651 NODES=111	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.223 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.236 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=2.884	UNSAT TT=3.09	No data	UNSAT TT=0.226 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.223 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=1.416	UNSAT TT=0.215 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.222 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=5.772	No data	UNSAT TT=2.115	UNSAT TT=2.665
csp/graphColoring/leighton/ leighton-5/ normalized-lei450-05a-05.xml	SAT TT=0.422	SAT TT=2.526 CHECKS=110856 NODES=595	SAT TT=2.792 CHECKS=184794 NODES=581	SAT TT=1.277	SAT TT=447.955 CHECKS=1509280000	SAT TT=289.562 CHECKS=519536000	SAT TT=6.731 ASSIGNMENTS=13	SAT TT=7.595 ASSIGNMENTS=18	SAT TT=11.364 CHECKS=190382 NODES=1194	? (TO) TT=1800.08	SAT TT=42.839 CHECKS=148395000 NODES=56525	SAT TT=0.45 ASSIGNMENTS=483 CHECKS=294439	SAT TT=0.439 ASSIGNMENTS=483 CHECKS=294439	SAT TT=4.922	SAT TT=5.029	No data	SAT TT=0.453 ASSIGNMENTS=540 CHECKS=364576	SAT TT=2.018 ASSIGNMENTS=4532 CHECKS=2867310	SAT TT=1.912	SAT TT=0.818 ASSIGNMENTS=2417 CHECKS=743654	SAT TT=0.422 ASSIGNMENTS=511 CHECKS=303715	SAT TT=7.226	No data	SAT TT=2.756	SAT TT=3.099
csp/graphColoring/leighton/ leighton-5/ normalized-lei450-05b-05.xml	SAT TT=0.292	SAT TT=4.458 CHECKS=1869350 NODES=4044	SAT TT=3.606 CHECKS=1023800 NODES=2253	SAT TT=0.823	SAT TT=318.981 CHECKS=1181030000	SAT TT=99.2 CHECKS=230641000	SAT TT=9.09 ASSIGNMENTS=332	SAT TT=9.79 ASSIGNMENTS=279	SAT TT=13.024 CHECKS=220506 NODES=1414	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=0.342 ASSIGNMENTS=207 CHECKS=180188	SAT TT=0.36 ASSIGNMENTS=207 CHECKS=180188	SAT TT=4.695	SAT TT=4.644	No data	SAT TT=0.292 ASSIGNMENTS=219 CHECKS=139115	SAT TT=3.416 ASSIGNMENTS=7971 CHECKS=5214960	SAT TT=1.988	SAT TT=0.509 ASSIGNMENTS=1843 CHECKS=360458	SAT TT=0.303 ASSIGNMENTS=170 CHECKS=130299	SAT TT=7.76	No data	SAT TT=2.439	SAT TT=3.498
csp/graphColoring/ mug/ normalized-mug100-1-3.xml	UNSAT TT=0.784	UNSAT TT=1.851 CHECKS=425372 NODES=17420	UNSAT TT=1.361 CHECKS=191679 NODES=8068	? (TO) TT=1800.09	UNSAT TT=105.087 CHECKS=227798000	UNSAT TT=98.215 CHECKS=250633000	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=16.455 ASSIGNMENTS=189705 CHECKS=4917310	UNSAT TT=16.802 ASSIGNMENTS=189705 CHECKS=4917310	UNSAT TT=1.157	UNSAT TT=0.83	No data	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	UNSAT TT=1.505	No data	UNSAT TT=0.784	UNSAT TT=0.8
csp/graphColoring/ mug/ normalized-mug100-1-4.xml	SAT TT=0.012	SAT TT=0.84 CHECKS=853 NODES=100	SAT TT=0.867 CHECKS=904 NODES=0	SAT TT=0.049	SAT TT=0.021 CHECKS=4024	SAT TT=0.015 CHECKS=3890	SAT TT=0.816 ASSIGNMENTS=87	SAT TT=0.783 ASSIGNMENTS=87	SAT TT=0.764 CHECKS=577 NODES=100	SAT TT=0.795 CHECKS=3448 NODES=34	SAT TT=0.796 CHECKS=7804 NODES=38	SAT TT=0.025 ASSIGNMENTS=88 CHECKS=332	SAT TT=0.024 ASSIGNMENTS=88 CHECKS=332	SAT TT=1.325	SAT TT=1.661	No data	SAT TT=0.014 ASSIGNMENTS=88 CHECKS=332	SAT TT=0.013 ASSIGNMENTS=92 CHECKS=332	SAT TT=0.456	SAT TT=0.012 ASSIGNMENTS=87 CHECKS=332	SAT TT=0.013 ASSIGNMENTS=92 CHECKS=332	SAT TT=1.453	No data	SAT TT=0.795	SAT TT=0.801
csp/graphColoring/ mug/ normalized-mug100-25-3.xml	UNSAT TT=0.853	UNSAT TT=1.169 CHECKS=123868 NODES=5383	UNSAT TT=1.601 CHECKS=370077 NODES=14905	? (TO) TT=1800.08	UNSAT TT=83.273 CHECKS=194949000	UNSAT TT=82.412 CHECKS=222694000	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=8.717 ASSIGNMENTS=17178 CHECKS=361474	UNSAT TT=8.683 ASSIGNMENTS=17178 CHECKS=361474	UNSAT TT=0.824	UNSAT TT=0.959	No data	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=1.573	No data	UNSAT TT=0.853	UNSAT TT=0.88
csp/graphColoring/ mug/ normalized-mug100-25-4.xml	SAT TT=0.011	SAT TT=0.886 CHECKS=857 NODES=100	SAT TT=0.816 CHECKS=916 NODES=0	SAT TT=0.052	SAT TT=0.023 CHECKS=4026	SAT TT=0.015 CHECKS=3821	SAT TT=0.821 ASSIGNMENTS=90	SAT TT=0.786 ASSIGNMENTS=90	SAT TT=0.763 CHECKS=577 NODES=100	SAT TT=0.801 CHECKS=3516 NODES=39	SAT TT=0.821 CHECKS=7800 NODES=37	SAT TT=0.024 ASSIGNMENTS=95 CHECKS=332	SAT TT=0.024 ASSIGNMENTS=95 CHECKS=332	SAT TT=1.319	SAT TT=1.316	No data	SAT TT=0.011 ASSIGNMENTS=95 CHECKS=332	SAT TT=0.012 ASSIGNMENTS=88 CHECKS=332	SAT TT=0.452	SAT TT=0.012 ASSIGNMENTS=93 CHECKS=332	SAT TT=0.011 ASSIGNMENTS=87 CHECKS=332	SAT TT=1.454	No data	SAT TT=0.903	SAT TT=0.848
csp/graphColoring/ mug/ normalized-mug88-1-3.xml	UNSAT TT=0.717	UNSAT TT=1.35 CHECKS=238723 NODES=10640	UNSAT TT=1.484 CHECKS=214798 NODES=9870	UNSAT TT=1539.12	UNSAT TT=82.676 CHECKS=199592000	UNSAT TT=89.994 CHECKS=238785000	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=10.836 ASSIGNMENTS=77382 CHECKS=1850830	UNSAT TT=11.644 ASSIGNMENTS=77382 CHECKS=1850830	UNSAT TT=0.796	UNSAT TT=0.97	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=1.545	No data	UNSAT TT=0.717	UNSAT TT=0.784
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ mug/ normalized-mug88-1-4.xml	SAT TT=0.009	SAT TT=0.835 CHECKS=743 NODES=88	SAT TT=0.896 CHECKS=784 NODES=0	SAT TT=0.045	SAT TT=0.019 CHECKS=3285	SAT TT=0.013 CHECKS=3366	SAT TT=0.727 ASSIGNMENTS=77	SAT TT=0.739 ASSIGNMENTS=77	SAT TT=0.712 CHECKS=508 NODES=88	SAT TT=0.714 CHECKS=2984 NODES=27	SAT TT=0.718 CHECKS=6118 NODES=31	SAT TT=0.024 ASSIGNMENTS=77 CHECKS=292	SAT TT=0.023 ASSIGNMENTS=77 CHECKS=292	SAT TT=1.192	SAT TT=1.201	No data	SAT TT=0.009 ASSIGNMENTS=77 CHECKS=292	SAT TT=0.012 ASSIGNMENTS=80 CHECKS=292	SAT TT=0.421	SAT TT=0.012 ASSIGNMENTS=77 CHECKS=292	SAT TT=0.01 ASSIGNMENTS=80 CHECKS=292	SAT TT=1.35	No data	SAT TT=0.721	SAT TT=0.716
csp/graphColoring/ mug/ normalized-mug88-25-3.xml	UNSAT TT=0.855	UNSAT TT=1.149 CHECKS=64756 NODES=2934	UNSAT TT=1.283 CHECKS=180888 NODES=7119	? (TO) TT=1800.06	UNSAT TT=7.906 CHECKS=27554400	UNSAT TT=11.032 CHECKS=37505600	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=9.63 ASSIGNMENTS=34731 CHECKS=780235	UNSAT TT=10.2 ASSIGNMENTS=34731 CHECKS=780235	UNSAT TT=0.803	UNSAT TT=0.938	No data	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=1.481	No data	UNSAT TT=0.857	UNSAT TT=0.855
csp/graphColoring/ mug/ normalized-mug88-25-4.xml	SAT TT=0.01	SAT TT=0.857 CHECKS=763 NODES=88	SAT TT=0.804 CHECKS=816 NODES=0	SAT TT=0.049	SAT TT=0.019 CHECKS=3304	SAT TT=0.014 CHECKS=3414	SAT TT=0.724 ASSIGNMENTS=74	SAT TT=0.787 ASSIGNMENTS=74	SAT TT=0.735 CHECKS=501 NODES=88	SAT TT=0.757 CHECKS=3068 NODES=33	SAT TT=0.755 CHECKS=7102 NODES=39	SAT TT=0.024 ASSIGNMENTS=78 CHECKS=292	SAT TT=0.024 ASSIGNMENTS=78 CHECKS=292	SAT TT=1.431	SAT TT=1.94	No data	SAT TT=0.012 ASSIGNMENTS=78 CHECKS=292	SAT TT=0.012 ASSIGNMENTS=75 CHECKS=292	SAT TT=0.417	SAT TT=0.011 ASSIGNMENTS=76 CHECKS=292	SAT TT=0.01 ASSIGNMENTS=81 CHECKS=292	SAT TT=1.425	No data	SAT TT=0.777	SAT TT=0.732
csp/graphColoring/ myciel/ normalized-myciel3-3.xml	UNSAT TT=0.007	UNSAT TT=0.69 CHECKS=276 NODES=9	UNSAT TT=0.664 CHECKS=721 NODES=0	UNSAT TT=0.027	UNSAT TT=0.01 CHECKS=660	UNSAT TT=0.007 CHECKS=1052	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.479 ASSIGNMENTS=0	UNSAT TT=0.469 CHECKS=422 NODES=35	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.019 ASSIGNMENTS=20 CHECKS=265	UNSAT TT=0.02 ASSIGNMENTS=20 CHECKS=265	UNSAT TT=0.737	UNSAT TT=0.542	No data	UNSAT TT=0.007 ASSIGNMENTS=18 CHECKS=255	UNSAT TT=0.007 ASSIGNMENTS=34 CHECKS=488	UNSAT TT=0.289	UNSAT TT=0.008 ASSIGNMENTS=48 CHECKS=487	UNSAT TT=0.007 ASSIGNMENTS=30 CHECKS=392	UNSAT TT=0.854	No data	UNSAT TT=0.496	UNSAT TT=0.506
csp/graphColoring/ myciel/ normalized-myciel3-4.xml	SAT TT=0.006	SAT TT=0.736 CHECKS=104 NODES=11	SAT TT=0.675 CHECKS=101 NODES=0	SAT TT=0.027	SAT TT=0.008 CHECKS=656	SAT TT=0.008 CHECKS=600	SAT TT=0.476 ASSIGNMENTS=9	SAT TT=0.52 ASSIGNMENTS=9	SAT TT=0.461 CHECKS=67 NODES=11	SAT TT=0.469 CHECKS=412 NODES=3	SAT TT=0.448 CHECKS=476 NODES=4	SAT TT=0.018 ASSIGNMENTS=10 CHECKS=40	SAT TT=0.018 ASSIGNMENTS=10 CHECKS=40	SAT TT=0.872	SAT TT=0.881	No data	SAT TT=0.006 ASSIGNMENTS=10 CHECKS=40	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=40	SAT TT=0.282	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=40	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=40	SAT TT=0.911	No data	SAT TT=0.507	SAT TT=0.504
csp/graphColoring/ myciel/ normalized-myciel4-4.xml	UNSAT TT=0.026	UNSAT TT=0.872 CHECKS=29912 NODES=544	UNSAT TT=0.859 CHECKS=30322 NODES=578	UNSAT TT=0.053	UNSAT TT=0.028 CHECKS=70057	UNSAT TT=0.026 CHECKS=69976	UNSAT TT=0.636 ASSIGNMENTS=149	UNSAT TT=0.644 ASSIGNMENTS=149	UNSAT TT=0.753 CHECKS=39010 NODES=2638	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=0.038 ASSIGNMENTS=1918 CHECKS=44836	UNSAT TT=0.036 ASSIGNMENTS=1918 CHECKS=44836	UNSAT TT=0.695	UNSAT TT=0.703	No data	UNSAT TT=0.026 ASSIGNMENTS=1998 CHECKS=46161	UNSAT TT=0.044 ASSIGNMENTS=5397 CHECKS=99440	UNSAT TT=0.363	UNSAT TT=0.038 ASSIGNMENTS=3187 CHECKS=71019	UNSAT TT=0.04 ASSIGNMENTS=3792 CHECKS=85111	UNSAT TT=1.523	No data	UNSAT TT=0.704	UNSAT TT=0.68
csp/graphColoring/ myciel/ normalized-myciel4-5.xml	SAT TT=0.007	SAT TT=0.747 CHECKS=390 NODES=23	SAT TT=0.715 CHECKS=380 NODES=0	SAT TT=0.035	SAT TT=0.014 CHECKS=2261	SAT TT=0.009 CHECKS=1850	SAT TT=0.626 ASSIGNMENTS=21	SAT TT=0.571 ASSIGNMENTS=21	SAT TT=0.688 CHECKS=276 NODES=23	SAT TT=0.601 CHECKS=1757 NODES=6	SAT TT=0.609 CHECKS=2142 NODES=7	SAT TT=0.02 ASSIGNMENTS=22 CHECKS=142	SAT TT=0.021 ASSIGNMENTS=22 CHECKS=142	SAT TT=1.166	SAT TT=1.019	No data	SAT TT=0.007 ASSIGNMENTS=22 CHECKS=142	SAT TT=0.008 ASSIGNMENTS=22 CHECKS=142	SAT TT=0.35	SAT TT=0.007 ASSIGNMENTS=22 CHECKS=142	SAT TT=0.009 ASSIGNMENTS=22 CHECKS=142	SAT TT=1.063	No data	SAT TT=0.614	SAT TT=0.659
csp/graphColoring/ myciel/ normalized-myciel5-4.xml	UNSAT TT=0.046	UNSAT TT=0.942 CHECKS=53921 NODES=442	UNSAT TT=0.993 CHECKS=64809 NODES=527	UNSAT TT=0.102	UNSAT TT=0.079 CHECKS=274748	UNSAT TT=0.074 CHECKS=271591	UNSAT TT=0.844 ASSIGNMENTS=122	UNSAT TT=1.108 ASSIGNMENTS=122	UNSAT TT=1.143 CHECKS=90367 NODES=2704	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.061 ASSIGNMENTS=1387 CHECKS=92249	UNSAT TT=0.059 ASSIGNMENTS=1387 CHECKS=92249	UNSAT TT=0.933	UNSAT TT=0.907	No data	UNSAT TT=0.046 ASSIGNMENTS=1295 CHECKS=88720	UNSAT TT=0.102 ASSIGNMENTS=5225 CHECKS=238316	UNSAT TT=0.485	UNSAT TT=0.099 ASSIGNMENTS=3305 CHECKS=208915	UNSAT TT=0.059 ASSIGNMENTS=2208 CHECKS=143390	UNSAT TT=2.211	No data	UNSAT TT=0.944	UNSAT TT=0.989
csp/graphColoring/ myciel/ normalized-myciel5-5.xml	UNSAT TT=25.039	UNSAT TT=25.039 CHECKS=34788100 NODES=397254	UNSAT TT=29.904 CHECKS=39853800 NODES=458975	UNSAT TT=655.767	UNSAT TT=99.347 CHECKS=454619000	UNSAT TT=96.833 CHECKS=451476000	UNSAT TT=46.066 ASSIGNMENTS=574723	UNSAT TT=46.541 ASSIGNMENTS=574723	UNSAT TT=387.389 CHECKS=96524000 NODES=4328700	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=102.481 ASSIGNMENTS=1786190 CHECKS=163939000	UNSAT TT=102.791 ASSIGNMENTS=1786190 CHECKS=163939000	UNSAT TT=186.452	UNSAT TT=216.136	No data	UNSAT TT=33.677 ASSIGNMENTS=2237490 CHECKS=96805700	UNSAT TT=31 ASSIGNMENTS=2014660 CHECKS=88679500	UNSAT TT=99.477	UNSAT TT=31.59 ASSIGNMENTS=1908840 CHECKS=72511500	UNSAT TT=67.804 ASSIGNMENTS=4817280 CHECKS=213097000	? (TO) TT=1800.11	No data	UNSAT TT=56.015	UNSAT TT=232.688
csp/graphColoring/ myciel/ normalized-myciel5-6.xml	SAT TT=0.012	SAT TT=0.85 CHECKS=1356 NODES=47	SAT TT=0.9 CHECKS=1353 NODES=0	SAT TT=0.053	SAT TT=0.029 CHECKS=7632	SAT TT=0.017 CHECKS=7809	SAT TT=0.806 ASSIGNMENTS=45	SAT TT=0.812 ASSIGNMENTS=45	SAT TT=1.075 CHECKS=1047 NODES=47	SAT TT=0.84 CHECKS=7480 NODES=21	SAT TT=0.879 CHECKS=10296 NODES=17	SAT TT=0.025 ASSIGNMENTS=46 CHECKS=472	SAT TT=0.028 ASSIGNMENTS=46 CHECKS=472	SAT TT=1.417	SAT TT=1.31	No data	SAT TT=0.012 ASSIGNMENTS=46 CHECKS=472	SAT TT=0.014 ASSIGNMENTS=46 CHECKS=472	SAT TT=0.461	SAT TT=0.014 ASSIGNMENTS=46 CHECKS=472	SAT TT=0.014 ASSIGNMENTS=46 CHECKS=472	SAT TT=1.656	No data	SAT TT=0.818	SAT TT=0.826
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ myciel/ normalized-myciel6-4.xml	UNSAT TT=0.097	UNSAT TT=1.291 CHECKS=161372 NODES=583	UNSAT TT=1.353 CHECKS=179166 NODES=606	UNSAT TT=0.42	UNSAT TT=0.836 CHECKS=3349740	UNSAT TT=1.169 CHECKS=5272040	UNSAT TT=1.341 ASSIGNMENTS=384	UNSAT TT=1.34 ASSIGNMENTS=384	UNSAT TT=2.764 CHECKS=248880 NODES=3412	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.116 ASSIGNMENTS=1152 CHECKS=193635	UNSAT TT=0.112 ASSIGNMENTS=1152 CHECKS=193635	UNSAT TT=1.367	UNSAT TT=1.518	No data	UNSAT TT=0.097 ASSIGNMENTS=1318 CHECKS=214314	UNSAT TT=0.264 ASSIGNMENTS=5872 CHECKS=641014	UNSAT TT=1.107	UNSAT TT=0.214 ASSIGNMENTS=2838 CHECKS=443103	UNSAT TT=0.126 ASSIGNMENTS=1767 CHECKS=286561	UNSAT TT=6	No data	UNSAT TT=1.46	UNSAT TT=1.812
csp/graphColoring/ myciel/ normalized-myciel6-5.xml	UNSAT TT=26.269	UNSAT TT=38.679 CHECKS=54230100 NODES=219820	UNSAT TT=40.458 CHECKS=56468200 NODES=229679	? (TO) TT=1800.1	UNSAT TT=454.804 CHECKS=2164930000	UNSAT TT=471.947 CHECKS=2071190000	UNSAT TT=48.066 ASSIGNMENTS=242956	UNSAT TT=45.642 ASSIGNMENTS=242956	UNSAT TT=972.593 CHECKS=160487000 NODES=3047840	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=72.602 ASSIGNMENTS=1410710 CHECKS=193561000	UNSAT TT=140.936 ASSIGNMENTS=934415 CHECKS=222544000	UNSAT TT=679.873	UNSAT TT=538.734	No data	UNSAT TT=28.471 ASSIGNMENTS=633487 CHECKS=84302100	UNSAT TT=26.269 ASSIGNMENTS=591023 CHECKS=77526400	UNSAT TT=76.085	UNSAT TT=77.7 ASSIGNMENTS=1631870 CHECKS=196656000	UNSAT TT=65.203 ASSIGNMENTS=1410710 CHECKS=193561000	? (TO) TT=1800.16	No data	UNSAT TT=139.635	UNSAT TT=425.14
csp/graphColoring/ myciel/ normalized-myciel6-6.xml		? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.1	No data	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.15	No data	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/graphColoring/ myciel/ normalized-myciel7-4.xml	UNSAT TT=0.252	UNSAT TT=2.233 CHECKS=495812 NODES=804	UNSAT TT=2.072 CHECKS=425206 NODES=703	UNSAT TT=1.654	UNSAT TT=5.612 CHECKS=20398800	UNSAT TT=8.906 CHECKS=31411900	UNSAT TT=2.396 ASSIGNMENTS=607	UNSAT TT=2.597 ASSIGNMENTS=607	UNSAT TT=7.046 CHECKS=434406 NODES=2951	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=0.295 ASSIGNMENTS=1428 CHECKS=647886	UNSAT TT=0.314 ASSIGNMENTS=1428 CHECKS=647886	UNSAT TT=1.861	UNSAT TT=2.063	No data	UNSAT TT=0.252 ASSIGNMENTS=1281 CHECKS=559705	UNSAT TT=0.759 ASSIGNMENTS=7199 CHECKS=2187140	UNSAT TT=1.129	UNSAT TT=0.517 ASSIGNMENTS=3050 CHECKS=1268800	UNSAT TT=0.299 ASSIGNMENTS=1475 CHECKS=632049	UNSAT TT=5.266	No data	UNSAT TT=2.033	UNSAT TT=2.43
csp/graphColoring/ myciel/ normalized-myciel7-5.xml	UNSAT TT=41.969	UNSAT TT=69.367 CHECKS=96661500 NODES=163338	UNSAT TT=80.057 CHECKS=99896700 NODES=172079	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=130.077 ASSIGNMENTS=290172	UNSAT TT=143.436 ASSIGNMENTS=290172	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=95.503 ASSIGNMENTS=803507 CHECKS=276100000	UNSAT TT=289.205 ASSIGNMENTS=780141 CHECKS=405808000	? (TO) TT=1800.07	UNSAT TT=1120.16	No data	UNSAT TT=41.969 ASSIGNMENTS=383099 CHECKS=130085000	UNSAT TT=43.306 ASSIGNMENTS=404567 CHECKS=134256000	UNSAT TT=166.228	UNSAT TT=228.431 ASSIGNMENTS=1847260 CHECKS=620943000	UNSAT TT=83.017 ASSIGNMENTS=803507 CHECKS=276100000	? (TO) TT=1800.17	No data	UNSAT TT=365.613	UNSAT TT=811.677
csp/graphColoring/ myciel/ normalized-myciel7-6.xml		? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	No data	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.14	No data	? (TO) TT=1800.07	? (TO) TT=1800.14
csp/graphColoring/ myciel/ normalized-myciel7-7.xml		? (TO) TT=1800.18	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800	No data	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.12	No data	? (TO) TT=1800.07	? (TO) TT=1800.09
csp/graphColoring/ myciel/ normalized-myciel7-8.xml	SAT TT=0.087	SAT TT=1.825 CHECKS=15124 NODES=191	SAT TT=1.483 CHECKS=15654 NODES=0	SAT TT=0.317	SAT TT=0.228 CHECKS=154093	SAT TT=0.116 CHECKS=148235	SAT TT=2.032 ASSIGNMENTS=186	SAT TT=2.121 ASSIGNMENTS=186	SAT TT=2.843 CHECKS=13175 NODES=191	SAT TT=2.791 CHECKS=115048 NODES=130	SAT TT=2.822 CHECKS=327112 NODES=116	SAT TT=0.103 ASSIGNMENTS=187 CHECKS=4720	SAT TT=0.097 ASSIGNMENTS=187 CHECKS=4720	SAT TT=3.148	SAT TT=3.042	No data	SAT TT=0.087 ASSIGNMENTS=187 CHECKS=4720	SAT TT=0.092 ASSIGNMENTS=187 CHECKS=4720	SAT TT=1.041	SAT TT=0.091 ASSIGNMENTS=190 CHECKS=4720	SAT TT=0.087 ASSIGNMENTS=187 CHECKS=4720	SAT TT=3.9	No data	SAT TT=1.77	SAT TT=1.796
csp/graphColoring/ register/fpsol/ normalized-fpsol2-i-1-55.xml	UNSAT TT=0.404	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=1.536	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=5.182 ASSIGNMENTS=0	UNSAT TT=5.113 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=0.462 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.434 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.05	? (MO) TT=1013.88	No data	UNSAT TT=0.404 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.442 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.11	UNSAT TT=0.436 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.436 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.17	No data	? (TO) TT=1800.08	? (TO) TT=1800.04
csp/graphColoring/ register/fpsol/ normalized-fpsol2-i-2-10.xml	UNSAT TT=0.311	UNSAT TT=3.945 CHECKS=20 NODES=0	UNSAT TT=3.931 CHECKS=20 NODES=0	UNSAT TT=1.198	UNSAT TT=12.426 CHECKS=27253100	UNSAT TT=18.294 CHECKS=36397800	UNSAT TT=3.972 ASSIGNMENTS=0	UNSAT TT=3.738 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=0.348 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.35 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	? (TO) TT=1800.03	No data	UNSAT TT=0.329 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.33 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1262.95	UNSAT TT=0.311 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.317 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.14	No data	UNSAT TT=6.531	UNSAT TT=26.194
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ register/fpsol/ normalized-fpsol2-i-2-15.xml	UNSAT TT=0.329	UNSAT TT=4.184 CHECKS=60 NODES=0	UNSAT TT=4.049 CHECKS=60 NODES=0	UNSAT TT=1.199	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=4.092 ASSIGNMENTS=0	UNSAT TT=4.273 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=0.348 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.347 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.02	? (TO) TT=1800.01	No data	UNSAT TT=0.34 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.333 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.07	UNSAT TT=0.332 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.329 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.11	No data	? (TO) TT=1800.02	? (TO) TT=1800.13
csp/graphColoring/ register/fpsol/ normalized-fpsol2-i-2-27.xml	UNSAT TT=0.31	? (TO) TT=1800.12	UNSAT TT=4.328 CHECKS=541039 NODES=0	UNSAT TT=1.209	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=3.759 ASSIGNMENTS=0	UNSAT TT=4.29 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=0.342 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.345 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.03	? (TO) TT=1800.06	No data	UNSAT TT=0.334 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.332 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.08	UNSAT TT=0.31 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.313 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.18	No data	? (TO) TT=1800.09	? (TO) TT=1800
csp/graphColoring/ register/fpsol/ normalized-fpsol2-i-3-27.xml	UNSAT TT=0.308	? (TO) TT=1800.15	UNSAT TT=4.455 CHECKS=540007 NODES=0	UNSAT TT=1.199	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=3.828 ASSIGNMENTS=0	UNSAT TT=4.329 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=0.35 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.349 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800	? (TO) TT=1800.05	No data	UNSAT TT=0.325 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.324 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.09	UNSAT TT=0.309 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.308 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.17	No data	? (TO) TT=1800.09	? (TO) TT=1800.01
csp/graphColoring/ register/inithx/ normalized-inithx-i-1-10.xml	UNSAT TT=0.67	UNSAT TT=11.482 CHECKS=20 NODES=0	UNSAT TT=11.032 CHECKS=20 NODES=0	UNSAT TT=2.585	UNSAT TT=2.767 CHECKS=55250	UNSAT TT=1.984 CHECKS=55250	UNSAT TT=6.89 ASSIGNMENTS=0	UNSAT TT=7.658 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.749 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.753 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	? (TO) TT=1800.02	No data	UNSAT TT=0.67 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.672 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=795.334	UNSAT TT=0.729 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.679 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.15	No data	UNSAT TT=10.421	UNSAT TT=38.23
csp/graphColoring/ register/inithx/ normalized-inithx-i-1-45.xml	UNSAT TT=0.722	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=7.126 ASSIGNMENTS=0	UNSAT TT=7.129 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800	UNSAT TT=0.734 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.734 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.06	? (MO) TT=1719.15	No data	UNSAT TT=0.733 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.732 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.1	UNSAT TT=0.722 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.752 ASSIGNMENTS=0 CHECKS=3	? TT=481.099	No data	? (TO) TT=1800.01	? (TO) TT=1800.06
csp/graphColoring/ register/inithx/ normalized-inithx-i-2-15.xml	UNSAT TT=0.5	UNSAT TT=8.297 CHECKS=30 NODES=0	UNSAT TT=7.754 CHECKS=30 NODES=0	UNSAT TT=1.811	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=5.388 ASSIGNMENTS=0	UNSAT TT=5.389 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=0.565 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.566 ASSIGNMENTS=0 CHECKS=14	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	UNSAT TT=0.5 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.535 ASSIGNMENTS=0 CHECKS=14	? (TO) TT=1800.04	UNSAT TT=0.545 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.567 ASSIGNMENTS=0 CHECKS=14	? (TO) TT=1800.1	No data	? (TO) TT=1800.06	? (TO) TT=1800.08
csp/graphColoring/ register/inithx/ normalized-inithx-i-2-20.xml	UNSAT TT=0.511	UNSAT TT=8.287 CHECKS=40 NODES=0	UNSAT TT=7.589 CHECKS=40 NODES=0	UNSAT TT=1.845	? (TO) TT=1800.02	? (TO) TT=1800.11	UNSAT TT=5.451 ASSIGNMENTS=0	UNSAT TT=5.72 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.521 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.521 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.01	? (TO) TT=1800.05	No data	UNSAT TT=0.535 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.537 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.08	UNSAT TT=0.53 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.511 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.18	No data	? (TO) TT=1800.08	? (TO) TT=1800.03
csp/graphColoring/ register/inithx/ normalized-inithx-i-2-31.xml	SAT TT=0.547	SAT TT=9.356 CHECKS=373091 NODES=645	SAT TT=8.148 CHECKS=365150 NODES=0	SAT TT=2.015	SAT TT=3.001 CHECKS=1773630	SAT TT=2.428 CHECKS=1740680	SAT TT=10.84 ASSIGNMENTS=615	SAT TT=12.82 ASSIGNMENTS=615	SAT TT=66.4 CHECKS=280233 NODES=645	? (TO) TT=1800.06	SAT TT=74.178 CHECKS=68345400 NODES=5466	SAT TT=0.564 ASSIGNMENTS=644 CHECKS=28196	SAT TT=0.569 ASSIGNMENTS=644 CHECKS=28196	SAT TT=33.08	SAT TT=22.615	No data	SAT TT=0.565 ASSIGNMENTS=644 CHECKS=28196	SAT TT=0.562 ASSIGNMENTS=644 CHECKS=28289	SAT TT=3.121	SAT TT=0.642 ASSIGNMENTS=1356 CHECKS=145724	SAT TT=0.547 ASSIGNMENTS=644 CHECKS=28196	SAT TT=23.921	No data	SAT TT=6.249	SAT TT=14.673
csp/graphColoring/ register/inithx/ normalized-inithx-i-3-20.xml	UNSAT TT=0.513	UNSAT TT=7.517 CHECKS=40 NODES=0	UNSAT TT=7.516 CHECKS=40 NODES=0	UNSAT TT=1.945	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=5.755 ASSIGNMENTS=0	UNSAT TT=5.46 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=0.553 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.551 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.02	? (TO) TT=1800.07	No data	UNSAT TT=0.548 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.552 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.04	UNSAT TT=0.513 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.537 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.11	No data	? (TO) TT=1800.02	? (TO) TT=1800.05
csp/graphColoring/ register/inithx/ normalized-inithx-i-3-28.xml	UNSAT TT=0.5	UNSAT TT=151.806 CHECKS=198485000 NODES=9861	UNSAT TT=164.989 CHECKS=198894000 NODES=9861	UNSAT TT=1.959	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=5.721 ASSIGNMENTS=0	UNSAT TT=5.994 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.555 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.555 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800	? (TO) TT=1800.07	No data	UNSAT TT=0.542 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.534 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.05	UNSAT TT=0.502 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.5 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.2	No data	? (TO) TT=1800.01	? (TO) TT=1800.04
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ register/inithx/ normalized-inithx-i-3-30.xml	UNSAT TT=0.499	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=5.585 ASSIGNMENTS=0	UNSAT TT=5.499 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.526 ASSIGNMENTS=0 CHECKS=19	UNSAT TT=0.525 ASSIGNMENTS=0 CHECKS=19	? (TO) TT=1800.02	? (TO) TT=1800.03	No data	UNSAT TT=0.536 ASSIGNMENTS=0 CHECKS=19	UNSAT TT=0.499 ASSIGNMENTS=0 CHECKS=19	? (TO) TT=1800.1	UNSAT TT=0.551 ASSIGNMENTS=0 CHECKS=19	UNSAT TT=0.553 ASSIGNMENTS=0 CHECKS=19	? (TO) TT=1800.17	No data	? (TO) TT=1800.05	? (TO) TT=1800.08
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-1-05.xml	UNSAT TT=0.142	UNSAT TT=1.983 CHECKS=10 NODES=0	UNSAT TT=2.063 CHECKS=10 NODES=0	UNSAT TT=0.51	UNSAT TT=0.362 CHECKS=3998	UNSAT TT=0.194 CHECKS=3998	UNSAT TT=2.4 ASSIGNMENTS=0	UNSAT TT=2.441 ASSIGNMENTS=0	UNSAT TT=4.962 CHECKS=23870 NODES=144	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.157 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.156 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.406	UNSAT TT=2.25	No data	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.142 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.463	UNSAT TT=0.145 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.146 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=5.228	No data	UNSAT TT=2.05	UNSAT TT=2.155
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-1-25.xml	UNSAT TT=0.133	UNSAT TT=2.185 CHECKS=50 NODES=0	UNSAT TT=2.065 CHECKS=50 NODES=0	UNSAT TT=0.517	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=2.503 ASSIGNMENTS=0	UNSAT TT=2.492 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=0.154 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.153 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	? (TO) TT=1800.1	No data	UNSAT TT=0.141 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.146 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.04	UNSAT TT=0.133 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.134 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.13	No data	? (TO) TT=1800.06	? (TO) TT=1800.13
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-1-49.xml	SAT TT=0.148	SAT TT=2.258 CHECKS=176336 NODES=197	SAT TT=2.294 CHECKS=156715 NODES=0	SAT TT=0.491	SAT TT=0.464 CHECKS=350054	SAT TT=0.299 CHECKS=395865	SAT TT=3.601 ASSIGNMENTS=147	SAT TT=3.581 ASSIGNMENTS=147	SAT TT=7.226 CHECKS=139292 NODES=197	SAT TT=945.29 CHECKS=6929180000 NODES=1961250	SAT TT=6.673 CHECKS=10990800 NODES=1366	SAT TT=0.159 ASSIGNMENTS=194 CHECKS=8147	SAT TT=0.16 ASSIGNMENTS=194 CHECKS=8147	SAT TT=17.127	SAT TT=12.083	No data	SAT TT=0.149 ASSIGNMENTS=194 CHECKS=8147	SAT TT=0.148 ASSIGNMENTS=194 CHECKS=8172	SAT TT=1.445	SAT TT=0.149 ASSIGNMENTS=193 CHECKS=8174	SAT TT=0.149 ASSIGNMENTS=194 CHECKS=8147	SAT TT=16.898	No data	SAT TT=3.45	SAT TT=6.75
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-2-05.xml	UNSAT TT=0.143	UNSAT TT=1.918 CHECKS=10 NODES=0	UNSAT TT=2.08 CHECKS=10 NODES=0	UNSAT TT=0.513	UNSAT TT=0.358 CHECKS=3914	UNSAT TT=0.194 CHECKS=3914	UNSAT TT=2.433 ASSIGNMENTS=0	UNSAT TT=2.591 ASSIGNMENTS=0	UNSAT TT=5.325 CHECKS=24912 NODES=144	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=0.152 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.371	UNSAT TT=2.397	No data	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.264	UNSAT TT=0.144 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.144 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=5.25	No data	UNSAT TT=1.803	UNSAT TT=2.513
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-2-20.xml	UNSAT TT=0.142	UNSAT TT=1.916 CHECKS=40 NODES=0	UNSAT TT=1.918 CHECKS=40 NODES=0	UNSAT TT=0.516	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=2.258 ASSIGNMENTS=0	UNSAT TT=2.645 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.152 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.152 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.1	? (TO) TT=1800.07	No data	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.06	UNSAT TT=0.142 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.11	No data	? (TO) TT=1800.05	? (TO) TT=1800.05
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-3-30.xml	UNSAT TT=0.132	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=2.414 ASSIGNMENTS=0	UNSAT TT=2.695 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.147 ASSIGNMENTS=0 CHECKS=7	UNSAT TT=0.147 ASSIGNMENTS=0 CHECKS=7	? (TO) TT=1800.07	? (TO) TT=1800.01	No data	UNSAT TT=0.132 ASSIGNMENTS=0 CHECKS=7	UNSAT TT=0.145 ASSIGNMENTS=0 CHECKS=7	? (TO) TT=1800.02	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=7	UNSAT TT=0.142 ASSIGNMENTS=0 CHECKS=7	? (TO) TT=1800.24	No data	? (TO) TT=1800.03	? (TO) TT=1800.06
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-4-29.xml	UNSAT TT=0.131	UNSAT TT=1.957 CHECKS=58 NODES=0	UNSAT TT=1.953 CHECKS=58 NODES=0	UNSAT TT=0.514	? (TO) TT=1800.11	? (TO) TT=1800.04	UNSAT TT=2.406 ASSIGNMENTS=0	UNSAT TT=2.58 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.154 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.156 ASSIGNMENTS=0 CHECKS=9	? (TO) TT=1800.02	? (TO) TT=1800.07	No data	UNSAT TT=0.147 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.148 ASSIGNMENTS=0 CHECKS=9	? (TO) TT=1800.13	UNSAT TT=0.131 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.144 ASSIGNMENTS=0 CHECKS=9	? (TO) TT=1800.15	No data	? (TO) TT=1800.06	? (TO) TT=1800.04
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-4-30.xml	UNSAT TT=0.144	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=2.286 ASSIGNMENTS=0	UNSAT TT=2.642 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=0.156 ASSIGNMENTS=0 CHECKS=7	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=7	? (TO) TT=1800.01	? (TO) TT=1800.06	No data	UNSAT TT=0.146 ASSIGNMENTS=0 CHECKS=7	UNSAT TT=0.146 ASSIGNMENTS=0 CHECKS=7	? (TO) TT=1800.05	UNSAT TT=0.144 ASSIGNMENTS=0 CHECKS=7	UNSAT TT=0.145 ASSIGNMENTS=0 CHECKS=7	? (TO) TT=1800.14	No data	? (TO) TT=1800.05	? (TO) TT=1800.15
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-5-10.xml	UNSAT TT=0.137	UNSAT TT=1.962 CHECKS=20 NODES=0	UNSAT TT=2.154 CHECKS=20 NODES=0	UNSAT TT=0.525	UNSAT TT=1.197 CHECKS=2915630	UNSAT TT=1.406 CHECKS=4182160	UNSAT TT=2.576 ASSIGNMENTS=0	UNSAT TT=2.247 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.158 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.08	UNSAT TT=599.726	No data	UNSAT TT=0.145 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.145 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=584.386	UNSAT TT=0.137 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.146 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.12	No data	UNSAT TT=7.199	UNSAT TT=11.879
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ register/zeroin/ normalized-zeroin-i-1-45.xml	UNSAT TT=0.151	UNSAT TT=2.111 CHECKS=90 NODES=0	UNSAT TT=2.234 CHECKS=90 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=2.465 ASSIGNMENTS=0	UNSAT TT=2.703 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.163 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.163 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.03	? (MO) TT=1491.88	No data	UNSAT TT=0.151 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.151 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.1	UNSAT TT=0.153 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.151 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.14	No data	? (TO) TT=1800.05	? (TO) TT=1800.08
csp/graphColoring/ register/zeroin/ normalized-zeroin-i-2-28.xml	UNSAT TT=0.129	UNSAT TT=2.018 CHECKS=56 NODES=0	UNSAT TT=2.057 CHECKS=56 NODES=0	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=2.073 ASSIGNMENTS=0	UNSAT TT=2.302 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.145 ASSIGNMENTS=0 CHECKS=12	? (TO) TT=1800.05	? (TO) TT=1800.07	No data	UNSAT TT=0.13 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.129 ASSIGNMENTS=0 CHECKS=12	? (TO) TT=1800.03	UNSAT TT=0.131 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.13 ASSIGNMENTS=0 CHECKS=12	? (TO) TT=1800.19	No data	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/graphColoring/ register/zeroin/ normalized-zeroin-i-2-30.xml	SAT TT=0.134	SAT TT=2.1 CHECKS=88469 NODES=211	SAT TT=2.184 CHECKS=80672 NODES=0	SAT TT=0.442	SAT TT=0.418 CHECKS=342900	SAT TT=0.266 CHECKS=364654	SAT TT=3.089 ASSIGNMENTS=180	SAT TT=3.405 ASSIGNMENTS=181	SAT TT=5.408 CHECKS=66237 NODES=211	? (TO) TT=1800	SAT TT=5.947 CHECKS=8384530 NODES=1681	SAT TT=0.145 ASSIGNMENTS=209 CHECKS=7365	SAT TT=0.145 ASSIGNMENTS=209 CHECKS=7365	SAT TT=8.523	SAT TT=7.132	No data	SAT TT=0.136 ASSIGNMENTS=209 CHECKS=7365	SAT TT=0.137 ASSIGNMENTS=208 CHECKS=7440	SAT TT=1.237	SAT TT=0.166 ASSIGNMENTS=1478 CHECKS=42809	SAT TT=0.134 ASSIGNMENTS=209 CHECKS=7365	SAT TT=12.88	No data	SAT TT=2.639	SAT TT=4.418
csp/graphColoring/ school/ normalized-school1-13.xml	UNSAT TT=0.862	UNSAT TT=4.596 CHECKS=98 NODES=0	UNSAT TT=4.963 CHECKS=98 NODES=0	UNSAT TT=2.543	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=9.372 ASSIGNMENTS=0	UNSAT TT=9.631 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.91 ASSIGNMENTS=0 CHECKS=5	UNSAT TT=0.916 ASSIGNMENTS=0 CHECKS=5	? (TO) TT=1800.09	? (TO) TT=1800.07	No data	UNSAT TT=0.88 ASSIGNMENTS=0 CHECKS=5	UNSAT TT=0.879 ASSIGNMENTS=0 CHECKS=5	? (TO) TT=1800.05	UNSAT TT=0.867 ASSIGNMENTS=0 CHECKS=5	UNSAT TT=0.862 ASSIGNMENTS=0 CHECKS=5	? (TO) TT=1800.16	No data	? (TO) TT=1800.01	UNSAT TT=770.38
csp/graphColoring/ school/ normalized-school1-14.xml	SAT TT=1.275	SAT TT=5.576 CHECKS=135370 NODES=394	SAT TT=6.366 CHECKS=240254 NODES=0	SAT TT=2.546	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=13.139 ASSIGNMENTS=42	SAT TT=60.937 ASSIGNMENTS=36	SAT TT=213.252 CHECKS=1252360 NODES=4342	SAT TT=213.082 CHECKS=250656000 NODES=154749	SAT TT=162.371 CHECKS=11939600 NODES=770	SAT TT=1.322 ASSIGNMENTS=49 CHECKS=162052	SAT TT=1.322 ASSIGNMENTS=49 CHECKS=162052	SAT TT=20.137	SAT TT=14.993	No data	SAT TT=1.349 ASSIGNMENTS=49 CHECKS=162052	SAT TT=54.496 ASSIGNMENTS=6839 CHECKS=19371800	? (TO) TT=1800.05	SAT TT=12.362 ASSIGNMENTS=2412 CHECKS=4713990	SAT TT=1.275 ASSIGNMENTS=49 CHECKS=162052	SAT TT=14.605	No data	SAT TT=5.897	SAT TT=11.224
csp/graphColoring/ school/ normalized-school1-15.xml	SAT TT=1.291	SAT TT=5.604 CHECKS=151940 NODES=392	SAT TT=5.734 CHECKS=192716 NODES=0	SAT TT=2.573	SAT TT=18.06 CHECKS=19456000	SAT TT=24.727 CHECKS=30608900	SAT TT=401.352 ASSIGNMENTS=1288	? (TO) TT=1800.12	SAT TT=161.971 CHECKS=375977 NODES=1210	SAT TT=141.767 CHECKS=2547270 NODES=861	SAT TT=145.389 CHECKS=12491400 NODES=854	SAT TT=1.35 ASSIGNMENTS=82 CHECKS=176794	SAT TT=1.348 ASSIGNMENTS=82 CHECKS=176794	SAT TT=22.093	SAT TT=15.605	No data	SAT TT=1.291 ASSIGNMENTS=82 CHECKS=176794	SAT TT=52.895 ASSIGNMENTS=8627 CHECKS=18924100	? (TO) TT=1800.07	SAT TT=21.335 ASSIGNMENTS=5858 CHECKS=8747820	SAT TT=1.322 ASSIGNMENTS=82 CHECKS=176794	SAT TT=22.34	No data	SAT TT=6.388	SAT TT=9.828
csp/graphColoring/ school/ normalized-school1-16.xml	SAT TT=0.81	SAT TT=5.447 CHECKS=167334 NODES=388	SAT TT=8.327 CHECKS=585034 NODES=388	SAT TT=2.593	SAT TT=19.81 CHECKS=24507200	SAT TT=21.7 CHECKS=27787400	SAT TT=1688.24 ASSIGNMENTS=3800	? (TO) TT=1800.09	SAT TT=453.869 CHECKS=5659770 NODES=14077	SAT TT=159.304 CHECKS=2599340 NODES=803	SAT TT=148.596 CHECKS=12386700 NODES=947	SAT TT=0.824 ASSIGNMENTS=88 CHECKS=39026	SAT TT=0.831 ASSIGNMENTS=88 CHECKS=39026	SAT TT=23.469	SAT TT=15.134	No data	SAT TT=0.817 ASSIGNMENTS=88 CHECKS=39026	SAT TT=64.986 ASSIGNMENTS=603120 CHECKS=111908000	? (TO) TT=1800.09	SAT TT=1.26 ASSIGNMENTS=6362 CHECKS=749587	SAT TT=0.81 ASSIGNMENTS=87 CHECKS=39026	SAT TT=15.865	No data	SAT TT=6.581	SAT TT=10.344
csp/graphColoring/ school/ normalized-school1-nsh-12.xml	UNSAT TT=0.728	UNSAT TT=4.054 CHECKS=24 NODES=0	UNSAT TT=3.947 CHECKS=24 NODES=0	UNSAT TT=1.938	? (TO) TT=1800.04	? (TO) TT=1800.12	UNSAT TT=7.467 ASSIGNMENTS=0	UNSAT TT=7.556 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=0.741 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.754 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	UNSAT TT=0.735 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.728 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	UNSAT TT=0.749 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.744 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.87	No data	UNSAT TT=322.882	UNSAT TT=250.583
csp/graphColoring/ school/ normalized-school1-nsh-13.xml	UNSAT TT=0.695	UNSAT TT=4.025 CHECKS=26 NODES=0	UNSAT TT=3.765 CHECKS=26 NODES=0	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=7.536 ASSIGNMENTS=0	UNSAT TT=6.726 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.751 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.744 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	? (TO) TT=1800	No data	UNSAT TT=0.695 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.742 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.1	UNSAT TT=0.743 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.737 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.18	No data	UNSAT TT=453.034	? (TO) TT=1800.06
csp/graphColoring/ school/ normalized-school1-nsh-14.xml	SAT TT=1.011	SAT TT=15.463 CHECKS=10629900 NODES=3196	SAT TT=5.142 CHECKS=211503 NODES=0	SAT TT=1793.84	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=18.083 ASSIGNMENTS=60	SAT TT=67.647 ASSIGNMENTS=39	SAT TT=91.319 CHECKS=639822 NODES=2013	SAT TT=1322.25 CHECKS=5553030000 NODES=4202190	SAT TT=73.332 CHECKS=8221210 NODES=794	SAT TT=1.059 ASSIGNMENTS=50 CHECKS=129183	SAT TT=1.068 ASSIGNMENTS=50 CHECKS=129183	SAT TT=15.706	SAT TT=12.538	No data	SAT TT=1.011 ASSIGNMENTS=50 CHECKS=129183	SAT TT=42.58 ASSIGNMENTS=6251 CHECKS=14470000	? (TO) TT=1800.11	SAT TT=12.777 ASSIGNMENTS=4754 CHECKS=5415860	SAT TT=1.07 ASSIGNMENTS=50 CHECKS=129183	SAT TT=13.176	No data	SAT TT=6.238	SAT TT=8.39
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ school/ normalized-school1-nsh-15.xml	SAT TT=1.072	SAT TT=5.302 CHECKS=451754 NODES=510	SAT TT=6.984 CHECKS=816486 NODES=510	SAT TT=27.003	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=396.32 ASSIGNMENTS=1489	? (TO) TT=1800.13	SAT TT=92.386 CHECKS=571967 NODES=2306	SAT TT=120.719 CHECKS=225342000 NODES=153214	SAT TT=73.808 CHECKS=8942680 NODES=963	SAT TT=1.11 ASSIGNMENTS=97 CHECKS=157057	SAT TT=1.095 ASSIGNMENTS=97 CHECKS=157057	SAT TT=16.923	SAT TT=12.815	No data	SAT TT=1.086 ASSIGNMENTS=97 CHECKS=157057	SAT TT=36.852 ASSIGNMENTS=8745 CHECKS=13517100	? (TO) TT=1800.08	SAT TT=14.345 ASSIGNMENTS=5358 CHECKS=5432380	SAT TT=1.072 ASSIGNMENTS=98 CHECKS=156767	SAT TT=16.38	No data	SAT TT=5.118	SAT TT=8.881
csp/graphColoring/ sgb/book/ normalized-anna-5.xml	UNSAT TT=0.023	UNSAT TT=0.985 CHECKS=0 NODES=0	UNSAT TT=1.012 CHECKS=0 NODES=0	UNSAT TT=0.094	UNSAT TT=0.058 CHECKS=77211	UNSAT TT=0.04 CHECKS=78412	UNSAT TT=1.149 ASSIGNMENTS=0	UNSAT TT=1.163 ASSIGNMENTS=0	UNSAT TT=1.22 CHECKS=10700 NODES=207	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=1.121	UNSAT TT=1.097	No data	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.676	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=2.372	No data	UNSAT TT=1.243	UNSAT TT=1.245
csp/graphColoring/ sgb/book/ normalized-anna-9.xml	UNSAT TT=0.023	UNSAT TT=1.065 CHECKS=0 NODES=0	UNSAT TT=0.975 CHECKS=0 NODES=0	UNSAT TT=1500.87	UNSAT TT=471.789 CHECKS=1719900000	UNSAT TT=463.632 CHECKS=1704970000	UNSAT TT=1.015 ASSIGNMENTS=0	UNSAT TT=1.038 ASSIGNMENTS=0	UNSAT TT=145.856 CHECKS=22651200 NODES=402628	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=291.473	UNSAT TT=21.715	No data	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=7.534	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=74.711	No data	UNSAT TT=1.879	UNSAT TT=3.555
csp/graphColoring/ sgb/book/ normalized-david-5.xml	UNSAT TT=0.019	UNSAT TT=0.924 CHECKS=0 NODES=0	UNSAT TT=0.989 CHECKS=0 NODES=0	UNSAT TT=0.079	UNSAT TT=0.039 CHECKS=420	UNSAT TT=0.02 CHECKS=420	UNSAT TT=0.897 ASSIGNMENTS=0	UNSAT TT=0.921 ASSIGNMENTS=0	UNSAT TT=1.162 CHECKS=11038 NODES=170	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=1.092	UNSAT TT=1.005	No data	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.627	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=2.129	No data	UNSAT TT=1.141	UNSAT TT=1.303
csp/graphColoring/ sgb/book/ normalized-david-8.xml	UNSAT TT=0.019	UNSAT TT=0.9 CHECKS=0 NODES=0	UNSAT TT=0.977 CHECKS=0 NODES=0	UNSAT TT=0.748	UNSAT TT=0.045 CHECKS=49829	UNSAT TT=0.029 CHECKS=50665	UNSAT TT=1 ASSIGNMENTS=0	UNSAT TT=0.956 ASSIGNMENTS=0	UNSAT TT=12.187 CHECKS=2285510 NODES=46404	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=5.919	UNSAT TT=2.483	No data	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=1.425	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=6.303	No data	UNSAT TT=1.293	UNSAT TT=1.647
csp/graphColoring/ sgb/book/ normalized-homer-12.xml	UNSAT TT=0.074	UNSAT TT=1310.15 CHECKS=2489650000 NODES=4037900	UNSAT TT=1279.2 CHECKS=2489670000 NODES=4037900	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=1.916 ASSIGNMENTS=0	UNSAT TT=1.628 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=0.091 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.094 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.02	? (TO) TT=1800.04	No data	UNSAT TT=0.082 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.077 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.06	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.11	No data	UNSAT TT=89.42	UNSAT TT=165.118
csp/graphColoring/ sgb/book/ normalized-huck-10.xml	UNSAT TT=0.015	UNSAT TT=0.966 CHECKS=40043 NODES=94	UNSAT TT=0.918 CHECKS=8025 NODES=0	UNSAT TT=1796.74	UNSAT TT=0.038 CHECKS=38942	UNSAT TT=0.026 CHECKS=38733	UNSAT TT=0.816 ASSIGNMENTS=0	UNSAT TT=0.822 ASSIGNMENTS=0	UNSAT TT=491.328 CHECKS=87762900 NODES=3973090	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.09	UNSAT TT=56.95	No data	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=61.378	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=525.532	No data	UNSAT TT=2.532	UNSAT TT=11.818
csp/graphColoring/ sgb/book/ normalized-jean-5.xml	UNSAT TT=0.015	UNSAT TT=0.902 CHECKS=10 NODES=0	UNSAT TT=0.824 CHECKS=10 NODES=0	UNSAT TT=0.053	UNSAT TT=0.026 CHECKS=265	UNSAT TT=0.015 CHECKS=265	UNSAT TT=0.748 ASSIGNMENTS=0	UNSAT TT=0.757 ASSIGNMENTS=0	UNSAT TT=0.873 CHECKS=3864 NODES=175	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=1.112	UNSAT TT=0.836	No data	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.509	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=1.771	No data	UNSAT TT=0.818	UNSAT TT=0.84
csp/graphColoring/sgb/games/ normalized-games120-8.xml	UNSAT TT=0.026	UNSAT TT=0.989 CHECKS=0 NODES=0	UNSAT TT=1.022 CHECKS=0 NODES=0	UNSAT TT=0.107	UNSAT TT=71.205 CHECKS=217260000	UNSAT TT=79.359 CHECKS=255602000	UNSAT TT=1.024 ASSIGNMENTS=0	UNSAT TT=1.072 ASSIGNMENTS=0	UNSAT TT=8.988 CHECKS=525431 NODES=46397	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=5.874	UNSAT TT=3.856	No data	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=4.243	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=4.486	No data	UNSAT TT=1.605	UNSAT TT=1.563
csp/graphColoring/ sgb/miles/ normalized-miles1000-40.xml	UNSAT TT=0.112	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=2.229 ASSIGNMENTS=0	UNSAT TT=2.407 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=0.126 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.133 ASSIGNMENTS=0 CHECKS=3	? (MO) TT=1612.27	? (TO) TT=1800.05	No data	UNSAT TT=0.112 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.113 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.11	UNSAT TT=0.126 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.127 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.18	No data	? (TO) TT=1800.04	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ sgb/miles/ normalized-miles1500-30.xml	UNSAT TT=0.198	UNSAT TT=2.214 CHECKS=0 NODES=0	UNSAT TT=2.112 CHECKS=0 NODES=0	UNSAT TT=0.653	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=3.01 ASSIGNMENTS=0	UNSAT TT=2.697 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=0.215 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.211 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	? (TO) TT=1800.02	No data	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.198 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.21	No data	? (TO) TT=1800.02	? (TO) TT=1800.1
csp/graphColoring/ sgb/miles/ normalized-miles1500-72.xml	UNSAT TT=0.182	UNSAT TT=2.128 CHECKS=0 NODES=0	UNSAT TT=2.135 CHECKS=0 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=2.993 ASSIGNMENTS=0	UNSAT TT=3.104 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=0.204 ASSIGNMENTS=0 CHECKS=5	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=5	? (MO) TT=956.69	? (MO) TT=488.64	No data	UNSAT TT=0.182 ASSIGNMENTS=0 CHECKS=5	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=5	? (TO) TT=1800.03	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=5	UNSAT TT=0.198 ASSIGNMENTS=0 CHECKS=5	? (TO) TT=1800.18	No data	? (TO) TT=1800.06	? (TO) TT=1800.1
csp/graphColoring/ sgb/miles/ normalized-miles1500-73.xml	SAT TT=0.189	SAT TT=2.357 CHECKS=350364 NODES=128	SAT TT=2.31 CHECKS=335666 NODES=0	SAT TT=0.622	SAT TT=0.626 CHECKS=682749	SAT TT=0.47 CHECKS=742486	SAT TT=4.018 ASSIGNMENTS=56	SAT TT=3.911 ASSIGNMENTS=56	SAT TT=15.513 CHECKS=502271 NODES=848	SAT TT=8.563 CHECKS=3523770 NODES=288	SAT TT=11.322 CHECKS=12696400 NODES=955	SAT TT=0.222 ASSIGNMENTS=127 CHECKS=10476	SAT TT=0.217 ASSIGNMENTS=127 CHECKS=10476	SAT TT=46.209	SAT TT=17.949	No data	SAT TT=0.203 ASSIGNMENTS=127 CHECKS=10476	SAT TT=0.202 ASSIGNMENTS=126 CHECKS=10476	SAT TT=1.401	SAT TT=0.695 ASSIGNMENTS=12194 CHECKS=685702	SAT TT=0.189 ASSIGNMENTS=127 CHECKS=10475	SAT TT=72.818	No data	SAT TT=4.551	SAT TT=11.586
csp/graphColoring/ sgb/miles/ normalized-miles500-10.xml	UNSAT TT=0.046	UNSAT TT=1.182 CHECKS=0 NODES=0	UNSAT TT=1.19 CHECKS=0 NODES=0	UNSAT TT=0.171	? (TO) TT=1800.08	UNSAT TT=1708.98 CHECKS=8019910000	UNSAT TT=1.539 ASSIGNMENTS=0	UNSAT TT=1.284 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=11	? (TO) TT=1800.08	UNSAT TT=179.749	No data	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=103.186	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=11	? (TO) TT=1800.13	No data	UNSAT TT=6.868	UNSAT TT=7.457
csp/graphColoring/ sgb/miles/ normalized-miles500-15.xml	UNSAT TT=0.045	UNSAT TT=1.204 CHECKS=0 NODES=0	UNSAT TT=1.209 CHECKS=0 NODES=0	UNSAT TT=0.172	? (TO) TT=1800.02	? (TO) TT=1800.11	UNSAT TT=1.354 ASSIGNMENTS=0	UNSAT TT=1.529 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.05	? (TO) TT=1800.1	No data	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.2	No data	? (TO) TT=1800.1	? (TO) TT=1800.15
csp/graphColoring/ sgb/miles/ normalized-miles500-19.xml	UNSAT TT=0.044	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=1.284 ASSIGNMENTS=0	UNSAT TT=1.292 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=6	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=6	? (TO) TT=1800.06	? (TO) TT=1800.06	No data	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=6	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=6	? (TO) TT=1800.04	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=6	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=6	? (TO) TT=1800.12	No data	? (TO) TT=1800.04	? (TO) TT=1800.06
csp/graphColoring/ sgb/miles/ normalized-miles750-15.xml	UNSAT TT=0.075	UNSAT TT=1.336 CHECKS=0 NODES=0	UNSAT TT=1.358 CHECKS=0 NODES=0	UNSAT TT=0.285	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=1.651 ASSIGNMENTS=0	UNSAT TT=1.966 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.086 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.085 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.01	? (TO) TT=1800.02	No data	UNSAT TT=0.08 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.081 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.06	UNSAT TT=0.075 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.077 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.16	No data	? (TO) TT=1800.11	? (TO) TT=1800.05
csp/graphColoring/ sgb/miles/ normalized-miles750-29.xml	UNSAT TT=0.074	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=1.913 ASSIGNMENTS=0	UNSAT TT=1.715 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.092 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.091 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.06	? (TO) TT=1800.07	No data	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.11	UNSAT TT=0.081 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.082 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.18	No data	? (TO) TT=1800.04	? (TO) TT=1800.07
csp/graphColoring/ sgb/miles/ normalized-miles750-31.xml	SAT TT=0.08	SAT TT=1.615 CHECKS=49632 NODES=128	SAT TT=1.496 CHECKS=49299 NODES=0	SAT TT=0.294	SAT TT=11.6 CHECKS=56627200	SAT TT=17.111 CHECKS=86464500	SAT TT=2.289 ASSIGNMENTS=93	SAT TT=2.143 ASSIGNMENTS=93	SAT TT=3.571 CHECKS=71743 NODES=761	SAT TT=3.162 CHECKS=2529390 NODES=1525	SAT TT=2.74 CHECKS=1839400 NODES=449	SAT TT=0.097 ASSIGNMENTS=122 CHECKS=4443	SAT TT=0.095 ASSIGNMENTS=122 CHECKS=4443	SAT TT=6.362	SAT TT=5.398	No data	SAT TT=0.081 ASSIGNMENTS=122 CHECKS=4443	SAT TT=0.096 ASSIGNMENTS=986 CHECKS=20827	? (TO) TT=1800.07	SAT TT=0.195 ASSIGNMENTS=4572 CHECKS=122022	SAT TT=0.08 ASSIGNMENTS=122 CHECKS=4443	SAT TT=13.487	No data	SAT TT=2.029	SAT TT=3.2
csp/graphColoring/sgb/miles/ normalized-miles750-5.xml	UNSAT TT=0.079	UNSAT TT=1.422 CHECKS=0 NODES=0	UNSAT TT=1.388 CHECKS=0 NODES=0	UNSAT TT=0.288	UNSAT TT=0.187 CHECKS=165603	UNSAT TT=0.119 CHECKS=321911	UNSAT TT=1.824 ASSIGNMENTS=0	UNSAT TT=1.774 ASSIGNMENTS=0	UNSAT TT=2.531 CHECKS=6650 NODES=177	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=0.093 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.092 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.821	UNSAT TT=1.695	No data	UNSAT TT=0.079 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.08 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.999	UNSAT TT=0.08 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.079 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=4.055	No data	UNSAT TT=1.859	UNSAT TT=2.036
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ sgb/queen/ normalized-queen12-12-11.xml	UNSAT TT=0.095	UNSAT TT=1.487 CHECKS=22 NODES=0	UNSAT TT=1.501 CHECKS=22 NODES=0	UNSAT TT=0.349	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=1.993 ASSIGNMENTS=0	UNSAT TT=1.995 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.108 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.106 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	? (TO) TT=1800	No data	UNSAT TT=0.097 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.095 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.04	UNSAT TT=0.098 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.095 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.16	No data	UNSAT TT=14.58	UNSAT TT=11.473
csp/graphColoring/ sgb/queen/ normalized-queen12-12-14.xml	SAT TT=0.933	SAT TT=11.095 CHECKS=11316300 NODES=57864	SAT TT=3.649 CHECKS=2120150 NODES=10938	SAT TT=55.645	SAT TT=154.714 CHECKS=773226000	? (TO) TT=1800.09	SAT TT=110.288 ASSIGNMENTS=44105	SAT TT=58.191 ASSIGNMENTS=19702	SAT TT=205.791 CHECKS=14143100 NODES=235468	SAT TT=3.249 CHECKS=354296 NODES=402	SAT TT=3.097 CHECKS=1304330 NODES=723	SAT TT=8.236 ASSIGNMENTS=18697 CHECKS=2180330	SAT TT=170.448 ASSIGNMENTS=1183720 CHECKS=229036000	SAT TT=13.117	SAT TT=104.096	No data	SAT TT=9.722 ASSIGNMENTS=224516 CHECKS=28313200	? (TO) TT=1800.11	? (TO) TT=1800.13	SAT TT=8.248 ASSIGNMENTS=134597 CHECKS=20559400	SAT TT=0.933 ASSIGNMENTS=18697 CHECKS=2180330	SAT TT=318.771	No data	SAT TT=4.296	SAT TT=18.875
csp/graphColoring/ sgb/queen/ normalized-queen15-15-15.xml		? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.04	No data	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.18	No data	? (TO) TT=1800.05	? (TO) TT=1800.04
csp/graphColoring/ sgb/queen/ normalized-queen8-12-10.xml	UNSAT TT=0.051	UNSAT TT=1.183 CHECKS=39 NODES=0	UNSAT TT=1.187 CHECKS=39 NODES=0	UNSAT TT=0.195	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=1.366 ASSIGNMENTS=0	UNSAT TT=1.667 ASSIGNMENTS=0	UNSAT TT=1723.99 CHECKS=208480000 NODES=3957090	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.04	UNSAT TT=105.644	No data	UNSAT TT=0.052 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=169.906	UNSAT TT=0.052 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.14	No data	UNSAT TT=6.037	UNSAT TT=6.162
csp/graphColoring/ sgb/queen/ normalized-queen8-12-12.xml	SAT TT=0.055	SAT TT=1.633 CHECKS=137462 NODES=1126	SAT TT=1.517 CHECKS=60950 NODES=381	SAT TT=0.199	SAT TT=12.677 CHECKS=59749000	SAT TT=17.781 CHECKS=86672000	SAT TT=4.378 ASSIGNMENTS=442	SAT TT=3.867 ASSIGNMENTS=216	SAT TT=3.927 CHECKS=210328 NODES=4735	SAT TT=2.047 CHECKS=168024 NODES=294	SAT TT=1.885 CHECKS=235212 NODES=159	SAT TT=0.068 ASSIGNMENTS=142 CHECKS=11878	SAT TT=0.07 ASSIGNMENTS=142 CHECKS=11878	SAT TT=3.126	SAT TT=2.829	No data	SAT TT=0.055 ASSIGNMENTS=109 CHECKS=8748	SAT TT=0.217 ASSIGNMENTS=8173 CHECKS=284561	? (TO) TT=1800.1	SAT TT=0.097 ASSIGNMENTS=1686 CHECKS=64223	SAT TT=0.076 ASSIGNMENTS=644 CHECKS=54793	SAT TT=4.109	No data	SAT TT=1.566	SAT TT=1.665
csp/graphColoring/sgb/queen/ normalized-queen8-8-9.xml	SAT TT=0.945	SAT TT=6.942 CHECKS=7271100 NODES=47953	SAT TT=19.133 CHECKS=23097800 NODES=153835	SAT TT=1.142	SAT TT=18.018 CHECKS=87082500	SAT TT=17.548 CHECKS=84234100	SAT TT=43.731 ASSIGNMENTS=29099	SAT TT=2.509 ASSIGNMENTS=366	SAT TT=20.799 CHECKS=3301950 NODES=75147	SAT TT=1.394 CHECKS=265219 NODES=1167	SAT TT=2 CHECKS=6091950 NODES=8222	SAT TT=13.614 ASSIGNMENTS=47433 CHECKS=7006570	SAT TT=13.746 ASSIGNMENTS=47433 CHECKS=7006570	SAT TT=23.637	SAT TT=43.667	No data	SAT TT=364.165 ASSIGNMENTS=7729060 CHECKS=774419000	SAT TT=1.778 ASSIGNMENTS=36783 CHECKS=3795950	? (TO) TT=1800.06	SAT TT=3.717 ASSIGNMENTS=72578 CHECKS=7359090	SAT TT=0.945 ASSIGNMENTS=19063 CHECKS=1970120	SAT TT=57.955	No data	SAT TT=92.648	SAT TT=3.746
csp/hanoi/ normalized-hanoi-3_ext.xml	SAT TT=0.006	SAT TT=0.611 CHECKS=164 NODES=6	SAT TT=0.593 CHECKS=164 NODES=0	SAT TT=0.027	SAT TT=0.006 CHECKS=17	SAT TT=0.009 CHECKS=17	SAT TT=0.327 ASSIGNMENTS=1	SAT TT=0.338 ASSIGNMENTS=1	SAT TT=0.284 CHECKS=145 NODES=6	SAT TT=0.273 CHECKS=165 NODES=0	SAT TT=0.275 CHECKS=165 NODES=0	SAT TT=0.02 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.017 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.962	SAT TT=0.837	No data	SAT TT=0.007 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.007 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.269	SAT TT=0.006 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.006 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.702	SAT TT=0.01 ASSIGNMENTS=7 CHECKS=835	SAT TT=0.462	SAT TT=0.482
csp/hanoi/ normalized-hanoi-4_ext.xml	SAT TT=0.007	SAT TT=0.619 CHECKS=2211 NODES=14	SAT TT=0.618 CHECKS=2210 NODES=0	SAT TT=0.032	SAT TT=0.018 CHECKS=49	SAT TT=0.019 CHECKS=49	SAT TT=0.37 ASSIGNMENTS=1	SAT TT=0.365 ASSIGNMENTS=1	SAT TT=0.329 CHECKS=2970 NODES=14	SAT TT=0.305 CHECKS=3157 NODES=0	SAT TT=0.305 CHECKS=3157 NODES=0	SAT TT=0.021 ASSIGNMENTS=0 CHECKS=48	SAT TT=0.018 ASSIGNMENTS=0 CHECKS=48	SAT TT=1.742	SAT TT=1.673	No data	SAT TT=0.008 ASSIGNMENTS=0 CHECKS=48	SAT TT=0.007 ASSIGNMENTS=0 CHECKS=48	SAT TT=0.301	SAT TT=0.007 ASSIGNMENTS=0 CHECKS=48	SAT TT=0.008 ASSIGNMENTS=0 CHECKS=48	SAT TT=0.973	SAT TT=0.009 ASSIGNMENTS=14 CHECKS=13167	SAT TT=0.733	SAT TT=0.618
csp/hanoi/ normalized-hanoi-5_ext.xml	SAT TT=0.009	SAT TT=0.673 CHECKS=30105 NODES=30	SAT TT=1.231 CHECKS=30105 NODES=0	SAT TT=0.066	SAT TT=0.208 CHECKS=113	SAT TT=0.215 CHECKS=113	SAT TT=0.578 ASSIGNMENTS=1	SAT TT=0.571 ASSIGNMENTS=1	SAT TT=0.754 CHECKS=55621 NODES=30	SAT TT=0.372 CHECKS=58513 NODES=0	SAT TT=0.39 CHECKS=58513 NODES=0	SAT TT=0.021 ASSIGNMENTS=0 CHECKS=112	SAT TT=0.019 ASSIGNMENTS=0 CHECKS=112	SAT TT=19.202	SAT TT=14.622	No data	SAT TT=0.01 ASSIGNMENTS=0 CHECKS=112	SAT TT=0.011 ASSIGNMENTS=0 CHECKS=112	? (problem) TT=0.443	SAT TT=0.009 ASSIGNMENTS=0 CHECKS=112	SAT TT=0.009 ASSIGNMENTS=0 CHECKS=112	SAT TT=1.543	SAT TT=0.101 ASSIGNMENTS=31 CHECKS=528638	SAT TT=1.397	SAT TT=1.684
csp/hanoi/ normalized-hanoi-6_ext.xml	SAT TT=0.041	SAT TT=0.868 CHECKS=570583 NODES=62	SAT TT=0.732 CHECKS=570583 NODES=0	SAT TT=0.356	SAT TT=5.463 CHECKS=241	SAT TT=5.519 CHECKS=241	SAT TT=3.422 ASSIGNMENTS=1	SAT TT=3.392 ASSIGNMENTS=1	SAT TT=5.704 CHECKS=1045260 NODES=62	SAT TT=0.533 CHECKS=1096760 NODES=0	SAT TT=0.55 CHECKS=1096760 NODES=0	SAT TT=0.062 ASSIGNMENTS=0 CHECKS=240	SAT TT=0.058 ASSIGNMENTS=0 CHECKS=240	SAT TT=274.011	SAT TT=271.254	No data	SAT TT=0.046 ASSIGNMENTS=0 CHECKS=240	SAT TT=0.041 ASSIGNMENTS=0 CHECKS=240	? (problem) TT=1.33	SAT TT=0.048 ASSIGNMENTS=0 CHECKS=240	SAT TT=0.044 ASSIGNMENTS=0 CHECKS=240	SAT TT=4.14	SAT TT=0.925 ASSIGNMENTS=62 CHECKS=5075380	SAT TT=17.11	SAT TT=16.641
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/hanoi/ normalized-hanoi-7_ext.xml	SAT TT=0.391	SAT TT=1.042 CHECKS=10427700 NODES=126	SAT TT=1.09 CHECKS=10427700 NODES=126	SAT TT=5.435	SAT TT=203.012 CHECKS=497	SAT TT=203.165 CHECKS=497	SAT TT=55.823 ASSIGNMENTS=1	SAT TT=55.218 ASSIGNMENTS=1	SAT TT=60.605 CHECKS=19969000 NODES=126	SAT TT=1.075 CHECKS=20567700 NODES=0	SAT TT=1.117 CHECKS=20567700 NODES=0	SAT TT=0.409 ASSIGNMENTS=0 CHECKS=496	SAT TT=0.442 ASSIGNMENTS=0 CHECKS=496	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	SAT TT=0.425 ASSIGNMENTS=0 CHECKS=496	SAT TT=0.391 ASSIGNMENTS=0 CHECKS=496	? (problem) TT=5.34	SAT TT=0.407 ASSIGNMENTS=0 CHECKS=496	SAT TT=0.425 ASSIGNMENTS=0 CHECKS=496	SAT TT=28.386	SAT TT=30.896 ASSIGNMENTS=127 CHECKS=185321000	SAT TT=475.201	SAT TT=368.853
csp/haystacks/ normalized-haystacks-05.xml	UNSAT TT=0.008	UNSAT TT=0.726 CHECKS=643 NODES=22	UNSAT TT=0.75 CHECKS=599 NODES=0	UNSAT TT=0.034	UNSAT TT=2.443 CHECKS=3959920	UNSAT TT=5.118 CHECKS=10436200	UNSAT TT=0.755 ASSIGNMENTS=0	UNSAT TT=0.734 ASSIGNMENTS=0	UNSAT TT=8.26 CHECKS=4136230 NODES=291029	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=0.021 ASSIGNMENTS=116 CHECKS=3395	UNSAT TT=0.023 ASSIGNMENTS=116 CHECKS=3395	UNSAT TT=0.946	UNSAT TT=0.727	No data	UNSAT TT=0.008 ASSIGNMENTS=25 CHECKS=992	UNSAT TT=0.018 ASSIGNMENTS=593 CHECKS=13494	UNSAT TT=40.869	UNSAT TT=0.012 ASSIGNMENTS=168 CHECKS=4148	UNSAT TT=0.009 ASSIGNMENTS=67 CHECKS=2098	UNSAT TT=1.174	No data	UNSAT TT=0.626	UNSAT TT=0.626
csp/haystacks/ normalized-haystacks-08.xml	UNSAT TT=0.068	UNSAT TT=1.152 CHECKS=14842 NODES=228	UNSAT TT=1.073 CHECKS=11920 NODES=0	UNSAT TT=0.2	? (TO) TT=1800.06	? (TO) TT=1800.11	UNSAT TT=1.265 ASSIGNMENTS=0	UNSAT TT=1.47 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=0.707 ASSIGNMENTS=8136 CHECKS=979305	UNSAT TT=0.7 ASSIGNMENTS=8136 CHECKS=979305	UNSAT TT=1.479	UNSAT TT=1.238	No data	UNSAT TT=0.171 ASSIGNMENTS=1864 CHECKS=226773	UNSAT TT=0.359 ASSIGNMENTS=7467 CHECKS=490913	? (TO) TT=1800.09	UNSAT TT=0.462 ASSIGNMENTS=4265 CHECKS=520719	UNSAT TT=0.068 ASSIGNMENTS=641 CHECKS=77490	UNSAT TT=3.267	No data	UNSAT TT=1.532	UNSAT TT=1.595
csp/haystacks/ normalized-haystacks-10.xml	UNSAT TT=0.236	UNSAT TT=1.425 CHECKS=264202 NODES=2381	UNSAT TT=1.085 CHECKS=13661 NODES=0	UNSAT TT=8.325	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=1.791 ASSIGNMENTS=0	UNSAT TT=1.861 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=8.616 ASSIGNMENTS=0	UNSAT TT=7.408 ASSIGNMENTS=1965 CHECKS=309611	UNSAT TT=85.589	UNSAT TT=162.938	No data	UNSAT TT=5.558 ASSIGNMENTS=44199 CHECKS=7929500	UNSAT TT=5.771 ASSIGNMENTS=53286 CHECKS=8357500	? (TO) TT=1800.03	UNSAT TT=61.827 ASSIGNMENTS=294993 CHECKS=66933400	UNSAT TT=0.236 ASSIGNMENTS=1965 CHECKS=309611	UNSAT TT=70.84	No data	UNSAT TT=3.075	UNSAT TT=13.409
csp/haystacks/ normalized-haystacks-11.xml	UNSAT TT=1.221	UNSAT TT=2.868 CHECKS=1423860 NODES=10110	UNSAT TT=1.221 CHECKS=15578 NODES=0	UNSAT TT=82.683	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=2.006 ASSIGNMENTS=0	UNSAT TT=2.326 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=9.417 ASSIGNMENTS=0	UNSAT TT=8.657 ASSIGNMENTS=10883 CHECKS=2129330	? (TO) TT=1800.06	? (TO) TT=1800.01	No data	UNSAT TT=52.487 ASSIGNMENTS=357213 CHECKS=74332800	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=1.601 ASSIGNMENTS=10883 CHECKS=2129330	UNSAT TT=1722.22	No data	UNSAT TT=11.672	UNSAT TT=81.18
csp/haystacks/ normalized-haystacks-12.xml	UNSAT TT=1.399	UNSAT TT=5.091 CHECKS=3259090 NODES=21500	UNSAT TT=1.399 CHECKS=21535 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=2.193 ASSIGNMENTS=0	UNSAT TT=2.355 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=9.377 ASSIGNMENTS=0	UNSAT TT=11.22 ASSIGNMENTS=18116 CHECKS=4177240	? (TO) TT=1800.01	? (TO) TT=1800.08	No data	UNSAT TT=607.708 ASSIGNMENTS=3351570 CHECKS=779363000	UNSAT TT=491.989 ASSIGNMENTS=2758640 CHECKS=641731000	? (TO) TT=1800.12	? (TO) TT=1800.04	UNSAT TT=3.512 ASSIGNMENTS=18116 CHECKS=4177240	? (TO) TT=1800.14	No data	UNSAT TT=48.373	UNSAT TT=271.214
csp/haystacks/ normalized-haystacks-15.xml	UNSAT TT=1.935	UNSAT TT=1428.17 CHECKS=1485810000 NODES=6657340	UNSAT TT=1.935 CHECKS=66002 NODES=0	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=3.568 ASSIGNMENTS=0	UNSAT TT=4.414 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=11.092 ASSIGNMENTS=0	UNSAT TT=15.438 ASSIGNMENTS=28686 CHECKS=8513550	? (TO) TT=1800.04	? (TO) TT=1800.04	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=7.82 ASSIGNMENTS=28686 CHECKS=8513550	? (TO) TT=1801.09	No data	? (TO) TT=1800.16	? (TO) TT=1800.13
csp/haystacks/ normalized-haystacks-16.xml	UNSAT TT=2.343	? (TO) TT=1800.13	UNSAT TT=2.343 CHECKS=114052 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.1	UNSAT TT=4.181 ASSIGNMENTS=0	UNSAT TT=6.574 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=11.73 ASSIGNMENTS=0	UNSAT TT=25.783 ASSIGNMENTS=58043 CHECKS=18972200	? (TO) TT=1800	? (TO) TT=1800	No data	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=18.253 ASSIGNMENTS=58043 CHECKS=18972200	? (TO) TT=1800.17	No data	? (TO) TT=1800	? (TO) TT=1800.06
csp/haystacks/ normalized-haystacks-20.xml	UNSAT TT=5.291	? (TO) TT=1800.12	UNSAT TT=5.291 CHECKS=533629 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=8.396 ASSIGNMENTS=0	UNSAT TT=8.179 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=16.988 ASSIGNMENTS=0	UNSAT TT=1246.92 ASSIGNMENTS=1612090 CHECKS=927161000	? (TO) TT=1800.07	? (TO) TT=1800.1	No data	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=59.336 ASSIGNMENTS=106711 CHECKS=36221900	UNSAT TT=1129.61 ASSIGNMENTS=1612090 CHECKS=927161000	? (TO) TT=1800.12	No data	? (TO) TT=1800.03	? (TO) TT=1800.02
csp/haystacks/ normalized-haystacks-29.xml	UNSAT TT=32.486	? (TO) TT=1800.13	UNSAT TT=33.389 CHECKS=2444860 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=32.486 ASSIGNMENTS=0	UNSAT TT=33.811 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08	? (MO) TT=1637.31	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.14	No data	? (TO) TT=1800.02	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/haystacks/ normalized-haystacks-30.xml	UNSAT TT=33.602	? (TO) TT=1800.11	UNSAT TT=33.602 CHECKS=2076730 NODES=0	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.11	UNSAT TT=37.308 ASSIGNMENTS=0	UNSAT TT=33.771 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.07	? (MO) TT=1297.68	No data	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.19	No data	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/haystacks/ normalized-haystacks-35.xml	UNSAT TT=64.511	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=68.248 ASSIGNMENTS=0	UNSAT TT=64.511 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (MO) TT=1200.16	? (MO) TT=821.11	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.21	No data	? (TO) TT=1800.01	? (TO) TT=1800.07
csp/haystacks/ normalized-haystacks-36.xml	UNSAT TT=54.709	? (TO) TT=1800.14	UNSAT TT=54.709 CHECKS=3017070 NODES=0	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=71.09 ASSIGNMENTS=0	UNSAT TT=78.083 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.07	? (MO) TT=1200.06	? (MO) TT=1150.21	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.1	? (exit code) TT=1125.36	No data	? (TO) TT=1800.05	? (TO) TT=1800.11
csp/haystacks/ normalized-haystacks-43.xml	UNSAT TT=145.621	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.11	UNSAT TT=145.621 ASSIGNMENTS=0	UNSAT TT=181.6 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.1	? (MO) TT=1399.32	? (MO) TT=1143.88	No data	? (TO) TT=1800.04	? (TO) TT=1800.11	? (exit code) TT=157.168	? (TO) TT=1800.03	? (TO) TT=1800.08	? TT=216.778	No data	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/haystacks/ normalized-haystacks-45.xml	UNSAT TT=346.213	? (TO) TT=1800.19	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=346.213 ASSIGNMENTS=0	UNSAT TT=361.143 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800	? (MO) TT=1373.71	? (MO) TT=1049.22	No data	? (TO) TT=1800.05	? (TO) TT=1800.04	? (exit code) TT=205.771	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=787.547	No data	? (TO) TT=1800.08	? (TO) TT=1800.04
csp/haystacks/ normalized-haystacks-48.xml		? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	? (MO) TT=1436.19	? (MO) TT=1025.43	No data	? (TO) TT=1800.09	? (TO) TT=1800.04	? (exit code) TT=363.877	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=586.121	No data	? (TO) TT=1800.12	? (TO) TT=1800.05
csp/haystacks/ normalized-haystacks-54.xml		? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.2	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.09	? (MO) TT=1489.49	? (MO) TT=409.51	No data	? (TO) TT=1800.1	? (TO) TT=1800.06	? (exit code) TT=621.692	? (TO) TT=1800.02	? (TO) TT=1800.09	? TT=205.855	No data	? (TO) TT=1800.13	? (TO) TT=1800.01
csp/jnhSat/ normalized-jnh01_ext.xml	SAT TT=0.036	SAT TT=1.322 CHECKS=31091 NODES=1179	SAT TT=1.378 CHECKS=29690 NODES=982	SAT TT=0.193	SAT TT=0.196 CHECKS=102543	SAT TT=0.097 CHECKS=106043	SAT TT=1.118 ASSIGNMENTS=65	SAT TT=1.171 ASSIGNMENTS=105	SAT TT=0.734 CHECKS=21599 NODES=124	SAT TT=1.048 CHECKS=823868 NODES=1873	SAT TT=0.795 CHECKS=363159 NODES=371	SAT TT=0.048 ASSIGNMENTS=81 CHECKS=46280	SAT TT=0.052 ASSIGNMENTS=81 CHECKS=46280	SAT TT=6.039	SAT TT=5.53	SAT TT=0.654 CHECKS=11779	SAT TT=0.04 ASSIGNMENTS=83 CHECKS=49293	SAT TT=0.067 ASSIGNMENTS=507 CHECKS=226031	SAT TT=0.858	SAT TT=0.036 ASSIGNMENTS=117 CHECKS=32014	SAT TT=0.04 ASSIGNMENTS=81 CHECKS=46280	SAT TT=1.813	SAT TT=0.165 ASSIGNMENTS=281 CHECKS=157118	SAT TT=0.988	SAT TT=1.026
csp/jnhSat/ normalized-jnh07_ext.xml	SAT TT=0.035	SAT TT=1.204 CHECKS=6201 NODES=242	SAT TT=1.287 CHECKS=7581 NODES=243	SAT TT=0.221	SAT TT=0.166 CHECKS=98971	SAT TT=0.078 CHECKS=97954	SAT TT=0.957 ASSIGNMENTS=38	SAT TT=0.887 ASSIGNMENTS=13	SAT TT=0.697 CHECKS=11819 NODES=104	SAT TT=0.796 CHECKS=322174 NODES=820	SAT TT=0.692 CHECKS=154124 NODES=186	SAT TT=0.048 ASSIGNMENTS=53 CHECKS=31765	SAT TT=0.047 ASSIGNMENTS=53 CHECKS=31765	SAT TT=4.704	SAT TT=4.941	SAT TT=0.568 CHECKS=20219	SAT TT=0.035 ASSIGNMENTS=55 CHECKS=35403	SAT TT=0.036 ASSIGNMENTS=66 CHECKS=33652	SAT TT=0.81	SAT TT=0.036 ASSIGNMENTS=94 CHECKS=30366	SAT TT=0.036 ASSIGNMENTS=53 CHECKS=31765	SAT TT=1.64	SAT TT=0.255 ASSIGNMENTS=283 CHECKS=154999	SAT TT=0.999	SAT TT=1.006
csp/jnhSat/ normalized-jnh12_ext.xml	SAT TT=0.037	SAT TT=1.071 CHECKS=3023 NODES=128	SAT TT=1.082 CHECKS=4078 NODES=0	SAT TT=0.182	SAT TT=0.094 CHECKS=38091	SAT TT=0.05 CHECKS=27447	SAT TT=0.836 ASSIGNMENTS=6	SAT TT=0.966 ASSIGNMENTS=5	SAT TT=0.75 CHECKS=47304 NODES=140	SAT TT=1.943 CHECKS=2772330 NODES=7325	SAT TT=0.883 CHECKS=238976 NODES=306	SAT TT=0.048 ASSIGNMENTS=53 CHECKS=41867	SAT TT=0.047 ASSIGNMENTS=53 CHECKS=41867	SAT TT=5.296	SAT TT=4.77	SAT TT=0.533 CHECKS=11806	SAT TT=0.037 ASSIGNMENTS=41 CHECKS=43630	SAT TT=0.038 ASSIGNMENTS=70 CHECKS=50059	SAT TT=0.856	SAT TT=0.038 ASSIGNMENTS=66 CHECKS=31983	SAT TT=0.039 ASSIGNMENTS=53 CHECKS=41867	SAT TT=1.639	SAT TT=0.148 ASSIGNMENTS=202 CHECKS=104956	SAT TT=0.999	SAT TT=1.052
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhSat/ normalized-jnh17_ext.xml	SAT TT=0.033	SAT TT=1.058 CHECKS=3404 NODES=127	SAT TT=1.115 CHECKS=5121 NODES=139	SAT TT=0.199	SAT TT=0.184 CHECKS=100448	SAT TT=0.084 CHECKS=94569	SAT TT=1.094 ASSIGNMENTS=53	SAT TT=0.878 ASSIGNMENTS=10	SAT TT=0.862 CHECKS=99110 NODES=188	SAT TT=0.782 CHECKS=276778 NODES=711	SAT TT=0.703 CHECKS=138293 NODES=170	SAT TT=0.047 ASSIGNMENTS=42 CHECKS=30167	SAT TT=0.048 ASSIGNMENTS=42 CHECKS=30167	SAT TT=4.727	SAT TT=4.712	SAT TT=0.493 CHECKS=13047	SAT TT=0.042 ASSIGNMENTS=87 CHECKS=67602	SAT TT=0.084 ASSIGNMENTS=587 CHECKS=332863	SAT TT=0.826	SAT TT=0.033 ASSIGNMENTS=87 CHECKS=24537	SAT TT=0.035 ASSIGNMENTS=42 CHECKS=30167	SAT TT=1.626	SAT TT=0.214 ASSIGNMENTS=168 CHECKS=96858	SAT TT=0.997	SAT TT=1.039
csp/jnhSat/ normalized-jnh201_ext.xml	SAT TT=0.031	SAT TT=1.078 CHECKS=4697 NODES=216	SAT TT=1.123 CHECKS=5804 NODES=213	SAT TT=0.165	SAT TT=0.099 CHECKS=39897	SAT TT=0.054 CHECKS=25808	SAT TT=0.889 ASSIGNMENTS=31	SAT TT=0.884 ASSIGNMENTS=29	SAT TT=0.734 CHECKS=28550 NODES=142	SAT TT=0.685 CHECKS=30142 NODES=36	SAT TT=0.669 CHECKS=73505 NODES=61	SAT TT=0.045 ASSIGNMENTS=33 CHECKS=7600	SAT TT=0.045 ASSIGNMENTS=33 CHECKS=7600	SAT TT=6.197	SAT TT=5.424	SAT TT=0.617 CHECKS=14562	SAT TT=0.031 ASSIGNMENTS=37 CHECKS=8277	SAT TT=0.043 ASSIGNMENTS=228 CHECKS=72565	SAT TT=0.772	SAT TT=0.033 ASSIGNMENTS=64 CHECKS=13681	SAT TT=0.034 ASSIGNMENTS=33 CHECKS=7600	SAT TT=1.652	SAT TT=0.089 ASSIGNMENTS=122 CHECKS=48560	SAT TT=0.999	SAT TT=0.979
csp/jnhSat/ normalized-jnh204_ext.xml	SAT TT=0.05	SAT TT=1.215 CHECKS=19669 NODES=615	SAT TT=1.249 CHECKS=31825 NODES=577	SAT TT=1.193	SAT TT=0.268 CHECKS=141464	SAT TT=0.215 CHECKS=293895	SAT TT=2.055 ASSIGNMENTS=393	SAT TT=1.75 ASSIGNMENTS=276	SAT TT=1.55 CHECKS=464657 NODES=531	SAT TT=1.13 CHECKS=1155770 NODES=3180	SAT TT=1.445 CHECKS=3152710 NODES=3251	SAT TT=0.062 ASSIGNMENTS=232 CHECKS=154994	SAT TT=0.061 ASSIGNMENTS=232 CHECKS=154994	SAT TT=7.23	SAT TT=7.135	SAT TT=0.624 CHECKS=149060	SAT TT=0.066 ASSIGNMENTS=404 CHECKS=265618	SAT TT=0.316 ASSIGNMENTS=4210 CHECKS=1979940	SAT TT=1.172	SAT TT=0.099 ASSIGNMENTS=803 CHECKS=510988	SAT TT=0.05 ASSIGNMENTS=232 CHECKS=154994	SAT TT=1.788	SAT TT=0.27 ASSIGNMENTS=479 CHECKS=232358	SAT TT=0.986	SAT TT=1.173
csp/jnhSat/ normalized-jnh205_ext.xml	SAT TT=0.036	SAT TT=1.133 CHECKS=10024 NODES=352	SAT TT=1.2 CHECKS=14050 NODES=453	SAT TT=0.178	SAT TT=0.139 CHECKS=64434	SAT TT=0.069 CHECKS=51963	SAT TT=1.18 ASSIGNMENTS=74	SAT TT=1.251 ASSIGNMENTS=79	SAT TT=0.785 CHECKS=61736 NODES=169	SAT TT=0.772 CHECKS=340175 NODES=907	SAT TT=0.902 CHECKS=835144 NODES=1073	SAT TT=0.05 ASSIGNMENTS=73 CHECKS=61932	SAT TT=0.049 ASSIGNMENTS=73 CHECKS=61932	SAT TT=4.648	SAT TT=4.731	SAT TT=0.496 CHECKS=24433	SAT TT=0.036 ASSIGNMENTS=53 CHECKS=37981	SAT TT=0.117 ASSIGNMENTS=1175 CHECKS=590693	SAT TT=1.006	SAT TT=0.036 ASSIGNMENTS=109 CHECKS=48990	SAT TT=0.037 ASSIGNMENTS=73 CHECKS=61932	SAT TT=1.696	SAT TT=0.255 ASSIGNMENTS=314 CHECKS=192645	SAT TT=1.008	SAT TT=0.989
csp/jnhSat/ normalized-jnh207_ext.xml	SAT TT=0.04	SAT TT=1.336 CHECKS=52756 NODES=1139	SAT TT=1.003 CHECKS=1942 NODES=0	SAT TT=0.598	SAT TT=0.248 CHECKS=134296	SAT TT=0.147 CHECKS=198074	SAT TT=1.341 ASSIGNMENTS=123	SAT TT=1.477 ASSIGNMENTS=160	SAT TT=0.644 CHECKS=8724 NODES=100	SAT TT=1.44 CHECKS=1927310 NODES=5219	SAT TT=0.692 CHECKS=215288 NODES=250	SAT TT=0.051 ASSIGNMENTS=103 CHECKS=81780	SAT TT=0.054 ASSIGNMENTS=103 CHECKS=81780	SAT TT=4.719	SAT TT=4.675	SAT TT=0.515 CHECKS=38303	SAT TT=0.044 ASSIGNMENTS=146 CHECKS=123564	SAT TT=0.033 ASSIGNMENTS=50 CHECKS=21688	SAT TT=0.874	SAT TT=0.043 ASSIGNMENTS=183 CHECKS=85892	SAT TT=0.04 ASSIGNMENTS=103 CHECKS=81780	SAT TT=1.849	SAT TT=0.287 ASSIGNMENTS=519 CHECKS=288426	SAT TT=0.995	SAT TT=0.996
csp/jnhSat/ normalized-jnh209_ext.xml	SAT TT=0.032	SAT TT=1.419 CHECKS=28061 NODES=880	SAT TT=1.235 CHECKS=21828 NODES=620	SAT TT=0.192	SAT TT=0.153 CHECKS=71112	SAT TT=0.093 CHECKS=93233	SAT TT=1.062 ASSIGNMENTS=87	SAT TT=1.281 ASSIGNMENTS=155	SAT TT=0.746 CHECKS=48676 NODES=159	SAT TT=1.951 CHECKS=3149640 NODES=8716	SAT TT=0.772 CHECKS=367844 NODES=536	SAT TT=0.047 ASSIGNMENTS=101 CHECKS=55036	SAT TT=0.053 ASSIGNMENTS=101 CHECKS=55036	SAT TT=4.482	SAT TT=4.543	SAT TT=0.518 CHECKS=40046	SAT TT=0.037 ASSIGNMENTS=97 CHECKS=52339	SAT TT=0.065 ASSIGNMENTS=582 CHECKS=248614	SAT TT=0.757	SAT TT=0.032 ASSIGNMENTS=118 CHECKS=28410	SAT TT=0.038 ASSIGNMENTS=101 CHECKS=55036	SAT TT=1.82	SAT TT=0.478 ASSIGNMENTS=845 CHECKS=508130	SAT TT=0.99	SAT TT=1.026
csp/jnhSat/ normalized-jnh210_ext.xml	SAT TT=0.034	SAT TT=1.862 CHECKS=5052 NODES=219	SAT TT=1.116 CHECKS=7633 NODES=249	SAT TT=0.245	SAT TT=0.163 CHECKS=95758	SAT TT=0.075 CHECKS=60919	SAT TT=1.051 ASSIGNMENTS=69	SAT TT=0.858 ASSIGNMENTS=19	SAT TT=0.647 CHECKS=12234 NODES=105	SAT TT=0.693 CHECKS=73642 NODES=171	SAT TT=0.695 CHECKS=223041 NODES=283	SAT TT=0.046 ASSIGNMENTS=65 CHECKS=44178	SAT TT=0.046 ASSIGNMENTS=65 CHECKS=44178	SAT TT=4.556	SAT TT=4.529	SAT TT=0.554 CHECKS=23691	SAT TT=0.036 ASSIGNMENTS=102 CHECKS=58413	SAT TT=0.072 ASSIGNMENTS=614 CHECKS=285558	SAT TT=0.863	SAT TT=0.039 ASSIGNMENTS=127 CHECKS=63899	SAT TT=0.034 ASSIGNMENTS=65 CHECKS=44178	SAT TT=1.615	SAT TT=0.489 ASSIGNMENTS=718 CHECKS=438284	SAT TT=1.03	SAT TT=0.998
csp/jnhSat/ normalized-jnh212_ext.xml	SAT TT=0.055	SAT TT=1.451 CHECKS=50680 NODES=1618	SAT TT=1.598 CHECKS=64441 NODES=1891	SAT TT=5.13	SAT TT=1.112 CHECKS=652227	SAT TT=0.216 CHECKS=284458	SAT TT=2.493 ASSIGNMENTS=450	SAT TT=1.616 ASSIGNMENTS=213	SAT TT=1.126 CHECKS=256839 NODES=321	SAT TT=38.473 CHECKS=89750300 NODES=245335	SAT TT=13.966 CHECKS=59558500 NODES=39669	SAT TT=0.079 ASSIGNMENTS=355 CHECKS=282433	SAT TT=0.083 ASSIGNMENTS=355 CHECKS=282433	SAT TT=4.646	SAT TT=5.357	SAT TT=0.542 CHECKS=73890	SAT TT=0.069 ASSIGNMENTS=386 CHECKS=306256	SAT TT=0.308 ASSIGNMENTS=4364 CHECKS=1950750	SAT TT=1.421	SAT TT=0.055 ASSIGNMENTS=344 CHECKS=199933	SAT TT=0.068 ASSIGNMENTS=355 CHECKS=282433	SAT TT=1.811	SAT TT=1.058 ASSIGNMENTS=1888 CHECKS=1185840	SAT TT=1.014	SAT TT=1.019
csp/jnhSat/ normalized-jnh213_ext.xml	SAT TT=0.033	SAT TT=1.053 CHECKS=1862 NODES=101	SAT TT=1.06 CHECKS=3593 NODES=101	SAT TT=0.165	SAT TT=0.176 CHECKS=107309	SAT TT=0.082 CHECKS=111940	SAT TT=0.995 ASSIGNMENTS=22	SAT TT=0.999 ASSIGNMENTS=15	SAT TT=0.682 CHECKS=21388 NODES=115	SAT TT=0.75 CHECKS=174201 NODES=475	SAT TT=0.857 CHECKS=688716 NODES=949	SAT TT=0.043 ASSIGNMENTS=42 CHECKS=22009	SAT TT=0.043 ASSIGNMENTS=42 CHECKS=22009	SAT TT=4.703	SAT TT=4.598	SAT TT=0.484 CHECKS=14725	SAT TT=0.034 ASSIGNMENTS=25 CHECKS=18408	SAT TT=0.035 ASSIGNMENTS=104 CHECKS=34754	SAT TT=0.809	SAT TT=0.034 ASSIGNMENTS=59 CHECKS=27530	SAT TT=0.033 ASSIGNMENTS=42 CHECKS=22009	SAT TT=1.621	SAT TT=0.146 ASSIGNMENTS=326 CHECKS=140979	SAT TT=1	SAT TT=1.004
csp/jnhSat/ normalized-jnh217_ext.xml	SAT TT=0.034	SAT TT=1.092 CHECKS=8047 NODES=164	SAT TT=1.102 CHECKS=8276 NODES=158	SAT TT=0.263	SAT TT=0.101 CHECKS=36168	SAT TT=0.06 CHECKS=35572	SAT TT=0.919 ASSIGNMENTS=59	SAT TT=0.948 ASSIGNMENTS=67	SAT TT=1.164 CHECKS=243803 NODES=381	SAT TT=0.742 CHECKS=180335 NODES=435	SAT TT=0.789 CHECKS=327359 NODES=387	SAT TT=0.043 ASSIGNMENTS=58 CHECKS=30004	SAT TT=0.044 ASSIGNMENTS=58 CHECKS=30004	SAT TT=4.576	SAT TT=4.58	SAT TT=0.495 CHECKS=15757	SAT TT=0.044 ASSIGNMENTS=59 CHECKS=27360	SAT TT=0.078 ASSIGNMENTS=750 CHECKS=328477	SAT TT=0.748	SAT TT=0.044 ASSIGNMENTS=234 CHECKS=94066	SAT TT=0.034 ASSIGNMENTS=58 CHECKS=30004	SAT TT=1.624	SAT TT=0.123 ASSIGNMENTS=212 CHECKS=72579	SAT TT=1.01	SAT TT=0.984
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhSat/ normalized-jnh218_ext.xml	SAT TT=0.035	SAT TT=1.055 CHECKS=3122 NODES=133	SAT TT=1.1 CHECKS=5597 NODES=146	SAT TT=0.206	SAT TT=0.151 CHECKS=82239	SAT TT=0.074 CHECKS=74399	SAT TT=1.071 ASSIGNMENTS=69	SAT TT=0.842 ASSIGNMENTS=18	SAT TT=0.692 CHECKS=27465 NODES=123	SAT TT=0.685 CHECKS=131146 NODES=326	SAT TT=0.752 CHECKS=320978 NODES=369	SAT TT=0.046 ASSIGNMENTS=57 CHECKS=37918	SAT TT=0.045 ASSIGNMENTS=57 CHECKS=37918	SAT TT=4.66	SAT TT=4.753	SAT TT=0.5 CHECKS=19497	SAT TT=0.041 ASSIGNMENTS=101 CHECKS=69174	SAT TT=0.041 ASSIGNMENTS=138 CHECKS=71383	SAT TT=0.789	SAT TT=0.035 ASSIGNMENTS=104 CHECKS=36793	SAT TT=0.036 ASSIGNMENTS=57 CHECKS=37918	SAT TT=1.657	SAT TT=0.138 ASSIGNMENTS=261 CHECKS=124379	SAT TT=1.017	SAT TT=0.991
csp/jnhSat/ normalized-jnh220_ext.xml	SAT TT=0.036	SAT TT=1.272 CHECKS=23795 NODES=692	SAT TT=1.489 CHECKS=35268 NODES=1081	SAT TT=0.182	SAT TT=0.145 CHECKS=63624	SAT TT=0.073 CHECKS=62733	SAT TT=1.029 ASSIGNMENTS=69	SAT TT=1.432 ASSIGNMENTS=159	SAT TT=0.748 CHECKS=53790 NODES=155	SAT TT=0.758 CHECKS=299134 NODES=778	SAT TT=1.021 CHECKS=1346650 NODES=1655	SAT TT=0.05 ASSIGNMENTS=90 CHECKS=61962	SAT TT=0.05 ASSIGNMENTS=90 CHECKS=61962	SAT TT=4.716	SAT TT=4.55	SAT TT=1.094 CHECKS=66435	SAT TT=0.036 ASSIGNMENTS=69 CHECKS=48711	SAT TT=0.149 ASSIGNMENTS=1627 CHECKS=768327	SAT TT=0.721	SAT TT=0.039 ASSIGNMENTS=146 CHECKS=48785	SAT TT=0.038 ASSIGNMENTS=90 CHECKS=61962	SAT TT=1.978	SAT TT=0.184 ASSIGNMENTS=361 CHECKS=253075	SAT TT=0.987	SAT TT=0.994
csp/jnhSat/ normalized-jnh301_ext.xml	SAT TT=0.048	SAT TT=1.203 CHECKS=12387 NODES=455	SAT TT=1.228 CHECKS=13477 NODES=434	SAT TT=0.37	SAT TT=0.71 CHECKS=384029	SAT TT=0.17 CHECKS=177926	SAT TT=1.707 ASSIGNMENTS=196	SAT TT=1.68 ASSIGNMENTS=255	SAT TT=1.239 CHECKS=249630 NODES=321	SAT TT=2.103 CHECKS=3074680 NODES=6619	SAT TT=1.272 CHECKS=1950170 NODES=1946	SAT TT=0.059 ASSIGNMENTS=123 CHECKS=103239	SAT TT=0.058 ASSIGNMENTS=123 CHECKS=103239	SAT TT=5.912	SAT TT=5.833	SAT TT=0.699 CHECKS=77263	SAT TT=0.056 ASSIGNMENTS=213 CHECKS=164004	SAT TT=0.319 ASSIGNMENTS=3930 CHECKS=1866930	SAT TT=1.123	SAT TT=0.051 ASSIGNMENTS=254 CHECKS=128179	SAT TT=0.048 ASSIGNMENTS=123 CHECKS=103239	SAT TT=1.879	SAT TT=0.244 ASSIGNMENTS=350 CHECKS=170510	SAT TT=1.026	SAT TT=1.05
csp/jnhUnsat/ normalized-jnh02_ext.xml	UNSAT TT=0.035	UNSAT TT=1.035 CHECKS=1536 NODES=45	UNSAT TT=1.095 CHECKS=3055 NODES=0	UNSAT TT=0.177	UNSAT TT=0.057 CHECKS=7983	UNSAT TT=0.048 CHECKS=9366	UNSAT TT=0.701 ASSIGNMENTS=0	UNSAT TT=0.855 ASSIGNMENTS=0	UNSAT TT=0.853 CHECKS=25626 NODES=17	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=0.047 ASSIGNMENTS=12 CHECKS=12920	UNSAT TT=0.045 ASSIGNMENTS=12 CHECKS=12920	UNSAT TT=5.154	UNSAT TT=5.638	UNSAT TT=0.532 CHECKS=7412	UNSAT TT=0.036 ASSIGNMENTS=10 CHECKS=9732	UNSAT TT=0.033 ASSIGNMENTS=11 CHECKS=10834	UNSAT TT=0.673	UNSAT TT=0.037 ASSIGNMENTS=60 CHECKS=26020	UNSAT TT=0.035 ASSIGNMENTS=12 CHECKS=12920	UNSAT TT=1.681	UNSAT TT=0.154 ASSIGNMENTS=148 CHECKS=129267	UNSAT TT=0.978	UNSAT TT=1.028
csp/jnhUnsat/ normalized-jnh04_ext.xml	UNSAT TT=0.043	UNSAT TT=1.388 CHECKS=24129 NODES=451	UNSAT TT=1.305 CHECKS=32481 NODES=481	UNSAT TT=0.608	UNSAT TT=0.088 CHECKS=33333	UNSAT TT=0.061 CHECKS=39366	UNSAT TT=0.81 ASSIGNMENTS=0	UNSAT TT=0.885 ASSIGNMENTS=0	UNSAT TT=0.971 CHECKS=172754 NODES=137	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.049 ASSIGNMENTS=87 CHECKS=72429	UNSAT TT=0.054 ASSIGNMENTS=87 CHECKS=72429	UNSAT TT=4.18	UNSAT TT=4.294	UNSAT TT=0.555 CHECKS=34749	UNSAT TT=0.043 ASSIGNMENTS=134 CHECKS=107345	UNSAT TT=0.289 ASSIGNMENTS=3584 CHECKS=1835560	UNSAT TT=0.716	UNSAT TT=0.047 ASSIGNMENTS=182 CHECKS=115706	UNSAT TT=0.044 ASSIGNMENTS=87 CHECKS=72429	UNSAT TT=1.641	UNSAT TT=0.283 ASSIGNMENTS=253 CHECKS=244562	UNSAT TT=1.316	UNSAT TT=1.242
csp/jnhUnsat/ normalized-jnh05_ext.xml	UNSAT TT=0.034	UNSAT TT=1.148 CHECKS=5463 NODES=202	UNSAT TT=1.164 CHECKS=6102 NODES=97	UNSAT TT=0.174	UNSAT TT=0.096 CHECKS=31442	UNSAT TT=0.052 CHECKS=21812	UNSAT TT=1.131 ASSIGNMENTS=0	UNSAT TT=0.922 ASSIGNMENTS=0	UNSAT TT=0.773 CHECKS=36922 NODES=33	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.047 ASSIGNMENTS=19 CHECKS=17174	UNSAT TT=0.046 ASSIGNMENTS=19 CHECKS=17174	UNSAT TT=4.437	UNSAT TT=4.329	UNSAT TT=0.527 CHECKS=17896	UNSAT TT=0.034 ASSIGNMENTS=21 CHECKS=20230	UNSAT TT=0.043 ASSIGNMENTS=114 CHECKS=70258	UNSAT TT=0.715	UNSAT TT=0.039 ASSIGNMENTS=78 CHECKS=27717	UNSAT TT=0.036 ASSIGNMENTS=19 CHECKS=17174	UNSAT TT=1.819	UNSAT TT=0.162 ASSIGNMENTS=206 CHECKS=137262	UNSAT TT=1.261	UNSAT TT=1.156
csp/jnhUnsat/ normalized-jnh06_ext.xml	UNSAT TT=0.045	UNSAT TT=1.373 CHECKS=51228 NODES=930	UNSAT TT=1.312 CHECKS=19234 NODES=554	UNSAT TT=0.381	UNSAT TT=0.264 CHECKS=127577	UNSAT TT=0.11 CHECKS=102667	UNSAT TT=1.457 ASSIGNMENTS=132	UNSAT TT=1.375 ASSIGNMENTS=148	UNSAT TT=1.059 CHECKS=199841 NODES=177	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.056 ASSIGNMENTS=127 CHECKS=88654	UNSAT TT=0.056 ASSIGNMENTS=127 CHECKS=88654	UNSAT TT=4.988	UNSAT TT=4.084	UNSAT TT=0.519 CHECKS=37057	UNSAT TT=0.046 ASSIGNMENTS=160 CHECKS=116649	UNSAT TT=0.335 ASSIGNMENTS=3954 CHECKS=2018960	UNSAT TT=0.92	UNSAT TT=0.045 ASSIGNMENTS=194 CHECKS=91316	UNSAT TT=0.045 ASSIGNMENTS=127 CHECKS=88654	UNSAT TT=1.915	UNSAT TT=0.479 ASSIGNMENTS=609 CHECKS=450433	UNSAT TT=0.979	UNSAT TT=1
csp/jnhUnsat/ normalized-jnh08_ext.xml	UNSAT TT=0.033	UNSAT TT=1.155 CHECKS=4712 NODES=151	UNSAT TT=1.221 CHECKS=7718 NODES=170	UNSAT TT=0.178	UNSAT TT=0.078 CHECKS=19911	UNSAT TT=0.047 CHECKS=15449	UNSAT TT=0.811 ASSIGNMENTS=0	UNSAT TT=1.032 ASSIGNMENTS=0	UNSAT TT=0.824 CHECKS=63906 NODES=54	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.047 ASSIGNMENTS=16 CHECKS=16134	UNSAT TT=0.047 ASSIGNMENTS=16 CHECKS=16134	UNSAT TT=4.299	UNSAT TT=4.161	UNSAT TT=0.526 CHECKS=13052	UNSAT TT=0.036 ASSIGNMENTS=22 CHECKS=22439	UNSAT TT=0.104 ASSIGNMENTS=988 CHECKS=567717	UNSAT TT=0.641	UNSAT TT=0.037 ASSIGNMENTS=95 CHECKS=39404	UNSAT TT=0.033 ASSIGNMENTS=16 CHECKS=16134	UNSAT TT=1.768	UNSAT TT=0.094 ASSIGNMENTS=146 CHECKS=104271	UNSAT TT=1.005	UNSAT TT=1.04
csp/jnhUnsat/ normalized-jnh09_ext.xml	UNSAT TT=0.038	UNSAT TT=1.262 CHECKS=16683 NODES=595	UNSAT TT=1.334 CHECKS=18844 NODES=715	UNSAT TT=0.422	UNSAT TT=0.072 CHECKS=17836	UNSAT TT=0.056 CHECKS=32338	UNSAT TT=1.071 ASSIGNMENTS=0	UNSAT TT=0.825 ASSIGNMENTS=0	UNSAT TT=1.019 CHECKS=94974 NODES=94	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.054 ASSIGNMENTS=87 CHECKS=58349	UNSAT TT=0.055 ASSIGNMENTS=87 CHECKS=58349	UNSAT TT=4.021	UNSAT TT=5.653	UNSAT TT=0.513 CHECKS=29895	UNSAT TT=0.038 ASSIGNMENTS=97 CHECKS=66023	UNSAT TT=0.125 ASSIGNMENTS=1292 CHECKS=635751	UNSAT TT=0.78	UNSAT TT=0.039 ASSIGNMENTS=136 CHECKS=64108	UNSAT TT=0.04 ASSIGNMENTS=87 CHECKS=58349	UNSAT TT=1.777	UNSAT TT=0.253 ASSIGNMENTS=263 CHECKS=170659	UNSAT TT=1.012	UNSAT TT=1.149
csp/jnhUnsat/ normalized-jnh10_ext.xml	UNSAT TT=0.035	UNSAT TT=1.173 CHECKS=8141 NODES=208	UNSAT TT=1.144 CHECKS=4565 NODES=0	UNSAT TT=0.181	UNSAT TT=0.068 CHECKS=12039	UNSAT TT=0.049 CHECKS=17028	UNSAT TT=0.985 ASSIGNMENTS=0	UNSAT TT=0.791 ASSIGNMENTS=0	UNSAT TT=0.824 CHECKS=62568 NODES=48	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.047 ASSIGNMENTS=16 CHECKS=15721	UNSAT TT=0.044 ASSIGNMENTS=16 CHECKS=15721	UNSAT TT=4.253	UNSAT TT=4.217	UNSAT TT=0.5 CHECKS=10983	UNSAT TT=0.035 ASSIGNMENTS=17 CHECKS=17019	UNSAT TT=0.04 ASSIGNMENTS=60 CHECKS=49794	UNSAT TT=0.902	UNSAT TT=0.036 ASSIGNMENTS=73 CHECKS=32823	UNSAT TT=0.035 ASSIGNMENTS=16 CHECKS=15721	UNSAT TT=1.796	UNSAT TT=0.152 ASSIGNMENTS=185 CHECKS=132702	UNSAT TT=0.972	UNSAT TT=1.13
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhUnsat/ normalized-jnh11_ext.xml	UNSAT TT=0.038	UNSAT TT=1.277 CHECKS=15730 NODES=459	UNSAT TT=1.313 CHECKS=12325 NODES=300	UNSAT TT=0.554	UNSAT TT=0.113 CHECKS=49562	UNSAT TT=0.072 CHECKS=73107	UNSAT TT=1.155 ASSIGNMENTS=36	UNSAT TT=1.127 ASSIGNMENTS=6	UNSAT TT=0.991 CHECKS=129717 NODES=119	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=0.054 ASSIGNMENTS=80 CHECKS=72218	UNSAT TT=0.055 ASSIGNMENTS=80 CHECKS=72218	UNSAT TT=4.068	UNSAT TT=4.491	UNSAT TT=0.52 CHECKS=15577	UNSAT TT=0.04 ASSIGNMENTS=79 CHECKS=66981	UNSAT TT=0.317 ASSIGNMENTS=3774 CHECKS=1804830	UNSAT TT=0.753	UNSAT TT=0.038 ASSIGNMENTS=85 CHECKS=48160	UNSAT TT=0.043 ASSIGNMENTS=80 CHECKS=72218	UNSAT TT=1.889	UNSAT TT=0.243 ASSIGNMENTS=307 CHECKS=210023	UNSAT TT=1.245	UNSAT TT=1.044
csp/jnhUnsat/ normalized-jnh13_ext.xml	UNSAT TT=0.033	UNSAT TT=1.134 CHECKS=5469 NODES=131	UNSAT TT=1.28 CHECKS=6460 NODES=127	UNSAT TT=0.175	UNSAT TT=0.078 CHECKS=23769	UNSAT TT=0.052 CHECKS=19967	UNSAT TT=1.015 ASSIGNMENTS=0	UNSAT TT=0.774 ASSIGNMENTS=0	UNSAT TT=0.727 CHECKS=41305 NODES=34	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.045 ASSIGNMENTS=13 CHECKS=12733	UNSAT TT=0.048 ASSIGNMENTS=13 CHECKS=12733	UNSAT TT=5.132	UNSAT TT=4.207	UNSAT TT=0.72 CHECKS=8937	UNSAT TT=0.034 ASSIGNMENTS=11 CHECKS=12953	UNSAT TT=0.178 ASSIGNMENTS=1735 CHECKS=970875	UNSAT TT=0.677	UNSAT TT=0.036 ASSIGNMENTS=81 CHECKS=29540	UNSAT TT=0.033 ASSIGNMENTS=13 CHECKS=12733	UNSAT TT=1.761	UNSAT TT=0.109 ASSIGNMENTS=194 CHECKS=130886	UNSAT TT=1.042	UNSAT TT=1.4
csp/jnhUnsat/ normalized-jnh14_ext.xml	UNSAT TT=0.035	UNSAT TT=1.22 CHECKS=12072 NODES=414	UNSAT TT=1.402 CHECKS=14474 NODES=430	UNSAT TT=0.34	UNSAT TT=0.084 CHECKS=25450	UNSAT TT=0.048 CHECKS=23438	UNSAT TT=1.022 ASSIGNMENTS=0	UNSAT TT=1.041 ASSIGNMENTS=0	UNSAT TT=0.767 CHECKS=54779 NODES=47	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.048 ASSIGNMENTS=43 CHECKS=28491	UNSAT TT=0.044 ASSIGNMENTS=43 CHECKS=28491	UNSAT TT=4.157	UNSAT TT=5.216	UNSAT TT=0.734 CHECKS=22138	UNSAT TT=0.039 ASSIGNMENTS=70 CHECKS=56452	UNSAT TT=0.201 ASSIGNMENTS=2589 CHECKS=1226600	UNSAT TT=0.841	UNSAT TT=0.041 ASSIGNMENTS=159 CHECKS=57710	UNSAT TT=0.035 ASSIGNMENTS=43 CHECKS=28491	UNSAT TT=1.73	UNSAT TT=0.181 ASSIGNMENTS=216 CHECKS=191911	UNSAT TT=1.034	UNSAT TT=1.164
csp/jnhUnsat/ normalized-jnh15_ext.xml	UNSAT TT=0.034	UNSAT TT=1.386 CHECKS=13652 NODES=401	UNSAT TT=1.19 CHECKS=10088 NODES=168	UNSAT TT=0.237	UNSAT TT=0.101 CHECKS=42017	UNSAT TT=0.057 CHECKS=41576	UNSAT TT=0.902 ASSIGNMENTS=10	UNSAT TT=1.164 ASSIGNMENTS=1	UNSAT TT=0.933 CHECKS=59275 NODES=41	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=0.047 ASSIGNMENTS=47 CHECKS=42509	UNSAT TT=0.05 ASSIGNMENTS=47 CHECKS=42509	UNSAT TT=5.233	UNSAT TT=4.92	UNSAT TT=0.66 CHECKS=26455	UNSAT TT=0.038 ASSIGNMENTS=67 CHECKS=48676	UNSAT TT=0.124 ASSIGNMENTS=1046 CHECKS=613418	UNSAT TT=0.903	UNSAT TT=0.034 ASSIGNMENTS=103 CHECKS=43635	UNSAT TT=0.036 ASSIGNMENTS=47 CHECKS=42509	UNSAT TT=1.773	UNSAT TT=0.284 ASSIGNMENTS=415 CHECKS=271891	UNSAT TT=1.139	UNSAT TT=1.042
csp/jnhUnsat/ normalized-jnh16_ext.xml	UNSAT TT=0.119	UNSAT TT=2.585 CHECKS=234797 NODES=5167	UNSAT TT=2.556 CHECKS=223072 NODES=5339	UNSAT TT=1.715	UNSAT TT=5.649 CHECKS=2992990	UNSAT TT=2.694 CHECKS=3878880	UNSAT TT=4.187 ASSIGNMENTS=854	UNSAT TT=7.674 ASSIGNMENTS=2131	UNSAT TT=5.015 CHECKS=2327160 NODES=1952	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.131 ASSIGNMENTS=736 CHECKS=567811	UNSAT TT=0.132 ASSIGNMENTS=736 CHECKS=567811	UNSAT TT=4.467	UNSAT TT=4.28	UNSAT TT=0.868 CHECKS=315260	UNSAT TT=0.133 ASSIGNMENTS=848 CHECKS=659886	UNSAT TT=0.411 ASSIGNMENTS=4730 CHECKS=2492440	UNSAT TT=1.85	UNSAT TT=0.136 ASSIGNMENTS=904 CHECKS=655316	UNSAT TT=0.119 ASSIGNMENTS=736 CHECKS=567811	UNSAT TT=2.134	UNSAT TT=2.506 ASSIGNMENTS=5010 CHECKS=3581100	UNSAT TT=1.245	UNSAT TT=1.199
csp/jnhUnsat/ normalized-jnh18_ext.xml	UNSAT TT=0.039	UNSAT TT=1.327 CHECKS=23099 NODES=766	UNSAT TT=1.339 CHECKS=19645 NODES=658	UNSAT TT=0.291	UNSAT TT=0.386 CHECKS=199967	UNSAT TT=0.099 CHECKS=97199	UNSAT TT=1.258 ASSIGNMENTS=87	UNSAT TT=1.212 ASSIGNMENTS=68	UNSAT TT=1.992 CHECKS=577392 NODES=463	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.054 ASSIGNMENTS=98 CHECKS=72438	UNSAT TT=0.062 ASSIGNMENTS=98 CHECKS=72438	UNSAT TT=5.174	UNSAT TT=5.815	UNSAT TT=0.777 CHECKS=67027	UNSAT TT=0.049 ASSIGNMENTS=142 CHECKS=105061	UNSAT TT=0.327 ASSIGNMENTS=4082 CHECKS=2138040	UNSAT TT=0.922	UNSAT TT=0.045 ASSIGNMENTS=198 CHECKS=99945	UNSAT TT=0.039 ASSIGNMENTS=98 CHECKS=72438	UNSAT TT=1.949	UNSAT TT=0.344 ASSIGNMENTS=640 CHECKS=424875	UNSAT TT=1.222	UNSAT TT=1.001
csp/jnhUnsat/ normalized-jnh19_ext.xml	UNSAT TT=0.048	UNSAT TT=1.302 CHECKS=19591 NODES=613	UNSAT TT=1.406 CHECKS=29688 NODES=789	UNSAT TT=0.756	UNSAT TT=0.535 CHECKS=273477	UNSAT TT=0.282 CHECKS=365478	UNSAT TT=1.89 ASSIGNMENTS=212	UNSAT TT=1.002 ASSIGNMENTS=22	UNSAT TT=0.839 CHECKS=64946 NODES=51	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.06 ASSIGNMENTS=125 CHECKS=113006	UNSAT TT=0.056 ASSIGNMENTS=125 CHECKS=113006	UNSAT TT=4.338	UNSAT TT=4.584	UNSAT TT=0.605 CHECKS=51156	UNSAT TT=0.048 ASSIGNMENTS=135 CHECKS=118965	UNSAT TT=0.321 ASSIGNMENTS=3828 CHECKS=1983590	UNSAT TT=0.975	UNSAT TT=0.049 ASSIGNMENTS=205 CHECKS=105866	UNSAT TT=0.048 ASSIGNMENTS=125 CHECKS=113006	UNSAT TT=1.69	UNSAT TT=0.415 ASSIGNMENTS=703 CHECKS=497972	UNSAT TT=1.026	UNSAT TT=1.026
csp/jnhUnsat/ normalized-jnh202_ext.xml	UNSAT TT=0.032	UNSAT TT=1.079 CHECKS=839 NODES=31	UNSAT TT=1.064 CHECKS=1666 NODES=0	UNSAT TT=0.173	UNSAT TT=0.063 CHECKS=13861	UNSAT TT=0.046 CHECKS=9985	UNSAT TT=0.699 ASSIGNMENTS=0	UNSAT TT=0.801 ASSIGNMENTS=0	UNSAT TT=0.746 CHECKS=57384 NODES=43	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=0.046 ASSIGNMENTS=18 CHECKS=16686	UNSAT TT=0.045 ASSIGNMENTS=18 CHECKS=16686	UNSAT TT=4.312	UNSAT TT=4.578	UNSAT TT=0.539 CHECKS=23990	UNSAT TT=0.032 ASSIGNMENTS=18 CHECKS=16967	UNSAT TT=0.047 ASSIGNMENTS=116 CHECKS=77073	UNSAT TT=0.661	UNSAT TT=0.033 ASSIGNMENTS=54 CHECKS=19376	UNSAT TT=0.035 ASSIGNMENTS=18 CHECKS=16686	UNSAT TT=1.724	UNSAT TT=0.197 ASSIGNMENTS=318 CHECKS=275028	UNSAT TT=0.972	UNSAT TT=1.22
csp/jnhUnsat/ normalized-jnh203_ext.xml	UNSAT TT=0.036	UNSAT TT=1.261 CHECKS=17212 NODES=557	UNSAT TT=1.206 CHECKS=15095 NODES=455	UNSAT TT=0.188	UNSAT TT=0.168 CHECKS=72551	UNSAT TT=0.087 CHECKS=72213	UNSAT TT=1.155 ASSIGNMENTS=53	UNSAT TT=0.93 ASSIGNMENTS=15	UNSAT TT=1.005 CHECKS=93319 NODES=85	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.048 ASSIGNMENTS=54 CHECKS=41414	UNSAT TT=0.048 ASSIGNMENTS=54 CHECKS=41414	UNSAT TT=4.019	UNSAT TT=4.116	UNSAT TT=0.562 CHECKS=29862	UNSAT TT=0.039 ASSIGNMENTS=67 CHECKS=51762	UNSAT TT=0.341 ASSIGNMENTS=3764 CHECKS=2083950	UNSAT TT=0.783	UNSAT TT=0.039 ASSIGNMENTS=129 CHECKS=61920	UNSAT TT=0.036 ASSIGNMENTS=54 CHECKS=41414	UNSAT TT=1.873	UNSAT TT=0.154 ASSIGNMENTS=371 CHECKS=210375	UNSAT TT=1.2	UNSAT TT=1.21
csp/jnhUnsat/ normalized-jnh206_ext.xml	UNSAT TT=0.047	UNSAT TT=1.322 CHECKS=32441 NODES=884	UNSAT TT=1.237 CHECKS=24232 NODES=585	UNSAT TT=0.235	UNSAT TT=0.202 CHECKS=111475	UNSAT TT=0.097 CHECKS=110724	UNSAT TT=1.379 ASSIGNMENTS=100	UNSAT TT=1.128 ASSIGNMENTS=61	UNSAT TT=1.187 CHECKS=229877 NODES=208	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=0.063 ASSIGNMENTS=151 CHECKS=130802	UNSAT TT=0.063 ASSIGNMENTS=151 CHECKS=130802	UNSAT TT=4.025	UNSAT TT=4.162	UNSAT TT=0.52 CHECKS=45502	UNSAT TT=0.047 ASSIGNMENTS=134 CHECKS=125594	UNSAT TT=0.338 ASSIGNMENTS=4002 CHECKS=1966060	UNSAT TT=0.873	UNSAT TT=0.055 ASSIGNMENTS=282 CHECKS=175550	UNSAT TT=0.047 ASSIGNMENTS=151 CHECKS=130802	UNSAT TT=1.944	UNSAT TT=0.302 ASSIGNMENTS=629 CHECKS=366050	UNSAT TT=0.977	UNSAT TT=1.325
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhUnsat/ normalized-jnh208_ext.xml	UNSAT TT=0.035	UNSAT TT=1.241 CHECKS=32632 NODES=491	UNSAT TT=1.31 CHECKS=27544 NODES=376	UNSAT TT=0.203	UNSAT TT=0.235 CHECKS=122953	UNSAT TT=0.101 CHECKS=117711	UNSAT TT=1.249 ASSIGNMENTS=62	UNSAT TT=1.108 ASSIGNMENTS=23	UNSAT TT=0.886 CHECKS=99125 NODES=81	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=0.046 ASSIGNMENTS=42 CHECKS=36283	UNSAT TT=0.05 ASSIGNMENTS=42 CHECKS=36283	UNSAT TT=4.662	UNSAT TT=4.264	UNSAT TT=0.61 CHECKS=32416	UNSAT TT=0.038 ASSIGNMENTS=82 CHECKS=62801	UNSAT TT=0.324 ASSIGNMENTS=3537 CHECKS=1831530	UNSAT TT=1.03	UNSAT TT=0.039 ASSIGNMENTS=90 CHECKS=49649	UNSAT TT=0.035 ASSIGNMENTS=42 CHECKS=36283	UNSAT TT=1.762	UNSAT TT=0.261 ASSIGNMENTS=297 CHECKS=198019	UNSAT TT=1.214	UNSAT TT=1.035
csp/jnhUnsat/ normalized-jnh20_ext.xml	UNSAT TT=0.04	UNSAT TT=1.182 CHECKS=10769 NODES=367	UNSAT TT=1.286 CHECKS=12081 NODES=299	UNSAT TT=0.229	UNSAT TT=0.132 CHECKS=49566	UNSAT TT=0.052 CHECKS=21635	UNSAT TT=0.932 ASSIGNMENTS=0	UNSAT TT=0.876 ASSIGNMENTS=0	UNSAT TT=0.811 CHECKS=75999 NODES=69	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=0.047 ASSIGNMENTS=75 CHECKS=65162	UNSAT TT=0.053 ASSIGNMENTS=75 CHECKS=65162	UNSAT TT=4.405	UNSAT TT=4.201	UNSAT TT=0.651 CHECKS=40634	UNSAT TT=0.041 ASSIGNMENTS=82 CHECKS=66046	UNSAT TT=0.074 ASSIGNMENTS=459 CHECKS=287257	UNSAT TT=0.724	UNSAT TT=0.04 ASSIGNMENTS=116 CHECKS=58932	UNSAT TT=0.041 ASSIGNMENTS=75 CHECKS=65162	UNSAT TT=1.919	UNSAT TT=0.26 ASSIGNMENTS=274 CHECKS=193683	UNSAT TT=1.227	UNSAT TT=1.036
csp/jnhUnsat/ normalized-jnh211_ext.xml	UNSAT TT=0.032	UNSAT TT=1.181 CHECKS=7129 NODES=230	UNSAT TT=1.288 CHECKS=8411 NODES=214	UNSAT TT=0.18	UNSAT TT=0.064 CHECKS=15066	UNSAT TT=0.055 CHECKS=38037	UNSAT TT=0.764 ASSIGNMENTS=0	UNSAT TT=0.779 ASSIGNMENTS=0	UNSAT TT=0.951 CHECKS=72090 NODES=60	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.043 ASSIGNMENTS=18 CHECKS=14766	UNSAT TT=0.039 ASSIGNMENTS=18 CHECKS=14766	UNSAT TT=5.358	UNSAT TT=4.086	UNSAT TT=0.503 CHECKS=14345	UNSAT TT=0.034 ASSIGNMENTS=33 CHECKS=27475	UNSAT TT=0.078 ASSIGNMENTS=605 CHECKS=330026	UNSAT TT=0.787	UNSAT TT=0.034 ASSIGNMENTS=77 CHECKS=30431	UNSAT TT=0.032 ASSIGNMENTS=18 CHECKS=14766	UNSAT TT=1.652	UNSAT TT=0.098 ASSIGNMENTS=179 CHECKS=113276	UNSAT TT=0.983	UNSAT TT=1.209
csp/jnhUnsat/ normalized-jnh214_ext.xml	UNSAT TT=0.035	UNSAT TT=1.172 CHECKS=9170 NODES=262	UNSAT TT=1.18 CHECKS=12139 NODES=295	UNSAT TT=0.177	UNSAT TT=0.186 CHECKS=97015	UNSAT TT=0.064 CHECKS=44495	UNSAT TT=1.194 ASSIGNMENTS=19	UNSAT TT=1.019 ASSIGNMENTS=29	UNSAT TT=0.991 CHECKS=89520 NODES=84	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.049 ASSIGNMENTS=38 CHECKS=32226	UNSAT TT=0.046 ASSIGNMENTS=38 CHECKS=32226	UNSAT TT=4.031	UNSAT TT=4.251	UNSAT TT=0.489 CHECKS=15525	UNSAT TT=0.037 ASSIGNMENTS=42 CHECKS=35489	UNSAT TT=0.298 ASSIGNMENTS=3636 CHECKS=1645080	UNSAT TT=0.775	UNSAT TT=0.037 ASSIGNMENTS=127 CHECKS=45334	UNSAT TT=0.035 ASSIGNMENTS=38 CHECKS=32226	UNSAT TT=1.782	UNSAT TT=0.139 ASSIGNMENTS=192 CHECKS=94987	UNSAT TT=1.009	UNSAT TT=1.015
csp/jnhUnsat/ normalized-jnh215_ext.xml	UNSAT TT=0.036	UNSAT TT=1.308 CHECKS=13766 NODES=340	UNSAT TT=1.279 CHECKS=20743 NODES=462	UNSAT TT=0.253	UNSAT TT=0.113 CHECKS=50556	UNSAT TT=0.061 CHECKS=45694	UNSAT TT=1.339 ASSIGNMENTS=57	UNSAT TT=1.126 ASSIGNMENTS=11	UNSAT TT=0.795 CHECKS=54326 NODES=48	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.048 ASSIGNMENTS=44 CHECKS=34940	UNSAT TT=0.046 ASSIGNMENTS=44 CHECKS=34940	UNSAT TT=4.133	UNSAT TT=4.027	UNSAT TT=0.502 CHECKS=23878	UNSAT TT=0.04 ASSIGNMENTS=85 CHECKS=69855	UNSAT TT=0.14 ASSIGNMENTS=1600 CHECKS=725167	UNSAT TT=0.699	UNSAT TT=0.045 ASSIGNMENTS=225 CHECKS=101877	UNSAT TT=0.036 ASSIGNMENTS=44 CHECKS=34940	UNSAT TT=1.667	UNSAT TT=0.155 ASSIGNMENTS=237 CHECKS=187196	UNSAT TT=1.304	UNSAT TT=1.016
csp/jnhUnsat/ normalized-jnh216_ext.xml	UNSAT TT=0.043	UNSAT TT=1.277 CHECKS=24390 NODES=691	UNSAT TT=1.254 CHECKS=25895 NODES=685	UNSAT TT=0.221	UNSAT TT=32.34 CHECKS=25177600	UNSAT TT=0.105 CHECKS=113204	UNSAT TT=1.361 ASSIGNMENTS=110	UNSAT TT=1.243 ASSIGNMENTS=69	UNSAT TT=0.984 CHECKS=137369 NODES=125	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.058 ASSIGNMENTS=102 CHECKS=89073	UNSAT TT=0.057 ASSIGNMENTS=102 CHECKS=89073	UNSAT TT=3.99	UNSAT TT=4.925	UNSAT TT=0.575 CHECKS=63985	UNSAT TT=0.046 ASSIGNMENTS=129 CHECKS=110696	UNSAT TT=0.326 ASSIGNMENTS=3795 CHECKS=1807000	UNSAT TT=0.878	UNSAT TT=0.043 ASSIGNMENTS=153 CHECKS=75599	UNSAT TT=0.043 ASSIGNMENTS=102 CHECKS=89073	UNSAT TT=1.769	UNSAT TT=0.314 ASSIGNMENTS=547 CHECKS=343587	UNSAT TT=1.212	UNSAT TT=1.064
csp/jnhUnsat/ normalized-jnh219_ext.xml	UNSAT TT=0.034	UNSAT TT=1.107 CHECKS=8788 NODES=217	UNSAT TT=1.198 CHECKS=11123 NODES=225	UNSAT TT=0.198	UNSAT TT=0.162 CHECKS=66908	UNSAT TT=0.084 CHECKS=83245	UNSAT TT=1.192 ASSIGNMENTS=44	UNSAT TT=1.266 ASSIGNMENTS=30	UNSAT TT=1.146 CHECKS=266407 NODES=242	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=0.045 ASSIGNMENTS=44 CHECKS=39871	UNSAT TT=0.048 ASSIGNMENTS=44 CHECKS=39871	UNSAT TT=4.047	UNSAT TT=4.728	UNSAT TT=0.638 CHECKS=26698	UNSAT TT=0.039 ASSIGNMENTS=53 CHECKS=46395	UNSAT TT=0.305 ASSIGNMENTS=3980 CHECKS=1922970	UNSAT TT=0.964	UNSAT TT=0.039 ASSIGNMENTS=133 CHECKS=58625	UNSAT TT=0.034 ASSIGNMENTS=44 CHECKS=39871	UNSAT TT=1.837	UNSAT TT=0.295 ASSIGNMENTS=688 CHECKS=396942	UNSAT TT=1.08	UNSAT TT=0.98
csp/jnhUnsat/ normalized-jnh302_ext.xml	UNSAT TT=0.032	UNSAT TT=1.011 CHECKS=162 NODES=0	UNSAT TT=1.023 CHECKS=162 NODES=0	UNSAT TT=0.18	UNSAT TT=0.049 CHECKS=2146	UNSAT TT=0.046 CHECKS=2146	UNSAT TT=0.651 ASSIGNMENTS=0	UNSAT TT=0.705 ASSIGNMENTS=0	UNSAT TT=0.691 CHECKS=6021 NODES=0	UNSAT TT=0.799 CHECKS=7728 NODES=0	UNSAT TT=0.965 CHECKS=7728 NODES=0	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=5.073	UNSAT TT=5.294	UNSAT TT=0.553 CHECKS=7934	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.877	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=1.715	UNSAT TT=0.12 ASSIGNMENTS=141 CHECKS=159031	UNSAT TT=1.039	UNSAT TT=1.261
csp/jnhUnsat/ normalized-jnh303_ext.xml	UNSAT TT=0.042	UNSAT TT=1.209 CHECKS=15300 NODES=437	UNSAT TT=1.271 CHECKS=17359 NODES=406	UNSAT TT=0.239	UNSAT TT=0.195 CHECKS=99729	UNSAT TT=0.108 CHECKS=115750	UNSAT TT=1.506 ASSIGNMENTS=69	UNSAT TT=1.37 ASSIGNMENTS=29	UNSAT TT=0.917 CHECKS=131812 NODES=106	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=0.055 ASSIGNMENTS=97 CHECKS=70423	UNSAT TT=0.056 ASSIGNMENTS=97 CHECKS=70423	UNSAT TT=4.498	UNSAT TT=4.883	UNSAT TT=0.781 CHECKS=21767	UNSAT TT=0.044 ASSIGNMENTS=69 CHECKS=62646	UNSAT TT=0.366 ASSIGNMENTS=3774 CHECKS=2269940	UNSAT TT=0.856	UNSAT TT=0.044 ASSIGNMENTS=146 CHECKS=83588	UNSAT TT=0.042 ASSIGNMENTS=97 CHECKS=70423	UNSAT TT=1.82	UNSAT TT=0.297 ASSIGNMENTS=371 CHECKS=249415	UNSAT TT=0.973	UNSAT TT=1.044
csp/jnhUnsat/ normalized-jnh304_ext.xml	UNSAT TT=0.036	UNSAT TT=1.24 CHECKS=10982 NODES=268	UNSAT TT=1.1 CHECKS=3036 NODES=0	UNSAT TT=0.272	UNSAT TT=0.062 CHECKS=9940	UNSAT TT=0.048 CHECKS=6569	UNSAT TT=0.685 ASSIGNMENTS=0	UNSAT TT=0.701 ASSIGNMENTS=0	UNSAT TT=0.719 CHECKS=21410 NODES=10	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.048 ASSIGNMENTS=17 CHECKS=16169	UNSAT TT=0.048 ASSIGNMENTS=17 CHECKS=16169	UNSAT TT=4.432	UNSAT TT=4.528	UNSAT TT=0.531 CHECKS=12509	UNSAT TT=0.038 ASSIGNMENTS=36 CHECKS=29884	UNSAT TT=0.047 ASSIGNMENTS=180 CHECKS=112593	UNSAT TT=0.682	UNSAT TT=0.036 ASSIGNMENTS=92 CHECKS=25652	UNSAT TT=0.036 ASSIGNMENTS=17 CHECKS=16169	UNSAT TT=1.729	UNSAT TT=0.114 ASSIGNMENTS=173 CHECKS=144889	UNSAT TT=1.249	UNSAT TT=1.048
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhUnsat/ normalized-jnh305_ext.xml	UNSAT TT=0.035	UNSAT TT=1.068 CHECKS=3676 NODES=83	UNSAT TT=1.157 CHECKS=5483 NODES=84	UNSAT TT=0.186	UNSAT TT=0.101 CHECKS=34303	UNSAT TT=0.065 CHECKS=45175	UNSAT TT=0.894 ASSIGNMENTS=0	UNSAT TT=1.024 ASSIGNMENTS=0	UNSAT TT=0.758 CHECKS=27202 NODES=25	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.045 ASSIGNMENTS=12 CHECKS=15011	UNSAT TT=0.046 ASSIGNMENTS=12 CHECKS=15011	UNSAT TT=5.03	UNSAT TT=5.058	UNSAT TT=0.708 CHECKS=12489	UNSAT TT=0.035 ASSIGNMENTS=10 CHECKS=14371	UNSAT TT=0.071 ASSIGNMENTS=376 CHECKS=259006	UNSAT TT=0.936	UNSAT TT=0.037 ASSIGNMENTS=67 CHECKS=37051	UNSAT TT=0.035 ASSIGNMENTS=12 CHECKS=15011	UNSAT TT=1.807	UNSAT TT=0.121 ASSIGNMENTS=184 CHECKS=155306	UNSAT TT=1.028	UNSAT TT=1.194
csp/jnhUnsat/ normalized-jnh306_ext.xml	UNSAT TT=0.068	UNSAT TT=2 CHECKS=148016 NODES=2759	UNSAT TT=2.026 CHECKS=134157 NODES=2445	UNSAT TT=1.244	UNSAT TT=1.857 CHECKS=899573	UNSAT TT=0.813 CHECKS=1196730	UNSAT TT=2.991 ASSIGNMENTS=472	UNSAT TT=2.076 ASSIGNMENTS=260	UNSAT TT=3.178 CHECKS=1212120 NODES=952	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=0.075 ASSIGNMENTS=282 CHECKS=252095	UNSAT TT=0.076 ASSIGNMENTS=282 CHECKS=252095	UNSAT TT=4.615	UNSAT TT=4.235	UNSAT TT=1.11 CHECKS=132359	UNSAT TT=0.09 ASSIGNMENTS=435 CHECKS=403019	UNSAT TT=0.35 ASSIGNMENTS=4074 CHECKS=2275400	UNSAT TT=1.306	UNSAT TT=0.068 ASSIGNMENTS=307 CHECKS=217589	UNSAT TT=0.07 ASSIGNMENTS=282 CHECKS=252095	UNSAT TT=2.138	UNSAT TT=1.172 ASSIGNMENTS=1746 CHECKS=1354690	UNSAT TT=1.146	UNSAT TT=1.002
csp/jnhUnsat/ normalized-jnh307_ext.xml	UNSAT TT=0.033	UNSAT TT=1.024 CHECKS=890 NODES=36	UNSAT TT=1.091 CHECKS=529 NODES=0	UNSAT TT=0.17	UNSAT TT=0.053 CHECKS=2811	UNSAT TT=0.047 CHECKS=2811	UNSAT TT=0.822 ASSIGNMENTS=0	UNSAT TT=0.78 ASSIGNMENTS=0	UNSAT TT=0.718 CHECKS=8404 NODES=1	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.047 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=0.044 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=4.242	UNSAT TT=4.336	UNSAT TT=0.623 CHECKS=10100	UNSAT TT=0.033 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=0.035 ASSIGNMENTS=1 CHECKS=3843	UNSAT TT=0.662	UNSAT TT=0.035 ASSIGNMENTS=4 CHECKS=4618	UNSAT TT=0.033 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=1.738	UNSAT TT=0.137 ASSIGNMENTS=129 CHECKS=77539	UNSAT TT=1.031	UNSAT TT=1.555
csp/jnhUnsat/ normalized-jnh309_ext.xml	UNSAT TT=0.035	UNSAT TT=1.198 CHECKS=8979 NODES=193	UNSAT TT=1.117 CHECKS=2007 NODES=0	UNSAT TT=0.21	UNSAT TT=0.071 CHECKS=12234	UNSAT TT=0.052 CHECKS=14749	UNSAT TT=0.968 ASSIGNMENTS=0	UNSAT TT=0.823 ASSIGNMENTS=0	UNSAT TT=0.885 CHECKS=36625 NODES=26	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=0.05 ASSIGNMENTS=16 CHECKS=16323	UNSAT TT=0.049 ASSIGNMENTS=16 CHECKS=16323	UNSAT TT=4.966	UNSAT TT=4.268	UNSAT TT=0.55 CHECKS=25571	UNSAT TT=0.035 ASSIGNMENTS=21 CHECKS=23048	UNSAT TT=0.079 ASSIGNMENTS=460 CHECKS=286282	UNSAT TT=0.747	UNSAT TT=0.039 ASSIGNMENTS=33 CHECKS=21557	UNSAT TT=0.035 ASSIGNMENTS=16 CHECKS=16323	UNSAT TT=1.687	UNSAT TT=0.155 ASSIGNMENTS=129 CHECKS=88276	UNSAT TT=1.195	UNSAT TT=1.055
csp/jnhUnsat/ normalized-jnh310_ext.xml	UNSAT TT=0.034	UNSAT TT=1.058 CHECKS=301 NODES=15	UNSAT TT=1.015 CHECKS=183 NODES=0	UNSAT TT=0.184	UNSAT TT=0.056 CHECKS=4182	UNSAT TT=0.043 CHECKS=3728	UNSAT TT=0.885 ASSIGNMENTS=0	UNSAT TT=0.761 ASSIGNMENTS=0	UNSAT TT=0.727 CHECKS=14626 NODES=13	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.044 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=0.047 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=4.555	UNSAT TT=5.223	UNSAT TT=0.54 CHECKS=2313	UNSAT TT=0.034 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=0.059 ASSIGNMENTS=340 CHECKS=188119	UNSAT TT=0.655	UNSAT TT=0.035 ASSIGNMENTS=38 CHECKS=11240	UNSAT TT=0.036 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=1.748	UNSAT TT=0.08 ASSIGNMENTS=36 CHECKS=30532	UNSAT TT=1.039	UNSAT TT=1.276
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-10.xml	SAT TT=0.071	SAT TT=2.13 CHECKS=2161970 NODES=1472	SAT TT=2.016 CHECKS=1071380 NODES=523	SAT TT=0.09	SAT TT=23.583 CHECKS=54863000	SAT TT=34.537 CHECKS=75404300	SAT TT=1.368 ASSIGNMENTS=80	SAT TT=1.724 ASSIGNMENTS=80	SAT TT=1.394 CHECKS=0 NODES=51	SAT TT=17.175 CHECKS=192326000 NODES=157539	SAT TT=1.637 CHECKS=9190790 NODES=5254	SAT TT=0.256 ASSIGNMENTS=1109 CHECKS=1808670	SAT TT=0.257 ASSIGNMENTS=1109 CHECKS=1808670	SAT TT=480.631	SAT TT=33.895	No data	SAT TT=0.345 ASSIGNMENTS=1770 CHECKS=2556840	SAT TT=0.073 ASSIGNMENTS=858 CHECKS=388319	SAT TT=0.735	SAT TT=0.199 ASSIGNMENTS=1629 CHECKS=1166960	SAT TT=0.071 ASSIGNMENTS=405 CHECKS=364951	SAT TT=33.062	No data	SAT TT=1.056	SAT TT=1.548
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-1.xml	SAT TT=0.04	SAT TT=1.916 CHECKS=800721 NODES=537	SAT TT=1.922 CHECKS=308967 NODES=84	SAT TT=0.089	SAT TT=17.473 CHECKS=40952800	SAT TT=18.261 CHECKS=47069000	SAT TT=1.361 ASSIGNMENTS=71	SAT TT=1.451 ASSIGNMENTS=71	SAT TT=1.283 CHECKS=0 NODES=224	SAT TT=50.803 CHECKS=572198000 NODES=482337	SAT TT=1.123 CHECKS=368461 NODES=76	SAT TT=0.117 ASSIGNMENTS=592 CHECKS=656739	SAT TT=0.116 ASSIGNMENTS=592 CHECKS=656739	SAT TT=397.674	SAT TT=23.088	No data	SAT TT=0.107 ASSIGNMENTS=768 CHECKS=642394	SAT TT=0.111 ASSIGNMENTS=1512 CHECKS=667826	SAT TT=0.729	SAT TT=0.062 ASSIGNMENTS=574 CHECKS=254308	SAT TT=0.04 ASSIGNMENTS=109 CHECKS=136278	SAT TT=13.89	No data	SAT TT=1.102	SAT TT=1.428
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-2.xml	SAT TT=0.022	SAT TT=1.954 CHECKS=214299 NODES=122	SAT TT=1.775 CHECKS=149112 NODES=0	SAT TT=0.085	SAT TT=18.561 CHECKS=50904200	SAT TT=17.468 CHECKS=49716500	SAT TT=1.406 ASSIGNMENTS=94	SAT TT=1.335 ASSIGNMENTS=94	SAT TT=1.295 CHECKS=0 NODES=93	SAT TT=16.01 CHECKS=183593000 NODES=152233	SAT TT=0.966 CHECKS=415127 NODES=76	SAT TT=0.05 ASSIGNMENTS=278 CHECKS=103472	SAT TT=0.048 ASSIGNMENTS=278 CHECKS=103472	SAT TT=460.467	SAT TT=24.576	No data	SAT TT=0.048 ASSIGNMENTS=602 CHECKS=213659	SAT TT=0.04 ASSIGNMENTS=315 CHECKS=147814	SAT TT=0.733	SAT TT=0.022 ASSIGNMENTS=68 CHECKS=18956	SAT TT=0.023 ASSIGNMENTS=102 CHECKS=33530	SAT TT=11.033	No data	SAT TT=1.094	SAT TT=1.362
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-3.xml	SAT TT=0.048	? (TO) TT=1800.11	? (TO) TT=1800.15	SAT TT=0.085	SAT TT=46.991 CHECKS=104102000	? (TO) TT=1800.08	SAT TT=1.661 ASSIGNMENTS=78	SAT TT=1.44 ASSIGNMENTS=78	SAT TT=7.664 CHECKS=0 NODES=46978	SAT TT=16.75 CHECKS=198037000 NODES=166163	SAT TT=3.645 CHECKS=36341900 NODES=21036	SAT TT=8.89 ASSIGNMENTS=78	SAT TT=7.154 ASSIGNMENTS=243 CHECKS=256362	SAT TT=511.733	SAT TT=43.776	No data	SAT TT=26.031 ASSIGNMENTS=162078 CHECKS=205884000	SAT TT=0.048 ASSIGNMENTS=533 CHECKS=187006	? (TO) TT=1800.03	SAT TT=0.058 ASSIGNMENTS=603 CHECKS=202779	SAT TT=0.054 ASSIGNMENTS=243 CHECKS=256362	SAT TT=101.047	No data	SAT TT=1.012	SAT TT=1.4
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-4.xml	SAT TT=0.021	SAT TT=1.81 CHECKS=370352 NODES=215	SAT TT=1.719 CHECKS=60534 NODES=0	SAT TT=0.086	SAT TT=11.555 CHECKS=33484100	SAT TT=23.971 CHECKS=62311600	SAT TT=1.531 ASSIGNMENTS=84	SAT TT=1.565 ASSIGNMENTS=84	SAT TT=1.287 CHECKS=0 NODES=144	SAT TT=6.551 CHECKS=64047300 NODES=53959	SAT TT=1.004 CHECKS=959150 NODES=478	SAT TT=0.294 ASSIGNMENTS=1124 CHECKS=2269000	SAT TT=0.295 ASSIGNMENTS=1124 CHECKS=2269000	SAT TT=361.781	SAT TT=25.582	No data	SAT TT=0.339 ASSIGNMENTS=1562 CHECKS=2748610	SAT TT=0.068 ASSIGNMENTS=808 CHECKS=381872	SAT TT=278.94	SAT TT=0.034 ASSIGNMENTS=241 CHECKS=76621	SAT TT=0.021 ASSIGNMENTS=47 CHECKS=13160	SAT TT=9.996	No data	SAT TT=0.981	SAT TT=1.564
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-5.xml	SAT TT=0.022	SAT TT=1.873 CHECKS=217212 NODES=131	SAT TT=1.779 CHECKS=59168 NODES=0	SAT TT=0.089	SAT TT=12.363 CHECKS=28161500	SAT TT=18.061 CHECKS=42792800	SAT TT=1.331 ASSIGNMENTS=90	SAT TT=1.441 ASSIGNMENTS=90	SAT TT=1.376 CHECKS=0 NODES=50	SAT TT=1.494 CHECKS=6252450 NODES=4874	SAT TT=0.948 CHECKS=498468 NODES=165	SAT TT=0.034 ASSIGNMENTS=82 CHECKS=24868	SAT TT=0.035 ASSIGNMENTS=82 CHECKS=24868	SAT TT=369.898	SAT TT=25.411	No data	SAT TT=0.022 ASSIGNMENTS=84 CHECKS=29880	SAT TT=0.023 ASSIGNMENTS=134 CHECKS=38333	SAT TT=0.867	SAT TT=0.035 ASSIGNMENTS=257 CHECKS=78520	SAT TT=0.023 ASSIGNMENTS=69 CHECKS=23514	SAT TT=10.634	No data	SAT TT=1.096	SAT TT=1.534
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-6.xml	SAT TT=0.024	SAT TT=1.854 CHECKS=74689 NODES=50	SAT TT=1.882 CHECKS=67056 NODES=0	SAT TT=0.093	SAT TT=0.411 CHECKS=9948	SAT TT=0.025 CHECKS=11088	SAT TT=1.402 ASSIGNMENTS=97	SAT TT=1.311 ASSIGNMENTS=97	SAT TT=1.574 CHECKS=0 NODES=50	SAT TT=1.324 CHECKS=2893570 NODES=2065	SAT TT=1.014 CHECKS=379891 NODES=53	SAT TT=0.04 ASSIGNMENTS=107 CHECKS=46400	SAT TT=0.037 ASSIGNMENTS=107 CHECKS=46400	SAT TT=326.105	SAT TT=24.763	No data	SAT TT=0.026 ASSIGNMENTS=106 CHECKS=45160	SAT TT=0.024 ASSIGNMENTS=60 CHECKS=17712	SAT TT=0.869	SAT TT=0.034 ASSIGNMENTS=312 CHECKS=77931	SAT TT=0.033 ASSIGNMENTS=151 CHECKS=66370	SAT TT=11.252	No data	SAT TT=1.026	SAT TT=1.507
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-7.xml	SAT TT=0.036	SAT TT=1.856 CHECKS=221884 NODES=134	SAT TT=1.764 CHECKS=90807 NODES=0	SAT TT=892.633	SAT TT=0.432 CHECKS=11521	SAT TT=0.025 CHECKS=11490	SAT TT=1.364 ASSIGNMENTS=78	SAT TT=1.455 ASSIGNMENTS=78	SAT TT=1.306 CHECKS=0 NODES=50	SAT TT=1.227 CHECKS=2732830 NODES=2015	SAT TT=1.14 CHECKS=2733380 NODES=1552	SAT TT=1.102 ASSIGNMENTS=5457 CHECKS=8306140	SAT TT=1.012 ASSIGNMENTS=5457 CHECKS=8306140	SAT TT=507.081	SAT TT=23.812	No data	SAT TT=1.069 ASSIGNMENTS=5449 CHECKS=8336000	SAT TT=0.055 ASSIGNMENTS=591 CHECKS=247544	SAT TT=0.736	SAT TT=0.036 ASSIGNMENTS=267 CHECKS=86154	SAT TT=0.066 ASSIGNMENTS=405 CHECKS=335762	SAT TT=11.036	No data	SAT TT=1.149	SAT TT=1.627
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-8.xml	SAT TT=0.042	SAT TT=2.11 CHECKS=911704 NODES=524	SAT TT=1.941 CHECKS=526002 NODES=167	SAT TT=0.083	SAT TT=23.731 CHECKS=50989800	SAT TT=34.618 CHECKS=77524700	SAT TT=1.347 ASSIGNMENTS=75	SAT TT=1.359 ASSIGNMENTS=75	SAT TT=1.273 CHECKS=0 NODES=98	SAT TT=14.155 CHECKS=171275000 NODES=144154	SAT TT=1.363 CHECKS=5646380 NODES=3338	SAT TT=0.213 ASSIGNMENTS=968 CHECKS=1408010	SAT TT=0.214 ASSIGNMENTS=968 CHECKS=1408010	SAT TT=391.208	SAT TT=23.506	No data	SAT TT=0.119 ASSIGNMENTS=1165 CHECKS=826614	SAT TT=0.151 ASSIGNMENTS=2191 CHECKS=1059170	? (TO) TT=1800.1	SAT TT=0.043 ASSIGNMENTS=386 CHECKS=118237	SAT TT=0.042 ASSIGNMENTS=196 CHECKS=169534	SAT TT=22.407	No data	SAT TT=1.142	SAT TT=1.37
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-9.xml	SAT TT=0.024	SAT TT=1.963 CHECKS=68293 NODES=50	SAT TT=1.826 CHECKS=100238 NODES=0	SAT TT=0.088	SAT TT=0.43 CHECKS=9015	SAT TT=0.027 CHECKS=15480	SAT TT=1.474 ASSIGNMENTS=82	SAT TT=1.366 ASSIGNMENTS=82	SAT TT=1.371 CHECKS=0 NODES=50	SAT TT=1.047 CHECKS=503160 NODES=155	SAT TT=1.015 CHECKS=357657 NODES=28	SAT TT=0.037 ASSIGNMENTS=80 CHECKS=29728	SAT TT=0.037 ASSIGNMENTS=80 CHECKS=29728	SAT TT=376.645	SAT TT=24.355	No data	SAT TT=0.027 ASSIGNMENTS=88 CHECKS=34690	SAT TT=0.027 ASSIGNMENTS=114 CHECKS=44617	SAT TT=0.728	SAT TT=0.042 ASSIGNMENTS=465 CHECKS=113488	SAT TT=0.024 ASSIGNMENTS=74 CHECKS=21156	SAT TT=12.301	No data	SAT TT=1.07	SAT TT=1.527
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-10.xml	SAT TT=0.03	SAT TT=1.988 CHECKS=80049 NODES=50	SAT TT=1.962 CHECKS=78774 NODES=0	SAT TT=0.087	SAT TT=0.448 CHECKS=123601	SAT TT=0.072 CHECKS=123347	SAT TT=1.402 ASSIGNMENTS=119	SAT TT=1.319 ASSIGNMENTS=119	SAT TT=1.507 CHECKS=0 NODES=50	SAT TT=2.369 CHECKS=16008800 NODES=11365	SAT TT=1.101 CHECKS=1401440 NODES=632	SAT TT=0.042 ASSIGNMENTS=131 CHECKS=60017	SAT TT=0.041 ASSIGNMENTS=131 CHECKS=60017	SAT TT=606.856	SAT TT=33.463	No data	SAT TT=0.03 ASSIGNMENTS=131 CHECKS=60017	SAT TT=0.065 ASSIGNMENTS=664 CHECKS=324080	SAT TT=0.696	SAT TT=0.038 ASSIGNMENTS=447 CHECKS=102740	SAT TT=0.104 ASSIGNMENTS=598 CHECKS=729398	SAT TT=12.943	No data	SAT TT=1.051	SAT TT=1.605
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-1.xml	SAT TT=0.042	SAT TT=2.258 CHECKS=383132 NODES=157	SAT TT=2.056 CHECKS=393670 NODES=74	SAT TT=581.235	SAT TT=25.607 CHECKS=53621400	SAT TT=35.523 CHECKS=78798500	SAT TT=1.445 ASSIGNMENTS=79	SAT TT=1.456 ASSIGNMENTS=79	SAT TT=1.518 CHECKS=0 NODES=147	SAT TT=649.692 CHECKS=8266180000 NODES=6301700	? (TO) TT=1800.07	SAT TT=0.057 ASSIGNMENTS=333 CHECKS=180816	SAT TT=0.058 ASSIGNMENTS=333 CHECKS=180816	SAT TT=588.304	SAT TT=79.168	No data	SAT TT=0.05 ASSIGNMENTS=455 CHECKS=225497	SAT TT=0.549 ASSIGNMENTS=7576 CHECKS=4406720	SAT TT=1207.63	SAT TT=1.876 ASSIGNMENTS=9623 CHECKS=14270000	SAT TT=0.042 ASSIGNMENTS=194 CHECKS=161857	SAT TT=12.14	No data	SAT TT=1.145	SAT TT=1.618
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-2.xml	SAT TT=0.531	SAT TT=2.324 CHECKS=1225870 NODES=510	SAT TT=2.073 CHECKS=912247 NODES=213	SAT TT=913.923	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=1.564 ASSIGNMENTS=124	SAT TT=1.568 ASSIGNMENTS=124	SAT TT=2.338 CHECKS=0 NODES=7566	SAT TT=470.696 CHECKS=5821060000 NODES=4477470	? (TO) TT=1800.06	SAT TT=0.964 ASSIGNMENTS=4676 CHECKS=7693550	SAT TT=0.902 ASSIGNMENTS=4676 CHECKS=7693550	SAT TT=760.781	SAT TT=143.742	No data	SAT TT=0.855 ASSIGNMENTS=4481 CHECKS=7567780	SAT TT=9.294 ASSIGNMENTS=46248 CHECKS=75939100	SAT TT=969.822	SAT TT=4.511 ASSIGNMENTS=21955 CHECKS=34145900	SAT TT=0.531 ASSIGNMENTS=2658 CHECKS=4139960	SAT TT=462.925	No data	SAT TT=1.14	SAT TT=1.53
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-3.xml	SAT TT=0.027	SAT TT=2.151 CHECKS=376894 NODES=132	SAT TT=2.231 CHECKS=502465 NODES=119	SAT TT=0.09	SAT TT=36.938 CHECKS=85497800	SAT TT=41.013 CHECKS=102981000	SAT TT=1.312 ASSIGNMENTS=106	SAT TT=1.531 ASSIGNMENTS=106	SAT TT=1.642 CHECKS=0 NODES=50	SAT TT=278.599 CHECKS=3618530000 NODES=2705990	SAT TT=1.21 CHECKS=834162 NODES=306	SAT TT=0.037 ASSIGNMENTS=116 CHECKS=43828	SAT TT=0.039 ASSIGNMENTS=116 CHECKS=43828	SAT TT=657.615	SAT TT=43.189	No data	SAT TT=0.027 ASSIGNMENTS=116 CHECKS=43828	SAT TT=0.254 ASSIGNMENTS=3457 CHECKS=1757560	SAT TT=0.741	SAT TT=0.049 ASSIGNMENTS=535 CHECKS=162875	SAT TT=0.192 ASSIGNMENTS=867 CHECKS=1412520	SAT TT=12.439	No data	SAT TT=1.118	SAT TT=1.538
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-4.xml	SAT TT=0.039	SAT TT=2.045 CHECKS=93785 NODES=59	SAT TT=2.05 CHECKS=213236 NODES=0	SAT TT=917.112	SAT TT=11.89 CHECKS=27986800	SAT TT=17.53 CHECKS=43080200	SAT TT=1.315 ASSIGNMENTS=96	SAT TT=1.316 ASSIGNMENTS=96	SAT TT=1.581 CHECKS=0 NODES=50	SAT TT=1.382 CHECKS=4480230 NODES=3042	SAT TT=0.988 CHECKS=716294 NODES=240	SAT TT=0.041 ASSIGNMENTS=157 CHECKS=61183	SAT TT=0.044 ASSIGNMENTS=157 CHECKS=61183	SAT TT=654.893	SAT TT=56.34	No data	SAT TT=0.062 ASSIGNMENTS=271 CHECKS=301022	SAT TT=0.049 ASSIGNMENTS=441 CHECKS=226645	SAT TT=0.795	SAT TT=0.039 ASSIGNMENTS=430 CHECKS=85956	SAT TT=0.053 ASSIGNMENTS=356 CHECKS=223583	SAT TT=13.18	No data	SAT TT=1.35	SAT TT=1.75
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-5.xml	SAT TT=0.027	SAT TT=2.132 CHECKS=93659 NODES=55	SAT TT=2.113 CHECKS=158355 NODES=0	SAT TT=0.09	SAT TT=5.305 CHECKS=12314800	SAT TT=6.83 CHECKS=16518700	SAT TT=1.431 ASSIGNMENTS=126	SAT TT=1.574 ASSIGNMENTS=126	SAT TT=1.666 CHECKS=0 NODES=50	SAT TT=18.288 CHECKS=211533000 NODES=154694	SAT TT=0.961 CHECKS=623887 NODES=133	SAT TT=0.041 ASSIGNMENTS=129 CHECKS=47583	SAT TT=0.037 ASSIGNMENTS=129 CHECKS=47583	SAT TT=621.616	SAT TT=32.056	No data	SAT TT=0.027 ASSIGNMENTS=140 CHECKS=52025	SAT TT=0.101 ASSIGNMENTS=1481 CHECKS=649009	SAT TT=0.804	SAT TT=0.058 ASSIGNMENTS=770 CHECKS=206938	SAT TT=0.214 ASSIGNMENTS=1135 CHECKS=1526920	SAT TT=13.228	No data	SAT TT=1.133	SAT TT=1.632
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-6.xml	SAT TT=0.024	SAT TT=2.148 CHECKS=77662 NODES=50	SAT TT=1.983 CHECKS=83706 NODES=0	SAT TT=6.963	SAT TT=0.439 CHECKS=11661	SAT TT=0.026 CHECKS=11820	SAT TT=1.666 ASSIGNMENTS=116	SAT TT=1.473 ASSIGNMENTS=116	SAT TT=1.495 CHECKS=0 NODES=50	SAT TT=81.684 CHECKS=1032650000 NODES=752558	SAT TT=0.983 CHECKS=817493 NODES=285	SAT TT=0.037 ASSIGNMENTS=98 CHECKS=28390	SAT TT=0.037 ASSIGNMENTS=98 CHECKS=28390	SAT TT=527.972	SAT TT=44.227	No data	SAT TT=0.024 ASSIGNMENTS=101 CHECKS=28205	SAT TT=0.027 ASSIGNMENTS=132 CHECKS=49420	SAT TT=0.737	SAT TT=0.041 ASSIGNMENTS=453 CHECKS=104408	SAT TT=0.106 ASSIGNMENTS=580 CHECKS=666959	SAT TT=14.06	No data	SAT TT=1.048	SAT TT=1.611
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-7.xml	SAT TT=0.033	SAT TT=2.192 CHECKS=164227 NODES=78	SAT TT=2.105 CHECKS=131660 NODES=0	SAT TT=0.088	SAT TT=22.191 CHECKS=50858900	SAT TT=34.553 CHECKS=78611000	SAT TT=1.416 ASSIGNMENTS=94	SAT TT=1.424 ASSIGNMENTS=94	SAT TT=1.461 CHECKS=0 NODES=50	SAT TT=31.752 CHECKS=408507000 NODES=303278	SAT TT=1.261 CHECKS=1448290 NODES=765	SAT TT=0.044 ASSIGNMENTS=123 CHECKS=67668	SAT TT=0.043 ASSIGNMENTS=123 CHECKS=67668	SAT TT=562.881	SAT TT=33.077	No data	SAT TT=0.033 ASSIGNMENTS=136 CHECKS=92360	SAT TT=0.09 ASSIGNMENTS=989 CHECKS=524401	SAT TT=0.886	SAT TT=0.035 ASSIGNMENTS=356 CHECKS=79279	SAT TT=0.068 ASSIGNMENTS=396 CHECKS=405967	SAT TT=17.694	No data	SAT TT=1.052	SAT TT=1.891
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-8.xml	SAT TT=0.031	SAT TT=2.048 CHECKS=76584 NODES=50	SAT TT=2.03 CHECKS=275722 NODES=50	SAT TT=0.091	SAT TT=23.927 CHECKS=55631500	SAT TT=22.552 CHECKS=55360200	SAT TT=1.342 ASSIGNMENTS=105	SAT TT=1.357 ASSIGNMENTS=105	SAT TT=1.66 CHECKS=0 NODES=50	SAT TT=427.733 CHECKS=5018690000 NODES=3748410	SAT TT=1.902 CHECKS=12604700 NODES=7104	SAT TT=0.038 ASSIGNMENTS=105 CHECKS=47856	SAT TT=0.038 ASSIGNMENTS=105 CHECKS=47856	SAT TT=582.756	SAT TT=57	No data	SAT TT=0.031 ASSIGNMENTS=132 CHECKS=63974	SAT TT=0.246 ASSIGNMENTS=3354 CHECKS=1722590	SAT TT=0.86	SAT TT=0.06 ASSIGNMENTS=677 CHECKS=224229	SAT TT=0.154 ASSIGNMENTS=933 CHECKS=1045000	SAT TT=13.504	No data	SAT TT=1.093	SAT TT=1.574
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-9.xml	SAT TT=0.067	SAT TT=2.438 CHECKS=1733440 NODES=721	SAT TT=41.146 CHECKS=482244000 NODES=177039	? (TO) TT=1800.02	SAT TT=0.54 CHECKS=236579	SAT TT=0.137 CHECKS=253143	SAT TT=1.457 ASSIGNMENTS=78	SAT TT=1.482 ASSIGNMENTS=78	SAT TT=1.467 CHECKS=0 NODES=345	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=0.122 ASSIGNMENTS=632 CHECKS=699534	SAT TT=0.124 ASSIGNMENTS=632 CHECKS=699534	SAT TT=709.368	SAT TT=713.885	No data	SAT TT=0.121 ASSIGNMENTS=823 CHECKS=744498	SAT TT=0.838 ASSIGNMENTS=9003 CHECKS=6963660	? (TO) TT=1800.08	SAT TT=0.529 ASSIGNMENTS=3595 CHECKS=3765360	SAT TT=0.067 ASSIGNMENTS=391 CHECKS=357091	SAT TT=25.635	No data	SAT TT=1.05	SAT TT=1.594
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-10.xml	SAT TT=0.024	SAT TT=2.147 CHECKS=679272 NODES=414	SAT TT=1.894 CHECKS=93882 NODES=0	SAT TT=0.089	SAT TT=14.493 CHECKS=36727600	SAT TT=17.543 CHECKS=48194800	SAT TT=1.319 ASSIGNMENTS=100	SAT TT=1.303 ASSIGNMENTS=100	SAT TT=1.426 CHECKS=0 NODES=50	SAT TT=18.483 CHECKS=232760000 NODES=182333	SAT TT=1.027 CHECKS=350650 NODES=34	SAT TT=0.042 ASSIGNMENTS=167 CHECKS=59974	SAT TT=0.042 ASSIGNMENTS=167 CHECKS=59974	SAT TT=603.964	SAT TT=26.163	No data	SAT TT=0.032 ASSIGNMENTS=219 CHECKS=71708	SAT TT=0.034 ASSIGNMENTS=191 CHECKS=100464	SAT TT=0.691	SAT TT=0.034 ASSIGNMENTS=280 CHECKS=74362	SAT TT=0.024 ASSIGNMENTS=90 CHECKS=24993	SAT TT=13.711	No data	SAT TT=1.111	SAT TT=1.539
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-1.xml	SAT TT=0.03	SAT TT=1.825 CHECKS=144023 NODES=87	SAT TT=1.928 CHECKS=68382 NODES=0	SAT TT=0.084	SAT TT=0.437 CHECKS=8796	SAT TT=0.022 CHECKS=9422	SAT TT=1.372 ASSIGNMENTS=77	SAT TT=1.283 ASSIGNMENTS=77	SAT TT=1.314 CHECKS=0 NODES=50	SAT TT=1.105 CHECKS=1503470 NODES=1002	SAT TT=1.085 CHECKS=481897 NODES=111	SAT TT=0.054 ASSIGNMENTS=166 CHECKS=179465	SAT TT=0.058 ASSIGNMENTS=166 CHECKS=179465	SAT TT=377.76	SAT TT=25.298	No data	SAT TT=0.054 ASSIGNMENTS=220 CHECKS=243769	SAT TT=0.037 ASSIGNMENTS=298 CHECKS=123190	SAT TT=0.869	SAT TT=0.037 ASSIGNMENTS=263 CHECKS=83667	SAT TT=0.03 ASSIGNMENTS=149 CHECKS=82904	SAT TT=11.971	No data	SAT TT=1.127	SAT TT=1.452
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-2.xml	SAT TT=0	SAT TT=1.881 CHECKS=131380 NODES=84	SAT TT=2.008 CHECKS=62890 NODES=0	SAT TT=0	SAT TT=0.437 CHECKS=10791	SAT TT=0.026 CHECKS=10601	SAT TT=1.274 ASSIGNMENTS=95	SAT TT=1.273 ASSIGNMENTS=95	SAT TT=1.43 CHECKS=0 NODES=94	SAT TT=1.175 CHECKS=1810900 NODES=1182	SAT TT=1.024 CHECKS=326576 NODES=27	SAT TT=0.037 ASSIGNMENTS=108 CHECKS=28882	SAT TT=0.038 ASSIGNMENTS=108 CHECKS=28882	SAT TT=411.026	SAT TT=25.559	No data	SAT TT=0.028 ASSIGNMENTS=199 CHECKS=48432	SAT TT=0.024 ASSIGNMENTS=43 CHECKS=16466	SAT TT=0.73	SAT TT=0.032 ASSIGNMENTS=184 CHECKS=52105	SAT TT=0.023 ASSIGNMENTS=53 CHECKS=16474	SAT TT=12.816	No data	SAT TT=1.102	SAT TT=1.662
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-3.xml	SAT TT=0.031	? (TO) TT=1800.11	SAT TT=1.806 CHECKS=66359 NODES=0	SAT TT=0.09	SAT TT=0.434 CHECKS=11141	SAT TT=0.026 CHECKS=12881	SAT TT=1.444 ASSIGNMENTS=87	SAT TT=1.311 ASSIGNMENTS=87	SAT TT=1.321 CHECKS=0 NODES=97	SAT TT=1.773 CHECKS=9037550 NODES=7058	SAT TT=0.973 CHECKS=686835 NODES=259	SAT TT=8.259 ASSIGNMENTS=87	SAT TT=7.81 ASSIGNMENTS=164 CHECKS=86177	SAT TT=483.819	SAT TT=25.174	No data	SAT TT=1.71 ASSIGNMENTS=8523 CHECKS=13610000	SAT TT=0.088 ASSIGNMENTS=962 CHECKS=506449	SAT TT=35.638	SAT TT=0.031 ASSIGNMENTS=186 CHECKS=54720	SAT TT=0.031 ASSIGNMENTS=164 CHECKS=86177	SAT TT=11.333	No data	SAT TT=1.153	SAT TT=1.501
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-4.xml	SAT TT=0.027	SAT TT=1.965 CHECKS=85445 NODES=57	SAT TT=1.8 CHECKS=64707 NODES=0	SAT TT=0.092	SAT TT=0.443 CHECKS=10703	SAT TT=0.027 CHECKS=12864	SAT TT=1.338 ASSIGNMENTS=81	SAT TT=1.557 ASSIGNMENTS=81	SAT TT=1.481 CHECKS=0 NODES=50	SAT TT=15.838 CHECKS=186854000 NODES=152096	SAT TT=1.046 CHECKS=389426 NODES=72	SAT TT=0.206 ASSIGNMENTS=955 CHECKS=1515000	SAT TT=0.221 ASSIGNMENTS=955 CHECKS=1515000	SAT TT=388.541	SAT TT=26.866	No data	SAT TT=0.165 ASSIGNMENTS=650 CHECKS=1129810	SAT TT=0.041 ASSIGNMENTS=322 CHECKS=142474	SAT TT=0.729	SAT TT=0.038 ASSIGNMENTS=340 CHECKS=87647	SAT TT=0.027 ASSIGNMENTS=150 CHECKS=41618	SAT TT=10.735	No data	SAT TT=1.115	SAT TT=1.614
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-5.xml	SAT TT=0.024	SAT TT=1.906 CHECKS=79234 NODES=51	SAT TT=1.876 CHECKS=59842 NODES=0	SAT TT=0.09	SAT TT=0.441 CHECKS=9769	SAT TT=0.024 CHECKS=9900	SAT TT=1.348 ASSIGNMENTS=94	SAT TT=1.423 ASSIGNMENTS=94	SAT TT=1.443 CHECKS=0 NODES=50	SAT TT=1.766 CHECKS=10323700 NODES=7713	SAT TT=0.949 CHECKS=423380 NODES=39	SAT TT=0.039 ASSIGNMENTS=86 CHECKS=33633	SAT TT=0.037 ASSIGNMENTS=86 CHECKS=33633	SAT TT=440.105	SAT TT=26.97	No data	SAT TT=0.027 ASSIGNMENTS=94 CHECKS=41578	SAT TT=0.03 ASSIGNMENTS=146 CHECKS=67156	SAT TT=0.855	SAT TT=0.03 ASSIGNMENTS=201 CHECKS=50793	SAT TT=0.024 ASSIGNMENTS=75 CHECKS=22087	SAT TT=11.456	No data	SAT TT=1.221	SAT TT=1.517
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-6.xml	SAT TT=0.022	SAT TT=1.961 CHECKS=77545 NODES=50	SAT TT=1.949 CHECKS=68813 NODES=0	SAT TT=0.083	SAT TT=0.431 CHECKS=10968	SAT TT=0.023 CHECKS=10193	SAT TT=1.289 ASSIGNMENTS=116	SAT TT=1.281 ASSIGNMENTS=116	SAT TT=1.362 CHECKS=0 NODES=50	SAT TT=70.947 CHECKS=797549000 NODES=600199	SAT TT=0.945 CHECKS=384802 NODES=44	SAT TT=0.036 ASSIGNMENTS=97 CHECKS=27194	SAT TT=0.038 ASSIGNMENTS=97 CHECKS=27194	SAT TT=421.396	SAT TT=26.967	No data	SAT TT=0.022 ASSIGNMENTS=97 CHECKS=27194	SAT TT=0.031 ASSIGNMENTS=148 CHECKS=63930	SAT TT=0.858	SAT TT=0.029 ASSIGNMENTS=152 CHECKS=42558	SAT TT=0.023 ASSIGNMENTS=61 CHECKS=17397	SAT TT=13.231	No data	SAT TT=0.994	SAT TT=1.723
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-7.xml	SAT TT=0.028	SAT TT=2.034 CHECKS=152019 NODES=90	SAT TT=1.876 CHECKS=63656 NODES=0	SAT TT=0.092	SAT TT=0.407 CHECKS=12158	SAT TT=0.026 CHECKS=12443	SAT TT=1.456 ASSIGNMENTS=77	SAT TT=1.328 ASSIGNMENTS=77	SAT TT=1.568 CHECKS=0 NODES=50	SAT TT=1.05 CHECKS=1580390 NODES=967	SAT TT=1.2 CHECKS=375343 NODES=49	SAT TT=6.973 ASSIGNMENTS=99 CHECKS=52744	SAT TT=7.271 ASSIGNMENTS=99 CHECKS=52744	SAT TT=558.023	SAT TT=26.516	No data	SAT TT=3.264 ASSIGNMENTS=16349 CHECKS=26298700	SAT TT=0.033 ASSIGNMENTS=185 CHECKS=77480	SAT TT=0.679	SAT TT=0.036 ASSIGNMENTS=325 CHECKS=95015	SAT TT=0.028 ASSIGNMENTS=99 CHECKS=52744	SAT TT=11.566	No data	SAT TT=1.086	SAT TT=1.48
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-8.xml	SAT TT=0.024	SAT TT=1.882 CHECKS=204209 NODES=118	SAT TT=1.938 CHECKS=104052 NODES=0	SAT TT=0.09	SAT TT=0.405 CHECKS=10999	SAT TT=0.023 CHECKS=10863	SAT TT=1.303 ASSIGNMENTS=85	SAT TT=1.307 ASSIGNMENTS=85	SAT TT=1.329 CHECKS=0 NODES=50	SAT TT=1.178 CHECKS=2214530 NODES=1505	SAT TT=1.063 CHECKS=593851 NODES=208	SAT TT=0.035 ASSIGNMENTS=78 CHECKS=33618	SAT TT=0.036 ASSIGNMENTS=78 CHECKS=33618	SAT TT=270.916	SAT TT=28.701	No data	SAT TT=0.024 ASSIGNMENTS=78 CHECKS=33618	SAT TT=0.029 ASSIGNMENTS=118 CHECKS=62743	SAT TT=0.743	SAT TT=0.041 ASSIGNMENTS=473 CHECKS=124309	SAT TT=0.042 ASSIGNMENTS=162 CHECKS=179824	SAT TT=12.762	No data	SAT TT=1.085	SAT TT=1.882
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-9.xml	SAT TT=0.024	SAT TT=1.989 CHECKS=81706 NODES=50	SAT TT=1.917 CHECKS=64427 NODES=0	SAT TT=0.083	SAT TT=0.437 CHECKS=10299	SAT TT=0.026 CHECKS=9902	SAT TT=1.278 ASSIGNMENTS=92	SAT TT=1.355 ASSIGNMENTS=92	SAT TT=1.456 CHECKS=0 NODES=50	SAT TT=16.433 CHECKS=200890000 NODES=150046	SAT TT=1.014 CHECKS=458713 NODES=68	SAT TT=0.039 ASSIGNMENTS=84 CHECKS=27265	SAT TT=0.037 ASSIGNMENTS=84 CHECKS=27265	SAT TT=423.176	SAT TT=27.056	No data	SAT TT=0.026 ASSIGNMENTS=84 CHECKS=27265	SAT TT=0.027 ASSIGNMENTS=128 CHECKS=46576	SAT TT=0.74	SAT TT=0.033 ASSIGNMENTS=214 CHECKS=53725	SAT TT=0.024 ASSIGNMENTS=53 CHECKS=18305	SAT TT=12.967	No data	SAT TT=0.989	SAT TT=1.551
csp/jobShop-enddr2/ normalized-enddr2-10-by-5-10.xml	SAT TT=0.039	SAT TT=2.273 CHECKS=100807 NODES=50	SAT TT=2.176 CHECKS=82498 NODES=0	SAT TT=0.085	SAT TT=0.445 CHECKS=10310	SAT TT=0.028 CHECKS=14589	SAT TT=1.45 ASSIGNMENTS=115	SAT TT=1.423 ASSIGNMENTS=115	SAT TT=1.482 CHECKS=0 NODES=50	SAT TT=1.092 CHECKS=2158980 NODES=1194	SAT TT=1.064 CHECKS=615114 NODES=134	SAT TT=0.049 ASSIGNMENTS=234 CHECKS=137475	SAT TT=0.055 ASSIGNMENTS=234 CHECKS=137475	SAT TT=633.551	SAT TT=34.979	No data	SAT TT=0.059 ASSIGNMENTS=392 CHECKS=271692	SAT TT=0.064 ASSIGNMENTS=928 CHECKS=358946	SAT TT=0.69	SAT TT=0.039 ASSIGNMENTS=495 CHECKS=91888	SAT TT=0.044 ASSIGNMENTS=172 CHECKS=164309	SAT TT=15.575	No data	SAT TT=1.01	SAT TT=1.706
csp/jobShop-enddr2/ normalized-enddr2-10-by-5-1.xml	SAT TT=0.03	SAT TT=2.224 CHECKS=95363 NODES=50	SAT TT=2.183 CHECKS=140590 NODES=0	SAT TT=0.09	SAT TT=8.42 CHECKS=19342100	SAT TT=13.657 CHECKS=33436400	SAT TT=1.483 ASSIGNMENTS=93	SAT TT=1.695 ASSIGNMENTS=93	SAT TT=1.605 CHECKS=0 NODES=50	SAT TT=9.687 CHECKS=113123000 NODES=82225	SAT TT=1.104 CHECKS=1307380 NODES=626	SAT TT=0.038 ASSIGNMENTS=93 CHECKS=36141	SAT TT=0.037 ASSIGNMENTS=93 CHECKS=36141	SAT TT=737.009	SAT TT=44.035	No data	SAT TT=0.03 ASSIGNMENTS=110 CHECKS=54206	SAT TT=0.206 ASSIGNMENTS=2876 CHECKS=1426260	SAT TT=0.8	SAT TT=0.105 ASSIGNMENTS=1075 CHECKS=543240	SAT TT=0.039 ASSIGNMENTS=164 CHECKS=140498	SAT TT=13.359	No data	SAT TT=1.296	SAT TT=1.574
csp/jobShop-enddr2/ normalized-enddr2-10-by-5-2.xml	SAT TT=0.023	SAT TT=2.346 CHECKS=798936 NODES=240	SAT TT=2.226 CHECKS=728669 NODES=156	SAT TT=0.096	SAT TT=22.321 CHECKS=49229000	SAT TT=34.63 CHECKS=72253000	SAT TT=1.431 ASSIGNMENTS=72	SAT TT=1.356 ASSIGNMENTS=72	SAT TT=1.464 CHECKS=0 NODES=144	SAT TT=184.002 CHECKS=2251530000 NODES=1653180	SAT TT=1.254 CHECKS=4357310 NODES=2469	SAT TT=0.038 ASSIGNMENTS=124 CHECKS=28824	SAT TT=0.037 ASSIGNMENTS=124 CHECKS=28824	SAT TT=671.782	SAT TT=35.436	No data	SAT TT=0.023 ASSIGNMENTS=124 CHECKS=28824	SAT TT=0.17 ASSIGNMENTS=2297 CHECKS=1281430	SAT TT=0.71	SAT TT=0.342 ASSIGNMENTS=2620 CHECKS=2245800	SAT TT=0.043 ASSIGNMENTS=187 CHECKS=167385	SAT TT=25.344	No data	SAT TT=1.113	SAT TT=1.675
csp/jobShop-enddr2/ normalized-enddr2-10-by-5-3.xml	SAT TT=0.029	SAT TT=2.219 CHECKS=89982 NODES=50	SAT TT=2.154 CHECKS=395901 NODES=80	SAT TT=0.093	SAT TT=11.925 CHECKS=27448300	SAT TT=20.47 CHECKS=48462300	SAT TT=1.334 ASSIGNMENTS=120	SAT TT=1.339 ASSIGNMENTS=120	SAT TT=1.537 CHECKS=0 NODES=50	SAT TT=80.993 CHECKS=1072350000 NODES=760045	SAT TT=1.017 CHECKS=1245070 NODES=526	SAT TT=0.042 ASSIGNMENTS=131 CHECKS=61207	SAT TT=0.043 ASSIGNMENTS=131 CHECKS=61207	SAT TT=632.646	SAT TT=34.879	No data	SAT TT=0.029 ASSIGNMENTS=140 CHECKS=65870	SAT TT=0.056 ASSIGNMENTS=446 CHECKS=263949	SAT TT=0.747	SAT TT=0.038 ASSIGNMENTS=360 CHECKS=90437	SAT TT=0.042 ASSIGNMENTS=170 CHECKS=175452	SAT TT=15.11	No data	SAT TT=1.062	SAT TT=1.703
csp/jobShop-enddr2/ normalized-enddr2-10-by-5-4.xml	SAT TT=0.024	SAT TT=2.146 CHECKS=93451 NODES=51	SAT TT=2.159 CHECKS=82534 NODES=0	SAT TT=0.09	SAT TT=0.449 CHECKS=12461	SAT TT=0.025 CHECKS=12742	SAT TT=1.297 ASSIGNMENTS=112	SAT TT=1.421 ASSIGNMENTS=112	SAT TT=1.73 CHECKS=0 NODES=50	SAT TT=3.939 CHECKS=40174100 NODES=28376	SAT TT=1.015 CHECKS=494330 NODES=91	SAT TT=0.036 ASSIGNMENTS=117 CHECKS=31966	SAT TT=0.036 ASSIGNMENTS=117 CHECKS=31966	SAT TT=699.853	SAT TT=34.419	No data	SAT TT=0.024 ASSIGNMENTS=117 CHECKS=31966	SAT TT=0.027 ASSIGNMENTS=125 CHECKS=40061	SAT TT=0.785	SAT TT=0.033 ASSIGNMENTS=269 CHECKS=51686	SAT TT=0.025 ASSIGNMENTS=58 CHECKS=28193	SAT TT=14.635	No data	SAT TT=1.276	SAT TT=1.728
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jobShop-enddr2/ normalized-enddr2-10-by-5-5.xml	SAT TT=0.029	SAT TT=2.263 CHECKS=90914 NODES=50	SAT TT=2.529 CHECKS=83784 NODES=0	SAT TT=0.091	SAT TT=0.436 CHECKS=11537	SAT TT=0.024 CHECKS=12428	SAT TT=1.335 ASSIGNMENTS=119	SAT TT=1.467 ASSIGNMENTS=119	SAT TT=1.568 CHECKS=0 NODES=50	SAT TT=1.051 CHECKS=1553080 NODES=795	SAT TT=0.997 CHECKS=616552 NODES=114	SAT TT=0.04 ASSIGNMENTS=131 CHECKS=50569	SAT TT=0.037 ASSIGNMENTS=131 CHECKS=50569	SAT TT=848.889	SAT TT=35.682	No data	SAT TT=0.029 ASSIGNMENTS=136 CHECKS=52257	SAT TT=0.054 ASSIGNMENTS=533 CHECKS=257896	SAT TT=0.737	SAT TT=0.031 ASSIGNMENTS=274 CHECKS=51676	SAT TT=0.032 ASSIGNMENTS=133 CHECKS=81058	SAT TT=14.093	No data	SAT TT=1.094	SAT TT=1.6
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-10.xml	SAT TT=0.024	SAT TT=2.284 CHECKS=94847 NODES=50	SAT TT=2.21 CHECKS=86949 NODES=0	SAT TT=0.091	SAT TT=0.442 CHECKS=8350	SAT TT=0.025 CHECKS=12213	SAT TT=1.427 ASSIGNMENTS=111	SAT TT=1.329 ASSIGNMENTS=111	SAT TT=1.511 CHECKS=0 NODES=50	SAT TT=17.227 CHECKS=212752000 NODES=150035	SAT TT=0.978 CHECKS=594420 NODES=47	SAT TT=0.044 ASSIGNMENTS=169 CHECKS=62594	SAT TT=0.042 ASSIGNMENTS=169 CHECKS=62594	SAT TT=731.896	SAT TT=35.951	No data	SAT TT=0.028 ASSIGNMENTS=198 CHECKS=72856	SAT TT=0.027 ASSIGNMENTS=166 CHECKS=44820	SAT TT=0.674	SAT TT=0.024 ASSIGNMENTS=117 CHECKS=28418	SAT TT=0.025 ASSIGNMENTS=112 CHECKS=43785	SAT TT=14.985	No data	SAT TT=1.122	SAT TT=1.589
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-1.xml	SAT TT=0.027	SAT TT=2.202 CHECKS=106942 NODES=50	SAT TT=2.168 CHECKS=158061 NODES=0	SAT TT=0.084	SAT TT=0.436 CHECKS=12768	SAT TT=0.026 CHECKS=11873	SAT TT=1.313 ASSIGNMENTS=107	SAT TT=1.549 ASSIGNMENTS=107	SAT TT=1.477 CHECKS=0 NODES=50	SAT TT=1.16 CHECKS=2003870 NODES=1056	SAT TT=1.069 CHECKS=1629790 NODES=746	SAT TT=0.037 ASSIGNMENTS=100 CHECKS=32817	SAT TT=0.038 ASSIGNMENTS=100 CHECKS=32817	SAT TT=999.851	SAT TT=37.766	No data	SAT TT=0.027 ASSIGNMENTS=126 CHECKS=43158	SAT TT=0.035 ASSIGNMENTS=244 CHECKS=107883	SAT TT=0.679	SAT TT=0.037 ASSIGNMENTS=414 CHECKS=89668	SAT TT=0.038 ASSIGNMENTS=150 CHECKS=138506	SAT TT=15.839	No data	SAT TT=1.133	SAT TT=1.59
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-2.xml	SAT TT=0.024	SAT TT=2.203 CHECKS=92868 NODES=50	SAT TT=2.145 CHECKS=79179 NODES=0	SAT TT=0.085	SAT TT=0.448 CHECKS=16800	SAT TT=0.028 CHECKS=17879	SAT TT=1.371 ASSIGNMENTS=109	SAT TT=1.45 ASSIGNMENTS=109	SAT TT=1.444 CHECKS=0 NODES=51	SAT TT=55.831 CHECKS=667799000 NODES=471122	SAT TT=1.154 CHECKS=1730920 NODES=846	SAT TT=0.037 ASSIGNMENTS=129 CHECKS=26301	SAT TT=0.038 ASSIGNMENTS=129 CHECKS=26301	SAT TT=694.12	SAT TT=34.608	No data	SAT TT=0.024 ASSIGNMENTS=129 CHECKS=26301	SAT TT=0.183 ASSIGNMENTS=2323 CHECKS=1212270	SAT TT=0.686	SAT TT=0.027 ASSIGNMENTS=129 CHECKS=28861	SAT TT=0.092 ASSIGNMENTS=456 CHECKS=564012	SAT TT=15.203	No data	SAT TT=1.126	SAT TT=1.596
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-3.xml	SAT TT=0.031	SAT TT=2.322 CHECKS=227152 NODES=91	SAT TT=2.277 CHECKS=163750 NODES=0	SAT TT=0.091	SAT TT=0.446 CHECKS=12876	SAT TT=0.025 CHECKS=10434	SAT TT=1.329 ASSIGNMENTS=106	SAT TT=1.508 ASSIGNMENTS=106	SAT TT=1.579 CHECKS=0 NODES=50	SAT TT=50.815 CHECKS=670794000 NODES=452615	SAT TT=1.129 CHECKS=807608 NODES=203	SAT TT=0.04 ASSIGNMENTS=110 CHECKS=43053	SAT TT=0.04 ASSIGNMENTS=110 CHECKS=43053	SAT TT=598.005	SAT TT=36.441	No data	SAT TT=0.031 ASSIGNMENTS=138 CHECKS=62676	SAT TT=0.05 ASSIGNMENTS=486 CHECKS=232501	SAT TT=0.682	SAT TT=0.039 ASSIGNMENTS=355 CHECKS=83487	SAT TT=0.038 ASSIGNMENTS=159 CHECKS=113302	SAT TT=16.647	No data	SAT TT=1.143	SAT TT=1.631
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-4.xml	SAT TT=0.03	SAT TT=2.398 CHECKS=104644 NODES=50	SAT TT=2.197 CHECKS=84219 NODES=0	SAT TT=0.083	SAT TT=11.144 CHECKS=32294300	SAT TT=17.083 CHECKS=47864200	SAT TT=1.292 ASSIGNMENTS=113	SAT TT=1.529 ASSIGNMENTS=113	SAT TT=1.486 CHECKS=0 NODES=50	SAT TT=1.568 CHECKS=7073320 NODES=4558	SAT TT=1.185 CHECKS=551277 NODES=63	SAT TT=0.04 ASSIGNMENTS=139 CHECKS=64069	SAT TT=0.044 ASSIGNMENTS=139 CHECKS=64069	SAT TT=893.772	SAT TT=33.08	No data	SAT TT=0.03 ASSIGNMENTS=139 CHECKS=65956	SAT TT=0.031 ASSIGNMENTS=204 CHECKS=70908	SAT TT=0.677	SAT TT=0.031 ASSIGNMENTS=283 CHECKS=53377	SAT TT=0.035 ASSIGNMENTS=149 CHECKS=103651	SAT TT=16.119	No data	SAT TT=1.04	SAT TT=1.779
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-5.xml	SAT TT=0.028	SAT TT=2.308 CHECKS=104129 NODES=50	SAT TT=2.434 CHECKS=86199 NODES=0	SAT TT=0.091	SAT TT=0.417 CHECKS=9800	SAT TT=0.025 CHECKS=9865	SAT TT=1.354 ASSIGNMENTS=117	SAT TT=1.351 ASSIGNMENTS=117	SAT TT=1.612 CHECKS=0 NODES=50	SAT TT=60.532 CHECKS=686326000 NODES=451552	SAT TT=1.035 CHECKS=688333 NODES=124	SAT TT=0.041 ASSIGNMENTS=161 CHECKS=62989	SAT TT=0.041 ASSIGNMENTS=161 CHECKS=62989	SAT TT=786.66	SAT TT=35.134	No data	SAT TT=0.033 ASSIGNMENTS=259 CHECKS=91512	SAT TT=0.028 ASSIGNMENTS=144 CHECKS=52459	SAT TT=0.686	SAT TT=0.059 ASSIGNMENTS=755 CHECKS=243102	SAT TT=0.029 ASSIGNMENTS=114 CHECKS=71044	SAT TT=16.326	No data	SAT TT=1.204	SAT TT=1.826
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-6.xml	SAT TT=0.025	SAT TT=2.292 CHECKS=103619 NODES=50	SAT TT=2.604 CHECKS=86530 NODES=0	SAT TT=0.09	SAT TT=0.446 CHECKS=9730	SAT TT=0.024 CHECKS=11623	SAT TT=1.39 ASSIGNMENTS=116	SAT TT=1.327 ASSIGNMENTS=116	SAT TT=1.674 CHECKS=0 NODES=50	SAT TT=1.2 CHECKS=2339320 NODES=1250	SAT TT=1.028 CHECKS=533311 NODES=88	SAT TT=0.038 ASSIGNMENTS=138 CHECKS=31707	SAT TT=0.038 ASSIGNMENTS=138 CHECKS=31707	SAT TT=879.766	SAT TT=37.712	No data	SAT TT=0.025 ASSIGNMENTS=140 CHECKS=31816	SAT TT=0.058 ASSIGNMENTS=783 CHECKS=265931	SAT TT=0.686	SAT TT=0.048 ASSIGNMENTS=574 CHECKS=128469	SAT TT=0.033 ASSIGNMENTS=180 CHECKS=84614	SAT TT=16.496	No data	SAT TT=1.127	SAT TT=1.704
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-7.xml	SAT TT=0.025	SAT TT=2.222 CHECKS=91572 NODES=50	SAT TT=2.137 CHECKS=80628 NODES=0	SAT TT=0.092	SAT TT=0.41 CHECKS=9702	SAT TT=0.023 CHECKS=10346	SAT TT=1.426 ASSIGNMENTS=125	SAT TT=1.324 ASSIGNMENTS=125	SAT TT=1.594 CHECKS=0 NODES=50	SAT TT=1.892 CHECKS=12112400 NODES=7954	SAT TT=0.998 CHECKS=713443 NODES=185	SAT TT=0.037 ASSIGNMENTS=98 CHECKS=27706	SAT TT=0.038 ASSIGNMENTS=98 CHECKS=27706	SAT TT=716.538	SAT TT=34.638	No data	SAT TT=0.025 ASSIGNMENTS=98 CHECKS=27706	SAT TT=0.029 ASSIGNMENTS=132 CHECKS=48777	SAT TT=0.684	SAT TT=0.036 ASSIGNMENTS=436 CHECKS=77954	SAT TT=0.061 ASSIGNMENTS=232 CHECKS=299607	SAT TT=14.498	No data	SAT TT=1.039	SAT TT=1.64
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-8.xml	SAT TT=0.023	SAT TT=2.291 CHECKS=94109 NODES=50	SAT TT=2.446 CHECKS=192745 NODES=0	SAT TT=0.091	SAT TT=11.21 CHECKS=27905800	SAT TT=12.764 CHECKS=36861800	SAT TT=1.481 ASSIGNMENTS=121	SAT TT=1.356 ASSIGNMENTS=121	SAT TT=1.536 CHECKS=0 NODES=50	SAT TT=21.668 CHECKS=240006000 NODES=160378	SAT TT=1.012 CHECKS=929282 NODES=259	SAT TT=0.036 ASSIGNMENTS=79 CHECKS=20925	SAT TT=0.034 ASSIGNMENTS=79 CHECKS=20925	SAT TT=851.612	SAT TT=38.727	No data	SAT TT=0.023 ASSIGNMENTS=79 CHECKS=20925	SAT TT=0.064 ASSIGNMENTS=823 CHECKS=347122	SAT TT=0.685	SAT TT=0.027 ASSIGNMENTS=81 CHECKS=26069	SAT TT=0.039 ASSIGNMENTS=161 CHECKS=152208	SAT TT=15.321	No data	SAT TT=1.051	SAT TT=1.55
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-9.xml	SAT TT=0.024	SAT TT=2.319 CHECKS=86437 NODES=50	SAT TT=2.123 CHECKS=84361 NODES=0	SAT TT=0.089	SAT TT=0.44 CHECKS=11974	SAT TT=0.027 CHECKS=9711	SAT TT=1.301 ASSIGNMENTS=104	SAT TT=1.349 ASSIGNMENTS=104	SAT TT=1.476 CHECKS=0 NODES=50	SAT TT=76.039 CHECKS=880660000 NODES=606307	SAT TT=0.995 CHECKS=884159 NODES=296	SAT TT=0.035 ASSIGNMENTS=110 CHECKS=29061	SAT TT=0.038 ASSIGNMENTS=110 CHECKS=29061	SAT TT=1078.4	SAT TT=37.327	No data	SAT TT=0.024 ASSIGNMENTS=110 CHECKS=29061	SAT TT=0.06 ASSIGNMENTS=700 CHECKS=319023	SAT TT=0.693	SAT TT=0.027 ASSIGNMENTS=102 CHECKS=24513	SAT TT=0.084 ASSIGNMENTS=403 CHECKS=504997	SAT TT=14.353	No data	SAT TT=1.1	SAT TT=1.61
csp/js-taillard-15/ normalized-js-taillard-15-100-0.xml	SAT TT=23.706	? (TO) TT=1800.12	? (TO) TT=1800.21	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1764.46	SAT TT=81.497 ASSIGNMENTS=6212	SAT TT=83.964 ASSIGNMENTS=6212	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=88.241 ASSIGNMENTS=6212	SAT TT=781.014 ASSIGNMENTS=6212	? (problem) TT=60.864	? (problem) TT=65.987	No data	SAT TT=1088.96 ASSIGNMENTS=1108130 CHECKS=396330000	SAT TT=681.411 ASSIGNMENTS=281602 CHECKS=2369390000	? (TO) TT=1800.11	SAT TT=1321.97 ASSIGNMENTS=627550 CHECKS=255820000	SAT TT=759.101 ASSIGNMENTS=337438 CHECKS=2671270000	? TT=283.421	No data	SAT TT=23.706	SAT TT=46.647
csp/js-taillard-15/ normalized-js-taillard-15-100-3.xml	SAT TT=116.43	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=208.878 ASSIGNMENTS=16117	SAT TT=206.424 ASSIGNMENTS=16117	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=295.683 ASSIGNMENTS=16117	SAT TT=901.68 ASSIGNMENTS=16117	? (problem) TT=70.165	? (problem) TT=66.129	No data	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.02	? (exit code) TT=294.01	No data	SAT TT=186.73	SAT TT=116.43
csp/js-taillard-15/ normalized-js-taillard-15-100-6.xml	SAT TT=126.636	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	SAT TT=1388.8 ASSIGNMENTS=116745	SAT TT=1491.67 ASSIGNMENTS=116745	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=1597.57 ASSIGNMENTS=116745	? (TO) TT=1800.1	? (problem) TT=73.782	? (problem) TT=70.892	No data	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.01	? TT=258.971	No data	SAT TT=126.636	SAT TT=128.633
csp/js-taillard-15/ normalized-js-taillard-15-100-8.xml	SAT TT=36.214	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=1699.66 ASSIGNMENTS=130210	SAT TT=1680.81 ASSIGNMENTS=130210	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=1724.29 ASSIGNMENTS=130210	? (TO) TT=1800.02	? (problem) TT=61.317	? (problem) TT=60.547	No data	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.02	? (exit code) TT=274.065	No data	SAT TT=36.214	SAT TT=221.671
csp/js-taillard-15/ normalized-js-taillard-15-105-3.xml	SAT TT=6.687	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=50.846 ASSIGNMENTS=3509	SAT TT=49.494 ASSIGNMENTS=3509	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=148.228 ASSIGNMENTS=3509	SAT TT=743.836 ASSIGNMENTS=3509	? (problem) TT=81.956	? (problem) TT=77.578	No data	SAT TT=1012.29 ASSIGNMENTS=519822 CHECKS=3839240000	SAT TT=49.852 ASSIGNMENTS=19422 CHECKS=170973000	? (TO) TT=1800.07	SAT TT=71.947 ASSIGNMENTS=28242 CHECKS=236235000	SAT TT=203.149 ASSIGNMENTS=99355 CHECKS=750792000	? TT=278.642	No data	SAT TT=6.687	SAT TT=15.493
csp/js-taillard-15/ normalized-js-taillard-15-105-4.xml	SAT TT=9.595	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=11.6 ASSIGNMENTS=445	SAT TT=11.997 ASSIGNMENTS=445	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=109.204 ASSIGNMENTS=445	SAT TT=705.143 ASSIGNMENTS=445	? (problem) TT=73.902	? (problem) TT=78.841	No data	SAT TT=81.37 ASSIGNMENTS=20906 CHECKS=272568000	SAT TT=1364.6 ASSIGNMENTS=628729 CHECKS=491718000	? (TO) TT=1800.05	SAT TT=209.074 ASSIGNMENTS=95613 CHECKS=715911000	SAT TT=619.721 ASSIGNMENTS=285664 CHECKS=2212420000	? (exit code) TT=285.306	No data	SAT TT=9.595	SAT TT=18.29
csp/js-taillard-15/ normalized-js-taillard-15-105-7.xml	SAT TT=14.287	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=23.979 ASSIGNMENTS=1479	SAT TT=25.593 ASSIGNMENTS=1479	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=122.66 ASSIGNMENTS=1479	SAT TT=718.812 ASSIGNMENTS=1479	? (problem) TT=70.608	? (problem) TT=67.301	No data	? (TO) TT=1800.04	SAT TT=67.602 ASSIGNMENTS=80824 CHECKS=264689000	? (TO) TT=1800.1	SAT TT=42.5 ASSIGNMENTS=17310 CHECKS=143199000	? (TO) TT=1800.03	? (exit code) TT=281.677	No data	SAT TT=14.744	SAT TT=14.287
csp/js-taillard-15/ normalized-js-taillard-15-105-8.xml	SAT TT=5.516	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=15.396 ASSIGNMENTS=863	SAT TT=16.597 ASSIGNMENTS=863	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=114.269 ASSIGNMENTS=863	SAT TT=113.957 ASSIGNMENTS=863	? (problem) TT=59.821	? (problem) TT=63.997	No data	? (TO) TT=1800.04	SAT TT=34.263 ASSIGNMENTS=18310 CHECKS=124796000	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? TT=284.138	No data	SAT TT=5.516	SAT TT=15.214
csp/js-taillard-15/ normalized-js-taillard-15-95-2.xml	UNSAT TT=9.068	? (TO) TT=1800.21	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=9.732 ASSIGNMENTS=29	UNSAT TT=9.068 ASSIGNMENTS=29	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=107.298 ASSIGNMENTS=29	UNSAT TT=702.789 ASSIGNMENTS=29	? (problem) TT=58.291	? (problem) TT=58.491	No data	UNSAT TT=18.64 ASSIGNMENTS=5663 CHECKS=62663000	UNSAT TT=28.44 ASSIGNMENTS=13892 CHECKS=97417300	? (TO) TT=1800.1	UNSAT TT=56.93 ASSIGNMENTS=20869 CHECKS=189534000	UNSAT TT=134.55 ASSIGNMENTS=47205 CHECKS=465216000	? TT=334.319	No data	UNSAT TT=10.577	UNSAT TT=14.693
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/js-taillard-15/ normalized-js-taillard-15-95-4.xml	UNSAT TT=11.481	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=29.17 ASSIGNMENTS=1715	UNSAT TT=30.349 ASSIGNMENTS=1715	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=34.116 ASSIGNMENTS=1715	UNSAT TT=722.703 ASSIGNMENTS=1715	? (problem) TT=69.175	? (problem) TT=69.648	No data	UNSAT TT=89.801 ASSIGNMENTS=31069 CHECKS=316158000	UNSAT TT=66.705 ASSIGNMENTS=27985 CHECKS=238038000	? (TO) TT=1800.07	UNSAT TT=182.519 ASSIGNMENTS=63185 CHECKS=622488000	UNSAT TT=127.113 ASSIGNMENTS=40397 CHECKS=416820000	? (exit code) TT=319.838	No data	UNSAT TT=11.481	UNSAT TT=17.881
csp/js-taillard-20-15/ normalized-js-taillard-20-15-100-0.xml		? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (problem) TT=61.491	? (problem) TT=62.145	No data	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (exit code) TT=275.512	No data	? (TO) TT=1800.01	? (TO) TT=1800.01
csp/js-taillard-20-15/ normalized-js-taillard-20-15-100-2.xml		? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.08	? (problem) TT=75.817	? (problem) TT=78.657	No data	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	? TT=270.313	No data	? (TO) TT=1800.08	? (TO) TT=1800.03
csp/js-taillard-20-15/ normalized-js-taillard-20-15-100-4.xml		? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.05	? (problem) TT=63.341	? (problem) TT=65.018	No data	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? TT=271.117	No data	? (TO) TT=1800.03	? (TO) TT=1800.07
csp/js-taillard-20-15/ normalized-js-taillard-20-15-100-8.xml		? (TO) TT=1800.09	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (problem) TT=71.055	? (problem) TT=71.779	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=284.126	No data	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/js-taillard-20-15/ normalized-js-taillard-20-15-105-3.xml	SAT TT=18.894	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=39.096 ASSIGNMENTS=1394	SAT TT=44.243 ASSIGNMENTS=1394	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=46.225 ASSIGNMENTS=1394	SAT TT=574.535 ASSIGNMENTS=1394	? (problem) TT=72.087	? (problem) TT=73.945	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? TT=276.949	No data	SAT TT=18.894	SAT TT=46.635
csp/js-taillard-20-15/ normalized-js-taillard-20-15-105-4.xml	SAT TT=40.559	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=40.559 ASSIGNMENTS=1455	SAT TT=44.684 ASSIGNMENTS=1455	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=49.944 ASSIGNMENTS=1455	SAT TT=575.703 ASSIGNMENTS=1455	? (problem) TT=72.384	? (problem) TT=76.317	No data	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=278.543	No data	SAT TT=182.669	SAT TT=64.086
csp/js-taillard-20-15/ normalized-js-taillard-20-15-105-9.xml	SAT TT=22.005	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=22.005 ASSIGNMENTS=498	SAT TT=22.928 ASSIGNMENTS=498	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=29.537 ASSIGNMENTS=498	SAT TT=553.194 ASSIGNMENTS=498	? (problem) TT=70.87	? (problem) TT=77.582	No data	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=287.418	No data	SAT TT=34.39	SAT TT=42.635
csp/js-taillard-20-15/ normalized-js-taillard-20-15-95-0.xml		? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (problem) TT=66.715	? (problem) TT=67.009	No data	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=274.922	No data	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/js-taillard-20-15/ normalized-js-taillard-20-15-95-2.xml		? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.01	? (problem) TT=80.621	? (problem) TT=86.364	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.05	? (exit code) TT=277.464	No data	? (TO) TT=1800	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/js-taillard-20-15/ normalized-js-taillard-20-15-95-9.xml		? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.03	? (problem) TT=59.587	? (problem) TT=59.691	No data	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.05	? TT=287.704	No data	? (TO) TT=1800.06	? (TO) TT=1800.01
csp/js-taillard-20/ normalized-js-taillard-20-100-0.xml		? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800	? (problem) TT=77.332	? (problem) TT=73.083	No data	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=221.418	No data	? (TO) TT=1800.04	? (TO) TT=1800.02
csp/js-taillard-20/ normalized-js-taillard-20-100-3.xml		? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.08	? (problem) TT=62.498	? (problem) TT=71.759	No data	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.04	? (exit code) TT=230.702	No data	? (TO) TT=1800.04	? (TO) TT=1800.02
csp/js-taillard-20/ normalized-js-taillard-20-100-5.xml		? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (problem) TT=76.096	? (problem) TT=75.735	No data	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=255.671	No data	? (TO) TT=1800.04	? (TO) TT=1800.05
csp/js-taillard-20/ normalized-js-taillard-20-105-3.xml	SAT TT=54.071	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=65.329 ASSIGNMENTS=1704	SAT TT=66.952 ASSIGNMENTS=1704	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=82.569 ASSIGNMENTS=1704	SAT TT=763.635 ASSIGNMENTS=1704	? (problem) TT=72.613	? (problem) TT=72.931	No data	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=226.006	No data	SAT TT=54.071	SAT TT=71.274
csp/js-taillard-20/ normalized-js-taillard-20-105-5.xml	SAT TT=49.897	? (TO) TT=1800.07	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=250.279 ASSIGNMENTS=8096	SAT TT=275.595 ASSIGNMENTS=8096	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=272.904 ASSIGNMENTS=8096	SAT TT=983.94 ASSIGNMENTS=8096	? (problem) TT=71.877	? (problem) TT=71.802	No data	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? TT=216.385	No data	SAT TT=82.794	SAT TT=49.897
csp/js-taillard-20/ normalized-js-taillard-20-105-6.xml	SAT TT=65.503	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=1123.89 ASSIGNMENTS=37727	SAT TT=1140.16 ASSIGNMENTS=37727	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=1247.68 ASSIGNMENTS=37727	SAT TT=1748.12 ASSIGNMENTS=37727	? (problem) TT=70.991	? (problem) TT=76.849	No data	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.03	? TT=215.813	No data	SAT TT=65.503	SAT TT=108.985
csp/js-taillard-20/ normalized-js-taillard-20-105-7.xml	SAT TT=18.977	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT TT=46.449 ASSIGNMENTS=899	SAT TT=54.698 ASSIGNMENTS=899	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=72.834 ASSIGNMENTS=899	SAT TT=748.631 ASSIGNMENTS=899	? (problem) TT=68.554	? (problem) TT=74.855	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=220.666	No data	SAT TT=18.977	SAT TT=38.444
csp/js-taillard-20/ normalized-js-taillard-20-105-8.xml	SAT TT=13.385	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=815.952 ASSIGNMENTS=29994	SAT TT=881.513 ASSIGNMENTS=29994	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=1002.01 ASSIGNMENTS=29994	SAT TT=1618.86 ASSIGNMENTS=29994	? (problem) TT=63.508	? (problem) TT=67.104	No data	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? TT=214.286	No data	SAT TT=13.385	SAT TT=53.228
csp/js-taillard-20/ normalized-js-taillard-20-95-1.xml		? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.09	? (problem) TT=70.073	? (problem) TT=68.395	No data	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=264.221	No data	? (TO) TT=1800.05	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/js-taillard-20/ normalized-js-taillard-20-95-7.xml	UNSAT TT=3.468	? (TO) TT=1800.09	? (TO) TT=1800.22	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=3.468 ASSIGNMENTS=0	UNSAT TT=3.574 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=46.661 ASSIGNMENTS=0	UNSAT TT=699.046 ASSIGNMENTS=0	? (problem) TT=73.258	? (problem) TT=73.489	No data	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.1	? TT=253.883	No data	UNSAT TT=195.777	UNSAT TT=238.584
csp/knights/ normalized-knights-100-25.xml		? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.02	No data	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.04	? TT=1199.4	No data	? (TO) TT=1800.12	? (TO) TT=1800.01
csp/knights/ normalized-knights-12-5.xml	UNSAT TT=0.075	UNSAT TT=0.815 CHECKS=232842 NODES=128	UNSAT TT=0.883 CHECKS=355092 NODES=0	UNSAT TT=0.075	UNSAT TT=2.229 CHECKS=66548	UNSAT TT=0.237 CHECKS=67390	UNSAT TT=0.838 ASSIGNMENTS=0	UNSAT TT=0.789 ASSIGNMENTS=0	UNSAT TT=0.648 CHECKS=435922 NODES=215	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=8.414 ASSIGNMENTS=140 CHECKS=349494	UNSAT TT=8.292 ASSIGNMENTS=140 CHECKS=349494	UNSAT TT=2.351	UNSAT TT=1.997	No data	UNSAT TT=2.488 ASSIGNMENTS=213 CHECKS=3285	UNSAT TT=3.115 ASSIGNMENTS=638 CHECKS=7558	UNSAT TT=4.103	UNSAT TT=2.575 ASSIGNMENTS=143 CHECKS=2758	UNSAT TT=2.483 ASSIGNMENTS=214 CHECKS=3508	UNSAT TT=4.308	No data	UNSAT TT=0.644	UNSAT TT=1.038
csp/knights/ normalized-knights-12-9.xml	UNSAT TT=0.184	UNSAT TT=0.887 CHECKS=586217 NODES=128	UNSAT TT=0.882 CHECKS=757398 NODES=0	UNSAT TT=0.184	UNSAT TT=3.6 CHECKS=116971	UNSAT TT=0.366 CHECKS=179528	UNSAT TT=1.856 ASSIGNMENTS=0	UNSAT TT=2 ASSIGNMENTS=0	UNSAT TT=0.81 CHECKS=899040 NODES=230	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=8.62 ASSIGNMENTS=143 CHECKS=733962	UNSAT TT=8.114 ASSIGNMENTS=143 CHECKS=733962	UNSAT TT=3.752	UNSAT TT=2.776	No data	UNSAT TT=9.02 ASSIGNMENTS=211 CHECKS=7975	UNSAT TT=19.281 ASSIGNMENTS=1160 CHECKS=32779	? (TO) TT=1800.09	UNSAT TT=8.93 ASSIGNMENTS=143 CHECKS=5984	UNSAT TT=10.606 ASSIGNMENTS=214 CHECKS=8089	UNSAT TT=6.936	No data	UNSAT TT=55.213	UNSAT TT=179.107
csp/knights/ normalized-knights-15-9.xml	UNSAT TT=0.548	UNSAT TT=1.07 CHECKS=1911490 NODES=206	UNSAT TT=1.076 CHECKS=2497140 NODES=0	UNSAT TT=0.548	UNSAT TT=10.306 CHECKS=355527	UNSAT TT=1.146 CHECKS=541157	UNSAT TT=4.343 ASSIGNMENTS=0	UNSAT TT=4.254 ASSIGNMENTS=0	UNSAT TT=1.182 CHECKS=3263140 NODES=323	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=8.772 ASSIGNMENTS=221 CHECKS=2399880	UNSAT TT=8.693 ASSIGNMENTS=221 CHECKS=2399880	UNSAT TT=9.313	UNSAT TT=5.422	No data	UNSAT TT=35.351 ASSIGNMENTS=332 CHECKS=12778	UNSAT TT=65.411 ASSIGNMENTS=1842 CHECKS=51955	? (TO) TT=1800.11	UNSAT TT=31.187 ASSIGNMENTS=224 CHECKS=9674	UNSAT TT=35.137 ASSIGNMENTS=335 CHECKS=12893	UNSAT TT=12.105	No data	UNSAT TT=141.26	UNSAT TT=404.132
csp/knights/ normalized-knights-25-5.xml	UNSAT TT=0.826	UNSAT TT=1.808 CHECKS=6742540 NODES=596	UNSAT TT=2.236 CHECKS=10878900 NODES=0	UNSAT TT=0.898	UNSAT TT=52.552 CHECKS=325771	UNSAT TT=5.436 CHECKS=1980860	UNSAT TT=1694.94 ASSIGNMENTS=678385	UNSAT TT=1614.63 ASSIGNMENTS=678385	UNSAT TT=2.647 CHECKS=30628900 NODES=936	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=9.108 ASSIGNMENTS=621 CHECKS=11640700	UNSAT TT=9.284 ASSIGNMENTS=621 CHECKS=11640700	UNSAT TT=57.029	UNSAT TT=18.795	No data	UNSAT TT=198.457 ASSIGNMENTS=934 CHECKS=15114	UNSAT TT=220.292 ASSIGNMENTS=3011 CHECKS=35606	UNSAT TT=25.84	UNSAT TT=211.27 ASSIGNMENTS=624 CHECKS=12872	UNSAT TT=193.105 ASSIGNMENTS=935 CHECKS=16058	UNSAT TT=36.581	No data	UNSAT TT=0.826	UNSAT TT=1.246
csp/knights/ normalized-knights-25-9.xml	UNSAT TT=2.453	UNSAT TT=2.453 CHECKS=16875000 NODES=596	UNSAT TT=2.79 CHECKS=23068500 NODES=0	UNSAT TT=6.765	UNSAT TT=94.589 CHECKS=1187040	UNSAT TT=6.369 CHECKS=3397030	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=5.968 CHECKS=66977300 NODES=969	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=9.928 ASSIGNMENTS=621 CHECKS=25531000	UNSAT TT=9.413 ASSIGNMENTS=621 CHECKS=25531000	UNSAT TT=115.98	UNSAT TT=33.158	No data	UNSAT TT=654.639 ASSIGNMENTS=932 CHECKS=37204	UNSAT TT=884.118 ASSIGNMENTS=1765 CHECKS=57225	? (TO) TT=1800.11	UNSAT TT=604.695 ASSIGNMENTS=624 CHECKS=28474	UNSAT TT=619.106 ASSIGNMENTS=935 CHECKS=37388	UNSAT TT=85.684	No data	UNSAT TT=575.577	? (TO) TT=1800.13
csp/knights/ normalized-knights-50-9.xml	UNSAT TT=27.038	UNSAT TT=27.038 CHECKS=1005120000 NODES=2446	UNSAT TT=36.346 CHECKS=1408930000 NODES=0	UNSAT TT=106.089	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.06	UNSAT TT=190.691 CHECKS=4506580000 NODES=4307	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=63.244 ASSIGNMENTS=2494 CHECKS=1440480000	UNSAT TT=63.37 ASSIGNMENTS=2494 CHECKS=1440480000	? (MO) TT=404.03	? (MO) TT=408.5	No data	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.03	? TT=314.444	No data	? (TO) TT=1800.03	? (TO) TT=1800.12
csp/knights/ normalized-knights-80-25.xml		? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.05	No data	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? TT=494.963	No data	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/knights/ normalized-knights-80-9.xml		? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.09	No data	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.02	? TT=541.08	No data	? (TO) TT=1800.07	? (TO) TT=1800.04
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/knights/ normalized-knights-8-5.xml	UNSAT TT=0.036	UNSAT TT=0.763 CHECKS=24208 NODES=52	UNSAT TT=0.762 CHECKS=33573 NODES=0	UNSAT TT=0.036	UNSAT TT=0.42 CHECKS=13194	UNSAT TT=2.587 CHECKS=923473	UNSAT TT=0.841 ASSIGNMENTS=0	UNSAT TT=0.844 ASSIGNMENTS=0	UNSAT TT=0.567 CHECKS=35956 NODES=95	? (TO) TT=1800	? (TO) TT=1800.09	UNSAT TT=0.276 ASSIGNMENTS=94 CHECKS=1396	UNSAT TT=0.271 ASSIGNMENTS=94 CHECKS=1396	UNSAT TT=1.069	UNSAT TT=1.182	No data	UNSAT TT=0.261 ASSIGNMENTS=93 CHECKS=1385	UNSAT TT=0.344 ASSIGNMENTS=265 CHECKS=3127	UNSAT TT=1.403	UNSAT TT=0.27 ASSIGNMENTS=63 CHECKS=1142	UNSAT TT=0.265 ASSIGNMENTS=94 CHECKS=1488	UNSAT TT=3.355	No data	UNSAT TT=0.75	UNSAT TT=0.64
csp/langford2/ normalized-langford-2-10.xml	UNSAT TT=1.192	UNSAT TT=7.253 CHECKS=8302060 NODES=95782	UNSAT TT=7.393 CHECKS=8309230 NODES=95666	UNSAT TT=1.192	UNSAT TT=82.834 CHECKS=490285000	UNSAT TT=83.114 CHECKS=475605000	UNSAT TT=14.365 ASSIGNMENTS=112954	UNSAT TT=11.686 ASSIGNMENTS=67618	UNSAT TT=7.855 CHECKS=1446730 NODES=61492	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=1.39 ASSIGNMENTS=36820 CHECKS=2299550	UNSAT TT=1.404 ASSIGNMENTS=36820 CHECKS=2299550	UNSAT TT=68.53	UNSAT TT=17.098	No data	UNSAT TT=1.247 ASSIGNMENTS=37026 CHECKS=2342630	UNSAT TT=1.338 ASSIGNMENTS=40020 CHECKS=2480990	UNSAT TT=6.199	UNSAT TT=2.498 ASSIGNMENTS=73647 CHECKS=4600430	UNSAT TT=2.141 ASSIGNMENTS=61169 CHECKS=3777720	UNSAT TT=364.274	No data	UNSAT TT=11.273	UNSAT TT=19.705
csp/langford2/ normalized-langford-2-11.xml	SAT TT=0.013	SAT TT=0.867 CHECKS=6587 NODES=41	SAT TT=0.943 CHECKS=16536 NODES=41	SAT TT=0.055	SAT TT=0.04 CHECKS=29414	SAT TT=0.018 CHECKS=27499	SAT TT=0.966 ASSIGNMENTS=14	SAT TT=1.001 ASSIGNMENTS=29	SAT TT=0.956 CHECKS=6975 NODES=68	SAT TT=1.222 CHECKS=49450 NODES=99	SAT TT=0.959 CHECKS=627046 NODES=788	SAT TT=0.028 ASSIGNMENTS=16 CHECKS=1342	SAT TT=0.024 ASSIGNMENTS=16 CHECKS=1342	SAT TT=1.899	SAT TT=2.082	No data	SAT TT=0.013 ASSIGNMENTS=13 CHECKS=1082	SAT TT=0.016 ASSIGNMENTS=41 CHECKS=3199	SAT TT=0.499	SAT TT=0.016 ASSIGNMENTS=14 CHECKS=1091	SAT TT=0.013 ASSIGNMENTS=16 CHECKS=1351	SAT TT=3.739	No data	SAT TT=0.856	SAT TT=0.917
csp/langford2/ normalized-langford-2-13.xml	UNSAT TT=364.714	? (TO) TT=1800.14	? (TO) TT=1800.11	UNSAT TT=364.714	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=1082.78 ASSIGNMENTS=15456400 CHECKS=1072250000	UNSAT TT=1084.54 ASSIGNMENTS=15456400 CHECKS=1072250000	? (TO) TT=1800	? (TO) TT=1800.11	No data	UNSAT TT=433.005 ASSIGNMENTS=10878000 CHECKS=756156000	UNSAT TT=393.132 ASSIGNMENTS=10682900 CHECKS=736722000	UNSAT TT=1152.95	UNSAT TT=928.323 ASSIGNMENTS=22184000 CHECKS=1616560000	UNSAT TT=582.537 ASSIGNMENTS=15456400 CHECKS=1072250000	? (TO) TT=1800.17	No data	? (TO) TT=1800.05	? (TO) TT=1800.14
csp/langford2/ normalized-langford-2-14.xml		? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.13	No data	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.13	No data	? (TO) TT=1800.08	? (TO) TT=1800.1
csp/langford2/ normalized-langford-2-17.xml		? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.14	No data	? (TO) TT=1800.11	? (TO) TT=1800.07
csp/langford2/ normalized-langford-2-19.xml	SAT TT=0.031	SAT TT=1.169 CHECKS=47249 NODES=122	SAT TT=1.139 CHECKS=86218 NODES=121	SAT TT=0.119	SAT TT=1.099 CHECKS=6400640	SAT TT=1.152 CHECKS=6094220	SAT TT=1.502 ASSIGNMENTS=28	SAT TT=3.062 ASSIGNMENTS=7880	SAT TT=1.563 CHECKS=34374 NODES=86	SAT TT=1.61 CHECKS=1244670 NODES=1126	SAT TT=1.469 CHECKS=349415 NODES=184	SAT TT=0.043 ASSIGNMENTS=34 CHECKS=3346	SAT TT=0.044 ASSIGNMENTS=34 CHECKS=3346	SAT TT=3.806	SAT TT=3.677	No data	SAT TT=0.031 ASSIGNMENTS=36 CHECKS=3650	SAT TT=0.032 ASSIGNMENTS=15 CHECKS=2143	SAT TT=9.495	SAT TT=0.098 ASSIGNMENTS=521 CHECKS=54440	SAT TT=0.039 ASSIGNMENTS=193 CHECKS=16430	SAT TT=5.648	No data	SAT TT=1.384	SAT TT=1.464
csp/langford2/ normalized-langford-2-20.xml	SAT TT=0.035	SAT TT=1.233 CHECKS=92424 NODES=252	SAT TT=1.321 CHECKS=137728 NODES=252	SAT TT=0.122	SAT TT=2.203 CHECKS=13292700	SAT TT=2.538 CHECKS=13317300	SAT TT=1.557 ASSIGNMENTS=55	SAT TT=2.37 ASSIGNMENTS=2721	SAT TT=1.849 CHECKS=49899 NODES=135	SAT TT=1.895 CHECKS=2458250 NODES=2065	SAT TT=1.61 CHECKS=457625 NODES=230	SAT TT=0.047 ASSIGNMENTS=40 CHECKS=4384	SAT TT=0.049 ASSIGNMENTS=40 CHECKS=4384	SAT TT=4.323	SAT TT=4.355	No data	SAT TT=0.036 ASSIGNMENTS=40 CHECKS=4384	SAT TT=0.035 ASSIGNMENTS=23 CHECKS=2870	SAT TT=17.167	SAT TT=0.134 ASSIGNMENTS=713 CHECKS=76941	SAT TT=0.038 ASSIGNMENTS=76 CHECKS=7851	SAT TT=6.8	No data	SAT TT=1.261	SAT TT=1.551
csp/langford2/ normalized-langford-2-25.xml		? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.2	No data	? (TO) TT=1800.01	? (TO) TT=1800.09
csp/langford2/ normalized-langford-2-2.xml	UNSAT TT=0.006	UNSAT TT=0.676 CHECKS=25 NODES=0	UNSAT TT=0.68 CHECKS=25 NODES=0	UNSAT TT=0.025	UNSAT TT=0.008 CHECKS=21	UNSAT TT=0.008 CHECKS=21	UNSAT TT=0.45 ASSIGNMENTS=0	UNSAT TT=0.481 ASSIGNMENTS=0	UNSAT TT=0.421 CHECKS=26 NODES=0	UNSAT TT=0.407 CHECKS=34 NODES=0	UNSAT TT=0.424 CHECKS=34 NODES=0	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.975	UNSAT TT=0.692	No data	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.285	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.883	No data	UNSAT TT=0.453	UNSAT TT=0.452
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/langford2/ normalized-langford-2-30.xml		? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.16	No data	? (TO) TT=1800.08	? (TO) TT=1800.07
csp/langford2/ normalized-langford-2-4.xml	SAT TT=0.007	SAT TT=0.714 CHECKS=240 NODES=8	SAT TT=0.694 CHECKS=240 NODES=0	SAT TT=0.029	SAT TT=0.011 CHECKS=1735	SAT TT=0.008 CHECKS=7133	SAT TT=0.529 ASSIGNMENTS=2	SAT TT=1.153 ASSIGNMENTS=2	SAT TT=0.482 CHECKS=263 NODES=10	SAT TT=0.509 CHECKS=4535 NODES=105	SAT TT=0.54 CHECKS=217772 NODES=2381	SAT TT=0.019 ASSIGNMENTS=2 CHECKS=96	SAT TT=0.019 ASSIGNMENTS=2 CHECKS=96	SAT TT=1.207	SAT TT=1.058	No data	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=96	SAT TT=0.008 ASSIGNMENTS=1 CHECKS=95	SAT TT=0.309	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=133	SAT TT=0.008 ASSIGNMENTS=2 CHECKS=96	SAT TT=0.976	No data	SAT TT=0.518	SAT TT=0.506
csp/langford2/ normalized-langford-2-50.xml		? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	? (MO) TT=1483.11	? (MO) TT=1064.28	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.24	No data	? (TO) TT=1800.03	? (TO) TT=1800.09
csp/langford2/ normalized-langford-2-5.xml	UNSAT TT=0.006	UNSAT TT=0.732 CHECKS=2511 NODES=36	UNSAT TT=0.716 CHECKS=3275 NODES=36	UNSAT TT=0.03	UNSAT TT=0.016 CHECKS=7536	UNSAT TT=0.009 CHECKS=6652	UNSAT TT=0.617 ASSIGNMENTS=8	UNSAT TT=0.642 ASSIGNMENTS=9	UNSAT TT=0.675 CHECKS=1307 NODES=35	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.02 ASSIGNMENTS=17 CHECKS=836	UNSAT TT=0.02 ASSIGNMENTS=17 CHECKS=836	UNSAT TT=0.884	UNSAT TT=0.897	No data	UNSAT TT=0.006 ASSIGNMENTS=15 CHECKS=779	UNSAT TT=0.007 ASSIGNMENTS=16 CHECKS=852	UNSAT TT=0.334	UNSAT TT=0.009 ASSIGNMENTS=46 CHECKS=1755	UNSAT TT=0.008 ASSIGNMENTS=20 CHECKS=980	UNSAT TT=1.437	No data	UNSAT TT=0.592	UNSAT TT=0.533
csp/langford2/ normalized-langford-2-7.xml	SAT TT=0.008	SAT TT=0.807 CHECKS=1221 NODES=15	SAT TT=0.754 CHECKS=2687 NODES=0	SAT TT=0.036	SAT TT=0.02 CHECKS=7154	SAT TT=0.011 CHECKS=4875	SAT TT=0.792 ASSIGNMENTS=4	SAT TT=0.711 ASSIGNMENTS=8	SAT TT=0.671 CHECKS=1172 NODES=19	SAT TT=0.67 CHECKS=32731 NODES=226	SAT TT=1.069 CHECKS=2759890 NODES=6201	SAT TT=0.021 ASSIGNMENTS=3 CHECKS=284	SAT TT=0.021 ASSIGNMENTS=3 CHECKS=284	SAT TT=1.543	SAT TT=1.283	No data	SAT TT=0.008 ASSIGNMENTS=3 CHECKS=284	SAT TT=0.01 ASSIGNMENTS=8 CHECKS=503	SAT TT=0.356	SAT TT=0.012 ASSIGNMENTS=30 CHECKS=1484	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=374	SAT TT=1.624	No data	SAT TT=0.619	SAT TT=0.661
csp/langford2/ normalized-langford-2-8.xml	SAT TT=0.01	SAT TT=0.787 CHECKS=5268 NODES=63	SAT TT=0.868 CHECKS=8832 NODES=63	SAT TT=0.039	SAT TT=0.026 CHECKS=15286	SAT TT=0.013 CHECKS=14851	SAT TT=0.742 ASSIGNMENTS=13	SAT TT=0.788 ASSIGNMENTS=8	SAT TT=0.799 CHECKS=2225 NODES=30	SAT TT=0.781 CHECKS=53755 NODES=282	SAT TT=0.864 CHECKS=12710 NODES=27	SAT TT=0.022 ASSIGNMENTS=13 CHECKS=918	SAT TT=0.022 ASSIGNMENTS=13 CHECKS=918	SAT TT=1.84	SAT TT=1.511	No data	SAT TT=0.011 ASSIGNMENTS=13 CHECKS=946	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=396	SAT TT=0.393	SAT TT=0.012 ASSIGNMENTS=67 CHECKS=3406	SAT TT=0.011 ASSIGNMENTS=13 CHECKS=914	SAT TT=2.131	No data	SAT TT=0.673	SAT TT=0.681
csp/langford3/ normalized-langford-3-10.xml	SAT TT=0.026	SAT TT=1.327 CHECKS=430675 NODES=1480	SAT TT=1.355 CHECKS=455334 NODES=1508	SAT TT=0.109	SAT TT=0.959 CHECKS=5165700	SAT TT=0.7 CHECKS=4143060	SAT TT=1.32 ASSIGNMENTS=378	SAT TT=1.248 ASSIGNMENTS=105	SAT TT=1.172 CHECKS=21923 NODES=146	SAT TT=5.262 CHECKS=29411500 NODES=57184	? (TO) TT=1800.09	SAT TT=0.067 ASSIGNMENTS=336 CHECKS=63773	SAT TT=0.066 ASSIGNMENTS=336 CHECKS=63773	SAT TT=2.654	SAT TT=2.763	No data	SAT TT=0.053 ASSIGNMENTS=335 CHECKS=62877	SAT TT=0.026 ASSIGNMENTS=56 CHECKS=11058	SAT TT=0.808	SAT TT=0.078 ASSIGNMENTS=491 CHECKS=89677	SAT TT=0.143 ASSIGNMENTS=1245 CHECKS=237305	SAT TT=5.346	No data	SAT TT=1.208	SAT TT=1.46
csp/langford3/ normalized-langford-3-11.xml	UNSAT TT=0.88	UNSAT TT=7.225 CHECKS=9951240 NODES=34279	UNSAT TT=7.398 CHECKS=9985230 NODES=34349	UNSAT TT=0.945	UNSAT TT=92.396 CHECKS=525283000	UNSAT TT=102.815 CHECKS=567343000	UNSAT TT=7.949 ASSIGNMENTS=23027	UNSAT TT=8.918 ASSIGNMENTS=23267	UNSAT TT=9.446 CHECKS=3169520 NODES=19411	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.88 ASSIGNMENTS=8186 CHECKS=1577810	UNSAT TT=0.888 ASSIGNMENTS=8186 CHECKS=1577810	UNSAT TT=13.608	UNSAT TT=13.103	No data	UNSAT TT=0.925 ASSIGNMENTS=8218 CHECKS=1587330	UNSAT TT=1.289 ASSIGNMENTS=11503 CHECKS=2184580	UNSAT TT=3.984	UNSAT TT=2.99 ASSIGNMENTS=27411 CHECKS=5212290	UNSAT TT=1.534 ASSIGNMENTS=13775 CHECKS=2652040	UNSAT TT=155.457	No data	UNSAT TT=11.445	UNSAT TT=12.662
csp/langford3/ normalized-langford-3-12.xml	UNSAT TT=3.945	UNSAT TT=31.016 CHECKS=46124200 NODES=153737	UNSAT TT=30.531 CHECKS=46169400 NODES=153762	UNSAT TT=3.945	UNSAT TT=375.462 CHECKS=2321330000	UNSAT TT=407.061 CHECKS=2245260000	UNSAT TT=26.657 ASSIGNMENTS=90137	UNSAT TT=28.396 ASSIGNMENTS=74336	UNSAT TT=66.393 CHECKS=20081000 NODES=81778	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=35.393 ASSIGNMENTS=153737 CHECKS=46124200	UNSAT TT=35.031 ASSIGNMENTS=153737 CHECKS=46124200	UNSAT TT=209.475	UNSAT TT=92.37	No data	UNSAT TT=4.134 ASSIGNMENTS=34675 CHECKS=7114670	UNSAT TT=4.471 ASSIGNMENTS=38052 CHECKS=7767450	UNSAT TT=18.353	UNSAT TT=13.007 ASSIGNMENTS=105689 CHECKS=22446300	UNSAT TT=6.199 ASSIGNMENTS=51872 CHECKS=10659200	UNSAT TT=1502.82	No data	UNSAT TT=85.49	UNSAT TT=82.731
csp/langford3/ normalized-langford-3-13.xml	UNSAT TT=18.507	UNSAT TT=156.822 CHECKS=237252000 NODES=750737	UNSAT TT=153.211 CHECKS=237232000 NODES=750563	UNSAT TT=18.507	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=117.058 ASSIGNMENTS=400170	UNSAT TT=146.249 ASSIGNMENTS=360818	UNSAT TT=209.299 CHECKS=119771000 NODES=382480	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=149.085 ASSIGNMENTS=750737 CHECKS=237252000	UNSAT TT=149.671 ASSIGNMENTS=750737 CHECKS=237252000	? (TO) TT=1800.08	UNSAT TT=827.471	No data	UNSAT TT=20.403 ASSIGNMENTS=164322 CHECKS=35437500	UNSAT TT=20.677 ASSIGNMENTS=167158 CHECKS=36001200	UNSAT TT=95.162	UNSAT TT=77.834 ASSIGNMENTS=623437 CHECKS=135623000	UNSAT TT=30.852 ASSIGNMENTS=250177 CHECKS=53971200	? (TO) TT=1800.11	No data	UNSAT TT=788.596	UNSAT TT=1059.88
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/langford3/ normalized-langford-3-16.xml		? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.03	No data	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.15	No data	? (TO) TT=1800.13	? (TO) TT=1800.11
csp/langford3/ normalized-langford-3-18.xml	SAT TT=0.52	SAT TT=28.567 CHECKS=40139700 NODES=86840	SAT TT=26.4 CHECKS=40176700 NODES=86651	SAT TT=3.72	SAT TT=10.542 CHECKS=65004100	SAT TT=51.46 CHECKS=272826000	SAT TT=11.796 ASSIGNMENTS=27332	SAT TT=74.74 ASSIGNMENTS=130122	SAT TT=45.722 CHECKS=19529500 NODES=36825	SAT TT=701.332 CHECKS=5319120000 NODES=2973570	? (TO) TT=1800.04	SAT TT=33.607 ASSIGNMENTS=86840 CHECKS=40139700	SAT TT=33.548 ASSIGNMENTS=86840 CHECKS=40139700	SAT TT=7.946	SAT TT=25.245	No data	SAT TT=4.882 ASSIGNMENTS=30291 CHECKS=8635890	SAT TT=0.52 ASSIGNMENTS=2237 CHECKS=598521	SAT TT=13.07	SAT TT=0.76 ASSIGNMENTS=3630 CHECKS=997705	SAT TT=2.589 ASSIGNMENTS=17428 CHECKS=4831400	SAT TT=300.078	No data	SAT TT=12.513	SAT TT=4.98
csp/langford3/ normalized-langford-3-20.xml		? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.02	No data	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.38	No data	? (TO) TT=1800.09	? (TO) TT=1800.16
csp/langford3/ normalized-langford-3-21.xml		? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.01	No data	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	No data	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/langford3/ normalized-langford-3-2.xml	UNSAT TT=0.006	UNSAT TT=0.649 CHECKS=44 NODES=0	UNSAT TT=0.726 CHECKS=44 NODES=0	UNSAT TT=0.028	UNSAT TT=0.008 CHECKS=18	UNSAT TT=0.008 CHECKS=18	UNSAT TT=0.488 ASSIGNMENTS=0	UNSAT TT=0.48 ASSIGNMENTS=0	UNSAT TT=0.427 CHECKS=15 NODES=0	UNSAT TT=0.444 CHECKS=78 NODES=0	UNSAT TT=0.418 CHECKS=78 NODES=0	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=1.027	UNSAT TT=0.76	No data	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.288	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.925	No data	UNSAT TT=0.48	UNSAT TT=0.499
csp/langford3/ normalized-langford-3-3.xml	UNSAT TT=0.006	UNSAT TT=0.676 CHECKS=189 NODES=0	UNSAT TT=0.721 CHECKS=189 NODES=0	UNSAT TT=0.029	UNSAT TT=0.012 CHECKS=203	UNSAT TT=0.007 CHECKS=203	UNSAT TT=0.518 ASSIGNMENTS=0	UNSAT TT=0.613 ASSIGNMENTS=0	UNSAT TT=0.522 CHECKS=200 NODES=0	UNSAT TT=0.515 CHECKS=358 NODES=0	UNSAT TT=0.542 CHECKS=358 NODES=0	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=82	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=82	UNSAT TT=1.082	UNSAT TT=0.919	No data	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=82	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=82	UNSAT TT=0.31	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=82	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=82	UNSAT TT=1.275	No data	UNSAT TT=0.564	UNSAT TT=0.531
csp/langford3/ normalized-langford-3-40.xml		? (TO) TT=1800.2	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.01	? (MO) TT=1182.78	No data	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	? TT=561.598	No data	? (TO) TT=1800.02	? (TO) TT=1800.08
csp/langford3/ normalized-langford-3-5.xml	UNSAT TT=0.009	UNSAT TT=0.768 CHECKS=3135 NODES=12	UNSAT TT=0.863 CHECKS=7462 NODES=0	UNSAT TT=0.038	UNSAT TT=0.025 CHECKS=9334	UNSAT TT=0.011 CHECKS=12337	UNSAT TT=0.669 ASSIGNMENTS=0	UNSAT TT=0.72 ASSIGNMENTS=0	UNSAT TT=0.746 CHECKS=1927 NODES=10	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=0.021 ASSIGNMENTS=5 CHECKS=804	UNSAT TT=0.023 ASSIGNMENTS=5 CHECKS=804	UNSAT TT=1.142	UNSAT TT=0.975	No data	UNSAT TT=0.009 ASSIGNMENTS=5 CHECKS=804	UNSAT TT=0.012 ASSIGNMENTS=6 CHECKS=920	UNSAT TT=0.413	UNSAT TT=0.009 ASSIGNMENTS=18 CHECKS=1802	UNSAT TT=0.01 ASSIGNMENTS=5 CHECKS=804	UNSAT TT=1.718	No data	UNSAT TT=0.693	UNSAT TT=0.687
csp/langford3/ normalized-langford-3-6.xml	UNSAT TT=0.012	UNSAT TT=0.854 CHECKS=10812 NODES=43	UNSAT TT=0.877 CHECKS=16154 NODES=43	UNSAT TT=0.044	UNSAT TT=0.038 CHECKS=37526	UNSAT TT=0.02 CHECKS=42296	UNSAT TT=0.901 ASSIGNMENTS=0	UNSAT TT=0.804 ASSIGNMENTS=0	UNSAT TT=0.966 CHECKS=4712 NODES=35	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=0.024 ASSIGNMENTS=15 CHECKS=2190	UNSAT TT=0.024 ASSIGNMENTS=15 CHECKS=2190	UNSAT TT=1.228	UNSAT TT=1.241	No data	UNSAT TT=0.012 ASSIGNMENTS=15 CHECKS=2257	UNSAT TT=0.012 ASSIGNMENTS=17 CHECKS=2629	UNSAT TT=0.406	UNSAT TT=0.015 ASSIGNMENTS=72 CHECKS=8304	UNSAT TT=0.013 ASSIGNMENTS=15 CHECKS=2190	UNSAT TT=2.042	No data	UNSAT TT=0.909	UNSAT TT=0.77
csp/langford3/ normalized-langford-3-9.xml	SAT TT=0.029	SAT TT=1.116 CHECKS=122460 NODES=439	SAT TT=1.188 CHECKS=145475 NODES=464	SAT TT=0.082	SAT TT=0.273 CHECKS=1254320	SAT TT=0.239 CHECKS=1231570	SAT TT=1.27 ASSIGNMENTS=47	SAT TT=1.204 ASSIGNMENTS=148	SAT TT=1.112 CHECKS=4944 NODES=32	SAT TT=8.558 CHECKS=50477600 NODES=123551	? (TO) TT=1800.01	SAT TT=0.042 ASSIGNMENTS=110 CHECKS=19284	SAT TT=0.039 ASSIGNMENTS=110 CHECKS=19284	SAT TT=2.425	SAT TT=2.392	No data	SAT TT=0.029 ASSIGNMENTS=110 CHECKS=18737	SAT TT=0.033 ASSIGNMENTS=157 CHECKS=24694	SAT TT=0.773	SAT TT=0.044 ASSIGNMENTS=247 CHECKS=39094	SAT TT=0.051 ASSIGNMENTS=329 CHECKS=56553	SAT TT=3.996	No data	SAT TT=1.167	SAT TT=1.043
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/langford4/ normalized-langford-4-11.xml	UNSAT TT=0.287	UNSAT TT=3.274 CHECKS=3540950 NODES=4874	UNSAT TT=3.273 CHECKS=3608040 NODES=4824	UNSAT TT=0.42	UNSAT TT=76.405 CHECKS=438714000	UNSAT TT=74.117 CHECKS=439312000	UNSAT TT=3.329 ASSIGNMENTS=1997	UNSAT TT=3.849 ASSIGNMENTS=2297	UNSAT TT=4.388 CHECKS=1797160 NODES=2660	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.308 ASSIGNMENTS=1085 CHECKS=421132	UNSAT TT=0.321 ASSIGNMENTS=1085 CHECKS=421132	UNSAT TT=4.763	UNSAT TT=5.556	No data	UNSAT TT=0.287 ASSIGNMENTS=1085 CHECKS=420374	UNSAT TT=1.045 ASSIGNMENTS=4370 CHECKS=1610720	UNSAT TT=1.614	UNSAT TT=0.687 ASSIGNMENTS=2547 CHECKS=927686	UNSAT TT=0.457 ASSIGNMENTS=1694 CHECKS=653829	UNSAT TT=50.933	No data	UNSAT TT=3.633	UNSAT TT=3.885
csp/langford4/ normalized-langford-4-12.xml	UNSAT TT=0.924	UNSAT TT=8.389 CHECKS=12397300 NODES=17043	UNSAT TT=8.346 CHECKS=12474400 NODES=17039	UNSAT TT=1.056	UNSAT TT=111.334 CHECKS=644339000	UNSAT TT=107.688 CHECKS=594234000	UNSAT TT=6.429 ASSIGNMENTS=6711	UNSAT TT=12.201 ASSIGNMENTS=11501	UNSAT TT=12.282 CHECKS=6315260 NODES=7914	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=0.939 ASSIGNMENTS=3231 CHECKS=1339270	UNSAT TT=0.934 ASSIGNMENTS=3231 CHECKS=1339270	UNSAT TT=11.216	UNSAT TT=10.849	No data	UNSAT TT=0.924 ASSIGNMENTS=3269 CHECKS=1353120	UNSAT TT=1.823 ASSIGNMENTS=6462 CHECKS=2611750	UNSAT TT=3.891	UNSAT TT=2.996 ASSIGNMENTS=10575 CHECKS=4253700	UNSAT TT=1.487 ASSIGNMENTS=5190 CHECKS=2134220	UNSAT TT=188.915	No data	UNSAT TT=11.746	UNSAT TT=10.733
csp/langford4/ normalized-langford-4-14.xml	UNSAT TT=11.54	UNSAT TT=104.153 CHECKS=180272000 NODES=225947	UNSAT TT=102.354 CHECKS=180438000 NODES=226034	UNSAT TT=11.54	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=60.717 ASSIGNMENTS=86778	UNSAT TT=113.189 ASSIGNMENTS=127155	UNSAT TT=184.683 CHECKS=99379800 NODES=101231	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=110.935 ASSIGNMENTS=225947 CHECKS=180272000	UNSAT TT=110.463 ASSIGNMENTS=225947 CHECKS=180272000	UNSAT TT=502.476	UNSAT TT=523.083	No data	UNSAT TT=12.444 ASSIGNMENTS=41400 CHECKS=19024500	UNSAT TT=13.608 ASSIGNMENTS=44886 CHECKS=20579500	UNSAT TT=61.888	UNSAT TT=55.108 ASSIGNMENTS=204109 CHECKS=87042100	UNSAT TT=19.061 ASSIGNMENTS=64780 CHECKS=29731500	? (TO) TT=1800.15	No data	UNSAT TT=499.393	UNSAT TT=377.969
csp/langford4/ normalized-langford-4-17.xml	UNSAT TT=759.747	? (TO) TT=1800.11	? (TO) TT=1800.09	UNSAT TT=759.747	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.01	No data	UNSAT TT=985.394 ASSIGNMENTS=2930680 CHECKS=1539890000	UNSAT TT=981.587 ASSIGNMENTS=2934720 CHECKS=1542030000	? (TO) TT=1800.12	? (TO) TT=1800.04	UNSAT TT=1259.87 ASSIGNMENTS=4010500 CHECKS=2108980000	? (TO) TT=1800.1	No data	? (TO) TT=1800	? (TO) TT=1800.11
csp/langford4/ normalized-langford-4-18.xml		? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	No data	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.12	No data	? (TO) TT=1800.15	? (TO) TT=1800.06
csp/langford4/ normalized-langford-4-19.xml		? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.03	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.2	No data	? (TO) TT=1800.04	? (TO) TT=1800.07
csp/langford4/ normalized-langford-4-20.xml		? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.2	No data	? (TO) TT=1800	? (TO) TT=1800.09
csp/langford4/ normalized-langford-4-2.xml	UNSAT TT=0.007	UNSAT TT=0.671 CHECKS=89 NODES=0	UNSAT TT=0.7 CHECKS=89 NODES=0	UNSAT TT=0.028	UNSAT TT=0.011 CHECKS=33	UNSAT TT=0.008 CHECKS=33	UNSAT TT=0.59 ASSIGNMENTS=0	UNSAT TT=0.514 ASSIGNMENTS=0	UNSAT TT=0.477 CHECKS=34 NODES=0	UNSAT TT=0.472 CHECKS=215 NODES=0	UNSAT TT=0.527 CHECKS=215 NODES=0	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=25	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=25	UNSAT TT=0.931	UNSAT TT=0.823	No data	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=25	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=25	UNSAT TT=0.308	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=25	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=25	UNSAT TT=1.044	No data	UNSAT TT=0.497	UNSAT TT=0.517
csp/langford4/ normalized-langford-4-30.xml		? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	No data	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.04	? TT=349.357	No data	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/langford4/ normalized-langford-4-3.xml	UNSAT TT=0.006	UNSAT TT=0.737 CHECKS=218 NODES=0	UNSAT TT=0.742 CHECKS=218 NODES=0	UNSAT TT=0.032	UNSAT TT=0.02 CHECKS=72	UNSAT TT=0.011 CHECKS=72	UNSAT TT=0.607 ASSIGNMENTS=0	UNSAT TT=0.666 ASSIGNMENTS=0	UNSAT TT=0.593 CHECKS=52 NODES=0	UNSAT TT=0.625 CHECKS=540 NODES=0	UNSAT TT=0.62 CHECKS=540 NODES=0	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=50	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=50	UNSAT TT=1.169	UNSAT TT=0.829	No data	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=50	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=50	UNSAT TT=0.362	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=50	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=50	UNSAT TT=1.657	No data	UNSAT TT=0.597	UNSAT TT=0.66
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/langford4/ normalized-langford-4-40.xml		? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (MO) TT=1262.45	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	? TT=118.917	No data	? (TO) TT=1800.08	? (TO) TT=1800
csp/langford4/ normalized-langford-4-4.xml	UNSAT TT=0.01	UNSAT TT=0.753 CHECKS=875 NODES=0	UNSAT TT=0.775 CHECKS=875 NODES=0	UNSAT TT=0.04	UNSAT TT=0.027 CHECKS=815	UNSAT TT=0.01 CHECKS=815	UNSAT TT=0.771 ASSIGNMENTS=0	UNSAT TT=0.731 ASSIGNMENTS=0	UNSAT TT=0.756 CHECKS=857 NODES=0	UNSAT TT=0.833 CHECKS=1773 NODES=0	UNSAT TT=0.706 CHECKS=1773 NODES=0	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=224	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=224	UNSAT TT=1.569	UNSAT TT=1.006	No data	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=224	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=224	UNSAT TT=0.438	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=224	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=224	UNSAT TT=1.968	No data	UNSAT TT=0.688	UNSAT TT=0.694
csp/langford4/ normalized-langford-4-5.xml	UNSAT TT=0.011	UNSAT TT=0.831 CHECKS=3255 NODES=1	UNSAT TT=0.816 CHECKS=3285 NODES=0	UNSAT TT=0.05	UNSAT TT=0.035 CHECKS=6858	UNSAT TT=0.014 CHECKS=6934	UNSAT TT=0.784 ASSIGNMENTS=0	UNSAT TT=0.88 ASSIGNMENTS=0	UNSAT TT=0.88 CHECKS=3147 NODES=4	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=0.024 ASSIGNMENTS=1 CHECKS=806	UNSAT TT=0.025 ASSIGNMENTS=1 CHECKS=806	UNSAT TT=1.191	UNSAT TT=1.175	No data	UNSAT TT=0.012 ASSIGNMENTS=1 CHECKS=806	UNSAT TT=0.013 ASSIGNMENTS=2 CHECKS=891	UNSAT TT=0.528	UNSAT TT=0.011 ASSIGNMENTS=12 CHECKS=2217	UNSAT TT=0.014 ASSIGNMENTS=1 CHECKS=806	UNSAT TT=2.085	No data	UNSAT TT=0.776	UNSAT TT=0.809
csp/langford4/ normalized-langford-4-8.xml	UNSAT TT=0.029	UNSAT TT=1.144 CHECKS=107341 NODES=172	UNSAT TT=1.149 CHECKS=139296 NODES=172	UNSAT TT=0.096	UNSAT TT=0.147 CHECKS=469450	UNSAT TT=0.1 CHECKS=456513	UNSAT TT=1.355 ASSIGNMENTS=19	UNSAT TT=1.276 ASSIGNMENTS=22	UNSAT TT=1.283 CHECKS=28080 NODES=113	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=0.042 ASSIGNMENTS=38 CHECKS=12609	UNSAT TT=0.041 ASSIGNMENTS=38 CHECKS=12609	UNSAT TT=1.974	UNSAT TT=2.272	No data	UNSAT TT=0.029 ASSIGNMENTS=38 CHECKS=12605	UNSAT TT=0.038 ASSIGNMENTS=107 CHECKS=29706	UNSAT TT=0.633	UNSAT TT=0.055 ASSIGNMENTS=176 CHECKS=44518	UNSAT TT=0.032 ASSIGNMENTS=38 CHECKS=12642	UNSAT TT=4.686	No data	UNSAT TT=1.131	UNSAT TT=1.164
csp/langford4/ normalized-langford-4-9.xml	UNSAT TT=0.048	UNSAT TT=1.36 CHECKS=310918 NODES=384	UNSAT TT=1.292 CHECKS=350777 NODES=396	UNSAT TT=0.119	UNSAT TT=0.741 CHECKS=4143060	UNSAT TT=0.802 CHECKS=4812750	UNSAT TT=1.383 ASSIGNMENTS=40	UNSAT TT=1.595 ASSIGNMENTS=205	UNSAT TT=1.51 CHECKS=116307 NODES=194	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.063 ASSIGNMENTS=107 CHECKS=38109	UNSAT TT=0.061 ASSIGNMENTS=107 CHECKS=38109	UNSAT TT=2.5	UNSAT TT=2.281	No data	UNSAT TT=0.048 ASSIGNMENTS=90 CHECKS=33757	UNSAT TT=0.077 ASSIGNMENTS=247 CHECKS=78361	UNSAT TT=0.728	UNSAT TT=0.103 ASSIGNMENTS=360 CHECKS=109655	UNSAT TT=0.052 ASSIGNMENTS=128 CHECKS=45891	UNSAT TT=6.969	No data	UNSAT TT=1.173	UNSAT TT=1.277
csp/langford/ normalized-langford-2-4-ext.xml	SAT TT=0.005	SAT TT=0.669 CHECKS=242 NODES=8	SAT TT=0.704 CHECKS=242 NODES=0	SAT TT=0.029	SAT TT=0.011 CHECKS=3422	SAT TT=0.011 CHECKS=2609	SAT TT=0.395 ASSIGNMENTS=2	SAT TT=0.412 ASSIGNMENTS=2	SAT TT=0.315 CHECKS=270 NODES=10	SAT TT=0.324 CHECKS=2762 NODES=55	SAT TT=0.325 CHECKS=32159 NODES=349	SAT TT=0.017 ASSIGNMENTS=2 CHECKS=200	SAT TT=0.018 ASSIGNMENTS=2 CHECKS=200	SAT TT=0.809	SAT TT=0.812	No data	SAT TT=0.006 ASSIGNMENTS=2 CHECKS=200	SAT TT=0.008 ASSIGNMENTS=2 CHECKS=192	SAT TT=0.274	SAT TT=0.005 ASSIGNMENTS=2 CHECKS=226	SAT TT=0.008 ASSIGNMENTS=2 CHECKS=200	SAT TT=0.715	SAT TT=0.009 ASSIGNMENTS=10 CHECKS=1024	SAT TT=0.503	SAT TT=0.499
csp/langford/ normalized-langford-3-11-ext.xml	UNSAT TT=1.162	UNSAT TT=7.291 CHECKS=10053800 NODES=34361	UNSAT TT=7.19 CHECKS=10075500 NODES=34337	UNSAT TT=2.278	UNSAT TT=77.72 CHECKS=38638200	UNSAT TT=83.566 CHECKS=60527400	UNSAT TT=2.831 ASSIGNMENTS=4009	UNSAT TT=5.009 ASSIGNMENTS=7542	UNSAT TT=9.355 CHECKS=3182420 NODES=19411	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=1.203 ASSIGNMENTS=8266 CHECKS=7322500	UNSAT TT=1.214 ASSIGNMENTS=8266 CHECKS=7322500	UNSAT TT=13.894	UNSAT TT=11.687	No data	UNSAT TT=1.174 ASSIGNMENTS=8211 CHECKS=7306140	UNSAT TT=1.602 ASSIGNMENTS=11454 CHECKS=10053200	UNSAT TT=128.27	UNSAT TT=1.162 ASSIGNMENTS=8504 CHECKS=7670600	UNSAT TT=1.168 ASSIGNMENTS=8266 CHECKS=7322500	UNSAT TT=38.073	UNSAT TT=37.46 ASSIGNMENTS=38939 CHECKS=51069000	UNSAT TT=10.274	UNSAT TT=12.742
csp/langford/ normalized-langford-3-9-ext.xml	SAT TT=0.019	SAT TT=0.954 CHECKS=123859 NODES=438	SAT TT=0.977 CHECKS=140446 NODES=432	SAT TT=0.088	SAT TT=1.919 CHECKS=1011290	SAT TT=0.121 CHECKS=61258	SAT TT=0.808 ASSIGNMENTS=47	SAT TT=0.815 ASSIGNMENTS=93	SAT TT=0.555 CHECKS=5001 NODES=32	SAT TT=0.784 CHECKS=1932420 NODES=4662	? (TO) TT=1800.03	SAT TT=0.04 ASSIGNMENTS=110 CHECKS=81976	SAT TT=0.039 ASSIGNMENTS=110 CHECKS=81976	SAT TT=1.94	SAT TT=1.838	No data	SAT TT=0.03 ASSIGNMENTS=110 CHECKS=81548	SAT TT=0.019 ASSIGNMENTS=21 CHECKS=14078	SAT TT=0.61	SAT TT=0.048 ASSIGNMENTS=249 CHECKS=236445	SAT TT=0.028 ASSIGNMENTS=110 CHECKS=81976	SAT TT=1.696	SAT TT=0.144 ASSIGNMENTS=47 CHECKS=59638	SAT TT=1.102	SAT TT=1.25
csp/langford/ normalized-slangford-3-11-ext.xml	UNSAT TT=1.246	UNSAT TT=7.164 CHECKS=10089200 NODES=34311	UNSAT TT=7.188 CHECKS=10107900 NODES=34344	UNSAT TT=2.366	UNSAT TT=291.228 CHECKS=132919000	UNSAT TT=89.689 CHECKS=48258100	UNSAT TT=3.31 ASSIGNMENTS=4019	UNSAT TT=6.048 ASSIGNMENTS=7542	UNSAT TT=9.424 CHECKS=3191300 NODES=19411	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=1.36 ASSIGNMENTS=8213 CHECKS=7771110	UNSAT TT=1.246 ASSIGNMENTS=8213 CHECKS=7771110	UNSAT TT=13.656	UNSAT TT=19.671	No data	UNSAT TT=1.345 ASSIGNMENTS=8273 CHECKS=7820000	UNSAT TT=1.852 ASSIGNMENTS=11450 CHECKS=10681500	UNSAT TT=145.631	UNSAT TT=1.397 ASSIGNMENTS=8465 CHECKS=8144540	UNSAT TT=1.31 ASSIGNMENTS=8213 CHECKS=7771110	UNSAT TT=37.618	UNSAT TT=41.949 ASSIGNMENTS=50339 CHECKS=65965600	UNSAT TT=11.155	UNSAT TT=14.969
csp/lard/ normalized-lard-83-83.xml	SAT TT=10.523	SAT TT=15.563 CHECKS=628603 NODES=83	SAT TT=16.663 CHECKS=609336 NODES=0	? (problem) TT=295.569	? TT=25.698	? TT=23.439	SAT TT=16.305 ASSIGNMENTS=84	SAT TT=16.005 ASSIGNMENTS=84	SAT TT=53.668 CHECKS=297801 NODES=83	SAT TT=49.869 CHECKS=598266 NODES=4	SAT TT=52.744 CHECKS=615327 NODES=5	SAT TT=11.635 ASSIGNMENTS=83 CHECKS=13842	SAT TT=11.774 ASSIGNMENTS=83 CHECKS=13842	? (problem) TT=133.439	? (problem) TT=133.725	No data	SAT TT=11.564 ASSIGNMENTS=83 CHECKS=13842	SAT TT=11.227 ASSIGNMENTS=83 CHECKS=14089	? (exit code) TT=29.978	SAT TT=11.446 ASSIGNMENTS=83 CHECKS=20092	SAT TT=10.523 ASSIGNMENTS=83 CHECKS=13842	SAT TT=56.082	SAT TT=32.246 ASSIGNMENTS=83 CHECKS=432750	? (MO) TT=25.38	? (MO) TT=24.65
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lard/ normalized-lard-84-84.xml	SAT TT=11.147	SAT TT=16.266 CHECKS=642809 NODES=84	SAT TT=16.113 CHECKS=609986 NODES=0	? (problem) TT=309.616	? TT=24.217	? TT=27.203	SAT TT=15.315 ASSIGNMENTS=85	SAT TT=15.726 ASSIGNMENTS=85	SAT TT=56.9 CHECKS=305592 NODES=84	SAT TT=51.775 CHECKS=599734 NODES=0	SAT TT=51.145 CHECKS=599734 NODES=0	SAT TT=12.337 ASSIGNMENTS=84 CHECKS=14093	SAT TT=12.203 ASSIGNMENTS=84 CHECKS=14093	? (problem) TT=172.57	? (problem) TT=196.036	No data	SAT TT=12.085 ASSIGNMENTS=84 CHECKS=14093	SAT TT=11.985 ASSIGNMENTS=84 CHECKS=14706	? (exit code) TT=27.739	SAT TT=11.147 ASSIGNMENTS=61 CHECKS=14025	SAT TT=12.077 ASSIGNMENTS=84 CHECKS=14093	SAT TT=53.751	SAT TT=34.263 ASSIGNMENTS=84 CHECKS=436939	? (MO) TT=25.881	? (MO) TT=27.097
csp/lard/ normalized-lard-85-85.xml	SAT TT=11.518	SAT TT=16.662 CHECKS=671476 NODES=85	SAT TT=16.891 CHECKS=655479 NODES=0	? (problem) TT=325.392	? TT=26.619	? TT=30.397	SAT TT=16.562 ASSIGNMENTS=86	SAT TT=16.287 ASSIGNMENTS=86	SAT TT=58.273 CHECKS=319416 NODES=85	SAT TT=54.862 CHECKS=641534 NODES=4	SAT TT=58.984 CHECKS=652287 NODES=4	SAT TT=12.516 ASSIGNMENTS=85 CHECKS=14456	SAT TT=12.479 ASSIGNMENTS=85 CHECKS=14456	? (problem) TT=299.59	? (problem) TT=280.807	No data	SAT TT=12.13 ASSIGNMENTS=85 CHECKS=14456	SAT TT=11.725 ASSIGNMENTS=85 CHECKS=14842	? (exit code) TT=30.806	SAT TT=11.518 ASSIGNMENTS=85 CHECKS=21086	SAT TT=12.839 ASSIGNMENTS=85 CHECKS=14456	SAT TT=59.26	SAT TT=33.244 ASSIGNMENTS=85 CHECKS=589557	? (MO) TT=26.741	? (MO) TT=26.135
csp/lard/ normalized-lard-86-86.xml	SAT TT=12.162	SAT TT=18.713 CHECKS=640681 NODES=86	SAT TT=17.579 CHECKS=599048 NODES=0	? (problem) TT=351.267	? TT=28.277	? TT=27.203	SAT TT=17.375 ASSIGNMENTS=87	SAT TT=17.191 ASSIGNMENTS=87	SAT TT=59.538 CHECKS=327592 NODES=86	SAT TT=56.426 CHECKS=643685 NODES=0	SAT TT=60.952 CHECKS=650920 NODES=1	SAT TT=12.25 ASSIGNMENTS=86 CHECKS=14846	SAT TT=13.362 ASSIGNMENTS=86 CHECKS=14846	? (problem) TT=314.993	? (problem) TT=316.768	No data	SAT TT=13.188 ASSIGNMENTS=86 CHECKS=14846	SAT TT=12.3 ASSIGNMENTS=86 CHECKS=15512	? (exit code) TT=30.537	SAT TT=12.785 ASSIGNMENTS=56 CHECKS=14703	SAT TT=12.162 ASSIGNMENTS=86 CHECKS=14846	SAT TT=60.622	SAT TT=34.721 ASSIGNMENTS=86 CHECKS=470679	? (MO) TT=26.17	? (MO) TT=28.9
csp/lard/ normalized-lard-87-87.xml	SAT TT=12.728	SAT TT=18.288 CHECKS=725372 NODES=87	SAT TT=20.009 CHECKS=706304 NODES=0	? (problem) TT=363.089	? (TO) TT=24.566	Signal TT=25.396	SAT TT=22.495 ASSIGNMENTS=88	SAT TT=21.307 ASSIGNMENTS=88	SAT TT=67.48 CHECKS=342220 NODES=87	SAT TT=58.472 CHECKS=672515 NODES=0	SAT TT=59.423 CHECKS=672458 NODES=0	SAT TT=13.384 ASSIGNMENTS=87 CHECKS=15174	SAT TT=13.451 ASSIGNMENTS=87 CHECKS=15174	? (problem) TT=289.819	? (problem) TT=301.382	No data	SAT TT=12.728 ASSIGNMENTS=87 CHECKS=15174	SAT TT=13.484 ASSIGNMENTS=87 CHECKS=15464	? (exit code) TT=31.218	SAT TT=13.774 ASSIGNMENTS=87 CHECKS=22104	SAT TT=13.504 ASSIGNMENTS=87 CHECKS=15174	SAT TT=61.736	SAT TT=36.457 ASSIGNMENTS=87 CHECKS=632744	? (MO) TT=27.135	? (MO) TT=28.132
csp/lard/ normalized-lard-88-88.xml	SAT TT=13.17	SAT TT=20.038 CHECKS=670262 NODES=88	SAT TT=20.452 CHECKS=627361 NODES=0	? (problem) TT=367.094	Signal TT=23.602	Signal TT=22.94	SAT TT=26.012 ASSIGNMENTS=89	SAT TT=24.133 ASSIGNMENTS=89	SAT TT=66.564 CHECKS=349356 NODES=88	SAT TT=64.168 CHECKS=687981 NODES=0	SAT TT=62.006 CHECKS=687981 NODES=0	SAT TT=13.299 ASSIGNMENTS=88 CHECKS=15562	SAT TT=13.17 ASSIGNMENTS=88 CHECKS=15562	? (problem) TT=571.502	? (problem) TT=633.913	No data	SAT TT=13.184 ASSIGNMENTS=88 CHECKS=15562	SAT TT=14.142 ASSIGNMENTS=88 CHECKS=16235	? (exit code) TT=50.31	SAT TT=14.175 ASSIGNMENTS=50 CHECKS=15397	SAT TT=14.101 ASSIGNMENTS=88 CHECKS=15562	SAT TT=63.815	SAT TT=38.139 ASSIGNMENTS=88 CHECKS=646732	? (MO) TT=31.88	? (MO) TT=30.05
csp/lard/ normalized-lard-89-89.xml	SAT TT=13.695	SAT TT=19.59 CHECKS=775225 NODES=89	SAT TT=21.185 CHECKS=747565 NODES=0	? (problem) TT=388.757	Signal TT=118.981	Signal TT=20.862	SAT TT=40.868 ASSIGNMENTS=90	SAT TT=38.386 ASSIGNMENTS=90	SAT TT=73.607 CHECKS=366451 NODES=89	SAT TT=66.924 CHECKS=720327 NODES=0	SAT TT=65.288 CHECKS=735912 NODES=2	SAT TT=14.679 ASSIGNMENTS=89 CHECKS=15958	SAT TT=13.695 ASSIGNMENTS=89 CHECKS=15958	? (problem) TT=400.038	? (problem) TT=339.473	No data	SAT TT=14.659 ASSIGNMENTS=89 CHECKS=15958	SAT TT=13.753 ASSIGNMENTS=89 CHECKS=16680	? (exit code) TT=48.914	SAT TT=14.864 ASSIGNMENTS=89 CHECKS=23146	SAT TT=14.354 ASSIGNMENTS=89 CHECKS=15958	SAT TT=68.565	SAT TT=44.124 ASSIGNMENTS=89 CHECKS=533554	? (MO) TT=30.274	? (MO) TT=31.06
csp/lard/ normalized-lard-90-90.xml	SAT TT=14.5	SAT TT=21.226 CHECKS=780902 NODES=90	SAT TT=20.989 CHECKS=748192 NODES=0	? (problem) TT=406.213	Signal TT=20.87	Signal TT=21.99	? (problem) TT=43.908	? (problem) TT=44.657	SAT TT=73.008 CHECKS=375270 NODES=90	SAT TT=70.671 CHECKS=737295 NODES=0	SAT TT=71.24 CHECKS=737265 NODES=0	SAT TT=16.186 ASSIGNMENTS=90 CHECKS=16212	SAT TT=16.174 ASSIGNMENTS=90 CHECKS=16212	? (problem) TT=333.485	? (problem) TT=359.541	No data	SAT TT=15.742 ASSIGNMENTS=90 CHECKS=16212	SAT TT=14.983 ASSIGNMENTS=90 CHECKS=16676	? (exit code) TT=76.738	SAT TT=15.814 ASSIGNMENTS=54 CHECKS=16107	SAT TT=14.5 ASSIGNMENTS=90 CHECKS=16212	SAT TT=74.997	SAT TT=42.119 ASSIGNMENTS=90 CHECKS=546118	? TT=125.776	? (MO) TT=29.433
csp/lard/ normalized-lard-91-91.xml	SAT TT=15.352	SAT TT=23.42 CHECKS=829260 NODES=91	SAT TT=21.496 CHECKS=805112 NODES=0	? (problem) TT=425.316	? TT=13.181	? TT=12.196	? (problem) TT=48.88	? (problem) TT=51.644	SAT TT=77.897 CHECKS=391143 NODES=91	SAT TT=69.713 CHECKS=769107 NODES=0	SAT TT=71.294 CHECKS=769107 NODES=0	SAT TT=15.352 ASSIGNMENTS=91 CHECKS=16615	SAT TT=16.702 ASSIGNMENTS=91 CHECKS=16615	? (problem) TT=345.317	? (problem) TT=370.751	No data	SAT TT=15.489 ASSIGNMENTS=91 CHECKS=16615	SAT TT=16.587 ASSIGNMENTS=91 CHECKS=17157	? (exit code) TT=44.852	SAT TT=16.54 ASSIGNMENTS=91 CHECKS=24212	SAT TT=16.6 ASSIGNMENTS=91 CHECKS=16615	? TT=133.401	SAT TT=44.893 ASSIGNMENTS=91 CHECKS=725354	? (MO) TT=30.84	? (MO) TT=32.53
csp/lard/ normalized-lard-92-92.xml	SAT TT=16.101	SAT TT=24.186 CHECKS=752761 NODES=92	SAT TT=22.337 CHECKS=695792 NODES=0	? (problem) TT=438.335	? TT=12.767	? TT=13.947	? (problem) TT=43.914	? (problem) TT=48.391	SAT TT=77.563 CHECKS=400632 NODES=92	SAT TT=78.28 CHECKS=787960 NODES=0	SAT TT=73.802 CHECKS=796293 NODES=1	SAT TT=16.359 ASSIGNMENTS=92 CHECKS=17048	SAT TT=17.107 ASSIGNMENTS=92 CHECKS=17048	? (problem) TT=290.549	? (problem) TT=298.832	No data	SAT TT=17.147 ASSIGNMENTS=92 CHECKS=17048	SAT TT=17.444 ASSIGNMENTS=92 CHECKS=18138	? (exit code) TT=58.912	SAT TT=16.101 ASSIGNMENTS=53 CHECKS=16833	SAT TT=16.936 ASSIGNMENTS=92 CHECKS=17048	? TT=131.126	SAT TT=48.858 ASSIGNMENTS=92 CHECKS=575005	? (MO) TT=34.66	? (MO) TT=33.33
csp/largeQueens/ normalized-queens-1000.xml		? (MO) TT=195.063	? (MO) TT=190.497	? (problem) TT=114.741	? TT=41.426	? TT=1408.4	? (TO) TT=1802.18	? (TO) TT=1802.18	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.06	? (problem) TT=1651.78	? (TO) TT=1800.09	? (TO) TT=1800.03	No data	? (TO) TT=1800.17	? (TO) TT=1800.09	? (exit code) TT=879.604	? (TO) TT=1800.16	? (TO) TT=1800.16	? TT=214.851	No data	? TT=329.86	? TT=349.209
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/largeQueens/ normalized-queens-300.xml	SAT TT=10.921	SAT TT=47.667 CHECKS=60271000 NODES=764	SAT TT=48.538 CHECKS=60271000 NODES=764	SAT TT=10.921	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.14	? TT=1094.35	? (TO) TT=1078.44	? (TO) TT=1095.6	? (TO) TT=1800.04	SAT TT=96.78 ASSIGNMENTS=3857 CHECKS=192532000	? (MO) TT=1293.4	? (MO) TT=1278.05	No data	? (TO) TT=1800.09	SAT TT=381.094 ASSIGNMENTS=283 CHECKS=8146680	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.04	? TT=538.817	No data	? (MO) TT=148.413	? (MO) TT=335.366
csp/largeQueens/ normalized-queens-400.xml	SAT TT=20.094	? (TO) TT=1800.15	? (TO) TT=1800.15	SAT TT=20.094	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.25	? (TO) TT=1800.25	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	SAT TT=1163.14 ASSIGNMENTS=386 CHECKS=19469000	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.1	? TT=217.91	No data	? TT=198.9	? TT=182.026
csp/largeQueens/ normalized-queens-500.xml	SAT TT=47.463	? (TO) TT=1800.18	? (TO) TT=1800.17	SAT TT=47.463	? TT=798.022	? (TO) TT=1800.13	? (MO) TT=147.012	? (MO) TT=168.129	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? TT=217.806	No data	? TT=211.551	? TT=197.264
csp/largeQueens/ normalized-queens-800.xml		? (MO) TT=58.382	? (MO) TT=57.752	? (TO) TT=1800.15	Signal TT=44.892	? TT=568.455	? (TO) TT=1802.22	? (TO) TT=1802.19	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.09	No data	? (TO) TT=1800.06	? (TO) TT=1800.08	? (exit code) TT=207.864	? (TO) TT=1800.14	? (TO) TT=1800.06	? TT=243.976	No data	? (MO) TT=6.299	? TT=139.476
csp/latinSquare/ normalized-latinSquare-dg-10_all.xml	UNSAT TT=1.398	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.13	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.18	No data	UNSAT TT=1.398	UNSAT TT=1.703
csp/latinSquare/ normalized-latinSquare-dg-11_all.xml	SAT TT=1.27	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.11	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.14	No data	SAT TT=1.27	? (TO) TT=1800.06
csp/latinSquare/ normalized-latinSquare-dg-12_all.xml	UNSAT TT=1.744	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.2	No data	UNSAT TT=1.744	UNSAT TT=2.523
csp/latinSquare/ normalized-latinSquare-dg-3_all.xml	UNSAT TT=0.006	UNSAT TT=0.663 CHECKS=0 NODES=2	UNSAT TT=0.615 CHECKS=0 NODES=0	UNSAT TT=0.023	UNSAT TT=0.008 CHECKS=18	UNSAT TT=0.009 CHECKS=18	UNSAT TT=0.382 ASSIGNMENTS=4	UNSAT TT=0.397 ASSIGNMENTS=4	No data	No data	No data	UNSAT TT=0.015 ASSIGNMENTS=3 CHECKS=102	UNSAT TT=0.017 ASSIGNMENTS=3 CHECKS=102	No data	No data	No data	UNSAT TT=0.006 ASSIGNMENTS=3 CHECKS=102	UNSAT TT=0.007 ASSIGNMENTS=2 CHECKS=83	UNSAT TT=0.255	UNSAT TT=0.007 ASSIGNMENTS=5 CHECKS=122	UNSAT TT=0.007 ASSIGNMENTS=3 CHECKS=98	UNSAT TT=0.696	No data	UNSAT TT=0.49	UNSAT TT=0.485
csp/latinSquare/ normalized-latinSquare-dg-4_all.xml	UNSAT TT=0.005	UNSAT TT=0.639 CHECKS=0 NODES=3	UNSAT TT=0.61 CHECKS=0 NODES=0	UNSAT TT=0.026	UNSAT TT=0.007 CHECKS=39	UNSAT TT=0.01 CHECKS=39	UNSAT TT=0.376 ASSIGNMENTS=0	UNSAT TT=0.368 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.019 ASSIGNMENTS=9 CHECKS=364	UNSAT TT=0.019 ASSIGNMENTS=9 CHECKS=364	No data	No data	No data	UNSAT TT=0.008 ASSIGNMENTS=9 CHECKS=366	UNSAT TT=0.006 ASSIGNMENTS=6 CHECKS=318	UNSAT TT=0.259	UNSAT TT=0.005 ASSIGNMENTS=18 CHECKS=637	UNSAT TT=0.006 ASSIGNMENTS=9 CHECKS=406	UNSAT TT=0.731	No data	UNSAT TT=0.586	UNSAT TT=0.566
csp/latinSquare/ normalized-latinSquare-dg-5_all.xml	SAT TT=0.006	SAT TT=0.689 CHECKS=26 NODES=27	SAT TT=0.659 CHECKS=26 NODES=0	SAT TT=0.028	SAT TT=0.013 CHECKS=3279	SAT TT=0.012 CHECKS=1868	SAT TT=0.508 ASSIGNMENTS=6	SAT TT=0.575 ASSIGNMENTS=6	No data	No data	No data	SAT TT=0.017 ASSIGNMENTS=5 CHECKS=542	SAT TT=0.018 ASSIGNMENTS=5 CHECKS=542	No data	No data	No data	SAT TT=0.007 ASSIGNMENTS=5 CHECKS=542	SAT TT=0.006 ASSIGNMENTS=5 CHECKS=533	SAT TT=0.265	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=529	SAT TT=0.007 ASSIGNMENTS=5 CHECKS=540	SAT TT=0.712	No data	SAT TT=0.673	SAT TT=0.667
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/latinSquare/ normalized-latinSquare-dg-6_all.xml	UNSAT TT=0.014	UNSAT TT=0.94 CHECKS=157 NODES=196	UNSAT TT=0.815 CHECKS=210 NODES=206	UNSAT TT=0.165	UNSAT TT=0.021 CHECKS=1769	UNSAT TT=0.021 CHECKS=1871	UNSAT TT=0.868 ASSIGNMENTS=273	UNSAT TT=0.751 ASSIGNMENTS=100	No data	No data	No data	UNSAT TT=0.039 ASSIGNMENTS=509 CHECKS=29628	UNSAT TT=0.041 ASSIGNMENTS=509 CHECKS=29628	No data	No data	No data	UNSAT TT=0.029 ASSIGNMENTS=544 CHECKS=30025	UNSAT TT=0.014 ASSIGNMENTS=144 CHECKS=11200	UNSAT TT=0.301	UNSAT TT=0.045 ASSIGNMENTS=839 CHECKS=43235	UNSAT TT=0.04 ASSIGNMENTS=807 CHECKS=43223	UNSAT TT=1.273	No data	UNSAT TT=0.827	UNSAT TT=0.82
csp/latinSquare/ normalized-latinSquare-dg-7_all.xml	SAT TT=0.009	SAT TT=0.78 CHECKS=74 NODES=53	SAT TT=0.835 CHECKS=74 NODES=57	SAT TT=0.034	SAT TT=0.03 CHECKS=3798	SAT TT=0.03 CHECKS=4097	SAT TT=0.724 ASSIGNMENTS=10	SAT TT=0.738 ASSIGNMENTS=10	No data	No data	No data	SAT TT=0.02 ASSIGNMENTS=13 CHECKS=2140	SAT TT=0.021 ASSIGNMENTS=13 CHECKS=2140	No data	No data	No data	SAT TT=0.01 ASSIGNMENTS=13 CHECKS=2140	SAT TT=0.009 ASSIGNMENTS=13 CHECKS=1769	SAT TT=0.303	SAT TT=0.014 ASSIGNMENTS=163 CHECKS=8394	SAT TT=0.011 ASSIGNMENTS=37 CHECKS=5463	SAT TT=0.87	No data	SAT TT=1.057	SAT TT=0.884
csp/latinSquare/ normalized-latinSquare-dg-8_all.xml	UNSAT TT=1.039	UNSAT TT=673.617 CHECKS=52946900 NODES=7379320	UNSAT TT=670.173 CHECKS=64468400 NODES=8128950	? (TO) TT=1800.08	UNSAT TT=204.56 CHECKS=64493400	UNSAT TT=1223.9 CHECKS=486650000	? (TO) TT=1800.41	? (TO) TT=1800.14	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=152.087	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.12	No data	UNSAT TT=1.039	UNSAT TT=1.039
csp/latinSquare/ normalized-latinSquare-dg-9_all.xml	UNSAT TT=1.025	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.12	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.19	No data	UNSAT TT=1.025	UNSAT TT=1.15
csp/lexHerald/ normalized-crossword-m1-lex-05-01.xml	SAT TT=0.418	SAT TT=1.036 CHECKS=18787 NODES=96	SAT TT=1.414 CHECKS=129622 NODES=401	SAT TT=3.723	SAT TT=0.651 CHECKS=12998	SAT TT=0.568 CHECKS=13433	SAT TT=9.235 ASSIGNMENTS=786	SAT TT=1.73 ASSIGNMENTS=10	SAT TT=66.942 CHECKS=69865000 NODES=87	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=17.073 ASSIGNMENTS=786	SAT TT=8.126 ASSIGNMENTS=627 CHECKS=249532	? (TO) TT=1800.02	? (TO) TT=1800.07	No data	SAT TT=6.474 ASSIGNMENTS=7815 CHECKS=3876700	SAT TT=1.852 ASSIGNMENTS=9359 CHECKS=971161	SAT TT=1.476	SAT TT=0.418 ASSIGNMENTS=600 CHECKS=216831	SAT TT=0.443 ASSIGNMENTS=627 CHECKS=249532	? (MO) TT=30.602	No data	SAT TT=19.376	SAT TT=21.277
csp/lexHerald/ normalized-crossword-m1-lex-05-05.xml	SAT TT=0.031	SAT TT=0.996 CHECKS=6381 NODES=22	SAT TT=0.877 CHECKS=10499 NODES=22	SAT TT=0.778	SAT TT=0.275 CHECKS=3812	SAT TT=0.235 CHECKS=3941	SAT TT=1.303 ASSIGNMENTS=122	SAT TT=1.129 ASSIGNMENTS=11	SAT TT=115.396 CHECKS=6073740 NODES=17	SAT TT=48.049 CHECKS=5385310 NODES=1950020	SAT TT=111.204 CHECKS=119153000 NODES=17153	SAT TT=0.484 ASSIGNMENTS=2319 CHECKS=417902	SAT TT=0.486 ASSIGNMENTS=2319 CHECKS=417902	? (TO) TT=1800.08	? (TO) TT=1800.01	No data	SAT TT=0.402 ASSIGNMENTS=1796 CHECKS=316642	SAT TT=0.081 ASSIGNMENTS=404 CHECKS=35936	SAT TT=0.723	SAT TT=0.031 ASSIGNMENTS=68 CHECKS=6483	SAT TT=0.032 ASSIGNMENTS=110 CHECKS=10499	? (MO) TT=37.787	No data	SAT TT=2.26	SAT TT=2.676
csp/lexHerald/ normalized-crossword-m1-lex-05-06.xml	SAT TT=0.028	SAT TT=0.921 CHECKS=2391 NODES=25	SAT TT=0.903 CHECKS=4114 NODES=25	SAT TT=2.413	SAT TT=0.4 CHECKS=3486	SAT TT=0.353 CHECKS=3500	SAT TT=4.279 ASSIGNMENTS=498	SAT TT=1.355 ASSIGNMENTS=19	SAT TT=99.699 CHECKS=17986800 NODES=27	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=11.731 ASSIGNMENTS=498	SAT TT=11.357 ASSIGNMENTS=498	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	SAT TT=3.444 ASSIGNMENTS=5619 CHECKS=1058470	SAT TT=1.575 ASSIGNMENTS=5644 CHECKS=560596	SAT TT=0.79	SAT TT=0.028 ASSIGNMENTS=38 CHECKS=3438	SAT TT=0.066 ASSIGNMENTS=143 CHECKS=15881	? (MO) TT=33.971	No data	SAT TT=5.236	SAT TT=7.376
csp/lexHerald/ normalized-crossword-m1-lex-05-09.xml	SAT TT=0.019	SAT TT=0.852 CHECKS=2077 NODES=20	SAT TT=0.854 CHECKS=1737 NODES=0	SAT TT=1.037	SAT TT=0.23 CHECKS=1259	SAT TT=0.233 CHECKS=1522	SAT TT=1.38 ASSIGNMENTS=163	SAT TT=0.952 ASSIGNMENTS=10	SAT TT=122.873 CHECKS=6459080 NODES=21	SAT TT=78.469 CHECKS=8258500 NODES=3600140	SAT TT=108.639 CHECKS=22229900 NODES=1807	SAT TT=0.295 ASSIGNMENTS=835 CHECKS=83953	SAT TT=0.292 ASSIGNMENTS=835 CHECKS=83953	? (TO) TT=1800.07	? (TO) TT=1800.03	No data	SAT TT=0.254 ASSIGNMENTS=627 CHECKS=65526	SAT TT=0.019 ASSIGNMENTS=5 CHECKS=489	SAT TT=0.568	SAT TT=0.028 ASSIGNMENTS=46 CHECKS=2728	SAT TT=0.046 ASSIGNMENTS=154 CHECKS=10251	? (MO) TT=40.181	No data	SAT TT=2.619	SAT TT=3.499
csp/lexHerald/ normalized-crossword-m1-lex-05-10.xml	SAT TT=0.018	SAT TT=0.831 CHECKS=3735 NODES=17	SAT TT=0.864 CHECKS=2824 NODES=0	SAT TT=0.788	SAT TT=0.216 CHECKS=2571	SAT TT=0.134 CHECKS=1506	SAT TT=1.283 ASSIGNMENTS=142	SAT TT=0.957 ASSIGNMENTS=10	SAT TT=128.76 CHECKS=5780890 NODES=19	SAT TT=71.398 CHECKS=12264000 NODES=43950000	SAT TT=74.675 CHECKS=15291600 NODES=1808	SAT TT=0.357 ASSIGNMENTS=1540 CHECKS=270899	SAT TT=0.355 ASSIGNMENTS=1540 CHECKS=270899	? (TO) TT=1800.04	? (TO) TT=1800.07	No data	SAT TT=0.553 ASSIGNMENTS=2330 CHECKS=417960	SAT TT=0.018 ASSIGNMENTS=11 CHECKS=1052	SAT TT=0.632	SAT TT=0.024 ASSIGNMENTS=29 CHECKS=3176	SAT TT=0.027 ASSIGNMENTS=75 CHECKS=6665	? TT=91.799	No data	SAT TT=2.264	SAT TT=2.633
csp/lexHerald/ normalized-crossword-m1-lex-15-03.xml	SAT TT=0.217	SAT TT=3.723 CHECKS=451693 NODES=808	SAT TT=2.782 CHECKS=203731 NODES=200	? (TO) TT=1800.13	SAT TT=8.436 CHECKS=232924	SAT TT=8.774 CHECKS=611707	SAT TT=12.13 ASSIGNMENTS=79	SAT TT=61.674 ASSIGNMENTS=264	SAT TT=437.681 CHECKS=1808380000 NODES=412	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=0.256 ASSIGNMENTS=74 CHECKS=112311	SAT TT=0.259 ASSIGNMENTS=74 CHECKS=112311	? (TO) TT=1800.11	? (TO) TT=1800.09	No data	SAT TT=0.217 ASSIGNMENTS=60 CHECKS=75949	SAT TT=20.205 ASSIGNMENTS=19830 CHECKS=24677700	? (TO) TT=1800.01	SAT TT=49.78 ASSIGNMENTS=30186 CHECKS=27135400	SAT TT=0.601 ASSIGNMENTS=347 CHECKS=433695	? (MO) TT=33.931	No data	SAT TT=583.863	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexHerald/ normalized-crossword-m1-lex-15-04.xml	UNSAT TT=1.608	UNSAT TT=11.64 CHECKS=1902950 NODES=4951	UNSAT TT=7.381 CHECKS=485064 NODES=2299	? (TO) TT=1800.08	UNSAT TT=29.944 CHECKS=1705940	UNSAT TT=14.108 CHECKS=1097550	UNSAT TT=21.806 ASSIGNMENTS=0	UNSAT TT=28.002 ASSIGNMENTS=0	UNSAT TT=1107.29 CHECKS=6570340000 NODES=1316	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=19.79 ASSIGNMENTS=4951 CHECKS=1902950	UNSAT TT=17.717 ASSIGNMENTS=4951 CHECKS=1902950	? (TO) TT=1800	? (TO) TT=1800.05	No data	UNSAT TT=1.608 ASSIGNMENTS=606 CHECKS=1300030	UNSAT TT=13.909 ASSIGNMENTS=7960 CHECKS=9925820	UNSAT TT=8.32	UNSAT TT=11.008 ASSIGNMENTS=3266 CHECKS=7793880	UNSAT TT=1.814 ASSIGNMENTS=463 CHECKS=1291450	? (MO) TT=37.824	No data	UNSAT TT=735.255	UNSAT TT=503.359
csp/lexHerald/ normalized-crossword-m1-lex-15-05.xml	SAT TT=0.268	SAT TT=2.478 CHECKS=174192 NODES=189	SAT TT=3.228 CHECKS=349278 NODES=334	SAT TT=1161.83	SAT TT=44.178 CHECKS=2649060	SAT TT=6.993 CHECKS=521272	SAT TT=12.297 ASSIGNMENTS=91	SAT TT=62.35 ASSIGNMENTS=57	SAT TT=223.569 CHECKS=667871000 NODES=453	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.297 ASSIGNMENTS=108 CHECKS=144862	SAT TT=0.283 ASSIGNMENTS=108 CHECKS=144862	? (TO) TT=1800.09	? (TO) TT=1800.03	No data	SAT TT=0.327 ASSIGNMENTS=173 CHECKS=229543	SAT TT=17.543 ASSIGNMENTS=12298 CHECKS=22138500	SAT TT=20.109	SAT TT=95.833 ASSIGNMENTS=52996 CHECKS=48824600	SAT TT=0.268 ASSIGNMENTS=107 CHECKS=144633	? (MO) TT=31.4	No data	SAT TT=313.94	? (TO) TT=1800.03
csp/lexHerald/ normalized-crossword-m1-lex-15-07.xml	SAT TT=11.293	SAT TT=17.613 CHECKS=3581190 NODES=7324	SAT TT=60.213 CHECKS=16093000 NODES=26775	? (TO) TT=1800.05	SAT TT=86.262 CHECKS=3896450	SAT TT=107.417 CHECKS=6199500	SAT TT=39.872 ASSIGNMENTS=2012	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=41.897 ASSIGNMENTS=11470 CHECKS=16897400	SAT TT=116.223 ASSIGNMENTS=48839 CHECKS=32646700	? (TO) TT=1800.06	? (TO) TT=1800.04	No data	SAT TT=11.293 ASSIGNMENTS=3123 CHECKS=5013950	SAT TT=511.508 ASSIGNMENTS=198214 CHECKS=254744000	? (TO) TT=1800	SAT TT=116.261 ASSIGNMENTS=40983 CHECKS=45057400	SAT TT=33.732 ASSIGNMENTS=11470 CHECKS=16897400	? (MO) TT=32.115	No data	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/lexHerald/ normalized-crossword-m1-lex-15-09.xml	SAT TT=0.202	SAT TT=2.383 CHECKS=126350 NODES=368	SAT TT=2.878 CHECKS=221545 NODES=362	? (TO) TT=1800.07	SAT TT=8.379 CHECKS=191646	SAT TT=6.265 CHECKS=146823	SAT TT=9.325 ASSIGNMENTS=91	SAT TT=42.989 ASSIGNMENTS=177	SAT TT=283.501 CHECKS=826296000 NODES=414	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT TT=0.213 ASSIGNMENTS=77 CHECKS=72829	SAT TT=0.214 ASSIGNMENTS=77 CHECKS=72829	? (TO) TT=1800.06	? (TO) TT=1800.04	No data	SAT TT=0.202 ASSIGNMENTS=76 CHECKS=74439	SAT TT=15.897 ASSIGNMENTS=18918 CHECKS=19043600	SAT TT=23.655	SAT TT=42.172 ASSIGNMENTS=31691 CHECKS=22246500	SAT TT=0.455 ASSIGNMENTS=340 CHECKS=336082	? (MO) TT=43.413	No data	SAT TT=975.246	? (TO) TT=1800.01
csp/lexHerald/ normalized-crossword-m1-lex-19-03.xml	SAT TT=71.437	SAT TT=147.472 CHECKS=36729500 NODES=85434	SAT TT=71.437 CHECKS=14985600 NODES=41201	? (TO) TT=1800.1	SAT TT=391.963 CHECKS=42224200	SAT TT=1096.19 CHECKS=133928000	? (TO) TT=1800.15	? (TO) TT=1800.09	SAT TT=815.439 CHECKS=449591000 NODES=11872	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=105.106 ASSIGNMENTS=48894 CHECKS=23590800	SAT TT=112.3 ASSIGNMENTS=48894 CHECKS=23590800	? (TO) TT=1800.08	? (TO) TT=1800	No data	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=637.39 ASSIGNMENTS=184969 CHECKS=315635000	SAT TT=432.318 ASSIGNMENTS=127767 CHECKS=300676000	? (MO) TT=36.206	No data	? (TO) TT=1800.07	? (TO) TT=1800.07
csp/lexHerald/ normalized-crossword-m1-lex-19-06.xml	SAT TT=0.466	SAT TT=4.966 CHECKS=772627 NODES=812	SAT TT=6.031 CHECKS=956265 NODES=803	? (TO) TT=1800.12	SAT TT=11.769 CHECKS=755822	SAT TT=8.725 CHECKS=633577	SAT TT=21.718 ASSIGNMENTS=127	SAT TT=74.735 ASSIGNMENTS=550	SAT TT=263.124 CHECKS=682795000 NODES=800	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=0.487 ASSIGNMENTS=162 CHECKS=274165	SAT TT=0.466 ASSIGNMENTS=162 CHECKS=274165	? (TO) TT=1800.06	? (TO) TT=1800.09	No data	SAT TT=0.5 ASSIGNMENTS=161 CHECKS=308193	SAT TT=14.098 ASSIGNMENTS=7494 CHECKS=15675900	SAT TT=1590.83	SAT TT=71.613 ASSIGNMENTS=46714 CHECKS=88412500	SAT TT=0.677 ASSIGNMENTS=385 CHECKS=510826	? (MO) TT=30.686	No data	SAT TT=1536.08	? (TO) TT=1800
csp/lexHerald/ normalized-crossword-m1-lex-19-09.xml	SAT TT=0.438	SAT TT=5.075 CHECKS=518365 NODES=712	SAT TT=5.796 CHECKS=695502 NODES=714	? (TO) TT=1800.12	SAT TT=51.814 CHECKS=5030510	SAT TT=9.664 CHECKS=1043110	SAT TT=29.9 ASSIGNMENTS=99	SAT TT=66.151 ASSIGNMENTS=158	SAT TT=254.075 CHECKS=750639000 NODES=607	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=0.45 ASSIGNMENTS=118 CHECKS=240060	SAT TT=0.452 ASSIGNMENTS=118 CHECKS=240060	? (TO) TT=1800.05	? (TO) TT=1800.03	No data	SAT TT=0.438 ASSIGNMENTS=123 CHECKS=245428	SAT TT=15.655 ASSIGNMENTS=7544 CHECKS=18843300	SAT TT=13.349	SAT TT=203.996 ASSIGNMENTS=97691 CHECKS=255082000	SAT TT=1.113 ASSIGNMENTS=525 CHECKS=1295660	? (MO) TT=37.204	No data	SAT TT=1078.92	? (TO) TT=1800.04
csp/lexHerald/ normalized-crossword-m1-lex-21-02.xml	SAT TT=2.459	SAT TT=14.147 CHECKS=3939890 NODES=2734	SAT TT=12.698 CHECKS=2702910 NODES=3138	? (TO) TT=1800.14	SAT TT=47.277 CHECKS=5779680	SAT TT=26.625 CHECKS=3485260	SAT TT=37.476 ASSIGNMENTS=436	SAT TT=1683.59 ASSIGNMENTS=62008	SAT TT=1085.48 CHECKS=5267680000 NODES=1610	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=10.604 ASSIGNMENTS=937 CHECKS=2921020	SAT TT=21.469 ASSIGNMENTS=2734 CHECKS=3939890	? (TO) TT=1800.03	? (TO) TT=1800.01	No data	SAT TT=3.457 ASSIGNMENTS=1267 CHECKS=4112260	SAT TT=17.63 ASSIGNMENTS=8455 CHECKS=18309100	? (TO) TT=1800.04	SAT TT=59.948 ASSIGNMENTS=33245 CHECKS=67448800	SAT TT=2.459 ASSIGNMENTS=937 CHECKS=2921020	? (MO) TT=33.675	No data	? (TO) TT=1800.02	? (TO) TT=1800.01
csp/lexHerald/ normalized-crossword-m1-lex-21-03.xml	SAT TT=2.199	SAT TT=10.366 CHECKS=2336370 NODES=3048	SAT TT=15.835 CHECKS=3429390 NODES=4487	? (TO) TT=1800.1	SAT TT=22.739 CHECKS=1419380	SAT TT=72.019 CHECKS=8262950	SAT TT=42.259 ASSIGNMENTS=880	SAT TT=88.146 ASSIGNMENTS=678	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=9.703 ASSIGNMENTS=754 CHECKS=1999630	SAT TT=17.206 ASSIGNMENTS=3048 CHECKS=2336370	? (TO) TT=1800.02	? (TO) TT=1800.02	No data	SAT TT=29.923 ASSIGNMENTS=10122 CHECKS=27589700	SAT TT=37.093 ASSIGNMENTS=16981 CHECKS=36958800	? (TO) TT=1800.05	SAT TT=51.753 ASSIGNMENTS=23652 CHECKS=47890800	SAT TT=2.199 ASSIGNMENTS=754 CHECKS=1999630	? (MO) TT=27.138	No data	? (TO) TT=1800.07	? (TO) TT=1800.1
csp/lexHerald/ normalized-crossword-m1-lex-21-10.xml	UNSAT TT=372.809	UNSAT TT=398.458 CHECKS=21511500 NODES=218824	UNSAT TT=372.809 CHECKS=21744400 NODES=218588	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=377.016 ASSIGNMENTS=223441 CHECKS=22517000	UNSAT TT=376.39 ASSIGNMENTS=223441 CHECKS=22517000	? (TO) TT=1800.05	? (TO) TT=1800.08	No data	? (TO) TT=1800.06	UNSAT TT=533.778 ASSIGNMENTS=149152 CHECKS=523911000	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=934.013 ASSIGNMENTS=259349 CHECKS=927253000	? (MO) TT=32.141	No data	? (TO) TT=1800.04	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexHerald/ normalized-crossword-m1-lex-23-02.xml	SAT TT=1.775	SAT TT=11.881 CHECKS=2654310 NODES=2351	SAT TT=81.809 CHECKS=29273000 NODES=9382	? (TO) TT=1800.07	SAT TT=128.731 CHECKS=17908900	SAT TT=43.04 CHECKS=7745670	SAT TT=59.735 ASSIGNMENTS=972	? (TO) TT=1800.12	SAT TT=602.784 CHECKS=2660000000 NODES=1338	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=1.786 ASSIGNMENTS=647 CHECKS=1754510	SAT TT=1.775 ASSIGNMENTS=647 CHECKS=1754510	? (TO) TT=1800.01	? (TO) TT=1800.01	No data	SAT TT=3.69 ASSIGNMENTS=1608 CHECKS=4340680	SAT TT=20.817 ASSIGNMENTS=9041 CHECKS=25641800	? (TO) TT=1800.07	SAT TT=220.415 ASSIGNMENTS=104223 CHECKS=280985000	SAT TT=2.002 ASSIGNMENTS=786 CHECKS=2178710	? (MO) TT=39.303	No data	? (TO) TT=1800.02	? (TO) TT=1800.09
csp/lexHerald/ normalized-crossword-m1-lex-23-04.xml	SAT TT=858.914	SAT TT=917.591 CHECKS=279462000 NODES=99832	SAT TT=1150.59 CHECKS=351873000 NODES=148537	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=858.914 ASSIGNMENTS=99832 CHECKS=279462000	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07	No data	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=91.379	No data	? (TO) TT=1800.06	? (TO) TT=1800
csp/lexHerald/ normalized-crossword-m1-lex-23-05.xml	SAT TT=9.753	SAT TT=12.391 CHECKS=2048810 NODES=2102	SAT TT=34.197 CHECKS=8956970 NODES=6194	? (TO) TT=1800.15	SAT TT=236.834 CHECKS=45479900	SAT TT=143.8 CHECKS=30439800	SAT TT=50.089 ASSIGNMENTS=576	? (TO) TT=1800.08	SAT TT=232.729 CHECKS=576070000 NODES=954	? (TO) TT=1800.06	? (TO) TT=1800	SAT TT=19.948 ASSIGNMENTS=4020 CHECKS=18178300	SAT TT=21.91 ASSIGNMENTS=4020 CHECKS=18178300	? (TO) TT=1800.01	? (TO) TT=1800.08	No data	SAT TT=9.753 ASSIGNMENTS=3993 CHECKS=15566000	SAT TT=29.721 ASSIGNMENTS=10870 CHECKS=34409600	SAT TT=244.698	SAT TT=106.103 ASSIGNMENTS=46161 CHECKS=135373000	SAT TT=13.284 ASSIGNMENTS=4020 CHECKS=18178300	? (MO) TT=31.696	No data	? (TO) TT=1800.06	? (TO) TT=1800.02
csp/lexHerald/ normalized-crossword-m1-lex-23-06.xml	UNSAT TT=1071.41	UNSAT TT=1137.5 CHECKS=68146500 NODES=602394	? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=1071.41 ASSIGNMENTS=602394 CHECKS=68146500	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	No data	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.02	? (MO) TT=37.641	No data	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle02.xml	SAT TT=0.01	SAT TT=0.82 CHECKS=1533 NODES=8	SAT TT=0.738 CHECKS=1229 NODES=0	SAT TT=0.06	SAT TT=0.043 CHECKS=538	SAT TT=0.04 CHECKS=759	SAT TT=0.672 ASSIGNMENTS=55	SAT TT=0.65 ASSIGNMENTS=7	SAT TT=88.456 CHECKS=23225 NODES=8	SAT TT=36.59 CHECKS=21881 NODES=5	SAT TT=37.881 CHECKS=21666 NODES=3	SAT TT=0.039 ASSIGNMENTS=183 CHECKS=6457	SAT TT=0.033 ASSIGNMENTS=183 CHECKS=6457	SAT TT=75.174	SAT TT=74.445	No data	SAT TT=0.019 ASSIGNMENTS=183 CHECKS=6457	SAT TT=0.017 ASSIGNMENTS=130 CHECKS=4029	SAT TT=0.358	SAT TT=0.01 ASSIGNMENTS=7 CHECKS=204	SAT TT=0.014 ASSIGNMENTS=138 CHECKS=3449	SAT TT=1372.9	No data	SAT TT=0.708	SAT TT=0.766
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle03.xml	SAT TT=0.026	SAT TT=0.798 CHECKS=2828 NODES=14	SAT TT=0.784 CHECKS=1626 NODES=0	SAT TT=0.188	SAT TT=0.135 CHECKS=974	SAT TT=0.113 CHECKS=982	SAT TT=1.142 ASSIGNMENTS=136	SAT TT=0.796 ASSIGNMENTS=10	SAT TT=133.797 CHECKS=366167 NODES=21	SAT TT=70.064 CHECKS=356803 NODES=13	SAT TT=76.061 CHECKS=4801750 NODES=130	SAT TT=0.18 ASSIGNMENTS=1047 CHECKS=71660	SAT TT=0.183 ASSIGNMENTS=1047 CHECKS=71660	? (TO) TT=1800.01	? (TO) TT=1800.1	No data	SAT TT=0.244 ASSIGNMENTS=1427 CHECKS=103989	SAT TT=0.122 ASSIGNMENTS=865 CHECKS=49235	SAT TT=0.495	SAT TT=0.026 ASSIGNMENTS=72 CHECKS=4443	SAT TT=0.027 ASSIGNMENTS=120 CHECKS=7321	? (TO) TT=1800.14	No data	SAT TT=1.162	SAT TT=1.534
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle04.xml	SAT TT=0.033	SAT TT=0.806 CHECKS=1979 NODES=20	SAT TT=0.887 CHECKS=4639 NODES=21	SAT TT=1.147	SAT TT=0.24 CHECKS=1558	SAT TT=0.219 CHECKS=1508	SAT TT=1.347 ASSIGNMENTS=58	SAT TT=1.038 ASSIGNMENTS=11	SAT TT=133.643 CHECKS=11674000 NODES=34	SAT TT=68.511 CHECKS=59750700 NODES=67350000	SAT TT=538.034 CHECKS=889337000 NODES=35485	SAT TT=0.341 ASSIGNMENTS=1114 CHECKS=91661	SAT TT=0.342 ASSIGNMENTS=1114 CHECKS=91661	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	SAT TT=0.343 ASSIGNMENTS=1241 CHECKS=102716	SAT TT=0.325 ASSIGNMENTS=1338 CHECKS=91920	SAT TT=0.596	SAT TT=0.036 ASSIGNMENTS=76 CHECKS=4980	SAT TT=0.033 ASSIGNMENTS=92 CHECKS=5246	? (MO) TT=38.362	No data	SAT TT=2.863	SAT TT=3.47
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle05.xml	SAT TT=0.026	SAT TT=0.822 CHECKS=2257 NODES=21	SAT TT=0.812 CHECKS=1036 NODES=0	SAT TT=0.741	SAT TT=0.259 CHECKS=1528	SAT TT=0.242 CHECKS=1539	SAT TT=2.057 ASSIGNMENTS=348	SAT TT=1.032 ASSIGNMENTS=11	SAT TT=93.233 CHECKS=6638670 NODES=24	SAT TT=69.57 CHECKS=210681000 NODES=234900000	SAT TT=200.703 CHECKS=366129000 NODES=18765	SAT TT=0.519 ASSIGNMENTS=1571 CHECKS=122081	SAT TT=0.491 ASSIGNMENTS=1571 CHECKS=122081	? (TO) TT=1800.03	? (TO) TT=1800.01	No data	SAT TT=0.399 ASSIGNMENTS=1381 CHECKS=106865	SAT TT=0.051 ASSIGNMENTS=155 CHECKS=8426	SAT TT=0.768	SAT TT=0.026 ASSIGNMENTS=32 CHECKS=1614	SAT TT=0.037 ASSIGNMENTS=123 CHECKS=7525	? (MO) TT=34.862	No data	SAT TT=2.653	SAT TT=3.077
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle06.xml	SAT TT=0.024	SAT TT=1.018 CHECKS=2629 NODES=23	SAT TT=0.884 CHECKS=3109 NODES=0	SAT TT=2.037	SAT TT=0.325 CHECKS=2074	SAT TT=0.257 CHECKS=1589	SAT TT=76.719 ASSIGNMENTS=14855	SAT TT=1.227 ASSIGNMENTS=12	SAT TT=91.445 CHECKS=17782400 NODES=24	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=0.501 ASSIGNMENTS=1307 CHECKS=181427	SAT TT=0.505 ASSIGNMENTS=1307 CHECKS=181427	? (TO) TT=1800.09	? (TO) TT=1800.01	No data	SAT TT=0.405 ASSIGNMENTS=1065 CHECKS=158935	SAT TT=1.53 ASSIGNMENTS=4940 CHECKS=507035	SAT TT=0.669	SAT TT=0.024 ASSIGNMENTS=23 CHECKS=2871	SAT TT=0.029 ASSIGNMENTS=74 CHECKS=6238	? (MO) TT=32.623	No data	SAT TT=4.538	SAT TT=6.234
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle07.xml	SAT TT=0.026	SAT TT=0.929 CHECKS=4359 NODES=32	SAT TT=0.908 CHECKS=6330 NODES=0	SAT TT=2.814	SAT TT=0.288 CHECKS=1736	SAT TT=0.323 CHECKS=2374	SAT TT=6.059 ASSIGNMENTS=1437	SAT TT=1.152 ASSIGNMENTS=23	SAT TT=122.692 CHECKS=12082400 NODES=31	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=0.257 ASSIGNMENTS=1021 CHECKS=97562	SAT TT=0.258 ASSIGNMENTS=1021 CHECKS=97562	? (TO) TT=1800.05	? (TO) TT=1800.09	No data	SAT TT=0.222 ASSIGNMENTS=1046 CHECKS=98434	SAT TT=0.233 ASSIGNMENTS=1015 CHECKS=86635	SAT TT=0.711	SAT TT=0.026 ASSIGNMENTS=24 CHECKS=1849	SAT TT=0.05 ASSIGNMENTS=153 CHECKS=13098	? TT=95.735	No data	SAT TT=3.638	SAT TT=5.237
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle09.xml	SAT TT=0.078	SAT TT=0.984 CHECKS=4673 NODES=35	SAT TT=1.095 CHECKS=4418 NODES=0	SAT TT=4.223	SAT TT=0.407 CHECKS=2492	SAT TT=0.347 CHECKS=2541	SAT TT=6.818 ASSIGNMENTS=613	SAT TT=1.983 ASSIGNMENTS=20	SAT TT=122.752 CHECKS=12872500 NODES=37	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=14.946 ASSIGNMENTS=613	SAT TT=14.911 ASSIGNMENTS=613	? (TO) TT=1800.1	? (TO) TT=1800.04	No data	SAT TT=2.565 ASSIGNMENTS=2848 CHECKS=877711	SAT TT=0.407 ASSIGNMENTS=649 CHECKS=104187	SAT TT=1.05	SAT TT=0.078 ASSIGNMENTS=102 CHECKS=12891	SAT TT=0.12 ASSIGNMENTS=160 CHECKS=34349	? (MO) TT=33.801	No data	SAT TT=16.323	SAT TT=20.502
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle10.xml	SAT TT=0.037	SAT TT=1.064 CHECKS=20650 NODES=42	SAT TT=1.006 CHECKS=14188 NODES=0	SAT TT=2.372	SAT TT=0.724 CHECKS=10703	SAT TT=0.461 CHECKS=7367	SAT TT=1.907 ASSIGNMENTS=22	SAT TT=2.086 ASSIGNMENTS=18	SAT TT=128.797 CHECKS=122086 NODES=45	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.05 ASSIGNMENTS=25 CHECKS=5247	SAT TT=0.049 ASSIGNMENTS=25 CHECKS=5247	? (TO) TT=1800.04	? (TO) TT=1800.09	No data	SAT TT=0.038 ASSIGNMENTS=24 CHECKS=6221	SAT TT=3.193 ASSIGNMENTS=9076 CHECKS=2026060	SAT TT=1.608	SAT TT=0.082 ASSIGNMENTS=123 CHECKS=30648	SAT TT=0.037 ASSIGNMENTS=20 CHECKS=5805	? (TO) TT=1800.1	No data	SAT TT=16.58	SAT TT=21.649
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle11.xml	SAT TT=0.094	SAT TT=0.959 CHECKS=3576 NODES=38	SAT TT=1.026 CHECKS=8716 NODES=39	SAT TT=10.16	SAT TT=0.622 CHECKS=4391	SAT TT=0.48 CHECKS=3724	SAT TT=3.999 ASSIGNMENTS=270	SAT TT=1.876 ASSIGNMENTS=20	SAT TT=154.657 CHECKS=378218000 NODES=40	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=0.879 ASSIGNMENTS=1364 CHECKS=292760	SAT TT=0.885 ASSIGNMENTS=1364 CHECKS=292760	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	SAT TT=1.039 ASSIGNMENTS=1505 CHECKS=321028	SAT TT=3.699 ASSIGNMENTS=5046 CHECKS=823050	SAT TT=1.105	SAT TT=0.238 ASSIGNMENTS=327 CHECKS=47061	SAT TT=0.094 ASSIGNMENTS=113 CHECKS=23475	? TT=79.694	No data	SAT TT=18.385	SAT TT=20.815
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle15.xml	SAT TT=0.075	SAT TT=1.5 CHECKS=54249 NODES=103	SAT TT=1.648 CHECKS=116865 NODES=108	SAT TT=8.52	SAT TT=2.227 CHECKS=31265	SAT TT=1.647 CHECKS=32495	SAT TT=4.038 ASSIGNMENTS=48	SAT TT=6.913 ASSIGNMENTS=58	SAT TT=132.992 CHECKS=675650 NODES=143	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=0.088 ASSIGNMENTS=52 CHECKS=25836	SAT TT=0.091 ASSIGNMENTS=52 CHECKS=25836	? (TO) TT=1800.07	? (TO) TT=1800.01	No data	SAT TT=0.075 ASSIGNMENTS=52 CHECKS=25836	SAT TT=6.808 ASSIGNMENTS=18851 CHECKS=8104390	SAT TT=2.285	SAT TT=1.787 ASSIGNMENTS=2677 CHECKS=1679310	SAT TT=0.077 ASSIGNMENTS=58 CHECKS=27431	? TT=100.623	No data	SAT TT=26.958	SAT TT=26.961
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle16.xml	SAT TT=0.142	SAT TT=2.297 CHECKS=199736 NODES=273	SAT TT=2.278 CHECKS=306346 NODES=274	SAT TT=8.928	SAT TT=2.674 CHECKS=65052	SAT TT=1.943 CHECKS=86643	SAT TT=5.286 ASSIGNMENTS=64	SAT TT=23.286 ASSIGNMENTS=60	SAT TT=328.121 CHECKS=1136900000 NODES=339	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=0.159 ASSIGNMENTS=81 CHECKS=47351	SAT TT=0.157 ASSIGNMENTS=81 CHECKS=47351	? (TO) TT=1800.02	? (TO) TT=1800.04	No data	SAT TT=0.144 ASSIGNMENTS=81 CHECKS=47351	SAT TT=10.175 ASSIGNMENTS=19445 CHECKS=13858700	? (TO) TT=1800.1	SAT TT=3.491 ASSIGNMENTS=3989 CHECKS=2580580	SAT TT=0.142 ASSIGNMENTS=76 CHECKS=40586	? (MO) TT=41.689	No data	SAT TT=54.137	SAT TT=51.276
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle17.xml	SAT TT=0.229	SAT TT=2.337 CHECKS=215531 NODES=185	SAT TT=3.123 CHECKS=411522 NODES=342	SAT TT=14.974	SAT TT=5.421 CHECKS=201448	SAT TT=3.709 CHECKS=246570	SAT TT=8.952 ASSIGNMENTS=80	SAT TT=52.986 ASSIGNMENTS=66	SAT TT=257.972 CHECKS=631407000 NODES=304	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.251 ASSIGNMENTS=85 CHECKS=72551	SAT TT=0.246 ASSIGNMENTS=85 CHECKS=72551	? (TO) TT=1800.08	? (TO) TT=1800.03	No data	SAT TT=0.229 ASSIGNMENTS=85 CHECKS=72551	SAT TT=20.451 ASSIGNMENTS=22718 CHECKS=27243900	? (TO) TT=1800.1	SAT TT=58.865 ASSIGNMENTS=39497 CHECKS=31136500	SAT TT=0.271 ASSIGNMENTS=122 CHECKS=101036	? TT=100.989	No data	SAT TT=433.106	SAT TT=740.86
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle18.xml	SAT TT=0.203	SAT TT=2.589 CHECKS=225836 NODES=351	SAT TT=2.923 CHECKS=356791 NODES=349	? (TO) TT=1800.11	SAT TT=39.606 CHECKS=2776440	SAT TT=2.56 CHECKS=198283	SAT TT=9.902 ASSIGNMENTS=87	SAT TT=62.262 ASSIGNMENTS=81	SAT TT=134.216 CHECKS=2539450 NODES=342	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=0.214 ASSIGNMENTS=106 CHECKS=82330	SAT TT=0.228 ASSIGNMENTS=106 CHECKS=82330	? (TO) TT=1800.09	? (TO) TT=1800.02	No data	SAT TT=0.214 ASSIGNMENTS=106 CHECKS=82330	SAT TT=17.696 ASSIGNMENTS=19647 CHECKS=25036800	SAT TT=5.997	SAT TT=61.746 ASSIGNMENTS=40259 CHECKS=33673700	SAT TT=0.203 ASSIGNMENTS=94 CHECKS=79210	? (MO) TT=63.926	No data	SAT TT=66.768	SAT TT=264.508
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle19.xml	SAT TT=0.392	SAT TT=2.884 CHECKS=263371 NODES=477	SAT TT=3.073 CHECKS=329057 NODES=456	? (TO) TT=1800.05	SAT TT=7.485 CHECKS=339092	SAT TT=6.216 CHECKS=354095	SAT TT=13.725 ASSIGNMENTS=383	SAT TT=39.523 ASSIGNMENTS=76	SAT TT=269.03 CHECKS=895289000 NODES=385	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=0.412 ASSIGNMENTS=170 CHECKS=162308	SAT TT=0.392 ASSIGNMENTS=170 CHECKS=162308	? (TO) TT=1800.07	? (TO) TT=1800.08	No data	SAT TT=0.795 ASSIGNMENTS=327 CHECKS=371749	SAT TT=18.573 ASSIGNMENTS=16620 CHECKS=20136200	? (TO) TT=1800	SAT TT=53.476 ASSIGNMENTS=39152 CHECKS=29860900	SAT TT=0.489 ASSIGNMENTS=212 CHECKS=235755	? (MO) TT=32.135	No data	SAT TT=332.475	? (TO) TT=1800.02
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle20.xml	SAT TT=0.099	SAT TT=1.187 CHECKS=4919 NODES=53	SAT TT=1.145 CHECKS=21196 NODES=66	SAT TT=4.904	SAT TT=0.987 CHECKS=8936	SAT TT=0.829 CHECKS=8377	SAT TT=118.778 ASSIGNMENTS=9403	SAT TT=2.318 ASSIGNMENTS=20	SAT TT=121.882 CHECKS=14309600 NODES=53	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=116.449 ASSIGNMENTS=9403	SAT TT=126.131 ASSIGNMENTS=9403	? (TO) TT=1800.06	? (TO) TT=1800.04	No data	SAT TT=7.137 ASSIGNMENTS=8734 CHECKS=3582390	SAT TT=4.722 ASSIGNMENTS=6705 CHECKS=1581020	SAT TT=1.645	SAT TT=0.255 ASSIGNMENTS=408 CHECKS=85202	SAT TT=0.099 ASSIGNMENTS=218 CHECKS=44647	? (MO) TT=45.677	No data	SAT TT=21.736	SAT TT=34.944
csp/lexVg/ normalized-crossword-m1c-lex-vg10-11_ext.xml	UNSAT TT=1.55	UNSAT TT=1.701 CHECKS=0 NODES=221	UNSAT TT=3.236 CHECKS=0 NODES=209	? (TO) TT=1800.09	UNSAT TT=41.101 CHECKS=112511	UNSAT TT=17.807 CHECKS=43417	UNSAT TT=20.787 ASSIGNMENTS=0	UNSAT TT=22.258 ASSIGNMENTS=0	UNSAT TT=2.762 CHECKS=0 NODES=368	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=9.329 ASSIGNMENTS=221 CHECKS=0	UNSAT TT=9.026 ASSIGNMENTS=221 CHECKS=0	UNSAT TT=64.248	UNSAT TT=51.21	UNSAT TT=4.342 CHECKS=36205	UNSAT TT=1.55 ASSIGNMENTS=206 CHECKS=41245	UNSAT TT=18.017 ASSIGNMENTS=3472 CHECKS=462122	UNSAT TT=14.413	UNSAT TT=7.462 ASSIGNMENTS=1645 CHECKS=197688	UNSAT TT=1.631 ASSIGNMENTS=238 CHECKS=43669	? TT=31.591	? (TO) TT=1800.08	UNSAT TT=181.014	? (TO) TT=1800
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg10-12_ext.xml	UNSAT TT=0.371	UNSAT TT=0.943 CHECKS=0 NODES=58	UNSAT TT=1.906 CHECKS=0 NODES=0	? (TO) TT=1800.08	UNSAT TT=9.712 CHECKS=26649	UNSAT TT=8.838 CHECKS=24132	UNSAT TT=4.181 ASSIGNMENTS=0	UNSAT TT=4.548 ASSIGNMENTS=0	UNSAT TT=1.055 CHECKS=0 NODES=74	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=0.421 ASSIGNMENTS=60 CHECKS=9481	UNSAT TT=0.422 ASSIGNMENTS=60 CHECKS=9481	UNSAT TT=34.658	UNSAT TT=27.653	UNSAT TT=0.957 CHECKS=6723	UNSAT TT=0.4 ASSIGNMENTS=60 CHECKS=9433	UNSAT TT=15.501 ASSIGNMENTS=3172 CHECKS=436031	UNSAT TT=7.774	UNSAT TT=1.35 ASSIGNMENTS=279 CHECKS=37352	UNSAT TT=0.371 ASSIGNMENTS=60 CHECKS=9481	? TT=32.877	? (TO) TT=1800.11	UNSAT TT=88.589	UNSAT TT=149.832
csp/lexVg/ normalized-crossword-m1c-lex-vg11-12_ext.xml	UNSAT TT=0.214	UNSAT TT=0.836 CHECKS=0 NODES=23	UNSAT TT=0.877 CHECKS=0 NODES=0	? (TO) TT=1800.14	UNSAT TT=3.369 CHECKS=9260	UNSAT TT=3.622 CHECKS=9134	UNSAT TT=1.993 ASSIGNMENTS=0	UNSAT TT=2.337 ASSIGNMENTS=0	UNSAT TT=0.81 CHECKS=0 NODES=27	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.36 ASSIGNMENTS=40 CHECKS=8217	UNSAT TT=0.338 ASSIGNMENTS=40 CHECKS=8217	UNSAT TT=19.154	UNSAT TT=14.674	UNSAT TT=0.378 CHECKS=2811	UNSAT TT=0.214 ASSIGNMENTS=29 CHECKS=5256	UNSAT TT=1.682 ASSIGNMENTS=343 CHECKS=45212	UNSAT TT=2.263	UNSAT TT=0.422 ASSIGNMENTS=72 CHECKS=10791	UNSAT TT=0.32 ASSIGNMENTS=40 CHECKS=8217	? TT=32.237	? (TO) TT=1800.02	UNSAT TT=51.717	UNSAT TT=60.992
csp/lexVg/ normalized-crossword-m1c-lex-vg11-13_ext.xml	UNSAT TT=0.09	UNSAT TT=0.776 CHECKS=0 NODES=7	UNSAT TT=0.829 CHECKS=0 NODES=0	UNSAT TT=223.836	UNSAT TT=0.656 CHECKS=1168	UNSAT TT=0.883 CHECKS=1644	UNSAT TT=0.792 ASSIGNMENTS=0	UNSAT TT=0.698 ASSIGNMENTS=0	UNSAT TT=0.542 CHECKS=0 NODES=7	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.096 ASSIGNMENTS=6 CHECKS=1652	UNSAT TT=0.1 ASSIGNMENTS=6 CHECKS=1652	UNSAT TT=14.086	UNSAT TT=10.75	UNSAT TT=0.175 CHECKS=967	UNSAT TT=0.09 ASSIGNMENTS=6 CHECKS=1652	UNSAT TT=0.118 ASSIGNMENTS=15 CHECKS=2242	UNSAT TT=1.197	UNSAT TT=0.114 ASSIGNMENTS=15 CHECKS=2098	UNSAT TT=0.09 ASSIGNMENTS=6 CHECKS=1652	? TT=33.724	? (TO) TT=1800.01	UNSAT TT=35.674	UNSAT TT=575.879
csp/lexVg/ normalized-crossword-m1c-lex-vg11-15_ext.xml	UNSAT TT=0.019	UNSAT TT=0.741 CHECKS=0 NODES=0	UNSAT TT=0.795 CHECKS=0 NODES=0	UNSAT TT=20.418	UNSAT TT=0.248 CHECKS=41	UNSAT TT=0.243 CHECKS=41	UNSAT TT=0.481 ASSIGNMENTS=0	UNSAT TT=0.456 ASSIGNMENTS=0	UNSAT TT=0.467 CHECKS=0 NODES=0	UNSAT TT=0.453 CHECKS=0 NODES=0	UNSAT TT=0.431 CHECKS=0 NODES=0	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=11.872	UNSAT TT=9.553	UNSAT TT=0.06 CHECKS=151	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=1.053	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=12	? TT=34.5	? (TO) TT=1800.08	UNSAT TT=34.783	UNSAT TT=47.764
csp/lexVg/ normalized-crossword-m1c-lex-vg12-12_ext.xml	UNSAT TT=0.085	UNSAT TT=0.835 CHECKS=0 NODES=8	UNSAT TT=0.786 CHECKS=0 NODES=0	UNSAT TT=279.771	UNSAT TT=1.212 CHECKS=3480	UNSAT TT=1.121 CHECKS=3878	UNSAT TT=0.88 ASSIGNMENTS=0	UNSAT TT=0.967 ASSIGNMENTS=0	UNSAT TT=0.499 CHECKS=0 NODES=11	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.104 ASSIGNMENTS=11 CHECKS=1916	UNSAT TT=0.103 ASSIGNMENTS=11 CHECKS=1916	UNSAT TT=12.92	UNSAT TT=10.64	UNSAT TT=0.121 CHECKS=1037	UNSAT TT=0.085 ASSIGNMENTS=8 CHECKS=1469	UNSAT TT=0.221 ASSIGNMENTS=38 CHECKS=4969	UNSAT TT=1.154	UNSAT TT=0.153 ASSIGNMENTS=20 CHECKS=3565	UNSAT TT=0.094 ASSIGNMENTS=11 CHECKS=1916	? TT=57.464	? (TO) TT=1800.05	UNSAT TT=38.436	? (TO) TT=1800.04
csp/lexVg/ normalized-crossword-m1c-lex-vg12-13_ext.xml	UNSAT TT=0.031	UNSAT TT=0.754 CHECKS=0 NODES=0	UNSAT TT=0.788 CHECKS=0 NODES=0	UNSAT TT=122.654	UNSAT TT=0.192 CHECKS=66	UNSAT TT=0.187 CHECKS=66	UNSAT TT=0.613 ASSIGNMENTS=0	UNSAT TT=0.575 ASSIGNMENTS=0	UNSAT TT=0.605 CHECKS=0 NODES=0	UNSAT TT=0.453 CHECKS=0 NODES=0	UNSAT TT=0.629 CHECKS=0 NODES=0	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=10.486	UNSAT TT=8.251	UNSAT TT=0.054 CHECKS=223	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=1.028	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=104	? TT=54.929	? (TO) TT=1800.05	UNSAT TT=21.316	UNSAT TT=287.535
csp/lexVg/ normalized-crossword-m1c-lex-vg12-14_ext.xml	UNSAT TT=0.027	UNSAT TT=0.793 CHECKS=0 NODES=0	UNSAT TT=0.91 CHECKS=0 NODES=0	UNSAT TT=52.102	UNSAT TT=0.172 CHECKS=51	UNSAT TT=0.173 CHECKS=51	UNSAT TT=0.48 ASSIGNMENTS=0	UNSAT TT=0.549 ASSIGNMENTS=0	UNSAT TT=0.517 CHECKS=0 NODES=0	UNSAT TT=0.447 CHECKS=0 NODES=0	UNSAT TT=0.437 CHECKS=0 NODES=0	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=8.512	UNSAT TT=7.711	UNSAT TT=0.044 CHECKS=159	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.846	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=55	? TT=53.509	? (TO) TT=1800.04	UNSAT TT=18.139	UNSAT TT=39.923
csp/lexVg/ normalized-crossword-m1c-lex-vg13-13_ext.xml	UNSAT TT=0.026	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=0.762 CHECKS=0 NODES=0	UNSAT TT=66.948	UNSAT TT=0.168 CHECKS=82	UNSAT TT=0.168 CHECKS=82	UNSAT TT=0.442 ASSIGNMENTS=0	UNSAT TT=0.47 ASSIGNMENTS=0	UNSAT TT=0.386 CHECKS=0 NODES=0	UNSAT TT=0.393 CHECKS=0 NODES=0	UNSAT TT=0.439 CHECKS=0 NODES=0	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=7.706	UNSAT TT=6.444	UNSAT TT=0.034 CHECKS=218	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.719	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=53	? TT=53.693	? (TO) TT=1800.08	UNSAT TT=13.599	UNSAT TT=42.119
csp/lexVg/ normalized-crossword-m1c-lex-vg13-15_ext.xml	UNSAT TT=0.019	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=0.743 CHECKS=0 NODES=0	UNSAT TT=8.3	UNSAT TT=0.085 CHECKS=29	UNSAT TT=0.085 CHECKS=29	UNSAT TT=0.53 ASSIGNMENTS=0	UNSAT TT=0.53 ASSIGNMENTS=0	UNSAT TT=0.423 CHECKS=0 NODES=0	UNSAT TT=0.422 CHECKS=0 NODES=0	UNSAT TT=0.419 CHECKS=0 NODES=0	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=6.26	UNSAT TT=5.443	UNSAT TT=0.032 CHECKS=65	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.623	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=14	? TT=51.591	? (TO) TT=1800.07	UNSAT TT=7.693	UNSAT TT=12.517
csp/lexVg/ normalized-crossword-m1c-lex-vg13-16_ext.xml	UNSAT TT=0.017	UNSAT TT=0.723 CHECKS=0 NODES=0	UNSAT TT=0.8 CHECKS=0 NODES=0	UNSAT TT=8.962	UNSAT TT=0.087 CHECKS=29	UNSAT TT=0.085 CHECKS=29	UNSAT TT=0.48 ASSIGNMENTS=0	UNSAT TT=0.433 ASSIGNMENTS=0	UNSAT TT=0.378 CHECKS=0 NODES=0	UNSAT TT=0.377 CHECKS=0 NODES=0	UNSAT TT=0.376 CHECKS=0 NODES=0	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=5.637	UNSAT TT=5.237	UNSAT TT=0.026 CHECKS=82	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.629	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=14	? TT=62.107	? (TO) TT=1800.04	UNSAT TT=7.926	UNSAT TT=12.638
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg13-17_ext.xml	UNSAT TT=0.016	UNSAT TT=0.771 CHECKS=0 NODES=0	UNSAT TT=0.765 CHECKS=0 NODES=0	UNSAT TT=6.71	UNSAT TT=0.09 CHECKS=30	UNSAT TT=0.084 CHECKS=30	UNSAT TT=0.455 ASSIGNMENTS=0	UNSAT TT=0.427 ASSIGNMENTS=0	UNSAT TT=0.402 CHECKS=0 NODES=0	UNSAT TT=0.374 CHECKS=0 NODES=0	UNSAT TT=0.492 CHECKS=0 NODES=0	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=5.989	UNSAT TT=5.188	UNSAT TT=0.025 CHECKS=55	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.599	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=14	? TT=57.387	? (TO) TT=1800.03	UNSAT TT=8.143	UNSAT TT=11.668
csp/lexVg/ normalized-crossword-m1c-lex-vg14-15_ext.xml	UNSAT TT=0.019	UNSAT TT=0.75 CHECKS=0 NODES=0	UNSAT TT=0.793 CHECKS=0 NODES=0	UNSAT TT=4.283	UNSAT TT=0.056 CHECKS=29	UNSAT TT=0.056 CHECKS=29	UNSAT TT=0.471 ASSIGNMENTS=0	UNSAT TT=0.566 ASSIGNMENTS=0	UNSAT TT=0.455 CHECKS=0 NODES=0	UNSAT TT=0.376 CHECKS=0 NODES=0	UNSAT TT=0.392 CHECKS=0 NODES=0	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=4.316	UNSAT TT=4.034	UNSAT TT=0.025 CHECKS=98	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.547	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=15	? (exit code) TT=88.171	? (TO) TT=1800.11	UNSAT TT=5.422	UNSAT TT=6.838
csp/lexVg/ normalized-crossword-m1c-lex-vg14-18_ext.xml	UNSAT TT=0.015	UNSAT TT=0.973 CHECKS=0 NODES=0	UNSAT TT=0.846 CHECKS=0 NODES=0	UNSAT TT=4.796	UNSAT TT=0.061 CHECKS=19	UNSAT TT=0.06 CHECKS=19	UNSAT TT=0.428 ASSIGNMENTS=0	UNSAT TT=0.464 ASSIGNMENTS=0	UNSAT TT=0.421 CHECKS=0 NODES=0	UNSAT TT=0.471 CHECKS=0 NODES=0	UNSAT TT=0.386 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=4.282	UNSAT TT=4.096	UNSAT TT=0.025 CHECKS=30	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.513	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=15	? TT=101.027	? (TO) TT=1800.08	UNSAT TT=4.127	UNSAT TT=6.515
csp/lexVg/ normalized-crossword-m1c-lex-vg15-16_ext.xml	UNSAT TT=0.019	UNSAT TT=0.792 CHECKS=0 NODES=0	UNSAT TT=0.797 CHECKS=0 NODES=0	UNSAT TT=1.342	UNSAT TT=0.034 CHECKS=17	UNSAT TT=0.034 CHECKS=17	UNSAT TT=0.422 ASSIGNMENTS=0	UNSAT TT=0.46 ASSIGNMENTS=0	UNSAT TT=0.371 CHECKS=0 NODES=0	UNSAT TT=0.366 CHECKS=0 NODES=0	UNSAT TT=0.381 CHECKS=0 NODES=0	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=3.638	UNSAT TT=3.334	UNSAT TT=0.023 CHECKS=50	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.476	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=16	? (exit code) TT=82.514	? (TO) TT=1800.02	UNSAT TT=2.36	UNSAT TT=3.774
csp/lexVg/ normalized-crossword-m1c-lex-vg15-17_ext.xml	UNSAT TT=0.016	UNSAT TT=0.748 CHECKS=0 NODES=0	UNSAT TT=0.731 CHECKS=0 NODES=0	UNSAT TT=1.411	UNSAT TT=0.031 CHECKS=18	UNSAT TT=0.029 CHECKS=18	UNSAT TT=0.481 ASSIGNMENTS=0	UNSAT TT=0.443 ASSIGNMENTS=0	UNSAT TT=0.375 CHECKS=0 NODES=0	UNSAT TT=0.359 CHECKS=0 NODES=0	UNSAT TT=0.371 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=3.47	UNSAT TT=2.961	UNSAT TT=0.021 CHECKS=24	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.423	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	? TT=81.753	? (TO) TT=1800.02	UNSAT TT=2.196	UNSAT TT=3.076
csp/lexVg/ normalized-crossword-m1c-lex-vg15-18_ext.xml	UNSAT TT=0.014	UNSAT TT=0.727 CHECKS=0 NODES=0	UNSAT TT=0.832 CHECKS=0 NODES=0	UNSAT TT=1.397	UNSAT TT=0.034 CHECKS=19	UNSAT TT=0.032 CHECKS=19	UNSAT TT=0.43 ASSIGNMENTS=0	UNSAT TT=0.467 ASSIGNMENTS=0	UNSAT TT=0.401 CHECKS=0 NODES=0	UNSAT TT=0.363 CHECKS=0 NODES=0	UNSAT TT=0.347 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=3.505	UNSAT TT=3.147	UNSAT TT=0.024 CHECKS=18	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.428	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=16	? TT=85.732	? (TO) TT=1800.04	UNSAT TT=2.01	UNSAT TT=3.077
csp/lexVg/ normalized-crossword-m1c-lex-vg16-18_ext.xml	UNSAT TT=0.016	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=0.766 CHECKS=0 NODES=0	UNSAT TT=0.605	UNSAT TT=0.025 CHECKS=19	UNSAT TT=0.025 CHECKS=19	UNSAT TT=0.454 ASSIGNMENTS=0	UNSAT TT=0.444 ASSIGNMENTS=0	UNSAT TT=0.415 CHECKS=0 NODES=0	UNSAT TT=0.375 CHECKS=0 NODES=0	UNSAT TT=0.375 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=3.32	UNSAT TT=2.936	UNSAT TT=0.021 CHECKS=5	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.427	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=17	? (exit code) TT=78.15	? (TO) TT=1800.05	UNSAT TT=1.696	UNSAT TT=2.085
csp/lexVg/ normalized-crossword-m1c-lex-vg16-20_ext.xml	UNSAT TT=0.014	UNSAT TT=0.804 CHECKS=0 NODES=0	UNSAT TT=0.768 CHECKS=0 NODES=0	UNSAT TT=0.713	UNSAT TT=0.038 CHECKS=45	UNSAT TT=0.035 CHECKS=45	UNSAT TT=0.496 ASSIGNMENTS=0	UNSAT TT=0.479 ASSIGNMENTS=0	UNSAT TT=0.449 CHECKS=0 NODES=0	UNSAT TT=0.388 CHECKS=0 NODES=0	UNSAT TT=0.383 CHECKS=0 NODES=0	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=3.297	UNSAT TT=3.091	UNSAT TT=0.024 CHECKS=6	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.432	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=17	? TT=99.572	? (TO) TT=1800.05	UNSAT TT=1.466	UNSAT TT=2.051
csp/lexVg/ normalized-crossword-m1c-lex-vg4-5_ext.xml	SAT TT=0.017	SAT TT=0.731 CHECKS=34 NODES=28	SAT TT=0.743 CHECKS=9 NODES=21	SAT TT=2.39	SAT TT=0.247 CHECKS=601	SAT TT=0.191 CHECKS=446	SAT TT=0.906 ASSIGNMENTS=11	SAT TT=0.952 ASSIGNMENTS=10	SAT TT=16.223 CHECKS=11747400 NODES=22	SAT TT=1386.18 CHECKS=8572600000 NODES=-33934500	? (TO) TT=1800.1	SAT TT=0.03 ASSIGNMENTS=7 CHECKS=192	SAT TT=0.03 ASSIGNMENTS=7 CHECKS=192	SAT TT=12.305	SAT TT=15.472	SAT TT=0.036 CHECKS=101	SAT TT=0.018 ASSIGNMENTS=7 CHECKS=192	SAT TT=0.021 ASSIGNMENTS=13 CHECKS=466	SAT TT=0.59	SAT TT=0.032 ASSIGNMENTS=55 CHECKS=1527	SAT TT=0.017 ASSIGNMENTS=7 CHECKS=192	? (MO) TT=33.132	SAT TT=0.489 ASSIGNMENTS=28 CHECKS=2552530	SAT TT=4.352	SAT TT=4.706
csp/lexVg/ normalized-crossword-m1c-lex-vg4-6_ext.xml	SAT TT=0.048	SAT TT=0.899 CHECKS=101 NODES=156	SAT TT=0.862 CHECKS=126 NODES=148	SAT TT=2.814	SAT TT=4.063 CHECKS=28721	SAT TT=0.533 CHECKS=2652	SAT TT=1.382 ASSIGNMENTS=28	SAT TT=1.266 ASSIGNMENTS=11	SAT TT=143.507 CHECKS=395229000 NODES=31	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=0.283 ASSIGNMENTS=359 CHECKS=17565	SAT TT=0.302 ASSIGNMENTS=359 CHECKS=17565	SAT TT=11.639	SAT TT=117.246	SAT TT=0.048 CHECKS=218	SAT TT=0.215 ASSIGNMENTS=233 CHECKS=12157	SAT TT=0.077 ASSIGNMENTS=85 CHECKS=3461	SAT TT=0.749	SAT TT=0.395 ASSIGNMENTS=568 CHECKS=22976	SAT TT=0.288 ASSIGNMENTS=359 CHECKS=17565	? TT=89.73	SAT TT=0.511 ASSIGNMENTS=43 CHECKS=767573	SAT TT=10.841	SAT TT=18.813
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg4-8_ext.xml	SAT TT=6	SAT TT=7.02 CHECKS=17728 NODES=12539	SAT TT=8.65 CHECKS=21002 NODES=14447	? (TO) TT=1800.09	SAT TT=103.668 CHECKS=435754	SAT TT=442.774 CHECKS=2678410	SAT TT=156.672 ASSIGNMENTS=18790	SAT TT=43.101 ASSIGNMENTS=3021	SAT TT=6 CHECKS=62294500 NODES=2113	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=13.961 ASSIGNMENTS=12539 CHECKS=17728	SAT TT=14.033 ASSIGNMENTS=12539 CHECKS=17728	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=27.041 CHECKS=1314950	SAT TT=13.482 ASSIGNMENTS=8925 CHECKS=712766	SAT TT=10.905 ASSIGNMENTS=7987 CHECKS=576957	SAT TT=31.701	SAT TT=52.702 ASSIGNMENTS=33893 CHECKS=2879500	SAT TT=15.466 ASSIGNMENTS=10304 CHECKS=850296	? TT=89.115	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.14
csp/lexVg/ normalized-crossword-m1c-lex-vg5-5_ext.xml	SAT TT=0.02	SAT TT=0.9 CHECKS=41 NODES=40	SAT TT=0.894 CHECKS=11 NODES=0	SAT TT=3.518	SAT TT=0.396 CHECKS=1194	SAT TT=0.397 CHECKS=1131	SAT TT=1.257 ASSIGNMENTS=13	SAT TT=1.385 ASSIGNMENTS=32	SAT TT=39.172 CHECKS=28272600 NODES=25	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=0.03 ASSIGNMENTS=16 CHECKS=616	SAT TT=0.032 ASSIGNMENTS=16 CHECKS=616	SAT TT=16.753	SAT TT=7.432	SAT TT=0.044 CHECKS=1636	SAT TT=0.02 ASSIGNMENTS=16 CHECKS=572	SAT TT=0.015 ASSIGNMENTS=7 CHECKS=202	SAT TT=0.808	SAT TT=0.036 ASSIGNMENTS=41 CHECKS=1426	SAT TT=0.021 ASSIGNMENTS=16 CHECKS=616	? (MO) TT=33.176	SAT TT=0.965 ASSIGNMENTS=50 CHECKS=5442460	SAT TT=7.881	SAT TT=10.453
csp/lexVg/ normalized-crossword-m1c-lex-vg5-6_ext.xml	SAT TT=5.481	SAT TT=14.966 CHECKS=67154 NODES=34824	SAT TT=7.608 CHECKS=27230 NODES=18004	SAT TT=1434.67	SAT TT=288.28 CHECKS=1413740	SAT TT=511.806 CHECKS=2788560	SAT TT=60.654 ASSIGNMENTS=6073	SAT TT=38.659 ASSIGNMENTS=2881	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=21.738 ASSIGNMENTS=34824 CHECKS=67154	SAT TT=20.968 ASSIGNMENTS=34824 CHECKS=67154	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=5.481 CHECKS=300900	SAT TT=39.486 ASSIGNMENTS=31273 CHECKS=2360280	SAT TT=10.026 ASSIGNMENTS=8886 CHECKS=578393	SAT TT=131.506	SAT TT=24.026 ASSIGNMENTS=18289 CHECKS=1333380	SAT TT=31.575 ASSIGNMENTS=23984 CHECKS=1805910	? (MO) TT=33.896	SAT TT=1169.48 ASSIGNMENTS=919 CHECKS=25025400	SAT TT=388.49	SAT TT=100.415
csp/lexVg/ normalized-crossword-m1c-lex-vg5-7_ext.xml	UNSAT TT=113.01	UNSAT TT=113.01 CHECKS=553586 NODES=217904	UNSAT TT=121.249 CHECKS=555619 NODES=222056	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=1042.07 ASSIGNMENTS=86032	UNSAT TT=1353.24 ASSIGNMENTS=73497	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=116.863 ASSIGNMENTS=217904 CHECKS=553586	UNSAT TT=116.706 ASSIGNMENTS=217904 CHECKS=553586	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=248.753 CHECKS=10004200	UNSAT TT=230.921 ASSIGNMENTS=134726 CHECKS=11781500	UNSAT TT=273.408 ASSIGNMENTS=155190 CHECKS=13480400	UNSAT TT=1468.67	UNSAT TT=294.211 ASSIGNMENTS=162921 CHECKS=14358100	UNSAT TT=275.054 ASSIGNMENTS=149956 CHECKS=13027900	? (MO) TT=36.928	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.13
csp/lexVg/ normalized-crossword-m1c-lex-vg5-8_ext.xml	UNSAT TT=54.047	UNSAT TT=54.047 CHECKS=177197 NODES=79365	UNSAT TT=73.236 CHECKS=192182 NODES=96226	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=463.75 ASSIGNMENTS=37211	UNSAT TT=525.961 ASSIGNMENTS=27337	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=61.254 ASSIGNMENTS=79365 CHECKS=177197	UNSAT TT=61.763 ASSIGNMENTS=79365 CHECKS=177197	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=111.967 CHECKS=4011410	UNSAT TT=149.995 ASSIGNMENTS=66894 CHECKS=6523850	UNSAT TT=128.855 ASSIGNMENTS=59690 CHECKS=5669970	UNSAT TT=785.589	UNSAT TT=132.879 ASSIGNMENTS=59941 CHECKS=5923160	UNSAT TT=141.269 ASSIGNMENTS=68671 CHECKS=6687120	? (MO) TT=31.666	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.11
csp/lexVg/ normalized-crossword-m1c-lex-vg5-9_ext.xml	UNSAT TT=24.422	UNSAT TT=26.015 CHECKS=39642 NODES=26821	UNSAT TT=24.422 CHECKS=45677 NODES=26632	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=681.814 CHECKS=2370920	UNSAT TT=99.853 ASSIGNMENTS=6430	UNSAT TT=227.732 ASSIGNMENTS=9209	UNSAT TT=1471.33 CHECKS=19400100000 NODES=32922	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=31.488 ASSIGNMENTS=26821 CHECKS=39642	UNSAT TT=31.45 ASSIGNMENTS=26821 CHECKS=39642	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=73.371 CHECKS=2175040	UNSAT TT=39.676 ASSIGNMENTS=16104 CHECKS=1751530	UNSAT TT=41.817 ASSIGNMENTS=17833 CHECKS=1817980	UNSAT TT=425.674	UNSAT TT=55.295 ASSIGNMENTS=21432 CHECKS=2264480	UNSAT TT=42.57 ASSIGNMENTS=16042 CHECKS=1744540	? (MO) TT=32.274	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08
csp/lexVg/ normalized-crossword-m1c-lex-vg6-10_ext.xml	UNSAT TT=9.73	UNSAT TT=11.104 CHECKS=8326 NODES=6470	UNSAT TT=9.73 CHECKS=7068 NODES=5945	? (TO) TT=1800.11	UNSAT TT=253.363 CHECKS=685443	UNSAT TT=189.733 CHECKS=560726	UNSAT TT=44.96 ASSIGNMENTS=1818	UNSAT TT=170.455 ASSIGNMENTS=4764	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=18.029 ASSIGNMENTS=6470 CHECKS=8326	UNSAT TT=18.838 ASSIGNMENTS=6470 CHECKS=8326	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=28.994 CHECKS=407705	UNSAT TT=16.8 ASSIGNMENTS=4326 CHECKS=580228	UNSAT TT=25.002 ASSIGNMENTS=7420 CHECKS=832156	UNSAT TT=137.664	UNSAT TT=16.611 ASSIGNMENTS=4523 CHECKS=562966	UNSAT TT=17.585 ASSIGNMENTS=4497 CHECKS=604233	? TT=70.152	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.02
csp/lexVg/ normalized-crossword-m1c-lex-vg6-6_ext.xml	SAT TT=0.038	SAT TT=1.792 CHECKS=1191 NODES=1338	SAT TT=2.302 CHECKS=1818 NODES=1929	? (TO) TT=1800.05	SAT TT=5.758 CHECKS=29328	SAT TT=9.541 CHECKS=51071	SAT TT=13.062 ASSIGNMENTS=741	SAT TT=16.543 ASSIGNMENTS=644	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1.115 ASSIGNMENTS=580 CHECKS=52453	SAT TT=1.13 ASSIGNMENTS=580 CHECKS=52453	SAT TT=468.03	SAT TT=84.71	SAT TT=0.618 CHECKS=24183	SAT TT=9.907 ASSIGNMENTS=5182 CHECKS=487622	SAT TT=5.45 ASSIGNMENTS=3669 CHECKS=220267	SAT TT=25.22	SAT TT=0.038 ASSIGNMENTS=18 CHECKS=1051	SAT TT=1.119 ASSIGNMENTS=580 CHECKS=52453	? TT=81.992	SAT TT=344.255 ASSIGNMENTS=861 CHECKS=692529000	SAT TT=168.793	SAT TT=265.099
csp/lexVg/ normalized-crossword-m1c-lex-vg6-8_ext.xml	UNSAT TT=81.531	UNSAT TT=81.531 CHECKS=184004 NODES=86556	UNSAT TT=85.263 CHECKS=165544 NODES=82937	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=382.009 ASSIGNMENTS=21381	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.1	UNSAT TT=94.433 ASSIGNMENTS=86556 CHECKS=184004	UNSAT TT=88.698 ASSIGNMENTS=86556 CHECKS=184004	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=200.206 CHECKS=4343720	UNSAT TT=139.865 ASSIGNMENTS=48746 CHECKS=5602740	UNSAT TT=144.642 ASSIGNMENTS=50798 CHECKS=5777040	UNSAT TT=1588.24	UNSAT TT=155.979 ASSIGNMENTS=50043 CHECKS=5808880	UNSAT TT=147.117 ASSIGNMENTS=50737 CHECKS=5833450	? TT=76.066	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09
csp/lexVg/ normalized-crossword-m1c-lex-vg6-9_ext.xml	UNSAT TT=28.952	UNSAT TT=39.342 CHECKS=56094 NODES=28413	UNSAT TT=28.952 CHECKS=39520 NODES=20961	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=803.118 CHECKS=2408340	UNSAT TT=166.768 ASSIGNMENTS=8020	UNSAT TT=851.778 ASSIGNMENTS=25462	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=43.435 ASSIGNMENTS=28413 CHECKS=56094	UNSAT TT=43.196 ASSIGNMENTS=28413 CHECKS=56094	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=93.842 CHECKS=1681860	UNSAT TT=64.502 ASSIGNMENTS=17705 CHECKS=2225640	UNSAT TT=55.206 ASSIGNMENTS=16800 CHECKS=2007220	UNSAT TT=620.48	UNSAT TT=46.203 ASSIGNMENTS=12884 CHECKS=1590250	UNSAT TT=58.808 ASSIGNMENTS=15940 CHECKS=2046330	? TT=77.226	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg7-10_ext.xml	UNSAT TT=10.191	UNSAT TT=10.191 CHECKS=2573 NODES=5081	UNSAT TT=10.815 CHECKS=4929 NODES=5427	? (TO) TT=1800.03	UNSAT TT=321.609 CHECKS=778394	UNSAT TT=204.588 CHECKS=469694	UNSAT TT=34.439 ASSIGNMENTS=885	UNSAT TT=135.204 ASSIGNMENTS=3112	UNSAT TT=20.883 CHECKS=0 NODES=5397	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=16.559 ASSIGNMENTS=5081 CHECKS=2573	UNSAT TT=17.843 ASSIGNMENTS=5081 CHECKS=2573	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=66.523 CHECKS=802216	UNSAT TT=19.345 ASSIGNMENTS=3904 CHECKS=593591	UNSAT TT=27.061 ASSIGNMENTS=6624 CHECKS=797786	UNSAT TT=171.092	UNSAT TT=13.506 ASSIGNMENTS=3128 CHECKS=416562	UNSAT TT=18.522 ASSIGNMENTS=3720 CHECKS=568056	? TT=76.499	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.02
csp/lexVg/ normalized-crossword-m1c-lex-vg7-8_ext.xml	UNSAT TT=81.69	UNSAT TT=87.174 CHECKS=201289 NODES=72247	UNSAT TT=81.69 CHECKS=201777 NODES=66473	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=1397.94 CHECKS=3717400	UNSAT TT=350.519 ASSIGNMENTS=15347	UNSAT TT=1296.04 ASSIGNMENTS=35283	UNSAT TT=257.786 CHECKS=0 NODES=105887	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=88.609 ASSIGNMENTS=72247 CHECKS=201289	UNSAT TT=88.827 ASSIGNMENTS=72247 CHECKS=201289	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=254.472 CHECKS=4424240	UNSAT TT=250.017 ASSIGNMENTS=61554 CHECKS=8324050	UNSAT TT=142.02 ASSIGNMENTS=35950 CHECKS=4527790	UNSAT TT=1367.69	UNSAT TT=223.413 ASSIGNMENTS=55319 CHECKS=7251720	UNSAT TT=190.978 ASSIGNMENTS=46456 CHECKS=6124340	? TT=91.849	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09
csp/lexVg/ normalized-crossword-m1c-lex-vg7-9_ext.xml	UNSAT TT=30.657	UNSAT TT=30.657 CHECKS=41191 NODES=21224	UNSAT TT=33.966 CHECKS=56096 NODES=21473	? (TO) TT=1800.13	UNSAT TT=914.653 CHECKS=2276300	UNSAT TT=721.99 CHECKS=1838910	UNSAT TT=586.789 ASSIGNMENTS=19560	UNSAT TT=335.795 ASSIGNMENTS=8491	UNSAT TT=93.068 CHECKS=0 NODES=31989	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=37.412 ASSIGNMENTS=21224 CHECKS=41191	UNSAT TT=37.23 ASSIGNMENTS=21224 CHECKS=41191	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=135.989 CHECKS=2042900	UNSAT TT=70.163 ASSIGNMENTS=15252 CHECKS=2164980	UNSAT TT=58.358 ASSIGNMENTS=13817 CHECKS=1746510	UNSAT TT=466.618	UNSAT TT=51.589 ASSIGNMENTS=11677 CHECKS=1591190	UNSAT TT=49.639 ASSIGNMENTS=11558 CHECKS=1636660	? TT=89.817	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.02
csp/lexVg/ normalized-crossword-m1c-lex-vg8-12_ext.xml	UNSAT TT=1.051	UNSAT TT=1.642 CHECKS=33 NODES=220	UNSAT TT=3.16 CHECKS=28 NODES=191	? (TO) TT=1800.05	UNSAT TT=51.803 CHECKS=123458	UNSAT TT=16.962 CHECKS=35104	UNSAT TT=15.986 ASSIGNMENTS=20	UNSAT TT=16.241 ASSIGNMENTS=16	UNSAT TT=2.011 CHECKS=0 NODES=264	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=1.222 ASSIGNMENTS=209 CHECKS=33829	UNSAT TT=1.221 ASSIGNMENTS=209 CHECKS=33829	UNSAT TT=94.475	UNSAT TT=43.092	UNSAT TT=1.968 CHECKS=17670	UNSAT TT=1.051 ASSIGNMENTS=183 CHECKS=29040	UNSAT TT=14.854 ASSIGNMENTS=3437 CHECKS=401250	UNSAT TT=10.053	UNSAT TT=4.622 ASSIGNMENTS=1230 CHECKS=126819	UNSAT TT=1.194 ASSIGNMENTS=209 CHECKS=33829	? TT=33.488	? (TO) TT=1800.07	UNSAT TT=165.665	? (TO) TT=1800.09
csp/lexVg/ normalized-crossword-m1c-lex-vg8-8_ext.xml	UNSAT TT=41.382	UNSAT TT=44.378 CHECKS=57921 NODES=25529	UNSAT TT=41.382 CHECKS=60510 NODES=26356	? (TO) TT=1800.06	UNSAT TT=665.823 CHECKS=2337270	UNSAT TT=1058.7 CHECKS=3496070	UNSAT TT=624.682 ASSIGNMENTS=20986	? (TO) TT=1800.07	UNSAT TT=117.416 CHECKS=0 NODES=37004	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=49.505 ASSIGNMENTS=25047 CHECKS=57145	UNSAT TT=52.717 ASSIGNMENTS=25047 CHECKS=57145	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=117.481 CHECKS=1866740	UNSAT TT=126.588 ASSIGNMENTS=27845 CHECKS=4042700	UNSAT TT=76.948 ASSIGNMENTS=17353 CHECKS=2324880	UNSAT TT=560.966	UNSAT TT=123.224 ASSIGNMENTS=26884 CHECKS=3848170	UNSAT TT=81.442 ASSIGNMENTS=17445 CHECKS=2518560	? TT=32.642	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07
csp/lexVg/ normalized-crossword-m1c-lex-vg8-9_ext.xml	UNSAT TT=16.812	UNSAT TT=16.812 CHECKS=11528 NODES=7482	UNSAT TT=19.493 CHECKS=18281 NODES=8704	? (TO) TT=1800.06	UNSAT TT=497.331 CHECKS=1061760	UNSAT TT=315.34 CHECKS=676415	UNSAT TT=95.673 ASSIGNMENTS=2788	UNSAT TT=654.701 ASSIGNMENTS=12117	UNSAT TT=40.437 CHECKS=0 NODES=9731	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=23.768 ASSIGNMENTS=7482 CHECKS=11528	UNSAT TT=24.03 ASSIGNMENTS=7482 CHECKS=11528	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=68.586 CHECKS=737436	UNSAT TT=30.558 ASSIGNMENTS=5550 CHECKS=869739	UNSAT TT=39.64 ASSIGNMENTS=8434 CHECKS=1100810	UNSAT TT=539.045	UNSAT TT=21.744 ASSIGNMENTS=4366 CHECKS=628606	UNSAT TT=39.919 ASSIGNMENTS=7439 CHECKS=1135480	? TT=24.921	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08
csp/lexVg/ normalized-crossword-m1c-lex-vg9-10_ext.xml	UNSAT TT=5.347	UNSAT TT=5.347 CHECKS=149 NODES=1309	UNSAT TT=5.434 CHECKS=129 NODES=1252	? (TO) TT=1800.09	UNSAT TT=116.417 CHECKS=235006	UNSAT TT=97.733 CHECKS=171745	UNSAT TT=25.666 ASSIGNMENTS=290	UNSAT TT=143.003 ASSIGNMENTS=2171	UNSAT TT=10.453 CHECKS=0 NODES=1606	? (TO) TT=1800	? (TO) TT=1800.1	UNSAT TT=12.375 ASSIGNMENTS=1309 CHECKS=149	UNSAT TT=12.945 ASSIGNMENTS=1309 CHECKS=149	UNSAT TT=535.569	UNSAT TT=464.654	UNSAT TT=18.442 CHECKS=140229	UNSAT TT=6.353 ASSIGNMENTS=969 CHECKS=188303	UNSAT TT=21.078 ASSIGNMENTS=4384 CHECKS=545587	UNSAT TT=59.797	UNSAT TT=11.228 ASSIGNMENTS=2238 CHECKS=305118	UNSAT TT=7.269 ASSIGNMENTS=1047 CHECKS=203531	? TT=31.714	? (TO) TT=1800.04	UNSAT TT=1389.91	? (TO) TT=1800.03
csp/lexVg/ normalized-crossword-m1c-lex-vg9-12_ext.xml	UNSAT TT=0.747	UNSAT TT=1.275 CHECKS=0 NODES=103	UNSAT TT=3.472 CHECKS=0 NODES=109	? (TO) TT=1800.08	UNSAT TT=30.283 CHECKS=75131	UNSAT TT=11.949 CHECKS=25367	UNSAT TT=19.074 ASSIGNMENTS=0	UNSAT TT=18.929 ASSIGNMENTS=0	UNSAT TT=1.757 CHECKS=0 NODES=152	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.942 ASSIGNMENTS=156 CHECKS=25448	UNSAT TT=0.937 ASSIGNMENTS=156 CHECKS=25448	UNSAT TT=57.316	UNSAT TT=44.296	UNSAT TT=2.892 CHECKS=19941	UNSAT TT=0.747 ASSIGNMENTS=118 CHECKS=19036	UNSAT TT=16.836 ASSIGNMENTS=3356 CHECKS=430306	UNSAT TT=10.644	UNSAT TT=5.721 ASSIGNMENTS=1389 CHECKS=146535	UNSAT TT=0.998 ASSIGNMENTS=156 CHECKS=25448	? TT=39.105	? (TO) TT=1800.1	UNSAT TT=155.094	? (TO) TT=1800.07
csp/lexVg/ normalized-crossword-m1c-lex-vg9-9_ext.xml	UNSAT TT=10.384	UNSAT TT=10.384 CHECKS=1840 NODES=3110	UNSAT TT=12.865 CHECKS=2142 NODES=3871	? (TO) TT=1800.09	UNSAT TT=206.949 CHECKS=545607	UNSAT TT=200.06 CHECKS=595263	UNSAT TT=44.966 ASSIGNMENTS=859	UNSAT TT=223.399 ASSIGNMENTS=4120	UNSAT TT=32.394 CHECKS=0 NODES=5241	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=17.56 ASSIGNMENTS=3450 CHECKS=2792	UNSAT TT=17.928 ASSIGNMENTS=3450 CHECKS=2792	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=26.255 CHECKS=274715	UNSAT TT=20.787 ASSIGNMENTS=3398 CHECKS=577238	UNSAT TT=28.083 ASSIGNMENTS=5806 CHECKS=732491	UNSAT TT=155.491	UNSAT TT=16.293 ASSIGNMENTS=3385 CHECKS=478366	UNSAT TT=16.977 ASSIGNMENTS=2892 CHECKS=461466	? TT=38.363	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09
csp/magicSquare/ normalized-magicSquare-10_glb.xml	SAT TT=1.684	? (TO) TT=1800.16	? (TO) TT=1800.13	SAT TT=897.768	SAT TT=11.69 CHECKS=1031510	SAT TT=17.067 CHECKS=1505360	? (TO) TT=1800.1	SAT TT=27.619 ASSIGNMENTS=27069	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.12	SAT TT=1.684 ASSIGNMENTS=17786 CHECKS=2032110	? (TO) TT=1800.05	? TT=1.023	No data	SAT TT=85.986	SAT TT=1469.4
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/magicSquare/ normalized-magicSquare-11_glb.xml	SAT TT=11.823	? (TO) TT=1800.13	? (TO) TT=1800.14	SAT TT=902.69	SAT TT=11.823 CHECKS=634265	SAT TT=17.951 CHECKS=962199	? (TO) TT=1800.09	SAT TT=11.894 ASSIGNMENTS=7539	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=18.713 ASSIGNMENTS=190903 CHECKS=18299700	? (TO) TT=1800.06	? TT=1.03	No data	? (MO) TT=79.22	? (MO) TT=287.98
csp/magicSquare/ normalized-magicSquare-12_glb.xml	SAT TT=5.187	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT TT=1127.58	SAT TT=13.175 CHECKS=551132	SAT TT=17.86 CHECKS=650219	? (TO) TT=1800.03	? (TO) TT=1800.12	No data	No data	No data	SAT TT=177.024 ASSIGNMENTS=1374760 CHECKS=208353000	SAT TT=1039.5 ASSIGNMENTS=1374760 CHECKS=208353000	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=5.187 ASSIGNMENTS=37059 CHECKS=6716080	SAT TT=168.943 ASSIGNMENTS=1374760 CHECKS=208353000	? TT=1.036	No data	? (MO) TT=143.12	? (MO) TT=349.53
csp/magicSquare/ normalized-magicSquare-13_glb.xml	SAT TT=2.879	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=949.141	SAT TT=2.879 CHECKS=182281	SAT TT=51.364 CHECKS=3103840	? (TO) TT=1800.12	SAT TT=436.179 ASSIGNMENTS=263294	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.03	No data	No data	No data	SAT TT=459.794 ASSIGNMENTS=7304620 CHECKS=410981000	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.05	? TT=0.971	No data	? TT=173.272	? TT=180.475
csp/magicSquare/ normalized-magicSquare-14_glb.xml	SAT TT=64.383	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=64.383 CHECKS=5363900	SAT TT=71.769 CHECKS=5967680	? (TO) TT=1800.18	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.07	? TT=1.013	No data	? TT=181.403	? TT=180.054
csp/magicSquare/ normalized-magicSquare-15_glb.xml	SAT TT=8.089	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=8.639 CHECKS=328051	SAT TT=8.089 CHECKS=240652	? (TO) TT=1800.05	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	No data	No data	? (TO) TT=1800	? (TO) TT=1800.1	? (problem) TT=0.444	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=1.042	No data	? TT=172.858	? TT=171.081
csp/magicSquare/ normalized-magicSquare-16_glb.xml	SAT TT=48.292	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.08	SAT TT=48.292 CHECKS=2420730	SAT TT=791.607 CHECKS=67704600	? (TO) TT=1800.03	? (TO) TT=1800.12	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.08	? (problem) TT=0.483	SAT TT=1422.89 ASSIGNMENTS=5194840 CHECKS=1569760000	? (TO) TT=1800.1	? TT=1.024	No data	? TT=173.316	? TT=174.792
csp/magicSquare/ normalized-magicSquare-17_glb.xml	SAT TT=455.393	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.08	SAT TT=586.94 CHECKS=24257900	SAT TT=455.393 CHECKS=16141600	? (TO) TT=1800.09	? (TO) TT=1800.13	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.08	? (problem) TT=0.512	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=1.086	No data	? TT=170.987	? TT=170.526
csp/magicSquare/ normalized-magicSquare-18_glb.xml	SAT TT=382.126	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=382.126 CHECKS=15470000	SAT TT=467.941 CHECKS=4933040	? (TO) TT=1800.1	? (TO) TT=1800.16	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.03	? (problem) TT=0.549	? (TO) TT=1800.05	? (TO) TT=1800.1	? TT=1.147	No data	? TT=167.519	? TT=166.378
csp/magicSquare/ normalized-magicSquare-19_glb.xml		? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.04	? (problem) TT=0.444	? (TO) TT=1800.05	? (TO) TT=1800.07	? TT=1.105	No data	? TT=171.233	? TT=166.991
csp/magicSquare/ normalized-magicSquare-20_glb.xml		? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.03	? (problem) TT=0.467	? (TO) TT=1800.11	? (TO) TT=1800.03	? TT=1.177	No data	? TT=173.315	? TT=173.279
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/magicSquare/ normalized-magicSquare-3_glb.xml	SAT TT=0.005	SAT TT=0.656 CHECKS=69 NODES=96	SAT TT=0.668 CHECKS=71 NODES=73	SAT TT=0.026	SAT TT=0.008 CHECKS=815	SAT TT=3.704 CHECKS=717	SAT TT=0.456 ASSIGNMENTS=3	SAT TT=0.541 ASSIGNMENTS=3	No data	No data	No data	SAT TT=0.018 ASSIGNMENTS=8 CHECKS=252	SAT TT=0.018 ASSIGNMENTS=8 CHECKS=252	No data	No data	No data	SAT TT=0.005 ASSIGNMENTS=8 CHECKS=254	SAT TT=0.006 ASSIGNMENTS=2 CHECKS=148	SAT TT=0.25	SAT TT=0.006 ASSIGNMENTS=22 CHECKS=651	SAT TT=0.007 ASSIGNMENTS=8 CHECKS=252	? TT=0.675	No data	SAT TT=0.541	SAT TT=0.631
csp/magicSquare/ normalized-magicSquare-4_glb.xml	SAT TT=0.006	SAT TT=0.743 CHECKS=457 NODES=415	SAT TT=0.768 CHECKS=924 NODES=739	SAT TT=0.03	SAT TT=0.031 CHECKS=7052	SAT TT=0.014 CHECKS=1395	SAT TT=0.444 ASSIGNMENTS=9	SAT TT=0.497 ASSIGNMENTS=6	No data	No data	No data	SAT TT=0.022 ASSIGNMENTS=47 CHECKS=3302	SAT TT=0.022 ASSIGNMENTS=47 CHECKS=3302	No data	No data	No data	SAT TT=0.006 ASSIGNMENTS=32 CHECKS=2135	SAT TT=0.007 ASSIGNMENTS=33 CHECKS=1862	SAT TT=0.274	SAT TT=0.007 ASSIGNMENTS=109 CHECKS=3940	SAT TT=0.007 ASSIGNMENTS=49 CHECKS=3204	? TT=0.692	No data	SAT TT=0.715	SAT TT=0.907
csp/magicSquare/ normalized-magicSquare-5_glb.xml	SAT TT=0.017	SAT TT=1.234 CHECKS=17551 NODES=8654	SAT TT=2.684 CHECKS=123515 NODES=36055	SAT TT=0.851	SAT TT=0.229 CHECKS=71461	SAT TT=0.228 CHECKS=71646	SAT TT=0.668 ASSIGNMENTS=64	SAT TT=0.632 ASSIGNMENTS=177	No data	No data	No data	SAT TT=0.028 ASSIGNMENTS=233 CHECKS=18393	SAT TT=0.028 ASSIGNMENTS=233 CHECKS=18393	No data	No data	No data	SAT TT=0.104 ASSIGNMENTS=2840 CHECKS=228577	SAT TT=0.106 ASSIGNMENTS=3550 CHECKS=211776	SAT TT=0.464	SAT TT=0.036 ASSIGNMENTS=1022 CHECKS=48130	SAT TT=0.017 ASSIGNMENTS=302 CHECKS=23965	? TT=0.676	No data	SAT TT=1.892	SAT TT=3.019
csp/magicSquare/ normalized-magicSquare-6_glb.xml	SAT TT=0.08	SAT TT=1.693 CHECKS=37713 NODES=13992	SAT TT=1.786 CHECKS=39143 NODES=14132	SAT TT=1799.65	SAT TT=10.798 CHECKS=2761000	SAT TT=16.947 CHECKS=4038360	SAT TT=0.784 ASSIGNMENTS=460	SAT TT=0.727 ASSIGNMENTS=186	No data	No data	No data	SAT TT=7.848 ASSIGNMENTS=6772 CHECKS=558799	SAT TT=7.323 ASSIGNMENTS=6772 CHECKS=558799	No data	No data	No data	SAT TT=1.715 ASSIGNMENTS=58740 CHECKS=3127750	SAT TT=259.053 ASSIGNMENTS=6457830 CHECKS=548311000	? (TO) TT=1800.07	SAT TT=0.08 ASSIGNMENTS=2218 CHECKS=122183	SAT TT=0.299 ASSIGNMENTS=6772 CHECKS=558799	? TT=0.667	No data	SAT TT=2.712	SAT TT=7.445
csp/magicSquare/ normalized-magicSquare-7_glb.xml	SAT TT=0.026	SAT TT=13.784 CHECKS=1117200 NODES=163190	? (TO) TT=1800.05	SAT TT=896.631	SAT TT=11.605 CHECKS=2095220	SAT TT=17.125 CHECKS=3084090	SAT TT=914.911 ASSIGNMENTS=1919250	SAT TT=1.319 ASSIGNMENTS=742	No data	No data	No data	SAT TT=7.604 ASSIGNMENTS=314 CHECKS=32107	SAT TT=7.614 ASSIGNMENTS=314 CHECKS=32107	No data	No data	No data	SAT TT=440.359 ASSIGNMENTS=11124100 CHECKS=808020000	? (TO) TT=1800.07	SAT TT=0.425	SAT TT=0.209 ASSIGNMENTS=4432 CHECKS=298159	SAT TT=0.026 ASSIGNMENTS=314 CHECKS=32107	? TT=0.719	No data	SAT TT=7.195	SAT TT=26.429
csp/magicSquare/ normalized-magicSquare-8_glb.xml	SAT TT=2.543	SAT TT=3.42 CHECKS=296792 NODES=23997	SAT TT=3.665 CHECKS=296792 NODES=23997	SAT TT=898.005	SAT TT=11.76 CHECKS=1737520	SAT TT=17.584 CHECKS=2595040	SAT TT=18.988 ASSIGNMENTS=19284	SAT TT=2.603 ASSIGNMENTS=1986	No data	No data	No data	SAT TT=14.198 ASSIGNMENTS=108600 CHECKS=10326200	SAT TT=14.623 ASSIGNMENTS=108600 CHECKS=10326200	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=2.543 ASSIGNMENTS=45148 CHECKS=3448070	SAT TT=6.275 ASSIGNMENTS=108600 CHECKS=10326200	? TT=0.839	No data	SAT TT=26.021	SAT TT=56.141
csp/magicSquare/ normalized-magicSquare-9_glb.xml	SAT TT=0.065	? (TO) TT=1800.15	? (TO) TT=1800.15	SAT TT=893.426	SAT TT=10.648 CHECKS=1471050	SAT TT=17.296 CHECKS=2174290	? (TO) TT=1800.1	SAT TT=1.74 ASSIGNMENTS=183	No data	No data	No data	SAT TT=0.11 ASSIGNMENTS=1423 CHECKS=125827	SAT TT=0.115 ASSIGNMENTS=1423 CHECKS=125827	No data	No data	No data	SAT TT=0.065 ASSIGNMENTS=841 CHECKS=80394	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=1.397 ASSIGNMENTS=18986 CHECKS=1655010	SAT TT=261.797 ASSIGNMENTS=4336780 CHECKS=396504000	? TT=0.921	No data	SAT TT=581.719	SAT TT=569.869
csp/marc/ normalized-large-80-sat_ext.xml	SAT TT=9.085	SAT TT=11.884 CHECKS=34612 NODES=80	SAT TT=12.754 CHECKS=34612 NODES=0	? (problem) TT=276.855	SAT TT=16.323 CHECKS=4953	SAT TT=16.346 CHECKS=4953	SAT TT=13.289 ASSIGNMENTS=1	SAT TT=13.658 ASSIGNMENTS=1	SAT TT=49.399 CHECKS=35136 NODES=80	SAT TT=45.328 CHECKS=51592 NODES=0	SAT TT=46.868 CHECKS=51592 NODES=0	SAT TT=9.711 ASSIGNMENTS=0 CHECKS=9401	SAT TT=9.86 ASSIGNMENTS=0 CHECKS=9401	? (TO) TT=1800.06	? (TO) TT=1800.02	No data	SAT TT=9.735 ASSIGNMENTS=0 CHECKS=9401	SAT TT=9.708 ASSIGNMENTS=0 CHECKS=9401	? (exit code) TT=69.884	SAT TT=9.085 ASSIGNMENTS=0 CHECKS=9401	SAT TT=9.568 ASSIGNMENTS=0 CHECKS=9401	SAT TT=45.187	SAT TT=26.696 ASSIGNMENTS=80 CHECKS=31232	? (MO) TT=24.37	? (MO) TT=23.46
csp/marc/ normalized-large-80-unsat_ext.xml	UNSAT TT=7.233	UNSAT TT=10.136 CHECKS=1146780 NODES=79	UNSAT TT=10.2 CHECKS=1181720 NODES=0	? (problem) TT=213.208	UNSAT TT=72.162 CHECKS=60976	UNSAT TT=51.007 CHECKS=40620	UNSAT TT=13.099 ASSIGNMENTS=1	UNSAT TT=12.609 ASSIGNMENTS=1	UNSAT TT=39.552 CHECKS=1281460 NODES=128	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=7.784 ASSIGNMENTS=123 CHECKS=22876	UNSAT TT=7.831 ASSIGNMENTS=123 CHECKS=22876	? (TO) TT=1800.06	UNSAT TT=317.066	No data	UNSAT TT=7.233 ASSIGNMENTS=79 CHECKS=15801	UNSAT TT=8.737 ASSIGNMENTS=3028 CHECKS=486042	? (exit code) TT=30.115	UNSAT TT=7.637 ASSIGNMENTS=79 CHECKS=15801	UNSAT TT=7.699 ASSIGNMENTS=123 CHECKS=22876	UNSAT TT=37.149	UNSAT TT=22.689 ASSIGNMENTS=80 CHECKS=910185	? (MO) TT=21.34	? (MO) TT=20.36
csp/marc/ normalized-large-84-sat_ext.xml	SAT TT=11.008	SAT TT=15.023 CHECKS=49944 NODES=84	SAT TT=15.211 CHECKS=49944 NODES=0	? (problem) TT=329.025	SAT TT=16.189 CHECKS=5532	SAT TT=16.754 CHECKS=5532	SAT TT=15.886 ASSIGNMENTS=1	SAT TT=15.036 ASSIGNMENTS=1	SAT TT=55.895 CHECKS=87803 NODES=84	SAT TT=55.453 CHECKS=109463 NODES=0	SAT TT=50.726 CHECKS=109463 NODES=0	SAT TT=11.008 ASSIGNMENTS=0 CHECKS=10375	SAT TT=11.797 ASSIGNMENTS=0 CHECKS=10375	? (problem) TT=185.134	? (problem) TT=177.841	No data	SAT TT=11.858 ASSIGNMENTS=0 CHECKS=10375	SAT TT=11.798 ASSIGNMENTS=0 CHECKS=10375	? (exit code) TT=29.635	SAT TT=11.841 ASSIGNMENTS=0 CHECKS=10375	SAT TT=11.67 ASSIGNMENTS=0 CHECKS=10375	SAT TT=50.11	SAT TT=35.453 ASSIGNMENTS=85 CHECKS=35028	? (MO) TT=26.8	? (MO) TT=26.84
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/marc/ normalized-large-84-unsat_ext.xml	UNSAT TT=8.963	UNSAT TT=13.002 CHECKS=1239080 NODES=82	UNSAT TT=13.188 CHECKS=1413230 NODES=0	? (problem) TT=253.355	UNSAT TT=100.677 CHECKS=73853	UNSAT TT=59.284 CHECKS=41942	UNSAT TT=14.614 ASSIGNMENTS=1	UNSAT TT=16.017 ASSIGNMENTS=1	UNSAT TT=50.34 CHECKS=1375600 NODES=123	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=8.963 ASSIGNMENTS=130 CHECKS=25612	UNSAT TT=9.176 ASSIGNMENTS=130 CHECKS=25612	? (problem) TT=130.743	? (problem) TT=129.726	No data	UNSAT TT=9.53 ASSIGNMENTS=83 CHECKS=17431	UNSAT TT=10.376 ASSIGNMENTS=3034 CHECKS=512771	? (exit code) TT=32.224	UNSAT TT=9.585 ASSIGNMENTS=83 CHECKS=17680	UNSAT TT=9.564 ASSIGNMENTS=130 CHECKS=25612	UNSAT TT=47.734	UNSAT TT=28.634 ASSIGNMENTS=84 CHECKS=1041690	? (MO) TT=22.545	? (MO) TT=22.72
csp/marc/ normalized-large-88-sat_ext.xml	SAT TT=13.162	SAT TT=18.295 CHECKS=41489 NODES=88	SAT TT=16.523 CHECKS=41489 NODES=0	? (problem) TT=369.383	SAT TT=18.862 CHECKS=5939	SAT TT=16.931 CHECKS=5939	SAT TT=26.639 ASSIGNMENTS=1	SAT TT=27.684 ASSIGNMENTS=1	SAT TT=69.672 CHECKS=79561 NODES=88	SAT TT=66.237 CHECKS=99998 NODES=0	SAT TT=66.47 CHECKS=99998 NODES=0	SAT TT=14.165 ASSIGNMENTS=0 CHECKS=11397	SAT TT=14.211 ASSIGNMENTS=0 CHECKS=11397	? (problem) TT=296.501	? (problem) TT=322.321	No data	SAT TT=14.173 ASSIGNMENTS=0 CHECKS=11397	SAT TT=13.162 ASSIGNMENTS=0 CHECKS=11397	? (exit code) TT=109.609	SAT TT=14.912 ASSIGNMENTS=0 CHECKS=11397	SAT TT=14.06 ASSIGNMENTS=0 CHECKS=11397	SAT TT=58.956	SAT TT=41.011 ASSIGNMENTS=88 CHECKS=34037	? (MO) TT=28.16	? (MO) TT=30.202
csp/marc/ normalized-large-88-unsat_ext.xml	UNSAT TT=10.484	UNSAT TT=13.885 CHECKS=1349870 NODES=81	UNSAT TT=14.046 CHECKS=1645020 NODES=0	? (problem) TT=297.964	Signal TT=18.626	Signal TT=19.431	UNSAT TT=18.222 ASSIGNMENTS=1	UNSAT TT=17.078 ASSIGNMENTS=1	UNSAT TT=57.322 CHECKS=1716860 NODES=141	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=11.379 ASSIGNMENTS=136 CHECKS=27629	UNSAT TT=11.282 ASSIGNMENTS=136 CHECKS=27629	? (problem) TT=114.674	? (problem) TT=115.175	No data	UNSAT TT=10.554 ASSIGNMENTS=87 CHECKS=19402	UNSAT TT=13.092 ASSIGNMENTS=3041 CHECKS=538448	? (exit code) TT=27.745	UNSAT TT=10.484 ASSIGNMENTS=87 CHECKS=19315	UNSAT TT=11.159 ASSIGNMENTS=136 CHECKS=27629	UNSAT TT=52.226	UNSAT TT=32.681 ASSIGNMENTS=88 CHECKS=1220360	? TT=161.374	? (MO) TT=25.038
csp/marc/ normalized-large-92-sat_ext.xml	SAT TT=15.846	SAT TT=19.524 CHECKS=51620 NODES=92	SAT TT=21.425 CHECKS=51620 NODES=0	? (problem) TT=468.339	? TT=13.722	? TT=12.909	? (problem) TT=40.885	? (problem) TT=40.01	SAT TT=84.206 CHECKS=56908 NODES=92	SAT TT=79.75 CHECKS=79336 NODES=0	SAT TT=77.373 CHECKS=79336 NODES=0	SAT TT=17.712 ASSIGNMENTS=0 CHECKS=12467	SAT TT=17.23 ASSIGNMENTS=0 CHECKS=12467	? (problem) TT=314.918	? (problem) TT=307.074	No data	SAT TT=16.034 ASSIGNMENTS=0 CHECKS=12467	SAT TT=16.092 ASSIGNMENTS=0 CHECKS=12467	? (exit code) TT=37.853	SAT TT=15.846 ASSIGNMENTS=0 CHECKS=12467	SAT TT=17.156 ASSIGNMENTS=0 CHECKS=12467	SAT TT=70.487	SAT TT=49.051 ASSIGNMENTS=92 CHECKS=58017	? (MO) TT=34.28	? (MO) TT=34.32
csp/marc/ normalized-large-92-unsat_ext.xml	UNSAT TT=12.586	UNSAT TT=16.578 CHECKS=1691770 NODES=91	UNSAT TT=16.317 CHECKS=1909970 NODES=0	? (problem) TT=348.758	Signal TT=21.23	Signal TT=21.084	UNSAT TT=22.33 ASSIGNMENTS=1	UNSAT TT=24.072 ASSIGNMENTS=1	UNSAT TT=62.843 CHECKS=1952880 NODES=147	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=13.831 ASSIGNMENTS=142 CHECKS=30355	UNSAT TT=13.655 ASSIGNMENTS=142 CHECKS=30355	? (problem) TT=319.299	? (problem) TT=318.085	No data	UNSAT TT=12.797 ASSIGNMENTS=91 CHECKS=21022	UNSAT TT=15.677 ASSIGNMENTS=3042 CHECKS=561984	? (exit code) TT=34.357	UNSAT TT=12.586 ASSIGNMENTS=91 CHECKS=20840	UNSAT TT=13.624 ASSIGNMENTS=142 CHECKS=30355	UNSAT TT=63.759	UNSAT TT=38.773 ASSIGNMENTS=92 CHECKS=1376540	? (MO) TT=28.36	? (MO) TT=26.926
csp/marc/ normalized-large-96-sat_ext.xml	SAT TT=18.77	SAT TT=25.172 CHECKS=62678 NODES=96	SAT TT=22.67 CHECKS=62678 NODES=0	? (problem) TT=543.195	? TT=15.68	? TT=15.561	? (problem) TT=38.47	? (problem) TT=40.999	SAT TT=103.741 CHECKS=48181 NODES=96	SAT TT=94.933 CHECKS=72297 NODES=0	SAT TT=97.055 CHECKS=72297 NODES=0	SAT TT=20.426 ASSIGNMENTS=0 CHECKS=13585	SAT TT=20.398 ASSIGNMENTS=0 CHECKS=13585	? (problem) TT=298.973	? (problem) TT=301.079	No data	SAT TT=20.398 ASSIGNMENTS=0 CHECKS=13585	SAT TT=20.455 ASSIGNMENTS=0 CHECKS=13585	? (exit code) TT=115.378	SAT TT=21.135 ASSIGNMENTS=0 CHECKS=13585	SAT TT=18.77 ASSIGNMENTS=0 CHECKS=13585	SAT TT=113.776	SAT TT=54.726 ASSIGNMENTS=103 CHECKS=67904	? (MO) TT=39.3	? (MO) TT=36.89
csp/marc/ normalized-large-96-unsat_ext.xml	UNSAT TT=15.143	UNSAT TT=20.664 CHECKS=1934710 NODES=95	UNSAT TT=20.578 CHECKS=2215540 NODES=0	? (problem) TT=426.432	? TT=12.262	? TT=13.04	? (problem) TT=42.723	? (problem) TT=43.281	UNSAT TT=82.913 CHECKS=2209300 NODES=153	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=16.876 ASSIGNMENTS=149 CHECKS=33400	UNSAT TT=16.488 ASSIGNMENTS=149 CHECKS=33400	? (problem) TT=308.015	? (problem) TT=325.828	No data	UNSAT TT=15.889 ASSIGNMENTS=95 CHECKS=23086	UNSAT TT=17.307 ASSIGNMENTS=3052 CHECKS=587597	? (exit code) TT=44.863	UNSAT TT=16.057 ASSIGNMENTS=95 CHECKS=22991	UNSAT TT=15.143 ASSIGNMENTS=149 CHECKS=33400	? TT=119.82	UNSAT TT=46.805 ASSIGNMENTS=95 CHECKS=1561180	? TT=183.309	? (MO) TT=32.531
csp/medium/ normalized-patat-02-medium-1.xml	SAT TT=128.007	? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.15	No data	No data	No data	SAT TT=1738.73 ASSIGNMENTS=250470 CHECKS=3520620000	? (TO) TT=1800.05	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=1692.09 ASSIGNMENTS=250470 CHECKS=3520620000	? (TO) TT=1800.14	No data	? (TO) TT=1800.09	SAT TT=128.007
csp/medium/ normalized-patat-02-medium-2.xml	SAT TT=102.676	? (TO) TT=1800.23	? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.21	? (TO) TT=1800.11	No data	No data	No data	SAT TT=115.198 ASSIGNMENTS=14243 CHECKS=219525000	SAT TT=703.06 ASSIGNMENTS=14243 CHECKS=219525000	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=102.676 ASSIGNMENTS=14243 CHECKS=219525000	? (TO) TT=1800.13	No data	? (TO) TT=1800.23	SAT TT=120.645
csp/medium/ normalized-patat-02-medium-3.xml	SAT TT=121.831	? (TO) TT=1800.19	? (TO) TT=1800.19	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.2	No data	No data	No data	SAT TT=187.465 ASSIGNMENTS=20329 CHECKS=365668000	SAT TT=777.083 ASSIGNMENTS=20329 CHECKS=365668000	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=166.621 ASSIGNMENTS=20329 CHECKS=365668000	? (TO) TT=1800.12	No data	? (TO) TT=1800.26	SAT TT=121.831
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/medium/ normalized-patat-02-medium-4.xml	SAT TT=118.807	? (TO) TT=1800.17	? (TO) TT=1800.23	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.2	No data	No data	No data	SAT TT=1008.44 ASSIGNMENTS=187436 CHECKS=2144250000	SAT TT=1560.57 ASSIGNMENTS=187436 CHECKS=2144250000	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=965.629 ASSIGNMENTS=187436 CHECKS=2144250000	? (TO) TT=1800.17	No data	? (TO) TT=1800.03	SAT TT=118.807
csp/medium/ normalized-patat-02-medium-5.xml	SAT TT=93.899	? (TO) TT=1800.19	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.12	No data	No data	No data	SAT TT=407.486 ASSIGNMENTS=185341 CHECKS=887187000	SAT TT=997.173 ASSIGNMENTS=185341 CHECKS=887187000	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=383.096 ASSIGNMENTS=185341 CHECKS=887187000	? (TO) TT=1802.23	No data	? (TO) TT=1800.15	SAT TT=93.899
csp/mknap/ normalized-mknap-1-0.xml	SAT TT=0.007	SAT TT=0.747 CHECKS=71 NODES=6	SAT TT=0.679 CHECKS=71 NODES=0	SAT TT=0.029	SAT TT=0.011 CHECKS=65	SAT TT=0.009 CHECKS=92	SAT TT=0.488 ASSIGNMENTS=1	SAT TT=0.502 ASSIGNMENTS=1	SAT TT=0.547 CHECKS=76 NODES=6	SAT TT=0.573 CHECKS=83 NODES=0	SAT TT=0.531 CHECKS=83 NODES=0	SAT TT=0.018 ASSIGNMENTS=2 CHECKS=635	SAT TT=0.018 ASSIGNMENTS=2 CHECKS=635	SAT TT=1.463	SAT TT=1.687	No data	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=635	SAT TT=0.009 ASSIGNMENTS=2 CHECKS=1044	SAT TT=0.302	SAT TT=0.008 ASSIGNMENTS=4 CHECKS=974	SAT TT=0.008 ASSIGNMENTS=3 CHECKS=621	SAT TT=1.364	No data	SAT TT=0.5	SAT TT=0.469
csp/mknap/ normalized-mknap-1-2.xml	SAT TT=0.013	SAT TT=1.346 CHECKS=41836 NODES=15	SAT TT=1.223 CHECKS=41836 NODES=0	SAT TT=0.037	SAT TT=0.163 CHECKS=886	SAT TT=0.048 CHECKS=1162	SAT TT=0.575 ASSIGNMENTS=9	SAT TT=0.546 ASSIGNMENTS=25	SAT TT=1.05 CHECKS=46513 NODES=15	SAT TT=0.97 CHECKS=46529 NODES=0	SAT TT=1.041 CHECKS=46529 NODES=0	SAT TT=0.024 ASSIGNMENTS=13 CHECKS=8382	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=8382	SAT TT=2.801	SAT TT=2.579	No data	SAT TT=0.013 ASSIGNMENTS=13 CHECKS=8382	SAT TT=0.014 ASSIGNMENTS=25 CHECKS=13007	SAT TT=0.365	SAT TT=3.354 ASSIGNMENTS=6398 CHECKS=1937140	SAT TT=0.013 ASSIGNMENTS=10 CHECKS=7062	SAT TT=12.724	No data	SAT TT=1.394	SAT TT=4.058
csp/mknap/ normalized-mknap-1-3.xml	SAT TT=0.03	SAT TT=19.193 CHECKS=1565190 NODES=20	SAT TT=18.805 CHECKS=1565190 NODES=0	SAT TT=0.05	SAT TT=2 CHECKS=36622	SAT TT=2.628 CHECKS=53826	SAT TT=0.545 ASSIGNMENTS=19	SAT TT=0.772 ASSIGNMENTS=254	SAT TT=9.491 CHECKS=1311300 NODES=20	SAT TT=6.645 CHECKS=1311320 NODES=0	SAT TT=6.24 CHECKS=1311320 NODES=0	SAT TT=0.043 ASSIGNMENTS=66 CHECKS=42215	SAT TT=0.043 ASSIGNMENTS=66 CHECKS=42215	? (problem) TT=39.054	? (problem) TT=32.989	No data	SAT TT=0.03 ASSIGNMENTS=66 CHECKS=42215	SAT TT=0.887 ASSIGNMENTS=3677 CHECKS=1960360	SAT TT=0.378	SAT TT=12.861 ASSIGNMENTS=22355 CHECKS=4544830	SAT TT=0.048 ASSIGNMENTS=143 CHECKS=90571	? TT=340.472	No data	SAT TT=3.398	SAT TT=9.877
csp/mknap/ normalized-mknap-1-4.xml	SAT TT=0.065	? (TO) TT=1800.16	? (TO) TT=1800.18	SAT TT=0.065	SAT TT=42.654 CHECKS=508593	SAT TT=45.474 CHECKS=541580	SAT TT=1.416 ASSIGNMENTS=13258	SAT TT=0.854 ASSIGNMENTS=1807	SAT TT=1568.73 CHECKS=386154000 NODES=28	SAT TT=1608.75 CHECKS=386155000 NODES=0	SAT TT=1607.68 CHECKS=386155000 NODES=0	SAT TT=9.4 ASSIGNMENTS=13258	SAT TT=61.474 ASSIGNMENTS=138723 CHECKS=137352000	? (MO) TT=256.58	? (MO) TT=275.82	No data	SAT TT=1.418 ASSIGNMENTS=3596 CHECKS=3279130	SAT TT=7.971 ASSIGNMENTS=20493 CHECKS=18472800	SAT TT=0.791	SAT TT=136.099 ASSIGNMENTS=32294 CHECKS=22099100	SAT TT=55.486 ASSIGNMENTS=138723 CHECKS=137352000	? TT=939.507	No data	SAT TT=11.99	SAT TT=46.099
csp/mknap/ normalized-mknap-1-5.xml	SAT TT=1.204	? (TO) TT=1800.14	? (TO) TT=1800.11	SAT TT=1.204	SAT TT=120.512 CHECKS=863472	SAT TT=89.942 CHECKS=695190	SAT TT=5.477 ASSIGNMENTS=105826	SAT TT=1.925 ASSIGNMENTS=18723	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=412.224 ASSIGNMENTS=1523430 CHECKS=906612000	SAT TT=410.627 ASSIGNMENTS=1523430 CHECKS=906612000	? (TO) TT=1800	? (TO) TT=1800.06	No data	SAT TT=79.785 ASSIGNMENTS=286594 CHECKS=180977000	SAT TT=58.954 ASSIGNMENTS=234559 CHECKS=142503000	SAT TT=1.29	SAT TT=239.562 ASSIGNMENTS=168324 CHECKS=97077800	SAT TT=401.278 ASSIGNMENTS=1523430 CHECKS=906612000	? (TO) TT=1800.15	No data	? (MO) TT=139.36	? (MO) TT=347.835
csp/mknap/ normalized-mknap-1-6.xml	SAT TT=12.671	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=302.627	? (TO) TT=1800.02	SAT TT=1589.11 CHECKS=7670940	SAT TT=73.533 ASSIGNMENTS=1489160	SAT TT=12.671 ASSIGNMENTS=200210	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=327.645 ASSIGNMENTS=1489160	SAT TT=1161.51 ASSIGNMENTS=1489160	? (TO) TT=1800.02	? (TO) TT=1800.06	No data	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=15.122	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.06	No data	? TT=274.199	? TT=256.572
csp/modifiedRenault/ normalized-renault-mod-0_ext.xml	SAT TT=0.586	SAT TT=1.958 CHECKS=3626 NODES=523	SAT TT=1.766 CHECKS=1487 NODES=0	SAT TT=917.438	SAT TT=37.664 CHECKS=101021	SAT TT=6.888 CHECKS=14856	SAT TT=5.155 ASSIGNMENTS=19	SAT TT=5.03 ASSIGNMENTS=35	SAT TT=84.176 CHECKS=101284000 NODES=156	SAT TT=1399 CHECKS=557903000 NODES=-1590470000	? (TO) TT=1800.05	SAT TT=0.598 ASSIGNMENTS=40 CHECKS=1423	SAT TT=0.617 ASSIGNMENTS=40 CHECKS=1423	SAT TT=13.541	SAT TT=10.973	SAT TT=1.053 CHECKS=903	SAT TT=0.615 ASSIGNMENTS=40 CHECKS=1423	SAT TT=0.662 ASSIGNMENTS=134 CHECKS=4246	SAT TT=5.722	SAT TT=1.158 ASSIGNMENTS=501 CHECKS=45371	SAT TT=0.586 ASSIGNMENTS=40 CHECKS=1423	? TT=46.175	SAT TT=1.4 ASSIGNMENTS=202 CHECKS=25542	SAT TT=7.595	SAT TT=8.073
csp/modifiedRenault/ normalized-renault-mod-10_ext.xml	UNSAT TT=0.749	UNSAT TT=1.886 CHECKS=1969 NODES=466	UNSAT TT=2.212 CHECKS=3217 NODES=440	? (TO) TT=1800.07	UNSAT TT=6.491 CHECKS=30544	UNSAT TT=7.508 CHECKS=38433	UNSAT TT=5.156 ASSIGNMENTS=224	UNSAT TT=166.284 ASSIGNMENTS=32934	UNSAT TT=68.165 CHECKS=40090600 NODES=154	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=0.749 ASSIGNMENTS=910 CHECKS=29032	UNSAT TT=0.751 ASSIGNMENTS=910 CHECKS=29032	UNSAT TT=10.281	UNSAT TT=9.332	UNSAT TT=1.313 CHECKS=10769	UNSAT TT=0.774 ASSIGNMENTS=901 CHECKS=28428	UNSAT TT=2.664 ASSIGNMENTS=5421 CHECKS=137844	UNSAT TT=5.138	UNSAT TT=1.162 ASSIGNMENTS=1518 CHECKS=65435	UNSAT TT=0.808 ASSIGNMENTS=910 CHECKS=29032	? TT=129.243	UNSAT TT=1.719 ASSIGNMENTS=88 CHECKS=50227	UNSAT TT=7.577	UNSAT TT=8.504
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/modifiedRenault/ normalized-renault-mod-11_ext.xml	SAT TT=0.537	SAT TT=1.638 CHECKS=673 NODES=116	SAT TT=1.81 CHECKS=1360 NODES=115	SAT TT=911.968	SAT TT=8.224 CHECKS=22812	SAT TT=6.057 CHECKS=13873	SAT TT=4.188 ASSIGNMENTS=26	SAT TT=4.62 ASSIGNMENTS=91	SAT TT=70.806 CHECKS=39912500 NODES=111	SAT TT=684.737 CHECKS=630211000 NODES=980250000	? (TO) TT=1800.08	SAT TT=0.558 ASSIGNMENTS=22 CHECKS=924	SAT TT=0.553 ASSIGNMENTS=22 CHECKS=924	SAT TT=12.169	SAT TT=11.445	SAT TT=1.059 CHECKS=1630	SAT TT=0.582 ASSIGNMENTS=22 CHECKS=924	SAT TT=0.6 ASSIGNMENTS=148 CHECKS=4412	SAT TT=5.276	SAT TT=0.584 ASSIGNMENTS=53 CHECKS=1669	SAT TT=0.537 ASSIGNMENTS=22 CHECKS=924	? TT=45.094	SAT TT=1.428 ASSIGNMENTS=152 CHECKS=48746	SAT TT=7.434	SAT TT=8.231
csp/modifiedRenault/ normalized-renault-mod-12_ext.xml	UNSAT TT=0.689	UNSAT TT=2.284 CHECKS=5192 NODES=378	UNSAT TT=1.795 CHECKS=1383 NODES=0	? (TO) TT=1800.07	UNSAT TT=22.409 CHECKS=63692	UNSAT TT=8.276 CHECKS=36129	UNSAT TT=4.338 ASSIGNMENTS=0	UNSAT TT=4.366 ASSIGNMENTS=0	UNSAT TT=68.559 CHECKS=39967600 NODES=32	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=0.706 ASSIGNMENTS=148 CHECKS=9814	UNSAT TT=0.719 ASSIGNMENTS=148 CHECKS=9814	UNSAT TT=9.044	UNSAT TT=8.545	UNSAT TT=1.112 CHECKS=16907	UNSAT TT=0.769 ASSIGNMENTS=298 CHECKS=18751	UNSAT TT=3.217 ASSIGNMENTS=4792 CHECKS=178896	UNSAT TT=4.993	UNSAT TT=1.409 ASSIGNMENTS=475 CHECKS=50686	UNSAT TT=0.689 ASSIGNMENTS=148 CHECKS=9814	? TT=61.249	UNSAT TT=1.498 ASSIGNMENTS=294 CHECKS=287261	UNSAT TT=7.535	UNSAT TT=8.295
csp/modifiedRenault/ normalized-renault-mod-13_ext.xml	SAT TT=0.545	SAT TT=1.584 CHECKS=669 NODES=117	SAT TT=1.741 CHECKS=1200 NODES=125	SAT TT=16.185	SAT TT=5.812 CHECKS=14726	SAT TT=5.143 CHECKS=14131	SAT TT=4.148 ASSIGNMENTS=27	SAT TT=4.736 ASSIGNMENTS=60	SAT TT=125.437 CHECKS=243215000 NODES=239	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=0.599 ASSIGNMENTS=42 CHECKS=1620	SAT TT=0.555 ASSIGNMENTS=42 CHECKS=1620	SAT TT=12.962	SAT TT=11.901	SAT TT=1.06 CHECKS=2230	SAT TT=0.587 ASSIGNMENTS=42 CHECKS=1620	SAT TT=1.005 ASSIGNMENTS=1029 CHECKS=32077	SAT TT=5.019	SAT TT=1.049 ASSIGNMENTS=679 CHECKS=43700	SAT TT=0.545 ASSIGNMENTS=42 CHECKS=1620	? TT=56.712	SAT TT=1.484 ASSIGNMENTS=165 CHECKS=26701	SAT TT=8.03	SAT TT=8.516
csp/modifiedRenault/ normalized-renault-mod-14_ext.xml	UNSAT TT=0.661	UNSAT TT=2.037 CHECKS=2983 NODES=243	UNSAT TT=2.349 CHECKS=5227 NODES=302	? (TO) TT=1800.06	UNSAT TT=23.798 CHECKS=62150	UNSAT TT=7.787 CHECKS=29979	UNSAT TT=5.495 ASSIGNMENTS=72	UNSAT TT=8.924 ASSIGNMENTS=574	UNSAT TT=72.756 CHECKS=39978200 NODES=64	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.665 ASSIGNMENTS=278 CHECKS=12018	UNSAT TT=0.663 ASSIGNMENTS=278 CHECKS=12018	UNSAT TT=9.645	UNSAT TT=8.761	UNSAT TT=1.107 CHECKS=11572	UNSAT TT=0.758 ASSIGNMENTS=541 CHECKS=23880	UNSAT TT=2.971 ASSIGNMENTS=5276 CHECKS=160311	UNSAT TT=5.921	UNSAT TT=0.88 ASSIGNMENTS=407 CHECKS=34354	UNSAT TT=0.661 ASSIGNMENTS=278 CHECKS=12018	? TT=74.054	UNSAT TT=1.664 ASSIGNMENTS=402 CHECKS=429170	UNSAT TT=7.707	UNSAT TT=8.421
csp/modifiedRenault/ normalized-renault-mod-16_ext.xml	UNSAT TT=0.728	UNSAT TT=2.308 CHECKS=2463 NODES=805	UNSAT TT=2.328 CHECKS=3123 NODES=798	? (TO) TT=1800.09	UNSAT TT=7.494 CHECKS=38231	UNSAT TT=6.68 CHECKS=43301	UNSAT TT=5.987 ASSIGNMENTS=777	UNSAT TT=95.609 ASSIGNMENTS=54837	UNSAT TT=72.823 CHECKS=40088800 NODES=211	? (TO) TT=1800.1	? (TO) TT=1800	UNSAT TT=0.728 ASSIGNMENTS=1303 CHECKS=48533	UNSAT TT=0.81 ASSIGNMENTS=1303 CHECKS=48533	UNSAT TT=10.047	UNSAT TT=8.767	UNSAT TT=1.142 CHECKS=20062	UNSAT TT=0.787 ASSIGNMENTS=1343 CHECKS=49320	UNSAT TT=2.603 ASSIGNMENTS=5486 CHECKS=158224	UNSAT TT=5.672	UNSAT TT=1.216 ASSIGNMENTS=1537 CHECKS=74974	UNSAT TT=0.761 ASSIGNMENTS=1303 CHECKS=48533	? TT=47.966	UNSAT TT=1.789 ASSIGNMENTS=738 CHECKS=386796	UNSAT TT=7.661	UNSAT TT=8.553
csp/modifiedRenault/ normalized-renault-mod-17_ext.xml	UNSAT TT=0.669	UNSAT TT=2.371 CHECKS=6031 NODES=495	UNSAT TT=1.789 CHECKS=797 NODES=0	? (TO) TT=1800.1	UNSAT TT=13.595 CHECKS=37874	UNSAT TT=13.728 CHECKS=48337	UNSAT TT=5.616 ASSIGNMENTS=0	UNSAT TT=5.636 ASSIGNMENTS=0	UNSAT TT=72.26 CHECKS=46176000 NODES=43	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=0.685 ASSIGNMENTS=104 CHECKS=6206	UNSAT TT=0.682 ASSIGNMENTS=104 CHECKS=6206	UNSAT TT=10.219	UNSAT TT=8.764	UNSAT TT=1.291 CHECKS=7008	UNSAT TT=0.745 ASSIGNMENTS=219 CHECKS=11739	UNSAT TT=2.935 ASSIGNMENTS=5053 CHECKS=161976	UNSAT TT=5.202	UNSAT TT=1.287 ASSIGNMENTS=541 CHECKS=56023	UNSAT TT=0.669 ASSIGNMENTS=104 CHECKS=6206	? TT=53.293	UNSAT TT=1.567 ASSIGNMENTS=103 CHECKS=160279	UNSAT TT=7.883	UNSAT TT=8.847
csp/modifiedRenault/ normalized-renault-mod-18_ext.xml	UNSAT TT=0.667	UNSAT TT=2.002 CHECKS=3110 NODES=540	UNSAT TT=2.258 CHECKS=2523 NODES=512	? (TO) TT=1800.12	UNSAT TT=6.563 CHECKS=29093	UNSAT TT=6.656 CHECKS=27980	UNSAT TT=5.227 ASSIGNMENTS=169	UNSAT TT=59.376 ASSIGNMENTS=28546	UNSAT TT=72.67 CHECKS=39992900 NODES=89	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.685 ASSIGNMENTS=565 CHECKS=18446	UNSAT TT=0.685 ASSIGNMENTS=565 CHECKS=18446	UNSAT TT=10.407	UNSAT TT=8.647	UNSAT TT=1.329 CHECKS=8632	UNSAT TT=0.695 ASSIGNMENTS=607 CHECKS=19705	UNSAT TT=2.646 ASSIGNMENTS=5351 CHECKS=145590	UNSAT TT=5.25	UNSAT TT=0.909 ASSIGNMENTS=464 CHECKS=35515	UNSAT TT=0.667 ASSIGNMENTS=565 CHECKS=18446	? TT=56.946	UNSAT TT=1.578 ASSIGNMENTS=262 CHECKS=115516	UNSAT TT=7.676	UNSAT TT=8.01
csp/modifiedRenault/ normalized-renault-mod-19_ext.xml	UNSAT TT=0.626	UNSAT TT=1.856 CHECKS=1700 NODES=532	UNSAT TT=2.546 CHECKS=3886 NODES=487	? (TO) TT=1800.12	UNSAT TT=21.086 CHECKS=61613	UNSAT TT=6.182 CHECKS=21886	UNSAT TT=3.765 ASSIGNMENTS=0	UNSAT TT=3.844 ASSIGNMENTS=0	UNSAT TT=73.141 CHECKS=39994500 NODES=59	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.626 ASSIGNMENTS=169 CHECKS=8262	UNSAT TT=0.667 ASSIGNMENTS=169 CHECKS=8262	UNSAT TT=8.918	UNSAT TT=10.172	UNSAT TT=1.094 CHECKS=9927	UNSAT TT=0.72 ASSIGNMENTS=357 CHECKS=18774	UNSAT TT=2.457 ASSIGNMENTS=5324 CHECKS=137622	UNSAT TT=5.467	UNSAT TT=0.908 ASSIGNMENTS=482 CHECKS=37874	UNSAT TT=0.661 ASSIGNMENTS=169 CHECKS=8262	? TT=51.966	UNSAT TT=1.551 ASSIGNMENTS=169 CHECKS=144994	UNSAT TT=7.676	UNSAT TT=7.957
csp/modifiedRenault/ normalized-renault-mod-1_ext.xml	UNSAT TT=0.649	UNSAT TT=1.85 CHECKS=1408 NODES=63	UNSAT TT=1.789 CHECKS=787 NODES=0	? (TO) TT=1800.09	UNSAT TT=16.162 CHECKS=59393	UNSAT TT=7.117 CHECKS=30527	UNSAT TT=3.813 ASSIGNMENTS=0	UNSAT TT=3.59 ASSIGNMENTS=0	UNSAT TT=84.224 CHECKS=91225600 NODES=42	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.665 ASSIGNMENTS=101 CHECKS=5324	UNSAT TT=0.676 ASSIGNMENTS=101 CHECKS=5324	UNSAT TT=10.231	UNSAT TT=9.49	UNSAT TT=1.239 CHECKS=11261	UNSAT TT=0.766 ASSIGNMENTS=286 CHECKS=13200	UNSAT TT=2.357 ASSIGNMENTS=5127 CHECKS=165726	UNSAT TT=5.293	UNSAT TT=0.888 ASSIGNMENTS=339 CHECKS=29363	UNSAT TT=0.649 ASSIGNMENTS=101 CHECKS=5324	? TT=50.207	UNSAT TT=1.476 ASSIGNMENTS=268 CHECKS=198173	UNSAT TT=7.902	UNSAT TT=8.127
csp/modifiedRenault/ normalized-renault-mod-20_ext.xml	UNSAT TT=0.66	UNSAT TT=2.5 CHECKS=5667 NODES=504	UNSAT TT=2.667 CHECKS=5542 NODES=460	? (TO) TT=1800.13	UNSAT TT=28.31 CHECKS=124829	UNSAT TT=8.153 CHECKS=46720	UNSAT TT=4.066 ASSIGNMENTS=0	UNSAT TT=4.129 ASSIGNMENTS=0	UNSAT TT=119.764 CHECKS=243225000 NODES=57	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.721 ASSIGNMENTS=129 CHECKS=15234	UNSAT TT=0.727 ASSIGNMENTS=129 CHECKS=15234	UNSAT TT=10.551	UNSAT TT=9.609	UNSAT TT=1.125 CHECKS=15273	UNSAT TT=0.725 ASSIGNMENTS=237 CHECKS=23353	UNSAT TT=2.674 ASSIGNMENTS=4933 CHECKS=246583	UNSAT TT=5.546	UNSAT TT=1.017 ASSIGNMENTS=371 CHECKS=48210	UNSAT TT=0.66 ASSIGNMENTS=129 CHECKS=15234	? TT=122.496	UNSAT TT=2.123 ASSIGNMENTS=626 CHECKS=1121500	UNSAT TT=7.603	UNSAT TT=8.355
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/modifiedRenault/ normalized-renault-mod-21_ext.xml	UNSAT TT=0.648	UNSAT TT=2.037 CHECKS=3583 NODES=248	UNSAT TT=2.326 CHECKS=3930 NODES=235	? (TO) TT=1800.13	UNSAT TT=13.146 CHECKS=67969	UNSAT TT=7.624 CHECKS=42925	UNSAT TT=5.777 ASSIGNMENTS=118	UNSAT TT=12.387 ASSIGNMENTS=1729	UNSAT TT=67.82 CHECKS=40040800 NODES=70	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.648 ASSIGNMENTS=320 CHECKS=19660	UNSAT TT=0.701 ASSIGNMENTS=320 CHECKS=19660	UNSAT TT=10.441	UNSAT TT=10.093	UNSAT TT=1.216 CHECKS=22417	UNSAT TT=0.739 ASSIGNMENTS=585 CHECKS=34379	UNSAT TT=2.959 ASSIGNMENTS=5148 CHECKS=185284	UNSAT TT=5.774	UNSAT TT=1.241 ASSIGNMENTS=479 CHECKS=46920	UNSAT TT=0.684 ASSIGNMENTS=320 CHECKS=19660	? TT=93.144	UNSAT TT=1.529 ASSIGNMENTS=301 CHECKS=240401	UNSAT TT=8.042	UNSAT TT=7.829
csp/modifiedRenault/ normalized-renault-mod-22_ext.xml	UNSAT TT=0.672	UNSAT TT=2.021 CHECKS=1765 NODES=401	UNSAT TT=2.297 CHECKS=2874 NODES=266	? (TO) TT=1800.07	UNSAT TT=20.658 CHECKS=64436	UNSAT TT=8.351 CHECKS=42912	UNSAT TT=8.464 ASSIGNMENTS=0	UNSAT TT=4.721 ASSIGNMENTS=0	UNSAT TT=68.154 CHECKS=39988900 NODES=47	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.672 ASSIGNMENTS=208 CHECKS=16290	UNSAT TT=0.717 ASSIGNMENTS=208 CHECKS=16290	UNSAT TT=11.927	UNSAT TT=8.896	UNSAT TT=1.103 CHECKS=23084	UNSAT TT=0.776 ASSIGNMENTS=364 CHECKS=31816	UNSAT TT=3.25 ASSIGNMENTS=5219 CHECKS=177267	UNSAT TT=5.024	UNSAT TT=1.057 ASSIGNMENTS=571 CHECKS=47708	UNSAT TT=0.712 ASSIGNMENTS=208 CHECKS=16290	? TT=91.479	UNSAT TT=1.48 ASSIGNMENTS=106 CHECKS=107428	UNSAT TT=7.339	UNSAT TT=7.936
csp/modifiedRenault/ normalized-renault-mod-23_ext.xml	UNSAT TT=0.727	UNSAT TT=2.188 CHECKS=6738 NODES=426	UNSAT TT=2.394 CHECKS=6016 NODES=404	? (TO) TT=1800.05	UNSAT TT=19.088 CHECKS=64596	UNSAT TT=12.985 CHECKS=68595	UNSAT TT=3.814 ASSIGNMENTS=0	UNSAT TT=3.847 ASSIGNMENTS=0	UNSAT TT=81.353 CHECKS=94440800 NODES=55	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=0.756 ASSIGNMENTS=213 CHECKS=18567	UNSAT TT=0.727 ASSIGNMENTS=213 CHECKS=18567	UNSAT TT=12.176	UNSAT TT=9.791	UNSAT TT=1.13 CHECKS=27042	UNSAT TT=0.859 ASSIGNMENTS=388 CHECKS=34039	UNSAT TT=2.475 ASSIGNMENTS=5281 CHECKS=192586	UNSAT TT=5.609	UNSAT TT=1.325 ASSIGNMENTS=822 CHECKS=75938	UNSAT TT=0.743 ASSIGNMENTS=213 CHECKS=18567	? TT=93.089	UNSAT TT=1.663 ASSIGNMENTS=367 CHECKS=441179	UNSAT TT=8.334	UNSAT TT=8.49
csp/modifiedRenault/ normalized-renault-mod-24_ext.xml	UNSAT TT=0.692	UNSAT TT=2.429 CHECKS=1356 NODES=140	UNSAT TT=1.901 CHECKS=1182 NODES=0	? (TO) TT=1800.1	UNSAT TT=16.308 CHECKS=58834	UNSAT TT=7.512 CHECKS=31884	UNSAT TT=4.743 ASSIGNMENTS=0	UNSAT TT=4.271 ASSIGNMENTS=0	UNSAT TT=70.045 CHECKS=39963600 NODES=51	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=0.692 ASSIGNMENTS=193 CHECKS=12290	UNSAT TT=0.736 ASSIGNMENTS=193 CHECKS=12290	UNSAT TT=10.855	UNSAT TT=9.894	UNSAT TT=1.196 CHECKS=18642	UNSAT TT=0.764 ASSIGNMENTS=248 CHECKS=17161	UNSAT TT=3.296 ASSIGNMENTS=5094 CHECKS=230564	UNSAT TT=5.303	UNSAT TT=1.052 ASSIGNMENTS=388 CHECKS=35259	UNSAT TT=0.724 ASSIGNMENTS=193 CHECKS=12290	? TT=96.454	UNSAT TT=1.55 ASSIGNMENTS=176 CHECKS=154826	UNSAT TT=7.901	UNSAT TT=8.577
csp/modifiedRenault/ normalized-renault-mod-26_ext.xml	UNSAT TT=0.682	UNSAT TT=2.505 CHECKS=2392 NODES=543	UNSAT TT=2.597 CHECKS=2736 NODES=525	? (TO) TT=1800.09	UNSAT TT=10.824 CHECKS=54195	UNSAT TT=6.777 CHECKS=38132	UNSAT TT=4.278 ASSIGNMENTS=82	UNSAT TT=13.152 ASSIGNMENTS=2319	UNSAT TT=68.897 CHECKS=40044200 NODES=85	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.752 ASSIGNMENTS=411 CHECKS=26129	UNSAT TT=0.7 ASSIGNMENTS=411 CHECKS=26129	UNSAT TT=12.103	UNSAT TT=10.246	UNSAT TT=1.414 CHECKS=15583	UNSAT TT=0.7 ASSIGNMENTS=419 CHECKS=28928	UNSAT TT=2.855 ASSIGNMENTS=5134 CHECKS=191794	UNSAT TT=6.08	UNSAT TT=1.067 ASSIGNMENTS=474 CHECKS=41607	UNSAT TT=0.682 ASSIGNMENTS=411 CHECKS=26129	? TT=101.112	UNSAT TT=1.611 ASSIGNMENTS=209 CHECKS=124708	UNSAT TT=8.778	UNSAT TT=7.986
csp/modifiedRenault/ normalized-renault-mod-27_ext.xml	UNSAT TT=0.698	UNSAT TT=1.843 CHECKS=2627 NODES=187	UNSAT TT=1.765 CHECKS=786 NODES=0	? (TO) TT=1800.12	UNSAT TT=11.871 CHECKS=31145	UNSAT TT=14.613 CHECKS=51656	UNSAT TT=4.429 ASSIGNMENTS=0	UNSAT TT=4.492 ASSIGNMENTS=0	UNSAT TT=70.322 CHECKS=39983400 NODES=46	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=0.715 ASSIGNMENTS=109 CHECKS=9336	UNSAT TT=0.722 ASSIGNMENTS=109 CHECKS=9336	UNSAT TT=10.567	UNSAT TT=9.875	UNSAT TT=1.14 CHECKS=10834	UNSAT TT=0.756 ASSIGNMENTS=272 CHECKS=22197	UNSAT TT=1.128 ASSIGNMENTS=1112 CHECKS=43235	UNSAT TT=5.21	UNSAT TT=0.996 ASSIGNMENTS=337 CHECKS=34524	UNSAT TT=0.698 ASSIGNMENTS=109 CHECKS=9336	? TT=94.376	UNSAT TT=1.586 ASSIGNMENTS=75 CHECKS=69916	UNSAT TT=8.424	UNSAT TT=8.327
csp/modifiedRenault/ normalized-renault-mod-28_ext.xml	UNSAT TT=0.659	UNSAT TT=2.112 CHECKS=1712 NODES=224	UNSAT TT=2.071 CHECKS=2589 NODES=215	? (TO) TT=1800.09	UNSAT TT=44.444 CHECKS=119372	UNSAT TT=8.885 CHECKS=41601	UNSAT TT=4.714 ASSIGNMENTS=0	UNSAT TT=4.925 ASSIGNMENTS=0	UNSAT TT=71.084 CHECKS=40034700 NODES=54	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=0.723 ASSIGNMENTS=189 CHECKS=17363	UNSAT TT=0.672 ASSIGNMENTS=189 CHECKS=17363	UNSAT TT=12.031	UNSAT TT=9.828	UNSAT TT=1.212 CHECKS=20421	UNSAT TT=0.821 ASSIGNMENTS=391 CHECKS=34799	UNSAT TT=2.533 ASSIGNMENTS=5158 CHECKS=179476	UNSAT TT=5.591	UNSAT TT=1.99 ASSIGNMENTS=1536 CHECKS=140448	UNSAT TT=0.659 ASSIGNMENTS=189 CHECKS=17363	? (exit code) TT=120.609	UNSAT TT=1.799 ASSIGNMENTS=156 CHECKS=394915	UNSAT TT=8.12	UNSAT TT=9.292
csp/modifiedRenault/ normalized-renault-mod-29_ext.xml	UNSAT TT=0.728	UNSAT TT=1.95 CHECKS=21 NODES=9	UNSAT TT=2.057 CHECKS=1303 NODES=0	? (TO) TT=1800.06	UNSAT TT=8.079 CHECKS=25436	UNSAT TT=7.977 CHECKS=34564	UNSAT TT=3.328 ASSIGNMENTS=0	UNSAT TT=3.15 ASSIGNMENTS=0	UNSAT TT=67.8 CHECKS=39980600 NODES=40	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.728 ASSIGNMENTS=84 CHECKS=10879	UNSAT TT=0.734 ASSIGNMENTS=84 CHECKS=10879	UNSAT TT=10.659	UNSAT TT=9.692	UNSAT TT=1.094 CHECKS=11443	UNSAT TT=0.796 ASSIGNMENTS=124 CHECKS=15453	UNSAT TT=2.82 ASSIGNMENTS=4664 CHECKS=250101	UNSAT TT=5.726	UNSAT TT=0.971 ASSIGNMENTS=204 CHECKS=29409	UNSAT TT=0.728 ASSIGNMENTS=84 CHECKS=10879	? (exit code) TT=105.217	UNSAT TT=1.576 ASSIGNMENTS=126 CHECKS=227519	UNSAT TT=8.199	UNSAT TT=8.569
csp/modifiedRenault/ normalized-renault-mod-30_ext.xml	UNSAT TT=0.844	UNSAT TT=2.769 CHECKS=6588 NODES=609	UNSAT TT=3.453 CHECKS=7982 NODES=568	? (TO) TT=1800.07	UNSAT TT=49.513 CHECKS=174067	UNSAT TT=19.099 CHECKS=86332	UNSAT TT=4.848 ASSIGNMENTS=209	UNSAT TT=5.702 ASSIGNMENTS=397	UNSAT TT=327.083 CHECKS=1089730000 NODES=145	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.904 ASSIGNMENTS=338 CHECKS=33601	UNSAT TT=0.901 ASSIGNMENTS=338 CHECKS=33601	UNSAT TT=10.267	UNSAT TT=9.254	UNSAT TT=1.191 CHECKS=37209	UNSAT TT=0.888 ASSIGNMENTS=572 CHECKS=55353	UNSAT TT=3.736 ASSIGNMENTS=4821 CHECKS=258171	UNSAT TT=5.709	UNSAT TT=1.151 ASSIGNMENTS=502 CHECKS=51791	UNSAT TT=0.844 ASSIGNMENTS=338 CHECKS=33601	? TT=77.893	UNSAT TT=2.4 ASSIGNMENTS=100 CHECKS=918667	UNSAT TT=7.928	UNSAT TT=8.598
csp/modifiedRenault/ normalized-renault-mod-31_ext.xml	SAT TT=0.641	SAT TT=1.889 CHECKS=4320 NODES=503	SAT TT=2.313 CHECKS=5954 NODES=481	SAT TT=1356.4	SAT TT=38.058 CHECKS=151760	SAT TT=9.763 CHECKS=41300	SAT TT=5.458 ASSIGNMENTS=107	SAT TT=8.203 ASSIGNMENTS=1252	SAT TT=153.486 CHECKS=420892000 NODES=246	SAT TT=843.105 CHECKS=2268540000 NODES=888300000	? (TO) TT=1800.03	SAT TT=0.709 ASSIGNMENTS=190 CHECKS=13751	SAT TT=0.661 ASSIGNMENTS=190 CHECKS=13751	SAT TT=12.974	SAT TT=12.138	SAT TT=1.054 CHECKS=10708	SAT TT=0.641 ASSIGNMENTS=178 CHECKS=8365	SAT TT=1.906 ASSIGNMENTS=3611 CHECKS=121754	SAT TT=5.251	SAT TT=1.854 ASSIGNMENTS=496 CHECKS=52086	SAT TT=0.703 ASSIGNMENTS=190 CHECKS=13751	? TT=73.525	SAT TT=1.532 ASSIGNMENTS=180 CHECKS=68523	SAT TT=7.324	SAT TT=8.395
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/modifiedRenault/ normalized-renault-mod-33_ext.xml	UNSAT TT=0.65	UNSAT TT=2.914 CHECKS=4746 NODES=297	UNSAT TT=3.131 CHECKS=4604 NODES=221	? (TO) TT=1800.12	UNSAT TT=30.581 CHECKS=120695	UNSAT TT=7.187 CHECKS=37114	UNSAT TT=5.214 ASSIGNMENTS=47	UNSAT TT=5.682 ASSIGNMENTS=76	UNSAT TT=85.448 CHECKS=84192500 NODES=144	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.676 ASSIGNMENTS=137 CHECKS=10183	UNSAT TT=0.674 ASSIGNMENTS=137 CHECKS=10183	UNSAT TT=9.851	UNSAT TT=9.03	UNSAT TT=1.171 CHECKS=9681	UNSAT TT=0.693 ASSIGNMENTS=201 CHECKS=14300	UNSAT TT=3.417 ASSIGNMENTS=4752 CHECKS=249865	UNSAT TT=5.333	UNSAT TT=2.077 ASSIGNMENTS=406 CHECKS=42101	UNSAT TT=0.65 ASSIGNMENTS=137 CHECKS=10183	? TT=58.668	UNSAT TT=1.497 ASSIGNMENTS=227 CHECKS=240572	UNSAT TT=7.696	UNSAT TT=7.593
csp/modifiedRenault/ normalized-renault-mod-35_ext.xml	UNSAT TT=0.706	UNSAT TT=2.449 CHECKS=9707 NODES=174	UNSAT TT=1.756 CHECKS=1027 NODES=0	UNSAT TT=15.913	UNSAT TT=2.755 CHECKS=3036	UNSAT TT=2.774 CHECKS=3442	UNSAT TT=2.037 ASSIGNMENTS=0	UNSAT TT=1.949 ASSIGNMENTS=0	UNSAT TT=101.663 CHECKS=158203000 NODES=7	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=0.722 ASSIGNMENTS=37 CHECKS=8271	UNSAT TT=0.715 ASSIGNMENTS=37 CHECKS=8271	UNSAT TT=9.813	UNSAT TT=8.582	UNSAT TT=1.048 CHECKS=14872	UNSAT TT=0.762 ASSIGNMENTS=73 CHECKS=12338	UNSAT TT=0.923 ASSIGNMENTS=277 CHECKS=17921	UNSAT TT=4.874	UNSAT TT=1.448 ASSIGNMENTS=145 CHECKS=25921	UNSAT TT=0.706 ASSIGNMENTS=37 CHECKS=8271	? TT=63.708	UNSAT TT=1.495 ASSIGNMENTS=171 CHECKS=258826	UNSAT TT=8.053	UNSAT TT=8.056
csp/modifiedRenault/ normalized-renault-mod-36_ext.xml	SAT TT=0.674	SAT TT=2.426 CHECKS=6273 NODES=505	SAT TT=2.635 CHECKS=7996 NODES=449	? (TO) TT=1800.11	SAT TT=35.845 CHECKS=118776	SAT TT=7.588 CHECKS=32223	SAT TT=4.471 ASSIGNMENTS=27	SAT TT=5.209 ASSIGNMENTS=31	SAT TT=71.287 CHECKS=51895100 NODES=172	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=0.705 ASSIGNMENTS=157 CHECKS=9629	SAT TT=0.699 ASSIGNMENTS=157 CHECKS=9629	SAT TT=12.389	SAT TT=13.403	SAT TT=1.127 CHECKS=5532	SAT TT=0.702 ASSIGNMENTS=241 CHECKS=12189	SAT TT=3.949 ASSIGNMENTS=4717 CHECKS=210178	SAT TT=5.417	SAT TT=1.339 ASSIGNMENTS=473 CHECKS=56149	SAT TT=0.674 ASSIGNMENTS=157 CHECKS=9629	? TT=58.108	SAT TT=1.48 ASSIGNMENTS=167 CHECKS=34894	SAT TT=7.648	SAT TT=8.351
csp/modifiedRenault/ normalized-renault-mod-37_ext.xml	UNSAT TT=0.679	UNSAT TT=2.265 CHECKS=6446 NODES=351	UNSAT TT=1.782 CHECKS=810 NODES=0	? (TO) TT=1800.11	UNSAT TT=11.244 CHECKS=30827	UNSAT TT=8.159 CHECKS=38646	UNSAT TT=3.963 ASSIGNMENTS=0	UNSAT TT=4.441 ASSIGNMENTS=0	UNSAT TT=70.373 CHECKS=39950600 NODES=30	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=0.762 ASSIGNMENTS=163 CHECKS=12791	UNSAT TT=0.679 ASSIGNMENTS=163 CHECKS=12791	UNSAT TT=9.094	UNSAT TT=8.408	UNSAT TT=1.121 CHECKS=19956	UNSAT TT=0.848 ASSIGNMENTS=327 CHECKS=24777	UNSAT TT=3.049 ASSIGNMENTS=4921 CHECKS=160326	UNSAT TT=4.936	UNSAT TT=1.384 ASSIGNMENTS=407 CHECKS=40166	UNSAT TT=0.723 ASSIGNMENTS=163 CHECKS=12791	? TT=108.576	UNSAT TT=1.573 ASSIGNMENTS=242 CHECKS=202317	UNSAT TT=7.504	UNSAT TT=8.227
csp/modifiedRenault/ normalized-renault-mod-39_ext.xml	UNSAT TT=0.643	UNSAT TT=2.07 CHECKS=2872 NODES=472	UNSAT TT=1.823 CHECKS=1720 NODES=0	? (TO) TT=1800.07	UNSAT TT=21.085 CHECKS=67486	UNSAT TT=13.145 CHECKS=48945	UNSAT TT=4.667 ASSIGNMENTS=0	UNSAT TT=4.902 ASSIGNMENTS=0	UNSAT TT=68.321 CHECKS=40022800 NODES=47	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=0.643 ASSIGNMENTS=148 CHECKS=8994	UNSAT TT=0.717 ASSIGNMENTS=148 CHECKS=8994	UNSAT TT=9.489	UNSAT TT=9.444	UNSAT TT=1.327 CHECKS=13144	UNSAT TT=0.762 ASSIGNMENTS=294 CHECKS=18917	UNSAT TT=3.579 ASSIGNMENTS=4858 CHECKS=181297	UNSAT TT=4.964	UNSAT TT=1.29 ASSIGNMENTS=418 CHECKS=44047	UNSAT TT=0.693 ASSIGNMENTS=148 CHECKS=8994	? TT=50.746	UNSAT TT=1.585 ASSIGNMENTS=184 CHECKS=205978	UNSAT TT=7.76	UNSAT TT=8.082
csp/modifiedRenault/ normalized-renault-mod-3_ext.xml	UNSAT TT=0.622	UNSAT TT=1.954 CHECKS=3251 NODES=177	UNSAT TT=1.959 CHECKS=1812 NODES=0	? (TO) TT=1800.12	UNSAT TT=14.39 CHECKS=38040	UNSAT TT=7.86 CHECKS=26893	UNSAT TT=4.717 ASSIGNMENTS=0	UNSAT TT=4.36 ASSIGNMENTS=0	UNSAT TT=71.162 CHECKS=39973900 NODES=54	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.628 ASSIGNMENTS=134 CHECKS=5245	UNSAT TT=0.637 ASSIGNMENTS=134 CHECKS=5245	UNSAT TT=10.532	UNSAT TT=8.621	UNSAT TT=1.071 CHECKS=8929	UNSAT TT=0.694 ASSIGNMENTS=290 CHECKS=12409	UNSAT TT=2.922 ASSIGNMENTS=5059 CHECKS=142238	UNSAT TT=5.008	UNSAT TT=1.017 ASSIGNMENTS=393 CHECKS=37173	UNSAT TT=0.622 ASSIGNMENTS=134 CHECKS=5245	? TT=57.657	UNSAT TT=1.503 ASSIGNMENTS=313 CHECKS=262539	UNSAT TT=7.778	UNSAT TT=8.11
csp/modifiedRenault/ normalized-renault-mod-40_ext.xml	UNSAT TT=0.645	UNSAT TT=1.488 CHECKS=175 NODES=7	UNSAT TT=1.594 CHECKS=1162 NODES=0	? (TO) TT=1800.06	UNSAT TT=11.619 CHECKS=35310	UNSAT TT=7.922 CHECKS=27864	UNSAT TT=3.706 ASSIGNMENTS=0	UNSAT TT=4.028 ASSIGNMENTS=0	UNSAT TT=84.46 CHECKS=81984500 NODES=39	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=0.657 ASSIGNMENTS=117 CHECKS=6941	UNSAT TT=0.658 ASSIGNMENTS=117 CHECKS=6941	UNSAT TT=8.607	UNSAT TT=8.057	UNSAT TT=1.142 CHECKS=7509	UNSAT TT=0.674 ASSIGNMENTS=197 CHECKS=10083	UNSAT TT=1.868 ASSIGNMENTS=4555 CHECKS=122011	UNSAT TT=4.919	UNSAT TT=0.943 ASSIGNMENTS=403 CHECKS=44227	UNSAT TT=0.645 ASSIGNMENTS=117 CHECKS=6941	? TT=81.505	UNSAT TT=1.63 ASSIGNMENTS=156 CHECKS=277918	UNSAT TT=7.702	UNSAT TT=7.455
csp/modifiedRenault/ normalized-renault-mod-41_ext.xml	SAT TT=0.597	SAT TT=1.704 CHECKS=2191 NODES=282	SAT TT=1.81 CHECKS=2636 NODES=273	SAT TT=1577.5	SAT TT=30.891 CHECKS=144874	SAT TT=5.684 CHECKS=28581	SAT TT=3.784 ASSIGNMENTS=127	SAT TT=5.451 ASSIGNMENTS=865	SAT TT=71.078 CHECKS=50154600 NODES=170	SAT TT=211.22 CHECKS=193187000 NODES=337201000	? (TO) TT=1800.04	SAT TT=0.649 ASSIGNMENTS=188 CHECKS=5882	SAT TT=0.612 ASSIGNMENTS=188 CHECKS=5882	SAT TT=13.533	SAT TT=11.443	SAT TT=1.026 CHECKS=8259	SAT TT=0.687 ASSIGNMENTS=255 CHECKS=7089	SAT TT=1.602 ASSIGNMENTS=4992 CHECKS=146347	SAT TT=5.513	SAT TT=0.724 ASSIGNMENTS=363 CHECKS=22038	SAT TT=0.597 ASSIGNMENTS=188 CHECKS=5882	? TT=58.891	SAT TT=1.475 ASSIGNMENTS=148 CHECKS=37258	SAT TT=8.377	SAT TT=8.205
csp/modifiedRenault/ normalized-renault-mod-42_ext.xml	UNSAT TT=0.607	UNSAT TT=2.097 CHECKS=4676 NODES=223	UNSAT TT=1.719 CHECKS=804 NODES=0	? (TO) TT=1800.1	UNSAT TT=11.653 CHECKS=37960	UNSAT TT=6.241 CHECKS=20586	UNSAT TT=4.344 ASSIGNMENTS=0	UNSAT TT=4.529 ASSIGNMENTS=0	UNSAT TT=70 CHECKS=43011200 NODES=36	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.607 ASSIGNMENTS=91 CHECKS=4093	UNSAT TT=0.643 ASSIGNMENTS=91 CHECKS=4093	UNSAT TT=9.475	UNSAT TT=8.46	UNSAT TT=1.084 CHECKS=5470	UNSAT TT=0.713 ASSIGNMENTS=157 CHECKS=8423	UNSAT TT=2.931 ASSIGNMENTS=4886 CHECKS=155509	UNSAT TT=5.047	UNSAT TT=1.034 ASSIGNMENTS=542 CHECKS=44319	UNSAT TT=0.628 ASSIGNMENTS=91 CHECKS=4093	? TT=78.349	UNSAT TT=1.428 ASSIGNMENTS=198 CHECKS=134598	UNSAT TT=7.592	UNSAT TT=8.597
csp/modifiedRenault/ normalized-renault-mod-43_ext.xml	SAT TT=0.594	SAT TT=2.086 CHECKS=3961 NODES=504	SAT TT=2.2 CHECKS=1929 NODES=0	SAT TT=23.22	SAT TT=19.13 CHECKS=67662	SAT TT=9.506 CHECKS=31724	SAT TT=4.053 ASSIGNMENTS=17	SAT TT=4.474 ASSIGNMENTS=35	SAT TT=98.918 CHECKS=164856000 NODES=124	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.608 ASSIGNMENTS=33 CHECKS=1920	SAT TT=0.608 ASSIGNMENTS=33 CHECKS=1920	SAT TT=12.359	SAT TT=11.756	SAT TT=1.043 CHECKS=1146	SAT TT=0.596 ASSIGNMENTS=33 CHECKS=1920	Wrong Cert. TT=0.6 ASSIGNMENTS=27 CHECKS=1465	SAT TT=5.68	SAT TT=0.871 ASSIGNMENTS=122 CHECKS=13740	SAT TT=0.594 ASSIGNMENTS=33 CHECKS=1920	? TT=80.649	SAT TT=1.413 ASSIGNMENTS=114 CHECKS=31298	SAT TT=7.815	SAT TT=7.982
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/modifiedRenault/ normalized-renault-mod-44_ext.xml	SAT TT=0.551	SAT TT=1.75 CHECKS=700 NODES=108	SAT TT=1.776 CHECKS=1455 NODES=0	SAT TT=15.203	SAT TT=46.879 CHECKS=151943	SAT TT=5.183 CHECKS=11400	SAT TT=4.5 ASSIGNMENTS=32	SAT TT=4.267 ASSIGNMENTS=34	SAT TT=68.709 CHECKS=39909400 NODES=108	SAT TT=95.774 CHECKS=256697000 NODES=80850100	? (TO) TT=1800.04	SAT TT=0.563 ASSIGNMENTS=30 CHECKS=1394	SAT TT=0.603 ASSIGNMENTS=30 CHECKS=1394	SAT TT=12.337	SAT TT=10.625	SAT TT=1.047 CHECKS=769	SAT TT=0.6 ASSIGNMENTS=30 CHECKS=1394	SAT TT=0.58 ASSIGNMENTS=32 CHECKS=1311	SAT TT=5.989	SAT TT=0.723 ASSIGNMENTS=134 CHECKS=9268	SAT TT=0.551 ASSIGNMENTS=30 CHECKS=1394	? TT=78.757	SAT TT=1.401 ASSIGNMENTS=109 CHECKS=20354	SAT TT=7.123	SAT TT=7.823
csp/modifiedRenault/ normalized-renault-mod-46_ext.xml	SAT TT=0.563	SAT TT=1.629 CHECKS=609 NODES=108	SAT TT=1.73 CHECKS=707 NODES=0	SAT TT=14.676	SAT TT=46.599 CHECKS=155637	SAT TT=5.432 CHECKS=11883	SAT TT=4.058 ASSIGNMENTS=29	SAT TT=4.645 ASSIGNMENTS=40	SAT TT=92.075 CHECKS=116118000 NODES=110	SAT TT=118.658 CHECKS=153790000 NODES=165450000	? (TO) TT=1800.06	SAT TT=0.617 ASSIGNMENTS=29 CHECKS=1382	SAT TT=0.61 ASSIGNMENTS=29 CHECKS=1382	SAT TT=12.343	SAT TT=12.191	SAT TT=1.076 CHECKS=831	SAT TT=0.563 ASSIGNMENTS=29 CHECKS=1382	SAT TT=0.602 ASSIGNMENTS=28 CHECKS=1301	SAT TT=4.922	SAT TT=0.711 ASSIGNMENTS=98 CHECKS=5639	SAT TT=0.606 ASSIGNMENTS=29 CHECKS=1382	? TT=87.202	SAT TT=1.404 ASSIGNMENTS=109 CHECKS=21056	SAT TT=7.587	SAT TT=8.022
csp/modifiedRenault/ normalized-renault-mod-47_ext.xml	UNSAT TT=0.664	UNSAT TT=1.627 CHECKS=19 NODES=7	UNSAT TT=1.873 CHECKS=1258 NODES=0	? (TO) TT=1800.06	UNSAT TT=5.864 CHECKS=21704	UNSAT TT=10.681 CHECKS=41826	UNSAT TT=2.685 ASSIGNMENTS=0	UNSAT TT=3.049 ASSIGNMENTS=0	UNSAT TT=100.459 CHECKS=154626000 NODES=16	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=0.706 ASSIGNMENTS=78 CHECKS=7062	UNSAT TT=0.69 ASSIGNMENTS=78 CHECKS=7062	UNSAT TT=8.773	UNSAT TT=9.29	UNSAT TT=1.007 CHECKS=11074	UNSAT TT=0.688 ASSIGNMENTS=179 CHECKS=14162	UNSAT TT=2.24 ASSIGNMENTS=2914 CHECKS=167937	UNSAT TT=4.993	UNSAT TT=0.81 ASSIGNMENTS=128 CHECKS=20626	UNSAT TT=0.664 ASSIGNMENTS=78 CHECKS=7062	? TT=85.286	UNSAT TT=1.606 ASSIGNMENTS=220 CHECKS=208470	UNSAT TT=7.754	UNSAT TT=8.015
csp/modifiedRenault/ normalized-renault-mod-48_ext.xml	SAT TT=0.592	SAT TT=2.329 CHECKS=3437 NODES=215	SAT TT=1.667 CHECKS=761 NODES=0	SAT TT=14.922	SAT TT=18.268 CHECKS=41888	SAT TT=7.31 CHECKS=18846	SAT TT=5.113 ASSIGNMENTS=23	SAT TT=5.244 ASSIGNMENTS=27	SAT TT=69.788 CHECKS=41379900 NODES=143	SAT TT=630.193 CHECKS=659834000 NODES=1043850000	SAT TT=487.752 CHECKS=1318350000 NODES=788164	SAT TT=0.627 ASSIGNMENTS=36 CHECKS=2047	SAT TT=0.611 ASSIGNMENTS=36 CHECKS=2047	SAT TT=12.164	SAT TT=11.996	SAT TT=1.243 CHECKS=2088	SAT TT=0.592 ASSIGNMENTS=36 CHECKS=2047	SAT TT=0.698 ASSIGNMENTS=210 CHECKS=11333	SAT TT=5.78	SAT TT=1.497 ASSIGNMENTS=295 CHECKS=44062	SAT TT=0.594 ASSIGNMENTS=36 CHECKS=2047	? TT=59.101	SAT TT=1.432 ASSIGNMENTS=109 CHECKS=20641	SAT TT=7.905	SAT TT=8.116
csp/modifiedRenault/ normalized-renault-mod-49_ext.xml	SAT TT=0.624	SAT TT=2.014 CHECKS=3357 NODES=425	SAT TT=2.105 CHECKS=3797 NODES=366	SAT TT=15.988	SAT TT=22.682 CHECKS=90177	SAT TT=5.448 CHECKS=16965	SAT TT=4.892 ASSIGNMENTS=84	SAT TT=4.3 ASSIGNMENTS=29	SAT TT=67.659 CHECKS=39983200 NODES=114	SAT TT=877.011 CHECKS=1065020000 NODES=1321950000	? (TO) TT=1800.02	SAT TT=0.632 ASSIGNMENTS=112 CHECKS=3602	SAT TT=0.669 ASSIGNMENTS=112 CHECKS=3602	SAT TT=11.208	SAT TT=11.478	SAT TT=1.061 CHECKS=3838	SAT TT=0.645 ASSIGNMENTS=116 CHECKS=3633	SAT TT=1.669 ASSIGNMENTS=2798 CHECKS=92527	SAT TT=5.34	SAT TT=1.022 ASSIGNMENTS=527 CHECKS=41799	SAT TT=0.624 ASSIGNMENTS=112 CHECKS=3602	? TT=49.9	SAT TT=1.589 ASSIGNMENTS=378 CHECKS=210626	SAT TT=8.689	SAT TT=7.94
csp/modifiedRenault/ normalized-renault-mod-4_ext.xml	SAT TT=0.564	SAT TT=1.801 CHECKS=1715 NODES=171	SAT TT=1.734 CHECKS=1067 NODES=0	SAT TT=14.558	SAT TT=12.675 CHECKS=32936	SAT TT=6.182 CHECKS=14063	SAT TT=4.465 ASSIGNMENTS=26	SAT TT=4.451 ASSIGNMENTS=37	SAT TT=68.47 CHECKS=39876300 NODES=114	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=0.609 ASSIGNMENTS=28 CHECKS=1322	SAT TT=0.564 ASSIGNMENTS=28 CHECKS=1322	SAT TT=12.157	SAT TT=11.133	SAT TT=1.112 CHECKS=1305	SAT TT=0.568 ASSIGNMENTS=28 CHECKS=1322	SAT TT=0.64 ASSIGNMENTS=41 CHECKS=1284	SAT TT=5.566	SAT TT=1.05 ASSIGNMENTS=478 CHECKS=34365	SAT TT=0.615 ASSIGNMENTS=28 CHECKS=1322	? TT=48.2	SAT TT=1.423 ASSIGNMENTS=113 CHECKS=21818	SAT TT=7.928	SAT TT=8.177
csp/modifiedRenault/ normalized-renault-mod-5_ext.xml	UNSAT TT=0.641	UNSAT TT=2.218 CHECKS=3925 NODES=344	UNSAT TT=2.108 CHECKS=1891 NODES=0	? (TO) TT=1800.1	UNSAT TT=21.484 CHECKS=60361	UNSAT TT=9.485 CHECKS=28966	UNSAT TT=3.834 ASSIGNMENTS=0	UNSAT TT=3.908 ASSIGNMENTS=0	UNSAT TT=70.983 CHECKS=39980700 NODES=31	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.662 ASSIGNMENTS=116 CHECKS=6288	UNSAT TT=0.662 ASSIGNMENTS=116 CHECKS=6288	UNSAT TT=9.453	UNSAT TT=8.613	UNSAT TT=1.077 CHECKS=12537	UNSAT TT=0.734 ASSIGNMENTS=293 CHECKS=15975	UNSAT TT=2.55 ASSIGNMENTS=4920 CHECKS=141554	UNSAT TT=4.794	UNSAT TT=0.997 ASSIGNMENTS=356 CHECKS=34272	UNSAT TT=0.641 ASSIGNMENTS=116 CHECKS=6288	? TT=66.33	UNSAT TT=1.672 ASSIGNMENTS=229 CHECKS=245928	UNSAT TT=7.828	UNSAT TT=8.189
csp/modifiedRenault/ normalized-renault-mod-9_ext.xml	SAT TT=0.584	SAT TT=2.091 CHECKS=3556 NODES=571	SAT TT=2.277 CHECKS=3714 NODES=537	SAT TT=915.421	SAT TT=6.137 CHECKS=17926	SAT TT=7.846 CHECKS=17407	SAT TT=4.463 ASSIGNMENTS=28	SAT TT=4.802 ASSIGNMENTS=222	SAT TT=69.128 CHECKS=41076000 NODES=161	SAT TT=1651.47 CHECKS=728258000 NODES=-1120970000	? (TO) TT=1800.04	SAT TT=0.602 ASSIGNMENTS=44 CHECKS=1756	SAT TT=0.6 ASSIGNMENTS=44 CHECKS=1756	SAT TT=12.812	SAT TT=10.984	SAT TT=0.996 CHECKS=2421	SAT TT=0.62 ASSIGNMENTS=44 CHECKS=1756	SAT TT=2.784 ASSIGNMENTS=5054 CHECKS=151671	SAT TT=5.512	SAT TT=1.365 ASSIGNMENTS=443 CHECKS=44815	SAT TT=0.584 ASSIGNMENTS=44 CHECKS=1756	? TT=69.38	SAT TT=1.516 ASSIGNMENTS=112 CHECKS=21611	SAT TT=8.019	SAT TT=7.796
csp/nengfa/ normalized-block.xml	UNSAT TT=3.833	? (TO) TT=1800.08	? (TO) TT=1800.13	UNSAT TT=1576.66	? (TO) TT=1800.05	? (TO) TT=1800.1	? (problem) TT=2.342	? (problem) TT=2.174	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=15.185	UNSAT TT=17.261	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=23.165	No data	UNSAT TT=3.919	UNSAT TT=3.833
csp/nengfa/ normalized-color.xml	UNSAT TT=1.574	UNSAT TT=30.112 CHECKS=16358100 NODES=15419	UNSAT TT=20.121 CHECKS=8515120 NODES=8855	UNSAT TT=56.097	UNSAT TT=1038.52 CHECKS=2277000000	? (TO) TT=1800.04	UNSAT TT=18.273 ASSIGNMENTS=471	UNSAT TT=14.323 ASSIGNMENTS=91	UNSAT TT=124.562 CHECKS=2886830 NODES=7605	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=1.594 ASSIGNMENTS=1460 CHECKS=1007930	UNSAT TT=1.574 ASSIGNMENTS=1460 CHECKS=1007930	UNSAT TT=1525.69	UNSAT TT=1428.69	No data	UNSAT TT=1.575 ASSIGNMENTS=1500 CHECKS=967643	UNSAT TT=12.455 ASSIGNMENTS=20302 CHECKS=15248200	UNSAT TT=3.252	UNSAT TT=2.427 ASSIGNMENTS=4242 CHECKS=1827390	UNSAT TT=1.761 ASSIGNMENTS=1993 CHECKS=1329870	UNSAT TT=174.167	No data	UNSAT TT=8.212	UNSAT TT=8.352
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/nengfa/ normalized-pack.xml	SAT TT=34.225	SAT TT=936.802 CHECKS=1423020000 NODES=27180	SAT TT=925.439 CHECKS=1423020000 NODES=27180	SAT TT=1340.32	SAT TT=771.91 CHECKS=290338000	? (TO) TT=1800.03	? (problem) TT=7.551	? (problem) TT=7.689	SAT TT=735.495 CHECKS=1281730000 NODES=11069	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=538.374 ASSIGNMENTS=114204 CHECKS=280348000	SAT TT=477.911 ASSIGNMENTS=114204 CHECKS=280348000	? (MO) TT=385.89	? (MO) TT=388.27	No data	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=470.74 ASSIGNMENTS=114204 CHECKS=280348000	? TT=122.483	No data	SAT TT=34.225	SAT TT=37.311
csp/nengfa/ normalized-protein.xml	SAT TT=5.622	SAT TT=1108.33 CHECKS=2555860000 NODES=1738100	SAT TT=552.514 CHECKS=1118470000 NODES=837562	SAT TT=1507.14	SAT TT=5.622 CHECKS=2550550	Signal TT=5.483	SAT TT=148.896 ASSIGNMENTS=138158	? (TO) TT=1800.08	No data	No data	No data	SAT TT=172.737 ASSIGNMENTS=167071	SAT TT=1120.96 ASSIGNMENTS=1738100 CHECKS=2555860000	No data	No data	No data	SAT TT=197.421 ASSIGNMENTS=1178800 CHECKS=342749000	SAT TT=764.168 ASSIGNMENTS=4415720 CHECKS=1306840000	? (problem) TT=0.883	? (TO) TT=1800.03	SAT TT=33.144 ASSIGNMENTS=136824 CHECKS=50246100	SAT TT=262.477	No data	SAT TT=36.222	SAT TT=8.773
csp/nengfa/ normalized-queens1.xml	SAT TT=2.198	SAT TT=4.196 CHECKS=734619 NODES=171	SAT TT=4.677 CHECKS=1226290 NODES=171	SAT TT=64.045	SAT TT=24.803 CHECKS=50564700	SAT TT=51.429 CHECKS=119303000	SAT TT=57.435 ASSIGNMENTS=538	SAT TT=56.573 ASSIGNMENTS=179	SAT TT=53.104 CHECKS=4287610 NODES=872	SAT TT=21.312 CHECKS=7264080 NODES=72	SAT TT=22.38 CHECKS=8987760 NODES=100	SAT TT=51.329 ASSIGNMENTS=538	SAT TT=12.959 ASSIGNMENTS=192 CHECKS=752993	? (TO) TT=1800	? (TO) TT=1800.09	No data	SAT TT=249.191 ASSIGNMENTS=50386 CHECKS=222703000	SAT TT=133.192 ASSIGNMENTS=10209 CHECKS=103484000	? (TO) TT=1800.08	SAT TT=141.931 ASSIGNMENTS=7459 CHECKS=99992400	SAT TT=2.198 ASSIGNMENTS=103 CHECKS=965177	? TT=605.589	No data	SAT TT=12.047	SAT TT=35.547
csp/nengfa/ normalized-queens2.xml	SAT TT=0.076	SAT TT=3.845 CHECKS=1210500 NODES=316	SAT TT=5.822 CHECKS=3646510 NODES=312	SAT TT=0.5	SAT TT=1.397 CHECKS=19976	SAT TT=0.93 CHECKS=23401	SAT TT=16.308 ASSIGNMENTS=1699	? (TO) TT=1800.15	No data	No data	No data	SAT TT=0.095 ASSIGNMENTS=92 CHECKS=59818	SAT TT=0.088 ASSIGNMENTS=92 CHECKS=59818	No data	No data	No data	SAT TT=0.083 ASSIGNMENTS=92 CHECKS=59818	SAT TT=0.155 ASSIGNMENTS=339 CHECKS=147796	? (TO) TT=1800.09	SAT TT=3.008 ASSIGNMENTS=9069 CHECKS=4885590	SAT TT=0.076 ASSIGNMENTS=93 CHECKS=58763	SAT TT=19.03	No data	SAT TT=16.917	SAT TT=34.222
csp/nengfa/ normalized-radi.xml	SAT TT=0.036	SAT TT=313.467 CHECKS=465626000 NODES=8948	SAT TT=315.216 CHECKS=459093000 NODES=8905	SAT TT=8.211	SAT TT=0.437 CHECKS=60525	SAT TT=0.364 CHECKS=53261	SAT TT=1.239 ASSIGNMENTS=102	SAT TT=1.13 ASSIGNMENTS=36	SAT TT=172.292 CHECKS=256883000 NODES=200	SAT TT=1556 CHECKS=3501020000 NODES=5558290	? (TO) TT=1800.06	SAT TT=0.046 ASSIGNMENTS=71 CHECKS=18246	SAT TT=0.045 ASSIGNMENTS=71 CHECKS=18246	? (problem) TT=149.148	? (problem) TT=148.095	No data	SAT TT=0.036 ASSIGNMENTS=87 CHECKS=18085	SAT TT=0.846 ASSIGNMENTS=11180 CHECKS=1742310	SAT TT=0.685	SAT TT=0.371 ASSIGNMENTS=2839 CHECKS=437882	SAT TT=0.7 ASSIGNMENTS=7383 CHECKS=1445130	? TT=125.992	No data	SAT TT=1.533	SAT TT=1.907
csp/nengfa/ normalized-route.xml	SAT TT=4.692	SAT TT=7.963 CHECKS=75471 NODES=81	SAT TT=8.606 CHECKS=202929 NODES=0	SAT TT=257.539	SAT TT=21.234 CHECKS=20942800	SAT TT=17.992 CHECKS=14367400	SAT TT=17.059 ASSIGNMENTS=33	SAT TT=16.142 ASSIGNMENTS=36	SAT TT=21.759 CHECKS=115846 NODES=117	SAT TT=138.084 CHECKS=49755100 NODES=9057	SAT TT=28.152 CHECKS=8875040 NODES=437	SAT TT=14.706 ASSIGNMENTS=115 CHECKS=3601910	SAT TT=16.973 ASSIGNMENTS=81 CHECKS=75471	? (TO) TT=1800.07	? (TO) TT=1800.09	No data	SAT TT=4.692 ASSIGNMENTS=116 CHECKS=3594490	SAT TT=6.223 ASSIGNMENTS=389 CHECKS=4617750	SAT TT=6.323	SAT TT=8.757 ASSIGNMENTS=271 CHECKS=7017180	SAT TT=5.609 ASSIGNMENTS=115 CHECKS=3601910	? (exit code) TT=98.927	No data	SAT TT=6.839	SAT TT=7.342
csp/nengfa/ normalized-schur.xml	SAT TT=0.34	SAT TT=4.623 CHECKS=805771 NODES=2597	SAT TT=8.018 CHECKS=2034400 NODES=6261	SAT TT=17.533	? (TO) TT=1800.06	SAT TT=32.383 CHECKS=33801300	SAT TT=3.504 ASSIGNMENTS=61	SAT TT=3.172 ASSIGNMENTS=61	SAT TT=4.683 CHECKS=12110 NODES=110	SAT TT=8.207 CHECKS=6507370 NODES=7583	SAT TT=5.14 CHECKS=847869 NODES=327	SAT TT=0.353 ASSIGNMENTS=60 CHECKS=29428	SAT TT=0.353 ASSIGNMENTS=60 CHECKS=29428	SAT TT=178.449	SAT TT=181.273	No data	SAT TT=0.34 ASSIGNMENTS=60 CHECKS=29428	SAT TT=25.552 ASSIGNMENTS=19667 CHECKS=25538300	SAT TT=196.688	SAT TT=2.711 ASSIGNMENTS=1800 CHECKS=2317110	SAT TT=9.088 ASSIGNMENTS=4736 CHECKS=8677330	SAT TT=25.208	No data	SAT TT=24.674	SAT TT=9.867
csp/nengfa/ normalized-sudoku368.xml	SAT TT=0.063	SAT TT=2.87 CHECKS=6477 NODES=4122	SAT TT=18.366 CHECKS=2733 NODES=3698	SAT TT=8.93	SAT TT=0.063 CHECKS=2477	SAT TT=0.083 CHECKS=5599	SAT TT=0.998 ASSIGNMENTS=1	SAT TT=0.935 ASSIGNMENTS=1	No data	No data	No data	SAT TT=0.111 ASSIGNMENTS=302 CHECKS=123211	SAT TT=0.1 ASSIGNMENTS=302 CHECKS=123211	No data	No data	No data	SAT TT=0.19 ASSIGNMENTS=1005 CHECKS=313177	SAT TT=0.546 ASSIGNMENTS=6217 CHECKS=994130	SAT TT=0.834	SAT TT=0.171 ASSIGNMENTS=1197 CHECKS=189375	SAT TT=0.104 ASSIGNMENTS=548 CHECKS=136533	SAT TT=2.834	No data	SAT TT=3.828	SAT TT=4.161
csp/ogdHerald/ normalized-crossword-m1-ogd-05-01.xml	SAT TT=0.069	SAT TT=0.927 CHECKS=3576 NODES=25	SAT TT=1.168 CHECKS=6613 NODES=25	SAT TT=4.815	SAT TT=1.11 CHECKS=4281	SAT TT=1.029 CHECKS=4299	SAT TT=16.792 ASSIGNMENTS=906	SAT TT=1.92 ASSIGNMENTS=15	SAT TT=62.681 CHECKS=20081800 NODES=28	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=22.841 ASSIGNMENTS=906	SAT TT=7.603 ASSIGNMENTS=188 CHECKS=22235	? (TO) TT=1800.1	? (TO) TT=1800.02	No data	SAT TT=9.559 ASSIGNMENTS=7855 CHECKS=3435890	SAT TT=2.047 ASSIGNMENTS=9293 CHECKS=982195	SAT TT=1.744	SAT TT=0.1 ASSIGNMENTS=178 CHECKS=26480	SAT TT=0.069 ASSIGNMENTS=188 CHECKS=22235	? (MO) TT=37.439	No data	SAT TT=14.928	SAT TT=17.969
csp/ogdHerald/ normalized-crossword-m1-ogd-05-04.xml	SAT TT=0.032	SAT TT=1.043 CHECKS=2400 NODES=19	SAT TT=0.872 CHECKS=1602 NODES=0	SAT TT=1.954	SAT TT=0.349 CHECKS=976	SAT TT=0.355 CHECKS=1271	SAT TT=2.936 ASSIGNMENTS=302	SAT TT=1.127 ASSIGNMENTS=13	SAT TT=117.14 CHECKS=4579910 NODES=22	SAT TT=57.856 CHECKS=5420250 NODES=3150030	SAT TT=222.148 CHECKS=333000000 NODES=11118	SAT TT=0.401 ASSIGNMENTS=1155 CHECKS=93290	SAT TT=0.387 ASSIGNMENTS=1155 CHECKS=93290	? (TO) TT=1800.09	? (TO) TT=1800	No data	SAT TT=0.443 ASSIGNMENTS=1830 CHECKS=132036	SAT TT=0.032 ASSIGNMENTS=14 CHECKS=923	SAT TT=0.747	SAT TT=0.042 ASSIGNMENTS=50 CHECKS=2724	SAT TT=0.052 ASSIGNMENTS=147 CHECKS=6599	? (MO) TT=35.953	No data	SAT TT=4.129	SAT TT=5.392
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdHerald/ normalized-crossword-m1-ogd-05-06.xml	SAT TT=0.073	SAT TT=0.952 CHECKS=1698 NODES=23	SAT TT=1.056 CHECKS=1859 NODES=0	SAT TT=2.889	SAT TT=0.768 CHECKS=2152	SAT TT=0.749 CHECKS=2392	SAT TT=3.672 ASSIGNMENTS=226	SAT TT=1.774 ASSIGNMENTS=14	SAT TT=92.684 CHECKS=11673400 NODES=29	SAT TT=1277.58 CHECKS=5293990000 NODES=1231330000	? (TO) TT=1800.08	SAT TT=0.697 ASSIGNMENTS=1207 CHECKS=200133	SAT TT=0.676 ASSIGNMENTS=1207 CHECKS=200133	? (TO) TT=1800.06	? (TO) TT=1800.08	No data	SAT TT=0.643 ASSIGNMENTS=1211 CHECKS=199439	SAT TT=0.189 ASSIGNMENTS=388 CHECKS=40675	SAT TT=1.532	SAT TT=0.073 ASSIGNMENTS=93 CHECKS=10453	SAT TT=0.097 ASSIGNMENTS=164 CHECKS=17465	? (MO) TT=33.032	No data	SAT TT=9.217	SAT TT=12.92
csp/ogdHerald/ normalized-crossword-m1-ogd-05-08.xml	SAT TT=0.052	SAT TT=0.904 CHECKS=3016 NODES=21	SAT TT=0.889 CHECKS=2122 NODES=0	SAT TT=2.888	SAT TT=0.622 CHECKS=2056	SAT TT=0.617 CHECKS=2188	SAT TT=2.343 ASSIGNMENTS=152	SAT TT=1.64 ASSIGNMENTS=15	SAT TT=108.151 CHECKS=10842600 NODES=25	SAT TT=293.004 CHECKS=180117000 NODES=1608000000	? (TO) TT=1800.02	SAT TT=0.705 ASSIGNMENTS=1228 CHECKS=186984	SAT TT=0.724 ASSIGNMENTS=1228 CHECKS=186984	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	SAT TT=0.902 ASSIGNMENTS=1698 CHECKS=268346	SAT TT=0.802 ASSIGNMENTS=2992 CHECKS=236565	SAT TT=1.31	SAT TT=0.097 ASSIGNMENTS=150 CHECKS=15797	SAT TT=0.052 ASSIGNMENTS=94 CHECKS=6447	? (MO) TT=30.944	No data	SAT TT=9.615	SAT TT=11.736
csp/ogdHerald/ normalized-crossword-m1-ogd-05-09.xml	SAT TT=0.043	SAT TT=0.833 CHECKS=2166 NODES=19	SAT TT=0.868 CHECKS=1510 NODES=0	SAT TT=1.496	SAT TT=0.381 CHECKS=1278	SAT TT=0.327 CHECKS=1084	SAT TT=1.281 ASSIGNMENTS=71	SAT TT=1.126 ASSIGNMENTS=13	SAT TT=123.1 CHECKS=3387240 NODES=21	SAT TT=78.446 CHECKS=7038580 NODES=4500020	? (MO) TT=17.78	SAT TT=0.324 ASSIGNMENTS=802 CHECKS=77748	SAT TT=0.314 ASSIGNMENTS=802 CHECKS=77748	? (TO) TT=1800.09	? (TO) TT=1800.08	No data	SAT TT=0.289 ASSIGNMENTS=695 CHECKS=70796	SAT TT=0.044 ASSIGNMENTS=61 CHECKS=3535	SAT TT=0.784	SAT TT=0.043 ASSIGNMENTS=59 CHECKS=2906	SAT TT=0.049 ASSIGNMENTS=109 CHECKS=6808	? (MO) TT=38.389	No data	SAT TT=4.367	SAT TT=5.516
csp/ogdHerald/ normalized-crossword-m1-ogd-05-10.xml	SAT TT=0.034	SAT TT=0.881 CHECKS=4858 NODES=17	SAT TT=0.847 CHECKS=4129 NODES=0	SAT TT=1.589	SAT TT=0.28 CHECKS=1400	SAT TT=0.253 CHECKS=1609	SAT TT=1.506 ASSIGNMENTS=121	SAT TT=1.007 ASSIGNMENTS=15	SAT TT=129.347 CHECKS=2984550 NODES=19	SAT TT=66.936 CHECKS=3899510 NODES=7800020	SAT TT=94.905 CHECKS=22446700 NODES=4257	SAT TT=0.247 ASSIGNMENTS=1009 CHECKS=178578	SAT TT=0.225 ASSIGNMENTS=1009 CHECKS=178578	? (TO) TT=1800.07	? (TO) TT=1800.06	No data	SAT TT=0.424 ASSIGNMENTS=1362 CHECKS=245977	SAT TT=0.095 ASSIGNMENTS=326 CHECKS=26284	SAT TT=0.722	SAT TT=0.034 ASSIGNMENTS=25 CHECKS=2334	SAT TT=0.093 ASSIGNMENTS=251 CHECKS=24689	? (MO) TT=35.732	No data	SAT TT=3.944	SAT TT=4.515
csp/ogdHerald/ normalized-crossword-m1-ogd-15-02.xml	SAT TT=0.913	SAT TT=3.913 CHECKS=219221 NODES=324	SAT TT=4.49 CHECKS=338547 NODES=321	? (TO) TT=1800.06	SAT TT=30.145 CHECKS=156028	SAT TT=16.889 CHECKS=62487	SAT TT=33.333 ASSIGNMENTS=86	SAT TT=60.567 ASSIGNMENTS=81	SAT TT=229.704 CHECKS=622558000 NODES=371	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=0.952 ASSIGNMENTS=79 CHECKS=69464	SAT TT=0.937 ASSIGNMENTS=79 CHECKS=69464	? (TO) TT=1800.02	? (TO) TT=1800.1	No data	SAT TT=0.913 ASSIGNMENTS=79 CHECKS=69464	SAT TT=74.31 ASSIGNMENTS=15050 CHECKS=19984800	SAT TT=38.231	SAT TT=51.759 ASSIGNMENTS=11278 CHECKS=9593620	SAT TT=0.944 ASSIGNMENTS=97 CHECKS=73114	? TT=98.717	No data	? (MO) TT=6.67	? (TO) TT=1800.07
csp/ogdHerald/ normalized-crossword-m1-ogd-15-03.xml	SAT TT=0.538	SAT TT=2.948 CHECKS=154375 NODES=195	SAT TT=3.916 CHECKS=288911 NODES=195	SAT TT=33.076	SAT TT=30.822 CHECKS=95812	SAT TT=23.169 CHECKS=53313	SAT TT=21.15 ASSIGNMENTS=106	SAT TT=60.539 ASSIGNMENTS=84	SAT TT=207.889 CHECKS=544969000 NODES=265	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=0.552 ASSIGNMENTS=103 CHECKS=63534	SAT TT=0.553 ASSIGNMENTS=103 CHECKS=63534	? (TO) TT=1800.03	? (TO) TT=1800	No data	SAT TT=0.547 ASSIGNMENTS=103 CHECKS=63534	SAT TT=48.748 ASSIGNMENTS=25562 CHECKS=22188600	SAT TT=21.468	SAT TT=22.164 ASSIGNMENTS=6130 CHECKS=4927320	SAT TT=0.538 ASSIGNMENTS=100 CHECKS=63137	? (MO) TT=31.643	No data	? (TO) TT=1800	? (TO) TT=1800.06
csp/ogdHerald/ normalized-crossword-m1-ogd-15-05.xml	SAT TT=0.746	SAT TT=3.321 CHECKS=193399 NODES=185	SAT TT=3.954 CHECKS=351613 NODES=188	? (TO) TT=1800.1	SAT TT=26.24 CHECKS=111013	SAT TT=14.09 CHECKS=103171	SAT TT=19.93 ASSIGNMENTS=104	SAT TT=62.577 ASSIGNMENTS=85	SAT TT=160.785 CHECKS=234090000 NODES=307	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.798 ASSIGNMENTS=98 CHECKS=75903	SAT TT=0.929 ASSIGNMENTS=98 CHECKS=75903	? (TO) TT=1800.09	? (TO) TT=1800.04	No data	SAT TT=0.904 ASSIGNMENTS=98 CHECKS=75903	SAT TT=54.165 ASSIGNMENTS=21622 CHECKS=23144400	SAT TT=18.597	SAT TT=59.227 ASSIGNMENTS=16202 CHECKS=13764700	SAT TT=0.746 ASSIGNMENTS=90 CHECKS=63126	? TT=87.88	No data	? (TO) TT=1800.05	? (TO) TT=1800.2
csp/ogdHerald/ normalized-crossword-m1-ogd-15-06.xml	SAT TT=0.897	SAT TT=6.153 CHECKS=269791 NODES=930	SAT TT=7.19 CHECKS=147950 NODES=501	? (TO) TT=1800.07	SAT TT=37.424 CHECKS=109965	SAT TT=25.347 CHECKS=40197	SAT TT=31.924 ASSIGNMENTS=70	SAT TT=47.523 ASSIGNMENTS=68	SAT TT=204.321 CHECKS=562974000 NODES=323	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=0.907 ASSIGNMENTS=78 CHECKS=56861	SAT TT=0.966 ASSIGNMENTS=78 CHECKS=56861	? (TO) TT=1800.01	? (TO) TT=1800.04	No data	SAT TT=0.897 ASSIGNMENTS=79 CHECKS=57081	SAT TT=65.317 ASSIGNMENTS=17865 CHECKS=14628300	SAT TT=35.02	SAT TT=45.762 ASSIGNMENTS=7837 CHECKS=5057230	SAT TT=1.072 ASSIGNMENTS=107 CHECKS=61590	? TT=77.503	No data	? (TO) TT=1800.09	? (MO) TT=6.376
csp/ogdHerald/ normalized-crossword-m1-ogd-15-08.xml	SAT TT=0.569	SAT TT=3.127 CHECKS=161512 NODES=188	SAT TT=3.901 CHECKS=289040 NODES=189	? (TO) TT=1800.12	SAT TT=27.059 CHECKS=91234	SAT TT=20.057 CHECKS=66612	SAT TT=17.161 ASSIGNMENTS=106	SAT TT=42.976 ASSIGNMENTS=78	SAT TT=186.8 CHECKS=423219000 NODES=258	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=0.61 ASSIGNMENTS=114 CHECKS=58012	SAT TT=0.569 ASSIGNMENTS=114 CHECKS=58012	? (TO) TT=1800.07	? (TO) TT=1800.07	No data	SAT TT=0.595 ASSIGNMENTS=114 CHECKS=58012	SAT TT=31.899 ASSIGNMENTS=21460 CHECKS=22485200	SAT TT=31.624	SAT TT=35.012 ASSIGNMENTS=13176 CHECKS=8775080	SAT TT=0.619 ASSIGNMENTS=103 CHECKS=61284	? (MO) TT=35.324	No data	? (TO) TT=1800	? (TO) TT=1800.04
csp/ogdHerald/ normalized-crossword-m1-ogd-19-02.xml	SAT TT=1.147	SAT TT=5.918 CHECKS=359025 NODES=531	SAT TT=7.95 CHECKS=513466 NODES=531	? (TO) TT=1800.17	SAT TT=34.443 CHECKS=196117	SAT TT=28.547 CHECKS=237161	SAT TT=43.694 ASSIGNMENTS=114	SAT TT=66.435 ASSIGNMENTS=212	SAT TT=224.064 CHECKS=579765000 NODES=423	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=1.158 ASSIGNMENTS=103 CHECKS=118325	SAT TT=1.163 ASSIGNMENTS=103 CHECKS=118325	? (TO) TT=1800.02	? (TO) TT=1800.01	No data	SAT TT=1.147 ASSIGNMENTS=103 CHECKS=118325	SAT TT=113.024 ASSIGNMENTS=20375 CHECKS=45974700	SAT TT=63.359	SAT TT=75.491 ASSIGNMENTS=12729 CHECKS=14687700	SAT TT=1.243 ASSIGNMENTS=142 CHECKS=135414	? TT=77.559	No data	? (MO) TT=7.392	? (MO) TT=7.481
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdHerald/ normalized-crossword-m1-ogd-19-05.xml	SAT TT=0.591	SAT TT=3.968 CHECKS=389571 NODES=292	SAT TT=6.338 CHECKS=839027 NODES=299	? (TO) TT=1800.06	SAT TT=29.035 CHECKS=258501	SAT TT=13.478 CHECKS=159602	SAT TT=32.706 ASSIGNMENTS=112	SAT TT=66.631 ASSIGNMENTS=360	SAT TT=319.478 CHECKS=962057000 NODES=442	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.592 ASSIGNMENTS=120 CHECKS=164203	SAT TT=0.591 ASSIGNMENTS=120 CHECKS=164203	? (TO) TT=1800.09	? (TO) TT=1800.04	No data	SAT TT=0.666 ASSIGNMENTS=120 CHECKS=164203	SAT TT=5.159 ASSIGNMENTS=1361 CHECKS=2496820	SAT TT=29.896	SAT TT=39.656 ASSIGNMENTS=10876 CHECKS=22538400	SAT TT=0.658 ASSIGNMENTS=124 CHECKS=169335	? (MO) TT=45.764	No data	? (TO) TT=1800.05	? (TO) TT=1800.04
csp/ogdHerald/ normalized-crossword-m1-ogd-19-06.xml	SAT TT=1.454	SAT TT=5.327 CHECKS=443343 NODES=291	SAT TT=7.206 CHECKS=678067 NODES=291	? (TO) TT=1800.07	SAT TT=55.531 CHECKS=260089	SAT TT=27.71 CHECKS=109972	SAT TT=42.008 ASSIGNMENTS=153	SAT TT=65.947 ASSIGNMENTS=139	SAT TT=216.712 CHECKS=411071000 NODES=504	? (TO) TT=1800.04	? (TO) TT=1800	SAT TT=1.537 ASSIGNMENTS=157 CHECKS=161643	SAT TT=1.48 ASSIGNMENTS=157 CHECKS=161643	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	SAT TT=1.454 ASSIGNMENTS=157 CHECKS=161643	SAT TT=20.576 ASSIGNMENTS=3554 CHECKS=4652140	? (TO) TT=1800.03	SAT TT=203.098 ASSIGNMENTS=31585 CHECKS=47613500	SAT TT=1.491 ASSIGNMENTS=153 CHECKS=163902	? TT=100.411	No data	? (MO) TT=7.29	? (MO) TT=7.88
csp/ogdHerald/ normalized-crossword-m1-ogd-19-08.xml	SAT TT=1.522	SAT TT=6.147 CHECKS=570466 NODES=302	SAT TT=8.602 CHECKS=1242960 NODES=568	? (TO) TT=1800.1	SAT TT=40.694 CHECKS=209968	SAT TT=25.092 CHECKS=133892	SAT TT=43.13 ASSIGNMENTS=150	SAT TT=69.216 ASSIGNMENTS=328	SAT TT=199.618 CHECKS=331564000 NODES=469	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=1.707 ASSIGNMENTS=192 CHECKS=243341	SAT TT=1.604 ASSIGNMENTS=192 CHECKS=243341	? (TO) TT=1800.08	? (TO) TT=1800.05	No data	SAT TT=1.734 ASSIGNMENTS=193 CHECKS=244313	SAT TT=55.023 ASSIGNMENTS=10905 CHECKS=18585500	SAT TT=202.706	SAT TT=42.129 ASSIGNMENTS=7809 CHECKS=14590800	SAT TT=1.522 ASSIGNMENTS=200 CHECKS=231462	? TT=81.781	No data	? (MO) TT=8.23	? (MO) TT=8.06
csp/ogdHerald/ normalized-crossword-m1-ogd-21-03.xml	SAT TT=1.495	SAT TT=5.532 CHECKS=272797 NODES=371	SAT TT=7.693 CHECKS=463302 NODES=371	? (TO) TT=1800.12	SAT TT=43.687 CHECKS=219325	SAT TT=45.024 CHECKS=167154	SAT TT=51.517 ASSIGNMENTS=154	SAT TT=66.435 ASSIGNMENTS=140	SAT TT=492.62 CHECKS=1814310000 NODES=676	? (TO) TT=1800	? (TO) TT=1800.05	SAT TT=1.513 ASSIGNMENTS=180 CHECKS=161589	SAT TT=1.511 ASSIGNMENTS=180 CHECKS=161589	? (TO) TT=1800.02	? (TO) TT=1800.05	No data	SAT TT=1.495 ASSIGNMENTS=180 CHECKS=161589	SAT TT=73.105 ASSIGNMENTS=11084 CHECKS=13950500	? (MO) TT=41.58	SAT TT=89.574 ASSIGNMENTS=14041 CHECKS=18222900	SAT TT=1.78 ASSIGNMENTS=191 CHECKS=216462	? TT=96.658	No data	? (TO) TT=1800.2	? (MO) TT=8.45
csp/ogdHerald/ normalized-crossword-m1-ogd-21-05.xml	SAT TT=0.856	SAT TT=4.916 CHECKS=265481 NODES=383	SAT TT=6.868 CHECKS=373260 NODES=378	? (TO) TT=1800.11	SAT TT=51.277 CHECKS=370406	SAT TT=35.486 CHECKS=215167	SAT TT=42.235 ASSIGNMENTS=177	SAT TT=103.782 ASSIGNMENTS=1395	SAT TT=1376.45 CHECKS=6470460000 NODES=1036	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=1.332 ASSIGNMENTS=224 CHECKS=296774	SAT TT=1.259 ASSIGNMENTS=224 CHECKS=296774	? (TO) TT=1800.06	? (TO) TT=1800.04	No data	SAT TT=1.184 ASSIGNMENTS=226 CHECKS=298539	SAT TT=49.589 ASSIGNMENTS=11555 CHECKS=16229300	SAT TT=48.976	SAT TT=107.702 ASSIGNMENTS=25082 CHECKS=38040600	SAT TT=0.856 ASSIGNMENTS=177 CHECKS=200195	? (MO) TT=34.788	No data	? (TO) TT=1800.26	? (TO) TT=1800.29
csp/ogdHerald/ normalized-crossword-m1-ogd-21-08.xml	SAT TT=1.141	SAT TT=7.07 CHECKS=599752 NODES=367	SAT TT=8.68 CHECKS=1065130 NODES=371	? (TO) TT=1800.11	SAT TT=69.655 CHECKS=603265	SAT TT=31.593 CHECKS=358159	SAT TT=45.187 ASSIGNMENTS=198	? (TO) TT=1800.15	SAT TT=478.945 CHECKS=1936670000 NODES=890	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.15 ASSIGNMENTS=202 CHECKS=265265	SAT TT=1.214 ASSIGNMENTS=202 CHECKS=265265	? (TO) TT=1800.01	? (TO) TT=1800.1	No data	SAT TT=1.141 ASSIGNMENTS=202 CHECKS=265265	SAT TT=38.767 ASSIGNMENTS=10651 CHECKS=17630500	? (TO) TT=1800.01	SAT TT=155.23 ASSIGNMENTS=36787 CHECKS=69086700	SAT TT=1.145 ASSIGNMENTS=207 CHECKS=261998	? TT=83.358	No data	? (MO) TT=7.381	? (MO) TT=7.28
csp/ogdHerald/ normalized-crossword-m1-ogd-21-10.xml	SAT TT=3.256	SAT TT=8.983 CHECKS=265498 NODES=1384	SAT TT=11.328 CHECKS=200122 NODES=1029	? (problem) TT=51.237	SAT TT=89.782 CHECKS=1055370	SAT TT=60.949 CHECKS=470543	SAT TT=68.034 ASSIGNMENTS=151	? (TO) TT=1800.14	SAT TT=606.018 CHECKS=2703620000 NODES=997	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=16.73 ASSIGNMENTS=1383 CHECKS=264722	SAT TT=16.209 ASSIGNMENTS=1383 CHECKS=264722	? (TO) TT=1800.06	? (TO) TT=1800	No data	SAT TT=4.932 ASSIGNMENTS=669 CHECKS=964438	SAT TT=94.418 ASSIGNMENTS=9794 CHECKS=16726500	? (MO) TT=45.47	SAT TT=157.801 ASSIGNMENTS=18001 CHECKS=30589900	SAT TT=3.256 ASSIGNMENTS=348 CHECKS=505001	? TT=78.311	No data	? (MO) TT=7.09	? (MO) TT=7.07
csp/ogdHerald/ normalized-crossword-m1-ogd-23-02.xml	SAT TT=2.258	SAT TT=9.265 CHECKS=760880 NODES=608	SAT TT=11.278 CHECKS=1171760 NODES=444	? (problem) TT=65.319	SAT TT=72.649 CHECKS=509655	SAT TT=32.518 CHECKS=269031	SAT TT=70.359 ASSIGNMENTS=205	SAT TT=159.886 ASSIGNMENTS=2706	SAT TT=368.915 CHECKS=1156120000 NODES=874	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=2.392 ASSIGNMENTS=213 CHECKS=306603	SAT TT=2.502 ASSIGNMENTS=213 CHECKS=306603	? (TO) TT=1800.03	? (TO) TT=1800.03	No data	SAT TT=2.387 ASSIGNMENTS=213 CHECKS=306603	SAT TT=85.353 ASSIGNMENTS=13279 CHECKS=24747700	? (MO) TT=44.76	SAT TT=269.006 ASSIGNMENTS=37726 CHECKS=77871200	SAT TT=2.258 ASSIGNMENTS=214 CHECKS=301928	? TT=98.452	No data	? (MO) TT=9.35	? (MO) TT=9.31
csp/ogdHerald/ normalized-crossword-m1-ogd-23-03.xml	SAT TT=2.543	SAT TT=9.84 CHECKS=505816 NODES=1123	SAT TT=13.26 CHECKS=824798 NODES=1123	? (problem) TT=70.915	SAT TT=85.375 CHECKS=766586	SAT TT=39.048 CHECKS=351549	SAT TT=69.474 ASSIGNMENTS=179	SAT TT=600.469 ASSIGNMENTS=16825	SAT TT=531.525 CHECKS=2052790000 NODES=618	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=2.825 ASSIGNMENTS=250 CHECKS=346176	SAT TT=2.842 ASSIGNMENTS=250 CHECKS=346176	? (TO) TT=1800.07	? (TO) TT=1800.03	No data	SAT TT=2.882 ASSIGNMENTS=276 CHECKS=369680	SAT TT=94.283 ASSIGNMENTS=11615 CHECKS=20454700	? (MO) TT=44.75	SAT TT=126.51 ASSIGNMENTS=15103 CHECKS=27159900	SAT TT=2.543 ASSIGNMENTS=201 CHECKS=286927	? TT=109.239	No data	? (MO) TT=9.53	? (MO) TT=9.53
csp/ogdHerald/ normalized-crossword-m1-ogd-23-07.xml	SAT TT=2.426	SAT TT=9.987 CHECKS=632546 NODES=849	SAT TT=12.623 CHECKS=857925 NODES=450	? (problem) TT=64.583	SAT TT=73.616 CHECKS=425359	SAT TT=35.295 CHECKS=286091	SAT TT=71.405 ASSIGNMENTS=203	SAT TT=75.498 ASSIGNMENTS=380	SAT TT=430.468 CHECKS=1645730000 NODES=946	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=2.582 ASSIGNMENTS=189 CHECKS=283028	SAT TT=2.452 ASSIGNMENTS=189 CHECKS=283028	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	SAT TT=2.426 ASSIGNMENTS=189 CHECKS=283028	SAT TT=111.345 ASSIGNMENTS=12587 CHECKS=24669700	? (MO) TT=46	SAT TT=445.216 ASSIGNMENTS=51001 CHECKS=108336000	SAT TT=2.555 ASSIGNMENTS=192 CHECKS=283738	? TT=100.139	No data	? (MO) TT=9.44	? (MO) TT=9.549
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdHerald/ normalized-crossword-m1-ogd-23-08.xml	SAT TT=1.429	SAT TT=8.74 CHECKS=635114 NODES=936	SAT TT=13.575 CHECKS=756952 NODES=1315	? (TO) TT=1800.18	SAT TT=78.405 CHECKS=758967	SAT TT=86.406 CHECKS=1929500	SAT TT=62.719 ASSIGNMENTS=254	? (TO) TT=1800.06	SAT TT=681.81 CHECKS=2860230000 NODES=988	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=1.449 ASSIGNMENTS=210 CHECKS=317852	SAT TT=1.443 ASSIGNMENTS=210 CHECKS=317852	? (TO) TT=1800.02	? (TO) TT=1800.1	No data	SAT TT=1.429 ASSIGNMENTS=210 CHECKS=317852	SAT TT=66.898 ASSIGNMENTS=13076 CHECKS=22436100	? (MO) TT=49.84	SAT TT=236.242 ASSIGNMENTS=50588 CHECKS=89435300	SAT TT=1.619 ASSIGNMENTS=228 CHECKS=375495	? TT=83.992	No data	? (TO) TT=1800.19	? (MO) TT=6.26
csp/ogdHerald/ normalized-crossword-m1-ogd-23-09.xml	SAT TT=2.094	SAT TT=10.762 CHECKS=1245680 NODES=1199	SAT TT=14.848 CHECKS=1005220 NODES=1235	? (TO) TT=1800.15	SAT TT=63.14 CHECKS=1138740	SAT TT=44.932 CHECKS=525345	SAT TT=71.804 ASSIGNMENTS=159	? (TO) TT=1800.07	SAT TT=555.663 CHECKS=2507880000 NODES=813	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=2.183 ASSIGNMENTS=222 CHECKS=546396	SAT TT=2.316 ASSIGNMENTS=222 CHECKS=546396	? (TO) TT=1800.01	? (TO) TT=1800.04	No data	SAT TT=2.177 ASSIGNMENTS=226 CHECKS=551566	SAT TT=70.611 ASSIGNMENTS=10721 CHECKS=31297700	? (MO) TT=44.01	SAT TT=276.167 ASSIGNMENTS=42035 CHECKS=136670000	SAT TT=2.094 ASSIGNMENTS=216 CHECKS=624994	? TT=73.589	No data	? (TO) TT=1800.11	? (MO) TT=7.415
csp/ogdHerald/ normalized-crossword-m1-ogd-23-10.xml	SAT TT=5.559	SAT TT=12.025 CHECKS=395373 NODES=1288	SAT TT=29.92 CHECKS=1389220 NODES=3196	? (problem) TT=60.821	SAT TT=84.148 CHECKS=333817	SAT TT=99.018 CHECKS=555449	SAT TT=69.622 ASSIGNMENTS=135	? (TO) TT=1800.14	SAT TT=216.174 CHECKS=228422000 NODES=1070	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=23.005 ASSIGNMENTS=2114 CHECKS=853311	SAT TT=26.045 ASSIGNMENTS=2114 CHECKS=853311	? (TO) TT=1800.09	? (TO) TT=1800.09	No data	SAT TT=5.559 ASSIGNMENTS=352 CHECKS=585943	SAT TT=147.162 ASSIGNMENTS=11257 CHECKS=17668900	? (MO) TT=7.49	SAT TT=635.023 ASSIGNMENTS=52023 CHECKS=86383100	SAT TT=8.976 ASSIGNMENTS=507 CHECKS=963852	? TT=63.457	No data	? (MO) TT=7.31	? (MO) TT=7.14
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle02.xml	SAT TT=0.009	SAT TT=0.741 CHECKS=1738 NODES=8	SAT TT=0.725 CHECKS=1041 NODES=0	SAT TT=0.065	SAT TT=0.04 CHECKS=436	SAT TT=0.034 CHECKS=488	SAT TT=0.732 ASSIGNMENTS=68	SAT TT=0.673 ASSIGNMENTS=6	SAT TT=88.955 CHECKS=17595 NODES=9	SAT TT=31.147 CHECKS=21926 NODES=8	SAT TT=32.547 CHECKS=19369 NODES=3	SAT TT=0.03 ASSIGNMENTS=143 CHECKS=5947	SAT TT=0.028 ASSIGNMENTS=143 CHECKS=5947	SAT TT=79.999	SAT TT=75.08	No data	SAT TT=0.019 ASSIGNMENTS=145 CHECKS=6112	SAT TT=0.009 ASSIGNMENTS=15 CHECKS=613	SAT TT=0.343	SAT TT=0.01 ASSIGNMENTS=7 CHECKS=231	SAT TT=0.015 ASSIGNMENTS=118 CHECKS=3255	SAT TT=1337.74	No data	SAT TT=0.834	SAT TT=0.896
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle03.xml	SAT TT=0.022	SAT TT=0.778 CHECKS=2393 NODES=14	SAT TT=0.814 CHECKS=1528 NODES=0	SAT TT=0.24	SAT TT=0.154 CHECKS=1032	SAT TT=0.131 CHECKS=997	SAT TT=1.212 ASSIGNMENTS=67	SAT TT=1.012 ASSIGNMENTS=11	SAT TT=136.879 CHECKS=415980 NODES=15	SAT TT=89.731 CHECKS=1966270 NODES=2250010	SAT TT=85.095 CHECKS=428991 NODES=12	SAT TT=0.222 ASSIGNMENTS=914 CHECKS=69613	SAT TT=0.209 ASSIGNMENTS=914 CHECKS=69613	? (TO) TT=1800.02	? (TO) TT=1800.02	No data	SAT TT=0.204 ASSIGNMENTS=812 CHECKS=64590	SAT TT=0.057 ASSIGNMENTS=418 CHECKS=20259	SAT TT=0.497	SAT TT=0.024 ASSIGNMENTS=76 CHECKS=4153	SAT TT=0.022 ASSIGNMENTS=97 CHECKS=4590	? (TO) TT=1800.12	No data	SAT TT=1.414	SAT TT=1.778
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle05.xml	SAT TT=0.036	SAT TT=0.859 CHECKS=2409 NODES=21	SAT TT=0.873 CHECKS=1744 NODES=0	SAT TT=1.543	SAT TT=0.339 CHECKS=1014	SAT TT=0.356 CHECKS=1263	SAT TT=2.752 ASSIGNMENTS=228	SAT TT=1.051 ASSIGNMENTS=15	SAT TT=90.287 CHECKS=3778160 NODES=22	SAT TT=38.4 CHECKS=50809300 NODES=56400000	SAT TT=46.702 CHECKS=29324900 NODES=1384	SAT TT=9.924 ASSIGNMENTS=228	SAT TT=10.565 ASSIGNMENTS=228	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	SAT TT=1.236 ASSIGNMENTS=2855 CHECKS=236063	SAT TT=0.076 ASSIGNMENTS=155 CHECKS=8744	SAT TT=0.914	SAT TT=0.036 ASSIGNMENTS=23 CHECKS=1155	SAT TT=0.061 ASSIGNMENTS=223 CHECKS=8840	? (MO) TT=40.129	No data	SAT TT=4.423	SAT TT=5.662
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle06.xml	SAT TT=0.037	SAT TT=0.866 CHECKS=3346 NODES=24	SAT TT=0.884 CHECKS=2363 NODES=0	SAT TT=2.962	SAT TT=0.622 CHECKS=1547	SAT TT=0.527 CHECKS=1586	SAT TT=6.057 ASSIGNMENTS=297	SAT TT=1.457 ASSIGNMENTS=12	SAT TT=93.936 CHECKS=10348500 NODES=24	SAT TT=233.416 CHECKS=153308000 NODES=1398300000	? (TO) TT=1800.09	SAT TT=0.971 ASSIGNMENTS=1623 CHECKS=267414	SAT TT=1.055 ASSIGNMENTS=1623 CHECKS=267414	? (TO) TT=1800.04	? (TO) TT=1800.09	No data	SAT TT=3.094 ASSIGNMENTS=4739 CHECKS=921562	SAT TT=0.037 ASSIGNMENTS=20 CHECKS=2672	SAT TT=1.097	SAT TT=0.053 ASSIGNMENTS=66 CHECKS=5705	SAT TT=0.047 ASSIGNMENTS=95 CHECKS=8714	? (MO) TT=37.661	No data	SAT TT=9.449	SAT TT=11.887
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle07.xml	SAT TT=0.038	SAT TT=0.909 CHECKS=4866 NODES=30	SAT TT=0.903 CHECKS=4732 NODES=0	SAT TT=2.034	SAT TT=0.769 CHECKS=3743	SAT TT=0.511 CHECKS=2039	SAT TT=14.943 ASSIGNMENTS=3056	SAT TT=1.585 ASSIGNMENTS=23	SAT TT=132.296 CHECKS=7555750 NODES=31	SAT TT=1392.27 CHECKS=4822550000 NODES=1478230000	SAT TT=1018.32 CHECKS=1648650000 NODES=85045	SAT TT=0.21 ASSIGNMENTS=592 CHECKS=85849	SAT TT=0.208 ASSIGNMENTS=592 CHECKS=85849	? (TO) TT=1800.07	? (TO) TT=1800.09	No data	SAT TT=0.204 ASSIGNMENTS=606 CHECKS=87656	SAT TT=0.054 ASSIGNMENTS=74 CHECKS=5663	SAT TT=1.016	SAT TT=0.038 ASSIGNMENTS=40 CHECKS=2377	SAT TT=0.074 ASSIGNMENTS=154 CHECKS=13498	? TT=100.925	No data	SAT TT=7.027	SAT TT=8.72
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle08.xml	SAT TT=0.16	SAT TT=1.137 CHECKS=15503 NODES=41	SAT TT=1.122 CHECKS=12944 NODES=0	SAT TT=13.089	SAT TT=1.946 CHECKS=6389	SAT TT=2.458 CHECKS=10336	SAT TT=3.286 ASSIGNMENTS=273	SAT TT=3.09 ASSIGNMENTS=25	SAT TT=131.115 CHECKS=315091 NODES=44	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=1.024 ASSIGNMENTS=1526 CHECKS=530618	SAT TT=1.018 ASSIGNMENTS=1526 CHECKS=530618	? (TO) TT=1800.04	? (TO) TT=1800.05	No data	SAT TT=1.014 ASSIGNMENTS=1438 CHECKS=502068	SAT TT=2.214 ASSIGNMENTS=1469 CHECKS=272335	SAT TT=2.805	SAT TT=0.165 ASSIGNMENTS=74 CHECKS=8801	SAT TT=0.16 ASSIGNMENTS=160 CHECKS=30198	? (TO) TT=1800.15	No data	SAT TT=183.298	SAT TT=174.917
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle10.xml	SAT TT=0.118	SAT TT=1.213 CHECKS=22773 NODES=41	SAT TT=1.387 CHECKS=57768 NODES=44	SAT TT=4.219	SAT TT=48.738 CHECKS=247516	SAT TT=3.257 CHECKS=15114	SAT TT=3.581 ASSIGNMENTS=26	SAT TT=3.971 ASSIGNMENTS=28	SAT TT=129.362 CHECKS=134913 NODES=45	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=0.135 ASSIGNMENTS=24 CHECKS=5687	SAT TT=0.135 ASSIGNMENTS=24 CHECKS=5687	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	SAT TT=0.13 ASSIGNMENTS=24 CHECKS=5687	SAT TT=8.544 ASSIGNMENTS=11465 CHECKS=1729850	SAT TT=3.58	SAT TT=0.182 ASSIGNMENTS=71 CHECKS=18703	SAT TT=0.118 ASSIGNMENTS=24 CHECKS=5687	? (TO) TT=1800.18	No data	SAT TT=232.981	SAT TT=237.225
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle11.xml	SAT TT=0.265	SAT TT=1.312 CHECKS=5711 NODES=38	SAT TT=1.182 CHECKS=3201 NODES=0	SAT TT=6.391	SAT TT=2.631 CHECKS=4449	SAT TT=2.664 CHECKS=5252	SAT TT=4.044 ASSIGNMENTS=174	SAT TT=3.643 ASSIGNMENTS=18	SAT TT=112.484 CHECKS=189330000 NODES=38	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=0.889 ASSIGNMENTS=1056 CHECKS=185443	SAT TT=0.901 ASSIGNMENTS=1056 CHECKS=185443	? (TO) TT=1800.05	? (TO) TT=1800.06	No data	SAT TT=0.633 ASSIGNMENTS=944 CHECKS=170415	SAT TT=0.806 ASSIGNMENTS=322 CHECKS=48295	SAT TT=3.262	SAT TT=0.477 ASSIGNMENTS=208 CHECKS=21188	SAT TT=0.265 ASSIGNMENTS=110 CHECKS=22983	? TT=80.039	No data	SAT TT=151.287	SAT TT=166.573
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle12.xml	SAT TT=0.045	SAT TT=1.079 CHECKS=24190 NODES=52	SAT TT=1.245 CHECKS=18061 NODES=0	SAT TT=2.563	SAT TT=0.88 CHECKS=8278	SAT TT=0.671 CHECKS=8767	SAT TT=1.981 ASSIGNMENTS=39	SAT TT=2.596 ASSIGNMENTS=36	SAT TT=128.682 CHECKS=10179500 NODES=56	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=0.059 ASSIGNMENTS=37 CHECKS=6989	SAT TT=0.06 ASSIGNMENTS=37 CHECKS=6989	? (TO) TT=1800.07	? (TO) TT=1800.02	No data	SAT TT=0.045 ASSIGNMENTS=37 CHECKS=6989	SAT TT=2.603 ASSIGNMENTS=11178 CHECKS=2503680	? (TO) TT=1800.11	SAT TT=0.274 ASSIGNMENTS=643 CHECKS=155602	SAT TT=0.052 ASSIGNMENTS=44 CHECKS=10653	? (MO) TT=31.768	No data	SAT TT=8.543	SAT TT=11.358
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle13.xml	SAT TT=0.298	SAT TT=1.712 CHECKS=34538 NODES=65	SAT TT=1.696 CHECKS=32395 NODES=0	SAT TT=10.352	SAT TT=8.014 CHECKS=26757	SAT TT=5.478 CHECKS=13912	SAT TT=6.587 ASSIGNMENTS=46	SAT TT=7.216 ASSIGNMENTS=34	SAT TT=137.415 CHECKS=2182740 NODES=70	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=0.324 ASSIGNMENTS=46 CHECKS=12954	SAT TT=0.307 ASSIGNMENTS=46 CHECKS=12954	? (TO) TT=1800.09	? (TO) TT=1800.06	No data	SAT TT=0.298 ASSIGNMENTS=46 CHECKS=12954	SAT TT=18.772 ASSIGNMENTS=15822 CHECKS=4252790	SAT TT=5.715	SAT TT=2.268 ASSIGNMENTS=1121 CHECKS=433612	SAT TT=0.323 ASSIGNMENTS=40 CHECKS=13064	? (MO) TT=43.156	No data	SAT TT=1202.06	SAT TT=1352.68
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle16.xml	SAT TT=0.275	SAT TT=2.326 CHECKS=141580 NODES=137	SAT TT=2.725 CHECKS=305792 NODES=137	SAT TT=1634.91	SAT TT=5.409 CHECKS=44521	SAT TT=3.878 CHECKS=38213	SAT TT=8.192 ASSIGNMENTS=87	SAT TT=19.296 ASSIGNMENTS=82	SAT TT=214.463 CHECKS=526612000 NODES=221	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=0.308 ASSIGNMENTS=88 CHECKS=40120	SAT TT=0.307 ASSIGNMENTS=88 CHECKS=40120	? (TO) TT=1800.1	? (TO) TT=1800.06	No data	SAT TT=0.275 ASSIGNMENTS=88 CHECKS=40120	SAT TT=17.251 ASSIGNMENTS=19910 CHECKS=14155900	SAT TT=6.177	SAT TT=6.419 ASSIGNMENTS=4355 CHECKS=2539200	SAT TT=0.287 ASSIGNMENTS=82 CHECKS=39313	? (MO) TT=54.361	No data	SAT TT=223.944	SAT TT=232.776
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle17.xml	SAT TT=0.418	SAT TT=2.599 CHECKS=245496 NODES=185	SAT TT=3.612 CHECKS=452743 NODES=185	? (TO) TT=1800.06	SAT TT=12.358 CHECKS=69677	SAT TT=10.756 CHECKS=69033	SAT TT=15.711 ASSIGNMENTS=98	SAT TT=51.771 ASSIGNMENTS=102	SAT TT=191.13 CHECKS=305425000 NODES=241	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=0.445 ASSIGNMENTS=108 CHECKS=73192	SAT TT=0.448 ASSIGNMENTS=108 CHECKS=73192	? (TO) TT=1800.08	? (TO) TT=1800.02	No data	SAT TT=0.45 ASSIGNMENTS=108 CHECKS=73192	SAT TT=40.023 ASSIGNMENTS=25361 CHECKS=27031400	? (TO) TT=1800.06	SAT TT=58.84 ASSIGNMENTS=25913 CHECKS=18753700	SAT TT=0.418 ASSIGNMENTS=104 CHECKS=67307	? TT=79.348	No data	SAT TT=1046.23	SAT TT=1059.65
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle19.xml	SAT TT=0.826	SAT TT=3.1 CHECKS=154205 NODES=193	SAT TT=4.187 CHECKS=280376 NODES=193	? (TO) TT=1800.08	SAT TT=34.378 CHECKS=134278	SAT TT=13.675 CHECKS=48994	SAT TT=22.766 ASSIGNMENTS=91	SAT TT=60.356 ASSIGNMENTS=88	SAT TT=168.358 CHECKS=370142000 NODES=266	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=0.929 ASSIGNMENTS=100 CHECKS=59462	SAT TT=0.907 ASSIGNMENTS=100 CHECKS=59462	? (TO) TT=1800.05	? (TO) TT=1800.06	No data	SAT TT=0.871 ASSIGNMENTS=100 CHECKS=59462	SAT TT=43.948 ASSIGNMENTS=21103 CHECKS=19679500	SAT TT=19.251	SAT TT=21.767 ASSIGNMENTS=5689 CHECKS=4028720	SAT TT=0.826 ASSIGNMENTS=92 CHECKS=53804	? TT=79.599	No data	? (MO) TT=6.337	? (MO) TT=6.87
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle21.xml	SAT TT=0.162	SAT TT=1.752 CHECKS=116587 NODES=131	SAT TT=2.259 CHECKS=213548 NODES=128	SAT TT=11.408	SAT TT=6.849 CHECKS=38625	SAT TT=6.707 CHECKS=89031	SAT TT=6.928 ASSIGNMENTS=71	SAT TT=17.395 ASSIGNMENTS=79	SAT TT=295.425 CHECKS=784086000 NODES=199	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.172 ASSIGNMENTS=79 CHECKS=32801	SAT TT=0.172 ASSIGNMENTS=79 CHECKS=32801	? (TO) TT=1800.09	? (TO) TT=1800.08	No data	SAT TT=0.162 ASSIGNMENTS=78 CHECKS=32650	SAT TT=9.876 ASSIGNMENTS=19879 CHECKS=9969070	SAT TT=5.674	SAT TT=4.095 ASSIGNMENTS=4094 CHECKS=1997310	SAT TT=0.163 ASSIGNMENTS=96 CHECKS=35630	? (MO) TT=41.805	No data	SAT TT=113.241	SAT TT=122.424
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle22.xml	SAT TT=0.347	SAT TT=2.187 CHECKS=81327 NODES=134	SAT TT=2.833 CHECKS=139203 NODES=134	? (TO) TT=1800.05	SAT TT=15.41 CHECKS=68840	SAT TT=13.484 CHECKS=42701	SAT TT=18.974 ASSIGNMENTS=63	SAT TT=24.086 ASSIGNMENTS=62	SAT TT=133.131 CHECKS=3284820 NODES=138	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=0.367 ASSIGNMENTS=60 CHECKS=34811	SAT TT=0.347 ASSIGNMENTS=60 CHECKS=34811	? (TO) TT=1800.04	? (TO) TT=1800.04	No data	SAT TT=0.364 ASSIGNMENTS=60 CHECKS=34811	SAT TT=55.861 ASSIGNMENTS=14353 CHECKS=11369000	SAT TT=13.183	SAT TT=17.441 ASSIGNMENTS=3790 CHECKS=3330050	SAT TT=0.428 ASSIGNMENTS=87 CHECKS=50191	? (MO) TT=41.999	No data	? (TO) TT=1800.07	? (TO) TT=1800.1
csp/ogdVg/ normalized-crossword-m1c-ogd-vg10-10_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (MO) TT=40.13	? (TO) TT=1800.11	? (TO) TT=1800.08	? TT=40.428	? (TO) TT=1800.04	? (TO) TT=1800.18	? (TO) TT=1800.15
csp/ogdVg/ normalized-crossword-m1c-ogd-vg10-11_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (MO) TT=37.05	? (TO) TT=1800.09	? (TO) TT=1800.1	? TT=34.472	? (TO) TT=1800.01	? (MO) TT=6.199	? (TO) TT=1800.26
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdVg/ normalized-crossword-m1c-ogd-vg10-12_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? (MO) TT=36.23	? (TO) TT=1800.04	? (TO) TT=1800.03	? TT=35.852	? (TO) TT=1800.06	? (TO) TT=1800.92	? (TO) TT=1800.18
csp/ogdVg/ normalized-crossword-m1c-ogd-vg10-13_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.03	? (MO) TT=34.91	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=43.803	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.2
csp/ogdVg/ normalized-crossword-m1c-ogd-vg10-14_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	? (MO) TT=31.91	? (TO) TT=1800.01	? (TO) TT=1800.06	? TT=35.561	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.19
csp/ogdVg/ normalized-crossword-m1c-ogd-vg11-11_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	? (MO) TT=37.85	? (TO) TT=1800.04	? (TO) TT=1800.06	? TT=31.551	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.42
csp/ogdVg/ normalized-crossword-m1c-ogd-vg11-12_ext.xml		? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800.19	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (MO) TT=39.44	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=33.193	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.19
csp/ogdVg/ normalized-crossword-m1c-ogd-vg11-13_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.07	? (MO) TT=35.26	? (TO) TT=1800.02	? (TO) TT=1800.03	? TT=44.875	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.2
csp/ogdVg/ normalized-crossword-m1c-ogd-vg11-14_ext.xml	UNSAT TT=1512.65	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=1512.65 ASSIGNMENTS=16057 CHECKS=3278980	? (TO) TT=1800.06	? (MO) TT=32.87	UNSAT TT=1689.84 ASSIGNMENTS=19978 CHECKS=4017500	UNSAT TT=1719.67 ASSIGNMENTS=17198 CHECKS=3506410	? TT=37.112	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.21
csp/ogdVg/ normalized-crossword-m1c-ogd-vg11-15_ext.xml	UNSAT TT=518.23	UNSAT TT=979.969 CHECKS=2573 NODES=8237	UNSAT TT=929.901 CHECKS=3002 NODES=7899	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.1	UNSAT TT=1149.16 ASSIGNMENTS=2757	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=1301.97 ASSIGNMENTS=6522 CHECKS=1319550	UNSAT TT=972.559 ASSIGNMENTS=8237 CHECKS=2573	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=518.23 ASSIGNMENTS=6440 CHECKS=1290740	UNSAT TT=786.378 ASSIGNMENTS=10533 CHECKS=1887510	? (MO) TT=33.28	UNSAT TT=617.418 ASSIGNMENTS=8433 CHECKS=1636530	UNSAT TT=572.414 ASSIGNMENTS=6522 CHECKS=1319550	? TT=43.655	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.19
csp/ogdVg/ normalized-crossword-m1c-ogd-vg12-12_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	? (MO) TT=39.78	? (TO) TT=1800.09	? (TO) TT=1800.05	? TT=97.335	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.08
csp/ogdVg/ normalized-crossword-m1c-ogd-vg12-13_ext.xml	UNSAT TT=1417.23	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=1530.36 ASSIGNMENTS=17381 CHECKS=3221680	? (TO) TT=1800.1	? (MO) TT=32.46	? (TO) TT=1800.07	UNSAT TT=1417.23 ASSIGNMENTS=16474 CHECKS=3045320	? TT=78.954	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.19
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdVg/ normalized-crossword-m1c-ogd-vg12-14_ext.xml	UNSAT TT=669.147	UNSAT TT=1239.15 CHECKS=806 NODES=11735	UNSAT TT=1231.95 CHECKS=1057 NODES=11511	? (TO) TT=1800.18	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=1298.55 ASSIGNMENTS=11735 CHECKS=806	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=724.573 ASSIGNMENTS=8505 CHECKS=1691960	UNSAT TT=1041.51 ASSIGNMENTS=13373 CHECKS=2426480	? (MO) TT=33.5	UNSAT TT=775.6 ASSIGNMENTS=10227 CHECKS=1996470	UNSAT TT=669.147 ASSIGNMENTS=8295 CHECKS=1659000	? TT=97.085	? (TO) TT=1800.07	? (TO) TT=1800.49	? (TO) TT=1800.14
csp/ogdVg/ normalized-crossword-m1c-ogd-vg12-15_ext.xml	UNSAT TT=287.458	UNSAT TT=429.469 CHECKS=33 NODES=4293	UNSAT TT=426.248 CHECKS=40 NODES=3940	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=601.768 ASSIGNMENTS=1269	? (TO) TT=1800.14	UNSAT TT=1100.52 CHECKS=0 NODES=5464	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=424.163 ASSIGNMENTS=4293 CHECKS=33	UNSAT TT=412.483 ASSIGNMENTS=4293 CHECKS=33	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=796.511 CHECKS=694107	UNSAT TT=305.904 ASSIGNMENTS=4107 CHECKS=815376	UNSAT TT=450.663 ASSIGNMENTS=6829 CHECKS=1178890	? (MO) TT=30.52	UNSAT TT=330.881 ASSIGNMENTS=5241 CHECKS=1015330	UNSAT TT=287.458 ASSIGNMENTS=3479 CHECKS=705376	? TT=88.302	? (TO) TT=1800.02	? (TO) TT=1800.21	? (TO) TT=1800.14
csp/ogdVg/ normalized-crossword-m1c-ogd-vg13-13_ext.xml	UNSAT TT=380.573	UNSAT TT=680.515 CHECKS=2148 NODES=8731	UNSAT TT=678.507 CHECKS=264 NODES=8836	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.17	UNSAT TT=1071.35 ASSIGNMENTS=2465	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=604.797 ASSIGNMENTS=7947 CHECKS=2323	UNSAT TT=613.536 ASSIGNMENTS=7947 CHECKS=2323	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=1458.23 CHECKS=1941580	UNSAT TT=380.573 ASSIGNMENTS=6039 CHECKS=1111060	UNSAT TT=791.277 ASSIGNMENTS=11790 CHECKS=1996590	? (MO) TT=34.65	UNSAT TT=608.191 ASSIGNMENTS=10577 CHECKS=1901610	UNSAT TT=419.765 ASSIGNMENTS=6063 CHECKS=1114500	? TT=86.202	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.21
csp/ogdVg/ normalized-crossword-m1c-ogd-vg13-14_ext.xml	UNSAT TT=162.52	UNSAT TT=268.483 CHECKS=42 NODES=3371	UNSAT TT=360.628 CHECKS=44 NODES=3586	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=688.568 ASSIGNMENTS=1522	? (TO) TT=1800.09	UNSAT TT=818.118 CHECKS=0 NODES=5059	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=285.049 ASSIGNMENTS=3371 CHECKS=42	UNSAT TT=280.857 ASSIGNMENTS=3371 CHECKS=42	? (TO) TT=1800.1	UNSAT TT=1788.31	UNSAT TT=793.802 CHECKS=984750	UNSAT TT=186.72 ASSIGNMENTS=2859 CHECKS=525846	UNSAT TT=440.328 ASSIGNMENTS=7395 CHECKS=1283530	? (MO) TT=29.25	UNSAT TT=253.248 ASSIGNMENTS=4817 CHECKS=927999	UNSAT TT=162.52 ASSIGNMENTS=2811 CHECKS=518691	? TT=82.81	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.12
csp/ogdVg/ normalized-crossword-m1c-ogd-vg13-15_ext.xml	UNSAT TT=63.781	UNSAT TT=93.138 CHECKS=0 NODES=1269	UNSAT TT=139.364 CHECKS=0 NODES=1498	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=211.223 ASSIGNMENTS=498	? (TO) TT=1800.13	UNSAT TT=283.088 CHECKS=0 NODES=1748	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=108.445 ASSIGNMENTS=1269 CHECKS=0	UNSAT TT=100.427 ASSIGNMENTS=1269 CHECKS=0	UNSAT TT=742.887	UNSAT TT=663.537	UNSAT TT=206.048 CHECKS=233272	UNSAT TT=63.781 ASSIGNMENTS=1215 CHECKS=227538	UNSAT TT=260.15 ASSIGNMENTS=4885 CHECKS=805937	? (MO) TT=28.03	UNSAT TT=129.861 ASSIGNMENTS=3296 CHECKS=641554	UNSAT TT=68.531 ASSIGNMENTS=1273 CHECKS=231987	? TT=85.028	? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.17
csp/ogdVg/ normalized-crossword-m1c-ogd-vg13-16_ext.xml	UNSAT TT=4.545	UNSAT TT=14.879 CHECKS=0 NODES=160	UNSAT TT=49.367 CHECKS=0 NODES=99	? (TO) TT=1800.06	UNSAT TT=309.986 CHECKS=31605	UNSAT TT=363.928 CHECKS=28628	UNSAT TT=76.441 ASSIGNMENTS=45	UNSAT TT=432.115 ASSIGNMENTS=554	UNSAT TT=29.286 CHECKS=0 NODES=202	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=21.958 ASSIGNMENTS=160 CHECKS=0	UNSAT TT=21.11 ASSIGNMENTS=160 CHECKS=0	UNSAT TT=176.18	UNSAT TT=153.466	UNSAT TT=18.774 CHECKS=18544	UNSAT TT=4.545 ASSIGNMENTS=99 CHECKS=21592	UNSAT TT=155.696 ASSIGNMENTS=3544 CHECKS=627492	? (MO) TT=26.82	UNSAT TT=87.54 ASSIGNMENTS=2656 CHECKS=491936	UNSAT TT=5.48 ASSIGNMENTS=116 CHECKS=22862	? TT=89.673	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.1
csp/ogdVg/ normalized-crossword-m1c-ogd-vg14-15_ext.xml	UNSAT TT=35.759	UNSAT TT=39.124 CHECKS=0 NODES=771	UNSAT TT=93.436 CHECKS=0 NODES=1033	? (TO) TT=1800.17	UNSAT TT=645.513 CHECKS=93187	UNSAT TT=1090.35 CHECKS=165861	UNSAT TT=126.418 ASSIGNMENTS=267	? (TO) TT=1800.12	UNSAT TT=137.913 CHECKS=0 NODES=1141	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=47.584 ASSIGNMENTS=771 CHECKS=0	UNSAT TT=49.214 ASSIGNMENTS=771 CHECKS=0	UNSAT TT=817.899	UNSAT TT=959.646	UNSAT TT=196.57 CHECKS=246486	UNSAT TT=35.759 ASSIGNMENTS=785 CHECKS=163768	UNSAT TT=162.593 ASSIGNMENTS=4410 CHECKS=785270	? (MO) TT=24.62	UNSAT TT=120.796 ASSIGNMENTS=3294 CHECKS=718130	UNSAT TT=35.812 ASSIGNMENTS=799 CHECKS=167426	? TT=102.436	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.18
csp/ogdVg/ normalized-crossword-m1c-ogd-vg14-17_ext.xml	UNSAT TT=1.498	UNSAT TT=3.017 CHECKS=0 NODES=39	UNSAT TT=12.433 CHECKS=0 NODES=0	? (TO) TT=1800.09	UNSAT TT=80.385 CHECKS=11658	UNSAT TT=58.901 CHECKS=11341	UNSAT TT=68.38 ASSIGNMENTS=0	UNSAT TT=86.127 ASSIGNMENTS=51	UNSAT TT=10.613 CHECKS=0 NODES=69	? (TO) TT=1800	? (TO) TT=1800.1	UNSAT TT=10.069 ASSIGNMENTS=39 CHECKS=0	UNSAT TT=1.579 ASSIGNMENTS=44 CHECKS=9327	UNSAT TT=141.446	UNSAT TT=113.431	UNSAT TT=11.653 CHECKS=17264	UNSAT TT=1.904 ASSIGNMENTS=53 CHECKS=11269	UNSAT TT=100.213 ASSIGNMENTS=3324 CHECKS=636470	? (MO) TT=23.21	UNSAT TT=4.509 ASSIGNMENTS=176 CHECKS=27329	UNSAT TT=1.498 ASSIGNMENTS=44 CHECKS=9327	? TT=82.806	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/ogdVg/ normalized-crossword-m1c-ogd-vg15-16_ext.xml	UNSAT TT=1.089	UNSAT TT=1.997 CHECKS=0 NODES=38	UNSAT TT=4.383 CHECKS=0 NODES=0	? (TO) TT=1800.14	UNSAT TT=52.729 CHECKS=19297	UNSAT TT=32.462 CHECKS=13101	UNSAT TT=66.345 ASSIGNMENTS=0	UNSAT TT=60.415 ASSIGNMENTS=0	UNSAT TT=6.037 CHECKS=0 NODES=62	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=1.089 ASSIGNMENTS=30 CHECKS=8031	UNSAT TT=1.106 ASSIGNMENTS=30 CHECKS=8031	UNSAT TT=157.003	UNSAT TT=113.356	UNSAT TT=4.699 CHECKS=6148	UNSAT TT=1.152 ASSIGNMENTS=36 CHECKS=8531	UNSAT TT=79.498 ASSIGNMENTS=3305 CHECKS=654744	UNSAT TT=55.665	UNSAT TT=9.049 ASSIGNMENTS=459 CHECKS=74787	UNSAT TT=1.136 ASSIGNMENTS=30 CHECKS=8031	? TT=79.683	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.07
csp/ogdVg/ normalized-crossword-m1c-ogd-vg15-19_ext.xml	UNSAT TT=0.183	UNSAT TT=1.082 CHECKS=0 NODES=0	UNSAT TT=1.269 CHECKS=0 NODES=0	? (TO) TT=1800.18	UNSAT TT=5.31 CHECKS=88	UNSAT TT=5.295 CHECKS=88	UNSAT TT=0.818 ASSIGNMENTS=0	UNSAT TT=0.913 ASSIGNMENTS=0	UNSAT TT=1.809 CHECKS=0 NODES=0	UNSAT TT=1.722 CHECKS=0 NODES=0	UNSAT TT=1.773 CHECKS=0 NODES=0	UNSAT TT=0.214 ASSIGNMENTS=0 CHECKS=453	UNSAT TT=0.193 ASSIGNMENTS=0 CHECKS=453	UNSAT TT=87.539	UNSAT TT=63.788	UNSAT TT=0.81 CHECKS=596	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=453	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=453	UNSAT TT=17.507	UNSAT TT=0.183 ASSIGNMENTS=0 CHECKS=453	UNSAT TT=0.201 ASSIGNMENTS=0 CHECKS=453	? TT=84.723	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.15
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdVg/ normalized-crossword-m1c-ogd-vg16-16_ext.xml	UNSAT TT=0.278	UNSAT TT=1.045 CHECKS=0 NODES=8	UNSAT TT=1.052 CHECKS=0 NODES=0	? (TO) TT=1800.17	UNSAT TT=5.664 CHECKS=4213	UNSAT TT=4.838 CHECKS=3992	UNSAT TT=1.549 ASSIGNMENTS=0	UNSAT TT=1.646 ASSIGNMENTS=0	UNSAT TT=0.967 CHECKS=0 NODES=11	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.314 ASSIGNMENTS=6 CHECKS=2917	UNSAT TT=0.318 ASSIGNMENTS=6 CHECKS=2917	UNSAT TT=58.762	UNSAT TT=50.741	UNSAT TT=0.619 CHECKS=1511	UNSAT TT=0.278 ASSIGNMENTS=7 CHECKS=3034	UNSAT TT=1.431 ASSIGNMENTS=89 CHECKS=17835	UNSAT TT=5.784	UNSAT TT=0.4 ASSIGNMENTS=22 CHECKS=3517	UNSAT TT=0.304 ASSIGNMENTS=6 CHECKS=2917	? TT=87.061	? (TO) TT=1800.08	UNSAT TT=794.444	? (TO) TT=1800.07
csp/ogdVg/ normalized-crossword-m1c-ogd-vg16-18_ext.xml	UNSAT TT=0.106	UNSAT TT=0.857 CHECKS=0 NODES=0	UNSAT TT=0.846 CHECKS=0 NODES=0	? (TO) TT=1800.08	UNSAT TT=1.039 CHECKS=102	UNSAT TT=1.019 CHECKS=102	UNSAT TT=0.621 ASSIGNMENTS=0	UNSAT TT=0.656 ASSIGNMENTS=0	UNSAT TT=0.864 CHECKS=0 NODES=0	UNSAT TT=0.701 CHECKS=0 NODES=0	UNSAT TT=0.7 CHECKS=0 NODES=0	UNSAT TT=0.123 ASSIGNMENTS=0 CHECKS=539	UNSAT TT=0.119 ASSIGNMENTS=0 CHECKS=539	UNSAT TT=40.317	UNSAT TT=30.401	UNSAT TT=0.143 CHECKS=138	UNSAT TT=0.109 ASSIGNMENTS=0 CHECKS=539	UNSAT TT=0.112 ASSIGNMENTS=0 CHECKS=539	UNSAT TT=4.462	UNSAT TT=0.106 ASSIGNMENTS=0 CHECKS=539	UNSAT TT=0.11 ASSIGNMENTS=0 CHECKS=539	? TT=82.142	? (TO) TT=1800.03	UNSAT TT=411.384	? (TO) TT=1800.1
csp/ogdVg/ normalized-crossword-m1c-ogd-vg16-20_ext.xml	UNSAT TT=0.087	UNSAT TT=1 CHECKS=0 NODES=0	UNSAT TT=0.878 CHECKS=0 NODES=0	UNSAT TT=72.162	UNSAT TT=1.036 CHECKS=57	UNSAT TT=1.042 CHECKS=57	UNSAT TT=0.593 ASSIGNMENTS=0	UNSAT TT=0.72 ASSIGNMENTS=0	UNSAT TT=0.627 CHECKS=0 NODES=0	UNSAT TT=0.736 CHECKS=0 NODES=0	UNSAT TT=0.603 CHECKS=0 NODES=0	UNSAT TT=0.099 ASSIGNMENTS=0 CHECKS=77	UNSAT TT=0.098 ASSIGNMENTS=0 CHECKS=77	UNSAT TT=35.999	UNSAT TT=27.343	UNSAT TT=0.113 CHECKS=77	UNSAT TT=0.091 ASSIGNMENTS=0 CHECKS=77	UNSAT TT=0.087 ASSIGNMENTS=0 CHECKS=77	UNSAT TT=3.953	UNSAT TT=0.087 ASSIGNMENTS=0 CHECKS=77	UNSAT TT=0.088 ASSIGNMENTS=0 CHECKS=77	? TT=74.452	? (TO) TT=1800.05	UNSAT TT=425.284	UNSAT TT=489.767
csp/ogdVg/ normalized-crossword-m1c-ogd-vg4-4_ext.xml	SAT TT=0.01	SAT TT=0.691 CHECKS=9 NODES=16	SAT TT=0.687 CHECKS=9 NODES=0	SAT TT=0.25	SAT TT=0.245 CHECKS=590	SAT TT=0.229 CHECKS=534	SAT TT=0.745 ASSIGNMENTS=15	SAT TT=0.706 ASSIGNMENTS=13	SAT TT=1.251 CHECKS=694140 NODES=16	SAT TT=2.683 CHECKS=19790600 NODES=12900000	SAT TT=15.238 CHECKS=48921900 NODES=3853	SAT TT=0.023 ASSIGNMENTS=12 CHECKS=185	SAT TT=0.024 ASSIGNMENTS=12 CHECKS=185	SAT TT=4.435	SAT TT=3.641	SAT TT=0.023 CHECKS=76	SAT TT=0.01 ASSIGNMENTS=12 CHECKS=185	SAT TT=0.012 ASSIGNMENTS=10 CHECKS=176	SAT TT=0.62	SAT TT=0.012 ASSIGNMENTS=8 CHECKS=135	SAT TT=0.013 ASSIGNMENTS=12 CHECKS=185	SAT TT=14.725	SAT TT=0.032 ASSIGNMENTS=16 CHECKS=23159	SAT TT=2.021	SAT TT=2.51
csp/ogdVg/ normalized-crossword-m1c-ogd-vg4-6_ext.xml	SAT TT=0.066	SAT TT=0.816 CHECKS=10 NODES=25	SAT TT=1.07 CHECKS=26 NODES=32	SAT TT=2.895	SAT TT=1.077 CHECKS=796	SAT TT=0.971 CHECKS=652	SAT TT=1.724 ASSIGNMENTS=13	SAT TT=1.745 ASSIGNMENTS=11	SAT TT=102.039 CHECKS=192408000 NODES=26	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=0.084 ASSIGNMENTS=16 CHECKS=385	SAT TT=0.083 ASSIGNMENTS=16 CHECKS=385	SAT TT=20.325	SAT TT=17.539	SAT TT=0.116 CHECKS=216	SAT TT=0.073 ASSIGNMENTS=16 CHECKS=385	SAT TT=0.077 ASSIGNMENTS=18 CHECKS=523	SAT TT=1.749	SAT TT=0.066 ASSIGNMENTS=20 CHECKS=448	SAT TT=0.071 ASSIGNMENTS=16 CHECKS=385	? TT=109.604	SAT TT=0.243 ASSIGNMENTS=29 CHECKS=250750	SAT TT=46.228	SAT TT=47.527
csp/ogdVg/ normalized-crossword-m1c-ogd-vg4-8_ext.xml	SAT TT=0.36	SAT TT=1.038 CHECKS=46 NODES=41	SAT TT=1.406 CHECKS=50 NODES=69	SAT TT=403.61	SAT TT=7.585 CHECKS=1794	SAT TT=5.754 CHECKS=1277	SAT TT=5.99 ASSIGNMENTS=22	SAT TT=9.39 ASSIGNMENTS=35	SAT TT=2.502 CHECKS=558265 NODES=35	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=0.581 ASSIGNMENTS=52 CHECKS=3033	SAT TT=0.546 ASSIGNMENTS=52 CHECKS=3033	SAT TT=168.189	SAT TT=77.766	SAT TT=0.36 CHECKS=3334	SAT TT=0.531 ASSIGNMENTS=48 CHECKS=2783	SAT TT=1.25 ASSIGNMENTS=105 CHECKS=5476	SAT TT=6.164	SAT TT=4.495 ASSIGNMENTS=627 CHECKS=28771	SAT TT=0.588 ASSIGNMENTS=52 CHECKS=3033	? TT=95.061	SAT TT=987.208 ASSIGNMENTS=1085 CHECKS=294168000	SAT TT=1065.92	SAT TT=1072.48
csp/ogdVg/ normalized-crossword-m1c-ogd-vg5-7_ext.xml	SAT TT=0.268	SAT TT=0.976 CHECKS=28 NODES=42	SAT TT=1.801 CHECKS=85 NODES=253	SAT TT=1358.65	SAT TT=7.951 CHECKS=6263	SAT TT=8.496 CHECKS=4312	SAT TT=11.171 ASSIGNMENTS=226	SAT TT=4.579 ASSIGNMENTS=12	SAT TT=31.097 CHECKS=20962400 NODES=66	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=1.13 ASSIGNMENTS=193 CHECKS=12016	SAT TT=1.098 ASSIGNMENTS=193 CHECKS=12016	SAT TT=927.074	SAT TT=1002.72	SAT TT=0.268 CHECKS=2595	SAT TT=0.948 ASSIGNMENTS=156 CHECKS=10360	SAT TT=0.376 ASSIGNMENTS=61 CHECKS=3190	SAT TT=5.024	SAT TT=2.861 ASSIGNMENTS=696 CHECKS=32108	SAT TT=1.113 ASSIGNMENTS=193 CHECKS=12016	? TT=90.888	SAT TT=0.349 ASSIGNMENTS=46 CHECKS=44371	SAT TT=352.155	SAT TT=372.204
csp/ogdVg/ normalized-crossword-m1c-ogd-vg5-8_ext.xml	SAT TT=0.231	SAT TT=1.863 CHECKS=170 NODES=272	SAT TT=1.612 CHECKS=61 NODES=60	SAT TT=1362.19	SAT TT=14.587 CHECKS=4896	SAT TT=27.049 CHECKS=9235	SAT TT=181.325 ASSIGNMENTS=1990	SAT TT=16.779 ASSIGNMENTS=93	SAT TT=33.553 CHECKS=19330300 NODES=58	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=0.255 ASSIGNMENTS=15 CHECKS=579	SAT TT=0.257 ASSIGNMENTS=15 CHECKS=579	? (TO) TT=1800.05	SAT TT=725.525	SAT TT=0.41 CHECKS=3323	SAT TT=0.231 ASSIGNMENTS=15 CHECKS=579	SAT TT=16.626 ASSIGNMENTS=1450 CHECKS=79113	SAT TT=8.181	SAT TT=82.183 ASSIGNMENTS=6546 CHECKS=506737	SAT TT=0.235 ASSIGNMENTS=15 CHECKS=579	? (MO) TT=42.539	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/ogdVg/ normalized-crossword-m1c-ogd-vg6-10_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.02	? TT=82.691	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02
csp/ogdVg/ normalized-crossword-m1c-ogd-vg6-6_ext.xml	SAT TT=0.141	SAT TT=0.911 CHECKS=13 NODES=36	SAT TT=0.842 CHECKS=13 NODES=0	SAT TT=21.019	SAT TT=7.185 CHECKS=9263	SAT TT=3.211 CHECKS=1168	SAT TT=4.186 ASSIGNMENTS=21	SAT TT=3.969 ASSIGNMENTS=14	SAT TT=218.917 CHECKS=671845000 NODES=37	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.181 ASSIGNMENTS=36 CHECKS=1717	SAT TT=0.179 ASSIGNMENTS=36 CHECKS=1717	SAT TT=327.045	SAT TT=51.826	SAT TT=0.141 CHECKS=584	SAT TT=0.323 ASSIGNMENTS=67 CHECKS=3422	SAT TT=1.746 ASSIGNMENTS=451 CHECKS=21794	SAT TT=4.393	SAT TT=2.951 ASSIGNMENTS=844 CHECKS=40139	SAT TT=0.171 ASSIGNMENTS=36 CHECKS=1717	? TT=76.039	SAT TT=11.94 ASSIGNMENTS=128 CHECKS=16203500	SAT TT=131.418	SAT TT=160.795
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdVg/ normalized-crossword-m1c-ogd-vg6-7_ext.xml	SAT TT=0.431	SAT TT=1.521 CHECKS=82 NODES=276	SAT TT=1.646 CHECKS=53 NODES=60	SAT TT=305.388	SAT TT=287.031 CHECKS=178635	SAT TT=156.207 CHECKS=111363	SAT TT=236.656 ASSIGNMENTS=3885	SAT TT=12.664 ASSIGNMENTS=79	SAT TT=198.167 CHECKS=761548000 NODES=175	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=8.947 ASSIGNMENTS=276 CHECKS=82	SAT TT=8.95 ASSIGNMENTS=276 CHECKS=82	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=0.431 CHECKS=3884	SAT TT=16.602 ASSIGNMENTS=1624 CHECKS=125302	SAT TT=28.844 ASSIGNMENTS=3687 CHECKS=208875	SAT TT=25.203	SAT TT=19.255 ASSIGNMENTS=2061 CHECKS=148616	SAT TT=13.394 ASSIGNMENTS=1437 CHECKS=112167	? TT=91.293	SAT TT=1560.45 ASSIGNMENTS=19086 CHECKS=201007000	SAT TT=441.144	SAT TT=709.33
csp/ogdVg/ normalized-crossword-m1c-ogd-vg6-8_ext.xml	SAT TT=4.418	SAT TT=5.613 CHECKS=6280 NODES=3643	SAT TT=4.418 CHECKS=980 NODES=1160	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=164.195 CHECKS=54840	SAT TT=16.056 ASSIGNMENTS=99	SAT TT=1352.11 ASSIGNMENTS=6159	SAT TT=1510.03 CHECKS=13889200000 NODES=18944	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=13.329 ASSIGNMENTS=3643 CHECKS=6280	SAT TT=13.892 ASSIGNMENTS=3643 CHECKS=6280	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=23.564 CHECKS=635281	SAT TT=49.06 ASSIGNMENTS=2351 CHECKS=185680	SAT TT=957.925 ASSIGNMENTS=44839 CHECKS=3920490	SAT TT=284.547	SAT TT=195.546 ASSIGNMENTS=9679 CHECKS=846691	SAT TT=57.258 ASSIGNMENTS=2939 CHECKS=216796	? TT=100.943	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05
csp/ogdVg/ normalized-crossword-m1c-ogd-vg6-9_ext.xml	SAT TT=36.449	SAT TT=224.14 CHECKS=360767 NODES=175034	SAT TT=193.642 CHECKS=310908 NODES=131717	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800	SAT TT=234.109 ASSIGNMENTS=175034 CHECKS=360767	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=36.449 CHECKS=785238	SAT TT=1365.79 ASSIGNMENTS=44721 CHECKS=3897980	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=1390.37 ASSIGNMENTS=46379 CHECKS=4046340	? TT=100.63	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/ogdVg/ normalized-crossword-m1c-ogd-vg7-10_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=118.79	? (TO) TT=1800.07	? (TO) TT=1800.21	? (TO) TT=1800.02
csp/ogdVg/ normalized-crossword-m1c-ogd-vg7-11_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=120.365	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09
csp/ogdVg/ normalized-crossword-m1c-ogd-vg7-7_ext.xml	SAT TT=1.082	SAT TT=5.29 CHECKS=3169 NODES=2303	SAT TT=2.059 CHECKS=15 NODES=134	SAT TT=1454.8	SAT TT=455.258 CHECKS=383399	SAT TT=38.587 CHECKS=19400	? (TO) TT=1800.15	SAT TT=46.698 ASSIGNMENTS=337	SAT TT=9.241 CHECKS=0 NODES=1352	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=13.075 ASSIGNMENTS=2296 CHECKS=3562	SAT TT=13.049 ASSIGNMENTS=2296 CHECKS=3562	? (TO) TT=1800	SAT TT=1001.96	SAT TT=1.082 CHECKS=21133	SAT TT=8.435 ASSIGNMENTS=553 CHECKS=60632	SAT TT=43.142 ASSIGNMENTS=4112 CHECKS=270622	SAT TT=11.535	SAT TT=849.349 ASSIGNMENTS=67661 CHECKS=5853160	SAT TT=9.894 ASSIGNMENTS=595 CHECKS=63657	? TT=80.978	SAT TT=74.075 ASSIGNMENTS=451 CHECKS=1149820	SAT TT=1036.91	? (TO) TT=1800.03
csp/ogdVg/ normalized-crossword-m1c-ogd-vg7-8_ext.xml	SAT TT=702.439	SAT TT=702.439 CHECKS=1229680 NODES=415397	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? TT=82.491	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02
csp/ogdVg/ normalized-crossword-m1c-ogd-vg7-9_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.1	? TT=101.094	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/ogdVg/ normalized-crossword-m1c-ogd-vg8-10_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (MO) TT=34.38	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=39.628	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.2
csp/ogdVg/ normalized-crossword-m1c-ogd-vg8-11_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.09	? (MO) TT=33.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=33.904	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.15
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdVg/ normalized-crossword-m1c-ogd-vg8-12_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (MO) TT=33.17	? (TO) TT=1800.08	? (TO) TT=1800.08	? TT=33.598	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.15
csp/ogdVg/ normalized-crossword-m1c-ogd-vg8-8_ext.xml	SAT TT=24.369	SAT TT=85.533 CHECKS=36691 NODES=19214	SAT TT=1521.21 CHECKS=1227840 NODES=423141	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.17	SAT TT=63.225 ASSIGNMENTS=108	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=24.369 ASSIGNMENTS=3194 CHECKS=4324	SAT TT=24.756 ASSIGNMENTS=3194 CHECKS=4324	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=737.285 ASSIGNMENTS=19240 CHECKS=2077540	? (TO) TT=1800.04	SAT TT=30.52	SAT TT=758.225 ASSIGNMENTS=20687 CHECKS=2221110	SAT TT=758.685 ASSIGNMENTS=18692 CHECKS=2090520	? TT=35.713	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.03
csp/ogdVg/ normalized-crossword-m1c-ogd-vg9-10_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.02	? (MO) TT=36.71	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=31.35	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.03
csp/ogdVg/ normalized-crossword-m1c-ogd-vg9-12_ext.xml		? (TO) TT=1800.04	? (MO) TT=1.371	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (MO) TT=32.5	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=33.512	? (TO) TT=1800.05	? (TO) TT=1800.19	? (TO) TT=1800.12
csp/ogdVg/ normalized-crossword-m1c-ogd-vg9-13_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.06	? (MO) TT=32.94	? (TO) TT=1800.1	? (TO) TT=1800.04	? TT=38.863	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.13
csp/ogdVg/ normalized-crossword-m1c-ogd-vg9-9_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (MO) TT=36.29	? (TO) TT=1800.05	? (TO) TT=1800.04	? TT=28.965	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.02
csp/ortholatin/ normalized-ortholatin-10.xml		? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.14	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.21	No data	? (TO) TT=1800.08	? (TO) TT=1800.02
csp/ortholatin/ normalized-ortholatin-15.xml		? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.06	? (exit code) TT=1.208	? (TO) TT=1800.08	? (TO) TT=1800.08	? (MO) TT=26.92	No data	? (TO) TT=1800.19	? (TO) TT=1800.18
csp/ortholatin/ normalized-ortholatin-20.xml		? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.14	No data	No data	No data	? (TO) TT=1800	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.04	? (exit code) TT=2.503	? (TO) TT=1800.03	? (TO) TT=1800.08	? TT=112.215	No data	? (MO) TT=150.63	? (MO) TT=364.24
csp/ortholatin/ normalized-ortholatin-2.xml	UNSAT TT=0.004	UNSAT TT=0.621 CHECKS=0 NODES=2	UNSAT TT=0.631 CHECKS=0 NODES=0	UNSAT TT=0.027	UNSAT TT=0.006 CHECKS=100	UNSAT TT=0.008 CHECKS=97	UNSAT TT=0.36 ASSIGNMENTS=0	UNSAT TT=0.412 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.018 ASSIGNMENTS=3 CHECKS=87	UNSAT TT=0.017 ASSIGNMENTS=3 CHECKS=87	No data	No data	No data	UNSAT TT=0.004 ASSIGNMENTS=3 CHECKS=85	UNSAT TT=0.007 ASSIGNMENTS=3 CHECKS=87	UNSAT TT=0.271	UNSAT TT=0.007 ASSIGNMENTS=8 CHECKS=165	UNSAT TT=0.006 ASSIGNMENTS=3 CHECKS=87	UNSAT TT=0.676	No data	UNSAT TT=0.48	UNSAT TT=0.498
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ortholatin/ normalized-ortholatin-5.xml	SAT TT=0.012	SAT TT=2.71 CHECKS=44580 NODES=21518	SAT TT=0.754 CHECKS=54 NODES=0	SAT TT=2.26	SAT TT=0.044 CHECKS=5086	SAT TT=0.044 CHECKS=4990	SAT TT=1.013 ASSIGNMENTS=17	SAT TT=0.975 ASSIGNMENTS=18	No data	No data	No data	SAT TT=0.024 ASSIGNMENTS=31 CHECKS=3313	SAT TT=0.025 ASSIGNMENTS=31 CHECKS=3313	No data	No data	No data	SAT TT=0.013 ASSIGNMENTS=29 CHECKS=3197	SAT TT=0.012 ASSIGNMENTS=13 CHECKS=1478	SAT TT=2.024	SAT TT=0.016 ASSIGNMENTS=105 CHECKS=5899	SAT TT=0.012 ASSIGNMENTS=29 CHECKS=2782	SAT TT=1.615	No data	SAT TT=0.926	SAT TT=1.078
csp/ortholatin/ normalized-ortholatin-6.xml		? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	No data	? (TO) TT=1800.05	? (TO) TT=1800.04
csp/ortholatin/ normalized-ortholatin-7.xml	SAT TT=0.289	SAT TT=82.141 CHECKS=1859340 NODES=612971	SAT TT=8.975 CHECKS=144365 NODES=63343	? (TO) TT=1800.1	SAT TT=138.026 CHECKS=30676600	SAT TT=20.929 CHECKS=6541080	? (TO) TT=1800.23	? (TO) TT=1800.16	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.06	No data	No data	No data	SAT TT=30.886 ASSIGNMENTS=158111 CHECKS=32314500	SAT TT=18.699 ASSIGNMENTS=93358 CHECKS=21578600	? (TO) TT=1800.1	SAT TT=270.375 ASSIGNMENTS=1151240 CHECKS=385743000	? (TO) TT=1800.09	SAT TT=383.197	No data	SAT TT=54.156	SAT TT=456.542
csp/ortholatin/ normalized-ortholatin-8.xml	SAT TT=0.539	SAT TT=859.227 CHECKS=16877400 NODES=5667120	? (TO) TT=1800.15	SAT TT=65.375	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.11	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.09	No data	No data	No data	SAT TT=286.404 ASSIGNMENTS=1431890 CHECKS=373770000	? (TO) TT=1800.06	SAT TT=0.539	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.21	No data	? (TO) TT=1800.07	? (TO) TT=1800.09
csp/ortholatin/ normalized-ortholatin-9.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.21	No data	? (TO) TT=1800.1	? (TO) TT=1800.06
csp/os-gp/ normalized-gp10-01-1092.xml	UNSAT TT=5.173	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=5.173 ASSIGNMENTS=347	UNSAT TT=5.934 ASSIGNMENTS=347	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=12.597 ASSIGNMENTS=347	UNSAT TT=675.9 ASSIGNMENTS=39181 CHECKS=127633000	? (problem) TT=76.094	? (problem) TT=79.934	No data	UNSAT TT=35.8 ASSIGNMENTS=67362 CHECKS=248398000	UNSAT TT=9.817 ASSIGNMENTS=25555 CHECKS=62539300	? (TO) TT=1800.08	UNSAT TT=20.022 ASSIGNMENTS=36660 CHECKS=116574000	UNSAT TT=19.071 ASSIGNMENTS=39181 CHECKS=127633000	? TT=255.48	No data	UNSAT TT=8.635	UNSAT TT=21.501
csp/os-gp/ normalized-gp10-01-1093.xml	SAT TT=1.102	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=3.25 ASSIGNMENTS=209	SAT TT=3.265 ASSIGNMENTS=209	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=1.102 ASSIGNMENTS=2254 CHECKS=6862360	SAT TT=1.174 ASSIGNMENTS=2254 CHECKS=6862360	? (problem) TT=61.038	? (problem) TT=65.502	No data	SAT TT=5.227 ASSIGNMENTS=11972 CHECKS=36794800	SAT TT=2.918 ASSIGNMENTS=14728 CHECKS=17167600	? (TO) TT=1800.1	SAT TT=3.971 ASSIGNMENTS=10119 CHECKS=20648200	SAT TT=2.078 ASSIGNMENTS=3852 CHECKS=13075200	? (exit code) TT=276.013	No data	SAT TT=8.047	SAT TT=20.718
csp/os-gp/ normalized-gp10-02-1096.xml	UNSAT TT=0.201	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=28.335 CHECKS=36597000	? (TO) TT=1800.03	UNSAT TT=3.045 ASSIGNMENTS=5	UNSAT TT=3.203 ASSIGNMENTS=5	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.315 ASSIGNMENTS=279 CHECKS=1605400	UNSAT TT=0.313 ASSIGNMENTS=279 CHECKS=1605400	? (problem) TT=81.685	? (problem) TT=75.287	No data	UNSAT TT=0.642 ASSIGNMENTS=892 CHECKS=3603820	UNSAT TT=2.397 ASSIGNMENTS=13535 CHECKS=14139000	UNSAT TT=1.743	UNSAT TT=0.664 ASSIGNMENTS=2614 CHECKS=2365430	UNSAT TT=0.201 ASSIGNMENTS=141 CHECKS=835396	? (exit code) TT=254.391	No data	UNSAT TT=5.977	UNSAT TT=18.883
csp/os-gp/ normalized-gp10-02-1097.xml	SAT TT=0.096	SAT TT=171.617 CHECKS=4897280 NODES=31311	SAT TT=169.826 CHECKS=4897280 NODES=31311	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=2.633 ASSIGNMENTS=116	SAT TT=2.912 ASSIGNMENTS=116	SAT TT=66.226 CHECKS=0 NODES=299	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.112 ASSIGNMENTS=180 CHECKS=209382	SAT TT=0.113 ASSIGNMENTS=180 CHECKS=209382	? (problem) TT=71.199	? (problem) TT=71.596	No data	SAT TT=0.096 ASSIGNMENTS=164 CHECKS=190354	SAT TT=2.19 ASSIGNMENTS=12929 CHECKS=12543900	SAT TT=2.797	SAT TT=0.523 ASSIGNMENTS=2841 CHECKS=1960780	SAT TT=0.176 ASSIGNMENTS=271 CHECKS=734485	? (exit code) TT=258.375	No data	SAT TT=6.348	SAT TT=20.311
csp/os-gp/ normalized-gp10-03-1080.xml	UNSAT TT=11.632	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=17.771 ASSIGNMENTS=1923	UNSAT TT=16.688 ASSIGNMENTS=1923	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=23.426 ASSIGNMENTS=1923	UNSAT TT=763.728 ASSIGNMENTS=1923	? (problem) TT=71.506	? (problem) TT=66.276	No data	? (TO) TT=1800.06	UNSAT TT=13.912 ASSIGNMENTS=37371 CHECKS=88851700	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=288.533 ASSIGNMENTS=657346 CHECKS=1989810000	? TT=270.107	No data	UNSAT TT=11.632	UNSAT TT=22.864
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-gp/ normalized-gp10-03-1081.xml	SAT TT=1.539	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=2.995 ASSIGNMENTS=212	SAT TT=3.068 ASSIGNMENTS=212	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=10.242 ASSIGNMENTS=212	SAT TT=656.965 ASSIGNMENTS=3206 CHECKS=9356440	? (problem) TT=59.556	? (problem) TT=58.827	No data	SAT TT=32.546 ASSIGNMENTS=73141 CHECKS=212434000	SAT TT=6.963 ASSIGNMENTS=23230 CHECKS=46674100	? (TO) TT=1800.09	SAT TT=17.207 ASSIGNMENTS=36157 CHECKS=108550000	SAT TT=1.539 ASSIGNMENTS=3206 CHECKS=9356440	? TT=267.183	No data	SAT TT=10.647	SAT TT=20.434
csp/os-gp/ normalized-gp10-04-1076.xml	UNSAT TT=0.33	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=4.085 ASSIGNMENTS=93	UNSAT TT=4.299 ASSIGNMENTS=93	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=1.199 ASSIGNMENTS=1999 CHECKS=7726470	UNSAT TT=1.231 ASSIGNMENTS=1999 CHECKS=7726470	? (problem) TT=61.298	? (problem) TT=61.043	No data	UNSAT TT=3.146 ASSIGNMENTS=6727 CHECKS=21610200	UNSAT TT=2.254 ASSIGNMENTS=13138 CHECKS=13444800	? (TO) TT=1800.11	UNSAT TT=3.845 ASSIGNMENTS=8820 CHECKS=21605200	UNSAT TT=0.33 ASSIGNMENTS=616 CHECKS=1785850	? TT=298.061	No data	UNSAT TT=7.013	UNSAT TT=20.371
csp/os-gp/ normalized-gp10-04-1077.xml	SAT TT=0.173	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=85.556 CHECKS=163990000	? (TO) TT=1800.02	SAT TT=3.591 ASSIGNMENTS=136	SAT TT=3.771 ASSIGNMENTS=136	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.433 ASSIGNMENTS=741 CHECKS=2620460	SAT TT=0.487 ASSIGNMENTS=741 CHECKS=2620460	? (problem) TT=70.913	? (problem) TT=70.933	No data	SAT TT=0.965 ASSIGNMENTS=1796 CHECKS=6627750	SAT TT=2.46 ASSIGNMENTS=13046 CHECKS=13457100	SAT TT=1135.75	SAT TT=0.339 ASSIGNMENTS=1317 CHECKS=1229190	SAT TT=0.173 ASSIGNMENTS=302 CHECKS=732991	? (exit code) TT=302.78	No data	SAT TT=6.545	SAT TT=18.396
csp/os-gp/ normalized-gp10-05-1070.xml	UNSAT TT=17.295	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=42.579 ASSIGNMENTS=5156	UNSAT TT=40.603 ASSIGNMENTS=5156	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=95.359 ASSIGNMENTS=331668 CHECKS=545762000	UNSAT TT=743.098 ASSIGNMENTS=331668 CHECKS=545762000	? (problem) TT=67.071	? (problem) TT=65.173	No data	UNSAT TT=584.71 ASSIGNMENTS=1230390 CHECKS=3520620000	UNSAT TT=17.295 ASSIGNMENTS=47234 CHECKS=109996000	? (TO) TT=1800.12	UNSAT TT=20.123 ASSIGNMENTS=37199 CHECKS=124768000	UNSAT TT=90.362 ASSIGNMENTS=331668 CHECKS=545762000	? TT=290.541	No data	UNSAT TT=19.394	UNSAT TT=25.654
csp/os-gp/ normalized-gp10-05-1071.xml	SAT TT=0.605	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=5.893 ASSIGNMENTS=471	SAT TT=5.8 ASSIGNMENTS=471	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=8.202 ASSIGNMENTS=652 CHECKS=1886440	SAT TT=655.782 ASSIGNMENTS=652 CHECKS=1886440	? (problem) TT=70.176	? (problem) TT=69.998	No data	SAT TT=59.837 ASSIGNMENTS=203547 CHECKS=373835000	SAT TT=5.422 ASSIGNMENTS=19247 CHECKS=33929200	? (TO) TT=1800.04	SAT TT=10.116 ASSIGNMENTS=20730 CHECKS=49524300	SAT TT=0.605 ASSIGNMENTS=652 CHECKS=1886440	? (exit code) TT=293.967	No data	SAT TT=12.416	SAT TT=22.934
csp/os-gp/ normalized-gp10-06-1070.xml	UNSAT TT=0.394	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=3.854 ASSIGNMENTS=73	UNSAT TT=4.074 ASSIGNMENTS=73	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=11.425 ASSIGNMENTS=73	UNSAT TT=656.349 ASSIGNMENTS=634 CHECKS=2239020	? (problem) TT=63.825	? (problem) TT=68.307	No data	UNSAT TT=14.637 ASSIGNMENTS=27653 CHECKS=102594000	UNSAT TT=2.447 ASSIGNMENTS=12981 CHECKS=15020600	? (TO) TT=1800.03	UNSAT TT=2.155 ASSIGNMENTS=5551 CHECKS=11392600	UNSAT TT=0.394 ASSIGNMENTS=634 CHECKS=2239020	? (exit code) TT=272.581	No data	UNSAT TT=6.839	UNSAT TT=20.13
csp/os-gp/ normalized-gp10-06-1071.xml	SAT TT=0.243	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.02	SAT TT=165.097 CHECKS=314611000	SAT TT=51.227 CHECKS=58584400	SAT TT=3.45 ASSIGNMENTS=116	SAT TT=3.426 ASSIGNMENTS=116	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=0.632 ASSIGNMENTS=767 CHECKS=3275020	SAT TT=0.499 ASSIGNMENTS=767 CHECKS=3275020	? (problem) TT=61.66	? (problem) TT=64.584	No data	SAT TT=1.431 ASSIGNMENTS=2260 CHECKS=8900000	SAT TT=2.346 ASSIGNMENTS=12636 CHECKS=12395000	? (TO) TT=1800.09	SAT TT=0.474 ASSIGNMENTS=1475 CHECKS=2192830	SAT TT=0.243 ASSIGNMENTS=391 CHECKS=1096440	? (exit code) TT=288.058	No data	SAT TT=6.418	SAT TT=20.033
csp/os-gp/ normalized-gp10-07-1078.xml	UNSAT TT=3.46	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=3.46 ASSIGNMENTS=70	UNSAT TT=3.631 ASSIGNMENTS=70	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=10.204 ASSIGNMENTS=70	UNSAT TT=664.527 ASSIGNMENTS=14319 CHECKS=51167300	? (problem) TT=69.476	? (problem) TT=64.411	No data	UNSAT TT=8.832 ASSIGNMENTS=17279 CHECKS=58630000	UNSAT TT=14.676 ASSIGNMENTS=32691 CHECKS=90181000	? (TO) TT=1800.03	UNSAT TT=16.633 ASSIGNMENTS=30460 CHECKS=94220800	UNSAT TT=7.721 ASSIGNMENTS=14319 CHECKS=51167300	? (exit code) TT=310.235	No data	UNSAT TT=6.352	UNSAT TT=19.133
csp/os-gp/ normalized-gp10-07-1079.xml	SAT TT=0.23	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=3.615 ASSIGNMENTS=576	SAT TT=3.743 ASSIGNMENTS=576	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.238 ASSIGNMENTS=335 CHECKS=906372	SAT TT=0.23 ASSIGNMENTS=335 CHECKS=906372	? (problem) TT=66.156	? (problem) TT=75.003	No data	SAT TT=0.467 ASSIGNMENTS=871 CHECKS=2743980	SAT TT=11.38 ASSIGNMENTS=32423 CHECKS=77182500	? (TO) TT=1800.1	SAT TT=2.351 ASSIGNMENTS=5954 CHECKS=12822500	SAT TT=1.643 ASSIGNMENTS=3326 CHECKS=10782000	? TT=293.237	No data	SAT TT=6.552	SAT TT=18.828
csp/os-gp/ normalized-gp10-08-1092.xml	UNSAT TT=0.314	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=3.16 ASSIGNMENTS=53	UNSAT TT=3.293 ASSIGNMENTS=53	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=1.133 ASSIGNMENTS=1990 CHECKS=7309100	UNSAT TT=1.216 ASSIGNMENTS=1990 CHECKS=7309100	? (problem) TT=68.039	? (problem) TT=70.899	No data	UNSAT TT=1.22 ASSIGNMENTS=2076 CHECKS=7583210	UNSAT TT=3.047 ASSIGNMENTS=14183 CHECKS=17246700	? (TO) TT=1800.04	UNSAT TT=1.854 ASSIGNMENTS=5350 CHECKS=9383550	UNSAT TT=0.314 ASSIGNMENTS=483 CHECKS=1683600	? (exit code) TT=304.579	No data	UNSAT TT=7.649	UNSAT TT=20.299
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-gp/ normalized-gp10-08-1093.xml	SAT TT=0.138	SAT TT=310.177 CHECKS=11710100 NODES=66736	SAT TT=307.06 CHECKS=11710100 NODES=66736	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=55.794 CHECKS=59145400	SAT TT=2.98 ASSIGNMENTS=156	SAT TT=3.069 ASSIGNMENTS=156	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=1.395 ASSIGNMENTS=2376 CHECKS=8543890	SAT TT=1.378 ASSIGNMENTS=2376 CHECKS=8543890	? (problem) TT=66.704	? (problem) TT=63.837	No data	SAT TT=1.506 ASSIGNMENTS=2797 CHECKS=9739760	SAT TT=2.718 ASSIGNMENTS=13530 CHECKS=15351400	SAT TT=492.35	SAT TT=6.739 ASSIGNMENTS=12861 CHECKS=40364000	SAT TT=0.138 ASSIGNMENTS=253 CHECKS=523575	? (exit code) TT=307.156	No data	SAT TT=6.88	SAT TT=20.518
csp/os-gp/ normalized-gp10-09-1111.xml	UNSAT TT=0.363	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=2.491 ASSIGNMENTS=37	UNSAT TT=2.529 ASSIGNMENTS=37	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=1.025 ASSIGNMENTS=2089 CHECKS=6345840	UNSAT TT=1.048 ASSIGNMENTS=2089 CHECKS=6345840	? (problem) TT=67.377	? (problem) TT=66.722	No data	UNSAT TT=1.083 ASSIGNMENTS=2138 CHECKS=6688150	UNSAT TT=2.428 ASSIGNMENTS=13237 CHECKS=13193800	? (TO) TT=1800.11	UNSAT TT=2.801 ASSIGNMENTS=7427 CHECKS=16108400	UNSAT TT=0.363 ASSIGNMENTS=845 CHECKS=2074510	? TT=313.644	No data	UNSAT TT=6.502	UNSAT TT=18.976
csp/os-gp/ normalized-gp10-09-1112.xml	SAT TT=0.203	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=1063.06 CHECKS=2866400000	SAT TT=2.519 ASSIGNMENTS=172	SAT TT=2.851 ASSIGNMENTS=172	SAT TT=1019.69 CHECKS=0 NODES=87913	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.344 ASSIGNMENTS=577 CHECKS=1690330	SAT TT=0.342 ASSIGNMENTS=577 CHECKS=1690330	? (problem) TT=70.455	? (problem) TT=65.845	No data	SAT TT=0.417 ASSIGNMENTS=829 CHECKS=2416800	SAT TT=2.27 ASSIGNMENTS=13667 CHECKS=13091400	SAT TT=410.207	SAT TT=0.475 ASSIGNMENTS=2919 CHECKS=1217390	SAT TT=0.203 ASSIGNMENTS=350 CHECKS=810834	? TT=315.403	No data	SAT TT=6.703	SAT TT=19.54
csp/os-gp/ normalized-gp10-10-1091.xml	UNSAT TT=0.23	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=3.389 ASSIGNMENTS=52	UNSAT TT=3.486 ASSIGNMENTS=52	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=1.354 ASSIGNMENTS=1919 CHECKS=9407800	UNSAT TT=1.502 ASSIGNMENTS=1919 CHECKS=9407800	? (problem) TT=64.337	? (problem) TT=68.017	No data	UNSAT TT=2.416 ASSIGNMENTS=3444 CHECKS=15847600	UNSAT TT=2.583 ASSIGNMENTS=12416 CHECKS=15443600	? (TO) TT=1800.04	UNSAT TT=1.337 ASSIGNMENTS=4105 CHECKS=6537740	UNSAT TT=0.23 ASSIGNMENTS=327 CHECKS=1105480	? (exit code) TT=283.005	No data	UNSAT TT=7.439	UNSAT TT=20.641
csp/os-gp/ normalized-gp10-10-1092.xml	SAT TT=0.212	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=110.227 CHECKS=191167000	? (TO) TT=1800.09	SAT TT=3.194 ASSIGNMENTS=144	SAT TT=3.265 ASSIGNMENTS=144	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=1.085 ASSIGNMENTS=1494 CHECKS=6586080	SAT TT=1.067 ASSIGNMENTS=1494 CHECKS=6586080	? (problem) TT=56.199	? (problem) TT=56.439	No data	SAT TT=1.308 ASSIGNMENTS=2154 CHECKS=8153460	SAT TT=2.422 ASSIGNMENTS=12610 CHECKS=14181200	SAT TT=105.056	SAT TT=1.342 ASSIGNMENTS=4028 CHECKS=6237990	SAT TT=0.212 ASSIGNMENTS=319 CHECKS=870263	? (exit code) TT=320.986	No data	SAT TT=7.441	SAT TT=20.448
csp/os-taillard-10/ normalized-os-taillard-10-100-4.xml	SAT TT=2.527	SAT TT=102.265 CHECKS=44084200 NODES=161677	SAT TT=102.492 CHECKS=44084200 NODES=161677	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=2.822 ASSIGNMENTS=177	SAT TT=2.527 ASSIGNMENTS=177	SAT TT=869.05 CHECKS=0 NODES=671798	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=10.324 ASSIGNMENTS=177	SAT TT=10.281 ASSIGNMENTS=177	? (problem) TT=56.31	? (problem) TT=58.139	No data	SAT TT=83.821 ASSIGNMENTS=417586 CHECKS=576066000	SAT TT=3.825 ASSIGNMENTS=23751 CHECKS=23636300	? (TO) TT=1800.14	SAT TT=5.942 ASSIGNMENTS=23397 CHECKS=27704600	SAT TT=4.208 ASSIGNMENTS=17606 CHECKS=26473300	? TT=273.531	No data	SAT TT=4.465	SAT TT=11.802
csp/os-taillard-10/ normalized-os-taillard-10-100-8.xml	SAT TT=2.05	SAT TT=658.829 CHECKS=590505000 NODES=861694	SAT TT=616.411 CHECKS=590505000 NODES=861694	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=2.465 ASSIGNMENTS=139	SAT TT=2.626 ASSIGNMENTS=139	SAT TT=1025.07 CHECKS=0 NODES=956725	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=9.887 ASSIGNMENTS=139	SAT TT=9.177 ASSIGNMENTS=139	? (problem) TT=58.911	? (problem) TT=59.434	No data	? (TO) TT=1800.04	SAT TT=4.423 ASSIGNMENTS=27705 CHECKS=26522500	? (TO) TT=1800.08	SAT TT=10.187 ASSIGNMENTS=29253 CHECKS=61206800	SAT TT=2.05 ASSIGNMENTS=7110 CHECKS=12811500	? TT=313.277	No data	SAT TT=4.941	SAT TT=11.88
csp/os-taillard-10/ normalized-os-taillard-10-105-0.xml	SAT TT=0.348	SAT TT=5.945 CHECKS=127144 NODES=6850	SAT TT=5.636 CHECKS=127144 NODES=6850	? (TO) TT=1800.07	SAT TT=28.209 CHECKS=55170900	SAT TT=17.846 CHECKS=45809300	SAT TT=2.276 ASSIGNMENTS=170	SAT TT=2.68 ASSIGNMENTS=170	SAT TT=49.453 CHECKS=0 NODES=8036	? (TO) TT=1800.03	SAT TT=3.941 CHECKS=36907700 NODES=2089	SAT TT=9.739 ASSIGNMENTS=170	SAT TT=9.766 ASSIGNMENTS=170	? (problem) TT=61.614	? (problem) TT=58.503	No data	SAT TT=219.158 ASSIGNMENTS=1069140 CHECKS=1394430000	SAT TT=2.103 ASSIGNMENTS=17353 CHECKS=11965000	SAT TT=14.657	SAT TT=1.462 ASSIGNMENTS=5656 CHECKS=6493310	SAT TT=0.348 ASSIGNMENTS=1095 CHECKS=1929740	? TT=329.92	No data	SAT TT=4.772	SAT TT=13.463
csp/os-taillard-10/ normalized-os-taillard-10-105-2.xml	SAT TT=0.262	SAT TT=1.59 CHECKS=910 NODES=247	SAT TT=1.633 CHECKS=910 NODES=247	SAT TT=0.262	SAT TT=27.3 CHECKS=51096800	SAT TT=29.857 CHECKS=69203400	SAT TT=2.355 ASSIGNMENTS=164	SAT TT=2.636 ASSIGNMENTS=164	SAT TT=43.108 CHECKS=0 NODES=4335	? (TO) TT=1800.04	SAT TT=3.059 CHECKS=20514300 NODES=1354	SAT TT=9.168 ASSIGNMENTS=164	SAT TT=10.099 ASSIGNMENTS=164	? (problem) TT=60.215	? (problem) TT=55.445	No data	SAT TT=26.243 ASSIGNMENTS=145766 CHECKS=193609000	SAT TT=2.181 ASSIGNMENTS=18192 CHECKS=12715500	SAT TT=1.682	SAT TT=1.051 ASSIGNMENTS=5285 CHECKS=4091320	SAT TT=0.456 ASSIGNMENTS=1012 CHECKS=2295380	? TT=331.989	No data	SAT TT=4.385	SAT TT=12.859
csp/os-taillard-10/ normalized-os-taillard-10-105-6.xml	SAT TT=0.251	SAT TT=1.647 CHECKS=2721 NODES=236	SAT TT=1.646 CHECKS=2721 NODES=236	SAT TT=0.251	SAT TT=25.663 CHECKS=55001700	SAT TT=36.869 CHECKS=81541400	SAT TT=2.273 ASSIGNMENTS=176	SAT TT=2.621 ASSIGNMENTS=176	SAT TT=39.814 CHECKS=0 NODES=761	? (TO) TT=1800	SAT TT=4.863 CHECKS=40192200 NODES=2533	SAT TT=0.43 ASSIGNMENTS=1692 CHECKS=2345010	SAT TT=0.425 ASSIGNMENTS=1692 CHECKS=2345010	? (problem) TT=58.402	? (problem) TT=54.615	No data	SAT TT=0.813 ASSIGNMENTS=2869 CHECKS=4968730	SAT TT=2.123 ASSIGNMENTS=17261 CHECKS=11694400	? (TO) TT=1800.12	SAT TT=0.989 ASSIGNMENTS=4360 CHECKS=3936780	SAT TT=0.391 ASSIGNMENTS=1131 CHECKS=2068030	? TT=282.241	No data	SAT TT=3.859	SAT TT=12.943
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-taillard-10/ normalized-os-taillard-10-105-8.xml	SAT TT=0.249	SAT TT=1.937 CHECKS=1228 NODES=557	SAT TT=2.125 CHECKS=1228 NODES=557	SAT TT=0.249	SAT TT=27.478 CHECKS=56607300	SAT TT=34.511 CHECKS=76723800	SAT TT=2.272 ASSIGNMENTS=152	SAT TT=2.647 ASSIGNMENTS=152	SAT TT=38.081 CHECKS=0 NODES=2274	? (TO) TT=1800.01	SAT TT=4.04 CHECKS=37282200 NODES=2388	SAT TT=9.823 ASSIGNMENTS=152	SAT TT=9.627 ASSIGNMENTS=152	? (problem) TT=55.849	? (problem) TT=59.838	No data	SAT TT=7.156 ASSIGNMENTS=36215 CHECKS=42635600	SAT TT=2.181 ASSIGNMENTS=17729 CHECKS=12646300	? (TO) TT=1800.11	SAT TT=1.018 ASSIGNMENTS=5613 CHECKS=3967380	SAT TT=0.395 ASSIGNMENTS=1466 CHECKS=1908790	? TT=284.451	No data	SAT TT=4.225	SAT TT=11.769
csp/os-taillard-10/ normalized-os-taillard-10-105-9.xml	SAT TT=0.197	SAT TT=1.609 CHECKS=910 NODES=100	SAT TT=1.534 CHECKS=910 NODES=100	SAT TT=0.265	SAT TT=26.266 CHECKS=46206100	SAT TT=37.273 CHECKS=79308900	SAT TT=2.413 ASSIGNMENTS=171	SAT TT=2.489 ASSIGNMENTS=171	SAT TT=36.732 CHECKS=0 NODES=2502	? (TO) TT=1800.04	SAT TT=2.547 CHECKS=12785000 NODES=662	SAT TT=0.197 ASSIGNMENTS=625 CHECKS=782920	SAT TT=0.201 ASSIGNMENTS=625 CHECKS=782920	? (problem) TT=56.841	? (problem) TT=54.311	No data	SAT TT=1.231 ASSIGNMENTS=5046 CHECKS=7980500	SAT TT=2.349 ASSIGNMENTS=18584 CHECKS=14131800	? (TO) TT=1800.04	SAT TT=0.752 ASSIGNMENTS=4306 CHECKS=2615270	SAT TT=0.241 ASSIGNMENTS=1057 CHECKS=1001830	? TT=266.157	No data	SAT TT=4.268	SAT TT=12.416
csp/os-taillard-10/ normalized-os-taillard-10-95-1.xml	UNSAT TT=0.251	? (TO) TT=1800.12	? (TO) TT=1800.15	UNSAT TT=0.251	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=1.678 ASSIGNMENTS=0	UNSAT TT=1.33 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=8.975 ASSIGNMENTS=0	UNSAT TT=8.764 ASSIGNMENTS=0	? (problem) TT=49.979	? (problem) TT=49.669	No data	UNSAT TT=160.419 ASSIGNMENTS=900456 CHECKS=1053550000	UNSAT TT=77.044 ASSIGNMENTS=399912 CHECKS=528994000	? (TO) TT=1800.08	UNSAT TT=91.835 ASSIGNMENTS=369324 CHECKS=412705000	UNSAT TT=67.547 ASSIGNMENTS=367805 CHECKS=422673000	? TT=338.225	No data	UNSAT TT=26.457	UNSAT TT=43.63
csp/os-taillard-10/ normalized-os-taillard-10-95-3.xml	UNSAT TT=0.254	? (TO) TT=1800.13	? (TO) TT=1800.09	UNSAT TT=0.254	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=1.442 ASSIGNMENTS=0	UNSAT TT=1.342 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=8.947 ASSIGNMENTS=0	UNSAT TT=8.505 ASSIGNMENTS=0	? (problem) TT=59.738	? (problem) TT=63.102	No data	UNSAT TT=138.352 ASSIGNMENTS=785783 CHECKS=879738000	UNSAT TT=282.799 ASSIGNMENTS=1399820 CHECKS=1813040000	? (TO) TT=1800.08	UNSAT TT=11.242 ASSIGNMENTS=49898 CHECKS=46681400	? (TO) TT=1800.08	? TT=466.293	No data	UNSAT TT=282.771	UNSAT TT=580.252
csp/os-taillard-10/ normalized-os-taillard-10-95-8.xml	UNSAT TT=0.249	? (TO) TT=1800.09	? (TO) TT=1800.16	UNSAT TT=0.249	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=1.521 ASSIGNMENTS=0	UNSAT TT=1.371 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=8.967 ASSIGNMENTS=0	UNSAT TT=9.145 ASSIGNMENTS=0	? (problem) TT=59.555	? (problem) TT=60	No data	UNSAT TT=211.535 ASSIGNMENTS=1209200 CHECKS=1357360000	UNSAT TT=14.121 ASSIGNMENTS=88882 CHECKS=85158900	? (TO) TT=1800.1	UNSAT TT=91.224 ASSIGNMENTS=369557 CHECKS=451299000	UNSAT TT=61.559 ASSIGNMENTS=368038 CHECKS=421863000	? TT=279.905	No data	UNSAT TT=27.043	UNSAT TT=14.255
csp/os-taillard-15/ normalized-os-taillard-15-100-1.xml	SAT TT=1.013	SAT TT=9.878 CHECKS=238832 NODES=5945	SAT TT=9.145 CHECKS=238832 NODES=5945	SAT TT=1350.84	SAT TT=865.705 CHECKS=1638840000	? (TO) TT=1800.07	SAT TT=6.807 ASSIGNMENTS=440	SAT TT=6.729 ASSIGNMENTS=440	SAT TT=188.112 CHECKS=0 NODES=41057	? (TO) TT=1800.05	SAT TT=18.051 CHECKS=204785000 NODES=5024	SAT TT=8.835 ASSIGNMENTS=1502 CHECKS=6100250	SAT TT=14.296 ASSIGNMENTS=440	? (problem) TT=72.211	? (problem) TT=72.538	No data	? (TO) TT=1800.1	SAT TT=23.536 ASSIGNMENTS=50353 CHECKS=165637000	? (TO) TT=1800.12	SAT TT=3.801 ASSIGNMENTS=18358 CHECKS=24257400	SAT TT=1.013 ASSIGNMENTS=1502 CHECKS=6100250	? (exit code) TT=258.187	No data	SAT TT=18.515	SAT TT=59.396
csp/os-taillard-15/ normalized-os-taillard-15-100-4.xml	SAT TT=0.822	SAT TT=3.463 CHECKS=3165 NODES=232	SAT TT=3.397 CHECKS=3165 NODES=232	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=6.435 ASSIGNMENTS=402	SAT TT=6.257 ASSIGNMENTS=402	SAT TT=69.902 CHECKS=0 NODES=1539	? (TO) TT=1800.07	SAT TT=19.985 CHECKS=215834000 NODES=5088	SAT TT=8.321 ASSIGNMENTS=1843 CHECKS=4591710	SAT TT=8.769 ASSIGNMENTS=1843 CHECKS=4591710	? (problem) TT=64.364	? (problem) TT=68.267	No data	? (TO) TT=1800.02	SAT TT=8.637 ASSIGNMENTS=25909 CHECKS=37804500	? (TO) TT=1800.02	SAT TT=1.268 ASSIGNMENTS=8823 CHECKS=7298030	SAT TT=0.822 ASSIGNMENTS=1843 CHECKS=4591710	? TT=250.386	No data	SAT TT=19.964	SAT TT=67.26
csp/os-taillard-15/ normalized-os-taillard-15-105-0.xml	SAT TT=0.564	SAT TT=3.701 CHECKS=3165 NODES=343	SAT TT=3.592 CHECKS=3165 NODES=343	SAT TT=1349.35	SAT TT=45.803 CHECKS=52587800	SAT TT=134.84 CHECKS=236413000	SAT TT=5.975 ASSIGNMENTS=433	SAT TT=6.043 ASSIGNMENTS=433	SAT TT=76.396 CHECKS=0 NODES=3233	? (TO) TT=1800.05	SAT TT=7.809 CHECKS=44598800 NODES=714	SAT TT=7.836 ASSIGNMENTS=1214 CHECKS=2371710	SAT TT=8.579 ASSIGNMENTS=1214 CHECKS=2371710	? (problem) TT=80.142	? (problem) TT=76.157	No data	SAT TT=19.177 ASSIGNMENTS=31512 CHECKS=155484000	SAT TT=6.312 ASSIGNMENTS=22074 CHECKS=18505900	? (TO) TT=1800.08	SAT TT=2.6 ASSIGNMENTS=13403 CHECKS=16987000	SAT TT=0.564 ASSIGNMENTS=1214 CHECKS=2371710	? TT=279.434	No data	SAT TT=18.804	SAT TT=67.515
csp/os-taillard-15/ normalized-os-taillard-15-105-3.xml	SAT TT=0.351	SAT TT=3.513 CHECKS=3165 NODES=339	SAT TT=3.801 CHECKS=3165 NODES=339	SAT TT=1.148	SAT TT=45.695 CHECKS=48627400	SAT TT=46.898 CHECKS=68921500	SAT TT=6.073 ASSIGNMENTS=466	SAT TT=6.364 ASSIGNMENTS=466	SAT TT=79.333 CHECKS=0 NODES=4331	? (TO) TT=1800.09	SAT TT=8.536 CHECKS=47806800 NODES=855	SAT TT=0.351 ASSIGNMENTS=692 CHECKS=827922	SAT TT=0.372 ASSIGNMENTS=692 CHECKS=827922	? (problem) TT=70.869	? (problem) TT=66.536	No data	SAT TT=1.079 ASSIGNMENTS=5390 CHECKS=7167420	SAT TT=6.389 ASSIGNMENTS=21885 CHECKS=18438900	? (TO) TT=1800.11	SAT TT=1.235 ASSIGNMENTS=7850 CHECKS=6925900	SAT TT=1.766 ASSIGNMENTS=3652 CHECKS=11954200	? (exit code) TT=265.702	No data	SAT TT=16.9	SAT TT=67.899
csp/os-taillard-15/ normalized-os-taillard-15-105-5.xml	SAT TT=1.143	SAT TT=3.845 CHECKS=3165 NODES=327	SAT TT=3.631 CHECKS=3165 NODES=327	SAT TT=1.143	? (TO) TT=1800.01	SAT TT=21.931 CHECKS=18843200	SAT TT=22.631 ASSIGNMENTS=7376	SAT TT=23.595 ASSIGNMENTS=7376	SAT TT=71.963 CHECKS=0 NODES=2282	? (TO) TT=1800.08	SAT TT=9.628 CHECKS=63928200 NODES=1430	SAT TT=9.702 ASSIGNMENTS=4632 CHECKS=12516600	SAT TT=10.006 ASSIGNMENTS=4632 CHECKS=12516600	? (problem) TT=84.672	? (problem) TT=84.986	No data	SAT TT=7.094 ASSIGNMENTS=9840 CHECKS=58401500	SAT TT=6.364 ASSIGNMENTS=21764 CHECKS=18242600	? (TO) TT=1800.08	SAT TT=4.204 ASSIGNMENTS=16994 CHECKS=31042700	SAT TT=1.927 ASSIGNMENTS=4632 CHECKS=12516600	? (exit code) TT=235.751	No data	SAT TT=17.717	SAT TT=68.025
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-taillard-15/ normalized-os-taillard-15-105-7.xml	SAT TT=0.902	SAT TT=4.286 CHECKS=3273 NODES=691	SAT TT=4.376 CHECKS=3273 NODES=691	SAT TT=1.132	? (TO) TT=1800.05	SAT TT=49.77 CHECKS=77840100	SAT TT=6.711 ASSIGNMENTS=449	SAT TT=6.678 ASSIGNMENTS=449	SAT TT=67.816 CHECKS=0 NODES=926	? (TO) TT=1800.07	SAT TT=8.19 CHECKS=51084500 NODES=1039	SAT TT=8.665 ASSIGNMENTS=1476 CHECKS=4985100	SAT TT=8.86 ASSIGNMENTS=1476 CHECKS=4985100	? (problem) TT=75.717	? (problem) TT=72.022	No data	SAT TT=13.855 ASSIGNMENTS=16298 CHECKS=119758000	SAT TT=6.329 ASSIGNMENTS=21873 CHECKS=18461600	SAT TT=3.652	SAT TT=2.079 ASSIGNMENTS=10629 CHECKS=13356300	SAT TT=0.902 ASSIGNMENTS=1476 CHECKS=4985100	? TT=271.867	No data	SAT TT=18.451	SAT TT=60.48
csp/os-taillard-15/ normalized-os-taillard-15-105-8.xml	SAT TT=0.826	SAT TT=3.424 CHECKS=3165 NODES=228	SAT TT=3.451 CHECKS=3165 NODES=228	SAT TT=1.127	SAT TT=108.917 CHECKS=128364000	SAT TT=0.322 CHECKS=111950	SAT TT=14.225 ASSIGNMENTS=3733	SAT TT=13.652 ASSIGNMENTS=3733	SAT TT=68.952 CHECKS=0 NODES=1107	? (TO) TT=1800.03	SAT TT=7.711 CHECKS=34632800 NODES=349	SAT TT=0.862 ASSIGNMENTS=1596 CHECKS=4496810	SAT TT=0.826 ASSIGNMENTS=1596 CHECKS=4496810	? (problem) TT=73.891	? (problem) TT=73.952	No data	SAT TT=2.121 ASSIGNMENTS=4890 CHECKS=15273600	SAT TT=5.342 ASSIGNMENTS=15986 CHECKS=13489100	? (TO) TT=1800.07	SAT TT=1.045 ASSIGNMENTS=6181 CHECKS=5117250	SAT TT=0.845 ASSIGNMENTS=1225 CHECKS=4560390	? TT=300.466	No data	SAT TT=17.578	SAT TT=67.509
csp/os-taillard-15/ normalized-os-taillard-15-105-9.xml	SAT TT=0.503	SAT TT=3.37 CHECKS=3165 NODES=225	SAT TT=3.24 CHECKS=3165 NODES=225	? (TO) TT=1800.06	SAT TT=45.543 CHECKS=58808700	SAT TT=50.116 CHECKS=84239700	SAT TT=6.501 ASSIGNMENTS=399	SAT TT=6.169 ASSIGNMENTS=399	SAT TT=68.584 CHECKS=0 NODES=1100	? (TO) TT=1800	SAT TT=8.093 CHECKS=52126300 NODES=1040	SAT TT=9.528 ASSIGNMENTS=4606 CHECKS=12651100	SAT TT=8.96 ASSIGNMENTS=4606 CHECKS=12651100	? (problem) TT=60.283	? (problem) TT=64.93	No data	? (TO) TT=1800.03	SAT TT=6.89 ASSIGNMENTS=21428 CHECKS=18645700	? (TO) TT=1800.05	SAT TT=0.503 ASSIGNMENTS=3070 CHECKS=1527580	SAT TT=1.897 ASSIGNMENTS=4606 CHECKS=12651100	? TT=262.684	No data	SAT TT=17.244	SAT TT=66.117
csp/os-taillard-15/ normalized-os-taillard-15-95-2.xml	UNSAT TT=2.591	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	UNSAT TT=2.591 ASSIGNMENTS=0	UNSAT TT=2.618 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=9.433 ASSIGNMENTS=0	? (problem) TT=68.659	? (problem) TT=68.825	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=289.97	No data	? (TO) TT=1800.06	? (TO) TT=1800.05
csp/os-taillard-15/ normalized-os-taillard-15-95-9.xml	UNSAT TT=1.118	? (TO) TT=1800.06	? (TO) TT=1800.11	UNSAT TT=1.118	? (TO) TT=1800.12	? (TO) TT=1800.05	UNSAT TT=2.759 ASSIGNMENTS=0	UNSAT TT=2.631 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=9.527 ASSIGNMENTS=0	? (problem) TT=66.226	? (problem) TT=66.188	No data	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.08	? (exit code) TT=253.809	No data	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/os-taillard-20/ normalized-os-taillard-20-100-0.xml	SAT TT=9.302	SAT TT=11.836 CHECKS=15015 NODES=1867	SAT TT=11.829 CHECKS=15015 NODES=1867	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT TT=18.113 ASSIGNMENTS=797	SAT TT=18.831 ASSIGNMENTS=797	SAT TT=165.019 CHECKS=0 NODES=12123	? (TO) TT=1800.03	SAT TT=56.984 CHECKS=576783000 NODES=7029	SAT TT=19.203 ASSIGNMENTS=11354 CHECKS=82609900	SAT TT=19.755 ASSIGNMENTS=11354 CHECKS=82609900	? (problem) TT=69.378	? (problem) TT=64.299	No data	? (TO) TT=1800.05	SAT TT=21.659 ASSIGNMENTS=35617 CHECKS=52615200	? (TO) TT=1800.08	SAT TT=9.302 ASSIGNMENTS=22497 CHECKS=53892600	SAT TT=11.691 ASSIGNMENTS=11354 CHECKS=82609900	? (exit code) TT=256.739	No data	SAT TT=52.922	SAT TT=199.745
csp/os-taillard-20/ normalized-os-taillard-20-100-1.xml	SAT TT=7.927	SAT TT=15.968 CHECKS=34403 NODES=3277	SAT TT=16.345 CHECKS=34403 NODES=3277	SAT TT=896.509	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=27.56 ASSIGNMENTS=2805	SAT TT=29.337 ASSIGNMENTS=2805	SAT TT=1020.15 CHECKS=0 NODES=119795	? (TO) TT=1800.08	SAT TT=50.989 CHECKS=475069000 NODES=5123	SAT TT=50.522 ASSIGNMENTS=53056 CHECKS=343605000	SAT TT=23.155 ASSIGNMENTS=3277 CHECKS=34403	? (problem) TT=74.671	? (problem) TT=69.414	No data	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.11	SAT TT=7.927 ASSIGNMENTS=16864 CHECKS=45170300	SAT TT=44.709 ASSIGNMENTS=53056 CHECKS=343605000	? TT=259.103	No data	SAT TT=58.282	SAT TT=215.867
csp/os-taillard-20/ normalized-os-taillard-20-100-3.xml	SAT TT=8.192	SAT TT=9.868 CHECKS=7620 NODES=918	SAT TT=9.702 CHECKS=7620 NODES=918	SAT TT=8.192	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=17.512 ASSIGNMENTS=832	SAT TT=17.22 ASSIGNMENTS=832	SAT TT=678.579 CHECKS=0 NODES=85198	? (TO) TT=1800.04	SAT TT=42.801 CHECKS=314078000 NODES=3486	SAT TT=31.432 ASSIGNMENTS=20908 CHECKS=172018000	SAT TT=16.787 ASSIGNMENTS=918 CHECKS=7620	? (problem) TT=71.664	? (problem) TT=75.831	No data	? (TO) TT=1800.1	SAT TT=27.158 ASSIGNMENTS=42703 CHECKS=97463600	? (TO) TT=1800.1	SAT TT=80.22 ASSIGNMENTS=68939 CHECKS=540412000	SAT TT=24.29 ASSIGNMENTS=20908 CHECKS=172018000	? (exit code) TT=245.032	No data	SAT TT=51.879	SAT TT=201.615
csp/os-taillard-20/ normalized-os-taillard-20-105-8.xml	SAT TT=2.417	SAT TT=8.756 CHECKS=9565 NODES=677	SAT TT=9.039 CHECKS=9565 NODES=677	SAT TT=897.038	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=18.349 ASSIGNMENTS=866	SAT TT=17.242 ASSIGNMENTS=866	SAT TT=228.494 CHECKS=0 NODES=20043	? (TO) TT=1800.01	SAT TT=25.219 CHECKS=128908000 NODES=1060	SAT TT=10.021 ASSIGNMENTS=2049 CHECKS=11565300	SAT TT=16.366 ASSIGNMENTS=677 CHECKS=9565	? (problem) TT=71.801	? (problem) TT=76.38	No data	? (TO) TT=1800.1	SAT TT=22.546 ASSIGNMENTS=38589 CHECKS=53671200	? (TO) TT=1800.1	SAT TT=3.161 ASSIGNMENTS=11943 CHECKS=14751800	SAT TT=2.417 ASSIGNMENTS=2049 CHECKS=11565300	? TT=249.72	No data	SAT TT=57.02	SAT TT=265.495
csp/os-taillard-20/ normalized-os-taillard-20-105-9.xml	SAT TT=2.517	SAT TT=8.107 CHECKS=7620 NODES=400	SAT TT=8.046 CHECKS=7620 NODES=400	SAT TT=3.98	? (TO) TT=1800.12	? (TO) TT=1800.03	SAT TT=19.164 ASSIGNMENTS=912	SAT TT=18.669 ASSIGNMENTS=912	SAT TT=175.363 CHECKS=0 NODES=15059	? (TO) TT=1800.08	SAT TT=25.026 CHECKS=127940000 NODES=1099	SAT TT=17.199 ASSIGNMENTS=10431 CHECKS=65366600	SAT TT=15.747 ASSIGNMENTS=400 CHECKS=7620	? (problem) TT=79.088	? (problem) TT=77.522	No data	? (TO) TT=1800.1	SAT TT=4.823 ASSIGNMENTS=7234 CHECKS=9954680	? (TO) TT=1800.05	SAT TT=2.517 ASSIGNMENTS=8256 CHECKS=11208300	SAT TT=9.56 ASSIGNMENTS=10431 CHECKS=65366600	? TT=271.95	No data	SAT TT=55.569	SAT TT=220.775
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-taillard-20/ normalized-os-taillard-20-95-0.xml	UNSAT TT=4.278	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.04	UNSAT TT=4.782 ASSIGNMENTS=0	UNSAT TT=4.278 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=11.787 ASSIGNMENTS=0	UNSAT TT=606.362 ASSIGNMENTS=0	? (problem) TT=69.555	? (problem) TT=69.457	No data	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.03	? (exit code) TT=259.369	No data	? (TO) TT=1800.26	? (TO) TT=1800.04
csp/os-taillard-20/ normalized-os-taillard-20-95-1.xml	SAT TT=55.621	SAT TT=696.552 CHECKS=333048000 NODES=539041	SAT TT=697.197 CHECKS=333048000 NODES=539041	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=107.755 ASSIGNMENTS=20533	SAT TT=114.46 ASSIGNMENTS=20533	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=270.498 ASSIGNMENTS=20533	SAT TT=143.26 ASSIGNMENTS=20533	? (problem) TT=74.375	? (problem) TT=74.718	No data	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=539.653 ASSIGNMENTS=1434050 CHECKS=3479430000	SAT TT=175.541 ASSIGNMENTS=190502 CHECKS=1316840000	? TT=255.006	No data	SAT TT=55.621	SAT TT=207.848
csp/os-taillard-20/ normalized-os-taillard-20-95-2.xml	UNSAT TT=3.869	? (TO) TT=1800.19	? (TO) TT=1800.17	UNSAT TT=3.869	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=4.662 ASSIGNMENTS=0	UNSAT TT=4.44 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=174.191 ASSIGNMENTS=0	UNSAT TT=174.387 ASSIGNMENTS=0	? (problem) TT=70.487	? (problem) TT=73.522	No data	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=269.454	No data	? (TO) TT=1800.35	? (TO) TT=1800.05
csp/os-taillard-20/ normalized-os-taillard-20-95-6.xml	UNSAT TT=4.212	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.11	UNSAT TT=4.212 ASSIGNMENTS=0	UNSAT TT=4.724 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=173.929 ASSIGNMENTS=0	UNSAT TT=760.817 ASSIGNMENTS=0	? (problem) TT=64.185	? (problem) TT=64.024	No data	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.1	? TT=265.131	No data	? (MO) TT=979.3	? (TO) TT=1800.19
csp/os-taillard-20/ normalized-os-taillard-20-95-7.xml	SAT TT=17.523	SAT TT=59.433 CHECKS=16443800 NODES=35026	SAT TT=55.514 CHECKS=16443800 NODES=35026	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=17.523 ASSIGNMENTS=766	SAT TT=19.493 ASSIGNMENTS=766	SAT TT=1013.58 CHECKS=0 NODES=109491	? (TO) TT=1800	? (TO) TT=1800.07	SAT TT=24.506 ASSIGNMENTS=766	SAT TT=35.539 ASSIGNMENTS=35901 CHECKS=188922000	? (problem) TT=62.922	? (problem) TT=67.375	No data	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=177.625 ASSIGNMENTS=246393 CHECKS=1276400000	SAT TT=25.732 ASSIGNMENTS=35901 CHECKS=188922000	? TT=258.665	No data	SAT TT=53.288	SAT TT=197.09
csp/os-taillard-4/ normalized-os-taillard-4-100-3.xml	SAT TT=0.009	SAT TT=4.367 CHECKS=50618200 NODES=6909	SAT TT=4.434 CHECKS=53417300 NODES=6970	SAT TT=1.122	SAT TT=1.066 CHECKS=1969490	SAT TT=1.12 CHECKS=2385630	SAT TT=0.834 ASSIGNMENTS=17	SAT TT=0.81 ASSIGNMENTS=17	SAT TT=0.982 CHECKS=0 NODES=182	? (TO) TT=1800	? (TO) TT=1800.05	SAT TT=0.028 ASSIGNMENTS=67 CHECKS=29212	SAT TT=0.026 ASSIGNMENTS=67 CHECKS=29212	SAT TT=985.846	SAT TT=38.016	No data	SAT TT=0.011 ASSIGNMENTS=55 CHECKS=24531	SAT TT=0.017 ASSIGNMENTS=143 CHECKS=55565	SAT TT=0.443	SAT TT=0.01 ASSIGNMENTS=140 CHECKS=16741	SAT TT=0.009 ASSIGNMENTS=50 CHECKS=16580	SAT TT=18.129	No data	SAT TT=0.656	SAT TT=0.813
csp/os-taillard-4/ normalized-os-taillard-4-100-4.xml	SAT TT=0.01	SAT TT=1.546 CHECKS=47380 NODES=16	SAT TT=1.953 CHECKS=7527830 NODES=635	SAT TT=2.967	SAT TT=5.397 CHECKS=11843500	SAT TT=8.722 CHECKS=18548700	SAT TT=0.784 ASSIGNMENTS=16	SAT TT=0.794 ASSIGNMENTS=16	SAT TT=1.111 CHECKS=0 NODES=364	SAT TT=1480.74 CHECKS=16600000000 NODES=11888700	? (TO) TT=1800.03	SAT TT=0.022 ASSIGNMENTS=23 CHECKS=8549	SAT TT=0.022 ASSIGNMENTS=23 CHECKS=8549	SAT TT=1590.38	SAT TT=44.59	No data	SAT TT=0.011 ASSIGNMENTS=29 CHECKS=11484	SAT TT=0.019 ASSIGNMENTS=222 CHECKS=73432	SAT TT=0.396	SAT TT=0.013 ASSIGNMENTS=147 CHECKS=26690	SAT TT=0.01 ASSIGNMENTS=44 CHECKS=12293	SAT TT=10.538	No data	SAT TT=0.939	SAT TT=1.103
csp/os-taillard-4/ normalized-os-taillard-4-100-7.xml	SAT TT=0.009	SAT TT=1.234 CHECKS=885039 NODES=153	SAT TT=1.127 CHECKS=28514 NODES=0	SAT TT=0.036	SAT TT=0.309 CHECKS=369244	SAT TT=0.208 CHECKS=366549	SAT TT=0.782 ASSIGNMENTS=13	SAT TT=0.913 ASSIGNMENTS=13	SAT TT=0.873 CHECKS=0 NODES=17	SAT TT=410.256 CHECKS=4511390000 NODES=4964600	SAT TT=412.401 CHECKS=1561880000 NODES=835560	SAT TT=0.021 ASSIGNMENTS=20 CHECKS=6524	SAT TT=0.023 ASSIGNMENTS=20 CHECKS=6524	SAT TT=149.9	SAT TT=19.812	No data	SAT TT=0.011 ASSIGNMENTS=29 CHECKS=11629	SAT TT=0.012 ASSIGNMENTS=35 CHECKS=15220	SAT TT=0.367	SAT TT=0.011 ASSIGNMENTS=50 CHECKS=7093	SAT TT=0.009 ASSIGNMENTS=26 CHECKS=9996	SAT TT=6.331	No data	SAT TT=0.661	SAT TT=1.045
csp/os-taillard-4/ normalized-os-taillard-4-100-8.xml	SAT TT=0.007	SAT TT=1.547 CHECKS=3416470 NODES=684	SAT TT=1.553 CHECKS=1203720 NODES=219	SAT TT=0.041	SAT TT=0.416 CHECKS=604334	SAT TT=0.275 CHECKS=602413	SAT TT=0.732 ASSIGNMENTS=15	SAT TT=0.946 ASSIGNMENTS=15	SAT TT=0.863 CHECKS=0 NODES=18	SAT TT=714.566 CHECKS=7854130000 NODES=6451930	SAT TT=1027.83 CHECKS=4859790000 NODES=1803470	SAT TT=0.02 ASSIGNMENTS=16 CHECKS=2271	SAT TT=0.022 ASSIGNMENTS=16 CHECKS=2271	SAT TT=267.161	SAT TT=38.669	No data	SAT TT=0.007 ASSIGNMENTS=16 CHECKS=2271	SAT TT=0.008 ASSIGNMENTS=14 CHECKS=2170	SAT TT=0.429	SAT TT=0.009 ASSIGNMENTS=15 CHECKS=1986	SAT TT=0.01 ASSIGNMENTS=29 CHECKS=9340	SAT TT=8.859	No data	SAT TT=0.668	SAT TT=0.82
csp/os-taillard-4/ normalized-os-taillard-4-105-0.xml	SAT TT=0.009	SAT TT=1.23 CHECKS=25457 NODES=16	SAT TT=1.113 CHECKS=30127 NODES=0	SAT TT=0.037	SAT TT=32.025 CHECKS=78016000	SAT TT=3.19 CHECKS=7966860	SAT TT=0.734 ASSIGNMENTS=22	SAT TT=0.757 ASSIGNMENTS=22	SAT TT=0.835 CHECKS=0 NODES=16	SAT TT=100.456 CHECKS=1133330000 NODES=1245740	SAT TT=0.673 CHECKS=581336 NODES=478	SAT TT=0.023 ASSIGNMENTS=33 CHECKS=10882	SAT TT=0.021 ASSIGNMENTS=33 CHECKS=10882	SAT TT=136.364	SAT TT=18.633	No data	SAT TT=0.009 ASSIGNMENTS=30 CHECKS=9383	SAT TT=0.011 ASSIGNMENTS=16 CHECKS=2415	SAT TT=0.382	SAT TT=0.009 ASSIGNMENTS=46 CHECKS=5993	SAT TT=0.009 ASSIGNMENTS=32 CHECKS=6096	SAT TT=5.323	No data	SAT TT=0.924	SAT TT=0.791
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-taillard-4/ normalized-os-taillard-4-105-2.xml	SAT TT=0.009	SAT TT=1.572 CHECKS=48881 NODES=17	SAT TT=1.573 CHECKS=41643 NODES=0	SAT TT=0.036	SAT TT=0.112 CHECKS=7507	SAT TT=0.012 CHECKS=6756	SAT TT=0.829 ASSIGNMENTS=20	SAT TT=0.79 ASSIGNMENTS=20	SAT TT=0.875 CHECKS=0 NODES=50	SAT TT=0.867 CHECKS=496671 NODES=160	SAT TT=0.591 CHECKS=321437 NODES=41	SAT TT=0.021 ASSIGNMENTS=22 CHECKS=2441	SAT TT=0.02 ASSIGNMENTS=22 CHECKS=2441	SAT TT=1313.43	SAT TT=38.411	No data	SAT TT=0.01 ASSIGNMENTS=22 CHECKS=2441	SAT TT=0.009 ASSIGNMENTS=39 CHECKS=8043	SAT TT=0.422	SAT TT=0.011 ASSIGNMENTS=20 CHECKS=2272	SAT TT=0.009 ASSIGNMENTS=35 CHECKS=6064	SAT TT=9.342	No data	SAT TT=0.663	SAT TT=0.953
csp/os-taillard-4/ normalized-os-taillard-4-105-4.xml	SAT TT=0.009	SAT TT=1.716 CHECKS=320010 NODES=47	SAT TT=1.665 CHECKS=46495 NODES=0	SAT TT=0.037	SAT TT=0.112 CHECKS=7087	SAT TT=0.011 CHECKS=5893	SAT TT=0.742 ASSIGNMENTS=21	SAT TT=0.749 ASSIGNMENTS=21	SAT TT=0.985 CHECKS=0 NODES=17	SAT TT=0.87 CHECKS=2629930 NODES=1538	SAT TT=0.657 CHECKS=515313 NODES=114	SAT TT=0.021 ASSIGNMENTS=24 CHECKS=2278	SAT TT=0.02 ASSIGNMENTS=24 CHECKS=2278	? (TO) TT=1800.03	SAT TT=50.049	No data	SAT TT=0.01 ASSIGNMENTS=24 CHECKS=2278	SAT TT=0.009 ASSIGNMENTS=11 CHECKS=2434	SAT TT=0.36	SAT TT=0.01 ASSIGNMENTS=22 CHECKS=2202	SAT TT=0.009 ASSIGNMENTS=27 CHECKS=3666	SAT TT=11.152	No data	SAT TT=0.76	SAT TT=0.861
csp/os-taillard-4/ normalized-os-taillard-4-95-4.xml	UNSAT TT=0.01	UNSAT TT=5.138 CHECKS=75154200 NODES=8892	UNSAT TT=5.628 CHECKS=76786800 NODES=8795	UNSAT TT=0.036	UNSAT TT=0.353 CHECKS=465955	UNSAT TT=0.225 CHECKS=465423	UNSAT TT=0.664 ASSIGNMENTS=0	UNSAT TT=0.576 ASSIGNMENTS=0	UNSAT TT=2.816 CHECKS=0 NODES=7003	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.021 ASSIGNMENTS=19 CHECKS=6501	UNSAT TT=0.023 ASSIGNMENTS=19 CHECKS=6501	UNSAT TT=816.617	UNSAT TT=53.969	No data	UNSAT TT=0.011 ASSIGNMENTS=21 CHECKS=6156	UNSAT TT=0.142 ASSIGNMENTS=3570 CHECKS=1014970	UNSAT TT=0.533	UNSAT TT=0.012 ASSIGNMENTS=71 CHECKS=9756	UNSAT TT=0.01 ASSIGNMENTS=25 CHECKS=6183	UNSAT TT=38.21	No data	UNSAT TT=0.626	UNSAT TT=0.85
csp/os-taillard-4/ normalized-os-taillard-4-95-5.xml	UNSAT TT=0.008	UNSAT TT=1.149 CHECKS=241065 NODES=79	UNSAT TT=1.061 CHECKS=159848 NODES=0	UNSAT TT=0.037	UNSAT TT=0.141 CHECKS=52580	UNSAT TT=0.049 CHECKS=51452	UNSAT TT=0.678 ASSIGNMENTS=0	UNSAT TT=0.583 ASSIGNMENTS=0	UNSAT TT=0.752 CHECKS=0 NODES=43	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.021 ASSIGNMENTS=1 CHECKS=1594	UNSAT TT=0.02 ASSIGNMENTS=1 CHECKS=1594	UNSAT TT=22.869	UNSAT TT=13.537	No data	UNSAT TT=0.008 ASSIGNMENTS=1 CHECKS=1594	UNSAT TT=0.01 ASSIGNMENTS=32 CHECKS=13066	UNSAT TT=0.366	UNSAT TT=0.01 ASSIGNMENTS=1 CHECKS=1594	UNSAT TT=0.008 ASSIGNMENTS=1 CHECKS=1173	UNSAT TT=4.88	No data	UNSAT TT=0.606	UNSAT TT=0.875
csp/os-taillard-4/ normalized-os-taillard-4-95-8.xml	UNSAT TT=0.008	UNSAT TT=1.355 CHECKS=1276160 NODES=150	UNSAT TT=1.38 CHECKS=677895 NODES=0	UNSAT TT=0.036	UNSAT TT=0.188 CHECKS=143809	UNSAT TT=0.097 CHECKS=126831	UNSAT TT=0.613 ASSIGNMENTS=0	UNSAT TT=0.616 ASSIGNMENTS=0	UNSAT TT=0.926 CHECKS=0 NODES=258	? (TO) TT=1800	? (TO) TT=1800.01	UNSAT TT=0.02 ASSIGNMENTS=21 CHECKS=5633	UNSAT TT=0.022 ASSIGNMENTS=21 CHECKS=5633	UNSAT TT=202.022	UNSAT TT=28.013	No data	UNSAT TT=0.01 ASSIGNMENTS=23 CHECKS=7360	UNSAT TT=0.022 ASSIGNMENTS=338 CHECKS=104122	UNSAT TT=0.363	UNSAT TT=0.011 ASSIGNMENTS=87 CHECKS=8686	UNSAT TT=0.008 ASSIGNMENTS=19 CHECKS=4673	UNSAT TT=8.002	No data	UNSAT TT=0.637	UNSAT TT=0.761
csp/os-taillard-5/ normalized-os-taillard-5-100-0.xml	SAT TT=0.042	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.07	SAT TT=35.631 CHECKS=80873500	SAT TT=99.588 CHECKS=258619000	SAT TT=1.093 ASSIGNMENTS=67	SAT TT=1.088 ASSIGNMENTS=67	SAT TT=9.647 CHECKS=0 NODES=21070	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.222 ASSIGNMENTS=2290 CHECKS=1561070	SAT TT=0.225 ASSIGNMENTS=2290 CHECKS=1561070	? (TO) TT=1800.01	? (MO) TT=664.92	No data	SAT TT=0.219 ASSIGNMENTS=2376 CHECKS=1656230	SAT TT=0.254 ASSIGNMENTS=4744 CHECKS=1905990	SAT TT=8.041	SAT TT=0.05 ASSIGNMENTS=707 CHECKS=282865	SAT TT=0.042 ASSIGNMENTS=397 CHECKS=248312	? (TO) TT=1800.16	No data	SAT TT=0.889	SAT TT=1.164
csp/os-taillard-5/ normalized-os-taillard-5-100-8.xml	SAT TT=0.138	? (TO) TT=1800.19	? (TO) TT=1800.15	? (TO) TT=1800.07	SAT TT=664.98 CHECKS=1569030000	SAT TT=110.966 CHECKS=274134000	SAT TT=1.256 ASSIGNMENTS=160	SAT TT=1.382 ASSIGNMENTS=160	SAT TT=83.078 CHECKS=0 NODES=211404	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=0.14 ASSIGNMENTS=1329 CHECKS=901828	SAT TT=0.138 ASSIGNMENTS=1329 CHECKS=901828	? (TO) TT=1800.05	? (MO) TT=509.19	No data	SAT TT=0.189 ASSIGNMENTS=2480 CHECKS=1398840	SAT TT=0.267 ASSIGNMENTS=4851 CHECKS=1999450	SAT TT=47.314	SAT TT=0.189 ASSIGNMENTS=2424 CHECKS=1318180	SAT TT=0.243 ASSIGNMENTS=3087 CHECKS=1846830	? (TO) TT=1800.42	No data	SAT TT=0.995	SAT TT=1.345
csp/os-taillard-5/ normalized-os-taillard-5-100-9.xml	SAT TT=0.049	SAT TT=50.401 CHECKS=981581000 NODES=114351	SAT TT=5.532 CHECKS=67338400 NODES=9455	? (TO) TT=1800.1	SAT TT=23.528 CHECKS=47979800	SAT TT=49.469 CHECKS=126683000	SAT TT=1.085 ASSIGNMENTS=87	SAT TT=1.086 ASSIGNMENTS=87	SAT TT=1.648 CHECKS=0 NODES=132	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=0.325 ASSIGNMENTS=3325 CHECKS=2597610	SAT TT=0.327 ASSIGNMENTS=3325 CHECKS=2597610	? (TO) TT=1800.03	? (MO) TT=775.99	No data	SAT TT=0.184 ASSIGNMENTS=2013 CHECKS=1482050	SAT TT=0.332 ASSIGNMENTS=5852 CHECKS=2715080	SAT TT=1.282	SAT TT=0.172 ASSIGNMENTS=2103 CHECKS=1188600	SAT TT=0.049 ASSIGNMENTS=459 CHECKS=323601	SAT TT=26.851	No data	SAT TT=0.793	SAT TT=1.235
csp/os-taillard-5/ normalized-os-taillard-5-105-0.xml	SAT TT=0.014	SAT TT=1.8 CHECKS=61280 NODES=25	SAT TT=1.878 CHECKS=679820 NODES=83	SAT TT=535.622	SAT TT=10.923 CHECKS=25696400	SAT TT=18.714 CHECKS=43430100	SAT TT=0.853 ASSIGNMENTS=26	SAT TT=0.851 ASSIGNMENTS=26	SAT TT=1.499 CHECKS=0 NODES=65	SAT TT=1739.96 CHECKS=22827100000 NODES=10740500	SAT TT=0.869 CHECKS=1054260 NODES=249	SAT TT=0.027 ASSIGNMENTS=105 CHECKS=37629	SAT TT=0.028 ASSIGNMENTS=105 CHECKS=37629	? (TO) TT=1800.02	SAT TT=99.33	No data	SAT TT=0.015 ASSIGNMENTS=65 CHECKS=22293	SAT TT=0.027 ASSIGNMENTS=297 CHECKS=115249	SAT TT=0.563	SAT TT=0.02 ASSIGNMENTS=260 CHECKS=53787	SAT TT=0.014 ASSIGNMENTS=58 CHECKS=18592	SAT TT=35.195	No data	SAT TT=0.779	SAT TT=1.461
csp/os-taillard-5/ normalized-os-taillard-5-105-1.xml	SAT TT=0.014	SAT TT=2.238 CHECKS=78451 NODES=25	SAT TT=2.231 CHECKS=154397 NODES=0	SAT TT=47.109	SAT TT=10.533 CHECKS=27157900	SAT TT=15.567 CHECKS=42643700	SAT TT=0.849 ASSIGNMENTS=32	SAT TT=0.866 ASSIGNMENTS=32	SAT TT=1.48 CHECKS=0 NODES=58	SAT TT=1084.52 CHECKS=14306900000 NODES=7653110	SAT TT=1.053 CHECKS=3751520 NODES=1495	SAT TT=0.024 ASSIGNMENTS=40 CHECKS=7015	SAT TT=0.025 ASSIGNMENTS=40 CHECKS=7015	? (TO) TT=1800.07	SAT TT=77.019	No data	SAT TT=0.014 ASSIGNMENTS=40 CHECKS=7015	SAT TT=0.039 ASSIGNMENTS=471 CHECKS=215120	SAT TT=0.5	SAT TT=0.018 ASSIGNMENTS=268 CHECKS=40656	SAT TT=0.016 ASSIGNMENTS=92 CHECKS=35411	SAT TT=20.175	No data	SAT TT=0.759	SAT TT=1.158
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-taillard-5/ normalized-os-taillard-5-105-4.xml	SAT TT=0.012	SAT TT=2.632 CHECKS=8121650 NODES=1307	SAT TT=2.305 CHECKS=2715700 NODES=313	? (TO) TT=1800.07	SAT TT=23.294 CHECKS=55403600	SAT TT=17.312 CHECKS=42170200	SAT TT=0.862 ASSIGNMENTS=29	SAT TT=0.887 ASSIGNMENTS=29	SAT TT=1.702 CHECKS=0 NODES=143	SAT TT=765.162 CHECKS=9984110000 NODES=4354700	? (TO) TT=1800.03	SAT TT=0.024 ASSIGNMENTS=49 CHECKS=14569	SAT TT=0.024 ASSIGNMENTS=49 CHECKS=14569	? (TO) TT=1800.03	SAT TT=410.21	No data	SAT TT=0.014 ASSIGNMENTS=48 CHECKS=14569	SAT TT=0.05 ASSIGNMENTS=800 CHECKS=336142	SAT TT=0.772	SAT TT=0.024 ASSIGNMENTS=414 CHECKS=80736	SAT TT=0.012 ASSIGNMENTS=27 CHECKS=6009	SAT TT=433.326	No data	SAT TT=0.799	SAT TT=1.262
csp/os-taillard-5/ normalized-os-taillard-5-105-8.xml	SAT TT=0.015	SAT TT=1.243 CHECKS=206145 NODES=93	SAT TT=1.151 CHECKS=75560 NODES=0	SAT TT=1.783	SAT TT=23.277 CHECKS=56319700	SAT TT=34.379 CHECKS=87559900	SAT TT=0.876 ASSIGNMENTS=24	SAT TT=1.065 ASSIGNMENTS=24	SAT TT=1.992 CHECKS=0 NODES=168	SAT TT=723.81 CHECKS=8920540000 NODES=3600350	SAT TT=1.764 CHECKS=12556000 NODES=3760	SAT TT=0.026 ASSIGNMENTS=81 CHECKS=44204	SAT TT=0.028 ASSIGNMENTS=81 CHECKS=44204	SAT TT=133.574	? (MO) TT=468.14	No data	SAT TT=0.016 ASSIGNMENTS=60 CHECKS=26477	SAT TT=0.015 ASSIGNMENTS=78 CHECKS=23292	SAT TT=3.903	SAT TT=0.023 ASSIGNMENTS=332 CHECKS=88587	SAT TT=0.018 ASSIGNMENTS=101 CHECKS=51713	SAT TT=28.482	No data	SAT TT=0.81	SAT TT=1.286
csp/os-taillard-5/ normalized-os-taillard-5-95-5.xml	UNSAT TT=0.017	UNSAT TT=15.9 CHECKS=343119000 NODES=32073	UNSAT TT=15.89 CHECKS=353282000 NODES=32333	UNSAT TT=0.049	UNSAT TT=24.117 CHECKS=47005700	UNSAT TT=0.871 CHECKS=1915550	UNSAT TT=0.645 ASSIGNMENTS=0	UNSAT TT=0.78 ASSIGNMENTS=0	UNSAT TT=4.233 CHECKS=0 NODES=7528	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.026 ASSIGNMENTS=93 CHECKS=31611	UNSAT TT=0.029 ASSIGNMENTS=93 CHECKS=31611	? (TO) TT=1800.06	UNSAT TT=311.992	No data	UNSAT TT=0.017 ASSIGNMENTS=90 CHECKS=30811	UNSAT TT=0.234 ASSIGNMENTS=4442 CHECKS=1776690	UNSAT TT=2.455	UNSAT TT=0.023 ASSIGNMENTS=374 CHECKS=100986	UNSAT TT=0.02 ASSIGNMENTS=126 CHECKS=57386	UNSAT TT=123.08	No data	UNSAT TT=0.78	UNSAT TT=1.192
csp/os-taillard-5/ normalized-os-taillard-5-95-8.xml	UNSAT TT=0.015	UNSAT TT=11.159 CHECKS=162096000 NODES=17302	UNSAT TT=11.508 CHECKS=162770000 NODES=17334	UNSAT TT=0.047	UNSAT TT=3.197 CHECKS=6644730	? (TO) TT=1800.06	UNSAT TT=0.65 ASSIGNMENTS=0	UNSAT TT=0.661 ASSIGNMENTS=0	UNSAT TT=18.326 CHECKS=0 NODES=36414	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=0.031 ASSIGNMENTS=87 CHECKS=33386	UNSAT TT=0.027 ASSIGNMENTS=87 CHECKS=33386	? (TO) TT=1800.02	UNSAT TT=573.976	No data	UNSAT TT=0.016 ASSIGNMENTS=87 CHECKS=32400	UNSAT TT=0.236 ASSIGNMENTS=4682 CHECKS=1759630	UNSAT TT=2.979	UNSAT TT=0.024 ASSIGNMENTS=416 CHECKS=79615	UNSAT TT=0.015 ASSIGNMENTS=83 CHECKS=26600	UNSAT TT=61.921	No data	UNSAT TT=0.769	UNSAT TT=1.144
csp/os-taillard-5/ normalized-os-taillard-5-95-9.xml	UNSAT TT=0.015	UNSAT TT=6.663 CHECKS=93545500 NODES=7874	UNSAT TT=12.415 CHECKS=229519000 NODES=17960	UNSAT TT=0.046	UNSAT TT=88.94 CHECKS=189970000	UNSAT TT=58.374 CHECKS=140387000	UNSAT TT=0.651 ASSIGNMENTS=0	UNSAT TT=0.652 ASSIGNMENTS=0	UNSAT TT=5.785 CHECKS=0 NODES=11647	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.03 ASSIGNMENTS=83 CHECKS=29498	UNSAT TT=0.025 ASSIGNMENTS=83 CHECKS=29498	? (TO) TT=1800.01	UNSAT TT=297.555	No data	UNSAT TT=0.015 ASSIGNMENTS=85 CHECKS=30735	UNSAT TT=0.228 ASSIGNMENTS=4464 CHECKS=1733830	UNSAT TT=0.897	UNSAT TT=0.029 ASSIGNMENTS=377 CHECKS=100584	UNSAT TT=0.015 ASSIGNMENTS=88 CHECKS=30737	UNSAT TT=48.271	No data	UNSAT TT=0.744	UNSAT TT=1.08
csp/os-taillard-7/ normalized-os-taillard-7-100-0.xml	SAT TT=0.09	SAT TT=137.753 CHECKS=62558000 NODES=339667	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=1.433 ASSIGNMENTS=67	SAT TT=1.562 ASSIGNMENTS=67	SAT TT=122.533 CHECKS=0 NODES=224758	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.41 ASSIGNMENTS=2084 CHECKS=2862510	SAT TT=0.409 ASSIGNMENTS=2084 CHECKS=2862510	? (MO) TT=771.55	? (MO) TT=543.46	No data	SAT TT=0.758 ASSIGNMENTS=4080 CHECKS=5432050	SAT TT=1.625 ASSIGNMENTS=19970 CHECKS=11556700	SAT TT=283.699	SAT TT=7.786 ASSIGNMENTS=53727 CHECKS=56758500	SAT TT=0.09 ASSIGNMENTS=613 CHECKS=527848	? (TO) TT=1800.16	No data	SAT TT=1.985	SAT TT=3.994
csp/os-taillard-7/ normalized-os-taillard-7-100-6.xml	SAT TT=2.231	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=2.231 ASSIGNMENTS=283	SAT TT=2.439 ASSIGNMENTS=283	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=9.375 ASSIGNMENTS=283	SAT TT=9.712 ASSIGNMENTS=283	? (MO) TT=780.17	? (MO) TT=664.19	No data	SAT TT=10.326 ASSIGNMENTS=52724 CHECKS=78796000	SAT TT=7.424 ASSIGNMENTS=50586 CHECKS=57021900	? (TO) TT=1800.04	SAT TT=44.994 ASSIGNMENTS=250092 CHECKS=314365000	SAT TT=51.103 ASSIGNMENTS=318099 CHECKS=388087000	? (TO) TT=1800.19	No data	SAT TT=5.021	SAT TT=8.825
csp/os-taillard-7/ normalized-os-taillard-7-105-3.xml	SAT TT=0.055	SAT TT=1.647 CHECKS=5128 NODES=1000	SAT TT=1.367 CHECKS=865 NODES=387	? (TO) TT=1800.1	SAT TT=24.598 CHECKS=54342800	SAT TT=35.269 CHECKS=84617000	SAT TT=1.265 ASSIGNMENTS=59	SAT TT=1.255 ASSIGNMENTS=59	SAT TT=7.539 CHECKS=0 NODES=119	? (TO) TT=1800.01	SAT TT=1.592 CHECKS=9119310 NODES=1355	SAT TT=0.07 ASSIGNMENTS=443 CHECKS=234885	SAT TT=0.069 ASSIGNMENTS=443 CHECKS=234885	? (problem) TT=63.494	? (problem) TT=59.637	No data	SAT TT=0.055 ASSIGNMENTS=457 CHECKS=258575	SAT TT=0.565 ASSIGNMENTS=9000 CHECKS=4483120	SAT TT=0.839	SAT TT=0.2 ASSIGNMENTS=2204 CHECKS=1023710	SAT TT=0.193 ASSIGNMENTS=1071 CHECKS=1279030	SAT TT=458.925	No data	SAT TT=1.576	SAT TT=3.395
csp/os-taillard-7/ normalized-os-taillard-7-105-4.xml	SAT TT=0.051	SAT TT=1.42 CHECKS=11408 NODES=620	SAT TT=1.588 CHECKS=5910 NODES=986	? (TO) TT=1800.09	SAT TT=25.426 CHECKS=55707300	SAT TT=35.498 CHECKS=84798000	SAT TT=1.245 ASSIGNMENTS=69	SAT TT=1.247 ASSIGNMENTS=69	SAT TT=6.733 CHECKS=0 NODES=707	? (TO) TT=1800.09	SAT TT=1.785 CHECKS=7284010 NODES=1167	SAT TT=0.051 ASSIGNMENTS=160 CHECKS=110240	SAT TT=0.051 ASSIGNMENTS=160 CHECKS=110240	? (MO) TT=621.29	? (MO) TT=444.55	No data	SAT TT=0.098 ASSIGNMENTS=1064 CHECKS=526960	SAT TT=0.299 ASSIGNMENTS=4220 CHECKS=2140390	SAT TT=3.666	SAT TT=0.188 ASSIGNMENTS=1703 CHECKS=1047570	SAT TT=0.109 ASSIGNMENTS=514 CHECKS=656753	? (TO) TT=1800.15	No data	SAT TT=1.497	SAT TT=3.569
csp/os-taillard-7/ normalized-os-taillard-7-105-8.xml	SAT TT=0.032	SAT TT=1.394 CHECKS=26986 NODES=722	SAT TT=1.386 CHECKS=8985 NODES=565	? (TO) TT=1800.02	SAT TT=24.336 CHECKS=55815200	SAT TT=16.655 CHECKS=47367600	SAT TT=1.43 ASSIGNMENTS=68	SAT TT=1.491 ASSIGNMENTS=68	SAT TT=8.658 CHECKS=0 NODES=2281	? (TO) TT=1800.1	SAT TT=1.447 CHECKS=3247290 NODES=242	SAT TT=0.045 ASSIGNMENTS=113 CHECKS=62199	SAT TT=0.043 ASSIGNMENTS=113 CHECKS=62199	? (TO) TT=1800	? (TO) TT=1800	No data	SAT TT=0.032 ASSIGNMENTS=113 CHECKS=62810	SAT TT=0.068 ASSIGNMENTS=745 CHECKS=361595	SAT TT=19.363	SAT TT=0.098 ASSIGNMENTS=1081 CHECKS=363370	SAT TT=0.088 ASSIGNMENTS=486 CHECKS=472074	SAT TT=143.835	No data	SAT TT=1.551	SAT TT=3.703
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-taillard-7/ normalized-os-taillard-7-105-9.xml	SAT TT=0.045	SAT TT=1.206 CHECKS=926 NODES=216	SAT TT=1.329 CHECKS=301 NODES=302	SAT TT=1340.14	SAT TT=20.022 CHECKS=45066000	SAT TT=25.783 CHECKS=61926000	SAT TT=1.372 ASSIGNMENTS=54	SAT TT=1.243 ASSIGNMENTS=54	SAT TT=6.036 CHECKS=0 NODES=293	? (TO) TT=1800.09	SAT TT=1.634 CHECKS=5720640 NODES=901	SAT TT=0.072 ASSIGNMENTS=251 CHECKS=270200	SAT TT=0.073 ASSIGNMENTS=251 CHECKS=270200	? (MO) TT=739.69	? (MO) TT=461.33	No data	SAT TT=0.062 ASSIGNMENTS=321 CHECKS=293001	SAT TT=0.258 ASSIGNMENTS=3493 CHECKS=1844590	SAT TT=4.164	SAT TT=0.052 ASSIGNMENTS=610 CHECKS=124342	SAT TT=0.045 ASSIGNMENTS=159 CHECKS=143903	SAT TT=172.135	No data	SAT TT=1.548	SAT TT=3.463
csp/os-taillard-7/ normalized-os-taillard-7-95-4.xml	UNSAT TT=0.067	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=0.094	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=0.885 ASSIGNMENTS=0	UNSAT TT=1.041 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=8.266 ASSIGNMENTS=0	UNSAT TT=8.502 ASSIGNMENTS=0	? (MO) TT=862.36	? (MO) TT=719.13	No data	UNSAT TT=0.514 ASSIGNMENTS=6758 CHECKS=3552680	UNSAT TT=0.585 ASSIGNMENTS=8312 CHECKS=4367690	UNSAT TT=1384.4	UNSAT TT=0.159 ASSIGNMENTS=1793 CHECKS=706405	UNSAT TT=0.067 ASSIGNMENTS=654 CHECKS=326889	? (TO) TT=1800.15	No data	UNSAT TT=1.568	UNSAT TT=3.317
csp/os-taillard-7/ normalized-os-taillard-7-95-7.xml	UNSAT TT=0.096	? (TO) TT=1800.08	? (TO) TT=1800.14	UNSAT TT=0.096	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=1.059 ASSIGNMENTS=0	UNSAT TT=0.944 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.383 ASSIGNMENTS=4370 CHECKS=2760300	UNSAT TT=0.381 ASSIGNMENTS=4370 CHECKS=2760300	? (MO) TT=960.31	? (MO) TT=699.69	No data	UNSAT TT=0.395 ASSIGNMENTS=4328 CHECKS=2770680	UNSAT TT=0.737 ASSIGNMENTS=10727 CHECKS=5398150	? (TO) TT=1800.1	UNSAT TT=0.294 ASSIGNMENTS=3160 CHECKS=1410230	UNSAT TT=0.511 ASSIGNMENTS=5588 CHECKS=3503160	? (TO) TT=1800.16	No data	UNSAT TT=1.738	UNSAT TT=3.335
csp/os-taillard-7/ normalized-os-taillard-7-95-8.xml	UNSAT TT=0.078	? (TO) TT=1800.04	? (TO) TT=1800.11	UNSAT TT=0.093	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=1.04 ASSIGNMENTS=0	UNSAT TT=1.063 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=0.41 ASSIGNMENTS=4300 CHECKS=2714340	UNSAT TT=0.391 ASSIGNMENTS=4300 CHECKS=2714340	? (MO) TT=723.93	? (MO) TT=793.92	No data	UNSAT TT=0.361 ASSIGNMENTS=4275 CHECKS=2739740	UNSAT TT=0.565 ASSIGNMENTS=8465 CHECKS=4214870	UNSAT TT=1251.76	UNSAT TT=0.627 ASSIGNMENTS=6345 CHECKS=3500590	UNSAT TT=0.078 ASSIGNMENTS=667 CHECKS=384681	? (TO) TT=1800.16	No data	UNSAT TT=2.12	UNSAT TT=3.691
csp/os-taillard-7/ normalized-os-taillard-7-95-9.xml	UNSAT TT=0.073	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=0.093	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.918 ASSIGNMENTS=0	UNSAT TT=0.89 ASSIGNMENTS=0	UNSAT TT=543.774 CHECKS=0 NODES=1071400	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=0.214 ASSIGNMENTS=1869 CHECKS=1303690	UNSAT TT=0.215 ASSIGNMENTS=1869 CHECKS=1303690	? (MO) TT=1036.59	? (MO) TT=992.17	No data	UNSAT TT=0.395 ASSIGNMENTS=4281 CHECKS=2778100	UNSAT TT=0.579 ASSIGNMENTS=8328 CHECKS=4291180	UNSAT TT=80.854	UNSAT TT=0.241 ASSIGNMENTS=2794 CHECKS=1245030	UNSAT TT=0.073 ASSIGNMENTS=679 CHECKS=371084	? (TO) TT=1800.16	No data	UNSAT TT=1.607	UNSAT TT=3.14
csp/pigeons_glb/ normalized-pigeons-10_ext.xml	UNSAT TT=0.004	UNSAT TT=0.614 CHECKS=0 NODES=0	UNSAT TT=0.58 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.007 CHECKS=10	UNSAT TT=0.007 CHECKS=10	UNSAT TT=0.298 ASSIGNMENTS=0	UNSAT TT=0.341 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=46	No data	No data	No data	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=0.252	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=0.004 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=6.543	No data	UNSAT TT=0.333	UNSAT TT=0.337
csp/pigeons_glb/ normalized-pigeons-11_ext.xml	UNSAT TT=0.006	UNSAT TT=0.608 CHECKS=0 NODES=0	UNSAT TT=0.591 CHECKS=0 NODES=0	UNSAT TT=0.026	UNSAT TT=0.006 CHECKS=11	UNSAT TT=0.006 CHECKS=11	UNSAT TT=0.333 ASSIGNMENTS=0	UNSAT TT=0.352 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=56	No data	No data	No data	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=0.254	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=82.262	No data	UNSAT TT=0.336	UNSAT TT=0.334
csp/pigeons_glb/ normalized-pigeons-12_ext.xml	UNSAT TT=0.004	UNSAT TT=0.578 CHECKS=0 NODES=0	UNSAT TT=0.615 CHECKS=0 NODES=0	UNSAT TT=0.026	UNSAT TT=0.005 CHECKS=12	UNSAT TT=0.007 CHECKS=12	UNSAT TT=0.331 ASSIGNMENTS=0	UNSAT TT=0.36 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=67	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=67	No data	No data	No data	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=67	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=67	UNSAT TT=0.227	UNSAT TT=0.004 ASSIGNMENTS=0 CHECKS=67	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=67	? (TO) TT=1800.14	No data	UNSAT TT=0.356	UNSAT TT=0.335
csp/pigeons_glb/ normalized-pigeons-13_ext.xml	UNSAT TT=0.005	UNSAT TT=0.585 CHECKS=0 NODES=0	UNSAT TT=0.604 CHECKS=0 NODES=0	UNSAT TT=0.025	UNSAT TT=0.007 CHECKS=13	UNSAT TT=0.006 CHECKS=13	UNSAT TT=0.327 ASSIGNMENTS=0	UNSAT TT=0.336 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=79	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=79	No data	No data	No data	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=79	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=79	UNSAT TT=0.238	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=79	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=79	? (TO) TT=1800.13	No data	UNSAT TT=0.356	UNSAT TT=0.371
csp/pigeons_glb/ normalized-pigeons-14_ext.xml	UNSAT TT=0.004	UNSAT TT=0.575 CHECKS=0 NODES=0	UNSAT TT=0.581 CHECKS=0 NODES=0	UNSAT TT=0.027	UNSAT TT=0.005 CHECKS=14	UNSAT TT=0.007 CHECKS=14	UNSAT TT=0.346 ASSIGNMENTS=0	UNSAT TT=0.339 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=92	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=92	No data	No data	No data	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=92	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=92	UNSAT TT=0.244	UNSAT TT=0.004 ASSIGNMENTS=0 CHECKS=92	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=92	? (TO) TT=1800.09	No data	UNSAT TT=0.381	UNSAT TT=0.366
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pigeons_glb/ normalized-pigeons-15_ext.xml	UNSAT TT=0.005	UNSAT TT=0.574 CHECKS=0 NODES=0	UNSAT TT=0.594 CHECKS=0 NODES=0	UNSAT TT=0.028	UNSAT TT=0.008 CHECKS=15	UNSAT TT=0.008 CHECKS=15	UNSAT TT=0.306 ASSIGNMENTS=0	UNSAT TT=0.315 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=106	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=106	No data	No data	No data	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=106	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=106	UNSAT TT=0.239	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=106	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=106	? (TO) TT=1800.14	No data	UNSAT TT=0.392	UNSAT TT=0.405
csp/pigeons_glb/ normalized-pigeons-18_ext.xml	UNSAT TT=0.006	UNSAT TT=0.593 CHECKS=0 NODES=0	UNSAT TT=0.623 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.007 CHECKS=18	UNSAT TT=0.008 CHECKS=18	UNSAT TT=0.305 ASSIGNMENTS=0	UNSAT TT=0.357 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=154	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=154	No data	No data	No data	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=154	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=154	UNSAT TT=0.23	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=154	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=154	? (TO) TT=1800.13	No data	UNSAT TT=0.419	UNSAT TT=0.414
csp/pigeons_glb/ normalized-pigeons-20_ext.xml	UNSAT TT=0.005	UNSAT TT=0.622 CHECKS=0 NODES=0	UNSAT TT=0.602 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.007 CHECKS=20	UNSAT TT=0.007 CHECKS=20	UNSAT TT=0.346 ASSIGNMENTS=0	UNSAT TT=0.332 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=191	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=191	No data	No data	No data	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=191	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=191	UNSAT TT=0.243	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=191	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=191	? (TO) TT=1800.11	No data	UNSAT TT=0.397	UNSAT TT=0.397
csp/pigeons_glb/ normalized-pigeons-25_ext.xml	UNSAT TT=0.005	UNSAT TT=0.662 CHECKS=0 NODES=0	UNSAT TT=0.634 CHECKS=0 NODES=0	UNSAT TT=0.026	UNSAT TT=0.006 CHECKS=25	UNSAT TT=0.006 CHECKS=25	UNSAT TT=0.325 ASSIGNMENTS=0	UNSAT TT=0.318 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=301	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=301	No data	No data	No data	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=301	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=301	UNSAT TT=0.245	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=301	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=301	? (TO) TT=1800.6	No data	UNSAT TT=0.568	UNSAT TT=0.484
csp/pigeons_glb/ normalized-pigeons-30_ext.xml	UNSAT TT=0.006	UNSAT TT=0.623 CHECKS=0 NODES=0	UNSAT TT=0.641 CHECKS=0 NODES=0	UNSAT TT=0.027	UNSAT TT=0.007 CHECKS=30	UNSAT TT=0.007 CHECKS=30	UNSAT TT=0.332 ASSIGNMENTS=0	UNSAT TT=0.347 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=436	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=436	No data	No data	No data	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=436	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=436	UNSAT TT=0.257	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=436	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=436	? (TO) TT=1800.14	No data	UNSAT TT=0.512	UNSAT TT=0.513
csp/pigeons_glb/ normalized-pigeons-35_ext.xml	UNSAT TT=0.006	UNSAT TT=0.615 CHECKS=0 NODES=0	UNSAT TT=0.644 CHECKS=0 NODES=0	UNSAT TT=0.027	UNSAT TT=0.007 CHECKS=35	UNSAT TT=0.009 CHECKS=35	UNSAT TT=0.32 ASSIGNMENTS=0	UNSAT TT=0.353 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=596	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=596	No data	No data	No data	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=596	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=596	UNSAT TT=0.235	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=596	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=596	? (TO) TT=1800.2	No data	UNSAT TT=0.524	UNSAT TT=0.529
csp/pigeons_glb/ normalized-pigeons-40_ext.xml	UNSAT TT=0.006	UNSAT TT=0.633 CHECKS=0 NODES=0	UNSAT TT=0.671 CHECKS=0 NODES=0	UNSAT TT=0.027	UNSAT TT=0.006 CHECKS=40	UNSAT TT=0.009 CHECKS=40	UNSAT TT=0.336 ASSIGNMENTS=0	UNSAT TT=0.329 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=781	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=781	No data	No data	No data	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=781	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=781	UNSAT TT=0.246	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=781	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=781	? (TO) TT=1800.11	No data	UNSAT TT=0.544	UNSAT TT=0.555
csp/pigeons_glb/ normalized-pigeons-45_ext.xml	UNSAT TT=0.006	UNSAT TT=0.673 CHECKS=0 NODES=0	UNSAT TT=0.641 CHECKS=0 NODES=0	UNSAT TT=0.025	UNSAT TT=0.009 CHECKS=45	UNSAT TT=0.006 CHECKS=45	UNSAT TT=0.325 ASSIGNMENTS=0	UNSAT TT=0.337 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=991	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=991	No data	No data	No data	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=991	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=991	UNSAT TT=0.247	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=991	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=991	? (TO) TT=1800.23	No data	UNSAT TT=0.524	UNSAT TT=0.73
csp/pigeons_glb/ normalized-pigeons-50_ext.xml	UNSAT TT=0.007	UNSAT TT=0.64 CHECKS=0 NODES=0	UNSAT TT=0.633 CHECKS=0 NODES=0	UNSAT TT=0.028	UNSAT TT=0.009 CHECKS=50	UNSAT TT=0.007 CHECKS=50	UNSAT TT=0.38 ASSIGNMENTS=0	UNSAT TT=0.362 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1226	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1226	No data	No data	No data	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1226	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1226	UNSAT TT=0.258	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1226	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1226	? (TO) TT=1800.14	No data	UNSAT TT=0.598	UNSAT TT=0.583
csp/pigeons_glb/ normalized-pigeons-5_ext.xml	UNSAT TT=0.004	UNSAT TT=0.582 CHECKS=0 NODES=0	UNSAT TT=0.587 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.006 CHECKS=5	UNSAT TT=0.006 CHECKS=5	UNSAT TT=0.327 ASSIGNMENTS=0	UNSAT TT=0.346 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=11	No data	No data	No data	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.24	UNSAT TT=0.004 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.674	No data	UNSAT TT=0.316	UNSAT TT=0.313
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pigeons_glb/ normalized-pigeons-6_ext.xml	UNSAT TT=0.004	UNSAT TT=0.566 CHECKS=0 NODES=0	UNSAT TT=0.686 CHECKS=0 NODES=0	UNSAT TT=0.023	UNSAT TT=0.008 CHECKS=6	UNSAT TT=0.007 CHECKS=6	UNSAT TT=0.32 ASSIGNMENTS=0	UNSAT TT=0.325 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=16	No data	No data	No data	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.25	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.004 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.704	No data	UNSAT TT=0.309	UNSAT TT=0.307
csp/pigeons_glb/ normalized-pigeons-7_ext.xml	UNSAT TT=0.006	UNSAT TT=0.579 CHECKS=0 NODES=0	UNSAT TT=0.604 CHECKS=0 NODES=0	UNSAT TT=0.023	UNSAT TT=0.007 CHECKS=7	UNSAT TT=0.006 CHECKS=7	UNSAT TT=0.32 ASSIGNMENTS=0	UNSAT TT=0.3 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=22	No data	No data	No data	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.239	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=1.026	No data	UNSAT TT=0.315	UNSAT TT=0.315
csp/pigeons_glb/ normalized-pigeons-8_ext.xml	UNSAT TT=0.005	UNSAT TT=0.588 CHECKS=0 NODES=0	UNSAT TT=0.615 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.007 CHECKS=8	UNSAT TT=0.006 CHECKS=8	UNSAT TT=0.349 ASSIGNMENTS=0	UNSAT TT=0.302 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=29	No data	No data	No data	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=0.248	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=1.377	No data	UNSAT TT=0.322	UNSAT TT=0.321
csp/pigeons_glb/ normalized-pigeons-9_ext.xml	UNSAT TT=0.005	UNSAT TT=0.606 CHECKS=0 NODES=0	UNSAT TT=0.59 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.006 CHECKS=9	UNSAT TT=0.007 CHECKS=9	UNSAT TT=0.311 ASSIGNMENTS=0	UNSAT TT=0.305 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=37	No data	No data	No data	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=0.235	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=1.729	No data	UNSAT TT=0.323	UNSAT TT=0.338
csp/pigeons/ normalized-pigeons-11.xml	UNSAT TT=0.005	UNSAT TT=0.68 CHECKS=20 NODES=0	UNSAT TT=0.72 CHECKS=20 NODES=0	UNSAT TT=0.031	UNSAT TT=0.011 CHECKS=65	UNSAT TT=0.011 CHECKS=65	UNSAT TT=0.598 ASSIGNMENTS=0	UNSAT TT=0.564 ASSIGNMENTS=0	UNSAT TT=75.331 CHECKS=21797200 NODES=3977560	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	UNSAT TT=59.16	No data	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=23.999	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=580.843	No data	UNSAT TT=3.213	UNSAT TT=9.989
csp/pigeons/ normalized-pigeons-13.xml	UNSAT TT=0.006	UNSAT TT=0.78 CHECKS=24 NODES=0	UNSAT TT=0.792 CHECKS=24 NODES=0	UNSAT TT=0.033	UNSAT TT=0.012 CHECKS=90	UNSAT TT=0.008 CHECKS=90	UNSAT TT=0.734 ASSIGNMENTS=0	UNSAT TT=0.634 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.01	? (TO) TT=1800.07	No data	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.05	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	No data	UNSAT TT=127.239	UNSAT TT=421.563
csp/pigeons/ normalized-pigeons-14.xml	UNSAT TT=0.008	UNSAT TT=0.806 CHECKS=26 NODES=0	UNSAT TT=0.716 CHECKS=26 NODES=0	UNSAT TT=0.035	UNSAT TT=0.013 CHECKS=104	UNSAT TT=0.009 CHECKS=104	UNSAT TT=0.589 ASSIGNMENTS=0	UNSAT TT=0.623 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.09	? (TO) TT=1800.07	No data	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.04	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.17	No data	UNSAT TT=721.198	? (TO) TT=1800.05
csp/pigeons/ normalized-pigeons-16.xml	UNSAT TT=0.007	UNSAT TT=0.816 CHECKS=30 NODES=0	UNSAT TT=0.768 CHECKS=30 NODES=0	UNSAT TT=0.039	UNSAT TT=0.016 CHECKS=135	UNSAT TT=0.012 CHECKS=135	UNSAT TT=0.589 ASSIGNMENTS=0	UNSAT TT=0.59 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	? (TO) TT=1800.05	No data	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.1	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.18	No data	? (TO) TT=1800.15	? (TO) TT=1800.06
csp/pigeons/ normalized-pigeons-20.xml	UNSAT TT=0.011	UNSAT TT=0.827 CHECKS=38 NODES=0	UNSAT TT=0.838 CHECKS=38 NODES=0	UNSAT TT=0.044	UNSAT TT=0.021 CHECKS=209	UNSAT TT=0.015 CHECKS=209	UNSAT TT=0.671 ASSIGNMENTS=0	UNSAT TT=0.758 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800	? (TO) TT=1800.08	No data	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.16	No data	? (TO) TT=1800.11	? (TO) TT=1800.11
csp/pigeons/ normalized-pigeons-30-ord.xml	UNSAT TT=0.032	UNSAT TT=1.049 CHECKS=1654 NODES=0	UNSAT TT=1.077 CHECKS=1654 NODES=0	UNSAT TT=0.128	UNSAT TT=0.292 CHECKS=1363450	UNSAT TT=0.27 CHECKS=1468320	UNSAT TT=1.225 ASSIGNMENTS=0	UNSAT TT=1.358 ASSIGNMENTS=0	UNSAT TT=2.289 CHECKS=96750 NODES=1234	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=14.976	UNSAT TT=5.758	No data	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.712	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=4.861	No data	UNSAT TT=1.912	UNSAT TT=1.611
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pigeons/ normalized-pigeons-30.xml	UNSAT TT=0.018	UNSAT TT=1.033 CHECKS=58 NODES=0	UNSAT TT=0.947 CHECKS=58 NODES=0	UNSAT TT=0.076	UNSAT TT=0.043 CHECKS=464	UNSAT TT=0.024 CHECKS=464	UNSAT TT=0.938 ASSIGNMENTS=0	UNSAT TT=1.058 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800	? (TO) TT=1800.08	No data	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.03	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.23	No data	? (TO) TT=1800.08	? (TO) TT=1800.08
csp/pigeons/ normalized-pigeons-35.xml	UNSAT TT=0.024	UNSAT TT=1.015 CHECKS=68 NODES=0	UNSAT TT=1.062 CHECKS=68 NODES=0	UNSAT TT=0.096	UNSAT TT=0.054 CHECKS=629	UNSAT TT=0.034 CHECKS=629	UNSAT TT=1.194 ASSIGNMENTS=0	UNSAT TT=1.087 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.1	No data	? (TO) TT=1800.05	? (TO) TT=1800.14
csp/pigeons/ normalized-pigeons-40.xml	UNSAT TT=0.029	UNSAT TT=1.224 CHECKS=78 NODES=0	UNSAT TT=1.216 CHECKS=78 NODES=0	UNSAT TT=0.117	UNSAT TT=0.076 CHECKS=819	UNSAT TT=0.043 CHECKS=819	UNSAT TT=1.389 ASSIGNMENTS=0	UNSAT TT=1.102 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.01	? (TO) TT=1800.02	No data	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.09	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.22	No data	? (TO) TT=1800.04	? (TO) TT=1800.12
csp/pigeons/ normalized-pigeons-45.xml	UNSAT TT=0.035	UNSAT TT=1.168 CHECKS=88 NODES=0	UNSAT TT=1.219 CHECKS=88 NODES=0	UNSAT TT=0.142	UNSAT TT=0.095 CHECKS=1034	UNSAT TT=0.055 CHECKS=1034	UNSAT TT=1.19 ASSIGNMENTS=0	UNSAT TT=1.425 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.05 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	? (TO) TT=1800.06	No data	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.16	No data	? (TO) TT=1800.07	? (TO) TT=1800.07
csp/pigeons/ normalized-pigeons-50.xml	UNSAT TT=0.04	UNSAT TT=1.25 CHECKS=98 NODES=0	UNSAT TT=1.246 CHECKS=98 NODES=0	UNSAT TT=0.159	UNSAT TT=0.115 CHECKS=1274	UNSAT TT=0.063 CHECKS=1274	UNSAT TT=1.244 ASSIGNMENTS=0	UNSAT TT=1.442 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=1	? (MO) TT=1629.72	? (TO) TT=1800.07	No data	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.33	No data	? (TO) TT=1800.01	? (TO) TT=1800.1
csp/pigeons/ normalized-pigeons-8.xml	UNSAT TT=0.006	UNSAT TT=0.643 CHECKS=14 NODES=0	UNSAT TT=0.663 CHECKS=14 NODES=0	UNSAT TT=0.025	UNSAT TT=0.008 CHECKS=35	UNSAT TT=0.008 CHECKS=35	UNSAT TT=0.559 ASSIGNMENTS=0	UNSAT TT=0.513 ASSIGNMENTS=0	UNSAT TT=0.607 CHECKS=33553 NODES=5913	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.838	UNSAT TT=0.65	No data	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.303	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.598	No data	UNSAT TT=0.56	UNSAT TT=0.555
csp/pret/ normalized-pret-150-25_ext.xml	UNSAT TT=0.655	UNSAT TT=16.476 CHECKS=1957000 NODES=250870	UNSAT TT=75.088 CHECKS=10549000 NODES=1222260	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=24.314 ASSIGNMENTS=250870 CHECKS=1957000	UNSAT TT=23.022 ASSIGNMENTS=250870 CHECKS=1957000	UNSAT TT=0.959	UNSAT TT=0.791	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=1.305	? (TO) TT=1800.08	UNSAT TT=0.655	UNSAT TT=0.698
csp/pret/ normalized-pret-150-40_ext.xml	UNSAT TT=0.657	UNSAT TT=39.513 CHECKS=4869560 NODES=579823	UNSAT TT=135.662 CHECKS=20264500 NODES=2151090	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=43.814 ASSIGNMENTS=579823 CHECKS=4869560	UNSAT TT=46.48 ASSIGNMENTS=579823 CHECKS=4869560	UNSAT TT=0.776	UNSAT TT=1.002	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=1.364	? (TO) TT=1800.09	UNSAT TT=0.657	UNSAT TT=0.68
csp/pret/ normalized-pret-150-60_ext.xml	UNSAT TT=0.648	UNSAT TT=26.542 CHECKS=2650900 NODES=413451	UNSAT TT=17.021 CHECKS=1505670 NODES=248750	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=33.33 ASSIGNMENTS=413451 CHECKS=2650900	UNSAT TT=33.421 ASSIGNMENTS=413451 CHECKS=2650900	UNSAT TT=0.79	UNSAT TT=0.761	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=1.31	? (TO) TT=1800.08	UNSAT TT=0.691	UNSAT TT=0.648
csp/pret/ normalized-pret-150-75_ext.xml	UNSAT TT=0.683	UNSAT TT=56.792 CHECKS=6529300 NODES=917091	? (TO) TT=1800.19	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=63.624 ASSIGNMENTS=917091 CHECKS=6529300	UNSAT TT=63.884 ASSIGNMENTS=917091 CHECKS=6529300	UNSAT TT=0.762	UNSAT TT=0.74	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1788.25	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=1.44	? (TO) TT=1800.06	UNSAT TT=0.708	UNSAT TT=0.683
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pret/ normalized-pret-60-25_ext.xml	UNSAT TT=0.532	UNSAT TT=0.994 CHECKS=26773 NODES=5996	UNSAT TT=0.999 CHECKS=9166 NODES=3214	UNSAT TT=14.298	UNSAT TT=148.749 CHECKS=123167000	UNSAT TT=178.469 CHECKS=125587000	UNSAT TT=106.307 ASSIGNMENTS=1759700	UNSAT TT=134.482 ASSIGNMENTS=2097870	UNSAT TT=108.192 CHECKS=75992200 NODES=4473240	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=8.372 ASSIGNMENTS=5996 CHECKS=26773	UNSAT TT=8.491 ASSIGNMENTS=5996 CHECKS=26773	UNSAT TT=0.608	UNSAT TT=0.681	UNSAT TT=32.218 CHECKS=31394700	UNSAT TT=14.902 ASSIGNMENTS=2233420 CHECKS=27921700	UNSAT TT=16.492 ASSIGNMENTS=2328400 CHECKS=30992600	UNSAT TT=27.228	UNSAT TT=14.359 ASSIGNMENTS=2097620 CHECKS=24568900	UNSAT TT=14.086 ASSIGNMENTS=2082170 CHECKS=27862000	UNSAT TT=1.142	UNSAT TT=119.243 ASSIGNMENTS=11902900 CHECKS=46066900	UNSAT TT=0.543	UNSAT TT=0.532
csp/pret/ normalized-pret-60-40_ext.xml	UNSAT TT=0.532	UNSAT TT=6.812 CHECKS=1128880 NODES=145938	UNSAT TT=2.371 CHECKS=202609 NODES=36757	UNSAT TT=13.631	UNSAT TT=154.651 CHECKS=131007000	UNSAT TT=153.79 CHECKS=107612000	UNSAT TT=108.288 ASSIGNMENTS=1786280	UNSAT TT=118.074 ASSIGNMENTS=2097870	UNSAT TT=74.858 CHECKS=53422400 NODES=2913330	? (TO) TT=1800.1	? (TO) TT=1800.01	UNSAT TT=13.049 ASSIGNMENTS=145938 CHECKS=1128880	UNSAT TT=13.348 ASSIGNMENTS=145938 CHECKS=1128880	UNSAT TT=0.604	UNSAT TT=0.602	UNSAT TT=32.318 CHECKS=31394700	UNSAT TT=13.295 ASSIGNMENTS=2021840 CHECKS=26919900	UNSAT TT=17.921 ASSIGNMENTS=2303120 CHECKS=34018600	UNSAT TT=24.84	UNSAT TT=16.021 ASSIGNMENTS=2127050 CHECKS=30136100	UNSAT TT=11.896 ASSIGNMENTS=1924220 CHECKS=22541300	UNSAT TT=1.088	UNSAT TT=107.646 ASSIGNMENTS=11750700 CHECKS=44961000	UNSAT TT=0.535	UNSAT TT=0.532
csp/pret/ normalized-pret-60-60_ext.xml	UNSAT TT=0.524	UNSAT TT=1.269 CHECKS=56760 NODES=14091	UNSAT TT=1.247 CHECKS=54596 NODES=12484	UNSAT TT=13.673	UNSAT TT=83.091 CHECKS=53840200	UNSAT TT=145.452 CHECKS=131118000	UNSAT TT=120.377 ASSIGNMENTS=1971740	UNSAT TT=124.965 ASSIGNMENTS=2066640	UNSAT TT=99.051 CHECKS=66763900 NODES=3902360	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=8.232 ASSIGNMENTS=14091 CHECKS=56760	UNSAT TT=8.973 ASSIGNMENTS=14091 CHECKS=56760	UNSAT TT=0.61	UNSAT TT=0.784	UNSAT TT=31.925 CHECKS=27144700	UNSAT TT=14.238 ASSIGNMENTS=2028550 CHECKS=27031200	UNSAT TT=18.227 ASSIGNMENTS=2286460 CHECKS=34709400	UNSAT TT=23.025	UNSAT TT=14.695 ASSIGNMENTS=2073900 CHECKS=27376900	UNSAT TT=14.166 ASSIGNMENTS=2088260 CHECKS=26854300	UNSAT TT=1.129	UNSAT TT=111.663 ASSIGNMENTS=12040200 CHECKS=49119300	UNSAT TT=0.56	UNSAT TT=0.524
csp/pret/ normalized-pret-60-75_ext.xml	UNSAT TT=0.509	UNSAT TT=1.609 CHECKS=103001 NODES=22469	UNSAT TT=1.683 CHECKS=114581 NODES=23701	UNSAT TT=13.561	UNSAT TT=155.069 CHECKS=99884800	UNSAT TT=148.731 CHECKS=133991000	UNSAT TT=133.421 ASSIGNMENTS=2160460	UNSAT TT=127.654 ASSIGNMENTS=2090600	UNSAT TT=91.467 CHECKS=62716700 NODES=3617560	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=8.442 ASSIGNMENTS=22469 CHECKS=103001	UNSAT TT=8.622 ASSIGNMENTS=22469 CHECKS=103001	UNSAT TT=0.602	UNSAT TT=0.612	UNSAT TT=32.212 CHECKS=32036800	UNSAT TT=12.038 ASSIGNMENTS=2082980 CHECKS=24288200	UNSAT TT=18.398 ASSIGNMENTS=2260760 CHECKS=37719200	UNSAT TT=25.259	UNSAT TT=11.665 ASSIGNMENTS=1726070 CHECKS=21658700	UNSAT TT=13.579 ASSIGNMENTS=2130430 CHECKS=27539900	UNSAT TT=1.077	UNSAT TT=118.378 ASSIGNMENTS=11868400 CHECKS=48695900	UNSAT TT=0.542	UNSAT TT=0.509
csp/primes-10/ normalized-primes-10-20-2-1.xml	SAT TT=0.01	SAT TT=0.853 CHECKS=158104 NODES=100	SAT TT=0.816 CHECKS=158102 NODES=0	SAT TT=0.033	SAT TT=0.074 CHECKS=8189	SAT TT=0.162 CHECKS=454379	SAT TT=0.915 ASSIGNMENTS=70	SAT TT=0.918 ASSIGNMENTS=70	SAT TT=0.789 CHECKS=123369 NODES=100	SAT TT=1.954 CHECKS=235710 NODES=2550000	SAT TT=0.895 CHECKS=408855 NODES=25	SAT TT=0.024 ASSIGNMENTS=80 CHECKS=426	SAT TT=0.024 ASSIGNMENTS=80 CHECKS=426	SAT TT=2.475	SAT TT=2.41	No data	SAT TT=0.01 ASSIGNMENTS=80 CHECKS=426	SAT TT=0.011 ASSIGNMENTS=188 CHECKS=2153	SAT TT=0.36	SAT TT=0.754 ASSIGNMENTS=12314 CHECKS=205605	SAT TT=0.011 ASSIGNMENTS=80 CHECKS=426	SAT TT=4.472	No data	SAT TT=0.661	SAT TT=0.677
csp/primes-10/ normalized-primes-10-20-2-7.xml	SAT TT=0.017	SAT TT=653.535 CHECKS=951192000 NODES=2248	SAT TT=1364.82 CHECKS=1947110000 NODES=3646	SAT TT=0.041	SAT TT=0.384 CHECKS=2307	SAT TT=0.043 CHECKS=3130	SAT TT=2.162 ASSIGNMENTS=68	SAT TT=2.831 ASSIGNMENTS=133	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.032 ASSIGNMENTS=155 CHECKS=11037	SAT TT=0.031 ASSIGNMENTS=155 CHECKS=11037	? (TO) TT=1800.07	? (TO) TT=1800.09	No data	SAT TT=0.018 ASSIGNMENTS=157 CHECKS=11166	SAT TT=0.319 ASSIGNMENTS=7895 CHECKS=627071	SAT TT=0.408	SAT TT=3.165 ASSIGNMENTS=74177 CHECKS=3854570	SAT TT=0.017 ASSIGNMENTS=188 CHECKS=10088	? TT=96.005	No data	? (MO) TT=75.97	? (MO) TT=286.147
csp/primes-10/ normalized-primes-10-20-3-5.xml	SAT TT=0.016	SAT TT=5.501 CHECKS=8073400 NODES=100	SAT TT=15.358 CHECKS=23870500 NODES=136	SAT TT=0.038	SAT TT=0.49 CHECKS=5200	SAT TT=0.039 CHECKS=4452	SAT TT=1.771 ASSIGNMENTS=74	SAT TT=2.393 ASSIGNMENTS=427	SAT TT=408.086 CHECKS=1231760000 NODES=100	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=0.028 ASSIGNMENTS=292 CHECKS=11929	SAT TT=0.031 ASSIGNMENTS=292 CHECKS=11929	? (TO) TT=1800.09	? (TO) TT=1800.04	No data	SAT TT=0.018 ASSIGNMENTS=287 CHECKS=10416	SAT TT=0.196 ASSIGNMENTS=8217 CHECKS=358629	SAT TT=0.383	SAT TT=1.672 ASSIGNMENTS=42786 CHECKS=1300880	SAT TT=0.016 ASSIGNMENTS=301 CHECKS=9404	? TT=156.347	No data	SAT TT=50.413	SAT TT=262.697
csp/primes-10/ normalized-primes-10-20-3-7.xml	SAT TT=0.019	? (TO) TT=1800.06	? (TO) TT=1800.12	SAT TT=0.046	SAT TT=0.462 CHECKS=4009	SAT TT=0.095 CHECKS=7125	SAT TT=1.985 ASSIGNMENTS=67	SAT TT=4.031 ASSIGNMENTS=1397	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=0.034 ASSIGNMENTS=367 CHECKS=16057	SAT TT=0.031 ASSIGNMENTS=367 CHECKS=16057	? (TO) TT=1800	? (TO) TT=1800.02	No data	SAT TT=0.022 ASSIGNMENTS=416 CHECKS=21267	SAT TT=0.291 ASSIGNMENTS=8978 CHECKS=616039	SAT TT=0.379	SAT TT=5.415 ASSIGNMENTS=79977 CHECKS=4554320	SAT TT=0.019 ASSIGNMENTS=271 CHECKS=13261	? TT=142.343	No data	? (MO) TT=107.42	? (MO) TT=291.89
csp/primes-10/ normalized-primes-10-40-2-1.xml	SAT TT=0.014	SAT TT=0.881 CHECKS=135689 NODES=100	SAT TT=0.869 CHECKS=136052 NODES=0	SAT TT=0.038	SAT TT=0.151 CHECKS=3125	SAT TT=0.112 CHECKS=192747	SAT TT=1.025 ASSIGNMENTS=43	SAT TT=1.131 ASSIGNMENTS=43	SAT TT=1.055 CHECKS=137067 NODES=100	SAT TT=0.978 CHECKS=150258 NODES=150008	SAT TT=1.197 CHECKS=476634 NODES=695	SAT TT=0.023 ASSIGNMENTS=77 CHECKS=1489	SAT TT=0.025 ASSIGNMENTS=77 CHECKS=1489	SAT TT=3.702	SAT TT=3.484	No data	SAT TT=0.014 ASSIGNMENTS=77 CHECKS=1489	SAT TT=0.019 ASSIGNMENTS=607 CHECKS=9911	SAT TT=0.427	SAT TT=0.171 ASSIGNMENTS=14247 CHECKS=153407	SAT TT=0.014 ASSIGNMENTS=81 CHECKS=1668	SAT TT=6.239	No data	SAT TT=0.719	SAT TT=0.821
csp/primes-10/ normalized-primes-10-40-2-3.xml	SAT TT=0.024	SAT TT=1.818 CHECKS=2215470 NODES=100	SAT TT=1.748 CHECKS=2118250 NODES=0	SAT TT=0.042	SAT TT=1.058 CHECKS=143718	SAT TT=0.769 CHECKS=141544	SAT TT=1.447 ASSIGNMENTS=41	SAT TT=1.45 ASSIGNMENTS=41	SAT TT=88.129 CHECKS=36681900 NODES=102	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.036 ASSIGNMENTS=265 CHECKS=16199	SAT TT=0.032 ASSIGNMENTS=265 CHECKS=16199	SAT TT=92.853	SAT TT=87.583	No data	SAT TT=0.024 ASSIGNMENTS=248 CHECKS=15065	SAT TT=0.229 ASSIGNMENTS=6072 CHECKS=373064	SAT TT=0.471	SAT TT=4.728 ASSIGNMENTS=44233 CHECKS=3019640	SAT TT=0.048 ASSIGNMENTS=856 CHECKS=63863	? TT=235.257	No data	SAT TT=1.659	SAT TT=3.6
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-10/ normalized-primes-10-40-2-5.xml	SAT TT=0.046	SAT TT=3.666 CHECKS=4657610 NODES=114	SAT TT=4.847 CHECKS=6028720 NODES=104	SAT TT=0.046	SAT TT=1.665 CHECKS=110788	SAT TT=1.287 CHECKS=103096	SAT TT=1.751 ASSIGNMENTS=66	SAT TT=3.364 ASSIGNMENTS=819	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=0.104 ASSIGNMENTS=2329 CHECKS=179214	SAT TT=0.104 ASSIGNMENTS=2329 CHECKS=179214	? (TO) TT=1800.06	? (TO) TT=1800.01	No data	SAT TT=0.061 ASSIGNMENTS=1234 CHECKS=98205	SAT TT=0.506 ASSIGNMENTS=10783 CHECKS=972402	SAT TT=0.406	SAT TT=1.657 ASSIGNMENTS=22774 CHECKS=1672320	SAT TT=0.046 ASSIGNMENTS=593 CHECKS=56924	? (TO) TT=1802.16	No data	SAT TT=12.266	SAT TT=54.304
csp/primes-10/ normalized-primes-10-40-2-7.xml	SAT TT=33.443	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=115.815 CHECKS=5173190	SAT TT=763.048 CHECKS=34974900	SAT TT=319.275 ASSIGNMENTS=127110	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=40.446 ASSIGNMENTS=158147 CHECKS=72472100	SAT TT=38.867 ASSIGNMENTS=158147 CHECKS=72472100	? (TO) TT=1800.07	? (TO) TT=1800	No data	SAT TT=842.724 ASSIGNMENTS=3552770 CHECKS=1768760000	SAT TT=563.257 ASSIGNMENTS=2830140 CHECKS=1210090000	SAT TT=72.969	SAT TT=47.41 ASSIGNMENTS=131010 CHECKS=49656500	SAT TT=33.443 ASSIGNMENTS=158147 CHECKS=72472100	? TT=150.763	No data	? (MO) TT=114.562	? (MO) TT=301.34
csp/primes-10/ normalized-primes-10-40-3-1.xml	SAT TT=0.022	SAT TT=1.772 CHECKS=2005960 NODES=100	SAT TT=1.724 CHECKS=2005960 NODES=0	SAT TT=0.042	SAT TT=0.41 CHECKS=74382	SAT TT=0.212 CHECKS=85477	SAT TT=0.946 ASSIGNMENTS=33	SAT TT=0.969 ASSIGNMENTS=33	SAT TT=7.902 CHECKS=1673280 NODES=100	SAT TT=4.618 CHECKS=3454780 NODES=900005	SAT TT=3.523 CHECKS=1860540 NODES=3	SAT TT=0.033 ASSIGNMENTS=111 CHECKS=13839	SAT TT=0.03 ASSIGNMENTS=111 CHECKS=13839	SAT TT=10.82	SAT TT=10.457	No data	SAT TT=0.022 ASSIGNMENTS=115 CHECKS=13960	SAT TT=0.316 ASSIGNMENTS=5463 CHECKS=539215	SAT TT=0.419	SAT TT=1.096 ASSIGNMENTS=16216 CHECKS=1120890	SAT TT=0.022 ASSIGNMENTS=113 CHECKS=13851	? TT=153.017	No data	SAT TT=1.038	SAT TT=1.692
csp/primes-10/ normalized-primes-10-40-3-5.xml		? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	No data	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=1338.5	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=207.878	No data	? (MO) TT=78.56	? (MO) TT=287.83
csp/primes-10/ normalized-primes-10-60-2-7.xml	SAT TT=0.122	SAT TT=493.417 CHECKS=775250000 NODES=5699	SAT TT=57.725 CHECKS=103653000 NODES=1286	SAT TT=0.122	SAT TT=8.599 CHECKS=334066	SAT TT=5.472 CHECKS=221518	SAT TT=10.268 ASSIGNMENTS=2512	SAT TT=5.397 ASSIGNMENTS=30	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=130.59 ASSIGNMENTS=327787 CHECKS=259520000	SAT TT=128.256 ASSIGNMENTS=327787 CHECKS=259520000	? (TO) TT=1800	? (TO) TT=1800.09	No data	SAT TT=15.694 ASSIGNMENTS=40637 CHECKS=33102200	SAT TT=2.589 ASSIGNMENTS=8468 CHECKS=5383740	SAT TT=0.64	SAT TT=50.278 ASSIGNMENTS=74191 CHECKS=62653000	SAT TT=122.707 ASSIGNMENTS=327787 CHECKS=259520000	? TT=153.487	No data	? (MO) TT=88.81	? (MO) TT=296.502
csp/primes-10/ normalized-primes-10-60-3-5.xml	SAT TT=5.114	? (TO) TT=1800.08	? (TO) TT=1800.17	SAT TT=30.747	SAT TT=12.447 CHECKS=585172	SAT TT=5.114 CHECKS=236405	SAT TT=69.104 ASSIGNMENTS=19287	SAT TT=17.185 ASSIGNMENTS=2075	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=30.951 ASSIGNMENTS=60397 CHECKS=48981300	SAT TT=29.686 ASSIGNMENTS=60397 CHECKS=48981300	? (TO) TT=1800.04	? (TO) TT=1800.04	No data	SAT TT=130.737 ASSIGNMENTS=331988 CHECKS=269430000	SAT TT=70.003 ASSIGNMENTS=153078 CHECKS=144142000	SAT TT=1.378	SAT TT=371.266 ASSIGNMENTS=236201 CHECKS=231564000	SAT TT=23.846 ASSIGNMENTS=60397 CHECKS=48981300	? (MO) TT=91.924	No data	? (MO) TT=91.78	? (MO) TT=299.823
csp/primes-10/ normalized-primes-10-60-3-7.xml	SAT TT=39.879	? (TO) TT=1800.09	? (TO) TT=1800.18	SAT TT=39.879	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=1251.29	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=159.955	No data	? TT=177.151	? TT=176.403
csp/primes-10/ normalized-primes-10-80-2-3.xml	SAT TT=0.022	SAT TT=1.093 CHECKS=303008 NODES=100	SAT TT=1.076 CHECKS=302110 NODES=0	SAT TT=0.056	SAT TT=0.607 CHECKS=463	SAT TT=0.022 CHECKS=425	SAT TT=1.008 ASSIGNMENTS=4	SAT TT=1.02 ASSIGNMENTS=4	SAT TT=104.127 CHECKS=16003400 NODES=100	SAT TT=43.66 CHECKS=16010400 NODES=0	SAT TT=40.844 CHECKS=16010400 NODES=0	SAT TT=0.033 ASSIGNMENTS=11 CHECKS=3914	SAT TT=0.035 ASSIGNMENTS=11 CHECKS=3914	SAT TT=191.251	SAT TT=187.716	No data	SAT TT=0.023 ASSIGNMENTS=11 CHECKS=3912	SAT TT=0.024 ASSIGNMENTS=8 CHECKS=3784	SAT TT=0.592	SAT TT=0.022 ASSIGNMENTS=10 CHECKS=3892	SAT TT=0.022 ASSIGNMENTS=11 CHECKS=3914	? TT=839.813	No data	SAT TT=1.023	SAT TT=1.052
csp/primes-10/ normalized-primes-10-80-3-7.xml	SAT TT=0.16	SAT TT=86.406 CHECKS=147938000 NODES=1190	SAT TT=72.313 CHECKS=134964000 NODES=1240	SAT TT=0.16	SAT TT=11.46 CHECKS=411761	SAT TT=6.827 CHECKS=269248	SAT TT=6.842 ASSIGNMENTS=48	SAT TT=22.164 ASSIGNMENTS=664	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=32.59 ASSIGNMENTS=42572 CHECKS=58246100	SAT TT=32.78 ASSIGNMENTS=42572 CHECKS=58246100	? (TO) TT=1800.06	? (TO) TT=1800.01	No data	SAT TT=7.263 ASSIGNMENTS=7759 CHECKS=15188400	SAT TT=5.086 ASSIGNMENTS=6721 CHECKS=10624600	SAT TT=7.464	SAT TT=105.574 ASSIGNMENTS=97456 CHECKS=78422600	SAT TT=25.357 ASSIGNMENTS=42572 CHECKS=58246100	? TT=175.723	No data	? TT=179.94	? TT=172.781
csp/primes-15/ normalized-primes-15-20-2-1.xml	SAT TT=0.012	SAT TT=1.044 CHECKS=625877 NODES=100	SAT TT=0.999 CHECKS=625878 NODES=0	SAT TT=0.032	SAT TT=0.085 CHECKS=11512	SAT TT=0.191 CHECKS=727194	SAT TT=0.964 ASSIGNMENTS=70	SAT TT=0.965 ASSIGNMENTS=70	SAT TT=1.133 CHECKS=351005 NODES=100	SAT TT=0.829 CHECKS=359460 NODES=3	SAT TT=0.833 CHECKS=359593 NODES=4	SAT TT=0.024 ASSIGNMENTS=124 CHECKS=1139	SAT TT=0.024 ASSIGNMENTS=124 CHECKS=1139	SAT TT=3.971	SAT TT=3.808	No data	SAT TT=0.012 ASSIGNMENTS=131 CHECKS=1287	SAT TT=0.056 ASSIGNMENTS=9295 CHECKS=68768	SAT TT=0.35	SAT TT=0.122 ASSIGNMENTS=15713 CHECKS=116213	SAT TT=0.014 ASSIGNMENTS=124 CHECKS=1139	SAT TT=9.963	No data	SAT TT=0.664	SAT TT=0.689
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-15/ normalized-primes-15-20-2-3.xml	SAT TT=0.016	SAT TT=4.054 CHECKS=6875710 NODES=208	SAT TT=3.515 CHECKS=5466530 NODES=0	SAT TT=0.039	SAT TT=0.298 CHECKS=9399	SAT TT=0.405 CHECKS=415121	SAT TT=1.843 ASSIGNMENTS=68	SAT TT=2.076 ASSIGNMENTS=68	SAT TT=254.936 CHECKS=522581000 NODES=109	? (TO) TT=1800.04	? (MO) TT=32.08	SAT TT=0.026 ASSIGNMENTS=457 CHECKS=10020	SAT TT=0.031 ASSIGNMENTS=457 CHECKS=10020	SAT TT=672.909	SAT TT=669.211	No data	SAT TT=0.016 ASSIGNMENTS=484 CHECKS=10922	SAT TT=0.115 ASSIGNMENTS=9210 CHECKS=210742	SAT TT=0.386	SAT TT=0.189 ASSIGNMENTS=10828 CHECKS=292168	SAT TT=0.017 ASSIGNMENTS=459 CHECKS=15670	? TT=149.464	No data	SAT TT=5.382	SAT TT=19.036
csp/primes-15/ normalized-primes-15-20-2-5.xml	SAT TT=0.029	? (TO) TT=1800.08	? (TO) TT=1800.13	SAT TT=0.039	SAT TT=1.315 CHECKS=461347	SAT TT=1.048 CHECKS=455362	SAT TT=2.442 ASSIGNMENTS=68	SAT TT=3.189 ASSIGNMENTS=63	? (TO) TT=1800.1	? (MO) TT=37.01	? (TO) TT=1800.08	SAT TT=0.034 ASSIGNMENTS=395 CHECKS=27209	SAT TT=0.036 ASSIGNMENTS=395 CHECKS=27209	? (TO) TT=1800.01	? (TO) TT=1800.09	No data	SAT TT=0.031 ASSIGNMENTS=215 CHECKS=50660	SAT TT=0.179 ASSIGNMENTS=7414 CHECKS=370628	SAT TT=0.363	SAT TT=0.432 ASSIGNMENTS=17500 CHECKS=785998	SAT TT=0.029 ASSIGNMENTS=628 CHECKS=40274	? TT=484.085	No data	? (MO) TT=64.918	? (MO) TT=256.178
csp/primes-15/ normalized-primes-15-20-2-7.xml	SAT TT=0.016	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=0.045	SAT TT=0.471 CHECKS=2162	SAT TT=0.153 CHECKS=14846	SAT TT=3.504 ASSIGNMENTS=67	SAT TT=4.565 ASSIGNMENTS=403	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=0.026 ASSIGNMENTS=179 CHECKS=11240	SAT TT=0.027 ASSIGNMENTS=179 CHECKS=11240	? (TO) TT=1800.06	? (TO) TT=1800.02	No data	SAT TT=0.017 ASSIGNMENTS=177 CHECKS=11598	SAT TT=0.312 ASSIGNMENTS=8319 CHECKS=734406	SAT TT=0.397	SAT TT=0.396 ASSIGNMENTS=11581 CHECKS=946619	SAT TT=0.016 ASSIGNMENTS=185 CHECKS=9088	? TT=153.795	No data	? TT=172.008	? TT=177.897
csp/primes-15/ normalized-primes-15-20-3-3.xml	SAT TT=0.014	SAT TT=1058.63 CHECKS=2002010000 NODES=19894	SAT TT=1112.38 CHECKS=2082310000 NODES=19952	SAT TT=0.041	SAT TT=0.346 CHECKS=6410	SAT TT=0.052 CHECKS=13140	SAT TT=3.165 ASSIGNMENTS=1400	SAT TT=4.201 ASSIGNMENTS=153	? (MO) TT=40.81	? (MO) TT=39.08	? (TO) TT=1800.07	SAT TT=0.027 ASSIGNMENTS=226 CHECKS=8194	SAT TT=0.026 ASSIGNMENTS=226 CHECKS=8194	? (TO) TT=1800.08	? (TO) TT=1800.05	No data	SAT TT=0.016 ASSIGNMENTS=213 CHECKS=7952	SAT TT=0.19 ASSIGNMENTS=8621 CHECKS=388027	SAT TT=0.387	SAT TT=0.549 ASSIGNMENTS=13837 CHECKS=1105280	SAT TT=0.014 ASSIGNMENTS=226 CHECKS=8194	? (MO) TT=80.643	No data	SAT TT=11.798	SAT TT=50.674
csp/primes-15/ normalized-primes-15-20-3-5.xml	SAT TT=0.012	SAT TT=44.969 CHECKS=84104800 NODES=1029	SAT TT=17.091 CHECKS=29812400 NODES=332	SAT TT=0.039	SAT TT=0.499 CHECKS=5503	SAT TT=0.988 CHECKS=308849	SAT TT=3.076 ASSIGNMENTS=65	SAT TT=4.459 ASSIGNMENTS=418	? (MO) TT=31	? (MO) TT=31.21	? (TO) TT=1800.01	SAT TT=0.024 ASSIGNMENTS=209 CHECKS=5780	SAT TT=0.028 ASSIGNMENTS=209 CHECKS=5780	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	SAT TT=0.014 ASSIGNMENTS=212 CHECKS=5862	SAT TT=0.154 ASSIGNMENTS=8357 CHECKS=346753	SAT TT=0.433	SAT TT=0.222 ASSIGNMENTS=10238 CHECKS=392054	SAT TT=0.012 ASSIGNMENTS=228 CHECKS=6277	? TT=148.497	No data	? TT=171.401	? TT=163.689
csp/primes-15/ normalized-primes-15-40-2-1.xml	SAT TT=0.015	SAT TT=1.016 CHECKS=453007 NODES=100	SAT TT=1.033 CHECKS=453007 NODES=0	SAT TT=0.038	SAT TT=0.201 CHECKS=33733	SAT TT=0.071 CHECKS=183793	SAT TT=0.983 ASSIGNMENTS=40	SAT TT=1.186 ASSIGNMENTS=40	SAT TT=1.843 CHECKS=433837 NODES=100	SAT TT=1.244 CHECKS=438773 NODES=3	SAT TT=1.18 CHECKS=438782 NODES=2	SAT TT=0.026 ASSIGNMENTS=81 CHECKS=1797	SAT TT=0.027 ASSIGNMENTS=81 CHECKS=1797	SAT TT=4.941	SAT TT=5.016	No data	SAT TT=0.015 ASSIGNMENTS=81 CHECKS=1798	SAT TT=0.028 ASSIGNMENTS=1611 CHECKS=20491	SAT TT=0.387	SAT TT=0.042 ASSIGNMENTS=3392 CHECKS=27539	SAT TT=0.016 ASSIGNMENTS=82 CHECKS=1797	SAT TT=17.683	No data	SAT TT=0.722	SAT TT=0.739
csp/primes-15/ normalized-primes-15-40-2-7.xml	SAT TT=1443.63	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.01	? (MO) TT=36.87	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.05	No data	? (TO) TT=1800.04	SAT TT=1443.63 ASSIGNMENTS=11022500 CHECKS=3704260000	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=150.714	No data	? TT=168.574	? TT=170.652
csp/primes-15/ normalized-primes-15-40-3-1.xml	SAT TT=0.027	SAT TT=2.708 CHECKS=4512560 NODES=176	SAT TT=1.45 CHECKS=1283470 NODES=0	SAT TT=0.041	SAT TT=0.455 CHECKS=1963	SAT TT=0.126 CHECKS=139933	SAT TT=0.925 ASSIGNMENTS=32	SAT TT=0.928 ASSIGNMENTS=32	SAT TT=50.607 CHECKS=18566900 NODES=100	SAT TT=18.439 CHECKS=19420900 NODES=2250010	SAT TT=15.754 CHECKS=18777000 NODES=3	SAT TT=0.042 ASSIGNMENTS=735 CHECKS=30517	SAT TT=0.042 ASSIGNMENTS=735 CHECKS=30517	SAT TT=45.823	SAT TT=45.152	No data	SAT TT=0.027 ASSIGNMENTS=612 CHECKS=28673	SAT TT=0.171 ASSIGNMENTS=5469 CHECKS=330249	SAT TT=0.426	SAT TT=0.192 ASSIGNMENTS=14231 CHECKS=327165	SAT TT=0.028 ASSIGNMENTS=451 CHECKS=33181	? (MO) TT=70.332	No data	SAT TT=1	SAT TT=1.452
csp/primes-15/ normalized-primes-15-40-3-5.xml		? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.05	? (MO) TT=21.21	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.05	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (MO) TT=94.112	No data	? TT=164.007	? TT=160.96
csp/primes-15/ normalized-primes-15-40-3-7.xml		? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	No data	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.05	? TT=156.947	No data	? TT=171.199	? TT=171.363
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-15/ normalized-primes-15-60-2-7.xml	SAT TT=0.084	SAT TT=11.562 CHECKS=20201800 NODES=995	SAT TT=14.885 CHECKS=24754700 NODES=975	SAT TT=0.084	SAT TT=2.331 CHECKS=47350	SAT TT=2.153 CHECKS=82703	SAT TT=1.579 ASSIGNMENTS=4	SAT TT=1.602 ASSIGNMENTS=4	? (MO) TT=34.32	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.171 ASSIGNMENTS=2582 CHECKS=2852640	SAT TT=1.165 ASSIGNMENTS=2582 CHECKS=2852640	? (TO) TT=1800.01	? (TO) TT=1800.09	No data	SAT TT=9.156 ASSIGNMENTS=16738 CHECKS=23001700	SAT TT=38.774 ASSIGNMENTS=91439 CHECKS=97877200	SAT TT=0.595	SAT TT=3.579 ASSIGNMENTS=14758 CHECKS=8664370	SAT TT=1.442 ASSIGNMENTS=3648 CHECKS=3569320	? (MO) TT=70.793	No data	? TT=175.619	? TT=176.447
csp/primes-15/ normalized-primes-15-80-2-1.xml	SAT TT=0.02	SAT TT=0.977 CHECKS=153841 NODES=100	SAT TT=0.966 CHECKS=153841 NODES=0	SAT TT=0.047	SAT TT=0.371 CHECKS=584	SAT TT=0.02 CHECKS=541	SAT TT=1.027 ASSIGNMENTS=10	SAT TT=1.034 ASSIGNMENTS=10	SAT TT=2.76 CHECKS=122263 NODES=100	SAT TT=1.619 CHECKS=123343 NODES=0	SAT TT=1.621 CHECKS=123343 NODES=0	SAT TT=0.03 ASSIGNMENTS=42 CHECKS=1496	SAT TT=0.034 ASSIGNMENTS=42 CHECKS=1496	SAT TT=6.815	SAT TT=6.378	No data	SAT TT=0.022 ASSIGNMENTS=42 CHECKS=1496	SAT TT=0.027 ASSIGNMENTS=1052 CHECKS=10340	SAT TT=0.457	SAT TT=0.024 ASSIGNMENTS=970 CHECKS=2723	SAT TT=0.021 ASSIGNMENTS=42 CHECKS=1496	SAT TT=17.438	No data	SAT TT=0.812	SAT TT=0.821
csp/primes-15/ normalized-primes-15-80-2-3.xml	SAT TT=0.022	SAT TT=1.652 CHECKS=720329 NODES=100	SAT TT=1.586 CHECKS=737764 NODES=0	SAT TT=0.057	SAT TT=0.878 CHECKS=435	SAT TT=0.023 CHECKS=396	SAT TT=0.98 ASSIGNMENTS=4	SAT TT=0.975 ASSIGNMENTS=4	? (MO) TT=121.73	? (MO) TT=32.38	? (MO) TT=464.26	SAT TT=0.038 ASSIGNMENTS=4 CHECKS=3864	SAT TT=0.036 ASSIGNMENTS=4 CHECKS=3864	? (TO) TT=1800.08	? (TO) TT=1800.08	No data	SAT TT=0.026 ASSIGNMENTS=4 CHECKS=3864	SAT TT=0.024 ASSIGNMENTS=4 CHECKS=3863	SAT TT=0.516	SAT TT=0.025 ASSIGNMENTS=4 CHECKS=3864	SAT TT=0.022 ASSIGNMENTS=4 CHECKS=3864	? TT=426.146	No data	SAT TT=1.057	SAT TT=1.079
csp/primes-15/ normalized-primes-15-80-3-1.xml	SAT TT=0.025	SAT TT=1.299 CHECKS=872531 NODES=100	SAT TT=1.303 CHECKS=686150 NODES=0	SAT TT=0.057	SAT TT=0.974 CHECKS=5101	SAT TT=0.027 CHECKS=2726	SAT TT=1.023 ASSIGNMENTS=9	SAT TT=0.894 ASSIGNMENTS=9	SAT TT=84.377 CHECKS=8708400 NODES=100	SAT TT=24.955 CHECKS=9043240 NODES=0	SAT TT=24.737 CHECKS=9043240 NODES=0	SAT TT=0.034 ASSIGNMENTS=61 CHECKS=8807	SAT TT=0.036 ASSIGNMENTS=61 CHECKS=8807	SAT TT=96.082	SAT TT=93.246	No data	SAT TT=0.025 ASSIGNMENTS=58 CHECKS=8774	SAT TT=0.028 ASSIGNMENTS=1028 CHECKS=18497	SAT TT=0.538	SAT TT=0.029 ASSIGNMENTS=1303 CHECKS=10591	SAT TT=0.029 ASSIGNMENTS=61 CHECKS=8807	? (MO) TT=52.823	No data	SAT TT=1.038	SAT TT=1.244
csp/primes-15/ normalized-primes-15-80-3-5.xml	SAT TT=0.686	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=0.686	SAT TT=17.571 CHECKS=752519	SAT TT=11.804 CHECKS=603646	SAT TT=12.083 ASSIGNMENTS=207	SAT TT=21.58 ASSIGNMENTS=701	? (MO) TT=74.55	? (TO) TT=1800.09	? (MO) TT=342.04	SAT TT=92.115 ASSIGNMENTS=119813 CHECKS=227104000	SAT TT=100.176 ASSIGNMENTS=119813 CHECKS=227104000	? (TO) TT=1800.08	? (TO) TT=1800.08	No data	SAT TT=28.595 ASSIGNMENTS=42536 CHECKS=70575200	SAT TT=6.554 ASSIGNMENTS=8435 CHECKS=16202100	SAT TT=1.177	SAT TT=22.438 ASSIGNMENTS=41520 CHECKS=54005800	SAT TT=89.871 ASSIGNMENTS=119813 CHECKS=227104000	? (MO) TT=91.761	No data	? TT=173.009	? TT=167.993
csp/primes-20/ normalized-primes-20-20-2-3.xml	SAT TT=0.011	SAT TT=18.757 CHECKS=34619800 NODES=242	SAT TT=20.774 CHECKS=40845700 NODES=203	SAT TT=0.041	SAT TT=0.383 CHECKS=5637	SAT TT=1.385 CHECKS=705219	SAT TT=4.089 ASSIGNMENTS=71	SAT TT=4.032 ASSIGNMENTS=71	SAT TT=1027.31 CHECKS=4569250000 NODES=102	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.023 ASSIGNMENTS=215 CHECKS=5379	SAT TT=0.024 ASSIGNMENTS=215 CHECKS=5379	? (TO) TT=1800.03	? (TO) TT=1800.08	No data	SAT TT=0.013 ASSIGNMENTS=204 CHECKS=5269	SAT TT=0.141 ASSIGNMENTS=8448 CHECKS=344251	SAT TT=0.407	SAT TT=0.015 ASSIGNMENTS=514 CHECKS=6741	SAT TT=0.011 ASSIGNMENTS=215 CHECKS=5379	? TT=153.189	No data	SAT TT=9.602	SAT TT=44.141
csp/primes-20/ normalized-primes-20-20-2-7.xml	SAT TT=0.045	? (TO) TT=1800.18	? (TO) TT=1800.1	SAT TT=0.045	SAT TT=0.754 CHECKS=3566	SAT TT=0.123 CHECKS=6495	SAT TT=8.714 ASSIGNMENTS=1980	SAT TT=14.392 ASSIGNMENTS=2190	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.05 ASSIGNMENTS=378 CHECKS=69901	SAT TT=0.05 ASSIGNMENTS=378 CHECKS=69901	? (TO) TT=1800.07	? (TO) TT=1800.01	No data	SAT TT=0.047 ASSIGNMENTS=794 CHECKS=105620	SAT TT=0.326 ASSIGNMENTS=8992 CHECKS=869312	SAT TT=0.418	SAT TT=0.053 ASSIGNMENTS=1107 CHECKS=113350	SAT TT=0.057 ASSIGNMENTS=550 CHECKS=136267	? (MO) TT=78.201	No data	? TT=197.599	? TT=195.926
csp/primes-20/ normalized-primes-20-20-3-5.xml	SAT TT=0.016	SAT TT=444.546 CHECKS=659615000 NODES=2076	SAT TT=414.36 CHECKS=666945000 NODES=2088	SAT TT=0.047	SAT TT=0.587 CHECKS=3626	SAT TT=0.451 CHECKS=123394	SAT TT=6.927 ASSIGNMENTS=62	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.029 ASSIGNMENTS=322 CHECKS=15105	SAT TT=0.028 ASSIGNMENTS=322 CHECKS=15105	? (TO) TT=1800.02	? (TO) TT=1800.08	No data	SAT TT=0.016 ASSIGNMENTS=323 CHECKS=15398	SAT TT=0.219 ASSIGNMENTS=8387 CHECKS=553031	SAT TT=0.691	SAT TT=0.026 ASSIGNMENTS=730 CHECKS=39851	SAT TT=0.02 ASSIGNMENTS=635 CHECKS=30686	? (MO) TT=78.021	No data	? TT=225.07	? TT=219.979
csp/primes-20/ normalized-primes-20-40-2-3.xml	SAT TT=0.084	SAT TT=5.56 CHECKS=9644510 NODES=267	SAT TT=5.59 CHECKS=10123300 NODES=194	SAT TT=0.084	SAT TT=4.767 CHECKS=426225	SAT TT=1.857 CHECKS=192701	SAT TT=5.355 ASSIGNMENTS=240	SAT TT=5.822 ASSIGNMENTS=240	SAT TT=552.96 CHECKS=1956630000 NODES=102	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.416 ASSIGNMENTS=11794 CHECKS=1084850	SAT TT=0.419 ASSIGNMENTS=11794 CHECKS=1084850	? (TO) TT=1800.02	? (TO) TT=1800.03	No data	SAT TT=1.391 ASSIGNMENTS=32239 CHECKS=3634010	SAT TT=0.288 ASSIGNMENTS=8340 CHECKS=783517	SAT TT=0.419	SAT TT=0.308 ASSIGNMENTS=5407 CHECKS=804030	SAT TT=0.4 ASSIGNMENTS=7466 CHECKS=1035040	? TT=479.395	No data	SAT TT=11.651	SAT TT=40.428
csp/primes-20/ normalized-primes-20-40-3-7.xml		? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	No data	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (MO) TT=99.079	No data	? TT=180.653	? TT=178.447
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-20/ normalized-primes-20-60-2-1.xml	SAT TT=0.014	SAT TT=1.179 CHECKS=760011 NODES=100	SAT TT=1.253 CHECKS=760010 NODES=0	SAT TT=0.044	SAT TT=0.474 CHECKS=12045	SAT TT=0.045 CHECKS=76054	SAT TT=1.276 ASSIGNMENTS=22	SAT TT=1.205 ASSIGNMENTS=22	SAT TT=6.557 CHECKS=569187 NODES=100	SAT TT=2.81 CHECKS=574695 NODES=2	SAT TT=3.147 CHECKS=574688 NODES=0	SAT TT=0.028 ASSIGNMENTS=86 CHECKS=4665	SAT TT=0.024 ASSIGNMENTS=86 CHECKS=4665	SAT TT=10.585	SAT TT=11.087	No data	SAT TT=0.017 ASSIGNMENTS=86 CHECKS=4665	SAT TT=0.041 ASSIGNMENTS=2704 CHECKS=64570	SAT TT=0.414	SAT TT=0.017 ASSIGNMENTS=177 CHECKS=4847	SAT TT=0.014 ASSIGNMENTS=85 CHECKS=4594	SAT TT=37.177	No data	SAT TT=0.819	SAT TT=0.85
csp/primes-20/ normalized-primes-20-60-2-3.xml	SAT TT=0.026	SAT TT=2.444 CHECKS=3620830 NODES=100	SAT TT=2.196 CHECKS=3494320 NODES=0	SAT TT=0.046	SAT TT=1.289 CHECKS=21236	SAT TT=0.037 CHECKS=17025	SAT TT=1.265 ASSIGNMENTS=12	SAT TT=1.194 ASSIGNMENTS=12	SAT TT=387.381 CHECKS=1121670000 NODES=100	SAT TT=307.261 CHECKS=1121670000 NODES=0	SAT TT=305.714 CHECKS=1121670000 NODES=2	SAT TT=0.037 ASSIGNMENTS=150 CHECKS=26468	SAT TT=0.035 ASSIGNMENTS=150 CHECKS=26468	? (TO) TT=1800	? (TO) TT=1800.01	No data	SAT TT=0.026 ASSIGNMENTS=143 CHECKS=24672	SAT TT=0.371 ASSIGNMENTS=4099 CHECKS=918767	SAT TT=0.485	SAT TT=0.031 ASSIGNMENTS=191 CHECKS=37531	SAT TT=0.026 ASSIGNMENTS=150 CHECKS=26464	? TT=225.439	No data	SAT TT=1.088	SAT TT=1.133
csp/primes-20/ normalized-primes-20-60-3-3.xml	SAT TT=0.065	SAT TT=49.886 CHECKS=103204000 NODES=509	SAT TT=54.667 CHECKS=114149000 NODES=433	SAT TT=0.065	SAT TT=10.812 CHECKS=661914	SAT TT=3.993 CHECKS=248777	SAT TT=11.817 ASSIGNMENTS=145	SAT TT=40.515 ASSIGNMENTS=15261	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=0.546 ASSIGNMENTS=2670 CHECKS=1358080	SAT TT=0.538 ASSIGNMENTS=2670 CHECKS=1358080	? (TO) TT=1800.09	? (TO) TT=1800.04	No data	SAT TT=94.669 ASSIGNMENTS=332305 CHECKS=269388000	SAT TT=1.683 ASSIGNMENTS=7315 CHECKS=4726500	SAT TT=0.712	SAT TT=1.03 ASSIGNMENTS=2640 CHECKS=2851710	SAT TT=0.841 ASSIGNMENTS=3791 CHECKS=2212590	? (MO) TT=119.9	No data	? (MO) TT=63.141	? (MO) TT=258.92
csp/primes-20/ normalized-primes-20-60-3-5.xml		? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	No data	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=913.24	? (TO) TT=1800.08	? (TO) TT=1800.04	? (MO) TT=63.267	No data	? TT=178.063	? TT=177.981
csp/primes-20/ normalized-primes-20-60-3-7.xml		? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.22	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	No data	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (MO) TT=92.647	No data	? TT=197.788	? TT=199.588
csp/primes-20/ normalized-primes-20-80-2-1.xml	SAT TT=0.018	SAT TT=1.296 CHECKS=761651 NODES=100	SAT TT=1.223 CHECKS=761650 NODES=0	SAT TT=0.045	SAT TT=0.596 CHECKS=502	SAT TT=0.02 CHECKS=4832	SAT TT=1.157 ASSIGNMENTS=11	SAT TT=1.245 ASSIGNMENTS=11	SAT TT=7.532 CHECKS=564964 NODES=100	SAT TT=3.45 CHECKS=570531 NODES=1	SAT TT=3.427 CHECKS=570616 NODES=1	SAT TT=0.025 ASSIGNMENTS=17 CHECKS=3945	SAT TT=0.03 ASSIGNMENTS=17 CHECKS=3945	SAT TT=13.099	SAT TT=11.827	No data	SAT TT=0.019 ASSIGNMENTS=17 CHECKS=3945	SAT TT=0.019 ASSIGNMENTS=22 CHECKS=4023	SAT TT=0.447	SAT TT=0.02 ASSIGNMENTS=17 CHECKS=3907	SAT TT=0.018 ASSIGNMENTS=17 CHECKS=3945	SAT TT=38.958	No data	SAT TT=0.903	SAT TT=0.899
csp/primes-20/ normalized-primes-20-80-2-7.xml	SAT TT=0.061	SAT TT=2.608 CHECKS=2280940 NODES=102	? (MO) TT=1.094	SAT TT=0.064	SAT TT=2.616 CHECKS=1993	SAT TT=0.061 CHECKS=1974	SAT TT=1.065 ASSIGNMENTS=1	SAT TT=1.059 ASSIGNMENTS=1	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=0.14 ASSIGNMENTS=86 CHECKS=291675	SAT TT=0.132 ASSIGNMENTS=86 CHECKS=291675	? (TO) TT=1800.08	? (TO) TT=1800.08	No data	SAT TT=0.121 ASSIGNMENTS=87 CHECKS=290766	SAT TT=2.476 ASSIGNMENTS=4052 CHECKS=7132430	SAT TT=0.566	SAT TT=0.091 ASSIGNMENTS=94 CHECKS=203043	SAT TT=0.121 ASSIGNMENTS=86 CHECKS=291675	? TT=338.589	No data	SAT TT=1.233	SAT TT=1.303
csp/primes-20/ normalized-primes-20-80-3-1.xml	SAT TT=0.026	SAT TT=2.083 CHECKS=2648340 NODES=100	SAT TT=1.626 CHECKS=2002620 NODES=0	SAT TT=0.056	SAT TT=1.189 CHECKS=9015	SAT TT=0.035 CHECKS=9128	SAT TT=1.124 ASSIGNMENTS=10	SAT TT=0.967 ASSIGNMENTS=10	SAT TT=139.976 CHECKS=78008800 NODES=100	SAT TT=136.031 CHECKS=90420600 NODES=1	SAT TT=133.582 CHECKS=90420700 NODES=1	SAT TT=0.039 ASSIGNMENTS=41 CHECKS=19826	SAT TT=0.036 ASSIGNMENTS=41 CHECKS=19826	SAT TT=459.678	SAT TT=448.309	No data	SAT TT=0.028 ASSIGNMENTS=41 CHECKS=19821	SAT TT=0.162 ASSIGNMENTS=1055 CHECKS=350031	SAT TT=0.534	SAT TT=0.036 ASSIGNMENTS=109 CHECKS=37635	SAT TT=0.026 ASSIGNMENTS=41 CHECKS=19826	? TT=154.84	No data	SAT TT=1.145	SAT TT=1.267
csp/primes-20/ normalized-primes-20-80-3-5.xml	SAT TT=91.117	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=114.798	SAT TT=1580.7 CHECKS=81040900	SAT TT=1534.1 CHECKS=74172400	SAT TT=330.626 ASSIGNMENTS=15523	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=179.823 ASSIGNMENTS=186794 CHECKS=502918000	SAT TT=189.874 ASSIGNMENTS=186794 CHECKS=502918000	? (TO) TT=1800.08	? (TO) TT=1800.07	No data	? (TO) TT=1800.07	SAT TT=91.117 ASSIGNMENTS=104594 CHECKS=272473000	SAT TT=203.622	SAT TT=276.054 ASSIGNMENTS=178349 CHECKS=814585000	SAT TT=183.603 ASSIGNMENTS=186794 CHECKS=502918000	? TT=224.842	No data	? TT=298.295	? TT=298.739
csp/primes-20/ normalized-primes-20-80-3-7.xml	SAT TT=11.866	SAT TT=923.091 CHECKS=1739830000 NODES=11857	SAT TT=911.841 CHECKS=1692960000 NODES=11937	SAT TT=14.554	SAT TT=11.866 CHECKS=332766	SAT TT=13.841 CHECKS=535867	SAT TT=10.107 ASSIGNMENTS=1	SAT TT=16.097 ASSIGNMENTS=1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=82.161 ASSIGNMENTS=93844 CHECKS=212771000	SAT TT=82.772 ASSIGNMENTS=93844 CHECKS=212771000	? (TO) TT=1800.09	? (TO) TT=1800.02	No data	? (TO) TT=1800.04	SAT TT=80.136 ASSIGNMENTS=85219 CHECKS=222324000	SAT TT=1.156	? (TO) TT=1800.02	SAT TT=76.13 ASSIGNMENTS=93844 CHECKS=212771000	? (MO) TT=108.635	No data	? TT=195.215	? TT=185.447
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-25/ normalized-primes-25-20-2-7.xml	SAT TT=0.017	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=0.046	SAT TT=0.705 CHECKS=2746	SAT TT=4.022 CHECKS=412244	SAT TT=12.93 ASSIGNMENTS=65	SAT TT=33.737 ASSIGNMENTS=18751	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=0.028 ASSIGNMENTS=419 CHECKS=16634	SAT TT=0.031 ASSIGNMENTS=419 CHECKS=16634	? (TO) TT=1800.08	? (TO) TT=1800	No data	SAT TT=0.017 ASSIGNMENTS=294 CHECKS=14856	SAT TT=0.348 ASSIGNMENTS=9223 CHECKS=1043960	SAT TT=0.4	SAT TT=0.028 ASSIGNMENTS=799 CHECKS=39635	SAT TT=0.018 ASSIGNMENTS=343 CHECKS=15285	? (MO) TT=64.084	No data	? TT=180.352	? TT=172.936
csp/primes-25/ normalized-primes-25-20-3-1.xml	SAT TT=0.028	SAT TT=38.741 CHECKS=90727300 NODES=217	SAT TT=43.712 CHECKS=103087000 NODES=0	SAT TT=0.036	SAT TT=0.471 CHECKS=11533	SAT TT=3.552 CHECKS=1575720	SAT TT=18.081 ASSIGNMENTS=586	SAT TT=15.635 ASSIGNMENTS=586	SAT TT=256.803 CHECKS=977269000 NODES=100	SAT TT=213.361 CHECKS=986536000 NODES=300000	SAT TT=205.985 CHECKS=1013240000 NODES=1333	SAT TT=0.041 ASSIGNMENTS=329 CHECKS=61249	SAT TT=0.042 ASSIGNMENTS=329 CHECKS=61249	SAT TT=425.732	SAT TT=440.835	No data	SAT TT=0.03 ASSIGNMENTS=322 CHECKS=64288	SAT TT=0.204 ASSIGNMENTS=8076 CHECKS=538835	SAT TT=0.394	SAT TT=0.028 ASSIGNMENTS=669 CHECKS=49310	SAT TT=0.028 ASSIGNMENTS=329 CHECKS=61249	? (MO) TT=113.729	No data	SAT TT=5.2	SAT TT=13.14
csp/primes-25/ normalized-primes-25-20-3-3.xml	SAT TT=0.013	SAT TT=10.806 CHECKS=19666500 NODES=106	SAT TT=47.058 CHECKS=93495400 NODES=189	SAT TT=0.04	SAT TT=0.497 CHECKS=6005	SAT TT=0.047 CHECKS=6574	SAT TT=9.245 ASSIGNMENTS=67	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.03 ASSIGNMENTS=876 CHECKS=21278	SAT TT=0.03 ASSIGNMENTS=876 CHECKS=21278	? (TO) TT=1800.04	? (TO) TT=1800.05	No data	SAT TT=0.02 ASSIGNMENTS=846 CHECKS=20959	SAT TT=0.172 ASSIGNMENTS=8617 CHECKS=431837	SAT TT=0.42	SAT TT=0.023 ASSIGNMENTS=838 CHECKS=25826	SAT TT=0.013 ASSIGNMENTS=272 CHECKS=7649	? (MO) TT=88.536	No data	? (MO) TT=72.5	? (MO) TT=271.997
csp/primes-25/ normalized-primes-25-20-3-7.xml	SAT TT=0.031	? (TO) TT=1800.15	? (TO) TT=1800.11	SAT TT=0.051	SAT TT=1.375 CHECKS=25469	SAT TT=2.237 CHECKS=276702	SAT TT=14.599 ASSIGNMENTS=727	SAT TT=21.018 ASSIGNMENTS=407	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=0.043 ASSIGNMENTS=906 CHECKS=54594	SAT TT=0.046 ASSIGNMENTS=906 CHECKS=54594	? (TO) TT=1800.02	? (TO) TT=1800.02	No data	SAT TT=0.031 ASSIGNMENTS=901 CHECKS=55084	SAT TT=0.495 ASSIGNMENTS=12073 CHECKS=1393870	SAT TT=0.427	SAT TT=0.202 ASSIGNMENTS=1931 CHECKS=557057	SAT TT=0.057 ASSIGNMENTS=1018 CHECKS=134418	? TT=481.549	No data	? TT=180.924	? TT=176.414
csp/primes-25/ normalized-primes-25-40-2-7.xml	SAT TT=15.341	? (TO) TT=1800.15	? (TO) TT=1800.13	SAT TT=31.287	? (TO) TT=1800.02	SAT TT=124.228 CHECKS=5432470	SAT TT=733.489 ASSIGNMENTS=78199	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=23.12 ASSIGNMENTS=105150 CHECKS=45655600	SAT TT=22.893 ASSIGNMENTS=105150 CHECKS=45655600	? (TO) TT=1800.04	? (TO) TT=1800.06	No data	SAT TT=21.808 ASSIGNMENTS=161853 CHECKS=64860500	? (TO) TT=1800.07	SAT TT=77.737	SAT TT=279.999 ASSIGNMENTS=1235820 CHECKS=870201000	SAT TT=15.341 ASSIGNMENTS=105150 CHECKS=45655600	? (MO) TT=129.777	No data	? TT=195.327	? TT=200.303
csp/primes-25/ normalized-primes-25-40-3-3.xml	SAT TT=719.109	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=730.806 CHECKS=54069600	? (TO) TT=1800.09	SAT TT=719.109 ASSIGNMENTS=147256	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.08	No data	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=576.847	? (TO) TT=1800.09	? (TO) TT=1800.08	? (MO) TT=65.73	No data	? (MO) TT=92.61	? (MO) TT=269.473
csp/primes-25/ normalized-primes-25-40-3-5.xml		? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800	No data	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=525.342	No data	? TT=177.195	? TT=186.267
csp/primes-25/ normalized-primes-25-40-3-7.xml		? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.09	No data	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	? (MO) TT=93.638	No data	? TT=195.065	? TT=193.933
csp/primes-25/ normalized-primes-25-60-2-3.xml	SAT TT=0.028	SAT TT=4.821 CHECKS=9112160 NODES=100	SAT TT=4.278 CHECKS=8330110 NODES=0	SAT TT=0.051	SAT TT=1.251 CHECKS=21336	SAT TT=0.05 CHECKS=24184	SAT TT=1.542 ASSIGNMENTS=14	SAT TT=1.397 ASSIGNMENTS=14	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.043 ASSIGNMENTS=158 CHECKS=39732	SAT TT=0.044 ASSIGNMENTS=158 CHECKS=39732	? (TO) TT=1800.06	? (TO) TT=1800.07	No data	SAT TT=0.034 ASSIGNMENTS=158 CHECKS=39751	SAT TT=0.555 ASSIGNMENTS=4545 CHECKS=1495110	SAT TT=0.469	SAT TT=0.028 ASSIGNMENTS=161 CHECKS=34862	SAT TT=0.033 ASSIGNMENTS=148 CHECKS=39262	? TT=706.195	No data	SAT TT=1.177	SAT TT=1.966
csp/primes-25/ normalized-primes-25-60-2-7.xml	SAT TT=2.076	SAT TT=254.464 CHECKS=461773000 NODES=1874	SAT TT=267.483 CHECKS=457298000 NODES=1907	? (TO) TT=1800.03	SAT TT=18.173 CHECKS=644936	SAT TT=7.699 CHECKS=328053	SAT TT=26.452 ASSIGNMENTS=196	SAT TT=100.449 ASSIGNMENTS=4955	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=9.799 ASSIGNMENTS=9957 CHECKS=5897070	SAT TT=9.186 ASSIGNMENTS=9957 CHECKS=5897070	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	SAT TT=628.385 ASSIGNMENTS=1947700 CHECKS=1808710000	SAT TT=92.648 ASSIGNMENTS=346297 CHECKS=266206000	SAT TT=0.785	? (TO) TT=1800.11	SAT TT=2.076 ASSIGNMENTS=9957 CHECKS=5897070	? TT=163.571	No data	? TT=225.154	? TT=220.838
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-25/ normalized-primes-25-60-3-3.xml	SAT TT=0.243	SAT TT=34.036 CHECKS=71149200 NODES=245	SAT TT=181.798 CHECKS=387635000 NODES=1019	SAT TT=0.243	SAT TT=23.351 CHECKS=1428150	SAT TT=52.088 CHECKS=3235850	SAT TT=17.806 ASSIGNMENTS=11	SAT TT=64.297 ASSIGNMENTS=1435	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=828.83 ASSIGNMENTS=1862700 CHECKS=2181150000	SAT TT=781.47 ASSIGNMENTS=1862700 CHECKS=2181150000	? (TO) TT=1800.05	? (TO) TT=1800.05	No data	SAT TT=47.216 ASSIGNMENTS=136977 CHECKS=126786000	SAT TT=43.753 ASSIGNMENTS=84714 CHECKS=117293000	SAT TT=0.628	SAT TT=244.959 ASSIGNMENTS=510823 CHECKS=705319000	SAT TT=756.398 ASSIGNMENTS=1862700 CHECKS=2181150000	? TT=114.406	No data	? (MO) TT=143.56	? (MO) TT=320.08
csp/primes-25/ normalized-primes-25-80-2-5.xml	SAT TT=0.055	SAT TT=3.926 CHECKS=6177420 NODES=108	SAT TT=3.323 CHECKS=5864340 NODES=0	SAT TT=0.064	SAT TT=1.874 CHECKS=1992	SAT TT=0.056 CHECKS=1971	SAT TT=1.166 ASSIGNMENTS=3	SAT TT=1.251 ASSIGNMENTS=3	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.069 ASSIGNMENTS=30 CHECKS=90524	SAT TT=0.071 ASSIGNMENTS=30 CHECKS=90524	? (TO) TT=1800.07	? (TO) TT=1800.08	No data	SAT TT=0.058 ASSIGNMENTS=26 CHECKS=90497	SAT TT=1.351 ASSIGNMENTS=3821 CHECKS=3588220	SAT TT=0.677	SAT TT=0.056 ASSIGNMENTS=45 CHECKS=90257	SAT TT=0.055 ASSIGNMENTS=26 CHECKS=90498	? TT=394.8	No data	SAT TT=1.294	SAT TT=1.155
csp/primes-25/ normalized-primes-25-80-3-1.xml	SAT TT=0.029	SAT TT=3.633 CHECKS=6661920 NODES=100	SAT TT=2.976 CHECKS=5340230 NODES=0	SAT TT=0.057	SAT TT=1.663 CHECKS=14399	SAT TT=0.038 CHECKS=14614	SAT TT=1.541 ASSIGNMENTS=10	SAT TT=1.352 ASSIGNMENTS=10	SAT TT=134.991 CHECKS=342219000 NODES=100	SAT TT=75.785 CHECKS=342220000 NODES=0	SAT TT=81.917 CHECKS=342220000 NODES=0	SAT TT=0.04 ASSIGNMENTS=37 CHECKS=26636	SAT TT=0.044 ASSIGNMENTS=37 CHECKS=26636	SAT TT=1428.05	SAT TT=1470.51	No data	SAT TT=0.032 ASSIGNMENTS=40 CHECKS=27958	SAT TT=0.202 ASSIGNMENTS=673 CHECKS=465261	SAT TT=0.473	SAT TT=0.033 ASSIGNMENTS=72 CHECKS=32763	SAT TT=0.029 ASSIGNMENTS=39 CHECKS=33024	? TT=157.489	No data	SAT TT=1.426	SAT TT=1.637
csp/primes-25/ normalized-primes-25-80-3-3.xml	SAT TT=0.067	SAT TT=7.36 CHECKS=13996200 NODES=154	SAT TT=5.658 CHECKS=10623600 NODES=0	SAT TT=0.067	SAT TT=3.213 CHECKS=70665	SAT TT=5.024 CHECKS=306000	SAT TT=1.338 ASSIGNMENTS=2	SAT TT=1.385 ASSIGNMENTS=2	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1.327 ASSIGNMENTS=1118 CHECKS=3451170	SAT TT=1.339 ASSIGNMENTS=1118 CHECKS=3451170	? (TO) TT=1800.08	? (TO) TT=1800.05	No data	SAT TT=2.186 ASSIGNMENTS=1812 CHECKS=5750010	SAT TT=4.875 ASSIGNMENTS=5756 CHECKS=13654300	SAT TT=0.734	SAT TT=10.66 ASSIGNMENTS=8665 CHECKS=28272700	SAT TT=5.254 ASSIGNMENTS=4382 CHECKS=14034300	? TT=161.145	No data	? (MO) TT=171.286	? (MO) TT=351.191
csp/primes-25/ normalized-primes-25-80-3-7.xml	SAT TT=91.769	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.09	SAT TT=1335.59 CHECKS=51343900	SAT TT=296.364 CHECKS=12402700	SAT TT=1533.37 ASSIGNMENTS=63225	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=98.829 ASSIGNMENTS=113994 CHECKS=260918000	SAT TT=100.388 ASSIGNMENTS=113994 CHECKS=260918000	? (TO) TT=1800.02	? (TO) TT=1800.08	No data	? (TO) TT=1800.08	SAT TT=479.61 ASSIGNMENTS=439638 CHECKS=1362960000	SAT TT=59.217	SAT TT=753.497 ASSIGNMENTS=351681 CHECKS=2116260000	SAT TT=91.769 ASSIGNMENTS=113994 CHECKS=260918000	? TT=158.871	No data	? TT=212.879	? TT=203.831
csp/primes-30/ normalized-primes-30-20-3-1.xml	SAT TT=0.025	SAT TT=47.135 CHECKS=113997000 NODES=174	SAT TT=113.839 CHECKS=259686000 NODES=140	SAT TT=0.036	SAT TT=4.256 CHECKS=1660860	SAT TT=3.385 CHECKS=1666710	SAT TT=9.961 ASSIGNMENTS=68	SAT TT=9.715 ASSIGNMENTS=68	? (MO) TT=9.97	? (MO) TT=10.18	? (MO) TT=9.84	SAT TT=0.083 ASSIGNMENTS=1900 CHECKS=153548	SAT TT=0.082 ASSIGNMENTS=1900 CHECKS=153548	SAT TT=787.185	SAT TT=812.25	No data	SAT TT=0.065 ASSIGNMENTS=1811 CHECKS=153177	SAT TT=0.308 ASSIGNMENTS=11023 CHECKS=809734	SAT TT=0.363	SAT TT=0.025 ASSIGNMENTS=911 CHECKS=31326	SAT TT=0.036 ASSIGNMENTS=939 CHECKS=70608	? TT=490.312	No data	SAT TT=11.012	SAT TT=17.049
csp/primes-30/ normalized-primes-30-20-3-7.xml	SAT TT=0.022	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=0.039	SAT TT=0.876 CHECKS=4683	SAT TT=0.066 CHECKS=4136	SAT TT=19.635 ASSIGNMENTS=73	? (TO) TT=1800.11	? (MO) TT=9.95	? (MO) TT=10.57	? (MO) TT=9.89	SAT TT=0.033 ASSIGNMENTS=531 CHECKS=28064	SAT TT=0.035 ASSIGNMENTS=531 CHECKS=28064	? (TO) TT=1800.04	? (TO) TT=1800.06	No data	SAT TT=0.022 ASSIGNMENTS=471 CHECKS=28416	SAT TT=0.343 ASSIGNMENTS=8764 CHECKS=944038	SAT TT=0.492	SAT TT=0.032 ASSIGNMENTS=817 CHECKS=52814	SAT TT=0.106 ASSIGNMENTS=1403 CHECKS=267573	? TT=494.361	No data	? TT=597.999	? TT=604.958
csp/primes-30/ normalized-primes-30-40-2-1.xml	SAT TT=0.012	SAT TT=4.397 CHECKS=9115200 NODES=100	SAT TT=4.287 CHECKS=9115200 NODES=0	SAT TT=0.04	SAT TT=0.962 CHECKS=560371	SAT TT=0.573 CHECKS=698240	SAT TT=2.687 ASSIGNMENTS=43	SAT TT=2.408 ASSIGNMENTS=43	SAT TT=15.733 CHECKS=7700660 NODES=100	SAT TT=7.191 CHECKS=9387260 NODES=450006	SAT TT=8.758 CHECKS=15522500 NODES=2134	SAT TT=0.027 ASSIGNMENTS=211 CHECKS=8042	SAT TT=0.03 ASSIGNMENTS=211 CHECKS=8042	SAT TT=21.474	SAT TT=21.674	No data	SAT TT=0.012 ASSIGNMENTS=211 CHECKS=8042	SAT TT=0.203 ASSIGNMENTS=5920 CHECKS=473585	SAT TT=0.415	SAT TT=0.018 ASSIGNMENTS=375 CHECKS=14317	SAT TT=0.016 ASSIGNMENTS=211 CHECKS=8042	? TT=191.76	No data	SAT TT=0.866	SAT TT=0.869
csp/primes-30/ normalized-primes-30-40-2-3.xml	SAT TT=3.577	SAT TT=202.689 CHECKS=414973000 NODES=959	SAT TT=246.418 CHECKS=459683000 NODES=1081	SAT TT=3.577	SAT TT=6.879 CHECKS=734556	SAT TT=5.988 CHECKS=582954	SAT TT=14.467 ASSIGNMENTS=1004	SAT TT=13.722 ASSIGNMENTS=1004	? (MO) TT=11.92	? (MO) TT=11.04	? (MO) TT=11.12	SAT TT=20.566 ASSIGNMENTS=1004	SAT TT=193.103 ASSIGNMENTS=4408550 CHECKS=503231000	? (TO) TT=1800.06	? (TO) TT=1800.05	No data	SAT TT=318.843 ASSIGNMENTS=4247820 CHECKS=887005000	? (TO) TT=1800.03	SAT TT=0.525	SAT TT=150.733 ASSIGNMENTS=1829170 CHECKS=423568000	SAT TT=196.395 ASSIGNMENTS=4408550 CHECKS=503231000	? TT=145.686	No data	SAT TT=79.302	SAT TT=130.539
csp/primes-30/ normalized-primes-30-40-2-7.xml	SAT TT=278.366	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.12	? (MO) TT=11.28	? (MO) TT=12.34	? (MO) TT=10.72	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	SAT TT=826.853 ASSIGNMENTS=3664510 CHECKS=2633670000	SAT TT=278.366 ASSIGNMENTS=1622720 CHECKS=814133000	SAT TT=0.737	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=119.286	No data	? TT=231.169	? TT=227.328
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-30/ normalized-primes-30-40-3-3.xml	SAT TT=14.829	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=14.829	SAT TT=1320.8 CHECKS=88454600	SAT TT=499.978 CHECKS=35546100	? (TO) TT=1800.05	? (TO) TT=1800.1	? (MO) TT=11.17	? (MO) TT=11.36	? (MO) TT=11.37	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.08	No data	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=455.36	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=151.055	No data	? TT=186.026	? TT=184.394
csp/primes-30/ normalized-primes-30-60-2-1.xml	SAT TT=0.017	SAT TT=2.388 CHECKS=3410680 NODES=100	SAT TT=2.18 CHECKS=3410680 NODES=0	SAT TT=0.045	SAT TT=0.96 CHECKS=148016	SAT TT=0.069 CHECKS=149471	SAT TT=1.268 ASSIGNMENTS=23	SAT TT=1.343 ASSIGNMENTS=23	SAT TT=19.504 CHECKS=1160180 NODES=100	SAT TT=7.236 CHECKS=1519750 NODES=2	SAT TT=6.662 CHECKS=1519740 NODES=0	SAT TT=0.029 ASSIGNMENTS=168 CHECKS=7976	SAT TT=0.03 ASSIGNMENTS=168 CHECKS=7976	SAT TT=28.208	SAT TT=26.388	No data	SAT TT=0.017 ASSIGNMENTS=168 CHECKS=7976	SAT TT=0.107 ASSIGNMENTS=5200 CHECKS=237600	SAT TT=0.453	SAT TT=0.021 ASSIGNMENTS=344 CHECKS=12337	SAT TT=0.017 ASSIGNMENTS=168 CHECKS=7976	? TT=223.307	No data	SAT TT=0.796	SAT TT=0.832
csp/primes-30/ normalized-primes-30-60-2-3.xml	SAT TT=0.047	SAT TT=7.174 CHECKS=16707800 NODES=101	SAT TT=7.092 CHECKS=16829200 NODES=0	SAT TT=0.047	SAT TT=1.129 CHECKS=16326	SAT TT=0.068 CHECKS=27833	SAT TT=0.983 ASSIGNMENTS=12	SAT TT=1.018 ASSIGNMENTS=12	? (MO) TT=11.27	? (MO) TT=10.35	? (MO) TT=11.45	SAT TT=0.081 ASSIGNMENTS=392 CHECKS=137203	SAT TT=0.08 ASSIGNMENTS=392 CHECKS=137203	? (TO) TT=1800	? (TO) TT=1800.07	No data	SAT TT=0.066 ASSIGNMENTS=390 CHECKS=134809	SAT TT=0.665 ASSIGNMENTS=5733 CHECKS=1674010	SAT TT=0.468	SAT TT=1.312 ASSIGNMENTS=5821 CHECKS=3368750	SAT TT=0.126 ASSIGNMENTS=795 CHECKS=295726	? TT=149.46	No data	SAT TT=1.184	SAT TT=1.206
csp/primes-30/ normalized-primes-30-60-2-7.xml	SAT TT=12.407	? (MO) TT=1.136	SAT TT=1276.81 CHECKS=2150260000 NODES=4940	SAT TT=28.74	SAT TT=28.121 CHECKS=1014520	SAT TT=18.638 CHECKS=738581	SAT TT=169.177 ASSIGNMENTS=10212	SAT TT=45.688 ASSIGNMENTS=1056	? (MO) TT=10.58	? (MO) TT=12.16	? (MO) TT=10.79	SAT TT=26.014 ASSIGNMENTS=94393 CHECKS=50945200	SAT TT=25.495 ASSIGNMENTS=94393 CHECKS=50945200	? (TO) TT=1800.06	? (TO) TT=1800.02	No data	SAT TT=23.148 ASSIGNMENTS=135976 CHECKS=67530700	SAT TT=79.519 ASSIGNMENTS=193114 CHECKS=245997000	SAT TT=0.851	SAT TT=12.407 ASSIGNMENTS=39059 CHECKS=34725600	SAT TT=16.224 ASSIGNMENTS=94393 CHECKS=50945200	? (MO) TT=81.518	No data	? TT=219.635	? TT=220.967
csp/primes-30/ normalized-primes-30-60-3-3.xml	SAT TT=0.674	SAT TT=60.221 CHECKS=139252000 NODES=296	SAT TT=110.352 CHECKS=231389000 NODES=288	SAT TT=0.674	SAT TT=40.382 CHECKS=2430390	SAT TT=46.218 CHECKS=2862840	SAT TT=41.44 ASSIGNMENTS=691	SAT TT=54.801 ASSIGNMENTS=790	? (MO) TT=12.11	? (MO) TT=10.57	? (MO) TT=9.91	SAT TT=26.018 ASSIGNMENTS=38508 CHECKS=49019600	SAT TT=25.502 ASSIGNMENTS=38508 CHECKS=49019600	? (TO) TT=1800.06	? (TO) TT=1800.05	No data	SAT TT=11.311 ASSIGNMENTS=32961 CHECKS=32940800	SAT TT=23.646 ASSIGNMENTS=78284 CHECKS=69518500	SAT TT=0.891	SAT TT=842.592 ASSIGNMENTS=858654 CHECKS=2393900000	SAT TT=18.597 ASSIGNMENTS=38508 CHECKS=49019600	? (MO) TT=60.57	No data	? TT=171.281	? TT=178.448
csp/primes-30/ normalized-primes-30-60-3-7.xml		? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.15	? (MO) TT=11.12	? (MO) TT=11.46	? (MO) TT=10.09	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.04	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (MO) TT=77.472	No data	? TT=683.267	? TT=700.466
csp/primes-30/ normalized-primes-30-80-2-1.xml	SAT TT=0.018	SAT TT=2.485 CHECKS=3382230 NODES=100	SAT TT=2.194 CHECKS=3382230 NODES=0	SAT TT=0.047	SAT TT=1.095 CHECKS=737	SAT TT=0.021 CHECKS=956	SAT TT=1.058 ASSIGNMENTS=11	SAT TT=1.052 ASSIGNMENTS=11	SAT TT=22.623 CHECKS=1091400 NODES=100	SAT TT=8.192 CHECKS=1450990 NODES=0	SAT TT=7.922 CHECKS=1451070 NODES=1	SAT TT=0.029 ASSIGNMENTS=85 CHECKS=5309	SAT TT=0.027 ASSIGNMENTS=85 CHECKS=5309	SAT TT=31.822	SAT TT=29.039	No data	SAT TT=0.019 ASSIGNMENTS=85 CHECKS=5320	SAT TT=0.035 ASSIGNMENTS=4062 CHECKS=37548	SAT TT=0.483	SAT TT=0.018 ASSIGNMENTS=105 CHECKS=5116	SAT TT=0.019 ASSIGNMENTS=85 CHECKS=5309	SAT TT=154.866	No data	SAT TT=0.873	SAT TT=0.894
csp/primes-30/ normalized-primes-30-80-2-7.xml	SAT TT=0.063	SAT TT=5.919 CHECKS=9242930 NODES=102	SAT TT=8.021 CHECKS=11608100 NODES=0	SAT TT=0.063	SAT TT=2.361 CHECKS=2143	SAT TT=0.075 CHECKS=2126	SAT TT=0.927 ASSIGNMENTS=1	SAT TT=1.016 ASSIGNMENTS=1	? (MO) TT=10.02	? (MO) TT=9.97	? (MO) TT=11.55	SAT TT=0.077 ASSIGNMENTS=60 CHECKS=110160	SAT TT=0.076 ASSIGNMENTS=60 CHECKS=110160	? (TO) TT=1800.02	? (TO) TT=1800.02	No data	SAT TT=0.066 ASSIGNMENTS=58 CHECKS=112600	SAT TT=1.771 ASSIGNMENTS=4025 CHECKS=4760180	SAT TT=0.606	SAT TT=0.092 ASSIGNMENTS=116 CHECKS=182086	SAT TT=0.07 ASSIGNMENTS=61 CHECKS=111820	? TT=716.435	No data	SAT TT=1.576	SAT TT=1.279
csp/primes-30/ normalized-primes-30-80-3-3.xml	SAT TT=0.292	SAT TT=7.668 CHECKS=17293400 NODES=211	SAT TT=10.088 CHECKS=21120400 NODES=0	SAT TT=1.395	SAT TT=2.897 CHECKS=48424	SAT TT=4.006 CHECKS=265121	SAT TT=1.161 ASSIGNMENTS=2	SAT TT=1.275 ASSIGNMENTS=2	? (MO) TT=11.54	? (MO) TT=10.28	? (MO) TT=10.88	SAT TT=0.292 ASSIGNMENTS=335 CHECKS=697558	SAT TT=0.295 ASSIGNMENTS=335 CHECKS=697558	? (TO) TT=1800.04	? (TO) TT=1800.03	No data	SAT TT=0.759 ASSIGNMENTS=757 CHECKS=1989930	SAT TT=3.189 ASSIGNMENTS=4989 CHECKS=8399560	SAT TT=0.614	SAT TT=1.939 ASSIGNMENTS=869 CHECKS=5304570	SAT TT=0.894 ASSIGNMENTS=820 CHECKS=2492020	? TT=146.898	No data	? TT=182.067	? TT=174.671
csp/primes-30/ normalized-primes-30-80-3-5.xml		? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.08	? (MO) TT=10.46	? (MO) TT=10.76	? (MO) TT=10.62	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.09	No data	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.06	? TT=143.925	No data	? TT=284.482	? TT=173.16
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/aim/ normalized-aim-100-1-6-1.xml	SAT TT=0.038	SAT TT=1.201 CHECKS=21846 NODES=1200	SAT TT=1.105 CHECKS=16672 NODES=1093	SAT TT=1132.65	SAT TT=0.185 CHECKS=111710	SAT TT=0.164 CHECKS=103884	SAT TT=1.384 ASSIGNMENTS=3338	SAT TT=1.388 ASSIGNMENTS=3338	SAT TT=1.091 CHECKS=5151 NODES=438	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=0.134 ASSIGNMENTS=1187 CHECKS=138942	SAT TT=0.125 ASSIGNMENTS=1187 CHECKS=138942	SAT TT=1.453	SAT TT=1.44	No data	SAT TT=0.058 ASSIGNMENTS=490 CHECKS=50727	SAT TT=0.211 ASSIGNMENTS=6629 CHECKS=281140	SAT TT=0.722	SAT TT=0.37 ASSIGNMENTS=2944 CHECKS=275974	SAT TT=0.038 ASSIGNMENTS=278 CHECKS=23153	SAT TT=1.983	No data	SAT TT=0.925	SAT TT=1.024
csp/pseudo/aim/ normalized-aim-100-1-6-4.xml	SAT TT=0.097	SAT TT=1.128 CHECKS=17655 NODES=1131	SAT TT=1.062 CHECKS=20123 NODES=1075	? (TO) TT=1800.03	SAT TT=0.318 CHECKS=186055	SAT TT=0.317 CHECKS=193769	SAT TT=1.065 ASSIGNMENTS=828	SAT TT=1.081 ASSIGNMENTS=828	SAT TT=1.042 CHECKS=15977 NODES=821	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=0.181 ASSIGNMENTS=1919 CHECKS=197180	SAT TT=0.178 ASSIGNMENTS=1919 CHECKS=197180	SAT TT=1.437	SAT TT=1.622	No data	SAT TT=0.14 ASSIGNMENTS=1563 CHECKS=167446	SAT TT=0.143 ASSIGNMENTS=5004 CHECKS=199060	SAT TT=0.652	SAT TT=0.097 ASSIGNMENTS=937 CHECKS=61589	SAT TT=0.109 ASSIGNMENTS=1034 CHECKS=126171	SAT TT=1.779	No data	SAT TT=0.814	SAT TT=0.924
csp/pseudo/aim/ normalized-aim-100-2-0-2.xml	SAT TT=0.489	SAT TT=3.198 CHECKS=896852 NODES=36656	SAT TT=4.525 CHECKS=1679380 NODES=65563	SAT TT=407.963	SAT TT=8.321 CHECKS=6348600	SAT TT=6.83 CHECKS=5231120	SAT TT=2.714 ASSIGNMENTS=18602	SAT TT=2.975 ASSIGNMENTS=18602	SAT TT=2.014 CHECKS=260619 NODES=6598	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=10.85 ASSIGNMENTS=36656 CHECKS=896852	SAT TT=11.36 ASSIGNMENTS=31349 CHECKS=5409650	SAT TT=1.557	SAT TT=1.711	No data	SAT TT=2.533 ASSIGNMENTS=21939 CHECKS=3586780	SAT TT=0.489 ASSIGNMENTS=7731 CHECKS=682765	SAT TT=0.827	SAT TT=3.019 ASSIGNMENTS=17937 CHECKS=2852450	SAT TT=3.531 ASSIGNMENTS=31349 CHECKS=5409650	SAT TT=1.904	No data	SAT TT=0.994	SAT TT=0.934
csp/pseudo/aim/ normalized-aim-100-3-4-2.xml	SAT TT=0.172	SAT TT=1.607 CHECKS=168115 NODES=5662	SAT TT=1.631 CHECKS=141600 NODES=5683	SAT TT=0.922	SAT TT=0.409 CHECKS=338498	SAT TT=0.311 CHECKS=273653	SAT TT=2.983 ASSIGNMENTS=11371	SAT TT=2.831 ASSIGNMENTS=11371	SAT TT=2.881 CHECKS=497348 NODES=5486	SAT TT=6.965 CHECKS=11520500 NODES=515730	? (TO) TT=1800.06	SAT TT=0.223 ASSIGNMENTS=996 CHECKS=272827	SAT TT=0.209 ASSIGNMENTS=996 CHECKS=272827	SAT TT=1.865	SAT TT=1.88	No data	SAT TT=0.172 ASSIGNMENTS=727 CHECKS=217532	SAT TT=1.05 ASSIGNMENTS=7639 CHECKS=1617400	SAT TT=0.862	SAT TT=0.731 ASSIGNMENTS=2749 CHECKS=753824	SAT TT=0.599 ASSIGNMENTS=2617 CHECKS=967997	SAT TT=2.094	No data	SAT TT=0.949	SAT TT=1.108
csp/pseudo/aim/ normalized-aim-100-3-4-3.xml	SAT TT=0.055	SAT TT=1.19 CHECKS=24647 NODES=1375	SAT TT=1.304 CHECKS=26200 NODES=1514	SAT TT=0.513	SAT TT=0.519 CHECKS=429416	SAT TT=1.863 CHECKS=1719700	SAT TT=2.525 ASSIGNMENTS=8616	SAT TT=2.354 ASSIGNMENTS=8616	SAT TT=1.967 CHECKS=138679 NODES=2729	SAT TT=11.894 CHECKS=20200200 NODES=895870	? (TO) TT=1800.01	SAT TT=0.513 ASSIGNMENTS=1774 CHECKS=719746	SAT TT=0.506 ASSIGNMENTS=1774 CHECKS=719746	SAT TT=1.695	SAT TT=1.744	No data	SAT TT=0.518 ASSIGNMENTS=1764 CHECKS=769907	SAT TT=0.82 ASSIGNMENTS=7032 CHECKS=1318810	SAT TT=0.809	SAT TT=1.555 ASSIGNMENTS=5720 CHECKS=1566430	SAT TT=0.055 ASSIGNMENTS=116 CHECKS=39128	SAT TT=2.26	No data	SAT TT=0.961	SAT TT=0.969
csp/pseudo/aim/ normalized-aim-100-3-4-4.xml	SAT TT=0.61	SAT TT=1.474 CHECKS=104142 NODES=4184	SAT TT=1.812 CHECKS=208276 NODES=7626	SAT TT=2.179	SAT TT=2.656 CHECKS=2395670	SAT TT=2.02 CHECKS=1849220	SAT TT=3.356 ASSIGNMENTS=13397	SAT TT=2.977 ASSIGNMENTS=13397	SAT TT=6.461 CHECKS=1722550 NODES=17499	SAT TT=7.898 CHECKS=12418100 NODES=553986	? (TO) TT=1800.02	SAT TT=1.33 ASSIGNMENTS=4798 CHECKS=2012540	SAT TT=1.325 ASSIGNMENTS=4798 CHECKS=2012540	SAT TT=1.909	SAT TT=1.718	No data	SAT TT=0.61 ASSIGNMENTS=2256 CHECKS=908128	SAT TT=1.046 ASSIGNMENTS=7468 CHECKS=1637620	SAT TT=0.787	SAT TT=0.622 ASSIGNMENTS=2197 CHECKS=660543	SAT TT=2.282 ASSIGNMENTS=10167 CHECKS=3802740	SAT TT=2.314	No data	SAT TT=1.068	SAT TT=0.932
csp/pseudo/aim/ normalized-aim-100-6-0-3.xml	SAT TT=0.072	SAT TT=1.338 CHECKS=22533 NODES=1124	SAT TT=1.452 CHECKS=23208 NODES=1015	SAT TT=0.904	SAT TT=0.201 CHECKS=134020	SAT TT=0.182 CHECKS=146791	SAT TT=1.54 ASSIGNMENTS=426	SAT TT=1.772 ASSIGNMENTS=426	SAT TT=1.725 CHECKS=99981 NODES=840	SAT TT=1.421 CHECKS=121799 NODES=2977	SAT TT=1.426 CHECKS=171365 NODES=1311	SAT TT=0.171 ASSIGNMENTS=292 CHECKS=184441	SAT TT=0.177 ASSIGNMENTS=292 CHECKS=184441	SAT TT=2.001	SAT TT=1.997	No data	SAT TT=0.101 ASSIGNMENTS=147 CHECKS=85816	SAT TT=0.84 ASSIGNMENTS=5220 CHECKS=1316770	SAT TT=0.818	SAT TT=0.342 ASSIGNMENTS=1272 CHECKS=356842	SAT TT=0.072 ASSIGNMENTS=70 CHECKS=48759	SAT TT=2.434	No data	SAT TT=1.095	SAT TT=1.328
csp/pseudo/aim/ normalized-aim-200-1-6-1.xml	SAT TT=1.167	SAT TT=1.873 CHECKS=193472 NODES=7946	SAT TT=2.102 CHECKS=222317 NODES=9646	? (TO) TT=1800.1	SAT TT=13.37 CHECKS=8478830	SAT TT=5.643 CHECKS=3485080	SAT TT=11.301 ASSIGNMENTS=92753	SAT TT=12.093 ASSIGNMENTS=92753	SAT TT=2.201 CHECKS=127369 NODES=3715	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=9.134 ASSIGNMENTS=7946 CHECKS=193472	SAT TT=9.697 ASSIGNMENTS=17344 CHECKS=3743000	SAT TT=1.904	SAT TT=1.975	No data	SAT TT=1.167 ASSIGNMENTS=7981 CHECKS=1580700	SAT TT=1.55 ASSIGNMENTS=19204 CHECKS=2118470	SAT TT=1.108	SAT TT=11.347 ASSIGNMENTS=43732 CHECKS=8977590	SAT TT=2.675 ASSIGNMENTS=17344 CHECKS=3743000	SAT TT=2.455	No data	SAT TT=1.238	SAT TT=1.2
csp/pseudo/aim/ normalized-aim-200-1-6-2.xml	SAT TT=0.885	SAT TT=3.875 CHECKS=792276 NODES=37887	SAT TT=3.731 CHECKS=753234 NODES=34327	? (TO) TT=1800.11	SAT TT=6.03 CHECKS=3193740	SAT TT=8.23 CHECKS=4269140	SAT TT=4.293 ASSIGNMENTS=37937	SAT TT=4.343 ASSIGNMENTS=37937	SAT TT=5.124 CHECKS=515808 NODES=17253	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=11.145 ASSIGNMENTS=37887 CHECKS=792276	SAT TT=1.496 ASSIGNMENTS=15438 CHECKS=1912100	SAT TT=1.787	SAT TT=1.818	No data	SAT TT=2.87 ASSIGNMENTS=27719 CHECKS=3586480	SAT TT=0.885 ASSIGNMENTS=15727 CHECKS=1141810	SAT TT=1.393	SAT TT=1.673 ASSIGNMENTS=8113 CHECKS=893074	SAT TT=1.369 ASSIGNMENTS=13464 CHECKS=1660980	SAT TT=2.681	No data	SAT TT=1.348	SAT TT=1.049
csp/pseudo/aim/ normalized-aim-200-1-6-4.xml	SAT TT=1.059	SAT TT=3.649 CHECKS=822520 NODES=29579	SAT TT=3.322 CHECKS=672110 NODES=27165	? (TO) TT=1800.05	SAT TT=44.571 CHECKS=23011200	SAT TT=15.367 CHECKS=8411770	SAT TT=14.026 ASSIGNMENTS=149488	SAT TT=14.846 ASSIGNMENTS=149488	SAT TT=22.21 CHECKS=2919140 NODES=103049	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=11.131 ASSIGNMENTS=29579 CHECKS=822520	SAT TT=29.646 ASSIGNMENTS=240841 CHECKS=29674400	SAT TT=2.098	SAT TT=1.891	No data	SAT TT=30.501 ASSIGNMENTS=297005 CHECKS=37328500	SAT TT=261.23 ASSIGNMENTS=1834890 CHECKS=356778000	SAT TT=26.301	SAT TT=5.825 ASSIGNMENTS=29095 CHECKS=3493110	SAT TT=24.099 ASSIGNMENTS=240841 CHECKS=29674400	SAT TT=2.336	No data	SAT TT=1.207	SAT TT=1.059
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/aim/ normalized-aim-200-2-0-3.xml	SAT TT=1.049	SAT TT=1.711 CHECKS=122864 NODES=7037	SAT TT=2.098 CHECKS=198192 NODES=10306	? (TO) TT=1800.07	SAT TT=8.241 CHECKS=4445050	SAT TT=31.368 CHECKS=17618400	SAT TT=30.033 ASSIGNMENTS=302970	SAT TT=28.622 ASSIGNMENTS=302970	SAT TT=20.612 CHECKS=2784570 NODES=73865	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=9.259 ASSIGNMENTS=7037 CHECKS=122864	SAT TT=10.915 ASSIGNMENTS=27190 CHECKS=4337900	SAT TT=2.134	SAT TT=2.283	No data	SAT TT=223.076 ASSIGNMENTS=1478320 CHECKS=296022000	SAT TT=1.72 ASSIGNMENTS=21420 CHECKS=2293980	SAT TT=1.005	SAT TT=16.693 ASSIGNMENTS=62767 CHECKS=9498680	SAT TT=3.482 ASSIGNMENTS=27190 CHECKS=4337900	SAT TT=2.657	No data	SAT TT=1.049	SAT TT=1.069
csp/pseudo/aim/ normalized-aim-200-3-4-4.xml	SAT TT=1.029	SAT TT=2.103 CHECKS=188104 NODES=6840	SAT TT=2.531 CHECKS=299548 NODES=10161	SAT TT=1785.89	SAT TT=6.663 CHECKS=4954940	SAT TT=9.721 CHECKS=7349590	SAT TT=7.977 ASSIGNMENTS=38004	SAT TT=8.888 ASSIGNMENTS=38004	SAT TT=27.206 CHECKS=5180360 NODES=49190	SAT TT=7.911 CHECKS=8404530 NODES=376254	? (TO) TT=1800.05	SAT TT=9.423 ASSIGNMENTS=6840 CHECKS=188104	SAT TT=9.54 ASSIGNMENTS=6840 CHECKS=188104	SAT TT=2.361	SAT TT=2.326	No data	SAT TT=10.483 ASSIGNMENTS=30817 CHECKS=14973000	SAT TT=5.321 ASSIGNMENTS=17393 CHECKS=7865580	SAT TT=1.861	SAT TT=9.741 ASSIGNMENTS=17184 CHECKS=7550590	SAT TT=1.029 ASSIGNMENTS=3467 CHECKS=1385420	SAT TT=3.044	No data	SAT TT=1.281	SAT TT=1.207
csp/pseudo/aim/ normalized-aim-200-6-0-3.xml	SAT TT=0.417	SAT TT=1.797 CHECKS=37739 NODES=2224	SAT TT=2.286 CHECKS=146463 NODES=4784	? (TO) TT=1800.06	SAT TT=1.431 CHECKS=1022330	SAT TT=3.134 CHECKS=2895050	SAT TT=2.181 ASSIGNMENTS=764	SAT TT=2.4 ASSIGNMENTS=764	SAT TT=2.538 CHECKS=83377 NODES=744	SAT TT=1488.82 CHECKS=2147590000 NODES=56854500	SAT TT=2.895 CHECKS=2701400 NODES=10360	SAT TT=0.417 ASSIGNMENTS=421 CHECKS=398974	SAT TT=0.434 ASSIGNMENTS=421 CHECKS=398974	SAT TT=2.787	SAT TT=2.666	No data	SAT TT=0.592 ASSIGNMENTS=632 CHECKS=622537	SAT TT=2.577 ASSIGNMENTS=6603 CHECKS=3270170	SAT TT=1.078	SAT TT=2.801 ASSIGNMENTS=3518 CHECKS=1864890	SAT TT=2.274 ASSIGNMENTS=2156 CHECKS=2641370	SAT TT=3.709	No data	SAT TT=1.234	SAT TT=1.358
csp/pseudo/aim/ normalized-aim-50-1-6-2.xml	SAT TT=0.013	SAT TT=0.989 CHECKS=16430 NODES=909	SAT TT=0.858 CHECKS=757 NODES=0	SAT TT=0.081	SAT TT=0.021 CHECKS=969	SAT TT=0.015 CHECKS=1069	SAT TT=0.733 ASSIGNMENTS=3	SAT TT=0.784 ASSIGNMENTS=3	SAT TT=0.838 CHECKS=6687 NODES=368	SAT TT=110.969 CHECKS=229738000 NODES=21019000	? (TO) TT=1800.05	SAT TT=0.025 ASSIGNMENTS=2 CHECKS=802	SAT TT=0.025 ASSIGNMENTS=2 CHECKS=802	SAT TT=1.28	SAT TT=1.152	No data	SAT TT=0.013 ASSIGNMENTS=2 CHECKS=802	SAT TT=0.048 ASSIGNMENTS=1251 CHECKS=50569	SAT TT=0.466	SAT TT=0.039 ASSIGNMENTS=472 CHECKS=27861	SAT TT=0.027 ASSIGNMENTS=209 CHECKS=22312	SAT TT=1.139	No data	SAT TT=0.708	SAT TT=0.791
csp/pseudo/aim/ normalized-aim-50-2-0-1.xml	SAT TT=0.037	SAT TT=1.017 CHECKS=8669 NODES=713	SAT TT=0.941 CHECKS=4777 NODES=410	SAT TT=6.479	SAT TT=0.203 CHECKS=147342	SAT TT=0.183 CHECKS=128657	SAT TT=0.945 ASSIGNMENTS=1211	SAT TT=1.195 ASSIGNMENTS=1211	SAT TT=0.832 CHECKS=5945 NODES=339	SAT TT=5.322 CHECKS=10376100 NODES=743890	? (TO) TT=1800.09	SAT TT=0.081 ASSIGNMENTS=749 CHECKS=81799	SAT TT=0.073 ASSIGNMENTS=749 CHECKS=81799	SAT TT=1.543	SAT TT=1.436	No data	SAT TT=0.073 ASSIGNMENTS=718 CHECKS=82307	SAT TT=0.198 ASSIGNMENTS=4767 CHECKS=269997	SAT TT=0.501	SAT TT=0.047 ASSIGNMENTS=493 CHECKS=33401	SAT TT=0.037 ASSIGNMENTS=305 CHECKS=33295	SAT TT=1.187	No data	SAT TT=0.746	SAT TT=0.731
csp/pseudo/aim/ normalized-aim-50-3-4-1.xml	SAT TT=0.019	SAT TT=0.993 CHECKS=4713 NODES=377	SAT TT=0.958 CHECKS=2685 NODES=157	SAT TT=0.081	SAT TT=0.047 CHECKS=20574	SAT TT=0.036 CHECKS=20512	SAT TT=0.967 ASSIGNMENTS=79	SAT TT=0.901 ASSIGNMENTS=79	SAT TT=1.004 CHECKS=23759 NODES=479	SAT TT=1.639 CHECKS=1525370 NODES=67916	SAT TT=1.11 CHECKS=119150 NODES=1079	SAT TT=0.043 ASSIGNMENTS=68 CHECKS=20150	SAT TT=0.041 ASSIGNMENTS=68 CHECKS=20150	SAT TT=1.691	SAT TT=1.359	No data	SAT TT=0.026 ASSIGNMENTS=51 CHECKS=13384	SAT TT=0.363 ASSIGNMENTS=4407 CHECKS=559116	SAT TT=0.599	SAT TT=0.064 ASSIGNMENTS=441 CHECKS=59095	SAT TT=0.019 ASSIGNMENTS=6 CHECKS=1812	SAT TT=1.741	No data	SAT TT=0.856	SAT TT=0.843
csp/pseudo/aim/ normalized-aim-50-3-4-4.xml	SAT TT=0.039	SAT TT=1.027 CHECKS=9606 NODES=578	SAT TT=0.994 CHECKS=5887 NODES=356	SAT TT=0.079	SAT TT=0.061 CHECKS=38409	SAT TT=0.056 CHECKS=38389	SAT TT=0.973 ASSIGNMENTS=460	SAT TT=1.044 ASSIGNMENTS=460	SAT TT=0.91 CHECKS=6600 NODES=186	SAT TT=1.161 CHECKS=485601 NODES=21639	SAT TT=1.08 CHECKS=434549 NODES=3331	SAT TT=0.057 ASSIGNMENTS=152 CHECKS=43768	SAT TT=0.057 ASSIGNMENTS=152 CHECKS=43768	SAT TT=1.417	SAT TT=1.385	No data	SAT TT=0.039 ASSIGNMENTS=125 CHECKS=34909	SAT TT=0.35 ASSIGNMENTS=4402 CHECKS=545662	SAT TT=0.609	SAT TT=0.045 ASSIGNMENTS=361 CHECKS=42302	SAT TT=0.045 ASSIGNMENTS=147 CHECKS=41742	SAT TT=1.759	No data	SAT TT=0.785	SAT TT=0.814
csp/pseudo/aim/ normalized-aim-50-6-0-1.xml	SAT TT=0.025	SAT TT=1.093 CHECKS=3257 NODES=192	SAT TT=1.095 CHECKS=8303 NODES=337	SAT TT=0.101	SAT TT=0.046 CHECKS=11108	SAT TT=0.032 CHECKS=11017	SAT TT=1.025 ASSIGNMENTS=36	SAT TT=1.037 ASSIGNMENTS=36	SAT TT=0.993 CHECKS=2873 NODES=116	SAT TT=1.099 CHECKS=77826 NODES=1933	SAT TT=1.081 CHECKS=62076 NODES=596	SAT TT=0.048 ASSIGNMENTS=50 CHECKS=21446	SAT TT=0.049 ASSIGNMENTS=50 CHECKS=21446	SAT TT=1.716	SAT TT=1.545	No data	SAT TT=0.035 ASSIGNMENTS=43 CHECKS=19179	SAT TT=0.081 ASSIGNMENTS=533 CHECKS=103306	SAT TT=0.861	SAT TT=0.038 ASSIGNMENTS=72 CHECKS=17033	SAT TT=0.025 ASSIGNMENTS=7 CHECKS=3218	SAT TT=1.82	No data	SAT TT=0.89	SAT TT=0.901
csp/pseudo/aim/ normalized-aim-50-6-0-3.xml	SAT TT=0.028	SAT TT=1.186 CHECKS=2355 NODES=157	SAT TT=1.106 CHECKS=3434 NODES=166	SAT TT=0.092	SAT TT=0.044 CHECKS=9519	SAT TT=0.028 CHECKS=9275	SAT TT=1.077 ASSIGNMENTS=4	SAT TT=1.016 ASSIGNMENTS=4	SAT TT=0.992 CHECKS=2817 NODES=128	SAT TT=1.114 CHECKS=72436 NODES=1813	SAT TT=1.081 CHECKS=54098 NODES=485	SAT TT=0.047 ASSIGNMENTS=18 CHECKS=9890	SAT TT=0.04 ASSIGNMENTS=18 CHECKS=9890	SAT TT=1.8	SAT TT=1.61	No data	SAT TT=0.028 ASSIGNMENTS=16 CHECKS=7480	SAT TT=0.053 ASSIGNMENTS=297 CHECKS=46804	SAT TT=0.858	SAT TT=0.049 ASSIGNMENTS=203 CHECKS=38747	SAT TT=0.038 ASSIGNMENTS=48 CHECKS=21982	SAT TT=1.723	No data	SAT TT=0.969	SAT TT=1.107
csp/pseudo/aim/ normalized-aim-50-6-0-4.xml	SAT TT=0.028	SAT TT=1.104 CHECKS=3435 NODES=199	SAT TT=1.072 CHECKS=4642 NODES=208	SAT TT=0.105	SAT TT=0.045 CHECKS=11808	SAT TT=0.032 CHECKS=11886	SAT TT=1.223 ASSIGNMENTS=41	SAT TT=1.209 ASSIGNMENTS=41	SAT TT=1.079 CHECKS=9331 NODES=170	SAT TT=1.046 CHECKS=57955 NODES=1410	SAT TT=1.058 CHECKS=191551 NODES=1592	SAT TT=0.039 ASSIGNMENTS=7 CHECKS=5576	SAT TT=0.038 ASSIGNMENTS=7 CHECKS=5576	SAT TT=1.482	SAT TT=1.525	No data	SAT TT=0.028 ASSIGNMENTS=7 CHECKS=5576	SAT TT=0.041 ASSIGNMENTS=140 CHECKS=26608	SAT TT=0.801	SAT TT=0.036 ASSIGNMENTS=90 CHECKS=16234	SAT TT=0.037 ASSIGNMENTS=43 CHECKS=21011	SAT TT=1.893	No data	SAT TT=0.962	SAT TT=0.986
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/chnl/ normalized-chnl-10-11.xml	UNSAT TT=0.058	UNSAT TT=1.467 CHECKS=212572 NODES=2319	UNSAT TT=1.584 CHECKS=254326 NODES=1665	? (TO) TT=1800.07	UNSAT TT=0.076 CHECKS=11881	UNSAT TT=0.058 CHECKS=7538	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=720.789 ASSIGNMENTS=6161630 CHECKS=725834000	UNSAT TT=869.723 ASSIGNMENTS=6161630 CHECKS=725834000	UNSAT TT=16.988	UNSAT TT=4.25	No data	? (TO) TT=1800.1	UNSAT TT=685.082 ASSIGNMENTS=9135120 CHECKS=883770000	UNSAT TT=37.465	? (TO) TT=1800.04	UNSAT TT=531.88 ASSIGNMENTS=6161630 CHECKS=725834000	UNSAT TT=1426.01	No data	UNSAT TT=11.762	UNSAT TT=11.287
csp/pseudo/chnl/ normalized-chnl-10-15.xml	UNSAT TT=0.062	UNSAT TT=6.176 CHECKS=2773630 NODES=2183	UNSAT TT=3.536 CHECKS=1683300 NODES=1354	? (TO) TT=1800.05	UNSAT TT=0.064 CHECKS=5081	UNSAT TT=0.062 CHECKS=5051	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.01	UNSAT TT=1655.7 ASSIGNMENTS=2865710 CHECKS=474578000	UNSAT TT=1655.95 ASSIGNMENTS=2865710 CHECKS=474578000	UNSAT TT=15.581	UNSAT TT=4.353	No data	? (TO) TT=1800.02	UNSAT TT=613.737 ASSIGNMENTS=5287110 CHECKS=852119000	UNSAT TT=50.798	UNSAT TT=1554.08 ASSIGNMENTS=6517850 CHECKS=1113020000	UNSAT TT=347.557 ASSIGNMENTS=2865710 CHECKS=474578000	? (TO) TT=1800.18	No data	UNSAT TT=16.435	UNSAT TT=5.999
csp/pseudo/chnl/ normalized-chnl-15-16.xml	UNSAT TT=0.327	UNSAT TT=73.688 CHECKS=51110700 NODES=29733	UNSAT TT=288.369 CHECKS=204356000 NODES=42154	? (TO) TT=1800.09	UNSAT TT=0.327 CHECKS=46106	UNSAT TT=0.336 CHECKS=47946	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	No data	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.21	No data	? (TO) TT=1800.09	? (TO) TT=1800.11
csp/pseudo/chnl/ normalized-chnl-15-20.xml	UNSAT TT=0.437	UNSAT TT=1103 CHECKS=716887000 NODES=32764	? (TO) TT=1800.17	? (TO) TT=1800.06	UNSAT TT=0.437 CHECKS=58974	UNSAT TT=0.458 CHECKS=55833	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.11	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	? TT=213.121	No data	? (TO) TT=1800.13	? (TO) TT=1800.05
csp/pseudo/chnl/ normalized-chnl-20-21.xml	UNSAT TT=1.032	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.05	UNSAT TT=1.065 CHECKS=131908	UNSAT TT=1.032 CHECKS=125953	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.04	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? TT=500.586	No data	? (TO) TT=1800.05	? (TO) TT=1800.11
csp/pseudo/chnl/ normalized-chnl-20-30.xml	UNSAT TT=1.889	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=2.265 CHECKS=206040	UNSAT TT=1.889 CHECKS=165351	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.02	No data	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.03	? TT=666.893	No data	? (TO) TT=1800.01	? (TO) TT=1800.09
csp/pseudo/chnl/ normalized-chnl-30-31.xml	UNSAT TT=7.287	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=7.287 CHECKS=587577	? (TO) TT=1800.23	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.01	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.12	No data	? (TO) TT=1800.07	? (TO) TT=1800.09
csp/pseudo/chnl/ normalized-chnl-30-35.xml	UNSAT TT=9.795	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=9.795 CHECKS=663367	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.01	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.16	No data	? (TO) TT=1800.04	? (TO) TT=1800
csp/pseudo/chnl/ normalized-chnl-30-40.xml	UNSAT TT=13.431	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.06	UNSAT TT=13.431 CHECKS=842229	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.04	No data	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.16	No data	? (TO) TT=1800.07	? (TO) TT=1800.05
csp/pseudo/chnl/ normalized-chnl-35-40.xml	UNSAT TT=21.029	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.02	UNSAT TT=21.029 CHECKS=1251830	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.1	No data	? (TO) TT=1800.08	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/chnl/ normalized-chnl-35-45.xml	UNSAT TT=29.427	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.04	UNSAT TT=29.427 CHECKS=1461720	UNSAT TT=44.48 CHECKS=1923810	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.05	No data	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.17	No data	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/pseudo/chnl/ normalized-chnl-40-41.xml		? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.09	No data	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	No data	? (TO) TT=1800	? (TO) TT=1800.07
csp/pseudo/chnl/ normalized-chnl-40-50.xml		? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.17	No data	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/pseudo/chnl/ normalized-chnl-50-55.xml		? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800	No data	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.15	No data	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/pseudo/chnl/ normalized-chnl-50-60.xml		? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	No data	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.1	No data	? (TO) TT=1800.05	? (TO) TT=1800.05
csp/pseudo/ circuits/ normalized-b1.xml	SAT TT=0.007	SAT TT=0.735 CHECKS=144 NODES=24	SAT TT=0.732 CHECKS=150 NODES=0	SAT TT=0.034	SAT TT=0.012 CHECKS=657	SAT TT=0.009 CHECKS=515	SAT TT=0.626 ASSIGNMENTS=11	SAT TT=0.697 ASSIGNMENTS=20	SAT TT=0.681 CHECKS=221 NODES=24	SAT TT=0.687 CHECKS=648 NODES=2	SAT TT=0.723 CHECKS=708 NODES=2	SAT TT=0.021 ASSIGNMENTS=12 CHECKS=609	SAT TT=0.022 ASSIGNMENTS=12 CHECKS=609	SAT TT=1.56	SAT TT=1.287	No data	SAT TT=0.01 ASSIGNMENTS=12 CHECKS=609	SAT TT=0.01 ASSIGNMENTS=17 CHECKS=628	SAT TT=0.351	SAT TT=0.009 ASSIGNMENTS=22 CHECKS=873	SAT TT=0.007 ASSIGNMENTS=12 CHECKS=603	SAT TT=1.503	No data	SAT TT=0.64	SAT TT=0.592
csp/pseudo/ circuits/ normalized-C17.xml	SAT TT=0.007	SAT TT=0.676 CHECKS=58 NODES=15	SAT TT=0.679 CHECKS=61 NODES=0	SAT TT=0.028	SAT TT=0.008 CHECKS=118	SAT TT=0.01 CHECKS=172	SAT TT=0.537 ASSIGNMENTS=6	SAT TT=0.511 ASSIGNMENTS=6	SAT TT=0.474 CHECKS=64 NODES=15	SAT TT=0.504 CHECKS=230 NODES=0	SAT TT=0.507 CHECKS=267 NODES=1	SAT TT=0.019 ASSIGNMENTS=5 CHECKS=160	SAT TT=0.016 ASSIGNMENTS=5 CHECKS=160	SAT TT=1.004	SAT TT=1.084	No data	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=160	SAT TT=0.009 ASSIGNMENTS=9 CHECKS=154	SAT TT=0.308	SAT TT=0.007 ASSIGNMENTS=6 CHECKS=156	SAT TT=0.007 ASSIGNMENTS=6 CHECKS=155	SAT TT=0.963	No data	SAT TT=0.481	SAT TT=0.507
csp/pseudo/ circuits/ normalized-C432.xml	SAT TT=0.331	SAT TT=2.652 CHECKS=9896 NODES=771	SAT TT=2.462 CHECKS=5573 NODES=0	SAT TT=0.641	SAT TT=0.398 CHECKS=24106	SAT TT=0.393 CHECKS=55174	SAT TT=2.81 ASSIGNMENTS=324	SAT TT=3.139 ASSIGNMENTS=655	SAT TT=106.913 CHECKS=16911 NODES=779	SAT TT=46.841 CHECKS=39305 NODES=40	SAT TT=49.29 CHECKS=108599 NODES=44	SAT TT=0.411 ASSIGNMENTS=344 CHECKS=70844	SAT TT=0.415 ASSIGNMENTS=344 CHECKS=70844	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	SAT TT=0.411 ASSIGNMENTS=344 CHECKS=70844	SAT TT=0.331 ASSIGNMENTS=456 CHECKS=119270	SAT TT=1.968	SAT TT=73.603 ASSIGNMENTS=42765 CHECKS=8746720	SAT TT=0.417 ASSIGNMENTS=350 CHECKS=71008	? (TO) TT=1800.15	No data	SAT TT=3.014	SAT TT=3.086
csp/pseudo/ circuits/ normalized-c8.xml	SAT TT=0.063	SAT TT=1.388 CHECKS=2962 NODES=239	SAT TT=1.444 CHECKS=2306 NODES=0	SAT TT=0.192	SAT TT=0.107 CHECKS=13694	SAT TT=0.083 CHECKS=13548	SAT TT=1.368 ASSIGNMENTS=83	SAT TT=1.418 ASSIGNMENTS=199	SAT TT=81.662 CHECKS=3766 NODES=243	SAT TT=25.481 CHECKS=9341 NODES=11	SAT TT=23.438 CHECKS=13615 NODES=11	SAT TT=0.077 ASSIGNMENTS=81 CHECKS=13533	SAT TT=0.075 ASSIGNMENTS=81 CHECKS=13533	? (TO) TT=1800.01	? (TO) TT=1800.02	No data	SAT TT=0.067 ASSIGNMENTS=81 CHECKS=13533	SAT TT=0.063 ASSIGNMENTS=88 CHECKS=14729	SAT TT=0.844	SAT TT=0.984 ASSIGNMENTS=4663 CHECKS=763194	SAT TT=0.064 ASSIGNMENTS=81 CHECKS=13281	? (TO) TT=1800.07	No data	SAT TT=1.34	SAT TT=1.47
csp/pseudo/ circuits/ normalized-cc.xml	SAT TT=0.025	SAT TT=1.044 CHECKS=1597 NODES=133	SAT TT=1.037 CHECKS=791 NODES=0	SAT TT=0.084	SAT TT=0.039 CHECKS=2239	SAT TT=0.029 CHECKS=2287	SAT TT=1.08 ASSIGNMENTS=27	SAT TT=1.868 ASSIGNMENTS=104	SAT TT=76.011 CHECKS=1387 NODES=133	SAT TT=16.785 CHECKS=3388 NODES=4	SAT TT=16.546 CHECKS=4359 NODES=6	SAT TT=0.039 ASSIGNMENTS=28 CHECKS=4754	SAT TT=0.038 ASSIGNMENTS=28 CHECKS=4754	? (TO) TT=1800.02	? (TO) TT=1800	No data	SAT TT=0.026 ASSIGNMENTS=28 CHECKS=4754	SAT TT=0.028 ASSIGNMENTS=43 CHECKS=5080	SAT TT=0.68	SAT TT=0.03 ASSIGNMENTS=81 CHECKS=5993	SAT TT=0.025 ASSIGNMENTS=28 CHECKS=4757	? (TO) TT=1800.18	No data	SAT TT=0.944	SAT TT=1.055
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ circuits/ normalized-cm42a.xml	SAT TT=0.02	SAT TT=1.021 CHECKS=1184 NODES=99	SAT TT=0.998 CHECKS=1442 NODES=0	SAT TT=0.073	SAT TT=0.035 CHECKS=4028	SAT TT=0.027 CHECKS=3507	SAT TT=0.972 ASSIGNMENTS=38	SAT TT=0.918 ASSIGNMENTS=38	SAT TT=2.872 CHECKS=1006 NODES=101	SAT TT=1.531 CHECKS=2909 NODES=9	SAT TT=1.661 CHECKS=4217 NODES=9	SAT TT=0.034 ASSIGNMENTS=52 CHECKS=4021	SAT TT=0.033 ASSIGNMENTS=52 CHECKS=4021	SAT TT=2.539	Wrong Cert. TT=2.667	No data	SAT TT=0.021 ASSIGNMENTS=43 CHECKS=3994	SAT TT=0.021 ASSIGNMENTS=45 CHECKS=3277	SAT TT=0.557	SAT TT=0.034 ASSIGNMENTS=325 CHECKS=16138	SAT TT=0.02 ASSIGNMENTS=50 CHECKS=4024	SAT TT=20.301	No data	SAT TT=0.934	SAT TT=0.907
csp/pseudo/ circuits/ normalized-cmb.xml	SAT TT=0.093	SAT TT=1.607 CHECKS=5563 NODES=304	SAT TT=1.701 CHECKS=2755 NODES=0	SAT TT=0.619	SAT TT=0.122 CHECKS=9069	SAT TT=0.113 CHECKS=18859	SAT TT=1.533 ASSIGNMENTS=153	SAT TT=1.879 ASSIGNMENTS=245	SAT TT=106.891 CHECKS=5575 NODES=308	SAT TT=50.533 CHECKS=13721 NODES=16	SAT TT=43.758 CHECKS=21439 NODES=16	SAT TT=0.114 ASSIGNMENTS=162 CHECKS=29368	SAT TT=0.119 ASSIGNMENTS=162 CHECKS=29368	SAT TT=375.349	Wrong Cert. TT=373.297	No data	SAT TT=0.104 ASSIGNMENTS=162 CHECKS=29368	SAT TT=0.093 ASSIGNMENTS=119 CHECKS=27145	SAT TT=0.93	SAT TT=2.275 ASSIGNMENTS=7506 CHECKS=1539860	SAT TT=0.107 ASSIGNMENTS=160 CHECKS=29474	? (TO) TT=1800.13	No data	SAT TT=1.527	SAT TT=2.256
csp/pseudo/ course/ normalized-ss97-4.xml	SAT TT=2.532	? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=252.285 ASSIGNMENTS=475286	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=1162.83 ASSIGNMENTS=1731 CHECKS=580222	SAT TT=1252.26 ASSIGNMENTS=1731 CHECKS=580222	? (TO) TT=1800.04	? (TO) TT=1800.03	No data	SAT TT=3.011 ASSIGNMENTS=1822 CHECKS=2222770	SAT TT=4.848 ASSIGNMENTS=7039 CHECKS=7819150	? (TO) TT=1800.1	SAT TT=15.986 ASSIGNMENTS=7291 CHECKS=5985600	SAT TT=2.532 ASSIGNMENTS=1731 CHECKS=580222	? (TO) TT=1800.14	No data	SAT TT=3.746	SAT TT=7.42
csp/pseudo/ course/ normalized-ss97-6.xml	SAT TT=0.04	? (TO) TT=1800.13	SAT TT=224 CHECKS=46781300 NODES=23817	? (TO) TT=1800.05	SAT TT=0.873 CHECKS=22994	SAT TT=0.879 CHECKS=23150	? (TO) TT=1800.08	SAT TT=1.25 ASSIGNMENTS=351	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=0.056 ASSIGNMENTS=130 CHECKS=18175	SAT TT=0.056 ASSIGNMENTS=130 CHECKS=18175	? (TO) TT=1800.04	? (TO) TT=1800.09	No data	SAT TT=0.04 ASSIGNMENTS=130 CHECKS=18175	SAT TT=0.06 ASSIGNMENTS=271 CHECKS=66053	SAT TT=141.642	SAT TT=0.151 ASSIGNMENTS=867 CHECKS=156378	SAT TT=0.044 ASSIGNMENTS=153 CHECKS=18742	? (TO) TT=1800.09	No data	SAT TT=1.252	SAT TT=1.385
csp/pseudo/ course/ normalized-ws97-3.xml	SAT TT=1.208	? (TO) TT=1800.19	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=82.455 ASSIGNMENTS=57720	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800	No data	? (TO) TT=1800.06	SAT TT=1.208 ASSIGNMENTS=2431 CHECKS=958859	? (TO) TT=1800.06	SAT TT=2.301 ASSIGNMENTS=2714 CHECKS=2591590	? (TO) TT=1800.09	? (TO) TT=1800.15	No data	SAT TT=5.497	SAT TT=10.207
csp/pseudo/ course/ normalized-ws97-5.xml	SAT TT=0.17	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.05	SAT TT=37.14 CHECKS=108787	? (TO) TT=1800.04	? (TO) TT=1800.18	SAT TT=2.642 ASSIGNMENTS=2436	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=1160.24 ASSIGNMENTS=606 CHECKS=179057	SAT TT=223.785 ASSIGNMENTS=606 CHECKS=179057	? (TO) TT=1800.05	? (TO) TT=1800.02	No data	? (TO) TT=1800.09	SAT TT=0.17 ASSIGNMENTS=156 CHECKS=122762	? (TO) TT=1800.12	SAT TT=0.248 ASSIGNMENTS=537 CHECKS=166124	SAT TT=0.291 ASSIGNMENTS=606 CHECKS=179057	? (TO) TT=1800.11	No data	SAT TT=2.417	SAT TT=3.72
csp/pseudo/fpga/ normalized-fpga-10-10.xml	SAT TT=0.084	SAT TT=1.568 CHECKS=150473 NODES=2926	SAT TT=1.01 CHECKS=1465 NODES=0	SAT TT=888.318	SAT TT=0.084 CHECKS=16539	SAT TT=0.104 CHECKS=25361	SAT TT=9.226 ASSIGNMENTS=127355	SAT TT=0.915 ASSIGNMENTS=66	SAT TT=0.859 CHECKS=2827 NODES=150	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=8.835 ASSIGNMENTS=1966 CHECKS=195642	SAT TT=8.868 ASSIGNMENTS=1966 CHECKS=195642	SAT TT=1.728	SAT TT=1.705	No data	SAT TT=285.619 ASSIGNMENTS=2580350 CHECKS=421864000	? (TO) TT=1800.09	SAT TT=20.086	SAT TT=0.167 ASSIGNMENTS=1088 CHECKS=159381	SAT TT=0.144 ASSIGNMENTS=994 CHECKS=167247	SAT TT=3.856	No data	SAT TT=0.946	SAT TT=0.918
csp/pseudo/fpga/ normalized-fpga-10-8.xml	SAT TT=0.11	SAT TT=1.341 CHECKS=66706 NODES=3257	SAT TT=1.393 CHECKS=72754 NODES=3718	SAT TT=896.532	SAT TT=0.127 CHECKS=35289	SAT TT=0.114 CHECKS=32861	SAT TT=16.672 ASSIGNMENTS=269893	SAT TT=1.055 ASSIGNMENTS=2002	SAT TT=0.911 CHECKS=21518 NODES=608	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=8.775 ASSIGNMENTS=1836 CHECKS=67604	SAT TT=8.929 ASSIGNMENTS=1836 CHECKS=67604	SAT TT=1.613	SAT TT=1.716	No data	SAT TT=456.374 ASSIGNMENTS=2654620 CHECKS=678505000	SAT TT=0.214 ASSIGNMENTS=2536 CHECKS=307420	SAT TT=31.898	SAT TT=0.11 ASSIGNMENTS=735 CHECKS=108930	SAT TT=1.19 ASSIGNMENTS=7694 CHECKS=1786280	SAT TT=3.046	No data	SAT TT=0.833	SAT TT=0.858
csp/pseudo/fpga/ normalized-fpga-10-9.xml	SAT TT=0.099	SAT TT=1.618 CHECKS=204440 NODES=5028	SAT TT=1.017 CHECKS=908 NODES=0	SAT TT=898.535	SAT TT=0.115 CHECKS=29591	SAT TT=0.099 CHECKS=24007	SAT TT=14.857 ASSIGNMENTS=256375	SAT TT=0.812 ASSIGNMENTS=66	SAT TT=0.833 CHECKS=2025 NODES=135	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=75.108 ASSIGNMENTS=552372 CHECKS=52670100	SAT TT=69.54 ASSIGNMENTS=552372 CHECKS=52670100	SAT TT=1.769	SAT TT=1.689	No data	SAT TT=49.719 ASSIGNMENTS=446877 CHECKS=70943500	SAT TT=300.101 ASSIGNMENTS=1657720 CHECKS=421911000	SAT TT=1.976	SAT TT=0.152 ASSIGNMENTS=964 CHECKS=154165	SAT TT=2.522 ASSIGNMENTS=15326 CHECKS=4107750	SAT TT=2.889	No data	SAT TT=1.11	SAT TT=0.952
csp/pseudo/fpga/ normalized-fpga-11-11.xml	SAT TT=0.103	SAT TT=3.418 CHECKS=1539180 NODES=8471	SAT TT=1.122 CHECKS=2593 NODES=0	SAT TT=899.513	SAT TT=0.103 CHECKS=23182	SAT TT=0.149 CHECKS=42717	SAT TT=48.444 ASSIGNMENTS=687776	SAT TT=0.924 ASSIGNMENTS=81	SAT TT=0.986 CHECKS=4349 NODES=182	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=842.377 ASSIGNMENTS=3256280 CHECKS=751090000	SAT TT=849.179 ASSIGNMENTS=3256280 CHECKS=751090000	SAT TT=1.974	SAT TT=1.918	No data	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=217.837	SAT TT=0.572 ASSIGNMENTS=2096 CHECKS=465899	SAT TT=0.238 ASSIGNMENTS=1478 CHECKS=272798	SAT TT=5.238	No data	SAT TT=1.15	SAT TT=1.031
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/fpga/ normalized-fpga-12-10.xml	SAT TT=0.248	SAT TT=2.246 CHECKS=485940 NODES=10241	SAT TT=4.94 CHECKS=1748620 NODES=34316	SAT TT=892.112	SAT TT=0.248 CHECKS=74225	SAT TT=0.263 CHECKS=75337	SAT TT=32.826 ASSIGNMENTS=534094	SAT TT=1.508 ASSIGNMENTS=3170	SAT TT=1.082 CHECKS=22431 NODES=681	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=61.934 ASSIGNMENTS=319181 CHECKS=47496900	SAT TT=61.736 ASSIGNMENTS=319181 CHECKS=47496900	SAT TT=1.834	SAT TT=1.772	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.12	SAT TT=0.6 ASSIGNMENTS=2402 CHECKS=550230	? (TO) TT=1800.01	SAT TT=27.779	No data	SAT TT=238.015	SAT TT=0.936
csp/pseudo/fpga/ normalized-fpga-13-11.xml	SAT TT=0.414	SAT TT=4.556 CHECKS=1959720 NODES=18904	SAT TT=10.727 CHECKS=5540890 NODES=60162	SAT TT=896.141	SAT TT=0.418 CHECKS=116820	SAT TT=0.414 CHECKS=116734	SAT TT=281.34 ASSIGNMENTS=4077740	SAT TT=1.057 ASSIGNMENTS=436	SAT TT=1.335 CHECKS=72886 NODES=1420	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.13	SAT TT=1.94	SAT TT=2.14	No data	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.51 ASSIGNMENTS=1933 CHECKS=508338	? (TO) TT=1800.02	? (TO) TT=1800.17	No data	SAT TT=54.38	SAT TT=1.173
csp/pseudo/fpga/ normalized-fpga-14-12.xml	SAT TT=0.599	SAT TT=6.184 CHECKS=2708710 NODES=26881	SAT TT=10.174 CHECKS=5346440 NODES=35760	SAT TT=892.64	SAT TT=0.599 CHECKS=163920	SAT TT=2.056 CHECKS=570581	SAT TT=257.221 ASSIGNMENTS=3779120	SAT TT=1.367 ASSIGNMENTS=580	SAT TT=2.282 CHECKS=502873 NODES=3937	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=2.058	SAT TT=2.35	No data	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=2.787 ASSIGNMENTS=6271 CHECKS=2729220	? (TO) TT=1800.06	? (TO) TT=1800.15	No data	? (TO) TT=1800.04	SAT TT=1.242
csp/pseudo/fpga/ normalized-fpga-14-14.xml	SAT TT=0.4	SAT TT=7.391 CHECKS=3720990 NODES=11364	SAT TT=1.228 CHECKS=17739 NODES=0	SAT TT=897.856	SAT TT=0.403 CHECKS=101586	SAT TT=0.4 CHECKS=102879	SAT TT=281.432 ASSIGNMENTS=3266990	SAT TT=1.355 ASSIGNMENTS=134	SAT TT=1.319 CHECKS=20643 NODES=294	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=1646.34 ASSIGNMENTS=1728 CHECKS=500466	SAT TT=2.265	SAT TT=2.362	No data	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=9.226 ASSIGNMENTS=27739 CHECKS=8360460	SAT TT=0.44 ASSIGNMENTS=1728 CHECKS=500466	SAT TT=786.124	No data	SAT TT=18.648	SAT TT=1.677
csp/pseudo/fpga/ normalized-fpga-15-14.xml	SAT TT=0.673	SAT TT=41.549 CHECKS=29154300 NODES=57432	SAT TT=164.826 CHECKS=121277000 NODES=237929	SAT TT=915.463	SAT TT=0.673 CHECKS=166547	SAT TT=0.678 CHECKS=169488	SAT TT=1072.71 ASSIGNMENTS=13542700	SAT TT=1.476 ASSIGNMENTS=779	SAT TT=1.758 CHECKS=99455 NODES=902	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=2.492	SAT TT=2.607	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.12	SAT TT=16.295 ASSIGNMENTS=43526 CHECKS=15120000	? (TO) TT=1800.07	? (TO) TT=1800.14	No data	SAT TT=144.166	SAT TT=1.503
csp/pseudo/fpga/ normalized-fpga-20-18.xml	SAT TT=3.861	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=26.489 CHECKS=6110250	SAT TT=30.563 CHECKS=7127170	? (TO) TT=1800.07	SAT TT=3.861 ASSIGNMENTS=13085	SAT TT=488.436 CHECKS=451410000 NODES=486194	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=4.562	SAT TT=6.476	No data	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=198.63	No data	? (TO) TT=1800.07	SAT TT=4.73
csp/pseudo/fpga/ normalized-fpga-25-23.xml	SAT TT=3.817	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.09	SAT TT=148.618 CHECKS=30253500	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=322.582 ASSIGNMENTS=1223930	SAT TT=115.662 CHECKS=83178000 NODES=4889	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=50.395	SAT TT=87.1	No data	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? TT=253.506	No data	? (TO) TT=1800	SAT TT=3.817
csp/pseudo/fpga/ normalized-fpga-30-28.xml	SAT TT=5.074	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.14	SAT TT=5.342 ASSIGNMENTS=6892	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=1552.7	? (TO) TT=1800.06	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.01	? TT=309.57	No data	? (TO) TT=1800.02	SAT TT=5.074
csp/pseudo/fpga/ normalized-fpga-30-30.xml	SAT TT=3.288	? (TO) TT=1800.17	? (TO) TT=1800.15	SAT TT=1349.2	SAT TT=86.505 CHECKS=13296500	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=3.288 ASSIGNMENTS=646	SAT TT=767.231 CHECKS=1073840000 NODES=1350	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.22	No data	? (TO) TT=1800.02	SAT TT=6.841
csp/pseudo/fpga/ normalized-fpga-35-34.xml	SAT TT=10.837	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.04	SAT TT=262.674 CHECKS=18969900	? (TO) TT=1800.11	SAT TT=77.418 ASSIGNMENTS=135627	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.02	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.2	No data	? (TO) TT=1800.1	SAT TT=10.837
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/fpga/ normalized-fpga-35-35.xml	SAT TT=5.027	? (TO) TT=1800.12	? (TO) TT=1800.16	SAT TT=1346.36	SAT TT=184.1 CHECKS=21793500	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=5.027 ASSIGNMENTS=885	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	No data	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.05	? TT=1402.68	No data	? (TO) TT=1800.03	SAT TT=10.406
csp/pseudo/garden/ normalized-g-100x100.xml	SAT TT=1.391	SAT TT=23.335 CHECKS=20002 NODES=10000	SAT TT=26.992 CHECKS=20001 NODES=0	SAT TT=3.967	SAT TT=43.526 CHECKS=166909	SAT TT=38.154 CHECKS=167626	SAT TT=30.622 ASSIGNMENTS=6226	SAT TT=25.056 ASSIGNMENTS=6226	SAT TT=64.946 CHECKS=129270 NODES=10000	? TT=36.127 CHECKS=60679 NODES=0	SAT TT=36.901 CHECKS=1598420 NODES=203	SAT TT=1.759 ASSIGNMENTS=6715 CHECKS=260632	SAT TT=2.023 ASSIGNMENTS=6715 CHECKS=260632	SAT TT=124.925	SAT TT=118.284	No data	SAT TT=2.02 ASSIGNMENTS=6715 CHECKS=260632	SAT TT=1.391 ASSIGNMENTS=7033 CHECKS=265221	SAT TT=6.713	SAT TT=2.16 ASSIGNMENTS=6666 CHECKS=261790	SAT TT=2.477 ASSIGNMENTS=7022 CHECKS=265144	SAT TT=9.162	No data	SAT TT=3.968	SAT TT=4.056
csp/pseudo/ garden/ normalized-g-15x15.xml	SAT TT=0.029	SAT TT=1.257 CHECKS=452 NODES=225	SAT TT=1.042 CHECKS=452 NODES=0	SAT TT=0.104	SAT TT=0.041 CHECKS=3383	SAT TT=0.031 CHECKS=3317	SAT TT=0.98 ASSIGNMENTS=144	SAT TT=0.995 ASSIGNMENTS=144	SAT TT=0.991 CHECKS=2454 NODES=225	SAT TT=0.953 CHECKS=3903 NODES=1	SAT TT=0.945 CHECKS=4394 NODES=2	SAT TT=0.043 ASSIGNMENTS=154 CHECKS=5461	SAT TT=0.036 ASSIGNMENTS=154 CHECKS=5461	SAT TT=1.893	SAT TT=1.671	No data	SAT TT=0.03 ASSIGNMENTS=154 CHECKS=5461	SAT TT=0.029 ASSIGNMENTS=97 CHECKS=5098	SAT TT=0.651	SAT TT=0.04 ASSIGNMENTS=312 CHECKS=8475	SAT TT=0.031 ASSIGNMENTS=153 CHECKS=5467	SAT TT=2.062	No data	SAT TT=0.923	SAT TT=1.066
csp/pseudo/ garden/ normalized-g-2x2.xml	SAT TT=0.005	SAT TT=0.651 CHECKS=11 NODES=4	SAT TT=0.648 CHECKS=9 NODES=0	SAT TT=0.024	SAT TT=0.008 CHECKS=56	SAT TT=0.005 CHECKS=60	SAT TT=0.455 ASSIGNMENTS=3	SAT TT=0.509 ASSIGNMENTS=3	SAT TT=0.421 CHECKS=6 NODES=4	SAT TT=0.422 CHECKS=58 NODES=0	SAT TT=0.444 CHECKS=58 NODES=0	SAT TT=0.019 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.019 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.785	SAT TT=0.766	No data	SAT TT=0.006 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.005 ASSIGNMENTS=1 CHECKS=30	SAT TT=0.264	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.892	No data	SAT TT=0.481	SAT TT=0.442
csp/pseudo/ garden/ normalized-g-4x4.xml	SAT TT=0.006	SAT TT=0.702 CHECKS=33 NODES=16	SAT TT=0.683 CHECKS=33 NODES=0	SAT TT=0.029	SAT TT=0.008 CHECKS=200	SAT TT=0.007 CHECKS=244	SAT TT=0.592 ASSIGNMENTS=11	SAT TT=0.486 ASSIGNMENTS=11	SAT TT=0.506 CHECKS=86 NODES=16	SAT TT=0.51 CHECKS=264 NODES=0	SAT TT=0.514 CHECKS=264 NODES=0	SAT TT=0.018 ASSIGNMENTS=10 CHECKS=280	SAT TT=0.02 ASSIGNMENTS=10 CHECKS=280	SAT TT=1.008	SAT TT=0.964	No data	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=280	SAT TT=0.008 ASSIGNMENTS=9 CHECKS=254	SAT TT=0.293	SAT TT=0.008 ASSIGNMENTS=11 CHECKS=270	SAT TT=0.006 ASSIGNMENTS=10 CHECKS=280	SAT TT=0.896	No data	SAT TT=0.484	SAT TT=0.514
csp/pseudo/ garden/ normalized-g-7x7.xml	SAT TT=0.009	SAT TT=0.867 CHECKS=100 NODES=49	SAT TT=0.781 CHECKS=99 NODES=0	SAT TT=0.042	SAT TT=0.015 CHECKS=702	SAT TT=0.012 CHECKS=673	SAT TT=0.678 ASSIGNMENTS=31	SAT TT=0.689 ASSIGNMENTS=31	SAT TT=0.633 CHECKS=403 NODES=49	SAT TT=0.689 CHECKS=839 NODES=0	SAT TT=0.698 CHECKS=834 NODES=0	SAT TT=0.021 ASSIGNMENTS=33 CHECKS=1041	SAT TT=0.022 ASSIGNMENTS=33 CHECKS=1041	SAT TT=1.325	SAT TT=1.183	No data	SAT TT=0.01 ASSIGNMENTS=33 CHECKS=1041	SAT TT=0.009 ASSIGNMENTS=21 CHECKS=960	SAT TT=0.391	SAT TT=0.01 ASSIGNMENTS=30 CHECKS=1030	SAT TT=0.01 ASSIGNMENTS=33 CHECKS=1051	SAT TT=1.538	No data	SAT TT=0.635	SAT TT=0.574
csp/pseudo/ garden/ normalized-g-9x3.xml	SAT TT=0.006	SAT TT=0.718 CHECKS=56 NODES=27	SAT TT=0.737 CHECKS=56 NODES=0	SAT TT=0.033	SAT TT=0.011 CHECKS=382	SAT TT=0.006 CHECKS=337	SAT TT=0.512 ASSIGNMENTS=19	SAT TT=0.568 ASSIGNMENTS=19	SAT TT=0.562 CHECKS=176 NODES=27	SAT TT=0.624 CHECKS=483 NODES=1	SAT TT=0.535 CHECKS=457 NODES=0	SAT TT=0.019 ASSIGNMENTS=18 CHECKS=497	SAT TT=0.018 ASSIGNMENTS=18 CHECKS=497	SAT TT=1.165	SAT TT=1.041	No data	SAT TT=0.009 ASSIGNMENTS=18 CHECKS=497	SAT TT=0.008 ASSIGNMENTS=13 CHECKS=413	SAT TT=0.329	SAT TT=0.008 ASSIGNMENTS=21 CHECKS=488	SAT TT=0.009 ASSIGNMENTS=18 CHECKS=497	SAT TT=1.024	No data	SAT TT=0.556	SAT TT=0.524
csp/pseudo/ garden/ normalized-g-9x9.xml	SAT TT=0.011	SAT TT=0.867 CHECKS=164 NODES=81	SAT TT=0.828 CHECKS=164 NODES=0	SAT TT=0.052	SAT TT=0.02 CHECKS=1149	SAT TT=0.014 CHECKS=1180	SAT TT=0.713 ASSIGNMENTS=54	SAT TT=0.713 ASSIGNMENTS=54	SAT TT=0.752 CHECKS=766 NODES=81	SAT TT=0.744 CHECKS=1424 NODES=1	SAT TT=0.82 CHECKS=1506 NODES=1	SAT TT=0.025 ASSIGNMENTS=54 CHECKS=1829	SAT TT=0.025 ASSIGNMENTS=54 CHECKS=1829	SAT TT=1.316	SAT TT=1.365	No data	SAT TT=0.011 ASSIGNMENTS=54 CHECKS=1829	SAT TT=0.014 ASSIGNMENTS=33 CHECKS=1680	SAT TT=0.469	SAT TT=0.012 ASSIGNMENTS=58 CHECKS=1805	SAT TT=0.014 ASSIGNMENTS=55 CHECKS=1823	SAT TT=1.567	No data	SAT TT=0.663	SAT TT=0.684
csp/pseudoGLB/ normalized-43s-smv.xml	UNSAT TT=111.955	? TT=0.929	? TT=0.8	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	No data	No data	No data	? (problem) TT=1.593	? (problem) TT=3.653	? (TO) TT=1800.09	? (problem) TT=1474.75	? (problem) TT=1.591	? TT=1.845	No data	UNSAT TT=111.955	UNSAT TT=238.32
csp/pseudoGLB/ normalized-army12-21bt.xml		? TT=0.621	? TT=0.65	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.16	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? TT=0.818	No data	? (TO) TT=1800.06	? (TO) TT=1800.14
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-army12-21ls.xml		? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.05	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=0.819	No data	? (TO) TT=1800.01	? (TO) TT=1800.1
csp/pseudoGLB/ normalized-army13-24ls.xml		? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.01	? TT=0.828	No data	? (TO) TT=1800.04	? (TO) TT=1800.1
csp/pseudoGLB/ normalized-army9-12ls.xml	SAT TT=2.98	? (TO) TT=1800.13	? (TO) TT=1800.09	SAT TT=955.134	SAT TT=1169.67 CHECKS=451769000	? (TO) TT=1800.06	SAT TT=1739.74 ASSIGNMENTS=11510000	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=142.661	SAT TT=4.743 ASSIGNMENTS=15281 CHECKS=3547570	? (TO) TT=1800.03	? TT=0.77	No data	SAT TT=23.531	SAT TT=2.98
csp/pseudoGLB/ normalized-cache-inv10-ucl.xml	UNSAT TT=5.679	? TT=0.936	? TT=0.974	UNSAT TT=10.151	UNSAT TT=16.192 CHECKS=1935330	UNSAT TT=16.564 CHECKS=2361740	UNSAT TT=10.917 ASSIGNMENTS=0	UNSAT TT=14.308 ASSIGNMENTS=0	No data	No data	No data	? (problem) TT=18.937	UNSAT TT=29.304 ASSIGNMENTS=0	No data	No data	No data	? (problem) TT=94.054	? (problem) TT=226.705	UNSAT TT=5.679	? (problem) TT=458.7	? (problem) TT=10.137	? TT=2.548	No data	UNSAT TT=7.162	UNSAT TT=7.04
csp/pseudoGLB/ normalized-cache-inv12-ucl.xml	UNSAT TT=24.393	? TT=1.61	? TT=1.54	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.2	? (TO) TT=1800.13	No data	No data	No data	? (problem) TT=31.146	? (TO) TT=1800.08	No data	No data	No data	? (problem) TT=99.343	? (problem) TT=114.222	UNSAT TT=1514.22	? (TO) TT=1800.1	? (problem) TT=16.763	? TT=3.667	No data	UNSAT TT=24.393	UNSAT TT=25.602
csp/pseudoGLB/ normalized-chnl10-15-pb-cnf-cr.xml	UNSAT TT=0.074	UNSAT TT=1.9 CHECKS=68173 NODES=19735	UNSAT TT=2.331 CHECKS=108997 NODES=25607	? (TO) TT=1800.1	UNSAT TT=0.074 CHECKS=7852	UNSAT TT=0.104 CHECKS=17083	? (TO) TT=1800.1	? (TO) TT=1800.11	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=50.777	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=0.804	No data	UNSAT TT=16.295	UNSAT TT=6.202
csp/pseudoGLB/ normalized-chnl10-20-pb-cnf-cr.xml	UNSAT TT=0.105	UNSAT TT=3.153 CHECKS=75102 NODES=35388	UNSAT TT=3.496 CHECKS=92593 NODES=39340	? (TO) TT=1800.02	UNSAT TT=0.106 CHECKS=10219	UNSAT TT=0.105 CHECKS=8507	? (TO) TT=1800.12	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=61.773	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=0.763	No data	UNSAT TT=20.808	UNSAT TT=7.023
csp/pseudoGLB/ normalized-chnl15-20-pb-cnf-cr.xml	UNSAT TT=0.391	UNSAT TT=60.912 CHECKS=1960670 NODES=769275	UNSAT TT=140.354 CHECKS=6238600 NODES=1722070	? (TO) TT=1800.02	UNSAT TT=0.462 CHECKS=85632	UNSAT TT=0.391 CHECKS=66820	? (TO) TT=1800.08	? (TO) TT=1800.12	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=0.819	No data	? (TO) TT=1800.1	? (TO) TT=1800.11
csp/pseudoGLB/ normalized-chnl15-25-pb-cnf-cr.xml	UNSAT TT=0.63	UNSAT TT=123.762 CHECKS=3394620 NODES=1394070	UNSAT TT=223.337 CHECKS=6403000 NODES=2443880	? (TO) TT=1800.1	UNSAT TT=0.673 CHECKS=124985	UNSAT TT=0.63 CHECKS=121942	? (TO) TT=1800.09	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.03	? TT=0.877	No data	? (TO) TT=1800.12	? (TO) TT=1800.05
csp/pseudoGLB/ normalized-chnl35-40-pb-cnf-cr.xml	UNSAT TT=14.277	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=14.277 CHECKS=1842180	UNSAT TT=28.227 CHECKS=2505810	? (TO) TT=1800.11	? (TO) TT=1800.14	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.03	? TT=1.597	No data	? (TO) TT=1800.09	? (TO) TT=1800.01
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-chnl35-45-pb-cnf-cr.xml	UNSAT TT=19.312	? (TO) TT=1800.18	? (TO) TT=1800.17	? (TO) TT=1800.04	UNSAT TT=19.312 CHECKS=2267900	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.12	No data	No data	No data	? (TO) TT=1800	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? TT=1.669	No data	? (TO) TT=1800.1	? (TO) TT=1800.05
csp/pseudoGLB/ normalized-chnl40-45-pb-cnf-cr.xml	UNSAT TT=27.412	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.07	UNSAT TT=27.412 CHECKS=3209810	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.13	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=1.858	No data	? (TO) TT=1800.07	? (TO) TT=1800.01
csp/pseudoGLB/ normalized-chnl40-50-pb-cnf-cr.xml		? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.14	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07	? TT=1.939	No data	? (TO) TT=1800.06	? (TO) TT=1800.01
csp/pseudoGLB/ normalized-chnl50-60-pb-cnf-cr.xml		? (TO) TT=1800.1	? (TO) TT=1800.2	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.13	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=2.53	No data	? (TO) TT=1800.03	? (TO) TT=1800.06
csp/pseudoGLB/ normalized-dbst-v30-e350-d15-mw10-3.PB06.xml	SAT TT=32.668	? (MO) TT=21.624	? (MO) TT=20.626	SAT TT=882.268	? TT=24.447	? TT=22.253	? (MO) TT=56.845	? (MO) TT=72.231	No data	No data	No data	? (problem) TT=126.527	SAT TT=1102.15 ASSIGNMENTS=761 CHECKS=2641290	No data	No data	No data	SAT TT=69.859 ASSIGNMENTS=1143 CHECKS=26800700	SAT TT=364.402 ASSIGNMENTS=144336 CHECKS=165586000	? (MO) TT=215.65	SAT TT=96.513 ASSIGNMENTS=3292 CHECKS=52623000	SAT TT=32.668 ASSIGNMENTS=761 CHECKS=2641290	? TT=1.082	No data	? (MO) TT=189.01	? (MO) TT=361.134
csp/pseudoGLB/ normalized-elf-rf7-ucl.xml	UNSAT TT=1.461	? TT=0.704	? TT=0.832	? (TO) TT=1800.02	UNSAT TT=2.549 CHECKS=1589780	UNSAT TT=2.456 CHECKS=1551410	UNSAT TT=2.745 ASSIGNMENTS=760	UNSAT TT=2.497 ASSIGNMENTS=46	No data	No data	No data	UNSAT TT=8.874 ASSIGNMENTS=760	UNSAT TT=9.328 ASSIGNMENTS=760	No data	No data	No data	? (problem) TT=0.248	? (problem) TT=1.442	UNSAT TT=1.461	? (problem) TT=396.465	? (problem) TT=0.255	? TT=1.034	No data	UNSAT TT=2.755	UNSAT TT=4.226
csp/pseudoGLB/ normalized-fpga10-10-sat-pb-cnf-cr.xml	SAT TT=0.064	SAT TT=10.956 CHECKS=2516440 NODES=298884	SAT TT=7.515 CHECKS=2083110 NODES=174218	SAT TT=1794.12	SAT TT=0.129 CHECKS=29530	SAT TT=0.124 CHECKS=27874	SAT TT=4.62 ASSIGNMENTS=63895	SAT TT=0.638 ASSIGNMENTS=66	No data	No data	No data	SAT TT=62.499 ASSIGNMENTS=1174710 CHECKS=56932200	SAT TT=63.247 ASSIGNMENTS=1174710 CHECKS=56932200	No data	No data	No data	? (TO) TT=1800.06	SAT TT=494.505 ASSIGNMENTS=9836430 CHECKS=515575000	SAT TT=19.716	SAT TT=0.064 ASSIGNMENTS=1110 CHECKS=38055	SAT TT=50.565 ASSIGNMENTS=1174710 CHECKS=56932200	? TT=0.728	No data	SAT TT=1.125	SAT TT=1.177
csp/pseudoGLB/ normalized-fpga11-9-sat-pb-cnf-cr.xml	SAT TT=0.621	SAT TT=95.93 CHECKS=31372800 NODES=2720840	SAT TT=71.956 CHECKS=23961200 NODES=2007370	SAT TT=893.445	SAT TT=0.621 CHECKS=267981	SAT TT=0.773 CHECKS=347038	SAT TT=9.134 ASSIGNMENTS=135001	SAT TT=1.547 ASSIGNMENTS=5805	No data	No data	No data	SAT TT=519.224 ASSIGNMENTS=12547100 CHECKS=538253000	SAT TT=499.08 ASSIGNMENTS=12547100 CHECKS=538253000	No data	No data	No data	? (TO) TT=1800.05	SAT TT=50.819 ASSIGNMENTS=1146160 CHECKS=54569500	SAT TT=1627.88	SAT TT=2.363 ASSIGNMENTS=20286 CHECKS=2193560	SAT TT=511.315 ASSIGNMENTS=12547100 CHECKS=538253000	? TT=0.753	No data	SAT TT=0.95	SAT TT=0.971
csp/pseudoGLB/ normalized-fpga13-13-sat-pb-cnf-cr.xml	SAT TT=0.477	? (TO) TT=1800.15	SAT TT=1294.69 CHECKS=405977000 NODES=26011500	? (TO) TT=1800.1	SAT TT=0.519 CHECKS=142055	SAT TT=0.477 CHECKS=140126	SAT TT=51.261 ASSIGNMENTS=697509	SAT TT=0.763 ASSIGNMENTS=115	No data	No data	No data	? (TO) TT=1800.05	SAT TT=1717.79 ASSIGNMENTS=697509	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=0.562 ASSIGNMENTS=4592 CHECKS=314745	? (TO) TT=1800.1	? TT=0.721	No data	SAT TT=9.116	SAT TT=1.284
csp/pseudoGLB/ normalized-fpga14-12-sat-pb-cnf-cr.xml	SAT TT=0.826	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=898.458	SAT TT=1.024 CHECKS=341240	SAT TT=17.139 CHECKS=7053220	SAT TT=181.628 ASSIGNMENTS=2638800	SAT TT=0.826 ASSIGNMENTS=580	No data	No data	No data	SAT TT=1064.92 ASSIGNMENTS=17986500 CHECKS=970322000	SAT TT=1071.92 ASSIGNMENTS=17986500 CHECKS=970322000	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=1353.62 ASSIGNMENTS=6150600 CHECKS=1158530000	SAT TT=1057.32 ASSIGNMENTS=17986500 CHECKS=970322000	? TT=0.785	No data	? (TO) TT=1800.1	SAT TT=1.311
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-fpga14-13-sat-pb-cnf-cr.xml	SAT TT=0.66	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=1786.83	SAT TT=0.789 CHECKS=232522	SAT TT=0.66 CHECKS=184982	SAT TT=577.847 ASSIGNMENTS=7181960	SAT TT=0.97 ASSIGNMENTS=134	No data	No data	No data	SAT TT=1768.25 ASSIGNMENTS=25845000 CHECKS=1496540000	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=316.671 ASSIGNMENTS=2019240 CHECKS=185447000	? (TO) TT=1800.05	? TT=0.799	No data	SAT TT=13.375	SAT TT=1.381
csp/pseudoGLB/ normalized-fpga14-14-sat-pb-cnf-cr.xml	SAT TT=0.702	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	SAT TT=0.74 CHECKS=199492	SAT TT=0.702 CHECKS=186245	SAT TT=493.404 ASSIGNMENTS=6039580	SAT TT=0.979 ASSIGNMENTS=134	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=17.844 ASSIGNMENTS=105858 CHECKS=8282440	? (TO) TT=1800.03	? TT=0.787	No data	SAT TT=18.902	SAT TT=1.545
csp/pseudoGLB/ normalized-fpga20-20-sat-pb-cnf-cr.xml	SAT TT=1.067	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT TT=6.187 CHECKS=1542100	SAT TT=898.037 CHECKS=178471000	? (TO) TT=1800.06	SAT TT=1.067 ASSIGNMENTS=281	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=0.838	No data	? (TO) TT=1800.04	SAT TT=2.656
csp/pseudoGLB/ normalized-fpga25-24-sat-pb-cnf-cr.xml	SAT TT=3.997	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=24.412 CHECKS=5427660	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=11.213 ASSIGNMENTS=33636	No data	No data	No data	? (TO) TT=1800	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	? TT=0.938	No data	? (TO) TT=1800	SAT TT=3.997
csp/pseudoGLB/ normalized-fpga25-25-sat-pb-cnf-cr.xml	SAT TT=1.421	? (TO) TT=1800.19	? (TO) TT=1800.16	SAT TT=1344.02	SAT TT=23.048 CHECKS=5355780	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=1.421 ASSIGNMENTS=445	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=0.92	No data	? (TO) TT=1800.08	SAT TT=5.048
csp/pseudoGLB/ normalized-fpga30-30-sat-pb-cnf-cr.xml	SAT TT=2.156	? (TO) TT=1800.12	? (TO) TT=1800.18	SAT TT=1345.22	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=2.156 ASSIGNMENTS=646	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? TT=1.023	No data	? (TO) TT=1800.06	SAT TT=6.45
csp/pseudoGLB/ normalized-fpga35-34-sat-pb-cnf-cr.xml	SAT TT=10.776	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=81.418 ASSIGNMENTS=135627	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.01	? TT=1.264	No data	? (TO) TT=1800.07	SAT TT=10.776
csp/pseudoGLB/ normalized-ooo-rf8-ucl.xml	UNSAT TT=8.423	? TT=0.918	? TT=0.872	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.15	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	No data	No data	? (problem) TT=1.535	? (problem) TT=12.738	UNSAT TT=483.595	? (problem) TT=170.813	? (problem) TT=1.555	? TT=2.403	No data	UNSAT TT=8.423	UNSAT TT=14.45
csp/pseudoGLB/ normalized-ooo-tag12-ucl.xml	UNSAT TT=45.558	? TT=1.408	? TT=1.49	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.2	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.06	No data	No data	No data	? (problem) TT=4.722	? (problem) TT=34.524	? (TO) TT=1800.06	? (problem) TT=1760.55	? (problem) TT=4.759	? TT=3.558	No data	UNSAT TT=45.558	UNSAT TT=55.36
csp/pseudoGLB/ normalized-pigeon-cardinality-105-100.xml		? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.15	No data	No data	No data	? (TO) TT=1800	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? TT=3.219	No data	? (TO) TT=1800.03	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-pigeon-cardinality-15-10.xml	UNSAT TT=0.05	UNSAT TT=1.32 CHECKS=57416 NODES=15550	UNSAT TT=1.427 CHECKS=46460 NODES=18649	UNSAT TT=464.795	UNSAT TT=0.05 CHECKS=9362	UNSAT TT=0.055 CHECKS=10353	? (TO) TT=1800.08	? (TO) TT=1800.16	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=33.916	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=0.704	No data	UNSAT TT=81.191	UNSAT TT=361.502
csp/pseudoGLB/ normalized-pigeon-cardinality-25-20.xml	UNSAT TT=0.765	UNSAT TT=1371.69 CHECKS=99863900 NODES=22092500	? (TO) TT=1800.17	? (TO) TT=1800.04	UNSAT TT=0.765 CHECKS=137091	UNSAT TT=0.807 CHECKS=145695	? (TO) TT=1800.12	? (TO) TT=1800.13	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=0.826	No data	? (TO) TT=1800.11	? (TO) TT=1800.07
csp/pseudoGLB/ normalized-pigeon-cardinality-55-50.xml		? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.13	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? TT=1.504	No data	? (TO) TT=1800.02	? (TO) TT=1800.01
csp/pseudoGLB/ normalized-pigeon-cardinality-71-70.xml		? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=2.257	No data	? (TO) TT=1800.03	? (TO) TT=1800.09
csp/pseudoGLB/ normalized-pigeon-cardinality-75-70.xml		? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.13	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.01	? TT=2.517	No data	? (TO) TT=1800.07	? (TO) TT=1800.01
csp/pseudoGLB/ normalized-pigeon-cardinality-95-90.xml		? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.13	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=2.502	No data	? (TO) TT=1800.02	? (TO) TT=1800.04
csp/pseudoGLB/ normalized-pigeon-clauses-45-40.xml		? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.11	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.09	? TT=1.291	No data	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/pseudoGLB/ normalized-pigeon-clauses-65-60.xml		? (MO) TT=22.846	? (MO) TT=22.743	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.41	? (TO) TT=1800.3	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.13	? TT=2.079	No data	? (TO) TT=1800.04	? (TO) TT=1800.04
csp/pseudoGLB/ normalized-pigeon-clauses-71-70.xml		? (MO) TT=11.702	? (MO) TT=9.477	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.11	? (TO) TT=1800.25	? (TO) TT=1800.7	No data	No data	No data	? (MO) TT=1594.71	? (MO) TT=1101.75	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.09	? TT=2.291	No data	? (TO) TT=1800.08	? (TO) TT=1800.09
csp/pseudoGLB/ normalized-pigeon-clauses-91-90.xml		? (MO) TT=18.266	? (MO) TT=20.523	? (TO) TT=1800.09	? TT=23.043	? TT=22.428	? (problem) TT=291.593	? (MO) TT=76.881	No data	No data	No data	? (TO) TT=1800.03	? (problem) TT=1539.62	No data	No data	No data	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.19	? (TO) TT=1800.1	? TT=2.494	No data	? (TO) TT=1800.05	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-pigeon-clauses-95-90.xml		? (MO) TT=21.777	? (MO) TT=21.308	? (TO) TT=1800.06	? TT=24.517	? TT=22.257	? (problem) TT=265.636	? (problem) TT=270.813	No data	No data	No data	? (problem) TT=1591.42	? (problem) TT=1087.55	No data	No data	No data	? (TO) TT=1800.15	? (TO) TT=1800.13	? (exit code) TT=82.039	? (TO) TT=1800.15	? (TO) TT=1800.12	? TT=2.491	No data	? (TO) TT=1800.08	? (MO) TT=6.298
csp/pseudoGLB/ normalized-ppp:1-9-16-19.xml	SAT TT=1429.89	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.11	? (exit code) TT=15.662	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=1.975	No data	SAT TT=1429.89	? (TO) TT=1800.04
csp/pseudoGLB/ normalized-reduced-cuww2.xml	SAT TT=0.01	? (TO) TT=1800.13	? (TO) TT=1800.09	SAT TT=0.038	SAT TT=3.747 CHECKS=189255	SAT TT=5.059 CHECKS=270004	SAT TT=0.877 ASSIGNMENTS=6983	SAT TT=0.441 ASSIGNMENTS=51	No data	No data	No data	SAT TT=0.127 ASSIGNMENTS=1525 CHECKS=16736	SAT TT=0.117 ASSIGNMENTS=1525 CHECKS=16736	No data	No data	No data	SAT TT=0.117 ASSIGNMENTS=1525 CHECKS=16736	SAT TT=0.019 ASSIGNMENTS=424 CHECKS=1793	SAT TT=0.347	SAT TT=0.016 ASSIGNMENTS=202 CHECKS=1272	SAT TT=0.01 ASSIGNMENTS=57 CHECKS=203	? TT=0.654	No data	? TT=1478.16	? TT=466.925
csp/pseudoGLB/ normalized-reduced-prob10.xml	SAT TT=0.015	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT TT=0.038	SAT TT=0.084 CHECKS=2024	SAT TT=0.085 CHECKS=2008	SAT TT=0.426 ASSIGNMENTS=132	SAT TT=0.474 ASSIGNMENTS=171	No data	No data	No data	SAT TT=0.027 ASSIGNMENTS=131 CHECKS=728	SAT TT=0.026 ASSIGNMENTS=131 CHECKS=728	No data	No data	No data	SAT TT=0.015 ASSIGNMENTS=131 CHECKS=728	SAT TT=0.018 ASSIGNMENTS=223 CHECKS=815	SAT TT=0.328	SAT TT=0.017 ASSIGNMENTS=175 CHECKS=1035	SAT TT=0.024 ASSIGNMENTS=296 CHECKS=1834	? TT=0.697	No data	? TT=895.488	? TT=912.307
csp/pseudoGLB/ normalized-reduced-prob1.xml	SAT TT=0.017	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=0.034	SAT TT=0.107 CHECKS=3642	SAT TT=0.106 CHECKS=3622	SAT TT=0.469 ASSIGNMENTS=197	SAT TT=0.517 ASSIGNMENTS=198	No data	No data	No data	SAT TT=0.032 ASSIGNMENTS=197 CHECKS=1549	SAT TT=0.031 ASSIGNMENTS=197 CHECKS=1549	No data	No data	No data	SAT TT=0.02 ASSIGNMENTS=197 CHECKS=1549	SAT TT=0.021 ASSIGNMENTS=377 CHECKS=1658	SAT TT=0.32	SAT TT=0.033 ASSIGNMENTS=468 CHECKS=3104	SAT TT=0.017 ASSIGNMENTS=258 CHECKS=1304	? TT=0.704	No data	? TT=801.198	? TT=787.216
csp/pseudoGLB/ normalized-reduced-prob3.xml	SAT TT=0.019	? (TO) TT=1800.14	? (TO) TT=1800.1	SAT TT=0.035	SAT TT=0.231 CHECKS=14987	SAT TT=0.228 CHECKS=15344	SAT TT=0.519 ASSIGNMENTS=1451	SAT TT=0.656 ASSIGNMENTS=1904	No data	No data	No data	SAT TT=0.031 ASSIGNMENTS=301 CHECKS=2409	SAT TT=0.032 ASSIGNMENTS=301 CHECKS=2409	No data	No data	No data	SAT TT=0.019 ASSIGNMENTS=301 CHECKS=2409	SAT TT=0.133 ASSIGNMENTS=5835 CHECKS=28841	SAT TT=0.299	SAT TT=0.027 ASSIGNMENTS=610 CHECKS=4245	SAT TT=0.067 ASSIGNMENTS=1650 CHECKS=12596	? TT=0.702	No data	? TT=241.347	? TT=243.218
csp/pseudoGLB/ normalized-reduced-prob4.xml	SAT TT=0.015	? (TO) TT=1800.11	? (TO) TT=1800.08	SAT TT=0.035	SAT TT=0.13 CHECKS=4198	SAT TT=0.232 CHECKS=7880	SAT TT=0.474 ASSIGNMENTS=220	SAT TT=0.555 ASSIGNMENTS=101	No data	No data	No data	SAT TT=0.034 ASSIGNMENTS=220 CHECKS=1808	SAT TT=0.031 ASSIGNMENTS=220 CHECKS=1808	No data	No data	No data	SAT TT=0.02 ASSIGNMENTS=220 CHECKS=1808	SAT TT=0.029 ASSIGNMENTS=691 CHECKS=3029	SAT TT=0.363	SAT TT=0.029 ASSIGNMENTS=345 CHECKS=2850	SAT TT=0.015 ASSIGNMENTS=123 CHECKS=791	? TT=0.683	No data	? TT=332.609	? TT=327.75
csp/pseudoGLB/ normalized-robin10.xml	SAT TT=7.256	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=24.253 ASSIGNMENTS=60110	SAT TT=10.722 ASSIGNMENTS=8653	No data	No data	No data	SAT TT=27.081 ASSIGNMENTS=11347 CHECKS=4560900	SAT TT=27.189 ASSIGNMENTS=11347 CHECKS=4560900	No data	No data	No data	SAT TT=29.481 ASSIGNMENTS=15635 CHECKS=7028610	SAT TT=844.801 ASSIGNMENTS=568788 CHECKS=217775000	SAT TT=1532.03	SAT TT=1397.68 ASSIGNMENTS=819382 CHECKS=346444000	SAT TT=19.454 ASSIGNMENTS=11347 CHECKS=4560900	? TT=1.235	No data	SAT TT=7.256	SAT TT=47.115
csp/pseudoGLB/ normalized-robin12.xml	SAT TT=53.734	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=280.36 ASSIGNMENTS=399560	? (TO) TT=1800.14	No data	No data	No data	? (TO) TT=1800.01	SAT TT=1189.42 ASSIGNMENTS=399560	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.06	? TT=1.929	No data	SAT TT=53.734	SAT TT=543.542
csp/pseudoGLB/ normalized-robin16.xml		? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1819.67	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.12	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.11	? TT=3.264	No data	? (TO) TT=1800.07	? (TO) TT=1800.04
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-t2001-13queen13-1110966688.xml	UNSAT TT=2.307	UNSAT TT=1395.12 CHECKS=292605000 NODES=42673900	UNSAT TT=229.203 CHECKS=51231100 NODES=7317180	UNSAT TT=9.488	UNSAT TT=290.62 CHECKS=22616200	UNSAT TT=300.481 CHECKS=21755200	UNSAT TT=13.914 ASSIGNMENTS=117121	UNSAT TT=28.806 ASSIGNMENTS=251948	No data	No data	No data	UNSAT TT=85.92 ASSIGNMENTS=275090 CHECKS=25961000	UNSAT TT=1311.56 ASSIGNMENTS=42673900 CHECKS=292605000	No data	No data	No data	UNSAT TT=30.105 ASSIGNMENTS=109917 CHECKS=9123780	UNSAT TT=22.303 ASSIGNMENTS=98767 CHECKS=7364380	UNSAT TT=2.307	UNSAT TT=58.422 ASSIGNMENTS=213355 CHECKS=16719700	UNSAT TT=79.272 ASSIGNMENTS=275090 CHECKS=25961000	? TT=0.723	No data	UNSAT TT=24.139	UNSAT TT=30.996
csp/pseudoGLB/ normalized-t2001-13queen13-1110967523.xml	UNSAT TT=3.314	UNSAT TT=465.664 CHECKS=84608400 NODES=15260200	UNSAT TT=1083.03 CHECKS=230575000 NODES=34998500	UNSAT TT=11.908	UNSAT TT=298.003 CHECKS=22902500	UNSAT TT=145.048 CHECKS=9546150	UNSAT TT=44.334 ASSIGNMENTS=441003	UNSAT TT=40.513 ASSIGNMENTS=335533	No data	No data	No data	UNSAT TT=156.586 ASSIGNMENTS=486776 CHECKS=45075400	UNSAT TT=506.596 ASSIGNMENTS=15260200 CHECKS=84608400	No data	No data	No data	UNSAT TT=47.977 ASSIGNMENTS=194708 CHECKS=14772000	UNSAT TT=41.11 ASSIGNMENTS=179201 CHECKS=13735900	UNSAT TT=3.314	UNSAT TT=137.075 ASSIGNMENTS=516401 CHECKS=39724300	UNSAT TT=147.742 ASSIGNMENTS=486776 CHECKS=45075400	? TT=0.744	No data	UNSAT TT=48.603	UNSAT TT=63.647
csp/pseudoGLB/ normalized-t2001-13queen13-1110968898.xml	UNSAT TT=2.48	UNSAT TT=807.428 CHECKS=141797000 NODES=26679200	UNSAT TT=304.532 CHECKS=54367000 NODES=9896390	UNSAT TT=11.469	UNSAT TT=255.713 CHECKS=21956900	UNSAT TT=204.766 CHECKS=14577300	UNSAT TT=25.927 ASSIGNMENTS=222762	UNSAT TT=40.825 ASSIGNMENTS=327491	No data	No data	No data	UNSAT TT=98.231 ASSIGNMENTS=289749 CHECKS=27446900	UNSAT TT=823.616 ASSIGNMENTS=26679200 CHECKS=141797000	No data	No data	No data	UNSAT TT=43.5 ASSIGNMENTS=168219 CHECKS=13152700	UNSAT TT=33.372 ASSIGNMENTS=139025 CHECKS=10895000	UNSAT TT=2.48	UNSAT TT=87.122 ASSIGNMENTS=373447 CHECKS=26537900	UNSAT TT=90.092 ASSIGNMENTS=289749 CHECKS=27446900	? TT=0.746	No data	UNSAT TT=38.77	UNSAT TT=43.165
csp/pseudoGLB/ normalized-t2001-13queen13-1110969577.xml	UNSAT TT=2.413	UNSAT TT=662.843 CHECKS=119791000 NODES=19731700	UNSAT TT=758.389 CHECKS=153063000 NODES=22348100	UNSAT TT=7.672	UNSAT TT=265.654 CHECKS=21691800	UNSAT TT=136.159 CHECKS=8752900	UNSAT TT=26.754 ASSIGNMENTS=226749	UNSAT TT=30.924 ASSIGNMENTS=243695	No data	No data	No data	UNSAT TT=93.765 ASSIGNMENTS=286366 CHECKS=25823600	UNSAT TT=625.594 ASSIGNMENTS=19731700 CHECKS=119791000	No data	No data	No data	UNSAT TT=22.554 ASSIGNMENTS=82058 CHECKS=6767800	UNSAT TT=21.953 ASSIGNMENTS=92616 CHECKS=6742640	UNSAT TT=2.413	UNSAT TT=95.782 ASSIGNMENTS=361527 CHECKS=27320100	UNSAT TT=78.812 ASSIGNMENTS=286366 CHECKS=25823600	? TT=0.73	No data	UNSAT TT=30.983	UNSAT TT=37.033
csp/pseudoGLB/ normalized-t2001-13queen13-1110970631.xml	UNSAT TT=2.765	UNSAT TT=1101.25 CHECKS=233661000 NODES=33202400	UNSAT TT=227.236 CHECKS=41533900 NODES=6734240	UNSAT TT=8.462	UNSAT TT=332.019 CHECKS=24128200	UNSAT TT=285.776 CHECKS=17160200	UNSAT TT=33.716 ASSIGNMENTS=296808	UNSAT TT=28.484 ASSIGNMENTS=244600	No data	No data	No data	UNSAT TT=112.491 ASSIGNMENTS=387780 CHECKS=32023400	UNSAT TT=1028.66 ASSIGNMENTS=33202400 CHECKS=233661000	No data	No data	No data	UNSAT TT=39.239 ASSIGNMENTS=167989 CHECKS=11979000	UNSAT TT=34.286 ASSIGNMENTS=155012 CHECKS=10595100	UNSAT TT=2.765	UNSAT TT=120.876 ASSIGNMENTS=490107 CHECKS=34302200	UNSAT TT=103.883 ASSIGNMENTS=387780 CHECKS=32023400	? TT=0.712	No data	UNSAT TT=25.678	UNSAT TT=32.205
csp/pseudoGLB/ normalized-t2001-13queen13-1110972763.xml	UNSAT TT=3.706	UNSAT TT=946.865 CHECKS=170204000 NODES=28873700	UNSAT TT=904.206 CHECKS=177285000 NODES=28596300	UNSAT TT=11.471	UNSAT TT=217.396 CHECKS=14979000	UNSAT TT=497.301 CHECKS=38525800	UNSAT TT=13.869 ASSIGNMENTS=118057	UNSAT TT=30.018 ASSIGNMENTS=238012	No data	No data	No data	UNSAT TT=69.284 ASSIGNMENTS=217209 CHECKS=20270500	UNSAT TT=879.271 ASSIGNMENTS=28873700 CHECKS=170204000	No data	No data	No data	UNSAT TT=34.942 ASSIGNMENTS=131599 CHECKS=10574600	UNSAT TT=25.919 ASSIGNMENTS=103639 CHECKS=7922360	UNSAT TT=3.706	UNSAT TT=123.827 ASSIGNMENTS=469763 CHECKS=35484000	UNSAT TT=62.248 ASSIGNMENTS=217209 CHECKS=20270500	? TT=0.738	No data	UNSAT TT=31.463	UNSAT TT=36.494
csp/pseudoGLB/ normalized-t2001-13queen13-1110972958.xml	SAT TT=0.457	SAT TT=175.997 CHECKS=31677500 NODES=5341920	SAT TT=431.39 CHECKS=94251000 NODES=12843600	SAT TT=6.314	SAT TT=18.533 CHECKS=1228020	SAT TT=22.251 CHECKS=1549060	SAT TT=16.61 ASSIGNMENTS=139594	SAT TT=3.01 ASSIGNMENTS=16536	No data	No data	No data	SAT TT=7.494 ASSIGNMENTS=1312 CHECKS=132791	SAT TT=170.292 ASSIGNMENTS=5341920 CHECKS=31677500	No data	No data	No data	SAT TT=41.337 ASSIGNMENTS=162503 CHECKS=13497600	SAT TT=24.241 ASSIGNMENTS=100804 CHECKS=8059580	SAT TT=3.452	SAT TT=7.019 ASSIGNMENTS=28745 CHECKS=1989630	SAT TT=0.457 ASSIGNMENTS=1312 CHECKS=132791	? TT=0.724	No data	SAT TT=19.718	SAT TT=30.023
csp/pseudoGLB/ normalized-t2001-13queen13-1110973670.xml	UNSAT TT=2.747	UNSAT TT=1259.18 CHECKS=265073000 NODES=39310300	UNSAT TT=1094.69 CHECKS=241123000 NODES=32724500	UNSAT TT=13.079	UNSAT TT=265.448 CHECKS=20769400	UNSAT TT=190.481 CHECKS=13205900	UNSAT TT=25.014 ASSIGNMENTS=210721	UNSAT TT=38.805 ASSIGNMENTS=348239	No data	No data	No data	UNSAT TT=60.172 ASSIGNMENTS=158900 CHECKS=15713000	UNSAT TT=1206.59 ASSIGNMENTS=39310300 CHECKS=265073000	No data	No data	No data	UNSAT TT=22.753 ASSIGNMENTS=88517 CHECKS=7358070	UNSAT TT=15.226 ASSIGNMENTS=62836 CHECKS=4994090	UNSAT TT=2.747	UNSAT TT=153.655 ASSIGNMENTS=662250 CHECKS=46548000	UNSAT TT=52.91 ASSIGNMENTS=158900 CHECKS=15713000	? TT=0.744	No data	UNSAT TT=29.467	UNSAT TT=47.967
csp/pseudoGLB/ normalized-t2001-13queen13-1110975607.xml	UNSAT TT=1.907	UNSAT TT=315.152 CHECKS=77290800 NODES=10162000	UNSAT TT=211.581 CHECKS=35757300 NODES=6276880	UNSAT TT=11.892	UNSAT TT=117.815 CHECKS=7250890	UNSAT TT=286.032 CHECKS=17730200	UNSAT TT=10.53 ASSIGNMENTS=86346	UNSAT TT=27.954 ASSIGNMENTS=238556	No data	No data	No data	UNSAT TT=56.879 ASSIGNMENTS=156452 CHECKS=14813800	UNSAT TT=325.434 ASSIGNMENTS=10162000 CHECKS=77290800	No data	No data	No data	UNSAT TT=22.05 ASSIGNMENTS=88367 CHECKS=7052390	UNSAT TT=13.762 ASSIGNMENTS=60699 CHECKS=4162810	UNSAT TT=1.907	UNSAT TT=90.262 ASSIGNMENTS=359097 CHECKS=25640500	UNSAT TT=45.874 ASSIGNMENTS=156452 CHECKS=14813800	? TT=0.72	No data	UNSAT TT=19.868	UNSAT TT=25.341
csp/pseudoGLB/ normalized-t2001-13queen13-1110976730.xml	UNSAT TT=7.307	UNSAT TT=867.439 CHECKS=146101000 NODES=28151600	UNSAT TT=763.369 CHECKS=152851000 NODES=23281900	UNSAT TT=11.182	UNSAT TT=871.176 CHECKS=74821200	UNSAT TT=485.946 CHECKS=38417900	UNSAT TT=26.964 ASSIGNMENTS=224839	UNSAT TT=38.423 ASSIGNMENTS=337438	No data	No data	No data	UNSAT TT=325.652 ASSIGNMENTS=1160150 CHECKS=97597000	UNSAT TT=887.441 ASSIGNMENTS=28151600 CHECKS=146101000	No data	No data	No data	UNSAT TT=72.51 ASSIGNMENTS=291373 CHECKS=22181100	UNSAT TT=60.103 ASSIGNMENTS=252358 CHECKS=19689600	UNSAT TT=7.307	UNSAT TT=169.358 ASSIGNMENTS=651168 CHECKS=48911500	UNSAT TT=316.725 ASSIGNMENTS=1160150 CHECKS=97597000	? TT=0.747	No data	UNSAT TT=58.235	UNSAT TT=88.155
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-t2001-13queen13-1110976935.xml	UNSAT TT=2.841	UNSAT TT=236.513 CHECKS=47953100 NODES=7544040	UNSAT TT=653.411 CHECKS=125229000 NODES=21035900	UNSAT TT=11.79	UNSAT TT=187.841 CHECKS=13658600	UNSAT TT=293.467 CHECKS=21472100	UNSAT TT=14.392 ASSIGNMENTS=117566	UNSAT TT=53.06 ASSIGNMENTS=447053	No data	No data	No data	UNSAT TT=116.975 ASSIGNMENTS=375027 CHECKS=33285600	UNSAT TT=239.683 ASSIGNMENTS=7544040 CHECKS=47953100	No data	No data	No data	UNSAT TT=32.766 ASSIGNMENTS=121612 CHECKS=9970130	UNSAT TT=23.352 ASSIGNMENTS=98157 CHECKS=7092340	UNSAT TT=2.841	UNSAT TT=96.12 ASSIGNMENTS=390558 CHECKS=27418300	UNSAT TT=100.686 ASSIGNMENTS=375027 CHECKS=33285600	? TT=0.72	No data	UNSAT TT=32.704	UNSAT TT=36.483
csp/pseudoGLB/ normalized-t2001-13queen13-1110977464.xml	SAT TT=2.312	SAT TT=178.225 CHECKS=27265700 NODES=5327440	SAT TT=803.016 CHECKS=138050000 NODES=24512800	SAT TT=2.312	SAT TT=189.985 CHECKS=16862800	SAT TT=149.717 CHECKS=11310000	SAT TT=31.03 ASSIGNMENTS=271875	SAT TT=5.844 ASSIGNMENTS=40056	No data	No data	No data	SAT TT=70.314 ASSIGNMENTS=205435 CHECKS=19199300	SAT TT=170.211 ASSIGNMENTS=5327440 CHECKS=27265700	No data	No data	No data	SAT TT=15.998 ASSIGNMENTS=59643 CHECKS=4854110	SAT TT=19.767 ASSIGNMENTS=86817 CHECKS=6570960	SAT TT=2.362	SAT TT=23.29 ASSIGNMENTS=104584 CHECKS=7079100	SAT TT=63.021 ASSIGNMENTS=205435 CHECKS=19199300	? TT=0.695	No data	SAT TT=14.773	SAT TT=32.946
csp/pseudoGLB/ normalized-t2001-13queen13-1111212923.xml	UNSAT TT=4.294	UNSAT TT=578.644 CHECKS=106337000 NODES=19015400	UNSAT TT=251.131 CHECKS=41066500 NODES=7604240	UNSAT TT=8.673	UNSAT TT=376.384 CHECKS=28001700	UNSAT TT=482.075 CHECKS=36170300	UNSAT TT=17.773 ASSIGNMENTS=160627	UNSAT TT=40.477 ASSIGNMENTS=326001	No data	No data	No data	UNSAT TT=132.923 ASSIGNMENTS=500784 CHECKS=40872700	UNSAT TT=582.02 ASSIGNMENTS=19015400 CHECKS=106337000	No data	No data	No data	UNSAT TT=48.756 ASSIGNMENTS=201462 CHECKS=15055400	UNSAT TT=37.423 ASSIGNMENTS=152267 CHECKS=11484100	UNSAT TT=4.294	UNSAT TT=80.049 ASSIGNMENTS=291113 CHECKS=22871400	UNSAT TT=133.954 ASSIGNMENTS=500784 CHECKS=40872700	? TT=0.739	No data	UNSAT TT=28.165	UNSAT TT=33.94
csp/pseudoGLB/ normalized-t2001-13queen13-1111213670.xml	UNSAT TT=2.469	UNSAT TT=421.74 CHECKS=89258400 NODES=13635700	? (TO) TT=1800.07	UNSAT TT=9.997	UNSAT TT=146.614 CHECKS=8783090	UNSAT TT=298.953 CHECKS=18687800	UNSAT TT=15.184 ASSIGNMENTS=112336	UNSAT TT=41.704 ASSIGNMENTS=329741	No data	No data	No data	UNSAT TT=92.497 ASSIGNMENTS=280918 CHECKS=25829200	UNSAT TT=427.657 ASSIGNMENTS=13635700 CHECKS=89258400	No data	No data	No data	UNSAT TT=28.871 ASSIGNMENTS=112855 CHECKS=8829930	UNSAT TT=21.167 ASSIGNMENTS=87347 CHECKS=6455680	UNSAT TT=2.469	UNSAT TT=69.761 ASSIGNMENTS=284668 CHECKS=19964000	UNSAT TT=84.507 ASSIGNMENTS=280918 CHECKS=25829200	? TT=0.709	No data	UNSAT TT=20.686	UNSAT TT=38.525
csp/pseudoGLB/ normalized-t2001-13queen13-1111217374.xml	SAT TT=0.936	SAT TT=91.962 CHECKS=17509700 NODES=2835970	SAT TT=848.461 CHECKS=202373000 NODES=26024700	SAT TT=1.459	SAT TT=34.147 CHECKS=2858820	SAT TT=17.003 CHECKS=1483850	SAT TT=3.217 ASSIGNMENTS=19611	SAT TT=9.199 ASSIGNMENTS=75279	No data	No data	No data	SAT TT=59.504 ASSIGNMENTS=152331 CHECKS=16018500	SAT TT=94.62 ASSIGNMENTS=2835970 CHECKS=17509700	No data	No data	No data	SAT TT=6.57 ASSIGNMENTS=22384 CHECKS=1981250	SAT TT=4.149 ASSIGNMENTS=22752 CHECKS=1291760	SAT TT=0.936	SAT TT=23.987 ASSIGNMENTS=92135 CHECKS=6753460	SAT TT=51.784 ASSIGNMENTS=152331 CHECKS=16018500	? TT=0.744	No data	SAT TT=2.641	SAT TT=5.706
csp/pseudoGLB/ normalized-t2001-13queen13-1111219348.xml	UNSAT TT=3.272	UNSAT TT=619.328 CHECKS=110378000 NODES=20147400	UNSAT TT=757.213 CHECKS=129516000 NODES=22396400	UNSAT TT=9.78	UNSAT TT=382.321 CHECKS=31484900	UNSAT TT=514.205 CHECKS=35984000	UNSAT TT=17.508 ASSIGNMENTS=158596	UNSAT TT=42.42 ASSIGNMENTS=351131	No data	No data	No data	UNSAT TT=87.812 ASSIGNMENTS=282151 CHECKS=26144700	UNSAT TT=622.441 ASSIGNMENTS=20147400 CHECKS=110378000	No data	No data	No data	UNSAT TT=40.787 ASSIGNMENTS=147054 CHECKS=12316600	UNSAT TT=27.29 ASSIGNMENTS=116625 CHECKS=9019550	UNSAT TT=3.272	UNSAT TT=74.082 ASSIGNMENTS=284619 CHECKS=21213700	UNSAT TT=86.662 ASSIGNMENTS=282151 CHECKS=26144700	? TT=0.719	No data	UNSAT TT=26.66	UNSAT TT=40.928
csp/pseudoGLB/ normalized-t2001-13queen13-1111220019.xml	UNSAT TT=2.606	UNSAT TT=850.313 CHECKS=153641000 NODES=25432100	UNSAT TT=339.153 CHECKS=63063900 NODES=10715100	UNSAT TT=10.076	UNSAT TT=234.144 CHECKS=18832000	UNSAT TT=289.69 CHECKS=19822600	UNSAT TT=18.85 ASSIGNMENTS=168426	UNSAT TT=37.818 ASSIGNMENTS=307871	No data	No data	No data	UNSAT TT=111.744 ASSIGNMENTS=364091 CHECKS=34111300	UNSAT TT=792.91 ASSIGNMENTS=25432100 CHECKS=153641000	No data	No data	No data	UNSAT TT=34.952 ASSIGNMENTS=139124 CHECKS=11319000	UNSAT TT=27.71 ASSIGNMENTS=105706 CHECKS=8443160	UNSAT TT=2.606	UNSAT TT=102.656 ASSIGNMENTS=385536 CHECKS=29327800	UNSAT TT=112.567 ASSIGNMENTS=364091 CHECKS=34111300	? TT=0.698	No data	UNSAT TT=28.286	UNSAT TT=39.71
csp/pseudoGLB/ normalized-t2001-13queen13-1111221203.xml	UNSAT TT=5.056	? (TO) TT=1800.12	UNSAT TT=714.867 CHECKS=156838000 NODES=23018000	UNSAT TT=9.805	UNSAT TT=197.623 CHECKS=14966600	UNSAT TT=298.528 CHECKS=21528600	UNSAT TT=19.492 ASSIGNMENTS=169305	UNSAT TT=37.037 ASSIGNMENTS=321796	No data	No data	No data	UNSAT TT=145.937 ASSIGNMENTS=478174 CHECKS=43187900	UNSAT TT=1650.62 ASSIGNMENTS=478174 CHECKS=43187900	No data	No data	No data	UNSAT TT=38.553 ASSIGNMENTS=159067 CHECKS=12667600	UNSAT TT=23.757 ASSIGNMENTS=94395 CHECKS=7362220	UNSAT TT=5.056	UNSAT TT=201.693 ASSIGNMENTS=863676 CHECKS=62983300	UNSAT TT=130.875 ASSIGNMENTS=478174 CHECKS=43187900	? TT=0.695	No data	UNSAT TT=29.767	UNSAT TT=42.449
csp/pseudoGLB/ normalized-t2001-13queen13-1111221953.xml	SAT TT=1.121	SAT TT=815.181 CHECKS=167403000 NODES=24725800	SAT TT=1051.76 CHECKS=232429000 NODES=34804100	SAT TT=2.227	SAT TT=42.228 CHECKS=2876040	SAT TT=99.973 CHECKS=6552900	SAT TT=15.983 ASSIGNMENTS=144314	SAT TT=6.885 ASSIGNMENTS=50427	No data	No data	No data	SAT TT=38.313 ASSIGNMENTS=116881 CHECKS=10359200	SAT TT=761.786 ASSIGNMENTS=24725800 CHECKS=167403000	No data	No data	No data	SAT TT=15.691 ASSIGNMENTS=62768 CHECKS=4828570	SAT TT=25.639 ASSIGNMENTS=115226 CHECKS=8498340	SAT TT=1.121	SAT TT=86.655 ASSIGNMENTS=373039 CHECKS=26555100	SAT TT=31.261 ASSIGNMENTS=116881 CHECKS=10359200	? TT=0.74	No data	SAT TT=18.772	SAT TT=24.478
csp/pseudoGLB/ normalized-t2001-13queen13-1111222257.xml	UNSAT TT=3.572	UNSAT TT=541.872 CHECKS=141824000 NODES=17127900	UNSAT TT=217.918 CHECKS=42128600 NODES=6325690	UNSAT TT=10.844	UNSAT TT=460.617 CHECKS=32281100	UNSAT TT=175.951 CHECKS=10974400	UNSAT TT=27.195 ASSIGNMENTS=231727	UNSAT TT=29.513 ASSIGNMENTS=234927	No data	No data	No data	UNSAT TT=141.93 ASSIGNMENTS=498882 CHECKS=40872400	UNSAT TT=542.019 ASSIGNMENTS=17127900 CHECKS=141824000	No data	No data	No data	UNSAT TT=39.228 ASSIGNMENTS=156121 CHECKS=11974200	UNSAT TT=29.185 ASSIGNMENTS=129318 CHECKS=9669900	UNSAT TT=3.572	UNSAT TT=160.529 ASSIGNMENTS=651460 CHECKS=46139700	UNSAT TT=133.692 ASSIGNMENTS=498882 CHECKS=40872400	? TT=0.753	No data	UNSAT TT=34.774	UNSAT TT=52.299
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-t2001-13queen13-1111223696.xml	SAT TT=2.078	SAT TT=418.793 CHECKS=70335300 NODES=12727400	SAT TT=315.09 CHECKS=56445600 NODES=9574350	SAT TT=9.372	SAT TT=260.432 CHECKS=24771600	SAT TT=100.07 CHECKS=8269320	SAT TT=22.556 ASSIGNMENTS=193925	SAT TT=36.1 ASSIGNMENTS=321701	No data	No data	No data	SAT TT=70.358 ASSIGNMENTS=203071 CHECKS=19264700	SAT TT=392.463 ASSIGNMENTS=12727400 CHECKS=70335300	No data	No data	No data	SAT TT=27.492 ASSIGNMENTS=100830 CHECKS=8391310	SAT TT=17.532 ASSIGNMENTS=70447 CHECKS=5413610	SAT TT=2.078	SAT TT=29.185 ASSIGNMENTS=111237 CHECKS=8320770	SAT TT=62.624 ASSIGNMENTS=203071 CHECKS=19264700	? TT=0.724	No data	SAT TT=28.967	SAT TT=14.543
csp/pseudoGLB/ normalized-t2001-13queen13-1111224929.xml	UNSAT TT=2.957	UNSAT TT=893 CHECKS=156141000 NODES=27261000	UNSAT TT=253.894 CHECKS=49371200 NODES=8173050	UNSAT TT=8.713	UNSAT TT=354.677 CHECKS=27179700	UNSAT TT=534.185 CHECKS=38775600	UNSAT TT=15.287 ASSIGNMENTS=124013	UNSAT TT=37.408 ASSIGNMENTS=326373	No data	No data	No data	UNSAT TT=90.139 ASSIGNMENTS=287871 CHECKS=24733000	UNSAT TT=829.991 ASSIGNMENTS=27261000 CHECKS=156141000	No data	No data	No data	UNSAT TT=42.515 ASSIGNMENTS=174672 CHECKS=13027200	UNSAT TT=21.216 ASSIGNMENTS=88768 CHECKS=6516630	UNSAT TT=2.957	UNSAT TT=72.117 ASSIGNMENTS=294074 CHECKS=22311900	UNSAT TT=80.514 ASSIGNMENTS=287871 CHECKS=24733000	? TT=0.778	No data	UNSAT TT=32.794	UNSAT TT=45.381
csp/pseudoGLB/ normalized-t2001-13queen13-1111225605.xml	UNSAT TT=2.269	UNSAT TT=830.743 CHECKS=172297000 NODES=25212600	UNSAT TT=556.406 CHECKS=90406600 NODES=16748100	UNSAT TT=13.094	UNSAT TT=156.222 CHECKS=10537400	UNSAT TT=158.544 CHECKS=10802100	UNSAT TT=26.5 ASSIGNMENTS=232145	UNSAT TT=41.018 ASSIGNMENTS=345385	No data	No data	No data	UNSAT TT=243.416 ASSIGNMENTS=862578 CHECKS=71927200	UNSAT TT=778.095 ASSIGNMENTS=25212600 CHECKS=172297000	No data	No data	No data	UNSAT TT=49.631 ASSIGNMENTS=215979 CHECKS=15922400	UNSAT TT=40.538 ASSIGNMENTS=166295 CHECKS=12457900	UNSAT TT=2.269	UNSAT TT=122.296 ASSIGNMENTS=487018 CHECKS=35058500	UNSAT TT=234.683 ASSIGNMENTS=862578 CHECKS=71927200	? TT=0.746	No data	UNSAT TT=31.741	UNSAT TT=48.853
csp/pseudoGLB/ normalized-t2001-13queen13-1111227012.xml	UNSAT TT=3.181	UNSAT TT=1215.03 CHECKS=257188000 NODES=39454100	UNSAT TT=365.201 CHECKS=67181400 NODES=11805900	UNSAT TT=14.949	UNSAT TT=170.863 CHECKS=13074400	UNSAT TT=210.478 CHECKS=13660800	UNSAT TT=26.236 ASSIGNMENTS=236305	UNSAT TT=42.141 ASSIGNMENTS=345556	No data	No data	No data	UNSAT TT=121.632 ASSIGNMENTS=379073 CHECKS=34249100	UNSAT TT=1212.87 ASSIGNMENTS=39454100 CHECKS=257188000	No data	No data	No data	UNSAT TT=41.231 ASSIGNMENTS=155660 CHECKS=12402900	UNSAT TT=27.631 ASSIGNMENTS=105344 CHECKS=8428350	UNSAT TT=3.181	UNSAT TT=93.034 ASSIGNMENTS=364291 CHECKS=28646800	UNSAT TT=109.399 ASSIGNMENTS=379073 CHECKS=34249100	? TT=0.757	No data	UNSAT TT=30.022	UNSAT TT=41.012
csp/pseudoGLB/ normalized-t3002-11tsp11-1900546417.xml	UNSAT TT=46.892	? (TO) TT=1800.16	? (TO) TT=1800.07	UNSAT TT=46.892	UNSAT TT=94.524 CHECKS=51553600	UNSAT TT=183.385 CHECKS=102580000	? (TO) TT=1800.09	UNSAT TT=1068.55 ASSIGNMENTS=1516120	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=296.807	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=0.756	No data	UNSAT TT=73.918	UNSAT TT=313.859
csp/pseudoGLB/ normalized-t3002-11tsp11-1900547334.xml	SAT TT=1.32	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=1.32	SAT TT=36.588 CHECKS=20939900	SAT TT=244.496 CHECKS=141593000	SAT TT=64.73 ASSIGNMENTS=111326	SAT TT=8.895 ASSIGNMENTS=10824	No data	No data	No data	SAT TT=153.557 ASSIGNMENTS=121355 CHECKS=115262000	SAT TT=222.558 ASSIGNMENTS=121355 CHECKS=115262000	No data	No data	No data	SAT TT=44.082 ASSIGNMENTS=31743 CHECKS=33322200	SAT TT=30.897 ASSIGNMENTS=44489 CHECKS=23345400	SAT TT=10.689	? (TO) TT=1800.08	SAT TT=131.782 ASSIGNMENTS=121355 CHECKS=115262000	? TT=0.722	No data	SAT TT=14.206	SAT TT=2.342
csp/pseudoGLB/ normalized-t3002-11tsp11-1900548667.xml	UNSAT TT=80.213	? (TO) TT=1800.1	? (TO) TT=1800.12	UNSAT TT=80.213	UNSAT TT=516.526 CHECKS=314721000	UNSAT TT=495.449 CHECKS=326349000	? (TO) TT=1800.06	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.05	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=340.752	? (TO) TT=1800.09	? (TO) TT=1800.06	? TT=0.711	No data	UNSAT TT=574.458	? (TO) TT=1800.15
csp/pseudoGLB/ normalized-t3002-11tsp11-1900552423.xml	UNSAT TT=7.67	? (TO) TT=1800.16	? (TO) TT=1800.16	UNSAT TT=15.29	UNSAT TT=50.061 CHECKS=26353700	UNSAT TT=82.146 CHECKS=41514900	UNSAT TT=1743.39 ASSIGNMENTS=2829690	UNSAT TT=260.052 ASSIGNMENTS=308752	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=71.335	? (TO) TT=1800.06	? (TO) TT=1800.05	? TT=0.764	No data	UNSAT TT=10.548	UNSAT TT=7.67
csp/pseudoGLB/ normalized-t3002-11tsp11-1900553812.xml	UNSAT TT=22.858	? (TO) TT=1800.08	? (TO) TT=1800.13	UNSAT TT=22.858	UNSAT TT=162.932 CHECKS=97722600	UNSAT TT=164.232 CHECKS=93450400	? (TO) TT=1800.16	UNSAT TT=367.973 ASSIGNMENTS=483236	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=124.449	? (TO) TT=1800.01	? (TO) TT=1800.08	? TT=0.747	No data	UNSAT TT=32.462	UNSAT TT=35.765
csp/pseudoGLB/ normalized-t3002-11tsp11-1900554375.xml	SAT TT=0.622	? (TO) TT=1800.11	? (TO) TT=1800.13	SAT TT=0.622	SAT TT=33.045 CHECKS=18847900	SAT TT=22.327 CHECKS=11754400	SAT TT=4.544 ASSIGNMENTS=5138	SAT TT=2.73 ASSIGNMENTS=1436	No data	No data	No data	SAT TT=33.476 ASSIGNMENTS=21600 CHECKS=19812600	SAT TT=103.783 ASSIGNMENTS=21600 CHECKS=19812600	No data	No data	No data	SAT TT=17.707 ASSIGNMENTS=12482 CHECKS=13035100	SAT TT=1.665 ASSIGNMENTS=23172 CHECKS=1248240	SAT TT=1.312	SAT TT=400.388 ASSIGNMENTS=219327 CHECKS=227804000	SAT TT=25.359 ASSIGNMENTS=21600 CHECKS=19812600	? TT=0.738	No data	SAT TT=2.472	SAT TT=2.817
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-t3002-11tsp11-1900557362.xml	UNSAT TT=24.335	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=25.842	UNSAT TT=199.509 CHECKS=105983000	UNSAT TT=165.031 CHECKS=84785700	? (TO) TT=1800.15	UNSAT TT=508.382 ASSIGNMENTS=638722	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.02	No data	No data	No data	UNSAT TT=1507.99 ASSIGNMENTS=963493 CHECKS=1152120000	? (TO) TT=1800.02	UNSAT TT=135.562	? (TO) TT=1800.05	? (TO) TT=1800.08	? TT=0.784	No data	UNSAT TT=24.335	UNSAT TT=29.676
csp/pseudoGLB/ normalized-t3002-11tsp11-1900557957.xml	UNSAT TT=23.761	? (TO) TT=1800.14	? (TO) TT=1800.06	UNSAT TT=23.761	UNSAT TT=165.718 CHECKS=87657000	UNSAT TT=162.824 CHECKS=89186300	? (TO) TT=1800.13	UNSAT TT=537.426 ASSIGNMENTS=614827	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=118.278	? (TO) TT=1800.11	? (TO) TT=1800.08	? TT=0.772	No data	UNSAT TT=50.867	UNSAT TT=62.735
csp/pseudoGLB/ normalized-t3002-11tsp11-1900558739.xml	UNSAT TT=66.887	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=66.887	UNSAT TT=341.284 CHECKS=203221000	UNSAT TT=172.118 CHECKS=96406400	? (TO) TT=1800.09	UNSAT TT=1121.82 ASSIGNMENTS=1663200	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=376.814	? (TO) TT=1800.03	? (TO) TT=1800.05	? TT=0.781	No data	UNSAT TT=121.954	UNSAT TT=444.378
csp/pseudoGLB/ normalized-t3002-11tsp11-1900563801.xml	UNSAT TT=11.179	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=27.548	UNSAT TT=171.847 CHECKS=98278800	UNSAT TT=173.828 CHECKS=95197000	? (TO) TT=1800.14	UNSAT TT=571.85 ASSIGNMENTS=841057	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=165.728	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=0.741	No data	UNSAT TT=11.179	UNSAT TT=14.532
csp/pseudoGLB/ normalized-t3002-11tsp11-1900564824.xml	UNSAT TT=4.41	? (TO) TT=1800.07	? (TO) TT=1800.12	UNSAT TT=11.609	UNSAT TT=31.209 CHECKS=15806100	UNSAT TT=35.803 CHECKS=18246000	UNSAT TT=1447.4 ASSIGNMENTS=2290220	UNSAT TT=192.131 ASSIGNMENTS=224062	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.01	No data	No data	No data	UNSAT TT=1534.6 ASSIGNMENTS=1060560 CHECKS=1208050000	? (TO) TT=1800.08	UNSAT TT=66.013	? (TO) TT=1800.07	? (TO) TT=1800.07	? TT=0.726	No data	UNSAT TT=6.631	UNSAT TT=4.41
csp/pseudoGLB/ normalized-t3002-11tsp11-1900567135.xml	UNSAT TT=17.68	? (TO) TT=1800.11	? (TO) TT=1800.13	UNSAT TT=17.68	UNSAT TT=158.165 CHECKS=85594400	UNSAT TT=133.222 CHECKS=74166600	? (TO) TT=1800.07	UNSAT TT=353.995 ASSIGNMENTS=432837	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=105.229	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=0.722	No data	UNSAT TT=67.607	UNSAT TT=37.04
csp/pseudoGLB/ normalized-t3002-11tsp11-1900567939.xml	SAT TT=2.981	? (TO) TT=1800.14	? (TO) TT=1800.12	SAT TT=2.981	SAT TT=55.034 CHECKS=30321700	SAT TT=43.328 CHECKS=25307900	SAT TT=37.627 ASSIGNMENTS=61286	SAT TT=6.49 ASSIGNMENTS=6225	No data	No data	No data	SAT TT=20.616 ASSIGNMENTS=9748 CHECKS=10108800	SAT TT=92.288 ASSIGNMENTS=9748 CHECKS=10108800	No data	No data	No data	SAT TT=77.482 ASSIGNMENTS=56270 CHECKS=59424300	SAT TT=212.365 ASSIGNMENTS=158951 CHECKS=161022000	SAT TT=13.888	? (TO) TT=1800.09	SAT TT=12.416 ASSIGNMENTS=9748 CHECKS=10108800	? TT=0.758	No data	SAT TT=12.363	SAT TT=3.944
csp/pseudoGLB/ normalized-t3002-11tsp11-1900567985.xml	UNSAT TT=48.857	? (TO) TT=1800.11	? (TO) TT=1800.04	UNSAT TT=48.857	UNSAT TT=278.531 CHECKS=158680000	UNSAT TT=292.8 CHECKS=176722000	? (TO) TT=1800.12	UNSAT TT=1234 ASSIGNMENTS=2001800	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.05	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=295.08	? (TO) TT=1800.05	? (TO) TT=1800.1	? TT=0.751	No data	UNSAT TT=424.173	UNSAT TT=1260.95
csp/pseudoGLB/ normalized-t3002-11tsp11-1900568186.xml	UNSAT TT=20.823	? (TO) TT=1800.15	? (TO) TT=1800.05	UNSAT TT=25.147	UNSAT TT=68.975 CHECKS=36788800	UNSAT TT=153.007 CHECKS=86740400	? (TO) TT=1800.18	UNSAT TT=479.841 ASSIGNMENTS=597933	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.09	UNSAT TT=360.674	? (TO) TT=1800.07	? (TO) TT=1800.09	? TT=0.77	No data	UNSAT TT=24.834	UNSAT TT=20.823
csp/pseudoGLB/ normalized-t3002-11tsp11-1900571132.xml	UNSAT TT=17.747	? (TO) TT=1800.09	? (TO) TT=1800.14	UNSAT TT=17.747	UNSAT TT=60.103 CHECKS=30804300	UNSAT TT=143.449 CHECKS=83064400	? (TO) TT=1800.12	UNSAT TT=392.769 ASSIGNMENTS=542227	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=184.982	? (TO) TT=1800.02	? (TO) TT=1800.12	? TT=0.768	No data	UNSAT TT=131.288	UNSAT TT=308.01
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-t3002-11tsp11-1900574974.xml	SAT TT=1.044	? (TO) TT=1800.14	? (TO) TT=1800.13	SAT TT=1.044	SAT TT=101.19 CHECKS=62030200	SAT TT=39.339 CHECKS=21447200	SAT TT=6.383 ASSIGNMENTS=8256	SAT TT=3.652 ASSIGNMENTS=2646	No data	No data	No data	SAT TT=103.725 ASSIGNMENTS=73903 CHECKS=74223500	SAT TT=164.417 ASSIGNMENTS=73903 CHECKS=74223500	No data	No data	No data	SAT TT=8.508 ASSIGNMENTS=6526 CHECKS=6864300	SAT TT=47.244 ASSIGNMENTS=54954 CHECKS=36593600	SAT TT=1.771	SAT TT=128.627 ASSIGNMENTS=92027 CHECKS=74474000	SAT TT=85.626 ASSIGNMENTS=73903 CHECKS=74223500	? TT=0.767	No data	SAT TT=2.234	SAT TT=3.593
csp/pseudoGLB/ normalized-t3002-11tsp11-1900577000.xml	SAT TT=0.672	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=0.672	SAT TT=2.204 CHECKS=983785	SAT TT=2.565 CHECKS=1207450	SAT TT=4.14 ASSIGNMENTS=5601	SAT TT=6.659 ASSIGNMENTS=6783	No data	No data	No data	SAT TT=25.477 ASSIGNMENTS=14838 CHECKS=13885100	SAT TT=97.507 ASSIGNMENTS=14838 CHECKS=13885100	No data	No data	No data	SAT TT=6.068 ASSIGNMENTS=3863 CHECKS=4421220	SAT TT=20.175 ASSIGNMENTS=36253 CHECKS=16557500	SAT TT=1.453	SAT TT=105.301 ASSIGNMENTS=68075 CHECKS=58506000	SAT TT=16.42 ASSIGNMENTS=14838 CHECKS=13885100	? TT=0.754	No data	SAT TT=2.454	SAT TT=2.902
csp/pseudoGLB/ normalized-t3002-11tsp11-1900581320.xml	UNSAT TT=68.163	? (TO) TT=1800.1	? (TO) TT=1800.15	UNSAT TT=68.163	UNSAT TT=409.189 CHECKS=236780000	UNSAT TT=337.257 CHECKS=215240000	? (TO) TT=1800.1	UNSAT TT=1639.69 ASSIGNMENTS=2295010	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=228.716	? (TO) TT=1800.02	? (TO) TT=1800.03	? TT=0.746	No data	UNSAT TT=157.179	UNSAT TT=610.537
csp/pseudoGLB/ normalized-t3002-11tsp11-1900582300.xml	UNSAT TT=36.179	? (TO) TT=1800.15	? (TO) TT=1800.14	UNSAT TT=36.179	UNSAT TT=320.386 CHECKS=179921000	UNSAT TT=170.167 CHECKS=101153000	? (TO) TT=1800.1	UNSAT TT=924.592 ASSIGNMENTS=1187980	No data	No data	No data	? (TO) TT=1800	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=368.068	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=0.759	No data	UNSAT TT=234.664	UNSAT TT=1048.78
csp/pseudoGLB/ normalized-t3002-11tsp11-1900667195.xml	UNSAT TT=58.39	? (TO) TT=1800.16	? (TO) TT=1800.1	UNSAT TT=58.39	UNSAT TT=290.787 CHECKS=166515000	UNSAT TT=288.327 CHECKS=167466000	? (TO) TT=1800.13	UNSAT TT=1055.34 ASSIGNMENTS=1574200	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=414.94	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=0.76	No data	UNSAT TT=301.402	UNSAT TT=1208.67
csp/pseudoGLB/ normalized-t3002-11tsp11-1900669309.xml	SAT TT=1.464	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=1.775	SAT TT=202.179 CHECKS=111687000	SAT TT=161.644 CHECKS=99966300	SAT TT=963.755 ASSIGNMENTS=1386870	SAT TT=6.695 ASSIGNMENTS=7417	No data	No data	No data	SAT TT=409.665 ASSIGNMENTS=250295 CHECKS=322789000	SAT TT=458.808 ASSIGNMENTS=250295 CHECKS=322789000	No data	No data	No data	SAT TT=307.179 ASSIGNMENTS=236395 CHECKS=241430000	SAT TT=138.266 ASSIGNMENTS=114042 CHECKS=106529000	SAT TT=1.464	? (TO) TT=1800.04	SAT TT=413.488 ASSIGNMENTS=250295 CHECKS=322789000	? TT=0.785	No data	SAT TT=8.231	SAT TT=16.669
csp/pseudoGLB/ normalized-t3002-11tsp11-1900670167.xml	UNSAT TT=28.063	? (TO) TT=1800.12	? (TO) TT=1800.14	UNSAT TT=28.063	UNSAT TT=221.32 CHECKS=128018000	UNSAT TT=165.476 CHECKS=97778100	? (TO) TT=1800.06	UNSAT TT=610.177 ASSIGNMENTS=826004	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=380.37	? (TO) TT=1800.1	? (TO) TT=1800.08	? TT=0.721	No data	UNSAT TT=48.458	UNSAT TT=80.025
csp/pseudoGLB/ normalized-t3002-11tsp11-1900670675.xml	UNSAT TT=18.83	? (TO) TT=1800.05	? (TO) TT=1800.13	UNSAT TT=47.774	UNSAT TT=369.455 CHECKS=221959000	UNSAT TT=286.296 CHECKS=186882000	UNSAT TT=994.817 ASSIGNMENTS=1445220	UNSAT TT=991.233 ASSIGNMENTS=1617340	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.07	No data	No data	No data	UNSAT TT=1413.28 ASSIGNMENTS=924734 CHECKS=1074270000	? (TO) TT=1800.1	UNSAT TT=121.462	? (TO) TT=1800.02	? (TO) TT=1800.06	? TT=0.767	No data	UNSAT TT=18.83	UNSAT TT=21.459
csp/pseudo/ii/ normalized-ii-16a2.xml	SAT TT=1.822	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=3.935	SAT TT=13.619 CHECKS=12729400	SAT TT=8.943 CHECKS=6015530	SAT TT=23.485 ASSIGNMENTS=100	SAT TT=22.436 ASSIGNMENTS=100	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=1.822 ASSIGNMENTS=103 CHECKS=342975	SAT TT=1.979 ASSIGNMENTS=103 CHECKS=342975	SAT TT=31.515	SAT TT=31.775	No data	SAT TT=1.916 ASSIGNMENTS=103 CHECKS=342975	SAT TT=2.223 ASSIGNMENTS=908 CHECKS=647487	SAT TT=48.861	? (TO) TT=1800.1	SAT TT=1.885 ASSIGNMENTS=103 CHECKS=338350	SAT TT=176.958	No data	SAT TT=5.352	SAT TT=6.198
csp/pseudo/ii/ normalized-ii-16b2.xml	SAT TT=5.129	? (TO) TT=1800.11	? (TO) TT=1800.13	SAT TT=1615.96	? (TO) TT=1800.06	SAT TT=205.18 CHECKS=213195000	? (TO) TT=1800.1	? (TO) TT=1800.16	SAT TT=476.737 CHECKS=18314400 NODES=12858	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=21.027	SAT TT=20.798	No data	? (TO) TT=1800.11	SAT TT=5.433 ASSIGNMENTS=596 CHECKS=3650160	SAT TT=11.079	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=257.18	No data	SAT TT=5.129	SAT TT=6.386
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ii/ normalized-ii-16c2.xml	SAT TT=5.995	? (TO) TT=1800.1	? (TO) TT=1800.12	SAT TT=1611.36	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.28	SAT TT=918.014 CHECKS=41894500 NODES=26932	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=19	SAT TT=18.131	No data	? (TO) TT=1800.03	SAT TT=50.365 ASSIGNMENTS=4687 CHECKS=37051400	SAT TT=12.333	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=336.72	No data	SAT TT=5.995	SAT TT=6.714
csp/pseudo/ii/ normalized-ii-16d1.xml	SAT TT=7.45	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=88.416 CHECKS=39468800	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=822.658 CHECKS=35391100 NODES=39811	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=26.566	SAT TT=26.986	No data	? (TO) TT=1800.08	SAT TT=20.411 ASSIGNMENTS=7762 CHECKS=19490600	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=417.987	No data	SAT TT=7.45	SAT TT=8.138
csp/pseudo/ii/ normalized-ii-16e1.xml	SAT TT=8.592	? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.02	SAT TT=64.493 CHECKS=16959200	SAT TT=73.737 CHECKS=18390400	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=32.051	SAT TT=31.96	No data	? (TO) TT=1800.06	SAT TT=24.881 ASSIGNMENTS=8248 CHECKS=24904900	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=888.211	No data	SAT TT=8.592	SAT TT=13.004
csp/pseudo/ii/ normalized-ii-16e2.xml	SAT TT=5.925	? (TO) TT=1800.09	? (TO) TT=1800.13	SAT TT=923.206	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.14	SAT TT=461.489 CHECKS=31062500 NODES=14989	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=12.388	SAT TT=12.566	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=17.101	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=462.383	No data	SAT TT=5.925	SAT TT=7.817
csp/pseudo/ii/ normalized-ii-32a1.xml	SAT TT=7.118	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.07	SAT TT=1063.84 CHECKS=25046000 NODES=14972	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	No data	? (TO) TT=1800.06	SAT TT=7.118 ASSIGNMENTS=238 CHECKS=6054420	SAT TT=9.839	SAT TT=7.648 ASSIGNMENTS=510 CHECKS=6471450	? (TO) TT=1800.08	? (TO) TT=1800.09	No data	SAT TT=7.781	SAT TT=8.448
csp/pseudo/ii/ normalized-ii-32b3.xml	SAT TT=4.083	? (TO) TT=1800.14	? (TO) TT=1800.14	SAT TT=1603.68	SAT TT=47.058 CHECKS=17658200	SAT TT=68.159 CHECKS=26673300	SAT TT=19.494 ASSIGNMENTS=3034	SAT TT=16.806 ASSIGNMENTS=3034	SAT TT=108.32 CHECKS=1137050 NODES=1355	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=254.011 ASSIGNMENTS=26680 CHECKS=95700900	SAT TT=245.502 ASSIGNMENTS=26680 CHECKS=95700900	? (TO) TT=1800.07	? (TO) TT=1800.05	No data	? (TO) TT=1800.06	SAT TT=49.876 ASSIGNMENTS=1479 CHECKS=38285300	SAT TT=11.226	SAT TT=4.083 ASSIGNMENTS=224 CHECKS=3126790	? (TO) TT=1800.02	? (TO) TT=1800.17	No data	SAT TT=6.292	SAT TT=10.813
csp/pseudo/ii/ normalized-ii-32c3.xml	SAT TT=1.938	? (TO) TT=1800.09	SAT TT=1722.4 CHECKS=566503000 NODES=220969	? (TO) TT=1800.09	SAT TT=7.381 CHECKS=1866220	SAT TT=9.237 CHECKS=2416450	SAT TT=850.913 ASSIGNMENTS=492279	SAT TT=856.302 ASSIGNMENTS=492279	SAT TT=71.232 CHECKS=176945 NODES=768	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	No data	? (TO) TT=1800.1	SAT TT=1.938 ASSIGNMENTS=140 CHECKS=1597340	SAT TT=16.435	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.06	No data	SAT TT=4.25	SAT TT=6.336
csp/pseudo/ii/ normalized-ii-32d2.xml	SAT TT=5.815	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.1	SAT TT=219.158 CHECKS=103325000	SAT TT=419.212 CHECKS=237242000	SAT TT=52.832 ASSIGNMENTS=19079	SAT TT=52.798 ASSIGNMENTS=19079	SAT TT=738.448 CHECKS=20656200 NODES=25782	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=1649.14 ASSIGNMENTS=19079	SAT TT=1646.63 ASSIGNMENTS=19079	? (TO) TT=1800.09	? (TO) TT=1800.01	No data	? (TO) TT=1800.12	SAT TT=26.645 ASSIGNMENTS=4673 CHECKS=26839100	SAT TT=1290.89	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.12	No data	SAT TT=7.604	SAT TT=5.815
csp/pseudo/ii/ normalized-ii-32e1.xml	SAT TT=0.194	SAT TT=1.869 CHECKS=8106 NODES=444	SAT TT=2.026 CHECKS=19180 NODES=444	SAT TT=0.45	SAT TT=0.927 CHECKS=253165	SAT TT=0.333 CHECKS=72134	SAT TT=2.085 ASSIGNMENTS=30	SAT TT=2.299 ASSIGNMENTS=30	SAT TT=62.302 CHECKS=12069 NODES=511	SAT TT=4.114 CHECKS=1997470 NODES=31587	SAT TT=2.723 CHECKS=1236850 NODES=1029	SAT TT=0.206 ASSIGNMENTS=44 CHECKS=99064	SAT TT=0.219 ASSIGNMENTS=44 CHECKS=99064	? (TO) TT=1800.03	? (TO) TT=1800.08	No data	SAT TT=0.196 ASSIGNMENTS=44 CHECKS=99064	SAT TT=1.451 ASSIGNMENTS=1324 CHECKS=2168180	SAT TT=1.268	SAT TT=0.317 ASSIGNMENTS=153 CHECKS=203557	SAT TT=0.194 ASSIGNMENTS=43 CHECKS=97828	? (TO) TT=1800.08	No data	SAT TT=2.1	SAT TT=3.038
csp/pseudo/ii/ normalized-ii-32e2.xml	SAT TT=3.064	SAT TT=15.922 CHECKS=5268120 NODES=5115	SAT TT=154.685 CHECKS=58904200 NODES=37606	SAT TT=1791.51	SAT TT=14.449 CHECKS=6814430	SAT TT=19.361 CHECKS=9428700	SAT TT=244.352 ASSIGNMENTS=183291	SAT TT=264.796 ASSIGNMENTS=183291	SAT TT=64.686 CHECKS=38104 NODES=612	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=54.034 ASSIGNMENTS=17054 CHECKS=20229200	SAT TT=56.136 ASSIGNMENTS=17054 CHECKS=20229200	? (TO) TT=1800.04	? (TO) TT=1800.01	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=6.705	SAT TT=3.465 ASSIGNMENTS=729 CHECKS=2552010	SAT TT=800.004 ASSIGNMENTS=68954 CHECKS=677669000	? (TO) TT=1800.14	No data	SAT TT=3.064	SAT TT=4.544
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ii/ normalized-ii-32e3.xml	SAT TT=1.232	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=38.897 CHECKS=17865500	SAT TT=66.393 CHECKS=24961600	SAT TT=372.349 ASSIGNMENTS=121330	SAT TT=353.778 ASSIGNMENTS=121330	SAT TT=86.052 CHECKS=421584 NODES=1003	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=255.194 ASSIGNMENTS=25304 CHECKS=93659400	SAT TT=254.614 ASSIGNMENTS=25304 CHECKS=93659400	? (TO) TT=1800.04	? (TO) TT=1800.01	No data	? (TO) TT=1800.03	SAT TT=1.232 ASSIGNMENTS=60 CHECKS=758327	SAT TT=11.698	SAT TT=1.355 ASSIGNMENTS=172 CHECKS=1009690	? (TO) TT=1800.06	? (TO) TT=1800.14	No data	SAT TT=4.808	SAT TT=8.347
csp/pseudo/ ii/ normalized-ii-8a1.xml	SAT TT=0.02	SAT TT=0.988 CHECKS=1070 NODES=134	SAT TT=0.975 CHECKS=1334 NODES=0	SAT TT=0.08	SAT TT=0.042 CHECKS=9238	SAT TT=0.029 CHECKS=6426	SAT TT=1.099 ASSIGNMENTS=21	SAT TT=1.332 ASSIGNMENTS=21	SAT TT=0.994 CHECKS=1160 NODES=140	SAT TT=1.191 CHECKS=11217 NODES=555	SAT TT=1.022 CHECKS=63712 NODES=324	SAT TT=0.032 ASSIGNMENTS=16 CHECKS=1337	SAT TT=0.033 ASSIGNMENTS=16 CHECKS=1337	SAT TT=1.686	SAT TT=1.787	No data	SAT TT=0.02 ASSIGNMENTS=16 CHECKS=1337	SAT TT=0.021 ASSIGNMENTS=32 CHECKS=1611	SAT TT=0.597	SAT TT=0.021 ASSIGNMENTS=79 CHECKS=4220	SAT TT=0.022 ASSIGNMENTS=19 CHECKS=1371	SAT TT=1.846	No data	SAT TT=0.913	SAT TT=0.92
csp/pseudo/ ii/ normalized-ii-8b1.xml	SAT TT=0.133	SAT TT=8.312 CHECKS=7477 NODES=672	SAT TT=8.275 CHECKS=23179 NODES=672	SAT TT=0.453	SAT TT=0.393 CHECKS=137611	SAT TT=0.411 CHECKS=325535	SAT TT=2.882 ASSIGNMENTS=55	SAT TT=3.085 ASSIGNMENTS=55	SAT TT=3.171 CHECKS=8774 NODES=674	SAT TT=2.758 CHECKS=51132 NODES=826	SAT TT=3.493 CHECKS=717578 NODES=661	SAT TT=0.155 ASSIGNMENTS=54 CHECKS=11621	SAT TT=0.162 ASSIGNMENTS=54 CHECKS=11621	SAT TT=3.48	SAT TT=3.462	No data	SAT TT=0.144 ASSIGNMENTS=54 CHECKS=11621	SAT TT=0.699 ASSIGNMENTS=7187 CHECKS=837611	SAT TT=1.226	SAT TT=0.171 ASSIGNMENTS=260 CHECKS=19702	SAT TT=0.133 ASSIGNMENTS=54 CHECKS=11643	SAT TT=5.215	No data	SAT TT=1.712	SAT TT=1.519
csp/pseudo/ ii/ normalized-ii-8b2.xml	SAT TT=0.294	SAT TT=14.348 CHECKS=551906 NODES=3076	SAT TT=14.326 CHECKS=355945 NODES=2814	SAT TT=0.853	SAT TT=1.327 CHECKS=997002	SAT TT=1.133 CHECKS=1025090	SAT TT=4.59 ASSIGNMENTS=53	SAT TT=4.375 ASSIGNMENTS=53	SAT TT=8.394 CHECKS=94586 NODES=1506	? (TO) TT=1800.09	SAT TT=8.652 CHECKS=9112610 NODES=4396	SAT TT=0.3 ASSIGNMENTS=52 CHECKS=22824	SAT TT=0.314 ASSIGNMENTS=52 CHECKS=22824	SAT TT=5.749	SAT TT=5.508	No data	SAT TT=0.302 ASSIGNMENTS=52 CHECKS=22824	SAT TT=1.469 ASSIGNMENTS=8086 CHECKS=1428680	SAT TT=1.742	SAT TT=0.425 ASSIGNMENTS=414 CHECKS=65912	SAT TT=0.294 ASSIGNMENTS=52 CHECKS=22833	SAT TT=6.58	No data	SAT TT=2.221	SAT TT=2.12
csp/pseudo/ ii/ normalized-ii-8b4.xml	SAT TT=0.582	SAT TT=9.22 CHECKS=1845260 NODES=6271	SAT TT=9.888 CHECKS=1999360 NODES=6549	SAT TT=1.679	SAT TT=3.194 CHECKS=1309160	SAT TT=4.172 CHECKS=3530280	SAT TT=8.754 ASSIGNMENTS=46	SAT TT=8.454 ASSIGNMENTS=46	SAT TT=29.277 CHECKS=170291 NODES=2490	? (TO) TT=1800.09	SAT TT=24.672 CHECKS=16318700 NODES=2875	SAT TT=0.603 ASSIGNMENTS=46 CHECKS=45058	SAT TT=0.62 ASSIGNMENTS=46 CHECKS=45058	SAT TT=11.476	SAT TT=11.266	No data	SAT TT=0.619 ASSIGNMENTS=46 CHECKS=45058	SAT TT=1.582 ASSIGNMENTS=5099 CHECKS=1273690	SAT TT=3.182	SAT TT=3.108 ASSIGNMENTS=1502 CHECKS=214309	SAT TT=0.582 ASSIGNMENTS=46 CHECKS=45058	SAT TT=7.505	No data	SAT TT=2.651	SAT TT=3.094
csp/pseudo/ ii/ normalized-ii-8c2.xml	SAT TT=0.473	SAT TT=13.038 CHECKS=7848340 NODES=16084	SAT TT=8.055 CHECKS=1839020 NODES=5766	SAT TT=1.398	SAT TT=2.647 CHECKS=2032650	SAT TT=1.674 CHECKS=828840	SAT TT=6.736 ASSIGNMENTS=100	SAT TT=6.118 ASSIGNMENTS=100	SAT TT=17.293 CHECKS=60424 NODES=2161	SAT TT=99.082 CHECKS=105619000 NODES=1651790	SAT TT=16.837 CHECKS=10331500 NODES=2675	SAT TT=0.514 ASSIGNMENTS=100 CHECKS=41973	SAT TT=0.521 ASSIGNMENTS=100 CHECKS=41973	SAT TT=10.195	SAT TT=8.639	No data	SAT TT=0.473 ASSIGNMENTS=100 CHECKS=41973	SAT TT=3.785 ASSIGNMENTS=21780 CHECKS=3455760	SAT TT=166.428	SAT TT=5.615 ASSIGNMENTS=3119 CHECKS=558330	SAT TT=0.538 ASSIGNMENTS=100 CHECKS=41973	SAT TT=7.881	No data	SAT TT=3.152	SAT TT=3.371
csp/pseudo/jnh/ normalized-jnh-12.xml	SAT TT=0.092	SAT TT=1.902 CHECKS=11436 NODES=461	SAT TT=1.793 CHECKS=17056 NODES=256	SAT TT=0.33	SAT TT=0.135 CHECKS=30684	SAT TT=0.092 CHECKS=28671	SAT TT=1.546 ASSIGNMENTS=9	SAT TT=1.682 ASSIGNMENTS=9	SAT TT=1.979 CHECKS=107856 NODES=278	SAT TT=151.701 CHECKS=241627000 NODES=1201210	? (TO) TT=1800	SAT TT=0.359 ASSIGNMENTS=54 CHECKS=253825	SAT TT=0.327 ASSIGNMENTS=54 CHECKS=253825	SAT TT=3.356	SAT TT=3.097	No data	SAT TT=0.46 ASSIGNMENTS=102 CHECKS=414681	SAT TT=2.044 ASSIGNMENTS=1095 CHECKS=2016190	SAT TT=0.98	SAT TT=0.281 ASSIGNMENTS=88 CHECKS=163740	SAT TT=0.339 ASSIGNMENTS=72 CHECKS=283895	SAT TT=3.901	No data	SAT TT=1.414	SAT TT=1.748
csp/pseudo/jnh/ normalized-jnh-17.xml	SAT TT=0.207	SAT TT=1.629 CHECKS=14698 NODES=615	SAT TT=1.793 CHECKS=16441 NODES=597	SAT TT=0.317	SAT TT=0.251 CHECKS=131484	SAT TT=0.207 CHECKS=132865	SAT TT=1.636 ASSIGNMENTS=57	SAT TT=1.809 ASSIGNMENTS=57	SAT TT=1.871 CHECKS=31727 NODES=221	SAT TT=20.825 CHECKS=30696500 NODES=154438	SAT TT=5.972 CHECKS=9196790 NODES=12798	SAT TT=0.304 ASSIGNMENTS=53 CHECKS=222386	SAT TT=0.312 ASSIGNMENTS=53 CHECKS=222386	SAT TT=3.283	SAT TT=3.155	No data	SAT TT=0.364 ASSIGNMENTS=74 CHECKS=297358	SAT TT=3.276 ASSIGNMENTS=2016 CHECKS=3616030	SAT TT=0.987	SAT TT=0.35 ASSIGNMENTS=148 CHECKS=244119	SAT TT=0.303 ASSIGNMENTS=47 CHECKS=211728	SAT TT=3.863	No data	SAT TT=1.449	SAT TT=1.632
csp/pseudo/ jnh/ normalized-jnh-1.xml	SAT TT=0.3	SAT TT=1.565 CHECKS=4504 NODES=274	SAT TT=1.689 CHECKS=7021 NODES=259	SAT TT=0.34	SAT TT=0.332 CHECKS=184915	SAT TT=0.3 CHECKS=211900	SAT TT=2.009 ASSIGNMENTS=122	SAT TT=1.98 ASSIGNMENTS=122	SAT TT=2.098 CHECKS=166082 NODES=364	SAT TT=40 CHECKS=59863800 NODES=271081	SAT TT=2.069 CHECKS=540676 NODES=885	SAT TT=1.355 ASSIGNMENTS=254 CHECKS=1146800	SAT TT=1.131 ASSIGNMENTS=254 CHECKS=1146800	SAT TT=3.379	SAT TT=3.567	No data	SAT TT=0.631 ASSIGNMENTS=145 CHECKS=484978	SAT TT=8.151 ASSIGNMENTS=4130 CHECKS=8143300	SAT TT=1.004	SAT TT=2.715 ASSIGNMENTS=1233 CHECKS=2197790	SAT TT=0.344 ASSIGNMENTS=80 CHECKS=264577	SAT TT=4.802	No data	SAT TT=1.707	SAT TT=1.52
csp/pseudo/jnh/ normalized-jnh-201.xml	SAT TT=0.168	SAT TT=1.626 CHECKS=2276 NODES=200	SAT TT=1.647 CHECKS=5461 NODES=200	SAT TT=0.305	SAT TT=0.295 CHECKS=156366	SAT TT=0.187 CHECKS=101791	SAT TT=1.806 ASSIGNMENTS=87	SAT TT=1.697 ASSIGNMENTS=87	SAT TT=1.836 CHECKS=46552 NODES=269	SAT TT=1.793 CHECKS=147916 NODES=622	SAT TT=1.837 CHECKS=372033 NODES=544	SAT TT=0.209 ASSIGNMENTS=54 CHECKS=123137	SAT TT=0.212 ASSIGNMENTS=54 CHECKS=123137	SAT TT=3.339	SAT TT=3.566	No data	SAT TT=0.185 ASSIGNMENTS=43 CHECKS=86177	SAT TT=1.88 ASSIGNMENTS=895 CHECKS=1829800	SAT TT=0.982	SAT TT=0.168 ASSIGNMENTS=60 CHECKS=61658	SAT TT=0.177 ASSIGNMENTS=42 CHECKS=90691	SAT TT=6.542	No data	SAT TT=1.49	SAT TT=1.84
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/jnh/ normalized-jnh-204.xml	SAT TT=0.272	SAT TT=2.173 CHECKS=77565 NODES=3236	SAT TT=2.012 CHECKS=55229 NODES=2052	SAT TT=0.368	SAT TT=0.366 CHECKS=208995	SAT TT=0.396 CHECKS=270045	SAT TT=1.747 ASSIGNMENTS=97	SAT TT=1.888 ASSIGNMENTS=97	SAT TT=3.795 CHECKS=900740 NODES=837	SAT TT=1631.49 CHECKS=2880170000 NODES=15647600	SAT TT=2.42 CHECKS=1580960 NODES=2889	SAT TT=0.272 ASSIGNMENTS=61 CHECKS=192895	SAT TT=0.275 ASSIGNMENTS=61 CHECKS=192895	SAT TT=3.288	SAT TT=3.096	No data	SAT TT=0.455 ASSIGNMENTS=123 CHECKS=403486	SAT TT=2.086 ASSIGNMENTS=1386 CHECKS=2147430	SAT TT=1.251	SAT TT=2.786 ASSIGNMENTS=1852 CHECKS=2565340	SAT TT=0.88 ASSIGNMENTS=200 CHECKS=824075	SAT TT=4.122	No data	SAT TT=1.978	SAT TT=1.64
csp/pseudo/jnh/ normalized-jnh-205.xml	SAT TT=0.318	SAT TT=1.592 CHECKS=6757 NODES=360	SAT TT=1.602 CHECKS=8667 NODES=434	SAT TT=0.318	SAT TT=0.567 CHECKS=394626	SAT TT=0.446 CHECKS=314465	SAT TT=1.642 ASSIGNMENTS=103	SAT TT=1.609 ASSIGNMENTS=103	SAT TT=2.775 CHECKS=465656 NODES=517	SAT TT=8.581 CHECKS=11183700 NODES=58974	SAT TT=1.993 CHECKS=733962 NODES=1320	SAT TT=0.397 ASSIGNMENTS=88 CHECKS=337455	SAT TT=0.389 ASSIGNMENTS=88 CHECKS=337455	SAT TT=3.382	SAT TT=3.245	No data	SAT TT=0.522 ASSIGNMENTS=110 CHECKS=437708	SAT TT=6.541 ASSIGNMENTS=4112 CHECKS=7268580	SAT TT=1.049	SAT TT=2.159 ASSIGNMENTS=1322 CHECKS=2231160	SAT TT=0.65 ASSIGNMENTS=142 CHECKS=631937	SAT TT=3.73	No data	SAT TT=1.649	SAT TT=1.636
csp/pseudo/jnh/ normalized-jnh-207.xml	SAT TT=0.432	SAT TT=1.612 CHECKS=9320 NODES=424	SAT TT=1.762 CHECKS=14618 NODES=542	SAT TT=0.707	SAT TT=0.547 CHECKS=366437	SAT TT=0.468 CHECKS=337755	SAT TT=2.008 ASSIGNMENTS=172	SAT TT=1.78 ASSIGNMENTS=172	SAT TT=1.951 CHECKS=52234 NODES=245	SAT TT=1295.14 CHECKS=2267540000 NODES=12112100	? (TO) TT=1800.07	SAT TT=0.542 ASSIGNMENTS=114 CHECKS=485879	SAT TT=0.582 ASSIGNMENTS=114 CHECKS=485879	SAT TT=2.993	SAT TT=3.467	No data	SAT TT=1.173 ASSIGNMENTS=287 CHECKS=1204540	SAT TT=6.889 ASSIGNMENTS=4339 CHECKS=7195940	SAT TT=0.992	SAT TT=0.55 ASSIGNMENTS=274 CHECKS=432668	SAT TT=0.432 ASSIGNMENTS=95 CHECKS=375519	SAT TT=4.12	No data	SAT TT=1.616	SAT TT=1.412
csp/pseudo/jnh/ normalized-jnh-209.xml	SAT TT=0.359	SAT TT=1.832 CHECKS=16056 NODES=755	SAT TT=1.704 CHECKS=14446 NODES=548	SAT TT=0.359	SAT TT=0.701 CHECKS=483216	SAT TT=0.677 CHECKS=493898	SAT TT=1.986 ASSIGNMENTS=446	SAT TT=1.986 ASSIGNMENTS=446	SAT TT=1.812 CHECKS=70396 NODES=250	SAT TT=292.256 CHECKS=514017000 NODES=2801820	? (TO) TT=1800.03	SAT TT=1.09 ASSIGNMENTS=274 CHECKS=979847	SAT TT=1.079 ASSIGNMENTS=274 CHECKS=979847	SAT TT=3.371	SAT TT=3.183	No data	SAT TT=1.098 ASSIGNMENTS=273 CHECKS=1022760	SAT TT=6.228 ASSIGNMENTS=4548 CHECKS=6666210	SAT TT=0.943	SAT TT=4.132 ASSIGNMENTS=2346 CHECKS=4091210	SAT TT=0.673 ASSIGNMENTS=168 CHECKS=603594	SAT TT=3.852	No data	SAT TT=1.49	SAT TT=1.482
csp/pseudo/jnh/ normalized-jnh-210.xml	SAT TT=0.215	SAT TT=1.686 CHECKS=9707 NODES=540	SAT TT=1.659 CHECKS=11769 NODES=412	SAT TT=0.316	SAT TT=0.294 CHECKS=180968	SAT TT=0.296 CHECKS=218461	SAT TT=1.823 ASSIGNMENTS=66	SAT TT=1.951 ASSIGNMENTS=66	SAT TT=1.664 CHECKS=14071 NODES=204	SAT TT=3.083 CHECKS=2106610 NODES=11123	SAT TT=1.914 CHECKS=332638 NODES=707	SAT TT=0.299 ASSIGNMENTS=62 CHECKS=211328	SAT TT=0.287 ASSIGNMENTS=62 CHECKS=211328	SAT TT=3.168	SAT TT=3.225	No data	SAT TT=0.348 ASSIGNMENTS=71 CHECKS=270578	SAT TT=5.497 ASSIGNMENTS=3393 CHECKS=6000920	SAT TT=0.982	SAT TT=0.266 ASSIGNMENTS=95 CHECKS=163168	SAT TT=0.215 ASSIGNMENTS=48 CHECKS=141060	SAT TT=3.952	No data	SAT TT=1.733	SAT TT=1.802
csp/pseudo/jnh/ normalized-jnh-213.xml	SAT TT=0.19	SAT TT=1.623 CHECKS=8347 NODES=426	SAT TT=1.512 CHECKS=5890 NODES=0	SAT TT=0.386	SAT TT=0.319 CHECKS=200747	SAT TT=0.258 CHECKS=187587	SAT TT=1.672 ASSIGNMENTS=20	SAT TT=1.786 ASSIGNMENTS=20	SAT TT=1.624 CHECKS=32949 NODES=225	SAT TT=9.354 CHECKS=12345900 NODES=66492	SAT TT=2.349 CHECKS=1539550 NODES=2680	SAT TT=0.19 ASSIGNMENTS=54 CHECKS=127369	SAT TT=0.221 ASSIGNMENTS=54 CHECKS=127369	SAT TT=3.245	SAT TT=3.168	No data	SAT TT=0.325 ASSIGNMENTS=81 CHECKS=274473	SAT TT=4.743 ASSIGNMENTS=3123 CHECKS=5254140	SAT TT=0.991	SAT TT=1.884 ASSIGNMENTS=952 CHECKS=1683370	SAT TT=0.201 ASSIGNMENTS=41 CHECKS=120061	SAT TT=4.116	No data	SAT TT=1.606	SAT TT=1.596
csp/pseudo/jnh/ normalized-jnh-217.xml	SAT TT=0.232	SAT TT=1.865 CHECKS=15338 NODES=796	SAT TT=1.754 CHECKS=13338 NODES=619	SAT TT=0.351	SAT TT=0.271 CHECKS=134021	SAT TT=0.232 CHECKS=134257	SAT TT=1.845 ASSIGNMENTS=142	SAT TT=1.732 ASSIGNMENTS=142	SAT TT=1.86 CHECKS=77250 NODES=290	SAT TT=38.223 CHECKS=57262500 NODES=303588	SAT TT=5.978 CHECKS=10169500 NODES=13548	SAT TT=0.646 ASSIGNMENTS=168 CHECKS=598366	SAT TT=0.671 ASSIGNMENTS=168 CHECKS=598366	SAT TT=2.928	SAT TT=3.064	No data	SAT TT=1.033 ASSIGNMENTS=282 CHECKS=1021120	SAT TT=3.953 ASSIGNMENTS=2805 CHECKS=4410500	SAT TT=0.97	SAT TT=14.692 ASSIGNMENTS=9882 CHECKS=14044200	SAT TT=0.537 ASSIGNMENTS=117 CHECKS=442509	SAT TT=4.812	No data	SAT TT=1.42	SAT TT=1.795
csp/pseudo/jnh/ normalized-jnh-218.xml	SAT TT=0.176	SAT TT=1.678 CHECKS=11733 NODES=508	SAT TT=1.658 CHECKS=13636 NODES=443	SAT TT=0.331	SAT TT=0.222 CHECKS=110884	SAT TT=0.176 CHECKS=105033	SAT TT=1.588 ASSIGNMENTS=24	SAT TT=1.699 ASSIGNMENTS=24	SAT TT=1.616 CHECKS=31664 NODES=223	SAT TT=13.108 CHECKS=18478600 NODES=98000	? (TO) TT=1800.07	SAT TT=0.275 ASSIGNMENTS=59 CHECKS=181564	SAT TT=0.262 ASSIGNMENTS=59 CHECKS=181564	SAT TT=3.251	SAT TT=3.369	No data	SAT TT=0.347 ASSIGNMENTS=82 CHECKS=263507	SAT TT=3.948 ASSIGNMENTS=2400 CHECKS=4121460	SAT TT=0.997	SAT TT=0.434 ASSIGNMENTS=286 CHECKS=323000	SAT TT=0.259 ASSIGNMENTS=62 CHECKS=199714	SAT TT=4.101	No data	SAT TT=1.759	SAT TT=1.421
csp/pseudo/jnh/ normalized-jnh-220.xml	SAT TT=0.158	SAT TT=2.152 CHECKS=72228 NODES=2377	SAT TT=2.335 CHECKS=87729 NODES=2877	SAT TT=0.442	SAT TT=0.202 CHECKS=85141	SAT TT=0.158 CHECKS=81582	SAT TT=1.707 ASSIGNMENTS=88	SAT TT=1.708 ASSIGNMENTS=88	SAT TT=1.952 CHECKS=121631 NODES=299	SAT TT=573.648 CHECKS=915979000 NODES=4958410	SAT TT=3.826 CHECKS=4809690 NODES=7371	SAT TT=0.307 ASSIGNMENTS=62 CHECKS=223434	SAT TT=0.312 ASSIGNMENTS=62 CHECKS=223434	SAT TT=3.335	SAT TT=3.2	No data	SAT TT=0.287 ASSIGNMENTS=62 CHECKS=192758	SAT TT=6.802 ASSIGNMENTS=4253 CHECKS=7139510	SAT TT=0.99	SAT TT=2.665 ASSIGNMENTS=1516 CHECKS=2273940	SAT TT=0.397 ASSIGNMENTS=80 CHECKS=335072	SAT TT=4.478	No data	SAT TT=1.615	SAT TT=1.715
csp/pseudo/jnh/ normalized-jnh-301.xml	SAT TT=0.704	SAT TT=1.755 CHECKS=6351 NODES=538	SAT TT=1.816 CHECKS=7910 NODES=258	SAT TT=0.704	SAT TT=0.992 CHECKS=678516	SAT TT=1.252 CHECKS=914823	SAT TT=2.049 ASSIGNMENTS=767	SAT TT=2.018 ASSIGNMENTS=767	SAT TT=2.101 CHECKS=95691 NODES=291	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=9.92 ASSIGNMENTS=767	SAT TT=1.543 ASSIGNMENTS=288 CHECKS=1426390	SAT TT=3.688	SAT TT=3.818	No data	SAT TT=2.124 ASSIGNMENTS=384 CHECKS=1832000	SAT TT=9.472 ASSIGNMENTS=4222 CHECKS=9186690	SAT TT=0.971	SAT TT=4.158 ASSIGNMENTS=1480 CHECKS=3396950	SAT TT=1.889 ASSIGNMENTS=323 CHECKS=1631930	SAT TT=4.889	No data	SAT TT=1.559	SAT TT=1.771
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ jnh/ normalized-jnh-7.xml	SAT TT=0.26	SAT TT=1.667 CHECKS=8218 NODES=339	SAT TT=1.797 CHECKS=11671 NODES=342	SAT TT=0.35	SAT TT=0.26 CHECKS=142573	SAT TT=0.268 CHECKS=187535	SAT TT=1.591 ASSIGNMENTS=51	SAT TT=1.649 ASSIGNMENTS=51	SAT TT=1.681 CHECKS=12455 NODES=201	SAT TT=1.914 CHECKS=677138 NODES=3322	? (TO) TT=1800.06	SAT TT=0.331 ASSIGNMENTS=67 CHECKS=259351	SAT TT=0.369 ASSIGNMENTS=67 CHECKS=259351	SAT TT=3.127	SAT TT=3.403	No data	SAT TT=0.665 ASSIGNMENTS=145 CHECKS=558267	SAT TT=0.424 ASSIGNMENTS=183 CHECKS=345990	SAT TT=0.98	SAT TT=0.309 ASSIGNMENTS=108 CHECKS=184186	SAT TT=0.483 ASSIGNMENTS=104 CHECKS=434527	SAT TT=4.076	No data	SAT TT=1.73	SAT TT=1.447
csp/pseudo/ logic-synthesis/ normalized-5xp1-b.xml	SAT TT=1.543	SAT TT=4.112 CHECKS=23761 NODES=464	SAT TT=4.031 CHECKS=24239 NODES=0	SAT TT=1.72	SAT TT=7.097 CHECKS=164318	SAT TT=10.966 CHECKS=238309	SAT TT=3.519 ASSIGNMENTS=170	SAT TT=3.664 ASSIGNMENTS=441	SAT TT=128.313 CHECKS=42962 NODES=465	SAT TT=156.54 CHECKS=91826 NODES=0	SAT TT=177.303 CHECKS=91835 NODES=0	SAT TT=1.584 ASSIGNMENTS=169 CHECKS=1216870	SAT TT=1.675 ASSIGNMENTS=169 CHECKS=1216870	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	SAT TT=1.543 ASSIGNMENTS=169 CHECKS=1216870	SAT TT=2.255 ASSIGNMENTS=442 CHECKS=1514740	SAT TT=2.929	SAT TT=2.094 ASSIGNMENTS=572 CHECKS=1749760	SAT TT=1.631 ASSIGNMENTS=169 CHECKS=1216870	? (TO) TT=1800.12	No data	SAT TT=8.191	SAT TT=14.739
csp/pseudo/ logic-synthesis/ normalized-9sym-b.xml	SAT TT=0.996	SAT TT=3.118 CHECKS=18466 NODES=309	SAT TT=3.916 CHECKS=35697 NODES=309	SAT TT=1.246	SAT TT=2.585 CHECKS=108923	SAT TT=3.638 CHECKS=158449	SAT TT=2.65 ASSIGNMENTS=139	SAT TT=2.866 ASSIGNMENTS=189	SAT TT=88.778 CHECKS=38558 NODES=310	SAT TT=24.585 CHECKS=70388 NODES=0	SAT TT=26.695 CHECKS=75961 NODES=1	SAT TT=1.04 ASSIGNMENTS=141 CHECKS=711307	SAT TT=1.113 ASSIGNMENTS=141 CHECKS=711307	? (TO) TT=1800.07	? (TO) TT=1800.08	No data	SAT TT=1.016 ASSIGNMENTS=141 CHECKS=711307	SAT TT=1.106 ASSIGNMENTS=224 CHECKS=795965	SAT TT=2.132	SAT TT=1.439 ASSIGNMENTS=365 CHECKS=1027400	SAT TT=0.996 ASSIGNMENTS=139 CHECKS=681698	? (TO) TT=1800.13	No data	SAT TT=5.253	SAT TT=9.799
csp/pseudo/ logic-synthesis/ normalized-9symml.xml	SAT TT=0.213	SAT TT=2.304 CHECKS=8504 NODES=651	SAT TT=2.159 CHECKS=8668 NODES=0	SAT TT=0.54	SAT TT=0.376 CHECKS=51114	SAT TT=0.3 CHECKS=49311	SAT TT=2.753 ASSIGNMENTS=334	SAT TT=3.217 ASSIGNMENTS=559	SAT TT=108.996 CHECKS=12354 NODES=657	SAT TT=54.97 CHECKS=29511 NODES=40	SAT TT=64.251 CHECKS=61910 NODES=27	SAT TT=0.269 ASSIGNMENTS=340 CHECKS=46480	SAT TT=0.268 ASSIGNMENTS=340 CHECKS=46480	? (TO) TT=1800	? (TO) TT=1800.08	No data	SAT TT=0.283 ASSIGNMENTS=344 CHECKS=46384	SAT TT=0.213 ASSIGNMENTS=252 CHECKS=40802	SAT TT=1.955	SAT TT=87.176 ASSIGNMENTS=106253 CHECKS=15387600	SAT TT=0.284 ASSIGNMENTS=342 CHECKS=47964	? (TO) TT=1800.14	No data	SAT TT=2.166	SAT TT=2.185
csp/pseudo/ logic-synthesis/ normalized-alu4-b.xml	SAT TT=1.435	SAT TT=5.374 CHECKS=57694 NODES=807	SAT TT=5.715 CHECKS=52487 NODES=0	SAT TT=2.161	SAT TT=5.172 CHECKS=182985	SAT TT=6.772 CHECKS=274766	SAT TT=4.413 ASSIGNMENTS=443	SAT TT=4.305 ASSIGNMENTS=773	SAT TT=139.052 CHECKS=54510 NODES=810	SAT TT=314.744 CHECKS=113288 NODES=0	SAT TT=336.322 CHECKS=113280 NODES=0	SAT TT=1.435 ASSIGNMENTS=442 CHECKS=938023	SAT TT=1.68 ASSIGNMENTS=442 CHECKS=938023	? (TO) TT=1800.03	? (TO) TT=1800.08	No data	SAT TT=1.475 ASSIGNMENTS=442 CHECKS=938023	SAT TT=1.72 ASSIGNMENTS=745 CHECKS=1097510	SAT TT=7.32	SAT TT=2.113 ASSIGNMENTS=1104 CHECKS=1722680	SAT TT=1.764 ASSIGNMENTS=442 CHECKS=937460	? (TO) TT=1800.08	No data	SAT TT=8.79	SAT TT=14.5
csp/pseudo/ logic-synthesis/ normalized-apex4-a.xml	SAT TT=2.072	SAT TT=9.502 CHECKS=50601 NODES=4316	SAT TT=12.755 CHECKS=65043 NODES=4316	SAT TT=4.343	SAT TT=32.517 CHECKS=265348	SAT TT=83.933 CHECKS=931077	SAT TT=16.285 ASSIGNMENTS=2403	SAT TT=101.263 ASSIGNMENTS=3981	SAT TT=171.956 CHECKS=74442 NODES=4323	SAT TT=448.745 CHECKS=203580 NODES=14	SAT TT=574.466 CHECKS=310988 NODES=11	SAT TT=2.072 ASSIGNMENTS=2377 CHECKS=795047	SAT TT=2.17 ASSIGNMENTS=2377 CHECKS=795047	? (TO) TT=1800.01	? (TO) TT=1800.02	No data	SAT TT=2.245 ASSIGNMENTS=2377 CHECKS=795047	SAT TT=2.205 ASSIGNMENTS=3212 CHECKS=806602	SAT TT=93.027	SAT TT=2.888 ASSIGNMENTS=6051 CHECKS=1461360	SAT TT=2.251 ASSIGNMENTS=2384 CHECKS=795454	? (TO) TT=1800.11	No data	SAT TT=9.87	SAT TT=11.987
csp/pseudo/ logic-synthesis/ normalized-bench1-pi.xml	SAT TT=0.37	SAT TT=6.556 CHECKS=16806 NODES=4676	SAT TT=6.343 CHECKS=15108 NODES=0	SAT TT=0.97	SAT TT=7.542 CHECKS=88905	SAT TT=7.273 CHECKS=58533	SAT TT=6.211 ASSIGNMENTS=4318	SAT TT=5.332 ASSIGNMENTS=4318	SAT TT=135.18 CHECKS=15774 NODES=4676	SAT TT=770.873 CHECKS=29554 NODES=1	SAT TT=961.015 CHECKS=29499 NODES=0	SAT TT=13.67 ASSIGNMENTS=4318	SAT TT=11.248 ASSIGNMENTS=4676 CHECKS=15686	? (TO) TT=1800.02	? (TO) TT=1800.04	No data	SAT TT=5.717 ASSIGNMENTS=4286 CHECKS=292844	SAT TT=0.37 ASSIGNMENTS=1160 CHECKS=168646	SAT TT=1.95	SAT TT=13.686 ASSIGNMENTS=6658 CHECKS=482534	SAT TT=4.993 ASSIGNMENTS=4428 CHECKS=292751	? (TO) TT=1800.15	No data	SAT TT=3.998	SAT TT=5.074
csp/pseudo/ logic-synthesis/ normalized-clip-b.xml	SAT TT=0.713	SAT TT=2.607 CHECKS=15723 NODES=349	SAT TT=2.737 CHECKS=13381 NODES=0	SAT TT=0.821	SAT TT=2.012 CHECKS=57986	SAT TT=2.419 CHECKS=77633	SAT TT=2.146 ASSIGNMENTS=217	SAT TT=2.18 ASSIGNMENTS=306	SAT TT=123.663 CHECKS=21489 NODES=350	SAT TT=76.775 CHECKS=45530 NODES=1	SAT TT=75.021 CHECKS=46777 NODES=1	SAT TT=0.872 ASSIGNMENTS=218 CHECKS=547935	SAT TT=0.866 ASSIGNMENTS=218 CHECKS=547935	? (TO) TT=1800.04	? (TO) TT=1800.06	No data	SAT TT=0.845 ASSIGNMENTS=218 CHECKS=547935	SAT TT=0.763 ASSIGNMENTS=313 CHECKS=562889	SAT TT=2.006	SAT TT=0.713 ASSIGNMENTS=313 CHECKS=561647	SAT TT=0.737 ASSIGNMENTS=220 CHECKS=546847	? (TO) TT=1800.08	No data	SAT TT=3.816	SAT TT=7.138
csp/pseudo/ logic-synthesis/ normalized-count-b.xml	SAT TT=0.74	SAT TT=3.201 CHECKS=16860 NODES=467	SAT TT=3.189 CHECKS=21823 NODES=0	SAT TT=1.04	SAT TT=2.134 CHECKS=94584	SAT TT=2.742 CHECKS=124431	SAT TT=2.162 ASSIGNMENTS=319	SAT TT=2.509 ASSIGNMENTS=446	SAT TT=128.307 CHECKS=21992 NODES=468	SAT TT=563.925 CHECKS=53996 NODES=0	SAT TT=568.243 CHECKS=57734 NODES=1	SAT TT=0.779 ASSIGNMENTS=313 CHECKS=518929	SAT TT=0.79 ASSIGNMENTS=313 CHECKS=518929	? (TO) TT=1800.04	? (TO) TT=1800.05	No data	SAT TT=0.74 ASSIGNMENTS=313 CHECKS=518929	SAT TT=0.772 ASSIGNMENTS=415 CHECKS=530954	SAT TT=1.782	SAT TT=1.089 ASSIGNMENTS=652 CHECKS=854530	SAT TT=0.787 ASSIGNMENTS=318 CHECKS=564488	? (TO) TT=1800.1	No data	SAT TT=4.492	SAT TT=7.726
csp/pseudo/ logic-synthesis/ normalized-e-am-pi.xml	SAT TT=1.977	SAT TT=7.427 CHECKS=18602 NODES=4676	SAT TT=6.254 CHECKS=18619 NODES=0	SAT TT=1.977	SAT TT=11.633 CHECKS=71293	SAT TT=10.275 CHECKS=71842	SAT TT=8.192 ASSIGNMENTS=4410	SAT TT=8.536 ASSIGNMENTS=4410	SAT TT=151.768 CHECKS=51022 NODES=4676	SAT TT=348.4 CHECKS=128986 NODES=0	SAT TT=295.467 CHECKS=128986 NODES=0	SAT TT=11.526 ASSIGNMENTS=4420 CHECKS=1789690	SAT TT=14.375 ASSIGNMENTS=4676 CHECKS=18409	? (TO) TT=1800.07	? (TO) TT=1800.09	No data	SAT TT=2.402 ASSIGNMENTS=4414 CHECKS=1789700	SAT TT=2.635 ASSIGNMENTS=4554 CHECKS=1790230	SAT TT=3.493	SAT TT=2.171 ASSIGNMENTS=4520 CHECKS=1790110	SAT TT=2.749 ASSIGNMENTS=4420 CHECKS=1789690	? (TO) TT=1800.15	No data	SAT TT=8.314	SAT TT=18.229
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ logic-synthesis/ normalized-ex5-pi.xml	SAT TT=2.653	SAT TT=7.273 CHECKS=34697 NODES=2459	SAT TT=6.598 CHECKS=26787 NODES=0	SAT TT=2.653	SAT TT=10.591 CHECKS=87846	SAT TT=10.263 CHECKS=86998	SAT TT=5.459 ASSIGNMENTS=2299	SAT TT=5.405 ASSIGNMENTS=2299	SAT TT=148.627 CHECKS=92258 NODES=2459	SAT TT=1008.2 CHECKS=121457 NODES=0	SAT TT=918.267 CHECKS=124842 NODES=1	SAT TT=13.828 ASSIGNMENTS=2306 CHECKS=2594730	SAT TT=15.092 ASSIGNMENTS=2459 CHECKS=34670	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	SAT TT=3.959 ASSIGNMENTS=2302 CHECKS=2594070	SAT TT=3.271 ASSIGNMENTS=2349 CHECKS=2594800	SAT TT=19.119	SAT TT=3.321 ASSIGNMENTS=2364 CHECKS=2591550	SAT TT=3.537 ASSIGNMENTS=2306 CHECKS=2594730	? (TO) TT=1800.13	No data	SAT TT=11.341	SAT TT=26.354
csp/pseudo/ logic-synthesis/ normalized-f51m-b.xml	SAT TT=0.696	SAT TT=2.763 CHECKS=13302 NODES=406	SAT TT=2.842 CHECKS=16722 NODES=0	SAT TT=0.82	SAT TT=1.3 CHECKS=36109	SAT TT=1.499 CHECKS=43272	SAT TT=2.006 ASSIGNMENTS=158	SAT TT=2.437 ASSIGNMENTS=385	SAT TT=128.771 CHECKS=21160 NODES=407	SAT TT=75.179 CHECKS=41348 NODES=0	SAT TT=80.098 CHECKS=41346 NODES=0	SAT TT=0.718 ASSIGNMENTS=155 CHECKS=478880	SAT TT=0.714 ASSIGNMENTS=155 CHECKS=478880	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	SAT TT=0.7 ASSIGNMENTS=155 CHECKS=478880	SAT TT=0.758 ASSIGNMENTS=381 CHECKS=568577	SAT TT=2.14	SAT TT=0.7 ASSIGNMENTS=365 CHECKS=562472	SAT TT=0.696 ASSIGNMENTS=155 CHECKS=479221	? (TO) TT=1800.14	No data	SAT TT=4.245	SAT TT=7.201
csp/pseudo/ logic-synthesis/ normalized-max1024-pi.xml	SAT TT=0.295	SAT TT=3.073 CHECKS=9830 NODES=1278	SAT TT=2.079 CHECKS=4324 NODES=0	SAT TT=0.541	SAT TT=0.387 CHECKS=22526	SAT TT=0.333 CHECKS=17711	SAT TT=2.053 ASSIGNMENTS=912	SAT TT=2.222 ASSIGNMENTS=912	SAT TT=9.631 CHECKS=15156 NODES=1278	SAT TT=5.841 CHECKS=24662 NODES=5	SAT TT=6.181 CHECKS=25119 NODES=1	SAT TT=0.528 ASSIGNMENTS=922 CHECKS=61434	SAT TT=0.505 ASSIGNMENTS=922 CHECKS=61434	SAT TT=6.053	SAT TT=7.062	No data	SAT TT=0.419 ASSIGNMENTS=922 CHECKS=61434	SAT TT=0.295 ASSIGNMENTS=1213 CHECKS=152504	SAT TT=1.553	SAT TT=26.63 ASSIGNMENTS=23180 CHECKS=2911850	SAT TT=0.537 ASSIGNMENTS=918 CHECKS=61401	SAT TT=34.977	No data	SAT TT=2.889	SAT TT=2.646
csp/pseudo/ logic-synthesis/ normalized-prom2-pi.xml	SAT TT=0.485	SAT TT=3.756 CHECKS=34835 NODES=2617	SAT TT=3.643 CHECKS=12253 NODES=0	SAT TT=1.11	SAT TT=2.3 CHECKS=37165	SAT TT=2.13 CHECKS=37018	SAT TT=4.059 ASSIGNMENTS=1978	SAT TT=8.107 ASSIGNMENTS=2207	SAT TT=132.285 CHECKS=35952 NODES=2617	SAT TT=142.015 CHECKS=52404 NODES=11	SAT TT=124.545 CHECKS=68090 NODES=11	SAT TT=0.545 ASSIGNMENTS=1990 CHECKS=166534	SAT TT=0.51 ASSIGNMENTS=1990 CHECKS=166534	SAT TT=1222.31	SAT TT=1269.83	No data	SAT TT=0.566 ASSIGNMENTS=1990 CHECKS=166534	SAT TT=0.527 ASSIGNMENTS=2158 CHECKS=166853	SAT TT=2.507	SAT TT=0.485 ASSIGNMENTS=2148 CHECKS=166856	SAT TT=0.499 ASSIGNMENTS=1986 CHECKS=166402	? (TO) TT=1800.07	No data	SAT TT=4.753	SAT TT=5.8
csp/pseudo/ logic-synthesis/ normalized-rot-b.xml	SAT TT=1.555	SAT TT=6.263 CHECKS=58091 NODES=1451	SAT TT=7.501 CHECKS=80442 NODES=1451	SAT TT=2.387	SAT TT=8.973 CHECKS=291760	SAT TT=10.412 CHECKS=293068	SAT TT=5.204 ASSIGNMENTS=970	SAT TT=6.601 ASSIGNMENTS=1321	SAT TT=130.813 CHECKS=57157 NODES=1454	SAT TT=451.87 CHECKS=129137 NODES=2	SAT TT=455.203 CHECKS=136745 NODES=3	SAT TT=1.633 ASSIGNMENTS=978 CHECKS=910309	SAT TT=1.6 ASSIGNMENTS=978 CHECKS=910309	? (TO) TT=1800.05	? (TO) TT=1800.09	No data	SAT TT=1.633 ASSIGNMENTS=978 CHECKS=910309	SAT TT=1.555 ASSIGNMENTS=1289 CHECKS=925883	SAT TT=8.929	SAT TT=2.898 ASSIGNMENTS=3808 CHECKS=2613260	SAT TT=1.655 ASSIGNMENTS=970 CHECKS=910296	? (TO) TT=1800.11	No data	SAT TT=9.25	SAT TT=15.271
csp/pseudo/ logic-synthesis/ normalized-sao2-b.xml	SAT TT=0.465	SAT TT=2.787 CHECKS=26899 NODES=372	SAT TT=2.933 CHECKS=37190 NODES=372	SAT TT=0.795	SAT TT=0.644 CHECKS=28378	SAT TT=0.743 CHECKS=37262	SAT TT=2.448 ASSIGNMENTS=163	SAT TT=2.13 ASSIGNMENTS=358	SAT TT=128.827 CHECKS=19381 NODES=373	SAT TT=182.168 CHECKS=40254 NODES=0	SAT TT=177.589 CHECKS=40279 NODES=0	SAT TT=0.527 ASSIGNMENTS=162 CHECKS=275577	SAT TT=0.474 ASSIGNMENTS=162 CHECKS=275577	? (TO) TT=1800.06	? (TO) TT=1800.03	No data	SAT TT=0.465 ASSIGNMENTS=162 CHECKS=275577	SAT TT=0.644 ASSIGNMENTS=338 CHECKS=365000	SAT TT=1.807	SAT TT=0.673 ASSIGNMENTS=449 CHECKS=475534	SAT TT=0.509 ASSIGNMENTS=163 CHECKS=276049	? (TO) TT=1800.08	No data	SAT TT=4.289	SAT TT=5.75
csp/pseudo/mps/ normalized-mps-10teams.xml	SAT TT=6.266	? (TO) TT=1800.07	? (TO) TT=1800.15	SAT TT=7.481	SAT TT=1224.27 CHECKS=7024600	? (TO) TT=1800.03	SAT TT=13.293 ASSIGNMENTS=413	SAT TT=13.206 ASSIGNMENTS=403	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=19.813 ASSIGNMENTS=413	SAT TT=1605.46 ASSIGNMENTS=413	? (TO) TT=1800.08	? (TO) TT=1800.03	No data	SAT TT=563.688 ASSIGNMENTS=91810 CHECKS=485503000	? (TO) TT=1800.08	SAT TT=57.405	SAT TT=866.813 ASSIGNMENTS=105160 CHECKS=700807000	SAT TT=528.981 ASSIGNMENTS=69460 CHECKS=398790000	? (TO) TT=1800.13	No data	SAT TT=8.774	SAT TT=6.266
csp/pseudo/mps/ normalized-mps-air01.xml	SAT TT=0.975	SAT TT=4.413 CHECKS=48393 NODES=784	SAT TT=5.047 CHECKS=114850 NODES=1417	SAT TT=0.975	SAT TT=39.604 CHECKS=36496	SAT TT=5.566 CHECKS=4864	SAT TT=5.223 ASSIGNMENTS=374	SAT TT=5.683 ASSIGNMENTS=219	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=9.833 ASSIGNMENTS=724 CHECKS=1286420	SAT TT=12.337 ASSIGNMENTS=784 CHECKS=48393	? (TO) TT=1800.02	? (TO) TT=1800	No data	SAT TT=3.234 ASSIGNMENTS=866 CHECKS=4026810	SAT TT=6.25 ASSIGNMENTS=3702 CHECKS=8587800	SAT TT=3.509	SAT TT=4.056 ASSIGNMENTS=1828 CHECKS=6244830	SAT TT=1.711 ASSIGNMENTS=724 CHECKS=1286420	? TT=1680.71	No data	SAT TT=4.926	SAT TT=10.945
csp/pseudo/mps/ normalized-mps-air02.xml	SAT TT=33.176	? TT=78.573	? TT=70.217	SAT TT=33.176	Signal TT=13.116	Signal TT=14.099	? (problem) TT=53.27	? (problem) TT=50.585	? TT=0.652	? TT=0.694	? TT=0.695	? (MO) TT=227.4	? (MO) TT=242.07	? (problem) TT=38.889	? (problem) TT=41.385	No data	Signal TT=109.874	Signal TT=115.808	? (exit code) TT=202.793	SAT TT=174.206 ASSIGNMENTS=2960 CHECKS=143411000	Signal TT=107.316	? (TO) TT=1800.24	No data	? (MO) TT=133.147	? (MO) TT=344.443
csp/pseudo/mps/ normalized-mps-air03.xml	SAT TT=51.237	? TT=102.88	? TT=110.348	SAT TT=51.237	Signal TT=13.606	Signal TT=14.332	? (problem) TT=60.625	? (problem) TT=65.132	? TT=1.259	? TT=1.178	? TT=1.504	? (MO) TT=324.09	? (MO) TT=317.37	? (problem) TT=56.809	? (problem) TT=60.952	No data	Signal TT=133.986	Signal TT=180.765	? (exit code) TT=285.484	SAT TT=211.219 ASSIGNMENTS=2978 CHECKS=161318000	Signal TT=142.895	? (TO) TT=1800.09	No data	? (MO) TT=204.502	? (MO) TT=386.423
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/mps/ normalized-mps-air05.xml	SAT TT=46.035	? (TO) TT=1800.2	? (TO) TT=1800.19	SAT TT=902.087	SAT TT=393.723 CHECKS=314931	SAT TT=169.741 CHECKS=133562	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.04	? TT=190.769 CHECKS=51193 NODES=0	? TT=195.738 CHECKS=51185 NODES=0	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.01	No data	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.12	? TT=300.482	No data	SAT TT=46.035	SAT TT=102.116
csp/pseudo/mps/ normalized-mps-air06.xml	SAT TT=912.34	? (TO) TT=1800.21	? (TO) TT=1800.09	SAT TT=912.34	? (TO) TT=1800.19	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=233.923 CHECKS=2166780 NODES=0	? TT=225.272 CHECKS=2166740 NODES=0	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.16	? TT=515.17	No data	? (TO) TT=1800.12	? (TO) TT=1800.06
csp/pseudo/mps/ normalized-mps-bm23.xml	SAT TT=0.053	SAT TT=18.278 CHECKS=7659260 NODES=181	SAT TT=41.982 CHECKS=18496700 NODES=202	SAT TT=0.069	SAT TT=0.128 CHECKS=1524	SAT TT=0.13 CHECKS=1512	SAT TT=0.656 ASSIGNMENTS=29	SAT TT=0.87 ASSIGNMENTS=188	SAT TT=131.906 CHECKS=790925 NODES=93	SAT TT=139.59 CHECKS=120578 NODES=600025	SAT TT=129.564 CHECKS=117528 NODES=7	SAT TT=0.082 ASSIGNMENTS=61 CHECKS=85446	SAT TT=0.08 ASSIGNMENTS=61 CHECKS=85446	? (problem) TT=38.057	? (problem) TT=37.496	No data	SAT TT=0.064 ASSIGNMENTS=50 CHECKS=72707	SAT TT=0.288 ASSIGNMENTS=436 CHECKS=465635	SAT TT=0.501	SAT TT=48.097 ASSIGNMENTS=38426 CHECKS=25142200	SAT TT=0.053 ASSIGNMENTS=29 CHECKS=46196	? TT=480.457	No data	SAT TT=1.602	SAT TT=2.527
csp/pseudo/mps/ normalized-mps-diamond.xml	UNSAT TT=0.005	UNSAT TT=0.708 CHECKS=2 NODES=0	UNSAT TT=0.665 CHECKS=2 NODES=0	UNSAT TT=0.023	UNSAT TT=0.008 CHECKS=14	UNSAT TT=0.006 CHECKS=14	UNSAT TT=0.427 ASSIGNMENTS=0	UNSAT TT=0.469 ASSIGNMENTS=0	UNSAT TT=0.41 CHECKS=10 NODES=1	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.017 ASSIGNMENTS=1 CHECKS=11	UNSAT TT=0.017 ASSIGNMENTS=1 CHECKS=11	Wrong Cert. TT=0.842	Wrong Cert. TT=1.03	No data	UNSAT TT=0.007 ASSIGNMENTS=1 CHECKS=11	UNSAT TT=0.007 ASSIGNMENTS=1 CHECKS=11	UNSAT TT=0.278	UNSAT TT=0.005 ASSIGNMENTS=1 CHECKS=11	UNSAT TT=0.005 ASSIGNMENTS=1 CHECKS=11	UNSAT TT=0.828	No data	UNSAT TT=0.437	UNSAT TT=0.437
csp/pseudo/mps/ normalized-mps-l152lav.xml		? (TO) TT=1800.13	? (TO) TT=1800.19	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.07	? TT=0.413	? TT=0.423	? TT=0.428	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.1	No data	? (TO) TT=1800.11	? (TO) TT=1800.07	? (exit code) TT=11.019	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=312.093	No data	? (TO) TT=1800.18	? (TO) TT=1800.09
csp/pseudo/mps/ normalized-mps-mitre.xml	SAT TT=1598.68	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=1598.68	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800	No data	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1205.44	? (TO) TT=1800.12	? (TO) TT=1800.04	? TT=235.746	No data	? TT=174.062	? TT=169.608
csp/pseudo/mps/ normalized-mps-mzzv11.xml	SAT TT=7.263	? (TO) TT=1800.24	SAT TT=323.987 CHECKS=108458000 NODES=0	SAT TT=14.596	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=43.82 ASSIGNMENTS=2919	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=19.478 ASSIGNMENTS=3611 CHECKS=1266060	SAT TT=1104.74 ASSIGNMENTS=3611 CHECKS=1266060	? (problem) TT=209.161	? (problem) TT=197.863	No data	SAT TT=7.431 ASSIGNMENTS=3600 CHECKS=1266010	SAT TT=7.975 ASSIGNMENTS=4513 CHECKS=1915370	SAT TT=31.594	SAT TT=66.896 ASSIGNMENTS=25378 CHECKS=25954300	SAT TT=7.263 ASSIGNMENTS=3611 CHECKS=1266060	? TT=219.312	No data	? (MO) TT=80.546	? (MO) TT=269.523
csp/pseudo/mps/ normalized-mps-neos5.xml	SAT TT=0.426	SAT TT=2.459 CHECKS=124363 NODES=163	SAT TT=14.042 CHECKS=2252970 NODES=0	SAT TT=0.426	SAT TT=8.603 CHECKS=12823	SAT TT=8.846 CHECKS=12282	SAT TT=1.442 ASSIGNMENTS=145	SAT TT=1.505 ASSIGNMENTS=145	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.626 ASSIGNMENTS=145 CHECKS=627292	SAT TT=0.627 ASSIGNMENTS=145 CHECKS=627292	? (TO) TT=1800.09	? (TO) TT=1800.07	No data	SAT TT=0.614 ASSIGNMENTS=145 CHECKS=627292	SAT TT=2.422 ASSIGNMENTS=764 CHECKS=3287350	SAT TT=1.452	? (TO) TT=1800.09	SAT TT=0.614 ASSIGNMENTS=144 CHECKS=623010	? (TO) TT=1800.15	No data	? TT=220.732	? TT=218.814
csp/pseudo/mps/ normalized-mps-opt1217.xml	SAT TT=0.137	SAT TT=1.796 CHECKS=3116 NODES=787	SAT TT=1.422 CHECKS=3316 NODES=0	SAT TT=0.277	SAT TT=3.116 CHECKS=12385	SAT TT=4.013 CHECKS=15086	SAT TT=1.574 ASSIGNMENTS=738	SAT TT=1.922 ASSIGNMENTS=721	SAT TT=780.999 CHECKS=806636000 NODES=787	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=0.187 ASSIGNMENTS=738 CHECKS=85373	SAT TT=0.163 ASSIGNMENTS=738 CHECKS=85373	? (TO) TT=1800	? (TO) TT=1800.09	No data	SAT TT=0.178 ASSIGNMENTS=738 CHECKS=85373	SAT TT=0.137 ASSIGNMENTS=133 CHECKS=83899	SAT TT=1.224	SAT TT=0.17 ASSIGNMENTS=504 CHECKS=82796	SAT TT=0.178 ASSIGNMENTS=738 CHECKS=85373	? (TO) TT=1800.23	No data	? TT=200.637	? TT=191.939
csp/pseudo/mps/ normalized-mps-p0282.xml	SAT TT=0.07	SAT TT=54.075 CHECKS=22091000 NODES=284	SAT TT=147.706 CHECKS=42640500 NODES=0	SAT TT=0.169	SAT TT=0.613 CHECKS=11903	SAT TT=0.611 CHECKS=12400	SAT TT=1.296 ASSIGNMENTS=221	SAT TT=1.171 ASSIGNMENTS=266	SAT TT=124.648 CHECKS=3573950 NODES=282	SAT TT=250.547 CHECKS=2506190 NODES=13	SAT TT=261.429 CHECKS=3403180 NODES=49	SAT TT=0.082 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.084 ASSIGNMENTS=237 CHECKS=46009	? (problem) TT=79.221	? (problem) TT=72.285	No data	SAT TT=0.074 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.073 ASSIGNMENTS=133 CHECKS=39479	SAT TT=0.837	SAT TT=0.07 ASSIGNMENTS=212 CHECKS=35108	SAT TT=0.071 ASSIGNMENTS=228 CHECKS=45887	? (TO) TT=1801.37	No data	SAT TT=36.761	SAT TT=159.111
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/mps/ normalized-mps-p0291.xml	SAT TT=0.036	SAT TT=14.597 CHECKS=3270560 NODES=291	SAT TT=52.658 CHECKS=12747000 NODES=0	SAT TT=0.106	SAT TT=0.728 CHECKS=18263	SAT TT=0.659 CHECKS=16522	SAT TT=1.038 ASSIGNMENTS=274	SAT TT=1.245 ASSIGNMENTS=115	? (TO) TT=1800	SAT TT=40.551 CHECKS=5933 NODES=11	SAT TT=40.363 CHECKS=9690 NODES=15	SAT TT=0.053 ASSIGNMENTS=274 CHECKS=19556	SAT TT=0.051 ASSIGNMENTS=274 CHECKS=19556	? (MO) TT=1476.11	? (MO) TT=1465.58	No data	SAT TT=0.04 ASSIGNMENTS=274 CHECKS=19556	SAT TT=0.036 ASSIGNMENTS=122 CHECKS=13175	SAT TT=0.829	SAT TT=0.038 ASSIGNMENTS=192 CHECKS=9930	SAT TT=0.041 ASSIGNMENTS=278 CHECKS=19833	? (TO) TT=1800.16	No data	SAT TT=11.746	SAT TT=47.864
csp/pseudo/mps/ normalized-mps-p0548.xml	SAT TT=0.097	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=3.476 CHECKS=16160	SAT TT=3.503 CHECKS=17109	SAT TT=1.311 ASSIGNMENTS=389	SAT TT=2.316 ASSIGNMENTS=2810	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=0.109 ASSIGNMENTS=382 CHECKS=54026	SAT TT=0.11 ASSIGNMENTS=382 CHECKS=54026	? (MO) TT=27.01	? (MO) TT=24.38	No data	SAT TT=0.097 ASSIGNMENTS=384 CHECKS=53525	? (TO) TT=1800.09	SAT TT=1.277	? (TO) TT=1800.04	SAT TT=0.255 ASSIGNMENTS=971 CHECKS=371348	? TT=410.431	No data	? TT=165.183	? TT=172.715
csp/pseudo/mps/ normalized-mps-seymour.xml	SAT TT=0.9	SAT TT=10.219 CHECKS=27824 NODES=1372	SAT TT=5.339 CHECKS=15815 NODES=0	SAT TT=2.125	SAT TT=2.033 CHECKS=181757	SAT TT=1.856 CHECKS=184204	SAT TT=4.816 ASSIGNMENTS=792	SAT TT=5.198 ASSIGNMENTS=792	SAT TT=14.75 CHECKS=86280 NODES=1372	SAT TT=7.577 CHECKS=116673 NODES=3	SAT TT=7.364 CHECKS=132767 NODES=4	SAT TT=0.946 ASSIGNMENTS=801 CHECKS=293943	SAT TT=0.934 ASSIGNMENTS=801 CHECKS=293943	SAT TT=16.69	SAT TT=21.279	No data	SAT TT=0.928 ASSIGNMENTS=801 CHECKS=293943	SAT TT=0.915 ASSIGNMENTS=893 CHECKS=294998	SAT TT=16.128	SAT TT=0.9 ASSIGNMENTS=876 CHECKS=295079	SAT TT=0.922 ASSIGNMENTS=803 CHECKS=293957	SAT TT=56.852	No data	SAT TT=7.394	SAT TT=8.315
csp/pseudo/mps/ normalized-mps-stein27.xml	SAT TT=0.012	SAT TT=0.942 CHECKS=1864 NODES=27	SAT TT=0.883 CHECKS=3714 NODES=0	SAT TT=0.05	SAT TT=0.039 CHECKS=7897	SAT TT=0.026 CHECKS=7133	SAT TT=0.701 ASSIGNMENTS=9	SAT TT=0.666 ASSIGNMENTS=9	SAT TT=74.718 CHECKS=277484 NODES=27	SAT TT=14.306 CHECKS=165499 NODES=0	SAT TT=14.338 CHECKS=165467 NODES=0	SAT TT=0.024 ASSIGNMENTS=8 CHECKS=1620	SAT TT=0.025 ASSIGNMENTS=8 CHECKS=1620	? (MO) TT=38.08	? (MO) TT=38.27	No data	SAT TT=0.012 ASSIGNMENTS=8 CHECKS=1620	SAT TT=0.013 ASSIGNMENTS=6 CHECKS=1590	SAT TT=0.421	SAT TT=0.015 ASSIGNMENTS=8 CHECKS=1631	SAT TT=0.013 ASSIGNMENTS=9 CHECKS=1593	? TT=1091.71	No data	SAT TT=0.649	SAT TT=0.687
csp/pseudo/mps/ normalized-mps-stein9.xml	SAT TT=0.006	SAT TT=0.708 CHECKS=61 NODES=9	SAT TT=0.67 CHECKS=68 NODES=0	SAT TT=0.026	SAT TT=0.007 CHECKS=342	SAT TT=0.012 CHECKS=946	SAT TT=0.498 ASSIGNMENTS=5	SAT TT=0.476 ASSIGNMENTS=5	SAT TT=0.475 CHECKS=186 NODES=9	SAT TT=0.435 CHECKS=277 NODES=0	SAT TT=0.46 CHECKS=275 NODES=0	SAT TT=0.019 ASSIGNMENTS=4 CHECKS=186	SAT TT=0.018 ASSIGNMENTS=4 CHECKS=186	SAT TT=0.958	SAT TT=1.242	No data	SAT TT=0.006 ASSIGNMENTS=4 CHECKS=186	SAT TT=0.007 ASSIGNMENTS=4 CHECKS=183	SAT TT=0.276	SAT TT=0.007 ASSIGNMENTS=4 CHECKS=186	SAT TT=0.007 ASSIGNMENTS=4 CHECKS=186	SAT TT=0.988	No data	SAT TT=0.485	SAT TT=0.51
csp/pseudo/mps/ normalized-mps-vpm2.xml		? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.12	? (MO) TT=1428.96	? (MO) TT=1422.49	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=1732.42	No data	? TT=149.051	? TT=143.138
csp/pseudo/mpsReduced/ normalized-mps-red-afiro.xml	SAT TT=2.419	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=1679.15	SAT TT=1059.91 CHECKS=1127600	SAT TT=72.893 CHECKS=88785	SAT TT=3.26 ASSIGNMENTS=4152	SAT TT=2.419 ASSIGNMENTS=1185	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=12.857 ASSIGNMENTS=7661 CHECKS=11010100	SAT TT=1254.63 ASSIGNMENTS=7661 CHECKS=11010100	? (MO) TT=232.41	? (MO) TT=229.28	No data	SAT TT=2.592 ASSIGNMENTS=9210 CHECKS=4777940	SAT TT=5.396 ASSIGNMENTS=14673 CHECKS=11742200	SAT TT=20.733	? (TO) TT=1800.03	SAT TT=5.35 ASSIGNMENTS=7661 CHECKS=11010100	? (TO) TT=1802.2	No data	SAT TT=42.305	SAT TT=198.856
csp/pseudo/mpsReduced/ normalized-mps-red-agg3.xml	SAT TT=18.197	? (TO) TT=1800.17	? (TO) TT=1800.18	SAT TT=18.197	? (TO) TT=1800.13	? (TO) TT=1800.21	SAT TT=62.033 ASSIGNMENTS=7209	? (TO) TT=1800.14	? TT=0.907	? TT=1.058	? TT=0.898	SAT TT=793.552 ASSIGNMENTS=7209	SAT TT=1729.36 ASSIGNMENTS=7209	? (MO) TT=154.97	? (MO) TT=155.59	No data	? (TO) TT=1800.12	? (TO) TT=1800.09	SAT TT=44.401	? (TO) TT=1800.12	? (TO) TT=1800.14	? TT=234.481	No data	? TT=153.627	? TT=147.522
csp/pseudo/mpsReduced/ normalized-mps-red-agg.xml	SAT TT=1479.2	? (TO) TT=1800.06	? (TO) TT=1800.19	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=141.404 ASSIGNMENTS=102049	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800	SAT TT=1479.2 ASSIGNMENTS=102049	? (MO) TT=117.55	? (MO) TT=117.94	No data	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.13	? TT=237.629	No data	? TT=158.975	? TT=161.948
csp/pseudo/mpsReduced/ normalized-mps-red-air01.xml	SAT TT=0.972	SAT TT=4.383 CHECKS=48393 NODES=784	SAT TT=5.03 CHECKS=114850 NODES=1417	SAT TT=0.972	SAT TT=42.169 CHECKS=37578	SAT TT=6.311 CHECKS=5059	SAT TT=5.245 ASSIGNMENTS=374	SAT TT=5.477 ASSIGNMENTS=219	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=10.278 ASSIGNMENTS=724 CHECKS=1286420	SAT TT=12.309 ASSIGNMENTS=784 CHECKS=48393	? (TO) TT=1800.01	? (TO) TT=1800.04	No data	SAT TT=3.187 ASSIGNMENTS=866 CHECKS=4026810	SAT TT=13.581 ASSIGNMENTS=7867 CHECKS=21503600	SAT TT=3.296	SAT TT=3.676 ASSIGNMENTS=1828 CHECKS=6244830	SAT TT=1.692 ASSIGNMENTS=724 CHECKS=1286420	? TT=1578.44	No data	SAT TT=4.555	SAT TT=10.938
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/mpsReduced/ normalized-mps-red-air03.xml	SAT TT=48.271	? TT=110.398	? TT=110.616	SAT TT=48.271	Signal TT=12.54	Signal TT=13.569	? (problem) TT=65.158	? (problem) TT=60.638	? TT=1.206	? TT=1.143	? TT=1.402	? (MO) TT=302.74	? (MO) TT=307.37	? (problem) TT=56.993	? (problem) TT=62.244	No data	Signal TT=138.532	Signal TT=285.352	? (exit code) TT=295.178	SAT TT=203.283 ASSIGNMENTS=2978 CHECKS=161318000	Signal TT=138.98	? (TO) TT=1800.1	No data	? (MO) TT=194.775	? (MO) TT=408.775
csp/pseudo/mpsReduced/ normalized-mps-red-bandm.xml	UNSAT TT=21.105	? (TO) TT=1800.21	? (TO) TT=1800.22	UNSAT TT=21.105	Signal TT=14.018	Signal TT=14.019	UNSAT TT=114.31 ASSIGNMENTS=0	UNSAT TT=101.17 ASSIGNMENTS=0	? TT=0.87	? TT=0.949	? TT=0.717	UNSAT TT=108.4 ASSIGNMENTS=49 CHECKS=25473600	UNSAT TT=1468.6 ASSIGNMENTS=49 CHECKS=25473600	? (TO) TT=1800.04	? (TO) TT=1800	No data	UNSAT TT=50.685 ASSIGNMENTS=24 CHECKS=24615600	UNSAT TT=632.021 ASSIGNMENTS=226086 CHECKS=725820000	? (exit code) TT=104.874	UNSAT TT=68.545 ASSIGNMENTS=3132 CHECKS=46213100	UNSAT TT=51.693 ASSIGNMENTS=49 CHECKS=25473600	? (TO) TT=1800.08	No data	? TT=449.466	? TT=430.444
csp/pseudo/mpsReduced/ normalized-mps-red-beaconfd.xml	SAT TT=73.052	? TT=2.874	? TT=3.163	SAT TT=73.052	Signal TT=14.504	Signal TT=14.235	? (problem) TT=2.291	? (problem) TT=2.555	? TT=0.672	? TT=0.52	? TT=0.67	? (MO) TT=802.83	? (MO) TT=794.9	? (problem) TT=2.045	? (problem) TT=2.05	No data	Signal TT=272.803	? (MO) TT=819.844	? (exit code) TT=540.097	Signal TT=593.244	Signal TT=652.733	? TT=199.974	No data	? TT=248.779	? TT=301.993
csp/pseudo/mpsReduced/ normalized-mps-red-bell3a.xml	SAT TT=0.485	? (TO) TT=1800.19	? (TO) TT=1800.27	? (TO) TT=1800.02	SAT TT=31.81 CHECKS=131276	SAT TT=22.222 CHECKS=77469	SAT TT=3.443 ASSIGNMENTS=3372	SAT TT=10.285 ASSIGNMENTS=6678	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=8.153 ASSIGNMENTS=1169 CHECKS=289654	SAT TT=1250.44 ASSIGNMENTS=1169 CHECKS=289654	? (MO) TT=537.99	? (MO) TT=494.37	No data	? (TO) TT=1800.11	SAT TT=1.029 ASSIGNMENTS=4512 CHECKS=1626570	? (TO) TT=1800.06	SAT TT=302.715 ASSIGNMENTS=833196 CHECKS=289974000	SAT TT=0.485 ASSIGNMENTS=1169 CHECKS=289654	? (TO) TT=1800.13	No data	? TT=221.264	? TT=239.706
csp/pseudo/mpsReduced/ normalized-mps-red-berlin-5-8_0.xml	SAT TT=5.005	? (TO) TT=1800.18	? (TO) TT=1800.11	SAT TT=900.454	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=17.28 ASSIGNMENTS=4928	SAT TT=95.596 ASSIGNMENTS=4288	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=14.181 ASSIGNMENTS=4599 CHECKS=4325660	SAT TT=1419.32 ASSIGNMENTS=4599 CHECKS=4325660	? (MO) TT=579.96	? (MO) TT=607.66	No data	? (TO) TT=1800.06	SAT TT=5.087 ASSIGNMENTS=5216 CHECKS=4546580	? (TO) TT=1800.02	SAT TT=15.097 ASSIGNMENTS=18701 CHECKS=13020400	SAT TT=5.005 ASSIGNMENTS=4599 CHECKS=4325660	? (TO) TT=1801.57	No data	? TT=143.6	? TT=152.077
csp/pseudo/mpsReduced/ normalized-mps-red-blend.xml	UNSAT TT=2.462	? (TO) TT=1800.07	? (TO) TT=1800.15	UNSAT TT=2.462	UNSAT TT=113.53 CHECKS=11528	UNSAT TT=86.548 CHECKS=8647	UNSAT TT=22.28 ASSIGNMENTS=0	UNSAT TT=23.238 ASSIGNMENTS=0	? TT=0.653	? TT=0.652	? TT=0.62	UNSAT TT=30.582 ASSIGNMENTS=0	UNSAT TT=1062.64 ASSIGNMENTS=3625 CHECKS=51568400	? (TO) TT=1800.04	? (TO) TT=1800.05	No data	UNSAT TT=7.043 ASSIGNMENTS=707 CHECKS=10691500	UNSAT TT=96.859 ASSIGNMENTS=123863 CHECKS=132840000	UNSAT TT=696.233	UNSAT TT=18.845 ASSIGNMENTS=6079 CHECKS=37485300	UNSAT TT=28.478 ASSIGNMENTS=3625 CHECKS=51568400	? (TO) TT=1800.12	No data	? TT=422.801	? TT=413.084
csp/pseudo/mpsReduced/ normalized-mps-red-egout.xml	UNSAT TT=3.322	UNSAT TT=650.846 CHECKS=51621000 NODES=3119	UNSAT TT=866.605 CHECKS=68554800 NODES=3153	? (TO) TT=1800.03	UNSAT TT=16.145 CHECKS=13989	? (TO) TT=1800.04	UNSAT TT=3.139 ASSIGNMENTS=0	UNSAT TT=3.322 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=11.424 ASSIGNMENTS=3342 CHECKS=3401380	UNSAT TT=621.558 ASSIGNMENTS=3119 CHECKS=51621000	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	UNSAT TT=8.168 ASSIGNMENTS=10905 CHECKS=6502830	UNSAT TT=7.923 ASSIGNMENTS=9669 CHECKS=10692300	UNSAT TT=88.215	UNSAT TT=270.572 ASSIGNMENTS=262694 CHECKS=154697000	UNSAT TT=4.039 ASSIGNMENTS=3342 CHECKS=3401380	? TT=298.191	No data	UNSAT TT=4.248	UNSAT TT=8.66
csp/pseudo/mpsReduced/ normalized-mps-red-fiber.xml	SAT TT=30.47	SAT TT=175.287 CHECKS=21022700 NODES=5416	SAT TT=191.845 CHECKS=21396700 NODES=3237	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT TT=10.564 ASSIGNMENTS=29319	SAT TT=30.47 ASSIGNMENTS=31271	SAT TT=186.977 CHECKS=59048600 NODES=5701	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=1693.8 ASSIGNMENTS=29319	? (MO) TT=154.4	? (MO) TT=153.41	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=37.359	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1802.12	No data	? (MO) TT=83.658	? (MO) TT=285.83
csp/pseudo/mpsReduced/ normalized-mps-red-flugpl.xml	SAT TT=1.526	SAT TT=20.658 CHECKS=5302800 NODES=265	SAT TT=10.34 CHECKS=2493400 NODES=0	SAT TT=3.916	SAT TT=4.168 CHECKS=78985	SAT TT=5.322 CHECKS=101816	SAT TT=1.213 ASSIGNMENTS=2523	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=9.704 ASSIGNMENTS=12564 CHECKS=4357580	SAT TT=27.363 ASSIGNMENTS=265 CHECKS=5302800	? (MO) TT=126.36	? (MO) TT=126.15	No data	SAT TT=3.201 ASSIGNMENTS=14937 CHECKS=6288580	SAT TT=1.526 ASSIGNMENTS=11249 CHECKS=3010990	SAT TT=0.957	? (TO) TT=1800.06	SAT TT=2.246 ASSIGNMENTS=12564 CHECKS=4357580	? TT=601.587	No data	? (MO) TT=92.19	? (MO) TT=299.048
csp/pseudo/mpsReduced/ normalized-mps-red-gr4x6.xml	UNSAT TT=1562.29	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=1660.67 CHECKS=1732750	UNSAT TT=1562.29 CHECKS=2015800	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.09	No data	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.1	No data	? (TO) TT=1800.08	? (TO) TT=1800.13
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/mpsReduced/ normalized-mps-red-markshare2-1.xml	SAT TT=0.236	SAT TT=153.348 CHECKS=7590860 NODES=330	SAT TT=171.614 CHECKS=8639440 NODES=0	SAT TT=0.236	SAT TT=10.138 CHECKS=6950	SAT TT=9.163 CHECKS=6400	SAT TT=1.462 ASSIGNMENTS=199	SAT TT=2.879 ASSIGNMENTS=3158	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.359 ASSIGNMENTS=193 CHECKS=327075	SAT TT=0.356 ASSIGNMENTS=193 CHECKS=327075	? (MO) TT=120.28	? (MO) TT=119.31	No data	SAT TT=0.336 ASSIGNMENTS=193 CHECKS=327075	SAT TT=12.464 ASSIGNMENTS=8980 CHECKS=24590900	SAT TT=4.395	SAT TT=45.67 ASSIGNMENTS=48949 CHECKS=75524800	SAT TT=0.368 ASSIGNMENTS=203 CHECKS=328221	? TT=338.429	No data	? (MO) TT=91.71	? (MO) TT=298.381
csp/pseudo/mpsReduced/ normalized-mps-red-misc03.xml	SAT TT=1.592	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=38.677	SAT TT=15.145 CHECKS=67630	SAT TT=8.398 CHECKS=41579	SAT TT=1.199 ASSIGNMENTS=374	SAT TT=4.403 ASSIGNMENTS=18864	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=405.419 ASSIGNMENTS=739 CHECKS=1995020	SAT TT=459.475 ASSIGNMENTS=739 CHECKS=1995020	? (TO) TT=1800.03	? (TO) TT=1800.06	No data	SAT TT=10.56 ASSIGNMENTS=4042 CHECKS=14280500	SAT TT=10.009 ASSIGNMENTS=6291 CHECKS=14211700	SAT TT=3.034	SAT TT=3.126 ASSIGNMENTS=1204 CHECKS=4475840	SAT TT=1.592 ASSIGNMENTS=739 CHECKS=1995020	? TT=253.507	No data	? TT=229.072	? TT=203.201
csp/pseudo/mpsReduced/ normalized-mps-red-p0282.xml	SAT TT=0.064	SAT TT=54.257 CHECKS=22091000 NODES=284	SAT TT=139.239 CHECKS=42640500 NODES=0	SAT TT=0.166	SAT TT=0.574 CHECKS=12253	SAT TT=0.59 CHECKS=12859	SAT TT=1.22 ASSIGNMENTS=221	SAT TT=1.368 ASSIGNMENTS=266	SAT TT=131.655 CHECKS=3574300 NODES=282	SAT TT=239.739 CHECKS=2505840 NODES=14	SAT TT=256.452 CHECKS=2956720 NODES=20	SAT TT=0.08 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.078 ASSIGNMENTS=237 CHECKS=46009	? (problem) TT=73.758	? (problem) TT=75.673	No data	SAT TT=0.068 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.064 ASSIGNMENTS=133 CHECKS=40840	SAT TT=0.979	SAT TT=0.067 ASSIGNMENTS=212 CHECKS=35108	SAT TT=0.071 ASSIGNMENTS=228 CHECKS=45887	? (TO) TT=1801.47	No data	SAT TT=36.177	SAT TT=146.682
csp/pseudo/mpsReduced/ normalized-mps-red-pk1.xml	SAT TT=0.484	? (TO) TT=1800.06	? (TO) TT=1800.16	SAT TT=0.521	? (TO) TT=1800.1	SAT TT=122.784 CHECKS=187313	SAT TT=1.981 ASSIGNMENTS=690	SAT TT=6.342 ASSIGNMENTS=19099	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.04	SAT TT=8.737 ASSIGNMENTS=690	SAT TT=8.44 ASSIGNMENTS=246 CHECKS=446702	? (TO) TT=1800.08	? (TO) TT=1800.01	No data	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=1.654	? (TO) TT=1800.05	SAT TT=0.484 ASSIGNMENTS=246 CHECKS=446702	? (TO) TT=1800.1	No data	? TT=148.2	? TT=148.264
csp/pseudo/mpsReduced/ normalized-mps-red-ran10x10b.xml	SAT TT=1.359	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=1.359	SAT TT=53.791 CHECKS=21423	SAT TT=57.726 CHECKS=24249	SAT TT=43.759 ASSIGNMENTS=3171	SAT TT=45.097 ASSIGNMENTS=833	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=10.122 ASSIGNMENTS=1424 CHECKS=524730	SAT TT=1090.37 ASSIGNMENTS=1424 CHECKS=524730	? (TO) TT=1800.09	? (TO) TT=1800.02	No data	SAT TT=83.576 ASSIGNMENTS=42072 CHECKS=139280000	SAT TT=3.563 ASSIGNMENTS=2012 CHECKS=6083780	SAT TT=691.709	SAT TT=5.719 ASSIGNMENTS=1130 CHECKS=7461970	SAT TT=1.739 ASSIGNMENTS=1424 CHECKS=524730	? (TO) TT=1800.31	No data	SAT TT=4.77	SAT TT=7.749
csp/pseudo/mpsReduced/ normalized-mps-red-ran14x18.xml		? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.06	? TT=37.467 CHECKS=4275050 NODES=0	? TT=40.333 CHECKS=4275050 NODES=0	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.1	No data	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1802.14	No data	? (TO) TT=1800.08	? (TO) TT=1800.08
csp/pseudo/mpsReduced/ normalized-mps-red-ran16x16.xml	SAT TT=1.757	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=3.45	SAT TT=60.886 CHECKS=4834	SAT TT=58.629 CHECKS=4556	SAT TT=88.468 ASSIGNMENTS=3739	SAT TT=85.826 ASSIGNMENTS=2088	? (TO) TT=1800.01	? TT=39.466 CHECKS=3254050 NODES=0	? TT=39.897 CHECKS=3254050 NODES=0	SAT TT=1.757 ASSIGNMENTS=3545 CHECKS=2136710	SAT TT=1.862 ASSIGNMENTS=3545 CHECKS=2136710	? (TO) TT=1800.09	? (TO) TT=1800.06	No data	SAT TT=1.846 ASSIGNMENTS=3545 CHECKS=2136710	SAT TT=106.889 ASSIGNMENTS=240474 CHECKS=158768000	? (TO) TT=1800.08	SAT TT=1.907 ASSIGNMENTS=3495 CHECKS=2135200	SAT TT=2.38 ASSIGNMENTS=3774 CHECKS=2136030	? TT=431.907	No data	SAT TT=11.169	SAT TT=22.046
csp/pseudo/mpsReduced/ normalized-mps-red-sample2.xml	UNSAT TT=11.859	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=13.829 CHECKS=23622	UNSAT TT=11.859 CHECKS=26584	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	No data	? (TO) TT=1800.08	UNSAT TT=1071.58 ASSIGNMENTS=865701 CHECKS=1034350000	? (TO) TT=1800.12	UNSAT TT=233.564 ASSIGNMENTS=275425 CHECKS=135550000	UNSAT TT=562.817 ASSIGNMENTS=478493 CHECKS=568487000	? (TO) TT=1800.2	No data	? (MO) TT=81.91	? (MO) TT=284.27
csp/pseudo/mpsReduced/ normalized-mps-red-share2b.xml	UNSAT TT=12.69	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.11	UNSAT TT=333.675 CHECKS=88439	UNSAT TT=402.188 CHECKS=121378	UNSAT TT=9.878 ASSIGNMENTS=0	UNSAT TT=13.775 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=37.998 ASSIGNMENTS=6486 CHECKS=54297400	UNSAT TT=1280.38 ASSIGNMENTS=6486 CHECKS=54297400	? (MO) TT=210.33	? (MO) TT=207.82	No data	UNSAT TT=1007.41 ASSIGNMENTS=127421 CHECKS=2700260000	UNSAT TT=148.885 ASSIGNMENTS=113885 CHECKS=178021000	UNSAT TT=747.321	UNSAT TT=12.69 ASSIGNMENTS=16157 CHECKS=23071700	UNSAT TT=27.037 ASSIGNMENTS=6486 CHECKS=54297400	? TT=408.482	No data	? (MO) TT=157.134	? (MO) TT=355.992
csp/pseudo/mpsReduced/ normalized-mps-red-vtp-base.xml		? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=0.82	? TT=0.827	? TT=0.595	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.18	No data	? TT=161.023	? TT=171.371
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ niklas/ normalized-air04.xml	SAT TT=13.832	SAT TT=25.471 CHECKS=17721 NODES=8904	SAT TT=20.363 CHECKS=17721 NODES=0	SAT TT=13.832	SAT TT=85.646 CHECKS=53965	SAT TT=87.134 CHECKS=54270	SAT TT=70.159 ASSIGNMENTS=8905	SAT TT=150.549 ASSIGNMENTS=8905	SAT TT=383.4 CHECKS=71747 NODES=8904	? TT=224.569 CHECKS=70994 NODES=0	? TT=186.97 CHECKS=70989 NODES=0	SAT TT=29.771 ASSIGNMENTS=8904 CHECKS=10060500	SAT TT=37.209 ASSIGNMENTS=8904 CHECKS=17721	? (TO) TT=1800.09	? (TO) TT=1800.02	No data	SAT TT=17.138 ASSIGNMENTS=8904 CHECKS=10060500	SAT TT=15.86 ASSIGNMENTS=8904 CHECKS=10060500	SAT TT=41.423	SAT TT=16.441 ASSIGNMENTS=8904 CHECKS=10060500	SAT TT=17.45 ASSIGNMENTS=8904 CHECKS=10060500	? TT=1031.2	No data	SAT TT=53.998	SAT TT=93.643
csp/pseudo/ niklas/ normalized-air05.xml	SAT TT=10.708	SAT TT=23.167 CHECKS=9177 NODES=7195	SAT TT=19.064 CHECKS=9177 NODES=0	SAT TT=10.708	SAT TT=119.545 CHECKS=42154	SAT TT=119.909 CHECKS=40515	SAT TT=62.398 ASSIGNMENTS=7196	SAT TT=128.472 ASSIGNMENTS=7196	SAT TT=332.523 CHECKS=51575 NODES=7195	? TT=192.323 CHECKS=51180 NODES=0	? TT=201.31 CHECKS=51180 NODES=0	SAT TT=28.95 ASSIGNMENTS=7195 CHECKS=10019200	SAT TT=34.058 ASSIGNMENTS=7195 CHECKS=9177	? (TO) TT=1800.01	? (TO) TT=1800.07	No data	SAT TT=16.659 ASSIGNMENTS=7195 CHECKS=10019200	SAT TT=17.742 ASSIGNMENTS=7195 CHECKS=10019200	SAT TT=35.808	SAT TT=14.145 ASSIGNMENTS=7195 CHECKS=10019200	SAT TT=17.363 ASSIGNMENTS=7195 CHECKS=10019200	? TT=246.45	No data	SAT TT=43.41	SAT TT=80.006
csp/pseudo/ niklas/ normalized-enigma.xml	SAT TT=0.037	SAT TT=10.369 CHECKS=811227 NODES=100	SAT TT=3.332 CHECKS=262498 NODES=0	SAT TT=0.078	SAT TT=0.402 CHECKS=2936	SAT TT=0.415 CHECKS=3340	SAT TT=0.746 ASSIGNMENTS=94	SAT TT=0.776 ASSIGNMENTS=87	SAT TT=60.927 CHECKS=42396 NODES=100	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT TT=0.048 ASSIGNMENTS=96 CHECKS=17832	SAT TT=0.048 ASSIGNMENTS=96 CHECKS=17832	? (MO) TT=472.53	? (MO) TT=541.95	No data	SAT TT=0.038 ASSIGNMENTS=96 CHECKS=17832	SAT TT=0.037 ASSIGNMENTS=26 CHECKS=18535	SAT TT=0.665	SAT TT=0.087 ASSIGNMENTS=174 CHECKS=126054	SAT TT=0.038 ASSIGNMENTS=98 CHECKS=17941	? TT=1135.93	No data	? TT=804.05	? TT=837.737
csp/pseudo/ niklas/ normalized-l152lav.xml	SAT TT=2.854	SAT TT=12.468 CHECKS=2178 NODES=1989	SAT TT=11.608 CHECKS=2178 NODES=0	SAT TT=2.854	SAT TT=228.981 CHECKS=10027	SAT TT=220.383 CHECKS=10997	SAT TT=16.215 ASSIGNMENTS=1990	SAT TT=18.098 ASSIGNMENTS=1990	? TT=0.604	? TT=0.627	? TT=0.602	SAT TT=16.519 ASSIGNMENTS=1989 CHECKS=4846840	SAT TT=22.242 ASSIGNMENTS=1989 CHECKS=2178	? (TO) TT=1800.07	? (TO) TT=1800.08	No data	SAT TT=6.29 ASSIGNMENTS=1989 CHECKS=4846640	SAT TT=6.666 ASSIGNMENTS=1989 CHECKS=4846530	? (exit code) TT=16.483	SAT TT=6.219 ASSIGNMENTS=1989 CHECKS=4846560	SAT TT=6.387 ASSIGNMENTS=1989 CHECKS=4846840	? TT=1159.1	No data	SAT TT=20.945	SAT TT=83.957
csp/pseudo/ niklas/ normalized-lseu.xml	SAT TT=0.02	SAT TT=1.354 CHECKS=20525 NODES=91	SAT TT=1.485 CHECKS=48696 NODES=0	SAT TT=0.053	SAT TT=0.091 CHECKS=946	SAT TT=0.11 CHECKS=1045	SAT TT=0.681 ASSIGNMENTS=67	SAT TT=0.86 ASSIGNMENTS=306	SAT TT=68.279 CHECKS=199605 NODES=172	? (TO) TT=1800.03	SAT TT=1001.18 CHECKS=985807000 NODES=99979	SAT TT=0.033 ASSIGNMENTS=69 CHECKS=7810	SAT TT=0.031 ASSIGNMENTS=69 CHECKS=7810	? (TO) TT=1800.05	? (TO) TT=1800.02	No data	SAT TT=0.02 ASSIGNMENTS=69 CHECKS=7810	SAT TT=0.033 ASSIGNMENTS=225 CHECKS=36172	SAT TT=0.54	SAT TT=0.028 ASSIGNMENTS=137 CHECKS=26264	SAT TT=0.021 ASSIGNMENTS=69 CHECKS=7948	? (TO) TT=1800.16	No data	SAT TT=36.265	SAT TT=156.611
csp/pseudo/ niklas/ normalized-mitre.xml	SAT TT=995.97	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=995.97 CHECKS=2566540	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.03	No data	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=1202.23	? (TO) TT=1800.04	? (TO) TT=1800.08	? TT=953.048	No data	? TT=162.853	? TT=168.942
csp/pseudo/ niklas/ normalized-mod008.xml	SAT TT=0.193	SAT TT=1.524 CHECKS=330 NODES=319	SAT TT=1.43 CHECKS=824 NODES=0	SAT TT=0.193	SAT TT=10.871 CHECKS=3079	SAT TT=10.577 CHECKS=2981	SAT TT=1.41 ASSIGNMENTS=315	SAT TT=1.455 ASSIGNMENTS=319	SAT TT=62.049 CHECKS=1505 NODES=319	SAT TT=1.903 CHECKS=3951 NODES=0	SAT TT=1.868 CHECKS=3951 NODES=0	SAT TT=0.275 ASSIGNMENTS=315 CHECKS=266439	SAT TT=0.273 ASSIGNMENTS=315 CHECKS=266439	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	SAT TT=0.248 ASSIGNMENTS=315 CHECKS=266439	SAT TT=0.245 ASSIGNMENTS=317 CHECKS=266979	SAT TT=0.989	SAT TT=0.265 ASSIGNMENTS=317 CHECKS=266853	SAT TT=0.265 ASSIGNMENTS=315 CHECKS=266155	? (TO) TT=1800.15	No data	? TT=187.553	? TT=175.049
csp/pseudo/ niklas/ normalized-mux.xml	SAT TT=0.061	SAT TT=1.312 CHECKS=2210 NODES=232	SAT TT=1.3 CHECKS=1450 NODES=0	SAT TT=0.195	SAT TT=0.086 CHECKS=6690	SAT TT=0.078 CHECKS=13304	SAT TT=1.683 ASSIGNMENTS=95	SAT TT=1.518 ASSIGNMENTS=201	SAT TT=78.258 CHECKS=3939 NODES=234	SAT TT=19.218 CHECKS=10626 NODES=21	SAT TT=19.083 CHECKS=17854 NODES=21	SAT TT=0.074 ASSIGNMENTS=93 CHECKS=14034	SAT TT=0.077 ASSIGNMENTS=93 CHECKS=14034	SAT TT=135.997	Wrong Cert. TT=138.822	No data	SAT TT=0.064 ASSIGNMENTS=93 CHECKS=14034	SAT TT=0.061 ASSIGNMENTS=79 CHECKS=13836	SAT TT=0.883	SAT TT=0.817 ASSIGNMENTS=4173 CHECKS=533507	SAT TT=0.07 ASSIGNMENTS=89 CHECKS=13977	SAT TT=1581.31	No data	SAT TT=1.451	SAT TT=1.603
csp/pseudo/ niklas/ normalized-my-adder.xml	SAT TT=0.172	SAT TT=1.934 CHECKS=3817 NODES=577	SAT TT=1.642 CHECKS=3684 NODES=0	SAT TT=0.407	SAT TT=0.266 CHECKS=34902	SAT TT=0.204 CHECKS=34362	SAT TT=2.097 ASSIGNMENTS=345	SAT TT=2.3 ASSIGNMENTS=482	SAT TT=2.305 CHECKS=7777 NODES=577	SAT TT=2.305 CHECKS=22321 NODES=54	SAT TT=2.316 CHECKS=55715 NODES=34	SAT TT=0.186 ASSIGNMENTS=324 CHECKS=26582	SAT TT=0.193 ASSIGNMENTS=324 CHECKS=26582	SAT TT=4.238	Wrong Cert. TT=4.211	No data	SAT TT=0.172 ASSIGNMENTS=324 CHECKS=26582	SAT TT=0.794 ASSIGNMENTS=8049 CHECKS=747405	SAT TT=1.307	SAT TT=19.489 ASSIGNMENTS=45203 CHECKS=3678420	SAT TT=0.18 ASSIGNMENTS=320 CHECKS=26679	SAT TT=6.799	No data	SAT TT=1.5	SAT TT=1.877
csp/pseudo/ niklas/ normalized-p0282.xml	SAT TT=0.067	SAT TT=50.812 CHECKS=22091000 NODES=284	SAT TT=148.827 CHECKS=42640500 NODES=0	SAT TT=0.153	SAT TT=0.633 CHECKS=13648	SAT TT=0.6 CHECKS=12841	SAT TT=1.113 ASSIGNMENTS=221	SAT TT=1.233 ASSIGNMENTS=266	SAT TT=130.406 CHECKS=3573950 NODES=282	SAT TT=255.19 CHECKS=2505550 NODES=12	SAT TT=254.761 CHECKS=2502250 NODES=7	SAT TT=0.083 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.084 ASSIGNMENTS=237 CHECKS=46009	? (problem) TT=72.591	? (problem) TT=73.466	No data	SAT TT=0.071 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.069 ASSIGNMENTS=148 CHECKS=43002	SAT TT=0.978	SAT TT=0.07 ASSIGNMENTS=212 CHECKS=35108	SAT TT=0.067 ASSIGNMENTS=228 CHECKS=45887	? (TO) TT=1802.07	No data	SAT TT=35.958	SAT TT=156.52
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ niklas/ normalized-p0548.xml	SAT TT=0.151	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=2.091 CHECKS=10812	SAT TT=3.077 CHECKS=15728	SAT TT=1.208 ASSIGNMENTS=397	SAT TT=1.749 ASSIGNMENTS=2169	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=0.17 ASSIGNMENTS=606 CHECKS=202978	SAT TT=0.169 ASSIGNMENTS=606 CHECKS=202978	? (MO) TT=22.94	? (MO) TT=24.69	No data	SAT TT=0.151 ASSIGNMENTS=565 CHECKS=194339	SAT TT=7.641 ASSIGNMENTS=35883 CHECKS=16389100	SAT TT=0.876	? (TO) TT=1800.09	SAT TT=0.347 ASSIGNMENTS=1043 CHECKS=597264	? TT=385.758	No data	? TT=281.337	? TT=185.946
csp/pseudo/ niklas/ normalized-pk1.xml	SAT TT=0.099	SAT TT=1.079 CHECKS=435 NODES=86	SAT TT=0.989 CHECKS=435 NODES=0	SAT TT=0.153	SAT TT=1.133 CHECKS=3844	SAT TT=1.116 CHECKS=3862	SAT TT=1.061 ASSIGNMENTS=57	SAT TT=0.992 ASSIGNMENTS=86	SAT TT=61.478 CHECKS=1035 NODES=86	SAT TT=1.685 CHECKS=11281 NODES=5	SAT TT=2.295 CHECKS=98371 NODES=4	SAT TT=0.118 ASSIGNMENTS=56 CHECKS=89064	SAT TT=0.121 ASSIGNMENTS=56 CHECKS=89064	? (TO) TT=1800.02	? (TO) TT=1800.08	No data	SAT TT=0.112 ASSIGNMENTS=56 CHECKS=89064	SAT TT=0.099 ASSIGNMENTS=33 CHECKS=77962	SAT TT=0.799	SAT TT=39.2 ASSIGNMENTS=35397 CHECKS=61216900	SAT TT=0.105 ASSIGNMENTS=56 CHECKS=89586	? (TO) TT=1800.13	No data	? (MO) TT=76.804	? (MO) TT=283.747
csp/pseudo/ niklas/ normalized-seymour.xml	SAT TT=0.892	SAT TT=8.927 CHECKS=27702 NODES=1255	SAT TT=4.531 CHECKS=17069 NODES=0	SAT TT=2.095	SAT TT=1.878 CHECKS=239380	SAT TT=1.668 CHECKS=237091	SAT TT=4.794 ASSIGNMENTS=792	SAT TT=5.549 ASSIGNMENTS=792	SAT TT=12.01 CHECKS=93523 NODES=1255	SAT TT=5.509 CHECKS=122763 NODES=8	SAT TT=5.886 CHECKS=134146 NODES=4	SAT TT=0.934 ASSIGNMENTS=801 CHECKS=293685	SAT TT=0.934 ASSIGNMENTS=801 CHECKS=293685	SAT TT=15.52	SAT TT=21.469	No data	SAT TT=0.929 ASSIGNMENTS=801 CHECKS=293685	SAT TT=0.912 ASSIGNMENTS=880 CHECKS=294436	SAT TT=2.677	SAT TT=0.892 ASSIGNMENTS=851 CHECKS=293637	SAT TT=0.904 ASSIGNMENTS=804 CHECKS=293914	SAT TT=62.273	No data	SAT TT=7.627	SAT TT=8.425
csp/pseudo/ niklas/ normalized-stein27.xml	SAT TT=0.013	SAT TT=0.855 CHECKS=1864 NODES=27	SAT TT=0.861 CHECKS=3714 NODES=0	SAT TT=0.048	SAT TT=0.032 CHECKS=8042	SAT TT=0.027 CHECKS=7707	SAT TT=0.65 ASSIGNMENTS=9	SAT TT=0.848 ASSIGNMENTS=9	SAT TT=74.706 CHECKS=277484 NODES=27	SAT TT=14.331 CHECKS=165501 NODES=0	SAT TT=13.888 CHECKS=165499 NODES=0	SAT TT=0.026 ASSIGNMENTS=8 CHECKS=1620	SAT TT=0.027 ASSIGNMENTS=8 CHECKS=1620	? (MO) TT=41.56	? (MO) TT=40.99	No data	SAT TT=0.014 ASSIGNMENTS=8 CHECKS=1620	SAT TT=0.015 ASSIGNMENTS=6 CHECKS=1478	SAT TT=0.398	SAT TT=0.013 ASSIGNMENTS=8 CHECKS=1631	SAT TT=0.013 ASSIGNMENTS=9 CHECKS=1593	? TT=172.37	No data	SAT TT=0.687	SAT TT=0.694
csp/pseudo/ niklas/ normalized-stein45.xml	SAT TT=0.025	SAT TT=1.069 CHECKS=886 NODES=45	SAT TT=1.027 CHECKS=855 NODES=0	SAT TT=0.087	SAT TT=0.037 CHECKS=2220	SAT TT=0.025 CHECKS=2403	SAT TT=1.013 ASSIGNMENTS=13	SAT TT=0.95 ASSIGNMENTS=13	SAT TT=203.43 CHECKS=235859000 NODES=45	SAT TT=85.226 CHECKS=140514000 NODES=0	SAT TT=85.033 CHECKS=140514000 NODES=0	SAT TT=0.046 ASSIGNMENTS=12 CHECKS=4532	SAT TT=0.039 ASSIGNMENTS=12 CHECKS=4532	? (TO) TT=1800.02	? (TO) TT=1800.1	No data	SAT TT=0.026 ASSIGNMENTS=12 CHECKS=4532	SAT TT=0.032 ASSIGNMENTS=59 CHECKS=13639	SAT TT=0.742	SAT TT=0.029 ASSIGNMENTS=26 CHECKS=5771	SAT TT=0.026 ASSIGNMENTS=12 CHECKS=4512	? TT=754.848	No data	SAT TT=0.902	SAT TT=0.856
csp/pseudo/par/ normalized-par-16-2-c.xml	SAT TT=1.788	SAT TT=6.541 CHECKS=1678500 NODES=10893	SAT TT=44.202 CHECKS=15647300 NODES=117004	SAT TT=5.991	SAT TT=260.227 CHECKS=239070000	SAT TT=166.655 CHECKS=177948000	SAT TT=290.106 ASSIGNMENTS=367998	SAT TT=268.478 ASSIGNMENTS=367998	SAT TT=390.549 CHECKS=130430000 NODES=113465	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=13.265 ASSIGNMENTS=10893 CHECKS=1678500	SAT TT=159.531 ASSIGNMENTS=76639 CHECKS=181434000	SAT TT=3.539	SAT TT=3.335	No data	SAT TT=48.122 ASSIGNMENTS=24387 CHECKS=56319300	SAT TT=55.001 ASSIGNMENTS=35415 CHECKS=65498500	SAT TT=3.738	SAT TT=571.787 ASSIGNMENTS=201110 CHECKS=481324000	SAT TT=152.008 ASSIGNMENTS=76639 CHECKS=181434000	SAT TT=5.763	No data	SAT TT=2.075	SAT TT=1.788
csp/pseudo/par/ normalized-par-16-3-c.xml	SAT TT=1.667	SAT TT=201.275 CHECKS=75106700 NODES=574385	SAT TT=108.854 CHECKS=40865200 NODES=323384	SAT TT=2.882	SAT TT=93.108 CHECKS=85804300	SAT TT=145.248 CHECKS=159807000	SAT TT=24.679 ASSIGNMENTS=33908	SAT TT=24.871 ASSIGNMENTS=33908	SAT TT=57.14 CHECKS=19859400 NODES=19231	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=126.902 ASSIGNMENTS=60189 CHECKS=140788000	SAT TT=123.701 ASSIGNMENTS=60189 CHECKS=140788000	SAT TT=3.211	SAT TT=3.111	No data	SAT TT=96.459 ASSIGNMENTS=52652 CHECKS=119688000	SAT TT=118.735 ASSIGNMENTS=66614 CHECKS=138597000	SAT TT=5.96	SAT TT=239.023 ASSIGNMENTS=88562 CHECKS=215346000	SAT TT=115.363 ASSIGNMENTS=60189 CHECKS=140788000	SAT TT=6.617	No data	SAT TT=1.917	SAT TT=1.667
csp/pseudo/par/ normalized-par-16-4.xml	SAT TT=2.042	SAT TT=30.149 CHECKS=10481100 NODES=37310	SAT TT=83.391 CHECKS=29182600 NODES=96747	SAT TT=3.909	SAT TT=152.005 CHECKS=91980900	SAT TT=24.093 CHECKS=19708500	SAT TT=160.062 ASSIGNMENTS=98083	SAT TT=169.629 ASSIGNMENTS=98083	SAT TT=843.765 CHECKS=138728000 NODES=184926	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=44.534 ASSIGNMENTS=12418 CHECKS=34671800	SAT TT=37.88 ASSIGNMENTS=37310 CHECKS=10481100	SAT TT=8.464	SAT TT=8.511	No data	SAT TT=57.43 ASSIGNMENTS=23176 CHECKS=62770600	SAT TT=20.664 ASSIGNMENTS=13789 CHECKS=20549300	SAT TT=37.292	SAT TT=137.578 ASSIGNMENTS=38888 CHECKS=96856500	SAT TT=35.29 ASSIGNMENTS=12418 CHECKS=34671800	SAT TT=7.857	No data	SAT TT=2.042	SAT TT=2.217
csp/pseudo/par/ normalized-par-16-5-c.xml	SAT TT=1.618	SAT TT=194.223 CHECKS=71874700 NODES=613452	SAT TT=221.917 CHECKS=83949300 NODES=732514	SAT TT=10.628	SAT TT=139.07 CHECKS=135220000	SAT TT=463.76 CHECKS=555591000	SAT TT=42.873 ASSIGNMENTS=52888	SAT TT=43.357 ASSIGNMENTS=52888	SAT TT=302.746 CHECKS=99625400 NODES=87998	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=181.184 ASSIGNMENTS=613452 CHECKS=71874700	SAT TT=339.471 ASSIGNMENTS=160068 CHECKS=389951000	SAT TT=3.403	SAT TT=3.077	No data	SAT TT=42.624 ASSIGNMENTS=25876 CHECKS=54410600	SAT TT=24.594 ASSIGNMENTS=19489 CHECKS=29493000	SAT TT=2.47	SAT TT=34.441 ASSIGNMENTS=16364 CHECKS=30878600	SAT TT=328.516 ASSIGNMENTS=160068 CHECKS=389951000	SAT TT=5.772	No data	SAT TT=2.129	SAT TT=1.618
csp/pseudo/par/ normalized-par-16-5.xml	SAT TT=2.63	SAT TT=376.944 CHECKS=131326000 NODES=381898	SAT TT=356.438 CHECKS=131333000 NODES=381864	SAT TT=2.63	SAT TT=43.562 CHECKS=28905500	SAT TT=72.808 CHECKS=49731100	SAT TT=21.875 ASSIGNMENTS=12758	SAT TT=23.543 ASSIGNMENTS=12758	SAT TT=647.241 CHECKS=102235000 NODES=127106	? (TO) TT=1800	? (TO) TT=1800.04	SAT TT=325.33 ASSIGNMENTS=117479 CHECKS=326218000	SAT TT=312.483 ASSIGNMENTS=381898 CHECKS=131326000	SAT TT=8.43	SAT TT=8.281	No data	SAT TT=56.566 ASSIGNMENTS=23238 CHECKS=60958500	SAT TT=177.633 ASSIGNMENTS=69014 CHECKS=178059000	SAT TT=37.025	SAT TT=251.803 ASSIGNMENTS=76474 CHECKS=198151000	SAT TT=323.054 ASSIGNMENTS=117479 CHECKS=326218000	SAT TT=10.849	No data	SAT TT=2.766	SAT TT=2.646
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/par/ normalized-par-32-1-c.xml		? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.12	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	? (TO) TT=1800.13	? (TO) TT=1800.11
csp/pseudo/par/ normalized-par-32-1.xml		? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	No data	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.11	No data	? (TO) TT=1800.12	? (TO) TT=1800.05
csp/pseudo/par/ normalized-par-32-2-c.xml	SAT TT=180.881	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	No data	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=180.881	No data	? (TO) TT=1800.14	? (TO) TT=1800.12
csp/pseudo/par/ normalized-par-32-3-c.xml		? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.12	No data	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.12	No data	? (TO) TT=1800.05	? (TO) TT=1800.09
csp/pseudo/par/ normalized-par-32-4.xml		? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.05	No data	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.11	No data	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/pseudo/par/ normalized-par-32-5-c.xml		? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	No data	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	No data	? (TO) TT=1800.13	? (TO) TT=1800.06
csp/pseudo/par/ normalized-par-8-1-c.xml	SAT TT=0.031	SAT TT=1.039 CHECKS=1966 NODES=141	SAT TT=1.022 CHECKS=2827 NODES=132	SAT TT=0.086	SAT TT=0.052 CHECKS=18976	SAT TT=0.038 CHECKS=19433	SAT TT=1.039 ASSIGNMENTS=20	SAT TT=1.264 ASSIGNMENTS=20	SAT TT=0.97 CHECKS=1336 NODES=130	SAT TT=2.148 CHECKS=2649100 NODES=81086	SAT TT=1.78 CHECKS=1851390 NODES=10291	SAT TT=0.041 ASSIGNMENTS=15 CHECKS=10408	SAT TT=0.042 ASSIGNMENTS=15 CHECKS=10408	SAT TT=1.709	SAT TT=1.783	No data	SAT TT=0.031 ASSIGNMENTS=19 CHECKS=11997	SAT TT=0.067 ASSIGNMENTS=374 CHECKS=84056	SAT TT=0.739	SAT TT=0.072 ASSIGNMENTS=436 CHECKS=60847	SAT TT=0.035 ASSIGNMENTS=21 CHECKS=14559	SAT TT=1.824	No data	SAT TT=1.007	SAT TT=0.982
csp/pseudo/par/ normalized-par-8-2-c.xml	SAT TT=0.026	SAT TT=1.024 CHECKS=3607 NODES=157	SAT TT=1.144 CHECKS=4729 NODES=155	SAT TT=0.101	SAT TT=0.052 CHECKS=16107	SAT TT=0.035 CHECKS=17193	SAT TT=1.179 ASSIGNMENTS=17	SAT TT=1.277 ASSIGNMENTS=17	SAT TT=1.018 CHECKS=5574 NODES=151	SAT TT=2.43 CHECKS=2718350 NODES=79202	SAT TT=1.702 CHECKS=1149830 NODES=7072	SAT TT=0.037 ASSIGNMENTS=11 CHECKS=4600	SAT TT=0.037 ASSIGNMENTS=11 CHECKS=4600	SAT TT=1.732	SAT TT=1.499	No data	SAT TT=0.026 ASSIGNMENTS=12 CHECKS=5269	SAT TT=0.083 ASSIGNMENTS=477 CHECKS=106508	SAT TT=0.687	SAT TT=0.072 ASSIGNMENTS=456 CHECKS=57713	SAT TT=0.028 ASSIGNMENTS=11 CHECKS=5867	SAT TT=1.787	No data	SAT TT=0.874	SAT TT=1.008
csp/pseudo/par/ normalized-par-8-5-c.xml	SAT TT=0.027	SAT TT=1.045 CHECKS=1934 NODES=158	SAT TT=1.038 CHECKS=3944 NODES=166	SAT TT=0.096	SAT TT=0.054 CHECKS=19592	SAT TT=0.042 CHECKS=20062	SAT TT=1.085 ASSIGNMENTS=12	SAT TT=1.202 ASSIGNMENTS=12	SAT TT=1.101 CHECKS=4353 NODES=167	SAT TT=2.805 CHECKS=4085280 NODES=113948	SAT TT=1.159 CHECKS=67901 NODES=532	SAT TT=0.041 ASSIGNMENTS=8 CHECKS=5958	SAT TT=0.04 ASSIGNMENTS=8 CHECKS=5958	SAT TT=1.638	SAT TT=1.66	No data	SAT TT=0.031 ASSIGNMENTS=7 CHECKS=5947	SAT TT=0.027 ASSIGNMENTS=6 CHECKS=3708	SAT TT=0.751	SAT TT=0.062 ASSIGNMENTS=313 CHECKS=54157	SAT TT=0.03 ASSIGNMENTS=8 CHECKS=5958	SAT TT=2.013	No data	SAT TT=0.989	SAT TT=0.885
csp/pseudo/par/ normalized-par-8-5.xml	SAT TT=0.076	SAT TT=2.022 CHECKS=7922 NODES=718	SAT TT=1.961 CHECKS=12491 NODES=718	SAT TT=0.343	SAT TT=0.222 CHECKS=93738	SAT TT=0.168 CHECKS=90572	SAT TT=1.958 ASSIGNMENTS=10	SAT TT=2.012 ASSIGNMENTS=10	SAT TT=2.305 CHECKS=24002 NODES=768	SAT TT=2.648 CHECKS=1290310 NODES=49773	SAT TT=342.776 CHECKS=1110620000 NODES=1978640	SAT TT=0.095 ASSIGNMENTS=6 CHECKS=4243	SAT TT=0.095 ASSIGNMENTS=6 CHECKS=4243	SAT TT=3.505	SAT TT=3.447	No data	SAT TT=0.076 ASSIGNMENTS=6 CHECKS=4243	SAT TT=0.098 ASSIGNMENTS=94 CHECKS=36877	SAT TT=5.008	SAT TT=0.164 ASSIGNMENTS=623 CHECKS=92497	SAT TT=0.086 ASSIGNMENTS=10 CHECKS=9367	SAT TT=4.076	No data	SAT TT=1.849	SAT TT=1.233
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ppp/ normalized-ppp-1-11-19-21.xml		? (TO) TT=1800.09	? (MO) TT=7.447	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	No data	? (TO) TT=1800.03	? (TO) TT=1800.08	? (MO) TT=18.45	? (TO) TT=1800.03	? (TO) TT=1800.04	? TT=415.35	No data	? (TO) TT=1800.1	? (TO) TT=1800.06
csp/pseudo/ppp/ normalized-ppp-1-12-16.xml	SAT TT=7.417	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=85.287 CHECKS=3104980	? (TO) TT=1800.16	SAT TT=930.838 ASSIGNMENTS=194215	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=392.493 ASSIGNMENTS=174205 CHECKS=306943000	SAT TT=1148.91 ASSIGNMENTS=174205 CHECKS=306943000	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	? (TO) TT=1800.05	? (TO) TT=1800.09	? (exit code) TT=15.752	? (TO) TT=1800.02	SAT TT=379.522 ASSIGNMENTS=174205 CHECKS=306943000	? TT=269.88	No data	SAT TT=7.417	SAT TT=8.337
csp/pseudo/ppp/ normalized-ppp-1-13.xml	SAT TT=8.717	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.97	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.07	No data	? (TO) TT=1800.11	? (TO) TT=1800.07	? (exit code) TT=20.543	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=291.68	No data	SAT TT=94.45	SAT TT=8.717
csp/pseudo/ppp/ normalized-ppp-1-3-13-19.xml	SAT TT=8.516	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.03	No data	? (TO) TT=1800.04	? (TO) TT=1800.05	? (MO) TT=297.57	? (TO) TT=1800.03	? (TO) TT=1800.05	? TT=302.357	No data	SAT TT=108.01	SAT TT=8.516
csp/pseudo/ppp/ normalized-ppp-1-9-16-19.xml		? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	? (exit code) TT=16.842	? (TO) TT=1800.08	? (TO) TT=1800.12	? TT=299.157	No data	? (TO) TT=1800.08	? (TO) TT=1800.02
csp/pseudo/ppp/ normalized-ppp-3-13-25-26.xml	SAT TT=16.056	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=221.4 ASSIGNMENTS=130071 CHECKS=175138000	SAT TT=981.523 ASSIGNMENTS=130071 CHECKS=175138000	? (TO) TT=1800.06	? (TO) TT=1800.08	No data	? (TO) TT=1800.07	? (TO) TT=1800.1	? (exit code) TT=17.596	? (TO) TT=1800.1	SAT TT=214.613 ASSIGNMENTS=130071 CHECKS=175138000	? TT=268.202	No data	SAT TT=109.857	SAT TT=16.056
csp/pseudo/ primesDimacs/ normalized-bf-0432-007.xml	UNSAT TT=1.94	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.02	UNSAT TT=1256.28 CHECKS=782476000	UNSAT TT=1235.92 CHECKS=816716000	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=7.614	UNSAT TT=7.818	No data	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=72.158	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=7.774	No data	UNSAT TT=1.94	UNSAT TT=2.052
csp/pseudo/ primesDimacs/ normalized-bf-1355-075.xml	UNSAT TT=1.021	UNSAT TT=7.156 CHECKS=98296 NODES=5660	UNSAT TT=12.961 CHECKS=137672 NODES=5652	? (TO) TT=1800.09	UNSAT TT=14.877 CHECKS=13263500	UNSAT TT=4.712 CHECKS=3585030	UNSAT TT=11.932 ASSIGNMENTS=326	? (TO) TT=1800.14	UNSAT TT=18.079 CHECKS=27469 NODES=104	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=1.236 ASSIGNMENTS=290 CHECKS=286640	UNSAT TT=1.021 ASSIGNMENTS=290 CHECKS=286640	UNSAT TT=18.743	UNSAT TT=20.224	No data	UNSAT TT=1.122 ASSIGNMENTS=282 CHECKS=318791	UNSAT TT=5.285 ASSIGNMENTS=9653 CHECKS=4080640	UNSAT TT=114.214	UNSAT TT=784.844 ASSIGNMENTS=272907 CHECKS=246666000	UNSAT TT=1.161 ASSIGNMENTS=333 CHECKS=323600	UNSAT TT=8.264	No data	UNSAT TT=2.426	UNSAT TT=3.08
csp/pseudo/ primesDimacs/ normalized-bf-1355-638.xml	UNSAT TT=1.038	UNSAT TT=8.287 CHECKS=163179 NODES=7933	UNSAT TT=11.663 CHECKS=217720 NODES=8047	? (TO) TT=1800.02	UNSAT TT=11.083 CHECKS=8958060	UNSAT TT=5.816 CHECKS=3866100	UNSAT TT=11.173 ASSIGNMENTS=642	? (TO) TT=1800.14	UNSAT TT=18.505 CHECKS=17795 NODES=113	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=1.066 ASSIGNMENTS=332 CHECKS=270840	UNSAT TT=1.038 ASSIGNMENTS=332 CHECKS=270840	UNSAT TT=18.426	UNSAT TT=17.976	No data	UNSAT TT=1.128 ASSIGNMENTS=324 CHECKS=279024	UNSAT TT=5.448 ASSIGNMENTS=9567 CHECKS=4074000	UNSAT TT=94.874	UNSAT TT=319.55 ASSIGNMENTS=107294 CHECKS=72951900	UNSAT TT=1.056 ASSIGNMENTS=292 CHECKS=243472	UNSAT TT=8.556	No data	UNSAT TT=2.371	UNSAT TT=2.62
csp/pseudo/ primesDimacs/ normalized-bf-2670-001.xml	UNSAT TT=0.758	UNSAT TT=4.319 CHECKS=175155 NODES=3944	UNSAT TT=5.957 CHECKS=216075 NODES=4189	? (TO) TT=1800.04	UNSAT TT=2.77 CHECKS=1358240	UNSAT TT=3.374 CHECKS=1504840	UNSAT TT=5.075 ASSIGNMENTS=715	UNSAT TT=5.27 ASSIGNMENTS=715	UNSAT TT=9.879 CHECKS=69756 NODES=833	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.905 ASSIGNMENTS=951 CHECKS=454543	UNSAT TT=0.913 ASSIGNMENTS=951 CHECKS=454543	UNSAT TT=8.008	UNSAT TT=7.867	No data	UNSAT TT=1.013 ASSIGNMENTS=1143 CHECKS=549452	UNSAT TT=2.157 ASSIGNMENTS=11329 CHECKS=2067920	UNSAT TT=22.101	UNSAT TT=63.338 ASSIGNMENTS=97727 CHECKS=20923500	UNSAT TT=0.758 ASSIGNMENTS=656 CHECKS=323854	UNSAT TT=6.212	No data	UNSAT TT=2.373	UNSAT TT=1.888
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ primesDimacs/ normalized-f1000.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.09	No data	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.15	No data	? (TO) TT=1800.06	? (TO) TT=1800.08
csp/pseudo/ primesDimacs/ normalized-f2000.xml		? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.12	No data	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.19	No data	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/pseudo/ primesDimacs/ normalized-f600.xml		? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	No data	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.1	No data	? (TO) TT=1800.11	? (TO) TT=1800.12
csp/pseudo/ primesDimacs/ normalized-g-125-17.xml		? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.03	No data	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.18	No data	? (TO) TT=1800.03	? (TO) TT=1800.12
csp/pseudo/ primesDimacs/ normalized-g-125-18.xml		? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	No data	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.16	No data	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/pseudo/ primesDimacs/ normalized-hanoi4.xml	SAT TT=2.365	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=1465.29	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.11	SAT TT=40.033 CHECKS=3044760 NODES=9216	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=9.233	SAT TT=8.603	No data	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=81.875	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=9.202	No data	SAT TT=2.365	SAT TT=2.475
csp/pseudo/ primesDimacs/ normalized-hanoi5.xml	SAT TT=5.43	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=32.439	SAT TT=35.235	No data	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=237.339	No data	SAT TT=14.201	SAT TT=5.43
csp/pseudo/radar/ normalized-radar-10-10-4.5-0.5-100.xml	SAT TT=0.036	SAT TT=1.326 CHECKS=4336 NODES=372	SAT TT=1.176 CHECKS=4570 NODES=0	SAT TT=0.154	SAT TT=0.066 CHECKS=6431	SAT TT=0.047 CHECKS=6596	SAT TT=1.365 ASSIGNMENTS=46	SAT TT=1.395 ASSIGNMENTS=46	SAT TT=2.143 CHECKS=5858 NODES=372	SAT TT=6.102 CHECKS=124518 NODES=2100100	SAT TT=3.427 CHECKS=5919430 NODES=772	SAT TT=0.055 ASSIGNMENTS=58 CHECKS=9106	SAT TT=0.055 ASSIGNMENTS=58 CHECKS=9106	Wrong Cert. TT=3.497	Wrong Cert. TT=3.564	No data	SAT TT=0.041 ASSIGNMENTS=58 CHECKS=9106	SAT TT=0.036 ASSIGNMENTS=81 CHECKS=7956	SAT TT=0.835	SAT TT=0.048 ASSIGNMENTS=236 CHECKS=14489	SAT TT=0.042 ASSIGNMENTS=57 CHECKS=9112	SAT TT=11.039	No data	SAT TT=1.423	SAT TT=1.51
csp/pseudo/radar/ normalized-radar-10-10-4.5-0.95-100.xml	SAT TT=0.047	SAT TT=1.424 CHECKS=4113 NODES=435	SAT TT=1.48 CHECKS=5379 NODES=0	SAT TT=0.176	SAT TT=0.077 CHECKS=8093	SAT TT=0.054 CHECKS=8344	SAT TT=1.588 ASSIGNMENTS=58	SAT TT=1.746 ASSIGNMENTS=58	SAT TT=1.747 CHECKS=7588 NODES=435	SAT TT=34.309 CHECKS=861164 NODES=13350100	SAT TT=50.726 CHECKS=234371000 NODES=27583	SAT TT=0.06 ASSIGNMENTS=55 CHECKS=9946	SAT TT=0.059 ASSIGNMENTS=55 CHECKS=9946	Wrong Cert. TT=3.36	Wrong Cert. TT=3.638	No data	SAT TT=0.047 ASSIGNMENTS=55 CHECKS=9946	SAT TT=0.057 ASSIGNMENTS=347 CHECKS=27212	SAT TT=0.941	SAT TT=0.053 ASSIGNMENTS=131 CHECKS=9914	SAT TT=0.048 ASSIGNMENTS=74 CHECKS=9944	SAT TT=6.516	No data	SAT TT=1.48	SAT TT=1.481
csp/pseudo/radar/ normalized-radar-10-10-4.5-0.95-98.xml	SAT TT=0.044	SAT TT=1.286 CHECKS=3485 NODES=411	SAT TT=1.186 CHECKS=4631 NODES=0	SAT TT=0.167	SAT TT=0.069 CHECKS=7944	SAT TT=0.051 CHECKS=7901	SAT TT=1.592 ASSIGNMENTS=41	SAT TT=1.407 ASSIGNMENTS=41	SAT TT=1.638 CHECKS=7280 NODES=411	SAT TT=32.163 CHECKS=781950 NODES=12750100	SAT TT=25.588 CHECKS=113900000 NODES=13790	SAT TT=0.055 ASSIGNMENTS=45 CHECKS=9120	SAT TT=0.057 ASSIGNMENTS=45 CHECKS=9120	Wrong Cert. TT=3.932	Wrong Cert. TT=4.114	No data	SAT TT=0.047 ASSIGNMENTS=45 CHECKS=9120	SAT TT=0.045 ASSIGNMENTS=98 CHECKS=8213	SAT TT=0.831	SAT TT=0.086 ASSIGNMENTS=661 CHECKS=44723	SAT TT=0.044 ASSIGNMENTS=45 CHECKS=9101	SAT TT=6.061	No data	SAT TT=1.271	SAT TT=1.653
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/radar/ normalized-radar-10-20-4.5-0.5-100.xml	SAT TT=0.086	SAT TT=1.835 CHECKS=10585 NODES=776	SAT TT=1.625 CHECKS=10200 NODES=0	SAT TT=0.261	SAT TT=0.138 CHECKS=14916	SAT TT=0.114 CHECKS=14960	SAT TT=2.021 ASSIGNMENTS=91	SAT TT=2.168 ASSIGNMENTS=91	SAT TT=7.723 CHECKS=12459 NODES=776	SAT TT=7.534 CHECKS=135740 NODES=900207	SAT TT=14.803 CHECKS=50382100 NODES=5509	SAT TT=0.092 ASSIGNMENTS=98 CHECKS=21935	SAT TT=0.106 ASSIGNMENTS=98 CHECKS=21935	Wrong Cert. TT=7.239	Wrong Cert. TT=6.562	No data	SAT TT=0.088 ASSIGNMENTS=98 CHECKS=21935	SAT TT=0.086 ASSIGNMENTS=181 CHECKS=19281	SAT TT=1.053	SAT TT=0.201 ASSIGNMENTS=1128 CHECKS=102982	SAT TT=0.095 ASSIGNMENTS=112 CHECKS=21976	SAT TT=86.241	No data	SAT TT=1.67	SAT TT=1.762
csp/pseudo/radar/ normalized-radar-10-20-4.5-0.95-100.xml	SAT TT=0.103	SAT TT=2.317 CHECKS=12164 NODES=934	SAT TT=1.842 CHECKS=12582 NODES=0	SAT TT=0.374	SAT TT=0.158 CHECKS=18372	SAT TT=0.113 CHECKS=17657	SAT TT=1.966 ASSIGNMENTS=78	SAT TT=2.331 ASSIGNMENTS=78	SAT TT=5.283 CHECKS=16390 NODES=934	SAT TT=548.821 CHECKS=15243600 NODES=96000300	SAT TT=56.226 CHECKS=206660000 NODES=23809	SAT TT=0.129 ASSIGNMENTS=86 CHECKS=26871	SAT TT=0.12 ASSIGNMENTS=86 CHECKS=26871	Wrong Cert. TT=7.303	Wrong Cert. TT=7.772	No data	SAT TT=0.104 ASSIGNMENTS=86 CHECKS=26871	SAT TT=0.113 ASSIGNMENTS=423 CHECKS=45299	SAT TT=1.105	SAT TT=0.12 ASSIGNMENTS=305 CHECKS=26712	SAT TT=0.103 ASSIGNMENTS=98 CHECKS=26865	SAT TT=43.079	No data	SAT TT=1.914	SAT TT=2.257
csp/pseudo/radar/ normalized-radar-10-20-4.5-0.95-98.xml	SAT TT=0.101	SAT TT=2.172 CHECKS=12591 NODES=906	SAT TT=1.645 CHECKS=12927 NODES=0	SAT TT=0.34	SAT TT=0.167 CHECKS=18199	SAT TT=0.119 CHECKS=17838	SAT TT=2.086 ASSIGNMENTS=69	SAT TT=2.32 ASSIGNMENTS=69	SAT TT=3.695 CHECKS=16274 NODES=906	SAT TT=401.955 CHECKS=12171800 NODES=79650300	SAT TT=188.945 CHECKS=746862000 NODES=87924	SAT TT=0.119 ASSIGNMENTS=76 CHECKS=25008	SAT TT=0.114 ASSIGNMENTS=76 CHECKS=25008	Wrong Cert. TT=5.543	Wrong Cert. TT=5.706	No data	SAT TT=0.101 ASSIGNMENTS=76 CHECKS=25008	SAT TT=0.113 ASSIGNMENTS=380 CHECKS=41557	SAT TT=1.067	SAT TT=0.125 ASSIGNMENTS=275 CHECKS=24879	SAT TT=0.11 ASSIGNMENTS=75 CHECKS=25025	SAT TT=30.089	No data	SAT TT=1.785	SAT TT=2.149
csp/pseudo/radar/ normalized-radar-30-30-4.5-0.5-100.xml	SAT TT=0.876	SAT TT=5.754 CHECKS=89373 NODES=4447	SAT TT=5.148 CHECKS=70991 NODES=0	SAT TT=1.695	SAT TT=1.38 CHECKS=89997	SAT TT=1.165 CHECKS=92120	SAT TT=5.357 ASSIGNMENTS=332	SAT TT=5.69 ASSIGNMENTS=332	SAT TT=140.923 CHECKS=77519 NODES=4447	? (TO) TT=1800.08	SAT TT=561.512 CHECKS=670038000 NODES=72999	SAT TT=1.051 ASSIGNMENTS=392 CHECKS=186616	SAT TT=1.052 ASSIGNMENTS=392 CHECKS=186616	Wrong Cert. TT=275.72	Wrong Cert. TT=315.247	No data	SAT TT=0.876 ASSIGNMENTS=392 CHECKS=186616	SAT TT=0.984 ASSIGNMENTS=2960 CHECKS=598849	SAT TT=2.617	SAT TT=249.122 ASSIGNMENTS=70895 CHECKS=13330800	SAT TT=0.902 ASSIGNMENTS=386 CHECKS=186685	? (TO) TT=1800.15	No data	SAT TT=3.85	SAT TT=5.108
csp/pseudo/radar/ normalized-radar-30-30-4.5-0.95-100.xml	SAT TT=0.875	SAT TT=5.716 CHECKS=75346 NODES=4617	SAT TT=4.973 CHECKS=70153 NODES=0	SAT TT=1.735	SAT TT=1.383 CHECKS=97380	SAT TT=1.116 CHECKS=98287	SAT TT=6.649 ASSIGNMENTS=430	SAT TT=6.297 ASSIGNMENTS=430	SAT TT=77.746 CHECKS=93265 NODES=4617	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.976 ASSIGNMENTS=501 CHECKS=157778	SAT TT=0.903 ASSIGNMENTS=501 CHECKS=157778	Wrong Cert. TT=47.9	Wrong Cert. TT=68.55	No data	SAT TT=0.875 ASSIGNMENTS=501 CHECKS=157778	SAT TT=3.284 ASSIGNMENTS=17975 CHECKS=3051980	SAT TT=2.732	SAT TT=231.641 ASSIGNMENTS=73622 CHECKS=10459600	SAT TT=0.902 ASSIGNMENTS=397 CHECKS=157703	SAT TT=1484.3	No data	SAT TT=3.913	SAT TT=5.291
csp/pseudo/radar/ normalized-radar-30-30-4.5-0.95-98.xml	SAT TT=0.814	SAT TT=5.421 CHECKS=74144 NODES=4624	SAT TT=4.859 CHECKS=68809 NODES=0	SAT TT=1.595	SAT TT=1.233 CHECKS=96767	SAT TT=1.115 CHECKS=96027	SAT TT=5.795 ASSIGNMENTS=415	SAT TT=5.929 ASSIGNMENTS=415	SAT TT=73.559 CHECKS=83902 NODES=4624	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=0.814 ASSIGNMENTS=448 CHECKS=154239	SAT TT=0.82 ASSIGNMENTS=448 CHECKS=154239	Wrong Cert. TT=37.708	Wrong Cert. TT=62.883	No data	SAT TT=0.842 ASSIGNMENTS=448 CHECKS=154239	SAT TT=3.276 ASSIGNMENTS=19582 CHECKS=3131600	SAT TT=2.988	SAT TT=452.263 ASSIGNMENTS=104093 CHECKS=14025900	SAT TT=0.891 ASSIGNMENTS=435 CHECKS=154231	SAT TT=730.548	No data	SAT TT=4.545	SAT TT=4.727
csp/pseudo/radar/ normalized-radar-30-70-4.5-0.5-100.xml	SAT TT=1.533	SAT TT=25.505 CHECKS=214996 NODES=10772	SAT TT=22.773 CHECKS=172713 NODES=0	SAT TT=4.184	SAT TT=14.503 CHECKS=231633	SAT TT=15.615 CHECKS=232213	SAT TT=14.939 ASSIGNMENTS=850	SAT TT=16.895 ASSIGNMENTS=850	SAT TT=187.598 CHECKS=191093 NODES=10772	? TT=106.329 CHECKS=164245 NODES=0	? TT=110.41 CHECKS=164069 NODES=0	SAT TT=1.604 ASSIGNMENTS=941 CHECKS=448309	SAT TT=1.605 ASSIGNMENTS=941 CHECKS=448309	? (TO) TT=1800.06	? (TO) TT=1800.09	No data	SAT TT=1.683 ASSIGNMENTS=941 CHECKS=448309	SAT TT=1.533 ASSIGNMENTS=3045 CHECKS=447597	SAT TT=6.118	SAT TT=1.803 ASSIGNMENTS=2422 CHECKS=448511	SAT TT=1.831 ASSIGNMENTS=928 CHECKS=448228	? (TO) TT=1800.12	No data	SAT TT=7.675	SAT TT=10.415
csp/pseudo/radar/ normalized-radar-30-70-4.5-0.95-100.xml	SAT TT=1.501	SAT TT=23.344 CHECKS=177903 NODES=10976	SAT TT=21.69 CHECKS=166790 NODES=0	SAT TT=4.288	SAT TT=14.353 CHECKS=233431	SAT TT=15.63 CHECKS=235580	SAT TT=14.798 ASSIGNMENTS=856	SAT TT=18.018 ASSIGNMENTS=856	SAT TT=135.161 CHECKS=220962 NODES=10976	? TT=53.939 CHECKS=170982 NODES=0	? TT=61.808 CHECKS=171085 NODES=0	SAT TT=1.563 ASSIGNMENTS=981 CHECKS=376839	SAT TT=1.571 ASSIGNMENTS=981 CHECKS=376839	Wrong Cert. TT=171.127	Wrong Cert. TT=375.601	No data	SAT TT=1.613 ASSIGNMENTS=981 CHECKS=376839	SAT TT=1.501 ASSIGNMENTS=2976 CHECKS=376641	SAT TT=5.994	SAT TT=1.802 ASSIGNMENTS=2615 CHECKS=376844	SAT TT=1.566 ASSIGNMENTS=1042 CHECKS=376860	? (TO) TT=1800.1	No data	SAT TT=8.309	SAT TT=10.522
csp/pseudo/radar/ normalized-radar-30-70-4.5-0.95-98.xml	SAT TT=1.48	SAT TT=24.703 CHECKS=182863 NODES=10990	SAT TT=20.81 CHECKS=167199 NODES=0	SAT TT=3.944	SAT TT=13.761 CHECKS=231852	SAT TT=15.845 CHECKS=233448	SAT TT=15.16 ASSIGNMENTS=892	SAT TT=14.342 ASSIGNMENTS=892	SAT TT=165.621 CHECKS=219565 NODES=10990	? TT=73.854 CHECKS=169196 NODES=0	? TT=79.171 CHECKS=169125 NODES=0	SAT TT=1.48 ASSIGNMENTS=965 CHECKS=384815	SAT TT=1.584 ASSIGNMENTS=965 CHECKS=384815	Wrong Cert. TT=205.62	Wrong Cert. TT=384.528	No data	SAT TT=1.495 ASSIGNMENTS=965 CHECKS=384815	SAT TT=1.495 ASSIGNMENTS=3049 CHECKS=384204	SAT TT=5.91	SAT TT=1.89 ASSIGNMENTS=2670 CHECKS=384718	SAT TT=1.673 ASSIGNMENTS=1004 CHECKS=384754	? (TO) TT=1800.12	No data	SAT TT=7.389	SAT TT=9.698
csp/pseudo/routing/ normalized-s3-3-3-1.xml	SAT TT=0.165	SAT TT=14.15 CHECKS=8356460 NODES=3646	SAT TT=10.001 CHECKS=5845300 NODES=2201	SAT TT=898.823	SAT TT=0.259 CHECKS=30227	SAT TT=0.23 CHECKS=30202	SAT TT=1.973 ASSIGNMENTS=1119	SAT TT=30.096 ASSIGNMENTS=180124	SAT TT=23.862 CHECKS=51383700 NODES=891	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=0.573 ASSIGNMENTS=1026 CHECKS=670839	SAT TT=0.548 ASSIGNMENTS=1026 CHECKS=670839	Wrong Cert. TT=2.818	Wrong Cert. TT=2.966	No data	SAT TT=0.623 ASSIGNMENTS=1259 CHECKS=822169	SAT TT=1.661 ASSIGNMENTS=6610 CHECKS=2224080	SAT TT=1.135	SAT TT=1.201 ASSIGNMENTS=3037 CHECKS=966826	SAT TT=0.165 ASSIGNMENTS=369 CHECKS=167073	? TT=434.334	No data	SAT TT=1.534	SAT TT=1.498
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/routing/ normalized-s3-3-3-2.xml	SAT TT=0.259	? (TO) TT=1800.15	SAT TT=376.504 CHECKS=210100000 NODES=17165	SAT TT=893.605	SAT TT=0.285 CHECKS=27068	SAT TT=0.259 CHECKS=26980	SAT TT=1.862 ASSIGNMENTS=698	SAT TT=344.679 ASSIGNMENTS=1759760	SAT TT=219.298 CHECKS=399000000 NODES=944	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=1.213 ASSIGNMENTS=2013 CHECKS=1548150	SAT TT=1.199 ASSIGNMENTS=2013 CHECKS=1548150	Wrong Cert. TT=8.591	Wrong Cert. TT=8.595	No data	SAT TT=1.495 ASSIGNMENTS=2943 CHECKS=1970080	SAT TT=1.815 ASSIGNMENTS=6691 CHECKS=2403800	SAT TT=1.129	SAT TT=0.764 ASSIGNMENTS=2184 CHECKS=606330	SAT TT=0.376 ASSIGNMENTS=731 CHECKS=478232	? TT=233.332	No data	SAT TT=1.215	SAT TT=1.208
csp/pseudo/routing/ normalized-s3-3-3-3.xml	SAT TT=0.177	SAT TT=22.11 CHECKS=13661100 NODES=1915	SAT TT=25.388 CHECKS=13904200 NODES=2489	SAT TT=3.411	SAT TT=0.98 CHECKS=184509	SAT TT=1.657 CHECKS=305361	SAT TT=1.728 ASSIGNMENTS=1095	SAT TT=12.906 ASSIGNMENTS=55946	SAT TT=83.182 CHECKS=187643000 NODES=961	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.208 ASSIGNMENTS=338 CHECKS=198751	SAT TT=0.205 ASSIGNMENTS=338 CHECKS=198751	Wrong Cert. TT=4.217	Wrong Cert. TT=3.997	No data	SAT TT=0.177 ASSIGNMENTS=357 CHECKS=194747	SAT TT=0.956 ASSIGNMENTS=5230 CHECKS=1372310	SAT TT=0.976	SAT TT=1.303 ASSIGNMENTS=2366 CHECKS=733452	SAT TT=0.242 ASSIGNMENTS=597 CHECKS=284057	? TT=863.345	No data	SAT TT=1.388	SAT TT=1.418
csp/pseudo/routing/ normalized-s3-3-3-4.xml	SAT TT=0.129	SAT TT=24.373 CHECKS=14317700 NODES=5497	SAT TT=36.949 CHECKS=22273400 NODES=10519	SAT TT=896.77	SAT TT=1.154 CHECKS=225197	SAT TT=0.581 CHECKS=102051	SAT TT=2.121 ASSIGNMENTS=1135	SAT TT=17.576 ASSIGNMENTS=83525	SAT TT=12.752 CHECKS=19297500 NODES=370	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=0.131 ASSIGNMENTS=216 CHECKS=92278	SAT TT=0.129 ASSIGNMENTS=216 CHECKS=92278	Wrong Cert. TT=3.937	Wrong Cert. TT=3.78	No data	SAT TT=0.13 ASSIGNMENTS=271 CHECKS=129332	SAT TT=1.036 ASSIGNMENTS=5395 CHECKS=1472080	SAT TT=0.93	SAT TT=2.188 ASSIGNMENTS=4109 CHECKS=1605360	SAT TT=0.159 ASSIGNMENTS=311 CHECKS=153881	? TT=866.116	No data	SAT TT=1.307	SAT TT=1.413
csp/pseudo/routing/ normalized-s3-3-3-5.xml	SAT TT=0.143	SAT TT=19.753 CHECKS=12106400 NODES=1401	SAT TT=1.987 CHECKS=481814 NODES=0	SAT TT=893.074	SAT TT=1.589 CHECKS=271924	SAT TT=1.363 CHECKS=234202	SAT TT=2.715 ASSIGNMENTS=3781	SAT TT=350.812 ASSIGNMENTS=1967270	SAT TT=9.807 CHECKS=38244 NODES=243	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.162 ASSIGNMENTS=273 CHECKS=128870	SAT TT=0.154 ASSIGNMENTS=273 CHECKS=128870	Wrong Cert. TT=3.839	Wrong Cert. TT=4.385	No data	SAT TT=0.143 ASSIGNMENTS=268 CHECKS=128019	SAT TT=1.338 ASSIGNMENTS=6222 CHECKS=1946730	SAT TT=0.947	SAT TT=0.637 ASSIGNMENTS=1906 CHECKS=496858	SAT TT=0.161 ASSIGNMENTS=313 CHECKS=146457	? TT=207.688	No data	SAT TT=1.158	SAT TT=1.189
csp/pseudo/routing/ normalized-s4-4-3-10.xml	SAT TT=1.851	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.08	SAT TT=714.126 CHECKS=113037000	SAT TT=346.673 CHECKS=53284700	SAT TT=67.755 ASSIGNMENTS=139606	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=585.333 ASSIGNMENTS=361214 CHECKS=418929000	SAT TT=618.491 ASSIGNMENTS=361214 CHECKS=418929000	? (TO) TT=1800.08	? (TO) TT=1800.04	No data	SAT TT=627.07 ASSIGNMENTS=332522 CHECKS=471651000	SAT TT=116.662 ASSIGNMENTS=75487 CHECKS=87496900	SAT TT=8.992	SAT TT=745.97 ASSIGNMENTS=454432 CHECKS=401492000	SAT TT=569.279 ASSIGNMENTS=361214 CHECKS=418929000	? TT=228.42	No data	SAT TT=1.851	SAT TT=2.103
csp/pseudo/routing/ normalized-s4-4-3-1.xml	SAT TT=2.412	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	SAT TT=348.164 CHECKS=65336600	? (TO) TT=1800.02	SAT TT=49.263 ASSIGNMENTS=104331	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=1143.33 ASSIGNMENTS=946779 CHECKS=901929000	SAT TT=1173.11 ASSIGNMENTS=946779 CHECKS=901929000	Wrong Cert. TT=475.067	Wrong Cert. TT=508.889	No data	? (TO) TT=1800.09	SAT TT=31.884 ASSIGNMENTS=34430 CHECKS=28474600	? (TO) TT=1800.1	SAT TT=754.076 ASSIGNMENTS=583745 CHECKS=500745000	SAT TT=1108.59 ASSIGNMENTS=946779 CHECKS=901929000	? TT=220.063	No data	SAT TT=2.412	SAT TT=3.221
csp/pseudo/routing/ normalized-s4-4-3-2.xml	SAT TT=2.062	? (TO) TT=1800.13	? (TO) TT=1800.11	SAT TT=1349.76	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=55.239 ASSIGNMENTS=127283	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=82.281 ASSIGNMENTS=64781 CHECKS=62146300	SAT TT=124.11 ASSIGNMENTS=64781 CHECKS=62146300	Wrong Cert. TT=236.383	Wrong Cert. TT=235.653	No data	SAT TT=1111.19 ASSIGNMENTS=883703 CHECKS=936309000	SAT TT=1129.71 ASSIGNMENTS=812850 CHECKS=1025900000	SAT TT=93.435	? (TO) TT=1800.1	SAT TT=70.603 ASSIGNMENTS=64781 CHECKS=62146300	? TT=233.646	No data	SAT TT=2.062	SAT TT=2.687
csp/pseudo/routing/ normalized-s4-4-3-3.xml	SAT TT=2.687	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=1252.36 CHECKS=258071000	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	Wrong Cert. TT=227.703	Wrong Cert. TT=230.09	No data	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=292.826	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=1273.83	No data	SAT TT=4.396	SAT TT=2.687
csp/pseudo/routing/ normalized-s4-4-3-4.xml	SAT TT=1.942	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.09	SAT TT=948.805 CHECKS=170461000	? (TO) TT=1800.11	SAT TT=9.58 ASSIGNMENTS=22126	SAT TT=774.258 ASSIGNMENTS=2055640	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=18.043 ASSIGNMENTS=8482 CHECKS=9559560	SAT TT=56.034 ASSIGNMENTS=8482 CHECKS=9559560	Wrong Cert. TT=1017.73	Wrong Cert. TT=973.514	No data	SAT TT=1167.41 ASSIGNMENTS=811360 CHECKS=980026000	SAT TT=827.038 ASSIGNMENTS=558581 CHECKS=713791000	SAT TT=233.012	SAT TT=596.035 ASSIGNMENTS=455410 CHECKS=354587000	SAT TT=11.923 ASSIGNMENTS=8482 CHECKS=9559560	? TT=238.316	No data	SAT TT=2.02	SAT TT=1.942
csp/pseudo/routing/ normalized-s4-4-3-5.xml	SAT TT=2.348	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	SAT TT=451.578 ASSIGNMENTS=1240490	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	No data	SAT TT=1280.73 ASSIGNMENTS=729462 CHECKS=1024890000	SAT TT=466.262 ASSIGNMENTS=293825 CHECKS=369415000	SAT TT=103.319	? (TO) TT=1800.09	? (TO) TT=1800.05	? TT=250.146	No data	SAT TT=2.348	SAT TT=3.079
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/routing/ normalized-s4-4-3-6.xml	SAT TT=1.577	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT TT=898.929	? (TO) TT=1800.08	SAT TT=322.117 CHECKS=66114800	SAT TT=23.156 ASSIGNMENTS=61151	SAT TT=883.436 ASSIGNMENTS=2963120	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=9.913 ASSIGNMENTS=2157 CHECKS=2020660	SAT TT=45.882 ASSIGNMENTS=2157 CHECKS=2020660	Wrong Cert. TT=124.222	Wrong Cert. TT=115.512	No data	SAT TT=189.918 ASSIGNMENTS=182121 CHECKS=156986000	SAT TT=45.711 ASSIGNMENTS=51641 CHECKS=43571700	SAT TT=3.408	SAT TT=1311.72 ASSIGNMENTS=1223880 CHECKS=1011160000	SAT TT=2.415 ASSIGNMENTS=2157 CHECKS=2020660	? TT=224.588	No data	SAT TT=1.577	SAT TT=15.071
csp/pseudo/routing/ normalized-s4-4-3-7.xml	SAT TT=2.849	? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=214.74 CHECKS=40191200	SAT TT=118.69 ASSIGNMENTS=308413	? (TO) TT=1800.18	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=78.628 ASSIGNMENTS=65127 CHECKS=57304100	SAT TT=113.435 ASSIGNMENTS=65127 CHECKS=57304100	Wrong Cert. TT=492.662	Wrong Cert. TT=501.154	No data	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=83.266	SAT TT=936.736 ASSIGNMENTS=704807 CHECKS=497311000	SAT TT=68.592 ASSIGNMENTS=65127 CHECKS=57304100	? TT=230.073	No data	SAT TT=2.849	SAT TT=8.755
csp/pseudo/routing/ normalized-s4-4-3-8.xml	SAT TT=1.898	SAT TT=193.134 CHECKS=127189000 NODES=57137	? (TO) TT=1800.11	SAT TT=1030.57	SAT TT=16.01 CHECKS=3359980	SAT TT=31.782 CHECKS=7173040	SAT TT=3.361 ASSIGNMENTS=6180	SAT TT=253.789 ASSIGNMENTS=828416	SAT TT=1130.57 CHECKS=2814190000 NODES=40957	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=48.233 ASSIGNMENTS=7609 CHECKS=4472960	SAT TT=48.21 ASSIGNMENTS=7609 CHECKS=4472960	Wrong Cert. TT=4.003	Wrong Cert. TT=3.697	No data	SAT TT=16.701 ASSIGNMENTS=23841 CHECKS=18524800	SAT TT=5.035 ASSIGNMENTS=11778 CHECKS=5178070	SAT TT=1.971	SAT TT=97.975 ASSIGNMENTS=116307 CHECKS=51551200	SAT TT=4.393 ASSIGNMENTS=7609 CHECKS=4472960	? TT=866.223	No data	SAT TT=1.898	SAT TT=2.552
csp/pseudo/routing/ normalized-s4-4-3-9.xml	SAT TT=2.248	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=950.913 ASSIGNMENTS=1613820	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	No data	? (TO) TT=1800.1	SAT TT=98.015 ASSIGNMENTS=46442 CHECKS=64568800	? (TO) TT=1800.06	SAT TT=1461.19 ASSIGNMENTS=802936 CHECKS=878707000	? (TO) TT=1800.05	? TT=250.912	No data	SAT TT=2.248	SAT TT=2.357
csp/pseudo/ssa/ normalized-ssa-0432-003.xml	UNSAT TT=0.298	UNSAT TT=67.794 CHECKS=17319900 NODES=115972	UNSAT TT=47.533 CHECKS=10329100 NODES=83152	UNSAT TT=0.543	UNSAT TT=0.298 CHECKS=134508	UNSAT TT=0.384 CHECKS=296461	UNSAT TT=5.699 ASSIGNMENTS=7301	UNSAT TT=5.587 ASSIGNMENTS=7301	UNSAT TT=803.196 CHECKS=145049000 NODES=786797	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=43.326 ASSIGNMENTS=90077 CHECKS=45147400	UNSAT TT=76.576 ASSIGNMENTS=115966 CHECKS=17319900	UNSAT TT=4.312	UNSAT TT=4.283	No data	UNSAT TT=25.691 ASSIGNMENTS=83408 CHECKS=36542000	UNSAT TT=33.26 ASSIGNMENTS=79659 CHECKS=47831900	UNSAT TT=3.296	UNSAT TT=82.105 ASSIGNMENTS=192025 CHECKS=88303200	UNSAT TT=31.735 ASSIGNMENTS=90077 CHECKS=45147400	UNSAT TT=4.201	No data	UNSAT TT=1.312	UNSAT TT=1.807
csp/pseudo/ssa/ normalized-ssa-2670-130.xml	UNSAT TT=1.875	UNSAT TT=39.258 CHECKS=10931100 NODES=79830	UNSAT TT=53.557 CHECKS=15120200 NODES=105700	? (TO) TT=1800.03	UNSAT TT=223.818 CHECKS=85111100	UNSAT TT=107.613 CHECKS=48062400	UNSAT TT=179.144 ASSIGNMENTS=166440	UNSAT TT=174.23 ASSIGNMENTS=166440	UNSAT TT=827.407 CHECKS=57666800 NODES=194732	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=77.499 ASSIGNMENTS=62778 CHECKS=58091100	UNSAT TT=68.917 ASSIGNMENTS=142087 CHECKS=20250300	UNSAT TT=7.923	UNSAT TT=7.687	No data	UNSAT TT=19.769 ASSIGNMENTS=20890 CHECKS=16809300	UNSAT TT=21.163 ASSIGNMENTS=26136 CHECKS=17147900	UNSAT TT=10.298	UNSAT TT=120.797 ASSIGNMENTS=149252 CHECKS=45695800	UNSAT TT=71.167 ASSIGNMENTS=62778 CHECKS=58091100	UNSAT TT=7.036	No data	UNSAT TT=1.875	UNSAT TT=1.916
csp/pseudo/ssa/ normalized-ssa-2670-141.xml	UNSAT TT=1.618	UNSAT TT=115.509 CHECKS=39541600 NODES=423668	UNSAT TT=152.2 CHECKS=50122100 NODES=518679	? (TO) TT=1800.03	UNSAT TT=209.122 CHECKS=100853000	UNSAT TT=183.995 CHECKS=103197000	UNSAT TT=497.851 ASSIGNMENTS=481942	UNSAT TT=334.362 ASSIGNMENTS=481942	UNSAT TT=1612.47 CHECKS=168008000 NODES=608122	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=214.234 ASSIGNMENTS=290547 CHECKS=230652000	UNSAT TT=165.477 ASSIGNMENTS=566893 CHECKS=53130300	UNSAT TT=3.704	UNSAT TT=4.182	No data	UNSAT TT=45.511 ASSIGNMENTS=75002 CHECKS=50539200	UNSAT TT=41.691 ASSIGNMENTS=66685 CHECKS=47819500	UNSAT TT=6.635	UNSAT TT=476.424 ASSIGNMENTS=521618 CHECKS=315898000	UNSAT TT=204.684 ASSIGNMENTS=290547 CHECKS=230652000	UNSAT TT=5.882	No data	UNSAT TT=1.618	UNSAT TT=1.657
csp/pseudo/ssa/ normalized-ssa-6288-047.xml	UNSAT TT=2.52	UNSAT TT=22.678 CHECKS=791 NODES=0	UNSAT TT=23.555 CHECKS=791 NODES=0	UNSAT TT=10.197	UNSAT TT=17.256 CHECKS=45469	UNSAT TT=14.187 CHECKS=45469	UNSAT TT=30.377 ASSIGNMENTS=0	UNSAT TT=28.175 ASSIGNMENTS=0	UNSAT TT=345.964 CHECKS=2027 NODES=0	UNSAT TT=355.62 CHECKS=3956 NODES=0	UNSAT TT=401.097 CHECKS=3956 NODES=0	UNSAT TT=2.69 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=2.683 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=417.548	UNSAT TT=223.157	No data	UNSAT TT=2.657 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=2.52 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=22.751	UNSAT TT=2.637 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=2.649 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=10.811	No data	UNSAT TT=8.68	UNSAT TT=9.353
csp/pseudo/ssa/ normalized-ssa-7552-038.xml	SAT TT=0.336	SAT TT=3.985 CHECKS=61821 NODES=4149	SAT TT=6.493 CHECKS=97109 NODES=4100	SAT TT=1799.09	SAT TT=8.52 CHECKS=6664050	SAT TT=5.069 CHECKS=3594130	SAT TT=6.876 ASSIGNMENTS=1206	SAT TT=6.374 ASSIGNMENTS=1206	SAT TT=8.048 CHECKS=19334 NODES=3034	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=8.6 ASSIGNMENTS=1224 CHECKS=455939	SAT TT=10.506 ASSIGNMENTS=4145 CHECKS=61584	SAT TT=12.084	SAT TT=12.182	No data	SAT TT=5.369 ASSIGNMENTS=11874 CHECKS=4911170	SAT TT=0.336 ASSIGNMENTS=216 CHECKS=20447	SAT TT=7.661	SAT TT=3.052 ASSIGNMENTS=3051 CHECKS=661481	SAT TT=0.732 ASSIGNMENTS=1224 CHECKS=455939	SAT TT=7.426	No data	SAT TT=2.013	SAT TT=2.348
csp/pseudo/ssa/ normalized-ssa-7552-158.xml	SAT TT=0.26	SAT TT=3.473 CHECKS=15039 NODES=2726	SAT TT=5.482 CHECKS=43370 NODES=2726	SAT TT=0.89	SAT TT=6.006 CHECKS=4600080	SAT TT=4.03 CHECKS=3241330	SAT TT=4.948 ASSIGNMENTS=134	SAT TT=5.047 ASSIGNMENTS=134	SAT TT=6.947 CHECKS=17650 NODES=2757	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=0.291 ASSIGNMENTS=142 CHECKS=15319	SAT TT=0.292 ASSIGNMENTS=142 CHECKS=15319	SAT TT=11.312	SAT TT=11.538	No data	SAT TT=0.26 ASSIGNMENTS=142 CHECKS=15322	SAT TT=0.276 ASSIGNMENTS=210 CHECKS=14574	SAT TT=20.763	SAT TT=2.887 ASSIGNMENTS=7016 CHECKS=652881	SAT TT=0.26 ASSIGNMENTS=135 CHECKS=13865	SAT TT=6.989	No data	SAT TT=1.892	SAT TT=2.185
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ssa/ normalized-ssa-7552-159.xml	SAT TT=0.271	SAT TT=3.23 CHECKS=15826 NODES=2728	SAT TT=4.947 CHECKS=43322 NODES=2728	SAT TT=0.891	SAT TT=7.027 CHECKS=5525820	SAT TT=3.985 CHECKS=3182480	SAT TT=5.187 ASSIGNMENTS=144	SAT TT=5.112 ASSIGNMENTS=144	SAT TT=6.52 CHECKS=17785 NODES=2757	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=0.299 ASSIGNMENTS=159 CHECKS=19325	SAT TT=0.3 ASSIGNMENTS=159 CHECKS=19325	SAT TT=11.323	SAT TT=11.493	No data	SAT TT=0.29 ASSIGNMENTS=170 CHECKS=24861	SAT TT=0.285 ASSIGNMENTS=182 CHECKS=14459	SAT TT=15.832	SAT TT=2.653 ASSIGNMENTS=5221 CHECKS=490847	SAT TT=0.271 ASSIGNMENTS=153 CHECKS=15403	SAT TT=6.648	No data	SAT TT=1.947	SAT TT=2.055
csp/pseudo/ssa/ normalized-ssa-7552-160.xml	SAT TT=0.292	SAT TT=3.362 CHECKS=18673 NODES=2788	SAT TT=4.447 CHECKS=51359 NODES=0	SAT TT=0.985	SAT TT=6.924 CHECKS=5644880	SAT TT=4.595 CHECKS=3379640	SAT TT=5.385 ASSIGNMENTS=139	SAT TT=5.152 ASSIGNMENTS=139	SAT TT=7.121 CHECKS=18907 NODES=2817	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.785 ASSIGNMENTS=1377 CHECKS=519920	SAT TT=0.783 ASSIGNMENTS=1377 CHECKS=519920	SAT TT=9.867	SAT TT=9.776	No data	SAT TT=0.407 ASSIGNMENTS=451 CHECKS=133595	SAT TT=0.292 ASSIGNMENTS=175 CHECKS=16519	SAT TT=5.194	SAT TT=2.269 ASSIGNMENTS=3735 CHECKS=456520	SAT TT=0.31 ASSIGNMENTS=180 CHECKS=30534	SAT TT=6.648	No data	SAT TT=2.217	SAT TT=2.484
csp/pseudo/ttp/ normalized-circ-4-3.xml	SAT TT=0.08	SAT TT=1.667 CHECKS=17194 NODES=488	SAT TT=1.336 CHECKS=4809 NODES=0	SAT TT=1.123	SAT TT=0.639 CHECKS=100384	SAT TT=0.61 CHECKS=98983	SAT TT=1.929 ASSIGNMENTS=302	SAT TT=1.593 ASSIGNMENTS=78	SAT TT=1.585 CHECKS=4097 NODES=148	SAT TT=2.203 CHECKS=1035660 NODES=7376	SAT TT=1.482 CHECKS=90225 NODES=160	SAT TT=0.123 ASSIGNMENTS=93 CHECKS=62074	SAT TT=0.129 ASSIGNMENTS=93 CHECKS=62074	Wrong UNSAT TT=2.237	Wrong UNSAT TT=2.311	No data	SAT TT=0.122 ASSIGNMENTS=143 CHECKS=86225	SAT TT=0.103 ASSIGNMENTS=113 CHECKS=59010	SAT TT=1.261	SAT TT=0.08 ASSIGNMENTS=34 CHECKS=15972	SAT TT=0.122 ASSIGNMENTS=104 CHECKS=76973	SAT TT=5.125	No data	SAT TT=1.394	SAT TT=1.155
csp/pseudo/ttp/ normalized-circ-8-3.xml	SAT TT=17.092	? (TO) TT=1800.15	SAT TT=810.724 CHECKS=43264900 NODES=198694	? (TO) TT=1800.03	SAT TT=320.371 CHECKS=15876400	SAT TT=349.909 CHECKS=17755200	SAT TT=80.539 ASSIGNMENTS=22310	? (TO) TT=1800.09	SAT TT=118.903 CHECKS=2921390 NODES=1939	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=134.499 ASSIGNMENTS=63426 CHECKS=7925780	SAT TT=133.902 ASSIGNMENTS=63426 CHECKS=7925780	Wrong UNSAT TT=535.641	Wrong UNSAT TT=565.076	No data	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=767.23 ASSIGNMENTS=21464 CHECKS=416750000	? TT=488.945	No data	SAT TT=17.092	SAT TT=27.931
csp/pseudo/ttp/ normalized-data-6-3.xml	SAT TT=3.588	SAT TT=12.839 CHECKS=584163 NODES=8984	SAT TT=13.694 CHECKS=747346 NODES=10248	? (TO) TT=1800.03	SAT TT=26.028 CHECKS=2210310	SAT TT=17.377 CHECKS=1300180	SAT TT=6.925 ASSIGNMENTS=2445	SAT TT=36.113 ASSIGNMENTS=27194	SAT TT=34.832 CHECKS=83261 NODES=677	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=16.787 ASSIGNMENTS=6593 CHECKS=499480	SAT TT=16.742 ASSIGNMENTS=6593 CHECKS=499480	Wrong UNSAT TT=11.489	Wrong UNSAT TT=11.573	No data	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=94.262 ASSIGNMENTS=11862 CHECKS=57986600	SAT TT=11.633 ASSIGNMENTS=1536 CHECKS=7151380	? TT=217.951	No data	SAT TT=3.689	SAT TT=3.588
csp/pseudo/ttp/ normalized-data-8-3.xml	SAT TT=17.557	? (TO) TT=1800.15	SAT TT=826.24 CHECKS=43264900 NODES=198694	? (TO) TT=1800.11	SAT TT=339.49 CHECKS=19143000	SAT TT=710.767 CHECKS=38680600	SAT TT=90.297 ASSIGNMENTS=22310	? (TO) TT=1800.14	SAT TT=120.084 CHECKS=2921390 NODES=1939	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=138.837 ASSIGNMENTS=63426 CHECKS=7925780	SAT TT=137.892 ASSIGNMENTS=63426 CHECKS=7925780	Wrong UNSAT TT=574.925	Wrong UNSAT TT=544.635	No data	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=1006.39 ASSIGNMENTS=21464 CHECKS=416750000	? TT=353.593	No data	SAT TT=17.557	SAT TT=27.876
csp/pseudo/uclid/ normalized-22s-smv.xml	UNSAT TT=25.823	UNSAT TT=718.577 CHECKS=119897000 NODES=508834	UNSAT TT=951.029 CHECKS=143993000 NODES=693595	? (TO) TT=1800.08	UNSAT TT=25.823 CHECKS=11009000	UNSAT TT=325.929 CHECKS=45990200	UNSAT TT=26.194 ASSIGNMENTS=0	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.08	No data	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=384.459	UNSAT TT=31.104 ASSIGNMENTS=54207 CHECKS=22373800	? (TO) TT=1800.1	? TT=484.289	No data	? (MO) TT=70.3	? (MO) TT=268.54
csp/pseudo/uclid/ normalized-37s-smv.xml	UNSAT TT=2.663	UNSAT TT=87.937 CHECKS=13267400 NODES=75094	UNSAT TT=98.718 CHECKS=12752900 NODES=77610	UNSAT TT=214.017	UNSAT TT=389.223 CHECKS=83135600	UNSAT TT=673.092 CHECKS=153648000	UNSAT TT=500.187 ASSIGNMENTS=483920	UNSAT TT=60.46 ASSIGNMENTS=46176	UNSAT TT=324.58 CHECKS=73676000 NODES=148518	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=24.976 ASSIGNMENTS=42669 CHECKS=16490000	UNSAT TT=90.854 ASSIGNMENTS=75094 CHECKS=13267400	UNSAT TT=10.086	UNSAT TT=9.285	No data	UNSAT TT=122.844 ASSIGNMENTS=229315 CHECKS=141101000	UNSAT TT=71.94 ASSIGNMENTS=123784 CHECKS=78168300	UNSAT TT=54.053	? (TO) TT=1800.04	UNSAT TT=15.997 ASSIGNMENTS=42669 CHECKS=16490000	UNSAT TT=9.152	No data	UNSAT TT=2.663	UNSAT TT=3.75
csp/pseudo/uclid/ normalized-43s-smv.xml	UNSAT TT=93.958	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.06	Wrong Cert. TT=204.394	Wrong Cert. TT=931.325	No data	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=401.908	No data	UNSAT TT=93.958	UNSAT TT=195.867
csp/pseudo/uclid/ normalized-44s-smv.xml	UNSAT TT=5.33	UNSAT TT=50.445 CHECKS=14484600 NODES=76972	UNSAT TT=45.018 CHECKS=11241800 NODES=77829	? (TO) TT=1800.07	UNSAT TT=103.26 CHECKS=11890700	UNSAT TT=96.554 CHECKS=13044800	UNSAT TT=73.293 ASSIGNMENTS=273394	? (TO) TT=1800.15	UNSAT TT=79.916 CHECKS=18628800 NODES=179941	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=492.506 ASSIGNMENTS=418658 CHECKS=714841000	UNSAT TT=52.668 ASSIGNMENTS=76963 CHECKS=14484600	Wrong Cert. TT=12.231	Wrong Cert. TT=12.65	No data	UNSAT TT=67.703 ASSIGNMENTS=71468 CHECKS=97553200	UNSAT TT=175.009 ASSIGNMENTS=133658 CHECKS=261120000	UNSAT TT=3.955	? (TO) TT=1800.06	UNSAT TT=486.059 ASSIGNMENTS=418658 CHECKS=714841000	UNSAT TT=18.219	No data	UNSAT TT=5.33	UNSAT TT=10.357
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/uclid/ normalized-46s-smv.xml	UNSAT TT=11.623	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	Wrong Cert. TT=39.757	Wrong Cert. TT=50.397	No data	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=48.599	No data	UNSAT TT=11.623	UNSAT TT=28.601
csp/pseudo/uclid/ normalized-blast-floppy1-4.xml	SAT TT=0.046	SAT TT=2.026 CHECKS=146231 NODES=241	SAT TT=1.999 CHECKS=147760 NODES=0	SAT TT=0.143	SAT TT=0.225 CHECKS=10535	SAT TT=0.214 CHECKS=10382	SAT TT=1.13 ASSIGNMENTS=268	SAT TT=1.251 ASSIGNMENTS=75	SAT TT=11.983 CHECKS=949685 NODES=595	SAT TT=4.368 CHECKS=162600 NODES=34	SAT TT=4.431 CHECKS=164786 NODES=24	SAT TT=0.061 ASSIGNMENTS=156 CHECKS=18373	SAT TT=0.06 ASSIGNMENTS=156 CHECKS=18373	Wrong Cert. TT=47.156	Wrong Cert. TT=41.801	No data	SAT TT=0.046 ASSIGNMENTS=156 CHECKS=18373	SAT TT=0.069 ASSIGNMENTS=387 CHECKS=62613	SAT TT=0.704	SAT TT=20.502 ASSIGNMENTS=179234 CHECKS=12037300	SAT TT=0.051 ASSIGNMENTS=153 CHECKS=18196	SAT TT=303.234	No data	SAT TT=26.056	SAT TT=120.061
csp/pseudo/uclid/ normalized-blast-floppy1-7.xml	UNSAT TT=0.666	UNSAT TT=663.041 CHECKS=273666000 NODES=430	UNSAT TT=911.183 CHECKS=382944000 NODES=410	UNSAT TT=2.763	UNSAT TT=1.079 CHECKS=3907	UNSAT TT=1.371 CHECKS=9043	UNSAT TT=4.718 ASSIGNMENTS=0	UNSAT TT=4.582 ASSIGNMENTS=0	UNSAT TT=351.755 CHECKS=434108000 NODES=2	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=0.723 ASSIGNMENTS=1 CHECKS=101483	UNSAT TT=0.722 ASSIGNMENTS=1 CHECKS=101483	? (problem) TT=49.452	? (problem) TT=49.241	No data	UNSAT TT=0.666 ASSIGNMENTS=1 CHECKS=101483	UNSAT TT=39.211 ASSIGNMENTS=49980 CHECKS=46305600	UNSAT TT=84.165	UNSAT TT=0.725 ASSIGNMENTS=2 CHECKS=107550	UNSAT TT=0.849 ASSIGNMENTS=5 CHECKS=192020	? TT=426.602	No data	? TT=167.298	? TT=170.784
csp/pseudo/uclid/ normalized-blast-tlan3.xml	SAT TT=8.804	SAT TT=306.078 CHECKS=12140800 NODES=52024	SAT TT=566.465 CHECKS=12767000 NODES=52040	SAT TT=24.592	SAT TT=101.289 CHECKS=12864400	SAT TT=99.173 CHECKS=1057690	SAT TT=648.564 ASSIGNMENTS=3233	? (TO) TT=1800.18	SAT TT=1643.71 CHECKS=51654100 NODES=25505	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=94.588 ASSIGNMENTS=19952 CHECKS=2651060	SAT TT=94.8 ASSIGNMENTS=19952 CHECKS=2651060	? (problem) TT=267.233	? (problem) TT=275.675	No data	SAT TT=8.804 ASSIGNMENTS=1713 CHECKS=3047720	? (TO) TT=1800.12	SAT TT=48.804	? (TO) TT=1800.12	SAT TT=9.992 ASSIGNMENTS=1718 CHECKS=3027510	? TT=591.112	No data	? TT=173.949	? TT=181.396
csp/pseudo/uclid/ normalized-cache-ibm-q-unbounded-Icl2arity-ucl.xml	UNSAT TT=140.591	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.16	? (TO) TT=1800.05	? TT=1174.03 CHECKS=370173 NODES=0	? TT=1191.08 CHECKS=370173 NODES=0	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=533.29	UNSAT TT=519.142	No data	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=399.397	No data	UNSAT TT=140.591	UNSAT TT=253.6
csp/pseudo/uclid/ normalized-elf-rf6.xml	UNSAT TT=0.014	UNSAT TT=0.862 CHECKS=525 NODES=18	UNSAT TT=0.856 CHECKS=811 NODES=0	UNSAT TT=0.052	UNSAT TT=0.023 CHECKS=1321	UNSAT TT=0.018 CHECKS=1203	UNSAT TT=0.764 ASSIGNMENTS=0	UNSAT TT=0.779 ASSIGNMENTS=0	UNSAT TT=0.857 CHECKS=749 NODES=5	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.028 ASSIGNMENTS=3 CHECKS=772	UNSAT TT=0.025 ASSIGNMENTS=3 CHECKS=772	Wrong Cert. TT=2.016	Wrong Cert. TT=1.906	No data	UNSAT TT=0.016 ASSIGNMENTS=19 CHECKS=3367	UNSAT TT=0.056 ASSIGNMENTS=647 CHECKS=69852	UNSAT TT=0.533	UNSAT TT=0.015 ASSIGNMENTS=10 CHECKS=1206	UNSAT TT=0.014 ASSIGNMENTS=3 CHECKS=772	UNSAT TT=1.649	No data	UNSAT TT=0.708	UNSAT TT=0.682
csp/pseudo/uclid/ normalized-elf-rf8.xml	UNSAT TT=7.811	UNSAT TT=26.774 CHECKS=2650340 NODES=16891	UNSAT TT=62.814 CHECKS=4753880 NODES=15612	? (TO) TT=1800.09	UNSAT TT=71.863 CHECKS=22158200	UNSAT TT=37.627 CHECKS=5729870	UNSAT TT=171.47 ASSIGNMENTS=11133	? (TO) TT=1800.1	UNSAT TT=110.433 CHECKS=1241940 NODES=2103	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=17.4 ASSIGNMENTS=3265 CHECKS=7081820	UNSAT TT=36.659 ASSIGNMENTS=16891 CHECKS=2650340	Wrong Cert. TT=83.67	Wrong Cert. TT=137.229	No data	UNSAT TT=22.484 ASSIGNMENTS=8031 CHECKS=20453600	UNSAT TT=19.389 ASSIGNMENTS=26824 CHECKS=15519500	UNSAT TT=20.641	UNSAT TT=49.978 ASSIGNMENTS=32218 CHECKS=36334900	UNSAT TT=9.493 ASSIGNMENTS=3265 CHECKS=7081820	UNSAT TT=26.823	No data	UNSAT TT=7.811	UNSAT TT=18.498
csp/pseudo/uclid/ normalized-elf-rf9.xml	UNSAT TT=34.642	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.11	UNSAT TT=1607.25 CHECKS=337241000	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1846.07	? TT=861.637 CHECKS=311880 NODES=0	? TT=876.546 CHECKS=309277 NODES=0	UNSAT TT=558.807 ASSIGNMENTS=43991 CHECKS=177041000	UNSAT TT=1012.26 ASSIGNMENTS=43991 CHECKS=177041000	Wrong Cert. TT=798.713	? (TO) TT=1800.08	No data	UNSAT TT=331.337 ASSIGNMENTS=83654 CHECKS=267958000	UNSAT TT=198.187 ASSIGNMENTS=95084 CHECKS=139816000	? (TO) TT=1800.04	? (TO) TT=1800.14	UNSAT TT=220.647 ASSIGNMENTS=43991 CHECKS=177041000	UNSAT TT=135.041	No data	UNSAT TT=34.642	UNSAT TT=109.246
csp/pseudo/uclid/ normalized-ooo-burch-dill-4-accl.xml	UNSAT TT=22.61	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=63.355	UNSAT TT=44.046	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=64.754	No data	UNSAT TT=22.61	UNSAT TT=52.781
csp/pseudo/uclid/ normalized-ooo-burch-dill-8-accl.xml		? (TO) TT=1800.22	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.01	? TT=1020.73 CHECKS=311195 NODES=0	? TT=928.62 CHECKS=311195 NODES=0	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=678.531	UNSAT TT=425.42	No data	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05	? TT=1118.06	No data	? (TO) TT=1800.08	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/uclid/ normalized-ooo-rf10.xml	UNSAT TT=59.254	? (TO) TT=1800.18	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.07	? TT=1556.28 CHECKS=25012000 NODES=600000	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.03	Wrong Cert. TT=468.035	Wrong Cert. TT=499.765	No data	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=598.623	No data	UNSAT TT=59.254	UNSAT TT=64.058
csp/pseudo/uclid/ normalized-ooo-rf8.xml	UNSAT TT=7.511	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	Wrong Cert. TT=82.715	Wrong Cert. TT=96.651	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=505.96	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=30.381	No data	UNSAT TT=7.511	UNSAT TT=12.707
csp/pseudo/uclid/ normalized-ooo-tag10.xml	UNSAT TT=17.802	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.06	Wrong Cert. TT=146.604	Wrong Cert. TT=191.221	No data	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.12	UNSAT TT=370.497	No data	UNSAT TT=17.802	UNSAT TT=27.609
csp/QCP-10/ normalized-qcp-10-67-0_ext.xml	SAT TT=0.022	SAT TT=0.958 CHECKS=7709 NODES=100	SAT TT=0.964 CHECKS=14349 NODES=100	SAT TT=0.108	SAT TT=0.063 CHECKS=17902	SAT TT=0.043 CHECKS=3991	SAT TT=0.978 ASSIGNMENTS=26	SAT TT=0.993 ASSIGNMENTS=21	SAT TT=0.632 CHECKS=5307 NODES=105	SAT TT=0.672 CHECKS=18803 NODES=77	SAT TT=0.815 CHECKS=120657 NODES=310	SAT TT=0.036 ASSIGNMENTS=29 CHECKS=2452	SAT TT=0.037 ASSIGNMENTS=29 CHECKS=2452	SAT TT=1.589	SAT TT=1.817	No data	SAT TT=0.025 ASSIGNMENTS=29 CHECKS=2452	SAT TT=0.029 ASSIGNMENTS=167 CHECKS=19795	SAT TT=1.092	SAT TT=0.03 ASSIGNMENTS=226 CHECKS=24850	SAT TT=0.022 ASSIGNMENTS=29 CHECKS=2452	SAT TT=1.252	SAT TT=0.062 ASSIGNMENTS=100 CHECKS=44647	SAT TT=1.096	SAT TT=1.043
csp/QCP-10/ normalized-qcp-10-67-10_ext.xml	UNSAT TT=0.037	UNSAT TT=1.002 CHECKS=21618 NODES=288	UNSAT TT=0.929 CHECKS=7971 NODES=0	UNSAT TT=91.664	UNSAT TT=0.152 CHECKS=91803	UNSAT TT=0.074 CHECKS=28058	UNSAT TT=0.621 ASSIGNMENTS=0	UNSAT TT=0.838 ASSIGNMENTS=0	UNSAT TT=0.736 CHECKS=14126 NODES=480	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=8.065 ASSIGNMENTS=0	UNSAT TT=14.353 ASSIGNMENTS=211005 CHECKS=24446600	UNSAT TT=1.013	UNSAT TT=1.125	No data	UNSAT TT=0.037 ASSIGNMENTS=495 CHECKS=50804	UNSAT TT=0.166 ASSIGNMENTS=4988 CHECKS=539894	UNSAT TT=0.8	UNSAT TT=0.047 ASSIGNMENTS=851 CHECKS=92584	UNSAT TT=6.781 ASSIGNMENTS=211005 CHECKS=24446600	UNSAT TT=1.574	UNSAT TT=0.314 ASSIGNMENTS=1562 CHECKS=722588	UNSAT TT=1.143	UNSAT TT=1.355
csp/QCP-10/ normalized-qcp-10-67-11_ext.xml	UNSAT TT=0.042	UNSAT TT=1.068 CHECKS=82024 NODES=963	UNSAT TT=1.104 CHECKS=76300 NODES=767	UNSAT TT=109.178	UNSAT TT=0.076 CHECKS=25866	UNSAT TT=0.048 CHECKS=6571	UNSAT TT=0.604 ASSIGNMENTS=0	UNSAT TT=0.615 ASSIGNMENTS=0	UNSAT TT=0.694 CHECKS=6518 NODES=114	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.075 ASSIGNMENTS=1280 CHECKS=144558	UNSAT TT=0.076 ASSIGNMENTS=1280 CHECKS=144558	UNSAT TT=1.235	UNSAT TT=1.134	No data	UNSAT TT=0.051 ASSIGNMENTS=1016 CHECKS=116613	UNSAT TT=0.165 ASSIGNMENTS=5200 CHECKS=481072	UNSAT TT=0.693	UNSAT TT=0.042 ASSIGNMENTS=732 CHECKS=72292	UNSAT TT=0.061 ASSIGNMENTS=1280 CHECKS=144558	UNSAT TT=1.431	UNSAT TT=0.569 ASSIGNMENTS=2806 CHECKS=1125400	UNSAT TT=0.987	UNSAT TT=1.331
csp/QCP-10/ normalized-qcp-10-67-12_ext.xml	UNSAT TT=0.025	UNSAT TT=0.887 CHECKS=3245 NODES=0	UNSAT TT=0.882 CHECKS=3245 NODES=0	UNSAT TT=46.229	UNSAT TT=0.098 CHECKS=45697	UNSAT TT=0.05 CHECKS=11019	UNSAT TT=0.834 ASSIGNMENTS=0	UNSAT TT=0.702 ASSIGNMENTS=0	UNSAT TT=0.636 CHECKS=4630 NODES=40	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.041 ASSIGNMENTS=147 CHECKS=14002	UNSAT TT=0.038 ASSIGNMENTS=147 CHECKS=14002	UNSAT TT=0.979	UNSAT TT=0.907	No data	UNSAT TT=0.025 ASSIGNMENTS=150 CHECKS=14109	UNSAT TT=0.147 ASSIGNMENTS=4484 CHECKS=474271	UNSAT TT=0.808	UNSAT TT=0.032 ASSIGNMENTS=315 CHECKS=32076	UNSAT TT=0.028 ASSIGNMENTS=147 CHECKS=14002	UNSAT TT=1.796	UNSAT TT=0.08 ASSIGNMENTS=98 CHECKS=56023	UNSAT TT=0.916	UNSAT TT=1.006
csp/QCP-10/ normalized-qcp-10-67-13_ext.xml	UNSAT TT=0.022	UNSAT TT=1.005 CHECKS=3248 NODES=0	UNSAT TT=0.906 CHECKS=3248 NODES=0	UNSAT TT=0.101	UNSAT TT=0.057 CHECKS=12384	UNSAT TT=0.042 CHECKS=6609	UNSAT TT=0.81 ASSIGNMENTS=0	UNSAT TT=0.622 ASSIGNMENTS=0	UNSAT TT=0.632 CHECKS=5626 NODES=60	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.977	UNSAT TT=0.996	No data	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.675	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.307	UNSAT TT=0.059 ASSIGNMENTS=47 CHECKS=41092	UNSAT TT=1.089	UNSAT TT=1.201
csp/QCP-10/ normalized-qcp-10-67-14_ext.xml	UNSAT TT=0.022	UNSAT TT=0.867 CHECKS=3258 NODES=0	UNSAT TT=1.036 CHECKS=3258 NODES=0	UNSAT TT=2.759	UNSAT TT=0.072 CHECKS=24253	UNSAT TT=0.045 CHECKS=5870	UNSAT TT=0.609 ASSIGNMENTS=0	UNSAT TT=0.66 ASSIGNMENTS=0	UNSAT TT=0.617 CHECKS=4349 NODES=28	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=0.036 ASSIGNMENTS=21 CHECKS=2508	UNSAT TT=0.035 ASSIGNMENTS=21 CHECKS=2508	UNSAT TT=0.999	UNSAT TT=1.131	No data	UNSAT TT=0.024 ASSIGNMENTS=27 CHECKS=3048	UNSAT TT=0.144 ASSIGNMENTS=4599 CHECKS=407591	UNSAT TT=0.674	UNSAT TT=0.029 ASSIGNMENTS=276 CHECKS=26418	UNSAT TT=0.022 ASSIGNMENTS=21 CHECKS=2508	UNSAT TT=1.395	UNSAT TT=0.061 ASSIGNMENTS=62 CHECKS=46069	UNSAT TT=0.938	UNSAT TT=1.027
csp/QCP-10/ normalized-qcp-10-67-1_ext.xml	SAT TT=0.024	SAT TT=0.962 CHECKS=7966 NODES=102	SAT TT=0.915 CHECKS=7867 NODES=0	SAT TT=0.11	SAT TT=0.061 CHECKS=14587	SAT TT=0.041 CHECKS=3386	SAT TT=1.095 ASSIGNMENTS=25	SAT TT=1.038 ASSIGNMENTS=19	SAT TT=0.665 CHECKS=5261 NODES=103	SAT TT=0.687 CHECKS=23009 NODES=140	SAT TT=0.677 CHECKS=77767 NODES=135	SAT TT=0.036 ASSIGNMENTS=24 CHECKS=2354	SAT TT=0.036 ASSIGNMENTS=24 CHECKS=2354	SAT TT=1.598	SAT TT=1.71	No data	SAT TT=0.025 ASSIGNMENTS=24 CHECKS=2354	SAT TT=0.028 ASSIGNMENTS=105 CHECKS=12586	SAT TT=0.667	SAT TT=0.027 ASSIGNMENTS=72 CHECKS=7360	SAT TT=0.024 ASSIGNMENTS=24 CHECKS=2354	SAT TT=1.247	SAT TT=0.062 ASSIGNMENTS=100 CHECKS=44400	SAT TT=1.14	SAT TT=1.481
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-10/ normalized-qcp-10-67-2_ext.xml	SAT TT=0.023	SAT TT=0.963 CHECKS=7583 NODES=100	SAT TT=0.914 CHECKS=7702 NODES=0	SAT TT=0.109	SAT TT=0.06 CHECKS=14122	SAT TT=0.039 CHECKS=3327	SAT TT=1.065 ASSIGNMENTS=18	SAT TT=1.17 ASSIGNMENTS=16	SAT TT=0.777 CHECKS=5314 NODES=106	SAT TT=0.683 CHECKS=31100 NODES=288	SAT TT=0.686 CHECKS=105791 NODES=233	SAT TT=0.037 ASSIGNMENTS=25 CHECKS=2237	SAT TT=0.035 ASSIGNMENTS=25 CHECKS=2237	SAT TT=1.581	SAT TT=1.62	No data	SAT TT=0.023 ASSIGNMENTS=25 CHECKS=2237	SAT TT=0.027 ASSIGNMENTS=81 CHECKS=11280	SAT TT=0.707	SAT TT=0.025 ASSIGNMENTS=49 CHECKS=4932	SAT TT=0.025 ASSIGNMENTS=25 CHECKS=2237	SAT TT=1.322	SAT TT=0.064 ASSIGNMENTS=101 CHECKS=45899	SAT TT=1.285	SAT TT=1.162
csp/QCP-10/ normalized-qcp-10-67-3_ext.xml	SAT TT=0.025	SAT TT=0.967 CHECKS=7774 NODES=102	SAT TT=1.002 CHECKS=14811 NODES=113	SAT TT=0.106	SAT TT=0.06 CHECKS=15199	SAT TT=0.041 CHECKS=3064	SAT TT=0.988 ASSIGNMENTS=23	SAT TT=1.052 ASSIGNMENTS=22	SAT TT=0.63 CHECKS=5453 NODES=109	SAT TT=0.799 CHECKS=27085 NODES=224	SAT TT=0.682 CHECKS=120121 NODES=252	SAT TT=0.037 ASSIGNMENTS=118 CHECKS=12066	SAT TT=0.038 ASSIGNMENTS=118 CHECKS=12066	SAT TT=1.581	SAT TT=1.619	No data	SAT TT=0.025 ASSIGNMENTS=68 CHECKS=7250	SAT TT=0.032 ASSIGNMENTS=294 CHECKS=30048	SAT TT=0.873	SAT TT=0.028 ASSIGNMENTS=172 CHECKS=18039	SAT TT=0.026 ASSIGNMENTS=118 CHECKS=12066	SAT TT=1.407	SAT TT=0.062 ASSIGNMENTS=100 CHECKS=44652	SAT TT=1.108	SAT TT=1.033
csp/QCP-10/ normalized-qcp-10-67-4_ext.xml	SAT TT=0.027	SAT TT=0.962 CHECKS=8036 NODES=103	SAT TT=0.951 CHECKS=9535 NODES=0	SAT TT=0.099	SAT TT=0.058 CHECKS=16410	SAT TT=0.042 CHECKS=4222	SAT TT=1.011 ASSIGNMENTS=27	SAT TT=1.112 ASSIGNMENTS=25	SAT TT=0.675 CHECKS=5597 NODES=107	SAT TT=0.658 CHECKS=25340 NODES=181	SAT TT=0.634 CHECKS=104232 NODES=248	SAT TT=0.096 ASSIGNMENTS=2094 CHECKS=201460	SAT TT=0.097 ASSIGNMENTS=2094 CHECKS=201460	SAT TT=1.631	SAT TT=1.588	No data	SAT TT=0.073 ASSIGNMENTS=2009 CHECKS=181849	SAT TT=0.027 ASSIGNMENTS=108 CHECKS=14869	SAT TT=0.82	SAT TT=0.027 ASSIGNMENTS=49 CHECKS=5219	SAT TT=0.081 ASSIGNMENTS=2094 CHECKS=201460	SAT TT=1.241	SAT TT=0.058 ASSIGNMENTS=102 CHECKS=45139	SAT TT=1.152	SAT TT=1.336
csp/QCP-10/ normalized-qcp-10-67-5_ext.xml	SAT TT=0.024	SAT TT=0.936 CHECKS=7669 NODES=101	SAT TT=0.93 CHECKS=9196 NODES=0	SAT TT=0.106	SAT TT=0.058 CHECKS=13480	SAT TT=0.04 CHECKS=3494	SAT TT=0.966 ASSIGNMENTS=17	SAT TT=0.987 ASSIGNMENTS=23	SAT TT=0.652 CHECKS=5330 NODES=107	SAT TT=0.668 CHECKS=24709 NODES=184	SAT TT=0.703 CHECKS=158421 NODES=374	SAT TT=0.036 ASSIGNMENTS=26 CHECKS=2639	SAT TT=0.037 ASSIGNMENTS=26 CHECKS=2639	SAT TT=1.803	SAT TT=1.776	No data	SAT TT=0.024 ASSIGNMENTS=29 CHECKS=2748	SAT TT=0.027 ASSIGNMENTS=73 CHECKS=9987	SAT TT=0.693	SAT TT=0.03 ASSIGNMENTS=253 CHECKS=26126	SAT TT=0.025 ASSIGNMENTS=26 CHECKS=2639	SAT TT=1.309	SAT TT=0.057 ASSIGNMENTS=101 CHECKS=45072	SAT TT=1.025	SAT TT=1.227
csp/QCP-10/ normalized-qcp-10-67-6_ext.xml	SAT TT=0.024	SAT TT=1.007 CHECKS=21395 NODES=318	SAT TT=1.059 CHECKS=22775 NODES=203	SAT TT=0.101	SAT TT=0.062 CHECKS=17693	SAT TT=0.042 CHECKS=3780	SAT TT=0.999 ASSIGNMENTS=25	SAT TT=1.029 ASSIGNMENTS=28	SAT TT=0.67 CHECKS=6232 NODES=130	SAT TT=0.792 CHECKS=38727 NODES=380	SAT TT=0.682 CHECKS=65245 NODES=109	SAT TT=0.036 ASSIGNMENTS=33 CHECKS=2506	SAT TT=0.036 ASSIGNMENTS=33 CHECKS=2506	SAT TT=1.713	SAT TT=1.48	No data	SAT TT=0.024 ASSIGNMENTS=33 CHECKS=2506	SAT TT=0.026 ASSIGNMENTS=60 CHECKS=8529	SAT TT=0.681	SAT TT=0.027 ASSIGNMENTS=143 CHECKS=14283	SAT TT=0.026 ASSIGNMENTS=33 CHECKS=2506	SAT TT=1.251	SAT TT=0.063 ASSIGNMENTS=101 CHECKS=44975	SAT TT=1.165	SAT TT=1.138
csp/QCP-10/ normalized-qcp-10-67-7_ext.xml	SAT TT=0.024	SAT TT=0.973 CHECKS=8333 NODES=113	SAT TT=0.962 CHECKS=17078 NODES=100	SAT TT=0.119	SAT TT=0.072 CHECKS=26224	SAT TT=0.043 CHECKS=5693	SAT TT=1.09 ASSIGNMENTS=27	SAT TT=0.997 ASSIGNMENTS=20	SAT TT=0.612 CHECKS=5490 NODES=107	SAT TT=0.664 CHECKS=38060 NODES=395	SAT TT=0.689 CHECKS=104691 NODES=202	SAT TT=0.037 ASSIGNMENTS=45 CHECKS=4501	SAT TT=0.037 ASSIGNMENTS=45 CHECKS=4501	SAT TT=1.485	SAT TT=1.734	No data	SAT TT=0.025 ASSIGNMENTS=84 CHECKS=7542	SAT TT=0.026 ASSIGNMENTS=16 CHECKS=2073	SAT TT=0.843	SAT TT=0.028 ASSIGNMENTS=151 CHECKS=16169	SAT TT=0.024 ASSIGNMENTS=45 CHECKS=4501	SAT TT=1.329	SAT TT=0.061 ASSIGNMENTS=100 CHECKS=44742	SAT TT=1.175	SAT TT=0.977
csp/QCP-10/ normalized-qcp-10-67-8_ext.xml	SAT TT=0.023	SAT TT=0.956 CHECKS=7755 NODES=100	SAT TT=1.133 CHECKS=16331 NODES=108	SAT TT=0.11	SAT TT=0.07 CHECKS=23734	SAT TT=0.043 CHECKS=6398	SAT TT=1.023 ASSIGNMENTS=28	SAT TT=1.15 ASSIGNMENTS=18	SAT TT=0.631 CHECKS=5897 NODES=129	SAT TT=0.688 CHECKS=27572 NODES=208	SAT TT=0.674 CHECKS=70595 NODES=132	SAT TT=0.036 ASSIGNMENTS=28 CHECKS=2551	SAT TT=0.036 ASSIGNMENTS=28 CHECKS=2551	SAT TT=1.489	SAT TT=1.677	No data	SAT TT=0.024 ASSIGNMENTS=28 CHECKS=2551	SAT TT=0.032 ASSIGNMENTS=166 CHECKS=20046	SAT TT=0.847	SAT TT=0.026 ASSIGNMENTS=120 CHECKS=11940	SAT TT=0.023 ASSIGNMENTS=28 CHECKS=2551	SAT TT=1.322	SAT TT=0.063 ASSIGNMENTS=100 CHECKS=45030	SAT TT=1.161	SAT TT=1.023
csp/QCP-10/ normalized-qcp-10-67-9_ext.xml	SAT TT=0.026	SAT TT=0.973 CHECKS=7768 NODES=100	SAT TT=1.008 CHECKS=17363 NODES=108	SAT TT=0.107	SAT TT=0.081 CHECKS=34024	SAT TT=0.049 CHECKS=10292	SAT TT=1.036 ASSIGNMENTS=19	SAT TT=1.17 ASSIGNMENTS=17	SAT TT=0.659 CHECKS=9469 NODES=229	SAT TT=0.675 CHECKS=29872 NODES=247	SAT TT=0.69 CHECKS=72531 NODES=124	SAT TT=0.037 ASSIGNMENTS=36 CHECKS=3355	SAT TT=0.037 ASSIGNMENTS=36 CHECKS=3355	SAT TT=1.504	SAT TT=1.638	No data	SAT TT=0.026 ASSIGNMENTS=35 CHECKS=3212	SAT TT=0.026 ASSIGNMENTS=117 CHECKS=11343	SAT TT=0.693	SAT TT=0.03 ASSIGNMENTS=228 CHECKS=22666	SAT TT=0.026 ASSIGNMENTS=36 CHECKS=3355	SAT TT=1.407	SAT TT=0.061 ASSIGNMENTS=100 CHECKS=45020	SAT TT=0.994	SAT TT=0.982
csp/QCP-15/ normalized-qcp-15-120-0_ext.xml	SAT TT=0.164	SAT TT=1.485 CHECKS=189507 NODES=2100	SAT TT=1.398 CHECKS=148143 NODES=1429	SAT TT=0.487	SAT TT=0.942 CHECKS=566342	SAT TT=0.164 CHECKS=49748	SAT TT=2.562 ASSIGNMENTS=27	SAT TT=2.405 ASSIGNMENTS=22	SAT TT=2.509 CHECKS=65931 NODES=1181	SAT TT=1.753 CHECKS=604792 NODES=7337	SAT TT=1.791 CHECKS=1944370 NODES=2601	SAT TT=9.372 ASSIGNMENTS=27	SAT TT=9.33 ASSIGNMENTS=2100 CHECKS=189507	SAT TT=2.561	SAT TT=2.503	No data	SAT TT=2.053 ASSIGNMENTS=27436 CHECKS=8057580	SAT TT=0.29 ASSIGNMENTS=6077 CHECKS=920873	SAT TT=6.021	SAT TT=0.598 ASSIGNMENTS=7159 CHECKS=2204480	SAT TT=1.543 ASSIGNMENTS=20153 CHECKS=6217020	SAT TT=3.191	SAT TT=1.729 ASSIGNMENTS=5002 CHECKS=1406630	SAT TT=1.37	SAT TT=1.526
csp/QCP-15/ normalized-qcp-15-120-10_ext.xml	UNSAT TT=0.855	UNSAT TT=68.126 CHECKS=68894600 NODES=422203	UNSAT TT=81.098 CHECKS=75128700 NODES=444833	UNSAT TT=196.516	UNSAT TT=927.338 CHECKS=764965000	UNSAT TT=246.16 CHECKS=227269000	UNSAT TT=0.855 ASSIGNMENTS=0	UNSAT TT=0.914 ASSIGNMENTS=0	UNSAT TT=689.474 CHECKS=36151400 NODES=820062	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=8.754 ASSIGNMENTS=0	UNSAT TT=77.366 ASSIGNMENTS=422203 CHECKS=68894600	UNSAT TT=1.8	UNSAT TT=1.917	No data	UNSAT TT=6.233 ASSIGNMENTS=114695 CHECKS=25015600	UNSAT TT=2.846 ASSIGNMENTS=51484 CHECKS=11391500	UNSAT TT=57.083	UNSAT TT=2.844 ASSIGNMENTS=51074 CHECKS=11412000	UNSAT TT=22.171 ASSIGNMENTS=295614 CHECKS=87749900	UNSAT TT=3.067	UNSAT TT=978.191 ASSIGNMENTS=4124300 CHECKS=1017790000	UNSAT TT=1.314	UNSAT TT=1.798
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-15/ normalized-qcp-15-120-11_ext.xml	UNSAT TT=0.069	UNSAT TT=1.263 CHECKS=54673 NODES=497	UNSAT TT=1.321 CHECKS=81068 NODES=539	UNSAT TT=18.225	UNSAT TT=0.336 CHECKS=120858	UNSAT TT=0.177 CHECKS=36111	UNSAT TT=0.868 ASSIGNMENTS=0	UNSAT TT=0.872 ASSIGNMENTS=0	UNSAT TT=1.53 CHECKS=18914 NODES=36	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=8.401 ASSIGNMENTS=0	UNSAT TT=8.934 ASSIGNMENTS=497 CHECKS=54673	UNSAT TT=1.705	UNSAT TT=1.671	No data	UNSAT TT=0.069 ASSIGNMENTS=193 CHECKS=30906	UNSAT TT=0.265 ASSIGNMENTS=4750 CHECKS=805375	UNSAT TT=1.644	UNSAT TT=0.074 ASSIGNMENTS=431 CHECKS=71014	UNSAT TT=66.288 ASSIGNMENTS=808430 CHECKS=280336000	UNSAT TT=2.605	UNSAT TT=0.256 ASSIGNMENTS=180 CHECKS=235109	UNSAT TT=1.361	UNSAT TT=1.477
csp/QCP-15/ normalized-qcp-15-120-12_ext.xml	UNSAT TT=0.065	UNSAT TT=1.082 CHECKS=15538 NODES=0	UNSAT TT=1.153 CHECKS=15538 NODES=0	UNSAT TT=269.804	UNSAT TT=0.306 CHECKS=118616	UNSAT TT=0.2 CHECKS=37815	UNSAT TT=0.858 ASSIGNMENTS=0	UNSAT TT=0.848 ASSIGNMENTS=0	UNSAT TT=1.556 CHECKS=18113 NODES=65	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=0.071 ASSIGNMENTS=139 CHECKS=16485	UNSAT TT=0.079 ASSIGNMENTS=139 CHECKS=16485	UNSAT TT=1.693	UNSAT TT=1.637	No data	UNSAT TT=0.065 ASSIGNMENTS=179 CHECKS=20669	UNSAT TT=0.244 ASSIGNMENTS=5392 CHECKS=791596	UNSAT TT=1.667	UNSAT TT=0.085 ASSIGNMENTS=893 CHECKS=116867	UNSAT TT=0.068 ASSIGNMENTS=139 CHECKS=16485	UNSAT TT=2.63	UNSAT TT=0.335 ASSIGNMENTS=369 CHECKS=384177	UNSAT TT=1.316	UNSAT TT=1.422
csp/QCP-15/ normalized-qcp-15-120-13_ext.xml	UNSAT TT=1.671	UNSAT TT=29.813 CHECKS=30937800 NODES=165801	UNSAT TT=17.16 CHECKS=16417600 NODES=92199	UNSAT TT=98.304	UNSAT TT=338.257 CHECKS=281322000	UNSAT TT=88.296 CHECKS=80225600	UNSAT TT=2.125 ASSIGNMENTS=0	UNSAT TT=2.182 ASSIGNMENTS=0	UNSAT TT=150.956 CHECKS=8564360 NODES=176439	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=9.718 ASSIGNMENTS=0	UNSAT TT=38.444 ASSIGNMENTS=165801 CHECKS=30937800	UNSAT TT=2.003	UNSAT TT=1.816	No data	UNSAT TT=6.288 ASSIGNMENTS=72751 CHECKS=25324200	UNSAT TT=12.449 ASSIGNMENTS=150850 CHECKS=50530200	UNSAT TT=156.892	UNSAT TT=18.691 ASSIGNMENTS=237628 CHECKS=79574600	UNSAT TT=8.021 ASSIGNMENTS=97193 CHECKS=32937500	UNSAT TT=3.186	UNSAT TT=173.665 ASSIGNMENTS=869150 CHECKS=312800000	UNSAT TT=1.746	UNSAT TT=1.671
csp/QCP-15/ normalized-qcp-15-120-14_ext.xml	UNSAT TT=0.066	UNSAT TT=1.333 CHECKS=80695 NODES=803	UNSAT TT=1.441 CHECKS=79108 NODES=517	UNSAT TT=64.267	UNSAT TT=0.392 CHECKS=143943	UNSAT TT=0.575 CHECKS=336466	UNSAT TT=0.975 ASSIGNMENTS=0	UNSAT TT=0.867 ASSIGNMENTS=0	UNSAT TT=1.643 CHECKS=22826 NODES=116	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.081 ASSIGNMENTS=175 CHECKS=24725	UNSAT TT=0.078 ASSIGNMENTS=175 CHECKS=24725	UNSAT TT=1.751	UNSAT TT=1.625	No data	UNSAT TT=0.066 ASSIGNMENTS=178 CHECKS=26271	UNSAT TT=0.249 ASSIGNMENTS=5044 CHECKS=734442	UNSAT TT=1.942	UNSAT TT=0.082 ASSIGNMENTS=571 CHECKS=84924	UNSAT TT=0.066 ASSIGNMENTS=175 CHECKS=24725	UNSAT TT=2.492	UNSAT TT=0.241 ASSIGNMENTS=192 CHECKS=235794	UNSAT TT=1.373	UNSAT TT=1.497
csp/QCP-15/ normalized-qcp-15-120-1_ext.xml	SAT TT=0.096	SAT TT=1.518 CHECKS=222886 NODES=2456	SAT TT=1.553 CHECKS=211142 NODES=1960	SAT TT=8.076	SAT TT=1.426 CHECKS=838157	SAT TT=0.299 CHECKS=176181	SAT TT=2.821 ASSIGNMENTS=87	SAT TT=2.671 ASSIGNMENTS=40	SAT TT=4.585 CHECKS=184388 NODES=3400	SAT TT=1.617 CHECKS=282696 NODES=3280	SAT TT=2.108 CHECKS=2556870 NODES=3189	SAT TT=0.116 ASSIGNMENTS=437 CHECKS=139504	SAT TT=0.111 ASSIGNMENTS=437 CHECKS=139504	SAT TT=2.605	SAT TT=2.565	No data	SAT TT=0.11 ASSIGNMENTS=602 CHECKS=201213	SAT TT=0.292 ASSIGNMENTS=5020 CHECKS=893730	SAT TT=124.507	SAT TT=0.109 ASSIGNMENTS=761 CHECKS=194113	SAT TT=0.096 ASSIGNMENTS=437 CHECKS=139504	SAT TT=3.123	SAT TT=0.69 ASSIGNMENTS=2577 CHECKS=627411	SAT TT=1.483	SAT TT=1.51
csp/QCP-15/ normalized-qcp-15-120-2_ext.xml	SAT TT=0.298	SAT TT=1.785 CHECKS=395998 NODES=3709	SAT TT=10.585 CHECKS=9043460 NODES=64907	SAT TT=0.617	SAT TT=33.879 CHECKS=24148300	SAT TT=0.613 CHECKS=359549	SAT TT=2.523 ASSIGNMENTS=17	SAT TT=2.621 ASSIGNMENTS=19	SAT TT=3.167 CHECKS=100270 NODES=1856	SAT TT=1.88 CHECKS=1005300 NODES=12785	SAT TT=3.166 CHECKS=9988960 NODES=9645	SAT TT=10.572 ASSIGNMENTS=17	SAT TT=11.98 ASSIGNMENTS=87418 CHECKS=19454300	SAT TT=2.61	SAT TT=2.554	No data	SAT TT=2.924 ASSIGNMENTS=52118 CHECKS=11976600	SAT TT=0.298 ASSIGNMENTS=5898 CHECKS=982607	SAT TT=20.78	SAT TT=3.571 ASSIGNMENTS=67370 CHECKS=13278400	SAT TT=4.692 ASSIGNMENTS=87418 CHECKS=19454300	SAT TT=2.827	SAT TT=2.299 ASSIGNMENTS=14225 CHECKS=3243460	SAT TT=1.357	SAT TT=1.749
csp/QCP-15/ normalized-qcp-15-120-3_ext.xml	SAT TT=0.089	SAT TT=4.12 CHECKS=2768200 NODES=18180	SAT TT=1.869 CHECKS=377772 NODES=3508	SAT TT=25.651	SAT TT=0.265 CHECKS=98287	SAT TT=0.158 CHECKS=30306	SAT TT=2.658 ASSIGNMENTS=22	SAT TT=2.617 ASSIGNMENTS=26	SAT TT=13.745 CHECKS=762223 NODES=16089	SAT TT=2.106 CHECKS=984197 NODES=12860	SAT TT=2.064 CHECKS=3632730 NODES=4371	SAT TT=0.106 ASSIGNMENTS=351 CHECKS=120599	SAT TT=0.107 ASSIGNMENTS=351 CHECKS=120599	SAT TT=2.758	SAT TT=2.439	No data	SAT TT=0.167 ASSIGNMENTS=1224 CHECKS=429617	SAT TT=8.377 ASSIGNMENTS=132785 CHECKS=33829300	SAT TT=11.585	SAT TT=0.937 ASSIGNMENTS=10250 CHECKS=3412800	SAT TT=0.089 ASSIGNMENTS=351 CHECKS=120599	SAT TT=2.843	SAT TT=0.261 ASSIGNMENTS=411 CHECKS=253294	SAT TT=1.502	SAT TT=1.884
csp/QCP-15/ normalized-qcp-15-120-4_ext.xml	SAT TT=0.066	SAT TT=1.824 CHECKS=457461 NODES=4186	SAT TT=1.693 CHECKS=365624 NODES=2757	SAT TT=85.144	SAT TT=0.817 CHECKS=502288	SAT TT=1.022 CHECKS=706131	SAT TT=3.191 ASSIGNMENTS=167	SAT TT=2.291 ASSIGNMENTS=18	SAT TT=2.827 CHECKS=86780 NODES=1563	SAT TT=3.794 CHECKS=6303240 NODES=84151	? (TO) TT=1800.08	SAT TT=0.076 ASSIGNMENTS=165 CHECKS=31018	SAT TT=0.081 ASSIGNMENTS=165 CHECKS=31018	SAT TT=2.506	SAT TT=2.547	No data	SAT TT=0.394 ASSIGNMENTS=4066 CHECKS=1298560	SAT TT=0.393 ASSIGNMENTS=6544 CHECKS=1430490	SAT TT=5.526	SAT TT=1.423 ASSIGNMENTS=15871 CHECKS=5448940	SAT TT=0.066 ASSIGNMENTS=165 CHECKS=31018	SAT TT=3.019	SAT TT=2.776 ASSIGNMENTS=9219 CHECKS=3201800	SAT TT=1.405	SAT TT=1.782
csp/QCP-15/ normalized-qcp-15-120-5_ext.xml	SAT TT=0.367	SAT TT=2.204 CHECKS=810869 NODES=5495	SAT TT=10.015 CHECKS=8119460 NODES=50490	SAT TT=0.367	SAT TT=14.96 CHECKS=10200600	SAT TT=8.273 CHECKS=7781820	SAT TT=3.451 ASSIGNMENTS=62	SAT TT=3.083 ASSIGNMENTS=26	SAT TT=30.152 CHECKS=1758240 NODES=33141	SAT TT=8.387 CHECKS=17303400 NODES=244991	SAT TT=1.661 CHECKS=588870 NODES=1002	SAT TT=10.394 ASSIGNMENTS=62	SAT TT=9.892 ASSIGNMENTS=5495 CHECKS=810869	SAT TT=2.598	SAT TT=2.963	No data	SAT TT=11.554 ASSIGNMENTS=140271 CHECKS=50270700	SAT TT=1.229 ASSIGNMENTS=15737 CHECKS=4843560	SAT TT=1315.66	SAT TT=5.147 ASSIGNMENTS=55178 CHECKS=20607700	SAT TT=9.578 ASSIGNMENTS=116993 CHECKS=42085400	SAT TT=3.454	SAT TT=69.82 ASSIGNMENTS=338940 CHECKS=94993700	SAT TT=1.611	SAT TT=2.111
csp/QCP-15/ normalized-qcp-15-120-6_ext.xml	SAT TT=0.465	SAT TT=1.776 CHECKS=417725 NODES=3570	SAT TT=1.886 CHECKS=383716 NODES=3193	SAT TT=19.578	SAT TT=2.197 CHECKS=1401790	SAT TT=0.465 CHECKS=307968	SAT TT=2.689 ASSIGNMENTS=67	SAT TT=2.606 ASSIGNMENTS=32	SAT TT=2.841 CHECKS=86326 NODES=1794	SAT TT=1.915 CHECKS=1086130 NODES=14291	SAT TT=2.794 CHECKS=8723290 NODES=9058	SAT TT=1.374 ASSIGNMENTS=18111 CHECKS=5384810	SAT TT=1.514 ASSIGNMENTS=18111 CHECKS=5384810	SAT TT=2.458	SAT TT=2.579	No data	SAT TT=1.957 ASSIGNMENTS=23710 CHECKS=8258540	SAT TT=0.632 ASSIGNMENTS=9160 CHECKS=2191040	SAT TT=1.811	SAT TT=2.117 ASSIGNMENTS=26306 CHECKS=8026020	SAT TT=1.335 ASSIGNMENTS=18111 CHECKS=5384810	SAT TT=2.666	SAT TT=7.983 ASSIGNMENTS=31231 CHECKS=7469300	SAT TT=1.441	SAT TT=1.624
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-15/ normalized-qcp-15-120-7_ext.xml	SAT TT=0.384	SAT TT=1.568 CHECKS=263854 NODES=2427	SAT TT=1.446 CHECKS=172508 NODES=1414	SAT TT=0.97	SAT TT=9.276 CHECKS=6340330	SAT TT=1.158 CHECKS=908072	SAT TT=2.781 ASSIGNMENTS=40	SAT TT=2.809 ASSIGNMENTS=44	SAT TT=1.804 CHECKS=31917 NODES=458	SAT TT=1.755 CHECKS=173516 NODES=1788	SAT TT=1.969 CHECKS=3075520 NODES=4321	SAT TT=1.26 ASSIGNMENTS=13200 CHECKS=4459210	SAT TT=1.258 ASSIGNMENTS=13200 CHECKS=4459210	SAT TT=2.709	SAT TT=2.582	No data	SAT TT=0.813 ASSIGNMENTS=10788 CHECKS=3171960	SAT TT=0.684 ASSIGNMENTS=9831 CHECKS=2373610	SAT TT=53.567	SAT TT=1.411 ASSIGNMENTS=15828 CHECKS=5164040	SAT TT=1.203 ASSIGNMENTS=13200 CHECKS=4459210	SAT TT=2.922	SAT TT=9.665 ASSIGNMENTS=54258 CHECKS=13817100	SAT TT=1.435	SAT TT=1.482
csp/QCP-15/ normalized-qcp-15-120-8_ext.xml	SAT TT=0.255	SAT TT=2.542 CHECKS=1295610 NODES=9088	SAT TT=1.868 CHECKS=560127 NODES=4085	SAT TT=15.666	SAT TT=2.318 CHECKS=1538240	SAT TT=1.049 CHECKS=881616	SAT TT=2.606 ASSIGNMENTS=42	SAT TT=2.498 ASSIGNMENTS=26	SAT TT=2.125 CHECKS=45436 NODES=834	SAT TT=2.055 CHECKS=1241460 NODES=16130	SAT TT=2.332 CHECKS=5588600 NODES=5826	SAT TT=0.259 ASSIGNMENTS=2060 CHECKS=804545	SAT TT=0.258 ASSIGNMENTS=2060 CHECKS=804545	SAT TT=2.624	SAT TT=2.629	No data	SAT TT=0.297 ASSIGNMENTS=2359 CHECKS=958233	SAT TT=0.522 ASSIGNMENTS=7929 CHECKS=1814400	SAT TT=33.836	SAT TT=2.2 ASSIGNMENTS=26530 CHECKS=8919850	SAT TT=0.255 ASSIGNMENTS=2060 CHECKS=804545	SAT TT=3.191	SAT TT=0.711 ASSIGNMENTS=1749 CHECKS=499081	SAT TT=1.45	SAT TT=1.535
csp/QCP-15/ normalized-qcp-15-120-9_ext.xml	SAT TT=1.303	SAT TT=12.64 CHECKS=11213100 NODES=71894	SAT TT=6.327 CHECKS=4588480 NODES=24366	SAT TT=108.657	SAT TT=4.641 CHECKS=2966030	SAT TT=15.418 CHECKS=13318100	SAT TT=2.754 ASSIGNMENTS=29	SAT TT=2.718 ASSIGNMENTS=6	SAT TT=2.997 CHECKS=99776 NODES=1809	SAT TT=26.488 CHECKS=65705000 NODES=903393	? (TO) TT=1800	SAT TT=10.403 ASSIGNMENTS=29	SAT TT=19.644 ASSIGNMENTS=71894 CHECKS=11213100	SAT TT=2.617	SAT TT=2.568	No data	SAT TT=58.625 ASSIGNMENTS=808661 CHECKS=227102000	SAT TT=1.303 ASSIGNMENTS=16405 CHECKS=5035400	? (TO) TT=1800.11	SAT TT=9.282 ASSIGNMENTS=108559 CHECKS=35135000	SAT TT=83.526 ASSIGNMENTS=1146480 CHECKS=356217000	SAT TT=3.457	SAT TT=716.602 ASSIGNMENTS=1850280 CHECKS=459937000	SAT TT=1.531	SAT TT=1.638
csp/QCP-20/ normalized-qcp-20-187-0_ext.xml	SAT TT=3.689	SAT TT=86.178 CHECKS=71044700 NODES=296824	SAT TT=68.355 CHECKS=59193100 NODES=267618	? (TO) TT=1800.04	SAT TT=1559.42 CHECKS=750580000	? (TO) TT=1800.07	SAT TT=12.586 ASSIGNMENTS=308	SAT TT=7.945 ASSIGNMENTS=88	? (TO) TT=1800.08	SAT TT=35.998 CHECKS=63552400 NODES=661720	? (TO) TT=1800.06	SAT TT=15.179 ASSIGNMENTS=308	SAT TT=87.566 ASSIGNMENTS=296824 CHECKS=71044700	SAT TT=4.737	SAT TT=5.139	No data	SAT TT=371.034 ASSIGNMENTS=3413270 CHECKS=1544380000	SAT TT=3.689 ASSIGNMENTS=34612 CHECKS=15672000	? (TO) TT=1800.07	SAT TT=549.796 ASSIGNMENTS=5052710 CHECKS=2389460000	SAT TT=294.592 ASSIGNMENTS=2884700 CHECKS=1306400000	SAT TT=7.722	? (TO) TT=1800.1	SAT TT=4.273	SAT TT=7.71
csp/QCP-20/ normalized-qcp-20-187-10_ext.xml	UNSAT TT=5.808	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=196.177 ASSIGNMENTS=8438	UNSAT TT=88.792 ASSIGNMENTS=2468	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=67.933 ASSIGNMENTS=2434	UNSAT TT=734.904 ASSIGNMENTS=2434	UNSAT TT=5.808	UNSAT TT=20.349	No data	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=13.604	? (TO) TT=1800.1	UNSAT TT=9.165	UNSAT TT=9.768
csp/QCP-20/ normalized-qcp-20-187-11_ext.xml	UNSAT TT=0.201	UNSAT TT=4.086 CHECKS=1821240 NODES=9837	UNSAT TT=2.87 CHECKS=543852 NODES=3228	? (TO) TT=1800.1	UNSAT TT=3.116 CHECKS=1294710	UNSAT TT=1.484 CHECKS=240400	UNSAT TT=1.011 ASSIGNMENTS=0	UNSAT TT=1.213 ASSIGNMENTS=0	UNSAT TT=10.067 CHECKS=145949 NODES=2142	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=0.222 ASSIGNMENTS=2012 CHECKS=360868	UNSAT TT=0.223 ASSIGNMENTS=2012 CHECKS=360868	UNSAT TT=2.882	UNSAT TT=3.03	No data	UNSAT TT=0.224 ASSIGNMENTS=2069 CHECKS=390152	UNSAT TT=0.48 ASSIGNMENTS=7313 CHECKS=1482210	UNSAT TT=11.104	UNSAT TT=0.201 ASSIGNMENTS=1518 CHECKS=288165	UNSAT TT=0.216 ASSIGNMENTS=2012 CHECKS=360868	UNSAT TT=4.041	UNSAT TT=2.509 ASSIGNMENTS=1786 CHECKS=2862110	UNSAT TT=1.991	UNSAT TT=2.657
csp/QCP-20/ normalized-qcp-20-187-12_ext.xml	UNSAT TT=5.556	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=8.817 ASSIGNMENTS=3	UNSAT TT=8.318 ASSIGNMENTS=22	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=13.111 ASSIGNMENTS=170	UNSAT TT=679.857 ASSIGNMENTS=170	UNSAT TT=5.731	UNSAT TT=5.556	No data	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=10.037	? (TO) TT=1800.11	UNSAT TT=17.393	UNSAT TT=5.659
csp/QCP-20/ normalized-qcp-20-187-13_ext.xml	UNSAT TT=3.918	UNSAT TT=1004.12 CHECKS=850273000 NODES=3819070	UNSAT TT=1109.52 CHECKS=901767000 NODES=3912150	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=61.909 ASSIGNMENTS=2738	UNSAT TT=20.154 ASSIGNMENTS=364	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=73.849 ASSIGNMENTS=2808	UNSAT TT=737.606 ASSIGNMENTS=2808	UNSAT TT=4.708	UNSAT TT=3.918	No data	UNSAT TT=687.067 ASSIGNMENTS=6765400 CHECKS=2829090000	UNSAT TT=657.699 ASSIGNMENTS=6901810 CHECKS=2918940000	? (TO) TT=1800.08	UNSAT TT=389.174 ASSIGNMENTS=3747130 CHECKS=1573070000	UNSAT TT=749.406 ASSIGNMENTS=7567830 CHECKS=3147200000	UNSAT TT=6.871	? (TO) TT=1800.08	UNSAT TT=4.907	UNSAT TT=5.638
csp/QCP-20/ normalized-qcp-20-187-14_ext.xml	UNSAT TT=3.586	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=4.106 ASSIGNMENTS=0	UNSAT TT=4.118 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=11.324 ASSIGNMENTS=110	UNSAT TT=679.022 ASSIGNMENTS=110	UNSAT TT=5.341	UNSAT TT=3.625	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.11	UNSAT TT=5.31	? (TO) TT=1800.03	UNSAT TT=4.069	UNSAT TT=3.586
csp/QCP-20/ normalized-qcp-20-187-1_ext.xml	SAT TT=1.284	SAT TT=247.054 CHECKS=194819000 NODES=894042	SAT TT=106.901 CHECKS=86207800 NODES=361496	? (TO) TT=1800.09	SAT TT=1772.73 CHECKS=889563000	SAT TT=185.742 CHECKS=74609700	SAT TT=7.571 ASSIGNMENTS=30	SAT TT=7.366 ASSIGNMENTS=26	? (TO) TT=1800.09	SAT TT=98.953 CHECKS=191936000 NODES=1974040	? (TO) TT=1800.07	SAT TT=1.3 ASSIGNMENTS=12921 CHECKS=4654360	SAT TT=1.323 ASSIGNMENTS=12921 CHECKS=4654360	SAT TT=8.255	SAT TT=4.236	No data	SAT TT=3.046 ASSIGNMENTS=28113 CHECKS=11572400	SAT TT=31.858 ASSIGNMENTS=352100 CHECKS=134727000	? (TO) TT=1800.05	SAT TT=7.487 ASSIGNMENTS=85564 CHECKS=31309100	SAT TT=1.284 ASSIGNMENTS=12921 CHECKS=4654360	SAT TT=4.123	? (TO) TT=1800.08	SAT TT=2.718	SAT TT=2.805
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-20/ normalized-qcp-20-187-2_ext.xml	SAT TT=4.617	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=1354.15 CHECKS=504683000	SAT TT=15.658 ASSIGNMENTS=351	SAT TT=13.643 ASSIGNMENTS=213	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=30.475 ASSIGNMENTS=1028	SAT TT=699.321 ASSIGNMENTS=1028	SAT TT=6.022	SAT TT=7.225	No data	? (TO) TT=1800.06	SAT TT=735.499 ASSIGNMENTS=7282480 CHECKS=3353870000	? (TO) TT=1800.05	SAT TT=1371.13 ASSIGNMENTS=13209900 CHECKS=1456490000	SAT TT=997.939 ASSIGNMENTS=9104530 CHECKS=100722000	SAT TT=10.076	? (TO) TT=1800.1	SAT TT=8.19	SAT TT=4.617
csp/QCP-20/ normalized-qcp-20-187-3_ext.xml	SAT TT=4.797	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=10.955 ASSIGNMENTS=82	SAT TT=9.772 ASSIGNMENTS=34	? (TO) TT=1800.06	SAT TT=270.7 CHECKS=553253000 NODES=5810500	? (TO) TT=1800.08	SAT TT=32.802 ASSIGNMENTS=1154	SAT TT=702.01 ASSIGNMENTS=1154	SAT TT=5.648	SAT TT=4.965	No data	SAT TT=1087.8 ASSIGNMENTS=10250300 CHECKS=426425000	? (TO) TT=1800.08	? (TO) TT=1800.13	SAT TT=869.756 ASSIGNMENTS=7511240 CHECKS=3554840000	? (TO) TT=1800.04	SAT TT=7.375	? (TO) TT=1800.07	SAT TT=5.945	SAT TT=4.797
csp/QCP-20/ normalized-qcp-20-187-4_ext.xml	SAT TT=5.092	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=27.782 ASSIGNMENTS=1026	SAT TT=11.569 ASSIGNMENTS=172	? (TO) TT=1800.03	SAT TT=20.191 CHECKS=34876100 NODES=372428	? (TO) TT=1800.09	SAT TT=99.815 ASSIGNMENTS=4017	SAT TT=758.606 ASSIGNMENTS=4017	SAT TT=5.092	SAT TT=6.342	No data	? (TO) TT=1800.09	SAT TT=1495.3 ASSIGNMENTS=14166800 CHECKS=2472280000	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=8.3	? (TO) TT=1800.1	SAT TT=16.893	SAT TT=5.912
csp/QCP-20/ normalized-qcp-20-187-5_ext.xml	SAT TT=2.514	SAT TT=136.215 CHECKS=107969000 NODES=460722	SAT TT=611.783 CHECKS=534493000 NODES=2470600	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=6.896 CHECKS=1833940	SAT TT=10.422 ASSIGNMENTS=120	SAT TT=7.483 ASSIGNMENTS=24	? (TO) TT=1800.01	SAT TT=11.417 CHECKS=13794900 NODES=140757	? (TO) TT=1800.06	SAT TT=20.132 ASSIGNMENTS=521	SAT TT=129.725 ASSIGNMENTS=460722 CHECKS=107969000	SAT TT=4.403	SAT TT=4.24	No data	? (TO) TT=1800.07	SAT TT=50.736 ASSIGNMENTS=538921 CHECKS=208806000	? (TO) TT=1800.06	SAT TT=56.666 ASSIGNMENTS=582246 CHECKS=253759000	? (TO) TT=1800.02	SAT TT=4.905	? (TO) TT=1800.11	SAT TT=2.514	SAT TT=4.292
csp/QCP-20/ normalized-qcp-20-187-6_ext.xml	SAT TT=4.988	? (TO) TT=1800.1	SAT TT=1384.09 CHECKS=1230110000 NODES=4741160	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=1147.44 CHECKS=488402000	SAT TT=27.2 ASSIGNMENTS=1090	SAT TT=7.793 ASSIGNMENTS=63	? (TO) TT=1800.05	SAT TT=13.019 CHECKS=16341800 NODES=170729	? (TO) TT=1800.05	SAT TT=23.137 ASSIGNMENTS=807	SAT TT=691.743 ASSIGNMENTS=807	SAT TT=5.841	SAT TT=4.988	No data	SAT TT=37.453 ASSIGNMENTS=354247 CHECKS=167088000	SAT TT=956.689 ASSIGNMENTS=8572940 CHECKS=3994410000	? (TO) TT=1800.05	SAT TT=1425.12 ASSIGNMENTS=12144500 CHECKS=1324030000	SAT TT=135.171 ASSIGNMENTS=1126510 CHECKS=549540000	SAT TT=6.375	SAT TT=722.274 ASSIGNMENTS=2291300 CHECKS=709389000	SAT TT=7.797	SAT TT=10.33
csp/QCP-20/ normalized-qcp-20-187-7_ext.xml	SAT TT=3.473	SAT TT=1125.21 CHECKS=997941000 NODES=4322420	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=8.991 ASSIGNMENTS=131	SAT TT=8.906 ASSIGNMENTS=100	? (TO) TT=1800.03	SAT TT=31.612 CHECKS=53466000 NODES=564896	? (TO) TT=1800.01	SAT TT=11.663 ASSIGNMENTS=131	SAT TT=678.678 ASSIGNMENTS=131	SAT TT=6.406	SAT TT=6.537	No data	SAT TT=1511.79 ASSIGNMENTS=14831300 CHECKS=2128970000	SAT TT=138.199 ASSIGNMENTS=1300120 CHECKS=621673000	? (TO) TT=1800.08	SAT TT=1760.55 ASSIGNMENTS=16280500 CHECKS=3237210000	? (TO) TT=1800.04	SAT TT=4.966	SAT TT=1386.64 ASSIGNMENTS=5868380 CHECKS=1619470000	SAT TT=3.473	SAT TT=13.434
csp/QCP-20/ normalized-qcp-20-187-8_ext.xml	SAT TT=3.369	SAT TT=103.779 CHECKS=85623200 NODES=369967	SAT TT=3.97 CHECKS=1805770 NODES=10365	? (TO) TT=1800.02	SAT TT=148.427 CHECKS=77597100	SAT TT=1376.39 CHECKS=1311560000	SAT TT=8.46 ASSIGNMENTS=53	SAT TT=13.154 ASSIGNMENTS=228	SAT TT=396.684 CHECKS=11067600 NODES=192251	SAT TT=51.755 CHECKS=100310000 NODES=1038730	? (TO) TT=1800.04	SAT TT=13.966 ASSIGNMENTS=206	SAT TT=112.52 ASSIGNMENTS=369967 CHECKS=85623200	SAT TT=5.835	SAT TT=4.605	No data	SAT TT=301.348 ASSIGNMENTS=3260060 CHECKS=1260420000	SAT TT=7.867 ASSIGNMENTS=79487 CHECKS=32450600	? (TO) TT=1800.11	SAT TT=432.599 ASSIGNMENTS=3830550 CHECKS=1769440000	SAT TT=278.883 ASSIGNMENTS=2931480 CHECKS=1155290000	SAT TT=4.524	? (TO) TT=1800.04	SAT TT=3.712	SAT TT=3.369
csp/QCP-20/ normalized-qcp-20-187-9_ext.xml	SAT TT=1.527	SAT TT=771.553 CHECKS=643145000 NODES=2667110	SAT TT=5.795 CHECKS=3102290 NODES=15098	? (TO) TT=1800.04	SAT TT=18.857 CHECKS=8505560	SAT TT=788.028 CHECKS=260390000	SAT TT=7.727 ASSIGNMENTS=78	SAT TT=8.76 ASSIGNMENTS=153	? (TO) TT=1800.03	SAT TT=7.235 CHECKS=4154440 NODES=42970	? (TO) TT=1800	SAT TT=17.289 ASSIGNMENTS=408	SAT TT=684.963 ASSIGNMENTS=408	SAT TT=4.688	SAT TT=4.577	No data	SAT TT=193.378 ASSIGNMENTS=2148000 CHECKS=864870000	SAT TT=150.446 ASSIGNMENTS=1164980 CHECKS=631978000	? (TO) TT=1800.03	SAT TT=1.527 ASSIGNMENTS=11480 CHECKS=5951810	SAT TT=207.332 ASSIGNMENTS=2193810 CHECKS=876188000	SAT TT=5.019	? (TO) TT=1800.07	SAT TT=3.738	SAT TT=3.993
csp/QCP-25/ normalized-qcp-25-264-0_ext.xml	SAT TT=31.548	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=489.462 ASSIGNMENTS=10433	SAT TT=94.367 ASSIGNMENTS=1329	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=482.805 ASSIGNMENTS=10433	SAT TT=1177.74 ASSIGNMENTS=10433	SAT TT=43.353	SAT TT=34.017	No data	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=31.548	? (TO) TT=1800.12	SAT TT=273.693	SAT TT=107.804
csp/QCP-25/ normalized-qcp-25-264-10_ext.xml	UNSAT TT=19.47	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=148.3 ASSIGNMENTS=2369	UNSAT TT=129.935 ASSIGNMENTS=1263	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.01	UNSAT TT=132.104 ASSIGNMENTS=2369	UNSAT TT=797.306 ASSIGNMENTS=2369	UNSAT TT=42.075	UNSAT TT=19.47	No data	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=86.44	? (TO) TT=1800.09	UNSAT TT=255.43	UNSAT TT=129.58
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-25/ normalized-qcp-25-264-11_ext.xml	UNSAT TT=0.356	UNSAT TT=1.828 CHECKS=102046 NODES=0	UNSAT TT=1.836 CHECKS=102046 NODES=0	? (TO) TT=1800.04	UNSAT TT=4.012 CHECKS=728022	UNSAT TT=5.96 CHECKS=342599	UNSAT TT=1.163 ASSIGNMENTS=0	UNSAT TT=1.177 ASSIGNMENTS=0	UNSAT TT=18.254 CHECKS=115324 NODES=244	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=0.383 ASSIGNMENTS=2674 CHECKS=613406	UNSAT TT=0.384 ASSIGNMENTS=2674 CHECKS=613406	UNSAT TT=5.264	UNSAT TT=6.896	No data	UNSAT TT=0.402 ASSIGNMENTS=2888 CHECKS=673016	UNSAT TT=0.615 ASSIGNMENTS=8328 CHECKS=1813620	UNSAT TT=44.034	UNSAT TT=0.711 ASSIGNMENTS=7921 CHECKS=1887400	UNSAT TT=0.356 ASSIGNMENTS=2674 CHECKS=613406	UNSAT TT=4.87	UNSAT TT=2.95 ASSIGNMENTS=1617 CHECKS=2890660	UNSAT TT=3.13	UNSAT TT=3.384
csp/QCP-25/ normalized-qcp-25-264-12_ext.xml	UNSAT TT=1.469	UNSAT TT=1465.74 CHECKS=1217050000 NODES=4495920	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=1.469 ASSIGNMENTS=0	UNSAT TT=1.483 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=9.137 ASSIGNMENTS=0	UNSAT TT=676.066 ASSIGNMENTS=0	UNSAT TT=5.694	UNSAT TT=5.498	No data	? (TO) TT=1800.08	UNSAT TT=793.615 ASSIGNMENTS=11236600 CHECKS=3780190000	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	UNSAT TT=5.014	? (TO) TT=1800.15	UNSAT TT=3.181	UNSAT TT=3.889
csp/QCP-25/ normalized-qcp-25-264-13_ext.xml	UNSAT TT=1.4	? (TO) TT=1800.1	UNSAT TT=32.759 CHECKS=19295600 NODES=78577	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=1.4 ASSIGNMENTS=0	UNSAT TT=1.413 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=9.332 ASSIGNMENTS=0	UNSAT TT=675.912 ASSIGNMENTS=0	UNSAT TT=5.766	UNSAT TT=5.977	No data	? (TO) TT=1800.07	UNSAT TT=191.924 ASSIGNMENTS=3029480 CHECKS=840137000	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.09	UNSAT TT=5.366	? (TO) TT=1800.14	UNSAT TT=3.26	UNSAT TT=4.098
csp/QCP-25/ normalized-qcp-25-264-14_ext.xml	UNSAT TT=32.393	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=187.054 ASSIGNMENTS=2650	UNSAT TT=111.985 ASSIGNMENTS=1014	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=148.726 ASSIGNMENTS=2487	UNSAT TT=800.345 ASSIGNMENTS=2487	UNSAT TT=32.474	UNSAT TT=32.393	No data	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=70.472	? (TO) TT=1800.15	UNSAT TT=65.879	UNSAT TT=105.436
csp/QCP-25/ normalized-qcp-25-264-1_ext.xml	SAT TT=137.596	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=656.988	SAT TT=137.596	No data	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=371.733	? (TO) TT=1800.11	SAT TT=654.826	SAT TT=1696.08
csp/QCP-25/ normalized-qcp-25-264-2_ext.xml	SAT TT=10.57	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=30.048 ASSIGNMENTS=160	SAT TT=94.941 ASSIGNMENTS=1221	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=158.12 ASSIGNMENTS=2681	SAT TT=831.742 ASSIGNMENTS=2681	SAT TT=17.961	SAT TT=21.711	No data	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=10.57	? (TO) TT=1800.12	SAT TT=38.422	SAT TT=37.986
csp/QCP-25/ normalized-qcp-25-264-3_ext.xml	SAT TT=47.242	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=1391.47 ASSIGNMENTS=28060	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1419.53 ASSIGNMENTS=28060	? (TO) TT=1800.01	SAT TT=204.922	SAT TT=47.242	No data	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=299.072	? (TO) TT=1800.09	SAT TT=1169.24	SAT TT=93.987
csp/QCP-25/ normalized-qcp-25-264-4_ext.xml	SAT TT=27.328	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.06	SAT TT=1477.49 ASSIGNMENTS=26778	SAT TT=221.842 ASSIGNMENTS=2446	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=27.328	SAT TT=98.283	No data	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=166.727	? (TO) TT=1800.09	SAT TT=342.65	SAT TT=71.447
csp/QCP-25/ normalized-qcp-25-264-5_ext.xml	SAT TT=35.778	? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=962.125 ASSIGNMENTS=11219	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=35.778	SAT TT=116.864	No data	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=285.904	? (TO) TT=1800.13	SAT TT=230.37	SAT TT=97.073
csp/QCP-25/ normalized-qcp-25-264-6_ext.xml	SAT TT=57.228	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=57.228 ASSIGNMENTS=737	SAT TT=1151.55 ASSIGNMENTS=15852	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=119.394 ASSIGNMENTS=2319	SAT TT=786.463 ASSIGNMENTS=2319	SAT TT=366.619	SAT TT=141.766	No data	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=654.663	? (TO) TT=1800.07	SAT TT=166.843	SAT TT=166.095
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-25/ normalized-qcp-25-264-7_ext.xml	SAT TT=43.883	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=943.746 ASSIGNMENTS=22317	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=1453.41 CHECKS=2264150000 NODES=19452500	? (TO) TT=1800.06	SAT TT=252.841 ASSIGNMENTS=5745	SAT TT=918.357 ASSIGNMENTS=5745	SAT TT=70.143	SAT TT=43.883	No data	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=64.991	? (TO) TT=1800.14	SAT TT=53.629	SAT TT=228.492
csp/QCP-25/ normalized-qcp-25-264-8_ext.xml	SAT TT=25.145	? (TO) TT=1800.18	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=727.454 ASSIGNMENTS=15922	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=130.551 ASSIGNMENTS=2149	SAT TT=797.46 ASSIGNMENTS=2149	SAT TT=73.27	SAT TT=25.145	No data	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=61.858	? (TO) TT=1800.16	SAT TT=125.736	SAT TT=89.797
csp/QCP-25/ normalized-qcp-25-264-9_ext.xml	SAT TT=26.164	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=46.516 ASSIGNMENTS=447	SAT TT=1775.36 ASSIGNMENTS=21093	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=26.164	SAT TT=37.713	No data	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=380.529	? (TO) TT=1800.16	SAT TT=264.981	SAT TT=96.707
csp/QG3/ normalized-quasigroup3-10.xml		? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.13	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? TT=5.106	No data	? (TO) TT=1800.04	? (TO) TT=1800.08
csp/QG3/ normalized-quasigroup3-4.xml	SAT TT=0.008	SAT TT=0.935 CHECKS=931 NODES=52	SAT TT=0.915 CHECKS=931 NODES=0	SAT TT=0.04	SAT TT=0.027 CHECKS=2637	SAT TT=0.043 CHECKS=18113	SAT TT=0.748 ASSIGNMENTS=7	SAT TT=0.715 ASSIGNMENTS=7	No data	No data	No data	SAT TT=0.021 ASSIGNMENTS=6 CHECKS=422	SAT TT=0.023 ASSIGNMENTS=6 CHECKS=422	No data	No data	No data	SAT TT=0.009 ASSIGNMENTS=6 CHECKS=422	SAT TT=0.008 ASSIGNMENTS=6 CHECKS=422	SAT TT=0.426	SAT TT=0.01 ASSIGNMENTS=6 CHECKS=422	SAT TT=0.01 ASSIGNMENTS=6 CHECKS=421	? TT=1.083	No data	SAT TT=0.859	SAT TT=0.853
csp/QG3/ normalized-quasigroup3-5.xml	UNSAT TT=0.018	UNSAT TT=1.276 CHECKS=5073 NODES=61	UNSAT TT=1.255 CHECKS=13136 NODES=77	UNSAT TT=0.055	UNSAT TT=0.069 CHECKS=11966	UNSAT TT=0.204 CHECKS=107584	UNSAT TT=1.068 ASSIGNMENTS=10	UNSAT TT=1.006 ASSIGNMENTS=7	No data	No data	No data	UNSAT TT=0.03 ASSIGNMENTS=11 CHECKS=4225	UNSAT TT=0.028 ASSIGNMENTS=11 CHECKS=4225	No data	No data	No data	UNSAT TT=0.019 ASSIGNMENTS=11 CHECKS=4225	UNSAT TT=0.02 ASSIGNMENTS=17 CHECKS=5883	UNSAT TT=0.624	UNSAT TT=0.063 ASSIGNMENTS=248 CHECKS=43106	UNSAT TT=0.018 ASSIGNMENTS=11 CHECKS=4679	? TT=2.086	No data	UNSAT TT=1.024	UNSAT TT=1.025
csp/QG3/ normalized-quasigroup3-6.xml	UNSAT TT=0.1	UNSAT TT=1.729 CHECKS=86757 NODES=391	UNSAT TT=1.721 CHECKS=121801 NODES=378	UNSAT TT=0.1	UNSAT TT=0.188 CHECKS=51941	UNSAT TT=0.739 CHECKS=351466	UNSAT TT=1.7 ASSIGNMENTS=65	UNSAT TT=1.772 ASSIGNMENTS=55	No data	No data	No data	UNSAT TT=0.287 ASSIGNMENTS=110 CHECKS=184050	UNSAT TT=0.284 ASSIGNMENTS=110 CHECKS=184050	No data	No data	No data	UNSAT TT=0.263 ASSIGNMENTS=111 CHECKS=180068	UNSAT TT=4.593 ASSIGNMENTS=3313 CHECKS=3379770	UNSAT TT=0.671	UNSAT TT=0.479 ASSIGNMENTS=1211 CHECKS=323915	UNSAT TT=0.272 ASSIGNMENTS=116 CHECKS=187532	? TT=2.181	No data	UNSAT TT=1.187	UNSAT TT=1.256
csp/QG3/ normalized-quasigroup3-7.xml	UNSAT TT=1.629	UNSAT TT=20.31 CHECKS=5959460 NODES=11794	UNSAT TT=21.647 CHECKS=6040920 NODES=11994	UNSAT TT=1.84	UNSAT TT=11.337 CHECKS=5669460	UNSAT TT=47.321 CHECKS=17606000	UNSAT TT=38.94 ASSIGNMENTS=16863	UNSAT TT=12.749 ASSIGNMENTS=1840	No data	No data	No data	UNSAT TT=48.031 ASSIGNMENTS=16863	UNSAT TT=26.221 ASSIGNMENTS=11794 CHECKS=5959460	No data	No data	No data	UNSAT TT=15.818 ASSIGNMENTS=3860 CHECKS=9407950	UNSAT TT=26.496 ASSIGNMENTS=7003 CHECKS=14262900	UNSAT TT=1.629	UNSAT TT=35.98 ASSIGNMENTS=11059 CHECKS=21893200	UNSAT TT=30.446 ASSIGNMENTS=6442 CHECKS=16157500	? TT=2.767	No data	UNSAT TT=2.715	UNSAT TT=3.933
csp/QG3/ normalized-quasigroup3-8.xml	SAT TT=0.173	SAT TT=2.382 CHECKS=97097 NODES=204	SAT TT=2.34 CHECKS=131721 NODES=0	SAT TT=0.186	SAT TT=0.474 CHECKS=62420	SAT TT=4.113 CHECKS=1385220	SAT TT=14.493 ASSIGNMENTS=21	SAT TT=17.51 ASSIGNMENTS=337	No data	No data	No data	SAT TT=0.272 ASSIGNMENTS=34 CHECKS=78749	SAT TT=0.27 ASSIGNMENTS=34 CHECKS=78749	No data	No data	No data	SAT TT=0.248 ASSIGNMENTS=32 CHECKS=73157	SAT TT=1.856 ASSIGNMENTS=323 CHECKS=693851	SAT TT=0.843	SAT TT=0.173 ASSIGNMENTS=31 CHECKS=41196	SAT TT=0.204 ASSIGNMENTS=29 CHECKS=57766	? TT=3.076	No data	SAT TT=1.76	SAT TT=2.057
csp/QG3/ normalized-quasigroup3-9.xml		? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.13	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? TT=3.634	No data	? (TO) TT=1800.1	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QG4/ normalized-quasigroup4-10.xml		? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.05	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.03	? TT=5.373	No data	? (TO) TT=1800.04	? (TO) TT=1800.1
csp/QG4/ normalized-quasigroup4-4.xml	UNSAT TT=0.009	UNSAT TT=0.935 CHECKS=575 NODES=24	UNSAT TT=0.917 CHECKS=634 NODES=0	UNSAT TT=0.039	UNSAT TT=0.024 CHECKS=243	UNSAT TT=0.013 CHECKS=195	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.552 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.021 ASSIGNMENTS=1 CHECKS=248	UNSAT TT=0.022 ASSIGNMENTS=1 CHECKS=248	No data	No data	No data	UNSAT TT=0.01 ASSIGNMENTS=1 CHECKS=248	UNSAT TT=0.009 ASSIGNMENTS=1 CHECKS=225	UNSAT TT=0.423	UNSAT TT=0.011 ASSIGNMENTS=1 CHECKS=248	UNSAT TT=0.009 ASSIGNMENTS=1 CHECKS=228	? TT=1.023	No data	UNSAT TT=0.774	UNSAT TT=0.824
csp/QG4/ normalized-quasigroup4-5.xml	SAT TT=0.015	SAT TT=1.09 CHECKS=3891 NODES=80	SAT TT=1.081 CHECKS=3891 NODES=0	SAT TT=0.052	SAT TT=0.071 CHECKS=14332	SAT TT=0.227 CHECKS=117272	SAT TT=1.043 ASSIGNMENTS=9	SAT TT=1.082 ASSIGNMENTS=9	No data	No data	No data	SAT TT=0.026 ASSIGNMENTS=9 CHECKS=1539	SAT TT=0.026 ASSIGNMENTS=9 CHECKS=1539	No data	No data	No data	SAT TT=0.015 ASSIGNMENTS=9 CHECKS=1539	SAT TT=0.015 ASSIGNMENTS=8 CHECKS=1304	SAT TT=0.567	SAT TT=0.015 ASSIGNMENTS=9 CHECKS=1539	SAT TT=0.017 ASSIGNMENTS=9 CHECKS=1510	? TT=1.895	No data	SAT TT=0.993	SAT TT=1.385
csp/QG4/ normalized-quasigroup4-6.xml	UNSAT TT=0.09	UNSAT TT=1.628 CHECKS=74127 NODES=474	UNSAT TT=1.782 CHECKS=115495 NODES=479	UNSAT TT=0.09	UNSAT TT=0.177 CHECKS=51985	UNSAT TT=0.894 CHECKS=435550	UNSAT TT=1.678 ASSIGNMENTS=78	UNSAT TT=1.818 ASSIGNMENTS=13	No data	No data	No data	UNSAT TT=0.243 ASSIGNMENTS=103 CHECKS=151422	UNSAT TT=0.244 ASSIGNMENTS=103 CHECKS=151422	No data	No data	No data	UNSAT TT=0.184 ASSIGNMENTS=86 CHECKS=125982	UNSAT TT=4.515 ASSIGNMENTS=3287 CHECKS=3304680	UNSAT TT=0.73	UNSAT TT=0.414 ASSIGNMENTS=1225 CHECKS=293527	UNSAT TT=0.197 ASSIGNMENTS=92 CHECKS=142255	? TT=2.174	No data	UNSAT TT=1.188	UNSAT TT=1.209
csp/QG4/ normalized-quasigroup4-7.xml	UNSAT TT=1.592	UNSAT TT=21.671 CHECKS=6631310 NODES=11540	UNSAT TT=22.462 CHECKS=6733580 NODES=11401	UNSAT TT=1.592	UNSAT TT=8.21 CHECKS=4156480	UNSAT TT=14.963 CHECKS=5903740	UNSAT TT=27.817 ASSIGNMENTS=11662	UNSAT TT=12.702 ASSIGNMENTS=1468	No data	No data	No data	UNSAT TT=37.731 ASSIGNMENTS=11662	UNSAT TT=27.886 ASSIGNMENTS=11540 CHECKS=6631310	No data	No data	No data	UNSAT TT=12.358 ASSIGNMENTS=2566 CHECKS=7146310	UNSAT TT=22.913 ASSIGNMENTS=5995 CHECKS=12494500	UNSAT TT=1.615	UNSAT TT=32.683 ASSIGNMENTS=9366 CHECKS=17913200	UNSAT TT=23.685 ASSIGNMENTS=4573 CHECKS=12545300	? TT=2.597	No data	UNSAT TT=2.428	UNSAT TT=3.248
csp/QG4/ normalized-quasigroup4-8.xml	UNSAT TT=80.369	? (TO) TT=1800.11	? (TO) TT=1800.13	UNSAT TT=174.359	UNSAT TT=546.984 CHECKS=199542000	UNSAT TT=596.926 CHECKS=195226000	? (TO) TT=1800.08	UNSAT TT=960.435 ASSIGNMENTS=131442	No data	No data	No data	? (TO) TT=1800	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=80.369	? (TO) TT=1800.08	? (TO) TT=1800.01	? TT=2.848	No data	UNSAT TT=255.381	UNSAT TT=428.914
csp/QG4/ normalized-quasigroup4-9.xml	SAT TT=1.109	SAT TT=4.232 CHECKS=742527 NODES=1356	SAT TT=7.008 CHECKS=1758840 NODES=2478	SAT TT=1.243	SAT TT=1.109 CHECKS=189474	SAT TT=3.75 CHECKS=965080	SAT TT=48.036 ASSIGNMENTS=274	SAT TT=59.524 ASSIGNMENTS=2028	No data	No data	No data	SAT TT=59.892 ASSIGNMENTS=274	SAT TT=11.092 ASSIGNMENTS=1356 CHECKS=742519	No data	No data	No data	SAT TT=5.916 ASSIGNMENTS=369 CHECKS=1901520	SAT TT=5.788 ASSIGNMENTS=607 CHECKS=1806810	SAT TT=14.224	SAT TT=24.939 ASSIGNMENTS=3220 CHECKS=6093680	SAT TT=7.969 ASSIGNMENTS=541 CHECKS=2572430	? TT=3.508	No data	SAT TT=2.311	SAT TT=3.034
csp/QG5/ normalized-quasigroup5-10.xml	UNSAT TT=428.683	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=428.683	UNSAT TT=556.808 CHECKS=580615000	UNSAT TT=558.73 CHECKS=597323000	? (TO) TT=1800.11	? (TO) TT=1800.12	No data	No data	No data	UNSAT TT=819.995 ASSIGNMENTS=852548 CHECKS=1142100000	? (TO) TT=1800.06	No data	No data	No data	UNSAT TT=534.935 ASSIGNMENTS=610415 CHECKS=809770000	UNSAT TT=695.74 ASSIGNMENTS=798993 CHECKS=1058240000	UNSAT TT=904.463	? (TO) TT=1800.02	UNSAT TT=812.386 ASSIGNMENTS=852548 CHECKS=1142100000	? TT=1.072	No data	UNSAT TT=1540.36	? (TO) TT=1800.07
csp/QG5/ normalized-quasigroup5-4.xml	UNSAT TT=0.007	UNSAT TT=0.871 CHECKS=137 NODES=3	UNSAT TT=0.777 CHECKS=148 NODES=0	UNSAT TT=0.033	UNSAT TT=0.009 CHECKS=145	UNSAT TT=0.008 CHECKS=145	UNSAT TT=0.418 ASSIGNMENTS=0	UNSAT TT=0.428 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.018 ASSIGNMENTS=1 CHECKS=146	UNSAT TT=0.019 ASSIGNMENTS=1 CHECKS=146	No data	No data	No data	UNSAT TT=0.007 ASSIGNMENTS=1 CHECKS=146	UNSAT TT=0.008 ASSIGNMENTS=1 CHECKS=159	UNSAT TT=0.336	UNSAT TT=0.007 ASSIGNMENTS=1 CHECKS=146	UNSAT TT=0.008 ASSIGNMENTS=1 CHECKS=155	? TT=0.683	No data	UNSAT TT=0.7	UNSAT TT=0.77
csp/QG5/ normalized-quasigroup5-5.xml	SAT TT=0.01	SAT TT=0.92 CHECKS=997 NODES=65	SAT TT=0.89 CHECKS=949 NODES=0	SAT TT=0.039	SAT TT=0.017 CHECKS=10996	SAT TT=0.019 CHECKS=12609	SAT TT=0.625 ASSIGNMENTS=3	SAT TT=0.728 ASSIGNMENTS=3	No data	No data	No data	SAT TT=0.021 ASSIGNMENTS=2 CHECKS=669	SAT TT=0.021 ASSIGNMENTS=2 CHECKS=669	No data	No data	No data	SAT TT=0.01 ASSIGNMENTS=2 CHECKS=669	SAT TT=0.014 ASSIGNMENTS=2 CHECKS=669	SAT TT=0.329	SAT TT=0.012 ASSIGNMENTS=2 CHECKS=669	SAT TT=0.011 ASSIGNMENTS=2 CHECKS=665	? TT=0.723	No data	SAT TT=1.066	SAT TT=0.886
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QG5/ normalized-quasigroup5-6.xml	UNSAT TT=0.014	UNSAT TT=1.189 CHECKS=16514 NODES=230	UNSAT TT=1.254 CHECKS=29587 NODES=160	UNSAT TT=0.049	UNSAT TT=0.021 CHECKS=11918	UNSAT TT=0.024 CHECKS=13460	UNSAT TT=0.695 ASSIGNMENTS=26	UNSAT TT=0.795 ASSIGNMENTS=27	No data	No data	No data	UNSAT TT=0.024 ASSIGNMENTS=18 CHECKS=6437	UNSAT TT=0.025 ASSIGNMENTS=18 CHECKS=6437	No data	No data	No data	UNSAT TT=0.014 ASSIGNMENTS=11 CHECKS=5420	UNSAT TT=0.023 ASSIGNMENTS=114 CHECKS=19126	UNSAT TT=0.359	UNSAT TT=0.022 ASSIGNMENTS=117 CHECKS=21780	UNSAT TT=0.015 ASSIGNMENTS=15 CHECKS=5521	? TT=0.728	No data	UNSAT TT=0.941	UNSAT TT=1.026
csp/QG5/ normalized-quasigroup5-7.xml	SAT TT=0.014	SAT TT=1.167 CHECKS=4504 NODES=134	SAT TT=1.292 CHECKS=10632 NODES=0	SAT TT=0.053	SAT TT=0.03 CHECKS=17557	SAT TT=0.033 CHECKS=21233	SAT TT=0.966 ASSIGNMENTS=11	SAT TT=0.941 ASSIGNMENTS=25	No data	No data	No data	SAT TT=0.027 ASSIGNMENTS=5 CHECKS=2638	SAT TT=0.029 ASSIGNMENTS=5 CHECKS=2638	No data	No data	No data	SAT TT=0.014 ASSIGNMENTS=5 CHECKS=2600	SAT TT=0.02 ASSIGNMENTS=40 CHECKS=9649	SAT TT=0.423	SAT TT=0.016 ASSIGNMENTS=5 CHECKS=2513	SAT TT=0.014 ASSIGNMENTS=5 CHECKS=2467	? TT=0.763	No data	SAT TT=1.139	SAT TT=1.209
csp/QG5/ normalized-quasigroup5-8.xml	SAT TT=0.022	SAT TT=1.394 CHECKS=14155 NODES=195	SAT TT=1.443 CHECKS=40037 NODES=178	SAT TT=0.069	SAT TT=0.042 CHECKS=25994	SAT TT=0.038 CHECKS=24625	SAT TT=1.148 ASSIGNMENTS=7	SAT TT=1.198 ASSIGNMENTS=13	No data	No data	No data	SAT TT=0.034 ASSIGNMENTS=13 CHECKS=8184	SAT TT=0.034 ASSIGNMENTS=13 CHECKS=8184	No data	No data	No data	SAT TT=0.022 ASSIGNMENTS=13 CHECKS=8309	SAT TT=0.033 ASSIGNMENTS=77 CHECKS=25405	SAT TT=0.467	SAT TT=0.047 ASSIGNMENTS=128 CHECKS=44830	SAT TT=0.022 ASSIGNMENTS=13 CHECKS=8296	? TT=0.861	No data	SAT TT=1.315	SAT TT=1.45
csp/QG5/ normalized-quasigroup5-9.xml	UNSAT TT=18.436	UNSAT TT=223.091 CHECKS=104450000 NODES=194026	UNSAT TT=223.673 CHECKS=103436000 NODES=190373	UNSAT TT=24.881	UNSAT TT=96.998 CHECKS=101948000	UNSAT TT=92.98 CHECKS=100180000	UNSAT TT=474.216 ASSIGNMENTS=228263	? (TO) TT=1800.11	No data	No data	No data	UNSAT TT=45.24 ASSIGNMENTS=68668 CHECKS=59099100	UNSAT TT=221.612 ASSIGNMENTS=194026 CHECKS=104450000	No data	No data	No data	UNSAT TT=32.938 ASSIGNMENTS=53300 CHECKS=48317400	UNSAT TT=27.848 ASSIGNMENTS=50268 CHECKS=41181500	UNSAT TT=18.436	UNSAT TT=242.042 ASSIGNMENTS=494541 CHECKS=334791000	UNSAT TT=39.84 ASSIGNMENTS=68668 CHECKS=59099100	? TT=1.035	No data	UNSAT TT=39.34	UNSAT TT=43.706
csp/QG6/ normalized-quasigroup6-10.xml		? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? TT=2.935	No data	? (TO) TT=1800.07	? (TO) TT=1800.13
csp/QG6/ normalized-quasigroup6-4.xml	SAT TT=0.012	SAT TT=1.061 CHECKS=1427 NODES=78	SAT TT=1.034 CHECKS=1427 NODES=0	SAT TT=0.046	SAT TT=0.094 CHECKS=63383	SAT TT=0.084 CHECKS=61381	SAT TT=0.801 ASSIGNMENTS=21	SAT TT=0.877 ASSIGNMENTS=21	No data	No data	No data	SAT TT=0.025 ASSIGNMENTS=20 CHECKS=714	SAT TT=0.027 ASSIGNMENTS=20 CHECKS=714	No data	No data	No data	SAT TT=0.012 ASSIGNMENTS=20 CHECKS=714	SAT TT=0.012 ASSIGNMENTS=20 CHECKS=714	SAT TT=0.501	SAT TT=0.012 ASSIGNMENTS=20 CHECKS=714	SAT TT=0.012 ASSIGNMENTS=20 CHECKS=714	? TT=0.975	No data	SAT TT=1.182	SAT TT=0.957
csp/QG6/ normalized-quasigroup6-5.xml	UNSAT TT=0.025	UNSAT TT=1.373 CHECKS=3618 NODES=15	UNSAT TT=1.798 CHECKS=105671 NODES=15	UNSAT TT=0.067	UNSAT TT=0.171 CHECKS=146574	UNSAT TT=0.168 CHECKS=165545	UNSAT TT=1.163 ASSIGNMENTS=4	UNSAT TT=1.053 ASSIGNMENTS=4	No data	No data	No data	UNSAT TT=0.037 ASSIGNMENTS=15 CHECKS=6889	UNSAT TT=0.036 ASSIGNMENTS=15 CHECKS=6889	No data	No data	No data	UNSAT TT=0.026 ASSIGNMENTS=15 CHECKS=6889	UNSAT TT=0.081 ASSIGNMENTS=268 CHECKS=54640	UNSAT TT=0.504	UNSAT TT=0.063 ASSIGNMENTS=394 CHECKS=40427	UNSAT TT=0.025 ASSIGNMENTS=14 CHECKS=6311	? TT=1.208	No data	UNSAT TT=1.241	UNSAT TT=1.103
csp/QG6/ normalized-quasigroup6-6.xml	UNSAT TT=0.129	UNSAT TT=1.794 CHECKS=32584 NODES=91	UNSAT TT=3.264 CHECKS=396830 NODES=63	UNSAT TT=0.129	UNSAT TT=0.49 CHECKS=448923	UNSAT TT=0.555 CHECKS=521332	UNSAT TT=1.653 ASSIGNMENTS=17	UNSAT TT=1.596 ASSIGNMENTS=19	No data	No data	No data	UNSAT TT=0.228 ASSIGNMENTS=117 CHECKS=112842	UNSAT TT=0.228 ASSIGNMENTS=117 CHECKS=112842	No data	No data	No data	UNSAT TT=0.215 ASSIGNMENTS=133 CHECKS=126870	UNSAT TT=2.095 ASSIGNMENTS=3990 CHECKS=1393080	UNSAT TT=0.646	UNSAT TT=0.349 ASSIGNMENTS=728 CHECKS=193249	UNSAT TT=0.157 ASSIGNMENTS=76 CHECKS=79036	? TT=1.468	No data	UNSAT TT=1.27	UNSAT TT=1.448
csp/QG6/ normalized-quasigroup6-7.xml	UNSAT TT=1.009	UNSAT TT=4.272 CHECKS=747685 NODES=1037	UNSAT TT=7.902 CHECKS=1680190 NODES=1056	UNSAT TT=1.297	UNSAT TT=1.596 CHECKS=1259190	UNSAT TT=2.437 CHECKS=1634510	UNSAT TT=3.219 ASSIGNMENTS=126	UNSAT TT=4.304 ASSIGNMENTS=425	No data	No data	No data	UNSAT TT=10.824 ASSIGNMENTS=126	UNSAT TT=10.948 ASSIGNMENTS=1037 CHECKS=747685	No data	No data	No data	UNSAT TT=2.542 ASSIGNMENTS=548 CHECKS=1171260	UNSAT TT=6.614 ASSIGNMENTS=4898 CHECKS=3360220	UNSAT TT=1.009	UNSAT TT=11.228 ASSIGNMENTS=4870 CHECKS=5660160	UNSAT TT=2.711 ASSIGNMENTS=517 CHECKS=1252570	? TT=1.927	No data	UNSAT TT=1.892	UNSAT TT=2.081
csp/QG6/ normalized-quasigroup6-8.xml	SAT TT=0.173	SAT TT=3.733 CHECKS=47715 NODES=319	SAT TT=3.628 CHECKS=99204 NODES=0	SAT TT=4.122	SAT TT=2.058 CHECKS=1745820	SAT TT=3.073 CHECKS=2541230	SAT TT=5.416 ASSIGNMENTS=78	SAT TT=6.562 ASSIGNMENTS=230	No data	No data	No data	SAT TT=0.2 ASSIGNMENTS=82 CHECKS=33392	SAT TT=0.197 ASSIGNMENTS=82 CHECKS=33392	No data	No data	No data	SAT TT=0.173 ASSIGNMENTS=82 CHECKS=33392	SAT TT=2.921 ASSIGNMENTS=1557 CHECKS=1018100	SAT TT=0.924	SAT TT=4.146 ASSIGNMENTS=2073 CHECKS=1407610	SAT TT=0.185 ASSIGNMENTS=82 CHECKS=33011	? TT=2.258	No data	SAT TT=2.377	SAT TT=2.635
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QG6/ normalized-quasigroup6-9.xml	SAT TT=1.424	SAT TT=7.079 CHECKS=702659 NODES=1069	SAT TT=8.419 CHECKS=898749 NODES=972	SAT TT=2.218	SAT TT=5.398 CHECKS=3735240	SAT TT=4.064 CHECKS=2046270	SAT TT=14.623 ASSIGNMENTS=144	SAT TT=14.573 ASSIGNMENTS=251	No data	No data	No data	SAT TT=20.622 ASSIGNMENTS=144	SAT TT=13.395 ASSIGNMENTS=1069 CHECKS=702573	No data	No data	No data	SAT TT=2.277 ASSIGNMENTS=271 CHECKS=635055	SAT TT=17.812 ASSIGNMENTS=5790 CHECKS=5254200	SAT TT=1.424	SAT TT=6.76 ASSIGNMENTS=2165 CHECKS=1747570	SAT TT=4.356 ASSIGNMENTS=406 CHECKS=1245850	? TT=2.469	No data	SAT TT=2.802	SAT TT=4.38
csp/QG7/ normalized-quasigroup7-10.xml		? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.14	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=3.349	No data	? (TO) TT=1800.02	? (TO) TT=1800.1
csp/QG7/ normalized-quasigroup7-4.xml	UNSAT TT=0.011	UNSAT TT=1.047 CHECKS=859 NODES=8	UNSAT TT=1.037 CHECKS=1108 NODES=0	UNSAT TT=0.046	UNSAT TT=0.024 CHECKS=320	UNSAT TT=0.016 CHECKS=260	UNSAT TT=0.634 ASSIGNMENTS=0	UNSAT TT=0.613 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.024 ASSIGNMENTS=1 CHECKS=450	UNSAT TT=0.023 ASSIGNMENTS=1 CHECKS=450	No data	No data	No data	UNSAT TT=0.011 ASSIGNMENTS=1 CHECKS=450	UNSAT TT=0.014 ASSIGNMENTS=1 CHECKS=521	UNSAT TT=0.418	UNSAT TT=0.012 ASSIGNMENTS=1 CHECKS=450	UNSAT TT=0.012 ASSIGNMENTS=1 CHECKS=416	? TT=0.992	No data	UNSAT TT=0.904	UNSAT TT=0.932
csp/QG7/ normalized-quasigroup7-5.xml	SAT TT=0.02	SAT TT=1.391 CHECKS=4219 NODES=123	SAT TT=1.433 CHECKS=4320 NODES=0	SAT TT=0.071	SAT TT=0.148 CHECKS=120618	SAT TT=0.173 CHECKS=168127	SAT TT=1.079 ASSIGNMENTS=32	SAT TT=1.053 ASSIGNMENTS=33	No data	No data	No data	SAT TT=0.035 ASSIGNMENTS=32 CHECKS=2451	SAT TT=0.033 ASSIGNMENTS=32 CHECKS=2451	No data	No data	No data	SAT TT=0.022 ASSIGNMENTS=32 CHECKS=2451	SAT TT=0.02 ASSIGNMENTS=39 CHECKS=3059	SAT TT=0.519	SAT TT=0.026 ASSIGNMENTS=42 CHECKS=4573	SAT TT=0.02 ASSIGNMENTS=32 CHECKS=2503	? TT=1.204	No data	SAT TT=1.132	SAT TT=1.134
csp/QG7/ normalized-quasigroup7-6.xml	UNSAT TT=0.168	UNSAT TT=2.126 CHECKS=140424 NODES=283	UNSAT TT=2.993 CHECKS=330659 NODES=221	UNSAT TT=0.168	UNSAT TT=0.486 CHECKS=453180	UNSAT TT=0.546 CHECKS=534519	UNSAT TT=1.49 ASSIGNMENTS=53	UNSAT TT=1.641 ASSIGNMENTS=53	No data	No data	No data	UNSAT TT=0.587 ASSIGNMENTS=338 CHECKS=358238	UNSAT TT=0.584 ASSIGNMENTS=338 CHECKS=358238	No data	No data	No data	UNSAT TT=0.582 ASSIGNMENTS=332 CHECKS=353997	UNSAT TT=2.858 ASSIGNMENTS=4065 CHECKS=1927990	UNSAT TT=0.685	UNSAT TT=0.728 ASSIGNMENTS=971 CHECKS=444615	UNSAT TT=0.534 ASSIGNMENTS=321 CHECKS=337506	? TT=1.562	No data	UNSAT TT=1.452	UNSAT TT=1.43
csp/QG7/ normalized-quasigroup7-7.xml	UNSAT TT=1.879	UNSAT TT=21.802 CHECKS=6966120 NODES=9446	UNSAT TT=17.858 CHECKS=5845890 NODES=6911	UNSAT TT=11.377	UNSAT TT=5.998 CHECKS=3939430	UNSAT TT=6.423 CHECKS=4421760	UNSAT TT=15.216 ASSIGNMENTS=2308	UNSAT TT=9.023 ASSIGNMENTS=1554	No data	No data	No data	UNSAT TT=22.935 ASSIGNMENTS=2308	UNSAT TT=27.487 ASSIGNMENTS=9446 CHECKS=6966120	No data	No data	No data	UNSAT TT=33.961 ASSIGNMENTS=11663 CHECKS=16257400	UNSAT TT=21.009 ASSIGNMENTS=9769 CHECKS=10805900	UNSAT TT=1.879	UNSAT TT=54.825 ASSIGNMENTS=20553 CHECKS=27894900	UNSAT TT=72.549 ASSIGNMENTS=25219 CHECKS=36993900	? TT=1.899	No data	UNSAT TT=2.259	UNSAT TT=2.441
csp/QG7/ normalized-quasigroup7-8.xml	UNSAT TT=12.221	UNSAT TT=665.958 CHECKS=246908000 NODES=165416	UNSAT TT=672.818 CHECKS=234073000 NODES=156268	? (TO) TT=1800.05	UNSAT TT=164.049 CHECKS=100064000	UNSAT TT=131.626 CHECKS=70476900	UNSAT TT=654.383 ASSIGNMENTS=92715	UNSAT TT=427.621 ASSIGNMENTS=68209	No data	No data	No data	UNSAT TT=667.801 ASSIGNMENTS=92715	UNSAT TT=664.561 ASSIGNMENTS=165416 CHECKS=246908000	No data	No data	No data	? (TO) TT=1800.09	UNSAT TT=1398 ASSIGNMENTS=277514 CHECKS=529825000	UNSAT TT=60.021	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=2.25	No data	UNSAT TT=16.992	UNSAT TT=12.221
csp/QG7/ normalized-quasigroup7-9.xml	SAT TT=1.766	SAT TT=7.916 CHECKS=827627 NODES=1330	SAT TT=13.958 CHECKS=1724580 NODES=0	SAT TT=93.414	SAT TT=10.113 CHECKS=5948000	SAT TT=6.519 CHECKS=2976410	SAT TT=14.252 ASSIGNMENTS=188	SAT TT=22.318 ASSIGNMENTS=1090	No data	No data	No data	SAT TT=20.696 ASSIGNMENTS=188	SAT TT=14.847 ASSIGNMENTS=1330 CHECKS=827541	No data	No data	No data	SAT TT=60.442 ASSIGNMENTS=6994 CHECKS=18042500	SAT TT=113.202 ASSIGNMENTS=16884 CHECKS=34009700	SAT TT=1.766	SAT TT=79.039 ASSIGNMENTS=12198 CHECKS=23084000	SAT TT=62.291 ASSIGNMENTS=7073 CHECKS=18262700	? TT=2.513	No data	SAT TT=3.181	SAT TT=4.413
csp/queenAttacking/ normalized-queenAttacking-10.xml		? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=61.888 CHECKS=73816900	UNSAT TT=63.604 CHECKS=99104600	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.03	No data	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.03	? TT=898.494	No data	? (TO) TT=1800.05	? (TO) TT=1800.09
csp/queenAttacking/ normalized-queenAttacking-11.xml	UNSAT TT=368.848	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=82.413 CHECKS=83432700	UNSAT TT=71.69 CHECKS=117741000	? (TO) TT=1800.13	UNSAT TT=368.848 ASSIGNMENTS=66	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=150.712	No data	? (TO) TT=1800.09	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/queenAttacking/ normalized-queenAttacking-12.xml	UNSAT TT=748.425	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=142.411 CHECKS=141295000	UNSAT TT=78.293 CHECKS=105624000	UNSAT TT=1539.86 ASSIGNMENTS=1520	UNSAT TT=748.425 ASSIGNMENTS=22	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.06	? (MO) TT=842.09	No data	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? TT=256.536	No data	? (TO) TT=1800.1	? (TO) TT=1800.07
csp/queenAttacking/ normalized-queenAttacking-3.xml	UNSAT TT=0.009	UNSAT TT=0.679 CHECKS=137 NODES=0	UNSAT TT=0.74 CHECKS=137 NODES=0	UNSAT TT=0.034	UNSAT TT=0.024 CHECKS=1239	UNSAT TT=0.011 CHECKS=1377	UNSAT TT=0.704 ASSIGNMENTS=0	UNSAT TT=0.701 ASSIGNMENTS=0	UNSAT TT=0.583 CHECKS=1406 NODES=30	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=0.022 ASSIGNMENTS=31 CHECKS=1205	UNSAT TT=0.021 ASSIGNMENTS=31 CHECKS=1205	UNSAT TT=0.779	UNSAT TT=0.772	No data	UNSAT TT=0.009 ASSIGNMENTS=31 CHECKS=1133	UNSAT TT=0.012 ASSIGNMENTS=28 CHECKS=1338	UNSAT TT=2.968	UNSAT TT=0.016 ASSIGNMENTS=89 CHECKS=3000	UNSAT TT=0.011 ASSIGNMENTS=24 CHECKS=1243	UNSAT TT=1.754	No data	UNSAT TT=0.661	UNSAT TT=0.646
csp/queenAttacking/ normalized-queenAttacking-4.xml	UNSAT TT=0.05	UNSAT TT=1.099 CHECKS=271816 NODES=1889	UNSAT TT=1.066 CHECKS=278200 NODES=1885	UNSAT TT=0.076	UNSAT TT=21.554 CHECKS=17419400	UNSAT TT=32.073 CHECKS=26245100	UNSAT TT=1.435 ASSIGNMENTS=388	UNSAT TT=1.413 ASSIGNMENTS=343	UNSAT TT=0.858 CHECKS=20669 NODES=440	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.071 ASSIGNMENTS=335 CHECKS=23413	UNSAT TT=0.071 ASSIGNMENTS=335 CHECKS=23413	UNSAT TT=1.01	UNSAT TT=1.173	No data	UNSAT TT=0.05 ASSIGNMENTS=298 CHECKS=21117	UNSAT TT=0.286 ASSIGNMENTS=3326 CHECKS=188227	? (TO) TT=1800.11	UNSAT TT=0.156 ASSIGNMENTS=928 CHECKS=57155	UNSAT TT=0.058 ASSIGNMENTS=380 CHECKS=25928	UNSAT TT=3.275	No data	UNSAT TT=1.278	UNSAT TT=1.483
csp/queenAttacking/ normalized-queenAttacking-5.xml	SAT TT=0.049	SAT TT=1.417 CHECKS=796459 NODES=3289	SAT TT=1.531 CHECKS=811169 NODES=3289	SAT TT=5.81	Wrong UNSAT TT=24.873 CHECKS=27090400	Wrong UNSAT TT=40.65 CHECKS=44647500	SAT TT=20.396 ASSIGNMENTS=38676	SAT TT=4.237 ASSIGNMENTS=2481	SAT TT=2.359 CHECKS=259545 NODES=5730	SAT TT=2.389 CHECKS=9788200 NODES=16496	SAT TT=178.158 CHECKS=1345730000 NODES=495407	SAT TT=0.986 ASSIGNMENTS=7096 CHECKS=644160	SAT TT=0.987 ASSIGNMENTS=7096 CHECKS=644160	SAT TT=2.224	SAT TT=2.275	No data	SAT TT=1.658 ASSIGNMENTS=12809 CHECKS=1104960	SAT TT=0.049 ASSIGNMENTS=130 CHECKS=10334	? (TO) TT=1800.07	SAT TT=1.2 ASSIGNMENTS=5299 CHECKS=511608	SAT TT=0.108 ASSIGNMENTS=533 CHECKS=48236	SAT TT=7.266	No data	SAT TT=1.629	SAT TT=61.253
csp/queenAttacking/ normalized-queenAttacking-6.xml	SAT TT=4.23	? (TO) TT=1800.09	? (TO) TT=1800.17	SAT TT=285.777	Wrong UNSAT TT=23.896 CHECKS=31886300	Wrong UNSAT TT=32.401 CHECKS=48609900	SAT TT=9.904 ASSIGNMENTS=647	SAT TT=94.433 ASSIGNMENTS=114209	SAT TT=4.23 CHECKS=1503520 NODES=7137	SAT TT=19.538 CHECKS=152673000 NODES=124555	? (TO) TT=1800.07	SAT TT=29.634 ASSIGNMENTS=34451 CHECKS=3923430	SAT TT=299.917 ASSIGNMENTS=34451 CHECKS=3923430	SAT TT=15.85	SAT TT=11.322	No data	SAT TT=54.742 ASSIGNMENTS=97561 CHECKS=11313400	SAT TT=21.415 ASSIGNMENTS=26424 CHECKS=3197780	? (TO) TT=1800.1	SAT TT=58.59 ASSIGNMENTS=89665 CHECKS=13315300	SAT TT=22.209 ASSIGNMENTS=34451 CHECKS=3923430	SAT TT=103.475	No data	? (TO) TT=1800.1	SAT TT=154.158
csp/queenAttacking/ normalized-queenAttacking-7.xml	SAT TT=450.699	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.07	Wrong UNSAT TT=37.204 CHECKS=58035700	Wrong UNSAT TT=52.559 CHECKS=87594000	SAT TT=491.793 ASSIGNMENTS=597366	SAT TT=450.699 ASSIGNMENTS=328995	SAT TT=511.645 CHECKS=337241000 NODES=792499	SAT TT=624.23 CHECKS=5777620000 NODES=2511800	? (TO) TT=1800.07	SAT TT=1059.03 ASSIGNMENTS=1727560 CHECKS=212930000	SAT TT=1619.54 ASSIGNMENTS=597366	? (TO) TT=1800.04	SAT TT=909.859	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=1212.58 ASSIGNMENTS=1780320 CHECKS=320460000	SAT TT=1091.67 ASSIGNMENTS=1727560 CHECKS=212930000	? (TO) TT=1800.09	No data	SAT TT=1010.82	? (TO) TT=1800.13
csp/queenAttacking/ normalized-queenAttacking-8.xml		? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.07	Wrong UNSAT TT=30.106 CHECKS=41352500	Wrong UNSAT TT=37.672 CHECKS=60161000	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=1090.66	No data	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.17	No data	? (TO) TT=1800.09	? (TO) TT=1800.1
csp/queenAttacking/ normalized-queenAttacking-9.xml		? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.09	UNSAT TT=35.756 CHECKS=40447900	UNSAT TT=35.827 CHECKS=55227200	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.1	? (MO) TT=1261.81	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.18	No data	? (TO) TT=1800.08	? (TO) TT=1800.01
csp/queensKnights/ normalized-queensKnights-100-5-add.xml	UNSAT TT=21.342	UNSAT TT=1252.2 CHECKS=1355730000 NODES=9898	UNSAT TT=1282.62 CHECKS=1355730000 NODES=9898	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800	No data	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=1216.81	No data	UNSAT TT=21.342	UNSAT TT=43.567
csp/queensKnights/ normalized-queensKnights-100-5-mul.xml	UNSAT TT=30.76	? (TO) TT=1800.1	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.04	No data	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.12	? TT=292.326	No data	UNSAT TT=30.76	UNSAT TT=45.023
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/queensKnights/ normalized-queensKnights-10-5-mul.xml	UNSAT TT=0.864	UNSAT TT=0.864 CHECKS=101151 NODES=85	UNSAT TT=0.87 CHECKS=141037 NODES=0	UNSAT TT=16.858	UNSAT TT=24.47 CHECKS=11796600	UNSAT TT=34.952 CHECKS=15679800	UNSAT TT=1.429 ASSIGNMENTS=0	UNSAT TT=1.442 ASSIGNMENTS=0	UNSAT TT=0.93 CHECKS=369064 NODES=326	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=8.243 ASSIGNMENTS=0	UNSAT TT=7.933 ASSIGNMENTS=99 CHECKS=141102	UNSAT TT=2.205	UNSAT TT=2.038	No data	UNSAT TT=13.386 ASSIGNMENTS=1681 CHECKS=78255	UNSAT TT=287.272 ASSIGNMENTS=37844 CHECKS=1590670	? (TO) TT=1800.06	UNSAT TT=4.387 ASSIGNMENTS=700 CHECKS=103869	UNSAT TT=3.463 ASSIGNMENTS=441 CHECKS=25257	UNSAT TT=4.628	No data	UNSAT TT=0.882	UNSAT TT=0.979
csp/queensKnights/ normalized-queensKnights-12-5-mul.xml	UNSAT TT=1.005	UNSAT TT=1.191 CHECKS=272609 NODES=128	UNSAT TT=1.005 CHECKS=403318 NODES=0	UNSAT TT=762.433	UNSAT TT=27.736 CHECKS=13912600	UNSAT TT=35.239 CHECKS=22822700	UNSAT TT=1.371 ASSIGNMENTS=0	UNSAT TT=1.519 ASSIGNMENTS=0	UNSAT TT=1.203 CHECKS=783353 NODES=366	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=19.973 ASSIGNMENTS=765 CHECKS=44331	UNSAT TT=8.745 ASSIGNMENTS=140 CHECKS=383522	UNSAT TT=3.232	UNSAT TT=2.828	No data	UNSAT TT=85.812 ASSIGNMENTS=5339 CHECKS=323229	UNSAT TT=495.219 ASSIGNMENTS=35037 CHECKS=1501340	? (TO) TT=1800.05	UNSAT TT=9.68 ASSIGNMENTS=1326 CHECKS=250870	UNSAT TT=11.284 ASSIGNMENTS=765 CHECKS=44331	UNSAT TT=5.108	No data	UNSAT TT=1.362	UNSAT TT=1.368
csp/queensKnights/ normalized-queensKnights-20-5-mul.xml	UNSAT TT=1.338	UNSAT TT=1.637 CHECKS=4575410 NODES=376	UNSAT TT=1.661 CHECKS=6397900 NODES=0	? (TO) TT=1800.02	UNSAT TT=56.733 CHECKS=45808700	UNSAT TT=49.01 CHECKS=62842700	? (TO) TT=1800.15	? (TO) TT=1800.08	UNSAT TT=3.511 CHECKS=18966100 NODES=1384	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=9.031 ASSIGNMENTS=396 CHECKS=6534760	UNSAT TT=9.07 ASSIGNMENTS=396 CHECKS=6534760	UNSAT TT=24.121	UNSAT TT=10.496	No data	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=417.029 ASSIGNMENTS=4077 CHECKS=2007810	UNSAT TT=235.402 ASSIGNMENTS=2469 CHECKS=199335	UNSAT TT=18.619	No data	UNSAT TT=1.338	UNSAT TT=1.73
csp/queensKnights/ normalized-queensKnights-50-5-add.xml	UNSAT TT=4.381	UNSAT TT=20.094 CHECKS=406092000 NODES=2446	UNSAT TT=21.751 CHECKS=516515000 NODES=0	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=721.046 CHECKS=2919320000	? (TO) TT=1800.12	? (TO) TT=1800.12	UNSAT TT=257.721 CHECKS=5736140000 NODES=10946	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=38.47 ASSIGNMENTS=2491 CHECKS=649643000	UNSAT TT=38.218 ASSIGNMENTS=2491 CHECKS=649643000	UNSAT TT=386.723	UNSAT TT=305.295	No data	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=697.537	No data	UNSAT TT=4.381	UNSAT TT=9.212
csp/queensKnights/ normalized-queensKnights-80-5-add.xml	UNSAT TT=11.313	UNSAT TT=436.192 CHECKS=555846000 NODES=6318	UNSAT TT=480.142 CHECKS=575061000 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=661.188 ASSIGNMENTS=6399 CHECKS=788057000	UNSAT TT=662.202 ASSIGNMENTS=6399 CHECKS=788057000	? (MO) TT=1604.53	? (MO) TT=1625.51	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=1505.07	No data	UNSAT TT=11.313	UNSAT TT=25.91
csp/queensKnights/ normalized-queensKnights-80-5-mul.xml	UNSAT TT=13.082	UNSAT TT=452.789 CHECKS=636801000 NODES=6318	UNSAT TT=632.74 CHECKS=665022000 NODES=0	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=698.007 ASSIGNMENTS=6399 CHECKS=821018000	UNSAT TT=668.806 ASSIGNMENTS=6399 CHECKS=821018000	? (TO) TT=1800.03	? (MO) TT=1692.69	No data	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=347.817	No data	UNSAT TT=13.082	UNSAT TT=26.406
csp/queensKnights/ normalized-queensKnights-8-5-add.xml	UNSAT TT=0.273	UNSAT TT=0.849 CHECKS=24172 NODES=52	UNSAT TT=0.82 CHECKS=29251 NODES=0	UNSAT TT=0.682	UNSAT TT=0.547 CHECKS=62972	UNSAT TT=8.467 CHECKS=3006820	UNSAT TT=1.059 ASSIGNMENTS=0	UNSAT TT=1.259 ASSIGNMENTS=0	UNSAT TT=0.678 CHECKS=60111 NODES=151	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=8.238 ASSIGNMENTS=62 CHECKS=33864	UNSAT TT=8.575 ASSIGNMENTS=302 CHECKS=6823	UNSAT TT=1.443	UNSAT TT=1.28	No data	UNSAT TT=3.23 ASSIGNMENTS=925 CHECKS=24534	UNSAT TT=22.899 ASSIGNMENTS=9175 CHECKS=294156	UNSAT TT=151.053	UNSAT TT=0.273 ASSIGNMENTS=369 CHECKS=22897	UNSAT TT=0.946 ASSIGNMENTS=302 CHECKS=6823	UNSAT TT=3.126	No data	UNSAT TT=0.689	UNSAT TT=0.739
csp/queensKnights/ normalized-queensKnights-8-5-mul.xml	UNSAT TT=0.757	UNSAT TT=0.845 CHECKS=28925 NODES=52	UNSAT TT=0.834 CHECKS=42313 NODES=0	UNSAT TT=0.776	UNSAT TT=0.711 CHECKS=118455	UNSAT TT=34.149 CHECKS=14475700	UNSAT TT=1.151 ASSIGNMENTS=0	UNSAT TT=1.366 ASSIGNMENTS=0	UNSAT TT=0.801 CHECKS=64541 NODES=159	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=8.666 ASSIGNMENTS=0	UNSAT TT=8.497 ASSIGNMENTS=62 CHECKS=37832	UNSAT TT=1.816	UNSAT TT=1.701	No data	UNSAT TT=2.879 ASSIGNMENTS=821 CHECKS=34332	UNSAT TT=21.81 ASSIGNMENTS=8568 CHECKS=378893	UNSAT TT=199.287	UNSAT TT=1.017 ASSIGNMENTS=437 CHECKS=42121	UNSAT TT=0.934 ASSIGNMENTS=273 CHECKS=13609	UNSAT TT=4.608	No data	UNSAT TT=0.757	UNSAT TT=0.822
csp/queens/ normalized-queens-100.xml	SAT TT=3.19	SAT TT=3.356 CHECKS=837102 NODES=179	SAT TT=3.19 CHECKS=551867 NODES=0	SAT TT=11.176	SAT TT=48.216 CHECKS=78137000	SAT TT=47.671 CHECKS=113701000	SAT TT=295.168 ASSIGNMENTS=4904	SAT TT=316.581 ASSIGNMENTS=4904	SAT TT=18.631 CHECKS=1501120 NODES=601	SAT TT=9.146 CHECKS=3004650 NODES=99	SAT TT=8.634 CHECKS=2965050 NODES=69	SAT TT=23.115 ASSIGNMENTS=92 CHECKS=1143800	SAT TT=10.575 ASSIGNMENTS=188 CHECKS=841630	SAT TT=258.006	SAT TT=45.711	No data	SAT TT=81.429 ASSIGNMENTS=6467 CHECKS=27832200	SAT TT=614.944 ASSIGNMENTS=22425 CHECKS=38872600	? (TO) TT=1800	? (TO) TT=1800.11	SAT TT=14.489 ASSIGNMENTS=92 CHECKS=1143800	SAT TT=202.366	No data	SAT TT=16.345	SAT TT=30.622
csp/queens/ normalized-queens-120.xml	SAT TT=4.492	SAT TT=4.492 CHECKS=1410660 NODES=214	SAT TT=5.379 CHECKS=2384650 NODES=214	SAT TT=8.252	SAT TT=110.367 CHECKS=216012000	SAT TT=22.086 CHECKS=44000700	SAT TT=505.86 ASSIGNMENTS=4210	SAT TT=556.302 ASSIGNMENTS=4210	SAT TT=38.366 CHECKS=2715810 NODES=691	SAT TT=17.191 CHECKS=4419660 NODES=65	SAT TT=17.37 CHECKS=5383560 NODES=99	SAT TT=13.286 ASSIGNMENTS=231 CHECKS=1468090	SAT TT=12.532 ASSIGNMENTS=231 CHECKS=1468090	SAT TT=608.25	SAT TT=74.058	No data	SAT TT=26.46 ASSIGNMENTS=112 CHECKS=1758840	SAT TT=91.796 ASSIGNMENTS=372 CHECKS=5970600	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=96.061 ASSIGNMENTS=634 CHECKS=7477280	? TT=609.795	No data	SAT TT=24.088	SAT TT=52.465
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/queens/ normalized-queens-12.xml	SAT TT=0.012	SAT TT=0.758 CHECKS=2093 NODES=26	SAT TT=0.775 CHECKS=3733 NODES=26	SAT TT=0.037	SAT TT=0.104 CHECKS=9682	SAT TT=0.018 CHECKS=33946	SAT TT=1.086 ASSIGNMENTS=22	SAT TT=1.165 ASSIGNMENTS=15	SAT TT=0.671 CHECKS=1273 NODES=28	SAT TT=0.676 CHECKS=7326 NODES=30	SAT TT=0.655 CHECKS=7656 NODES=22	SAT TT=0.023 ASSIGNMENTS=7 CHECKS=2131	SAT TT=0.023 ASSIGNMENTS=7 CHECKS=2131	SAT TT=1.455	SAT TT=1.449	No data	SAT TT=0.012 ASSIGNMENTS=7 CHECKS=2131	SAT TT=0.027 ASSIGNMENTS=134 CHECKS=19038	SAT TT=0.439	SAT TT=0.174 ASSIGNMENTS=868 CHECKS=131036	SAT TT=0.013 ASSIGNMENTS=8 CHECKS=2362	SAT TT=1.755	No data	SAT TT=0.684	SAT TT=0.844
csp/queens/ normalized-queens-150.xml	SAT TT=2.322	SAT TT=8.572 CHECKS=5298730 NODES=459	SAT TT=10.79 CHECKS=7248470 NODES=458	SAT TT=2.322	? (TO) TT=1800.12	SAT TT=96.065 CHECKS=187828000	SAT TT=1798.36 ASSIGNMENTS=29374	? (TO) TT=1800.08	SAT TT=101.628 CHECKS=8904790 NODES=1314	SAT TT=41.586 CHECKS=8906480 NODES=93	SAT TT=42.046 CHECKS=9565800 NODES=89	SAT TT=163.466 ASSIGNMENTS=440 CHECKS=8583920	SAT TT=17.033 ASSIGNMENTS=416 CHECKS=5075110	SAT TT=149.563	SAT TT=156.854	No data	SAT TT=71.854 ASSIGNMENTS=142 CHECKS=3434780	SAT TT=162.182 ASSIGNMENTS=302 CHECKS=7704080	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=162.049 ASSIGNMENTS=440 CHECKS=8583920	? TT=650.379	No data	SAT TT=28.431	SAT TT=106.835
csp/queens/ normalized-queens-180.xml	SAT TT=10.492	SAT TT=12.593 CHECKS=9178230 NODES=479	SAT TT=10.492 CHECKS=3764840 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=103.073 CHECKS=192000000	? (TO) TT=1800.18	? (TO) TT=1800.14	SAT TT=213.927 CHECKS=24891500 NODES=1642	SAT TT=92.91 CHECKS=16029400 NODES=131	SAT TT=92.254 CHECKS=16915500 NODES=116	SAT TT=198.963 ASSIGNMENTS=179 CHECKS=6618400	SAT TT=26.43 ASSIGNMENTS=668 CHECKS=12254900	SAT TT=278.703	SAT TT=266.598	No data	? (TO) TT=1800.06	SAT TT=364.084 ASSIGNMENTS=361 CHECKS=13342200	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=180.927 ASSIGNMENTS=179 CHECKS=6618400	? TT=536.207	No data	SAT TT=62.149	SAT TT=171.105
csp/queens/ normalized-queens-200.xml	SAT TT=4.379	SAT TT=15.969 CHECKS=13451000 NODES=528	SAT TT=19.605 CHECKS=18804900 NODES=528	SAT TT=4.379	SAT TT=218.419 CHECKS=367484000	SAT TT=39.141 CHECKS=39135100	? (TO) TT=1800.14	? (TO) TT=1800.16	SAT TT=376.822 CHECKS=48927100 NODES=1826	SAT TT=157.937 CHECKS=21591500 NODES=135	SAT TT=155.093 CHECKS=24278000 NODES=146	SAT TT=313.411 ASSIGNMENTS=223 CHECKS=8980140	SAT TT=29.586 ASSIGNMENTS=534 CHECKS=13549300	SAT TT=390.46	SAT TT=378.24	No data	SAT TT=268.442 ASSIGNMENTS=211 CHECKS=8081850	SAT TT=301.51 ASSIGNMENTS=186 CHECKS=8961030	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=293.91 ASSIGNMENTS=223 CHECKS=8980140	? TT=220.443	No data	SAT TT=132.042	SAT TT=214.313
csp/queens/ normalized-queens-30.xml	SAT TT=0.113	SAT TT=1.041 CHECKS=21234 NODES=72	SAT TT=1.072 CHECKS=36094 NODES=72	SAT TT=0.113	SAT TT=12.038 CHECKS=39991700	SAT TT=17.102 CHECKS=58695600	SAT TT=7.44 ASSIGNMENTS=328	SAT TT=740.767 ASSIGNMENTS=278790	SAT TT=1.281 CHECKS=12399 NODES=60	SAT TT=1.231 CHECKS=75255 NODES=25	SAT TT=1.222 CHECKS=75255 NODES=18	SAT TT=0.208 ASSIGNMENTS=132 CHECKS=130103	SAT TT=0.21 ASSIGNMENTS=132 CHECKS=130103	SAT TT=4.372	SAT TT=3.776	No data	SAT TT=0.147 ASSIGNMENTS=54 CHECKS=63529	SAT TT=2.283 ASSIGNMENTS=1633 CHECKS=1002980	? (TO) TT=1800.05	SAT TT=1.236 ASSIGNMENTS=347 CHECKS=416733	SAT TT=0.129 ASSIGNMENTS=31 CHECKS=37038	SAT TT=4.172	No data	SAT TT=1.468	SAT TT=1.935
csp/queens/ normalized-queens-4.xml	SAT TT=0.005	SAT TT=0.744 CHECKS=90 NODES=5	SAT TT=0.638 CHECKS=95 NODES=0	SAT TT=0.024	SAT TT=0.009 CHECKS=299	SAT TT=0.008 CHECKS=390	SAT TT=0.518 ASSIGNMENTS=2	SAT TT=0.589 ASSIGNMENTS=4	SAT TT=0.391 CHECKS=42 NODES=5	SAT TT=0.397 CHECKS=150 NODES=3	SAT TT=0.392 CHECKS=150 NODES=2	SAT TT=0.019 ASSIGNMENTS=2 CHECKS=33	SAT TT=0.018 ASSIGNMENTS=2 CHECKS=33	SAT TT=0.865	SAT TT=0.865	No data	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=33	SAT TT=0.006 ASSIGNMENTS=2 CHECKS=33	SAT TT=0.261	SAT TT=0.008 ASSIGNMENTS=2 CHECKS=33	SAT TT=0.005 ASSIGNMENTS=1 CHECKS=19	SAT TT=0.844	No data	SAT TT=0.451	SAT TT=0.444
csp/queens/ normalized-queens-80.xml	SAT TT=0.691	SAT TT=2.353 CHECKS=618851 NODES=246	SAT TT=2.543 CHECKS=895075 NODES=246	SAT TT=0.691	SAT TT=35.251 CHECKS=75887800	SAT TT=31.869 CHECKS=85717600	SAT TT=161.24 ASSIGNMENTS=4968	SAT TT=162.086 ASSIGNMENTS=4968	SAT TT=9.814 CHECKS=854665 NODES=593	SAT TT=5.014 CHECKS=1494680 NODES=73	SAT TT=4.922 CHECKS=1646360 NODES=71	SAT TT=24.143 ASSIGNMENTS=392 CHECKS=2348980	SAT TT=10.249 ASSIGNMENTS=263 CHECKS=640082	SAT TT=109.284	SAT TT=25.122	No data	SAT TT=101.104 ASSIGNMENTS=12252 CHECKS=43934300	SAT TT=335.144 ASSIGNMENTS=25931 CHECKS=27388000	? (TO) TT=1800.11	SAT TT=577.353 ASSIGNMENTS=23058 CHECKS=49633000	SAT TT=16.772 ASSIGNMENTS=392 CHECKS=2348980	SAT TT=97.318	No data	SAT TT=7.301	SAT TT=15.316
csp/queens/ normalized-queens-8.xml	SAT TT=0.009	SAT TT=0.694 CHECKS=1044 NODES=18	SAT TT=0.729 CHECKS=558 NODES=0	SAT TT=0.028	SAT TT=0.047 CHECKS=4337	SAT TT=0.012 CHECKS=9304	SAT TT=0.882 ASSIGNMENTS=24	SAT TT=0.802 ASSIGNMENTS=9	SAT TT=0.529 CHECKS=324 NODES=12	SAT TT=0.527 CHECKS=2156 NODES=21	SAT TT=0.507 CHECKS=4956 NODES=48	SAT TT=0.021 ASSIGNMENTS=8 CHECKS=1268	SAT TT=0.021 ASSIGNMENTS=8 CHECKS=1268	SAT TT=1.196	SAT TT=1.173	No data	SAT TT=0.011 ASSIGNMENTS=19 CHECKS=2489	SAT TT=0.009 ASSIGNMENTS=15 CHECKS=1286	SAT TT=0.321	SAT TT=0.023 ASSIGNMENTS=204 CHECKS=14571	SAT TT=0.009 ASSIGNMENTS=11 CHECKS=1309	SAT TT=1.431	No data	SAT TT=0.556	SAT TT=0.548
csp/QWH-10/ normalized-qwh-10-57-0_ext.xml	SAT TT=0.021	SAT TT=0.938 CHECKS=7497 NODES=101	SAT TT=1.016 CHECKS=24710 NODES=0	SAT TT=0.102	SAT TT=0.114 CHECKS=109640	SAT TT=0.04 CHECKS=14117	SAT TT=1.227 ASSIGNMENTS=4	SAT TT=0.937 ASSIGNMENTS=9	SAT TT=0.587 CHECKS=5245 NODES=108	SAT TT=0.646 CHECKS=25298 NODES=379	SAT TT=0.662 CHECKS=282044 NODES=745	SAT TT=0.034 ASSIGNMENTS=6 CHECKS=1067	SAT TT=0.033 ASSIGNMENTS=6 CHECKS=1067	SAT TT=1.49	SAT TT=1.438	No data	SAT TT=0.024 ASSIGNMENTS=6 CHECKS=1067	SAT TT=0.022 ASSIGNMENTS=19 CHECKS=3202	SAT TT=0.62	SAT TT=0.024 ASSIGNMENTS=33 CHECKS=3579	SAT TT=0.021 ASSIGNMENTS=6 CHECKS=1067	SAT TT=1.301	SAT TT=0.054 ASSIGNMENTS=103 CHECKS=34312	SAT TT=0.956	SAT TT=1.144
csp/QWH-10/ normalized-qwh-10-57-1_ext.xml	SAT TT=0.022	SAT TT=0.953 CHECKS=9265 NODES=145	SAT TT=1.02 CHECKS=19847 NODES=0	SAT TT=0.106	SAT TT=0.121 CHECKS=112630	SAT TT=0.049 CHECKS=33631	SAT TT=0.833 ASSIGNMENTS=5	SAT TT=1.051 ASSIGNMENTS=4	SAT TT=0.624 CHECKS=6626 NODES=153	SAT TT=0.621 CHECKS=61113 NODES=1221	SAT TT=0.867 CHECKS=84676 NODES=280	SAT TT=0.029 ASSIGNMENTS=32 CHECKS=4937	SAT TT=0.033 ASSIGNMENTS=32 CHECKS=4937	SAT TT=1.529	SAT TT=1.593	No data	SAT TT=0.022 ASSIGNMENTS=35 CHECKS=5718	SAT TT=0.024 ASSIGNMENTS=76 CHECKS=10042	SAT TT=0.824	SAT TT=0.026 ASSIGNMENTS=137 CHECKS=13855	SAT TT=0.023 ASSIGNMENTS=32 CHECKS=4937	SAT TT=1.301	SAT TT=0.055 ASSIGNMENTS=133 CHECKS=36754	SAT TT=0.992	SAT TT=1.001
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-10/ normalized-qwh-10-57-2_ext.xml	SAT TT=0.022	SAT TT=0.906 CHECKS=6664 NODES=100	SAT TT=0.934 CHECKS=7844 NODES=0	SAT TT=0.103	SAT TT=0.057 CHECKS=23137	SAT TT=0.04 CHECKS=24242	SAT TT=1.065 ASSIGNMENTS=5	SAT TT=1.029 ASSIGNMENTS=6	SAT TT=0.624 CHECKS=5485 NODES=116	SAT TT=0.644 CHECKS=43398 NODES=807	SAT TT=0.659 CHECKS=52021 NODES=148	SAT TT=0.036 ASSIGNMENTS=16 CHECKS=2059	SAT TT=0.036 ASSIGNMENTS=16 CHECKS=2059	SAT TT=1.609	SAT TT=1.56	No data	SAT TT=0.022 ASSIGNMENTS=16 CHECKS=2064	SAT TT=0.022 ASSIGNMENTS=38 CHECKS=4669	SAT TT=0.662	SAT TT=0.023 ASSIGNMENTS=111 CHECKS=12201	SAT TT=0.023 ASSIGNMENTS=16 CHECKS=2059	SAT TT=1.191	SAT TT=0.055 ASSIGNMENTS=139 CHECKS=38982	SAT TT=0.956	SAT TT=0.983
csp/QWH-10/ normalized-qwh-10-57-3_ext.xml	SAT TT=0.021	SAT TT=0.992 CHECKS=12727 NODES=204	SAT TT=0.938 CHECKS=17818 NODES=127	SAT TT=0.104	SAT TT=0.049 CHECKS=15467	SAT TT=0.036 CHECKS=4447	SAT TT=1.009 ASSIGNMENTS=5	SAT TT=1.184 ASSIGNMENTS=9	SAT TT=0.628 CHECKS=4820 NODES=104	SAT TT=0.622 CHECKS=20416 NODES=245	SAT TT=0.747 CHECKS=598645 NODES=1499	SAT TT=0.034 ASSIGNMENTS=36 CHECKS=3598	SAT TT=0.033 ASSIGNMENTS=36 CHECKS=3598	SAT TT=1.681	SAT TT=1.526	No data	SAT TT=0.023 ASSIGNMENTS=42 CHECKS=4846	SAT TT=0.022 ASSIGNMENTS=10 CHECKS=2112	SAT TT=0.652	SAT TT=0.023 ASSIGNMENTS=38 CHECKS=4571	SAT TT=0.021 ASSIGNMENTS=36 CHECKS=3598	SAT TT=1.279	SAT TT=0.053 ASSIGNMENTS=118 CHECKS=35943	SAT TT=1.127	SAT TT=1.175
csp/QWH-10/ normalized-qwh-10-57-4_ext.xml	SAT TT=0.02	SAT TT=0.936 CHECKS=7332 NODES=106	SAT TT=0.985 CHECKS=31345 NODES=237	SAT TT=0.105	SAT TT=0.098 CHECKS=81484	SAT TT=0.044 CHECKS=18791	SAT TT=1.015 ASSIGNMENTS=9	SAT TT=0.959 ASSIGNMENTS=8	SAT TT=0.588 CHECKS=4900 NODES=105	SAT TT=0.62 CHECKS=18288 NODES=181	SAT TT=0.654 CHECKS=72467 NODES=172	SAT TT=0.034 ASSIGNMENTS=20 CHECKS=2512	SAT TT=0.033 ASSIGNMENTS=20 CHECKS=2512	SAT TT=1.593	SAT TT=1.434	No data	SAT TT=0.023 ASSIGNMENTS=20 CHECKS=2518	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=2033	SAT TT=0.647	SAT TT=0.025 ASSIGNMENTS=58 CHECKS=6051	SAT TT=0.02 ASSIGNMENTS=20 CHECKS=2512	SAT TT=1.32	SAT TT=0.057 ASSIGNMENTS=139 CHECKS=38338	SAT TT=0.976	SAT TT=1.016
csp/QWH-10/ normalized-qwh-10-57-5_ext.xml	SAT TT=0.022	SAT TT=1.001 CHECKS=18178 NODES=384	SAT TT=0.984 CHECKS=20199 NODES=119	SAT TT=0.107	SAT TT=0.112 CHECKS=102120	SAT TT=0.035 CHECKS=3311	SAT TT=0.894 ASSIGNMENTS=9	SAT TT=0.953 ASSIGNMENTS=9	SAT TT=0.864 CHECKS=5122 NODES=112	SAT TT=0.62 CHECKS=31715 NODES=513	SAT TT=0.613 CHECKS=56968 NODES=137	SAT TT=0.035 ASSIGNMENTS=29 CHECKS=4622	SAT TT=0.037 ASSIGNMENTS=29 CHECKS=4622	SAT TT=1.448	SAT TT=1.678	No data	SAT TT=0.024 ASSIGNMENTS=30 CHECKS=5180	SAT TT=0.023 ASSIGNMENTS=14 CHECKS=1509	SAT TT=0.624	SAT TT=0.022 ASSIGNMENTS=25 CHECKS=2885	SAT TT=0.023 ASSIGNMENTS=29 CHECKS=4622	SAT TT=1.212	SAT TT=0.058 ASSIGNMENTS=109 CHECKS=35529	SAT TT=1.22	SAT TT=1.004
csp/QWH-10/ normalized-qwh-10-57-6_ext.xml	SAT TT=0.02	SAT TT=0.944 CHECKS=6803 NODES=101	SAT TT=0.869 CHECKS=6741 NODES=0	SAT TT=0.103	SAT TT=0.05 CHECKS=12703	SAT TT=0.032 CHECKS=3291	SAT TT=1.184 ASSIGNMENTS=12	SAT TT=0.961 ASSIGNMENTS=10	SAT TT=0.67 CHECKS=5941 NODES=126	SAT TT=0.653 CHECKS=27398 NODES=387	SAT TT=0.668 CHECKS=130105 NODES=368	SAT TT=0.033 ASSIGNMENTS=21 CHECKS=1267	SAT TT=0.035 ASSIGNMENTS=21 CHECKS=1267	SAT TT=1.69	SAT TT=1.608	No data	SAT TT=0.02 ASSIGNMENTS=21 CHECKS=1267	SAT TT=0.024 ASSIGNMENTS=19 CHECKS=2538	SAT TT=0.642	SAT TT=0.023 ASSIGNMENTS=60 CHECKS=6026	SAT TT=0.022 ASSIGNMENTS=21 CHECKS=1267	SAT TT=1.275	SAT TT=0.068 ASSIGNMENTS=101 CHECKS=34102	SAT TT=1.084	SAT TT=1.387
csp/QWH-10/ normalized-qwh-10-57-7_ext.xml	SAT TT=0.022	SAT TT=0.947 CHECKS=9127 NODES=139	SAT TT=1.096 CHECKS=29504 NODES=372	SAT TT=0.103	SAT TT=0.052 CHECKS=23299	SAT TT=0.043 CHECKS=16318	SAT TT=1.243 ASSIGNMENTS=13	SAT TT=1.104 ASSIGNMENTS=7	SAT TT=0.727 CHECKS=5340 NODES=114	SAT TT=0.643 CHECKS=24139 NODES=349	SAT TT=0.654 CHECKS=63343 NODES=156	SAT TT=0.033 ASSIGNMENTS=7 CHECKS=2240	SAT TT=0.033 ASSIGNMENTS=7 CHECKS=2240	SAT TT=1.581	SAT TT=1.524	No data	SAT TT=0.022 ASSIGNMENTS=8 CHECKS=2252	SAT TT=0.022 ASSIGNMENTS=6 CHECKS=1168	SAT TT=0.661	SAT TT=0.026 ASSIGNMENTS=113 CHECKS=14245	SAT TT=0.022 ASSIGNMENTS=7 CHECKS=2240	SAT TT=1.275	SAT TT=0.058 ASSIGNMENTS=175 CHECKS=40589	SAT TT=1.061	SAT TT=1.212
csp/QWH-10/ normalized-qwh-10-57-8_ext.xml	SAT TT=0.022	SAT TT=0.926 CHECKS=7294 NODES=106	SAT TT=0.931 CHECKS=15074 NODES=101	SAT TT=0.102	SAT TT=0.052 CHECKS=20077	SAT TT=0.037 CHECKS=7559	SAT TT=0.969 ASSIGNMENTS=11	SAT TT=0.988 ASSIGNMENTS=8	SAT TT=0.643 CHECKS=5458 NODES=114	SAT TT=0.638 CHECKS=24212 NODES=303	SAT TT=0.665 CHECKS=219994 NODES=597	SAT TT=0.035 ASSIGNMENTS=26 CHECKS=2839	SAT TT=0.035 ASSIGNMENTS=26 CHECKS=2839	SAT TT=1.468	SAT TT=1.531	No data	SAT TT=0.023 ASSIGNMENTS=19 CHECKS=2347	SAT TT=0.023 ASSIGNMENTS=30 CHECKS=3099	SAT TT=0.685	SAT TT=0.022 ASSIGNMENTS=19 CHECKS=2645	SAT TT=0.022 ASSIGNMENTS=26 CHECKS=2839	SAT TT=1.282	SAT TT=0.058 ASSIGNMENTS=172 CHECKS=41573	SAT TT=1.05	SAT TT=0.992
csp/QWH-10/ normalized-qwh-10-57-9_ext.xml	SAT TT=0.024	SAT TT=0.982 CHECKS=7193 NODES=103	SAT TT=0.904 CHECKS=7161 NODES=0	SAT TT=0.102	SAT TT=0.045 CHECKS=12762	SAT TT=0.036 CHECKS=2847	SAT TT=0.992 ASSIGNMENTS=14	SAT TT=0.991 ASSIGNMENTS=14	SAT TT=0.712 CHECKS=8291 NODES=226	SAT TT=0.616 CHECKS=27488 NODES=350	SAT TT=0.661 CHECKS=97250 NODES=237	SAT TT=0.048 ASSIGNMENTS=320 CHECKS=41940	SAT TT=0.047 ASSIGNMENTS=320 CHECKS=41940	SAT TT=1.84	SAT TT=1.591	No data	SAT TT=0.033 ASSIGNMENTS=267 CHECKS=35614	SAT TT=0.038 ASSIGNMENTS=708 CHECKS=51125	SAT TT=0.642	SAT TT=0.024 ASSIGNMENTS=132 CHECKS=11342	SAT TT=0.034 ASSIGNMENTS=320 CHECKS=41940	SAT TT=1.283	SAT TT=0.068 ASSIGNMENTS=101 CHECKS=33514	SAT TT=0.962	SAT TT=0.99
csp/QWH-15/ normalized-qwh-15-106-0_ext.xml	SAT TT=0.061	SAT TT=1.437 CHECKS=215823 NODES=1788	SAT TT=1.433 CHECKS=132580 NODES=1141	SAT TT=0.259	SAT TT=0.339 CHECKS=165410	SAT TT=0.249 CHECKS=138364	SAT TT=2.583 ASSIGNMENTS=20	SAT TT=2.382 ASSIGNMENTS=13	SAT TT=2.169 CHECKS=46802 NODES=775	SAT TT=1.547 CHECKS=235335 NODES=3316	SAT TT=1.807 CHECKS=858933 NODES=1279	SAT TT=0.072 ASSIGNMENTS=88 CHECKS=22046	SAT TT=0.074 ASSIGNMENTS=88 CHECKS=22046	SAT TT=2.5	SAT TT=2.525	No data	SAT TT=0.061 ASSIGNMENTS=103 CHECKS=20156	SAT TT=0.259 ASSIGNMENTS=4056 CHECKS=711439	SAT TT=1.98	SAT TT=0.098 ASSIGNMENTS=603 CHECKS=150810	SAT TT=0.063 ASSIGNMENTS=88 CHECKS=22046	SAT TT=2.651	SAT TT=2.485 ASSIGNMENTS=7855 CHECKS=1647510	SAT TT=1.558	SAT TT=1.881
csp/QWH-15/ normalized-qwh-15-106-1_ext.xml	SAT TT=0.21	SAT TT=2.429 CHECKS=1128980 NODES=8034	SAT TT=2.79 CHECKS=1260490 NODES=8323	SAT TT=0.323	SAT TT=13.252 CHECKS=10335300	SAT TT=9.845 CHECKS=8684920	SAT TT=1.741 ASSIGNMENTS=10	SAT TT=1.914 ASSIGNMENTS=7	SAT TT=12.09 CHECKS=551278 NODES=12658	SAT TT=1.673 CHECKS=534970 NODES=7873	? (TO) TT=1800.06	SAT TT=0.309 ASSIGNMENTS=3341 CHECKS=917609	SAT TT=0.305 ASSIGNMENTS=3341 CHECKS=917609	SAT TT=2.515	SAT TT=2.508	No data	SAT TT=0.21 ASSIGNMENTS=2257 CHECKS=602641	SAT TT=0.329 ASSIGNMENTS=5757 CHECKS=1014420	SAT TT=1.994	SAT TT=0.227 ASSIGNMENTS=2486 CHECKS=688388	SAT TT=0.292 ASSIGNMENTS=3341 CHECKS=917609	SAT TT=2.573	SAT TT=27.914 ASSIGNMENTS=130558 CHECKS=31653400	SAT TT=1.474	SAT TT=1.486
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-15/ normalized-qwh-15-106-2_ext.xml	SAT TT=0.076	SAT TT=1.374 CHECKS=104267 NODES=1223	SAT TT=1.611 CHECKS=266546 NODES=1937	SAT TT=0.283	SAT TT=3.981 CHECKS=2968070	SAT TT=1.324 CHECKS=1294420	SAT TT=2.455 ASSIGNMENTS=8	SAT TT=2.469 ASSIGNMENTS=17	SAT TT=2.125 CHECKS=42223 NODES=696	SAT TT=1.876 CHECKS=1008410 NODES=16561	SAT TT=1.414 CHECKS=261884 NODES=375	SAT TT=0.088 ASSIGNMENTS=258 CHECKS=79056	SAT TT=0.088 ASSIGNMENTS=258 CHECKS=79056	SAT TT=2.59	SAT TT=2.43	No data	SAT TT=0.078 ASSIGNMENTS=321 CHECKS=79702	SAT TT=0.3 ASSIGNMENTS=4428 CHECKS=884034	SAT TT=2.402	SAT TT=0.193 ASSIGNMENTS=1570 CHECKS=485926	SAT TT=0.076 ASSIGNMENTS=258 CHECKS=79056	SAT TT=2.442	SAT TT=10.249 ASSIGNMENTS=32104 CHECKS=17725100	SAT TT=1.322	SAT TT=1.629
csp/QWH-15/ normalized-qwh-15-106-3_ext.xml	SAT TT=0.068	SAT TT=1.453 CHECKS=58343 NODES=714	SAT TT=1.531 CHECKS=119389 NODES=1094	SAT TT=0.258	SAT TT=0.413 CHECKS=236147	SAT TT=0.238 CHECKS=143199	SAT TT=2.902 ASSIGNMENTS=22	SAT TT=2.791 ASSIGNMENTS=15	SAT TT=2.346 CHECKS=61010 NODES=1136	SAT TT=1.663 CHECKS=223561 NODES=2882	SAT TT=1.709 CHECKS=2403780 NODES=3030	SAT TT=0.129 ASSIGNMENTS=808 CHECKS=221305	SAT TT=0.128 ASSIGNMENTS=808 CHECKS=221305	SAT TT=2.484	SAT TT=2.525	No data	SAT TT=0.068 ASSIGNMENTS=127 CHECKS=28913	SAT TT=0.131 ASSIGNMENTS=1891 CHECKS=258609	SAT TT=1.667	SAT TT=0.088 ASSIGNMENTS=639 CHECKS=109322	SAT TT=0.119 ASSIGNMENTS=808 CHECKS=221305	SAT TT=2.576	SAT TT=0.406 ASSIGNMENTS=1238 CHECKS=305943	SAT TT=1.527	SAT TT=1.721
csp/QWH-15/ normalized-qwh-15-106-4_ext.xml	SAT TT=0.072	SAT TT=1.37 CHECKS=102231 NODES=1229	SAT TT=2.156 CHECKS=800977 NODES=5196	SAT TT=0.263	SAT TT=0.207 CHECKS=85489	SAT TT=0.125 CHECKS=31497	SAT TT=2.739 ASSIGNMENTS=20	SAT TT=2.551 ASSIGNMENTS=12	SAT TT=1.921 CHECKS=38606 NODES=585	SAT TT=1.862 CHECKS=959963 NODES=15578	SAT TT=3.161 CHECKS=11806900 NODES=11813	SAT TT=0.148 ASSIGNMENTS=827 CHECKS=315173	SAT TT=0.15 ASSIGNMENTS=827 CHECKS=315173	SAT TT=2.52	SAT TT=2.653	No data	SAT TT=0.072 ASSIGNMENTS=263 CHECKS=87698	SAT TT=0.171 ASSIGNMENTS=2596 CHECKS=469073	SAT TT=2.742	SAT TT=0.088 ASSIGNMENTS=570 CHECKS=152598	SAT TT=0.131 ASSIGNMENTS=827 CHECKS=315173	SAT TT=2.793	SAT TT=3.472 ASSIGNMENTS=17878 CHECKS=4092040	SAT TT=1.243	SAT TT=1.446
csp/QWH-15/ normalized-qwh-15-106-5_ext.xml	SAT TT=0.362	SAT TT=1.304 CHECKS=88361 NODES=1089	SAT TT=1.637 CHECKS=148427 NODES=1478	SAT TT=0.564	SAT TT=0.785 CHECKS=533850	SAT TT=1.519 CHECKS=1389770	SAT TT=2.517 ASSIGNMENTS=4	SAT TT=2.64 ASSIGNMENTS=9	SAT TT=2.217 CHECKS=52372 NODES=969	SAT TT=1.744 CHECKS=1007920 NODES=15831	? (TO) TT=1800.04	SAT TT=0.709 ASSIGNMENTS=8428 CHECKS=2414670	SAT TT=0.665 ASSIGNMENTS=8428 CHECKS=2414670	SAT TT=2.369	SAT TT=2.499	No data	SAT TT=0.362 ASSIGNMENTS=4473 CHECKS=1280560	SAT TT=0.415 ASSIGNMENTS=6466 CHECKS=1321430	SAT TT=4.412	SAT TT=0.378 ASSIGNMENTS=4031 CHECKS=1163710	SAT TT=0.693 ASSIGNMENTS=8428 CHECKS=2414670	SAT TT=3.096	SAT TT=1.435 ASSIGNMENTS=1271 CHECKS=391064	SAT TT=1.338	SAT TT=1.78
csp/QWH-15/ normalized-qwh-15-106-6_ext.xml	SAT TT=0.057	SAT TT=1.333 CHECKS=60314 NODES=803	SAT TT=1.319 CHECKS=61997 NODES=437	SAT TT=0.485	SAT TT=0.31 CHECKS=156435	SAT TT=0.213 CHECKS=108153	SAT TT=2.565 ASSIGNMENTS=17	SAT TT=2.38 ASSIGNMENTS=15	SAT TT=1.643 CHECKS=26207 NODES=392	SAT TT=1.499 CHECKS=117565 NODES=1256	SAT TT=1.622 CHECKS=1189680 NODES=1487	SAT TT=0.07 ASSIGNMENTS=57 CHECKS=8104	SAT TT=0.072 ASSIGNMENTS=57 CHECKS=8104	SAT TT=2.381	SAT TT=2.55	No data	SAT TT=0.063 ASSIGNMENTS=83 CHECKS=15568	SAT TT=0.223 ASSIGNMENTS=3906 CHECKS=600434	SAT TT=1.897	SAT TT=0.073 ASSIGNMENTS=391 CHECKS=60088	SAT TT=0.057 ASSIGNMENTS=57 CHECKS=8104	SAT TT=2.624	SAT TT=3.12 ASSIGNMENTS=15534 CHECKS=3419420	SAT TT=1.343	SAT TT=1.426
csp/QWH-15/ normalized-qwh-15-106-7_ext.xml	SAT TT=0.139	SAT TT=2.566 CHECKS=1279100 NODES=7906	SAT TT=1.802 CHECKS=431497 NODES=3295	SAT TT=0.508	SAT TT=8.292 CHECKS=6505890	SAT TT=0.619 CHECKS=511293	SAT TT=2.866 ASSIGNMENTS=33	SAT TT=2.779 ASSIGNMENTS=27	SAT TT=4.766 CHECKS=200271 NODES=3884	SAT TT=1.81 CHECKS=782172 NODES=12169	SAT TT=1.903 CHECKS=2910910 NODES=3825	SAT TT=0.187 ASSIGNMENTS=1641 CHECKS=471301	SAT TT=0.201 ASSIGNMENTS=1641 CHECKS=471301	SAT TT=2.515	SAT TT=2.675	No data	SAT TT=0.139 ASSIGNMENTS=1017 CHECKS=298371	SAT TT=0.166 ASSIGNMENTS=2230 CHECKS=379518	SAT TT=1.631	SAT TT=0.239 ASSIGNMENTS=2564 CHECKS=642280	SAT TT=0.187 ASSIGNMENTS=1641 CHECKS=471301	SAT TT=3.168	SAT TT=3.538 ASSIGNMENTS=14925 CHECKS=2825110	SAT TT=1.406	SAT TT=1.685
csp/QWH-15/ normalized-qwh-15-106-8_ext.xml	SAT TT=0.107	SAT TT=1.873 CHECKS=451515 NODES=3199	SAT TT=1.66 CHECKS=325371 NODES=2130	SAT TT=0.309	SAT TT=2.036 CHECKS=1459400	SAT TT=0.671 CHECKS=547997	SAT TT=1.645 ASSIGNMENTS=2	SAT TT=1.565 ASSIGNMENTS=2	SAT TT=3.954 CHECKS=157607 NODES=2629	SAT TT=4.079 CHECKS=5663200 NODES=97312	? (TO) TT=1800.08	SAT TT=0.131 ASSIGNMENTS=761 CHECKS=266823	SAT TT=0.138 ASSIGNMENTS=761 CHECKS=266823	SAT TT=2.539	SAT TT=2.528	No data	SAT TT=0.107 ASSIGNMENTS=562 CHECKS=197270	SAT TT=0.249 ASSIGNMENTS=4030 CHECKS=713042	SAT TT=3.065	SAT TT=0.112 ASSIGNMENTS=800 CHECKS=196145	SAT TT=0.13 ASSIGNMENTS=761 CHECKS=266823	SAT TT=2.659	SAT TT=2.398 ASSIGNMENTS=14266 CHECKS=3197610	SAT TT=1.337	SAT TT=1.449
csp/QWH-15/ normalized-qwh-15-106-9_ext.xml	SAT TT=0.058	SAT TT=1.429 CHECKS=182791 NODES=1754	SAT TT=1.42 CHECKS=89898 NODES=878	SAT TT=0.56	SAT TT=0.318 CHECKS=171747	SAT TT=0.241 CHECKS=139235	SAT TT=2.572 ASSIGNMENTS=38	SAT TT=2.367 ASSIGNMENTS=12	SAT TT=1.852 CHECKS=41959 NODES=734	SAT TT=1.545 CHECKS=259056 NODES=3564	SAT TT=1.71 CHECKS=1643710 NODES=2386	SAT TT=0.069 ASSIGNMENTS=54 CHECKS=9570	SAT TT=0.07 ASSIGNMENTS=54 CHECKS=9570	SAT TT=2.665	SAT TT=2.825	No data	SAT TT=0.062 ASSIGNMENTS=60 CHECKS=9931	SAT TT=0.177 ASSIGNMENTS=2798 CHECKS=433332	SAT TT=1.814	SAT TT=0.127 ASSIGNMENTS=1050 CHECKS=245841	SAT TT=0.058 ASSIGNMENTS=54 CHECKS=9570	SAT TT=2.655	SAT TT=5.304 ASSIGNMENTS=20708 CHECKS=3564490	SAT TT=1.427	SAT TT=1.528
csp/QWH-20/ normalized-qwh-20-166-0_ext.xml	SAT TT=2.236	SAT TT=15.508 CHECKS=11517500 NODES=50375	SAT TT=33.152 CHECKS=26904800 NODES=107063	SAT TT=89.149	SAT TT=243.652 CHECKS=174070000	SAT TT=90.837 CHECKS=60911100	SAT TT=6.908 ASSIGNMENTS=35	SAT TT=7.862 ASSIGNMENTS=72	SAT TT=63.922 CHECKS=1662390 NODES=27289	SAT TT=5.767 CHECKS=3769410 NODES=45728	? (TO) TT=1800.01	SAT TT=16.96 ASSIGNMENTS=529	SAT TT=21.421 ASSIGNMENTS=50375 CHECKS=11517500	SAT TT=3.999	SAT TT=3.936	No data	SAT TT=17.473 ASSIGNMENTS=169822 CHECKS=68856000	SAT TT=4.476 ASSIGNMENTS=42006 CHECKS=17449900	SAT TT=347.054	SAT TT=3.084 ASSIGNMENTS=28377 CHECKS=12348400	SAT TT=17.799 ASSIGNMENTS=170479 CHECKS=69731100	SAT TT=4.25	SAT TT=514.774 ASSIGNMENTS=2591790 CHECKS=545638000	SAT TT=2.236	SAT TT=2.563
csp/QWH-20/ normalized-qwh-20-166-1_ext.xml	SAT TT=1.716	SAT TT=8.83 CHECKS=5725340 NODES=25633	SAT TT=27.383 CHECKS=22496500 NODES=89605	SAT TT=1.716	SAT TT=150.916 CHECKS=96048600	SAT TT=18.888 CHECKS=8932730	SAT TT=8.995 ASSIGNMENTS=73	SAT TT=8.14 ASSIGNMENTS=10	SAT TT=24.986 CHECKS=618756 NODES=8848	SAT TT=27.535 CHECKS=51015800 NODES=638419	? (TO) TT=1800.03	SAT TT=9.819 ASSIGNMENTS=38	SAT TT=15.634 ASSIGNMENTS=25633 CHECKS=5725340	SAT TT=4.326	SAT TT=4.232	No data	SAT TT=3.883 ASSIGNMENTS=32061 CHECKS=14751700	SAT TT=4.154 ASSIGNMENTS=38437 CHECKS=16557200	SAT TT=174.528	SAT TT=3.513 ASSIGNMENTS=27702 CHECKS=13280200	SAT TT=5.499 ASSIGNMENTS=46586 CHECKS=21202900	SAT TT=4.941	? (TO) TT=1800.11	SAT TT=2.547	SAT TT=2.619
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-20/ normalized-qwh-20-166-2_ext.xml	SAT TT=2.183	SAT TT=83.832 CHECKS=70261400 NODES=306910	SAT TT=56.864 CHECKS=46400900 NODES=200566	SAT TT=122.216	? (TO) TT=1800.05	SAT TT=939.622 CHECKS=883736000	SAT TT=8.085 ASSIGNMENTS=17	SAT TT=9.044 ASSIGNMENTS=19	SAT TT=241.482 CHECKS=5534910 NODES=103299	SAT TT=51.245 CHECKS=98857800 NODES=1174550	? (TO) TT=1800	SAT TT=11.542 ASSIGNMENTS=132	SAT TT=97.886 ASSIGNMENTS=306910 CHECKS=70261400	SAT TT=4.186	SAT TT=4.251	No data	SAT TT=40.889 ASSIGNMENTS=425229 CHECKS=164033000	SAT TT=11.921 ASSIGNMENTS=126256 CHECKS=48426500	SAT TT=491.933	SAT TT=11.821 ASSIGNMENTS=116001 CHECKS=46881500	SAT TT=34.723 ASSIGNMENTS=353975 CHECKS=138431000	SAT TT=4.787	? (TO) TT=1800.05	SAT TT=2.183	SAT TT=2.407
csp/QWH-20/ normalized-qwh-20-166-3_ext.xml	SAT TT=2.38	SAT TT=62.008 CHECKS=50666800 NODES=209532	SAT TT=93.066 CHECKS=76454500 NODES=310267	SAT TT=15.367	SAT TT=90.834 CHECKS=60274500	SAT TT=25.778 CHECKS=11638200	SAT TT=7.173 ASSIGNMENTS=19	SAT TT=6.863 ASSIGNMENTS=29	SAT TT=24.426 CHECKS=534323 NODES=8388	SAT TT=5.774 CHECKS=3844450 NODES=47110	? (TO) TT=1800.03	SAT TT=10.404 ASSIGNMENTS=66	SAT TT=64.659 ASSIGNMENTS=209532 CHECKS=50666800	SAT TT=4.412	SAT TT=4.094	No data	SAT TT=8.938 ASSIGNMENTS=78624 CHECKS=34123200	SAT TT=11.541 ASSIGNMENTS=99621 CHECKS=46252900	SAT TT=881.654	SAT TT=3.465 ASSIGNMENTS=28585 CHECKS=13053700	SAT TT=13.355 ASSIGNMENTS=109728 CHECKS=51367400	SAT TT=5.251	? (TO) TT=1800.11	SAT TT=2.38	SAT TT=2.509
csp/QWH-20/ normalized-qwh-20-166-4_ext.xml	SAT TT=1.187	SAT TT=12.823 CHECKS=8778950 NODES=39697	SAT TT=4.969 CHECKS=2796380 NODES=13196	SAT TT=1.526	SAT TT=11.202 CHECKS=6001560	SAT TT=4.64 CHECKS=1976180	SAT TT=6.64 ASSIGNMENTS=16	SAT TT=6.771 ASSIGNMENTS=14	SAT TT=6.86 CHECKS=105061 NODES=1322	SAT TT=5.26 CHECKS=2580650 NODES=31537	? (TO) TT=1800.09	SAT TT=9.195 ASSIGNMENTS=31	SAT TT=19.445 ASSIGNMENTS=39697 CHECKS=8778950	SAT TT=4.032	SAT TT=4.122	No data	SAT TT=2.256 ASSIGNMENTS=20693 CHECKS=8539040	SAT TT=3.589 ASSIGNMENTS=34287 CHECKS=13839200	SAT TT=199.061	SAT TT=1.187 ASSIGNMENTS=9389 CHECKS=4318250	SAT TT=1.814 ASSIGNMENTS=15648 CHECKS=6886240	SAT TT=4.486	SAT TT=169.447 ASSIGNMENTS=653808 CHECKS=191929000	SAT TT=2.085	SAT TT=2.726
csp/QWH-20/ normalized-qwh-20-166-5_ext.xml	SAT TT=1.941	SAT TT=13.167 CHECKS=9460090 NODES=45533	SAT TT=5.874 CHECKS=3123370 NODES=15218	SAT TT=1.941	SAT TT=6.84 CHECKS=3567520	SAT TT=23.014 CHECKS=11522400	SAT TT=8.518 ASSIGNMENTS=208	SAT TT=6.192 ASSIGNMENTS=10	SAT TT=141.922 CHECKS=3499360 NODES=62078	SAT TT=6.608 CHECKS=4091910 NODES=50111	? (TO) TT=1800.09	SAT TT=9.495 ASSIGNMENTS=32	SAT TT=20.402 ASSIGNMENTS=45533 CHECKS=9460090	SAT TT=4.246	SAT TT=4.243	No data	SAT TT=3.746 ASSIGNMENTS=35579 CHECKS=14496900	SAT TT=12.308 ASSIGNMENTS=110498 CHECKS=48128900	SAT TT=114.592	SAT TT=7.746 ASSIGNMENTS=71292 CHECKS=30423800	SAT TT=15.366 ASSIGNMENTS=135868 CHECKS=60617800	SAT TT=4.596	SAT TT=316.2 ASSIGNMENTS=1555780 CHECKS=348153000	SAT TT=1.983	SAT TT=2.179
csp/QWH-20/ normalized-qwh-20-166-6_ext.xml	SAT TT=2.093	SAT TT=678.38 CHECKS=578453000 NODES=2289160	SAT TT=733.98 CHECKS=617480000 NODES=2449220	SAT TT=26.211	SAT TT=630.792 CHECKS=426506000	SAT TT=743.975 CHECKS=686394000	SAT TT=13.455 ASSIGNMENTS=355	SAT TT=7.137 ASSIGNMENTS=35	SAT TT=1023.6 CHECKS=30148200 NODES=484442	SAT TT=19.064 CHECKS=31813800 NODES=396025	? (TO) TT=1800	SAT TT=14.513 ASSIGNMENTS=344	SAT TT=627.073 ASSIGNMENTS=780693 CHECKS=308737000	SAT TT=4	SAT TT=4.761	No data	SAT TT=72.722 ASSIGNMENTS=647024 CHECKS=282775000	SAT TT=95.031 ASSIGNMENTS=1011610 CHECKS=402841000	SAT TT=780.898	SAT TT=184.517 ASSIGNMENTS=1777640 CHECKS=709264000	SAT TT=75.137 ASSIGNMENTS=780693 CHECKS=308737000	SAT TT=4.22	? (TO) TT=1800.05	SAT TT=2.093	SAT TT=3.218
csp/QWH-20/ normalized-qwh-20-166-7_ext.xml	SAT TT=0.958	SAT TT=41.942 CHECKS=33707000 NODES=127619	SAT TT=11.904 CHECKS=9003780 NODES=38014	SAT TT=0.958	SAT TT=100.448 CHECKS=72003400	SAT TT=112.313 CHECKS=89976700	SAT TT=8.087 ASSIGNMENTS=51	SAT TT=7.975 ASSIGNMENTS=27	SAT TT=205.782 CHECKS=5035250 NODES=87964	SAT TT=12.327 CHECKS=18455200 NODES=226394	? (TO) TT=1800.1	SAT TT=15.568 ASSIGNMENTS=51	SAT TT=44.722 ASSIGNMENTS=127619 CHECKS=33707000	SAT TT=3.735	SAT TT=4.041	No data	SAT TT=3.465 ASSIGNMENTS=28393 CHECKS=13047700	SAT TT=11.602 ASSIGNMENTS=116825 CHECKS=49517700	SAT TT=441.75	SAT TT=6.603 ASSIGNMENTS=58019 CHECKS=24849900	SAT TT=3.53 ASSIGNMENTS=31841 CHECKS=14313600	SAT TT=4.18	? (TO) TT=1800.04	SAT TT=2.229	SAT TT=2.585
csp/QWH-20/ normalized-qwh-20-166-8_ext.xml	SAT TT=2.007	SAT TT=84.218 CHECKS=71402200 NODES=272925	SAT TT=21.75 CHECKS=16821300 NODES=69120	SAT TT=71.257	SAT TT=896.464 CHECKS=647662000	SAT TT=20.241 CHECKS=10284500	SAT TT=8.278 ASSIGNMENTS=120	SAT TT=6.99 ASSIGNMENTS=39	SAT TT=83.253 CHECKS=2131390 NODES=38238	SAT TT=5.235 CHECKS=2514800 NODES=29043	? (TO) TT=1800.08	SAT TT=10.001 ASSIGNMENTS=70	SAT TT=83.624 ASSIGNMENTS=272925 CHECKS=71402200	SAT TT=3.843	SAT TT=3.811	No data	SAT TT=8.494 ASSIGNMENTS=80871 CHECKS=33500100	SAT TT=7.827 ASSIGNMENTS=80558 CHECKS=33414100	SAT TT=306.823	SAT TT=4.492 ASSIGNMENTS=40807 CHECKS=19010900	SAT TT=8.109 ASSIGNMENTS=77692 CHECKS=31563100	SAT TT=4.437	SAT TT=229.047 ASSIGNMENTS=480934 CHECKS=134917000	SAT TT=2.007	SAT TT=2.519
csp/QWH-20/ normalized-qwh-20-166-9_ext.xml	SAT TT=0.841	SAT TT=21.36 CHECKS=16379600 NODES=73618	SAT TT=11.699 CHECKS=7600770 NODES=35262	SAT TT=0.846	SAT TT=428.237 CHECKS=317784000	SAT TT=2.296 CHECKS=665759	SAT TT=7.477 ASSIGNMENTS=80	SAT TT=6.889 ASSIGNMENTS=30	SAT TT=8.993 CHECKS=175160 NODES=2514	SAT TT=6.216 CHECKS=4654520 NODES=58992	? (TO) TT=1800	SAT TT=10.124 ASSIGNMENTS=96	SAT TT=27.502 ASSIGNMENTS=73618 CHECKS=16379600	SAT TT=3.943	SAT TT=4.088	No data	SAT TT=3.675 ASSIGNMENTS=29011 CHECKS=14404000	SAT TT=0.841 ASSIGNMENTS=8644 CHECKS=2821260	SAT TT=63.026	SAT TT=3.088 ASSIGNMENTS=27411 CHECKS=13017300	SAT TT=2.932 ASSIGNMENTS=24655 CHECKS=12165800	SAT TT=4.431	? (TO) TT=1800.08	SAT TT=2.212	SAT TT=2.494
csp/QWH-25/ normalized-qwh-25-235-0_ext.xml	SAT TT=19.9	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=399.005 ASSIGNMENTS=9494	SAT TT=335.483 ASSIGNMENTS=5457	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=343.013 ASSIGNMENTS=7890	SAT TT=991.238 ASSIGNMENTS=7890	SAT TT=48.226	SAT TT=22.389	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=32.764	? (TO) TT=1800.12	SAT TT=86.579	SAT TT=19.9
csp/QWH-25/ normalized-qwh-25-235-1_ext.xml	SAT TT=7.361	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=23.131 ASSIGNMENTS=198	SAT TT=65.014 ASSIGNMENTS=960	? (TO) TT=1800	SAT TT=963.326 CHECKS=1345400000 NODES=13734500	? (TO) TT=1800.05	SAT TT=23.459 ASSIGNMENTS=334	SAT TT=690.394 ASSIGNMENTS=334	SAT TT=8.505	SAT TT=7.361	No data	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=640.229 ASSIGNMENTS=4632240 CHECKS=2618280000	? (TO) TT=1800.06	SAT TT=9.069	? (TO) TT=1800.15	SAT TT=9.755	SAT TT=7.458
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-25/ normalized-qwh-25-235-2_ext.xml	SAT TT=5.692	? (TO) TT=1800.14	SAT TT=1532.01 CHECKS=1246070000 NODES=4261460	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=22.389 ASSIGNMENTS=195	SAT TT=27.407 ASSIGNMENTS=206	? (TO) TT=1800.02	SAT TT=140.889 CHECKS=193682000 NODES=1935340	? (TO) TT=1800	SAT TT=124.7 ASSIGNMENTS=2703	SAT TT=772.638 ASSIGNMENTS=2703	SAT TT=9.178	SAT TT=8.742	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=179.871 ASSIGNMENTS=1445520 CHECKS=711821000	? (TO) TT=1800.02	SAT TT=10.874	? (TO) TT=1800.14	SAT TT=5.692	SAT TT=8.045
csp/QWH-25/ normalized-qwh-25-235-3_ext.xml	SAT TT=6.393	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=63.268 ASSIGNMENTS=1043	SAT TT=29.985 ASSIGNMENTS=163	? (TO) TT=1800.09	SAT TT=95.901 CHECKS=131244000 NODES=1347400	? (TO) TT=1800.09	SAT TT=59.641 ASSIGNMENTS=1055	SAT TT=726.237 ASSIGNMENTS=1055	SAT TT=7.524	SAT TT=9.301	No data	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=8.943	? (TO) TT=1800.14	SAT TT=7.895	SAT TT=6.393
csp/QWH-25/ normalized-qwh-25-235-4_ext.xml	SAT TT=5.744	SAT TT=851.102 CHECKS=691923000 NODES=2374620	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=98.695 ASSIGNMENTS=2144	SAT TT=24.8 ASSIGNMENTS=201	? (TO) TT=1800.07	SAT TT=277.508 CHECKS=419937000 NODES=4227880	? (TO) TT=1800.05	SAT TT=199.635 ASSIGNMENTS=4963	SAT TT=845.541 ASSIGNMENTS=4963	SAT TT=14.262	SAT TT=8.012	No data	? (TO) TT=1800.03	SAT TT=54.891 ASSIGNMENTS=407004 CHECKS=226938000	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=6.335	? (TO) TT=1800.14	SAT TT=9.52	SAT TT=5.744
csp/QWH-25/ normalized-qwh-25-235-5_ext.xml	SAT TT=2.685	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=43.613 ASSIGNMENTS=542	SAT TT=20.195 ASSIGNMENTS=87	? (TO) TT=1800.06	SAT TT=984.404 CHECKS=1513140000 NODES=15523500	? (TO) TT=1800.06	SAT TT=97.5 ASSIGNMENTS=1745	SAT TT=757.572 ASSIGNMENTS=1745	SAT TT=7.827	SAT TT=8.491	No data	? (TO) TT=1800.1	SAT TT=826.678 ASSIGNMENTS=6686550 CHECKS=3398580000	? (TO) TT=1800.06	SAT TT=238.706 ASSIGNMENTS=1894360 CHECKS=946654000	? (TO) TT=1800.08	SAT TT=10.604	? (TO) TT=1800.08	SAT TT=2.685	SAT TT=8.27
csp/QWH-25/ normalized-qwh-25-235-6_ext.xml	SAT TT=5.536	SAT TT=416.661 CHECKS=367598000 NODES=1287530	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=26.723 ASSIGNMENTS=267	SAT TT=24.777 ASSIGNMENTS=197	? (TO) TT=1800.01	SAT TT=1118.34 CHECKS=1752430000 NODES=17638400	? (TO) TT=1800.08	SAT TT=63.076 ASSIGNMENTS=1413	SAT TT=466.091 ASSIGNMENTS=1287530 CHECKS=367598000	SAT TT=9.066	SAT TT=9.045	No data	SAT TT=1338.31 ASSIGNMENTS=11559000 CHECKS=1437760000	? (TO) TT=1800.02	SAT TT=1275.86	SAT TT=1610.55 ASSIGNMENTS=13712000 CHECKS=2365100000	? (TO) TT=1800.11	SAT TT=5.74	? (TO) TT=1800.14	SAT TT=5.774	SAT TT=5.536
csp/QWH-25/ normalized-qwh-25-235-7_ext.xml	SAT TT=9.976	? (TO) TT=1800.15	SAT TT=1012.88 CHECKS=891983000 NODES=3159650	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=1078.93 ASSIGNMENTS=28993	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=34.93 CHECKS=34652100 NODES=353146	? (TO) TT=1800.02	SAT TT=94.405 ASSIGNMENTS=2075	SAT TT=736.61 ASSIGNMENTS=2075	SAT TT=16.464	SAT TT=9.976	No data	SAT TT=1439.83 ASSIGNMENTS=12193300 CHECKS=1970930000	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=53.854	? (TO) TT=1800.06	SAT TT=83.951	SAT TT=25.78
csp/QWH-25/ normalized-qwh-25-235-8_ext.xml	SAT TT=6.162	? (TO) TT=1800.16	SAT TT=1328.48 CHECKS=1127200000 NODES=3879170	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=389.248 ASSIGNMENTS=8273	SAT TT=34.871 ASSIGNMENTS=381	? (TO) TT=1800.03	SAT TT=75.15 CHECKS=86619000 NODES=872996	? (TO) TT=1800.04	SAT TT=17.73 ASSIGNMENTS=208	SAT TT=684.913 ASSIGNMENTS=208	SAT TT=7.592	SAT TT=9.335	No data	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=17.327	? (TO) TT=1800.15	SAT TT=6.162	SAT TT=10.321
csp/QWH-25/ normalized-qwh-25-235-9_ext.xml	SAT TT=7.719	SAT TT=1123.08 CHECKS=890204000 NODES=3172820	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=376.323 ASSIGNMENTS=8346	SAT TT=19.661 ASSIGNMENTS=90	? (TO) TT=1800.01	SAT TT=147.261 CHECKS=195806000 NODES=2003980	? (TO) TT=1800.06	SAT TT=374.027 ASSIGNMENTS=8346	SAT TT=1066.64 ASSIGNMENTS=8346	SAT TT=8.724	SAT TT=7.719	No data	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=723.251 ASSIGNMENTS=5604060 CHECKS=2888380000	? (TO) TT=1800.07	SAT TT=23.533	? (TO) TT=1800.13	SAT TT=17.934	SAT TT=8.402
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-0.xml	SAT TT=0.037	SAT TT=1.99 CHECKS=274420 NODES=359	SAT TT=1.908 CHECKS=375817 NODES=217	SAT TT=1786.74	SAT TT=0.734 CHECKS=17338	SAT TT=0.143 CHECKS=11211	SAT TT=1.577 ASSIGNMENTS=202	SAT TT=2.202 ASSIGNMENTS=93	SAT TT=123.874 CHECKS=214630 NODES=312	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=0.058 ASSIGNMENTS=144 CHECKS=14389	SAT TT=0.056 ASSIGNMENTS=144 CHECKS=14389	? (problem) TT=113.8	? (problem) TT=111.747	No data	SAT TT=0.044 ASSIGNMENTS=134 CHECKS=12242	SAT TT=0.044 ASSIGNMENTS=376 CHECKS=18579	? TT=0.303	SAT TT=0.039 ASSIGNMENTS=102 CHECKS=5235	SAT TT=0.037 ASSIGNMENTS=110 CHECKS=5330	? (TO) TT=1802.39	No data	SAT TT=1.335	SAT TT=1.716
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-18.xml	UNSAT TT=0.034	UNSAT TT=1.709 CHECKS=262672 NODES=0	UNSAT TT=1.817 CHECKS=262672 NODES=0	UNSAT TT=0.081	UNSAT TT=0.641 CHECKS=123	UNSAT TT=0.078 CHECKS=123	UNSAT TT=1.085 ASSIGNMENTS=0	UNSAT TT=0.927 ASSIGNMENTS=0	UNSAT TT=130.956 CHECKS=4936 NODES=0	UNSAT TT=92.215 CHECKS=5476 NODES=0	UNSAT TT=93.858 CHECKS=5476 NODES=0	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=1025	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=1025	? (problem) TT=113.654	? (problem) TT=115.62	No data	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1025	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1025	? TT=0.343	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1025	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1025	? TT=630.553	No data	UNSAT TT=1.311	UNSAT TT=1.633
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-19.xml	UNSAT TT=0.033	UNSAT TT=1.494 CHECKS=21697 NODES=0	UNSAT TT=1.396 CHECKS=21697 NODES=0	UNSAT TT=0.083	UNSAT TT=0.652 CHECKS=133	UNSAT TT=0.07 CHECKS=133	UNSAT TT=0.914 ASSIGNMENTS=0	UNSAT TT=1.137 ASSIGNMENTS=0	UNSAT TT=136.984 CHECKS=16818800 NODES=0	UNSAT TT=97.564 CHECKS=16818800 NODES=0	UNSAT TT=111.113 CHECKS=16818800 NODES=0	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1835	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1835	? (problem) TT=124.348	? (problem) TT=126.262	No data	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1835	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1835	? TT=0.373	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=1835	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1835	? (TO) TT=1802.16	No data	UNSAT TT=1.324	UNSAT TT=1.507
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-1.xml	UNSAT TT=0.032	UNSAT TT=1.333 CHECKS=72974 NODES=0	UNSAT TT=1.344 CHECKS=72974 NODES=0	UNSAT TT=0.085	UNSAT TT=0.64 CHECKS=134	UNSAT TT=0.063 CHECKS=134	UNSAT TT=0.897 ASSIGNMENTS=0	UNSAT TT=0.929 ASSIGNMENTS=0	UNSAT TT=135.277 CHECKS=177618 NODES=0	UNSAT TT=180.016 CHECKS=177618 NODES=0	UNSAT TT=161.983 CHECKS=177618 NODES=0	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=1738	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=1738	? (problem) TT=119.52	? (problem) TT=119.949	No data	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1738	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1738	? TT=0.372	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=1738	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=1738	? TT=265.782	No data	UNSAT TT=1.433	UNSAT TT=1.327
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-21.xml	SAT TT=0.04	SAT TT=5.034 CHECKS=2286150 NODES=238	SAT TT=5.482 CHECKS=2422120 NODES=152	? (TO) TT=1800.03	SAT TT=0.802 CHECKS=3897	SAT TT=0.13 CHECKS=3836	SAT TT=1.603 ASSIGNMENTS=122	SAT TT=2.134 ASSIGNMENTS=100	SAT TT=130.515 CHECKS=5678540 NODES=526	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=0.053 ASSIGNMENTS=102 CHECKS=5317	SAT TT=0.054 ASSIGNMENTS=102 CHECKS=5317	? (problem) TT=131.499	? (problem) TT=125.393	No data	SAT TT=0.04 ASSIGNMENTS=109 CHECKS=5905	SAT TT=0.043 ASSIGNMENTS=179 CHECKS=9126	? TT=0.359	SAT TT=0.112 ASSIGNMENTS=782 CHECKS=58762	SAT TT=0.048 ASSIGNMENTS=173 CHECKS=15422	? TT=1717.13	No data	SAT TT=1.574	SAT TT=1.533
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-22.xml	SAT TT=0.036	SAT TT=3.5 CHECKS=1159850 NODES=151	SAT TT=26.005 CHECKS=13977300 NODES=288	? (TO) TT=1800.08	SAT TT=0.635 CHECKS=6818	SAT TT=0.091 CHECKS=6096	SAT TT=1.512 ASSIGNMENTS=111	SAT TT=1.87 ASSIGNMENTS=101	SAT TT=116.951 CHECKS=16955000 NODES=182	SAT TT=1187.78 CHECKS=110177000 NODES=1633050000	? (TO) TT=1800.05	SAT TT=0.049 ASSIGNMENTS=114 CHECKS=5420	SAT TT=0.048 ASSIGNMENTS=114 CHECKS=5420	? (problem) TT=119.445	? (problem) TT=109.979	No data	SAT TT=0.038 ASSIGNMENTS=110 CHECKS=5394	SAT TT=0.045 ASSIGNMENTS=428 CHECKS=20474	? TT=0.375	SAT TT=0.105 ASSIGNMENTS=884 CHECKS=49855	SAT TT=0.036 ASSIGNMENTS=106 CHECKS=4578	? TT=250.865	No data	SAT TT=1.392	SAT TT=1.413
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-23.xml	SAT TT=0.037	SAT TT=55.014 CHECKS=28898600 NODES=322	SAT TT=4.636 CHECKS=1847930 NODES=144	SAT TT=0.086	SAT TT=0.67 CHECKS=3248	SAT TT=0.085 CHECKS=3266	SAT TT=1.455 ASSIGNMENTS=103	SAT TT=2.043 ASSIGNMENTS=97	SAT TT=138.042 CHECKS=16979700 NODES=255	SAT TT=742.013 CHECKS=63239200 NODES=967800000	? (TO) TT=1800.1	SAT TT=0.046 ASSIGNMENTS=97 CHECKS=4764	SAT TT=0.051 ASSIGNMENTS=97 CHECKS=4764	? (problem) TT=93.396	? (problem) TT=84.924	No data	SAT TT=0.037 ASSIGNMENTS=97 CHECKS=4764	SAT TT=0.04 ASSIGNMENTS=217 CHECKS=8971	? TT=0.368	SAT TT=0.044 ASSIGNMENTS=199 CHECKS=8461	SAT TT=0.043 ASSIGNMENTS=106 CHECKS=7137	? TT=714.92	No data	SAT TT=1.613	SAT TT=1.572
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-27.xml	SAT TT=0.044	SAT TT=3.492 CHECKS=1407370 NODES=146	SAT TT=3.708 CHECKS=1577680 NODES=202	SAT TT=0.09	SAT TT=0.8 CHECKS=3005	SAT TT=0.109 CHECKS=2834	SAT TT=1.551 ASSIGNMENTS=238	SAT TT=2.153 ASSIGNMENTS=105	SAT TT=124.316 CHECKS=4595180 NODES=326	? (TO) TT=1800.04	? (TO) TT=1800	SAT TT=0.057 ASSIGNMENTS=145 CHECKS=10547	SAT TT=0.058 ASSIGNMENTS=145 CHECKS=10547	? (problem) TT=115.985	? (problem) TT=119.797	No data	SAT TT=0.044 ASSIGNMENTS=154 CHECKS=11097	SAT TT=0.044 ASSIGNMENTS=294 CHECKS=14090	? TT=0.374	SAT TT=0.049 ASSIGNMENTS=166 CHECKS=8262	SAT TT=0.044 ASSIGNMENTS=120 CHECKS=8742	? (TO) TT=1802.22	No data	SAT TT=1.447	SAT TT=1.631
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-2.xml	UNSAT TT=0.035	UNSAT TT=1.586 CHECKS=128206 NODES=0	UNSAT TT=1.466 CHECKS=128206 NODES=0	UNSAT TT=0.086	UNSAT TT=0.687 CHECKS=160	UNSAT TT=0.077 CHECKS=160	UNSAT TT=0.896 ASSIGNMENTS=0	UNSAT TT=0.921 ASSIGNMENTS=0	UNSAT TT=133.455 CHECKS=90382 NODES=0	UNSAT TT=97.355 CHECKS=90382 NODES=0	UNSAT TT=89.501 CHECKS=90382 NODES=0	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1786	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1786	? (problem) TT=101.339	? (problem) TT=105.23	No data	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1786	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1786	? TT=0.326	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1786	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1786	? TT=273.915	No data	UNSAT TT=1.425	UNSAT TT=1.475
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-30.xml	SAT TT=0.041	SAT TT=1.648 CHECKS=173726 NODES=145	SAT TT=2.291 CHECKS=487017 NODES=226	SAT TT=1346.68	SAT TT=0.861 CHECKS=12192	SAT TT=0.117 CHECKS=4498	SAT TT=1.367 ASSIGNMENTS=112	SAT TT=2.513 ASSIGNMENTS=141	SAT TT=140.548 CHECKS=197525 NODES=317	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=0.053 ASSIGNMENTS=120 CHECKS=7452	SAT TT=0.054 ASSIGNMENTS=120 CHECKS=7452	? (problem) TT=126.746	? (problem) TT=126.476	No data	SAT TT=0.041 ASSIGNMENTS=154 CHECKS=10237	SAT TT=0.056 ASSIGNMENTS=677 CHECKS=40546	? TT=0.321	SAT TT=0.127 ASSIGNMENTS=909 CHECKS=68874	SAT TT=0.041 ASSIGNMENTS=106 CHECKS=5987	? TT=1450.08	No data	SAT TT=1.385	SAT TT=1.55
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-32.xml	UNSAT TT=0.036	UNSAT TT=1.499 CHECKS=26931 NODES=0	UNSAT TT=1.404 CHECKS=26931 NODES=0	UNSAT TT=0.088	UNSAT TT=0.791 CHECKS=179	UNSAT TT=0.094 CHECKS=179	UNSAT TT=0.926 ASSIGNMENTS=0	UNSAT TT=1.116 ASSIGNMENTS=0	UNSAT TT=143.389 CHECKS=67209300 NODES=0	UNSAT TT=183.406 CHECKS=67209800 NODES=0	UNSAT TT=176.201 CHECKS=67209800 NODES=0	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=1946	UNSAT TT=0.05 ASSIGNMENTS=0 CHECKS=1946	? (problem) TT=99.932	? (problem) TT=107.409	No data	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1946	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1946	? TT=0.361	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1946	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=1946	? (TO) TT=1802.27	No data	UNSAT TT=1.417	UNSAT TT=1.308
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-40.xml	SAT TT=0.037	SAT TT=3.602 CHECKS=1164390 NODES=151	SAT TT=7.64 CHECKS=3591000 NODES=210	SAT TT=1340.93	SAT TT=0.845 CHECKS=5685	SAT TT=0.159 CHECKS=5604	SAT TT=1.404 ASSIGNMENTS=152	SAT TT=2.2 ASSIGNMENTS=101	SAT TT=137.814 CHECKS=16856500 NODES=150	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=0.056 ASSIGNMENTS=116 CHECKS=6784	SAT TT=0.05 ASSIGNMENTS=116 CHECKS=6784	? (problem) TT=122.328	? (problem) TT=137.343	No data	SAT TT=0.041 ASSIGNMENTS=117 CHECKS=6827	SAT TT=0.037 ASSIGNMENTS=96 CHECKS=4930	? TT=0.381	SAT TT=0.081 ASSIGNMENTS=551 CHECKS=37743	SAT TT=0.041 ASSIGNMENTS=109 CHECKS=5838	? TT=256.108	No data	SAT TT=1.287	SAT TT=1.391
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-41.xml	UNSAT TT=0.035	UNSAT TT=1.427 CHECKS=28388 NODES=0	UNSAT TT=1.293 CHECKS=28388 NODES=0	UNSAT TT=0.084	UNSAT TT=0.677 CHECKS=119	UNSAT TT=0.075 CHECKS=119	UNSAT TT=0.955 ASSIGNMENTS=0	UNSAT TT=1.126 ASSIGNMENTS=0	UNSAT TT=122.74 CHECKS=77911 NODES=0	UNSAT TT=86.069 CHECKS=77911 NODES=0	UNSAT TT=96.238 CHECKS=77911 NODES=0	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1032	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1032	? (problem) TT=98.583	? (problem) TT=99.159	No data	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1032	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1032	? TT=0.323	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1032	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1032	? TT=854.754	No data	UNSAT TT=1.516	UNSAT TT=1.388
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-44.xml	UNSAT TT=0.034	UNSAT TT=2.761 CHECKS=1051290 NODES=0	UNSAT TT=2.871 CHECKS=1051290 NODES=0	UNSAT TT=0.083	UNSAT TT=0.687 CHECKS=170	UNSAT TT=0.074 CHECKS=170	UNSAT TT=0.968 ASSIGNMENTS=0	UNSAT TT=0.945 ASSIGNMENTS=0	UNSAT TT=154.94 CHECKS=68214900 NODES=0	UNSAT TT=167.211 CHECKS=68215200 NODES=0	UNSAT TT=154.796 CHECKS=68215200 NODES=0	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1889	UNSAT TT=0.049 ASSIGNMENTS=0 CHECKS=1889	? (problem) TT=125.737	? (problem) TT=130.83	No data	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1889	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1889	? TT=0.369	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1889	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1889	? TT=252.13	No data	UNSAT TT=1.415	UNSAT TT=1.469
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-45.xml	SAT TT=0.039	SAT TT=1.86 CHECKS=420224 NODES=260	SAT TT=3.286 CHECKS=1186700 NODES=347	SAT TT=381.213	SAT TT=0.626 CHECKS=3276	SAT TT=0.084 CHECKS=3379	SAT TT=1.474 ASSIGNMENTS=102	SAT TT=1.915 ASSIGNMENTS=98	SAT TT=124.18 CHECKS=362965 NODES=149	SAT TT=842.005 CHECKS=44855000 NODES=1036200000	? (TO) TT=1800.09	SAT TT=0.053 ASSIGNMENTS=171 CHECKS=12481	SAT TT=0.05 ASSIGNMENTS=171 CHECKS=12481	? (problem) TT=120.836	? (problem) TT=119.601	No data	SAT TT=0.045 ASSIGNMENTS=174 CHECKS=12695	SAT TT=0.039 ASSIGNMENTS=199 CHECKS=8512	? TT=0.358	SAT TT=0.096 ASSIGNMENTS=797 CHECKS=50206	SAT TT=0.042 ASSIGNMENTS=187 CHECKS=12360	? TT=1477.02	No data	SAT TT=1.463	SAT TT=1.622
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-47.xml	UNSAT TT=0.036	UNSAT TT=1.391 CHECKS=74569 NODES=0	UNSAT TT=1.569 CHECKS=74569 NODES=0	UNSAT TT=0.086	UNSAT TT=0.819 CHECKS=123	UNSAT TT=0.102 CHECKS=123	UNSAT TT=0.905 ASSIGNMENTS=0	UNSAT TT=1.005 ASSIGNMENTS=0	UNSAT TT=121.471 CHECKS=83417 NODES=0	UNSAT TT=136.097 CHECKS=83873 NODES=0	UNSAT TT=120.602 CHECKS=83873 NODES=0	UNSAT TT=0.049 ASSIGNMENTS=0 CHECKS=1730	UNSAT TT=0.05 ASSIGNMENTS=0 CHECKS=1730	? (problem) TT=126.269	? (problem) TT=124.47	No data	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=1730	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1730	? TT=0.302	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1730	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1730	? TT=659.271	No data	UNSAT TT=1.388	UNSAT TT=1.515
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-49.xml	SAT TT=0.038	SAT TT=4.903 CHECKS=2201390 NODES=151	SAT TT=7.033 CHECKS=3328940 NODES=151	SAT TT=0.089	SAT TT=0.737 CHECKS=5898	SAT TT=0.1 CHECKS=3165	SAT TT=1.324 ASSIGNMENTS=105	SAT TT=1.847 ASSIGNMENTS=101	SAT TT=133.473 CHECKS=5397320 NODES=223	SAT TT=241.039 CHECKS=15864400 NODES=188400000	? (TO) TT=1800.09	SAT TT=0.053 ASSIGNMENTS=125 CHECKS=7139	SAT TT=0.049 ASSIGNMENTS=125 CHECKS=7139	? (problem) TT=145.905	? (problem) TT=149.863	No data	SAT TT=0.041 ASSIGNMENTS=145 CHECKS=9494	SAT TT=0.038 ASSIGNMENTS=216 CHECKS=7557	? TT=0.36	SAT TT=0.041 ASSIGNMENTS=115 CHECKS=4634	SAT TT=0.039 ASSIGNMENTS=95 CHECKS=4340	? (TO) TT=1802.35	No data	SAT TT=1.199	SAT TT=1.321
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-4.xml	SAT TT=0.04	SAT TT=4.003 CHECKS=1412560 NODES=152	SAT TT=11.501 CHECKS=5347100 NODES=211	? (TO) TT=1800.09	SAT TT=0.733 CHECKS=3914	SAT TT=0.122 CHECKS=3981	SAT TT=1.479 ASSIGNMENTS=125	SAT TT=2.185 ASSIGNMENTS=237	SAT TT=153.341 CHECKS=67456600 NODES=145	? (TO) TT=1800.07	? (MO) TT=62.71	SAT TT=0.053 ASSIGNMENTS=96 CHECKS=4868	SAT TT=0.051 ASSIGNMENTS=96 CHECKS=4868	? (problem) TT=122.832	? (problem) TT=130.522	No data	SAT TT=0.04 ASSIGNMENTS=96 CHECKS=4868	SAT TT=0.04 ASSIGNMENTS=105 CHECKS=5093	? TT=0.308	SAT TT=0.049 ASSIGNMENTS=175 CHECKS=8587	SAT TT=0.046 ASSIGNMENTS=112 CHECKS=8932	? (TO) TT=1802.38	No data	SAT TT=1.35	SAT TT=1.392
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-5.xml	UNSAT TT=0.035	UNSAT TT=1.913 CHECKS=271324 NODES=0	UNSAT TT=1.786 CHECKS=271324 NODES=0	UNSAT TT=0.085	UNSAT TT=0.837 CHECKS=150	UNSAT TT=0.112 CHECKS=150	UNSAT TT=0.991 ASSIGNMENTS=0	UNSAT TT=0.967 ASSIGNMENTS=0	UNSAT TT=146.454 CHECKS=121240 NODES=0	UNSAT TT=141.901 CHECKS=121912 NODES=0	UNSAT TT=170.11 CHECKS=121912 NODES=0	UNSAT TT=0.05 ASSIGNMENTS=0 CHECKS=1996	UNSAT TT=0.05 ASSIGNMENTS=0 CHECKS=1996	? (problem) TT=116.001	? (problem) TT=120.258	No data	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1996	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=1996	? TT=0.338	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1996	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1996	? TT=443.947	No data	UNSAT TT=1.452	UNSAT TT=1.339
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-6.xml	SAT TT=0.041	SAT TT=22.647 CHECKS=10854300 NODES=304	SAT TT=28.387 CHECKS=14856900 NODES=318	SAT TT=0.091	SAT TT=0.763 CHECKS=7323	SAT TT=0.124 CHECKS=7392	SAT TT=1.5 ASSIGNMENTS=104	SAT TT=2.384 ASSIGNMENTS=123	SAT TT=218.82 CHECKS=269355000 NODES=228	SAT TT=841.586 CHECKS=314126000 NODES=891450000	? (TO) TT=1800.05	SAT TT=0.054 ASSIGNMENTS=130 CHECKS=12121	SAT TT=0.056 ASSIGNMENTS=130 CHECKS=12121	? (problem) TT=120.092	? (problem) TT=114.995	No data	SAT TT=0.042 ASSIGNMENTS=141 CHECKS=12146	SAT TT=0.048 ASSIGNMENTS=435 CHECKS=22860	? TT=0.374	SAT TT=0.046 ASSIGNMENTS=131 CHECKS=6305	SAT TT=0.041 ASSIGNMENTS=109 CHECKS=9063	? (TO) TT=1802.25	No data	SAT TT=1.206	SAT TT=1.587
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-10.xml	SAT TT=0.05	SAT TT=1.921 CHECKS=147923 NODES=183	SAT TT=1.857 CHECKS=186477 NODES=0	SAT TT=0.106	SAT TT=1.823 CHECKS=6039	SAT TT=0.397 CHECKS=3810	SAT TT=1.739 ASSIGNMENTS=150	SAT TT=3.518 ASSIGNMENTS=146	SAT TT=159.771 CHECKS=62005200 NODES=442	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=0.071 ASSIGNMENTS=207 CHECKS=19414	SAT TT=0.07 ASSIGNMENTS=207 CHECKS=19414	? (problem) TT=154.874	? (problem) TT=152.763	No data	SAT TT=0.061 ASSIGNMENTS=207 CHECKS=19478	SAT TT=0.056 ASSIGNMENTS=356 CHECKS=19474	? TT=0.335	SAT TT=0.193 ASSIGNMENTS=1352 CHECKS=97848	SAT TT=0.05 ASSIGNMENTS=152 CHECKS=6708	? TT=610.908	No data	SAT TT=1.41	SAT TT=1.738
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-11.xml	SAT TT=0.052	SAT TT=1.91 CHECKS=141370 NODES=183	SAT TT=2.36 CHECKS=359511 NODES=262	SAT TT=0.1	SAT TT=2.092 CHECKS=3631	SAT TT=0.49 CHECKS=3660	SAT TT=1.567 ASSIGNMENTS=139	SAT TT=3.449 ASSIGNMENTS=144	SAT TT=130.806 CHECKS=609569 NODES=283	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=0.069 ASSIGNMENTS=195 CHECKS=13785	SAT TT=0.068 ASSIGNMENTS=195 CHECKS=13785	? (problem) TT=106.983	? (problem) TT=119.757	No data	SAT TT=0.054 ASSIGNMENTS=198 CHECKS=14971	SAT TT=0.058 ASSIGNMENTS=436 CHECKS=23924	? TT=0.336	SAT TT=0.188 ASSIGNMENTS=1249 CHECKS=106931	SAT TT=0.052 ASSIGNMENTS=149 CHECKS=6701	? (TO) TT=1802.3	No data	SAT TT=1.362	SAT TT=2.022
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-13.xml	SAT TT=0.045	SAT TT=1.698 CHECKS=125440 NODES=181	SAT TT=2.214 CHECKS=401711 NODES=185	SAT TT=0.099	SAT TT=1.077 CHECKS=4371	SAT TT=0.193 CHECKS=4115	SAT TT=1.701 ASSIGNMENTS=150	SAT TT=3.917 ASSIGNMENTS=460	SAT TT=129.728 CHECKS=298930 NODES=302	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=0.058 ASSIGNMENTS=158 CHECKS=9281	SAT TT=0.06 ASSIGNMENTS=158 CHECKS=9281	? (problem) TT=115.153	? (problem) TT=115.097	No data	SAT TT=0.05 ASSIGNMENTS=166 CHECKS=10037	SAT TT=0.045 ASSIGNMENTS=124 CHECKS=5890	? TT=0.337	SAT TT=0.107 ASSIGNMENTS=778 CHECKS=58722	SAT TT=0.05 ASSIGNMENTS=193 CHECKS=13658	? (TO) TT=1802.24	No data	SAT TT=1.366	SAT TT=1.585
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-16.xml	SAT TT=0.046	SAT TT=4.503 CHECKS=1234500 NODES=257	SAT TT=2.108 CHECKS=298555 NODES=181	SAT TT=0.097	SAT TT=1.272 CHECKS=5706	SAT TT=0.268 CHECKS=6228	SAT TT=1.623 ASSIGNMENTS=175	SAT TT=3.569 ASSIGNMENTS=170	SAT TT=134.336 CHECKS=93214 NODES=189	? (TO) TT=1800	? (TO) TT=1800	SAT TT=0.063 ASSIGNMENTS=137 CHECKS=6231	SAT TT=0.058 ASSIGNMENTS=137 CHECKS=6231	? (problem) TT=108.67	? (problem) TT=107.46	No data	SAT TT=0.05 ASSIGNMENTS=137 CHECKS=6231	SAT TT=0.046 ASSIGNMENTS=161 CHECKS=6408	? TT=0.332	SAT TT=0.059 ASSIGNMENTS=233 CHECKS=11116	SAT TT=0.048 ASSIGNMENTS=150 CHECKS=8199	? (TO) TT=1802.28	No data	SAT TT=1.431	SAT TT=1.492
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-1.xml	SAT TT=0.044	SAT TT=2.508 CHECKS=477780 NODES=240	SAT TT=2.595 CHECKS=485197 NODES=276	SAT TT=26.505	SAT TT=1.259 CHECKS=13385	SAT TT=0.32 CHECKS=15031	SAT TT=1.53 ASSIGNMENTS=190	SAT TT=3.253 ASSIGNMENTS=141	SAT TT=136.554 CHECKS=89039 NODES=181	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=0.06 ASSIGNMENTS=210 CHECKS=9444	SAT TT=0.066 ASSIGNMENTS=210 CHECKS=9444	? (problem) TT=125.321	? (problem) TT=131.533	No data	SAT TT=0.046 ASSIGNMENTS=170 CHECKS=8232	SAT TT=0.044 ASSIGNMENTS=138 CHECKS=6346	? TT=0.374	SAT TT=0.077 ASSIGNMENTS=444 CHECKS=25669	SAT TT=0.057 ASSIGNMENTS=236 CHECKS=19845	? (TO) TT=1802.14	No data	SAT TT=1.394	SAT TT=1.692
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-23.xml	SAT TT=0.049	SAT TT=1.919 CHECKS=152782 NODES=182	SAT TT=2.71 CHECKS=650827 NODES=262	SAT TT=893.382	SAT TT=0.981 CHECKS=3898	SAT TT=0.16 CHECKS=4190	SAT TT=1.702 ASSIGNMENTS=153	SAT TT=3.323 ASSIGNMENTS=148	SAT TT=132.15 CHECKS=223706 NODES=188	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=0.063 ASSIGNMENTS=157 CHECKS=9657	SAT TT=0.06 ASSIGNMENTS=157 CHECKS=9657	? (problem) TT=117.511	? (problem) TT=113.376	No data	SAT TT=0.053 ASSIGNMENTS=178 CHECKS=14142	SAT TT=0.051 ASSIGNMENTS=232 CHECKS=12829	? TT=0.336	SAT TT=0.076 ASSIGNMENTS=473 CHECKS=28224	SAT TT=0.049 ASSIGNMENTS=141 CHECKS=6639	? (TO) TT=1802.09	No data	SAT TT=1.442	SAT TT=1.817
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-24.xml	SAT TT=0.047	SAT TT=1.896 CHECKS=175331 NODES=300	SAT TT=2.922 CHECKS=677155 NODES=297	SAT TT=894.846	SAT TT=1.265 CHECKS=7226	SAT TT=0.226 CHECKS=4893	SAT TT=1.741 ASSIGNMENTS=148	SAT TT=3.491 ASSIGNMENTS=160	SAT TT=124.531 CHECKS=99565 NODES=184	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=0.076 ASSIGNMENTS=247 CHECKS=30902	SAT TT=0.076 ASSIGNMENTS=247 CHECKS=30902	? (problem) TT=134.849	? (problem) TT=148.91	No data	SAT TT=0.081 ASSIGNMENTS=300 CHECKS=53537	SAT TT=0.049 ASSIGNMENTS=140 CHECKS=6264	? TT=0.311	SAT TT=0.121 ASSIGNMENTS=786 CHECKS=57776	SAT TT=0.047 ASSIGNMENTS=147 CHECKS=6945	? TT=148.77	No data	SAT TT=1.485	SAT TT=1.654
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-26.xml	SAT TT=0.052	SAT TT=2.003 CHECKS=189006 NODES=344	SAT TT=2.695 CHECKS=444279 NODES=0	SAT TT=0.098	SAT TT=2.926 CHECKS=3580	SAT TT=0.745 CHECKS=3775	SAT TT=1.632 ASSIGNMENTS=137	SAT TT=3.672 ASSIGNMENTS=151	SAT TT=134.024 CHECKS=405800 NODES=183	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=0.065 ASSIGNMENTS=146 CHECKS=7420	SAT TT=0.059 ASSIGNMENTS=146 CHECKS=7420	? (problem) TT=147.128	? (problem) TT=150.261	No data	SAT TT=0.052 ASSIGNMENTS=146 CHECKS=7420	SAT TT=0.059 ASSIGNMENTS=328 CHECKS=20261	? TT=0.305	SAT TT=0.176 ASSIGNMENTS=1195 CHECKS=107268	SAT TT=0.054 ASSIGNMENTS=159 CHECKS=9103	? (TO) TT=1802.51	No data	SAT TT=1.361	SAT TT=1.595
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-27.xml	SAT TT=0.046	SAT TT=1.937 CHECKS=159824 NODES=196	SAT TT=2.857 CHECKS=533407 NODES=277	SAT TT=0.113	SAT TT=2.003 CHECKS=5722	SAT TT=0.525 CHECKS=5731	SAT TT=1.651 ASSIGNMENTS=207	SAT TT=3.563 ASSIGNMENTS=167	? (MO) TT=44.99	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=0.061 ASSIGNMENTS=159 CHECKS=8165	SAT TT=0.058 ASSIGNMENTS=159 CHECKS=8165	? (problem) TT=142.943	? (problem) TT=146.399	No data	SAT TT=0.049 ASSIGNMENTS=175 CHECKS=8258	SAT TT=0.046 ASSIGNMENTS=159 CHECKS=6618	? TT=0.336	SAT TT=0.142 ASSIGNMENTS=1034 CHECKS=87899	SAT TT=0.056 ASSIGNMENTS=173 CHECKS=11177	? (TO) TT=1802.31	No data	SAT TT=1.659	SAT TT=1.651
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-28.xml	SAT TT=0.049	SAT TT=1.992 CHECKS=215655 NODES=258	SAT TT=2.482 CHECKS=547087 NODES=181	SAT TT=0.137	SAT TT=1.679 CHECKS=5621	SAT TT=0.374 CHECKS=5361	SAT TT=1.549 ASSIGNMENTS=170	SAT TT=4.23 ASSIGNMENTS=211	SAT TT=132.823 CHECKS=359902 NODES=521	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=0.063 ASSIGNMENTS=145 CHECKS=7974	SAT TT=0.061 ASSIGNMENTS=145 CHECKS=7974	? (problem) TT=146.721	? (problem) TT=133.627	No data	SAT TT=0.053 ASSIGNMENTS=154 CHECKS=7961	SAT TT=0.059 ASSIGNMENTS=457 CHECKS=25418	? TT=0.374	SAT TT=0.127 ASSIGNMENTS=792 CHECKS=70549	SAT TT=0.049 ASSIGNMENTS=129 CHECKS=6192	? (TO) TT=1802.32	No data	SAT TT=1.672	SAT TT=1.691
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-29.xml	SAT TT=0.048	SAT TT=2.617 CHECKS=420152 NODES=284	SAT TT=2.655 CHECKS=577550 NODES=309	SAT TT=0.097	SAT TT=1.994 CHECKS=4021	SAT TT=0.427 CHECKS=4273	SAT TT=1.817 ASSIGNMENTS=161	SAT TT=3.36 ASSIGNMENTS=141	SAT TT=130.549 CHECKS=151089 NODES=184	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=0.063 ASSIGNMENTS=150 CHECKS=8155	SAT TT=0.064 ASSIGNMENTS=150 CHECKS=8155	? (problem) TT=134.43	? (problem) TT=128.659	No data	SAT TT=0.052 ASSIGNMENTS=160 CHECKS=9591	SAT TT=0.048 ASSIGNMENTS=140 CHECKS=7228	? TT=0.373	SAT TT=0.19 ASSIGNMENTS=1278 CHECKS=102509	SAT TT=0.049 ASSIGNMENTS=153 CHECKS=7669	? (TO) TT=1802.4	No data	SAT TT=1.395	SAT TT=1.624
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-2.xml	SAT TT=0.046	SAT TT=3.409 CHECKS=775597 NODES=348	SAT TT=2.938 CHECKS=613729 NODES=237	SAT TT=0.099	SAT TT=1.57 CHECKS=4245	SAT TT=0.32 CHECKS=4179	SAT TT=1.55 ASSIGNMENTS=153	SAT TT=3.562 ASSIGNMENTS=190	SAT TT=129.586 CHECKS=116974 NODES=182	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=0.063 ASSIGNMENTS=141 CHECKS=6429	SAT TT=0.063 ASSIGNMENTS=141 CHECKS=6429	? (problem) TT=115.87	? (problem) TT=110.983	No data	SAT TT=0.046 ASSIGNMENTS=141 CHECKS=6429	SAT TT=0.047 ASSIGNMENTS=257 CHECKS=13313	? TT=0.375	SAT TT=0.08 ASSIGNMENTS=443 CHECKS=24317	SAT TT=0.052 ASSIGNMENTS=141 CHECKS=7424	? (TO) TT=1802.19	No data	SAT TT=1.448	SAT TT=1.51
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-30.xml	SAT TT=0.051	SAT TT=1.849 CHECKS=158592 NODES=182	SAT TT=2.93 CHECKS=717731 NODES=516	SAT TT=896.774	SAT TT=1.189 CHECKS=6868	SAT TT=0.257 CHECKS=7333	SAT TT=1.551 ASSIGNMENTS=205	SAT TT=3.482 ASSIGNMENTS=190	SAT TT=127.44 CHECKS=163678 NODES=181	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.06 ASSIGNMENTS=147 CHECKS=6419	SAT TT=0.058 ASSIGNMENTS=147 CHECKS=6419	? (problem) TT=103.765	? (problem) TT=106.738	No data	SAT TT=0.051 ASSIGNMENTS=147 CHECKS=6419	SAT TT=0.051 ASSIGNMENTS=285 CHECKS=10559	? TT=0.31	SAT TT=0.128 ASSIGNMENTS=919 CHECKS=76868	SAT TT=0.051 ASSIGNMENTS=137 CHECKS=6180	? TT=1043.82	No data	SAT TT=1.346	SAT TT=1.518
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-35.xml	SAT TT=0.041	SAT TT=1.69 CHECKS=149604 NODES=187	SAT TT=3.276 CHECKS=849445 NODES=370	SAT TT=0.101	SAT TT=0.985 CHECKS=4418	SAT TT=0.157 CHECKS=4804	SAT TT=1.659 ASSIGNMENTS=142	SAT TT=2.992 ASSIGNMENTS=155	SAT TT=135.968 CHECKS=85049 NODES=182	? (TO) TT=1800.07	? (TO) TT=1800	SAT TT=0.054 ASSIGNMENTS=142 CHECKS=6455	SAT TT=0.056 ASSIGNMENTS=142 CHECKS=6455	? (problem) TT=109.752	? (problem) TT=111.322	No data	SAT TT=0.046 ASSIGNMENTS=142 CHECKS=6455	SAT TT=0.041 ASSIGNMENTS=127 CHECKS=5849	? TT=0.331	SAT TT=0.143 ASSIGNMENTS=1184 CHECKS=83758	SAT TT=0.048 ASSIGNMENTS=132 CHECKS=5729	? TT=1133.73	No data	SAT TT=1.484	SAT TT=1.869
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-36.xml	SAT TT=0.048	SAT TT=1.881 CHECKS=142330 NODES=185	SAT TT=2.397 CHECKS=441724 NODES=248	SAT TT=868.215	SAT TT=1.798 CHECKS=3915	SAT TT=0.36 CHECKS=4149	SAT TT=1.852 ASSIGNMENTS=152	SAT TT=3.63 ASSIGNMENTS=164	SAT TT=138.968 CHECKS=31488000 NODES=339	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=0.063 ASSIGNMENTS=136 CHECKS=6816	SAT TT=0.063 ASSIGNMENTS=136 CHECKS=6816	? (problem) TT=134.6	? (problem) TT=134.821	No data	SAT TT=0.048 ASSIGNMENTS=136 CHECKS=6816	SAT TT=0.048 ASSIGNMENTS=206 CHECKS=12173	? TT=0.373	SAT TT=0.184 ASSIGNMENTS=1183 CHECKS=105608	SAT TT=0.077 ASSIGNMENTS=323 CHECKS=44000	? TT=545.391	No data	SAT TT=1.62	SAT TT=1.581
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-38.xml	SAT TT=0.049	SAT TT=1.941 CHECKS=134163 NODES=180	SAT TT=1.797 CHECKS=151727 NODES=0	SAT TT=0.108	SAT TT=2.613 CHECKS=3213	SAT TT=0.608 CHECKS=3272	SAT TT=1.575 ASSIGNMENTS=151	SAT TT=4.033 ASSIGNMENTS=143	SAT TT=136.024 CHECKS=8658840 NODES=346	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=0.065 ASSIGNMENTS=162 CHECKS=10027	SAT TT=0.066 ASSIGNMENTS=162 CHECKS=10027	? (problem) TT=133.344	? (problem) TT=133.289	No data	SAT TT=0.053 ASSIGNMENTS=170 CHECKS=9872	SAT TT=0.06 ASSIGNMENTS=496 CHECKS=24645	? TT=0.309	SAT TT=0.066 ASSIGNMENTS=245 CHECKS=13852	SAT TT=0.049 ASSIGNMENTS=143 CHECKS=6674	? (TO) TT=1802.29	No data	SAT TT=1.386	SAT TT=1.631
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-39.xml	SAT TT=0.048	SAT TT=2.168 CHECKS=211389 NODES=263	SAT TT=2.216 CHECKS=292066 NODES=182	SAT TT=0.098	SAT TT=1.412 CHECKS=7565	SAT TT=0.281 CHECKS=3401	SAT TT=1.656 ASSIGNMENTS=218	SAT TT=3.678 ASSIGNMENTS=153	SAT TT=132.369 CHECKS=201732 NODES=409	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=0.059 ASSIGNMENTS=145 CHECKS=7675	SAT TT=0.064 ASSIGNMENTS=145 CHECKS=7675	? (problem) TT=96.721	? (problem) TT=99.219	No data	SAT TT=0.051 ASSIGNMENTS=142 CHECKS=7678	SAT TT=0.048 ASSIGNMENTS=131 CHECKS=6479	? TT=0.37	SAT TT=0.154 ASSIGNMENTS=1061 CHECKS=94027	SAT TT=0.049 ASSIGNMENTS=145 CHECKS=7755	? (TO) TT=1802.17	No data	SAT TT=1.548	SAT TT=1.522
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-42.xml	SAT TT=0.046	SAT TT=2.036 CHECKS=238463 NODES=335	SAT TT=2.77 CHECKS=638293 NODES=427	SAT TT=1343.92	SAT TT=1.281 CHECKS=3737	SAT TT=0.24 CHECKS=3793	SAT TT=1.583 ASSIGNMENTS=146	SAT TT=3.618 ASSIGNMENTS=167	SAT TT=135.156 CHECKS=96886 NODES=185	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=0.059 ASSIGNMENTS=155 CHECKS=9389	SAT TT=0.063 ASSIGNMENTS=155 CHECKS=9389	? (problem) TT=119.84	? (problem) TT=119.887	No data	SAT TT=0.05 ASSIGNMENTS=163 CHECKS=9421	SAT TT=0.046 ASSIGNMENTS=139 CHECKS=6324	? TT=0.335	SAT TT=0.069 ASSIGNMENTS=388 CHECKS=21468	SAT TT=0.049 ASSIGNMENTS=173 CHECKS=10042	? TT=686.018	No data	SAT TT=1.565	SAT TT=1.743
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-47.xml	SAT TT=0.046	SAT TT=1.847 CHECKS=145117 NODES=180	SAT TT=6.144 CHECKS=1799640 NODES=344	SAT TT=0.104	SAT TT=1.569 CHECKS=3669	SAT TT=0.317 CHECKS=3518	SAT TT=1.527 ASSIGNMENTS=144	SAT TT=3.701 ASSIGNMENTS=159	SAT TT=129.155 CHECKS=121193 NODES=307	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=0.062 ASSIGNMENTS=131 CHECKS=6336	SAT TT=0.063 ASSIGNMENTS=131 CHECKS=6336	? (problem) TT=121.021	? (problem) TT=120.082	No data	SAT TT=0.047 ASSIGNMENTS=131 CHECKS=6336	SAT TT=0.046 ASSIGNMENTS=138 CHECKS=6596	? TT=0.371	SAT TT=0.072 ASSIGNMENTS=316 CHECKS=17246	SAT TT=0.055 ASSIGNMENTS=176 CHECKS=12022	? (TO) TT=1802.17	No data	SAT TT=1.618	SAT TT=1.458
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-48.xml	SAT TT=0.044	SAT TT=1.66 CHECKS=115342 NODES=183	SAT TT=2.436 CHECKS=443382 NODES=270	SAT TT=0.101	SAT TT=1.003 CHECKS=4435	SAT TT=0.151 CHECKS=4302	SAT TT=1.461 ASSIGNMENTS=153	SAT TT=3.435 ASSIGNMENTS=244	SAT TT=127.421 CHECKS=3275180 NODES=180	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.059 ASSIGNMENTS=143 CHECKS=5797	SAT TT=0.059 ASSIGNMENTS=143 CHECKS=5797	? (problem) TT=119.687	? (problem) TT=119.189	No data	SAT TT=0.047 ASSIGNMENTS=143 CHECKS=5797	SAT TT=0.044 ASSIGNMENTS=164 CHECKS=6259	? TT=0.337	SAT TT=0.063 ASSIGNMENTS=319 CHECKS=15816	SAT TT=0.045 ASSIGNMENTS=136 CHECKS=5822	? TT=1465.07	No data	SAT TT=1.497	SAT TT=1.776
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-49.xml	SAT TT=0.048	SAT TT=1.716 CHECKS=127994 NODES=182	SAT TT=11.247 CHECKS=3854660 NODES=333	SAT TT=0.103	SAT TT=1.715 CHECKS=4671	SAT TT=0.392 CHECKS=4411	SAT TT=1.62 ASSIGNMENTS=155	SAT TT=4.107 ASSIGNMENTS=404	SAT TT=135.782 CHECKS=13496500 NODES=426	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=0.084 ASSIGNMENTS=309 CHECKS=41066	SAT TT=0.083 ASSIGNMENTS=309 CHECKS=41066	? (problem) TT=107.38	? (problem) TT=111.347	No data	SAT TT=0.069 ASSIGNMENTS=282 CHECKS=37384	SAT TT=0.048 ASSIGNMENTS=136 CHECKS=6331	? TT=0.331	SAT TT=0.062 ASSIGNMENTS=272 CHECKS=14858	SAT TT=0.055 ASSIGNMENTS=239 CHECKS=19381	? TT=578.127	No data	SAT TT=1.623	SAT TT=1.658
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-4.xml	SAT TT=0.052	SAT TT=2.487 CHECKS=331039 NODES=275	SAT TT=2.832 CHECKS=525093 NODES=296	SAT TT=0.389	SAT TT=3.018 CHECKS=4464	SAT TT=0.811 CHECKS=4609	SAT TT=1.718 ASSIGNMENTS=152	SAT TT=3.944 ASSIGNMENTS=182	SAT TT=130.738 CHECKS=111924 NODES=183	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.064 ASSIGNMENTS=143 CHECKS=7558	SAT TT=0.061 ASSIGNMENTS=143 CHECKS=7558	? (problem) TT=183.105	? (problem) TT=183.118	No data	SAT TT=0.052 ASSIGNMENTS=143 CHECKS=7558	SAT TT=0.053 ASSIGNMENTS=266 CHECKS=12524	? TT=0.332	SAT TT=0.181 ASSIGNMENTS=1272 CHECKS=105239	SAT TT=0.054 ASSIGNMENTS=154 CHECKS=8013	? (TO) TT=1802.15	No data	SAT TT=1.55	SAT TT=1.766
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-5.xml	SAT TT=0.05	SAT TT=2.032 CHECKS=152560 NODES=183	SAT TT=2.105 CHECKS=212957 NODES=0	SAT TT=0.108	SAT TT=2.181 CHECKS=4085	SAT TT=0.487 CHECKS=3170	SAT TT=1.684 ASSIGNMENTS=142	SAT TT=4.047 ASSIGNMENTS=229	SAT TT=127.502 CHECKS=113266 NODES=188	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.065 ASSIGNMENTS=142 CHECKS=7390	SAT TT=0.064 ASSIGNMENTS=142 CHECKS=7390	? (problem) TT=101.457	? (problem) TT=102.483	No data	SAT TT=0.05 ASSIGNMENTS=152 CHECKS=7324	SAT TT=0.053 ASSIGNMENTS=245 CHECKS=14701	? TT=0.331	SAT TT=0.194 ASSIGNMENTS=1273 CHECKS=113971	SAT TT=0.05 ASSIGNMENTS=138 CHECKS=6893	? (TO) TT=1802.32	No data	SAT TT=1.601	SAT TT=1.885
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-7.xml	SAT TT=0.053	SAT TT=1.924 CHECKS=142987 NODES=186	SAT TT=2.174 CHECKS=206816 NODES=0	SAT TT=1.856	SAT TT=2.221 CHECKS=4833	SAT TT=0.531 CHECKS=4247	SAT TT=1.723 ASSIGNMENTS=144	SAT TT=3.972 ASSIGNMENTS=222	SAT TT=122.929 CHECKS=110610 NODES=188	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=0.066 ASSIGNMENTS=188 CHECKS=10897	SAT TT=0.066 ASSIGNMENTS=188 CHECKS=10897	? (problem) TT=122.427	? (problem) TT=118.768	No data	SAT TT=0.053 ASSIGNMENTS=168 CHECKS=9309	SAT TT=0.057 ASSIGNMENTS=373 CHECKS=18325	? TT=0.336	SAT TT=0.178 ASSIGNMENTS=1121 CHECKS=100408	SAT TT=0.072 ASSIGNMENTS=368 CHECKS=35521	? TT=393.345	No data	SAT TT=1.49	SAT TT=1.821
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-8.xml	SAT TT=0.05	SAT TT=2.076 CHECKS=243092 NODES=294	SAT TT=2.393 CHECKS=372865 NODES=190	SAT TT=478.84	SAT TT=1.599 CHECKS=4207	SAT TT=0.333 CHECKS=4150	SAT TT=1.611 ASSIGNMENTS=205	SAT TT=3.472 ASSIGNMENTS=141	SAT TT=121.91 CHECKS=1927660 NODES=185	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=0.056 ASSIGNMENTS=147 CHECKS=7011	SAT TT=0.057 ASSIGNMENTS=147 CHECKS=7011	? (problem) TT=137.759	? (problem) TT=129.369	No data	SAT TT=0.051 ASSIGNMENTS=147 CHECKS=7011	SAT TT=0.06 ASSIGNMENTS=707 CHECKS=34826	? TT=0.328	SAT TT=0.166 ASSIGNMENTS=1157 CHECKS=88643	SAT TT=0.05 ASSIGNMENTS=156 CHECKS=8021	? TT=485.756	No data	SAT TT=1.464	SAT TT=1.681
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-11.xml	SAT TT=0.069	SAT TT=126.017 CHECKS=60162000 NODES=1524	SAT TT=116.156 CHECKS=61636300 NODES=1907	? (TO) TT=1800.11	SAT TT=4.438 CHECKS=8349	SAT TT=1.483 CHECKS=16887	SAT TT=2.159 ASSIGNMENTS=168	SAT TT=9.13 ASSIGNMENTS=182	SAT TT=544.347 CHECKS=1370410000 NODES=384	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=0.084 ASSIGNMENTS=125 CHECKS=11757	SAT TT=0.084 ASSIGNMENTS=125 CHECKS=11757	? (problem) TT=62.509	? (problem) TT=58.669	No data	SAT TT=0.069 ASSIGNMENTS=125 CHECKS=11757	SAT TT=0.073 ASSIGNMENTS=235 CHECKS=20369	? TT=0.314	SAT TT=0.309 ASSIGNMENTS=1545 CHECKS=222969	SAT TT=0.095 ASSIGNMENTS=367 CHECKS=44248	? TT=964.328	No data	SAT TT=1.952	SAT TT=1.938
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-12.xml	UNSAT TT=0.069	UNSAT TT=24.343 CHECKS=14446400 NODES=66	UNSAT TT=23.176 CHECKS=14780700 NODES=30	UNSAT TT=0.138	UNSAT TT=10.38 CHECKS=167	UNSAT TT=3.055 CHECKS=167	UNSAT TT=1.127 ASSIGNMENTS=0	UNSAT TT=1.313 ASSIGNMENTS=0	UNSAT TT=125.315 CHECKS=10685500 NODES=0	UNSAT TT=122.887 CHECKS=10685500 NODES=0	UNSAT TT=122.029 CHECKS=10685500 NODES=0	UNSAT TT=0.081 ASSIGNMENTS=0 CHECKS=4108	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=4108	? (problem) TT=73.468	? (problem) TT=76.662	No data	UNSAT TT=0.07 ASSIGNMENTS=0 CHECKS=4108	UNSAT TT=0.069 ASSIGNMENTS=0 CHECKS=4108	? TT=0.339	UNSAT TT=0.069 ASSIGNMENTS=0 CHECKS=4108	UNSAT TT=0.069 ASSIGNMENTS=0 CHECKS=4108	? TT=250.754	No data	UNSAT TT=1.687	UNSAT TT=1.776
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-14.xml	SAT TT=0.067	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=8.113 CHECKS=76619	SAT TT=2.212 CHECKS=20913	SAT TT=2.262 ASSIGNMENTS=303	SAT TT=7.816 ASSIGNMENTS=165	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=0.085 ASSIGNMENTS=112 CHECKS=12593	SAT TT=0.086 ASSIGNMENTS=112 CHECKS=12593	? (problem) TT=60.967	? (problem) TT=64.696	No data	SAT TT=0.067 ASSIGNMENTS=121 CHECKS=12612	SAT TT=0.117 ASSIGNMENTS=987 CHECKS=97505	? TT=0.34	SAT TT=0.243 ASSIGNMENTS=1273 CHECKS=146171	SAT TT=0.081 ASSIGNMENTS=183 CHECKS=28610	? TT=267.762	No data	SAT TT=1.628	SAT TT=1.692
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-26.xml	UNSAT TT=0.062	UNSAT TT=2.153 CHECKS=31225 NODES=0	UNSAT TT=2.051 CHECKS=31225 NODES=0	UNSAT TT=0.131	UNSAT TT=4.844 CHECKS=203	UNSAT TT=1.196 CHECKS=203	UNSAT TT=1.214 ASSIGNMENTS=0	UNSAT TT=1.177 ASSIGNMENTS=0	UNSAT TT=129.084 CHECKS=361888 NODES=0	UNSAT TT=105.093 CHECKS=361889 NODES=0	UNSAT TT=109.861 CHECKS=361889 NODES=0	UNSAT TT=0.077 ASSIGNMENTS=0 CHECKS=4099	UNSAT TT=0.07 ASSIGNMENTS=0 CHECKS=4099	? (problem) TT=73.53	? (problem) TT=73.724	No data	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=4099	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=4099	? TT=0.32	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=4099	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=4099	? TT=1509.66	No data	UNSAT TT=1.849	UNSAT TT=1.981
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-27.xml	SAT TT=0.066	SAT TT=249.548 CHECKS=105847000 NODES=2151	SAT TT=212.923 CHECKS=89020500 NODES=1779	? (TO) TT=1800.04	SAT TT=8.444 CHECKS=161717	SAT TT=3.164 CHECKS=106125	SAT TT=2.137 ASSIGNMENTS=346	SAT TT=8.341 ASSIGNMENTS=176	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=0.091 ASSIGNMENTS=201 CHECKS=19190	SAT TT=0.088 ASSIGNMENTS=201 CHECKS=19190	? (problem) TT=73.635	? (problem) TT=60.61	No data	SAT TT=0.074 ASSIGNMENTS=191 CHECKS=18383	SAT TT=0.314 ASSIGNMENTS=4839 CHECKS=482461	? TT=0.337	SAT TT=0.313 ASSIGNMENTS=1511 CHECKS=187535	SAT TT=0.066 ASSIGNMENTS=138 CHECKS=11619	? TT=248.245	No data	SAT TT=1.725	SAT TT=2.039
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-29.xml	UNSAT TT=0.062	? (TO) TT=1800.13	? (TO) TT=1800.14	UNSAT TT=0.137	UNSAT TT=15.645 CHECKS=210	UNSAT TT=4.719 CHECKS=210	UNSAT TT=1.223 ASSIGNMENTS=0	UNSAT TT=1.201 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.081 ASSIGNMENTS=0 CHECKS=3880	UNSAT TT=0.082 ASSIGNMENTS=0 CHECKS=3880	? (problem) TT=64.712	? (problem) TT=65.442	No data	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=3880	UNSAT TT=0.065 ASSIGNMENTS=0 CHECKS=3880	? TT=0.355	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=3880	UNSAT TT=0.069 ASSIGNMENTS=0 CHECKS=3880	? TT=246.293	No data	UNSAT TT=1.527	UNSAT TT=1.91
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-2.xml	UNSAT TT=0.062	UNSAT TT=38.48 CHECKS=24104200 NODES=98	UNSAT TT=37.099 CHECKS=23165300 NODES=73	UNSAT TT=0.126	UNSAT TT=6.72 CHECKS=181	UNSAT TT=1.916 CHECKS=181	UNSAT TT=1.044 ASSIGNMENTS=0	UNSAT TT=1.159 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=3446	UNSAT TT=0.073 ASSIGNMENTS=0 CHECKS=3446	? (problem) TT=77.174	? (problem) TT=77.047	No data	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=3446	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=3446	? TT=0.363	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=3446	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=3446	? TT=1216.66	No data	UNSAT TT=1.637	UNSAT TT=1.852
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-30.xml	UNSAT TT=0.059	UNSAT TT=107.082 CHECKS=76092100 NODES=414	UNSAT TT=110.092 CHECKS=72669900 NODES=323	UNSAT TT=0.128	UNSAT TT=5.425 CHECKS=189	UNSAT TT=1.457 CHECKS=189	UNSAT TT=1.039 ASSIGNMENTS=0	UNSAT TT=1.095 ASSIGNMENTS=0	UNSAT TT=131.89 CHECKS=50224400 NODES=0	UNSAT TT=73.717 CHECKS=50224400 NODES=0	UNSAT TT=74.967 CHECKS=50224400 NODES=0	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=3445	UNSAT TT=0.075 ASSIGNMENTS=0 CHECKS=3445	? (problem) TT=64.565	? (problem) TT=63.212	No data	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=3445	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=3445	? TT=0.425	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3445	UNSAT TT=0.06 ASSIGNMENTS=0 CHECKS=3445	? TT=289.071	No data	UNSAT TT=1.669	UNSAT TT=1.752
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-31.xml	UNSAT TT=0.057	? (TO) TT=1800.12	? (TO) TT=1800.11	UNSAT TT=0.116	UNSAT TT=2.195 CHECKS=194	UNSAT TT=0.415 CHECKS=194	UNSAT TT=1.097 ASSIGNMENTS=0	UNSAT TT=1.188 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=0.072 ASSIGNMENTS=0 CHECKS=3293	UNSAT TT=0.075 ASSIGNMENTS=0 CHECKS=3293	? (problem) TT=68.523	? (problem) TT=64.63	No data	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3293	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3293	? TT=0.358	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=3293	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3293	? TT=252.306	No data	UNSAT TT=1.618	UNSAT TT=1.926
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-33.xml	SAT TT=0.075	SAT TT=110.28 CHECKS=51272600 NODES=1258	SAT TT=18.882 CHECKS=8406970 NODES=288	? (TO) TT=1800.04	SAT TT=13.889 CHECKS=75960	SAT TT=10.166 CHECKS=322170	SAT TT=3.214 ASSIGNMENTS=580	SAT TT=14.025 ASSIGNMENTS=767	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.03	SAT TT=0.089 ASSIGNMENTS=134 CHECKS=13775	SAT TT=0.087 ASSIGNMENTS=134 CHECKS=13775	? (problem) TT=65.849	? (problem) TT=66.094	No data	SAT TT=0.075 ASSIGNMENTS=133 CHECKS=13806	SAT TT=0.139 ASSIGNMENTS=1119 CHECKS=142236	? TT=0.312	SAT TT=0.341 ASSIGNMENTS=1501 CHECKS=250245	SAT TT=0.085 ASSIGNMENTS=166 CHECKS=23042	? TT=1125.97	No data	SAT TT=1.716	SAT TT=2.124
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-34.xml	UNSAT TT=0.059	UNSAT TT=566.448 CHECKS=326865000 NODES=1584	UNSAT TT=798.389 CHECKS=434644000 NODES=1731	UNSAT TT=0.116	UNSAT TT=2.455 CHECKS=185	UNSAT TT=0.511 CHECKS=185	UNSAT TT=1.318 ASSIGNMENTS=0	UNSAT TT=1.225 ASSIGNMENTS=0	UNSAT TT=198.652 CHECKS=244477000 NODES=0	UNSAT TT=141.152 CHECKS=244477000 NODES=0	UNSAT TT=131.272 CHECKS=244477000 NODES=0	UNSAT TT=0.073 ASSIGNMENTS=0 CHECKS=3384	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=3384	? (problem) TT=61.8	? (problem) TT=66.067	No data	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3384	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=3384	? TT=0.313	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=3384	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=3384	? TT=294.963	No data	UNSAT TT=1.862	UNSAT TT=1.867
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-36.xml	SAT TT=0.1	SAT TT=224.183 CHECKS=96117800 NODES=2474	SAT TT=1147.56 CHECKS=457179000 NODES=7018	? (TO) TT=1800.03	SAT TT=6.056 CHECKS=154885	SAT TT=7.358 CHECKS=423545	SAT TT=2.251 ASSIGNMENTS=406	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=0.208 ASSIGNMENTS=838 CHECKS=229200	SAT TT=0.343 ASSIGNMENTS=838 CHECKS=229200	? (problem) TT=71.694	? (problem) TT=80.264	No data	SAT TT=0.17 ASSIGNMENTS=867 CHECKS=179649	SAT TT=0.58 ASSIGNMENTS=8499 CHECKS=1000790	? TT=0.317	SAT TT=0.395 ASSIGNMENTS=1827 CHECKS=243830	SAT TT=0.1 ASSIGNMENTS=394 CHECKS=60957	? TT=252.785	No data	SAT TT=1.507	SAT TT=1.986
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-39.xml	SAT TT=0.082	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.11	SAT TT=16.45 CHECKS=27933	SAT TT=6.087 CHECKS=50805	SAT TT=3.361 ASSIGNMENTS=581	SAT TT=12.034 ASSIGNMENTS=936	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=0.095 ASSIGNMENTS=172 CHECKS=19756	SAT TT=0.094 ASSIGNMENTS=172 CHECKS=19756	? (problem) TT=66.642	? (problem) TT=70.769	No data	SAT TT=0.082 ASSIGNMENTS=167 CHECKS=18965	SAT TT=0.132 ASSIGNMENTS=1131 CHECKS=120806	? TT=0.334	SAT TT=2.773 ASSIGNMENTS=16574 CHECKS=2429780	SAT TT=0.083 ASSIGNMENTS=198 CHECKS=21290	? TT=243.853	No data	SAT TT=1.521	SAT TT=1.811
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-43.xml	UNSAT TT=0.059	UNSAT TT=2.376 CHECKS=128066 NODES=0	UNSAT TT=2.206 CHECKS=128066 NODES=0	UNSAT TT=0.117	UNSAT TT=5.233 CHECKS=143	UNSAT TT=1.41 CHECKS=143	UNSAT TT=1.146 ASSIGNMENTS=0	UNSAT TT=1.056 ASSIGNMENTS=0	UNSAT TT=143.174 CHECKS=49658000 NODES=0	UNSAT TT=88.966 CHECKS=49960200 NODES=0	UNSAT TT=92.974 CHECKS=49960200 NODES=0	UNSAT TT=0.075 ASSIGNMENTS=0 CHECKS=3399	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=3399	? (problem) TT=72.02	? (problem) TT=87.655	No data	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3399	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=3399	? TT=0.319	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=3399	UNSAT TT=0.065 ASSIGNMENTS=0 CHECKS=3399	? TT=1049.92	No data	UNSAT TT=1.397	UNSAT TT=1.852
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-44.xml	SAT TT=0.075	SAT TT=78.282 CHECKS=39919500 NODES=1020	SAT TT=372.347 CHECKS=198001000 NODES=4352	? (TO) TT=1800.03	SAT TT=8.934 CHECKS=118415	SAT TT=7.26 CHECKS=328464	SAT TT=2.465 ASSIGNMENTS=171	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=0.084 ASSIGNMENTS=127 CHECKS=12077	SAT TT=0.083 ASSIGNMENTS=127 CHECKS=12077	? (problem) TT=61.727	? (problem) TT=62.454	No data	SAT TT=0.075 ASSIGNMENTS=127 CHECKS=12077	SAT TT=0.093 ASSIGNMENTS=458 CHECKS=56009	? TT=0.424	SAT TT=0.498 ASSIGNMENTS=1839 CHECKS=281751	SAT TT=0.082 ASSIGNMENTS=183 CHECKS=24251	? TT=262.854	No data	SAT TT=1.545	SAT TT=1.999
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-47.xml	UNSAT TT=0.06	UNSAT TT=2.489 CHECKS=407665 NODES=0	UNSAT TT=2.673 CHECKS=407665 NODES=0	UNSAT TT=0.129	UNSAT TT=14.231 CHECKS=130	UNSAT TT=4.567 CHECKS=130	UNSAT TT=1.148 ASSIGNMENTS=0	UNSAT TT=1.186 ASSIGNMENTS=0	UNSAT TT=147.593 CHECKS=49766900 NODES=0	UNSAT TT=184.661 CHECKS=49766900 NODES=0	UNSAT TT=190.015 CHECKS=49766900 NODES=0	UNSAT TT=0.072 ASSIGNMENTS=0 CHECKS=2043	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=2043	? (problem) TT=65.417	? (problem) TT=65.512	No data	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=2043	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=2043	? TT=0.321	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=2043	UNSAT TT=0.06 ASSIGNMENTS=0 CHECKS=2043	? TT=219.46	No data	UNSAT TT=1.529	UNSAT TT=1.991
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-48.xml	UNSAT TT=0.06	UNSAT TT=5.145 CHECKS=1343400 NODES=173	UNSAT TT=3.268 CHECKS=655097 NODES=0	UNSAT TT=0.125	UNSAT TT=14.414 CHECKS=240	UNSAT TT=4.315 CHECKS=240	UNSAT TT=1.279 ASSIGNMENTS=0	UNSAT TT=1.196 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.01	UNSAT TT=0.077 ASSIGNMENTS=0 CHECKS=3416	UNSAT TT=0.082 ASSIGNMENTS=0 CHECKS=3416	? (problem) TT=61.718	? (problem) TT=60.77	No data	UNSAT TT=0.065 ASSIGNMENTS=0 CHECKS=3416	UNSAT TT=0.065 ASSIGNMENTS=0 CHECKS=3416	? TT=0.333	UNSAT TT=0.06 ASSIGNMENTS=0 CHECKS=3416	UNSAT TT=0.067 ASSIGNMENTS=0 CHECKS=3416	? TT=1059.62	No data	UNSAT TT=1.561	UNSAT TT=1.893
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-49.xml	UNSAT TT=0.06	UNSAT TT=22.822 CHECKS=14257400 NODES=45	UNSAT TT=6.016 CHECKS=2970320 NODES=0	UNSAT TT=0.115	UNSAT TT=3.958 CHECKS=152	UNSAT TT=1.074 CHECKS=152	UNSAT TT=1.094 ASSIGNMENTS=0	UNSAT TT=1.065 ASSIGNMENTS=0	UNSAT TT=148.19 CHECKS=49612600 NODES=0	UNSAT TT=204.035 CHECKS=49612600 NODES=0	UNSAT TT=198.491 CHECKS=49612600 NODES=0	UNSAT TT=0.071 ASSIGNMENTS=0 CHECKS=3472	UNSAT TT=0.073 ASSIGNMENTS=0 CHECKS=3472	? (problem) TT=70.465	? (problem) TT=66.524	No data	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=3472	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=3472	? TT=0.334	UNSAT TT=0.065 ASSIGNMENTS=0 CHECKS=3472	UNSAT TT=0.06 ASSIGNMENTS=0 CHECKS=3472	? TT=997.317	No data	UNSAT TT=1.509	UNSAT TT=2.09
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-7.xml	UNSAT TT=0.053	UNSAT TT=1111.23 CHECKS=543047000 NODES=3972	UNSAT TT=1058.81 CHECKS=550291000 NODES=3970	UNSAT TT=0.127	UNSAT TT=4.618 CHECKS=170	UNSAT TT=1.134 CHECKS=170	UNSAT TT=1.018 ASSIGNMENTS=0	UNSAT TT=1.057 ASSIGNMENTS=0	UNSAT TT=579.423 CHECKS=1220950000 NODES=0	UNSAT TT=567.536 CHECKS=1220950000 NODES=0	UNSAT TT=611.065 CHECKS=1220950000 NODES=0	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=1944	UNSAT TT=0.073 ASSIGNMENTS=0 CHECKS=1944	? (problem) TT=78.958	? (problem) TT=70.928	No data	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=1944	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=1944	? TT=0.317	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=1944	UNSAT TT=0.055 ASSIGNMENTS=0 CHECKS=1944	? TT=1048.53	No data	UNSAT TT=1.499	UNSAT TT=1.668
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-9.xml	UNSAT TT=0.064	UNSAT TT=2.513 CHECKS=445775 NODES=0	UNSAT TT=2.506 CHECKS=445775 NODES=0	UNSAT TT=0.124	UNSAT TT=3.935 CHECKS=179	UNSAT TT=0.971 CHECKS=179	UNSAT TT=1.148 ASSIGNMENTS=0	UNSAT TT=1.085 ASSIGNMENTS=0	UNSAT TT=123.445 CHECKS=798161 NODES=0	UNSAT TT=201.341 CHECKS=798161 NODES=0	UNSAT TT=202.247 CHECKS=798161 NODES=0	UNSAT TT=0.075 ASSIGNMENTS=0 CHECKS=3536	UNSAT TT=0.072 ASSIGNMENTS=0 CHECKS=3536	? (problem) TT=71.309	? (problem) TT=71.859	No data	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=3536	UNSAT TT=0.067 ASSIGNMENTS=0 CHECKS=3536	? TT=0.358	UNSAT TT=0.066 ASSIGNMENTS=0 CHECKS=3536	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=3536	? TT=269.642	No data	UNSAT TT=1.631	UNSAT TT=1.841
csp/ramsey3/ normalized-ramsey-10-3.xml	SAT TT=0.011	SAT TT=1.044 CHECKS=1038 NODES=85	SAT TT=0.877 CHECKS=835 NODES=46	SAT TT=0.056	SAT TT=0.071 CHECKS=6054	SAT TT=34.704 CHECKS=41831300	SAT TT=0.72 ASSIGNMENTS=40	SAT TT=0.75 ASSIGNMENTS=40	SAT TT=0.814 CHECKS=1232 NODES=102	SAT TT=0.836 CHECKS=3014 NODES=8	SAT TT=0.732 CHECKS=4247 NODES=11	SAT TT=0.024 ASSIGNMENTS=40 CHECKS=664	SAT TT=0.023 ASSIGNMENTS=40 CHECKS=664	SAT TT=1.19	SAT TT=1.187	No data	SAT TT=0.013 ASSIGNMENTS=40 CHECKS=664	SAT TT=0.011 ASSIGNMENTS=35 CHECKS=547	SAT TT=4.809	SAT TT=0.015 ASSIGNMENTS=162 CHECKS=2988	SAT TT=0.013 ASSIGNMENTS=29 CHECKS=578	SAT TT=1.468	No data	SAT TT=0.834	SAT TT=0.883
csp/ramsey3/ normalized-ramsey-13-3.xml	SAT TT=0.021	SAT TT=1.029 CHECKS=1887 NODES=151	SAT TT=1.164 CHECKS=3639 NODES=215	SAT TT=1.431	SAT TT=0.166 CHECKS=16109	? (TO) TT=1800.06	SAT TT=1.126 ASSIGNMENTS=117	SAT TT=1.055 ASSIGNMENTS=117	SAT TT=1.028 CHECKS=2416 NODES=158	SAT TT=0.972 CHECKS=8991 NODES=41	SAT TT=0.953 CHECKS=13235 NODES=28	SAT TT=0.036 ASSIGNMENTS=55 CHECKS=2044	SAT TT=0.035 ASSIGNMENTS=55 CHECKS=2044	SAT TT=1.505	SAT TT=1.732	No data	SAT TT=0.024 ASSIGNMENTS=57 CHECKS=2146	SAT TT=0.05 ASSIGNMENTS=884 CHECKS=30190	? (TO) TT=1800.02	SAT TT=0.03 ASSIGNMENTS=322 CHECKS=9296	SAT TT=0.021 ASSIGNMENTS=46 CHECKS=1614	SAT TT=2.142	No data	SAT TT=1.337	SAT TT=1.355
csp/ramsey3/ normalized-ramsey-15-3.xml	SAT TT=0.161	SAT TT=110.907 CHECKS=36998000 NODES=1274680	SAT TT=49 CHECKS=17802400 NODES=514502	? (TO) TT=1800.11	SAT TT=61.459 CHECKS=51475100	? (TO) TT=1800.12	SAT TT=3.45 ASSIGNMENTS=8136	SAT TT=3.34 ASSIGNMENTS=8136	SAT TT=1.226 CHECKS=18665 NODES=476	SAT TT=1.93 CHECKS=1901810 NODES=24254	SAT TT=2.848 CHECKS=4122970 NODES=10575	SAT TT=9.048 ASSIGNMENTS=4292 CHECKS=156490	SAT TT=9.046 ASSIGNMENTS=4292 CHECKS=156490	SAT TT=1.837	SAT TT=1.911	No data	? (TO) TT=1800.08	SAT TT=1.252 ASSIGNMENTS=15981 CHECKS=1445160	? (TO) TT=1800.08	SAT TT=1.292 ASSIGNMENTS=12472 CHECKS=1544020	SAT TT=0.161 ASSIGNMENTS=1445 CHECKS=148508	SAT TT=2.997	No data	SAT TT=1.831	SAT TT=7.106
csp/ramsey3/ normalized-ramsey-16-3.xml	SAT TT=0.513	SAT TT=94.026 CHECKS=28276500 NODES=918201	? (TO) TT=1800.07	SAT TT=1687.17	SAT TT=29.765 CHECKS=23885700	? (TO) TT=1800.08	SAT TT=2.26 ASSIGNMENTS=2184	SAT TT=1.996 ASSIGNMENTS=2184	SAT TT=1.749 CHECKS=166802 NODES=2250	SAT TT=4.757 CHECKS=7607620 NODES=90420	SAT TT=1.557 CHECKS=739056 NODES=3187	SAT TT=8.727 ASSIGNMENTS=1529 CHECKS=46737	SAT TT=8.939 ASSIGNMENTS=1529 CHECKS=46737	SAT TT=1.903	SAT TT=2.073	No data	? (TO) TT=1800.06	SAT TT=0.828 ASSIGNMENTS=10563 CHECKS=883899	? (TO) TT=1800.12	SAT TT=0.53 ASSIGNMENTS=4651 CHECKS=587430	SAT TT=0.513 ASSIGNMENTS=4538 CHECKS=532646	SAT TT=3.174	No data	SAT TT=2.908	SAT TT=6.545
csp/ramsey3/ normalized-ramsey-17-3.xml	UNSAT TT=11.189	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=11.189 CHECKS=4652950	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	No data	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.16	No data	? (TO) TT=1800.07	? (TO) TT=1800.12
csp/ramsey3/ normalized-ramsey-18-3.xml	UNSAT TT=19.169	UNSAT TT=1721.17 CHECKS=525920000 NODES=13620600	? (TO) TT=1800.12	? (TO) TT=1800.04	UNSAT TT=19.169 CHECKS=7258600	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.12	No data	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.11	No data	? (TO) TT=1800.11	? (TO) TT=1800.1
csp/ramsey3/ normalized-ramsey-20-3.xml	UNSAT TT=23.197	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.02	UNSAT TT=23.197 CHECKS=7013200	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.08	No data	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.15	No data	? (TO) TT=1800.06	? (TO) TT=1800.11
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ramsey3/ normalized-ramsey-25-3.xml	UNSAT TT=60.424	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.04	UNSAT TT=60.424 CHECKS=25331000	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	No data	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	No data	? (TO) TT=1800.03	? (TO) TT=1800.1
csp/ramsey4/ normalized-ramsey-25-4.xml	SAT TT=0.142	SAT TT=2.707 CHECKS=89277 NODES=2585	SAT TT=4.286 CHECKS=501470 NODES=9263	SAT TT=73.75	SAT TT=71.407 CHECKS=28132200	? (TO) TT=1800.04	SAT TT=2.764 ASSIGNMENTS=438	SAT TT=2.59 ASSIGNMENTS=438	SAT TT=3.534 CHECKS=43922 NODES=1226	SAT TT=2.852 CHECKS=96862 NODES=153	SAT TT=3.137 CHECKS=232676 NODES=89	SAT TT=0.173 ASSIGNMENTS=260 CHECKS=22573	SAT TT=0.171 ASSIGNMENTS=260 CHECKS=22573	SAT TT=3.755	SAT TT=3.563	No data	SAT TT=0.158 ASSIGNMENTS=271 CHECKS=21056	SAT TT=0.28 ASSIGNMENTS=2130 CHECKS=138690	? (TO) TT=1800.09	SAT TT=0.37 ASSIGNMENTS=1476 CHECKS=155520	SAT TT=0.142 ASSIGNMENTS=227 CHECKS=15725	SAT TT=4.429	No data	SAT TT=11.758	SAT TT=19.299
csp/ramsey4/ normalized-ramsey-30-4.xml	SAT TT=0.259	SAT TT=1466.23 CHECKS=696818000 NODES=8969030	SAT TT=6.691 CHECKS=832943 NODES=13765	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.08	SAT TT=3.775 ASSIGNMENTS=559	SAT TT=3.311 ASSIGNMENTS=559	SAT TT=10.364 CHECKS=379071 NODES=3762	SAT TT=5.921 CHECKS=252713 NODES=587	SAT TT=6.181 CHECKS=680515 NODES=249	SAT TT=0.278 ASSIGNMENTS=312 CHECKS=37314	SAT TT=0.3 ASSIGNMENTS=312 CHECKS=37314	SAT TT=5.458	SAT TT=4.826	No data	SAT TT=0.276 ASSIGNMENTS=297 CHECKS=34633	SAT TT=3.49 ASSIGNMENTS=25464 CHECKS=2490420	? (TO) TT=1800.09	SAT TT=0.71 ASSIGNMENTS=2276 CHECKS=326371	SAT TT=0.259 ASSIGNMENTS=303 CHECKS=37035	SAT TT=6.116	No data	SAT TT=35.599	SAT TT=272.507
csp/ramsey4/ normalized-ramsey-32-4.xml	SAT TT=0.375	SAT TT=36.921 CHECKS=8377680 NODES=124110	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=4.81 ASSIGNMENTS=1314	SAT TT=4.363 ASSIGNMENTS=1314	SAT TT=25.54 CHECKS=1777520 NODES=9817	SAT TT=7.545 CHECKS=362562 NODES=891	SAT TT=8.656 CHECKS=1010300 NODES=302	SAT TT=11.008 ASSIGNMENTS=2938 CHECKS=174510	SAT TT=11.403 ASSIGNMENTS=2938 CHECKS=174510	SAT TT=6.501	SAT TT=10.501	No data	SAT TT=0.375 ASSIGNMENTS=452 CHECKS=89852	SAT TT=4.481 ASSIGNMENTS=27208 CHECKS=3086230	? (TO) TT=1800.05	SAT TT=1.002 ASSIGNMENTS=2657 CHECKS=462746	SAT TT=1.789 ASSIGNMENTS=4803 CHECKS=1743960	SAT TT=9.289	No data	SAT TT=36.434	SAT TT=607.457
csp/ramsey4/ normalized-ramsey-33-4.xml	SAT TT=1.122	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT TT=7.596 ASSIGNMENTS=3942	SAT TT=7.973 ASSIGNMENTS=3942	SAT TT=26.14 CHECKS=1313650 NODES=8275	SAT TT=134.572 CHECKS=224256000 NODES=900966	SAT TT=10.909 CHECKS=2061530 NODES=725	SAT TT=11.283 ASSIGNMENTS=3903 CHECKS=295199	SAT TT=11.61 ASSIGNMENTS=3903 CHECKS=295199	SAT TT=7.573	SAT TT=36.879	No data	? (TO) TT=1800.05	SAT TT=5.228 ASSIGNMENTS=29122 CHECKS=3884310	? (TO) TT=1800.1	SAT TT=1.122 ASSIGNMENTS=2576 CHECKS=513364	SAT TT=8.688 ASSIGNMENTS=23991 CHECKS=10180100	SAT TT=30.879	No data	SAT TT=63.96	SAT TT=828.092
csp/ramsey4/ normalized-ramsey-34-4.xml	SAT TT=1.575	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.02	SAT TT=105.834 ASSIGNMENTS=67156	SAT TT=101.739 ASSIGNMENTS=67156	SAT TT=40.921 CHECKS=2479700 NODES=12242	SAT TT=35.663 CHECKS=39719100 NODES=153985	SAT TT=11.409 CHECKS=1516230 NODES=544	SAT TT=14.573 ASSIGNMENTS=14202 CHECKS=1418260	SAT TT=14.598 ASSIGNMENTS=14202 CHECKS=1418260	SAT TT=7.852	SAT TT=41.776	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=1.575 ASSIGNMENTS=3935 CHECKS=909558	SAT TT=11.317 ASSIGNMENTS=28457 CHECKS=13399600	SAT TT=167.738	No data	SAT TT=366.2	SAT TT=1039.57
csp/ramsey4/ normalized-ramsey-35-4.xml	SAT TT=12.963	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=928.021 ASSIGNMENTS=669213	SAT TT=991.658 ASSIGNMENTS=669213	SAT TT=106.465 CHECKS=7799680 NODES=37035	SAT TT=1674.56 CHECKS=2662960000 NODES=10053200	SAT TT=12.963 CHECKS=1777030 NODES=559	SAT TT=1771.32 ASSIGNMENTS=669213	SAT TT=1063.55 ASSIGNMENTS=722397 CHECKS=394854000	SAT TT=160.261	SAT TT=173.659	No data	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=311.551 ASSIGNMENTS=722397 CHECKS=394854000	? (TO) TT=1800.29	No data	SAT TT=800.17	? (TO) TT=1800
csp/ramsey4/ normalized-ramsey-38-4.xml	SAT TT=551.135	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.05	SAT TT=564.971 ASSIGNMENTS=1467950 CHECKS=217059000	SAT TT=551.135 ASSIGNMENTS=1467950 CHECKS=217059000	? (TO) TT=1800.01	? (TO) TT=1800.03	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	No data	? (TO) TT=1800.02	? (TO) TT=1800.1
csp/ramsey4/ normalized-ramsey-45-4.xml		? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	No data	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.21	No data	? (TO) TT=1800.19	? (TO) TT=1800.04
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-0_ext.xml	UNSAT TT=0.687	UNSAT TT=1.783 CHECKS=0 NODES=1034	UNSAT TT=1.763 CHECKS=0 NODES=1000	? (TO) TT=1800.05	UNSAT TT=97.561 CHECKS=84652	UNSAT TT=81.938 CHECKS=92836	UNSAT TT=6.805 ASSIGNMENTS=111	UNSAT TT=8.255 ASSIGNMENTS=119	UNSAT TT=2.885 CHECKS=0 NODES=1143	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=10.423 ASSIGNMENTS=858 CHECKS=9363	UNSAT TT=9.303 ASSIGNMENTS=1034 CHECKS=0	UNSAT TT=248.424	UNSAT TT=521.031	UNSAT TT=0.687 CHECKS=6634	UNSAT TT=2.961 ASSIGNMENTS=858 CHECKS=9142	UNSAT TT=11.534 ASSIGNMENTS=4186 CHECKS=39944	UNSAT TT=3.874	UNSAT TT=2.587 ASSIGNMENTS=1037 CHECKS=9700	UNSAT TT=2.881 ASSIGNMENTS=858 CHECKS=9363	? TT=41.071	UNSAT TT=1548.51 ASSIGNMENTS=111148 CHECKS=993417000	UNSAT TT=852.803	UNSAT TT=988.571
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-10_ext.xml	UNSAT TT=0.68	UNSAT TT=1.564 CHECKS=0 NODES=955	UNSAT TT=1.576 CHECKS=0 NODES=955	UNSAT TT=409.533	UNSAT TT=62.664 CHECKS=65415	UNSAT TT=87.083 CHECKS=91031	UNSAT TT=5.997 ASSIGNMENTS=111	UNSAT TT=15.38 ASSIGNMENTS=448	UNSAT TT=1.833 CHECKS=0 NODES=1048	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=10.532 ASSIGNMENTS=783 CHECKS=9214	UNSAT TT=9.084 ASSIGNMENTS=955 CHECKS=0	UNSAT TT=354.85	UNSAT TT=388.111	UNSAT TT=0.68 CHECKS=7548	UNSAT TT=3.024 ASSIGNMENTS=783 CHECKS=9214	UNSAT TT=11.217 ASSIGNMENTS=4194 CHECKS=38331	UNSAT TT=3.857	UNSAT TT=3.305 ASSIGNMENTS=996 CHECKS=10589	UNSAT TT=3.083 ASSIGNMENTS=783 CHECKS=9214	? TT=37.275	UNSAT TT=1106.59 ASSIGNMENTS=111306 CHECKS=664299000	UNSAT TT=866.878	? (TO) TT=1800.03
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-11_ext.xml	UNSAT TT=1.697	UNSAT TT=1.718 CHECKS=0 NODES=994	UNSAT TT=2.058 CHECKS=0 NODES=994	UNSAT TT=137.719	UNSAT TT=102.193 CHECKS=75714	UNSAT TT=92.784 CHECKS=76526	UNSAT TT=6.44 ASSIGNMENTS=111	UNSAT TT=28.637 ASSIGNMENTS=827	UNSAT TT=2.071 CHECKS=0 NODES=1267	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=9.62 ASSIGNMENTS=779 CHECKS=8712	UNSAT TT=9.45 ASSIGNMENTS=994 CHECKS=0	UNSAT TT=189.382	UNSAT TT=470.024	UNSAT TT=1.697 CHECKS=7595	UNSAT TT=2.561 ASSIGNMENTS=779 CHECKS=8712	UNSAT TT=11.008 ASSIGNMENTS=4157 CHECKS=36877	UNSAT TT=8.821	UNSAT TT=2.762 ASSIGNMENTS=997 CHECKS=9581	UNSAT TT=2.394 ASSIGNMENTS=779 CHECKS=8712	? TT=29.038	UNSAT TT=988.95 ASSIGNMENTS=111165 CHECKS=623182000	UNSAT TT=878.643	UNSAT TT=1160.01
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-12_ext.xml	UNSAT TT=0.993	UNSAT TT=1.874 CHECKS=0 NODES=1445	UNSAT TT=2.14 CHECKS=0 NODES=1443	UNSAT TT=845.741	UNSAT TT=92.262 CHECKS=84106	UNSAT TT=88.869 CHECKS=92029	UNSAT TT=6.563 ASSIGNMENTS=111	UNSAT TT=32.592 ASSIGNMENTS=1050	UNSAT TT=1.635 CHECKS=0 NODES=1152	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=9.921 ASSIGNMENTS=750 CHECKS=7936	UNSAT TT=9.376 ASSIGNMENTS=1445 CHECKS=0	UNSAT TT=163.919	UNSAT TT=277.045	UNSAT TT=0.993 CHECKS=7378	UNSAT TT=2.289 ASSIGNMENTS=750 CHECKS=7936	UNSAT TT=9.818 ASSIGNMENTS=4129 CHECKS=35123	UNSAT TT=5.66	UNSAT TT=2.588 ASSIGNMENTS=967 CHECKS=9064	UNSAT TT=2.314 ASSIGNMENTS=750 CHECKS=7936	? TT=35.453	UNSAT TT=34.453 ASSIGNMENTS=112034 CHECKS=19182400	UNSAT TT=925.294	UNSAT TT=889.334
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-13_ext.xml	UNSAT TT=0.742	UNSAT TT=2.34 CHECKS=0 NODES=1727	UNSAT TT=2.097 CHECKS=0 NODES=1727	UNSAT TT=98.91	UNSAT TT=96.824 CHECKS=84944	UNSAT TT=79.726 CHECKS=96184	UNSAT TT=6.241 ASSIGNMENTS=111	UNSAT TT=19.029 ASSIGNMENTS=426	UNSAT TT=2.405 CHECKS=0 NODES=1148	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=10.477 ASSIGNMENTS=820 CHECKS=8646	UNSAT TT=9.143 ASSIGNMENTS=872 CHECKS=0	UNSAT TT=330.711	UNSAT TT=532.987	UNSAT TT=0.742 CHECKS=6946	UNSAT TT=2.708 ASSIGNMENTS=819 CHECKS=8622	UNSAT TT=11.449 ASSIGNMENTS=4193 CHECKS=38215	UNSAT TT=4.249	UNSAT TT=2.892 ASSIGNMENTS=1021 CHECKS=9460	UNSAT TT=2.805 ASSIGNMENTS=820 CHECKS=8646	? TT=31.836	UNSAT TT=148.915 ASSIGNMENTS=111408 CHECKS=101838000	UNSAT TT=1062.68	UNSAT TT=1653.33
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-14_ext.xml	UNSAT TT=0.543	UNSAT TT=1.603 CHECKS=0 NODES=999	UNSAT TT=1.582 CHECKS=0 NODES=999	UNSAT TT=690.455	UNSAT TT=112.003 CHECKS=90764	UNSAT TT=93.372 CHECKS=87869	UNSAT TT=7.745 ASSIGNMENTS=111	UNSAT TT=31.029 ASSIGNMENTS=561	UNSAT TT=2.312 CHECKS=0 NODES=1267	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=10.665 ASSIGNMENTS=825 CHECKS=10188	UNSAT TT=9.013 ASSIGNMENTS=999 CHECKS=0	UNSAT TT=181.698	UNSAT TT=582.025	UNSAT TT=0.543 CHECKS=6684	UNSAT TT=2.488 ASSIGNMENTS=825 CHECKS=10188	UNSAT TT=10.851 ASSIGNMENTS=4228 CHECKS=38861	UNSAT TT=5.505	UNSAT TT=3.403 ASSIGNMENTS=1116 CHECKS=11785	UNSAT TT=2.648 ASSIGNMENTS=825 CHECKS=10188	? TT=39.556	UNSAT TT=575.567 ASSIGNMENTS=112961 CHECKS=372329000	UNSAT TT=818.811	UNSAT TT=795.736
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-15_ext.xml	UNSAT TT=0.638	UNSAT TT=2.008 CHECKS=0 NODES=923	UNSAT TT=2.358 CHECKS=0 NODES=939	UNSAT TT=39.812	UNSAT TT=99.945 CHECKS=80798	UNSAT TT=42.644 CHECKS=43232	UNSAT TT=6.97 ASSIGNMENTS=111	UNSAT TT=185.712 ASSIGNMENTS=4477	UNSAT TT=2.52 CHECKS=0 NODES=1262	? (TO) TT=1800.09	? (TO) TT=1800	UNSAT TT=9.865 ASSIGNMENTS=819 CHECKS=9297	UNSAT TT=9.708 ASSIGNMENTS=923 CHECKS=0	UNSAT TT=305.844	UNSAT TT=550.906	UNSAT TT=0.638 CHECKS=6708	UNSAT TT=2.519 ASSIGNMENTS=818 CHECKS=9175	UNSAT TT=11.486 ASSIGNMENTS=4181 CHECKS=40421	UNSAT TT=5.584	UNSAT TT=2.928 ASSIGNMENTS=1030 CHECKS=10319	UNSAT TT=2.596 ASSIGNMENTS=819 CHECKS=9297	? TT=32.34	UNSAT TT=110.566 ASSIGNMENTS=111496 CHECKS=65326100	UNSAT TT=891.12	UNSAT TT=912.119
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-16_ext.xml	UNSAT TT=0.676	UNSAT TT=1.661 CHECKS=0 NODES=959	UNSAT TT=1.653 CHECKS=0 NODES=1197	? (TO) TT=1800.03	UNSAT TT=98.713 CHECKS=90081	UNSAT TT=74.406 CHECKS=81917	UNSAT TT=8.027 ASSIGNMENTS=111	UNSAT TT=19.029 ASSIGNMENTS=617	UNSAT TT=2.379 CHECKS=0 NODES=1282	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=10.987 ASSIGNMENTS=910 CHECKS=11498	UNSAT TT=8.92 ASSIGNMENTS=959 CHECKS=0	UNSAT TT=139.674	UNSAT TT=222.808	UNSAT TT=0.676 CHECKS=8717	UNSAT TT=3.291 ASSIGNMENTS=888 CHECKS=11094	UNSAT TT=11.31 ASSIGNMENTS=4229 CHECKS=39639	UNSAT TT=9.982	UNSAT TT=3.075 ASSIGNMENTS=1091 CHECKS=11621	UNSAT TT=3.383 ASSIGNMENTS=910 CHECKS=11498	? TT=33.919	UNSAT TT=218.527 ASSIGNMENTS=112957 CHECKS=132832000	UNSAT TT=804.402	UNSAT TT=985.492
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-17_ext.xml	UNSAT TT=0.641	UNSAT TT=1.58 CHECKS=0 NODES=930	UNSAT TT=1.622 CHECKS=0 NODES=930	UNSAT TT=107.804	UNSAT TT=82.185 CHECKS=76311	UNSAT TT=85.375 CHECKS=96474	UNSAT TT=6.655 ASSIGNMENTS=111	UNSAT TT=8.898 ASSIGNMENTS=131	UNSAT TT=1.919 CHECKS=0 NODES=1037	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=9.536 ASSIGNMENTS=757 CHECKS=8087	UNSAT TT=9.257 ASSIGNMENTS=930 CHECKS=0	UNSAT TT=225.623	UNSAT TT=506.88	UNSAT TT=0.641 CHECKS=6823	UNSAT TT=2.428 ASSIGNMENTS=756 CHECKS=8103	UNSAT TT=10.076 ASSIGNMENTS=4218 CHECKS=36020	UNSAT TT=3.704	UNSAT TT=2.697 ASSIGNMENTS=970 CHECKS=8959	UNSAT TT=2.378 ASSIGNMENTS=757 CHECKS=8087	? TT=35.801	UNSAT TT=203.298 ASSIGNMENTS=111114 CHECKS=122445000	UNSAT TT=783.204	UNSAT TT=847.535
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-18_ext.xml	UNSAT TT=0.578	UNSAT TT=1.383 CHECKS=0 NODES=835	UNSAT TT=1.528 CHECKS=0 NODES=835	? (TO) TT=1800.1	UNSAT TT=93.704 CHECKS=88306	UNSAT TT=85.669 CHECKS=91813	UNSAT TT=5.457 ASSIGNMENTS=111	UNSAT TT=20.218 ASSIGNMENTS=487	UNSAT TT=1.984 CHECKS=0 NODES=1056	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=10.378 ASSIGNMENTS=793 CHECKS=8575	UNSAT TT=9.166 ASSIGNMENTS=835 CHECKS=0	UNSAT TT=165.26	UNSAT TT=260.676	UNSAT TT=0.578 CHECKS=6643	UNSAT TT=2.611 ASSIGNMENTS=793 CHECKS=8575	UNSAT TT=10.337 ASSIGNMENTS=4217 CHECKS=36020	UNSAT TT=3.086	UNSAT TT=3.014 ASSIGNMENTS=994 CHECKS=9482	UNSAT TT=2.649 ASSIGNMENTS=793 CHECKS=8575	? TT=31.65	? (TO) TT=1800.02	UNSAT TT=809.883	UNSAT TT=1083.6
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-19_ext.xml	UNSAT TT=0.674	UNSAT TT=1.899 CHECKS=0 NODES=1370	UNSAT TT=2.13 CHECKS=0 NODES=1474	UNSAT TT=189.189	UNSAT TT=103.305 CHECKS=80298	UNSAT TT=88.588 CHECKS=82977	UNSAT TT=5.805 ASSIGNMENTS=111	UNSAT TT=24.691 ASSIGNMENTS=843	UNSAT TT=2.058 CHECKS=0 NODES=1036	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=9.513 ASSIGNMENTS=797 CHECKS=8758	UNSAT TT=9.467 ASSIGNMENTS=1370 CHECKS=0	UNSAT TT=158.294	UNSAT TT=235.035	UNSAT TT=0.674 CHECKS=6327	UNSAT TT=2.501 ASSIGNMENTS=780 CHECKS=8716	UNSAT TT=11.184 ASSIGNMENTS=4121 CHECKS=38789	UNSAT TT=8.054	UNSAT TT=2.569 ASSIGNMENTS=997 CHECKS=9712	UNSAT TT=2.5 ASSIGNMENTS=797 CHECKS=8758	? TT=32.628	UNSAT TT=1534.02 ASSIGNMENTS=111289 CHECKS=993647000	UNSAT TT=1093.92	UNSAT TT=1500.6
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-1_ext.xml	UNSAT TT=0.731	UNSAT TT=2.954 CHECKS=0 NODES=2509	UNSAT TT=2.939 CHECKS=0 NODES=2588	UNSAT TT=71.571	UNSAT TT=99.77 CHECKS=83916	UNSAT TT=89.623 CHECKS=90474	UNSAT TT=5.563 ASSIGNMENTS=111	UNSAT TT=15.895 ASSIGNMENTS=255	UNSAT TT=2.088 CHECKS=0 NODES=1060	? (TO) TT=1800	? (TO) TT=1800.08	UNSAT TT=9.653 ASSIGNMENTS=848 CHECKS=8798	UNSAT TT=10.485 ASSIGNMENTS=2509 CHECKS=0	UNSAT TT=282.682	UNSAT TT=446.772	UNSAT TT=0.731 CHECKS=6817	UNSAT TT=2.597 ASSIGNMENTS=858 CHECKS=9252	UNSAT TT=12.05 ASSIGNMENTS=4297 CHECKS=39761	UNSAT TT=6.834	UNSAT TT=3.006 ASSIGNMENTS=1101 CHECKS=11768	UNSAT TT=2.38 ASSIGNMENTS=848 CHECKS=8798	? TT=35.815	UNSAT TT=12.488 ASSIGNMENTS=113026 CHECKS=6262060	UNSAT TT=875.84	UNSAT TT=885.68
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-2_ext.xml	UNSAT TT=1.158	UNSAT TT=1.216 CHECKS=0 NODES=756	UNSAT TT=1.358 CHECKS=0 NODES=752	UNSAT TT=110.626	UNSAT TT=95.068 CHECKS=87092	UNSAT TT=82.026 CHECKS=92245	UNSAT TT=4.37 ASSIGNMENTS=111	UNSAT TT=17.24 ASSIGNMENTS=345	UNSAT TT=1.872 CHECKS=0 NODES=958	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=9.549 ASSIGNMENTS=724 CHECKS=7052	UNSAT TT=9.002 ASSIGNMENTS=756 CHECKS=0	UNSAT TT=91.282	UNSAT TT=125.435	UNSAT TT=1.158 CHECKS=7001	UNSAT TT=1.879 ASSIGNMENTS=724 CHECKS=7052	UNSAT TT=8.898 ASSIGNMENTS=4193 CHECKS=32554	UNSAT TT=5.189	UNSAT TT=2.299 ASSIGNMENTS=951 CHECKS=8586	UNSAT TT=1.682 ASSIGNMENTS=724 CHECKS=7052	? TT=36.543	UNSAT TT=1309.97 ASSIGNMENTS=111110 CHECKS=841934000	UNSAT TT=803.837	UNSAT TT=986.755
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-3_ext.xml	UNSAT TT=0.64	UNSAT TT=1.551 CHECKS=0 NODES=853	UNSAT TT=1.684 CHECKS=0 NODES=874	? (TO) TT=1800.05	UNSAT TT=98.694 CHECKS=92760	UNSAT TT=93.108 CHECKS=112488	UNSAT TT=7.014 ASSIGNMENTS=111	UNSAT TT=19.734 ASSIGNMENTS=679	UNSAT TT=2.562 CHECKS=0 NODES=1274	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=10.625 ASSIGNMENTS=899 CHECKS=10540	UNSAT TT=9.689 ASSIGNMENTS=853 CHECKS=0	UNSAT TT=181.322	UNSAT TT=348.264	UNSAT TT=0.64 CHECKS=7560	UNSAT TT=2.673 ASSIGNMENTS=902 CHECKS=10428	UNSAT TT=10.814 ASSIGNMENTS=4256 CHECKS=38715	UNSAT TT=5.018	UNSAT TT=3.502 ASSIGNMENTS=1136 CHECKS=12562	UNSAT TT=3.159 ASSIGNMENTS=899 CHECKS=10540	? TT=35.834	? (TO) TT=1800.01	UNSAT TT=1121.42	UNSAT TT=1675.11
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-4_ext.xml	UNSAT TT=0.674	UNSAT TT=1.893 CHECKS=0 NODES=1140	UNSAT TT=1.824 CHECKS=0 NODES=1140	UNSAT TT=1487.26	UNSAT TT=92.26 CHECKS=83398	UNSAT TT=88.72 CHECKS=88194	UNSAT TT=5.563 ASSIGNMENTS=111	UNSAT TT=11.67 ASSIGNMENTS=191	UNSAT TT=1.908 CHECKS=0 NODES=1027	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=9.927 ASSIGNMENTS=743 CHECKS=7756	UNSAT TT=9.678 ASSIGNMENTS=1140 CHECKS=0	UNSAT TT=219.859	UNSAT TT=476.404	UNSAT TT=0.674 CHECKS=6691	UNSAT TT=2.762 ASSIGNMENTS=774 CHECKS=8402	UNSAT TT=10.38 ASSIGNMENTS=4118 CHECKS=37012	UNSAT TT=3.847	UNSAT TT=2.481 ASSIGNMENTS=959 CHECKS=8708	UNSAT TT=2.186 ASSIGNMENTS=743 CHECKS=7756	? TT=33.029	UNSAT TT=450.423 ASSIGNMENTS=111110 CHECKS=346052000	UNSAT TT=863.232	UNSAT TT=914.948
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-5_ext.xml	UNSAT TT=1.002	UNSAT TT=3.467 CHECKS=0 NODES=1474	UNSAT TT=3.461 CHECKS=0 NODES=1542	? (TO) TT=1800.1	UNSAT TT=114.41 CHECKS=91305	UNSAT TT=106.646 CHECKS=96506	UNSAT TT=7.268 ASSIGNMENTS=111	UNSAT TT=19.665 ASSIGNMENTS=413	UNSAT TT=2.298 CHECKS=0 NODES=1375	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=10.489 ASSIGNMENTS=895 CHECKS=11369	UNSAT TT=9.947 ASSIGNMENTS=1474 CHECKS=0	UNSAT TT=284.375	UNSAT TT=732.757	UNSAT TT=1.002 CHECKS=6992	UNSAT TT=2.573 ASSIGNMENTS=863 CHECKS=9314	UNSAT TT=11.471 ASSIGNMENTS=4267 CHECKS=42607	UNSAT TT=10.46	UNSAT TT=3.344 ASSIGNMENTS=1108 CHECKS=12607	UNSAT TT=2.985 ASSIGNMENTS=895 CHECKS=11369	? TT=31.555	? (TO) TT=1800.07	UNSAT TT=1002.13	UNSAT TT=1432.77
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-6_ext.xml	UNSAT TT=0.676	UNSAT TT=2.009 CHECKS=0 NODES=882	UNSAT TT=2.03 CHECKS=0 NODES=871	UNSAT TT=121.364	UNSAT TT=101.019 CHECKS=87241	UNSAT TT=92.62 CHECKS=91176	UNSAT TT=6.833 ASSIGNMENTS=111	UNSAT TT=30.432 ASSIGNMENTS=813	UNSAT TT=1.942 CHECKS=0 NODES=1059	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=9.996 ASSIGNMENTS=815 CHECKS=8334	UNSAT TT=9.257 ASSIGNMENTS=882 CHECKS=0	UNSAT TT=139.348	UNSAT TT=489.974	UNSAT TT=0.676 CHECKS=6109	UNSAT TT=2.252 ASSIGNMENTS=815 CHECKS=8330	UNSAT TT=11.083 ASSIGNMENTS=4280 CHECKS=38745	UNSAT TT=4.996	UNSAT TT=2.995 ASSIGNMENTS=1060 CHECKS=10691	UNSAT TT=2.204 ASSIGNMENTS=815 CHECKS=8334	? TT=35.212	UNSAT TT=30.005 ASSIGNMENTS=113031 CHECKS=14766900	UNSAT TT=912.117	UNSAT TT=1060.66
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-7_ext.xml	UNSAT TT=0.73	UNSAT TT=2.041 CHECKS=0 NODES=2580	UNSAT TT=2.135 CHECKS=0 NODES=2633	? (TO) TT=1800.11	UNSAT TT=94.408 CHECKS=85397	UNSAT TT=70.046 CHECKS=72073	UNSAT TT=5.886 ASSIGNMENTS=111	UNSAT TT=38.272 ASSIGNMENTS=1080	UNSAT TT=2.178 CHECKS=0 NODES=1030	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=9.626 ASSIGNMENTS=762 CHECKS=7913	UNSAT TT=9.522 ASSIGNMENTS=2580 CHECKS=0	UNSAT TT=187.704	UNSAT TT=290.574	UNSAT TT=0.73 CHECKS=6735	UNSAT TT=2.23 ASSIGNMENTS=762 CHECKS=7913	UNSAT TT=10.02 ASSIGNMENTS=4125 CHECKS=37673	UNSAT TT=6.665	UNSAT TT=2.313 ASSIGNMENTS=949 CHECKS=8791	UNSAT TT=2.187 ASSIGNMENTS=762 CHECKS=7913	? TT=32.15	UNSAT TT=1439.49 ASSIGNMENTS=111110 CHECKS=948399000	UNSAT TT=781.079	UNSAT TT=800.169
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-8_ext.xml	UNSAT TT=0.725	UNSAT TT=2.175 CHECKS=0 NODES=1045	UNSAT TT=2.072 CHECKS=0 NODES=1052	? (TO) TT=1800.03	UNSAT TT=116.997 CHECKS=89071	UNSAT TT=111.636 CHECKS=91478	UNSAT TT=8.047 ASSIGNMENTS=112	UNSAT TT=21.348 ASSIGNMENTS=647	UNSAT TT=2.515 CHECKS=0 NODES=1387	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=10.821 ASSIGNMENTS=945 CHECKS=12317	UNSAT TT=9.296 ASSIGNMENTS=1045 CHECKS=0	UNSAT TT=295.363	UNSAT TT=528.905	UNSAT TT=0.725 CHECKS=9155	UNSAT TT=3.826 ASSIGNMENTS=989 CHECKS=12929	UNSAT TT=12.691 ASSIGNMENTS=4309 CHECKS=43520	UNSAT TT=11.509	UNSAT TT=4.142 ASSIGNMENTS=1180 CHECKS=13636	UNSAT TT=3.833 ASSIGNMENTS=945 CHECKS=12317	? TT=32.507	UNSAT TT=417.371 ASSIGNMENTS=113004 CHECKS=268148000	UNSAT TT=952.622	UNSAT TT=941.839
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-9_ext.xml	UNSAT TT=1.065	UNSAT TT=1.438 CHECKS=0 NODES=916	UNSAT TT=1.453 CHECKS=0 NODES=916	UNSAT TT=258.533	UNSAT TT=101.754 CHECKS=80625	UNSAT TT=91.802 CHECKS=88350	UNSAT TT=6.276 ASSIGNMENTS=111	UNSAT TT=26.456 ASSIGNMENTS=848	UNSAT TT=2.616 CHECKS=0 NODES=1259	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=9.972 ASSIGNMENTS=871 CHECKS=9291	UNSAT TT=9.272 ASSIGNMENTS=916 CHECKS=0	UNSAT TT=194.989	UNSAT TT=305.505	UNSAT TT=1.065 CHECKS=7536	UNSAT TT=2.963 ASSIGNMENTS=834 CHECKS=10247	UNSAT TT=11.198 ASSIGNMENTS=4217 CHECKS=40681	UNSAT TT=7.393	UNSAT TT=2.896 ASSIGNMENTS=1034 CHECKS=11129	UNSAT TT=2.438 ASSIGNMENTS=871 CHECKS=9291	? TT=33.739	UNSAT TT=1736.23 ASSIGNMENTS=111301 CHECKS=1006860000	UNSAT TT=1688.06	? (TO) TT=1800.09
csp/rand-2-23/ normalized-rand-23-23-253-131-46021_ext.xml	UNSAT TT=22.416	UNSAT TT=96.493 CHECKS=533169000 NODES=398553	UNSAT TT=94.597 CHECKS=532351000 NODES=398015	UNSAT TT=22.416	UNSAT TT=735.712 CHECKS=218785000	UNSAT TT=500.384 CHECKS=92168600	UNSAT TT=142.58 ASSIGNMENTS=188574	UNSAT TT=150.896 ASSIGNMENTS=188574	UNSAT TT=117.499 CHECKS=29226500 NODES=439459	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=44.885 ASSIGNMENTS=384589 CHECKS=157639000	UNSAT TT=96.014 ASSIGNMENTS=398553 CHECKS=533169000	? (TO) TT=1800	? (TO) TT=1800.07	No data	UNSAT TT=34.325 ASSIGNMENTS=388764 CHECKS=159740000	UNSAT TT=39.227 ASSIGNMENTS=407900 CHECKS=166703000	? (TO) TT=1800.12	UNSAT TT=36.352 ASSIGNMENTS=412299 CHECKS=169003000	UNSAT TT=34.284 ASSIGNMENTS=384589 CHECKS=157639000	? (TO) TT=1800.08	UNSAT TT=493.428 ASSIGNMENTS=409929 CHECKS=622859000	? (TO) TT=1800.09	? (TO) TT=1800.04
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-23/ normalized-rand-23-23-253-131-47021_ext.xml	UNSAT TT=19.782	UNSAT TT=89.888 CHECKS=539958000 NODES=401195	UNSAT TT=91.112 CHECKS=543707000 NODES=404017	UNSAT TT=19.782	UNSAT TT=889.333 CHECKS=255497000	UNSAT TT=508.22 CHECKS=89201600	UNSAT TT=133.043 ASSIGNMENTS=181934	UNSAT TT=148.274 ASSIGNMENTS=181934	UNSAT TT=124.334 CHECKS=29145300 NODES=434935	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=45.147 ASSIGNMENTS=395034 CHECKS=163451000	UNSAT TT=98.222 ASSIGNMENTS=401195 CHECKS=539958000	? (TO) TT=1800.09	? (TO) TT=1800.04	No data	UNSAT TT=38.148 ASSIGNMENTS=402640 CHECKS=165885000	UNSAT TT=37.567 ASSIGNMENTS=390675 CHECKS=160940000	? (TO) TT=1800.09	UNSAT TT=36.141 ASSIGNMENTS=394360 CHECKS=162732000	UNSAT TT=37.55 ASSIGNMENTS=395034 CHECKS=163451000	? (TO) TT=1800.15	UNSAT TT=518.774 ASSIGNMENTS=396010 CHECKS=604015000	? (TO) TT=1800.09	? (TO) TT=1800.06
csp/rand-2-23/ normalized-rand-23-23-253-131-48021_ext.xml	SAT TT=5.175	SAT TT=39.719 CHECKS=217622000 NODES=162155	SAT TT=38.687 CHECKS=212054000 NODES=158138	SAT TT=5.175	SAT TT=290.696 CHECKS=87249600	SAT TT=160.976 CHECKS=30004200	SAT TT=105.624 ASSIGNMENTS=132336	SAT TT=117.735 ASSIGNMENTS=132336	SAT TT=43.979 CHECKS=10069800 NODES=150437	SAT TT=8.491 CHECKS=59319000 NODES=117182	SAT TT=1566.28 CHECKS=10502000000 NODES=5155690	SAT TT=20.47 ASSIGNMENTS=129255 CHECKS=52884500	SAT TT=44.253 ASSIGNMENTS=162155 CHECKS=217622000	SAT TT=169.142	? (TO) TT=1800.03	No data	SAT TT=22.376 ASSIGNMENTS=251997 CHECKS=103514000	SAT TT=11.072 ASSIGNMENTS=126740 CHECKS=51486200	SAT TT=1514.25	SAT TT=6.221 ASSIGNMENTS=64139 CHECKS=26278600	SAT TT=12.395 ASSIGNMENTS=129255 CHECKS=52884500	? (TO) TT=1800.16	SAT TT=116.133 ASSIGNMENTS=64131 CHECKS=97844800	SAT TT=1198.47	? (TO) TT=1800.05
csp/rand-2-23/ normalized-rand-23-23-253-131-49021_ext.xml	SAT TT=3.386	SAT TT=14.107 CHECKS=72465500 NODES=54631	SAT TT=13.762 CHECKS=70516800 NODES=53062	SAT TT=15.875	SAT TT=801.051 CHECKS=229143000	SAT TT=351.196 CHECKS=66421000	SAT TT=12.638 ASSIGNMENTS=14425	SAT TT=13.829 ASSIGNMENTS=14425	SAT TT=76.191 CHECKS=17410300 NODES=259781	SAT TT=54.062 CHECKS=409586000 NODES=809278	? (TO) TT=1800.07	SAT TT=12.42 ASSIGNMENTS=49308 CHECKS=20104800	SAT TT=21.444 ASSIGNMENTS=54631 CHECKS=72465500	? (TO) TT=1800.06	? (TO) TT=1800.04	No data	SAT TT=3.386 ASSIGNMENTS=35898 CHECKS=14618900	SAT TT=15.201 ASSIGNMENTS=161070 CHECKS=65825400	SAT TT=1310.13	SAT TT=19.182 ASSIGNMENTS=200759 CHECKS=82712000	SAT TT=4.684 ASSIGNMENTS=49308 CHECKS=20104800	? (TO) TT=1800.17	SAT TT=153.363 ASSIGNMENTS=144913 CHECKS=224387000	SAT TT=288.602	? (TO) TT=1800.09
csp/rand-2-23/ normalized-rand-23-23-253-131-50021_ext.xml	SAT TT=3.707	SAT TT=68.224 CHECKS=372168000 NODES=283408	SAT TT=68.054 CHECKS=372414000 NODES=283348	SAT TT=18.381	SAT TT=249.154 CHECKS=69532500	SAT TT=68.779 CHECKS=12632900	SAT TT=142.248 ASSIGNMENTS=198953	SAT TT=170.758 ASSIGNMENTS=198953	SAT TT=106.136 CHECKS=24283500 NODES=369051	SAT TT=3.764 CHECKS=25738400 NODES=50817	? (TO) TT=1800.02	SAT TT=19.124 ASSIGNMENTS=120701 CHECKS=48578800	SAT TT=71.246 ASSIGNMENTS=283408 CHECKS=372168000	? (TO) TT=1800.08	? (TO) TT=1800.09	No data	SAT TT=30.627 ASSIGNMENTS=353961 CHECKS=143629000	SAT TT=18.403 ASSIGNMENTS=197022 CHECKS=79727800	SAT TT=1521.66	SAT TT=3.707 ASSIGNMENTS=42496 CHECKS=16971700	SAT TT=11.383 ASSIGNMENTS=120701 CHECKS=48578800	? (TO) TT=1800.14	SAT TT=89.904 ASSIGNMENTS=24708 CHECKS=35504300	SAT TT=1316.77	SAT TT=34.992
csp/rand-2-23/ normalized-rand-23-23-253-131-51021_ext.xml	UNSAT TT=23.169	UNSAT TT=101.144 CHECKS=562904000 NODES=422183	UNSAT TT=101.69 CHECKS=561518000 NODES=421807	UNSAT TT=23.169	UNSAT TT=950.811 CHECKS=261326000	UNSAT TT=502.703 CHECKS=94820100	UNSAT TT=161.519 ASSIGNMENTS=206864	UNSAT TT=166.036 ASSIGNMENTS=206864	UNSAT TT=132.303 CHECKS=30132700 NODES=453877	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=49.526 ASSIGNMENTS=441309 CHECKS=180994000	UNSAT TT=47.019 ASSIGNMENTS=441309 CHECKS=180994000	? (TO) TT=1800.04	? (TO) TT=1800.06	No data	UNSAT TT=39.7 ASSIGNMENTS=449184 CHECKS=183500000	UNSAT TT=41.123 ASSIGNMENTS=431923 CHECKS=176336000	? (TO) TT=1800.1	UNSAT TT=39.02 ASSIGNMENTS=439242 CHECKS=179912000	UNSAT TT=39.179 ASSIGNMENTS=441309 CHECKS=180994000	? (TO) TT=1800.2	UNSAT TT=505.358 ASSIGNMENTS=419396 CHECKS=637345000	? (TO) TT=1800.13	? (TO) TT=1800.05
csp/rand-2-23/ normalized-rand-23-23-253-131-52021_ext.xml	UNSAT TT=21.389	UNSAT TT=91.948 CHECKS=512578000 NODES=378497	UNSAT TT=91.224 CHECKS=511852000 NODES=377631	UNSAT TT=21.389	UNSAT TT=843.612 CHECKS=249713000	UNSAT TT=618.456 CHECKS=112021000	UNSAT TT=131.312 ASSIGNMENTS=178927	UNSAT TT=156.532 ASSIGNMENTS=178927	UNSAT TT=120.828 CHECKS=27564700 NODES=411870	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=42.802 ASSIGNMENTS=397901 CHECKS=164363000	UNSAT TT=92.549 ASSIGNMENTS=378497 CHECKS=512578000	? (TO) TT=1800.09	? (TO) TT=1800.1	No data	UNSAT TT=35.046 ASSIGNMENTS=380924 CHECKS=157006000	UNSAT TT=37.316 ASSIGNMENTS=388200 CHECKS=159503000	? (TO) TT=1800.1	UNSAT TT=36.122 ASSIGNMENTS=378555 CHECKS=156225000	UNSAT TT=37.981 ASSIGNMENTS=397901 CHECKS=164363000	? (TO) TT=1800.11	UNSAT TT=320.485 ASSIGNMENTS=370652 CHECKS=568510000	? (TO) TT=1800.12	? (TO) TT=1800.1
csp/rand-2-23/ normalized-rand-23-23-253-131-53021_ext.xml	SAT TT=2.822	SAT TT=75.704 CHECKS=443801000 NODES=329021	SAT TT=74.313 CHECKS=440558000 NODES=326414	SAT TT=11.146	SAT TT=103.316 CHECKS=26967500	SAT TT=337.099 CHECKS=63798300	SAT TT=80.592 ASSIGNMENTS=103260	SAT TT=85.174 ASSIGNMENTS=103260	SAT TT=67.004 CHECKS=16882700 NODES=251429	SAT TT=122.304 CHECKS=1009520000 NODES=1994700	? (TO) TT=1800.09	SAT TT=35.733 ASSIGNMENTS=302971 CHECKS=125038000	SAT TT=36.774 ASSIGNMENTS=302971 CHECKS=125038000	? (TO) TT=1800.08	? (TO) TT=1800.01	No data	SAT TT=2.822 ASSIGNMENTS=29404 CHECKS=11982400	SAT TT=21.406 ASSIGNMENTS=227447 CHECKS=93031600	SAT TT=1077.57	SAT TT=4.695 ASSIGNMENTS=48401 CHECKS=19792500	SAT TT=27.815 ASSIGNMENTS=302971 CHECKS=125038000	? (TO) TT=1800.12	SAT TT=71.49 ASSIGNMENTS=62038 CHECKS=95682100	SAT TT=418.232	? (TO) TT=1800.06
csp/rand-2-23/ normalized-rand-23-23-253-131-54021_ext.xml	SAT TT=0.811	SAT TT=19.193 CHECKS=100834000 NODES=76678	SAT TT=18.42 CHECKS=96406500 NODES=73599	SAT TT=12.762	SAT TT=231.606 CHECKS=65259300	SAT TT=2.26 CHECKS=364396	SAT TT=88.625 ASSIGNMENTS=121725	SAT TT=105.304 ASSIGNMENTS=121725	SAT TT=0.811 CHECKS=27399 NODES=272	SAT TT=5.59 CHECKS=38974300 NODES=76975	SAT TT=260.178 CHECKS=1877970000 NODES=949100	SAT TT=9.187 ASSIGNMENTS=15951 CHECKS=6633180	SAT TT=26.56 ASSIGNMENTS=76678 CHECKS=100834000	? (TO) TT=1800.08	SAT TT=1381.35	No data	SAT TT=16.48 ASSIGNMENTS=184923 CHECKS=75986800	SAT TT=5.593 ASSIGNMENTS=65172 CHECKS=25897900	SAT TT=281.58	SAT TT=21.12 ASSIGNMENTS=219847 CHECKS=89707600	SAT TT=1.465 ASSIGNMENTS=15951 CHECKS=6633180	? (TO) TT=1800.09	SAT TT=290.165 ASSIGNMENTS=304000 CHECKS=460191000	SAT TT=188.53	SAT TT=805.344
csp/rand-2-23/ normalized-rand-23-23-253-131-55021_ext.xml	UNSAT TT=22.347	UNSAT TT=95.572 CHECKS=530105000 NODES=396088	UNSAT TT=96.247 CHECKS=527259000 NODES=393986	UNSAT TT=22.347	UNSAT TT=933.805 CHECKS=259278000	UNSAT TT=463.729 CHECKS=90367800	UNSAT TT=137.084 ASSIGNMENTS=185544	UNSAT TT=160.234 ASSIGNMENTS=185544	UNSAT TT=111.782 CHECKS=28241200 NODES=425598	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=45.841 ASSIGNMENTS=404123 CHECKS=165423000	UNSAT TT=97.106 ASSIGNMENTS=396088 CHECKS=530105000	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	UNSAT TT=38.627 ASSIGNMENTS=434730 CHECKS=178183000	UNSAT TT=40.934 ASSIGNMENTS=434318 CHECKS=177530000	? (TO) TT=1800.08	UNSAT TT=39.203 ASSIGNMENTS=412282 CHECKS=169276000	UNSAT TT=38.137 ASSIGNMENTS=404123 CHECKS=165423000	? (TO) TT=1800.11	UNSAT TT=498.465 ASSIGNMENTS=416351 CHECKS=630602000	? (TO) TT=1800.1	? (TO) TT=1800.11
csp/rand-2-24/ normalized-rand-24-24-276-139-48021_ext.xml	SAT TT=2.009	SAT TT=66.229 CHECKS=360552000 NODES=257174	SAT TT=60.053 CHECKS=361825000 NODES=257652	SAT TT=3.286	SAT TT=1762.96 CHECKS=499084000	SAT TT=4.766 CHECKS=771811	SAT TT=59.735 ASSIGNMENTS=68090	SAT TT=58.085 ASSIGNMENTS=68090	SAT TT=211.674 CHECKS=46403600 NODES=686833	SAT TT=5.98 CHECKS=40404300 NODES=73145	? (TO) TT=1800.08	SAT TT=27.173 ASSIGNMENTS=204412 CHECKS=88954500	SAT TT=68.279 ASSIGNMENTS=257174 CHECKS=360552000	? (TO) TT=1800.01	? (TO) TT=1800.08	No data	SAT TT=20.824 ASSIGNMENTS=217758 CHECKS=94882100	SAT TT=10.508 ASSIGNMENTS=103299 CHECKS=44579700	SAT TT=372.304	SAT TT=77.232 ASSIGNMENTS=736516 CHECKS=322795000	SAT TT=21.255 ASSIGNMENTS=204412 CHECKS=88954500	? (TO) TT=1800.14	SAT TT=2.009 ASSIGNMENTS=748 CHECKS=1172300	? (TO) TT=1800.04	SAT TT=479.011
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-24/ normalized-rand-24-24-276-139-49021_ext.xml	UNSAT TT=48.246	UNSAT TT=200.805 CHECKS=1207730000 NODES=839841	UNSAT TT=213.756 CHECKS=1204170000 NODES=836873	UNSAT TT=48.246	? (TO) TT=1800.1	UNSAT TT=918.495 CHECKS=167487000	UNSAT TT=329.217 ASSIGNMENTS=392312	UNSAT TT=315.412 ASSIGNMENTS=392312	UNSAT TT=269.181 CHECKS=62349900 NODES=910012	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=93.34 ASSIGNMENTS=838067 CHECKS=368644000	UNSAT TT=217.264 ASSIGNMENTS=839841 CHECKS=1207730000	? (TO) TT=1800.04	? (TO) TT=1800.09	No data	UNSAT TT=80.941 ASSIGNMENTS=778136 CHECKS=341993000	UNSAT TT=81.344 ASSIGNMENTS=790847 CHECKS=346880000	? (TO) TT=1800.11	UNSAT TT=90.882 ASSIGNMENTS=850339 CHECKS=375601000	UNSAT TT=84.487 ASSIGNMENTS=838067 CHECKS=368644000	? (TO) TT=1800.14	UNSAT TT=1105.38 ASSIGNMENTS=871473 CHECKS=1405020000	? (TO) TT=1800.11	? (TO) TT=1800.12
csp/rand-2-24/ normalized-rand-24-24-276-139-50021_ext.xml	SAT TT=2.804	SAT TT=42.513 CHECKS=234733000 NODES=166976	SAT TT=42.506 CHECKS=232604000 NODES=165664	SAT TT=2.804	SAT TT=579.726 CHECKS=159937000	SAT TT=817.497 CHECKS=146342000	SAT TT=36.697 ASSIGNMENTS=45411	SAT TT=35.744 ASSIGNMENTS=45411	SAT TT=235.284 CHECKS=54520000 NODES=797412	SAT TT=123.522 CHECKS=1011160000 NODES=1831430	? (TO) TT=1800.1	SAT TT=19.345 ASSIGNMENTS=110625 CHECKS=48262300	SAT TT=46.762 ASSIGNMENTS=166976 CHECKS=234733000	? (TO) TT=1800.09	? (TO) TT=1800.02	No data	SAT TT=14.32 ASSIGNMENTS=139336 CHECKS=60754900	SAT TT=25.502 ASSIGNMENTS=268504 CHECKS=116794000	? (TO) TT=1800.06	SAT TT=31.738 ASSIGNMENTS=303968 CHECKS=133453000	SAT TT=11.258 ASSIGNMENTS=110625 CHECKS=48262300	? (TO) TT=1800.13	SAT TT=695.136 ASSIGNMENTS=737258 CHECKS=1178840000	? (TO) TT=1800.05	? (TO) TT=1800.1
csp/rand-2-24/ normalized-rand-24-24-276-139-51021_ext.xml	UNSAT TT=46.547	UNSAT TT=218.029 CHECKS=1222180000 NODES=852867	UNSAT TT=216.31 CHECKS=1217920000 NODES=850241	UNSAT TT=46.547	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=337.686 ASSIGNMENTS=425255	UNSAT TT=327.705 ASSIGNMENTS=425255	UNSAT TT=265.896 CHECKS=61855700 NODES=905038	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=96.026 ASSIGNMENTS=861857 CHECKS=378822000	UNSAT TT=206.505 ASSIGNMENTS=852867 CHECKS=1222180000	? (TO) TT=1800.06	? (TO) TT=1800.09	No data	UNSAT TT=86.541 ASSIGNMENTS=905083 CHECKS=397446000	UNSAT TT=91.684 ASSIGNMENTS=888562 CHECKS=390640000	? (TO) TT=1800.03	UNSAT TT=92.812 ASSIGNMENTS=881478 CHECKS=386924000	UNSAT TT=83.047 ASSIGNMENTS=861857 CHECKS=378822000	? (TO) TT=1800.16	UNSAT TT=1110.85 ASSIGNMENTS=867784 CHECKS=1401450000	? (TO) TT=1800.12	? (TO) TT=1800.1
csp/rand-2-24/ normalized-rand-24-24-276-139-52021_ext.xml	UNSAT TT=44.878	UNSAT TT=217.321 CHECKS=1218930000 NODES=852772	UNSAT TT=199.89 CHECKS=1218640000 NODES=852052	UNSAT TT=44.878	? (TO) TT=1800.06	UNSAT TT=1059.09 CHECKS=187121000	UNSAT TT=352.075 ASSIGNMENTS=420028	UNSAT TT=334.663 ASSIGNMENTS=420028	UNSAT TT=281.997 CHECKS=63028100 NODES=923341	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=100.143 ASSIGNMENTS=905639 CHECKS=399422000	UNSAT TT=206.725 ASSIGNMENTS=852772 CHECKS=1218930000	? (TO) TT=1800.08	? (TO) TT=1800.08	No data	UNSAT TT=93.267 ASSIGNMENTS=899872 CHECKS=396029000	UNSAT TT=88.872 ASSIGNMENTS=863148 CHECKS=378583000	? (TO) TT=1800.1	UNSAT TT=92.304 ASSIGNMENTS=908414 CHECKS=399648000	UNSAT TT=89.111 ASSIGNMENTS=905639 CHECKS=399422000	? (TO) TT=1800.12	UNSAT TT=1116.72 ASSIGNMENTS=902362 CHECKS=1451190000	? (TO) TT=1800.12	? (TO) TT=1800.09
csp/rand-2-24/ normalized-rand-24-24-276-139-53021_ext.xml	UNSAT TT=46.142	UNSAT TT=214.137 CHECKS=1210830000 NODES=851845	UNSAT TT=201.499 CHECKS=1211730000 NODES=851864	UNSAT TT=46.142	? (TO) TT=1800.07	UNSAT TT=1166.89 CHECKS=195716000	UNSAT TT=332.761 ASSIGNMENTS=430003	UNSAT TT=348.889 ASSIGNMENTS=430003	UNSAT TT=266.498 CHECKS=64694700 NODES=955553	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=103.359 ASSIGNMENTS=928184 CHECKS=406476000	UNSAT TT=218.641 ASSIGNMENTS=851845 CHECKS=1210830000	? (TO) TT=1800.05	? (TO) TT=1800.04	No data	UNSAT TT=93.821 ASSIGNMENTS=914250 CHECKS=400421000	UNSAT TT=88.189 ASSIGNMENTS=920321 CHECKS=400980000	? (TO) TT=1800.05	UNSAT TT=87.83 ASSIGNMENTS=908358 CHECKS=396845000	UNSAT TT=88.593 ASSIGNMENTS=928184 CHECKS=406476000	? (TO) TT=1800.13	UNSAT TT=1217.72 ASSIGNMENTS=912563 CHECKS=1455430000	? (TO) TT=1800.06	? (TO) TT=1800.14
csp/rand-2-24/ normalized-rand-24-24-276-139-54021_ext.xml	UNSAT TT=49.472	UNSAT TT=214.288 CHECKS=1204420000 NODES=846312	UNSAT TT=199.539 CHECKS=1200230000 NODES=843554	UNSAT TT=49.472	? (TO) TT=1800.04	UNSAT TT=1133.42 CHECKS=189550000	UNSAT TT=344.414 ASSIGNMENTS=434118	UNSAT TT=332.651 ASSIGNMENTS=434118	UNSAT TT=270.818 CHECKS=61137300 NODES=900623	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=93.599 ASSIGNMENTS=869144 CHECKS=381059000	UNSAT TT=205.783 ASSIGNMENTS=846312 CHECKS=1204420000	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	UNSAT TT=86.576 ASSIGNMENTS=900992 CHECKS=395121000	UNSAT TT=88.477 ASSIGNMENTS=870026 CHECKS=379656000	? (TO) TT=1800.13	UNSAT TT=95.299 ASSIGNMENTS=921877 CHECKS=403835000	UNSAT TT=85.981 ASSIGNMENTS=869144 CHECKS=381059000	? (TO) TT=1800.07	UNSAT TT=1165.45 ASSIGNMENTS=945633 CHECKS=1506710000	? (TO) TT=1800.06	? (TO) TT=1800.07
csp/rand-2-24/ normalized-rand-24-24-276-139-55021_ext.xml	SAT TT=5.384	SAT TT=32.603 CHECKS=178266000 NODES=128737	SAT TT=33.605 CHECKS=183296000 NODES=131329	SAT TT=28.537	SAT TT=1711.12 CHECKS=483083000	SAT TT=159.546 CHECKS=26500800	SAT TT=100.983 ASSIGNMENTS=119555	SAT TT=90.555 ASSIGNMENTS=119555	SAT TT=21.172 CHECKS=4902390 NODES=72453	SAT TT=18.34 CHECKS=136050000 NODES=246388	? (TO) TT=1800.05	SAT TT=12.682 ASSIGNMENTS=52551 CHECKS=22982100	SAT TT=39.941 ASSIGNMENTS=128737 CHECKS=178266000	? (TO) TT=1800.07	? (TO) TT=1800.04	No data	SAT TT=8.887 ASSIGNMENTS=88388 CHECKS=38533000	SAT TT=7.382 ASSIGNMENTS=75106 CHECKS=32069300	SAT TT=1243.58	SAT TT=68.077 ASSIGNMENTS=682438 CHECKS=298830000	SAT TT=5.384 ASSIGNMENTS=52551 CHECKS=22982100	? (TO) TT=1800.15	SAT TT=656.205 ASSIGNMENTS=565566 CHECKS=902690000	? (TO) TT=1800.09	SAT TT=950.93
csp/rand-2-24/ normalized-rand-24-24-276-139-56021_ext.xml	UNSAT TT=50.615	UNSAT TT=231.273 CHECKS=1295510000 NODES=911013	UNSAT TT=228.584 CHECKS=1284920000 NODES=903188	UNSAT TT=50.615	? (TO) TT=1800.05	UNSAT TT=1129.39 CHECKS=200974000	UNSAT TT=355.753 ASSIGNMENTS=421992	UNSAT TT=317.022 ASSIGNMENTS=421992	UNSAT TT=275.537 CHECKS=62452200 NODES=918422	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=91.551 ASSIGNMENTS=885203 CHECKS=387148000	UNSAT TT=234.239 ASSIGNMENTS=911013 CHECKS=1295510000	? (TO) TT=1800.01	? (TO) TT=1800.04	No data	UNSAT TT=95.459 ASSIGNMENTS=926372 CHECKS=407350000	UNSAT TT=91.75 ASSIGNMENTS=884249 CHECKS=385926000	? (TO) TT=1800.08	UNSAT TT=92.815 ASSIGNMENTS=909281 CHECKS=398017000	UNSAT TT=85.541 ASSIGNMENTS=885203 CHECKS=387148000	? (TO) TT=1800.14	UNSAT TT=1122.94 ASSIGNMENTS=911702 CHECKS=1455850000	? (TO) TT=1800.14	? (TO) TT=1800.13
csp/rand-2-24/ normalized-rand-24-24-276-139-57021_ext.xml	UNSAT TT=44.685	UNSAT TT=211.813 CHECKS=1196000000 NODES=829442	UNSAT TT=212.291 CHECKS=1192500000 NODES=827363	UNSAT TT=44.685	? (TO) TT=1800.01	UNSAT TT=1044.16 CHECKS=184058000	UNSAT TT=345.125 ASSIGNMENTS=404257	UNSAT TT=312.063 ASSIGNMENTS=404257	UNSAT TT=255.279 CHECKS=60754500 NODES=890236	? (TO) TT=1800.1	? (TO) TT=1800.01	UNSAT TT=89.592 ASSIGNMENTS=860974 CHECKS=378566000	UNSAT TT=200.69 ASSIGNMENTS=829442 CHECKS=1196000000	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	UNSAT TT=88.971 ASSIGNMENTS=863505 CHECKS=380008000	UNSAT TT=81.44 ASSIGNMENTS=843684 CHECKS=371025000	? (TO) TT=1800.08	UNSAT TT=85.941 ASSIGNMENTS=872867 CHECKS=383250000	UNSAT TT=89.935 ASSIGNMENTS=860974 CHECKS=378566000	? (TO) TT=1800.13	UNSAT TT=1186.8 ASSIGNMENTS=854171 CHECKS=1379490000	? (TO) TT=1800.14	? (TO) TT=1800.1
csp/rand-2-25/ normalized-rand-25-25-300-147-50021_ext.xml	UNSAT TT=107.632	UNSAT TT=475.116 CHECKS=2885910000 NODES=1905630	UNSAT TT=504.538 CHECKS=2880290000 NODES=1902140	UNSAT TT=107.632	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=736.701 ASSIGNMENTS=911836	UNSAT TT=737.083 ASSIGNMENTS=911836	UNSAT TT=660.541 CHECKS=139345000 NODES=2002670	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=218.472 ASSIGNMENTS=1940510 CHECKS=908851000	UNSAT TT=473.647 ASSIGNMENTS=1905630 CHECKS=2885910000	? (TO) TT=1800.01	? (TO) TT=1800.05	No data	UNSAT TT=200.463 ASSIGNMENTS=1901870 CHECKS=887916000	UNSAT TT=191.953 ASSIGNMENTS=1911460 CHECKS=892444000	? (TO) TT=1800.09	UNSAT TT=209.038 ASSIGNMENTS=1914350 CHECKS=893124000	UNSAT TT=213.334 ASSIGNMENTS=1940510 CHECKS=908851000	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-25/ normalized-rand-25-25-300-147-51021_ext.xml	SAT TT=17.791	SAT TT=52.412 CHECKS=307690000 NODES=207574	SAT TT=55.088 CHECKS=310305000 NODES=209187	SAT TT=23.269	? (TO) TT=1800.08	SAT TT=520.187 CHECKS=74229300	SAT TT=68.199 ASSIGNMENTS=77028	SAT TT=68.259 ASSIGNMENTS=77028	SAT TT=299.554 CHECKS=63340000 NODES=912077	SAT TT=17.791 CHECKS=144361000 NODES=240519	? (TO) TT=1800.1	SAT TT=74.975 ASSIGNMENTS=625344 CHECKS=290008000	SAT TT=58.848 ASSIGNMENTS=207574 CHECKS=307690000	? (TO) TT=1800.03	? (TO) TT=1800.06	No data	SAT TT=78.735 ASSIGNMENTS=724347 CHECKS=336973000	SAT TT=60.014 ASSIGNMENTS=600179 CHECKS=279308000	? (TO) TT=1800.06	SAT TT=108.137 ASSIGNMENTS=1062880 CHECKS=496400000	SAT TT=62.988 ASSIGNMENTS=625344 CHECKS=290008000	? (TO) TT=1800.14	SAT TT=512.991 ASSIGNMENTS=258446 CHECKS=435965000	? (TO) TT=1800.08	? (TO) TT=1800.07
csp/rand-2-25/ normalized-rand-25-25-300-147-52021_ext.xml	SAT TT=1.945	SAT TT=458.282 CHECKS=2586830000 NODES=1715120	SAT TT=453.551 CHECKS=2587730000 NODES=1715780	SAT TT=1.945	? (TO) TT=1800.02	SAT TT=1387.74 CHECKS=209473000	SAT TT=180.692 ASSIGNMENTS=224939	SAT TT=180.304 ASSIGNMENTS=224939	SAT TT=530.123 CHECKS=111184000 NODES=1608380	SAT TT=59.063 CHECKS=450848000 NODES=751218	? (TO) TT=1800.08	SAT TT=104.994 ASSIGNMENTS=893445 CHECKS=413503000	SAT TT=434.267 ASSIGNMENTS=1715120 CHECKS=2586830000	? (TO) TT=1800.03	? (TO) TT=1800.08	No data	SAT TT=106.398 ASSIGNMENTS=979408 CHECKS=454881000	SAT TT=205.113 ASSIGNMENTS=1882190 CHECKS=877792000	? (TO) TT=1800.04	SAT TT=42.875 ASSIGNMENTS=396564 CHECKS=183213000	SAT TT=98.363 ASSIGNMENTS=893445 CHECKS=413503000	? (TO) TT=1800.15	SAT TT=218.331 ASSIGNMENTS=14984 CHECKS=25106700	? (TO) TT=1800.12	? (TO) TT=1800.12
csp/rand-2-25/ normalized-rand-25-25-300-147-53021_ext.xml	SAT TT=0.808	SAT TT=8.435 CHECKS=41161500 NODES=29309	SAT TT=29.266 CHECKS=160045000 NODES=111802	SAT TT=76.005	SAT TT=531.592 CHECKS=132452000	? (TO) TT=1800.11	SAT TT=410.653 ASSIGNMENTS=509564	SAT TT=446.888 ASSIGNMENTS=509564	SAT TT=236.877 CHECKS=54288800 NODES=784456	SAT TT=0.808 CHECKS=733485 NODES=1169	? (TO) TT=1800.06	SAT TT=22.195 ASSIGNMENTS=145935 CHECKS=68306800	SAT TT=15.388 ASSIGNMENTS=29309 CHECKS=41161500	? (TO) TT=1800.04	? (TO) TT=1800.09	No data	SAT TT=145.7 ASSIGNMENTS=1329110 CHECKS=620534000	SAT TT=9.631 ASSIGNMENTS=90009 CHECKS=41667800	? (TO) TT=1800.1	SAT TT=13.709 ASSIGNMENTS=121876 CHECKS=57102900	SAT TT=14.815 ASSIGNMENTS=145935 CHECKS=68306800	? (TO) TT=1800.13	SAT TT=10.117 ASSIGNMENTS=6713 CHECKS=11024500	? (TO) TT=1800.06	? (TO) TT=1800.06
csp/rand-2-25/ normalized-rand-25-25-300-147-54021_ext.xml	SAT TT=9.298	SAT TT=82.066 CHECKS=488488000 NODES=328170	SAT TT=86.065 CHECKS=486602000 NODES=327133	SAT TT=40.194	SAT TT=332.742 CHECKS=76467000	SAT TT=72.896 CHECKS=12113100	SAT TT=149.252 ASSIGNMENTS=184166	SAT TT=161.361 ASSIGNMENTS=184166	SAT TT=140.172 CHECKS=32345200 NODES=467642	SAT TT=11.041 CHECKS=81865500 NODES=136389	? (TO) TT=1800.09	SAT TT=175.89 ASSIGNMENTS=1519940 CHECKS=709718000	SAT TT=87.524 ASSIGNMENTS=328170 CHECKS=488488000	? (TO) TT=1800.02	? (TO) TT=1800.07	No data	SAT TT=9.298 ASSIGNMENTS=93083 CHECKS=43269000	SAT TT=53.548 ASSIGNMENTS=497193 CHECKS=228423000	? (TO) TT=1800.03	SAT TT=30.917 ASSIGNMENTS=286600 CHECKS=131996000	SAT TT=153.099 ASSIGNMENTS=1519940 CHECKS=709718000	? (TO) TT=1800.13	SAT TT=1299.23 ASSIGNMENTS=1076830 CHECKS=1792660000	? (TO) TT=1800.04	SAT TT=407.837
csp/rand-2-25/ normalized-rand-25-25-300-147-55021_ext.xml	UNSAT TT=112.041	UNSAT TT=505.506 CHECKS=2852920000 NODES=1873800	UNSAT TT=461.901 CHECKS=2856310000 NODES=1876330	UNSAT TT=112.041	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=761.465 ASSIGNMENTS=877517	UNSAT TT=768.537 ASSIGNMENTS=877517	UNSAT TT=602.561 CHECKS=140116000 NODES=2005510	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=198.822 ASSIGNMENTS=1902060 CHECKS=891558000	UNSAT TT=466.362 ASSIGNMENTS=1873800 CHECKS=2852920000	? (TO) TT=1800.05	? (TO) TT=1800.06	No data	UNSAT TT=201.022 ASSIGNMENTS=1940120 CHECKS=910663000	UNSAT TT=195.007 ASSIGNMENTS=1915310 CHECKS=896406000	? (TO) TT=1800.07	UNSAT TT=203.747 ASSIGNMENTS=1989780 CHECKS=933378000	UNSAT TT=200.336 ASSIGNMENTS=1902060 CHECKS=891558000	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/rand-2-25/ normalized-rand-25-25-300-147-56021_ext.xml	SAT TT=8.105	SAT TT=186.57 CHECKS=1047070000 NODES=705773	SAT TT=186.691 CHECKS=1051570000 NODES=708660	SAT TT=93.978	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=770.293 ASSIGNMENTS=961905	SAT TT=770.442 ASSIGNMENTS=961905	SAT TT=241.124 CHECKS=55914500 NODES=806636	SAT TT=193.74 CHECKS=1488880000 NODES=2480960	? (TO) TT=1800.04	SAT TT=187.931 ASSIGNMENTS=1771150 CHECKS=825986000	SAT TT=181.608 ASSIGNMENTS=705773 CHECKS=1047070000	? (TO) TT=1800.05	? (TO) TT=1800.03	No data	SAT TT=43.481 ASSIGNMENTS=401774 CHECKS=185582000	SAT TT=8.105 ASSIGNMENTS=77259 CHECKS=34829600	? (TO) TT=1800.06	SAT TT=214.402 ASSIGNMENTS=1983530 CHECKS=926695000	SAT TT=190.782 ASSIGNMENTS=1771150 CHECKS=825986000	? (TO) TT=1800.13	SAT TT=138.478 ASSIGNMENTS=66959 CHECKS=111979000	? (TO) TT=1800.13	? (TO) TT=1800.12
csp/rand-2-25/ normalized-rand-25-25-300-147-57021_ext.xml	UNSAT TT=113.236	UNSAT TT=488.431 CHECKS=2779210000 NODES=1825840	UNSAT TT=484.278 CHECKS=2768240000 NODES=1818530	UNSAT TT=113.236	? (TO) TT=1800.03	? (TO) TT=1800.11	UNSAT TT=773.522 ASSIGNMENTS=889479	UNSAT TT=743.812 ASSIGNMENTS=889479	UNSAT TT=623.192 CHECKS=138627000 NODES=1982050	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=210.312 ASSIGNMENTS=1864800 CHECKS=874483000	UNSAT TT=457.631 ASSIGNMENTS=1825840 CHECKS=2779210000	? (TO) TT=1800.07	? (TO) TT=1800.03	No data	UNSAT TT=195.354 ASSIGNMENTS=1815280 CHECKS=851000000	UNSAT TT=214.945 ASSIGNMENTS=1978450 CHECKS=931513000	? (TO) TT=1800.11	UNSAT TT=204.641 ASSIGNMENTS=1873070 CHECKS=877892000	UNSAT TT=188.661 ASSIGNMENTS=1864800 CHECKS=874483000	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/rand-2-25/ normalized-rand-25-25-300-147-58021_ext.xml	UNSAT TT=113.305	UNSAT TT=487.535 CHECKS=2928760000 NODES=1928720	UNSAT TT=511.134 CHECKS=2929430000 NODES=1929820	UNSAT TT=113.305	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=745.477 ASSIGNMENTS=936209	UNSAT TT=798.805 ASSIGNMENTS=936209	UNSAT TT=684.323 CHECKS=144570000 NODES=2077810	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=208.517 ASSIGNMENTS=1959470 CHECKS=918238000	UNSAT TT=505.997 ASSIGNMENTS=1928720 CHECKS=2928760000	? (TO) TT=1800.07	? (TO) TT=1800.04	No data	UNSAT TT=207.493 ASSIGNMENTS=1893430 CHECKS=884805000	UNSAT TT=206.537 ASSIGNMENTS=1911280 CHECKS=895419000	? (TO) TT=1800.09	UNSAT TT=202.641 ASSIGNMENTS=1853260 CHECKS=867974000	UNSAT TT=215.928 ASSIGNMENTS=1959470 CHECKS=918238000	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11
csp/rand-2-25/ normalized-rand-25-25-300-147-59021_ext.xml	SAT TT=8.352	SAT TT=275.926 CHECKS=1561550000 NODES=1041490	SAT TT=272.582 CHECKS=1566140000 NODES=1043550	SAT TT=43.033	? (TO) TT=1800.07	SAT TT=284.53 CHECKS=44992700	SAT TT=357.848 ASSIGNMENTS=448165	SAT TT=360.876 ASSIGNMENTS=448165	SAT TT=485.607 CHECKS=109600000 NODES=1580140	SAT TT=8.352 CHECKS=64124100 NODES=106820	? (TO) TT=1800.08	SAT TT=58.476 ASSIGNMENTS=514183 CHECKS=238797000	SAT TT=275.704 ASSIGNMENTS=1041490 CHECKS=1561550000	? (TO) TT=1800.1	? (TO) TT=1800.02	No data	SAT TT=204.027 ASSIGNMENTS=1893770 CHECKS=886052000	SAT TT=155.581 ASSIGNMENTS=1562480 CHECKS=729007000	? (TO) TT=1800.05	SAT TT=227.144 ASSIGNMENTS=2036920 CHECKS=953861000	SAT TT=51.367 ASSIGNMENTS=514183 CHECKS=238797000	? (TO) TT=1800.12	SAT TT=799.268 ASSIGNMENTS=41685 CHECKS=68361400	? (TO) TT=1800.11	? (TO) TT=1800.1
csp/rand-2-26/ normalized-rand-26-26-325-155-52021_ext.xml	UNSAT TT=291.567	UNSAT TT=1170 CHECKS=7246210000 NODES=4551170	UNSAT TT=1234.79 CHECKS=7278110000 NODES=4570440	UNSAT TT=291.567	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=1610.96 CHECKS=344139000 NODES=4879860	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=500.702 ASSIGNMENTS=4501490 CHECKS=2220650000	UNSAT TT=1189.57 ASSIGNMENTS=4551170 CHECKS=7246210000	? (TO) TT=1800.01	? (TO) TT=1800.06	No data	UNSAT TT=491.253 ASSIGNMENTS=4482190 CHECKS=2211450000	UNSAT TT=504.795 ASSIGNMENTS=4332340 CHECKS=2140570000	? (TO) TT=1800.1	UNSAT TT=508.273 ASSIGNMENTS=4392540 CHECKS=2171510000	UNSAT TT=514.461 ASSIGNMENTS=4501490 CHECKS=2220650000	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-26/ normalized-rand-26-26-325-155-53021_ext.xml	SAT TT=74.507	SAT TT=488.582 CHECKS=2747490000 NODES=1738760	SAT TT=471.451 CHECKS=2705540000 NODES=1712600	SAT TT=130.733	? (TO) TT=1800.07	SAT TT=532.609 CHECKS=76451600	SAT TT=622.727 ASSIGNMENTS=732319	SAT TT=669.775 ASSIGNMENTS=732319	SAT TT=419.335 CHECKS=86304400 NODES=1226660	SAT TT=74.507 CHECKS=572688000 NODES=880856	? (TO) TT=1800.08	SAT TT=319.084 ASSIGNMENTS=2879850 CHECKS=1426670000	SAT TT=463.399 ASSIGNMENTS=1738760 CHECKS=2747490000	? (TO) TT=1800.04	? (TO) TT=1800.08	No data	SAT TT=280.189 ASSIGNMENTS=2557020 CHECKS=1266670000	SAT TT=96.283 ASSIGNMENTS=830431 CHECKS=405480000	? (TO) TT=1800.12	SAT TT=146.669 ASSIGNMENTS=1256800 CHECKS=617760000	SAT TT=336.227 ASSIGNMENTS=2879850 CHECKS=1426670000	? (TO) TT=1800.18	SAT TT=1763.23 ASSIGNMENTS=1352370 CHECKS=2366150000	? (TO) TT=1800.05	SAT TT=634.817
csp/rand-2-26/ normalized-rand-26-26-325-155-54021_ext.xml	SAT TT=11.206	SAT TT=371.826 CHECKS=2101470000 NODES=1345220	SAT TT=345.023 CHECKS=2104180000 NODES=1346860	SAT TT=66.845	SAT TT=1644.68 CHECKS=392962000	? (TO) TT=1800.06	SAT TT=725.201 ASSIGNMENTS=808546	SAT TT=718.961 ASSIGNMENTS=808546	SAT TT=772.192 CHECKS=166532000 NODES=2368080	SAT TT=11.206 CHECKS=88974300 NODES=136828	SAT TT=1.492 CHECKS=5018890 NODES=5043	SAT TT=37.71 ASSIGNMENTS=258777 CHECKS=127833000	SAT TT=352.147 ASSIGNMENTS=1345220 CHECKS=2101470000	? (TO) TT=1800.09	? (TO) TT=1800.04	No data	SAT TT=29.207 ASSIGNMENTS=252115 CHECKS=124265000	SAT TT=98.756 ASSIGNMENTS=908394 CHECKS=444034000	? (TO) TT=1800.07	SAT TT=140.284 ASSIGNMENTS=1199900 CHECKS=590341000	SAT TT=29.77 ASSIGNMENTS=258777 CHECKS=127833000	? (TO) TT=1800.19	SAT TT=63.431 ASSIGNMENTS=2717 CHECKS=4734370	? (TO) TT=1800.12	? (TO) TT=1800.05
csp/rand-2-26/ normalized-rand-26-26-325-155-55021_ext.xml	SAT TT=33.314	SAT TT=334.003 CHECKS=1901920000 NODES=1202430	SAT TT=307.624 CHECKS=1869650000 NODES=1182580	SAT TT=89.045	? (TO) TT=1800.09	SAT TT=1650.78 CHECKS=231360000	SAT TT=1687.57 ASSIGNMENTS=1994820	SAT TT=1765.19 ASSIGNMENTS=1994820	SAT TT=1291.14 CHECKS=286550000 NODES=4043770	SAT TT=234.007 CHECKS=1981320000 NODES=3047540	? (TO) TT=1800.01	SAT TT=515.776 ASSIGNMENTS=4348020 CHECKS=2158560000	SAT TT=313.938 ASSIGNMENTS=1202430 CHECKS=1901920000	? (TO) TT=1800.07	? (TO) TT=1800.06	No data	SAT TT=33.314 ASSIGNMENTS=280727 CHECKS=139531000	SAT TT=39.77 ASSIGNMENTS=367542 CHECKS=181709000	? (TO) TT=1800.1	SAT TT=59.763 ASSIGNMENTS=518455 CHECKS=255702000	SAT TT=466.157 ASSIGNMENTS=4348020 CHECKS=2158560000	? (TO) TT=1800.17	SAT TT=79.261 ASSIGNMENTS=28569 CHECKS=50370800	? (TO) TT=1800.06	? (TO) TT=1800.07
csp/rand-2-26/ normalized-rand-26-26-325-155-56021_ext.xml	UNSAT TT=264.937	UNSAT TT=1266.04 CHECKS=7252870000 NODES=4545840	UNSAT TT=1235.74 CHECKS=7256540000 NODES=4546850	UNSAT TT=264.937	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=1722.76 CHECKS=352037000 NODES=4974840	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=507.377 ASSIGNMENTS=4579750 CHECKS=2269450000	UNSAT TT=1177.76 ASSIGNMENTS=4545840 CHECKS=7252870000	? (TO) TT=1800.06	? (TO) TT=1800.07	No data	UNSAT TT=505.879 ASSIGNMENTS=4620170 CHECKS=2289230000	UNSAT TT=493.841 ASSIGNMENTS=4505960 CHECKS=2226490000	? (TO) TT=1800.11	UNSAT TT=499.229 ASSIGNMENTS=4620530 CHECKS=2288230000	UNSAT TT=524.308 ASSIGNMENTS=4579750 CHECKS=2269450000	? (TO) TT=1800.61	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.12
csp/rand-2-26/ normalized-rand-26-26-325-155-57021_ext.xml	UNSAT TT=276.757	UNSAT TT=1210.09 CHECKS=7015920000 NODES=4417690	UNSAT TT=1175.99 CHECKS=7021850000 NODES=4420660	UNSAT TT=276.757	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.11	UNSAT TT=1640.61 CHECKS=341969000 NODES=4843420	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=556.501 ASSIGNMENTS=4733860 CHECKS=2341110000	UNSAT TT=1152.36 ASSIGNMENTS=4417690 CHECKS=7015920000	? (TO) TT=1800.02	? (TO) TT=1800.07	No data	UNSAT TT=515.35 ASSIGNMENTS=4501240 CHECKS=2221670000	UNSAT TT=512.557 ASSIGNMENTS=4544040 CHECKS=2243480000	? (TO) TT=1800.09	UNSAT TT=537.484 ASSIGNMENTS=4658280 CHECKS=2307440000	UNSAT TT=546.6 ASSIGNMENTS=4733860 CHECKS=2341110000	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.15
csp/rand-2-26/ normalized-rand-26-26-325-155-58021_ext.xml	UNSAT TT=260.419	UNSAT TT=1215.36 CHECKS=7107960000 NODES=4462970	UNSAT TT=1166.22 CHECKS=7088050000 NODES=4451760	UNSAT TT=260.419	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	UNSAT TT=1473.88 CHECKS=328956000 NODES=4662900	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=551.869 ASSIGNMENTS=4691570 CHECKS=2319110000	UNSAT TT=1164.5 ASSIGNMENTS=4462970 CHECKS=7107960000	? (TO) TT=1800.09	? (TO) TT=1800.03	No data	UNSAT TT=502.395 ASSIGNMENTS=4588640 CHECKS=2267240000	UNSAT TT=546.146 ASSIGNMENTS=4652680 CHECKS=2297180000	? (TO) TT=1800.04	UNSAT TT=552.202 ASSIGNMENTS=4744880 CHECKS=2340850000	UNSAT TT=507.811 ASSIGNMENTS=4691570 CHECKS=2319110000	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.14
csp/rand-2-26/ normalized-rand-26-26-325-155-59021_ext.xml	SAT TT=75.046	SAT TT=1133.78 CHECKS=6596790000 NODES=4173600	SAT TT=1120.35 CHECKS=6638820000 NODES=4200470	SAT TT=275.969	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=700.225 ASSIGNMENTS=771510	SAT TT=653.567 ASSIGNMENTS=771510	SAT TT=835.961 CHECKS=182203000 NODES=2597540	SAT TT=75.046 CHECKS=632105000 NODES=972237	? (TO) TT=1800	SAT TT=291.402 ASSIGNMENTS=2621480 CHECKS=1292590000	SAT TT=1084.17 ASSIGNMENTS=4173600 CHECKS=6596790000	? (TO) TT=1800.01	? (TO) TT=1800.04	No data	SAT TT=288.294 ASSIGNMENTS=2507820 CHECKS=1235730000	SAT TT=185.282 ASSIGNMENTS=1613280 CHECKS=791390000	? (TO) TT=1800.1	SAT TT=399.79 ASSIGNMENTS=3517910 CHECKS=1734290000	SAT TT=297.813 ASSIGNMENTS=2621480 CHECKS=1292590000	? (TO) TT=1800.13	SAT TT=350.877 ASSIGNMENTS=221126 CHECKS=386187000	? (TO) TT=1800.07	? (TO) TT=1800.07
csp/rand-2-26/ normalized-rand-26-26-325-155-60021_ext.xml	UNSAT TT=280.708	UNSAT TT=1186.75 CHECKS=6859850000 NODES=4289250	UNSAT TT=1155.75 CHECKS=6855260000 NODES=4288530	UNSAT TT=280.708	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=1592.19 CHECKS=348946000 NODES=4904260	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=488.397 ASSIGNMENTS=4398790 CHECKS=2187410000	UNSAT TT=1168.55 ASSIGNMENTS=4289250 CHECKS=6859850000	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	UNSAT TT=474.532 ASSIGNMENTS=4169820 CHECKS=2068820000	UNSAT TT=521.623 ASSIGNMENTS=4416350 CHECKS=2192040000	? (TO) TT=1800.13	UNSAT TT=533.293 ASSIGNMENTS=4524370 CHECKS=2243320000	UNSAT TT=481.591 ASSIGNMENTS=4398790 CHECKS=2187410000	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.13
csp/rand-2-26/ normalized-rand-26-26-325-155-61021_ext.xml	SAT TT=16.186	SAT TT=412.164 CHECKS=2339320000 NODES=1481240	SAT TT=379.326 CHECKS=2346210000 NODES=1483280	SAT TT=231.294	? (TO) TT=1800.1	SAT TT=461.776 CHECKS=63994800	SAT TT=1488.84 ASSIGNMENTS=1770830	SAT TT=1558.72 ASSIGNMENTS=1770830	SAT TT=285.284 CHECKS=62336100 NODES=884898	SAT TT=99.692 CHECKS=778346000 NODES=1197190	? (TO) TT=1800.02	SAT TT=182.003 ASSIGNMENTS=1497890 CHECKS=733251000	SAT TT=385.659 ASSIGNMENTS=1481240 CHECKS=2339320000	? (TO) TT=1800.05	? (TO) TT=1800.08	No data	SAT TT=48.109 ASSIGNMENTS=414410 CHECKS=204939000	SAT TT=56.578 ASSIGNMENTS=491283 CHECKS=242013000	? (TO) TT=1800.12	SAT TT=71.098 ASSIGNMENTS=621766 CHECKS=302977000	SAT TT=174.244 ASSIGNMENTS=1497890 CHECKS=733251000	? (TO) TT=1800.15	SAT TT=935.911 ASSIGNMENTS=18721 CHECKS=31862700	? (TO) TT=1800.14	? (TO) TT=1800.03
csp/rand-2-27/ normalized-rand-27-27-351-163-54021_ext.xml	SAT TT=39.221	SAT TT=518.283 CHECKS=2913850000 NODES=1764170	SAT TT=466.648 CHECKS=2862790000 NODES=1735170	SAT TT=302.673	SAT TT=1535.8 CHECKS=337842000	? (TO) TT=1800.07	SAT TT=1666.03 ASSIGNMENTS=1908750	SAT TT=1751.86 ASSIGNMENTS=1908750	SAT TT=205.152 CHECKS=41736300 NODES=581981	SAT TT=39.221 CHECKS=305679000 NODES=435322	? (TO) TT=1800.05	SAT TT=98.531 ASSIGNMENTS=762452 CHECKS=393017000	SAT TT=512.89 ASSIGNMENTS=1764170 CHECKS=2913850000	? (TO) TT=1800.04	? (TO) TT=1800.08	No data	SAT TT=93.115 ASSIGNMENTS=760768 CHECKS=392144000	SAT TT=84.779 ASSIGNMENTS=689647 CHECKS=356895000	? (TO) TT=1800.1	SAT TT=88.889 ASSIGNMENTS=766059 CHECKS=402327000	SAT TT=91.905 ASSIGNMENTS=762452 CHECKS=393017000	? (TO) TT=1800.14	SAT TT=194.178 ASSIGNMENTS=133156 CHECKS=237466000	? (TO) TT=1800.14	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-27/ normalized-rand-27-27-351-163-55021_ext.xml	UNSAT TT=649.53	? (TO) TT=1800.17	? (TO) TT=1800.05	UNSAT TT=649.53	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=1184.66 ASSIGNMENTS=10067500 CHECKS=997937000	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	No data	UNSAT TT=1186.95 ASSIGNMENTS=10088000 CHECKS=1016310000	UNSAT TT=1133.93 ASSIGNMENTS=9815660 CHECKS=869883000	? (TO) TT=1800.04	UNSAT TT=1117.28 ASSIGNMENTS=9695890 CHECKS=797752000	UNSAT TT=1266.26 ASSIGNMENTS=10067500 CHECKS=997937000	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.09
csp/rand-2-27/ normalized-rand-27-27-351-163-56021_ext.xml	SAT TT=11.551	SAT TT=1129.72 CHECKS=6568260000 NODES=3938380	SAT TT=1066.43 CHECKS=6578250000 NODES=3943740	SAT TT=11.551	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT TT=800.557 ASSIGNMENTS=876331	SAT TT=789.133 ASSIGNMENTS=876331	? (TO) TT=1800.04	SAT TT=77.193 CHECKS=656088000 NODES=934358	? (TO) TT=1800	SAT TT=245.316 ASSIGNMENTS=1975550 CHECKS=1029770000	SAT TT=1100.84 ASSIGNMENTS=3938380 CHECKS=6568260000	? (TO) TT=1800.08	? (TO) TT=1800.01	No data	SAT TT=244.34 ASSIGNMENTS=1975850 CHECKS=1029590000	SAT TT=125.508 ASSIGNMENTS=1033040 CHECKS=538907000	? (TO) TT=1800.05	SAT TT=304.722 ASSIGNMENTS=2484060 CHECKS=1299260000	SAT TT=243.473 ASSIGNMENTS=1975550 CHECKS=1029770000	? (TO) TT=1800.09	SAT TT=1761.44 ASSIGNMENTS=1500920 CHECKS=2780240000	? (TO) TT=1800.08	? (TO) TT=1800.04
csp/rand-2-27/ normalized-rand-27-27-351-163-57021_ext.xml	UNSAT TT=637.335	? (TO) TT=1800.12	? (TO) TT=1800.14	UNSAT TT=637.335	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=1243.23 ASSIGNMENTS=10398400 CHECKS=1129510000	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.01	No data	UNSAT TT=1226.39 ASSIGNMENTS=10369100 CHECKS=1115610000	UNSAT TT=1221.11 ASSIGNMENTS=10707400 CHECKS=1308980000	? (TO) TT=1800.04	UNSAT TT=1308.1 ASSIGNMENTS=10618600 CHECKS=1251130000	UNSAT TT=1186.19 ASSIGNMENTS=10398400 CHECKS=1129510000	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/rand-2-27/ normalized-rand-27-27-351-163-58021_ext.xml	UNSAT TT=614.741	? (TO) TT=1800.13	? (TO) TT=1800.17	UNSAT TT=614.741	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=1205.17 ASSIGNMENTS=10546800 CHECKS=1241420000	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	No data	UNSAT TT=1318.48 ASSIGNMENTS=10825600 CHECKS=1388210000	UNSAT TT=1118.51 ASSIGNMENTS=9871870 CHECKS=876236000	? (TO) TT=1800.06	UNSAT TT=1280.71 ASSIGNMENTS=10626800 CHECKS=1290840000	UNSAT TT=1220.17 ASSIGNMENTS=10546800 CHECKS=1241420000	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/rand-2-27/ normalized-rand-27-27-351-163-59021_ext.xml	UNSAT TT=640.244	? (TO) TT=1800.09	? (TO) TT=1800.17	UNSAT TT=640.244	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=1211.17 ASSIGNMENTS=10415200 CHECKS=1148830000	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	No data	UNSAT TT=1243.58 ASSIGNMENTS=10776200 CHECKS=1344300000	UNSAT TT=1192.9 ASSIGNMENTS=10404700 CHECKS=1149450000	? (TO) TT=1800.09	UNSAT TT=1249.19 ASSIGNMENTS=10576600 CHECKS=1241860000	UNSAT TT=1192.76 ASSIGNMENTS=10415200 CHECKS=1148830000	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09
csp/rand-2-27/ normalized-rand-27-27-351-163-60021_ext.xml	SAT TT=154.041	SAT TT=159.193 CHECKS=973939000 NODES=576192	SAT TT=154.041 CHECKS=954643000 NODES=563382	SAT TT=534.268	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.14	SAT TT=1583.98 CHECKS=314194000 NODES=4335760	SAT TT=354.708 CHECKS=2812040000 NODES=4004900	? (TO) TT=1800.01	SAT TT=714.927 ASSIGNMENTS=6162560 CHECKS=3235710000	SAT TT=165.254 ASSIGNMENTS=576192 CHECKS=973939000	? (TO) TT=1800.04	? (TO) TT=1800.03	No data	SAT TT=648.661 ASSIGNMENTS=5642300 CHECKS=2962640000	SAT TT=425.577 ASSIGNMENTS=3491900 CHECKS=1834060000	? (TO) TT=1800.04	SAT TT=350.568 ASSIGNMENTS=3047410 CHECKS=1592920000	SAT TT=722.034 ASSIGNMENTS=6162560 CHECKS=3235710000	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08
csp/rand-2-27/ normalized-rand-27-27-351-163-61021_ext.xml	UNSAT TT=710.261	? (TO) TT=1800.13	? (TO) TT=1800.15	UNSAT TT=710.261	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=1293.36 ASSIGNMENTS=11299800 CHECKS=1581930000	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	No data	UNSAT TT=1411.74 ASSIGNMENTS=11501200 CHECKS=1696040000	UNSAT TT=1314.26 ASSIGNMENTS=11369800 CHECKS=1613550000	? (TO) TT=1800.04	UNSAT TT=1339.52 ASSIGNMENTS=11141000 CHECKS=1504690000	UNSAT TT=1333.76 ASSIGNMENTS=11299800 CHECKS=1581930000	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06
csp/rand-2-27/ normalized-rand-27-27-351-163-62021_ext.xml	UNSAT TT=614.566	? (TO) TT=1800.14	? (TO) TT=1800.12	UNSAT TT=614.566	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=1243.82 ASSIGNMENTS=10145100 CHECKS=1029940000	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	No data	UNSAT TT=1243.01 ASSIGNMENTS=10143700 CHECKS=1029480000	UNSAT TT=1258.31 ASSIGNMENTS=10064200 CHECKS=989803000	? (TO) TT=1800.03	UNSAT TT=1161.25 ASSIGNMENTS=10115600 CHECKS=1010630000	UNSAT TT=1166.09 ASSIGNMENTS=10145100 CHECKS=1029940000	? (TO) TT=1800.19	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.12
csp/rand-2-27/ normalized-rand-27-27-351-163-63021_ext.xml	SAT TT=101.245	SAT TT=391.378 CHECKS=2236910000 NODES=1345970	SAT TT=364.665 CHECKS=2237000000 NODES=1346900	SAT TT=603.986	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=1230.45 ASSIGNMENTS=1373910	SAT TT=1304.28 ASSIGNMENTS=1373910	? (TO) TT=1800.03	SAT TT=101.245 CHECKS=788549000 NODES=1123020	? (TO) TT=1800.01	SAT TT=1001.75 ASSIGNMENTS=8796990 CHECKS=320063000	SAT TT=370.103 ASSIGNMENTS=1345970 CHECKS=2236910000	? (TO) TT=1800.08	? (TO) TT=1800.01	No data	SAT TT=1055.26 ASSIGNMENTS=8640940 CHECKS=236682000	SAT TT=423.283 ASSIGNMENTS=3479330 CHECKS=1816440000	? (TO) TT=1800.1	SAT TT=633.102 ASSIGNMENTS=5046240 CHECKS=2645030000	SAT TT=1011.48 ASSIGNMENTS=8796990 CHECKS=320063000	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.12
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-15_ext.xml	SAT TT=0.178	SAT TT=0.908 CHECKS=123920 NODES=197	SAT TT=0.92 CHECKS=195296 NODES=224	SAT TT=0.603	SAT TT=0.558 CHECKS=179373	SAT TT=0.497 CHECKS=142905	SAT TT=1.212 ASSIGNMENTS=606	SAT TT=1.139 ASSIGNMENTS=606	SAT TT=1.007 CHECKS=124898 NODES=1420	SAT TT=1.429 CHECKS=6274190 NODES=28221	SAT TT=1.344 CHECKS=4857740 NODES=10477	SAT TT=0.196 ASSIGNMENTS=1847 CHECKS=641129	SAT TT=0.192 ASSIGNMENTS=1847 CHECKS=641129	SAT TT=2.627	SAT TT=2.246	No data	SAT TT=0.181 ASSIGNMENTS=1870 CHECKS=651701	SAT TT=0.233 ASSIGNMENTS=3774 CHECKS=905310	SAT TT=2.647	SAT TT=0.219 ASSIGNMENTS=2378 CHECKS=805830	SAT TT=0.178 ASSIGNMENTS=1847 CHECKS=641129	SAT TT=4.637	SAT TT=0.365 ASSIGNMENTS=463 CHECKS=501836	SAT TT=1.679	SAT TT=2.994
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-16_ext.xml	SAT TT=0.516	SAT TT=2.622 CHECKS=8899850 NODES=9067	SAT TT=2.808 CHECKS=8924320 NODES=9107	SAT TT=1.087	SAT TT=67.68 CHECKS=23165500	SAT TT=25.727 CHECKS=8882320	SAT TT=2.144 ASSIGNMENTS=2298	SAT TT=2.432 ASSIGNMENTS=2298	SAT TT=2.556 CHECKS=704330 NODES=8309	SAT TT=0.808 CHECKS=1381640 NODES=6061	? (TO) TT=1800.01	SAT TT=0.535 ASSIGNMENTS=5972 CHECKS=2246900	SAT TT=0.536 ASSIGNMENTS=5972 CHECKS=2246900	SAT TT=13.231	SAT TT=13.58	No data	SAT TT=1.125 ASSIGNMENTS=12254 CHECKS=4674600	SAT TT=0.708 ASSIGNMENTS=8839 CHECKS=2833900	SAT TT=22.647	SAT TT=1.035 ASSIGNMENTS=11532 CHECKS=4320670	SAT TT=0.516 ASSIGNMENTS=5972 CHECKS=2246900	SAT TT=51.594	SAT TT=9.443 ASSIGNMENTS=10308 CHECKS=13471800	SAT TT=6.533	SAT TT=22.32
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-19_ext.xml	SAT TT=0.062	SAT TT=1.21 CHECKS=528260 NODES=617	SAT TT=0.955 CHECKS=297234 NODES=317	SAT TT=0.486	SAT TT=5.615 CHECKS=2167280	SAT TT=0.453 CHECKS=135967	SAT TT=1.044 ASSIGNMENTS=196	SAT TT=0.942 ASSIGNMENTS=196	SAT TT=0.941 CHECKS=104884 NODES=1185	SAT TT=1.769 CHECKS=6791430 NODES=30588	? (TO) TT=1800.01	SAT TT=0.081 ASSIGNMENTS=474 CHECKS=166230	SAT TT=0.082 ASSIGNMENTS=474 CHECKS=166230	SAT TT=2.683	SAT TT=11.561	No data	SAT TT=0.062 ASSIGNMENTS=420 CHECKS=140892	SAT TT=0.269 ASSIGNMENTS=4053 CHECKS=992457	SAT TT=4.248	SAT TT=0.303 ASSIGNMENTS=3302 CHECKS=1172650	SAT TT=0.069 ASSIGNMENTS=474 CHECKS=166230	SAT TT=6.881	SAT TT=0.372 ASSIGNMENTS=430 CHECKS=557670	SAT TT=4.771	SAT TT=1.315
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-1_ext.xml	SAT TT=0.284	SAT TT=1.877 CHECKS=4603140 NODES=4608	SAT TT=1.889 CHECKS=4885520 NODES=4933	SAT TT=1.169	SAT TT=14.887 CHECKS=5290830	SAT TT=13.67 CHECKS=4554690	SAT TT=1.377 ASSIGNMENTS=986	SAT TT=1.513 ASSIGNMENTS=986	SAT TT=2.008 CHECKS=556289 NODES=5984	SAT TT=1.08 CHECKS=3605040 NODES=15953	? (TO) TT=1800.01	SAT TT=0.624 ASSIGNMENTS=6266 CHECKS=2446650	SAT TT=0.618 ASSIGNMENTS=6266 CHECKS=2446650	SAT TT=2.456	SAT TT=6.212	No data	SAT TT=0.584 ASSIGNMENTS=6139 CHECKS=2421360	SAT TT=0.284 ASSIGNMENTS=4198 CHECKS=1086540	SAT TT=6.951	SAT TT=0.591 ASSIGNMENTS=6122 CHECKS=2368420	SAT TT=0.602 ASSIGNMENTS=6266 CHECKS=2446650	SAT TT=8.829	SAT TT=5.261 ASSIGNMENTS=6154 CHECKS=8875920	SAT TT=2.608	SAT TT=2.926
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-22_ext.xml	SAT TT=0.129	SAT TT=0.984 CHECKS=343064 NODES=376	SAT TT=1.176 CHECKS=369477 NODES=377	SAT TT=0.502	SAT TT=1.681 CHECKS=620642	SAT TT=0.716 CHECKS=227760	SAT TT=1.126 ASSIGNMENTS=673	SAT TT=1.142 ASSIGNMENTS=673	SAT TT=1.104 CHECKS=193318 NODES=2133	SAT TT=0.648 CHECKS=565747 NODES=2453	SAT TT=0.634 CHECKS=79050 NODES=186	SAT TT=0.147 ASSIGNMENTS=1227 CHECKS=436220	SAT TT=0.135 ASSIGNMENTS=1227 CHECKS=436220	SAT TT=2.349	SAT TT=2.198	No data	SAT TT=0.189 ASSIGNMENTS=2039 CHECKS=758625	SAT TT=0.353 ASSIGNMENTS=5417 CHECKS=1501960	SAT TT=2.219	SAT TT=0.129 ASSIGNMENTS=1403 CHECKS=470730	SAT TT=0.131 ASSIGNMENTS=1227 CHECKS=436220	SAT TT=3.242	SAT TT=0.296 ASSIGNMENTS=233 CHECKS=290945	SAT TT=1.547	SAT TT=1.919
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-24_ext.xml	SAT TT=0.082	SAT TT=2.561 CHECKS=8115810 NODES=8584	SAT TT=2.623 CHECKS=8080930 NODES=8594	SAT TT=0.899	SAT TT=4.897 CHECKS=1783080	SAT TT=2.395 CHECKS=729140	SAT TT=1.079 ASSIGNMENTS=575	SAT TT=1.063 ASSIGNMENTS=575	SAT TT=1.562 CHECKS=384909 NODES=4187	SAT TT=3.037 CHECKS=17907200 NODES=87235	SAT TT=1078.74 CHECKS=7972670000 NODES=2303600	SAT TT=0.096 ASSIGNMENTS=642 CHECKS=226644	SAT TT=0.093 ASSIGNMENTS=642 CHECKS=226644	SAT TT=2.818	SAT TT=3.413	No data	SAT TT=0.379 ASSIGNMENTS=4136 CHECKS=1481580	SAT TT=0.284 ASSIGNMENTS=4288 CHECKS=1040480	SAT TT=1.531	SAT TT=0.148 ASSIGNMENTS=1562 CHECKS=513736	SAT TT=0.082 ASSIGNMENTS=642 CHECKS=226644	SAT TT=7.776	SAT TT=0.825 ASSIGNMENTS=493 CHECKS=658842	SAT TT=3.013	SAT TT=2.073
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-26_ext.xml	SAT TT=0.123	SAT TT=0.823 CHECKS=18687 NODES=43	SAT TT=0.896 CHECKS=52354 NODES=42	SAT TT=1.279	SAT TT=9.187 CHECKS=3607620	SAT TT=6.619 CHECKS=2103710	SAT TT=4.249 ASSIGNMENTS=5829	SAT TT=3.79 ASSIGNMENTS=5829	SAT TT=2.471 CHECKS=589963 NODES=7146	SAT TT=1.479 CHECKS=5818670 NODES=26339	SAT TT=0.711 CHECKS=621543 NODES=1634	SAT TT=1.028 ASSIGNMENTS=12685 CHECKS=4565220	SAT TT=1.102 ASSIGNMENTS=12685 CHECKS=4565220	SAT TT=5.228	SAT TT=8.812	No data	SAT TT=1.33 ASSIGNMENTS=16927 CHECKS=6105880	SAT TT=0.123 ASSIGNMENTS=1657 CHECKS=380613	SAT TT=15.52	SAT TT=0.375 ASSIGNMENTS=4585 CHECKS=1634280	SAT TT=1.072 ASSIGNMENTS=12685 CHECKS=4565220	SAT TT=9.148	SAT TT=5.501 ASSIGNMENTS=2572 CHECKS=2752160	SAT TT=4.113	SAT TT=7.822
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-28_ext.xml	SAT TT=0.075	SAT TT=3.162 CHECKS=11088300 NODES=11039	SAT TT=2.865 CHECKS=10331800 NODES=10275	SAT TT=0.721	SAT TT=4.258 CHECKS=1564640	SAT TT=0.792 CHECKS=227608	SAT TT=2.119 ASSIGNMENTS=1881	SAT TT=2.189 ASSIGNMENTS=1881	SAT TT=0.782 CHECKS=66421 NODES=717	SAT TT=0.896 CHECKS=1905360 NODES=9003	SAT TT=0.724 CHECKS=1075430 NODES=2965	SAT TT=0.087 ASSIGNMENTS=543 CHECKS=194398	SAT TT=0.087 ASSIGNMENTS=543 CHECKS=194398	SAT TT=2.477	SAT TT=3.545	No data	SAT TT=0.271 ASSIGNMENTS=2824 CHECKS=1045100	SAT TT=0.091 ASSIGNMENTS=1118 CHECKS=254359	SAT TT=1.18	SAT TT=0.287 ASSIGNMENTS=3399 CHECKS=1186760	SAT TT=0.075 ASSIGNMENTS=543 CHECKS=194398	SAT TT=5.549	SAT TT=1.843 ASSIGNMENTS=976 CHECKS=1358060	SAT TT=1.496	SAT TT=1.345
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-29_ext.xml	SAT TT=0.288	SAT TT=0.902 CHECKS=80200 NODES=120	SAT TT=0.869 CHECKS=58293 NODES=50	SAT TT=1.221	SAT TT=5.763 CHECKS=2308350	SAT TT=4.354 CHECKS=1475450	SAT TT=2.498 ASSIGNMENTS=2280	SAT TT=2.366 ASSIGNMENTS=2280	SAT TT=1.175 CHECKS=195747 NODES=2166	SAT TT=2.127 CHECKS=11270100 NODES=50937	? (TO) TT=1800.08	SAT TT=0.402 ASSIGNMENTS=3986 CHECKS=1544860	SAT TT=0.404 ASSIGNMENTS=3986 CHECKS=1544860	SAT TT=2.413	SAT TT=5.022	No data	SAT TT=0.328 ASSIGNMENTS=3307 CHECKS=1279910	SAT TT=0.751 ASSIGNMENTS=9560 CHECKS=3083300	SAT TT=8.667	SAT TT=0.288 ASSIGNMENTS=3308 CHECKS=1219400	SAT TT=0.387 ASSIGNMENTS=3986 CHECKS=1544860	SAT TT=11.107	SAT TT=4.843 ASSIGNMENTS=6125 CHECKS=7902050	SAT TT=1.86	SAT TT=4.496
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-2_ext.xml	SAT TT=0.093	SAT TT=1.527 CHECKS=1844270 NODES=1875	SAT TT=1.295 CHECKS=1833360 NODES=1823	SAT TT=0.914	SAT TT=6.045 CHECKS=2193290	SAT TT=0.561 CHECKS=174289	SAT TT=1.106 ASSIGNMENTS=538	SAT TT=1.045 ASSIGNMENTS=538	SAT TT=2.01 CHECKS=573376 NODES=6096	SAT TT=1.24 CHECKS=4163880 NODES=18829	? (TO) TT=1800.03	SAT TT=0.233 ASSIGNMENTS=2143 CHECKS=807120	SAT TT=0.23 ASSIGNMENTS=2143 CHECKS=807120	SAT TT=3.07	SAT TT=3.243	No data	SAT TT=0.093 ASSIGNMENTS=706 CHECKS=269398	SAT TT=0.267 ASSIGNMENTS=4139 CHECKS=1069770	SAT TT=2.137	SAT TT=0.096 ASSIGNMENTS=986 CHECKS=322095	SAT TT=0.199 ASSIGNMENTS=2143 CHECKS=807120	SAT TT=2.583	SAT TT=0.529 ASSIGNMENTS=276 CHECKS=409849	SAT TT=2.986	SAT TT=1.881
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-31_ext.xml	SAT TT=0.099	SAT TT=3.05 CHECKS=10505700 NODES=10043	SAT TT=3.203 CHECKS=10682600 NODES=10203	SAT TT=1.143	SAT TT=1.384 CHECKS=461644	SAT TT=0.704 CHECKS=212230	SAT TT=2.972 ASSIGNMENTS=3612	SAT TT=3.312 ASSIGNMENTS=3612	SAT TT=0.859 CHECKS=38314 NODES=413	SAT TT=5.231 CHECKS=30226300 NODES=136652	? (TO) TT=1800.09	SAT TT=0.617 ASSIGNMENTS=6498 CHECKS=2478920	SAT TT=0.576 ASSIGNMENTS=6498 CHECKS=2478920	SAT TT=3.51	SAT TT=4.982	No data	SAT TT=0.137 ASSIGNMENTS=1323 CHECKS=467497	SAT TT=0.653 ASSIGNMENTS=9110 CHECKS=2867310	SAT TT=4.257	SAT TT=0.108 ASSIGNMENTS=1043 CHECKS=340257	SAT TT=0.609 ASSIGNMENTS=6498 CHECKS=2478920	SAT TT=3.474	SAT TT=0.099 ASSIGNMENTS=95 CHECKS=100550	SAT TT=3.659	SAT TT=4.011
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-34_ext.xml	SAT TT=0.03	SAT TT=0.82 CHECKS=8165 NODES=31	SAT TT=0.885 CHECKS=39025 NODES=31	SAT TT=0.404	SAT TT=0.132 CHECKS=21669	SAT TT=0.091 CHECKS=7359	SAT TT=0.755 ASSIGNMENTS=29	SAT TT=0.76 ASSIGNMENTS=29	SAT TT=0.827 CHECKS=32326 NODES=340	SAT TT=0.711 CHECKS=724091 NODES=3283	SAT TT=409.035 CHECKS=2851290000 NODES=1224660	SAT TT=0.042 ASSIGNMENTS=30 CHECKS=8910	SAT TT=0.042 ASSIGNMENTS=30 CHECKS=8910	SAT TT=2.109	SAT TT=3.139	No data	SAT TT=0.032 ASSIGNMENTS=33 CHECKS=9607	SAT TT=0.233 ASSIGNMENTS=3748 CHECKS=907229	SAT TT=0.883	SAT TT=0.075 ASSIGNMENTS=732 CHECKS=228862	SAT TT=0.03 ASSIGNMENTS=30 CHECKS=8910	SAT TT=2.808	SAT TT=0.288 ASSIGNMENTS=306 CHECKS=340019	SAT TT=1.641	SAT TT=1.511
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-38_ext.xml	SAT TT=0.739	SAT TT=0.885 CHECKS=110060 NODES=154	SAT TT=1.497 CHECKS=2310440 NODES=2632	SAT TT=1.763	SAT TT=12.569 CHECKS=5020860	SAT TT=14.787 CHECKS=4863520	SAT TT=5.165 ASSIGNMENTS=8165	SAT TT=5.679 ASSIGNMENTS=8165	SAT TT=2.941 CHECKS=778456 NODES=9626	SAT TT=0.739 CHECKS=870495 NODES=3840	? (TO) TT=1800.07	SAT TT=1.021 ASSIGNMENTS=11560 CHECKS=4149040	SAT TT=1.021 ASSIGNMENTS=11560 CHECKS=4149040	SAT TT=6.954	SAT TT=3.42	No data	SAT TT=1.076 ASSIGNMENTS=12692 CHECKS=4559080	SAT TT=0.979 ASSIGNMENTS=12496 CHECKS=4031100	SAT TT=6.166	SAT TT=0.978 ASSIGNMENTS=12305 CHECKS=4375400	SAT TT=0.992 ASSIGNMENTS=11560 CHECKS=4149040	SAT TT=14.599	SAT TT=9.024 ASSIGNMENTS=11674 CHECKS=13410600	SAT TT=5.048	SAT TT=1.712
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-41_ext.xml	SAT TT=0.183	SAT TT=2.95 CHECKS=10094900 NODES=11354	SAT TT=3.155 CHECKS=10383100 NODES=11702	SAT TT=0.879	SAT TT=5.826 CHECKS=2395940	SAT TT=4.723 CHECKS=1588920	SAT TT=3.269 ASSIGNMENTS=4830	SAT TT=3.559 ASSIGNMENTS=4830	SAT TT=3.502 CHECKS=975984 NODES=11017	SAT TT=0.977 CHECKS=1925540 NODES=8613	SAT TT=0.631 CHECKS=147112 NODES=423	SAT TT=0.29 ASSIGNMENTS=2869 CHECKS=1057420	SAT TT=0.286 ASSIGNMENTS=2869 CHECKS=1057420	SAT TT=5.351	SAT TT=3.409	No data	SAT TT=0.183 ASSIGNMENTS=1815 CHECKS=668429	SAT TT=0.791 ASSIGNMENTS=10418 CHECKS=3263410	SAT TT=4.15	SAT TT=0.2 ASSIGNMENTS=2104 CHECKS=746236	SAT TT=0.27 ASSIGNMENTS=2869 CHECKS=1057420	SAT TT=11.863	SAT TT=8.476 ASSIGNMENTS=7482 CHECKS=10006300	SAT TT=1.175	SAT TT=2.167
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-42_ext.xml	SAT TT=0.204	SAT TT=0.886 CHECKS=78877 NODES=109	SAT TT=1.014 CHECKS=510458 NODES=514	SAT TT=1.215	SAT TT=78.517 CHECKS=25106000	SAT TT=10.012 CHECKS=3338060	SAT TT=3 ASSIGNMENTS=3251	SAT TT=3.156 ASSIGNMENTS=3251	SAT TT=1.844 CHECKS=436037 NODES=4689	SAT TT=1.069 CHECKS=3029090 NODES=14030	? (TO) TT=1800.08	SAT TT=0.41 ASSIGNMENTS=4151 CHECKS=1564440	SAT TT=0.41 ASSIGNMENTS=4151 CHECKS=1564440	SAT TT=3.927	SAT TT=10.014	No data	SAT TT=0.383 ASSIGNMENTS=4020 CHECKS=1508420	SAT TT=0.614 ASSIGNMENTS=7980 CHECKS=2457460	SAT TT=7.338	SAT TT=0.204 ASSIGNMENTS=2184 CHECKS=757805	SAT TT=0.399 ASSIGNMENTS=4151 CHECKS=1564440	SAT TT=8.326	SAT TT=4.471 ASSIGNMENTS=4508 CHECKS=6251840	SAT TT=1.719	SAT TT=2.785
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-45_ext.xml	SAT TT=0.06	SAT TT=0.838 CHECKS=23815 NODES=47	SAT TT=0.935 CHECKS=56847 NODES=41	SAT TT=0.503	SAT TT=19.04 CHECKS=7299270	SAT TT=3.249 CHECKS=1058720	SAT TT=1.318 ASSIGNMENTS=858	SAT TT=1.399 ASSIGNMENTS=858	SAT TT=1.155 CHECKS=219664 NODES=2232	SAT TT=0.673 CHECKS=435371 NODES=1911	SAT TT=0.91 CHECKS=1052620 NODES=2621	SAT TT=0.159 ASSIGNMENTS=1231 CHECKS=503775	SAT TT=0.16 ASSIGNMENTS=1231 CHECKS=503775	SAT TT=2.153	SAT TT=2.542	No data	SAT TT=0.06 ASSIGNMENTS=365 CHECKS=134158	SAT TT=0.262 ASSIGNMENTS=4145 CHECKS=1039480	SAT TT=2.265	SAT TT=0.115 ASSIGNMENTS=1181 CHECKS=412423	SAT TT=0.145 ASSIGNMENTS=1231 CHECKS=503775	SAT TT=3.875	SAT TT=0.91 ASSIGNMENTS=344 CHECKS=464126	SAT TT=1.798	SAT TT=1.305
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-49_ext.xml	SAT TT=0.159	SAT TT=1.706 CHECKS=3865680 NODES=4179	SAT TT=1.842 CHECKS=3966590 NODES=4123	SAT TT=0.553	SAT TT=9.746 CHECKS=3611280	SAT TT=0.413 CHECKS=112440	SAT TT=1.148 ASSIGNMENTS=704	SAT TT=1.238 ASSIGNMENTS=704	SAT TT=0.966 CHECKS=123562 NODES=1327	SAT TT=0.644 CHECKS=514704 NODES=2223	? (TO) TT=1800.04	SAT TT=0.174 ASSIGNMENTS=1612 CHECKS=604744	SAT TT=0.181 ASSIGNMENTS=1612 CHECKS=604744	SAT TT=5.898	SAT TT=2.633	No data	SAT TT=0.304 ASSIGNMENTS=3169 CHECKS=1186160	SAT TT=0.35 ASSIGNMENTS=4865 CHECKS=1345960	SAT TT=5.213	SAT TT=0.243 ASSIGNMENTS=2582 CHECKS=924587	SAT TT=0.159 ASSIGNMENTS=1612 CHECKS=604744	SAT TT=2.421	SAT TT=2.042 ASSIGNMENTS=1534 CHECKS=2127940	SAT TT=3.584	SAT TT=2.966
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-4_ext.xml	SAT TT=0.204	SAT TT=1.597 CHECKS=3069070 NODES=3077	SAT TT=1.618 CHECKS=2897420 NODES=2862	SAT TT=0.566	SAT TT=5.399 CHECKS=2042990	SAT TT=1.191 CHECKS=355126	SAT TT=0.973 ASSIGNMENTS=379	SAT TT=0.983 ASSIGNMENTS=379	SAT TT=1.317 CHECKS=198986 NODES=2225	SAT TT=0.871 CHECKS=134232 NODES=529	SAT TT=1135.01 CHECKS=7972940000 NODES=3165090	SAT TT=0.233 ASSIGNMENTS=2213 CHECKS=815286	SAT TT=0.217 ASSIGNMENTS=2213 CHECKS=815286	SAT TT=2.574	SAT TT=4.331	No data	SAT TT=0.204 ASSIGNMENTS=1989 CHECKS=754100	SAT TT=0.346 ASSIGNMENTS=4993 CHECKS=1363930	SAT TT=6.434	SAT TT=0.42 ASSIGNMENTS=4632 CHECKS=1689700	SAT TT=0.22 ASSIGNMENTS=2213 CHECKS=815286	SAT TT=2.877	SAT TT=6.283 ASSIGNMENTS=1331 CHECKS=1740390	SAT TT=1.429	SAT TT=2.577
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-50_ext.xml	SAT TT=0.078	SAT TT=1.275 CHECKS=1505390 NODES=1379	SAT TT=1.242 CHECKS=1517630 NODES=1383	SAT TT=0.632	SAT TT=11.231 CHECKS=3916130	SAT TT=0.766 CHECKS=242636	SAT TT=0.852 ASSIGNMENTS=181	SAT TT=0.952 ASSIGNMENTS=181	SAT TT=0.953 CHECKS=121376 NODES=1167	SAT TT=2.883 CHECKS=15381900 NODES=68875	? (TO) TT=1800.06	SAT TT=0.117 ASSIGNMENTS=768 CHECKS=311977	SAT TT=0.114 ASSIGNMENTS=768 CHECKS=311977	SAT TT=2.662	SAT TT=2.64	No data	SAT TT=0.083 ASSIGNMENTS=581 CHECKS=232394	SAT TT=0.307 ASSIGNMENTS=4221 CHECKS=1151660	SAT TT=1.946	SAT TT=0.078 ASSIGNMENTS=664 CHECKS=213952	SAT TT=0.103 ASSIGNMENTS=768 CHECKS=311977	SAT TT=4.587	SAT TT=1.18 ASSIGNMENTS=672 CHECKS=1045770	SAT TT=2.126	SAT TT=1.642
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-7_ext.xml	SAT TT=0.257	SAT TT=1.322 CHECKS=2046260 NODES=2134	SAT TT=1.342 CHECKS=1884960 NODES=1955	SAT TT=0.464	SAT TT=9.143 CHECKS=3390600	SAT TT=3.416 CHECKS=1188570	SAT TT=0.98 ASSIGNMENTS=326	SAT TT=0.935 ASSIGNMENTS=326	SAT TT=1.167 CHECKS=179975 NODES=2035	SAT TT=0.59 CHECKS=74817 NODES=277	SAT TT=878.244 CHECKS=6258150000 NODES=1624220	SAT TT=0.355 ASSIGNMENTS=3831 CHECKS=1462500	SAT TT=0.385 ASSIGNMENTS=3831 CHECKS=1462500	SAT TT=4.702	SAT TT=15.589	No data	SAT TT=0.341 ASSIGNMENTS=3614 CHECKS=1348380	SAT TT=0.257 ASSIGNMENTS=3843 CHECKS=936548	SAT TT=4.409	SAT TT=0.3 ASSIGNMENTS=3489 CHECKS=1267220	SAT TT=0.363 ASSIGNMENTS=3831 CHECKS=1462500	SAT TT=10.221	SAT TT=4.024 ASSIGNMENTS=3346 CHECKS=4519890	SAT TT=1.664	SAT TT=1.467
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-10_ext.xml	SAT TT=0.086	SAT TT=1.444 CHECKS=2363930 NODES=2305	SAT TT=1.108 CHECKS=771887 NODES=736	SAT TT=0.691	SAT TT=20.328 CHECKS=7468090	SAT TT=1.471 CHECKS=441265	SAT TT=2.054 ASSIGNMENTS=1817	SAT TT=2.209 ASSIGNMENTS=1817	SAT TT=1.192 CHECKS=152323 NODES=1626	SAT TT=0.924 CHECKS=2432960 NODES=10851	? (TO) TT=1800	SAT TT=0.181 ASSIGNMENTS=1539 CHECKS=605548	SAT TT=0.181 ASSIGNMENTS=1539 CHECKS=605548	SAT TT=2.635	SAT TT=2.896	No data	SAT TT=0.086 ASSIGNMENTS=653 CHECKS=254173	SAT TT=0.271 ASSIGNMENTS=3982 CHECKS=1011340	SAT TT=4.071	SAT TT=0.12 ASSIGNMENTS=1203 CHECKS=404883	SAT TT=0.165 ASSIGNMENTS=1539 CHECKS=605548	SAT TT=2.885	SAT TT=1.898 ASSIGNMENTS=712 CHECKS=898756	SAT TT=2.306	SAT TT=3.622
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-17_ext.xml	SAT TT=0.116	SAT TT=1.899 CHECKS=4372710 NODES=4283	SAT TT=1.843 CHECKS=4266450 NODES=4114	SAT TT=0.564	SAT TT=9.437 CHECKS=3512470	SAT TT=3.825 CHECKS=1285540	SAT TT=1.257 ASSIGNMENTS=816	SAT TT=1.366 ASSIGNMENTS=816	SAT TT=0.907 CHECKS=132008 NODES=1336	SAT TT=0.722 CHECKS=886974 NODES=3969	? (TO) TT=1800.01	SAT TT=0.125 ASSIGNMENTS=874 CHECKS=362571	SAT TT=0.127 ASSIGNMENTS=874 CHECKS=362571	SAT TT=3.503	SAT TT=2.235	No data	SAT TT=0.272 ASSIGNMENTS=2737 CHECKS=1049100	SAT TT=0.383 ASSIGNMENTS=5296 CHECKS=1525300	SAT TT=1.813	SAT TT=0.333 ASSIGNMENTS=3401 CHECKS=1276100	SAT TT=0.116 ASSIGNMENTS=874 CHECKS=362571	SAT TT=5.37	SAT TT=2.241 ASSIGNMENTS=1542 CHECKS=2337050	SAT TT=1.282	SAT TT=1.911
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-18_ext.xml	SAT TT=0.214	SAT TT=1.169 CHECKS=1023240 NODES=1065	SAT TT=1.422 CHECKS=2275320 NODES=2310	SAT TT=0.557	SAT TT=3.424 CHECKS=1284680	SAT TT=1.88 CHECKS=578291	SAT TT=1.479 ASSIGNMENTS=1092	SAT TT=1.697 ASSIGNMENTS=1092	SAT TT=1.545 CHECKS=375474 NODES=4055	SAT TT=2.759 CHECKS=14912600 NODES=68991	? (TO) TT=1800.01	SAT TT=0.275 ASSIGNMENTS=2762 CHECKS=992843	SAT TT=0.28 ASSIGNMENTS=2762 CHECKS=992843	SAT TT=2.948	SAT TT=4.678	No data	SAT TT=0.214 ASSIGNMENTS=2161 CHECKS=803322	SAT TT=0.293 ASSIGNMENTS=4350 CHECKS=1088150	SAT TT=3.846	SAT TT=0.388 ASSIGNMENTS=4337 CHECKS=1544100	SAT TT=0.263 ASSIGNMENTS=2762 CHECKS=992843	SAT TT=2.943	SAT TT=2.308 ASSIGNMENTS=2682 CHECKS=3669730	SAT TT=1.459	SAT TT=1.615
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-19_ext.xml	UNSAT TT=0.69	UNSAT TT=5.2 CHECKS=20354000 NODES=19520	UNSAT TT=5.272 CHECKS=20939400 NODES=20055	UNSAT TT=1.323	UNSAT TT=88.925 CHECKS=30628400	UNSAT TT=72.693 CHECKS=25807700	UNSAT TT=3.745 ASSIGNMENTS=4458	UNSAT TT=3.74 ASSIGNMENTS=4458	UNSAT TT=2.968 CHECKS=832185 NODES=9152	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.903 ASSIGNMENTS=9513 CHECKS=3626910	UNSAT TT=0.83 ASSIGNMENTS=9513 CHECKS=3626910	UNSAT TT=7.14	UNSAT TT=16.353	No data	UNSAT TT=0.861 ASSIGNMENTS=9542 CHECKS=3601020	UNSAT TT=0.69 ASSIGNMENTS=9428 CHECKS=3021180	UNSAT TT=14.126	UNSAT TT=0.757 ASSIGNMENTS=8400 CHECKS=3127840	UNSAT TT=0.866 ASSIGNMENTS=9513 CHECKS=3626910	UNSAT TT=21.971	UNSAT TT=9.501 ASSIGNMENTS=8982 CHECKS=12219500	UNSAT TT=6.352	UNSAT TT=7.18
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-23_ext.xml	SAT TT=0.761	SAT TT=3.334 CHECKS=10355600 NODES=10741	SAT TT=3.147 CHECKS=10485800 NODES=10974	SAT TT=1.293	SAT TT=22.163 CHECKS=9079140	SAT TT=4.076 CHECKS=1270130	SAT TT=3.437 ASSIGNMENTS=4857	SAT TT=3.662 ASSIGNMENTS=4857	SAT TT=3.133 CHECKS=892670 NODES=10315	SAT TT=6.556 CHECKS=43347300 NODES=197254	? (TO) TT=1800.03	SAT TT=1.2 ASSIGNMENTS=14464 CHECKS=5319360	SAT TT=1.213 ASSIGNMENTS=14464 CHECKS=5319360	SAT TT=10.314	SAT TT=3.756	No data	SAT TT=1.2 ASSIGNMENTS=14028 CHECKS=5135010	SAT TT=0.761 ASSIGNMENTS=9908 CHECKS=3174880	SAT TT=13.779	SAT TT=1.193 ASSIGNMENTS=13908 CHECKS=5063530	SAT TT=1.272 ASSIGNMENTS=14464 CHECKS=5319360	SAT TT=23.752	SAT TT=13.961 ASSIGNMENTS=10565 CHECKS=13242400	SAT TT=7.143	SAT TT=6.501
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-24_ext.xml	SAT TT=0.035	SAT TT=2.27 CHECKS=6309920 NODES=6715	SAT TT=2.202 CHECKS=5719260 NODES=6170	SAT TT=0.407	SAT TT=2.912 CHECKS=1056630	SAT TT=0.126 CHECKS=17744	SAT TT=0.789 ASSIGNMENTS=74	SAT TT=0.931 ASSIGNMENTS=74	SAT TT=0.684 CHECKS=43926 NODES=462	SAT TT=0.888 CHECKS=1068410 NODES=5122	SAT TT=0.63 CHECKS=224216 NODES=695	SAT TT=0.049 ASSIGNMENTS=124 CHECKS=39015	SAT TT=0.049 ASSIGNMENTS=124 CHECKS=39015	SAT TT=2.993	SAT TT=6.224	No data	SAT TT=0.035 ASSIGNMENTS=96 CHECKS=32139	SAT TT=0.227 ASSIGNMENTS=3842 CHECKS=879586	SAT TT=0.932	SAT TT=0.382 ASSIGNMENTS=4450 CHECKS=1511040	SAT TT=0.039 ASSIGNMENTS=124 CHECKS=39015	SAT TT=3.585	SAT TT=0.248 ASSIGNMENTS=171 CHECKS=159889	SAT TT=4.133	SAT TT=1.487
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-29_ext.xml	UNSAT TT=0.729	UNSAT TT=4.258 CHECKS=16335400 NODES=15881	UNSAT TT=4.267 CHECKS=16016900 NODES=15412	UNSAT TT=1.349	UNSAT TT=89.581 CHECKS=33558600	UNSAT TT=77.487 CHECKS=27151500	UNSAT TT=4.839 ASSIGNMENTS=6121	UNSAT TT=4.756 ASSIGNMENTS=6121	UNSAT TT=2.891 CHECKS=865097 NODES=9606	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=0.817 ASSIGNMENTS=8667 CHECKS=3268430	UNSAT TT=0.815 ASSIGNMENTS=8667 CHECKS=3268430	UNSAT TT=5.708	UNSAT TT=11.737	No data	UNSAT TT=0.786 ASSIGNMENTS=8631 CHECKS=3294570	UNSAT TT=0.839 ASSIGNMENTS=10534 CHECKS=3395900	UNSAT TT=12.992	UNSAT TT=0.745 ASSIGNMENTS=8549 CHECKS=3288930	UNSAT TT=0.729 ASSIGNMENTS=8667 CHECKS=3268430	UNSAT TT=15.716	UNSAT TT=11.138 ASSIGNMENTS=14965 CHECKS=19271200	UNSAT TT=5.72	UNSAT TT=6.647
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-31_ext.xml	UNSAT TT=0.792	UNSAT TT=4.513 CHECKS=16844800 NODES=16342	UNSAT TT=4.031 CHECKS=16871100 NODES=16421	UNSAT TT=1.355	UNSAT TT=82.687 CHECKS=29733200	UNSAT TT=73.414 CHECKS=24969500	UNSAT TT=4.071 ASSIGNMENTS=4869	UNSAT TT=3.723 ASSIGNMENTS=4869	UNSAT TT=3.029 CHECKS=867251 NODES=9517	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=0.827 ASSIGNMENTS=8773 CHECKS=3310030	UNSAT TT=0.839 ASSIGNMENTS=8773 CHECKS=3310030	UNSAT TT=10.052	UNSAT TT=14.928	No data	UNSAT TT=0.834 ASSIGNMENTS=9163 CHECKS=3454770	UNSAT TT=0.889 ASSIGNMENTS=10952 CHECKS=3582430	UNSAT TT=14.027	UNSAT TT=0.891 ASSIGNMENTS=10001 CHECKS=3698750	UNSAT TT=0.792 ASSIGNMENTS=8773 CHECKS=3310030	UNSAT TT=32.212	UNSAT TT=11.139 ASSIGNMENTS=13083 CHECKS=18754100	UNSAT TT=10.361	UNSAT TT=11.628
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-34_ext.xml	SAT TT=0.09	SAT TT=2.619 CHECKS=8353750 NODES=8200	SAT TT=2.741 CHECKS=9474020 NODES=9181	SAT TT=0.612	SAT TT=24.617 CHECKS=8782210	SAT TT=2.905 CHECKS=957759	SAT TT=1.395 ASSIGNMENTS=1091	SAT TT=1.492 ASSIGNMENTS=1091	SAT TT=0.916 CHECKS=124958 NODES=1366	SAT TT=1.314 CHECKS=5417480 NODES=24971	? (TO) TT=1800.08	SAT TT=0.108 ASSIGNMENTS=904 CHECKS=313146	SAT TT=0.117 ASSIGNMENTS=904 CHECKS=313146	SAT TT=2.405	SAT TT=5.321	No data	SAT TT=0.09 ASSIGNMENTS=782 CHECKS=267404	SAT TT=0.32 ASSIGNMENTS=4949 CHECKS=1320520	SAT TT=5.511	SAT TT=0.096 ASSIGNMENTS=957 CHECKS=298994	SAT TT=0.1 ASSIGNMENTS=904 CHECKS=313146	SAT TT=5.198	SAT TT=0.97 ASSIGNMENTS=795 CHECKS=980972	SAT TT=1.956	SAT TT=1.602
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-38_ext.xml	SAT TT=0.16	SAT TT=1.285 CHECKS=1473740 NODES=1727	SAT TT=1.312 CHECKS=1641130 NODES=1891	SAT TT=0.897	SAT TT=30.911 CHECKS=11637400	SAT TT=2.39 CHECKS=750857	SAT TT=2.595 ASSIGNMENTS=2774	SAT TT=2.404 ASSIGNMENTS=2774	SAT TT=1.991 CHECKS=517369 NODES=6226	SAT TT=7.39 CHECKS=46071700 NODES=207327	? (TO) TT=1800.07	SAT TT=0.236 ASSIGNMENTS=2536 CHECKS=896350	SAT TT=0.254 ASSIGNMENTS=2536 CHECKS=896350	SAT TT=3.937	SAT TT=6.559	No data	SAT TT=0.218 ASSIGNMENTS=2392 CHECKS=852916	SAT TT=0.41 ASSIGNMENTS=6019 CHECKS=1748240	SAT TT=13.848	SAT TT=0.16 ASSIGNMENTS=1668 CHECKS=553068	SAT TT=0.242 ASSIGNMENTS=2536 CHECKS=896350	SAT TT=20.822	SAT TT=2.585 ASSIGNMENTS=3208 CHECKS=4021310	SAT TT=10.02	SAT TT=9.577
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-39_ext.xml	SAT TT=0.152	SAT TT=1.369 CHECKS=1334410 NODES=1465	SAT TT=1.26 CHECKS=1383000 NODES=1512	SAT TT=0.446	SAT TT=7.249 CHECKS=2676550	SAT TT=5.094 CHECKS=1648420	SAT TT=1.486 ASSIGNMENTS=1183	SAT TT=1.543 ASSIGNMENTS=1183	SAT TT=1.84 CHECKS=361013 NODES=4130	SAT TT=2.09 CHECKS=10907000 NODES=50047	? (TO) TT=1800.03	SAT TT=0.169 ASSIGNMENTS=1490 CHECKS=524856	SAT TT=0.168 ASSIGNMENTS=1490 CHECKS=524856	SAT TT=2.263	SAT TT=8.512	No data	SAT TT=0.229 ASSIGNMENTS=2505 CHECKS=920648	SAT TT=0.228 ASSIGNMENTS=3696 CHECKS=876232	SAT TT=4.484	SAT TT=0.226 ASSIGNMENTS=2446 CHECKS=827809	SAT TT=0.152 ASSIGNMENTS=1490 CHECKS=524856	SAT TT=3.996	SAT TT=1.568 ASSIGNMENTS=778 CHECKS=1071310	SAT TT=4.419	SAT TT=1.758
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-40_ext.xml	UNSAT TT=0.912	UNSAT TT=4.135 CHECKS=15509500 NODES=15149	UNSAT TT=4.225 CHECKS=15126500 NODES=14762	UNSAT TT=2.178	UNSAT TT=88.869 CHECKS=30634600	UNSAT TT=74.938 CHECKS=26163100	UNSAT TT=4.499 ASSIGNMENTS=6322	UNSAT TT=5.045 ASSIGNMENTS=6322	UNSAT TT=3.548 CHECKS=1014540 NODES=11409	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=0.993 ASSIGNMENTS=10679 CHECKS=3983840	UNSAT TT=0.981 ASSIGNMENTS=10679 CHECKS=3983840	UNSAT TT=12.821	UNSAT TT=18.786	No data	UNSAT TT=0.956 ASSIGNMENTS=10723 CHECKS=4016950	UNSAT TT=0.973 ASSIGNMENTS=12150 CHECKS=4035030	UNSAT TT=20.217	UNSAT TT=0.912 ASSIGNMENTS=10142 CHECKS=3773960	UNSAT TT=0.947 ASSIGNMENTS=10679 CHECKS=3983840	UNSAT TT=50.096	UNSAT TT=10.688 ASSIGNMENTS=13404 CHECKS=18154900	UNSAT TT=9.387	UNSAT TT=13.226
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-43_ext.xml	SAT TT=0.122	SAT TT=2.03 CHECKS=4914060 NODES=5334	SAT TT=2.057 CHECKS=5267510 NODES=5840	SAT TT=1.869	SAT TT=1.177 CHECKS=414091	SAT TT=4.866 CHECKS=1755200	SAT TT=1.205 ASSIGNMENTS=602	SAT TT=1.149 ASSIGNMENTS=602	SAT TT=0.957 CHECKS=69156 NODES=713	SAT TT=1.355 CHECKS=5030810 NODES=22323	SAT TT=412.766 CHECKS=3036610000 NODES=1199480	SAT TT=0.316 ASSIGNMENTS=3089 CHECKS=1173330	SAT TT=0.293 ASSIGNMENTS=3089 CHECKS=1173330	SAT TT=3.808	SAT TT=2.448	No data	SAT TT=0.361 ASSIGNMENTS=3895 CHECKS=1441880	SAT TT=0.328 ASSIGNMENTS=4690 CHECKS=1262680	SAT TT=1.589	SAT TT=0.122 ASSIGNMENTS=1186 CHECKS=416120	SAT TT=0.29 ASSIGNMENTS=3089 CHECKS=1173330	SAT TT=4.5	SAT TT=1.193 ASSIGNMENTS=1405 CHECKS=1724600	SAT TT=1.499	SAT TT=3.643
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-45_ext.xml	SAT TT=0.096	SAT TT=0.999 CHECKS=288169 NODES=333	SAT TT=0.935 CHECKS=276807 NODES=283	SAT TT=0.452	SAT TT=3.1 CHECKS=1144210	SAT TT=1.863 CHECKS=604195	SAT TT=1.337 ASSIGNMENTS=737	SAT TT=1.308 ASSIGNMENTS=737	SAT TT=1.316 CHECKS=272352 NODES=2859	SAT TT=1.086 CHECKS=2049230 NODES=9128	SAT TT=7.718 CHECKS=54507700 NODES=74657	SAT TT=0.11 ASSIGNMENTS=771 CHECKS=299021	SAT TT=0.11 ASSIGNMENTS=771 CHECKS=299021	SAT TT=2.339	SAT TT=2.449	No data	SAT TT=0.147 ASSIGNMENTS=1446 CHECKS=555271	SAT TT=0.293 ASSIGNMENTS=4201 CHECKS=1082430	SAT TT=1.573	SAT TT=0.197 ASSIGNMENTS=2120 CHECKS=742463	SAT TT=0.096 ASSIGNMENTS=771 CHECKS=299021	SAT TT=3.208	SAT TT=0.979 ASSIGNMENTS=483 CHECKS=639260	SAT TT=2.19	SAT TT=1.761
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-46_ext.xml	SAT TT=0.047	SAT TT=1.496 CHECKS=2583770 NODES=2699	SAT TT=1.652 CHECKS=2636970 NODES=2661	SAT TT=0.628	SAT TT=0.579 CHECKS=173019	SAT TT=5.162 CHECKS=1847480	SAT TT=1.578 ASSIGNMENTS=1258	SAT TT=1.599 ASSIGNMENTS=1258	SAT TT=0.801 CHECKS=85711 NODES=865	SAT TT=6.883 CHECKS=42830400 NODES=184570	SAT TT=1358.96 CHECKS=10092000000 NODES=4394940	SAT TT=0.056 ASSIGNMENTS=173 CHECKS=71353	SAT TT=0.061 ASSIGNMENTS=173 CHECKS=71353	SAT TT=2.843	SAT TT=3.665	No data	SAT TT=0.269 ASSIGNMENTS=2584 CHECKS=1006350	SAT TT=0.355 ASSIGNMENTS=4857 CHECKS=1364780	SAT TT=3.585	SAT TT=0.331 ASSIGNMENTS=3643 CHECKS=1430800	SAT TT=0.047 ASSIGNMENTS=173 CHECKS=71353	SAT TT=3.429	SAT TT=1.89 ASSIGNMENTS=1116 CHECKS=1597920	SAT TT=3.056	SAT TT=1.455
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-48_ext.xml	SAT TT=0.069	SAT TT=2.707 CHECKS=8625390 NODES=8418	SAT TT=2.957 CHECKS=9779390 NODES=9376	SAT TT=0.929	SAT TT=6.812 CHECKS=2500850	SAT TT=3.019 CHECKS=972194	SAT TT=2.027 ASSIGNMENTS=1697	SAT TT=2.189 ASSIGNMENTS=1697	SAT TT=1.267 CHECKS=180128 NODES=1898	SAT TT=5.396 CHECKS=33958000 NODES=153002	? (TO) TT=1800.08	SAT TT=0.228 ASSIGNMENTS=2091 CHECKS=774295	SAT TT=0.225 ASSIGNMENTS=2091 CHECKS=774295	SAT TT=2.788	SAT TT=7.618	No data	SAT TT=0.141 ASSIGNMENTS=1234 CHECKS=468716	SAT TT=0.235 ASSIGNMENTS=3648 CHECKS=846974	SAT TT=6.554	SAT TT=0.069 ASSIGNMENTS=611 CHECKS=176391	SAT TT=0.198 ASSIGNMENTS=2091 CHECKS=774295	SAT TT=7.838	SAT TT=0.363 ASSIGNMENTS=318 CHECKS=468899	SAT TT=2.511	SAT TT=2.495
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-49_ext.xml	UNSAT TT=0.816	UNSAT TT=12.72 CHECKS=57045400 NODES=57653	UNSAT TT=12.746 CHECKS=57813400 NODES=58485	UNSAT TT=1.519	UNSAT TT=35.903 CHECKS=13410800	UNSAT TT=78.248 CHECKS=28047800	UNSAT TT=4.58 ASSIGNMENTS=6540	UNSAT TT=5.058 ASSIGNMENTS=6540	UNSAT TT=3.345 CHECKS=981323 NODES=10843	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=0.913 ASSIGNMENTS=9837 CHECKS=3709350	UNSAT TT=0.908 ASSIGNMENTS=9837 CHECKS=3709350	UNSAT TT=7.704	UNSAT TT=12.87	No data	UNSAT TT=0.823 ASSIGNMENTS=9155 CHECKS=3453100	UNSAT TT=0.863 ASSIGNMENTS=11177 CHECKS=3578580	UNSAT TT=15.92	UNSAT TT=0.816 ASSIGNMENTS=9303 CHECKS=3446200	UNSAT TT=0.881 ASSIGNMENTS=9837 CHECKS=3709350	UNSAT TT=19.077	UNSAT TT=9.575 ASSIGNMENTS=10706 CHECKS=13625700	UNSAT TT=7.02	UNSAT TT=9.717
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-5_ext.xml	SAT TT=0.064	SAT TT=3.765 CHECKS=14772900 NODES=15122	SAT TT=4.277 CHECKS=15875500 NODES=16141	SAT TT=0.692	SAT TT=3.836 CHECKS=1360890	SAT TT=0.318 CHECKS=84613	SAT TT=2.473 ASSIGNMENTS=2440	SAT TT=2.317 ASSIGNMENTS=2440	SAT TT=1.15 CHECKS=184557 NODES=2088	SAT TT=1.32 CHECKS=3949220 NODES=18115	SAT TT=1016.61 CHECKS=6948680000 NODES=1480610	SAT TT=0.357 ASSIGNMENTS=3650 CHECKS=1333320	SAT TT=0.356 ASSIGNMENTS=3650 CHECKS=1333320	SAT TT=3.367	SAT TT=4.192	No data	SAT TT=0.453 ASSIGNMENTS=5364 CHECKS=1976140	SAT TT=0.249 ASSIGNMENTS=3655 CHECKS=907535	SAT TT=2.255	SAT TT=0.064 ASSIGNMENTS=615 CHECKS=183207	SAT TT=0.316 ASSIGNMENTS=3650 CHECKS=1333320	SAT TT=10.411	SAT TT=0.883 ASSIGNMENTS=378 CHECKS=532084	SAT TT=2.761	SAT TT=4.061
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-6_ext.xml	UNSAT TT=0.427	UNSAT TT=3.635 CHECKS=13208300 NODES=12342	UNSAT TT=3.589 CHECKS=13315800 NODES=12415	UNSAT TT=0.887	UNSAT TT=85.38 CHECKS=29975600	UNSAT TT=13.458 CHECKS=4325160	UNSAT TT=2.63 ASSIGNMENTS=2599	UNSAT TT=2.339 ASSIGNMENTS=2599	UNSAT TT=2.039 CHECKS=533132 NODES=5400	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.466 ASSIGNMENTS=4596 CHECKS=1783280	UNSAT TT=0.471 ASSIGNMENTS=4596 CHECKS=1783280	UNSAT TT=3.426	UNSAT TT=5.79	No data	UNSAT TT=0.427 ASSIGNMENTS=4379 CHECKS=1715350	UNSAT TT=0.565 ASSIGNMENTS=7251 CHECKS=2250930	UNSAT TT=6.139	UNSAT TT=0.45 ASSIGNMENTS=4687 CHECKS=1779280	UNSAT TT=0.441 ASSIGNMENTS=4596 CHECKS=1783280	UNSAT TT=8.508	UNSAT TT=6.36 ASSIGNMENTS=7478 CHECKS=11698900	UNSAT TT=3.473	UNSAT TT=3.604
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-9_ext.xml	SAT TT=0.275	SAT TT=1.927 CHECKS=4366730 NODES=4737	SAT TT=1.841 CHECKS=3918240 NODES=4220	SAT TT=1.151	SAT TT=0.981 CHECKS=341156	SAT TT=3.1 CHECKS=1026450	SAT TT=3.04 ASSIGNMENTS=3241	SAT TT=2.765 ASSIGNMENTS=3241	SAT TT=1.765 CHECKS=365261 NODES=4542	SAT TT=1.539 CHECKS=6239530 NODES=27681	? (TO) TT=1800.04	SAT TT=0.381 ASSIGNMENTS=3969 CHECKS=1436140	SAT TT=0.386 ASSIGNMENTS=3969 CHECKS=1436140	SAT TT=2.543	SAT TT=12.879	No data	SAT TT=0.406 ASSIGNMENTS=4422 CHECKS=1627760	SAT TT=0.275 ASSIGNMENTS=4068 CHECKS=1018070	SAT TT=15.902	SAT TT=0.384 ASSIGNMENTS=4276 CHECKS=1511090	SAT TT=0.372 ASSIGNMENTS=3969 CHECKS=1436140	SAT TT=5.531	SAT TT=2.219 ASSIGNMENTS=2144 CHECKS=2836740	SAT TT=1.295	SAT TT=4.473
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-11_ext.xml	SAT TT=2.111	SAT TT=113.436 CHECKS=608190000 NODES=438246	SAT TT=113.041 CHECKS=608060000 NODES=437565	SAT TT=73.256	SAT TT=283.924 CHECKS=75019200	SAT TT=531.775 CHECKS=107383000	SAT TT=141.211 ASSIGNMENTS=165111	SAT TT=142.137 ASSIGNMENTS=165111	SAT TT=86.509 CHECKS=26862700 NODES=240225	SAT TT=2.111 CHECKS=9550740 NODES=29954	? (TO) TT=1800.01	SAT TT=74.82 ASSIGNMENTS=568203 CHECKS=291652000	SAT TT=110.808 ASSIGNMENTS=438246 CHECKS=608190000	SAT TT=979.749	? (TO) TT=1800.02	No data	SAT TT=72.761 ASSIGNMENTS=569910 CHECKS=292607000	SAT TT=59.975 ASSIGNMENTS=468155 CHECKS=239694000	? (TO) TT=1800.03	SAT TT=32.369 ASSIGNMENTS=252544 CHECKS=128950000	SAT TT=72.766 ASSIGNMENTS=568203 CHECKS=291652000	? (TO) TT=1800.1	SAT TT=466.863 ASSIGNMENTS=218077 CHECKS=389968000	SAT TT=1472.25	? (TO) TT=1800.11
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-12_ext.xml	SAT TT=21.033	SAT TT=35.785 CHECKS=202069000 NODES=153181	SAT TT=37.811 CHECKS=197436000 NODES=150291	SAT TT=49.544	SAT TT=784.138 CHECKS=225710000	SAT TT=1432.41 CHECKS=343163000	SAT TT=126.353 ASSIGNMENTS=164715	SAT TT=131.174 ASSIGNMENTS=164715	SAT TT=125.091 CHECKS=38009900 NODES=340105	SAT TT=21.033 CHECKS=141425000 NODES=453040	? (TO) TT=1800.04	SAT TT=40.135 ASSIGNMENTS=265420 CHECKS=131549000	SAT TT=40.47 ASSIGNMENTS=265420 CHECKS=131549000	? (TO) TT=1800	? (TO) TT=1800.09	No data	SAT TT=38.66 ASSIGNMENTS=313951 CHECKS=155929000	SAT TT=38.786 ASSIGNMENTS=319600 CHECKS=157960000	SAT TT=1297.18	SAT TT=36.217 ASSIGNMENTS=314683 CHECKS=156184000	SAT TT=32.507 ASSIGNMENTS=265420 CHECKS=131549000	? (TO) TT=1800.16	SAT TT=266.547 ASSIGNMENTS=211162 CHECKS=367710000	SAT TT=1079.55	SAT TT=1044.31
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-17_ext.xml	SAT TT=20.832	SAT TT=34.907 CHECKS=198350000 NODES=142535	SAT TT=21.345 CHECKS=107951000 NODES=79011	SAT TT=25.627	? (TO) TT=1800.03	SAT TT=874.948 CHECKS=184436000	SAT TT=267.066 ASSIGNMENTS=343550	SAT TT=266.651 ASSIGNMENTS=343550	SAT TT=174.826 CHECKS=54945600 NODES=503670	SAT TT=20.832 CHECKS=154237000 NODES=470471	? (TO) TT=1800.05	SAT TT=77.558 ASSIGNMENTS=556670 CHECKS=288296000	SAT TT=41.782 ASSIGNMENTS=142535 CHECKS=198350000	SAT TT=731.92	SAT TT=77.645	No data	SAT TT=57.97 ASSIGNMENTS=458994 CHECKS=239601000	SAT TT=57.483 ASSIGNMENTS=453641 CHECKS=233938000	SAT TT=1086.34	SAT TT=26.782 ASSIGNMENTS=227959 CHECKS=117490000	SAT TT=66.469 ASSIGNMENTS=556670 CHECKS=288296000	? (TO) TT=1800.08	SAT TT=611.393 ASSIGNMENTS=573815 CHECKS=1062390000	? (TO) TT=1800.08	SAT TT=1547.81
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-18_ext.xml	SAT TT=2.292	SAT TT=60.563 CHECKS=322143000 NODES=221723	SAT TT=56.51 CHECKS=305814000 NODES=211512	SAT TT=20.671	SAT TT=20.673 CHECKS=5603280	SAT TT=86.982 CHECKS=18316100	SAT TT=61.563 ASSIGNMENTS=74128	SAT TT=60.25 ASSIGNMENTS=74128	SAT TT=57.967 CHECKS=18730200 NODES=163345	SAT TT=2.292 CHECKS=11100800 NODES=34277	? (TO) TT=1800.06	SAT TT=18.144 ASSIGNMENTS=83732 CHECKS=43215100	SAT TT=62.228 ASSIGNMENTS=221723 CHECKS=322143000	? (TO) TT=1800.05	SAT TT=1701.58	No data	SAT TT=17.918 ASSIGNMENTS=138357 CHECKS=72031400	SAT TT=13.199 ASSIGNMENTS=112102 CHECKS=58113600	SAT TT=126.381	SAT TT=16.64 ASSIGNMENTS=128546 CHECKS=66078900	SAT TT=10.586 ASSIGNMENTS=83732 CHECKS=43215100	? (TO) TT=1800.17	SAT TT=137.018 ASSIGNMENTS=109103 CHECKS=198174000	SAT TT=136.773	SAT TT=63.174
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-19_ext.xml	SAT TT=3.448	SAT TT=74.323 CHECKS=399078000 NODES=282181	SAT TT=69.497 CHECKS=399592000 NODES=282606	SAT TT=33.156	SAT TT=836.026 CHECKS=229575000	SAT TT=804.12 CHECKS=185189000	SAT TT=58.521 ASSIGNMENTS=67125	SAT TT=58.356 ASSIGNMENTS=67125	SAT TT=91.476 CHECKS=28767000 NODES=245985	SAT TT=187.752 CHECKS=1396980000 NODES=4442790	? (TO) TT=1800.02	SAT TT=38.469 ASSIGNMENTS=233901 CHECKS=122615000	SAT TT=36.497 ASSIGNMENTS=233901 CHECKS=122615000	SAT TT=347.535	? (TO) TT=1800.06	No data	SAT TT=28.129 ASSIGNMENTS=234569 CHECKS=123026000	SAT TT=3.448 ASSIGNMENTS=29837 CHECKS=14834700	SAT TT=320.491	SAT TT=3.56 ASSIGNMENTS=29229 CHECKS=15117100	SAT TT=28.653 ASSIGNMENTS=233901 CHECKS=122615000	? (TO) TT=1800.14	SAT TT=114.18 ASSIGNMENTS=43723 CHECKS=81565900	SAT TT=120.577	SAT TT=734.511
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-1_ext.xml	SAT TT=1.093	SAT TT=1.12 CHECKS=828664 NODES=665	SAT TT=1.093 CHECKS=661944 NODES=479	SAT TT=11.347	SAT TT=715.383 CHECKS=207735000	SAT TT=45.441 CHECKS=10470400	SAT TT=16.337 ASSIGNMENTS=16215	SAT TT=16.164 ASSIGNMENTS=16215	SAT TT=38.438 CHECKS=12199500 NODES=103200	SAT TT=25.875 CHECKS=194215000 NODES=593020	? (TO) TT=1800	SAT TT=16.47 ASSIGNMENTS=67711 CHECKS=36055900	SAT TT=8.751 ASSIGNMENTS=665 CHECKS=828664	SAT TT=1604.56	? (TO) TT=1800	No data	SAT TT=7.856 ASSIGNMENTS=58991 CHECKS=31448800	SAT TT=25.003 ASSIGNMENTS=188515 CHECKS=100879000	SAT TT=632.393	SAT TT=14.615 ASSIGNMENTS=109979 CHECKS=58509100	SAT TT=8.985 ASSIGNMENTS=67711 CHECKS=36055900	? (TO) TT=1800.12	SAT TT=79.531 ASSIGNMENTS=52159 CHECKS=103375000	SAT TT=37.936	SAT TT=532.042
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-20_ext.xml	SAT TT=5.763	SAT TT=7.451 CHECKS=33186800 NODES=25969	SAT TT=41.11 CHECKS=213570000 NODES=161019	SAT TT=5.763	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=327.116 ASSIGNMENTS=403922	SAT TT=310.271 ASSIGNMENTS=403922	SAT TT=115.538 CHECKS=35348200 NODES=317507	SAT TT=50.741 CHECKS=352251000 NODES=1156420	? (TO) TT=1800.04	SAT TT=53.358 ASSIGNMENTS=372279 CHECKS=185493000	SAT TT=14.309 ASSIGNMENTS=25969 CHECKS=33186800	? (TO) TT=1800.09	? (TO) TT=1800.04	No data	SAT TT=35.905 ASSIGNMENTS=287978 CHECKS=143668000	SAT TT=89.694 ASSIGNMENTS=721511 CHECKS=359210000	SAT TT=1495.7	SAT TT=50.553 ASSIGNMENTS=400085 CHECKS=198853000	SAT TT=46.281 ASSIGNMENTS=372279 CHECKS=185493000	? (TO) TT=1800.11	SAT TT=579.216 ASSIGNMENTS=465773 CHECKS=814409000	? (TO) TT=1800.13	? (TO) TT=1800.06
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-22_ext.xml	SAT TT=0.835	SAT TT=24.379 CHECKS=132298000 NODES=99710	SAT TT=16.855 CHECKS=83483300 NODES=63195	SAT TT=248.633	? (TO) TT=1800.09	SAT TT=1352.74 CHECKS=325111000	SAT TT=82.834 ASSIGNMENTS=103234	SAT TT=80.795 ASSIGNMENTS=103234	SAT TT=6.862 CHECKS=1932110 NODES=18388	SAT TT=3.993 CHECKS=25333800 NODES=78967	? (TO) TT=1800.09	SAT TT=30.996 ASSIGNMENTS=180652 CHECKS=91127700	SAT TT=31.286 ASSIGNMENTS=99710 CHECKS=132298000	? (TO) TT=1800.01	? (TO) TT=1800.05	No data	SAT TT=9.223 ASSIGNMENTS=72313 CHECKS=37086900	SAT TT=0.835 ASSIGNMENTS=7658 CHECKS=3114620	SAT TT=124.757	SAT TT=21.981 ASSIGNMENTS=172266 CHECKS=86594800	SAT TT=22.406 ASSIGNMENTS=180652 CHECKS=91127700	SAT TT=696.188	SAT TT=79.198 ASSIGNMENTS=70996 CHECKS=120339000	SAT TT=1112	SAT TT=219.342
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-23_ext.xml	SAT TT=2.763	SAT TT=9.294 CHECKS=43676300 NODES=32744	SAT TT=8.962 CHECKS=41721000 NODES=31260	SAT TT=40.997	SAT TT=502.617 CHECKS=139874000	SAT TT=1445.16 CHECKS=355157000	SAT TT=23.109 ASSIGNMENTS=23709	SAT TT=23.224 ASSIGNMENTS=23709	SAT TT=15.743 CHECKS=4706950 NODES=41649	SAT TT=16.331 CHECKS=117731000 NODES=375508	? (TO) TT=1800.07	SAT TT=10.212 ASSIGNMENTS=21319 CHECKS=10876400	SAT TT=16.613 ASSIGNMENTS=32744 CHECKS=43676300	? (TO) TT=1800.09	? (TO) TT=1800.06	No data	SAT TT=3.391 ASSIGNMENTS=26248 CHECKS=13449200	SAT TT=6.988 ASSIGNMENTS=56470 CHECKS=28232000	SAT TT=6.004	SAT TT=7.295 ASSIGNMENTS=55317 CHECKS=29172700	SAT TT=2.763 ASSIGNMENTS=21319 CHECKS=10876400	? (TO) TT=1800.11	SAT TT=102.582 ASSIGNMENTS=24934 CHECKS=44453900	SAT TT=347.277	SAT TT=72.183
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-25_ext.xml	SAT TT=7.184	SAT TT=82.56 CHECKS=474895000 NODES=326374	SAT TT=83.874 CHECKS=458625000 NODES=315180	SAT TT=40.92	SAT TT=798.066 CHECKS=228916000	? (TO) TT=1800.02	SAT TT=69.211 ASSIGNMENTS=81891	SAT TT=72.475 ASSIGNMENTS=81891	SAT TT=38.071 CHECKS=12345500 NODES=107867	SAT TT=7.184 CHECKS=43722400 NODES=137169	? (TO) TT=1800	SAT TT=20.607 ASSIGNMENTS=96496 CHECKS=50354700	SAT TT=87.856 ASSIGNMENTS=326374 CHECKS=474895000	SAT TT=326.631	SAT TT=923.714	No data	SAT TT=35.89 ASSIGNMENTS=272584 CHECKS=142914000	SAT TT=12.671 ASSIGNMENTS=98113 CHECKS=50622300	SAT TT=414.267	SAT TT=12.985 ASSIGNMENTS=99424 CHECKS=51949800	SAT TT=12.478 ASSIGNMENTS=96496 CHECKS=50354700	? (TO) TT=1800.14	SAT TT=208.996 ASSIGNMENTS=97878 CHECKS=168275000	SAT TT=788.647	SAT TT=32.422
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-27_ext.xml	SAT TT=3.314	SAT TT=43.443 CHECKS=235043000 NODES=151929	SAT TT=47.376 CHECKS=260325000 NODES=169311	SAT TT=58.937	SAT TT=613.242 CHECKS=173711000	SAT TT=380.035 CHECKS=76911000	SAT TT=116.813 ASSIGNMENTS=124912	SAT TT=116.868 ASSIGNMENTS=124912	SAT TT=37.515 CHECKS=12064400 NODES=108430	SAT TT=3.314 CHECKS=18123800 NODES=58859	? (TO) TT=1800.02	SAT TT=36.835 ASSIGNMENTS=230282 CHECKS=120453000	SAT TT=46.984 ASSIGNMENTS=151929 CHECKS=235043000	SAT TT=1547.48	? (TO) TT=1800.1	No data	SAT TT=29.459 ASSIGNMENTS=230077 CHECKS=120769000	SAT TT=27.821 ASSIGNMENTS=218643 CHECKS=113551000	SAT TT=130.069	SAT TT=29.081 ASSIGNMENTS=226860 CHECKS=118497000	SAT TT=27.452 ASSIGNMENTS=230282 CHECKS=120453000	? (TO) TT=1800.11	SAT TT=339.007 ASSIGNMENTS=279392 CHECKS=538842000	SAT TT=603.511	SAT TT=835.53
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-28_ext.xml	SAT TT=0.233	SAT TT=9.097 CHECKS=44797300 NODES=29654	SAT TT=9.86 CHECKS=53978900 NODES=35582	SAT TT=31.745	SAT TT=11.531 CHECKS=3013110	SAT TT=163.602 CHECKS=33623900	SAT TT=1.535 ASSIGNMENTS=563	SAT TT=1.447 ASSIGNMENTS=563	SAT TT=17.655 CHECKS=5924950 NODES=49036	SAT TT=7.674 CHECKS=48088000 NODES=151766	? (TO) TT=1800.01	SAT TT=0.263 ASSIGNMENTS=1493 CHECKS=785748	SAT TT=0.253 ASSIGNMENTS=1493 CHECKS=785748	? (TO) TT=1800.04	SAT TT=229.694	No data	SAT TT=0.233 ASSIGNMENTS=1289 CHECKS=699504	SAT TT=1.651 ASSIGNMENTS=13179 CHECKS=6396530	SAT TT=15.634	SAT TT=1.138 ASSIGNMENTS=8905 CHECKS=4643320	SAT TT=0.246 ASSIGNMENTS=1493 CHECKS=785748	? (TO) TT=1800.09	SAT TT=52.143 ASSIGNMENTS=7192 CHECKS=14022500	SAT TT=383.061	SAT TT=466.948
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-33_ext.xml	SAT TT=6.794	SAT TT=128.027 CHECKS=671453000 NODES=519406	SAT TT=121.146 CHECKS=640932000 NODES=498622	SAT TT=173.808	SAT TT=754.349 CHECKS=204736000	SAT TT=171.885 CHECKS=34628500	SAT TT=333.071 ASSIGNMENTS=438888	SAT TT=336.449 ASSIGNMENTS=438888	SAT TT=269.358 CHECKS=78724100 NODES=742371	SAT TT=29.754 CHECKS=203229000 NODES=644521	? (TO) TT=1800.04	SAT TT=32.274 ASSIGNMENTS=200153 CHECKS=100239000	SAT TT=125.938 ASSIGNMENTS=519406 CHECKS=671453000	? (TO) TT=1800.05	SAT TT=316.184	No data	SAT TT=24.614 ASSIGNMENTS=196070 CHECKS=98311500	SAT TT=8.773 ASSIGNMENTS=76445 CHECKS=37867500	? (TO) TT=1800.08	SAT TT=6.794 ASSIGNMENTS=52609 CHECKS=26711600	SAT TT=22.98 ASSIGNMENTS=200153 CHECKS=100239000	? (TO) TT=1800.18	SAT TT=362.272 ASSIGNMENTS=65372 CHECKS=108406000	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-38_ext.xml	SAT TT=16.426	SAT TT=27.162 CHECKS=142937000 NODES=99464	SAT TT=30.083 CHECKS=157289000 NODES=108479	SAT TT=23.859	SAT TT=355.613 CHECKS=96906200	SAT TT=572.381 CHECKS=136704000	SAT TT=36.752 ASSIGNMENTS=41502	SAT TT=36.906 ASSIGNMENTS=41502	SAT TT=48.278 CHECKS=14517500 NODES=128345	SAT TT=28.102 CHECKS=209186000 NODES=653985	? (TO) TT=1800.08	SAT TT=30.504 ASSIGNMENTS=175705 CHECKS=91852100	SAT TT=32.652 ASSIGNMENTS=99464 CHECKS=142937000	? (TO) TT=1800	SAT TT=490.65	No data	SAT TT=20.656 ASSIGNMENTS=159666 CHECKS=82486400	SAT TT=16.426 ASSIGNMENTS=140248 CHECKS=71853900	SAT TT=277.231	SAT TT=23.136 ASSIGNMENTS=176904 CHECKS=92512200	SAT TT=22.469 ASSIGNMENTS=175705 CHECKS=91852100	SAT TT=528.434	SAT TT=283.787 ASSIGNMENTS=235286 CHECKS=434715000	SAT TT=209.817	SAT TT=103.887
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-39_ext.xml	SAT TT=4.806	SAT TT=64.486 CHECKS=358305000 NODES=229869	SAT TT=72.702 CHECKS=405221000 NODES=258826	SAT TT=13.765	SAT TT=1129.94 CHECKS=300972000	SAT TT=661.742 CHECKS=160561000	SAT TT=51.721 ASSIGNMENTS=53928	SAT TT=51.444 ASSIGNMENTS=53928	SAT TT=15.289 CHECKS=4987840 NODES=39493	SAT TT=4.806 CHECKS=30098000 NODES=91108	? (TO) TT=1800.04	SAT TT=21.239 ASSIGNMENTS=101575 CHECKS=55893400	SAT TT=66.42 ASSIGNMENTS=229869 CHECKS=358305000	SAT TT=222.362	SAT TT=128.995	No data	SAT TT=13.836 ASSIGNMENTS=101751 CHECKS=55915800	SAT TT=13.708 ASSIGNMENTS=102664 CHECKS=55865500	SAT TT=247.291	SAT TT=7.433 ASSIGNMENTS=54058 CHECKS=29895200	SAT TT=12.729 ASSIGNMENTS=101575 CHECKS=55893400	SAT TT=948.763	SAT TT=66.336 ASSIGNMENTS=25933 CHECKS=52244000	SAT TT=66.591	SAT TT=191.417
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-3_ext.xml	SAT TT=4.581	SAT TT=118.662 CHECKS=705927000 NODES=481550	SAT TT=124.111 CHECKS=684149000 NODES=468122	SAT TT=4.581	SAT TT=915.284 CHECKS=244726000	SAT TT=425.701 CHECKS=99288900	SAT TT=44.788 ASSIGNMENTS=49021	SAT TT=45.573 ASSIGNMENTS=49021	SAT TT=125.374 CHECKS=41169900 NODES=350418	SAT TT=26.157 CHECKS=187690000 NODES=587375	? (TO) TT=1800.08	SAT TT=26.409 ASSIGNMENTS=142556 CHECKS=74883700	SAT TT=125.661 ASSIGNMENTS=481550 CHECKS=705927000	SAT TT=367.672	SAT TT=389.431	No data	SAT TT=17.541 ASSIGNMENTS=142751 CHECKS=75036700	SAT TT=22.783 ASSIGNMENTS=179556 CHECKS=91929500	SAT TT=591.093	SAT TT=47.231 ASSIGNMENTS=354054 CHECKS=185830000	SAT TT=18.694 ASSIGNMENTS=142556 CHECKS=74883700	? (TO) TT=1800.13	SAT TT=280.068 ASSIGNMENTS=175241 CHECKS=351829000	SAT TT=703.824	SAT TT=1419.48
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-40_ext.xml	SAT TT=6.719	SAT TT=122.867 CHECKS=720062000 NODES=493848	SAT TT=121.714 CHECKS=725215000 NODES=497344	SAT TT=6.719	SAT TT=183.497 CHECKS=46841800	SAT TT=108.02 CHECKS=24372100	SAT TT=28.266 ASSIGNMENTS=30334	SAT TT=27.689 ASSIGNMENTS=30334	SAT TT=104.431 CHECKS=33562600 NODES=290578	SAT TT=119.172 CHECKS=903064000 NODES=2742740	? (TO) TT=1800.1	SAT TT=24.379 ASSIGNMENTS=128199 CHECKS=68466100	SAT TT=130.116 ASSIGNMENTS=493848 CHECKS=720062000	SAT TT=182.752	SAT TT=252.116	No data	SAT TT=16.444 ASSIGNMENTS=136390 CHECKS=72315800	SAT TT=35.232 ASSIGNMENTS=283509 CHECKS=153011000	SAT TT=422.404	SAT TT=34.697 ASSIGNMENTS=281985 CHECKS=152243000	SAT TT=16.727 ASSIGNMENTS=128199 CHECKS=68466100	SAT TT=1664.31	SAT TT=229.107 ASSIGNMENTS=74859 CHECKS=138195000	SAT TT=664.729	SAT TT=22.574
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-41_ext.xml	SAT TT=2.378	SAT TT=333.902 CHECKS=1838650000 NODES=1219540	SAT TT=337.293 CHECKS=1853890000 NODES=1227720	SAT TT=48.401	SAT TT=1071.52 CHECKS=297719000	SAT TT=192.044 CHECKS=42372300	SAT TT=149.08 ASSIGNMENTS=166967	SAT TT=135.817 ASSIGNMENTS=166967	SAT TT=63.54 CHECKS=20631700 NODES=174065	SAT TT=40.813 CHECKS=282924000 NODES=891626	? (TO) TT=1800.05	SAT TT=10.01 ASSIGNMENTS=17126 CHECKS=9335190	SAT TT=316.589 ASSIGNMENTS=1219540 CHECKS=1838650000	SAT TT=1123.3	? (TO) TT=1800.09	No data	SAT TT=2.409 ASSIGNMENTS=17683 CHECKS=9647800	SAT TT=14.694 ASSIGNMENTS=110101 CHECKS=59222200	SAT TT=806.929	SAT TT=31.76 ASSIGNMENTS=234481 CHECKS=127040000	SAT TT=2.378 ASSIGNMENTS=17126 CHECKS=9335190	? (TO) TT=1800.1	SAT TT=210.881 ASSIGNMENTS=33786 CHECKS=71497200	SAT TT=498.924	SAT TT=1795.52
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-42_ext.xml	SAT TT=2.398	SAT TT=83.068 CHECKS=448155000 NODES=311580	SAT TT=80.227 CHECKS=467003000 NODES=324668	SAT TT=3.298	SAT TT=606.928 CHECKS=167501000	SAT TT=201.709 CHECKS=39560600	SAT TT=8.581 ASSIGNMENTS=8840	SAT TT=8.605 ASSIGNMENTS=8840	SAT TT=58.321 CHECKS=17892800 NODES=159050	SAT TT=3.379 CHECKS=20154500 NODES=63277	? (TO) TT=1800.03	SAT TT=10.06 ASSIGNMENTS=18960 CHECKS=9625810	SAT TT=9.546 ASSIGNMENTS=18960 CHECKS=9625810	SAT TT=1220.22	? (TO) TT=1800.03	No data	SAT TT=3.659 ASSIGNMENTS=29323 CHECKS=14727300	SAT TT=2.398 ASSIGNMENTS=21205 CHECKS=10076800	SAT TT=101.256	SAT TT=22.305 ASSIGNMENTS=169781 CHECKS=87397400	SAT TT=2.445 ASSIGNMENTS=18960 CHECKS=9625810	SAT TT=229.959	SAT TT=157.097 ASSIGNMENTS=131390 CHECKS=233757000	SAT TT=800.856	SAT TT=23.379
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-44_ext.xml	SAT TT=11.489	SAT TT=34.111 CHECKS=181257000 NODES=128365	SAT TT=32.002 CHECKS=180737000 NODES=128483	SAT TT=45.423	SAT TT=803.378 CHECKS=217282000	SAT TT=439.541 CHECKS=96908600	SAT TT=95.395 ASSIGNMENTS=121544	SAT TT=101.942 ASSIGNMENTS=121544	SAT TT=219.225 CHECKS=72173200 NODES=656001	SAT TT=11.489 CHECKS=82511100 NODES=258089	? (TO) TT=1800.03	SAT TT=48.193 ASSIGNMENTS=355220 CHECKS=179501000	SAT TT=39.556 ASSIGNMENTS=128365 CHECKS=181257000	SAT TT=292.29	SAT TT=698.385	No data	SAT TT=44.1 ASSIGNMENTS=354039 CHECKS=178786000	SAT TT=49.691 ASSIGNMENTS=430235 CHECKS=216829000	SAT TT=1085.41	SAT TT=42.942 ASSIGNMENTS=361111 CHECKS=181395000	SAT TT=43.634 ASSIGNMENTS=355220 CHECKS=179501000	? (TO) TT=1800.2	SAT TT=559.245 ASSIGNMENTS=436501 CHECKS=746116000	SAT TT=415.567	SAT TT=684.203
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-49_ext.xml	SAT TT=2.727	SAT TT=64.525 CHECKS=337963000 NODES=248994	SAT TT=72.965 CHECKS=384733000 NODES=281667	SAT TT=3.777	SAT TT=1447.18 CHECKS=433538000	SAT TT=149.868 CHECKS=32189900	SAT TT=10.456 ASSIGNMENTS=12307	SAT TT=11.339 ASSIGNMENTS=12307	SAT TT=57.832 CHECKS=18725600 NODES=168365	SAT TT=8.485 CHECKS=53471900 NODES=164255	? (TO) TT=1800.05	SAT TT=10.869 ASSIGNMENTS=26732 CHECKS=13288400	SAT TT=67.154 ASSIGNMENTS=248994 CHECKS=337963000	? (TO) TT=1800	? (TO) TT=1800.02	No data	SAT TT=3.091 ASSIGNMENTS=24682 CHECKS=12326200	SAT TT=2.727 ASSIGNMENTS=25137 CHECKS=11848300	SAT TT=112.498	SAT TT=3.044 ASSIGNMENTS=26730 CHECKS=13237000	SAT TT=3.04 ASSIGNMENTS=26732 CHECKS=13288400	? (TO) TT=1800.15	SAT TT=208.495 ASSIGNMENTS=93586 CHECKS=167814000	SAT TT=779.068	SAT TT=58.189
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-50_ext.xml	SAT TT=2.522	SAT TT=266.839 CHECKS=1542810000 NODES=1143930	SAT TT=282.252 CHECKS=1519570000 NODES=1121160	SAT TT=2.522	? (TO) TT=1800.02	SAT TT=1664.5 CHECKS=366205000	SAT TT=805.909 ASSIGNMENTS=1028690	SAT TT=838.41 ASSIGNMENTS=1028690	SAT TT=346.193 CHECKS=105625000 NODES=1010360	SAT TT=418.677 CHECKS=3132570000 NODES=9607250	? (TO) TT=1800.05	SAT TT=157.883 ASSIGNMENTS=1282050 CHECKS=658419000	SAT TT=275.592 ASSIGNMENTS=1143930 CHECKS=1542810000	? (TO) TT=1800.02	? (TO) TT=1800.06	No data	SAT TT=143.846 ASSIGNMENTS=1238390 CHECKS=636029000	SAT TT=11.256 ASSIGNMENTS=91760 CHECKS=45682500	? (TO) TT=1800.11	SAT TT=99.802 ASSIGNMENTS=851275 CHECKS=431767000	SAT TT=152.351 ASSIGNMENTS=1282050 CHECKS=658419000	? (TO) TT=1800.16	SAT TT=1061.32 ASSIGNMENTS=828230 CHECKS=1377490000	SAT TT=730.415	? (TO) TT=1800.07
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-6_ext.xml	SAT TT=3.652	SAT TT=34.509 CHECKS=202743000 NODES=134223	SAT TT=27.328 CHECKS=147131000 NODES=96639	SAT TT=17.572	? (TO) TT=1800.07	SAT TT=1412.21 CHECKS=333073000	SAT TT=116.03 ASSIGNMENTS=139103	SAT TT=114.249 ASSIGNMENTS=139103	SAT TT=130.219 CHECKS=43985300 NODES=378105	SAT TT=3.652 CHECKS=20113500 NODES=64441	? (TO) TT=1800.1	SAT TT=36.504 ASSIGNMENTS=219918 CHECKS=114636000	SAT TT=41.882 ASSIGNMENTS=134223 CHECKS=202743000	? (TO) TT=1800.06	SAT TT=680.515	No data	SAT TT=29.546 ASSIGNMENTS=227762 CHECKS=118854000	SAT TT=42.766 ASSIGNMENTS=322088 CHECKS=168914000	SAT TT=307.531	SAT TT=37.678 ASSIGNMENTS=286323 CHECKS=149686000	SAT TT=26.613 ASSIGNMENTS=219918 CHECKS=114636000	SAT TT=439.539	SAT TT=302.528 ASSIGNMENTS=274261 CHECKS=510173000	SAT TT=1033.88	SAT TT=32.288
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-7_ext.xml	SAT TT=10.441	SAT TT=15.979 CHECKS=78452400 NODES=60331	SAT TT=24.706 CHECKS=125463000 NODES=96715	SAT TT=96.255	SAT TT=1389.59 CHECKS=382281000	? (TO) TT=1800.06	SAT TT=316.132 ASSIGNMENTS=400563	SAT TT=317.465 ASSIGNMENTS=400563	SAT TT=179.968 CHECKS=53901100 NODES=496611	SAT TT=13.676 CHECKS=90881100 NODES=289476	? (TO) TT=1800.04	SAT TT=110.374 ASSIGNMENTS=832174 CHECKS=415395000	SAT TT=22.903 ASSIGNMENTS=60331 CHECKS=78452400	? (TO) TT=1800.09	? (TO) TT=1800.03	No data	SAT TT=10.471 ASSIGNMENTS=86327 CHECKS=42462700	SAT TT=10.441 ASSIGNMENTS=87148 CHECKS=42254400	SAT TT=350.258	SAT TT=33.271 ASSIGNMENTS=268835 CHECKS=133530000	SAT TT=106.609 ASSIGNMENTS=832174 CHECKS=415395000	? (TO) TT=1800.16	SAT TT=1053.69 ASSIGNMENTS=799360 CHECKS=1301740000	? (TO) TT=1800.06	SAT TT=1062.08
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-8_ext.xml	SAT TT=6.669	SAT TT=79.698 CHECKS=450018000 NODES=287009	SAT TT=84.474 CHECKS=471067000 NODES=299430	SAT TT=20.504	SAT TT=528.157 CHECKS=132372000	SAT TT=279.613 CHECKS=56463700	SAT TT=49.434 ASSIGNMENTS=49890	SAT TT=45.982 ASSIGNMENTS=49890	SAT TT=63.784 CHECKS=20747700 NODES=176953	SAT TT=16.594 CHECKS=122544000 NODES=381471	? (TO) TT=1800	SAT TT=13.585 ASSIGNMENTS=49057 CHECKS=26140500	SAT TT=81.44 ASSIGNMENTS=287009 CHECKS=450018000	SAT TT=623.722	SAT TT=1069.08	No data	SAT TT=23.187 ASSIGNMENTS=173702 CHECKS=93003800	SAT TT=13.053 ASSIGNMENTS=105777 CHECKS=56239500	SAT TT=181.596	SAT TT=13.011 ASSIGNMENTS=95388 CHECKS=50727600	SAT TT=6.669 ASSIGNMENTS=49057 CHECKS=26140500	SAT TT=531.048	SAT TT=116.781 ASSIGNMENTS=32773 CHECKS=62278100	SAT TT=341.871	SAT TT=285.02
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-10_ext.xml	SAT TT=28.202	SAT TT=69.028 CHECKS=364894000 NODES=276758	SAT TT=68.909 CHECKS=363721000 NODES=274769	SAT TT=135.418	? (TO) TT=1800.02	SAT TT=1640.55 CHECKS=331296000	SAT TT=285.145 ASSIGNMENTS=347458	SAT TT=292.405 ASSIGNMENTS=347458	SAT TT=178.039 CHECKS=51072200 NODES=467696	SAT TT=28.202 CHECKS=210717000 NODES=652673	? (TO) TT=1800.02	SAT TT=97.421 ASSIGNMENTS=713151 CHECKS=368278000	SAT TT=71.141 ASSIGNMENTS=276758 CHECKS=364894000	SAT TT=276.09	SAT TT=286.809	No data	SAT TT=68.867 ASSIGNMENTS=556038 CHECKS=283010000	SAT TT=68.424 ASSIGNMENTS=557184 CHECKS=282784000	? (TO) TT=1800.07	SAT TT=68.353 ASSIGNMENTS=545002 CHECKS=277779000	SAT TT=83.94 ASSIGNMENTS=713151 CHECKS=368278000	SAT TT=1510.92	SAT TT=1265.07 ASSIGNMENTS=1206190 CHECKS=2031530000	SAT TT=194.285	SAT TT=1626.45
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-11_ext.xml	UNSAT TT=104.571	UNSAT TT=358.316 CHECKS=1946750000 NODES=1374860	UNSAT TT=336.795 CHECKS=1957920000 NODES=1379980	UNSAT TT=170.921	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=492.315 ASSIGNMENTS=594198	UNSAT TT=485.189 ASSIGNMENTS=594198	UNSAT TT=386.367 CHECKS=119229000 NODES=1084310	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=119.161 ASSIGNMENTS=868010 CHECKS=446714000	UNSAT TT=335.462 ASSIGNMENTS=1374860 CHECKS=1946750000	? (TO) TT=1800.08	? (TO) TT=1800.03	No data	UNSAT TT=115.569 ASSIGNMENTS=973805 CHECKS=497934000	UNSAT TT=115.448 ASSIGNMENTS=905233 CHECKS=464851000	? (TO) TT=1800.04	UNSAT TT=104.571 ASSIGNMENTS=876258 CHECKS=450591000	UNSAT TT=109.238 ASSIGNMENTS=868010 CHECKS=446714000	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.13
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-13_ext.xml	UNSAT TT=27.619	UNSAT TT=138.109 CHECKS=768417000 NODES=501800	UNSAT TT=140.051 CHECKS=790862000 NODES=514776	UNSAT TT=48.975	? (TO) TT=1800.04	? (TO) TT=1800.11	UNSAT TT=116.039 ASSIGNMENTS=134012	UNSAT TT=126.27 ASSIGNMENTS=134012	UNSAT TT=85.347 CHECKS=28846000 NODES=242672	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=39.87 ASSIGNMENTS=237191 CHECKS=128647000	UNSAT TT=133.468 ASSIGNMENTS=501800 CHECKS=768417000	? (TO) TT=1800.02	? (TO) TT=1800.03	No data	UNSAT TT=30.647 ASSIGNMENTS=227826 CHECKS=122972000	UNSAT TT=27.619 ASSIGNMENTS=222006 CHECKS=118911000	UNSAT TT=648.706	UNSAT TT=29.82 ASSIGNMENTS=220528 CHECKS=119027000	UNSAT TT=31.545 ASSIGNMENTS=237191 CHECKS=128647000	? (TO) TT=1800.14	UNSAT TT=604.761 ASSIGNMENTS=412849 CHECKS=813209000	UNSAT TT=469.602	UNSAT TT=1377.33
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-15_ext.xml	SAT TT=2.342	SAT TT=30.274 CHECKS=169255000 NODES=107442	SAT TT=26.301 CHECKS=158617000 NODES=102361	SAT TT=2.342	? (TO) TT=1800.09	SAT TT=301.586 CHECKS=62924800	SAT TT=60.219 ASSIGNMENTS=64944	SAT TT=60.972 ASSIGNMENTS=64944	SAT TT=37.921 CHECKS=13629400 NODES=106775	SAT TT=20.378 CHECKS=138851000 NODES=439135	? (TO) TT=1800.07	SAT TT=23.201 ASSIGNMENTS=114729 CHECKS=61629100	SAT TT=35.188 ASSIGNMENTS=107442 CHECKS=169255000	SAT TT=85.066	SAT TT=766.207	No data	SAT TT=7.241 ASSIGNMENTS=52911 CHECKS=28605500	SAT TT=13.69 ASSIGNMENTS=111537 CHECKS=59179800	SAT TT=134.819	SAT TT=15.526 ASSIGNMENTS=114489 CHECKS=61204400	SAT TT=15.699 ASSIGNMENTS=114729 CHECKS=61629100	SAT TT=1343.23	SAT TT=87.79 ASSIGNMENTS=57383 CHECKS=126015000	SAT TT=4.433	SAT TT=6.382
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-16_ext.xml	UNSAT TT=99.686	UNSAT TT=224.628 CHECKS=1314660000 NODES=1002760	UNSAT TT=227.358 CHECKS=1306120000 NODES=997863	UNSAT TT=131.696	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=372.422 ASSIGNMENTS=503703	UNSAT TT=400.221 ASSIGNMENTS=503703	UNSAT TT=307.555 CHECKS=92418000 NODES=865385	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=110.213 ASSIGNMENTS=818408 CHECKS=414846000	UNSAT TT=232.156 ASSIGNMENTS=1002760 CHECKS=1314660000	? (TO) TT=1800.02	? (TO) TT=1800.08	No data	UNSAT TT=100.91 ASSIGNMENTS=820446 CHECKS=415822000	UNSAT TT=99.686 ASSIGNMENTS=818978 CHECKS=414396000	? (TO) TT=1800.02	UNSAT TT=104.873 ASSIGNMENTS=829731 CHECKS=422683000	UNSAT TT=102.707 ASSIGNMENTS=818408 CHECKS=414846000	? (TO) TT=1800.17	UNSAT TT=1120.61 ASSIGNMENTS=1095710 CHECKS=1824950000	? (TO) TT=1800.11	? (TO) TT=1800.11
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-19_ext.xml	UNSAT TT=43.001	UNSAT TT=126.294 CHECKS=735696000 NODES=510919	UNSAT TT=125.754 CHECKS=729967000 NODES=506283	UNSAT TT=109.154	? (TO) TT=1800.09	UNSAT TT=786.588 CHECKS=165167000	UNSAT TT=179.661 ASSIGNMENTS=211865	UNSAT TT=194.144 ASSIGNMENTS=211865	UNSAT TT=143.757 CHECKS=48902200 NODES=418900	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=58.447 ASSIGNMENTS=391312 CHECKS=203760000	UNSAT TT=134.054 ASSIGNMENTS=510919 CHECKS=735696000	? (TO) TT=1800.03	? (TO) TT=1800.06	No data	UNSAT TT=51.348 ASSIGNMENTS=399906 CHECKS=207899000	UNSAT TT=43.001 ASSIGNMENTS=363298 CHECKS=187928000	UNSAT TT=1270.51	UNSAT TT=47.255 ASSIGNMENTS=364689 CHECKS=189601000	UNSAT TT=51.201 ASSIGNMENTS=391312 CHECKS=203760000	? (TO) TT=1800.13	UNSAT TT=675.025 ASSIGNMENTS=586166 CHECKS=1102780000	UNSAT TT=899.862	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-21_ext.xml	SAT TT=15.481	SAT TT=206.115 CHECKS=1120530000 NODES=821150	SAT TT=191.297 CHECKS=1119030000 NODES=820530	SAT TT=113.192	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=226.526 ASSIGNMENTS=279457	SAT TT=222.905 ASSIGNMENTS=279457	SAT TT=109.735 CHECKS=33419000 NODES=306080	SAT TT=44.257 CHECKS=331528000 NODES=1057260	? (TO) TT=1800.03	SAT TT=22.715 ASSIGNMENTS=137343 CHECKS=67687600	SAT TT=199.589 ASSIGNMENTS=821150 CHECKS=1120530000	? (TO) TT=1800.08	? (TO) TT=1800.05	No data	SAT TT=17.138 ASSIGNMENTS=138497 CHECKS=68301300	SAT TT=56.114 ASSIGNMENTS=454319 CHECKS=226718000	SAT TT=1041.64	SAT TT=36.177 ASSIGNMENTS=289290 CHECKS=143070000	SAT TT=15.481 ASSIGNMENTS=137343 CHECKS=67687600	? (TO) TT=1800.12	SAT TT=30.05 ASSIGNMENTS=21079 CHECKS=33645500	SAT TT=122.853	SAT TT=233.456
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-23_ext.xml	SAT TT=8.544	SAT TT=110.511 CHECKS=612481000 NODES=422681	SAT TT=112.046 CHECKS=607753000 NODES=419473	SAT TT=26.14	SAT TT=669.139 CHECKS=195389000	SAT TT=1415.52 CHECKS=364294000	SAT TT=176.465 ASSIGNMENTS=188229	SAT TT=164.443 ASSIGNMENTS=188229	SAT TT=83.469 CHECKS=26351600 NODES=221603	SAT TT=347.882 CHECKS=2655550000 NODES=8456400	? (TO) TT=1800.03	SAT TT=19.662 ASSIGNMENTS=102133 CHECKS=54478800	SAT TT=111.287 ASSIGNMENTS=422681 CHECKS=612481000	SAT TT=8.544	SAT TT=573.67	No data	SAT TT=26.012 ASSIGNMENTS=198337 CHECKS=104047000	SAT TT=23.904 ASSIGNMENTS=183041 CHECKS=95836500	SAT TT=688.662	SAT TT=22.051 ASSIGNMENTS=178867 CHECKS=94465800	SAT TT=13.547 ASSIGNMENTS=102133 CHECKS=54478800	SAT TT=47.654	SAT TT=334.719 ASSIGNMENTS=273356 CHECKS=514280000	SAT TT=607.605	SAT TT=186.015
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-24_ext.xml	UNSAT TT=53.868	UNSAT TT=140.245 CHECKS=760093000 NODES=537383	UNSAT TT=138.119 CHECKS=740737000 NODES=522900	UNSAT TT=152.715	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=277.333 ASSIGNMENTS=303800	UNSAT TT=273.978 ASSIGNMENTS=303800	UNSAT TT=201.479 CHECKS=60180600 NODES=525053	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=61.072 ASSIGNMENTS=447356 CHECKS=236430000	UNSAT TT=138.21 ASSIGNMENTS=537383 CHECKS=760093000	? (TO) TT=1800.01	? (TO) TT=1800.06	No data	UNSAT TT=64.211 ASSIGNMENTS=491123 CHECKS=261250000	UNSAT TT=57.387 ASSIGNMENTS=446119 CHECKS=234743000	UNSAT TT=1388.4	UNSAT TT=53.868 ASSIGNMENTS=442748 CHECKS=233632000	UNSAT TT=57.717 ASSIGNMENTS=447356 CHECKS=236430000	? (TO) TT=1800.16	UNSAT TT=1012.63 ASSIGNMENTS=657348 CHECKS=1239070000	UNSAT TT=1608.04	? (TO) TT=1800.06
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-25_ext.xml	UNSAT TT=53.415	UNSAT TT=203.88 CHECKS=1138680000 NODES=764698	UNSAT TT=205.487 CHECKS=1145510000 NODES=769644	UNSAT TT=118.915	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=211.132 ASSIGNMENTS=258629	UNSAT TT=228.985 ASSIGNMENTS=258629	UNSAT TT=181.807 CHECKS=58387400 NODES=498075	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=67.071 ASSIGNMENTS=440854 CHECKS=236197000	UNSAT TT=197.187 ASSIGNMENTS=764698 CHECKS=1138680000	? (TO) TT=1800.07	? (TO) TT=1800.03	No data	UNSAT TT=53.415 ASSIGNMENTS=427107 CHECKS=229072000	UNSAT TT=56.959 ASSIGNMENTS=428140 CHECKS=228003000	UNSAT TT=1366.28	UNSAT TT=55.731 ASSIGNMENTS=449335 CHECKS=237713000	UNSAT TT=58.39 ASSIGNMENTS=440854 CHECKS=236197000	? (TO) TT=1800.14	UNSAT TT=689.401 ASSIGNMENTS=585184 CHECKS=1113690000	UNSAT TT=1012.34	? (TO) TT=1800.14
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-28_ext.xml	UNSAT TT=46.747	UNSAT TT=329.119 CHECKS=1840180000 NODES=1241810	UNSAT TT=319.799 CHECKS=1818330000 NODES=1230180	UNSAT TT=60.374	UNSAT TT=1667.09 CHECKS=491474000	? (TO) TT=1800.02	UNSAT TT=197.35 ASSIGNMENTS=241267	UNSAT TT=205.26 ASSIGNMENTS=241267	UNSAT TT=149.772 CHECKS=47600700 NODES=407725	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=53.909 ASSIGNMENTS=390210 CHECKS=204598000	UNSAT TT=336.891 ASSIGNMENTS=1241810 CHECKS=1840180000	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	UNSAT TT=50.772 ASSIGNMENTS=392109 CHECKS=205698000	UNSAT TT=50.012 ASSIGNMENTS=388048 CHECKS=203128000	UNSAT TT=1470.76	UNSAT TT=51.717 ASSIGNMENTS=396311 CHECKS=206639000	UNSAT TT=46.747 ASSIGNMENTS=390210 CHECKS=204598000	? (TO) TT=1800.16	UNSAT TT=706.624 ASSIGNMENTS=638200 CHECKS=1189110000	UNSAT TT=1131.9	? (TO) TT=1800.11
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-29_ext.xml	UNSAT TT=18.324	UNSAT TT=42.578 CHECKS=234743000 NODES=156589	UNSAT TT=42.481 CHECKS=236131000 NODES=157630	UNSAT TT=44.918	UNSAT TT=1057.54 CHECKS=268851000	UNSAT TT=369.463 CHECKS=74603200	UNSAT TT=72.082 ASSIGNMENTS=79731	UNSAT TT=75.891 ASSIGNMENTS=79731	UNSAT TT=56.71 CHECKS=19304700 NODES=154409	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=26.113 ASSIGNMENTS=137878 CHECKS=73745500	UNSAT TT=46.845 ASSIGNMENTS=156589 CHECKS=234743000	UNSAT TT=1416.62	UNSAT TT=945.147	No data	UNSAT TT=18.956 ASSIGNMENTS=141065 CHECKS=76048000	UNSAT TT=19.529 ASSIGNMENTS=147148 CHECKS=78504800	UNSAT TT=472.159	UNSAT TT=19.243 ASSIGNMENTS=142862 CHECKS=76495100	UNSAT TT=18.324 ASSIGNMENTS=137878 CHECKS=73745500	? (TO) TT=1800.12	UNSAT TT=316.486 ASSIGNMENTS=206712 CHECKS=428672000	UNSAT TT=398.478	UNSAT TT=832.773
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-2_ext.xml	UNSAT TT=87.705	UNSAT TT=216.601 CHECKS=1221890000 NODES=871538	UNSAT TT=225.284 CHECKS=1227120000 NODES=874571	UNSAT TT=112.184	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=385.617 ASSIGNMENTS=486744	UNSAT TT=420.058 ASSIGNMENTS=486744	UNSAT TT=264.354 CHECKS=89984100 NODES=782251	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=100.157 ASSIGNMENTS=728500 CHECKS=375463000	UNSAT TT=212.49 ASSIGNMENTS=871538 CHECKS=1221890000	? (TO) TT=1800.01	? (TO) TT=1800	No data	UNSAT TT=93.115 ASSIGNMENTS=728648 CHECKS=375642000	UNSAT TT=93.493 ASSIGNMENTS=736590 CHECKS=380314000	? (TO) TT=1800.12	UNSAT TT=87.705 ASSIGNMENTS=737286 CHECKS=381430000	UNSAT TT=87.719 ASSIGNMENTS=728500 CHECKS=375463000	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.13
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-30_ext.xml	UNSAT TT=116.132	UNSAT TT=558.705 CHECKS=3301530000 NODES=2276680	UNSAT TT=578.806 CHECKS=3415650000 NODES=2353330	UNSAT TT=207.431	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=574.557 ASSIGNMENTS=691962	UNSAT TT=536.196 ASSIGNMENTS=691962	UNSAT TT=428.092 CHECKS=132678000 NODES=1176460	? (TO) TT=1800	? (TO) TT=1800.09	UNSAT TT=138.393 ASSIGNMENTS=1030830 CHECKS=530982000	UNSAT TT=534.906 ASSIGNMENTS=1030830 CHECKS=530982000	? (TO) TT=1800.03	? (TO) TT=1800.04	No data	UNSAT TT=137.296 ASSIGNMENTS=1090820 CHECKS=561084000	UNSAT TT=125.95 ASSIGNMENTS=996864 CHECKS=512723000	? (TO) TT=1800.11	UNSAT TT=116.132 ASSIGNMENTS=956225 CHECKS=489579000	UNSAT TT=130.914 ASSIGNMENTS=1030830 CHECKS=530982000	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.08
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-31_ext.xml	SAT TT=1.208	SAT TT=71.96 CHECKS=422272000 NODES=293133	SAT TT=75.728 CHECKS=415903000 NODES=289318	SAT TT=1.208	SAT TT=667.337 CHECKS=187444000	SAT TT=148.511 CHECKS=31962300	SAT TT=46.427 ASSIGNMENTS=55787	SAT TT=45.707 ASSIGNMENTS=55787	SAT TT=11.482 CHECKS=3735960 NODES=32691	SAT TT=1.584 CHECKS=6616610 NODES=21403	? (TO) TT=1800.07	SAT TT=19.977 ASSIGNMENTS=99024 CHECKS=49844100	SAT TT=78.464 ASSIGNMENTS=293133 CHECKS=422272000	SAT TT=236.174	SAT TT=257.71	No data	SAT TT=24.721 ASSIGNMENTS=205274 CHECKS=104987000	SAT TT=3.931 ASSIGNMENTS=32264 CHECKS=15816500	SAT TT=272.901	SAT TT=3.757 ASSIGNMENTS=29063 CHECKS=14709400	SAT TT=12.281 ASSIGNMENTS=99024 CHECKS=49844100	? (TO) TT=1800.08	SAT TT=287.401 ASSIGNMENTS=266612 CHECKS=475770000	SAT TT=65.331	SAT TT=34.406
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-32_ext.xml	UNSAT TT=69.694	UNSAT TT=272.218 CHECKS=1497120000 NODES=1066320	UNSAT TT=270.402 CHECKS=1497250000 NODES=1066530	UNSAT TT=182.803	? (TO) TT=1800.07	UNSAT TT=1599.47 CHECKS=344219000	UNSAT TT=287.807 ASSIGNMENTS=379148	UNSAT TT=297.746 ASSIGNMENTS=379148	UNSAT TT=332.115 CHECKS=108564000 NODES=933721	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=83.66 ASSIGNMENTS=588225 CHECKS=302278000	UNSAT TT=77.337 ASSIGNMENTS=588225 CHECKS=302278000	? (TO) TT=1800.09	? (TO) TT=1800.02	No data	UNSAT TT=69.694 ASSIGNMENTS=590537 CHECKS=303223000	UNSAT TT=77.415 ASSIGNMENTS=609524 CHECKS=312243000	? (TO) TT=1800.07	UNSAT TT=88.592 ASSIGNMENTS=687413 CHECKS=356005000	UNSAT TT=74.526 ASSIGNMENTS=588225 CHECKS=302278000	? (TO) TT=1800.14	UNSAT TT=1173.61 ASSIGNMENTS=1050180 CHECKS=1921540000	? (TO) TT=1800.11	? (TO) TT=1800.12
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-33_ext.xml	UNSAT TT=175.257	UNSAT TT=861.173 CHECKS=4635010000 NODES=3407270	UNSAT TT=794.987 CHECKS=4632330000 NODES=3406010	UNSAT TT=208.595	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=844.08 ASSIGNMENTS=1011330	UNSAT TT=767.953 ASSIGNMENTS=1011330	UNSAT TT=648.531 CHECKS=190411000 NODES=1771030	? (TO) TT=1800	? (TO) TT=1800	UNSAT TT=197.858 ASSIGNMENTS=1524370 CHECKS=768333000	UNSAT TT=596.025 ASSIGNMENTS=1524370 CHECKS=768333000	? (TO) TT=1800.02	? (TO) TT=1800.03	No data	UNSAT TT=176.87 ASSIGNMENTS=1531150 CHECKS=771871000	UNSAT TT=199.956 ASSIGNMENTS=1605240 CHECKS=811978000	? (TO) TT=1800.11	UNSAT TT=193.024 ASSIGNMENTS=1535300 CHECKS=779664000	UNSAT TT=175.257 ASSIGNMENTS=1524370 CHECKS=768333000	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-35_ext.xml	SAT TT=10.911	SAT TT=143.318 CHECKS=764937000 NODES=582454	SAT TT=143.216 CHECKS=768106000 NODES=584693	SAT TT=289.731	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=105.413 ASSIGNMENTS=142938	SAT TT=115.303 ASSIGNMENTS=142938	SAT TT=389.881 CHECKS=114830000 NODES=1079660	SAT TT=27.622 CHECKS=189040000 NODES=583466	? (TO) TT=1800.09	SAT TT=81.757 ASSIGNMENTS=597435 CHECKS=304648000	SAT TT=140.492 ASSIGNMENTS=582454 CHECKS=764937000	? (TO) TT=1800.1	? (TO) TT=1800.1	No data	SAT TT=51.54 ASSIGNMENTS=450228 CHECKS=227825000	SAT TT=126.02 ASSIGNMENTS=1024190 CHECKS=521673000	? (TO) TT=1800.06	SAT TT=52.121 ASSIGNMENTS=453224 CHECKS=228849000	SAT TT=74.584 ASSIGNMENTS=597435 CHECKS=304648000	? (TO) TT=1800.07	SAT TT=1749.77 ASSIGNMENTS=993786 CHECKS=1716950000	? (TO) TT=1800.08	SAT TT=10.911
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-36_ext.xml	SAT TT=10.221	SAT TT=201.537 CHECKS=1086150000 NODES=782463	SAT TT=178.523 CHECKS=1037890000 NODES=754564	SAT TT=16.299	SAT TT=1676.08 CHECKS=491545000	? (TO) TT=1800.02	SAT TT=247.759 ASSIGNMENTS=312940	SAT TT=248.953 ASSIGNMENTS=312940	SAT TT=109.573 CHECKS=33378800 NODES=301932	SAT TT=28.126 CHECKS=193437000 NODES=598790	? (TO) TT=1800.03	SAT TT=113.463 ASSIGNMENTS=837075 CHECKS=432774000	SAT TT=193.416 ASSIGNMENTS=782463 CHECKS=1086150000	? (TO) TT=1800.06	SAT TT=544.623	No data	SAT TT=99.643 ASSIGNMENTS=803317 CHECKS=416893000	SAT TT=94.494 ASSIGNMENTS=806993 CHECKS=418006000	? (TO) TT=1800.08	SAT TT=10.221 ASSIGNMENTS=88615 CHECKS=43716800	SAT TT=106.699 ASSIGNMENTS=837075 CHECKS=432774000	SAT TT=744.649	SAT TT=996.022 ASSIGNMENTS=750462 CHECKS=1315180000	? (TO) TT=1800.1	? (TO) TT=1800.1
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-39_ext.xml	SAT TT=2.212	SAT TT=109.54 CHECKS=621663000 NODES=387323	SAT TT=109.578 CHECKS=621980000 NODES=387581	SAT TT=11.452	SAT TT=376.023 CHECKS=93482500	SAT TT=157.611 CHECKS=33164600	SAT TT=48.788 ASSIGNMENTS=49000	SAT TT=48.191 ASSIGNMENTS=49000	SAT TT=23.585 CHECKS=8219540 NODES=64957	SAT TT=42.488 CHECKS=321196000 NODES=973624	? (TO) TT=1800.07	SAT TT=20.662 ASSIGNMENTS=91217 CHECKS=50763000	SAT TT=109.772 ASSIGNMENTS=387323 CHECKS=621663000	SAT TT=82.48	SAT TT=173.025	No data	SAT TT=12.52 ASSIGNMENTS=90466 CHECKS=50380900	SAT TT=5.657 ASSIGNMENTS=45098 CHECKS=24700200	SAT TT=335.15	SAT TT=12.854 ASSIGNMENTS=92546 CHECKS=51358800	SAT TT=12.497 ASSIGNMENTS=91217 CHECKS=50763000	SAT TT=560.15	SAT TT=96.54 ASSIGNMENTS=71398 CHECKS=161091000	SAT TT=10.285	SAT TT=2.212
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-41_ext.xml	UNSAT TT=40.626	UNSAT TT=436.765 CHECKS=2654060000 NODES=1700740	UNSAT TT=442.951 CHECKS=2656100000 NODES=1703180	UNSAT TT=57.094	? (TO) TT=1800.02	UNSAT TT=733.814 CHECKS=156934000	UNSAT TT=169.68 ASSIGNMENTS=184459	UNSAT TT=166.228 ASSIGNMENTS=184459	UNSAT TT=133.085 CHECKS=43252500 NODES=365570	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=52.015 ASSIGNMENTS=333371 CHECKS=181085000	UNSAT TT=444.73 ASSIGNMENTS=333371 CHECKS=181085000	? (TO) TT=1800.06	? (TO) TT=1800.07	No data	UNSAT TT=42.537 ASSIGNMENTS=315252 CHECKS=170078000	UNSAT TT=43.808 ASSIGNMENTS=321785 CHECKS=175248000	UNSAT TT=1300.08	UNSAT TT=40.626 ASSIGNMENTS=324931 CHECKS=177530000	UNSAT TT=44.286 ASSIGNMENTS=333371 CHECKS=181085000	? (TO) TT=1800.15	UNSAT TT=763.889 ASSIGNMENTS=639098 CHECKS=1322820000	UNSAT TT=619.154	? (TO) TT=1800.11
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-43_ext.xml	UNSAT TT=133.496	UNSAT TT=322.912 CHECKS=1771390000 NODES=1272930	UNSAT TT=306.211 CHECKS=1759810000 NODES=1265280	UNSAT TT=247.638	? (TO) TT=1800.1	? (TO) TT=1800.11	UNSAT TT=446.486 ASSIGNMENTS=573516	UNSAT TT=449.15 ASSIGNMENTS=573516	UNSAT TT=498.069 CHECKS=148577000 NODES=1361080	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=150.157 ASSIGNMENTS=1128720 CHECKS=579402000	UNSAT TT=307.115 ASSIGNMENTS=1272930 CHECKS=1771390000	? (TO) TT=1800	? (TO) TT=1800.01	No data	UNSAT TT=140.535 ASSIGNMENTS=1100590 CHECKS=562597000	UNSAT TT=133.496 ASSIGNMENTS=1118490 CHECKS=573200000	? (TO) TT=1800.07	UNSAT TT=135.477 ASSIGNMENTS=1145620 CHECKS=591854000	UNSAT TT=141.483 ASSIGNMENTS=1128720 CHECKS=579402000	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-48_ext.xml	UNSAT TT=27.72	UNSAT TT=101.835 CHECKS=560349000 NODES=375736	UNSAT TT=101.232 CHECKS=558021000 NODES=374569	UNSAT TT=42.603	? (TO) TT=1800.1	UNSAT TT=564.008 CHECKS=114524000	UNSAT TT=100.341 ASSIGNMENTS=116358	UNSAT TT=91.775 ASSIGNMENTS=116358	UNSAT TT=97.65 CHECKS=31774400 NODES=258073	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=36.176 ASSIGNMENTS=219132 CHECKS=116830000	UNSAT TT=105.415 ASSIGNMENTS=375736 CHECKS=560349000	? (TO) TT=1800.02	UNSAT TT=1748.22	No data	UNSAT TT=30.355 ASSIGNMENTS=229269 CHECKS=122945000	UNSAT TT=27.72 ASSIGNMENTS=212127 CHECKS=112116000	UNSAT TT=599.42	UNSAT TT=29.863 ASSIGNMENTS=223642 CHECKS=119459000	UNSAT TT=29.522 ASSIGNMENTS=219132 CHECKS=116830000	? (TO) TT=1800.12	UNSAT TT=635.448 ASSIGNMENTS=443929 CHECKS=866901000	UNSAT TT=321.489	UNSAT TT=1093.04
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-49_ext.xml	SAT TT=22.83	SAT TT=484.633 CHECKS=2602500000 NODES=1827620	SAT TT=449.963 CHECKS=2607160000 NODES=1827600	SAT TT=61.172	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=199.437 ASSIGNMENTS=270962	SAT TT=212.559 ASSIGNMENTS=270962	SAT TT=82.312 CHECKS=25816900 NODES=240030	SAT TT=521.268 CHECKS=4018360000 NODES=12308900	? (TO) TT=1800.03	SAT TT=28.79 ASSIGNMENTS=185571 CHECKS=94084500	SAT TT=425.179 ASSIGNMENTS=185571 CHECKS=94084500	? (TO) TT=1800.06	? (TO) TT=1800.04	No data	SAT TT=79.388 ASSIGNMENTS=635279 CHECKS=324781000	SAT TT=79.227 ASSIGNMENTS=635102 CHECKS=324030000	SAT TT=612.509	SAT TT=79.99 ASSIGNMENTS=637152 CHECKS=325593000	SAT TT=22.83 ASSIGNMENTS=185571 CHECKS=94084500	? (TO) TT=1800.17	SAT TT=1065.15 ASSIGNMENTS=911803 CHECKS=1575110000	SAT TT=819.584	SAT TT=1022.94
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-50_ext.xml	SAT TT=7.312	SAT TT=888.714 CHECKS=5163200000 NODES=3808050	SAT TT=956.667 CHECKS=5150720000 NODES=3797950	SAT TT=71.21	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=871.58 ASSIGNMENTS=1068690	SAT TT=836.456 ASSIGNMENTS=1068690	SAT TT=436.884 CHECKS=128141000 NODES=1226630	SAT TT=71.164 CHECKS=496490000 NODES=1526620	? (TO) TT=1800	SAT TT=148.417 ASSIGNMENTS=1104030 CHECKS=565880000	SAT TT=543.421 ASSIGNMENTS=1104030 CHECKS=565880000	? (TO) TT=1800.02	? (TO) TT=1800	No data	SAT TT=147.377 ASSIGNMENTS=1254260 CHECKS=643813000	SAT TT=72.657 ASSIGNMENTS=578125 CHECKS=295126000	? (TO) TT=1800.09	SAT TT=7.312 ASSIGNMENTS=58222 CHECKS=29239000	SAT TT=139.327 ASSIGNMENTS=1104030 CHECKS=565880000	? (TO) TT=1800.16	SAT TT=388.084 ASSIGNMENTS=121201 CHECKS=214940000	SAT TT=1071.79	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-10_ext.xml	SAT TT=98.581	? (TO) TT=1800.11	SAT TT=1597.81 CHECKS=9438360000 NODES=5625970	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.01	SAT TT=98.581 CHECKS=699321000 NODES=1650830	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	No data	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=851.779 ASSIGNMENTS=5701800 CHECKS=3398380000	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.06
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-14_ext.xml	SAT TT=200.759	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800	SAT TT=200.759 CHECKS=1552980000 NODES=3625110	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	No data	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.12
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-15_ext.xml	SAT TT=22.577	SAT TT=154.336 CHECKS=928995000 NODES=559115	SAT TT=224.013 CHECKS=1264170000 NODES=762696	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=159.413 CHECKS=1227630000 NODES=2885800	? (TO) TT=1800.08	SAT TT=159.919 ASSIGNMENTS=559115 CHECKS=928995000	SAT TT=160.608 ASSIGNMENTS=559115 CHECKS=928995000	? (TO) TT=1800.08	? (TO) TT=1800.09	No data	SAT TT=1116.28 ASSIGNMENTS=7319120 CHECKS=370393000	SAT TT=1192.84 ASSIGNMENTS=7300660 CHECKS=357800000	? (TO) TT=1800.1	SAT TT=22.577 ASSIGNMENTS=152327 CHECKS=92851800	SAT TT=1155.73 ASSIGNMENTS=7496360 CHECKS=488090000	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-17_ext.xml	SAT TT=200.667	SAT TT=210.961 CHECKS=1175350000 NODES=728272	SAT TT=200.906 CHECKS=1135320000 NODES=701559	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.12	SAT TT=276.869 CHECKS=71341200 NODES=544941	SAT TT=340.734 CHECKS=2713320000 NODES=6464880	? (TO) TT=1800.02	SAT TT=200.667 ASSIGNMENTS=728272 CHECKS=1175350000	SAT TT=200.816 ASSIGNMENTS=728272 CHECKS=1175350000	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	SAT TT=1784.06 ASSIGNMENTS=11150900 CHECKS=2722220000	SAT TT=1766.04 ASSIGNMENTS=11053600 CHECKS=2654150000	? (TO) TT=1800.11	SAT TT=390.599 ASSIGNMENTS=2484470 CHECKS=1524580000	SAT TT=1658.14 ASSIGNMENTS=10968000 CHECKS=2603940000	? (TO) TT=1800.13	SAT TT=1544.05 ASSIGNMENTS=812288 CHECKS=1681240000	? (TO) TT=1800.13	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-18_ext.xml	SAT TT=173.837	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=173.837 CHECKS=1259990000 NODES=2859210	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	No data	SAT TT=1795.37 ASSIGNMENTS=12275000 CHECKS=3267060000	SAT TT=333.819 ASSIGNMENTS=2191820 CHECKS=1353190000	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-1_ext.xml	SAT TT=37.306	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=37.306 CHECKS=262546000 NODES=621625	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.02	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=653.22 ASSIGNMENTS=4081480 CHECKS=2552980000	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-20_ext.xml	SAT TT=6.408	SAT TT=250.098 CHECKS=1487760000 NODES=846695	SAT TT=31.053 CHECKS=178398000 NODES=99390	SAT TT=493.989	SAT TT=919.788 CHECKS=186742000	? (TO) TT=1800.03	SAT TT=773.775 ASSIGNMENTS=739594	SAT TT=772.62 ASSIGNMENTS=739594	SAT TT=468.237 CHECKS=135434000 NODES=984092	SAT TT=139.718 CHECKS=1108330000 NODES=2674630	? (TO) TT=1800.02	SAT TT=254.595 ASSIGNMENTS=846695 CHECKS=1487760000	SAT TT=238.198 ASSIGNMENTS=846695 CHECKS=1487760000	? (TO) TT=1800.06	? (TO) TT=1800.09	No data	SAT TT=399.285 ASSIGNMENTS=2348420 CHECKS=1527270000	SAT TT=373.556 ASSIGNMENTS=2209080 CHECKS=1440260000	? (TO) TT=1800.04	SAT TT=6.408 ASSIGNMENTS=37539 CHECKS=23928900	SAT TT=352.853 ASSIGNMENTS=2242440 CHECKS=1463380000	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.1
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-22_ext.xml	SAT TT=209.235	SAT TT=1216.02 CHECKS=7489920000 NODES=4467590	SAT TT=618.702 CHECKS=3809160000 NODES=2299560	SAT TT=653.448	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=853.497 ASSIGNMENTS=859644	SAT TT=836.053 ASSIGNMENTS=859644	SAT TT=1017.83 CHECKS=282886000 NODES=2179520	SAT TT=582.538 CHECKS=4551390000 NODES=10716100	? (TO) TT=1800.08	SAT TT=597.419 ASSIGNMENTS=1283940 CHECKS=813954000	SAT TT=617.2 ASSIGNMENTS=1283940 CHECKS=813954000	? (TO) TT=1800.04	? (TO) TT=1800.07	No data	SAT TT=330.267 ASSIGNMENTS=2201490 CHECKS=1393890000	SAT TT=357.246 ASSIGNMENTS=2199500 CHECKS=1390480000	? (TO) TT=1800.12	SAT TT=356.783 ASSIGNMENTS=2193330 CHECKS=1386740000	SAT TT=209.235 ASSIGNMENTS=1283940 CHECKS=813954000	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.06
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-24_ext.xml	SAT TT=10.139	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=842.196 ASSIGNMENTS=803077	SAT TT=844.527 ASSIGNMENTS=803077	? (TO) TT=1800.01	SAT TT=10.139 CHECKS=64161000 NODES=149591	? (TO) TT=1800.1	SAT TT=697.378 ASSIGNMENTS=1719790 CHECKS=1110710000	SAT TT=711.726 ASSIGNMENTS=1719790 CHECKS=1110710000	? (TO) TT=1800.05	? (TO) TT=1800.05	No data	SAT TT=289.243 ASSIGNMENTS=1724640 CHECKS=1114250000	SAT TT=135.139 ASSIGNMENTS=809452 CHECKS=524530000	? (TO) TT=1800.12	SAT TT=797.381 ASSIGNMENTS=4781560 CHECKS=3067750000	SAT TT=281.804 ASSIGNMENTS=1719790 CHECKS=1110710000	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-25_ext.xml	SAT TT=408.171	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=408.171 CHECKS=3152150000 NODES=7361730	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	No data	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.07
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-29_ext.xml	SAT TT=140.391	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=565.531 CHECKS=149621000 NODES=1184740	SAT TT=140.391 CHECKS=1009950000 NODES=2388160	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	No data	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.11	SAT TT=1102.43 ASSIGNMENTS=7082680 CHECKS=68728200	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.12
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-30_ext.xml	SAT TT=43.68	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT TT=43.68 CHECKS=335257000 NODES=782987	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.07	No data	? (TO) TT=1800.02	SAT TT=1406.02 ASSIGNMENTS=9592680 CHECKS=1677110000	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-31_ext.xml	SAT TT=11.463	SAT TT=11.463 CHECKS=61828700 NODES=35983	SAT TT=26.02 CHECKS=158301000 NODES=90424	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=1173.78 ASSIGNMENTS=1185560	SAT TT=1262.26 ASSIGNMENTS=1185560	? (TO) TT=1800.02	SAT TT=48.42 CHECKS=371346000 NODES=859549	? (TO) TT=1800.02	SAT TT=17.749 ASSIGNMENTS=35983 CHECKS=61828700	SAT TT=18.261 ASSIGNMENTS=35983 CHECKS=61828700	? (TO) TT=1800.06	? (TO) TT=1800.08	No data	SAT TT=296.172 ASSIGNMENTS=1802580 CHECKS=1168620000	SAT TT=285.988 ASSIGNMENTS=1736640 CHECKS=1123890000	? (TO) TT=1800.04	SAT TT=298.756 ASSIGNMENTS=1807700 CHECKS=1171720000	SAT TT=285.072 ASSIGNMENTS=1735910 CHECKS=1125460000	? (TO) TT=1800.89	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.12
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-32_ext.xml	SAT TT=245.394	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.02	SAT TT=245.394 CHECKS=1738400000 NODES=4061960	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.05	No data	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.14
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-37_ext.xml	SAT TT=44.604	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=44.604 CHECKS=339712000 NODES=768130	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.04	No data	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-38_ext.xml	SAT TT=160.303	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=879.556 CHECKS=6747010000 NODES=15985000	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	No data	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.13
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-40_ext.xml	SAT TT=101.396	SAT TT=1085.03 CHECKS=6378480000 NODES=3636110	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.19	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT TT=101.396 CHECKS=739540000 NODES=1755150	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	No data	SAT TT=1415.23 ASSIGNMENTS=8788760 CHECKS=1208610000	SAT TT=161.99 ASSIGNMENTS=1016920 CHECKS=618775000	? (TO) TT=1800.06	SAT TT=182.135 ASSIGNMENTS=1128990 CHECKS=694237000	SAT TT=1355.64 ASSIGNMENTS=8773730 CHECKS=1198770000	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-41_ext.xml	SAT TT=250.205	? (TO) TT=1800.17	? (TO) TT=1800.07	SAT TT=375.241	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=942.138 ASSIGNMENTS=1019870	SAT TT=936.617 ASSIGNMENTS=1019870	? (TO) TT=1800.01	SAT TT=779.495 CHECKS=6034310000 NODES=14448300	? (TO) TT=1800.07	SAT TT=649.687 ASSIGNMENTS=1566560 CHECKS=954342000	SAT TT=652.892 ASSIGNMENTS=1566560 CHECKS=954342000	? (TO) TT=1800.01	? (TO) TT=1800.06	No data	SAT TT=274.883 ASSIGNMENTS=1848430 CHECKS=1128530000	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=250.205 ASSIGNMENTS=1566560 CHECKS=954342000	? (TO) TT=1800.63	? (TO) TT=1800.06	SAT TT=360.106	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-42_ext.xml	SAT TT=6.273	SAT TT=247.095 CHECKS=1491670000 NODES=861345	SAT TT=6.273 CHECKS=31014700 NODES=18741	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=728.943 ASSIGNMENTS=710176	SAT TT=733.417 ASSIGNMENTS=710176	? (TO) TT=1800.05	SAT TT=272.788 CHECKS=1970470000 NODES=4687070	? (TO) TT=1800.05	SAT TT=246.933 ASSIGNMENTS=861345 CHECKS=1491670000	SAT TT=258.321 ASSIGNMENTS=861345 CHECKS=1491670000	? (TO) TT=1800.05	? (TO) TT=1800.06	No data	SAT TT=174.068 ASSIGNMENTS=1038020 CHECKS=665244000	SAT TT=1234.12 ASSIGNMENTS=8095000 CHECKS=786497000	SAT TT=1195.5	SAT TT=1299.67 ASSIGNMENTS=8067700 CHECKS=763485000	SAT TT=173.553 ASSIGNMENTS=1024030 CHECKS=657058000	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.13
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-43_ext.xml	SAT TT=170.779	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=170.779 CHECKS=1332520000 NODES=3057080	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.13
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-44_ext.xml	SAT TT=42.149	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=42.149 CHECKS=322577000 NODES=740400	? (TO) TT=1800.03	SAT TT=636.581 ASSIGNMENTS=1458530 CHECKS=910314000	SAT TT=636.433 ASSIGNMENTS=1458530 CHECKS=910314000	? (TO) TT=1800.07	? (TO) TT=1800.05	No data	SAT TT=237.293 ASSIGNMENTS=1486870 CHECKS=930255000	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=236.431 ASSIGNMENTS=1474630 CHECKS=919857000	SAT TT=218.817 ASSIGNMENTS=1458530 CHECKS=910314000	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.13
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-47_ext.xml	SAT TT=1691.98	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.06	SAT TT=1691.98 CHECKS=12403100000 NODES=29592300	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-7_ext.xml	SAT TT=148.844	SAT TT=1756.55 CHECKS=10821600000 NODES=5839610	SAT TT=1787.99 CHECKS=11369000000 NODES=6114040	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.09	SAT TT=148.844 CHECKS=1144550000 NODES=2698700	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	No data	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.11
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-8_ext.xml	SAT TT=219.913	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=219.913 CHECKS=1726360000 NODES=4109370	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	No data	SAT TT=642.238 ASSIGNMENTS=4037110 CHECKS=2474580000	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=615.929 ASSIGNMENTS=3911900 CHECKS=2391800000	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.12
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-9_ext.xml	SAT TT=138.991	SAT TT=580.073 CHECKS=3353890000 NODES=2055440	SAT TT=138.991 CHECKS=829415000 NODES=515531	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.18	? (TO) TT=1800.06	SAT TT=319.325 CHECKS=2525020000 NODES=6040810	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	SAT TT=1161.67 ASSIGNMENTS=7371760 CHECKS=236856000	SAT TT=1068.86 ASSIGNMENTS=7371810 CHECKS=226862000	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=1085.34 ASSIGNMENTS=7366520 CHECKS=231098000	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.12
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-10_ext.xml	SAT TT=576.094	? (TO) TT=1800.13	? (TO) TT=1800.14	SAT TT=848.544	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.04	SAT TT=576.094 CHECKS=4428530000 NODES=10460900	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	No data	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.09
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-1_ext.xml	SAT TT=148.397	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=148.397 CHECKS=1068960000 NODES=2533800	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.08	No data	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-20_ext.xml	SAT TT=155.136	? (TO) TT=1800.1	? (TO) TT=1800.17	SAT TT=849.825	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=1754.95 ASSIGNMENTS=1688690	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=198.919 CHECKS=1463070000 NODES=3527900	? (TO) TT=1800.07	SAT TT=172.685 ASSIGNMENTS=993263 CHECKS=633305000	SAT TT=576.45 ASSIGNMENTS=993263 CHECKS=633305000	? (TO) TT=1800	? (TO) TT=1800.09	No data	SAT TT=164.148 ASSIGNMENTS=993834 CHECKS=633064000	SAT TT=248.693 ASSIGNMENTS=1491090 CHECKS=959874000	? (TO) TT=1800.11	SAT TT=1776.9 ASSIGNMENTS=10453200 CHECKS=2449180000	SAT TT=155.136 ASSIGNMENTS=993263 CHECKS=633305000	? (TO) TT=1800.12	SAT TT=874.99 ASSIGNMENTS=435913 CHECKS=965554000	? (TO) TT=1800.14	? (TO) TT=1800.11
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-21_ext.xml	SAT TT=157.878	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.14	SAT TT=727.168 CHECKS=193897000 NODES=1471850	SAT TT=157.878 CHECKS=1214530000 NODES=2788120	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	No data	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.08
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-24_ext.xml	SAT TT=590.139	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=590.139 CHECKS=4367570000 NODES=10240800	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800	No data	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.15	? (TO) TT=1800.06
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-25_ext.xml	SAT TT=1682.54	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=1682.54 CHECKS=13009700000 NODES=30381800	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.08	No data	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-27_ext.xml	SAT TT=137.858	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.04	SAT TT=137.858 CHECKS=972194000 NODES=2276630	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.02	No data	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.81	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.1
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-29_ext.xml	SAT TT=30.595	SAT TT=30.595 CHECKS=164163000 NODES=101562	SAT TT=351.299 CHECKS=2103520000 NODES=1253230	SAT TT=316.911	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=844.453 ASSIGNMENTS=785973	SAT TT=844.735 ASSIGNMENTS=785973	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=35.706 ASSIGNMENTS=101562 CHECKS=164163000	SAT TT=35.844 ASSIGNMENTS=101562 CHECKS=164163000	? (TO) TT=1800.07	? (TO) TT=1800.01	No data	SAT TT=249.277 ASSIGNMENTS=1534150 CHECKS=987591000	SAT TT=250.112 ASSIGNMENTS=1511460 CHECKS=972959000	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=209.518 ASSIGNMENTS=1253730 CHECKS=805907000	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.1
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-2_ext.xml	SAT TT=380.688	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=663.018 CHECKS=4769910000 NODES=11192700	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.05	No data	SAT TT=863.068 ASSIGNMENTS=4975910 CHECKS=3295370000	SAT TT=380.688 ASSIGNMENTS=2221600 CHECKS=1451650000	? (TO) TT=1800.05	SAT TT=610.995 ASSIGNMENTS=3580070 CHECKS=2348730000	SAT TT=833.996 ASSIGNMENTS=4953280 CHECKS=3279720000	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-30_ext.xml	SAT TT=1166.35	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=1166.35 CHECKS=8434440000 NODES=19697200	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.1	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-35_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.13
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-36_ext.xml	SAT TT=966.597	SAT TT=1183.09 CHECKS=6657870000 NODES=4007890	SAT TT=1059.5 CHECKS=6509120000 NODES=3931210	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	No data	SAT TT=993.307 ASSIGNMENTS=6371730 CHECKS=4033130000	SAT TT=966.597 ASSIGNMENTS=6330560 CHECKS=4002570000	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=1026.39 ASSIGNMENTS=6367460 CHECKS=4029880000	SAT TT=1126.15	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.15
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-37_ext.xml	SAT TT=680.963	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.01	SAT TT=680.963 CHECKS=5330020000 NODES=12061000	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	No data	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-40_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.07
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-41_ext.xml	SAT TT=129.195	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=129.195 CHECKS=925751000 NODES=2213500	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800	No data	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-42_ext.xml	SAT TT=431.763	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=431.763 CHECKS=3143970000 NODES=7468140	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	No data	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.13
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-44_ext.xml	SAT TT=147.156	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.1	No data	? (TO) TT=1800.06	SAT TT=147.156 ASSIGNMENTS=931286 CHECKS=585770000	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.12
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-46_ext.xml	SAT TT=391.069	SAT TT=391.069 CHECKS=2356840000 NODES=1494170	SAT TT=395.917 CHECKS=2226390000 NODES=1424280	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=579.218 CHECKS=4158490000 NODES=9860180	? (TO) TT=1800.06	SAT TT=394.26 ASSIGNMENTS=1494170 CHECKS=2356840000	SAT TT=406.541 ASSIGNMENTS=1494170 CHECKS=2356840000	? (TO) TT=1800	? (TO) TT=1800.09	No data	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-47_ext.xml	SAT TT=424.404	SAT TT=424.404 CHECKS=2525550000 NODES=1617500	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=581.928 CHECKS=4199430000 NODES=10005900	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	No data	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-48_ext.xml	SAT TT=439.352	? (TO) TT=1800.16	? (TO) TT=1800.09	SAT TT=439.352	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=1036.45 ASSIGNMENTS=923032	SAT TT=1066.77 ASSIGNMENTS=923032	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.05	No data	SAT TT=690.108 ASSIGNMENTS=4212240 CHECKS=2799820000	SAT TT=675.242 ASSIGNMENTS=4213310 CHECKS=2798470000	? (TO) TT=1800.06	SAT TT=688.195 ASSIGNMENTS=4199920 CHECKS=2789750000	SAT TT=680.218 ASSIGNMENTS=4192870 CHECKS=2786010000	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.11
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-49_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	No data	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.08
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-4_ext.xml	SAT TT=84.871	? (TO) TT=1800.08	SAT TT=1299.88 CHECKS=8001200000 NODES=4584710	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=84.871 CHECKS=654610000 NODES=1533330	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	SAT TT=774.016 ASSIGNMENTS=4655450 CHECKS=3008550000	SAT TT=459.784 ASSIGNMENTS=2773580 CHECKS=1777890000	? (TO) TT=1800.1	SAT TT=366.197 ASSIGNMENTS=2209780 CHECKS=1422430000	SAT TT=739.971 ASSIGNMENTS=4625840 CHECKS=2988170000	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.13
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-50_ext.xml	SAT TT=1198.98	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.03	SAT TT=1198.98 CHECKS=9264470000 NODES=21958100	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.02	No data	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.12
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-6_ext.xml	SAT TT=13.416	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800	SAT TT=13.416 CHECKS=89089400 NODES=206634	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	No data	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.14
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-7_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1795.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.04	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.1
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-13_ext.xml	SAT TT=13.027	SAT TT=338.321 CHECKS=2540030 NODES=233472	SAT TT=395.31 CHECKS=2333930 NODES=224781	SAT TT=394.887	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=509.483 ASSIGNMENTS=48630	SAT TT=1393.54 ASSIGNMENTS=90767	SAT TT=50.452 CHECKS=170902000 NODES=135403	SAT TT=86.063 CHECKS=766397000 NODES=2437300	? (TO) TT=1800.09	SAT TT=37.468 ASSIGNMENTS=110865 CHECKS=16008600	SAT TT=37.936 ASSIGNMENTS=110865 CHECKS=16008600	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=13.027 CHECKS=2346640	SAT TT=29.129 ASSIGNMENTS=110455 CHECKS=15960700	SAT TT=31.072 ASSIGNMENTS=116907 CHECKS=16395400	SAT TT=260.383	SAT TT=30.423 ASSIGNMENTS=111111 CHECKS=16050000	SAT TT=29.989 ASSIGNMENTS=110865 CHECKS=16008600	SAT TT=15.813	SAT TT=188.865 ASSIGNMENTS=152874 CHECKS=127269000	SAT TT=105.389	SAT TT=1585.37
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-14_ext.xml	SAT TT=1.327	SAT TT=37.899 CHECKS=158878 NODES=22624	SAT TT=39.859 CHECKS=162902 NODES=22472	SAT TT=92.398	SAT TT=327.919 CHECKS=3153480	SAT TT=262.4 CHECKS=2438960	SAT TT=100.514 ASSIGNMENTS=9382	SAT TT=125.558 ASSIGNMENTS=9417	SAT TT=15.676 CHECKS=44426500 NODES=37003	SAT TT=50.345 CHECKS=412682000 NODES=1302090	SAT TT=584.933 CHECKS=2208080000 NODES=3538850	SAT TT=9.414 ASSIGNMENTS=6069 CHECKS=871573	SAT TT=9.581 ASSIGNMENTS=6069 CHECKS=871573	SAT TT=695.326	? (TO) TT=1800.02	SAT TT=1.968 CHECKS=266822	SAT TT=1.327 ASSIGNMENTS=3935 CHECKS=557946	SAT TT=7.745 ASSIGNMENTS=32565 CHECKS=4094160	SAT TT=30.057	SAT TT=7.924 ASSIGNMENTS=29589 CHECKS=3951370	SAT TT=1.952 ASSIGNMENTS=6069 CHECKS=871573	SAT TT=142.129	SAT TT=7.518 ASSIGNMENTS=240 CHECKS=232909	SAT TT=21.172	SAT TT=18.504
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-15_ext.xml	SAT TT=4.118	SAT TT=73.233 CHECKS=381873 NODES=48121	SAT TT=73.81 CHECKS=383897 NODES=50774	SAT TT=14.62	SAT TT=275.725 CHECKS=2316530	SAT TT=311.679 CHECKS=2799430	SAT TT=34.952 ASSIGNMENTS=3623	SAT TT=431.502 ASSIGNMENTS=18054	SAT TT=7.865 CHECKS=20993700 NODES=16166	SAT TT=109.594 CHECKS=917219000 NODES=2883790	? (TO) TT=1800.09	SAT TT=17.934 ASSIGNMENTS=37101 CHECKS=4712380	SAT TT=17.793 ASSIGNMENTS=37101 CHECKS=4712380	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=11.467 CHECKS=1987770	SAT TT=10.389 ASSIGNMENTS=36293 CHECKS=5039030	SAT TT=1.882 ASSIGNMENTS=7504 CHECKS=834926	SAT TT=16.642	SAT TT=4.118 ASSIGNMENTS=14025 CHECKS=1812510	SAT TT=9.776 ASSIGNMENTS=37101 CHECKS=4712380	SAT TT=251.866	SAT TT=45.902 ASSIGNMENTS=29369 CHECKS=24544500	SAT TT=330.961	SAT TT=289.297
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-17_ext.xml	SAT TT=1.343	SAT TT=59.502 CHECKS=188752 NODES=38541	SAT TT=61.208 CHECKS=196260 NODES=38881	SAT TT=7.097	SAT TT=458.601 CHECKS=4519620	SAT TT=231.252 CHECKS=2233450	SAT TT=12.467 ASSIGNMENTS=1590	SAT TT=108.681 ASSIGNMENTS=9582	SAT TT=7.976 CHECKS=20240600 NODES=15404	SAT TT=328.455 CHECKS=2832080000 NODES=8851790	? (TO) TT=1800.05	SAT TT=1.462 ASSIGNMENTS=6371 CHECKS=684956	SAT TT=1.354 ASSIGNMENTS=6371 CHECKS=684956	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=3.217 CHECKS=462565	SAT TT=1.343 ASSIGNMENTS=5878 CHECKS=642422	SAT TT=1.471 ASSIGNMENTS=7319 CHECKS=703840	SAT TT=13.544	SAT TT=3.935 ASSIGNMENTS=14534 CHECKS=1899900	SAT TT=1.395 ASSIGNMENTS=6371 CHECKS=684956	SAT TT=346.813	SAT TT=24.61 ASSIGNMENTS=14353 CHECKS=15518400	SAT TT=55.831	SAT TT=44.678
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-19_ext.xml	SAT TT=12.411	SAT TT=175.516 CHECKS=1165570 NODES=112693	SAT TT=176.072 CHECKS=1242600 NODES=110632	SAT TT=94.101	SAT TT=1268.61 CHECKS=13142200	SAT TT=1188.67 CHECKS=12538800	SAT TT=162.712 ASSIGNMENTS=16067	SAT TT=176.19 ASSIGNMENTS=10403	SAT TT=30.103 CHECKS=95704500 NODES=79738	SAT TT=940.041 CHECKS=8485590000 NODES=26583900	? (TO) TT=1800.09	SAT TT=21.223 ASSIGNMENTS=57604 CHECKS=7380710	SAT TT=21.353 ASSIGNMENTS=57604 CHECKS=7380710	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=41.893 CHECKS=8172080	SAT TT=15.324 ASSIGNMENTS=64259 CHECKS=8315150	SAT TT=10.51 ASSIGNMENTS=44767 CHECKS=5642600	SAT TT=244.768	SAT TT=13.989 ASSIGNMENTS=59087 CHECKS=7645730	SAT TT=12.411 ASSIGNMENTS=57604 CHECKS=7380710	SAT TT=1746.5	SAT TT=177.821 ASSIGNMENTS=144690 CHECKS=105042000	SAT TT=1682.34	? (TO) TT=1800.06
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-20_ext.xml	SAT TT=3.151	SAT TT=114.725 CHECKS=416408 NODES=65063	SAT TT=149.336 CHECKS=499649 NODES=74262	SAT TT=133.939	SAT TT=399.303 CHECKS=3165710	SAT TT=175.04 CHECKS=1533850	SAT TT=35.833 ASSIGNMENTS=3504	SAT TT=87.131 ASSIGNMENTS=6070	SAT TT=7.522 CHECKS=23278700 NODES=15886	SAT TT=95.488 CHECKS=809627000 NODES=2681370	? (TO) TT=1800.02	SAT TT=11.417 ASSIGNMENTS=10535 CHECKS=1406420	SAT TT=11.464 ASSIGNMENTS=10535 CHECKS=1406420	SAT TT=1647.68	? (TO) TT=1800.02	SAT TT=3.151 CHECKS=444220	SAT TT=3.518 ASSIGNMENTS=10572 CHECKS=1409230	SAT TT=4.002 ASSIGNMENTS=14056 CHECKS=1736300	SAT TT=21.373	SAT TT=3.623 ASSIGNMENTS=10932 CHECKS=1469040	SAT TT=3.466 ASSIGNMENTS=10535 CHECKS=1406420	SAT TT=10.428	SAT TT=25.078 ASSIGNMENTS=13357 CHECKS=12158800	SAT TT=43.083	SAT TT=47.139
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-21_ext.xml	SAT TT=5.508	SAT TT=243.896 CHECKS=1790730 NODES=143542	SAT TT=234.117 CHECKS=1770730 NODES=142367	SAT TT=88.432	SAT TT=1129.95 CHECKS=9765660	SAT TT=315.284 CHECKS=2958490	SAT TT=253.851 ASSIGNMENTS=19456	? (TO) TT=1800.12	SAT TT=11.836 CHECKS=36907300 NODES=23364	SAT TT=1111.2 CHECKS=9510160000 NODES=30013400	? (TO) TT=1800	SAT TT=12.362 ASSIGNMENTS=18907 CHECKS=2409320	SAT TT=13.79 ASSIGNMENTS=18907 CHECKS=2409320	SAT TT=1117.14	SAT TT=348.738	SAT TT=9.972 CHECKS=1811580	SAT TT=6.428 ASSIGNMENTS=21779 CHECKS=2776360	SAT TT=15.376 ASSIGNMENTS=57362 CHECKS=6899710	SAT TT=73.08	SAT TT=7.869 ASSIGNMENTS=29080 CHECKS=3701810	SAT TT=5.508 ASSIGNMENTS=18907 CHECKS=2409320	SAT TT=48.835	SAT TT=26.27 ASSIGNMENTS=16934 CHECKS=15378400	SAT TT=47.027	SAT TT=87.426
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-26_ext.xml	SAT TT=1.797	SAT TT=6.769 CHECKS=13338 NODES=3482	SAT TT=6.728 CHECKS=13518 NODES=3406	SAT TT=511.234	SAT TT=595.546 CHECKS=5599090	SAT TT=20.404 CHECKS=183560	SAT TT=163.024 ASSIGNMENTS=16286	SAT TT=195.384 ASSIGNMENTS=11344	SAT TT=22.422 CHECKS=71883700 NODES=61198	SAT TT=63.492 CHECKS=529673000 NODES=1645820	? (TO) TT=1800.03	SAT TT=10.417 ASSIGNMENTS=9130 CHECKS=1215750	SAT TT=10.413 ASSIGNMENTS=9130 CHECKS=1215750	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=4.459 CHECKS=638697	SAT TT=1.797 ASSIGNMENTS=6585 CHECKS=792605	SAT TT=12.553 ASSIGNMENTS=43557 CHECKS=5957470	SAT TT=62.931	SAT TT=4.287 ASSIGNMENTS=15795 CHECKS=1997930	SAT TT=2.64 ASSIGNMENTS=9130 CHECKS=1215750	SAT TT=196.879	SAT TT=18.025 ASSIGNMENTS=4527 CHECKS=3865410	SAT TT=93.1	SAT TT=94.061
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-27_ext.xml	SAT TT=2.87	? (TO) TT=1800.17	? (TO) TT=1800.12	SAT TT=775.904	SAT TT=443.527 CHECKS=3909950	SAT TT=1292.17 CHECKS=13307800	SAT TT=653.334 ASSIGNMENTS=57230	? (TO) TT=1800.07	SAT TT=42.919 CHECKS=151995000 NODES=110620	SAT TT=189.285 CHECKS=1679800000 NODES=5133190	? (TO) TT=1800.03	SAT TT=41.224 ASSIGNMENTS=113897 CHECKS=15860000	SAT TT=41.905 ASSIGNMENTS=113897 CHECKS=15860000	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=2.87 CHECKS=481612	SAT TT=34.761 ASSIGNMENTS=117469 CHECKS=16266100	SAT TT=22.288 ASSIGNMENTS=76952 CHECKS=10548100	SAT TT=289.806	SAT TT=19.314 ASSIGNMENTS=70869 CHECKS=9813640	SAT TT=30.995 ASSIGNMENTS=113897 CHECKS=15860000	SAT TT=574.672	SAT TT=90.687 ASSIGNMENTS=59443 CHECKS=51577100	SAT TT=67.3	SAT TT=28.913
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-28_ext.xml	SAT TT=1.097	SAT TT=311.257 CHECKS=1506170 NODES=138140	SAT TT=297.849 CHECKS=1498720 NODES=135538	SAT TT=14.033	SAT TT=241.155 CHECKS=2086830	SAT TT=220.495 CHECKS=2254330	SAT TT=12.188 ASSIGNMENTS=1393	SAT TT=195.6 ASSIGNMENTS=11380	SAT TT=6.245 CHECKS=15299000 NODES=12503	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=9.837 ASSIGNMENTS=9534 CHECKS=1274820	SAT TT=10.745 ASSIGNMENTS=9534 CHECKS=1274820	SAT TT=1695.25	? (TO) TT=1800.03	SAT TT=4.898 CHECKS=901967	SAT TT=1.986 ASSIGNMENTS=6632 CHECKS=892337	SAT TT=1.482 ASSIGNMENTS=6592 CHECKS=680749	SAT TT=23.005	SAT TT=1.097 ASSIGNMENTS=3629 CHECKS=465374	SAT TT=2.773 ASSIGNMENTS=9534 CHECKS=1274820	SAT TT=337.735	SAT TT=34.81 ASSIGNMENTS=8546 CHECKS=8862670	SAT TT=286.294	SAT TT=290.188
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-2_ext.xml	SAT TT=4.59	SAT TT=52.849 CHECKS=190066 NODES=20762	SAT TT=49.474 CHECKS=178512 NODES=20158	SAT TT=238.736	SAT TT=207.268 CHECKS=1697800	SAT TT=1536.58 CHECKS=13460900	SAT TT=250.079 ASSIGNMENTS=25193	SAT TT=361.941 ASSIGNMENTS=28785	SAT TT=24.549 CHECKS=84768900 NODES=65478	SAT TT=73.447 CHECKS=659474000 NODES=1992310	? (TO) TT=1800.06	SAT TT=21.382 ASSIGNMENTS=49719 CHECKS=6516470	SAT TT=23.614 ASSIGNMENTS=49719 CHECKS=6516470	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=8.252 CHECKS=1214970	SAT TT=12.983 ASSIGNMENTS=42035 CHECKS=5456490	SAT TT=16.354 ASSIGNMENTS=55963 CHECKS=7273070	SAT TT=101.22	SAT TT=13.295 ASSIGNMENTS=44903 CHECKS=5701570	SAT TT=13.88 ASSIGNMENTS=49719 CHECKS=6516470	SAT TT=4.59	SAT TT=96.911 ASSIGNMENTS=47701 CHECKS=49983400	SAT TT=16.47	SAT TT=162.007
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-31_ext.xml	SAT TT=15.023	SAT TT=150.759 CHECKS=1027420 NODES=103010	SAT TT=195.938 CHECKS=1108280 NODES=113140	SAT TT=409.848	SAT TT=434.638 CHECKS=3859660	? (TO) TT=1800.07	SAT TT=876.302 ASSIGNMENTS=80930	? (TO) TT=1800.11	SAT TT=82.976 CHECKS=281722000 NODES=243977	SAT TT=256.407 CHECKS=2269520000 NODES=6896400	? (TO) TT=1800.08	SAT TT=50.235 ASSIGNMENTS=173354 CHECKS=21757800	SAT TT=160.578 ASSIGNMENTS=103010 CHECKS=1027420	? (TO) TT=1800	? (TO) TT=1800.01	SAT TT=60.07 CHECKS=10121500	SAT TT=46.783 ASSIGNMENTS=186061 CHECKS=23490000	SAT TT=42.489 ASSIGNMENTS=187404 CHECKS=23447200	SAT TT=339.912	SAT TT=20.079 ASSIGNMENTS=84062 CHECKS=10543600	SAT TT=42.816 ASSIGNMENTS=173354 CHECKS=21757800	SAT TT=15.023	SAT TT=353.968 ASSIGNMENTS=246780 CHECKS=198669000	SAT TT=21.239	SAT TT=178.421
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-33_ext.xml	SAT TT=34.143	SAT TT=173.984 CHECKS=1080290 NODES=131116	SAT TT=160.172 CHECKS=1109260 NODES=131445	SAT TT=387.503	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=448.093 ASSIGNMENTS=42118	? (TO) TT=1800.15	SAT TT=65.946 CHECKS=198973000 NODES=168915	SAT TT=225.158 CHECKS=1864390000 NODES=5701400	? (TO) TT=1800.06	SAT TT=42.981 ASSIGNMENTS=140268 CHECKS=20216600	SAT TT=42.448 ASSIGNMENTS=140268 CHECKS=20216600	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=51.176 CHECKS=9902410	SAT TT=87.466 ASSIGNMENTS=343394 CHECKS=49215800	SAT TT=86.569 ASSIGNMENTS=347065 CHECKS=49419400	SAT TT=488.596	SAT TT=89.704 ASSIGNMENTS=360508 CHECKS=51206700	SAT TT=34.143 ASSIGNMENTS=140268 CHECKS=20216600	SAT TT=1286.1	SAT TT=357.134 ASSIGNMENTS=301362 CHECKS=234001000	SAT TT=311.928	SAT TT=365.502
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-34_ext.xml	SAT TT=21.093	SAT TT=81.207 CHECKS=373230 NODES=41825	SAT TT=85.635 CHECKS=408879 NODES=45163	SAT TT=319.613	? (TO) TT=1800.09	SAT TT=1670.62 CHECKS=16282300	SAT TT=272.532 ASSIGNMENTS=25794	SAT TT=1455.13 ASSIGNMENTS=83357	SAT TT=49.678 CHECKS=171786000 NODES=127640	SAT TT=143.912 CHECKS=1180450000 NODES=3540980	? (TO) TT=1800.01	SAT TT=31.336 ASSIGNMENTS=85730 CHECKS=11049100	SAT TT=84.741 ASSIGNMENTS=41825 CHECKS=373230	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=60.285 CHECKS=11458000	SAT TT=23.149 ASSIGNMENTS=85953 CHECKS=11043000	SAT TT=24.673 ASSIGNMENTS=89968 CHECKS=11727200	SAT TT=132.914	SAT TT=21.093 ASSIGNMENTS=79996 CHECKS=10221500	SAT TT=24.157 ASSIGNMENTS=85730 CHECKS=11049100	SAT TT=1101.27	SAT TT=9.239 ASSIGNMENTS=3502 CHECKS=2728200	SAT TT=811.65	SAT TT=1730.92
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-36_ext.xml	SAT TT=6.402	SAT TT=392.18 CHECKS=2306000 NODES=221118	SAT TT=395.206 CHECKS=2342320 NODES=219150	SAT TT=444.524	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=223.982 ASSIGNMENTS=18172	SAT TT=1172.81 ASSIGNMENTS=84329	SAT TT=80.285 CHECKS=245092000 NODES=206472	SAT TT=88.961 CHECKS=741269000 NODES=2201450	? (TO) TT=1800.03	SAT TT=46.291 ASSIGNMENTS=152114 CHECKS=21911800	SAT TT=48.013 ASSIGNMENTS=152114 CHECKS=21911800	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=6.402 CHECKS=1005880	SAT TT=43.176 ASSIGNMENTS=160617 CHECKS=22315100	SAT TT=41.467 ASSIGNMENTS=167802 CHECKS=23095600	SAT TT=318.642	SAT TT=43.171 ASSIGNMENTS=162442 CHECKS=22492600	SAT TT=38.853 ASSIGNMENTS=152114 CHECKS=21911800	SAT TT=938.242	SAT TT=341.378 ASSIGNMENTS=235086 CHECKS=187739000	SAT TT=467.969	SAT TT=1674.19
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-37_ext.xml	SAT TT=38.277	SAT TT=702.939 CHECKS=4637970 NODES=478836	SAT TT=664.704 CHECKS=4602100 NODES=479606	SAT TT=158.048	? (TO) TT=1800.05	SAT TT=1509.57 CHECKS=15366700	SAT TT=564.314 ASSIGNMENTS=44618	SAT TT=109.449 ASSIGNMENTS=8259	SAT TT=55.323 CHECKS=185548000 NODES=145561	SAT TT=1294.99 CHECKS=10726400000 NODES=33350100	? (TO) TT=1800.08	SAT TT=54.775 ASSIGNMENTS=172327 CHECKS=26090600	SAT TT=55.141 ASSIGNMENTS=172327 CHECKS=26090600	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=182.808 CHECKS=34245800	SAT TT=47.342 ASSIGNMENTS=187150 CHECKS=28697900	SAT TT=22.346 ASSIGNMENTS=82724 CHECKS=12836400	SAT TT=182.98	SAT TT=38.277 ASSIGNMENTS=152115 CHECKS=22861200	SAT TT=46.333 ASSIGNMENTS=172327 CHECKS=26090600	SAT TT=1500.73	SAT TT=195.932 ASSIGNMENTS=125474 CHECKS=107171000	? (TO) TT=1800.08	SAT TT=555.301
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-38_ext.xml	SAT TT=3.277	SAT TT=49.606 CHECKS=190689 NODES=22262	SAT TT=49.289 CHECKS=193293 NODES=22504	SAT TT=10.228	SAT TT=321.258 CHECKS=2698360	SAT TT=735.427 CHECKS=6517260	SAT TT=33.426 ASSIGNMENTS=3474	SAT TT=64.345 ASSIGNMENTS=4962	SAT TT=6.978 CHECKS=19649100 NODES=14162	SAT TT=748.375 CHECKS=6623690000 NODES=21954200	SAT TT=429.378 CHECKS=1549790000 NODES=2601880	SAT TT=11.1 ASSIGNMENTS=12195 CHECKS=1405490	SAT TT=11.079 ASSIGNMENTS=12195 CHECKS=1405490	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=7.672 CHECKS=1128800	SAT TT=3.337 ASSIGNMENTS=12073 CHECKS=1391010	SAT TT=2.483 ASSIGNMENTS=10946 CHECKS=1134000	SAT TT=6.837	SAT TT=3.277 ASSIGNMENTS=11509 CHECKS=1328420	SAT TT=3.351 ASSIGNMENTS=12195 CHECKS=1405490	SAT TT=77.014	SAT TT=4.009 ASSIGNMENTS=453 CHECKS=278562	SAT TT=43.198	SAT TT=18.078
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-39_ext.xml	SAT TT=14.545	SAT TT=133.489 CHECKS=925198 NODES=108502	SAT TT=141.17 CHECKS=905563 NODES=106170	SAT TT=217.494	SAT TT=1338.53 CHECKS=14058600	SAT TT=1713.42 CHECKS=16687000	SAT TT=396.162 ASSIGNMENTS=26513	? (TO) TT=1800.11	SAT TT=78.77 CHECKS=277465000 NODES=216295	SAT TT=30.105 CHECKS=252692000 NODES=792872	? (TO) TT=1800.05	SAT TT=22.519 ASSIGNMENTS=53378 CHECKS=7482470	SAT TT=22.204 ASSIGNMENTS=53378 CHECKS=7482470	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=17.437 CHECKS=3894460	SAT TT=29.216 ASSIGNMENTS=110281 CHECKS=15738900	SAT TT=59.06 ASSIGNMENTS=219658 CHECKS=29966800	SAT TT=185.349	SAT TT=52.29 ASSIGNMENTS=190794 CHECKS=26743900	SAT TT=14.545 ASSIGNMENTS=53378 CHECKS=7482470	SAT TT=850.253	SAT TT=395.306 ASSIGNMENTS=264086 CHECKS=210857000	SAT TT=162.705	SAT TT=857.284
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-40_ext.xml	SAT TT=20.071	SAT TT=185.889 CHECKS=1355040 NODES=134302	SAT TT=193.929 CHECKS=1282610 NODES=129809	SAT TT=187.25	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=977.977 ASSIGNMENTS=78667	SAT TT=460.905 ASSIGNMENTS=27862	SAT TT=34.977 CHECKS=112828000 NODES=101211	SAT TT=1001.21 CHECKS=9193410000 NODES=28325800	? (TO) TT=1800.01	SAT TT=32.082 ASSIGNMENTS=98233 CHECKS=13801100	SAT TT=31.629 ASSIGNMENTS=98233 CHECKS=13801100	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=36.177 CHECKS=6834110	SAT TT=28.791 ASSIGNMENTS=107470 CHECKS=15458000	SAT TT=26.717 ASSIGNMENTS=102464 CHECKS=14475100	SAT TT=287.561	SAT TT=20.071 ASSIGNMENTS=80856 CHECKS=11146700	SAT TT=22.887 ASSIGNMENTS=98233 CHECKS=13801100	SAT TT=164.376	SAT TT=10.035 ASSIGNMENTS=3285 CHECKS=2779970	SAT TT=305.493	? (TO) TT=1800.13
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-41_ext.xml	SAT TT=23.512	SAT TT=190.327 CHECKS=1095980 NODES=118898	SAT TT=185.835 CHECKS=1109130 NODES=116988	SAT TT=271.511	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=154.814 ASSIGNMENTS=12938	SAT TT=162.92 ASSIGNMENTS=10451	SAT TT=24.481 CHECKS=77610600 NODES=59808	SAT TT=279.985 CHECKS=2349460000 NODES=7285270	? (TO) TT=1800.08	SAT TT=37.077 ASSIGNMENTS=111895 CHECKS=15843700	SAT TT=36.901 ASSIGNMENTS=111895 CHECKS=15843700	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=25.462 CHECKS=4767140	SAT TT=27.346 ASSIGNMENTS=103447 CHECKS=14593900	SAT TT=47.148 ASSIGNMENTS=182432 CHECKS=26042400	SAT TT=247.997	SAT TT=23.512 ASSIGNMENTS=92002 CHECKS=12517500	SAT TT=28.709 ASSIGNMENTS=111895 CHECKS=15843700	SAT TT=975.366	SAT TT=549.133 ASSIGNMENTS=263432 CHECKS=204678000	? (TO) TT=1800.02	SAT TT=481.837
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-46_ext.xml	SAT TT=0.679	SAT TT=20.264 CHECKS=67825 NODES=8430	SAT TT=20.213 CHECKS=65256 NODES=8349	SAT TT=269.958	SAT TT=201.728 CHECKS=1602850	SAT TT=131.816 CHECKS=1212420	SAT TT=59.107 ASSIGNMENTS=5388	SAT TT=38.236 ASSIGNMENTS=3067	SAT TT=8.584 CHECKS=24652900 NODES=22011	SAT TT=6.087 CHECKS=38412900 NODES=127636	? (TO) TT=1800.02	SAT TT=9.741 ASSIGNMENTS=7345 CHECKS=881946	SAT TT=28.212 ASSIGNMENTS=8430 CHECKS=67825	? (TO) TT=1800.08	SAT TT=992.664	SAT TT=0.679 CHECKS=34167	SAT TT=1.639 ASSIGNMENTS=6179 CHECKS=740064	SAT TT=1.382 ASSIGNMENTS=6151 CHECKS=624916	SAT TT=12.721	SAT TT=1.724 ASSIGNMENTS=5430 CHECKS=712204	SAT TT=2.015 ASSIGNMENTS=7345 CHECKS=881946	SAT TT=15.057	SAT TT=2.182 ASSIGNMENTS=1083 CHECKS=899847	SAT TT=30.22	SAT TT=6.658
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-48_ext.xml	SAT TT=10.979	SAT TT=471.778 CHECKS=4127500 NODES=318012	SAT TT=492.63 CHECKS=3702180 NODES=306238	SAT TT=95.463	SAT TT=853.118 CHECKS=8649900	SAT TT=561.014 CHECKS=5000560	SAT TT=601.828 ASSIGNMENTS=53666	SAT TT=1191.85 ASSIGNMENTS=49473	SAT TT=48.595 CHECKS=154479000 NODES=122448	SAT TT=380.15 CHECKS=3137640000 NODES=9818550	? (TO) TT=1800.03	SAT TT=24.812 ASSIGNMENTS=69455 CHECKS=9260920	SAT TT=25.046 ASSIGNMENTS=69455 CHECKS=9260920	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=34.471 CHECKS=6567990	SAT TT=21.563 ASSIGNMENTS=81928 CHECKS=11445100	SAT TT=21.551 ASSIGNMENTS=83190 CHECKS=11512500	SAT TT=132.092	SAT TT=10.979 ASSIGNMENTS=42590 CHECKS=5794630	SAT TT=17.112 ASSIGNMENTS=69455 CHECKS=9260920	SAT TT=1171.49	SAT TT=195.094 ASSIGNMENTS=137425 CHECKS=110294000	SAT TT=1432.13	SAT TT=1045.34
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-49_ext.xml	SAT TT=5.895	SAT TT=448.021 CHECKS=3116910 NODES=326760	SAT TT=455.275 CHECKS=3098100 NODES=335559	SAT TT=29.637	SAT TT=884.061 CHECKS=8517080	SAT TT=386.163 CHECKS=3788770	SAT TT=90.575 ASSIGNMENTS=8245	SAT TT=937.565 ASSIGNMENTS=55025	SAT TT=64.359 CHECKS=207302000 NODES=170893	SAT TT=60.385 CHECKS=488463000 NODES=1575330	? (TO) TT=1800.08	SAT TT=14.663 ASSIGNMENTS=26332 CHECKS=3495680	SAT TT=15.061 ASSIGNMENTS=26332 CHECKS=3495680	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=5.895 CHECKS=968994	SAT TT=7.088 ASSIGNMENTS=26816 CHECKS=3559290	SAT TT=29.207 ASSIGNMENTS=121957 CHECKS=15537500	SAT TT=50.394	SAT TT=9.311 ASSIGNMENTS=36511 CHECKS=4809550	SAT TT=6.864 ASSIGNMENTS=26332 CHECKS=3495680	SAT TT=26.999	SAT TT=87.051 ASSIGNMENTS=74199 CHECKS=54207000	SAT TT=222.841	SAT TT=134.343
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-50_ext.xml	SAT TT=28.358	SAT TT=38.805 CHECKS=192299 NODES=32940	SAT TT=62.115 CHECKS=347673 NODES=47675	SAT TT=1329.39	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=144.487 ASSIGNMENTS=7348	SAT TT=28.392 CHECKS=94487100 NODES=80806	SAT TT=728.379 CHECKS=6619350000 NODES=20021400	? (TO) TT=1800.03	SAT TT=44.151 ASSIGNMENTS=144771 CHECKS=19605500	SAT TT=44.733 ASSIGNMENTS=144771 CHECKS=19605500	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=144.983 CHECKS=29123300	SAT TT=28.358 ASSIGNMENTS=107865 CHECKS=14992700	SAT TT=111.813 ASSIGNMENTS=449009 CHECKS=59964400	SAT TT=109.036	SAT TT=32.607 ASSIGNMENTS=129417 CHECKS=18398600	SAT TT=36.164 ASSIGNMENTS=144771 CHECKS=19605500	SAT TT=81.021	SAT TT=363.339 ASSIGNMENTS=7266 CHECKS=5159950	SAT TT=206.129	? (TO) TT=1800.06
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-9_ext.xml	SAT TT=10.731	SAT TT=200.679 CHECKS=782784 NODES=97925	SAT TT=222.289 CHECKS=778299 NODES=97271	SAT TT=134.202	SAT TT=934.072 CHECKS=7961230	SAT TT=688.504 CHECKS=6569870	SAT TT=128.551 ASSIGNMENTS=13412	SAT TT=159.582 ASSIGNMENTS=12571	SAT TT=11.417 CHECKS=33821500 NODES=23921	SAT TT=84.29 CHECKS=692231000 NODES=2097440	? (TO) TT=1800.07	SAT TT=22.918 ASSIGNMENTS=54106 CHECKS=7356090	SAT TT=23.043 ASSIGNMENTS=54106 CHECKS=7356090	? (TO) TT=1800	? (TO) TT=1800	SAT TT=14.815 CHECKS=2290860	SAT TT=10.731 ASSIGNMENTS=35573 CHECKS=4921910	SAT TT=8.334 ASSIGNMENTS=30462 CHECKS=3979100	SAT TT=88.146	SAT TT=13.595 ASSIGNMENTS=49528 CHECKS=6994460	SAT TT=15.171 ASSIGNMENTS=54106 CHECKS=7356090	SAT TT=175.692	SAT TT=81.603 ASSIGNMENTS=31403 CHECKS=30565200	SAT TT=29.825	SAT TT=186.967
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-12_ext.xml	SAT TT=6.622	SAT TT=363.183 CHECKS=2189160 NODES=214124	SAT TT=298.847 CHECKS=1694470 NODES=179502	SAT TT=76.157	SAT TT=456.976 CHECKS=4287760	SAT TT=337.304 CHECKS=3321120	SAT TT=75.829 ASSIGNMENTS=7816	SAT TT=218.058 ASSIGNMENTS=14273	SAT TT=33.434 CHECKS=100050000 NODES=85254	SAT TT=222.827 CHECKS=1837480000 NODES=5693880	? (TO) TT=1800.06	SAT TT=21.316 ASSIGNMENTS=53610 CHECKS=6598100	SAT TT=21.2 ASSIGNMENTS=53610 CHECKS=6598100	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT TT=34.439 CHECKS=6958890	SAT TT=16.272 ASSIGNMENTS=55736 CHECKS=7679470	SAT TT=7.378 ASSIGNMENTS=30082 CHECKS=3924270	SAT TT=116.756	SAT TT=14.211 ASSIGNMENTS=54911 CHECKS=7203760	SAT TT=12.266 ASSIGNMENTS=53610 CHECKS=6598100	SAT TT=155.297	SAT TT=166.399 ASSIGNMENTS=116470 CHECKS=88599800	SAT TT=116.848	SAT TT=6.622
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-13_ext.xml	SAT TT=1.904	SAT TT=185.541 CHECKS=1114090 NODES=124481	SAT TT=173.314 CHECKS=1138070 NODES=126729	SAT TT=285.955	SAT TT=222.028 CHECKS=2027170	? (TO) TT=1800.07	SAT TT=327.027 ASSIGNMENTS=30834	? (TO) TT=1800.14	SAT TT=43.029 CHECKS=135676000 NODES=106668	SAT TT=21.852 CHECKS=186889000 NODES=594208	? (TO) TT=1800.06	SAT TT=26.416 ASSIGNMENTS=68349 CHECKS=9806860	SAT TT=26.485 ASSIGNMENTS=68349 CHECKS=9806860	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=1.904 CHECKS=291720	SAT TT=18.577 ASSIGNMENTS=68664 CHECKS=9850570	SAT TT=19.117 ASSIGNMENTS=71782 CHECKS=10071800	SAT TT=157.261	SAT TT=18.778 ASSIGNMENTS=69020 CHECKS=9849450	SAT TT=16.881 ASSIGNMENTS=68349 CHECKS=9806860	SAT TT=51.643	SAT TT=113.427 ASSIGNMENTS=13411 CHECKS=12943300	SAT TT=422.251	SAT TT=572.688
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-16_ext.xml	UNSAT TT=117.418	UNSAT TT=833.171 CHECKS=7437860 NODES=703761	UNSAT TT=844.929 CHECKS=7479160 NODES=702520	UNSAT TT=604.865	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.08	UNSAT TT=200.354 CHECKS=647115000 NODES=520823	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=136.556 ASSIGNMENTS=486579 CHECKS=69166500	UNSAT TT=794.356 ASSIGNMENTS=703761 CHECKS=7437860	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=153.184 CHECKS=30638700	UNSAT TT=123.266 ASSIGNMENTS=457428 CHECKS=65977000	UNSAT TT=112.038 ASSIGNMENTS=458369 CHECKS=66019600	UNSAT TT=895.256	UNSAT TT=117.418 ASSIGNMENTS=460547 CHECKS=63758000	UNSAT TT=125.393 ASSIGNMENTS=486579 CHECKS=69166500	? (TO) TT=1800.11	UNSAT TT=1134.1 ASSIGNMENTS=501909 CHECKS=475402000	? (TO) TT=1800.06	? (TO) TT=1800.12
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-17_ext.xml	SAT TT=18.208	SAT TT=118.382 CHECKS=352976 NODES=65358	SAT TT=118.227 CHECKS=353139 NODES=65167	SAT TT=61.389	SAT TT=1523.43 CHECKS=16051900	SAT TT=449.878 CHECKS=4623320	SAT TT=275.094 ASSIGNMENTS=25842	SAT TT=585.198 ASSIGNMENTS=24181	SAT TT=45.612 CHECKS=161373000 NODES=127939	SAT TT=95.187 CHECKS=784265000 NODES=2449630	? (TO) TT=1800.02	SAT TT=34.958 ASSIGNMENTS=111825 CHECKS=14319000	SAT TT=112.099 ASSIGNMENTS=65358 CHECKS=352976	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=18.208 CHECKS=2936220	SAT TT=26.697 ASSIGNMENTS=104520 CHECKS=13633700	SAT TT=26.273 ASSIGNMENTS=103355 CHECKS=13611300	SAT TT=250.094	SAT TT=26.443 ASSIGNMENTS=104685 CHECKS=14659100	SAT TT=27.534 ASSIGNMENTS=111825 CHECKS=14319000	SAT TT=123.399	SAT TT=196.316 ASSIGNMENTS=120796 CHECKS=108548000	SAT TT=84.496	SAT TT=58.922
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-18_ext.xml	UNSAT TT=13.627	UNSAT TT=130.9 CHECKS=556332 NODES=59184	UNSAT TT=124.203 CHECKS=545409 NODES=59418	UNSAT TT=1088.89	UNSAT TT=999.336 CHECKS=8728910	UNSAT TT=991.169 CHECKS=8565950	UNSAT TT=229.782 ASSIGNMENTS=15453	UNSAT TT=170.99 ASSIGNMENTS=9256	UNSAT TT=25.694 CHECKS=92755300 NODES=54138	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=21.544 ASSIGNMENTS=42014 CHECKS=5896870	UNSAT TT=21.684 ASSIGNMENTS=42014 CHECKS=5896870	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=17.054 CHECKS=2646230	UNSAT TT=15.786 ASSIGNMENTS=47859 CHECKS=6655450	UNSAT TT=10.92 ASSIGNMENTS=40564 CHECKS=5350570	UNSAT TT=68.475	UNSAT TT=14.007 ASSIGNMENTS=46085 CHECKS=6400270	UNSAT TT=13.627 ASSIGNMENTS=42014 CHECKS=5896870	UNSAT TT=202.555	UNSAT TT=55.821 ASSIGNMENTS=35825 CHECKS=35850700	UNSAT TT=179.937	UNSAT TT=173.951
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-1_ext.xml	SAT TT=5.721	SAT TT=160.426 CHECKS=621835 NODES=88969	SAT TT=143.131 CHECKS=652393 NODES=84700	SAT TT=217.933	SAT TT=924.052 CHECKS=8284210	SAT TT=1798.63 CHECKS=17631000	SAT TT=242.409 ASSIGNMENTS=18827	? (TO) TT=1800.05	SAT TT=36.925 CHECKS=110050000 NODES=92671	SAT TT=5.721 CHECKS=34976200 NODES=108423	? (TO) TT=1800.07	SAT TT=21.606 ASSIGNMENTS=55298 CHECKS=7704520	SAT TT=22.068 ASSIGNMENTS=55298 CHECKS=7704520	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=21.173 CHECKS=3427340	SAT TT=14.286 ASSIGNMENTS=56562 CHECKS=7895890	SAT TT=13.108 ASSIGNMENTS=53615 CHECKS=7133020	SAT TT=99.427	SAT TT=14.78 ASSIGNMENTS=58233 CHECKS=7972290	SAT TT=13.83 ASSIGNMENTS=55298 CHECKS=7704520	SAT TT=182.127	SAT TT=49.107 ASSIGNMENTS=29996 CHECKS=25263700	SAT TT=416.27	SAT TT=1320.7
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-20_ext.xml	SAT TT=0.479	SAT TT=363.31 CHECKS=1479710 NODES=174684	SAT TT=324.064 CHECKS=1307280 NODES=158599	SAT TT=259.939	SAT TT=660.01 CHECKS=5407230	SAT TT=18.559 CHECKS=136418	SAT TT=82.821 ASSIGNMENTS=6868	SAT TT=123.019 ASSIGNMENTS=7751	SAT TT=11.311 CHECKS=38860700 NODES=26226	SAT TT=49.202 CHECKS=421078000 NODES=1395660	? (TO) TT=1800	SAT TT=9.751 ASSIGNMENTS=6190 CHECKS=830662	SAT TT=9.682 ASSIGNMENTS=6190 CHECKS=830662	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=0.479 CHECKS=10921	SAT TT=5.201 ASSIGNMENTS=16201 CHECKS=2150130	SAT TT=5.343 ASSIGNMENTS=21271 CHECKS=2421430	SAT TT=38.466	SAT TT=5.278 ASSIGNMENTS=15674 CHECKS=2180110	SAT TT=2.061 ASSIGNMENTS=6190 CHECKS=830662	SAT TT=124.163	SAT TT=4.202 ASSIGNMENTS=2508 CHECKS=2458310	SAT TT=105.547	SAT TT=5.906
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-24_ext.xml	SAT TT=23.739	SAT TT=351.127 CHECKS=2037280 NODES=199257	SAT TT=347.809 CHECKS=2027320 NODES=201359	SAT TT=92.721	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT TT=122.106 ASSIGNMENTS=10812	SAT TT=1394.9 ASSIGNMENTS=86742	SAT TT=85.771 CHECKS=277209000 NODES=228591	SAT TT=512.32 CHECKS=4709690000 NODES=14160800	? (TO) TT=1800.02	SAT TT=38.934 ASSIGNMENTS=111102 CHECKS=15736600	SAT TT=39.156 ASSIGNMENTS=111102 CHECKS=15736600	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=45.303 CHECKS=7728420	SAT TT=23.739 ASSIGNMENTS=85907 CHECKS=11807200	SAT TT=24.27 ASSIGNMENTS=90260 CHECKS=12154300	SAT TT=48.375	SAT TT=49.905 ASSIGNMENTS=183718 CHECKS=24853400	SAT TT=31.354 ASSIGNMENTS=111102 CHECKS=15736600	SAT TT=426.393	SAT TT=157.472 ASSIGNMENTS=54067 CHECKS=48743500	SAT TT=1054.61	SAT TT=751.372
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-29_ext.xml	SAT TT=8.074	SAT TT=115.246 CHECKS=471852 NODES=65088	SAT TT=109.938 CHECKS=472954 NODES=63621	SAT TT=418.957	SAT TT=970.919 CHECKS=9477920	SAT TT=1523.12 CHECKS=15327900	SAT TT=246.059 ASSIGNMENTS=20214	SAT TT=632.763 ASSIGNMENTS=26091	SAT TT=8.074 CHECKS=24624200 NODES=17139	SAT TT=17.173 CHECKS=132305000 NODES=428279	? (TO) TT=1800.04	SAT TT=24.442 ASSIGNMENTS=56512 CHECKS=8323060	SAT TT=24.743 ASSIGNMENTS=56512 CHECKS=8323060	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=8.743 CHECKS=1391130	SAT TT=18.546 ASSIGNMENTS=62480 CHECKS=9228670	SAT TT=16.403 ASSIGNMENTS=55475 CHECKS=8048100	SAT TT=73.224	SAT TT=18.761 ASSIGNMENTS=64524 CHECKS=9448730	SAT TT=16.636 ASSIGNMENTS=56512 CHECKS=8323060	SAT TT=160.148	SAT TT=46.384 ASSIGNMENTS=22115 CHECKS=21010900	SAT TT=92.7	SAT TT=321.189
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-2_ext.xml	UNSAT TT=20.353	UNSAT TT=191.594 CHECKS=813583 NODES=73055	UNSAT TT=188.198 CHECKS=803442 NODES=72060	UNSAT TT=245.796	UNSAT TT=1425.09 CHECKS=10886200	UNSAT TT=1354.4 CHECKS=10128100	UNSAT TT=252.684 ASSIGNMENTS=26692	? (TO) TT=1800.37	UNSAT TT=32.094 CHECKS=101536000 NODES=78269	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=28.435 ASSIGNMENTS=70786 CHECKS=9233930	UNSAT TT=29.41 ASSIGNMENTS=70786 CHECKS=9233930	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=27.057 CHECKS=3704390	UNSAT TT=21.258 ASSIGNMENTS=71247 CHECKS=9402740	UNSAT TT=22 ASSIGNMENTS=75954 CHECKS=9717350	UNSAT TT=138.9	UNSAT TT=20.353 ASSIGNMENTS=67488 CHECKS=8752720	UNSAT TT=20.799 ASSIGNMENTS=70786 CHECKS=9233930	UNSAT TT=326.885	UNSAT TT=122.99 ASSIGNMENTS=81118 CHECKS=82925500	UNSAT TT=233.088	UNSAT TT=268.405
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-30_ext.xml	UNSAT TT=29.726	? (TO) TT=1800.12	? (TO) TT=1800.06	UNSAT TT=638.201	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=457.654 ASSIGNMENTS=36609	? (TO) TT=1800.08	UNSAT TT=52.626 CHECKS=178271000 NODES=113838	? (TO) TT=1800.09	? (TO) TT=1800	UNSAT TT=40.118 ASSIGNMENTS=105662 CHECKS=15513100	UNSAT TT=40.49 ASSIGNMENTS=105662 CHECKS=15513100	? (TO) TT=1800	? (TO) TT=1800.01	UNSAT TT=41.254 CHECKS=6755490	UNSAT TT=29.726 ASSIGNMENTS=98415 CHECKS=14037300	UNSAT TT=32.413 ASSIGNMENTS=103807 CHECKS=15234400	UNSAT TT=294.099	UNSAT TT=30.541 ASSIGNMENTS=101583 CHECKS=14396300	UNSAT TT=31.768 ASSIGNMENTS=105662 CHECKS=15513100	UNSAT TT=879.929	UNSAT TT=195.641 ASSIGNMENTS=108641 CHECKS=111872000	UNSAT TT=742.052	UNSAT TT=866.057
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-32_ext.xml	SAT TT=2.057	SAT TT=41.669 CHECKS=197377 NODES=30327	SAT TT=46.488 CHECKS=201368 NODES=30927	SAT TT=7.698	SAT TT=183.894 CHECKS=1531800	SAT TT=266.207 CHECKS=2624720	SAT TT=22.064 ASSIGNMENTS=2177	SAT TT=296.425 ASSIGNMENTS=16727	SAT TT=5.42 CHECKS=12565700 NODES=10889	SAT TT=319.145 CHECKS=2878600000 NODES=9453320	? (TO) TT=1800.06	SAT TT=10.849 ASSIGNMENTS=13570 CHECKS=1770420	SAT TT=48.987 ASSIGNMENTS=30327 CHECKS=197377	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=5.247 CHECKS=788113	SAT TT=2.057 ASSIGNMENTS=7944 CHECKS=1018320	SAT TT=1.062 ASSIGNMENTS=5174 CHECKS=461528	SAT TT=25.587	SAT TT=2.217 ASSIGNMENTS=8731 CHECKS=1098760	SAT TT=3.718 ASSIGNMENTS=13570 CHECKS=1770420	SAT TT=84.41	SAT TT=1.614 ASSIGNMENTS=246 CHECKS=189489	SAT TT=18.553	SAT TT=6.945
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-35_ext.xml	UNSAT TT=14.923	UNSAT TT=177.933 CHECKS=1229840 NODES=95282	UNSAT TT=180.691 CHECKS=1239280 NODES=99435	UNSAT TT=145.585	UNSAT TT=1594.31 CHECKS=15486700	UNSAT TT=1466.12 CHECKS=12984200	UNSAT TT=280.378 ASSIGNMENTS=28467	UNSAT TT=660.541 ASSIGNMENTS=27366	UNSAT TT=38.371 CHECKS=134376000 NODES=94189	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=24.043 ASSIGNMENTS=62576 CHECKS=7695370	UNSAT TT=170.135 ASSIGNMENTS=95282 CHECKS=1229840	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=29.718 CHECKS=4814120	UNSAT TT=16.999 ASSIGNMENTS=64431 CHECKS=8009630	UNSAT TT=16.182 ASSIGNMENTS=68546 CHECKS=8131340	UNSAT TT=225.412	UNSAT TT=16.168 ASSIGNMENTS=66161 CHECKS=8040780	UNSAT TT=14.923 ASSIGNMENTS=62576 CHECKS=7695370	UNSAT TT=866.154	UNSAT TT=142.079 ASSIGNMENTS=75920 CHECKS=62549100	UNSAT TT=401.376	UNSAT TT=567.157
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-38_ext.xml	UNSAT TT=5.807	UNSAT TT=53.413 CHECKS=215499 NODES=25908	UNSAT TT=60.237 CHECKS=212357 NODES=25941	UNSAT TT=123.316	UNSAT TT=485.288 CHECKS=4543830	UNSAT TT=384.991 CHECKS=3245650	UNSAT TT=81.624 ASSIGNMENTS=8210	UNSAT TT=65.005 ASSIGNMENTS=5235	UNSAT TT=11.811 CHECKS=40126300 NODES=28501	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=14.409 ASSIGNMENTS=24247 CHECKS=2910300	UNSAT TT=14.359 ASSIGNMENTS=24247 CHECKS=2910300	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=8.877 CHECKS=1317180	UNSAT TT=5.807 ASSIGNMENTS=22552 CHECKS=2586670	UNSAT TT=5.394 ASSIGNMENTS=22856 CHECKS=2503030	UNSAT TT=41.103	UNSAT TT=7.227 ASSIGNMENTS=26108 CHECKS=3026200	UNSAT TT=6.707 ASSIGNMENTS=24247 CHECKS=2910300	UNSAT TT=78.01	UNSAT TT=43.614 ASSIGNMENTS=21566 CHECKS=19933100	UNSAT TT=56.431	UNSAT TT=63.612
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-39_ext.xml	UNSAT TT=67.973	UNSAT TT=1363.79 CHECKS=13209800 NODES=1051130	UNSAT TT=1536.39 CHECKS=13788500 NODES=1053120	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=1688.88 ASSIGNMENTS=109966	? (TO) TT=1800.13	UNSAT TT=111.655 CHECKS=398504000 NODES=315598	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=72.782 ASSIGNMENTS=255175 CHECKS=36260000	UNSAT TT=78.592 ASSIGNMENTS=255175 CHECKS=36260000	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=97.215 CHECKS=20283200	UNSAT TT=67.973 ASSIGNMENTS=259399 CHECKS=37254100	UNSAT TT=70.33 ASSIGNMENTS=257884 CHECKS=36468200	UNSAT TT=574.627	UNSAT TT=72.67 ASSIGNMENTS=258653 CHECKS=37191000	UNSAT TT=70.86 ASSIGNMENTS=255175 CHECKS=36260000	? (TO) TT=1800.11	UNSAT TT=650.736 ASSIGNMENTS=391673 CHECKS=300469000	? (TO) TT=1800.03	? (TO) TT=1800.09
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-3_ext.xml	UNSAT TT=53.99	UNSAT TT=451.068 CHECKS=2603780 NODES=257898	UNSAT TT=462.118 CHECKS=2638640 NODES=256866	UNSAT TT=429.481	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=1038.48 ASSIGNMENTS=101388	UNSAT TT=689.809 ASSIGNMENTS=48468	UNSAT TT=117.943 CHECKS=408418000 NODES=348597	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=69.115 ASSIGNMENTS=260176 CHECKS=35732800	UNSAT TT=73.657 ASSIGNMENTS=260176 CHECKS=35732800	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=97.953 CHECKS=18327100	UNSAT TT=55.71 ASSIGNMENTS=236597 CHECKS=27828000	UNSAT TT=54.023 ASSIGNMENTS=240937 CHECKS=28254000	UNSAT TT=432.879	UNSAT TT=53.99 ASSIGNMENTS=231953 CHECKS=26592600	UNSAT TT=64.902 ASSIGNMENTS=260176 CHECKS=35732800	? (TO) TT=1800.68	UNSAT TT=330.757 ASSIGNMENTS=289055 CHECKS=211540000	? (TO) TT=1800.06	? (TO) TT=1800.13
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-41_ext.xml	SAT TT=4.577	SAT TT=344.527 CHECKS=2384140 NODES=216906	SAT TT=369.092 CHECKS=2472970 NODES=233846	SAT TT=823.406	SAT TT=163.579 CHECKS=1330060	? (TO) TT=1800.04	SAT TT=76.577 ASSIGNMENTS=5804	SAT TT=395.322 ASSIGNMENTS=16596	SAT TT=15.853 CHECKS=48097500 NODES=38713	SAT TT=521.448 CHECKS=4718830000 NODES=14643800	? (TO) TT=1800.08	SAT TT=12.484 ASSIGNMENTS=15952 CHECKS=2435100	SAT TT=12.642 ASSIGNMENTS=15952 CHECKS=2435100	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=37.779 CHECKS=7127880	SAT TT=4.626 ASSIGNMENTS=16195 CHECKS=2450860	SAT TT=17.184 ASSIGNMENTS=63350 CHECKS=9216630	SAT TT=26.018	SAT TT=29.65 ASSIGNMENTS=104093 CHECKS=15987000	SAT TT=4.577 ASSIGNMENTS=15952 CHECKS=2435100	SAT TT=1438.76	SAT TT=31.257 ASSIGNMENTS=5715 CHECKS=4154870	? (TO) TT=1800.05	SAT TT=1209.76
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-43_ext.xml	UNSAT TT=4.81	UNSAT TT=563.699 CHECKS=4068710 NODES=305123	UNSAT TT=549.332 CHECKS=4034440 NODES=304687	UNSAT TT=76.9	UNSAT TT=474.619 CHECKS=4620100	UNSAT TT=417.128 CHECKS=4188780	UNSAT TT=81.677 ASSIGNMENTS=9308	UNSAT TT=146.347 ASSIGNMENTS=9163	UNSAT TT=11.905 CHECKS=37927500 NODES=25739	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=12.28 ASSIGNMENTS=17885 CHECKS=2151410	UNSAT TT=558.824 ASSIGNMENTS=305123 CHECKS=4068710	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=6.338 CHECKS=1203520	UNSAT TT=4.81 ASSIGNMENTS=18446 CHECKS=2201190	UNSAT TT=6.289 ASSIGNMENTS=24706 CHECKS=2847740	UNSAT TT=30.351	UNSAT TT=5.272 ASSIGNMENTS=18908 CHECKS=2284210	UNSAT TT=4.823 ASSIGNMENTS=17885 CHECKS=2151410	UNSAT TT=131.312	UNSAT TT=44.315 ASSIGNMENTS=37251 CHECKS=29528600	UNSAT TT=115.974	UNSAT TT=93.167
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-44_ext.xml	UNSAT TT=16.422	UNSAT TT=496.627 CHECKS=3173140 NODES=300530	UNSAT TT=500.128 CHECKS=3122440 NODES=298726	UNSAT TT=166.139	UNSAT TT=1379.74 CHECKS=12707800	UNSAT TT=1520.16 CHECKS=14071700	UNSAT TT=314.88 ASSIGNMENTS=25135	UNSAT TT=963.24 ASSIGNMENTS=65938	UNSAT TT=30.902 CHECKS=109830000 NODES=83156	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=25.266 ASSIGNMENTS=62513 CHECKS=8026530	UNSAT TT=467.693 ASSIGNMENTS=300530 CHECKS=3173140	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=24.318 CHECKS=4020290	UNSAT TT=17.41 ASSIGNMENTS=61667 CHECKS=8073300	UNSAT TT=17.819 ASSIGNMENTS=61149 CHECKS=8198580	UNSAT TT=119.128	UNSAT TT=16.422 ASSIGNMENTS=63842 CHECKS=8229290	UNSAT TT=16.984 ASSIGNMENTS=62513 CHECKS=8026530	UNSAT TT=393.673	UNSAT TT=112.784 ASSIGNMENTS=79627 CHECKS=69152900	UNSAT TT=306.755	UNSAT TT=377.648
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-45_ext.xml	UNSAT TT=16.229	UNSAT TT=247.54 CHECKS=1203630 NODES=126228	UNSAT TT=260.811 CHECKS=1300780 NODES=135178	UNSAT TT=208.585	UNSAT TT=1278.74 CHECKS=11384500	UNSAT TT=1415.92 CHECKS=12175900	UNSAT TT=224.903 ASSIGNMENTS=12873	UNSAT TT=208.278 ASSIGNMENTS=10229	UNSAT TT=26.997 CHECKS=85455800 NODES=58529	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=24.242 ASSIGNMENTS=51288 CHECKS=7521620	UNSAT TT=24.467 ASSIGNMENTS=51288 CHECKS=7521620	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=23.05 CHECKS=3745910	UNSAT TT=16.487 ASSIGNMENTS=52753 CHECKS=7656360	UNSAT TT=14.49 ASSIGNMENTS=53506 CHECKS=7017530	UNSAT TT=101.656	UNSAT TT=16.901 ASSIGNMENTS=53017 CHECKS=7680850	UNSAT TT=16.229 ASSIGNMENTS=51288 CHECKS=7521620	UNSAT TT=296.435	UNSAT TT=105.239 ASSIGNMENTS=72248 CHECKS=60444300	UNSAT TT=196.769	UNSAT TT=219.067
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-47_ext.xml	SAT TT=15.225	SAT TT=21.088 CHECKS=86550 NODES=13119	SAT TT=23.519 CHECKS=88283 NODES=13705	SAT TT=29.179	SAT TT=668.727 CHECKS=6120980	SAT TT=1169.92 CHECKS=11141000	SAT TT=91.076 ASSIGNMENTS=9896	SAT TT=182.52 ASSIGNMENTS=12086	SAT TT=15.225 CHECKS=50678000 NODES=40996	SAT TT=518.695 CHECKS=4670210000 NODES=14393100	? (TO) TT=1800.08	SAT TT=29.998 ASSIGNMENTS=83717 CHECKS=10993600	SAT TT=30.353 ASSIGNMENTS=83717 CHECKS=10993600	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=64.386 CHECKS=12030400	SAT TT=23.237 ASSIGNMENTS=90068 CHECKS=11569100	SAT TT=24.216 ASSIGNMENTS=97474 CHECKS=12911500	SAT TT=105.138	SAT TT=24.27 ASSIGNMENTS=95611 CHECKS=13047000	SAT TT=22.047 ASSIGNMENTS=83717 CHECKS=10993600	SAT TT=238.232	SAT TT=3.599 ASSIGNMENTS=264 CHECKS=179878	SAT TT=207.208	SAT TT=196.701
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-49_ext.xml	SAT TT=23.162	SAT TT=461.365 CHECKS=3419990 NODES=350432	SAT TT=424.376 CHECKS=2972600 NODES=312744	SAT TT=151.627	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=799.517 ASSIGNMENTS=69861	SAT TT=445.183 ASSIGNMENTS=28400	SAT TT=94.903 CHECKS=309977000 NODES=249275	SAT TT=1433.8 CHECKS=12876300000 NODES=41573100	? (TO) TT=1800.03	SAT TT=60.577 ASSIGNMENTS=204211 CHECKS=27863600	SAT TT=60.707 ASSIGNMENTS=204211 CHECKS=27863600	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=118.974 CHECKS=21136400	SAT TT=23.162 ASSIGNMENTS=92390 CHECKS=11832200	SAT TT=44.007 ASSIGNMENTS=178729 CHECKS=22781400	SAT TT=344	SAT TT=24.014 ASSIGNMENTS=96212 CHECKS=12296800	SAT TT=51.604 ASSIGNMENTS=204211 CHECKS=27863600	? (TO) TT=1800.12	SAT TT=145.811 ASSIGNMENTS=76976 CHECKS=60853400	SAT TT=1147.78	SAT TT=1150.55
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-4_ext.xml	SAT TT=2.879	SAT TT=839.47 CHECKS=3610250 NODES=435071	SAT TT=865.074 CHECKS=3591940 NODES=436382	SAT TT=108.257	SAT TT=930.371 CHECKS=9331280	SAT TT=775.946 CHECKS=7718260	SAT TT=264.217 ASSIGNMENTS=22824	SAT TT=766.715 ASSIGNMENTS=31568	SAT TT=3.879 CHECKS=6355050 NODES=5336	SAT TT=128.386 CHECKS=1087490000 NODES=3392360	? (TO) TT=1800.07	SAT TT=13.456 ASSIGNMENTS=20999 CHECKS=3058230	SAT TT=13.225 ASSIGNMENTS=20999 CHECKS=3058230	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=31.182 CHECKS=6406330	SAT TT=5.044 ASSIGNMENTS=19267 CHECKS=2802990	SAT TT=5.876 ASSIGNMENTS=24014 CHECKS=3264310	SAT TT=29.4	SAT TT=2.879 ASSIGNMENTS=10731 CHECKS=1541390	SAT TT=5.51 ASSIGNMENTS=20999 CHECKS=3058230	SAT TT=468.712	SAT TT=86.524 ASSIGNMENTS=53876 CHECKS=44026600	SAT TT=561.944	SAT TT=133.791
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-6_ext.xml	UNSAT TT=9.703	UNSAT TT=716.651 CHECKS=3662910 NODES=372345	UNSAT TT=764.905 CHECKS=3714460 NODES=392500	UNSAT TT=96.513	UNSAT TT=869.304 CHECKS=7536960	UNSAT TT=936.193 CHECKS=8117110	UNSAT TT=193.382 ASSIGNMENTS=14512	UNSAT TT=474.067 ASSIGNMENTS=26431	UNSAT TT=20.797 CHECKS=68839700 NODES=42529	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=17.897 ASSIGNMENTS=31503 CHECKS=4330880	UNSAT TT=18.153 ASSIGNMENTS=31503 CHECKS=4330880	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=12.515 CHECKS=2009250	UNSAT TT=9.703 ASSIGNMENTS=29893 CHECKS=4158980	UNSAT TT=9.884 ASSIGNMENTS=33097 CHECKS=4385950	UNSAT TT=76.048	UNSAT TT=10.167 ASSIGNMENTS=30675 CHECKS=4349160	UNSAT TT=10.03 ASSIGNMENTS=31503 CHECKS=4330880	UNSAT TT=218.769	UNSAT TT=90.967 ASSIGNMENTS=53223 CHECKS=44188000	UNSAT TT=120.959	UNSAT TT=175.442
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-7_ext.xml	SAT TT=1.83	SAT TT=497.083 CHECKS=3207590 NODES=254309	SAT TT=495.171 CHECKS=3055150 NODES=239741	SAT TT=1240.29	? (TO) TT=1800.01	SAT TT=1352.75 CHECKS=13292100	SAT TT=249.967 ASSIGNMENTS=24938	SAT TT=276.603 ASSIGNMENTS=16647	SAT TT=30.019 CHECKS=106011000 NODES=77061	SAT TT=105.573 CHECKS=873610000 NODES=2800650	? (TO) TT=1800.1	SAT TT=22.069 ASSIGNMENTS=49062 CHECKS=7196390	SAT TT=22.075 ASSIGNMENTS=49062 CHECKS=7196390	? (TO) TT=1800.07	SAT TT=1582.62	SAT TT=1.83 CHECKS=316131	SAT TT=14.241 ASSIGNMENTS=48723 CHECKS=7143290	SAT TT=25.482 ASSIGNMENTS=86414 CHECKS=13464600	SAT TT=131.388	SAT TT=14.699 ASSIGNMENTS=50830 CHECKS=7188610	SAT TT=14.604 ASSIGNMENTS=49062 CHECKS=7196390	SAT TT=851.241	SAT TT=68.13 ASSIGNMENTS=26506 CHECKS=23103900	SAT TT=47.32	SAT TT=123.466
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-10_ext.xml	SAT TT=1175.69	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT TT=1663 CHECKS=5779840000 NODES=3811780	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=1392.03 ASSIGNMENTS=3594500 CHECKS=595561000	SAT TT=1437.01 ASSIGNMENTS=3594500 CHECKS=595561000	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=1258.89 CHECKS=198157000	SAT TT=1200.24 ASSIGNMENTS=3551390 CHECKS=589466000	SAT TT=1060.79 ASSIGNMENTS=3308160 CHECKS=555674000	? (TO) TT=1800.08	SAT TT=1175.69 ASSIGNMENTS=3658490 CHECKS=609397000	SAT TT=1216.69 ASSIGNMENTS=3594500 CHECKS=595561000	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-11_ext.xml	SAT TT=49.784	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=459.482 CHECKS=1579280000 NODES=861058	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=174.862 ASSIGNMENTS=342393 CHECKS=55194200	SAT TT=363.208 ASSIGNMENTS=342393 CHECKS=55194200	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=49.784 CHECKS=6376950	SAT TT=84.156 ASSIGNMENTS=244398 CHECKS=39832700	SAT TT=459.896 ASSIGNMENTS=1239750 CHECKS=198103000	? (TO) TT=1800.04	SAT TT=434.274 ASSIGNMENTS=1081330 CHECKS=184858000	SAT TT=126.25 ASSIGNMENTS=342393 CHECKS=55194200	? (TO) TT=1800.17	SAT TT=336.38 ASSIGNMENTS=104569 CHECKS=124461000	? (TO) TT=1800	? (TO) TT=1800.08
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-13_ext.xml	SAT TT=438.384	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.14	SAT TT=790.624 CHECKS=2744030000 NODES=1993470	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=555.579 ASSIGNMENTS=1607010 CHECKS=251029000	SAT TT=588.333 ASSIGNMENTS=1607010 CHECKS=251029000	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=994.102 CHECKS=129947000	SAT TT=530.893 ASSIGNMENTS=1628140 CHECKS=251808000	SAT TT=521.688 ASSIGNMENTS=1737890 CHECKS=263692000	? (TO) TT=1800.03	SAT TT=438.384 ASSIGNMENTS=1277280 CHECKS=206297000	SAT TT=535.56 ASSIGNMENTS=1607010 CHECKS=251029000	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-1_ext.xml	SAT TT=315.984	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.17	SAT TT=1334.14 CHECKS=4597960000 NODES=3070580	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=379.195 ASSIGNMENTS=1118160 CHECKS=195820000	SAT TT=422.148 ASSIGNMENTS=1118160 CHECKS=195820000	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=315.984 ASSIGNMENTS=1008780 CHECKS=179527000	SAT TT=347.359 ASSIGNMENTS=1038290 CHECKS=183563000	? (TO) TT=1800.07	SAT TT=337.36 ASSIGNMENTS=1013180 CHECKS=180278000	SAT TT=372.976 ASSIGNMENTS=1118160 CHECKS=195820000	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.12
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-20_ext.xml	SAT TT=104.09	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=1240.26 ASSIGNMENTS=69864	? (TO) TT=1800.13	SAT TT=255.613 CHECKS=853529000 NODES=478705	SAT TT=1512.46 CHECKS=14457000000 NODES=34063100	? (TO) TT=1800.08	SAT TT=187.547 ASSIGNMENTS=373262 CHECKS=63173500	SAT TT=178.339 ASSIGNMENTS=373262 CHECKS=63173500	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=104.09 CHECKS=17040900	SAT TT=150.946 ASSIGNMENTS=401635 CHECKS=66231000	SAT TT=162.26 ASSIGNMENTS=429689 CHECKS=70467800	SAT TT=1432.45	SAT TT=161.034 ASSIGNMENTS=429838 CHECKS=70602800	SAT TT=130.92 ASSIGNMENTS=373262 CHECKS=63173500	? (TO) TT=1800.17	SAT TT=800.219 ASSIGNMENTS=314840 CHECKS=360018000	? (TO) TT=1800	? (TO) TT=1800.07
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-21_ext.xml	SAT TT=43.043	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=639.023 ASSIGNMENTS=33084	SAT TT=881.896 ASSIGNMENTS=31176	SAT TT=304.446 CHECKS=1147240000 NODES=614931	SAT TT=255.211 CHECKS=2215460000 NODES=5537430	? (TO) TT=1800.08	SAT TT=85.124 ASSIGNMENTS=178497 CHECKS=26841900	SAT TT=144.151 ASSIGNMENTS=178497 CHECKS=26841900	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=43.043 CHECKS=6061610	SAT TT=62.03 ASSIGNMENTS=185535 CHECKS=27644400	SAT TT=210.066 ASSIGNMENTS=559854 CHECKS=88333400	SAT TT=667.448	SAT TT=193.689 ASSIGNMENTS=540033 CHECKS=83963200	SAT TT=58.99 ASSIGNMENTS=178497 CHECKS=26841900	SAT TT=295.224	SAT TT=621.029 ASSIGNMENTS=159811 CHECKS=194078000	? (TO) TT=1800.03	SAT TT=895.104
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-23_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.19	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-28_ext.xml	SAT TT=5.386	SAT TT=30.577 CHECKS=48404 NODES=8486	SAT TT=41.704 CHECKS=67071 NODES=10147	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=878.487 CHECKS=5282720	SAT TT=86.146 ASSIGNMENTS=5521	SAT TT=592.377 ASSIGNMENTS=29010	SAT TT=31.32 CHECKS=109525000 NODES=63890	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=39.996 ASSIGNMENTS=8486 CHECKS=48404	SAT TT=37.597 ASSIGNMENTS=8486 CHECKS=48404	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=37.281 CHECKS=4635370	SAT TT=5.696 ASSIGNMENTS=15048 CHECKS=2297700	SAT TT=27.917 ASSIGNMENTS=82956 CHECKS=11893200	SAT TT=57.089	SAT TT=13.708 ASSIGNMENTS=38096 CHECKS=5773710	SAT TT=5.386 ASSIGNMENTS=14563 CHECKS=2207210	SAT TT=221.7	SAT TT=1527.46 ASSIGNMENTS=553897 CHECKS=737512000	SAT TT=1274.65	? (TO) TT=1800.12
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-30_ext.xml	SAT TT=520.741	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=1340.13 ASSIGNMENTS=3618260 CHECKS=606083000	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=520.741 CHECKS=76471700	SAT TT=1194.61 ASSIGNMENTS=3378650 CHECKS=577106000	SAT TT=1164.94 ASSIGNMENTS=3420700 CHECKS=582879000	? (TO) TT=1800.03	SAT TT=1226.86 ASSIGNMENTS=3407870 CHECKS=583347000	SAT TT=1182.6 ASSIGNMENTS=3618260 CHECKS=606083000	? (TO) TT=1800.18	SAT TT=610.951 ASSIGNMENTS=261864 CHECKS=264345000	? (TO) TT=1800.01	? (TO) TT=1800.05
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-31_ext.xml	SAT TT=41.487	? (TO) TT=1800.08	? (TO) TT=1800.15	SAT TT=1764.24	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=80.016 ASSIGNMENTS=5712	? (TO) TT=1800.06	SAT TT=618.56 CHECKS=2313590000 NODES=1335260	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=66.511 ASSIGNMENTS=120660 CHECKS=20011500	SAT TT=124.138 ASSIGNMENTS=120660 CHECKS=20011500	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=72.069 CHECKS=11269500	SAT TT=41.487 ASSIGNMENTS=113087 CHECKS=18671800	SAT TT=259.71 ASSIGNMENTS=742152 CHECKS=117390000	SAT TT=297.565	SAT TT=249.123 ASSIGNMENTS=749100 CHECKS=119042000	SAT TT=43.551 ASSIGNMENTS=120660 CHECKS=20011500	SAT TT=1011.34	SAT TT=379.814 ASSIGNMENTS=193316 CHECKS=186480000	? (TO) TT=1800.02	? (TO) TT=1800.11
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-32_ext.xml	SAT TT=28.434	SAT TT=753.537 CHECKS=4163700 NODES=353411	SAT TT=877.236 CHECKS=4524170 NODES=368064	? (TO) TT=1800.12	SAT TT=239.951 CHECKS=1180250	? (TO) TT=1800.03	SAT TT=441.255 ASSIGNMENTS=31533	? (TO) TT=1800.18	SAT TT=188.59 CHECKS=621256000 NODES=407417	? (TO) TT=1800	? (TO) TT=1800	SAT TT=36.03 ASSIGNMENTS=87234 CHECKS=15754200	SAT TT=72.442 ASSIGNMENTS=87234 CHECKS=15754200	? (TO) TT=1800.01	? (TO) TT=1800	SAT TT=400.078 CHECKS=67135700	SAT TT=30.796 ASSIGNMENTS=87874 CHECKS=15500800	SAT TT=23.167 ASSIGNMENTS=68005 CHECKS=11943000	SAT TT=613.591	SAT TT=937.348 ASSIGNMENTS=2880300 CHECKS=510628000	SAT TT=28.434 ASSIGNMENTS=87234 CHECKS=15754200	? (TO) TT=1800.15	SAT TT=450.024 ASSIGNMENTS=108999 CHECKS=106957000	? (TO) TT=1800.1	? (TO) TT=1800.15
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-34_ext.xml	SAT TT=195.03	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=1780.51 ASSIGNMENTS=130071	? (TO) TT=1800.13	SAT TT=762.384 CHECKS=2720890000 NODES=1689170	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=486.768 ASSIGNMENTS=1380260 CHECKS=228372000	SAT TT=548.507 ASSIGNMENTS=1380260 CHECKS=228372000	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=725.684 CHECKS=98500400	SAT TT=195.03 ASSIGNMENTS=493929 CHECKS=85066300	SAT TT=304.859 ASSIGNMENTS=838806 CHECKS=144092000	? (TO) TT=1800.06	SAT TT=229.444 ASSIGNMENTS=628886 CHECKS=103720000	SAT TT=467.405 ASSIGNMENTS=1380260 CHECKS=228372000	SAT TT=933.528	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-35_ext.xml	SAT TT=3.588	SAT TT=38.759 CHECKS=63974 NODES=12597	SAT TT=37.939 CHECKS=60518 NODES=12009	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.13	SAT TT=271.405 CHECKS=957750000 NODES=493397	SAT TT=688.812 CHECKS=6385440000 NODES=15610900	? (TO) TT=1800.01	SAT TT=45.411 ASSIGNMENTS=12597 CHECKS=63974	SAT TT=47.16 ASSIGNMENTS=12597 CHECKS=63974	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=85.445 CHECKS=11709600	SAT TT=28.86 ASSIGNMENTS=75890 CHECKS=12291700	SAT TT=26.182 ASSIGNMENTS=71481 CHECKS=11721800	SAT TT=357.767	SAT TT=3.588 ASSIGNMENTS=9954 CHECKS=1497860	SAT TT=26.218 ASSIGNMENTS=75687 CHECKS=12214700	SAT TT=115.57	SAT TT=83.37 ASSIGNMENTS=26532 CHECKS=29364800	? (TO) TT=1800.07	? (TO) TT=1800.07
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-39_ext.xml	SAT TT=877.917	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=1353.97 ASSIGNMENTS=3116320 CHECKS=515620000	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=877.917 ASSIGNMENTS=2681600 CHECKS=448175000	SAT TT=312.346 ASSIGNMENTS=993825 CHECKS=159059000	? (TO) TT=1800.1	SAT TT=1113.92 ASSIGNMENTS=3208300 CHECKS=530132000	SAT TT=1036.67 ASSIGNMENTS=3116320 CHECKS=515620000	? (TO) TT=1800.19	SAT TT=697.934 ASSIGNMENTS=331448 CHECKS=327548000	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-3_ext.xml	SAT TT=333.966	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.09	SAT TT=651.981 CHECKS=2104920000 NODES=1412540	SAT TT=691.466 CHECKS=6515270000 NODES=16190400	? (TO) TT=1800.08	SAT TT=695.224 ASSIGNMENTS=1862400 CHECKS=291695000	SAT TT=753.7 ASSIGNMENTS=1862400 CHECKS=291695000	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=457.031 CHECKS=64749100	SAT TT=688.729 ASSIGNMENTS=1935400 CHECKS=304166000	SAT TT=697.053 ASSIGNMENTS=1940180 CHECKS=303002000	? (TO) TT=1800.05	SAT TT=670.374 ASSIGNMENTS=1890630 CHECKS=296777000	SAT TT=611.297 ASSIGNMENTS=1862400 CHECKS=291695000	SAT TT=333.966	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.14
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-40_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-42_ext.xml	SAT TT=94.539	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=976.551 ASSIGNMENTS=65257	? (TO) TT=1800.09	SAT TT=164.08 CHECKS=549363000 NODES=301050	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=336.601 ASSIGNMENTS=644331 CHECKS=113958000	SAT TT=338.839 ASSIGNMENTS=644331 CHECKS=113958000	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=94.539 CHECKS=13923000	SAT TT=261.868 ASSIGNMENTS=650221 CHECKS=115021000	SAT TT=260.436 ASSIGNMENTS=651434 CHECKS=114754000	? (TO) TT=1800.04	SAT TT=258.795 ASSIGNMENTS=646850 CHECKS=114359000	SAT TT=255.456 ASSIGNMENTS=644331 CHECKS=113958000	SAT TT=510.255	SAT TT=1198.72 ASSIGNMENTS=434179 CHECKS=454732000	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-43_ext.xml	SAT TT=533.821	SAT TT=1016.46 CHECKS=3170160 NODES=321504	SAT TT=1013.21 CHECKS=3237580 NODES=331577	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=1017.02 ASSIGNMENTS=3116420 CHECKS=493669000	SAT TT=1067.02 ASSIGNMENTS=3116420 CHECKS=493669000	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=533.821 CHECKS=73773000	SAT TT=992.684 ASSIGNMENTS=2958140 CHECKS=469462000	SAT TT=40.362 ASSIGNMENTS=122834 CHECKS=19446100	SAT TT=1221.71	SAT TT=1092.96 ASSIGNMENTS=3326820 CHECKS=523937000	SAT TT=996.186 ASSIGNMENTS=3116420 CHECKS=493669000	SAT TT=1519.74	SAT TT=311.455 ASSIGNMENTS=115732 CHECKS=107620000	? (TO) TT=1800.09	? (TO) TT=1800.14
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-45_ext.xml	SAT TT=85.557	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=750.965	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=1491.19 ASSIGNMENTS=83761	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=123.765 ASSIGNMENTS=240069 CHECKS=42010600	SAT TT=125.293 ASSIGNMENTS=240069 CHECKS=42010600	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=194.473 CHECKS=24216200	SAT TT=86.11 ASSIGNMENTS=234164 CHECKS=40939900	SAT TT=89.883 ASSIGNMENTS=247287 CHECKS=43028900	SAT TT=900.844	SAT TT=274.461 ASSIGNMENTS=742410 CHECKS=130222000	SAT TT=85.557 ASSIGNMENTS=240069 CHECKS=42010600	? (TO) TT=1800.21	SAT TT=178.466 ASSIGNMENTS=61759 CHECKS=73087500	? (TO) TT=1800.06	? (TO) TT=1800.11
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-47_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-50_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.14
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-5_ext.xml	SAT TT=177.164	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.13	SAT TT=212.602 CHECKS=774504000 NODES=467066	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=207.029 ASSIGNMENTS=505351 CHECKS=85203100	SAT TT=223.513 ASSIGNMENTS=505351 CHECKS=85203100	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=219.722 CHECKS=31374900	SAT TT=292.553 ASSIGNMENTS=867409 CHECKS=146853000	SAT TT=319.046 ASSIGNMENTS=866525 CHECKS=147383000	? (TO) TT=1800.05	SAT TT=200.336 ASSIGNMENTS=554002 CHECKS=94919600	SAT TT=177.164 ASSIGNMENTS=505351 CHECKS=85203100	? (TO) TT=1800.19	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-7_ext.xml	SAT TT=24.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.16	SAT TT=509.956 CHECKS=1895100000 NODES=1035350	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=105.515 ASSIGNMENTS=249609 CHECKS=42580200	SAT TT=140.667 ASSIGNMENTS=249609 CHECKS=42580200	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=293.849 CHECKS=43375600	SAT TT=92.739 ASSIGNMENTS=252230 CHECKS=42969700	SAT TT=28.449 ASSIGNMENTS=75386 CHECKS=12609200	? (TO) TT=1800.02	SAT TT=24.05 ASSIGNMENTS=65297 CHECKS=11074200	SAT TT=96.377 ASSIGNMENTS=249609 CHECKS=42580200	? (TO) TT=1800.14	SAT TT=1367.67 ASSIGNMENTS=422765 CHECKS=502169000	? (TO) TT=1800.04	? (TO) TT=1800.1
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-8_ext.xml	SAT TT=116.382	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=716.398 ASSIGNMENTS=43074	? (TO) TT=1800.07	SAT TT=211.953 CHECKS=723271000 NODES=470591	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=143.309 ASSIGNMENTS=387874 CHECKS=63962400	SAT TT=178.96 ASSIGNMENTS=387874 CHECKS=63962400	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=498.845 CHECKS=76018700	SAT TT=144.763 ASSIGNMENTS=405251 CHECKS=69066400	SAT TT=114.012 ASSIGNMENTS=329939 CHECKS=54726400	SAT TT=364.737	SAT TT=116.382 ASSIGNMENTS=320758 CHECKS=55187000	SAT TT=133.624 ASSIGNMENTS=387874 CHECKS=63962400	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.1
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-9_ext.xml	SAT TT=63.86	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.11	SAT TT=401.95 CHECKS=1425760000 NODES=910089	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=66.191 ASSIGNMENTS=195241 CHECKS=31680000	SAT TT=336.823 ASSIGNMENTS=195241 CHECKS=31680000	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=242.707 CHECKS=42648300	SAT TT=180.333 ASSIGNMENTS=574365 CHECKS=87947600	SAT TT=182.952 ASSIGNMENTS=581346 CHECKS=88805100	SAT TT=647.586	SAT TT=195.215 ASSIGNMENTS=601097 CHECKS=93827000	SAT TT=63.86 ASSIGNMENTS=195241 CHECKS=31680000	? (TO) TT=1800.18	SAT TT=530.011 ASSIGNMENTS=143816 CHECKS=175217000	? (TO) TT=1800.05	SAT TT=104.732
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-10_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-14_ext.xml	UNSAT TT=1189.87	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.12	UNSAT TT=1765.64 CHECKS=6136160000 NODES=3646260	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=1525.82 ASSIGNMENTS=3915160 CHECKS=656935000	UNSAT TT=1406.64 ASSIGNMENTS=3915160 CHECKS=656935000	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=1189.87 ASSIGNMENTS=3049140 CHECKS=516583000	UNSAT TT=1125.2 ASSIGNMENTS=3184090 CHECKS=526693000	? (TO) TT=1800.02	UNSAT TT=1486.2 ASSIGNMENTS=4180400 CHECKS=695794000	UNSAT TT=1381.81 ASSIGNMENTS=3915160 CHECKS=656935000	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.05
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-15_ext.xml	SAT TT=289.926	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.12	SAT TT=788.218 CHECKS=2546840000 NODES=1635000	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=380.516 ASSIGNMENTS=1151690 CHECKS=190838000	SAT TT=415.522 ASSIGNMENTS=1151690 CHECKS=190838000	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=413.906 CHECKS=62954300	SAT TT=938.068 ASSIGNMENTS=2995670 CHECKS=504376000	SAT TT=389.745 ASSIGNMENTS=1185320 CHECKS=197072000	? (TO) TT=1800.07	SAT TT=289.926 ASSIGNMENTS=899664 CHECKS=150957000	SAT TT=365.27 ASSIGNMENTS=1151690 CHECKS=190838000	? (TO) TT=1800.2	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-16_ext.xml	SAT TT=66.915	SAT TT=972.124 CHECKS=2902020 NODES=236999	SAT TT=1067.22 CHECKS=2887300 NODES=236735	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=1082.52 ASSIGNMENTS=73395	? (TO) TT=1800.09	SAT TT=133.604 CHECKS=487121000 NODES=270124	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=174.029 ASSIGNMENTS=187751 CHECKS=30917200	SAT TT=156.77 ASSIGNMENTS=187751 CHECKS=30917200	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=173.001 CHECKS=20553600	SAT TT=66.915 ASSIGNMENTS=176358 CHECKS=29362400	SAT TT=89.452 ASSIGNMENTS=225328 CHECKS=35702800	SAT TT=471.946	SAT TT=203.786 ASSIGNMENTS=504525 CHECKS=81862900	SAT TT=75.633 ASSIGNMENTS=187751 CHECKS=30917200	? (TO) TT=1800.19	SAT TT=810.717 ASSIGNMENTS=273813 CHECKS=337352000	? (TO) TT=1800.07	SAT TT=189.566
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-17_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.1
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-18_ext.xml	SAT TT=14.714	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.14	SAT TT=424.938 ASSIGNMENTS=18895	SAT TT=399.236 CHECKS=1489680000 NODES=848448	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=58.412 ASSIGNMENTS=94297 CHECKS=14487400	SAT TT=76.097 ASSIGNMENTS=94297 CHECKS=14487400	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=184.299 CHECKS=28440000	SAT TT=127.146 ASSIGNMENTS=408926 CHECKS=61332100	SAT TT=31.551 ASSIGNMENTS=96046 CHECKS=14440600	SAT TT=1447.27	SAT TT=14.714 ASSIGNMENTS=48479 CHECKS=7507920	SAT TT=31.357 ASSIGNMENTS=94297 CHECKS=14487400	? (TO) TT=1800.14	SAT TT=78.22 ASSIGNMENTS=32743 CHECKS=31455200	? (TO) TT=1800.03	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-19_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.15
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-1_ext.xml	SAT TT=332.942	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	SAT TT=1330.41 CHECKS=4598550000 NODES=3128980	SAT TT=332.942 CHECKS=2985180000 NODES=7072490	? (TO) TT=1800.09	SAT TT=1100.08 ASSIGNMENTS=2092760 CHECKS=344888000	SAT TT=662.567 ASSIGNMENTS=2092760 CHECKS=344888000	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=525.14 ASSIGNMENTS=1727640 CHECKS=297323000	SAT TT=688.96 ASSIGNMENTS=2306620 CHECKS=386398000	? (TO) TT=1800.06	SAT TT=649.594 ASSIGNMENTS=2194430 CHECKS=367924000	SAT TT=615.048 ASSIGNMENTS=2092760 CHECKS=344888000	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.15
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-22_ext.xml	UNSAT TT=187.488	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=369.447 CHECKS=1381200000 NODES=733306	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=216.8 ASSIGNMENTS=530504 CHECKS=84727100	UNSAT TT=251.973 ASSIGNMENTS=530504 CHECKS=84727100	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=297.299 CHECKS=40688100	UNSAT TT=195.117 ASSIGNMENTS=529432 CHECKS=85026100	UNSAT TT=206.876 ASSIGNMENTS=532257 CHECKS=85159800	? (TO) TT=1800.05	UNSAT TT=194.776 ASSIGNMENTS=529864 CHECKS=85010000	UNSAT TT=187.488 ASSIGNMENTS=530504 CHECKS=84727100	? (TO) TT=1800.18	UNSAT TT=1653.39 ASSIGNMENTS=726126 CHECKS=799419000	? (TO) TT=1800.09	? (TO) TT=1800.14
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-32_ext.xml	UNSAT TT=1261.2	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.12	UNSAT TT=1759.56 CHECKS=5843610000 NODES=4007370	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=1368.95 ASSIGNMENTS=4144990 CHECKS=733601000	UNSAT TT=1376.95 ASSIGNMENTS=4144990 CHECKS=733601000	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=1240.94 ASSIGNMENTS=3789800 CHECKS=670223000	? (TO) TT=1800.02	UNSAT TT=1261.2 ASSIGNMENTS=3830900 CHECKS=674816000	UNSAT TT=1356.29 ASSIGNMENTS=4144990 CHECKS=733601000	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-35_ext.xml	SAT TT=256.786	? (TO) TT=1800.15	? (TO) TT=1800.14	SAT TT=449.17	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=779.044 ASSIGNMENTS=47434	? (TO) TT=1800.12	SAT TT=315.929 CHECKS=1113100000 NODES=583763	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=526.616 ASSIGNMENTS=1183130 CHECKS=195661000	SAT TT=528.667 ASSIGNMENTS=1183130 CHECKS=195661000	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=256.786 CHECKS=37686700	SAT TT=434.302 ASSIGNMENTS=1185350 CHECKS=196537000	SAT TT=435.145 ASSIGNMENTS=1168950 CHECKS=196607000	? (TO) TT=1800.05	SAT TT=452.858 ASSIGNMENTS=1198910 CHECKS=204562000	SAT TT=427.237 ASSIGNMENTS=1183130 CHECKS=195661000	? (TO) TT=1800.19	? (TO) TT=1800.1	SAT TT=289.492	? (TO) TT=1800.06
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-36_ext.xml	UNSAT TT=1121.56	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=1691.62 ASSIGNMENTS=4159170 CHECKS=787159000	UNSAT TT=1634.31 ASSIGNMENTS=4159170 CHECKS=787159000	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=1461.17 ASSIGNMENTS=3792260 CHECKS=714179000	UNSAT TT=1592.97 ASSIGNMENTS=4247310 CHECKS=797716000	? (TO) TT=1800.08	UNSAT TT=1121.56 ASSIGNMENTS=3201970 CHECKS=576994000	UNSAT TT=1597.75 ASSIGNMENTS=4159170 CHECKS=787159000	? (TO) TT=1800.19	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.09
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-37_ext.xml	UNSAT TT=1782.01	? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=1782.01 ASSIGNMENTS=5480910 CHECKS=891859000	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.09
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-38_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.12
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-39_ext.xml		? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.09
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-42_ext.xml	UNSAT TT=315.777	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.15	UNSAT TT=528.133 CHECKS=1954180000 NODES=1059700	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=347.313 ASSIGNMENTS=847601 CHECKS=149271000	UNSAT TT=376.032 ASSIGNMENTS=847601 CHECKS=149271000	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=424.838 CHECKS=67321200	UNSAT TT=318.094 ASSIGNMENTS=850407 CHECKS=150091000	UNSAT TT=340.508 ASSIGNMENTS=848415 CHECKS=149978000	? (TO) TT=1800.09	UNSAT TT=315.777 ASSIGNMENTS=852188 CHECKS=150195000	UNSAT TT=330.71 ASSIGNMENTS=847601 CHECKS=149271000	? (TO) TT=1800.18	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-43_ext.xml	UNSAT TT=1403.18	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=1767.77 ASSIGNMENTS=4377020 CHECKS=694205000	UNSAT TT=1760.92 ASSIGNMENTS=4377020 CHECKS=694205000	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=1583.26 ASSIGNMENTS=4585220 CHECKS=724624000	UNSAT TT=1523.95 ASSIGNMENTS=4556530 CHECKS=722177000	? (TO) TT=1800	UNSAT TT=1496.99 ASSIGNMENTS=4593320 CHECKS=724089000	UNSAT TT=1403.18 ASSIGNMENTS=4377020 CHECKS=694205000	? (TO) TT=1800.21	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.11
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-45_ext.xml		? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-47_ext.xml	SAT TT=52.958	SAT TT=52.958 CHECKS=147886 NODES=24765	SAT TT=529.503 CHECKS=2368040 NODES=256801	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.14
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-4_ext.xml	UNSAT TT=147.772	? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.13	UNSAT TT=299.819 CHECKS=991049000 NODES=544085	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=206.123 ASSIGNMENTS=406014 CHECKS=72071500	UNSAT TT=209.829 ASSIGNMENTS=406014 CHECKS=72071500	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=254.99 CHECKS=31567800	UNSAT TT=160.03 ASSIGNMENTS=395435 CHECKS=69895200	UNSAT TT=155.521 ASSIGNMENTS=412359 CHECKS=71974700	UNSAT TT=1177.36	UNSAT TT=147.772 ASSIGNMENTS=361794 CHECKS=67325200	UNSAT TT=152.936 ASSIGNMENTS=406014 CHECKS=72071500	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.15
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-50_ext.xml	SAT TT=1089.38	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=1625.55 ASSIGNMENTS=4903370 CHECKS=869579000	SAT TT=1654.44 ASSIGNMENTS=4903370 CHECKS=869579000	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1089.38 ASSIGNMENTS=3285180 CHECKS=577832000	SAT TT=1104.62 ASSIGNMENTS=3385860 CHECKS=596940000	? (TO) TT=1800.01	SAT TT=1540.77 ASSIGNMENTS=4785960 CHECKS=844026000	SAT TT=1630.13 ASSIGNMENTS=4903370 CHECKS=869579000	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-6_ext.xml	SAT TT=828.509	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800	SAT TT=1117.58 ASSIGNMENTS=3766050 CHECKS=566313000	SAT TT=1379 ASSIGNMENTS=3766050 CHECKS=566313000	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=1612.42 CHECKS=233360000	SAT TT=828.509 ASSIGNMENTS=2731230 CHECKS=415852000	SAT TT=1126.11 ASSIGNMENTS=3752140 CHECKS=569880000	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=1106.22 ASSIGNMENTS=3766050 CHECKS=566313000	? (TO) TT=1800.22	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-7_ext.xml	SAT TT=100.636	? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT TT=367.809 CHECKS=1375380000 NODES=745600	SAT TT=878.014 CHECKS=8213690000 NODES=20393600	? (TO) TT=1800.01	SAT TT=369.099 ASSIGNMENTS=885299 CHECKS=147139000	SAT TT=372.209 ASSIGNMENTS=885299 CHECKS=147139000	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=100.636 CHECKS=16745600	SAT TT=378.166 ASSIGNMENTS=1037930 CHECKS=175382000	SAT TT=341.346 ASSIGNMENTS=907454 CHECKS=151378000	? (TO) TT=1800.03	SAT TT=131.922 ASSIGNMENTS=377309 CHECKS=64405800	SAT TT=304.083 ASSIGNMENTS=885299 CHECKS=147139000	SAT TT=1764.21	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.14
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-8_ext.xml	UNSAT TT=942.283	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.11	UNSAT TT=1374.35 CHECKS=4481680000 NODES=2870580	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=1050.26 ASSIGNMENTS=2911150 CHECKS=497891000	UNSAT TT=1087.82 ASSIGNMENTS=2911150 CHECKS=497891000	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=1349.61 CHECKS=201136000	UNSAT TT=942.283 ASSIGNMENTS=2656040 CHECKS=453383000	UNSAT TT=878.716 ASSIGNMENTS=2694510 CHECKS=458665000	? (TO) TT=1800	UNSAT TT=1010.75 ASSIGNMENTS=2871650 CHECKS=490675000	UNSAT TT=1021.54 ASSIGNMENTS=2911150 CHECKS=497891000	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-9_ext.xml	UNSAT TT=877.378	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=1530.55 CHECKS=5116150000 NODES=3293440	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=877.378 ASSIGNMENTS=2843290 CHECKS=428631000	UNSAT TT=1123.14 ASSIGNMENTS=2843290 CHECKS=428631000	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=1358.89 CHECKS=222572000	UNSAT TT=990.703 ASSIGNMENTS=3017250 CHECKS=491382000	UNSAT TT=856.491 ASSIGNMENTS=2829260 CHECKS=434348000	? (TO) TT=1800.01	UNSAT TT=902.623 ASSIGNMENTS=2766420 CHECKS=420676000	UNSAT TT=901.235 ASSIGNMENTS=2843290 CHECKS=428631000	? (TO) TT=1800.2	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.13
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-10_ext.xml	SAT TT=1604.78	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=1604.78 CHECKS=158321000	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.22	? (TO) TT=1800.11	? (MO) TT=8.38	? (MO) TT=8.38
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-13_ext.xml	SAT TT=1037.51	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=1037.51 CHECKS=115463000	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.05	? (MO) TT=8.44	? (MO) TT=8.432
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-14_ext.xml	SAT TT=235.303	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=235.303 CHECKS=26220500	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.08	? (MO) TT=8.457	? (MO) TT=8.447
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-16_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.16	? (TO) TT=1800.04	? (MO) TT=7.434	? (MO) TT=7.89
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-1_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.11	? (MO) TT=8.07	? (MO) TT=8.24
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-20_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.09	? (MO) TT=8.289	? (MO) TT=7.432
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-21_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.03	? (MO) TT=7.96	? (MO) TT=8.22
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-22_ext.xml	SAT TT=54.867	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=963.567 ASSIGNMENTS=39216	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=977.917 ASSIGNMENTS=124179 CHECKS=22991600	SAT TT=550.681 ASSIGNMENTS=124179 CHECKS=22991600	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=57.027 ASSIGNMENTS=124404 CHECKS=22921900	SAT TT=56.335 ASSIGNMENTS=127682 CHECKS=23355900	SAT TT=201.613	SAT TT=55.388 ASSIGNMENTS=124881 CHECKS=22962600	SAT TT=54.867 ASSIGNMENTS=124179 CHECKS=22991600	? (TO) TT=1800.17	? (TO) TT=1800.1	? (MO) TT=8.54	? (MO) TT=8.23
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-23_ext.xml	SAT TT=57.859	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.07	SAT TT=601.857 CHECKS=1878940000 NODES=1201950	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=67.571 ASSIGNMENTS=150099 CHECKS=29024200	SAT TT=99.54 ASSIGNMENTS=150099 CHECKS=29024200	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=60.118 ASSIGNMENTS=153202 CHECKS=29644700	SAT TT=844.183 ASSIGNMENTS=2263920 CHECKS=426756000	SAT TT=1094.27	SAT TT=993.49 ASSIGNMENTS=2924690 CHECKS=543912000	SAT TT=57.859 ASSIGNMENTS=150099 CHECKS=29024200	? (TO) TT=1800.18	? (TO) TT=1800.09	? (MO) TT=8.22	? (MO) TT=8.42
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-24_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.22	? (TO) TT=1800.03	? (MO) TT=8.36	? (MO) TT=8.41
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-25_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.04	? (MO) TT=8.45	? (MO) TT=8.43
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-27_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.03	? (MO) TT=8.16	? (MO) TT=8.31
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-28_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.04	? (MO) TT=8.438	? (MO) TT=8.44
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-30_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.09	? (MO) TT=8.17	? (MO) TT=8.35
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-31_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.1	? (MO) TT=7.99	? (MO) TT=8.31
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-32_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.19	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.17	? (TO) TT=1800.1	? (MO) TT=8.42	? (MO) TT=8.25
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-34_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.07	? (MO) TT=7.429	? (MO) TT=8.33
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-35_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.33	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.11	? (MO) TT=7.419	? (MO) TT=8.33
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-37_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.1	? (MO) TT=8.05	? (MO) TT=7.405
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-38_ext.xml		? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.02	? (MO) TT=8.26	? (MO) TT=8.06
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-3_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.03	? (MO) TT=8.451	? (MO) TT=8.41
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-40_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.23	? (TO) TT=1800.03	? (MO) TT=8.497	? (MO) TT=8.472
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-42_ext.xml		? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.01	? (MO) TT=8.23	? (MO) TT=8.468
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-43_ext.xml	SAT TT=318.281	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1639.41 CHECKS=5601330000 NODES=2578980	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=963.11 ASSIGNMENTS=1936310 CHECKS=359969000	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=318.281 CHECKS=32849000	SAT TT=863.978 ASSIGNMENTS=1801230 CHECKS=337345000	SAT TT=788.75 ASSIGNMENTS=1838630 CHECKS=330111000	? (TO) TT=1800.09	SAT TT=770.022 ASSIGNMENTS=1775630 CHECKS=321548000	SAT TT=890.767 ASSIGNMENTS=1936310 CHECKS=359969000	? (TO) TT=1800.23	? (TO) TT=1800.09	? (MO) TT=8.43	? (MO) TT=7.439
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-44_ext.xml		? (TO) TT=1800.11	? (MO) TT=2.327	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.18	? (TO) TT=1800.03	? (MO) TT=8.12	? (MO) TT=8.15
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-46_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.21	? (TO) TT=1800.03	? (MO) TT=8.316	? (MO) TT=8.43
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-48_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.02	? (MO) TT=7.605	? (MO) TT=7.572
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-50_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.2	? (TO) TT=1800.1	? (MO) TT=8.33	? (MO) TT=8.03
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-7_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.09	? (MO) TT=8.576	? (MO) TT=8.41
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-10_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.07	? (MO) TT=8.21	? (MO) TT=8.45
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-14_ext.xml	SAT TT=925.489	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800	SAT TT=1194.54 CHECKS=135863000	SAT TT=925.489 ASSIGNMENTS=2449140 CHECKS=443719000	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=929.382 ASSIGNMENTS=2354090 CHECKS=427465000	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.09	? (MO) TT=8.472	? (MO) TT=8.35
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-16_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.1	? (MO) TT=8.406	? (MO) TT=7.88
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-17_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.19	? (TO) TT=1800.08	? (MO) TT=7.153	? (MO) TT=8.453
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-18_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.07	? (MO) TT=8.45	? (MO) TT=8.434
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-1_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.11	? (MO) TT=8.3	? (MO) TT=8.18
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-20_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.05	? (MO) TT=8.36	? (MO) TT=8.444
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-23_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.02	? (MO) TT=7.414	? (MO) TT=8.32
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-24_ext.xml		? (TO) TT=1800.18	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.09	? (MO) TT=8.44	? (MO) TT=8.41
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-25_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.03	? (MO) TT=7.397	? (MO) TT=8.02
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-27_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.03	? (MO) TT=8.33	? (MO) TT=8.11
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-29_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.09	? (MO) TT=8.31	? (MO) TT=8.33
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-30_ext.xml		? (TO) TT=1800.16	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.04	? (MO) TT=8.28	? (MO) TT=8.465
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-31_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.21	? (TO) TT=1800.03	? (MO) TT=8.34	? (MO) TT=8.04
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-32_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (MO) TT=8.25	? (MO) TT=7.506
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-35_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.18	? (TO) TT=1800.02	? (MO) TT=7.432	? (MO) TT=7.407
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-36_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.2	? (TO) TT=1800.02	? (MO) TT=8.43	? (MO) TT=8.22
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-37_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.03	? (MO) TT=8.33	? (MO) TT=8.43
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-38_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.15	? (TO) TT=1800.09	? (MO) TT=7.433	? (MO) TT=7.13
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-39_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.06	? (MO) TT=8.06	? (MO) TT=8.429
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-3_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (MO) TT=8.22	? (MO) TT=8.75
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-40_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (MO) TT=8.43	? (MO) TT=8.472
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-41_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.07	? (MO) TT=8.45	? (MO) TT=8.467
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-42_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.06	? (MO) TT=8.39	? (MO) TT=8.31
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-44_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.21	? (TO) TT=1800.05	? (MO) TT=8.31	? (MO) TT=8.24
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-46_ext.xml	SAT TT=61.869	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=1403.9 ASSIGNMENTS=55223	? (TO) TT=1800.07	SAT TT=1343.81 CHECKS=4751880000 NODES=2689730	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=399.069 ASSIGNMENTS=165494 CHECKS=27374700	SAT TT=107.731 ASSIGNMENTS=165494 CHECKS=27374700	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=1340.23 CHECKS=177438000	SAT TT=62.344 ASSIGNMENTS=165592 CHECKS=27349400	SAT TT=97.071 ASSIGNMENTS=268923 CHECKS=41704800	SAT TT=1119.37	? (TO) TT=1800.08	SAT TT=61.869 ASSIGNMENTS=165494 CHECKS=27374700	? (TO) TT=1800.19	? (TO) TT=1800.07	? (MO) TT=8.36	? (MO) TT=8.34
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-5_ext.xml	SAT TT=1363.81	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.12	SAT TT=1402.77 ASSIGNMENTS=3053280 CHECKS=587551000	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=1439.78 ASSIGNMENTS=3401940 CHECKS=658018000	? (TO) TT=1800.03	SAT TT=1641.72 ASSIGNMENTS=3757630 CHECKS=719308000	SAT TT=1363.81 ASSIGNMENTS=3053280 CHECKS=587551000	? (TO) TT=1800.22	? (TO) TT=1800.07	? (MO) TT=8.33	? (MO) TT=8.504
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-6_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.54	? (TO) TT=1800.02	? (MO) TT=8.25	? (MO) TT=8.32
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-8_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.11	? (MO) TT=8.34	? (MO) TT=8.464
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-9_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.07	? (MO) TT=7.416	? (MO) TT=7.431
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-0_ext.xml	SAT TT=3.394	SAT TT=329.207 CHECKS=1176560 NODES=224141	SAT TT=318.215 CHECKS=1120340 NODES=224438	? (problem) TT=114.274	? (TO) TT=1800.15	? (TO) TT=1800.16	SAT TT=327.407 ASSIGNMENTS=2597	? (TO) TT=1800.09	SAT TT=23.651 CHECKS=23160500 NODES=28171	SAT TT=100.97 CHECKS=350475000 NODES=1472490	? (TO) TT=1800.04	SAT TT=4.313 ASSIGNMENTS=5921 CHECKS=286125	SAT TT=4.03 ASSIGNMENTS=5921 CHECKS=286125	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=13.419 CHECKS=1242050	SAT TT=3.945 ASSIGNMENTS=5993 CHECKS=290030	SAT TT=4.485 ASSIGNMENTS=8139 CHECKS=315015	SAT TT=52.719	SAT TT=3.394 ASSIGNMENTS=1984 CHECKS=89869	SAT TT=4.288 ASSIGNMENTS=5921 CHECKS=286125	? TT=111.227	SAT TT=583.169 ASSIGNMENTS=528049 CHECKS=145131000	? (MO) TT=12.65	? (MO) TT=12.58
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-10_ext.xml	SAT TT=5.034	SAT TT=56.319 CHECKS=146630 NODES=29957	SAT TT=63.596 CHECKS=148681 NODES=30781	? (problem) TT=115.866	? (TO) TT=1800.12	? (TO) TT=1800.18	SAT TT=731.316 ASSIGNMENTS=3866	SAT TT=1716.44 ASSIGNMENTS=13267	SAT TT=57.101 CHECKS=103722000 NODES=127459	SAT TT=72.474 CHECKS=259651000 NODES=1115260	? (TO) TT=1800	SAT TT=14.45 ASSIGNMENTS=9486 CHECKS=470011	SAT TT=65.831 ASSIGNMENTS=29957 CHECKS=146630	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=9.849 CHECKS=608585	SAT TT=5.194 ASSIGNMENTS=9802 CHECKS=508678	SAT TT=10.639 ASSIGNMENTS=40177 CHECKS=1927700	SAT TT=51.516	SAT TT=5.209 ASSIGNMENTS=10508 CHECKS=538070	SAT TT=5.034 ASSIGNMENTS=9486 CHECKS=470011	? TT=81.852	SAT TT=109.859 ASSIGNMENTS=71126 CHECKS=24464800	? (MO) TT=12.759	? (MO) TT=13.891
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-11_ext.xml	SAT TT=11.876	SAT TT=548.54 CHECKS=3066570 NODES=570182	SAT TT=423.776 CHECKS=1912130 NODES=329400	? (problem) TT=122.757	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=23.426 CHECKS=24004600 NODES=27935	SAT TT=214.91 CHECKS=876959000 NODES=3706290	? (TO) TT=1800.04	SAT TT=22.11 ASSIGNMENTS=40960 CHECKS=1974070	SAT TT=313.453 ASSIGNMENTS=40960 CHECKS=1974070	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=24.877 CHECKS=2427610	SAT TT=11.876 ASSIGNMENTS=41262 CHECKS=1994870	SAT TT=4.59 ASSIGNMENTS=10202 CHECKS=421211	SAT TT=56.762	SAT TT=38.376 ASSIGNMENTS=178307 CHECKS=8584150	SAT TT=11.958 ASSIGNMENTS=40960 CHECKS=1974070	? TT=111.585	SAT TT=411.363 ASSIGNMENTS=268983 CHECKS=84676900	? (MO) TT=13.903	? (MO) TT=12.71
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-12_ext.xml	SAT TT=8.698	SAT TT=26.432 CHECKS=165677 NODES=36903	SAT TT=44.992 CHECKS=317404 NODES=65121	? (problem) TT=112.301	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.18	SAT TT=54.383 CHECKS=103145000 NODES=136930	SAT TT=151.69 CHECKS=581015000 NODES=2459340	? (TO) TT=1800.06	SAT TT=25.249 ASSIGNMENTS=65514 CHECKS=3028190	SAT TT=34.693 ASSIGNMENTS=36903 CHECKS=165677	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=8.698 CHECKS=692658	SAT TT=15.007 ASSIGNMENTS=65960 CHECKS=3061760	SAT TT=15.349 ASSIGNMENTS=69350 CHECKS=3148200	SAT TT=95.568	SAT TT=11.951 ASSIGNMENTS=46176 CHECKS=2202850	SAT TT=14.107 ASSIGNMENTS=65514 CHECKS=3028190	? TT=84.399	SAT TT=54.305 ASSIGNMENTS=37555 CHECKS=8801440	? (MO) TT=12.781	? (MO) TT=11.818
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-13_ext.xml	SAT TT=15.754	SAT TT=505.438 CHECKS=8788570 NODES=1607820	SAT TT=500.622 CHECKS=8820780 NODES=1609430	? (problem) TT=117.811	? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=197.834 CHECKS=460367000 NODES=695733	SAT TT=100.211 CHECKS=372395000 NODES=1579560	? (TO) TT=1800.01	SAT TT=58.929 ASSIGNMENTS=288049 CHECKS=14110400	SAT TT=348.817 ASSIGNMENTS=288049 CHECKS=14110400	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=15.754 CHECKS=1725270	SAT TT=52.575 ASSIGNMENTS=287249 CHECKS=14058800	SAT TT=49.942 ASSIGNMENTS=291110 CHECKS=14182200	SAT TT=292.344	SAT TT=66.422 ASSIGNMENTS=372378 CHECKS=18208600	SAT TT=48.19 ASSIGNMENTS=288049 CHECKS=14110400	? TT=85.565	SAT TT=612.156 ASSIGNMENTS=460640 CHECKS=134843000	? (MO) TT=11.784	? (MO) TT=11.798
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-14_ext.xml	SAT TT=5.4	SAT TT=257.357 CHECKS=997437 NODES=200497	SAT TT=257.416 CHECKS=1019320 NODES=200720	? (problem) TT=119.971	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=374.168 CHECKS=942542000 NODES=1331260	SAT TT=320.772 CHECKS=1339510000 NODES=5793260	SAT TT=464.454 CHECKS=954174000 NODES=2272000	SAT TT=25.218 ASSIGNMENTS=54484 CHECKS=2748170	SAT TT=270.513 ASSIGNMENTS=200497 CHECKS=997437	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=22.173 CHECKS=1733690	SAT TT=15.024 ASSIGNMENTS=54281 CHECKS=2746570	SAT TT=30.125 ASSIGNMENTS=122689 CHECKS=6101690	SAT TT=138.071	SAT TT=5.4 ASSIGNMENTS=11274 CHECKS=554440	SAT TT=14.953 ASSIGNMENTS=54484 CHECKS=2748170	? TT=86.8	SAT TT=598.884 ASSIGNMENTS=226299 CHECKS=115480000	? (MO) TT=12.79	? (MO) TT=12.964
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-15_ext.xml	SAT TT=9.328	SAT TT=66.125 CHECKS=449037 NODES=96317	SAT TT=64.762 CHECKS=446555 NODES=96584	? (problem) TT=112.271	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.13	SAT TT=52.026 CHECKS=102174000 NODES=133837	SAT TT=63.827 CHECKS=220687000 NODES=940492	? (TO) TT=1800.06	SAT TT=22.827 ASSIGNMENTS=49412 CHECKS=2401560	SAT TT=75.905 ASSIGNMENTS=96317 CHECKS=449037	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=24.187 CHECKS=2547350	SAT TT=12.351 ASSIGNMENTS=49303 CHECKS=2396350	SAT TT=12.956 ASSIGNMENTS=53243 CHECKS=2500560	SAT TT=83.703	SAT TT=9.328 ASSIGNMENTS=34126 CHECKS=1654520	SAT TT=12.41 ASSIGNMENTS=49412 CHECKS=2401560	? TT=78.82	SAT TT=154.465 ASSIGNMENTS=82716 CHECKS=24890000	? (MO) TT=13.914	? (MO) TT=12.8
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-16_ext.xml	SAT TT=4.346	SAT TT=160.44 CHECKS=180038 NODES=42903	SAT TT=149.123 CHECKS=157543 NODES=37947	? (problem) TT=123.401	? (TO) TT=1800.14	? (TO) TT=1800.17	SAT TT=745.167 ASSIGNMENTS=6069	? (TO) TT=1800.1	SAT TT=26.084 CHECKS=30589600 NODES=44210	SAT TT=141.438 CHECKS=511162000 NODES=2127360	? (TO) TT=1800.05	SAT TT=14.966 ASSIGNMENTS=8097 CHECKS=357165	SAT TT=4.346 ASSIGNMENTS=8097 CHECKS=357165	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=16.834 CHECKS=1842190	SAT TT=6.153 ASSIGNMENTS=15937 CHECKS=741951	SAT TT=12.747 ASSIGNMENTS=52996 CHECKS=2509000	SAT TT=54.423	SAT TT=9.004 ASSIGNMENTS=31597 CHECKS=1424710	SAT TT=4.607 ASSIGNMENTS=8097 CHECKS=357165	? TT=82.194	SAT TT=371.055 ASSIGNMENTS=318762 CHECKS=115626000	? (MO) TT=12.737	? (MO) TT=12.95
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-17_ext.xml	SAT TT=8.735	SAT TT=105.104 CHECKS=761395 NODES=165804	SAT TT=104.925 CHECKS=766781 NODES=165613	? (problem) TT=119.944	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.19	? (TO) TT=1800.11	SAT TT=52.39 CHECKS=93619300 NODES=133926	SAT TT=311.564 CHECKS=1185440000 NODES=5030160	SAT TT=1151.77 CHECKS=2422860000 NODES=5078820	SAT TT=21.221 ASSIGNMENTS=39188 CHECKS=1849360	SAT TT=112.771 ASSIGNMENTS=165804 CHECKS=761395	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=8.735 CHECKS=480448	SAT TT=9.894 ASSIGNMENTS=38668 CHECKS=1837660	SAT TT=11.143 ASSIGNMENTS=42127 CHECKS=1939410	SAT TT=110.108	SAT TT=18.058 ASSIGNMENTS=76803 CHECKS=3645540	SAT TT=10.648 ASSIGNMENTS=39188 CHECKS=1849360	? TT=108.509	SAT TT=108.204 ASSIGNMENTS=64898 CHECKS=20507700	? (MO) TT=12.84	? (MO) TT=12.776
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-18_ext.xml	SAT TT=6.293	SAT TT=82.493 CHECKS=691926 NODES=133766	SAT TT=92.281 CHECKS=692036 NODES=134027	? (problem) TT=121.941	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.16	SAT TT=65.417 CHECKS=128393000 NODES=190591	SAT TT=54.408 CHECKS=166013000 NODES=727316	SAT TT=1404.77 CHECKS=3048910000 NODES=6985040	SAT TT=21.293 ASSIGNMENTS=44644 CHECKS=1988000	SAT TT=93.505 ASSIGNMENTS=133766 CHECKS=691926	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=25.42 CHECKS=2731650	SAT TT=10.96 ASSIGNMENTS=44893 CHECKS=2002810	SAT TT=11.558 ASSIGNMENTS=49383 CHECKS=2106090	SAT TT=101.07	SAT TT=6.293 ASSIGNMENTS=16705 CHECKS=810528	SAT TT=9.866 ASSIGNMENTS=44644 CHECKS=1988000	? TT=71.764	SAT TT=43.507 ASSIGNMENTS=27905 CHECKS=7722190	? (MO) TT=12.72	? (MO) TT=12.72
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-19_ext.xml	SAT TT=8.578	SAT TT=1041.03 CHECKS=2451140 NODES=524717	SAT TT=1058.93 CHECKS=2459380 NODES=525599	? (problem) TT=121.506	SAT TT=1181.78 CHECKS=252601	SAT TT=1543.81 CHECKS=323727	SAT TT=1519.1 ASSIGNMENTS=14577	? (TO) TT=1800.18	SAT TT=24.25 CHECKS=23441300 NODES=36996	SAT TT=68.823 CHECKS=211493000 NODES=877728	SAT TT=1186.78 CHECKS=2754630000 NODES=5628070	SAT TT=20.469 ASSIGNMENTS=35493 CHECKS=1682940	SAT TT=310.095 ASSIGNMENTS=35493 CHECKS=1682940	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=18.667 CHECKS=1865690	SAT TT=10.033 ASSIGNMENTS=35956 CHECKS=1684140	SAT TT=6.285 ASSIGNMENTS=17458 CHECKS=747152	SAT TT=110.319	SAT TT=8.578 ASSIGNMENTS=25758 CHECKS=1209070	SAT TT=9.258 ASSIGNMENTS=35493 CHECKS=1682940	? TT=79.903	SAT TT=201.213 ASSIGNMENTS=130041 CHECKS=39248800	? (MO) TT=11.794	? (MO) TT=12.81
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-1_ext.xml	SAT TT=3.316	SAT TT=230.553 CHECKS=196173 NODES=63661	SAT TT=247.921 CHECKS=195661 NODES=63576	? (problem) TT=115.042	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.12	SAT TT=146.131 CHECKS=324158000 NODES=434447	SAT TT=92.901 CHECKS=350267000 NODES=1480150	SAT TT=1138.02 CHECKS=2502400000 NODES=5001700	SAT TT=29.303 ASSIGNMENTS=73833 CHECKS=3623290	SAT TT=246.826 ASSIGNMENTS=63661 CHECKS=196173	? (TO) TT=1800	? (TO) TT=1800.04	SAT TT=37.657 CHECKS=3385550	SAT TT=19.048 ASSIGNMENTS=74582 CHECKS=3649620	SAT TT=11.179 ASSIGNMENTS=38980 CHECKS=1842210	SAT TT=154.409	SAT TT=3.316 ASSIGNMENTS=1924 CHECKS=95164	SAT TT=18.69 ASSIGNMENTS=73833 CHECKS=3623290	? TT=79.186	SAT TT=110.977 ASSIGNMENTS=43053 CHECKS=14885800	? (MO) TT=12.71	? (MO) TT=12.777
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-2_ext.xml	SAT TT=6.574	SAT TT=28.141 CHECKS=11529 NODES=3898	SAT TT=23.24 CHECKS=11473 NODES=3942	? (problem) TT=112.546	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=1502.07 ASSIGNMENTS=14551	? (TO) TT=1800.2	SAT TT=41.297 CHECKS=70752900 NODES=94783	SAT TT=41.223 CHECKS=110759000 NODES=474708	? (TO) TT=1800.03	SAT TT=20.72 ASSIGNMENTS=30994 CHECKS=1540440	SAT TT=35.495 ASSIGNMENTS=3898 CHECKS=11529	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=6.574 CHECKS=158891	SAT TT=10.316 ASSIGNMENTS=31196 CHECKS=1545070	SAT TT=9.173 ASSIGNMENTS=27978 CHECKS=1313110	SAT TT=96.447	SAT TT=7.876 ASSIGNMENTS=20426 CHECKS=1005180	SAT TT=10.261 ASSIGNMENTS=30994 CHECKS=1540440	? TT=100.393	SAT TT=22.467 ASSIGNMENTS=5513 CHECKS=2460270	? (MO) TT=12.75	? (MO) TT=13.76
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-3_ext.xml	SAT TT=12.97	SAT TT=143.99 CHECKS=502155 NODES=92389	SAT TT=148.571 CHECKS=484287 NODES=91195	? (problem) TT=123.09	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.13	SAT TT=71.149 CHECKS=145087000 NODES=200298	SAT TT=147.262 CHECKS=552697000 NODES=2354870	? (TO) TT=1800.04	SAT TT=27.753 ASSIGNMENTS=64016 CHECKS=3043790	SAT TT=153.346 ASSIGNMENTS=92389 CHECKS=502155	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=19.762 CHECKS=1267880	SAT TT=15.378 ASSIGNMENTS=64108 CHECKS=3045130	SAT TT=17.215 ASSIGNMENTS=69253 CHECKS=3194410	SAT TT=110.908	SAT TT=12.97 ASSIGNMENTS=50533 CHECKS=2433820	SAT TT=16.546 ASSIGNMENTS=64016 CHECKS=3043790	? TT=89.095	SAT TT=26.127 ASSIGNMENTS=5523 CHECKS=2416860	? (MO) TT=12.787	? (MO) TT=13.873
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-4_ext.xml	SAT TT=5.604	SAT TT=87.089 CHECKS=1252240 NODES=225823	SAT TT=85.707 CHECKS=1265050 NODES=225935	? (problem) TT=119.879	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=927.969 ASSIGNMENTS=7283	? (TO) TT=1800.17	SAT TT=68.625 CHECKS=124007000 NODES=201754	SAT TT=63.609 CHECKS=193629000 NODES=833849	? (TO) TT=1800.07	SAT TT=16.034 ASSIGNMENTS=15491 CHECKS=711874	SAT TT=88.32 ASSIGNMENTS=225823 CHECKS=1252240	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=20.29 CHECKS=2803380	SAT TT=5.604 ASSIGNMENTS=15407 CHECKS=710287	SAT TT=6.063 ASSIGNMENTS=20500 CHECKS=875391	SAT TT=62.85	SAT TT=8.643 ASSIGNMENTS=32576 CHECKS=1504750	SAT TT=5.77 ASSIGNMENTS=15491 CHECKS=711874	? TT=81.819	SAT TT=196.058 ASSIGNMENTS=149966 CHECKS=39098800	? (MO) TT=13.66	? (MO) TT=12.79
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-5_ext.xml	SAT TT=11.298	SAT TT=37.461 CHECKS=183071 NODES=40698	SAT TT=40.749 CHECKS=245501 NODES=53242	? (problem) TT=122.366	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.17	SAT TT=205.497 CHECKS=448398000 NODES=680792	SAT TT=326.022 CHECKS=1350070000 NODES=5624540	SAT TT=1694.16 CHECKS=3876760000 NODES=8097100	SAT TT=22.394 ASSIGNMENTS=51520 CHECKS=2307780	SAT TT=45.475 ASSIGNMENTS=40698 CHECKS=183071	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=12.972 CHECKS=1059420	SAT TT=11.298 ASSIGNMENTS=52077 CHECKS=2348660	SAT TT=12.185 ASSIGNMENTS=57737 CHECKS=2535210	SAT TT=100.967	SAT TT=33.116 ASSIGNMENTS=178323 CHECKS=7842940	SAT TT=11.779 ASSIGNMENTS=51520 CHECKS=2307780	? TT=81.948	SAT TT=230.125 ASSIGNMENTS=77967 CHECKS=24695200	? (MO) TT=12.809	? (MO) TT=12.653
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-6_ext.xml	SAT TT=5.206	SAT TT=172.82 CHECKS=256472 NODES=60001	SAT TT=144.273 CHECKS=242310 NODES=61410	? (problem) TT=122.392	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.13	SAT TT=56.497 CHECKS=101255000 NODES=135630	SAT TT=111.337 CHECKS=431250000 NODES=1882880	SAT TT=1005.2 CHECKS=2076880000 NODES=4913730	SAT TT=24.548 ASSIGNMENTS=49602 CHECKS=2508420	SAT TT=182.17 ASSIGNMENTS=60001 CHECKS=256472	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=5.206 CHECKS=5336	SAT TT=12.925 ASSIGNMENTS=49233 CHECKS=2481750	SAT TT=12.819 ASSIGNMENTS=43585 CHECKS=2164070	SAT TT=138.349	SAT TT=12.434 ASSIGNMENTS=40037 CHECKS=2077240	SAT TT=12.961 ASSIGNMENTS=49602 CHECKS=2508420	? TT=78.673	SAT TT=83.508 ASSIGNMENTS=32734 CHECKS=14180300	? (MO) TT=12.818	? (MO) TT=12.58
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-7_ext.xml	SAT TT=3.51	SAT TT=56.042 CHECKS=122359 NODES=37700	SAT TT=120.582 CHECKS=138349 NODES=40144	? (problem) TT=121.934	SAT TT=1218.38 CHECKS=268210	SAT TT=1025.76 CHECKS=206142	SAT TT=679.513 ASSIGNMENTS=4812	? (TO) TT=1800.14	SAT TT=16.918 CHECKS=5973940 NODES=8241	SAT TT=22.096 CHECKS=31561200 NODES=138449	? (TO) TT=1800.08	SAT TT=4.443 ASSIGNMENTS=6050 CHECKS=285357	SAT TT=4.056 ASSIGNMENTS=6050 CHECKS=285357	? (TO) TT=1800.06	SAT TT=1039.06	SAT TT=5.842 CHECKS=81470	SAT TT=3.966 ASSIGNMENTS=5925 CHECKS=272414	SAT TT=4.061 ASSIGNMENTS=5943 CHECKS=209583	SAT TT=50.928	SAT TT=3.51 ASSIGNMENTS=2838 CHECKS=129629	SAT TT=4.428 ASSIGNMENTS=6050 CHECKS=285357	? TT=110.985	SAT TT=28.342 ASSIGNMENTS=12166 CHECKS=2785460	? (MO) TT=13.874	? (MO) TT=12.67
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-8_ext.xml	SAT TT=11.096	SAT TT=250.023 CHECKS=290272 NODES=57650	SAT TT=395.242 CHECKS=417594 NODES=86349	? (problem) TT=120.33	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.21	SAT TT=153.228 CHECKS=339131000 NODES=444915	SAT TT=32.033 CHECKS=80371800 NODES=335665	? (TO) TT=1800.07	SAT TT=44.137 ASSIGNMENTS=165752 CHECKS=7924260	SAT TT=259.488 ASSIGNMENTS=57650 CHECKS=290272	? (TO) TT=1800.01	SAT TT=1496.79	SAT TT=45.187 CHECKS=5752510	SAT TT=36.892 ASSIGNMENTS=166684 CHECKS=7980180	SAT TT=32.281 ASSIGNMENTS=138879 CHECKS=6646260	SAT TT=299.118	SAT TT=11.096 ASSIGNMENTS=38513 CHECKS=1854140	SAT TT=34.081 ASSIGNMENTS=165752 CHECKS=7924260	? TT=111.674	SAT TT=99.361 ASSIGNMENTS=53656 CHECKS=21419700	? (MO) TT=11.79	? (MO) TT=13.67
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-9_ext.xml	SAT TT=13.206	SAT TT=79.359 CHECKS=130471 NODES=33526	SAT TT=77.03 CHECKS=134487 NODES=33804	? (problem) TT=121.737	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.16	SAT TT=53.474 CHECKS=100819000 NODES=133816	SAT TT=45.215 CHECKS=123964000 NODES=516915	SAT TT=1614.83 CHECKS=3735890000 NODES=7775790	SAT TT=25.783 ASSIGNMENTS=53924 CHECKS=2724760	SAT TT=87.43 ASSIGNMENTS=33526 CHECKS=130471	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=25.251 CHECKS=2267320	SAT TT=15.791 ASSIGNMENTS=55162 CHECKS=2813780	SAT TT=13.314 ASSIGNMENTS=47196 CHECKS=2290590	SAT TT=158.508	SAT TT=13.206 ASSIGNMENTS=45695 CHECKS=2299620	SAT TT=15.058 ASSIGNMENTS=53924 CHECKS=2724760	? TT=101.009	SAT TT=33.504 ASSIGNMENTS=8009 CHECKS=2868490	? (MO) TT=12.77	? (MO) TT=11.883
csp/rcpsp/ normalized-rcpsp20-02.xml	SAT TT=0.018	? TT=0.564	? TT=0.564	SAT TT=0.086	SAT TT=17.753 CHECKS=1728000	SAT TT=23.326 CHECKS=1896140	SAT TT=1.657 ASSIGNMENTS=552	SAT TT=1.893 ASSIGNMENTS=418	No data	No data	No data	SAT TT=0.03 ASSIGNMENTS=33 CHECKS=12898	SAT TT=0.028 ASSIGNMENTS=33 CHECKS=12898	No data	No data	No data	SAT TT=0.023 ASSIGNMENTS=47 CHECKS=22138	SAT TT=0.387 ASSIGNMENTS=2439 CHECKS=764119	? (exit code) TT=0.243	SAT TT=0.54 ASSIGNMENTS=1594 CHECKS=894739	SAT TT=0.018 ASSIGNMENTS=24 CHECKS=12850	? TT=1.544	No data	SAT TT=1.035	SAT TT=1.139
csp/rcpsp/ normalized-rcpsp20-03.xml	SAT TT=0.014	? TT=0.607	? TT=0.577	SAT TT=0.112	SAT TT=44.222 CHECKS=5317180	SAT TT=55.307 CHECKS=6889230	SAT TT=2.505 ASSIGNMENTS=1618	SAT TT=1.868 ASSIGNMENTS=359	No data	No data	No data	SAT TT=0.024 ASSIGNMENTS=10 CHECKS=5773	SAT TT=0.027 ASSIGNMENTS=10 CHECKS=5773	No data	No data	No data	SAT TT=0.015 ASSIGNMENTS=10 CHECKS=5773	SAT TT=0.34 ASSIGNMENTS=1979 CHECKS=664822	? (exit code) TT=0.242	SAT TT=0.07 ASSIGNMENTS=244 CHECKS=94006	SAT TT=0.014 ASSIGNMENTS=10 CHECKS=5772	? TT=1.551	No data	SAT TT=1.044	SAT TT=1.157
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpsp/ normalized-rcpsp20-04.xml	SAT TT=0.024	? TT=0.577	? TT=0.572	SAT TT=0.033	SAT TT=0.07 CHECKS=4805	SAT TT=0.077 CHECKS=5180	SAT TT=1.09 ASSIGNMENTS=15	SAT TT=1.101 ASSIGNMENTS=14	No data	No data	No data	SAT TT=0.037 ASSIGNMENTS=58 CHECKS=23102	SAT TT=0.038 ASSIGNMENTS=58 CHECKS=23102	No data	No data	No data	SAT TT=0.043 ASSIGNMENTS=96 CHECKS=50100	SAT TT=0.024 ASSIGNMENTS=60 CHECKS=21642	? (exit code) TT=0.25	SAT TT=0.027 ASSIGNMENTS=42 CHECKS=19265	SAT TT=0.027 ASSIGNMENTS=69 CHECKS=24516	? TT=1.544	No data	SAT TT=1.234	SAT TT=1.182
csp/rcpsp/ normalized-rcpsp20-05.xml	UNSAT TT=1.781	? TT=0.658	? TT=0.587	UNSAT TT=42.675	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=431.253 ASSIGNMENTS=310330	UNSAT TT=86.768 ASSIGNMENTS=41130	No data	No data	No data	UNSAT TT=60.215 ASSIGNMENTS=119552 CHECKS=121788000	UNSAT TT=60.298 ASSIGNMENTS=119552 CHECKS=121788000	No data	No data	No data	UNSAT TT=12.551 ASSIGNMENTS=31165 CHECKS=28385600	UNSAT TT=12.95 ASSIGNMENTS=35053 CHECKS=29509700	? (exit code) TT=0.244	UNSAT TT=151.037 ASSIGNMENTS=363794 CHECKS=285065000	UNSAT TT=51.321 ASSIGNMENTS=119552 CHECKS=121788000	? TT=1.558	No data	UNSAT TT=1.781	UNSAT TT=2.107
csp/rcpsp/ normalized-rcpsp20-06.xml	SAT TT=0.017	? TT=0.575	? TT=0.626	SAT TT=0.037	SAT TT=0.152 CHECKS=11569	SAT TT=0.15 CHECKS=10930	SAT TT=1.192 ASSIGNMENTS=13	SAT TT=1.228 ASSIGNMENTS=20	No data	No data	No data	SAT TT=0.036 ASSIGNMENTS=49 CHECKS=24906	SAT TT=0.037 ASSIGNMENTS=49 CHECKS=24906	No data	No data	No data	SAT TT=0.017 ASSIGNMENTS=19 CHECKS=9496	SAT TT=0.038 ASSIGNMENTS=203 CHECKS=59117	? (exit code) TT=0.237	SAT TT=0.035 ASSIGNMENTS=129 CHECKS=37879	SAT TT=0.054 ASSIGNMENTS=185 CHECKS=89356	? TT=1.568	No data	SAT TT=0.978	SAT TT=1.057
csp/rcpsp/ normalized-rcpsp20-07.xml	SAT TT=1.214	? TT=0.59	? TT=0.576	SAT TT=53.797	SAT TT=1378.08 CHECKS=115648000	SAT TT=628.479 CHECKS=72095100	SAT TT=362.468 ASSIGNMENTS=355416	SAT TT=16.177 ASSIGNMENTS=8035	No data	No data	No data	SAT TT=14.861 ASSIGNMENTS=19081 CHECKS=20231300	SAT TT=16.182 ASSIGNMENTS=19081 CHECKS=20231300	No data	No data	No data	SAT TT=3.967 ASSIGNMENTS=10692 CHECKS=9147700	SAT TT=2.411 ASSIGNMENTS=9015 CHECKS=5440870	? (exit code) TT=0.256	SAT TT=19.988 ASSIGNMENTS=44093 CHECKS=38624600	SAT TT=8.27 ASSIGNMENTS=19081 CHECKS=20231300	? TT=1.484	No data	SAT TT=1.221	SAT TT=1.214
csp/rcpsp/ normalized-rcpsp20-08.xml	SAT TT=0.039	? TT=0.663	? TT=0.57	SAT TT=0.156	SAT TT=40.418 CHECKS=6014840	SAT TT=51.637 CHECKS=7224470	SAT TT=432.165 ASSIGNMENTS=337207	SAT TT=1.644 ASSIGNMENTS=261	No data	No data	No data	SAT TT=0.07 ASSIGNMENTS=197 CHECKS=92702	SAT TT=0.069 ASSIGNMENTS=197 CHECKS=92702	No data	No data	No data	SAT TT=0.386 ASSIGNMENTS=1715 CHECKS=791008	SAT TT=0.039 ASSIGNMENTS=229 CHECKS=51341	? (exit code) TT=0.262	SAT TT=0.044 ASSIGNMENTS=124 CHECKS=43935	SAT TT=0.084 ASSIGNMENTS=398 CHECKS=154380	? TT=1.627	No data	SAT TT=1.169	SAT TT=1.09
csp/rcpsp/ normalized-rcpsp20-09.xml	SAT TT=0.013	? TT=0.681	? TT=0.592	SAT TT=0.036	SAT TT=11.191 CHECKS=1317040	SAT TT=20.684 CHECKS=2340310	SAT TT=1.017 ASSIGNMENTS=14	SAT TT=0.994 ASSIGNMENTS=12	No data	No data	No data	SAT TT=0.025 ASSIGNMENTS=15 CHECKS=4529	SAT TT=0.024 ASSIGNMENTS=15 CHECKS=4529	No data	No data	No data	SAT TT=0.013 ASSIGNMENTS=15 CHECKS=4529	SAT TT=0.061 ASSIGNMENTS=435 CHECKS=96479	? (exit code) TT=0.241	SAT TT=0.106 ASSIGNMENTS=508 CHECKS=138283	SAT TT=0.015 ASSIGNMENTS=16 CHECKS=4626	? TT=1.487	No data	SAT TT=1.136	SAT TT=0.991
csp/rcpsp/ normalized-rcpsp20-10.xml	SAT TT=0.016	? TT=0.623	? TT=0.589	SAT TT=0.043	SAT TT=57.809 CHECKS=5407500	SAT TT=38.002 CHECKS=3712770	SAT TT=1.187 ASSIGNMENTS=185	SAT TT=1.821 ASSIGNMENTS=339	No data	No data	No data	SAT TT=0.044 ASSIGNMENTS=96 CHECKS=44033	SAT TT=0.046 ASSIGNMENTS=96 CHECKS=44033	No data	No data	No data	SAT TT=0.016 ASSIGNMENTS=16 CHECKS=10619	SAT TT=0.08 ASSIGNMENTS=481 CHECKS=145266	? (exit code) TT=0.267	SAT TT=0.288 ASSIGNMENTS=1038 CHECKS=478768	SAT TT=0.182 ASSIGNMENTS=822 CHECKS=357629	? TT=1.485	No data	SAT TT=0.935	SAT TT=1.046
csp/rcpsp/ normalized-rcpsp20-11.xml	SAT TT=0.014	? TT=0.578	? TT=0.571	SAT TT=0.031	SAT TT=0.362 CHECKS=43204	SAT TT=0.545 CHECKS=63747	SAT TT=1.042 ASSIGNMENTS=14	SAT TT=1.142 ASSIGNMENTS=11	No data	No data	No data	SAT TT=0.026 ASSIGNMENTS=14 CHECKS=5460	SAT TT=0.024 ASSIGNMENTS=14 CHECKS=5460	No data	No data	No data	SAT TT=0.014 ASSIGNMENTS=14 CHECKS=5641	SAT TT=0.02 ASSIGNMENTS=91 CHECKS=17669	? (exit code) TT=0.234	SAT TT=0.016 ASSIGNMENTS=32 CHECKS=5335	SAT TT=0.014 ASSIGNMENTS=14 CHECKS=5459	? TT=1.496	No data	SAT TT=0.938	SAT TT=0.992
csp/rcpsp/ normalized-rcpsp20-12.xml	SAT TT=0.015	? TT=0.622	? TT=0.572	SAT TT=0.296	SAT TT=26.713 CHECKS=2853920	SAT TT=44.043 CHECKS=4644370	SAT TT=22.359 ASSIGNMENTS=15201	SAT TT=1.11 ASSIGNMENTS=42	No data	No data	No data	SAT TT=0.043 ASSIGNMENTS=79 CHECKS=39014	SAT TT=0.044 ASSIGNMENTS=79 CHECKS=39014	No data	No data	No data	SAT TT=0.03 ASSIGNMENTS=66 CHECKS=45107	SAT TT=0.015 ASSIGNMENTS=17 CHECKS=8119	? (exit code) TT=0.237	SAT TT=0.147 ASSIGNMENTS=444 CHECKS=201752	SAT TT=0.115 ASSIGNMENTS=428 CHECKS=225682	? TT=1.44	No data	SAT TT=1.031	SAT TT=1.109
csp/rcpsp/ normalized-rcpsp20-13.xml	SAT TT=0.015	? TT=0.646	? TT=0.567	SAT TT=0.123	SAT TT=36.575 CHECKS=3396260	SAT TT=363.908 CHECKS=41559000	SAT TT=1.862 ASSIGNMENTS=668	SAT TT=1.179 ASSIGNMENTS=88	No data	No data	No data	SAT TT=0.027 ASSIGNMENTS=9 CHECKS=6810	SAT TT=0.028 ASSIGNMENTS=9 CHECKS=6810	No data	No data	No data	SAT TT=0.017 ASSIGNMENTS=9 CHECKS=6810	SAT TT=0.25 ASSIGNMENTS=1451 CHECKS=507323	? (exit code) TT=0.239	SAT TT=0.077 ASSIGNMENTS=298 CHECKS=102588	SAT TT=0.015 ASSIGNMENTS=9 CHECKS=6810	? TT=1.504	No data	SAT TT=1.034	SAT TT=1.304
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpsp/ normalized-rcpsp20-14.xml	SAT TT=0.018	? TT=0.653	? TT=0.606	SAT TT=0.078	SAT TT=25.279 CHECKS=2619440	SAT TT=20.145 CHECKS=1824480	SAT TT=1.079 ASSIGNMENTS=21	SAT TT=240.205 ASSIGNMENTS=87434	No data	No data	No data	SAT TT=0.029 ASSIGNMENTS=16 CHECKS=11627	SAT TT=0.028 ASSIGNMENTS=16 CHECKS=11627	No data	No data	No data	SAT TT=0.018 ASSIGNMENTS=18 CHECKS=10768	SAT TT=0.136 ASSIGNMENTS=629 CHECKS=254975	? (exit code) TT=0.259	SAT TT=0.448 ASSIGNMENTS=1212 CHECKS=715846	SAT TT=0.02 ASSIGNMENTS=15 CHECKS=11624	? TT=1.52	No data	SAT TT=1.134	SAT TT=1.284
csp/rcpsp/ normalized-rcpsp20-15.xml	SAT TT=0.025	? TT=0.648	? TT=0.618	SAT TT=0.055	SAT TT=27.719 CHECKS=3258710	SAT TT=18.725 CHECKS=2668780	SAT TT=1.019 ASSIGNMENTS=57	SAT TT=1.061 ASSIGNMENTS=15	No data	No data	No data	SAT TT=0.064 ASSIGNMENTS=281 CHECKS=74780	SAT TT=0.064 ASSIGNMENTS=281 CHECKS=74780	No data	No data	No data	SAT TT=0.025 ASSIGNMENTS=72 CHECKS=29475	SAT TT=0.057 ASSIGNMENTS=358 CHECKS=92046	? (exit code) TT=0.265	SAT TT=0.07 ASSIGNMENTS=231 CHECKS=90855	SAT TT=0.04 ASSIGNMENTS=158 CHECKS=58035	? TT=1.382	No data	SAT TT=1.133	SAT TT=0.993
csp/rcpsp/ normalized-rcpsp20-16.xml	SAT TT=0.223	? TT=0.568	? TT=0.565	SAT TT=9.963	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=1.184 ASSIGNMENTS=122	SAT TT=10.928 ASSIGNMENTS=5822	No data	No data	No data	SAT TT=0.463 ASSIGNMENTS=1746 CHECKS=972557	SAT TT=0.459 ASSIGNMENTS=1746 CHECKS=972557	No data	No data	No data	SAT TT=0.443 ASSIGNMENTS=1683 CHECKS=985083	SAT TT=1.177 ASSIGNMENTS=6525 CHECKS=2447120	? (exit code) TT=0.238	SAT TT=1.283 ASSIGNMENTS=3733 CHECKS=2235760	SAT TT=0.223 ASSIGNMENTS=914 CHECKS=458166	? TT=1.582	No data	SAT TT=0.979	SAT TT=1.157
csp/rcpsp/ normalized-rcpsp20-17.xml	SAT TT=0.016	? TT=0.649	? TT=0.66	SAT TT=0.104	SAT TT=30.833 CHECKS=2368000	SAT TT=46.824 CHECKS=3717250	SAT TT=2.516 ASSIGNMENTS=1731	SAT TT=1.142 ASSIGNMENTS=100	No data	No data	No data	SAT TT=0.117 ASSIGNMENTS=474 CHECKS=181870	SAT TT=0.12 ASSIGNMENTS=474 CHECKS=181870	No data	No data	No data	SAT TT=0.056 ASSIGNMENTS=304 CHECKS=83609	SAT TT=0.021 ASSIGNMENTS=92 CHECKS=14055	? (exit code) TT=0.267	SAT TT=0.016 ASSIGNMENTS=24 CHECKS=7341	SAT TT=0.088 ASSIGNMENTS=479 CHECKS=174009	? TT=1.561	No data	SAT TT=0.952	SAT TT=1.211
csp/rcpsp/ normalized-rcpsp20-18.xml	SAT TT=0.121	? TT=0.644	? TT=0.604	SAT TT=4.897	SAT TT=14.114 CHECKS=1294140	SAT TT=28.329 CHECKS=2732310	SAT TT=29.158 ASSIGNMENTS=13637	SAT TT=2.201 ASSIGNMENTS=396	No data	No data	No data	SAT TT=7.804 ASSIGNMENTS=675 CHECKS=417672	SAT TT=7.893 ASSIGNMENTS=675 CHECKS=417672	No data	No data	No data	SAT TT=1.565 ASSIGNMENTS=4234 CHECKS=3553420	SAT TT=1.02 ASSIGNMENTS=5481 CHECKS=2258950	? (exit code) TT=0.261	SAT TT=0.121 ASSIGNMENTS=425 CHECKS=175223	SAT TT=0.19 ASSIGNMENTS=675 CHECKS=417672	? TT=1.444	No data	SAT TT=1.07	SAT TT=1.127
csp/rcpsp/ normalized-rcpsp20-19.xml	SAT TT=0.011	? TT=0.626	? TT=0.599	SAT TT=0.032	SAT TT=0.774 CHECKS=88580	SAT TT=1.171 CHECKS=132778	SAT TT=1.129 ASSIGNMENTS=18	SAT TT=1.083 ASSIGNMENTS=16	No data	No data	No data	SAT TT=0.024 ASSIGNMENTS=26 CHECKS=3956	SAT TT=0.023 ASSIGNMENTS=26 CHECKS=3956	No data	No data	No data	SAT TT=0.012 ASSIGNMENTS=26 CHECKS=3956	SAT TT=0.013 ASSIGNMENTS=21 CHECKS=4288	? (exit code) TT=0.255	SAT TT=0.016 ASSIGNMENTS=57 CHECKS=11053	SAT TT=0.011 ASSIGNMENTS=19 CHECKS=3912	? TT=1.419	No data	SAT TT=0.928	SAT TT=1.032
csp/rcpsp/ normalized-rcpsp20-20.xml	SAT TT=0.059	? TT=0.647	? TT=0.567	SAT TT=0.059	SAT TT=45.27 CHECKS=4555590	SAT TT=39.861 CHECKS=3591780	SAT TT=1.854 ASSIGNMENTS=629	SAT TT=1.782 ASSIGNMENTS=317	No data	No data	No data	SAT TT=0.107 ASSIGNMENTS=388 CHECKS=178404	SAT TT=0.109 ASSIGNMENTS=388 CHECKS=178404	No data	No data	No data	SAT TT=0.098 ASSIGNMENTS=339 CHECKS=176851	SAT TT=0.901 ASSIGNMENTS=5728 CHECKS=1799150	? (exit code) TT=0.255	SAT TT=0.108 ASSIGNMENTS=439 CHECKS=152393	SAT TT=0.184 ASSIGNMENTS=858 CHECKS=349606	? TT=1.476	No data	SAT TT=0.985	SAT TT=1.047
csp/rcpsp/ normalized-rcpsp25-21.xml	SAT TT=0.046	? TT=0.618	? TT=0.649	SAT TT=0.385	SAT TT=524.925 CHECKS=61435700	? (TO) TT=1800.04	SAT TT=1085.06 ASSIGNMENTS=615889	SAT TT=138.558 ASSIGNMENTS=56950	No data	No data	No data	SAT TT=0.057 ASSIGNMENTS=46 CHECKS=38293	SAT TT=0.057 ASSIGNMENTS=46 CHECKS=38293	No data	No data	No data	SAT TT=0.085 ASSIGNMENTS=145 CHECKS=108299	SAT TT=11.662 ASSIGNMENTS=22587 CHECKS=21836600	? (exit code) TT=0.295	SAT TT=14.97 ASSIGNMENTS=21007 CHECKS=23393300	SAT TT=0.046 ASSIGNMENTS=46 CHECKS=38292	? TT=1.87	No data	SAT TT=1.317	SAT TT=1.511
csp/rcpsp/ normalized-rcpsp25-22.xml	SAT TT=0.037	? TT=0.655	? TT=0.624	SAT TT=39.622	SAT TT=89.171 CHECKS=7531270	SAT TT=55.126 CHECKS=4100980	SAT TT=778.92 ASSIGNMENTS=365461	SAT TT=646.443 ASSIGNMENTS=268173	No data	No data	No data	SAT TT=0.044 ASSIGNMENTS=23 CHECKS=21850	SAT TT=0.046 ASSIGNMENTS=23 CHECKS=21850	No data	No data	No data	SAT TT=0.037 ASSIGNMENTS=28 CHECKS=27672	SAT TT=0.446 ASSIGNMENTS=1941 CHECKS=807613	? (exit code) TT=0.291	SAT TT=0.258 ASSIGNMENTS=466 CHECKS=365000	SAT TT=0.273 ASSIGNMENTS=556 CHECKS=496579	? TT=1.718	No data	SAT TT=1.285	SAT TT=1.771
csp/rcpsp/ normalized-rcpsp25-23.xml	SAT TT=0.062	? TT=0.617	? TT=0.65	SAT TT=327.981	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=939.428 ASSIGNMENTS=752609	SAT TT=17.269 ASSIGNMENTS=5459	No data	No data	No data	SAT TT=7.997 ASSIGNMENTS=1223 CHECKS=1108950	SAT TT=7.993 ASSIGNMENTS=1223 CHECKS=1108950	No data	No data	No data	SAT TT=0.161 ASSIGNMENTS=351 CHECKS=277224	SAT TT=2.492 ASSIGNMENTS=7603 CHECKS=5044820	? (exit code) TT=0.281	SAT TT=0.062 ASSIGNMENTS=119 CHECKS=63266	SAT TT=0.537 ASSIGNMENTS=1223 CHECKS=1108950	? TT=1.78	No data	SAT TT=1.305	SAT TT=1.473
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpsp/ normalized-rcpsp25-24.xml	SAT TT=0.026	? TT=0.634	? TT=0.634	SAT TT=0.041	SAT TT=44.029 CHECKS=3450380	SAT TT=41.997 CHECKS=3258180	SAT TT=1.468 ASSIGNMENTS=42	SAT TT=1.871 ASSIGNMENTS=232	No data	No data	No data	SAT TT=0.037 ASSIGNMENTS=11 CHECKS=15096	SAT TT=0.034 ASSIGNMENTS=11 CHECKS=15096	No data	No data	No data	SAT TT=0.028 ASSIGNMENTS=18 CHECKS=16665	SAT TT=0.055 ASSIGNMENTS=120 CHECKS=72703	? (exit code) TT=0.279	SAT TT=0.039 ASSIGNMENTS=48 CHECKS=26912	SAT TT=0.026 ASSIGNMENTS=11 CHECKS=15096	? TT=1.932	No data	SAT TT=1.197	SAT TT=1.34
csp/rcpsp/ normalized-rcpsp25-25.xml	SAT TT=0.07	? TT=0.623	? TT=0.629	SAT TT=11.042	SAT TT=55.258 CHECKS=6158690	SAT TT=691.151 CHECKS=66774200	SAT TT=30.641 ASSIGNMENTS=20829	SAT TT=1.72 ASSIGNMENTS=17	No data	No data	No data	SAT TT=0.113 ASSIGNMENTS=209 CHECKS=207368	SAT TT=0.12 ASSIGNMENTS=209 CHECKS=207368	No data	No data	No data	SAT TT=0.098 ASSIGNMENTS=181 CHECKS=173402	SAT TT=0.222 ASSIGNMENTS=1076 CHECKS=428582	? (exit code) TT=0.292	SAT TT=0.106 ASSIGNMENTS=184 CHECKS=127981	SAT TT=0.07 ASSIGNMENTS=154 CHECKS=106757	? TT=1.882	No data	SAT TT=1.259	SAT TT=1.36
csp/rcpsp/ normalized-rcpsp25-26.xml	SAT TT=0.033	? TT=0.621	? TT=0.624	SAT TT=0.04	SAT TT=0.313 CHECKS=38296	SAT TT=0.301 CHECKS=38051	SAT TT=1.579 ASSIGNMENTS=20	SAT TT=141.085 ASSIGNMENTS=84703	No data	No data	No data	SAT TT=0.044 ASSIGNMENTS=16 CHECKS=19679	SAT TT=0.043 ASSIGNMENTS=16 CHECKS=19679	No data	No data	No data	SAT TT=0.034 ASSIGNMENTS=16 CHECKS=19679	SAT TT=0.109 ASSIGNMENTS=598 CHECKS=156274	? (exit code) TT=0.278	SAT TT=0.05 ASSIGNMENTS=58 CHECKS=31322	SAT TT=0.033 ASSIGNMENTS=17 CHECKS=19697	? TT=1.725	No data	SAT TT=1.396	SAT TT=1.675
csp/rcpsp/ normalized-rcpsp25-27.xml	SAT TT=0.029	? TT=0.694	? TT=0.645	SAT TT=0.045	SAT TT=15.283 CHECKS=1605190	SAT TT=18.318 CHECKS=1628350	SAT TT=1.723 ASSIGNMENTS=20	SAT TT=1.637 ASSIGNMENTS=20	No data	No data	No data	SAT TT=0.04 ASSIGNMENTS=18 CHECKS=16336	SAT TT=0.042 ASSIGNMENTS=18 CHECKS=16336	No data	No data	No data	SAT TT=0.029 ASSIGNMENTS=18 CHECKS=16336	SAT TT=0.064 ASSIGNMENTS=279 CHECKS=88059	? (exit code) TT=0.296	SAT TT=0.237 ASSIGNMENTS=440 CHECKS=331445	SAT TT=0.029 ASSIGNMENTS=19 CHECKS=16215	? TT=1.867	No data	SAT TT=1.301	SAT TT=1.466
csp/rcpsp/ normalized-rcpsp25-28.xml	SAT TT=0.024	? TT=0.696	? TT=0.67	SAT TT=1.528	SAT TT=26.199 CHECKS=2891850	SAT TT=40.778 CHECKS=4505620	SAT TT=7.674 ASSIGNMENTS=3975	SAT TT=3.151 ASSIGNMENTS=1073	No data	No data	No data	SAT TT=0.035 ASSIGNMENTS=10 CHECKS=12949	SAT TT=0.034 ASSIGNMENTS=10 CHECKS=12949	No data	No data	No data	SAT TT=0.024 ASSIGNMENTS=14 CHECKS=14487	SAT TT=0.063 ASSIGNMENTS=228 CHECKS=93784	? (exit code) TT=0.314	SAT TT=0.138 ASSIGNMENTS=270 CHECKS=179297	SAT TT=0.024 ASSIGNMENTS=10 CHECKS=12949	? TT=1.86	No data	SAT TT=1.195	SAT TT=1.337
csp/rcpsp/ normalized-rcpsp25-29.xml	SAT TT=0.078	? TT=0.656	? TT=0.682	SAT TT=0.078	SAT TT=72.512 CHECKS=6468660	SAT TT=401.969 CHECKS=48069300	SAT TT=7.828 ASSIGNMENTS=3891	SAT TT=4.054 ASSIGNMENTS=1021	No data	No data	No data	SAT TT=1.002 ASSIGNMENTS=1996 CHECKS=1888550	SAT TT=0.926 ASSIGNMENTS=1996 CHECKS=1888550	No data	No data	No data	SAT TT=0.166 ASSIGNMENTS=292 CHECKS=303390	SAT TT=0.339 ASSIGNMENTS=1291 CHECKS=640586	? (exit code) TT=0.274	SAT TT=0.452 ASSIGNMENTS=768 CHECKS=693547	SAT TT=0.241 ASSIGNMENTS=502 CHECKS=459864	? TT=1.786	No data	SAT TT=1.538	SAT TT=1.667
csp/rcpsp/ normalized-rcpsp25-30.xml	SAT TT=0.04	? TT=0.62	? TT=0.621	SAT TT=0.04	SAT TT=40.539 CHECKS=4524180	SAT TT=55.257 CHECKS=5337870	SAT TT=5.862 ASSIGNMENTS=2580	SAT TT=4.02 ASSIGNMENTS=1113	No data	No data	No data	SAT TT=0.094 ASSIGNMENTS=166 CHECKS=134785	SAT TT=0.093 ASSIGNMENTS=166 CHECKS=134785	No data	No data	No data	SAT TT=0.114 ASSIGNMENTS=283 CHECKS=185294	SAT TT=0.137 ASSIGNMENTS=567 CHECKS=230194	? (exit code) TT=0.295	SAT TT=0.075 ASSIGNMENTS=156 CHECKS=80790	SAT TT=0.114 ASSIGNMENTS=280 CHECKS=204847	? TT=1.724	No data	SAT TT=1.233	SAT TT=1.334
csp/rcpsp/ normalized-rcpsp25-31.xml	SAT TT=0.142	? TT=0.699	? TT=0.766	SAT TT=0.142	SAT TT=754.859 CHECKS=47128500	SAT TT=235.647 CHECKS=23504000	SAT TT=3.143 ASSIGNMENTS=1631	SAT TT=6.043 ASSIGNMENTS=1991	No data	No data	No data	SAT TT=0.264 ASSIGNMENTS=510 CHECKS=510649	SAT TT=0.265 ASSIGNMENTS=510 CHECKS=510649	No data	No data	No data	SAT TT=0.194 ASSIGNMENTS=460 CHECKS=393248	SAT TT=2.595 ASSIGNMENTS=8568 CHECKS=5794460	? (exit code) TT=0.315	SAT TT=0.569 ASSIGNMENTS=1059 CHECKS=973692	SAT TT=0.912 ASSIGNMENTS=1907 CHECKS=2071760	? TT=1.686	No data	SAT TT=1.4	SAT TT=1.501
csp/rcpsp/ normalized-rcpsp25-32.xml	SAT TT=2.786	? TT=0.637	? TT=0.638	SAT TT=153.183	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=354.866 ASSIGNMENTS=356826	SAT TT=517.693 ASSIGNMENTS=250056	No data	No data	No data	SAT TT=50.696 ASSIGNMENTS=57994 CHECKS=93533900	SAT TT=50.152 ASSIGNMENTS=57994 CHECKS=93533900	No data	No data	No data	SAT TT=62.493 ASSIGNMENTS=91450 CHECKS=133333000	SAT TT=32.986 ASSIGNMENTS=50176 CHECKS=71033800	? (exit code) TT=0.285	SAT TT=403.671 ASSIGNMENTS=524676 CHECKS=717575000	SAT TT=42.683 ASSIGNMENTS=57994 CHECKS=93533900	? TT=1.872	No data	SAT TT=2.786	SAT TT=3.618
csp/rcpsp/ normalized-rcpsp25-33.xml	SAT TT=0.022	? TT=0.631	? TT=0.701	SAT TT=27.216	SAT TT=25.129 CHECKS=1909240	SAT TT=34.812 CHECKS=2775470	SAT TT=118.892 ASSIGNMENTS=73144	SAT TT=1.397 ASSIGNMENTS=106	No data	No data	No data	SAT TT=0.036 ASSIGNMENTS=29 CHECKS=16506	SAT TT=0.036 ASSIGNMENTS=29 CHECKS=16506	No data	No data	No data	SAT TT=0.022 ASSIGNMENTS=23 CHECKS=14433	SAT TT=0.028 ASSIGNMENTS=63 CHECKS=24510	? (exit code) TT=0.287	SAT TT=0.029 ASSIGNMENTS=58 CHECKS=23241	SAT TT=0.024 ASSIGNMENTS=29 CHECKS=16506	? TT=1.824	No data	SAT TT=1.093	SAT TT=1.145
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpsp/ normalized-rcpsp25-34.xml	SAT TT=0.042	? TT=0.701	? TT=0.622	SAT TT=2.97	SAT TT=34.745 CHECKS=2751540	SAT TT=36.703 CHECKS=3148470	SAT TT=77.259 ASSIGNMENTS=24965	SAT TT=1.779 ASSIGNMENTS=17	No data	No data	No data	SAT TT=0.054 ASSIGNMENTS=24 CHECKS=33928	SAT TT=0.053 ASSIGNMENTS=24 CHECKS=33928	No data	No data	No data	SAT TT=0.057 ASSIGNMENTS=45 CHECKS=61063	SAT TT=0.075 ASSIGNMENTS=188 CHECKS=100520	? (exit code) TT=0.267	SAT TT=0.138 ASSIGNMENTS=167 CHECKS=176459	SAT TT=0.042 ASSIGNMENTS=24 CHECKS=33928	? TT=1.677	No data	SAT TT=1.396	SAT TT=1.672
csp/rcpsp/ normalized-rcpsp25-35.xml	SAT TT=0.028	? TT=0.619	? TT=0.644	SAT TT=0.056	SAT TT=24.866 CHECKS=3617760	SAT TT=19.658 CHECKS=2448860	SAT TT=1.443 ASSIGNMENTS=65	SAT TT=1.487 ASSIGNMENTS=9	No data	No data	No data	SAT TT=0.041 ASSIGNMENTS=26 CHECKS=24187	SAT TT=0.04 ASSIGNMENTS=26 CHECKS=24187	No data	No data	No data	SAT TT=0.047 ASSIGNMENTS=61 CHECKS=59581	SAT TT=0.035 ASSIGNMENTS=78 CHECKS=35453	? (exit code) TT=0.294	SAT TT=0.028 ASSIGNMENTS=33 CHECKS=13434	SAT TT=0.028 ASSIGNMENTS=28 CHECKS=26842	? TT=1.792	No data	SAT TT=1.148	SAT TT=1.244
csp/rcpsp/ normalized-rcpsp25-36.xml	SAT TT=0.028	? TT=0.665	? TT=0.615	SAT TT=0.055	SAT TT=30.838 CHECKS=2921200	SAT TT=52.845 CHECKS=4787250	SAT TT=37.569 ASSIGNMENTS=24940	SAT TT=1.514 ASSIGNMENTS=159	No data	No data	No data	SAT TT=0.125 ASSIGNMENTS=300 CHECKS=191145	SAT TT=0.124 ASSIGNMENTS=300 CHECKS=191145	No data	No data	No data	SAT TT=0.032 ASSIGNMENTS=53 CHECKS=33517	SAT TT=0.067 ASSIGNMENTS=254 CHECKS=99099	? (exit code) TT=0.289	SAT TT=0.028 ASSIGNMENTS=40 CHECKS=19150	SAT TT=0.051 ASSIGNMENTS=116 CHECKS=72461	? TT=1.841	No data	SAT TT=1.341	SAT TT=1.318
csp/rcpsp/ normalized-rcpsp25-37.xml	SAT TT=0.123	? TT=0.783	? TT=0.645	SAT TT=45.349	SAT TT=35.69 CHECKS=3376760	SAT TT=239.516 CHECKS=26658200	SAT TT=380.415 ASSIGNMENTS=416757	SAT TT=1.629 ASSIGNMENTS=63	No data	No data	No data	SAT TT=0.506 ASSIGNMENTS=970 CHECKS=928680	SAT TT=0.465 ASSIGNMENTS=970 CHECKS=928680	No data	No data	No data	SAT TT=0.379 ASSIGNMENTS=783 CHECKS=671823	SAT TT=0.123 ASSIGNMENTS=451 CHECKS=195940	? (exit code) TT=0.291	SAT TT=2.147 ASSIGNMENTS=3191 CHECKS=3766060	SAT TT=0.455 ASSIGNMENTS=937 CHECKS=888087	? TT=1.781	No data	SAT TT=1.295	SAT TT=1.494
csp/rcpsp/ normalized-rcpsp25-38.xml	SAT TT=0.038	? TT=0.652	? TT=0.652	SAT TT=0.408	SAT TT=21.786 CHECKS=1973000	SAT TT=124.771 CHECKS=12218000	SAT TT=1.513 ASSIGNMENTS=58	SAT TT=1.35 ASSIGNMENTS=25	No data	No data	No data	SAT TT=0.054 ASSIGNMENTS=87 CHECKS=43497	SAT TT=0.055 ASSIGNMENTS=87 CHECKS=43497	No data	No data	No data	SAT TT=0.038 ASSIGNMENTS=68 CHECKS=38144	SAT TT=0.098 ASSIGNMENTS=352 CHECKS=149775	? (exit code) TT=0.293	SAT TT=0.041 ASSIGNMENTS=65 CHECKS=32496	SAT TT=0.323 ASSIGNMENTS=872 CHECKS=606455	? TT=1.677	No data	SAT TT=1.431	SAT TT=1.397
csp/rcpsp/ normalized-rcpsp25-39.xml	SAT TT=1.159	? TT=0.618	? TT=0.616	SAT TT=193.39	SAT TT=115.577 CHECKS=13354700	? (TO) TT=1800.1	SAT TT=52.77 ASSIGNMENTS=67692	SAT TT=44.148 ASSIGNMENTS=28917	No data	No data	No data	SAT TT=9.164 ASSIGNMENTS=3989 CHECKS=3836740	SAT TT=9.721 ASSIGNMENTS=3989 CHECKS=3836740	No data	No data	No data	SAT TT=1.159 ASSIGNMENTS=2484 CHECKS=2427650	SAT TT=4.658 ASSIGNMENTS=12660 CHECKS=9676070	? (exit code) TT=0.311	SAT TT=12.103 ASSIGNMENTS=20925 CHECKS=23176700	SAT TT=1.778 ASSIGNMENTS=3989 CHECKS=3836740	? TT=1.685	No data	SAT TT=1.523	SAT TT=1.401
csp/rcpsp/ normalized-rcpsp25-40.xml	SAT TT=0.095	? TT=0.622	? TT=0.618	SAT TT=0.095	SAT TT=97.913 CHECKS=11061000	SAT TT=101.941 CHECKS=13901600	SAT TT=1.702 ASSIGNMENTS=136	SAT TT=59.765 ASSIGNMENTS=21361	No data	No data	No data	SAT TT=0.544 ASSIGNMENTS=1250 CHECKS=1043960	SAT TT=0.556 ASSIGNMENTS=1250 CHECKS=1043960	No data	No data	No data	SAT TT=0.875 ASSIGNMENTS=1617 CHECKS=1913130	SAT TT=1.644 ASSIGNMENTS=5906 CHECKS=3416490	? (exit code) TT=0.299	SAT TT=0.298 ASSIGNMENTS=630 CHECKS=430688	SAT TT=1.077 ASSIGNMENTS=2216 CHECKS=2337940	? TT=1.874	No data	SAT TT=1.516	SAT TT=1.533
csp/rcpspTighter/ normalized-rcpsptight20-02.xml	UNSAT TT=0.009	? TT=0.571	? TT=0.6	UNSAT TT=3.86	UNSAT TT=0.01 CHECKS=246	UNSAT TT=0.009 CHECKS=246	UNSAT TT=0.627 ASSIGNMENTS=0	UNSAT TT=0.637 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.863 ASSIGNMENTS=2149 CHECKS=1346700	UNSAT TT=0.684 ASSIGNMENTS=2149 CHECKS=1346700	No data	No data	No data	UNSAT TT=0.678 ASSIGNMENTS=2158 CHECKS=1391260	UNSAT TT=2.778 ASSIGNMENTS=10715 CHECKS=5598410	? (exit code) TT=0.238	UNSAT TT=5.778 ASSIGNMENTS=16343 CHECKS=9870710	UNSAT TT=1.995 ASSIGNMENTS=6119 CHECKS=4144010	? TT=1.555	No data	UNSAT TT=1.13	UNSAT TT=1.222
csp/rcpspTighter/ normalized-rcpsptight20-03.xml	UNSAT TT=0.622	? TT=0.642	? TT=0.665	UNSAT TT=1.783	UNSAT TT=358.739 CHECKS=30539700	UNSAT TT=137.954 CHECKS=18405800	UNSAT TT=17.806 ASSIGNMENTS=14656	UNSAT TT=14.245 ASSIGNMENTS=4830	No data	No data	No data	UNSAT TT=0.745 ASSIGNMENTS=1990 CHECKS=1524820	UNSAT TT=0.745 ASSIGNMENTS=1990 CHECKS=1524820	No data	No data	No data	UNSAT TT=0.622 ASSIGNMENTS=1679 CHECKS=1296090	UNSAT TT=1.708 ASSIGNMENTS=7398 CHECKS=3320540	? (exit code) TT=0.24	UNSAT TT=3.462 ASSIGNMENTS=8118 CHECKS=6164510	UNSAT TT=3.52 ASSIGNMENTS=8996 CHECKS=7520210	? TT=1.503	No data	UNSAT TT=1.043	UNSAT TT=1.144
csp/rcpspTighter/ normalized-rcpsptight20-04.xml	SAT TT=0.018	? TT=0.602	? TT=0.571	SAT TT=0.032	SAT TT=0.036 CHECKS=1871	SAT TT=0.037 CHECKS=1918	SAT TT=1.146 ASSIGNMENTS=9	SAT TT=1.094 ASSIGNMENTS=12	No data	No data	No data	SAT TT=0.123 ASSIGNMENTS=339 CHECKS=203742	SAT TT=0.124 ASSIGNMENTS=339 CHECKS=203742	No data	No data	No data	SAT TT=0.146 ASSIGNMENTS=371 CHECKS=273792	SAT TT=0.018 ASSIGNMENTS=5 CHECKS=7194	? (exit code) TT=0.267	SAT TT=0.065 ASSIGNMENTS=143 CHECKS=79682	SAT TT=0.09 ASSIGNMENTS=275 CHECKS=174354	? TT=1.532	No data	SAT TT=1.124	SAT TT=1.186
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpspTighter/ normalized-rcpsptight20-05.xml	UNSAT TT=0.009	? TT=0.702	? TT=0.57	UNSAT TT=4.668	UNSAT TT=0.009 CHECKS=247	UNSAT TT=0.01 CHECKS=247	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.607 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=11.942 ASSIGNMENTS=10752 CHECKS=10533300	UNSAT TT=12.056 ASSIGNMENTS=10752 CHECKS=10533300	No data	No data	No data	UNSAT TT=1.349 ASSIGNMENTS=3104 CHECKS=3122430	UNSAT TT=2.539 ASSIGNMENTS=8551 CHECKS=5643780	? (exit code) TT=0.248	UNSAT TT=6.378 ASSIGNMENTS=14995 CHECKS=13109700	UNSAT TT=4.492 ASSIGNMENTS=10752 CHECKS=10533300	? TT=1.448	No data	UNSAT TT=1.087	UNSAT TT=1.182
csp/rcpspTighter/ normalized-rcpsptight20-06.xml	UNSAT TT=0.009	? TT=0.604	? TT=0.604	UNSAT TT=0.169	UNSAT TT=0.011 CHECKS=248	UNSAT TT=0.009 CHECKS=248	UNSAT TT=0.575 ASSIGNMENTS=0	UNSAT TT=0.687 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.112 ASSIGNMENTS=341 CHECKS=201134	UNSAT TT=0.115 ASSIGNMENTS=341 CHECKS=201134	No data	No data	No data	UNSAT TT=0.127 ASSIGNMENTS=373 CHECKS=255543	UNSAT TT=0.71 ASSIGNMENTS=4652 CHECKS=1485000	? (exit code) TT=0.254	UNSAT TT=0.203 ASSIGNMENTS=701 CHECKS=342151	UNSAT TT=0.138 ASSIGNMENTS=506 CHECKS=276645	? TT=1.45	No data	UNSAT TT=0.959	UNSAT TT=1.214
csp/rcpspTighter/ normalized-rcpsptight20-07.xml	UNSAT TT=0.009	? TT=0.598	? TT=0.574	UNSAT TT=4.622	UNSAT TT=0.009 CHECKS=218	UNSAT TT=0.009 CHECKS=218	UNSAT TT=0.663 ASSIGNMENTS=0	UNSAT TT=0.611 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.454 ASSIGNMENTS=1127 CHECKS=987048	UNSAT TT=0.455 ASSIGNMENTS=1127 CHECKS=987048	No data	No data	No data	UNSAT TT=0.331 ASSIGNMENTS=865 CHECKS=709562	UNSAT TT=1.059 ASSIGNMENTS=5039 CHECKS=2334830	? (exit code) TT=0.238	UNSAT TT=0.838 ASSIGNMENTS=1965 CHECKS=1367040	UNSAT TT=0.529 ASSIGNMENTS=1547 CHECKS=1289090	? TT=1.595	No data	UNSAT TT=1.207	UNSAT TT=1.116
csp/rcpspTighter/ normalized-rcpsptight20-08.xml	UNSAT TT=0.01	? TT=0.608	? TT=0.573	UNSAT TT=48.397	UNSAT TT=0.01 CHECKS=277	UNSAT TT=0.01 CHECKS=277	UNSAT TT=0.579 ASSIGNMENTS=0	UNSAT TT=0.577 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=1.245 ASSIGNMENTS=4371 CHECKS=2816320	UNSAT TT=1.349 ASSIGNMENTS=4371 CHECKS=2816320	No data	No data	No data	UNSAT TT=1.4 ASSIGNMENTS=5029 CHECKS=2892720	UNSAT TT=1.992 ASSIGNMENTS=10211 CHECKS=4028150	? (exit code) TT=0.254	UNSAT TT=7.198 ASSIGNMENTS=19550 CHECKS=10771700	UNSAT TT=4.446 ASSIGNMENTS=14870 CHECKS=9352280	? TT=1.468	No data	UNSAT TT=1.086	UNSAT TT=1.086
csp/rcpspTighter/ normalized-rcpsptight20-09.xml	UNSAT TT=0.009	? TT=0.627	? TT=0.572	UNSAT TT=3.997	UNSAT TT=0.011 CHECKS=213	UNSAT TT=0.009 CHECKS=213	UNSAT TT=0.573 ASSIGNMENTS=0	UNSAT TT=0.562 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.419 ASSIGNMENTS=1553 CHECKS=859950	UNSAT TT=0.416 ASSIGNMENTS=1553 CHECKS=859950	No data	No data	No data	UNSAT TT=0.473 ASSIGNMENTS=1727 CHECKS=989460	UNSAT TT=0.928 ASSIGNMENTS=5950 CHECKS=1917450	? (exit code) TT=0.251	UNSAT TT=2.504 ASSIGNMENTS=8305 CHECKS=4450540	UNSAT TT=1.706 ASSIGNMENTS=6289 CHECKS=3769650	? TT=1.489	No data	UNSAT TT=0.973	UNSAT TT=1.016
csp/rcpspTighter/ normalized-rcpsptight20-10.xml	UNSAT TT=0.011	? TT=0.603	? TT=0.571	UNSAT TT=6.005	UNSAT TT=0.012 CHECKS=230	UNSAT TT=0.011 CHECKS=230	UNSAT TT=0.557 ASSIGNMENTS=0	UNSAT TT=0.606 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.399 ASSIGNMENTS=1347 CHECKS=795448	UNSAT TT=0.4 ASSIGNMENTS=1347 CHECKS=795448	No data	No data	No data	UNSAT TT=0.126 ASSIGNMENTS=414 CHECKS=230758	UNSAT TT=0.763 ASSIGNMENTS=4647 CHECKS=1565350	? (exit code) TT=0.264	UNSAT TT=2.008 ASSIGNMENTS=6179 CHECKS=3551660	UNSAT TT=0.447 ASSIGNMENTS=1517 CHECKS=916548	? TT=1.574	No data	UNSAT TT=0.905	UNSAT TT=1.027
csp/rcpspTighter/ normalized-rcpsptight20-11.xml	UNSAT TT=0.01	? TT=0.63	? TT=0.569	UNSAT TT=0.031	UNSAT TT=0.011 CHECKS=215	UNSAT TT=0.01 CHECKS=215	UNSAT TT=0.586 ASSIGNMENTS=0	UNSAT TT=0.564 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=2139	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=2139	No data	No data	No data	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=2139	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=2139	? (exit code) TT=0.243	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=2139	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=2139	? TT=1.382	No data	UNSAT TT=0.902	UNSAT TT=1.152
csp/rcpspTighter/ normalized-rcpsptight20-12.xml	UNSAT TT=0.378	? TT=0.601	? TT=0.571	UNSAT TT=360.739	? (TO) TT=1800.09	UNSAT TT=1497.48 CHECKS=143044000	? (TO) TT=1800.13	UNSAT TT=33.188 ASSIGNMENTS=10909	No data	No data	No data	UNSAT TT=0.473 ASSIGNMENTS=1350 CHECKS=995059	UNSAT TT=0.473 ASSIGNMENTS=1350 CHECKS=995059	No data	No data	No data	UNSAT TT=0.378 ASSIGNMENTS=1171 CHECKS=812811	UNSAT TT=1.43 ASSIGNMENTS=6857 CHECKS=3195300	? (exit code) TT=0.24	UNSAT TT=1.752 ASSIGNMENTS=4782 CHECKS=3240570	UNSAT TT=0.822 ASSIGNMENTS=2545 CHECKS=1778320	? TT=1.408	No data	UNSAT TT=1.037	UNSAT TT=1.121
csp/rcpspTighter/ normalized-rcpsptight20-13.xml	UNSAT TT=0.011	? TT=0.579	? TT=0.573	UNSAT TT=1.565	UNSAT TT=0.011 CHECKS=226	UNSAT TT=0.011 CHECKS=226	UNSAT TT=0.608 ASSIGNMENTS=0	UNSAT TT=0.623 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.378 ASSIGNMENTS=990 CHECKS=742881	UNSAT TT=0.377 ASSIGNMENTS=990 CHECKS=742881	No data	No data	No data	UNSAT TT=0.329 ASSIGNMENTS=928 CHECKS=654981	UNSAT TT=1.07 ASSIGNMENTS=5070 CHECKS=2298150	? (exit code) TT=0.253	UNSAT TT=0.968 ASSIGNMENTS=2732 CHECKS=1691540	UNSAT TT=0.683 ASSIGNMENTS=2049 CHECKS=1437140	? TT=1.612	No data	UNSAT TT=1.057	UNSAT TT=1.164
csp/rcpspTighter/ normalized-rcpsptight20-14.xml	UNSAT TT=0.012	? TT=0.645	? TT=0.653	UNSAT TT=58.555	UNSAT TT=0.012 CHECKS=225	UNSAT TT=0.013 CHECKS=225	UNSAT TT=0.627 ASSIGNMENTS=0	UNSAT TT=0.567 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=47.232 ASSIGNMENTS=83072 CHECKS=90499300	UNSAT TT=43.95 ASSIGNMENTS=83072 CHECKS=90499300	No data	No data	No data	UNSAT TT=17.166 ASSIGNMENTS=39150 CHECKS=38472600	UNSAT TT=10.696 ASSIGNMENTS=26150 CHECKS=23527900	? (exit code) TT=0.254	UNSAT TT=58.299 ASSIGNMENTS=131083 CHECKS=102933000	UNSAT TT=40.054 ASSIGNMENTS=83072 CHECKS=90499300	? TT=1.42	No data	UNSAT TT=1.779	UNSAT TT=2.128
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpspTighter/ normalized-rcpsptight20-15.xml	UNSAT TT=0.01	? TT=0.568	? TT=0.605	UNSAT TT=0.038	UNSAT TT=0.01 CHECKS=240	UNSAT TT=0.011 CHECKS=240	UNSAT TT=0.638 ASSIGNMENTS=0	UNSAT TT=0.609 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.026 ASSIGNMENTS=12 CHECKS=8222	UNSAT TT=0.025 ASSIGNMENTS=12 CHECKS=8222	No data	No data	No data	UNSAT TT=0.015 ASSIGNMENTS=5 CHECKS=6400	UNSAT TT=0.039 ASSIGNMENTS=236 CHECKS=63116	? (exit code) TT=0.256	UNSAT TT=0.018 ASSIGNMENTS=30 CHECKS=9311	UNSAT TT=0.015 ASSIGNMENTS=12 CHECKS=8222	? TT=1.014	No data	UNSAT TT=0.924	UNSAT TT=1.009
csp/rcpspTighter/ normalized-rcpsptight20-16.xml	UNSAT TT=0.008	? TT=0.647	? TT=0.588	UNSAT TT=890.343	UNSAT TT=0.01 CHECKS=250	UNSAT TT=0.008 CHECKS=250	UNSAT TT=0.614 ASSIGNMENTS=0	UNSAT TT=0.578 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.74 ASSIGNMENTS=2546 CHECKS=1635260	UNSAT TT=0.702 ASSIGNMENTS=2546 CHECKS=1635260	No data	No data	No data	UNSAT TT=0.732 ASSIGNMENTS=2379 CHECKS=1595740	UNSAT TT=1.478 ASSIGNMENTS=7635 CHECKS=3248930	? (exit code) TT=0.238	UNSAT TT=4.186 ASSIGNMENTS=10733 CHECKS=6369890	UNSAT TT=2.878 ASSIGNMENTS=10060 CHECKS=7030450	? TT=1.471	No data	UNSAT TT=1.276	UNSAT TT=1.178
csp/rcpspTighter/ normalized-rcpsptight20-17.xml	UNSAT TT=0.008	? TT=0.566	? TT=0.6	? (TO) TT=1800.05	UNSAT TT=0.013 CHECKS=210	UNSAT TT=0.008 CHECKS=210	UNSAT TT=0.594 ASSIGNMENTS=0	UNSAT TT=0.606 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=17.723 ASSIGNMENTS=41717 CHECKS=23392900	UNSAT TT=16.944 ASSIGNMENTS=41717 CHECKS=23392900	No data	No data	No data	UNSAT TT=2.322 ASSIGNMENTS=9138 CHECKS=5301430	UNSAT TT=2.379 ASSIGNMENTS=13029 CHECKS=5076460	? (exit code) TT=0.261	UNSAT TT=7.451 ASSIGNMENTS=25495 CHECKS=13748300	UNSAT TT=10.28 ASSIGNMENTS=41717 CHECKS=23392900	? TT=1.417	No data	UNSAT TT=1.404	UNSAT TT=1.37
csp/rcpspTighter/ normalized-rcpsptight20-18.xml	UNSAT TT=0.009	? TT=0.581	? TT=0.563	UNSAT TT=1.298	UNSAT TT=0.011 CHECKS=257	UNSAT TT=0.009 CHECKS=257	UNSAT TT=0.604 ASSIGNMENTS=0	UNSAT TT=0.585 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.473 ASSIGNMENTS=1335 CHECKS=1118440	UNSAT TT=0.506 ASSIGNMENTS=1335 CHECKS=1118440	No data	No data	No data	UNSAT TT=0.469 ASSIGNMENTS=1362 CHECKS=1000200	UNSAT TT=1.545 ASSIGNMENTS=6632 CHECKS=3429010	? (exit code) TT=0.261	UNSAT TT=3.593 ASSIGNMENTS=8379 CHECKS=6772690	UNSAT TT=1.013 ASSIGNMENTS=3050 CHECKS=2479690	? TT=1.576	No data	UNSAT TT=1.193	UNSAT TT=1.129
csp/rcpspTighter/ normalized-rcpsptight20-19.xml	UNSAT TT=0.009	? TT=0.57	? TT=0.627	UNSAT TT=0.464	UNSAT TT=0.009 CHECKS=230	UNSAT TT=0.01 CHECKS=230	UNSAT TT=0.606 ASSIGNMENTS=0	UNSAT TT=0.621 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.146 ASSIGNMENTS=631 CHECKS=259758	UNSAT TT=0.148 ASSIGNMENTS=631 CHECKS=259758	No data	No data	No data	UNSAT TT=0.038 ASSIGNMENTS=160 CHECKS=56431	UNSAT TT=0.605 ASSIGNMENTS=5242 CHECKS=1196920	? (exit code) TT=0.265	UNSAT TT=0.377 ASSIGNMENTS=1678 CHECKS=618857	UNSAT TT=0.218 ASSIGNMENTS=1044 CHECKS=448902	? TT=1.433	No data	UNSAT TT=0.943	UNSAT TT=0.96
csp/rcpspTighter/ normalized-rcpsptight20-20.xml	UNSAT TT=0.009	? TT=0.646	? TT=0.605	UNSAT TT=0.69	UNSAT TT=0.01 CHECKS=230	UNSAT TT=0.009 CHECKS=230	UNSAT TT=0.694 ASSIGNMENTS=0	UNSAT TT=0.667 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.156 ASSIGNMENTS=513 CHECKS=271265	UNSAT TT=0.158 ASSIGNMENTS=513 CHECKS=271265	No data	No data	No data	UNSAT TT=0.261 ASSIGNMENTS=1010 CHECKS=493879	UNSAT TT=0.742 ASSIGNMENTS=4854 CHECKS=1413300	? (exit code) TT=0.24	UNSAT TT=4.065 ASSIGNMENTS=14236 CHECKS=6596280	UNSAT TT=0.596 ASSIGNMENTS=2636 CHECKS=1233850	? TT=1.395	No data	UNSAT TT=0.977	UNSAT TT=1.09
csp/rcpspTighter/ normalized-rcpsptight25-21.xml	UNSAT TT=1.582	? TT=0.618	? TT=0.658	UNSAT TT=165.342	UNSAT TT=1024.31 CHECKS=124745000	UNSAT TT=279.737 CHECKS=35391900	? (TO) TT=1800.09	UNSAT TT=124.767 ASSIGNMENTS=51580	No data	No data	No data	UNSAT TT=36.136 ASSIGNMENTS=44154 CHECKS=53054200	UNSAT TT=36.079 ASSIGNMENTS=44154 CHECKS=53054200	No data	No data	No data	UNSAT TT=7.577 ASSIGNMENTS=11566 CHECKS=13992300	UNSAT TT=7.176 ASSIGNMENTS=15324 CHECKS=13974100	? (exit code) TT=0.289	UNSAT TT=17.453 ASSIGNMENTS=23570 CHECKS=26682500	UNSAT TT=28.983 ASSIGNMENTS=44154 CHECKS=53054200	? TT=1.674	No data	UNSAT TT=1.582	UNSAT TT=1.751
csp/rcpspTighter/ normalized-rcpsptight25-22.xml	UNSAT TT=1.281	? TT=0.653	? TT=0.675	UNSAT TT=130.297	UNSAT TT=522.494 CHECKS=56652200	UNSAT TT=369.766 CHECKS=38111400	? (TO) TT=1800.13	UNSAT TT=20.196 ASSIGNMENTS=7897	No data	No data	No data	UNSAT TT=1.3 ASSIGNMENTS=2305 CHECKS=2617790	UNSAT TT=1.3 ASSIGNMENTS=2305 CHECKS=2617790	No data	No data	No data	UNSAT TT=1.521 ASSIGNMENTS=2794 CHECKS=3377970	UNSAT TT=2.346 ASSIGNMENTS=7408 CHECKS=4783310	? (exit code) TT=0.291	UNSAT TT=6.268 ASSIGNMENTS=9610 CHECKS=11026500	UNSAT TT=7.59 ASSIGNMENTS=13034 CHECKS=16029000	? TT=1.826	No data	UNSAT TT=1.416	UNSAT TT=1.724
csp/rcpspTighter/ normalized-rcpsptight25-23.xml	UNSAT TT=0.013	? TT=0.623	? TT=0.607	UNSAT TT=13.507	UNSAT TT=0.014 CHECKS=493	UNSAT TT=0.013 CHECKS=493	UNSAT TT=0.804 ASSIGNMENTS=0	UNSAT TT=0.852 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=1.354 ASSIGNMENTS=2630 CHECKS=2682530	UNSAT TT=1.261 ASSIGNMENTS=2630 CHECKS=2682530	No data	No data	No data	UNSAT TT=0.82 ASSIGNMENTS=1473 CHECKS=1642750	UNSAT TT=2.859 ASSIGNMENTS=7862 CHECKS=5780540	? (exit code) TT=0.281	UNSAT TT=4.912 ASSIGNMENTS=8501 CHECKS=7822730	UNSAT TT=4.882 ASSIGNMENTS=9382 CHECKS=9871950	? TT=1.704	No data	UNSAT TT=1.238	UNSAT TT=1.408
csp/rcpspTighter/ normalized-rcpsptight25-24.xml	UNSAT TT=0.045	? TT=0.631	? TT=0.619	UNSAT TT=0.118	UNSAT TT=34.83 CHECKS=2647760	UNSAT TT=57.778 CHECKS=4111820	UNSAT TT=0.918 ASSIGNMENTS=0	UNSAT TT=0.936 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.051 ASSIGNMENTS=56 CHECKS=45500	UNSAT TT=0.053 ASSIGNMENTS=56 CHECKS=45500	No data	No data	No data	UNSAT TT=0.045 ASSIGNMENTS=47 CHECKS=49495	UNSAT TT=0.37 ASSIGNMENTS=1569 CHECKS=671862	? (exit code) TT=0.307	UNSAT TT=0.066 ASSIGNMENTS=106 CHECKS=69924	UNSAT TT=0.126 ASSIGNMENTS=331 CHECKS=193789	? TT=1.874	No data	UNSAT TT=1.097	UNSAT TT=1.486
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpspTighter/ normalized-rcpsptight25-25.xml	UNSAT TT=0.183	? TT=0.697	? TT=0.648	UNSAT TT=5.193	UNSAT TT=50.448 CHECKS=6528180	UNSAT TT=83.712 CHECKS=10654400	UNSAT TT=305.717 ASSIGNMENTS=380349	UNSAT TT=1.639 ASSIGNMENTS=33	No data	No data	No data	UNSAT TT=0.208 ASSIGNMENTS=443 CHECKS=386142	UNSAT TT=0.207 ASSIGNMENTS=443 CHECKS=386142	No data	No data	No data	UNSAT TT=0.183 ASSIGNMENTS=363 CHECKS=361543	UNSAT TT=1.154 ASSIGNMENTS=5069 CHECKS=2430940	? (exit code) TT=0.294	UNSAT TT=0.583 ASSIGNMENTS=916 CHECKS=915314	UNSAT TT=0.302 ASSIGNMENTS=660 CHECKS=637124	? TT=1.895	No data	UNSAT TT=1.225	UNSAT TT=1.348
csp/rcpspTighter/ normalized-rcpsptight25-26.xml	UNSAT TT=0.413	? TT=0.621	? TT=0.7	UNSAT TT=1.931	UNSAT TT=35.061 CHECKS=2423480	UNSAT TT=6.517 CHECKS=503636	UNSAT TT=24.002 ASSIGNMENTS=21423	UNSAT TT=7.375 ASSIGNMENTS=3557	No data	No data	No data	UNSAT TT=0.464 ASSIGNMENTS=1022 CHECKS=948375	UNSAT TT=0.457 ASSIGNMENTS=1022 CHECKS=948375	No data	No data	No data	UNSAT TT=0.413 ASSIGNMENTS=959 CHECKS=872617	UNSAT TT=0.867 ASSIGNMENTS=6003 CHECKS=1706480	? (exit code) TT=0.292	UNSAT TT=1.081 ASSIGNMENTS=1884 CHECKS=1798710	UNSAT TT=0.511 ASSIGNMENTS=1081 CHECKS=1066660	? TT=1.691	No data	UNSAT TT=1.439	UNSAT TT=1.506
csp/rcpspTighter/ normalized-rcpsptight25-27.xml	SAT TT=0.04	? TT=0.618	? TT=0.701	SAT TT=0.043	SAT TT=20.193 CHECKS=2602030	SAT TT=32.935 CHECKS=3887640	SAT TT=46.967 ASSIGNMENTS=45072	SAT TT=1.887 ASSIGNMENTS=83	No data	No data	No data	SAT TT=0.174 ASSIGNMENTS=533 CHECKS=228742	SAT TT=0.174 ASSIGNMENTS=533 CHECKS=228742	No data	No data	No data	SAT TT=0.136 ASSIGNMENTS=422 CHECKS=193478	SAT TT=0.167 ASSIGNMENTS=707 CHECKS=328456	? (exit code) TT=0.277	SAT TT=0.658 ASSIGNMENTS=1213 CHECKS=1033990	SAT TT=0.04 ASSIGNMENTS=73 CHECKS=35229	? TT=1.711	No data	SAT TT=1.276	SAT TT=1.499
csp/rcpspTighter/ normalized-rcpsptight25-28.xml	UNSAT TT=0.22	? TT=0.613	? TT=0.656	UNSAT TT=6.118	UNSAT TT=37.698 CHECKS=4040560	UNSAT TT=55.535 CHECKS=6128380	UNSAT TT=1.409 ASSIGNMENTS=0	UNSAT TT=1.425 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.23 ASSIGNMENTS=527 CHECKS=464291	UNSAT TT=0.22 ASSIGNMENTS=527 CHECKS=464291	No data	No data	No data	UNSAT TT=0.274 ASSIGNMENTS=648 CHECKS=562360	UNSAT TT=1.058 ASSIGNMENTS=4804 CHECKS=2222340	? (exit code) TT=0.3	UNSAT TT=0.362 ASSIGNMENTS=646 CHECKS=639591	UNSAT TT=0.558 ASSIGNMENTS=1266 CHECKS=1245730	? TT=1.789	No data	UNSAT TT=1.182	UNSAT TT=1.328
csp/rcpspTighter/ normalized-rcpsptight25-29.xml	UNSAT TT=0.111	? TT=0.639	? TT=0.652	UNSAT TT=6.694	UNSAT TT=0.194 CHECKS=22095	UNSAT TT=0.201 CHECKS=24535	UNSAT TT=1.049 ASSIGNMENTS=0	UNSAT TT=0.999 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.158 ASSIGNMENTS=311 CHECKS=299211	UNSAT TT=0.17 ASSIGNMENTS=311 CHECKS=299211	No data	No data	No data	UNSAT TT=0.111 ASSIGNMENTS=172 CHECKS=191480	UNSAT TT=1.093 ASSIGNMENTS=4512 CHECKS=2320050	? (exit code) TT=0.313	UNSAT TT=0.398 ASSIGNMENTS=578 CHECKS=657591	UNSAT TT=0.385 ASSIGNMENTS=758 CHECKS=761699	? TT=1.702	No data	UNSAT TT=1.236	UNSAT TT=1.556
csp/rcpspTighter/ normalized-rcpsptight25-30.xml	UNSAT TT=0.013	? TT=0.617	? TT=0.675	UNSAT TT=8.634	UNSAT TT=0.015 CHECKS=462	UNSAT TT=0.013 CHECKS=462	UNSAT TT=516.952 ASSIGNMENTS=281079	UNSAT TT=13.51 ASSIGNMENTS=5717	No data	No data	No data	UNSAT TT=0.069 ASSIGNMENTS=88 CHECKS=87821	UNSAT TT=0.07 ASSIGNMENTS=88 CHECKS=87821	No data	No data	No data	UNSAT TT=0.069 ASSIGNMENTS=134 CHECKS=99985	UNSAT TT=0.721 ASSIGNMENTS=4347 CHECKS=1490140	? (exit code) TT=0.292	UNSAT TT=0.051 ASSIGNMENTS=72 CHECKS=52610	UNSAT TT=0.044 ASSIGNMENTS=58 CHECKS=53257	? TT=1.836	No data	UNSAT TT=1.072	UNSAT TT=1.29
csp/rcpspTighter/ normalized-rcpsptight25-31.xml	UNSAT TT=0.253	? TT=0.617	? TT=0.669	UNSAT TT=136.625	UNSAT TT=0.318 CHECKS=38039	UNSAT TT=6.776 CHECKS=776137	UNSAT TT=337.519 ASSIGNMENTS=238842	UNSAT TT=1.726 ASSIGNMENTS=49	No data	No data	No data	UNSAT TT=0.377 ASSIGNMENTS=862 CHECKS=766131	UNSAT TT=0.346 ASSIGNMENTS=862 CHECKS=766131	No data	No data	No data	UNSAT TT=0.253 ASSIGNMENTS=565 CHECKS=501782	UNSAT TT=1.259 ASSIGNMENTS=5554 CHECKS=2703900	? (exit code) TT=0.278	UNSAT TT=0.591 ASSIGNMENTS=978 CHECKS=1032880	UNSAT TT=0.427 ASSIGNMENTS=1026 CHECKS=918625	? TT=1.691	No data	UNSAT TT=1.25	UNSAT TT=1.493
csp/rcpspTighter/ normalized-rcpsptight25-32.xml	UNSAT TT=3.603	? TT=0.782	? TT=0.651	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.13	UNSAT TT=1402.84 ASSIGNMENTS=793823	No data	No data	No data	UNSAT TT=443.906 ASSIGNMENTS=589966 CHECKS=973239000	UNSAT TT=460.695 ASSIGNMENTS=589966 CHECKS=973239000	No data	No data	No data	UNSAT TT=109.784 ASSIGNMENTS=148178 CHECKS=243031000	UNSAT TT=88.227 ASSIGNMENTS=130886 CHECKS=189384000	? (exit code) TT=0.292	UNSAT TT=705.517 ASSIGNMENTS=941338 CHECKS=1217110000	UNSAT TT=407.283 ASSIGNMENTS=589966 CHECKS=973239000	? TT=1.692	No data	UNSAT TT=3.868	UNSAT TT=3.603
csp/rcpspTighter/ normalized-rcpsptight25-33.xml	UNSAT TT=0.064	? TT=0.636	? TT=0.664	UNSAT TT=615.771	UNSAT TT=40.5 CHECKS=3260480	UNSAT TT=56.132 CHECKS=3910690	UNSAT TT=1774.08 ASSIGNMENTS=1114790	UNSAT TT=1.391 ASSIGNMENTS=50	No data	No data	No data	UNSAT TT=0.065 ASSIGNMENTS=140 CHECKS=80853	UNSAT TT=0.064 ASSIGNMENTS=140 CHECKS=80853	No data	No data	No data	UNSAT TT=0.089 ASSIGNMENTS=240 CHECKS=145899	UNSAT TT=0.662 ASSIGNMENTS=4124 CHECKS=1395860	? (exit code) TT=0.318	UNSAT TT=0.104 ASSIGNMENTS=258 CHECKS=121939	UNSAT TT=0.066 ASSIGNMENTS=220 CHECKS=100304	? TT=1.794	No data	UNSAT TT=1.071	UNSAT TT=1.262
csp/rcpspTighter/ normalized-rcpsptight25-34.xml	UNSAT TT=0.061	? TT=0.649	? TT=0.624	UNSAT TT=0.885	UNSAT TT=105.482 CHECKS=6531350	UNSAT TT=163.729 CHECKS=11945500	UNSAT TT=1.019 ASSIGNMENTS=0	UNSAT TT=1.027 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.08 ASSIGNMENTS=76 CHECKS=95132	UNSAT TT=0.08 ASSIGNMENTS=76 CHECKS=95132	No data	No data	No data	UNSAT TT=0.066 ASSIGNMENTS=58 CHECKS=80555	UNSAT TT=0.323 ASSIGNMENTS=992 CHECKS=598518	? (exit code) TT=0.294	UNSAT TT=0.084 ASSIGNMENTS=72 CHECKS=95960	UNSAT TT=0.061 ASSIGNMENTS=55 CHECKS=89873	? TT=1.827	No data	UNSAT TT=1.3	UNSAT TT=1.597
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpspTighter/ normalized-rcpsptight25-35.xml	UNSAT TT=0.063	? TT=0.649	? TT=0.643	UNSAT TT=0.19	UNSAT TT=41.317 CHECKS=5634690	UNSAT TT=47.298 CHECKS=6923900	UNSAT TT=1.037 ASSIGNMENTS=0	UNSAT TT=1.064 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.063 ASSIGNMENTS=77 CHECKS=66713	UNSAT TT=0.064 ASSIGNMENTS=77 CHECKS=66713	No data	No data	No data	UNSAT TT=0.084 ASSIGNMENTS=142 CHECKS=139446	UNSAT TT=0.965 ASSIGNMENTS=3999 CHECKS=1885680	? (exit code) TT=0.296	UNSAT TT=0.068 ASSIGNMENTS=108 CHECKS=86090	UNSAT TT=0.169 ASSIGNMENTS=359 CHECKS=303514	? TT=1.671	No data	UNSAT TT=1.144	UNSAT TT=1.26
csp/rcpspTighter/ normalized-rcpsptight25-36.xml	UNSAT TT=0.026	? TT=0.678	? TT=0.624	UNSAT TT=0.504	UNSAT TT=34.99 CHECKS=3430370	UNSAT TT=37.264 CHECKS=3983100	UNSAT TT=1.194 ASSIGNMENTS=11	UNSAT TT=1.106 ASSIGNMENTS=3	No data	No data	No data	UNSAT TT=0.05 ASSIGNMENTS=65 CHECKS=47228	UNSAT TT=0.053 ASSIGNMENTS=65 CHECKS=47228	No data	No data	No data	UNSAT TT=0.026 ASSIGNMENTS=30 CHECKS=24646	UNSAT TT=0.415 ASSIGNMENTS=2130 CHECKS=756362	? (exit code) TT=0.297	UNSAT TT=0.037 ASSIGNMENTS=52 CHECKS=34504	UNSAT TT=0.044 ASSIGNMENTS=85 CHECKS=55637	? TT=1.68	No data	UNSAT TT=1.099	UNSAT TT=1.245
csp/rcpspTighter/ normalized-rcpsptight25-37.xml	UNSAT TT=0.069	? TT=0.698	? TT=0.669	UNSAT TT=0.833	UNSAT TT=0.131 CHECKS=11505	UNSAT TT=0.151 CHECKS=11535	UNSAT TT=0.952 ASSIGNMENTS=0	UNSAT TT=1.02 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.08 ASSIGNMENTS=89 CHECKS=88964	UNSAT TT=0.078 ASSIGNMENTS=89 CHECKS=88964	No data	No data	No data	UNSAT TT=0.069 ASSIGNMENTS=103 CHECKS=93938	UNSAT TT=0.722 ASSIGNMENTS=2751 CHECKS=1312100	? (exit code) TT=0.31	UNSAT TT=0.109 ASSIGNMENTS=162 CHECKS=134322	UNSAT TT=0.089 ASSIGNMENTS=146 CHECKS=130827	? TT=1.71	No data	UNSAT TT=1.302	UNSAT TT=1.638
csp/rcpspTighter/ normalized-rcpsptight25-38.xml	UNSAT TT=1.243	? TT=0.608	? TT=0.61	UNSAT TT=249.56	? (TO) TT=1800.03	UNSAT TT=680.022 CHECKS=58899000	? (TO) TT=1800.11	UNSAT TT=11.292 ASSIGNMENTS=3174	No data	No data	No data	UNSAT TT=11.25 ASSIGNMENTS=7157 CHECKS=7611830	UNSAT TT=10.612 ASSIGNMENTS=7157 CHECKS=7611830	No data	No data	No data	UNSAT TT=2.071 ASSIGNMENTS=4319 CHECKS=4153920	UNSAT TT=2.871 ASSIGNMENTS=9007 CHECKS=5509230	? (exit code) TT=0.304	UNSAT TT=6.067 ASSIGNMENTS=10039 CHECKS=9213400	UNSAT TT=3.714 ASSIGNMENTS=7157 CHECKS=7611830	? TT=1.702	No data	UNSAT TT=1.243	UNSAT TT=1.404
csp/rcpspTighter/ normalized-rcpsptight25-39.xml	UNSAT TT=0.011	? TT=0.635	? TT=0.655	? (TO) TT=1800.08	UNSAT TT=0.014 CHECKS=471	UNSAT TT=0.011 CHECKS=471	UNSAT TT=0.735 ASSIGNMENTS=0	UNSAT TT=0.806 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=1.401 ASSIGNMENTS=3042 CHECKS=3073840	UNSAT TT=13.801 ASSIGNMENTS=11924 CHECKS=13528200	No data	No data	No data	UNSAT TT=1.554 ASSIGNMENTS=3003 CHECKS=3352220	UNSAT TT=2.21 ASSIGNMENTS=7101 CHECKS=4713580	? (exit code) TT=0.318	UNSAT TT=8.021 ASSIGNMENTS=13169 CHECKS=14465600	UNSAT TT=6.224 ASSIGNMENTS=11924 CHECKS=13528200	? TT=1.672	No data	UNSAT TT=1.234	UNSAT TT=1.408
csp/rcpspTighter/ normalized-rcpsptight25-40.xml	UNSAT TT=1.685	? TT=0.703	? TT=0.624	UNSAT TT=156.548	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=1720.13 ASSIGNMENTS=1006120	UNSAT TT=527.112 ASSIGNMENTS=206029	No data	No data	No data	UNSAT TT=19.879 ASSIGNMENTS=18084 CHECKS=29092100	UNSAT TT=18.286 ASSIGNMENTS=18084 CHECKS=29092100	No data	No data	No data	UNSAT TT=4.757 ASSIGNMENTS=7457 CHECKS=10836300	UNSAT TT=4.857 ASSIGNMENTS=11796 CHECKS=10914700	? (exit code) TT=0.288	UNSAT TT=62.392 ASSIGNMENTS=74721 CHECKS=110836000	UNSAT TT=12.38 ASSIGNMENTS=18084 CHECKS=29092100	? TT=1.865	No data	UNSAT TT=1.685	UNSAT TT=1.745
csp/renault/ normalized-renault_ext.xml	SAT TT=0.548	SAT TT=1.578 CHECKS=313 NODES=101	SAT TT=1.806 CHECKS=377 NODES=0	SAT TT=15.428	SAT TT=5.948 CHECKS=11142	SAT TT=4.777 CHECKS=8696	SAT TT=4.408 ASSIGNMENTS=16	SAT TT=4.319 ASSIGNMENTS=36	SAT TT=69.752 CHECKS=39909200 NODES=101	SAT TT=62.978 CHECKS=47007700 NODES=101700000	SAT TT=306.893 CHECKS=735698000 NODES=60086	SAT TT=0.548 ASSIGNMENTS=18 CHECKS=741	SAT TT=0.583 ASSIGNMENTS=18 CHECKS=741	SAT TT=10.791	SAT TT=10.169	SAT TT=1.12 CHECKS=643	SAT TT=0.581 ASSIGNMENTS=18 CHECKS=741	SAT TT=0.607 ASSIGNMENTS=27 CHECKS=1061	SAT TT=5.03	SAT TT=0.582 ASSIGNMENTS=23 CHECKS=653	SAT TT=0.573 ASSIGNMENTS=18 CHECKS=741	? TT=87.525	SAT TT=1.418 ASSIGNMENTS=101 CHECKS=19797	SAT TT=7.865	SAT TT=7.652
csp/renault/ normalized-renault-mgd_ext.xml	SAT TT=0.539	SAT TT=1.547 CHECKS=383 NODES=101	SAT TT=1.622 CHECKS=642 NODES=0	SAT TT=15.491	SAT TT=5.46 CHECKS=11086	SAT TT=5.709 CHECKS=10432	SAT TT=4.364 ASSIGNMENTS=16	SAT TT=3.804 ASSIGNMENTS=36	SAT TT=70.942 CHECKS=39908900 NODES=101	SAT TT=237.327 CHECKS=79510000 NODES=490800000	SAT TT=676.776 CHECKS=1568950000 NODES=153877	SAT TT=0.549 ASSIGNMENTS=18 CHECKS=685	SAT TT=0.581 ASSIGNMENTS=18 CHECKS=685	SAT TT=10.734	SAT TT=9.999	SAT TT=1.095 CHECKS=580	SAT TT=0.571 ASSIGNMENTS=18 CHECKS=685	SAT TT=0.587 ASSIGNMENTS=31 CHECKS=1046	SAT TT=4.735	SAT TT=0.539 ASSIGNMENTS=23 CHECKS=599	SAT TT=0.573 ASSIGNMENTS=18 CHECKS=685	? TT=78.148	SAT TT=1.42 ASSIGNMENTS=101 CHECKS=19875	SAT TT=7.112	SAT TT=8.015
csp/rlfapGraphsMod/ normalized-graph12-w0.xml	SAT TT=0.085	SAT TT=2.169 CHECKS=26373 NODES=680	SAT TT=2.086 CHECKS=30060 NODES=0	SAT TT=0.156	SAT TT=36.379 CHECKS=6510070	SAT TT=4.444 CHECKS=2211930	SAT TT=1.253 ASSIGNMENTS=341	SAT TT=1.342 ASSIGNMENTS=341	SAT TT=1.166 CHECKS=24408 NODES=680	SAT TT=1.209 CHECKS=93540 NODES=324	SAT TT=1.198 CHECKS=148620 NODES=324	SAT TT=0.11 ASSIGNMENTS=340 CHECKS=680	SAT TT=0.104 ASSIGNMENTS=340 CHECKS=680	SAT TT=15.206	SAT TT=12.616	No data	SAT TT=0.094 ASSIGNMENTS=340 CHECKS=680	SAT TT=0.085 ASSIGNMENTS=340 CHECKS=680	SAT TT=1.218	SAT TT=0.111 ASSIGNMENTS=340 CHECKS=680	SAT TT=0.096 ASSIGNMENTS=340 CHECKS=680	SAT TT=3.647	No data	SAT TT=2.959	SAT TT=2.99
csp/rlfapGraphsMod/ normalized-graph12-w1.xml	UNSAT TT=0.209	UNSAT TT=2.067 CHECKS=372790 NODES=437	UNSAT TT=1.711 CHECKS=49562 NODES=0	? (TO) TT=1800.04	UNSAT TT=2.559 CHECKS=158798	UNSAT TT=0.325 CHECKS=164912	UNSAT TT=1.956 ASSIGNMENTS=0	UNSAT TT=2.061 ASSIGNMENTS=0	UNSAT TT=3.628 CHECKS=42831 NODES=25	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=0.209 ASSIGNMENTS=15 CHECKS=4010	UNSAT TT=0.218 ASSIGNMENTS=15 CHECKS=4010	UNSAT TT=68.461	UNSAT TT=69.315	No data	UNSAT TT=0.295 ASSIGNMENTS=85 CHECKS=10554	UNSAT TT=5.782 ASSIGNMENTS=11341 CHECKS=451559	UNSAT TT=101.81	UNSAT TT=0.74 ASSIGNMENTS=828 CHECKS=39462	UNSAT TT=0.219 ASSIGNMENTS=15 CHECKS=4010	UNSAT TT=7.507	No data	UNSAT TT=4.064	UNSAT TT=4.794
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapGraphsMod/ normalized-graph13-w0.xml	SAT TT=0.123	SAT TT=3.768 CHECKS=36495 NODES=916	SAT TT=3.265 CHECKS=41113 NODES=0	SAT TT=0.211	SAT TT=36.996 CHECKS=5732920	SAT TT=5.189 CHECKS=1954350	SAT TT=1.548 ASSIGNMENTS=459	SAT TT=1.566 ASSIGNMENTS=459	SAT TT=1.442 CHECKS=34046 NODES=916	SAT TT=1.767 CHECKS=129438 NODES=445	SAT TT=1.494 CHECKS=231572 NODES=445	SAT TT=0.134 ASSIGNMENTS=458 CHECKS=916	SAT TT=0.139 ASSIGNMENTS=458 CHECKS=916	SAT TT=18.098	SAT TT=16.244	No data	SAT TT=0.128 ASSIGNMENTS=458 CHECKS=916	SAT TT=0.123 ASSIGNMENTS=458 CHECKS=916	SAT TT=1.529	SAT TT=0.143 ASSIGNMENTS=458 CHECKS=916	SAT TT=0.125 ASSIGNMENTS=458 CHECKS=916	SAT TT=4.252	No data	SAT TT=3.669	SAT TT=4.186
csp/rlfapGraphsMod/ normalized-graph13-w1.xml	UNSAT TT=0.265	UNSAT TT=2.352 CHECKS=430640 NODES=416	UNSAT TT=2.058 CHECKS=40924 NODES=0	UNSAT TT=1340.48	UNSAT TT=3.858 CHECKS=263217	UNSAT TT=0.528 CHECKS=275302	UNSAT TT=1.872 ASSIGNMENTS=0	UNSAT TT=1.772 ASSIGNMENTS=0	UNSAT TT=4.186 CHECKS=37250 NODES=13	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.265 ASSIGNMENTS=11 CHECKS=5004	UNSAT TT=0.268 ASSIGNMENTS=11 CHECKS=5004	UNSAT TT=98.236	UNSAT TT=86.968	No data	UNSAT TT=0.416 ASSIGNMENTS=58 CHECKS=15543	UNSAT TT=7.787 ASSIGNMENTS=12379 CHECKS=566067	UNSAT TT=1.596	UNSAT TT=15.46 ASSIGNMENTS=21782 CHECKS=1003740	UNSAT TT=0.302 ASSIGNMENTS=13 CHECKS=5726	UNSAT TT=9.225	No data	UNSAT TT=5.109	UNSAT TT=6.026
csp/rlfapGraphsMod/ normalized-graph14-f28.xml	UNSAT TT=0.611	UNSAT TT=5.572 CHECKS=2827300 NODES=11553	UNSAT TT=29.257 CHECKS=11764300 NODES=756	? (TO) TT=1800.08	UNSAT TT=319.439 CHECKS=16788100	? (TO) TT=1800.04	UNSAT TT=4.903 ASSIGNMENTS=60	UNSAT TT=4.573 ASSIGNMENTS=60	UNSAT TT=7.166 CHECKS=28784 NODES=98	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=0.854 ASSIGNMENTS=2630 CHECKS=338944	UNSAT TT=0.839 ASSIGNMENTS=2630 CHECKS=338944	UNSAT TT=34.784	UNSAT TT=32.943	No data	UNSAT TT=0.611 ASSIGNMENTS=1496 CHECKS=208181	UNSAT TT=4.358 ASSIGNMENTS=13026 CHECKS=2078880	? (TO) TT=1800.12	UNSAT TT=59.33 ASSIGNMENTS=124843 CHECKS=27501900	UNSAT TT=2.632 ASSIGNMENTS=8813 CHECKS=1298650	UNSAT TT=9.531	No data	UNSAT TT=4.468	UNSAT TT=6.345
csp/rlfapGraphsMod/ normalized-graph2-f24.xml	SAT TT=0.16	SAT TT=2.277 CHECKS=180188 NODES=836	SAT TT=6.047 CHECKS=7611710 NODES=1040	SAT TT=0.379	SAT TT=3.342 CHECKS=1586100	? (TO) TT=1800.08	SAT TT=3.014 ASSIGNMENTS=179	SAT TT=3.039 ASSIGNMENTS=179	SAT TT=3.937 CHECKS=88922 NODES=1122	SAT TT=11.886 CHECKS=45641200 NODES=169800	? (TO) TT=1800.07	SAT TT=0.186 ASSIGNMENTS=215 CHECKS=24475	SAT TT=0.185 ASSIGNMENTS=215 CHECKS=24475	SAT TT=31.219	SAT TT=34.229	No data	SAT TT=0.16 ASSIGNMENTS=210 CHECKS=24312	SAT TT=3.699 ASSIGNMENTS=12817 CHECKS=1565760	? (TO) TT=1800.1	SAT TT=2.503 ASSIGNMENTS=3892 CHECKS=759946	SAT TT=0.191 ASSIGNMENTS=228 CHECKS=27009	SAT TT=7.046	No data	SAT TT=3.594	SAT TT=3.65
csp/rlfapGraphsMod/ normalized-graph8-f10.xml	SAT TT=1.474	SAT TT=4.051 CHECKS=1454430 NODES=3640	SAT TT=4.361 CHECKS=1292430 NODES=2704	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=5.769 ASSIGNMENTS=1434	SAT TT=5.859 ASSIGNMENTS=1434	SAT TT=9.546 CHECKS=404794 NODES=2815	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=8.281 ASSIGNMENTS=2351 CHECKS=521685	SAT TT=11.216 ASSIGNMENTS=3640 CHECKS=1454430	SAT TT=79.854	SAT TT=83.725	No data	SAT TT=1.821 ASSIGNMENTS=2697 CHECKS=692904	SAT TT=8.12 ASSIGNMENTS=17992 CHECKS=2813080	? (TO) TT=1800.1	SAT TT=15.045 ASSIGNMENTS=19962 CHECKS=4487820	SAT TT=1.474 ASSIGNMENTS=2351 CHECKS=521685	SAT TT=13.333	No data	SAT TT=17.837	SAT TT=8.754
csp/rlfapGraphsMod/ normalized-graph8-f11.xml	UNSAT TT=0.536	UNSAT TT=4.9 CHECKS=4604290 NODES=5841	UNSAT TT=5.331 CHECKS=4097270 NODES=2898	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=4.788 ASSIGNMENTS=44	UNSAT TT=4.888 ASSIGNMENTS=44	UNSAT TT=6.871 CHECKS=45530 NODES=89	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=11.852 ASSIGNMENTS=5841 CHECKS=4604290	UNSAT TT=13.005 ASSIGNMENTS=5841 CHECKS=4604290	UNSAT TT=78.09	UNSAT TT=77.649	No data	UNSAT TT=2.628 ASSIGNMENTS=4420 CHECKS=1276860	UNSAT TT=6.813 ASSIGNMENTS=13018 CHECKS=2408860	? (TO) TT=1800.06	UNSAT TT=2.868 ASSIGNMENTS=3515 CHECKS=824129	UNSAT TT=0.536 ASSIGNMENTS=477 CHECKS=128676	UNSAT TT=11.885	No data	UNSAT TT=6.302	UNSAT TT=8.057
csp/rlfapGraphsMod/ normalized-graph9-f10.xml	UNSAT TT=0.969	UNSAT TT=6.925 CHECKS=6824400 NODES=8649	UNSAT TT=7.674 CHECKS=8142880 NODES=9257	? (TO) TT=1800.11	UNSAT TT=217.241 CHECKS=13085300	? (TO) TT=1800.03	UNSAT TT=6.302 ASSIGNMENTS=8	UNSAT TT=7.134 ASSIGNMENTS=8	UNSAT TT=14.874 CHECKS=511133 NODES=2336	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=1.314 ASSIGNMENTS=1042 CHECKS=393813	UNSAT TT=1.161 ASSIGNMENTS=1042 CHECKS=393813	UNSAT TT=64.761	UNSAT TT=65.829	No data	UNSAT TT=0.969 ASSIGNMENTS=753 CHECKS=284684	UNSAT TT=11.126 ASSIGNMENTS=17622 CHECKS=3880640	? (TO) TT=1800.07	UNSAT TT=3.706 ASSIGNMENTS=4385 CHECKS=956685	UNSAT TT=6.393 ASSIGNMENTS=8708 CHECKS=3007850	UNSAT TT=17.519	No data	UNSAT TT=8.281	UNSAT TT=10.442
csp/rlfapGraphsMod/ normalized-graph9-f9.xml	SAT TT=0.95	SAT TT=6.054 CHECKS=4193910 NODES=6974	SAT TT=6.367 CHECKS=4379440 NODES=6847	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=9.731 ASSIGNMENTS=4869	SAT TT=9.814 ASSIGNMENTS=4869	SAT TT=46.158 CHECKS=2924930 NODES=18042	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=12.577 ASSIGNMENTS=6974 CHECKS=4193910	SAT TT=13.059 ASSIGNMENTS=6974 CHECKS=4193910	SAT TT=73.708	SAT TT=69.983	No data	SAT TT=1.118 ASSIGNMENTS=1702 CHECKS=347961	SAT TT=14.289 ASSIGNMENTS=28695 CHECKS=5020480	? (TO) TT=1800.12	SAT TT=46.577 ASSIGNMENTS=72521 CHECKS=19087000	SAT TT=0.95 ASSIGNMENTS=1379 CHECKS=276578	SAT TT=22.848	No data	SAT TT=36.627	SAT TT=13.029
csp/rlfapGraphs/ normalized-graph10.xml	SAT TT=1.015	SAT TT=4.103 CHECKS=741372 NODES=932	SAT TT=4.428 CHECKS=3635170 NODES=683	SAT TT=1342.64	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=36.267 ASSIGNMENTS=241	SAT TT=36.59 ASSIGNMENTS=241	SAT TT=8.381 CHECKS=208650 NODES=687	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=1.015 ASSIGNMENTS=215 CHECKS=116751	SAT TT=1.038 ASSIGNMENTS=215 CHECKS=116751	SAT TT=219.55	SAT TT=190.876	No data	SAT TT=1.336 ASSIGNMENTS=342 CHECKS=204388	SAT TT=5.693 ASSIGNMENTS=630 CHECKS=793963	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1.027 ASSIGNMENTS=212 CHECKS=116453	SAT TT=17.812	No data	SAT TT=9.686	SAT TT=11.603
csp/rlfapGraphs/ normalized-graph11.xml	UNSAT TT=0.271	UNSAT TT=3.038 CHECKS=4088 NODES=0	UNSAT TT=3.278 CHECKS=4088 NODES=0	UNSAT TT=0.644	UNSAT TT=2.894 CHECKS=512465	UNSAT TT=0.494 CHECKS=443375	UNSAT TT=2.996 ASSIGNMENTS=0	UNSAT TT=3.082 ASSIGNMENTS=0	UNSAT TT=9.013 CHECKS=5027 NODES=0	UNSAT TT=8.963 CHECKS=6090 NODES=0	UNSAT TT=8.54 CHECKS=6090 NODES=0	UNSAT TT=0.271 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=0.295 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=361.391	UNSAT TT=354.656	No data	UNSAT TT=0.283 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=0.275 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=2.53	UNSAT TT=0.278 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=0.286 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=14.934	No data	UNSAT TT=7.274	UNSAT TT=9.674
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapGraphs/ normalized-graph14.xml	SAT TT=0.563	SAT TT=5.07 CHECKS=280166 NODES=916	SAT TT=3.841 CHECKS=293518 NODES=0	SAT TT=0.852	SAT TT=6.898 CHECKS=103037	SAT TT=21.538 CHECKS=198701	SAT TT=7.304 ASSIGNMENTS=459	SAT TT=6.907 ASSIGNMENTS=459	SAT TT=8.493 CHECKS=204857 NODES=916	SAT TT=7.475 CHECKS=1125240 NODES=734	SAT TT=7.973 CHECKS=3209380 NODES=721	SAT TT=0.644 ASSIGNMENTS=458 CHECKS=27646	SAT TT=0.617 ASSIGNMENTS=458 CHECKS=27646	SAT TT=55.396	SAT TT=50.221	No data	SAT TT=0.563 ASSIGNMENTS=458 CHECKS=27646	SAT TT=0.601 ASSIGNMENTS=458 CHECKS=29773	? (TO) TT=1800.03	SAT TT=1.191 ASSIGNMENTS=457 CHECKS=35749	SAT TT=0.657 ASSIGNMENTS=458 CHECKS=27280	SAT TT=19.277	No data	SAT TT=11.096	SAT TT=14.108
csp/rlfapGraphs/ normalized-graph1.xml	SAT TT=0.136	SAT TT=1.588 CHECKS=62401 NODES=200	SAT TT=1.574 CHECKS=65702 NODES=0	SAT TT=0.218	SAT TT=0.607 CHECKS=20520	SAT TT=0.115 CHECKS=22738	SAT TT=2.659 ASSIGNMENTS=101	SAT TT=2.523 ASSIGNMENTS=101	SAT TT=2.987 CHECKS=42183 NODES=200	SAT TT=3.037 CHECKS=240144 NODES=159	SAT TT=3.06 CHECKS=389011 NODES=172	SAT TT=0.169 ASSIGNMENTS=100 CHECKS=9591	SAT TT=0.167 ASSIGNMENTS=100 CHECKS=9591	SAT TT=33.63	SAT TT=33.827	No data	SAT TT=0.152 ASSIGNMENTS=100 CHECKS=9591	SAT TT=0.136 ASSIGNMENTS=96 CHECKS=8256	SAT TT=39.11	SAT TT=0.138 ASSIGNMENTS=99 CHECKS=10298	SAT TT=0.149 ASSIGNMENTS=100 CHECKS=9512	SAT TT=7.187	No data	SAT TT=3.186	SAT TT=3.66
csp/rlfapGraphs/ normalized-graph2.xml	SAT TT=0.298	SAT TT=2.327 CHECKS=133861 NODES=400	SAT TT=2.332 CHECKS=140191 NODES=0	SAT TT=0.414	SAT TT=1.676 CHECKS=64619	SAT TT=1.299 CHECKS=111303	SAT TT=3.726 ASSIGNMENTS=201	SAT TT=3.771 ASSIGNMENTS=201	SAT TT=4.654 CHECKS=88161 NODES=401	SAT TT=4.321 CHECKS=506348 NODES=317	SAT TT=4.439 CHECKS=908426 NODES=289	SAT TT=0.317 ASSIGNMENTS=200 CHECKS=16863	SAT TT=0.303 ASSIGNMENTS=200 CHECKS=16863	SAT TT=42.592	SAT TT=44.046	No data	SAT TT=0.326 ASSIGNMENTS=200 CHECKS=16863	SAT TT=0.308 ASSIGNMENTS=200 CHECKS=16138	? (TO) TT=1800.03	SAT TT=0.298 ASSIGNMENTS=199 CHECKS=18762	SAT TT=0.304 ASSIGNMENTS=200 CHECKS=17038	SAT TT=10.487	No data	SAT TT=5.161	SAT TT=6.768
csp/rlfapGraphs/ normalized-graph4.xml	SAT TT=0.351	SAT TT=2.807 CHECKS=398868 NODES=565	SAT TT=2.478 CHECKS=706300 NODES=0	SAT TT=0.424	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=20.236 ASSIGNMENTS=180	SAT TT=17.841 ASSIGNMENTS=180	SAT TT=5.838 CHECKS=209481 NODES=478	? (TO) TT=1800	SAT TT=5.653 CHECKS=1986800 NODES=1402	SAT TT=0.395 ASSIGNMENTS=170 CHECKS=23928	SAT TT=0.378 ASSIGNMENTS=170 CHECKS=23928	SAT TT=129.377	SAT TT=116.961	No data	SAT TT=0.351 ASSIGNMENTS=170 CHECKS=23928	SAT TT=0.553 ASSIGNMENTS=159 CHECKS=62098	? (TO) TT=1800.14	SAT TT=156.993 ASSIGNMENTS=19704 CHECKS=18022300	SAT TT=0.359 ASSIGNMENTS=181 CHECKS=22642	SAT TT=12.411	No data	SAT TT=5.423	SAT TT=7.058
csp/rlfapGraphs/ normalized-graph6.xml	UNSAT TT=0.13	UNSAT TT=2.146 CHECKS=4115 NODES=0	UNSAT TT=2.148 CHECKS=4115 NODES=0	UNSAT TT=0.366	UNSAT TT=1.438 CHECKS=197452	UNSAT TT=0.265 CHECKS=223120	UNSAT TT=2.079 ASSIGNMENTS=0	UNSAT TT=2.462 ASSIGNMENTS=0	UNSAT TT=5.601 CHECKS=6036 NODES=0	UNSAT TT=5.028 CHECKS=9331 NODES=0	UNSAT TT=5.421 CHECKS=9331 NODES=0	UNSAT TT=0.146 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=0.152 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=151.306	UNSAT TT=176.41	No data	UNSAT TT=0.13 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=0.134 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=1.764	UNSAT TT=0.13 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=0.135 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=9.66	No data	UNSAT TT=5.191	UNSAT TT=6.528
csp/rlfapGraphs/ normalized-graph7.xml	UNSAT TT=0.124	UNSAT TT=2.114 CHECKS=3567 NODES=0	UNSAT TT=2.149 CHECKS=3567 NODES=0	UNSAT TT=0.39	UNSAT TT=1.388 CHECKS=131592	UNSAT TT=0.143 CHECKS=37561	UNSAT TT=2.396 ASSIGNMENTS=0	UNSAT TT=2.227 ASSIGNMENTS=0	UNSAT TT=6.159 CHECKS=4870 NODES=0	UNSAT TT=5.906 CHECKS=8544 NODES=0	UNSAT TT=5.75 CHECKS=8544 NODES=0	UNSAT TT=0.138 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=0.138 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=179.881	UNSAT TT=195.481	No data	UNSAT TT=0.127 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=0.124 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=1.998	UNSAT TT=0.126 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=0.126 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=9.216	No data	UNSAT TT=5.132	UNSAT TT=6.089
csp/rlfapGraphs/ normalized-graph8.xml	SAT TT=0.492	SAT TT=3.872 CHECKS=209983 NODES=680	SAT TT=3.165 CHECKS=369394 NODES=0	SAT TT=0.639	SAT TT=5.74 CHECKS=178952	SAT TT=14.526 CHECKS=455575	SAT TT=12.037 ASSIGNMENTS=340	SAT TT=6.094 ASSIGNMENTS=340	SAT TT=8.096 CHECKS=153423 NODES=681	SAT TT=6.702 CHECKS=1059770 NODES=877	SAT TT=7.503 CHECKS=2480420 NODES=714	SAT TT=0.541 ASSIGNMENTS=339 CHECKS=31071	SAT TT=0.575 ASSIGNMENTS=339 CHECKS=31071	SAT TT=89.176	SAT TT=96.058	No data	SAT TT=0.508 ASSIGNMENTS=339 CHECKS=31071	SAT TT=0.492 ASSIGNMENTS=331 CHECKS=29033	? (TO) TT=1800.03	SAT TT=3.418 ASSIGNMENTS=2720 CHECKS=363800	SAT TT=0.509 ASSIGNMENTS=340 CHECKS=31900	SAT TT=16.368	No data	SAT TT=9.518	SAT TT=10.772
csp/rlfapGraphs/ normalized-graph9.xml	SAT TT=0.644	SAT TT=4.705 CHECKS=283755 NODES=916	SAT TT=3.917 CHECKS=296646 NODES=0	SAT TT=0.96	SAT TT=61.296 CHECKS=746374	SAT TT=145.043 CHECKS=1383040	SAT TT=9.167 ASSIGNMENTS=458	SAT TT=8.541 ASSIGNMENTS=458	SAT TT=11.144 CHECKS=268141 NODES=1362	SAT TT=9.549 CHECKS=1605020 NODES=1185	SAT TT=9.92 CHECKS=4217320 NODES=926	SAT TT=0.79 ASSIGNMENTS=456 CHECKS=43681	SAT TT=0.72 ASSIGNMENTS=456 CHECKS=43681	SAT TT=82.869	SAT TT=76.261	No data	SAT TT=0.644 ASSIGNMENTS=456 CHECKS=43681	SAT TT=0.686 ASSIGNMENTS=455 CHECKS=43623	? (TO) TT=1800.03	SAT TT=4.255 ASSIGNMENTS=3652 CHECKS=534973	SAT TT=0.727 ASSIGNMENTS=458 CHECKS=44150	SAT TT=21.03	No data	SAT TT=15.525	SAT TT=15.608
csp/rlfapScens11/ normalized-scen11-f10.xml	UNSAT TT=0.722	UNSAT TT=2.696 CHECKS=440330 NODES=253	UNSAT TT=2.724 CHECKS=65045 NODES=0	? (TO) TT=1800.07	UNSAT TT=2.184 CHECKS=699353	UNSAT TT=1.016 CHECKS=1301930	UNSAT TT=6.058 ASSIGNMENTS=1091	UNSAT TT=6.604 ASSIGNMENTS=1091	UNSAT TT=6.286 CHECKS=76733 NODES=221	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.796 ASSIGNMENTS=670 CHECKS=205926	UNSAT TT=0.816 ASSIGNMENTS=670 CHECKS=205926	UNSAT TT=27.202	UNSAT TT=25.308	No data	UNSAT TT=0.759 ASSIGNMENTS=661 CHECKS=204618	UNSAT TT=7.548 ASSIGNMENTS=19771 CHECKS=2888340	? (TO) TT=1800.1	UNSAT TT=6.373 ASSIGNMENTS=7751 CHECKS=1985340	UNSAT TT=0.722 ASSIGNMENTS=495 CHECKS=165159	UNSAT TT=12.726	No data	UNSAT TT=7.214	UNSAT TT=9.202
csp/rlfapScens11/ normalized-scen11-f12.xml	UNSAT TT=0.649	UNSAT TT=2.554 CHECKS=15780 NODES=0	UNSAT TT=2.484 CHECKS=15780 NODES=0	? (TO) TT=1800.11	UNSAT TT=1.744 CHECKS=324105	UNSAT TT=0.904 CHECKS=1067550	UNSAT TT=5.957 ASSIGNMENTS=845	UNSAT TT=6.446 ASSIGNMENTS=845	UNSAT TT=6.042 CHECKS=55192 NODES=144	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=0.702 ASSIGNMENTS=468 CHECKS=162266	UNSAT TT=0.671 ASSIGNMENTS=468 CHECKS=162266	UNSAT TT=24.03	UNSAT TT=24.23	No data	UNSAT TT=0.699 ASSIGNMENTS=464 CHECKS=169037	UNSAT TT=6.494 ASSIGNMENTS=17387 CHECKS=2561700	UNSAT TT=1538.39	UNSAT TT=23.231 ASSIGNMENTS=24760 CHECKS=7633420	UNSAT TT=0.649 ASSIGNMENTS=470 CHECKS=162458	UNSAT TT=12.164	No data	UNSAT TT=8.109	UNSAT TT=8.875
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapScens11/ normalized-scen11-f1.xml	UNSAT TT=14.377	UNSAT TT=30.993 CHECKS=131930000 NODES=66963	UNSAT TT=30.52 CHECKS=138782000 NODES=70985	? (TO) TT=1800.07	UNSAT TT=631.624 CHECKS=64180300	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.01	No data	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.12	No data	UNSAT TT=14.377	UNSAT TT=17.761
csp/rlfapScens11/ normalized-scen11-f2.xml	UNSAT TT=12.614	UNSAT TT=12.614 CHECKS=47183500 NODES=25784	UNSAT TT=13.999 CHECKS=49401700 NODES=25606	? (TO) TT=1800.08	UNSAT TT=571.218 CHECKS=37298800	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	No data	UNSAT TT=13.72	UNSAT TT=17.555
csp/rlfapScens11/ normalized-scen11-f3.xml	UNSAT TT=5.851	UNSAT TT=5.851 CHECKS=13528400 NODES=6753	UNSAT TT=6.292 CHECKS=14707200 NODES=7440	? (TO) TT=1800.05	UNSAT TT=164.453 CHECKS=19031900	UNSAT TT=448.332 CHECKS=25253900	? (TO) TT=1800.09	? (TO) TT=1800.14	UNSAT TT=1621.81 CHECKS=273269000 NODES=758734	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=438.425	? (TO) TT=1800.07	No data	? (TO) TT=1800.06	UNSAT TT=533.09 ASSIGNMENTS=744794 CHECKS=201986000	? (TO) TT=1800.09	UNSAT TT=656.602 ASSIGNMENTS=812217 CHECKS=230211000	UNSAT TT=664.886 ASSIGNMENTS=819349 CHECKS=235452000	? (TO) TT=1800.17	No data	UNSAT TT=10.161	UNSAT TT=13.951
csp/rlfapScens11/ normalized-scen11-f4.xml	UNSAT TT=3.566	UNSAT TT=4.21 CHECKS=5082700 NODES=2340	UNSAT TT=3.566 CHECKS=1974780 NODES=1093	? (TO) TT=1800.07	UNSAT TT=12.172 CHECKS=5250390	UNSAT TT=112.373 CHECKS=14684000	? (TO) TT=1800.08	? (TO) TT=1800.12	UNSAT TT=477.351 CHECKS=78497300 NODES=215384	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=182.534	UNSAT TT=238.347	No data	UNSAT TT=1260.05 ASSIGNMENTS=1702530 CHECKS=507298000	UNSAT TT=165.312 ASSIGNMENTS=235699 CHECKS=62847800	? (TO) TT=1800.11	UNSAT TT=207.419 ASSIGNMENTS=253131 CHECKS=76492100	UNSAT TT=198.959 ASSIGNMENTS=251780 CHECKS=74216300	UNSAT TT=372.474	No data	UNSAT TT=9.079	UNSAT TT=12.395
csp/rlfapScens11/ normalized-scen11-f5.xml	UNSAT TT=2.724	UNSAT TT=3.431 CHECKS=2132660 NODES=927	UNSAT TT=2.724 CHECKS=132780 NODES=0	? (TO) TT=1800.07	UNSAT TT=10.117 CHECKS=7068680	UNSAT TT=4.801 CHECKS=6659070	UNSAT TT=664.781 ASSIGNMENTS=923708	UNSAT TT=604.668 ASSIGNMENTS=923708	UNSAT TT=113.569 CHECKS=18503400 NODES=45894	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=713.381 ASSIGNMENTS=2208820 CHECKS=2613080000	UNSAT TT=661.042 ASSIGNMENTS=2208820 CHECKS=2613080000	UNSAT TT=41.806	UNSAT TT=73.23	No data	UNSAT TT=390.947 ASSIGNMENTS=500970 CHECKS=160232000	UNSAT TT=55.746 ASSIGNMENTS=84226 CHECKS=18836900	? (TO) TT=1800.12	UNSAT TT=57.576 ASSIGNMENTS=65817 CHECKS=19491000	UNSAT TT=52.015 ASSIGNMENTS=60738 CHECKS=18224900	UNSAT TT=65.271	No data	UNSAT TT=8.054	UNSAT TT=10.475
csp/rlfapScens11/ normalized-scen11-f6.xml	UNSAT TT=2.923	UNSAT TT=3.238 CHECKS=1194890 NODES=540	UNSAT TT=2.923 CHECKS=78540 NODES=0	? (TO) TT=1800.03	UNSAT TT=3.739 CHECKS=1830160	UNSAT TT=1.753 CHECKS=2779450	UNSAT TT=108.029 ASSIGNMENTS=110191	UNSAT TT=112.737 ASSIGNMENTS=110191	UNSAT TT=30.43 CHECKS=3979890 NODES=10690	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=112.12 ASSIGNMENTS=341772 CHECKS=423566000	UNSAT TT=112.167 ASSIGNMENTS=341772 CHECKS=423566000	UNSAT TT=29.694	UNSAT TT=26.788	No data	UNSAT TT=108.591 ASSIGNMENTS=134685 CHECKS=40136400	UNSAT TT=20.84 ASSIGNMENTS=42235 CHECKS=6207020	? (TO) TT=1800.12	UNSAT TT=27.469 ASSIGNMENTS=34822 CHECKS=9403820	UNSAT TT=11.051 ASSIGNMENTS=12800 CHECKS=3850270	UNSAT TT=25.647	No data	UNSAT TT=7.81	UNSAT TT=10.653
csp/rlfapScens11/ normalized-scen11-f7.xml	UNSAT TT=2.78	UNSAT TT=2.858 CHECKS=981683 NODES=456	UNSAT TT=2.78 CHECKS=60873 NODES=0	? (TO) TT=1800.08	UNSAT TT=2.902 CHECKS=1398620	UNSAT TT=1.513 CHECKS=2328230	UNSAT TT=40.677 ASSIGNMENTS=47519	UNSAT TT=43.896 ASSIGNMENTS=47519	UNSAT TT=19.027 CHECKS=2230100 NODES=5749	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=47.638 ASSIGNMENTS=124244 CHECKS=149291000	UNSAT TT=47.729 ASSIGNMENTS=124244 CHECKS=149291000	UNSAT TT=29.588	UNSAT TT=29.172	No data	UNSAT TT=62.705 ASSIGNMENTS=77568 CHECKS=24159400	UNSAT TT=30.54 ASSIGNMENTS=52458 CHECKS=10581500	? (TO) TT=1800.07	UNSAT TT=26.926 ASSIGNMENTS=33275 CHECKS=9370010	UNSAT TT=6.543 ASSIGNMENTS=7489 CHECKS=2316300	UNSAT TT=19.429	No data	UNSAT TT=7.611	UNSAT TT=10.509
csp/rlfapScens11/ normalized-scen11-f8.xml	UNSAT TT=1.421	UNSAT TT=2.92 CHECKS=569369 NODES=230	UNSAT TT=2.573 CHECKS=54753 NODES=0	? (TO) TT=1800.06	UNSAT TT=3.226 CHECKS=1659280	UNSAT TT=1.171 CHECKS=1603920	UNSAT TT=13.907 ASSIGNMENTS=6305	UNSAT TT=12.964 ASSIGNMENTS=6305	UNSAT TT=7.457 CHECKS=402055 NODES=671	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=15.076 ASSIGNMENTS=13827 CHECKS=17383000	UNSAT TT=14.567 ASSIGNMENTS=13827 CHECKS=17383000	UNSAT TT=38.406	UNSAT TT=48.459	No data	UNSAT TT=9.743 ASSIGNMENTS=11373 CHECKS=3502050	UNSAT TT=13.938 ASSIGNMENTS=31462 CHECKS=4210700	? (TO) TT=1800.03	UNSAT TT=13.359 ASSIGNMENTS=15815 CHECKS=4021800	UNSAT TT=1.421 ASSIGNMENTS=1200 CHECKS=397406	UNSAT TT=13.544	No data	UNSAT TT=7.764	UNSAT TT=9.662
csp/rlfapScens11/ normalized-scen11-f9.xml	UNSAT TT=1.963	UNSAT TT=3.016 CHECKS=518692 NODES=266	UNSAT TT=2.631 CHECKS=51021 NODES=0	? (TO) TT=1800.1	UNSAT TT=2.203 CHECKS=864547	UNSAT TT=1.132 CHECKS=1555510	UNSAT TT=9.242 ASSIGNMENTS=3540	UNSAT TT=10.079 ASSIGNMENTS=3540	UNSAT TT=7.55 CHECKS=258832 NODES=407	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=12.846 ASSIGNMENTS=7920 CHECKS=9831370	UNSAT TT=13.461 ASSIGNMENTS=7920 CHECKS=9831370	UNSAT TT=27.741	UNSAT TT=28.904	No data	UNSAT TT=7.452 ASSIGNMENTS=8666 CHECKS=2798290	UNSAT TT=10.231 ASSIGNMENTS=27126 CHECKS=3851640	? (TO) TT=1800.07	UNSAT TT=10.155 ASSIGNMENTS=12355 CHECKS=3184770	UNSAT TT=1.963 ASSIGNMENTS=1892 CHECKS=628991	UNSAT TT=13.95	No data	UNSAT TT=6.973	UNSAT TT=9.644
csp/rlfapScensMod/ normalized-scen10-w1-f3.xml	UNSAT TT=0.229	UNSAT TT=1.578 CHECKS=35049 NODES=0	UNSAT TT=1.556 CHECKS=35049 NODES=0	UNSAT TT=0.276	UNSAT TT=3.764 CHECKS=642167	UNSAT TT=1.053 CHECKS=762694	UNSAT TT=1.947 ASSIGNMENTS=0	UNSAT TT=1.94 ASSIGNMENTS=0	UNSAT TT=2.754 CHECKS=63484 NODES=52	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.255 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=0.229 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=31.691	UNSAT TT=29.052	No data	UNSAT TT=0.243 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=4.815 ASSIGNMENTS=17867 CHECKS=628729	? (TO) TT=1800.08	UNSAT TT=5.816 ASSIGNMENTS=11290 CHECKS=671534	UNSAT TT=0.236 ASSIGNMENTS=117 CHECKS=8548	UNSAT TT=6.761	No data	UNSAT TT=3.584	UNSAT TT=4.635
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapScensMod/ normalized-scen1-f9.xml	UNSAT TT=0.906	UNSAT TT=5.248 CHECKS=5581360 NODES=4466	UNSAT TT=5.448 CHECKS=5947820 NODES=4414	? (TO) TT=1800.05	UNSAT TT=9.058 CHECKS=4755950	UNSAT TT=108.054 CHECKS=7408920	UNSAT TT=7.491 ASSIGNMENTS=822	UNSAT TT=7.732 ASSIGNMENTS=822	UNSAT TT=9.961 CHECKS=73845 NODES=150	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.958 ASSIGNMENTS=475 CHECKS=206905	UNSAT TT=0.994 ASSIGNMENTS=475 CHECKS=206905	UNSAT TT=35.458	UNSAT TT=37.202	No data	UNSAT TT=1.105 ASSIGNMENTS=728 CHECKS=290577	UNSAT TT=11.269 ASSIGNMENTS=32470 CHECKS=3819250	? (TO) TT=1800.1	UNSAT TT=11.786 ASSIGNMENTS=14133 CHECKS=3375760	UNSAT TT=0.906 ASSIGNMENTS=361 CHECKS=166635	UNSAT TT=16.527	No data	UNSAT TT=9.886	UNSAT TT=12.46
csp/rlfapScensMod/ normalized-scen2-f24.xml	SAT TT=0.091	SAT TT=1.493 CHECKS=217815 NODES=408	SAT TT=1.617 CHECKS=391341 NODES=487	SAT TT=0.232	SAT TT=0.4 CHECKS=34824	SAT TT=1.45 CHECKS=549179	SAT TT=2.257 ASSIGNMENTS=132	SAT TT=2.422 ASSIGNMENTS=132	SAT TT=2.051 CHECKS=29251 NODES=322	SAT TT=2.043 CHECKS=400136 NODES=599	SAT TT=2.007 CHECKS=475172 NODES=284	SAT TT=0.102 ASSIGNMENTS=115 CHECKS=9590	SAT TT=0.104 ASSIGNMENTS=115 CHECKS=9590	SAT TT=8.21	SAT TT=7.945	No data	SAT TT=0.091 ASSIGNMENTS=151 CHECKS=13024	SAT TT=0.36 ASSIGNMENTS=1451 CHECKS=131239	SAT TT=853.331	SAT TT=0.471 ASSIGNMENTS=730 CHECKS=167091	SAT TT=0.092 ASSIGNMENTS=124 CHECKS=10657	SAT TT=5.691	No data	SAT TT=2.564	SAT TT=2.965
csp/rlfapScensMod/ normalized-scen2-f25.xml	UNSAT TT=0.518	UNSAT TT=4.314 CHECKS=13711300 NODES=10010	UNSAT TT=4.466 CHECKS=13887500 NODES=10048	? (TO) TT=1800.05	UNSAT TT=4.204 CHECKS=2472890	UNSAT TT=15.578 CHECKS=7390980	UNSAT TT=3.652 ASSIGNMENTS=1771	UNSAT TT=3.802 ASSIGNMENTS=1771	UNSAT TT=2.256 CHECKS=77534 NODES=404	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.67 ASSIGNMENTS=830 CHECKS=307138	UNSAT TT=0.663 ASSIGNMENTS=830 CHECKS=307138	UNSAT TT=7.734	UNSAT TT=7.444	No data	UNSAT TT=0.667 ASSIGNMENTS=911 CHECKS=343901	UNSAT TT=2.44 ASSIGNMENTS=9894 CHECKS=1130520	UNSAT TT=969.642	UNSAT TT=1.446 ASSIGNMENTS=2668 CHECKS=625943	UNSAT TT=0.518 ASSIGNMENTS=569 CHECKS=227423	UNSAT TT=5.597	No data	UNSAT TT=2.342	UNSAT TT=2.812
csp/rlfapScensMod/ normalized-scen3-f10.xml	SAT TT=0.359	SAT TT=2.393 CHECKS=281340 NODES=711	SAT TT=2.441 CHECKS=347563 NODES=541	SAT TT=0.46	SAT TT=4.54 CHECKS=2141050	SAT TT=7.27 CHECKS=2287680	SAT TT=3.859 ASSIGNMENTS=329	SAT TT=4.017 ASSIGNMENTS=329	SAT TT=4.073 CHECKS=75605 NODES=471	SAT TT=3.912 CHECKS=1253960 NODES=2018	SAT TT=3.768 CHECKS=1610590 NODES=638	SAT TT=0.375 ASSIGNMENTS=369 CHECKS=70090	SAT TT=0.388 ASSIGNMENTS=369 CHECKS=70090	SAT TT=19.201	SAT TT=18.616	No data	SAT TT=0.392 ASSIGNMENTS=446 CHECKS=86223	SAT TT=5.661 ASSIGNMENTS=16394 CHECKS=2269480	? (TO) TT=1800.05	SAT TT=7.261 ASSIGNMENTS=7940 CHECKS=2449160	SAT TT=0.359 ASSIGNMENTS=362 CHECKS=74214	SAT TT=10.41	No data	SAT TT=6.502	SAT TT=6.896
csp/rlfapScensMod/ normalized-scen3-f11.xml	UNSAT TT=0.584	UNSAT TT=3.624 CHECKS=3827460 NODES=4480	UNSAT TT=3.519 CHECKS=3931970 NODES=4441	? (TO) TT=1800.05	UNSAT TT=12.688 CHECKS=3019860	? (TO) TT=1800.04	UNSAT TT=5.305 ASSIGNMENTS=1292	UNSAT TT=4.913 ASSIGNMENTS=1292	UNSAT TT=4.344 CHECKS=55901 NODES=166	? (TO) TT=1800.1	? (TO) TT=1800.02	UNSAT TT=0.584 ASSIGNMENTS=467 CHECKS=167970	UNSAT TT=0.592 ASSIGNMENTS=467 CHECKS=167970	UNSAT TT=18.57	UNSAT TT=16.22	No data	UNSAT TT=0.597 ASSIGNMENTS=561 CHECKS=196978	UNSAT TT=5.523 ASSIGNMENTS=13821 CHECKS=2191410	? (TO) TT=1800.06	UNSAT TT=4.515 ASSIGNMENTS=4627 CHECKS=1461440	UNSAT TT=0.646 ASSIGNMENTS=511 CHECKS=195117	UNSAT TT=10.815	No data	UNSAT TT=5.77	UNSAT TT=7.001
csp/rlfapScensMod/ normalized-scen6-w1-f2.xml	UNSAT TT=0.164	UNSAT TT=1.277 CHECKS=134420 NODES=249	UNSAT TT=1.033 CHECKS=20080 NODES=0	? (TO) TT=1800.06	UNSAT TT=2.216 CHECKS=573508	UNSAT TT=0.721 CHECKS=463712	UNSAT TT=2.093 ASSIGNMENTS=2721	UNSAT TT=2.142 ASSIGNMENTS=2721	UNSAT TT=1.557 CHECKS=62166 NODES=259	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=1.304 ASSIGNMENTS=5245 CHECKS=205264	UNSAT TT=1.348 ASSIGNMENTS=5245 CHECKS=205264	UNSAT TT=10.05	UNSAT TT=8.767	No data	UNSAT TT=1.214 ASSIGNMENTS=5120 CHECKS=198249	UNSAT TT=1.601 ASSIGNMENTS=11428 CHECKS=224727	? (TO) TT=1800.09	UNSAT TT=1.15 ASSIGNMENTS=3647 CHECKS=133019	UNSAT TT=0.164 ASSIGNMENTS=427 CHECKS=17176	UNSAT TT=3.863	No data	UNSAT TT=1.83	UNSAT TT=2.249
csp/rlfapScensMod/ normalized-scen6-w1.xml	SAT TT=0.068	SAT TT=1.123 CHECKS=27542 NODES=202	SAT TT=1.306 CHECKS=54790 NODES=202	SAT TT=0.099	SAT TT=4.693 CHECKS=990773	SAT TT=2.042 CHECKS=778794	SAT TT=1.805 ASSIGNMENTS=97	SAT TT=1.734 ASSIGNMENTS=97	SAT TT=1.404 CHECKS=26716 NODES=206	SAT TT=7.12 CHECKS=37952500 NODES=150661	SAT TT=1.479 CHECKS=144206 NODES=256	SAT TT=0.084 ASSIGNMENTS=99 CHECKS=1998	SAT TT=0.085 ASSIGNMENTS=99 CHECKS=1998	SAT TT=11.032	SAT TT=9.726	No data	SAT TT=0.07 ASSIGNMENTS=98 CHECKS=2004	SAT TT=0.072 ASSIGNMENTS=101 CHECKS=2402	? (TO) TT=1800.12	SAT TT=0.098 ASSIGNMENTS=166 CHECKS=3491	SAT TT=0.068 ASSIGNMENTS=98 CHECKS=2019	SAT TT=3.849	No data	SAT TT=1.836	SAT TT=2.44
csp/rlfapScensMod/ normalized-scen7-w1-f4.xml	SAT TT=0.144	SAT TT=1.462 CHECKS=66006 NODES=407	SAT TT=1.8 CHECKS=436612 NODES=409	SAT TT=0.161	SAT TT=14.923 CHECKS=2457350	SAT TT=11 CHECKS=2665900	SAT TT=1.857 ASSIGNMENTS=186	SAT TT=2.02 ASSIGNMENTS=186	SAT TT=1.996 CHECKS=68515 NODES=508	SAT TT=605.951 CHECKS=2042370000 NODES=16652200	SAT TT=2.176 CHECKS=470614 NODES=999	SAT TT=0.152 ASSIGNMENTS=201 CHECKS=5799	SAT TT=0.159 ASSIGNMENTS=201 CHECKS=5799	SAT TT=19.503	SAT TT=17.753	No data	SAT TT=0.144 ASSIGNMENTS=201 CHECKS=5799	SAT TT=0.249 ASSIGNMENTS=634 CHECKS=19158	? (TO) TT=1800.06	SAT TT=3.241 ASSIGNMENTS=12857 CHECKS=421598	SAT TT=0.153 ASSIGNMENTS=235 CHECKS=8522	SAT TT=5.403	No data	SAT TT=3.002	SAT TT=3.42
csp/rlfapScensMod/ normalized-scen9-w1-f3.xml	UNSAT TT=0.239	UNSAT TT=1.499 CHECKS=35049 NODES=0	UNSAT TT=1.515 CHECKS=35049 NODES=0	UNSAT TT=0.278	UNSAT TT=3.754 CHECKS=637999	UNSAT TT=0.931 CHECKS=660858	UNSAT TT=2.098 ASSIGNMENTS=0	UNSAT TT=2.072 ASSIGNMENTS=0	UNSAT TT=2.725 CHECKS=63484 NODES=52	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=0.283 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=0.26 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=32.643	UNSAT TT=29.867	No data	UNSAT TT=0.239 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=4.821 ASSIGNMENTS=17961 CHECKS=618193	? (TO) TT=1800.12	UNSAT TT=5.597 ASSIGNMENTS=11290 CHECKS=671534	UNSAT TT=0.239 ASSIGNMENTS=117 CHECKS=8548	UNSAT TT=7.339	No data	UNSAT TT=3.722	UNSAT TT=4.757
csp/rlfapScens/ normalized-scen10.xml	UNSAT TT=0.325	UNSAT TT=2.965 CHECKS=28372 NODES=0	UNSAT TT=3.051 CHECKS=28372 NODES=0	UNSAT TT=0.704	UNSAT TT=3.032 CHECKS=895102	UNSAT TT=0.799 CHECKS=838645	UNSAT TT=3.044 ASSIGNMENTS=0	UNSAT TT=3.216 ASSIGNMENTS=0	UNSAT TT=8.779 CHECKS=20253 NODES=0	UNSAT TT=7.079 CHECKS=32670 NODES=0	UNSAT TT=7.853 CHECKS=32670 NODES=0	UNSAT TT=0.352 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.34 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=182.647	UNSAT TT=187.181	No data	UNSAT TT=0.339 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.338 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=4.319	UNSAT TT=0.342 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.325 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=16.58	No data	UNSAT TT=8.147	UNSAT TT=11.121
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapScens/ normalized-scen11.xml	SAT TT=0.618	SAT TT=3.225 CHECKS=304730 NODES=724	SAT TT=3.215 CHECKS=245948 NODES=0	SAT TT=93.826	SAT TT=13.146 CHECKS=6564380	SAT TT=9.779 CHECKS=5004100	SAT TT=7.189 ASSIGNMENTS=582	SAT TT=6.836 ASSIGNMENTS=582	SAT TT=6.761 CHECKS=215011 NODES=847	SAT TT=5.601 CHECKS=1756210 NODES=1097	SAT TT=6.133 CHECKS=2907350 NODES=577	SAT TT=0.629 ASSIGNMENTS=525 CHECKS=65628	SAT TT=0.67 ASSIGNMENTS=525 CHECKS=65628	SAT TT=39.855	SAT TT=34.27	No data	SAT TT=0.71 ASSIGNMENTS=528 CHECKS=71078	SAT TT=5.92 ASSIGNMENTS=9932 CHECKS=818679	? (TO) TT=1800.07	SAT TT=22.236 ASSIGNMENTS=16126 CHECKS=3251060	SAT TT=0.618 ASSIGNMENTS=524 CHECKS=65719	SAT TT=19.404	No data	SAT TT=9.373	SAT TT=11.258
csp/rlfapScens/ normalized-scen1.xml	SAT TT=0.685	SAT TT=4.59 CHECKS=321671 NODES=917	SAT TT=3.737 CHECKS=334060 NODES=0	SAT TT=1.011	SAT TT=14.877 CHECKS=5516800	SAT TT=22.801 CHECKS=5400330	SAT TT=8.064 ASSIGNMENTS=459	SAT TT=8.285 ASSIGNMENTS=459	SAT TT=10.251 CHECKS=223669 NODES=916	SAT TT=9.178 CHECKS=1349020 NODES=715	SAT TT=9.198 CHECKS=3796710 NODES=622	SAT TT=0.807 ASSIGNMENTS=457 CHECKS=42321	SAT TT=0.82 ASSIGNMENTS=457 CHECKS=42321	SAT TT=54.716	SAT TT=49.031	No data	SAT TT=0.719 ASSIGNMENTS=457 CHECKS=42321	SAT TT=0.685 ASSIGNMENTS=456 CHECKS=42809	SAT TT=151.76	SAT TT=0.86 ASSIGNMENTS=526 CHECKS=66352	SAT TT=0.739 ASSIGNMENTS=457 CHECKS=41807	SAT TT=22.661	No data	SAT TT=12.009	SAT TT=16.086
csp/rlfapScens/ normalized-scen3.xml	SAT TT=0.328	SAT TT=2.553 CHECKS=158741 NODES=400	SAT TT=2.478 CHECKS=164098 NODES=0	SAT TT=0.493	SAT TT=5.554 CHECKS=2641720	SAT TT=1.715 CHECKS=141144	SAT TT=5.391 ASSIGNMENTS=201	SAT TT=5.411 ASSIGNMENTS=201	SAT TT=4.653 CHECKS=108830 NODES=400	SAT TT=4.068 CHECKS=708765 NODES=344	SAT TT=4.038 CHECKS=1205100 NODES=266	SAT TT=0.384 ASSIGNMENTS=200 CHECKS=20979	SAT TT=0.376 ASSIGNMENTS=200 CHECKS=20979	SAT TT=26.611	SAT TT=23.264	No data	SAT TT=0.353 ASSIGNMENTS=200 CHECKS=20979	SAT TT=0.328 ASSIGNMENTS=200 CHECKS=23152	SAT TT=10.65	SAT TT=0.375 ASSIGNMENTS=199 CHECKS=25953	SAT TT=0.356 ASSIGNMENTS=200 CHECKS=20646	SAT TT=12.974	No data	SAT TT=6.763	SAT TT=8.466
csp/rlfapScens/ normalized-scen4.xml	SAT TT=0.518	SAT TT=4.313 CHECKS=339251 NODES=1697	SAT TT=4.78 CHECKS=1050340 NODES=0	SAT TT=0.705	SAT TT=6.633 CHECKS=4889670	SAT TT=3.536 CHECKS=5519880	SAT TT=3.504 ASSIGNMENTS=236	SAT TT=3.337 ASSIGNMENTS=236	SAT TT=9.547 CHECKS=186478 NODES=803	? (TO) TT=1800.04	SAT TT=13.21 CHECKS=14677200 NODES=7509	SAT TT=0.521 ASSIGNMENTS=276 CHECKS=41543	SAT TT=0.558 ASSIGNMENTS=276 CHECKS=41543	SAT TT=204.748	SAT TT=190.034	No data	SAT TT=0.518 ASSIGNMENTS=276 CHECKS=41543	SAT TT=0.574 ASSIGNMENTS=252 CHECKS=41824	? (TO) TT=1800.05	SAT TT=1.839 ASSIGNMENTS=13208 CHECKS=772461	SAT TT=0.558 ASSIGNMENTS=288 CHECKS=41739	SAT TT=15.695	No data	SAT TT=8.995	SAT TT=10.817
csp/rlfapScens/ normalized-scen5.xml	SAT TT=0.293	SAT TT=2.855 CHECKS=143699 NODES=687	SAT TT=2.762 CHECKS=291420 NODES=0	SAT TT=0.464	SAT TT=3.336 CHECKS=2318510	SAT TT=2.103 CHECKS=2928560	SAT TT=3.252 ASSIGNMENTS=118	SAT TT=2.795 ASSIGNMENTS=118	SAT TT=6.309 CHECKS=82740 NODES=408	SAT TT=37.325 CHECKS=149608000 NODES=751036	SAT TT=6.586 CHECKS=7092170 NODES=2876	SAT TT=0.338 ASSIGNMENTS=123 CHECKS=22528	SAT TT=0.333 ASSIGNMENTS=123 CHECKS=22528	SAT TT=120.14	SAT TT=109.926	No data	SAT TT=0.331 ASSIGNMENTS=123 CHECKS=22528	SAT TT=0.293 ASSIGNMENTS=248 CHECKS=26775	? (TO) TT=1800.05	SAT TT=1.257 ASSIGNMENTS=3641 CHECKS=416351	SAT TT=0.314 ASSIGNMENTS=136 CHECKS=24585	SAT TT=11.685	No data	SAT TT=6.076	SAT TT=6.77
csp/rlfapScens/ normalized-scen6.xml	UNSAT TT=0.159	UNSAT TT=1.644 CHECKS=29270 NODES=0	UNSAT TT=1.609 CHECKS=29270 NODES=0	UNSAT TT=0.245	UNSAT TT=0.938 CHECKS=239807	UNSAT TT=0.223 CHECKS=245160	UNSAT TT=1.674 ASSIGNMENTS=0	UNSAT TT=1.922 ASSIGNMENTS=0	UNSAT TT=3.342 CHECKS=30700 NODES=0	UNSAT TT=3.03 CHECKS=36119 NODES=0	UNSAT TT=3.08 CHECKS=36119 NODES=0	UNSAT TT=0.183 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=49.908	UNSAT TT=48.228	No data	UNSAT TT=0.172 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=3.392	UNSAT TT=0.171 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=0.171 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=7.211	No data	UNSAT TT=3.987	UNSAT TT=4.456
csp/rlfapScens/ normalized-scen7.xml	UNSAT TT=0.266	UNSAT TT=2.633 CHECKS=15349 NODES=0	UNSAT TT=2.55 CHECKS=15349 NODES=0	UNSAT TT=0.494	UNSAT TT=1.967 CHECKS=555364	UNSAT TT=0.439 CHECKS=530226	UNSAT TT=2.55 ASSIGNMENTS=0	UNSAT TT=2.595 ASSIGNMENTS=0	UNSAT TT=6.044 CHECKS=4964 NODES=0	UNSAT TT=5.854 CHECKS=6142 NODES=0	UNSAT TT=5.528 CHECKS=6142 NODES=0	UNSAT TT=0.266 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=0.283 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=123.077	UNSAT TT=126.03	No data	UNSAT TT=0.281 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=0.299 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=2.871	UNSAT TT=0.305 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=0.268 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=13.32	No data	UNSAT TT=6.506	UNSAT TT=7.928
csp/rlfapScens/ normalized-scen8.xml	UNSAT TT=0.548	UNSAT TT=3.757 CHECKS=12529 NODES=0	UNSAT TT=3.87 CHECKS=12529 NODES=0	UNSAT TT=0.898	UNSAT TT=3.757 CHECKS=465144	UNSAT TT=1.01 CHECKS=837000	UNSAT TT=3.987 ASSIGNMENTS=0	UNSAT TT=3.749 ASSIGNMENTS=0	UNSAT TT=12.054 CHECKS=11399 NODES=0	UNSAT TT=11.229 CHECKS=16090 NODES=0	UNSAT TT=10.635 CHECKS=16090 NODES=0	UNSAT TT=0.557 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=0.614 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=292.112	UNSAT TT=271.184	No data	UNSAT TT=0.548 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=0.588 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=4.28	UNSAT TT=0.6 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=0.598 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=20.31	No data	UNSAT TT=11.467	UNSAT TT=14.774
csp/rlfapScens/ normalized-scen9.xml	UNSAT TT=0.316	UNSAT TT=2.982 CHECKS=28372 NODES=0	UNSAT TT=2.938 CHECKS=28372 NODES=0	UNSAT TT=0.692	UNSAT TT=3.293 CHECKS=875923	UNSAT TT=0.795 CHECKS=854538	UNSAT TT=2.963 ASSIGNMENTS=0	UNSAT TT=3.217 ASSIGNMENTS=0	UNSAT TT=8.071 CHECKS=20253 NODES=0	UNSAT TT=7.793 CHECKS=32670 NODES=0	UNSAT TT=7.093 CHECKS=32670 NODES=0	UNSAT TT=0.343 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.339 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=183.173	UNSAT TT=176.257	No data	UNSAT TT=0.316 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.348 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=4.613	UNSAT TT=0.324 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.329 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=16.673	No data	UNSAT TT=9.058	UNSAT TT=11.096
csp/schurrLemma/ normalized-lemma-100-9-mod.xml	UNSAT TT=0.528	? (TO) TT=1800.1	? (TO) TT=1800.11	UNSAT TT=0.626	? (TO) TT=1800.05	? (TO) TT=1800.02	? (problem) TT=1.346	? (problem) TT=1.442	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.552 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.554 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1466.44	UNSAT TT=751.587	No data	UNSAT TT=0.535 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.539 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=29.938	UNSAT TT=0.53 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.528 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=351.423	No data	UNSAT TT=6.271	UNSAT TT=19.517
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/schurrLemma/ normalized-lemma-12-9-mod.xml	UNSAT TT=0.006	UNSAT TT=27.7 CHECKS=25613000 NODES=320391	UNSAT TT=26.889 CHECKS=24722700 NODES=295247	UNSAT TT=0.029	UNSAT TT=85.673 CHECKS=453129000	UNSAT TT=86.576 CHECKS=446227000	UNSAT TT=0.625 ASSIGNMENTS=0	UNSAT TT=0.615 ASSIGNMENTS=0	UNSAT TT=24.763 CHECKS=31248600 NODES=394741	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=409.422	UNSAT TT=43.735	No data	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.881	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=386.472	No data	UNSAT TT=1.03	UNSAT TT=2
csp/schurrLemma/ normalized-lemma-15-9-mod.xml	UNSAT TT=0.007	UNSAT TT=31.263 CHECKS=34497100 NODES=204625	UNSAT TT=32.959 CHECKS=34693600 NODES=202782	UNSAT TT=0.033	UNSAT TT=117.111 CHECKS=583739000	UNSAT TT=116.253 CHECKS=530920000	UNSAT TT=0.676 ASSIGNMENTS=0	UNSAT TT=0.674 ASSIGNMENTS=0	UNSAT TT=37.503 CHECKS=51654000 NODES=259884	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=784.908	UNSAT TT=53.159	No data	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.971	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=295.39	No data	UNSAT TT=1.343	UNSAT TT=4.464
csp/schurrLemma/ normalized-lemma-20-9-mod.xml	UNSAT TT=0.01	UNSAT TT=62.918 CHECKS=75283300 NODES=202721	UNSAT TT=62.38 CHECKS=74485600 NODES=203248	UNSAT TT=0.047	UNSAT TT=87.451 CHECKS=393807000	UNSAT TT=180.19 CHECKS=817337000	UNSAT TT=0.947 ASSIGNMENTS=0	UNSAT TT=0.939 ASSIGNMENTS=0	UNSAT TT=64.881 CHECKS=110513000 NODES=257259	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=823.395	UNSAT TT=77.391	No data	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=6.472	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=470.351	No data	UNSAT TT=1.4	UNSAT TT=5.219
csp/schurrLemma/ normalized-lemma-23-3.xml	SAT TT=0.012	SAT TT=0.867 CHECKS=7356 NODES=163	SAT TT=0.846 CHECKS=417 NODES=0	SAT TT=0.058	SAT TT=0.061 CHECKS=2188	SAT TT=0.049 CHECKS=66058	SAT TT=0.789 ASSIGNMENTS=18	SAT TT=0.68 ASSIGNMENTS=18	SAT TT=0.912 CHECKS=70160 NODES=866	SAT TT=0.888 CHECKS=44108 NODES=426	SAT TT=0.799 CHECKS=13276 NODES=57	SAT TT=0.024 ASSIGNMENTS=14 CHECKS=1109	SAT TT=0.024 ASSIGNMENTS=14 CHECKS=1109	SAT TT=1.235	SAT TT=1.15	No data	SAT TT=0.012 ASSIGNMENTS=14 CHECKS=1109	SAT TT=0.053 ASSIGNMENTS=801 CHECKS=49729	SAT TT=0.682	SAT TT=0.03 ASSIGNMENTS=227 CHECKS=19516	SAT TT=0.07 ASSIGNMENTS=624 CHECKS=68552	SAT TT=1.91	No data	SAT TT=0.838	SAT TT=0.875
csp/schurrLemma/ normalized-lemma-24-3.xml	UNSAT TT=0.083	UNSAT TT=1.613 CHECKS=313553 NODES=5074	UNSAT TT=1.58 CHECKS=305904 NODES=5022	UNSAT TT=0.083	UNSAT TT=1.712 CHECKS=1738540	UNSAT TT=70.438 CHECKS=117852000	UNSAT TT=2.909 ASSIGNMENTS=8068	UNSAT TT=2.905 ASSIGNMENTS=8068	UNSAT TT=1.164 CHECKS=249923 NODES=2782	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.186 ASSIGNMENTS=1549 CHECKS=189500	UNSAT TT=0.186 ASSIGNMENTS=1549 CHECKS=189500	UNSAT TT=1.038	UNSAT TT=0.834	No data	UNSAT TT=0.151 ASSIGNMENTS=1488 CHECKS=182084	UNSAT TT=0.345 ASSIGNMENTS=5217 CHECKS=418785	UNSAT TT=28.658	UNSAT TT=0.431 ASSIGNMENTS=4815 CHECKS=523343	UNSAT TT=0.342 ASSIGNMENTS=3179 CHECKS=386617	UNSAT TT=2.267	No data	UNSAT TT=1.003	UNSAT TT=1.235
csp/schurrLemma/ normalized-lemma-30-9-mod.xml	UNSAT TT=0.015	UNSAT TT=142.409 CHECKS=209016000 NODES=203833	UNSAT TT=154.915 CHECKS=208352000 NODES=202754	UNSAT TT=0.076	UNSAT TT=354.139 CHECKS=1610310000	UNSAT TT=307.782 CHECKS=1537440000	UNSAT TT=1.125 ASSIGNMENTS=0	UNSAT TT=1.138 ASSIGNMENTS=0	UNSAT TT=157.677 CHECKS=274822000 NODES=251327	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=614.607	UNSAT TT=193.522	No data	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=9.654	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=379.171	No data	UNSAT TT=2.516	UNSAT TT=4.402
csp/schurrLemma/ normalized-lemma-50-9-mod.xml	UNSAT TT=0.044	UNSAT TT=493.224 CHECKS=706177000 NODES=202186	UNSAT TT=460.925 CHECKS=710946000 NODES=203588	UNSAT TT=0.171	UNSAT TT=869.283 CHECKS=3766130000	UNSAT TT=856.879 CHECKS=3702890000	UNSAT TT=2.123 ASSIGNMENTS=0	UNSAT TT=1.976 ASSIGNMENTS=0	UNSAT TT=448.819 CHECKS=804566000 NODES=256766	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.06 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=808.924	UNSAT TT=608.924	No data	UNSAT TT=0.049 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=15.438	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=534.629	No data	UNSAT TT=3.041	UNSAT TT=6.168
csp/schurrLemma/ normalized-lemma-66-4.xml	SAT TT=0.073	SAT TT=1.38 CHECKS=6355 NODES=79	? (TO) TT=1800.13	SAT TT=1675.52	SAT TT=7.54 CHECKS=6558790	? (TO) TT=1800.04	SAT TT=1.812 ASSIGNMENTS=86	SAT TT=1.547 ASSIGNMENTS=86	? (TO) TT=1800.02	SAT TT=41.464 CHECKS=77632000 NODES=183301	SAT TT=1.71 CHECKS=411248 NODES=387	SAT TT=0.085 ASSIGNMENTS=74 CHECKS=23832	SAT TT=0.089 ASSIGNMENTS=74 CHECKS=23832	SAT TT=444.956	? (TO) TT=1800.12	No data	SAT TT=0.073 ASSIGNMENTS=57 CHECKS=19621	SAT TT=421.705 ASSIGNMENTS=821388 CHECKS=577633000	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.16	No data	? (TO) TT=1800.11	? (TO) TT=1800.15
csp/schurrLemma/ normalized-lemma-67-4.xml		? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.1	No data	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.13	No data	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/small/ normalized-patat-02-small-1.xml	SAT TT=2.246	SAT TT=2.246 CHECKS=248439 NODES=200	SAT TT=3.548 CHECKS=1261610 NODES=200	? (TO) TT=1800.04	SAT TT=6.719 CHECKS=235929	SAT TT=18.548 CHECKS=9720380	? (TO) TT=1800.06	SAT TT=34.303 ASSIGNMENTS=153	No data	No data	No data	SAT TT=9.454 ASSIGNMENTS=200 CHECKS=248434	SAT TT=9.822 ASSIGNMENTS=200 CHECKS=248434	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=3.509 ASSIGNMENTS=9656 CHECKS=4751710	SAT TT=484.021 ASSIGNMENTS=1830860 CHECKS=974192000	SAT TT=33.558	No data	SAT TT=3.436	SAT TT=7.659
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/small/ normalized-patat-02-small-2.xml	SAT TT=0.125	SAT TT=2.165 CHECKS=154858 NODES=200	SAT TT=2.061 CHECKS=169805 NODES=0	SAT TT=0.412	SAT TT=5.269 CHECKS=214990	SAT TT=0.382 CHECKS=121917	SAT TT=3.772 ASSIGNMENTS=167	SAT TT=16.793 ASSIGNMENTS=156	No data	No data	No data	SAT TT=0.138 ASSIGNMENTS=158 CHECKS=66591	SAT TT=0.143 ASSIGNMENTS=158 CHECKS=66591	No data	No data	No data	SAT TT=0.125 ASSIGNMENTS=158 CHECKS=66591	SAT TT=2.046 ASSIGNMENTS=33407 CHECKS=8528350	? (TO) TT=1800.06	SAT TT=0.831 ASSIGNMENTS=3613 CHECKS=1547600	SAT TT=0.126 ASSIGNMENTS=139 CHECKS=66615	SAT TT=24.257	No data	SAT TT=3.723	SAT TT=8.377
csp/small/ normalized-patat-02-small-3.xml	SAT TT=0.659	SAT TT=2.772 CHECKS=513869 NODES=201	SAT TT=3.337 CHECKS=1094460 NODES=201	? (TO) TT=1800.12	SAT TT=7.484 CHECKS=222639	SAT TT=16.811 CHECKS=10235300	? (TO) TT=1800.14	SAT TT=39.457 ASSIGNMENTS=211	No data	No data	No data	SAT TT=9.753 ASSIGNMENTS=200 CHECKS=512913	SAT TT=9.783 ASSIGNMENTS=200 CHECKS=512913	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=4.437 ASSIGNMENTS=8774 CHECKS=4579590	SAT TT=0.659 ASSIGNMENTS=2590 CHECKS=1915760	SAT TT=53.908	No data	SAT TT=3.583	SAT TT=7.228
csp/small/ normalized-patat-02-small-4.xml	SAT TT=4.585	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.09	SAT TT=25.632 CHECKS=7305160	SAT TT=20.977 CHECKS=11513500	? (TO) TT=1800.16	SAT TT=68.478 ASSIGNMENTS=2523	No data	No data	No data	SAT TT=426.806 ASSIGNMENTS=600158 CHECKS=285535000	SAT TT=985.394 ASSIGNMENTS=600158 CHECKS=285535000	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=226.958 ASSIGNMENTS=600158 CHECKS=285535000	SAT TT=105.211	No data	SAT TT=4.585	SAT TT=7.664
csp/small/ normalized-patat-02-small-5.xml	SAT TT=0.864	SAT TT=26.032 CHECKS=18919200 NODES=23758	SAT TT=28.841 CHECKS=20000100 NODES=23853	? (TO) TT=1800.02	SAT TT=8.955 CHECKS=299335	SAT TT=18.581 CHECKS=9147290	? (TO) TT=1800.11	SAT TT=43.203 ASSIGNMENTS=167	No data	No data	No data	SAT TT=88.955 ASSIGNMENTS=51260 CHECKS=40277400	SAT TT=57.561 ASSIGNMENTS=51260 CHECKS=40277400	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=5.275 ASSIGNMENTS=9112 CHECKS=5625750	SAT TT=0.864 ASSIGNMENTS=2302 CHECKS=1525810	SAT TT=72.073	No data	SAT TT=5.685	SAT TT=11.379
csp/socialGolfers/ normalized-socialGolfer-6-3-5.xml	SAT TT=8.054	? (TO) TT=1800.12	SAT TT=659.955 CHECKS=135231000 NODES=2529250	? (TO) TT=1800.11	SAT TT=8.054 CHECKS=3369210	SAT TT=16.805 CHECKS=7540830	SAT TT=18.227 ASSIGNMENTS=50236	? (TO) TT=1800.16	SAT TT=241.903 CHECKS=78686900 NODES=154180	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=1661.99 ASSIGNMENTS=48701 CHECKS=42122700	SAT TT=319.841 ASSIGNMENTS=48701 CHECKS=42122700	SAT TT=294.496	SAT TT=24.734	No data	SAT TT=237.562 ASSIGNMENTS=65401 CHECKS=151995000	SAT TT=125.667 ASSIGNMENTS=48774 CHECKS=73355900	? (TO) TT=1800.03	SAT TT=910.112 ASSIGNMENTS=408762 CHECKS=505264000	SAT TT=65.991 ASSIGNMENTS=48701 CHECKS=42122700	? (TO) TT=1800.16	No data	SAT TT=51.289	SAT TT=67.654
csp/socialGolfers/ normalized-socialGolfer-6-3-6.xml	SAT TT=2.664	SAT TT=10.484 CHECKS=929194 NODES=20374	SAT TT=987.752 CHECKS=246549000 NODES=2337870	? (TO) TT=1800.1	SAT TT=15.438 CHECKS=2921480	SAT TT=3.716 CHECKS=839495	SAT TT=5.523 ASSIGNMENTS=3038	SAT TT=8.384 ASSIGNMENTS=3832	SAT TT=36.278 CHECKS=9144040 NODES=6829	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=12.619 ASSIGNMENTS=7230 CHECKS=1003200	SAT TT=12.783 ASSIGNMENTS=7230 CHECKS=1003200	SAT TT=10.405	SAT TT=10.435	No data	? (TO) TT=1800.03	SAT TT=7.298 ASSIGNMENTS=82143 CHECKS=5740400	? (TO) TT=1800.11	SAT TT=7.143 ASSIGNMENTS=6226 CHECKS=4721750	SAT TT=8.532 ASSIGNMENTS=4349 CHECKS=5654250	? TT=160.854	No data	SAT TT=20.385	SAT TT=2.664
csp/socialGolfers/ normalized-socialGolfer-6-3-7.xml	SAT TT=2.969	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=12.344 CHECKS=1841210	SAT TT=10.583 CHECKS=1696730	SAT TT=6.991 ASSIGNMENTS=1636	SAT TT=19.181 ASSIGNMENTS=8377	SAT TT=117.361 CHECKS=46589200 NODES=3983	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=23.583 ASSIGNMENTS=6803 CHECKS=6600970	SAT TT=23.175 ASSIGNMENTS=6803 CHECKS=6600970	SAT TT=17.555	SAT TT=19.308	No data	SAT TT=315.559 ASSIGNMENTS=172044 CHECKS=281587000	SAT TT=11.562 ASSIGNMENTS=120393 CHECKS=8509700	? (TO) TT=1800.05	SAT TT=3.27 ASSIGNMENTS=7423 CHECKS=1615370	SAT TT=2.969 ASSIGNMENTS=1443 CHECKS=1423330	? TT=148.518	No data	SAT TT=3.299	SAT TT=4.012
csp/socialGolfers/ normalized-socialGolfer-6-3-8.xml	SAT TT=2.05	SAT TT=52.4 CHECKS=13777800 NODES=31419	? (TO) TT=1800.15	? (TO) TT=1800.02	SAT TT=18.941 CHECKS=2521860	SAT TT=34.389 CHECKS=2977640	SAT TT=10.993 ASSIGNMENTS=3277	SAT TT=38.512 ASSIGNMENTS=12029	SAT TT=359.09 CHECKS=443317000 NODES=4523	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=67.027 ASSIGNMENTS=11581 CHECKS=25089100	SAT TT=67.61 ASSIGNMENTS=11581 CHECKS=25089100	SAT TT=43.288	SAT TT=42.26	No data	SAT TT=2.05 ASSIGNMENTS=1879 CHECKS=893598	SAT TT=18.167 ASSIGNMENTS=168472 CHECKS=12085800	? (TO) TT=1800.07	SAT TT=14.336 ASSIGNMENTS=11581 CHECKS=6563140	SAT TT=2.662 ASSIGNMENTS=2205 CHECKS=1150040	? TT=488.465	No data	SAT TT=4.698	SAT TT=5.079
csp/socialGolfers/ normalized-socialGolfer-6-4-5.xml		? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.01	No data	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? TT=158.355	No data	? (TO) TT=1800.01	? (TO) TT=1800.06
csp/socialGolfers/ normalized-socialGolfer-6-4-7.xml	SAT TT=20.854	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=291.183	SAT TT=327.835	No data	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1076.63 ASSIGNMENTS=267207 CHECKS=755303000	? (TO) TT=1800.1	? TT=673.939	No data	SAT TT=213.301	SAT TT=20.854
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/socialGolfers/ normalized-socialGolfer-6-4-8.xml	SAT TT=7.338	? (MO) TT=5.216	SAT TT=1573.03 CHECKS=540812000 NODES=101849	? (TO) TT=1800.03	SAT TT=82.521 CHECKS=6397680	SAT TT=92.526 CHECKS=5826430	SAT TT=19.257 ASSIGNMENTS=4458	SAT TT=655.464 ASSIGNMENTS=125573	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=512.04 ASSIGNMENTS=33305 CHECKS=159002000	SAT TT=477.739 ASSIGNMENTS=33305 CHECKS=159002000	? (TO) TT=1800.01	? (TO) TT=1800.05	No data	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=177.184 ASSIGNMENTS=36154 CHECKS=94642500	? (TO) TT=1800.08	? TT=226.396	No data	SAT TT=67.114	SAT TT=7.338
csp/socialGolfers/ normalized-socialGolfer-7-4-8.xml	SAT TT=339.765	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	No data	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT TT=731.177 ASSIGNMENTS=140446 CHECKS=411969000	? (TO) TT=1800.05	? TT=193.072	No data	? (TO) TT=1800.1	SAT TT=339.765
csp/socialGolfers/ normalized-socialGolfer-8-4-8.xml		? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? TT=180.57	No data	? (TO) TT=1800	? (TO) TT=1800.03
csp/socialGolfers/ normalized-socialGolfer-9-4-8.xml		? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800	No data	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.07	? TT=215.161	No data	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/ssa/ normalized-ssa-0432-003_ext.xml	UNSAT TT=0.069	UNSAT TT=14.831 CHECKS=3962210 NODES=47470	UNSAT TT=13.494 CHECKS=3353500 NODES=45882	UNSAT TT=0.479	UNSAT TT=0.069 CHECKS=39061	UNSAT TT=0.083 CHECKS=86528	UNSAT TT=1.578 ASSIGNMENTS=2464	UNSAT TT=0.99 ASSIGNMENTS=241	UNSAT TT=6.449 CHECKS=1505610 NODES=14940	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=9.762 ASSIGNMENTS=69734 CHECKS=7643670	UNSAT TT=20.704 ASSIGNMENTS=47470 CHECKS=3962210	UNSAT TT=1.06	UNSAT TT=1.212	UNSAT TT=0.201 CHECKS=126359	UNSAT TT=2.561 ASSIGNMENTS=78762 CHECKS=8544620	UNSAT TT=1.608 ASSIGNMENTS=41583 CHECKS=5732890	UNSAT TT=0.63	UNSAT TT=3.023 ASSIGNMENTS=86800 CHECKS=9053980	UNSAT TT=2.174 ASSIGNMENTS=69734 CHECKS=7643670	UNSAT TT=1.636	UNSAT TT=11.052 ASSIGNMENTS=77646 CHECKS=3061590	UNSAT TT=1.173	UNSAT TT=1.313
csp/ssa/ normalized-ssa-2670-130_ext.xml	UNSAT TT=1.389	UNSAT TT=41.019 CHECKS=10649900 NODES=168953	UNSAT TT=34.069 CHECKS=9962120 NODES=158051	? (TO) TT=1800.06	UNSAT TT=15.611 CHECKS=10482600	UNSAT TT=14.447 CHECKS=11802000	UNSAT TT=15.861 ASSIGNMENTS=29626	UNSAT TT=1751.31 ASSIGNMENTS=2457260	UNSAT TT=133.999 CHECKS=15995000 NODES=97475	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=9.405 ASSIGNMENTS=21081 CHECKS=4510680	UNSAT TT=1.524 ASSIGNMENTS=21081 CHECKS=4510680	UNSAT TT=1.924	UNSAT TT=1.919	UNSAT TT=2.609 CHECKS=1875930	UNSAT TT=1.965 ASSIGNMENTS=26389 CHECKS=5465440	UNSAT TT=2.3 ASSIGNMENTS=31397 CHECKS=6696580	UNSAT TT=3.291	UNSAT TT=2.498 ASSIGNMENTS=26130 CHECKS=6655050	UNSAT TT=1.491 ASSIGNMENTS=21081 CHECKS=4510680	UNSAT TT=3.366	UNSAT TT=0.534 ASSIGNMENTS=164 CHECKS=24212	UNSAT TT=1.389	UNSAT TT=1.538
csp/ssa/ normalized-ssa-2670-141_ext.xml	SAT TT=0.013	SAT TT=1.079 CHECKS=855 NODES=391	SAT TT=1.047 CHECKS=853 NODES=0	SAT TT=0.067	SAT TT=0.162 CHECKS=19139	SAT TT=0.17 CHECKS=19366	SAT TT=0.652 ASSIGNMENTS=295	SAT TT=0.683 ASSIGNMENTS=296	SAT TT=0.449 CHECKS=372 NODES=391	SAT TT=0.448 CHECKS=2371 NODES=40	SAT TT=0.479 CHECKS=6649 NODES=46	SAT TT=0.025 ASSIGNMENTS=294 CHECKS=483	SAT TT=0.026 ASSIGNMENTS=294 CHECKS=483	SAT TT=1.468	SAT TT=1.351	SAT TT=0.035 CHECKS=407	SAT TT=0.013 ASSIGNMENTS=294 CHECKS=483	SAT TT=0.012 ASSIGNMENTS=291 CHECKS=483	SAT TT=0.485	SAT TT=0.015 ASSIGNMENTS=296 CHECKS=483	SAT TT=0.014 ASSIGNMENTS=294 CHECKS=483	SAT TT=0.976	SAT TT=0.03 ASSIGNMENTS=392 CHECKS=1036	SAT TT=0.888	SAT TT=0.877
csp/ssa/ normalized-ssa-6288-047_ext.xml	SAT TT=0.855	SAT TT=23.677 CHECKS=117930 NODES=14349	SAT TT=64.259 CHECKS=227589 NODES=14367	SAT TT=393	SAT TT=23.197 CHECKS=1018450	SAT TT=26.633 CHECKS=992168	SAT TT=9.293 ASSIGNMENTS=2859	SAT TT=67.677 ASSIGNMENTS=714	SAT TT=221.012 CHECKS=155056 NODES=14463	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=0.954 ASSIGNMENTS=1838 CHECKS=116086	SAT TT=0.97 ASSIGNMENTS=1838 CHECKS=116086	SAT TT=166.181	SAT TT=172.92	SAT TT=2.296 CHECKS=66575	SAT TT=0.855 ASSIGNMENTS=1837 CHECKS=118799	SAT TT=1.997 ASSIGNMENTS=34558 CHECKS=2065300	SAT TT=7.143	SAT TT=3.293 ASSIGNMENTS=6279 CHECKS=357497	SAT TT=0.914 ASSIGNMENTS=1838 CHECKS=116086	SAT TT=7.135	? (MO) TT=5.217	SAT TT=4.665	SAT TT=4.744
csp/ssa/ normalized-ssa-7552-038_ext.xml	SAT TT=0.077	SAT TT=1.929 CHECKS=32181 NODES=2043	SAT TT=2.052 CHECKS=20699 NODES=0	SAT TT=3.85	SAT TT=1.767 CHECKS=1819150	SAT TT=1.284 CHECKS=1807530	SAT TT=1.803 ASSIGNMENTS=158	SAT TT=2.596 ASSIGNMENTS=242	SAT TT=1.886 CHECKS=15271 NODES=1590	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=0.099 ASSIGNMENTS=159 CHECKS=11687	SAT TT=0.098 ASSIGNMENTS=159 CHECKS=11687	SAT TT=3.659	SAT TT=4.006	SAT TT=0.189 CHECKS=23352	SAT TT=0.077 ASSIGNMENTS=177 CHECKS=16608	SAT TT=0.081 ASSIGNMENTS=269 CHECKS=35949	SAT TT=1.361	SAT TT=0.093 ASSIGNMENTS=202 CHECKS=11621	SAT TT=0.092 ASSIGNMENTS=159 CHECKS=11687	SAT TT=3.556	SAT TT=0.594 ASSIGNMENTS=1539 CHECKS=25249	SAT TT=1.761	SAT TT=1.487
csp/ssa/ normalized-ssa-7552-158_ext.xml	SAT TT=0.063	SAT TT=2.878 CHECKS=7005 NODES=1364	SAT TT=1.573 CHECKS=7085 NODES=0	SAT TT=0.329	SAT TT=1.35 CHECKS=1420320	SAT TT=0.943 CHECKS=1423000	SAT TT=1.604 ASSIGNMENTS=123	SAT TT=1.909 ASSIGNMENTS=101	SAT TT=1.246 CHECKS=5417 NODES=1363	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=0.079 ASSIGNMENTS=113 CHECKS=5669	SAT TT=0.079 ASSIGNMENTS=113 CHECKS=5669	SAT TT=2.981	SAT TT=3.061	SAT TT=0.124 CHECKS=4437	SAT TT=0.063 ASSIGNMENTS=113 CHECKS=5673	SAT TT=0.069 ASSIGNMENTS=569 CHECKS=25359	SAT TT=1.164	SAT TT=0.081 ASSIGNMENTS=337 CHECKS=17359	SAT TT=0.065 ASSIGNMENTS=113 CHECKS=5669	SAT TT=2.965	Wrong UNSAT TT=0.425 ASSIGNMENTS=86 CHECKS=10359	SAT TT=1.351	SAT TT=1.369
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ssa/ normalized-ssa-7552-159_ext.xml	SAT TT=0.062	SAT TT=2.821 CHECKS=7115 NODES=1366	SAT TT=1.832 CHECKS=11019 NODES=0	SAT TT=0.338	SAT TT=1.22 CHECKS=1219660	SAT TT=0.93 CHECKS=1196450	SAT TT=1.52 ASSIGNMENTS=133	SAT TT=1.987 ASSIGNMENTS=112	SAT TT=1.276 CHECKS=7102 NODES=1369	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=0.082 ASSIGNMENTS=125 CHECKS=6217	SAT TT=0.082 ASSIGNMENTS=125 CHECKS=6217	SAT TT=3.258	SAT TT=3.318	SAT TT=0.125 CHECKS=4429	SAT TT=0.062 ASSIGNMENTS=129 CHECKS=6595	SAT TT=0.063 ASSIGNMENTS=113 CHECKS=4674	SAT TT=1.348	SAT TT=0.084 ASSIGNMENTS=418 CHECKS=19041	SAT TT=0.068 ASSIGNMENTS=125 CHECKS=6217	SAT TT=2.972	SAT TT=0.482 ASSIGNMENTS=1472 CHECKS=28528	SAT TT=1.664	SAT TT=1.681
csp/ssa/ normalized-ssa-7552-160_ext.xml	SAT TT=0.034	SAT TT=2.288 CHECKS=3156 NODES=1303	SAT TT=1.777 CHECKS=2699 NODES=0	SAT TT=0.154	SAT TT=0.557 CHECKS=16428	SAT TT=0.582 CHECKS=16987	SAT TT=0.824 ASSIGNMENTS=475	SAT TT=1.105 ASSIGNMENTS=539	SAT TT=0.793 CHECKS=1910 NODES=757	SAT TT=0.696 CHECKS=10634 NODES=63	SAT TT=0.764 CHECKS=42674 NODES=53	SAT TT=0.046 ASSIGNMENTS=472 CHECKS=2173	SAT TT=0.044 ASSIGNMENTS=472 CHECKS=2173	SAT TT=2.08	SAT TT=2.146	SAT TT=0.079 CHECKS=1976	SAT TT=0.034 ASSIGNMENTS=472 CHECKS=2173	SAT TT=0.031 ASSIGNMENTS=531 CHECKS=2173	SAT TT=0.683	SAT TT=0.039 ASSIGNMENTS=492 CHECKS=2173	SAT TT=0.037 ASSIGNMENTS=472 CHECKS=2173	SAT TT=1.822	SAT TT=0.15 ASSIGNMENTS=757 CHECKS=4681	SAT TT=1.158	SAT TT=1.148
csp/subs/ normalized-scen06-sub0.xml	UNSAT TT=0.064	UNSAT TT=1 CHECKS=63301 NODES=23	UNSAT TT=1.006 CHECKS=57173 NODES=0	UNSAT TT=0.064	UNSAT TT=0.205 CHECKS=114675	UNSAT TT=0.062 CHECKS=86617	UNSAT TT=1.023 ASSIGNMENTS=0	UNSAT TT=0.926 ASSIGNMENTS=0	UNSAT TT=1.259 CHECKS=27374 NODES=16	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=0.087 ASSIGNMENTS=19 CHECKS=8599	UNSAT TT=0.081 ASSIGNMENTS=19 CHECKS=8599	UNSAT TT=8.208	UNSAT TT=8.086	No data	UNSAT TT=0.07 ASSIGNMENTS=21 CHECKS=10211	UNSAT TT=0.228 ASSIGNMENTS=257 CHECKS=58745	UNSAT TT=19.898	UNSAT TT=0.091 ASSIGNMENTS=30 CHECKS=9070	UNSAT TT=0.077 ASSIGNMENTS=19 CHECKS=8599	UNSAT TT=3.444	No data	UNSAT TT=1.301	UNSAT TT=1.421
csp/subs/ normalized-scen06-sub1.xml	UNSAT TT=0.077	UNSAT TT=1.028 CHECKS=6951 NODES=0	UNSAT TT=0.965 CHECKS=6951 NODES=0	UNSAT TT=0.077	UNSAT TT=0.171 CHECKS=62414	UNSAT TT=0.056 CHECKS=67162	UNSAT TT=0.928 ASSIGNMENTS=0	UNSAT TT=0.959 ASSIGNMENTS=0	UNSAT TT=1.316 CHECKS=29015 NODES=18	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.1 ASSIGNMENTS=15 CHECKS=7678	UNSAT TT=0.089 ASSIGNMENTS=15 CHECKS=7678	UNSAT TT=8.822	UNSAT TT=8.495	No data	UNSAT TT=0.081 ASSIGNMENTS=11 CHECKS=7456	UNSAT TT=0.111 ASSIGNMENTS=91 CHECKS=15516	UNSAT TT=2.616	UNSAT TT=0.083 ASSIGNMENTS=12 CHECKS=5297	UNSAT TT=0.09 ASSIGNMENTS=17 CHECKS=8443	UNSAT TT=3.582	No data	UNSAT TT=1.649	UNSAT TT=1.915
csp/subs/ normalized-scen06-sub2.xml	UNSAT TT=0.077	UNSAT TT=1.055 CHECKS=5863 NODES=0	UNSAT TT=1.009 CHECKS=5863 NODES=0	UNSAT TT=0.087	UNSAT TT=0.187 CHECKS=72563	UNSAT TT=0.063 CHECKS=75191	UNSAT TT=1.193 ASSIGNMENTS=0	UNSAT TT=1.056 ASSIGNMENTS=0	UNSAT TT=1.491 CHECKS=26952 NODES=17	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=0.106 ASSIGNMENTS=15 CHECKS=7742	UNSAT TT=0.108 ASSIGNMENTS=15 CHECKS=7742	UNSAT TT=11.111	UNSAT TT=9.081	No data	UNSAT TT=0.088 ASSIGNMENTS=11 CHECKS=7053	UNSAT TT=0.104 ASSIGNMENTS=67 CHECKS=14395	UNSAT TT=2.819	UNSAT TT=0.077 ASSIGNMENTS=12 CHECKS=5201	UNSAT TT=0.096 ASSIGNMENTS=13 CHECKS=7462	UNSAT TT=4.04	No data	UNSAT TT=1.622	UNSAT TT=1.92
csp/subs/ normalized-scen06-sub3.xml	UNSAT TT=0.081	UNSAT TT=1.103 CHECKS=7245 NODES=0	UNSAT TT=1.052 CHECKS=7245 NODES=0	UNSAT TT=0.1	UNSAT TT=0.199 CHECKS=79645	UNSAT TT=0.073 CHECKS=96196	UNSAT TT=1.249 ASSIGNMENTS=0	UNSAT TT=1.063 ASSIGNMENTS=0	UNSAT TT=1.633 CHECKS=30514 NODES=17	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.113 ASSIGNMENTS=15 CHECKS=8548	UNSAT TT=0.111 ASSIGNMENTS=15 CHECKS=8548	UNSAT TT=12.75	UNSAT TT=11.147	No data	UNSAT TT=0.096 ASSIGNMENTS=11 CHECKS=7767	UNSAT TT=0.106 ASSIGNMENTS=70 CHECKS=15601	UNSAT TT=3.349	UNSAT TT=0.081 ASSIGNMENTS=12 CHECKS=5731	UNSAT TT=0.095 ASSIGNMENTS=16 CHECKS=8526	UNSAT TT=4.051	No data	UNSAT TT=1.919	UNSAT TT=2.153
csp/subs/ normalized-scen06-sub4.xml	UNSAT TT=0.064	UNSAT TT=1.102 CHECKS=13106 NODES=0	UNSAT TT=1.098 CHECKS=13106 NODES=0	UNSAT TT=0.106	UNSAT TT=0.241 CHECKS=98533	UNSAT TT=0.083 CHECKS=107620	UNSAT TT=1.101 ASSIGNMENTS=0	UNSAT TT=1.215 ASSIGNMENTS=0	UNSAT TT=1.798 CHECKS=28773 NODES=12	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.085 ASSIGNMENTS=14 CHECKS=7262	UNSAT TT=0.086 ASSIGNMENTS=14 CHECKS=7262	UNSAT TT=14.114	UNSAT TT=13.714	No data	UNSAT TT=0.066 ASSIGNMENTS=8 CHECKS=5762	UNSAT TT=0.134 ASSIGNMENTS=149 CHECKS=29517	UNSAT TT=6.191	UNSAT TT=0.064 ASSIGNMENTS=9 CHECKS=4718	UNSAT TT=0.075 ASSIGNMENTS=14 CHECKS=7185	UNSAT TT=4.656	No data	UNSAT TT=1.963	UNSAT TT=2.399
csp/subs/ normalized-scen07-sub1.xml	UNSAT TT=0.075	UNSAT TT=0.981 CHECKS=12174 NODES=0	UNSAT TT=0.973 CHECKS=12174 NODES=0	UNSAT TT=0.077	UNSAT TT=0.161 CHECKS=53487	UNSAT TT=0.059 CHECKS=74799	UNSAT TT=1.123 ASSIGNMENTS=0	UNSAT TT=0.998 ASSIGNMENTS=0	UNSAT TT=1.355 CHECKS=30726 NODES=19	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=0.107 ASSIGNMENTS=14 CHECKS=9567	UNSAT TT=0.11 ASSIGNMENTS=14 CHECKS=9567	UNSAT TT=9.561	UNSAT TT=7.687	No data	UNSAT TT=0.086 ASSIGNMENTS=11 CHECKS=7658	UNSAT TT=0.11 ASSIGNMENTS=49 CHECKS=12431	UNSAT TT=4.026	UNSAT TT=0.075 ASSIGNMENTS=14 CHECKS=6421	UNSAT TT=0.089 ASSIGNMENTS=23 CHECKS=7330	UNSAT TT=3.753	No data	UNSAT TT=1.466	UNSAT TT=1.757
csp/subs/ normalized-scen07-sub2.xml	UNSAT TT=0.091	UNSAT TT=1.132 CHECKS=14323 NODES=0	UNSAT TT=1.047 CHECKS=14323 NODES=0	UNSAT TT=0.095	UNSAT TT=0.196 CHECKS=83701	UNSAT TT=0.063 CHECKS=79951	UNSAT TT=1.004 ASSIGNMENTS=0	UNSAT TT=1.202 ASSIGNMENTS=0	UNSAT TT=1.437 CHECKS=33885 NODES=19	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.12 ASSIGNMENTS=16 CHECKS=10707	UNSAT TT=0.122 ASSIGNMENTS=16 CHECKS=10707	UNSAT TT=11.75	UNSAT TT=9.294	No data	UNSAT TT=0.101 ASSIGNMENTS=11 CHECKS=8482	UNSAT TT=0.133 ASSIGNMENTS=88 CHECKS=20259	UNSAT TT=4.171	UNSAT TT=0.091 ASSIGNMENTS=14 CHECKS=7029	UNSAT TT=0.103 ASSIGNMENTS=23 CHECKS=8057	UNSAT TT=3.933	No data	UNSAT TT=1.723	UNSAT TT=1.912
csp/subs/ normalized-scen07-sub3.xml	UNSAT TT=0.104	UNSAT TT=1.177 CHECKS=15905 NODES=0	UNSAT TT=1.148 CHECKS=15905 NODES=0	UNSAT TT=0.108	UNSAT TT=0.23 CHECKS=111740	UNSAT TT=0.076 CHECKS=108735	UNSAT TT=1.053 ASSIGNMENTS=0	UNSAT TT=1.058 ASSIGNMENTS=0	UNSAT TT=1.532 CHECKS=35995 NODES=19	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=0.125 ASSIGNMENTS=16 CHECKS=11751	UNSAT TT=0.138 ASSIGNMENTS=16 CHECKS=11751	UNSAT TT=12.182	UNSAT TT=11.021	No data	UNSAT TT=0.107 ASSIGNMENTS=15 CHECKS=11011	UNSAT TT=0.151 ASSIGNMENTS=74 CHECKS=20943	UNSAT TT=4.838	UNSAT TT=0.104 ASSIGNMENTS=14 CHECKS=7707	UNSAT TT=0.119 ASSIGNMENTS=24 CHECKS=10936	UNSAT TT=4.304	No data	UNSAT TT=1.828	UNSAT TT=1.964
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/subs/ normalized-scen07-sub4.xml	UNSAT TT=0.098	UNSAT TT=1.186 CHECKS=12750 NODES=0	UNSAT TT=1.108 CHECKS=12750 NODES=0	UNSAT TT=0.121	UNSAT TT=0.275 CHECKS=126370	UNSAT TT=0.085 CHECKS=124172	UNSAT TT=1.182 ASSIGNMENTS=0	UNSAT TT=1.333 ASSIGNMENTS=0	UNSAT TT=1.771 CHECKS=43802 NODES=14	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=0.126 ASSIGNMENTS=17 CHECKS=8181	UNSAT TT=0.123 ASSIGNMENTS=17 CHECKS=8181	UNSAT TT=14.813	UNSAT TT=12.681	No data	UNSAT TT=0.113 ASSIGNMENTS=13 CHECKS=8889	UNSAT TT=0.298 ASSIGNMENTS=132 CHECKS=48835	UNSAT TT=68.902	UNSAT TT=0.098 ASSIGNMENTS=14 CHECKS=6249	UNSAT TT=0.112 ASSIGNMENTS=17 CHECKS=8181	UNSAT TT=4.241	No data	UNSAT TT=1.994	UNSAT TT=2.29
csp/super-jobShop/ super-jobShop-e0ddr1/ normalized-super-jobShop-e0ddr1-10.xml	SAT TT=0.283	SAT TT=20.607 CHECKS=267882000 NODES=55680	SAT TT=11.118 CHECKS=115247000 NODES=23924	? (TO) TT=1800.08	SAT TT=35.397 CHECKS=76139800	SAT TT=21.436 CHECKS=46763200	SAT TT=6.499 ASSIGNMENTS=128	SAT TT=7.368 ASSIGNMENTS=128	SAT TT=2.935 CHECKS=4511 NODES=100	SAT TT=137.73 CHECKS=1603380000 NODES=750357	SAT TT=1.811 CHECKS=1618170 NODES=353	SAT TT=7.685 ASSIGNMENTS=780 CHECKS=1497920	SAT TT=28.152 ASSIGNMENTS=55680 CHECKS=267882000	SAT TT=800.939	SAT TT=58.257	No data	SAT TT=1.92 ASSIGNMENTS=4589 CHECKS=12450100	SAT TT=1.679 ASSIGNMENTS=8984 CHECKS=10087900	SAT TT=7.341	SAT TT=198.685 ASSIGNMENTS=535608 CHECKS=1031680000	SAT TT=0.283 ASSIGNMENTS=780 CHECKS=1497920	SAT TT=37.937	No data	SAT TT=2.069	SAT TT=2.918
csp/super-jobShop/ super-jobShop-e0ddr1/ normalized-super-jobShop-e0ddr1-2.xml	UNSAT TT=821.609	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1781.51	No data	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.19	No data	UNSAT TT=821.609	UNSAT TT=1308.6
csp/super-jobShop/ super-jobShop-e0ddr1/ normalized-super-jobShop-e0ddr1-7.xml	SAT TT=0.754	SAT TT=5.315 CHECKS=34648800 NODES=8567	SAT TT=3.34 CHECKS=10192700 NODES=225	SAT TT=1341.4	SAT TT=35.335 CHECKS=82554700	SAT TT=21.409 CHECKS=46889500	SAT TT=10.185 ASSIGNMENTS=634	SAT TT=11.23 ASSIGNMENTS=634	SAT TT=2.845 CHECKS=4898 NODES=100	? (TO) TT=1800.08	SAT TT=2.069 CHECKS=2243350 NODES=586	SAT TT=0.864 ASSIGNMENTS=1957 CHECKS=5189110	SAT TT=0.859 ASSIGNMENTS=1957 CHECKS=5189110	SAT TT=779.519	SAT TT=59.409	No data	SAT TT=2.174 ASSIGNMENTS=5363 CHECKS=13944700	SAT TT=1.782 ASSIGNMENTS=9395 CHECKS=11243500	SAT TT=1605.1	SAT TT=94.747 ASSIGNMENTS=345635 CHECKS=455119000	SAT TT=0.754 ASSIGNMENTS=1468 CHECKS=4374000	SAT TT=26.577	No data	SAT TT=2.11	SAT TT=3.473
csp/super-jobShop/ super-jobShop-e0ddr1/ normalized-super-jobShop-e0ddr1-9.xml	UNSAT TT=429.282	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.01	No data	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.14	No data	UNSAT TT=429.282	UNSAT TT=534.219
csp/super-jobShop/ super-jobShop-e0ddr2/ normalized-super-jobShop-e0ddr2-10.xml	SAT TT=118.889	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.06	? (MO) TT=1359.49	No data	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=1382.99 ASSIGNMENTS=1977630 CHECKS=146639000	? (TO) TT=1800.11	No data	SAT TT=276.724	SAT TT=118.889
csp/super-jobShop/ super-jobShop-e0ddr2/ normalized-super-jobShop-e0ddr2-2.xml	SAT TT=0.791	SAT TT=2.803 CHECKS=1849980 NODES=304	SAT TT=18.999 CHECKS=262021000 NODES=35860	? (TO) TT=1800.04	SAT TT=41.359 CHECKS=88240800	SAT TT=57.734 CHECKS=125929000	SAT TT=29.018 ASSIGNMENTS=1092	SAT TT=27.632 ASSIGNMENTS=1092	SAT TT=3.575 CHECKS=6113 NODES=100	? (TO) TT=1800.09	SAT TT=1.932 CHECKS=2770680 NODES=714	SAT TT=14.486 ASSIGNMENTS=9303 CHECKS=41059400	SAT TT=10.617 ASSIGNMENTS=304 CHECKS=1849980	SAT TT=1227.95	SAT TT=100.72	No data	SAT TT=0.791 ASSIGNMENTS=2293 CHECKS=4600180	SAT TT=6.753 ASSIGNMENTS=15423 CHECKS=40336100	? (TO) TT=1800.08	SAT TT=470.04 ASSIGNMENTS=1121360 CHECKS=2761810000	SAT TT=6.987 ASSIGNMENTS=9303 CHECKS=41059400	SAT TT=37.316	No data	SAT TT=2.077	SAT TT=3.11
csp/super-jobShop/ super-jobShop-e0ddr2/ normalized-super-jobShop-e0ddr2-5.xml	SAT TT=2.354	SAT TT=4.554 CHECKS=26787000 NODES=3652	SAT TT=4.819 CHECKS=31933200 NODES=2400	? (TO) TT=1800.01	SAT TT=26.639 CHECKS=54532300	SAT TT=56.185 CHECKS=118378000	SAT TT=9.892 ASSIGNMENTS=431	SAT TT=10.3 ASSIGNMENTS=431	SAT TT=3.804 CHECKS=22934 NODES=1026	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=13.815 ASSIGNMENTS=9351 CHECKS=39101000	SAT TT=11.738 ASSIGNMENTS=3652 CHECKS=26787000	SAT TT=1643.95	SAT TT=139.964	No data	SAT TT=3.124 ASSIGNMENTS=12819 CHECKS=19946400	SAT TT=12.132 ASSIGNMENTS=25253 CHECKS=76450400	? (TO) TT=1800.12	? (TO) TT=1800.09	SAT TT=6.362 ASSIGNMENTS=9351 CHECKS=39101000	SAT TT=31.161	No data	SAT TT=2.354	SAT TT=3.262
csp/super-jobShop/ super-jobShop-e0ddr2/ normalized-super-jobShop-e0ddr2-7.xml	SAT TT=0.154	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.08	SAT TT=36.212 CHECKS=75656000	SAT TT=63.491 CHECKS=143710000	SAT TT=11.692 ASSIGNMENTS=360	SAT TT=12.12 ASSIGNMENTS=360	SAT TT=3.838 CHECKS=5247 NODES=100	? (TO) TT=1800	SAT TT=1.922 CHECKS=2210300 NODES=475	SAT TT=0.171 ASSIGNMENTS=338 CHECKS=555105	SAT TT=0.162 ASSIGNMENTS=338 CHECKS=555105	SAT TT=1181.43	SAT TT=81.385	No data	SAT TT=0.154 ASSIGNMENTS=336 CHECKS=594901	SAT TT=77.511 ASSIGNMENTS=130765 CHECKS=480407000	SAT TT=1.787	? (TO) TT=1800.05	SAT TT=17.002 ASSIGNMENTS=26772 CHECKS=99000700	SAT TT=260.37	No data	SAT TT=2.067	SAT TT=3.671
csp/super-jobShop/ super-jobShop-e0ddr2/ normalized-super-jobShop-e0ddr2-8.xml	SAT TT=0.299	? (TO) TT=1800.09	SAT TT=549.947 CHECKS=9017090000 NODES=1358740	SAT TT=1346.98	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=98.578 ASSIGNMENTS=11045	SAT TT=94.039 ASSIGNMENTS=11045	SAT TT=3.188 CHECKS=5984 NODES=100	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=1.284 ASSIGNMENTS=1617 CHECKS=7136690	SAT TT=1.243 ASSIGNMENTS=1617 CHECKS=7136690	SAT TT=1060.78	SAT TT=151.184	No data	SAT TT=0.299 ASSIGNMENTS=480 CHECKS=1535840	SAT TT=3.347 ASSIGNMENTS=13148 CHECKS=22039900	? (TO) TT=1800.05	SAT TT=653.739 ASSIGNMENTS=1874620 CHECKS=3859180000	SAT TT=4.579 ASSIGNMENTS=6409 CHECKS=27420200	SAT TT=661.784	No data	SAT TT=2.163	SAT TT=3.574
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-jobShop/ super-jobShop-e0ddr2/ normalized-super-jobShop-e0ddr2-9.xml	SAT TT=1.421	SAT TT=91.081 CHECKS=1342170000 NODES=196377	SAT TT=480.539 CHECKS=7260330000 NODES=1052150	? (TO) TT=1800.07	SAT TT=45.16 CHECKS=98216700	SAT TT=56.256 CHECKS=124524000	SAT TT=13.062 ASSIGNMENTS=382	SAT TT=13.131 ASSIGNMENTS=382	SAT TT=3.414 CHECKS=5516 NODES=100	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=27.494 ASSIGNMENTS=29586 CHECKS=122163000	SAT TT=90.468 ASSIGNMENTS=196377 CHECKS=1342170000	SAT TT=1521.84	? (MO) TT=650.31	No data	SAT TT=1.421 ASSIGNMENTS=3624 CHECKS=9496990	SAT TT=2.902 ASSIGNMENTS=10683 CHECKS=16773500	? (TO) TT=1800.04	SAT TT=360.124 ASSIGNMENTS=754000 CHECKS=2096980000	SAT TT=18.239 ASSIGNMENTS=29586 CHECKS=122163000	SAT TT=372.565	No data	SAT TT=3.397	SAT TT=3.647
csp/super-jobShop/ super-jobShop-enddr1/ normalized-super-jobShop-enddr1-10.xml	SAT TT=0.111	SAT TT=2.822 CHECKS=910382 NODES=197	SAT TT=3.496 CHECKS=11582900 NODES=103	SAT TT=0.318	SAT TT=17.997 CHECKS=32241500	SAT TT=0.089 CHECKS=83796	SAT TT=7.478 ASSIGNMENTS=139	SAT TT=7.395 ASSIGNMENTS=139	SAT TT=3.123 CHECKS=5267 NODES=100	SAT TT=137.689 CHECKS=1661760000 NODES=750499	SAT TT=1.99 CHECKS=1534380 NODES=210	SAT TT=0.118 ASSIGNMENTS=256 CHECKS=306866	SAT TT=0.12 ASSIGNMENTS=256 CHECKS=306866	SAT TT=923.085	SAT TT=67.683	No data	SAT TT=0.111 ASSIGNMENTS=300 CHECKS=346047	SAT TT=3.086 ASSIGNMENTS=10957 CHECKS=17539000	SAT TT=1.527	SAT TT=24.099 ASSIGNMENTS=110540 CHECKS=114278000	SAT TT=0.142 ASSIGNMENTS=296 CHECKS=495324	SAT TT=30.383	No data	SAT TT=2.1	SAT TT=3.362
csp/super-jobShop/ super-jobShop-enddr1/ normalized-super-jobShop-enddr1-4.xml	SAT TT=2.133	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=34.882 ASSIGNMENTS=856	SAT TT=34.703 ASSIGNMENTS=856	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=9.802 ASSIGNMENTS=4421 CHECKS=14670400	SAT TT=730.678 ASSIGNMENTS=4421 CHECKS=14670400	SAT TT=835.492	? (TO) TT=1800.04	No data	SAT TT=482.326 ASSIGNMENTS=1035290 CHECKS=2942440000	SAT TT=568.915 ASSIGNMENTS=1043130 CHECKS=3566480000	? (TO) TT=1800.05	SAT TT=59.114 ASSIGNMENTS=196925 CHECKS=301776000	SAT TT=2.774 ASSIGNMENTS=4421 CHECKS=14670400	SAT TT=61.18	No data	SAT TT=2.133	SAT TT=3.474
csp/super-jobShop/ super-jobShop-enddr1/ normalized-super-jobShop-enddr1-5.xml	SAT TT=1.891	SAT TT=6.064 CHECKS=40821600 NODES=10717	SAT TT=14.01 CHECKS=140466000 NODES=35077	? (TO) TT=1800.01	SAT TT=39.104 CHECKS=78514100	? (TO) TT=1800.06	SAT TT=7.351 ASSIGNMENTS=174	SAT TT=7.549 ASSIGNMENTS=174	? (TO) TT=1800.07	? (TO) TT=1800	SAT TT=3.689 CHECKS=21038300 NODES=7283	SAT TT=9.858 ASSIGNMENTS=4633 CHECKS=13658700	SAT TT=12.436 ASSIGNMENTS=10717 CHECKS=40821600	SAT TT=899.188	SAT TT=66.807	No data	SAT TT=1330.34 ASSIGNMENTS=2864800 CHECKS=3385590000	SAT TT=5.209 ASSIGNMENTS=14936 CHECKS=31439100	SAT TT=631.279	SAT TT=184.194 ASSIGNMENTS=495104 CHECKS=935472000	SAT TT=2.242 ASSIGNMENTS=4633 CHECKS=13658700	SAT TT=39.702	No data	SAT TT=1.891	SAT TT=3.113
csp/super-jobShop/ super-jobShop-enddr1/ normalized-super-jobShop-enddr1-6.xml	SAT TT=0.065	SAT TT=2.519 CHECKS=887759 NODES=202	SAT TT=2.789 CHECKS=2754110 NODES=315	SAT TT=0.322	SAT TT=1.32 CHECKS=41882	SAT TT=21.014 CHECKS=43417900	SAT TT=7.615 ASSIGNMENTS=178	SAT TT=8.27 ASSIGNMENTS=178	SAT TT=3.34 CHECKS=5003 NODES=101	SAT TT=185.556 CHECKS=2096130000 NODES=924818	SAT TT=1.955 CHECKS=1784750 NODES=314	SAT TT=0.077 ASSIGNMENTS=148 CHECKS=66483	SAT TT=0.078 ASSIGNMENTS=148 CHECKS=66483	SAT TT=898.785	SAT TT=65.792	No data	SAT TT=0.065 ASSIGNMENTS=148 CHECKS=66483	SAT TT=2.248 ASSIGNMENTS=10019 CHECKS=13333100	SAT TT=1.352	SAT TT=1.568 ASSIGNMENTS=6211 CHECKS=6957220	SAT TT=0.146 ASSIGNMENTS=390 CHECKS=576183	SAT TT=30.115	No data	SAT TT=1.935	SAT TT=3.117
csp/super-jobShop/ super-jobShop-enddr1/ normalized-super-jobShop-enddr1-8.xml	SAT TT=0.127	SAT TT=8.322 CHECKS=82965200 NODES=16230	SAT TT=8.316 CHECKS=86126100 NODES=15809	? (TO) TT=1800.02	SAT TT=62.336 CHECKS=129164000	SAT TT=57.71 CHECKS=124315000	SAT TT=14.059 ASSIGNMENTS=487	SAT TT=15.511 ASSIGNMENTS=487	SAT TT=3.217 CHECKS=4574 NODES=101	? (TO) TT=1800.02	SAT TT=2.072 CHECKS=3132140 NODES=899	SAT TT=7.366 ASSIGNMENTS=291 CHECKS=463949	SAT TT=15.984 ASSIGNMENTS=16230 CHECKS=82965200	SAT TT=1226.49	SAT TT=60.491	No data	SAT TT=68.5 ASSIGNMENTS=95770 CHECKS=393467000	SAT TT=63.019 ASSIGNMENTS=95561 CHECKS=386597000	SAT TT=18.23	SAT TT=79.587 ASSIGNMENTS=221182 CHECKS=408948000	SAT TT=0.127 ASSIGNMENTS=291 CHECKS=463949	SAT TT=42.152	No data	SAT TT=1.967	SAT TT=3.478
csp/super-jobShop/ super-jobShop-enddr1/ normalized-super-jobShop-enddr1-9.xml	SAT TT=0.292	SAT TT=1488.17 CHECKS=18821100000 NODES=4223580	? (TO) TT=1800.16	? (TO) TT=1800.01	SAT TT=82.934 CHECKS=172427000	SAT TT=56.894 CHECKS=118639000	SAT TT=9.586 ASSIGNMENTS=188	SAT TT=10.016 ASSIGNMENTS=188	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=4.301 CHECKS=28039300 NODES=9465	SAT TT=0.881 ASSIGNMENTS=2930 CHECKS=5915380	SAT TT=0.877 ASSIGNMENTS=2930 CHECKS=5915380	SAT TT=984.361	SAT TT=65.314	No data	SAT TT=0.292 ASSIGNMENTS=981 CHECKS=1608220	SAT TT=3.056 ASSIGNMENTS=11658 CHECKS=18327700	? (TO) TT=1800.1	SAT TT=313.424 ASSIGNMENTS=1132540 CHECKS=1801510000	SAT TT=0.375 ASSIGNMENTS=940 CHECKS=1941620	SAT TT=45.91	No data	SAT TT=2.323	SAT TT=3.042
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-10.xml	SAT TT=2.017	SAT TT=3.187 CHECKS=6095400 NODES=599	SAT TT=5.649 CHECKS=43297300 NODES=3616	? (TO) TT=1800.09	SAT TT=37.971 CHECKS=72109900	SAT TT=54.543 CHECKS=113098000	SAT TT=944.837 ASSIGNMENTS=43046	SAT TT=1024.26 ASSIGNMENTS=43046	SAT TT=3.92 CHECKS=14539 NODES=346	? (TO) TT=1800.04	SAT TT=3.095 CHECKS=12711500 NODES=4033	SAT TT=9.244 ASSIGNMENTS=2783 CHECKS=11508400	SAT TT=10.967 ASSIGNMENTS=599 CHECKS=6095400	SAT TT=1496.94	SAT TT=92.121	No data	SAT TT=19.571 ASSIGNMENTS=84582 CHECKS=141005000	SAT TT=35.438 ASSIGNMENTS=63847 CHECKS=212276000	SAT TT=1113.54	SAT TT=1039.73 ASSIGNMENTS=2534490 CHECKS=1834270000	SAT TT=2.017 ASSIGNMENTS=2783 CHECKS=11508400	SAT TT=38.188	No data	SAT TT=2.263	SAT TT=3.44
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-1.xml	SAT TT=0.271	SAT TT=3.341 CHECKS=4328660 NODES=737	SAT TT=4.429 CHECKS=19268600 NODES=1196	SAT TT=1345.7	SAT TT=46.391 CHECKS=87282700	SAT TT=62.402 CHECKS=123084000	SAT TT=18.293 ASSIGNMENTS=438	SAT TT=17.652 ASSIGNMENTS=438	SAT TT=3.601 CHECKS=6365 NODES=100	? (TO) TT=1800.06	SAT TT=1.964 CHECKS=2556440 NODES=555	SAT TT=0.483 ASSIGNMENTS=1138 CHECKS=2635540	SAT TT=0.484 ASSIGNMENTS=1138 CHECKS=2635540	SAT TT=1418.81	SAT TT=120.894	No data	SAT TT=0.631 ASSIGNMENTS=1562 CHECKS=3938520	SAT TT=3.328 ASSIGNMENTS=12417 CHECKS=20822100	? (TO) TT=1800.07	SAT TT=1397.85 ASSIGNMENTS=3974010 CHECKS=44724200	SAT TT=0.271 ASSIGNMENTS=415 CHECKS=1322700	SAT TT=92.734	No data	SAT TT=2.69	SAT TT=3.287
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-2.xml	SAT TT=0.33	SAT TT=2.939 CHECKS=396959 NODES=105	SAT TT=4.381 CHECKS=16088400 NODES=434	SAT TT=0.33	SAT TT=1.34 CHECKS=61996	SAT TT=0.089 CHECKS=82687	SAT TT=8.443 ASSIGNMENTS=242	SAT TT=9.346 ASSIGNMENTS=242	SAT TT=3.884 CHECKS=7323 NODES=100	SAT TT=394.411 CHECKS=4792120000 NODES=1951780	SAT TT=2.184 CHECKS=1715620 NODES=224	SAT TT=0.602 ASSIGNMENTS=1987 CHECKS=3386670	SAT TT=0.648 ASSIGNMENTS=1987 CHECKS=3386670	? (TO) TT=1800.01	SAT TT=92.525	No data	SAT TT=1.769 ASSIGNMENTS=5117 CHECKS=10193700	SAT TT=5.498 ASSIGNMENTS=14426 CHECKS=32314700	? (TO) TT=1800.12	SAT TT=65.248 ASSIGNMENTS=214642 CHECKS=333796000	SAT TT=0.871 ASSIGNMENTS=1886 CHECKS=4538330	SAT TT=38.596	No data	SAT TT=2.383	SAT TT=3.98
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-3.xml	SAT TT=0.088	SAT TT=7.142 CHECKS=59006100 NODES=10818	SAT TT=7.579 CHECKS=65317200 NODES=7322	SAT TT=1340.49	SAT TT=8.741 CHECKS=15379700	SAT TT=0.082 CHECKS=76020	SAT TT=8.951 ASSIGNMENTS=293	SAT TT=9.359 ASSIGNMENTS=293	SAT TT=3.737 CHECKS=9238 NODES=183	? (TO) TT=1800.09	SAT TT=2.954 CHECKS=12739900 NODES=4116	SAT TT=0.384 ASSIGNMENTS=1261 CHECKS=1837400	SAT TT=0.364 ASSIGNMENTS=1261 CHECKS=1837400	SAT TT=1482.24	SAT TT=97.312	No data	SAT TT=0.088 ASSIGNMENTS=362 CHECKS=184579	SAT TT=159.848 ASSIGNMENTS=217980 CHECKS=918491000	SAT TT=14.967	SAT TT=1069.88 ASSIGNMENTS=2953810 CHECKS=2287950000	SAT TT=3.01 ASSIGNMENTS=5044 CHECKS=17970900	SAT TT=58.307	No data	SAT TT=2.006	SAT TT=3.745
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-4.xml	SAT TT=1.667	SAT TT=4.07 CHECKS=19240200 NODES=2418	SAT TT=4.293 CHECKS=19639000 NODES=1087	? (TO) TT=1800.08	SAT TT=46.102 CHECKS=92298600	SAT TT=42.121 CHECKS=87213200	SAT TT=37.215 ASSIGNMENTS=1381	SAT TT=34.768 ASSIGNMENTS=1381	SAT TT=3.636 CHECKS=7215 NODES=100	? (TO) TT=1800.05	SAT TT=2.234 CHECKS=2800960 NODES=537	SAT TT=10.331 ASSIGNMENTS=3516 CHECKS=13502900	SAT TT=11.352 ASSIGNMENTS=2418 CHECKS=19240200	? (TO) TT=1800.1	SAT TT=97.141	No data	SAT TT=22.247 ASSIGNMENTS=29447 CHECKS=141493000	SAT TT=5.161 ASSIGNMENTS=13857 CHECKS=29875200	? (TO) TT=1800.04	SAT TT=237.003 ASSIGNMENTS=951947 CHECKS=1405280000	SAT TT=2.483 ASSIGNMENTS=3516 CHECKS=13502900	SAT TT=40.217	No data	SAT TT=1.667	SAT TT=3.58
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-5.xml	SAT TT=0.3	SAT TT=3.14 CHECKS=370869 NODES=103	SAT TT=3.828 CHECKS=9324400 NODES=0	SAT TT=896.959	SAT TT=7.089 CHECKS=11867900	SAT TT=3.73 CHECKS=7904290	SAT TT=70.564 ASSIGNMENTS=3976	SAT TT=71.399 ASSIGNMENTS=3976	SAT TT=3.616 CHECKS=6231 NODES=103	SAT TT=1579.01 CHECKS=19306300000 NODES=8402710	SAT TT=2.135 CHECKS=2688730 NODES=523	SAT TT=0.485 ASSIGNMENTS=961 CHECKS=2407680	SAT TT=0.449 ASSIGNMENTS=961 CHECKS=2407680	SAT TT=1755.67	SAT TT=91.701	No data	SAT TT=0.432 ASSIGNMENTS=1037 CHECKS=2190760	SAT TT=8.613 ASSIGNMENTS=19782 CHECKS=54388800	SAT TT=31.392	SAT TT=173.836 ASSIGNMENTS=465622 CHECKS=1005140000	SAT TT=0.3 ASSIGNMENTS=471 CHECKS=1519310	SAT TT=35.842	No data	SAT TT=2.118	SAT TT=3.741
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-6.xml	SAT TT=0.121	SAT TT=2.956 CHECKS=759911 NODES=145	SAT TT=3.571 CHECKS=5033280 NODES=200	SAT TT=0.314	SAT TT=1.351 CHECKS=61024	SAT TT=0.074 CHECKS=48747	SAT TT=14.735 ASSIGNMENTS=670	SAT TT=15.213 ASSIGNMENTS=670	SAT TT=4.016 CHECKS=7423 NODES=100	SAT TT=151.395 CHECKS=1792930000 NODES=759441	SAT TT=2.083 CHECKS=3082520 NODES=573	SAT TT=0.13 ASSIGNMENTS=302 CHECKS=343161	SAT TT=0.122 ASSIGNMENTS=302 CHECKS=343161	? (TO) TT=1800.08	SAT TT=95.829	No data	SAT TT=0.157 ASSIGNMENTS=640 CHECKS=628093	SAT TT=3.723 ASSIGNMENTS=13764 CHECKS=22309100	? (TO) TT=1800.08	SAT TT=121.642 ASSIGNMENTS=480888 CHECKS=706470000	SAT TT=0.121 ASSIGNMENTS=282 CHECKS=416881	SAT TT=36.746	No data	SAT TT=2.368	SAT TT=3.83
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-7.xml	SAT TT=0.116	SAT TT=3.308 CHECKS=4196300 NODES=726	SAT TT=4.337 CHECKS=20565800 NODES=103	SAT TT=0.325	SAT TT=7.466 CHECKS=12602600	SAT TT=0.094 CHECKS=95661	SAT TT=7.828 ASSIGNMENTS=201	SAT TT=8.874 ASSIGNMENTS=201	SAT TT=3.694 CHECKS=7016 NODES=100	SAT TT=30.918 CHECKS=327581000 NODES=151603	SAT TT=2.216 CHECKS=2312970 NODES=417	SAT TT=0.118 ASSIGNMENTS=252 CHECKS=244842	SAT TT=0.116 ASSIGNMENTS=252 CHECKS=244842	? (TO) TT=1800.06	SAT TT=94.28	No data	SAT TT=0.135 ASSIGNMENTS=365 CHECKS=465990	SAT TT=6.045 ASSIGNMENTS=16901 CHECKS=35759200	SAT TT=4.322	SAT TT=766.769 ASSIGNMENTS=2397480 CHECKS=60581300	SAT TT=0.133 ASSIGNMENTS=289 CHECKS=444517	SAT TT=37.475	No data	SAT TT=1.835	SAT TT=3.701
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-8.xml	SAT TT=0.509	SAT TT=3.167 CHECKS=2167680 NODES=305	SAT TT=4.546 CHECKS=21636600 NODES=309	SAT TT=893.665	SAT TT=35.805 CHECKS=73483200	SAT TT=55.138 CHECKS=114210000	SAT TT=10.393 ASSIGNMENTS=320	SAT TT=9.6 ASSIGNMENTS=320	SAT TT=3.895 CHECKS=6936 NODES=102	? (TO) TT=1800.06	SAT TT=2.131 CHECKS=1646600 NODES=191	SAT TT=0.705 ASSIGNMENTS=1982 CHECKS=4737730	SAT TT=0.708 ASSIGNMENTS=1982 CHECKS=4737730	SAT TT=1771.94	SAT TT=112.525	No data	SAT TT=4.123 ASSIGNMENTS=9382 CHECKS=26460200	SAT TT=3.666 ASSIGNMENTS=12926 CHECKS=21466400	? (TO) TT=1800.08	SAT TT=1296.6 ASSIGNMENTS=2897030 CHECKS=3558980000	SAT TT=0.509 ASSIGNMENTS=1134 CHECKS=2865150	SAT TT=37.648	No data	SAT TT=2.262	SAT TT=3.41
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-12.xml	SAT TT=91.57	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.04	? (problem) TT=66.667	? (problem) TT=71.14	No data	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	? TT=227.107	No data	SAT TT=1114.45	SAT TT=91.57
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-14.xml	SAT TT=106.091	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.02	? (problem) TT=73.776	? (problem) TT=78.028	No data	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (exit code) TT=223.419	No data	SAT TT=995.789	SAT TT=106.091
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-15.xml	SAT TT=57.283	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (problem) TT=62.249	? (problem) TT=68.289	No data	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=226.883	No data	SAT TT=963.645	SAT TT=57.283
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-1.xml	SAT TT=276.089	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (problem) TT=81.452	? (problem) TT=87.855	No data	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=237.392	No data	SAT TT=285.18	SAT TT=276.089
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-20.xml	SAT TT=150.792	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	? (problem) TT=66.448	? (problem) TT=68.346	No data	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=235.177	No data	SAT TT=1554.07	SAT TT=150.792
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-22.xml	UNSAT TT=57.912	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=171.35 ASSIGNMENTS=81	UNSAT TT=179.334 ASSIGNMENTS=81	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=87.531 ASSIGNMENTS=78	UNSAT TT=83.038 ASSIGNMENTS=49	? (problem) TT=67.058	? (problem) TT=71.849	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.07	? TT=239.598	No data	UNSAT TT=57.912	UNSAT TT=105.243
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-23.xml	UNSAT TT=31.577	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.02	UNSAT TT=164.978 ASSIGNMENTS=47	UNSAT TT=168.654 ASSIGNMENTS=32	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=80.009 ASSIGNMENTS=69	UNSAT TT=80.058 ASSIGNMENTS=69	? (problem) TT=57.887	? (problem) TT=53.95	No data	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.05	? TT=242.386	No data	UNSAT TT=31.577	UNSAT TT=49.877
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-30.xml	UNSAT TT=29.195	? (TO) TT=1800.17	? (TO) TT=1800.19	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=1765.69 ASSIGNMENTS=12195	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=556.537 ASSIGNMENTS=3472	UNSAT TT=556.922 ASSIGNMENTS=3472	? (problem) TT=67.408	? (problem) TT=68.724	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=242.841	No data	UNSAT TT=29.195	UNSAT TT=48.711
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-7.xml		? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	? (problem) TT=78.302	? (problem) TT=86.328	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=435.7	No data	? (TO) TT=1800.07	? (TO) TT=1800.05
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-8.xml	UNSAT TT=1118.07	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.03	? (problem) TT=74.086	? (problem) TT=73.258	No data	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.11	? TT=228.999	No data	UNSAT TT=1118.07	? (TO) TT=1800.07
csp/super-js/super-js-taillard-20-15/ normalized-super-js-taillard-20-15-24.xml	UNSAT TT=5.972	? (TO) TT=1800.09	? (TO) TT=1800.18	UNSAT TT=47.075	? (TO) TT=1800.14	? (TO) TT=1800.02	UNSAT TT=6.037 ASSIGNMENTS=0	UNSAT TT=5.972 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=12.636 ASSIGNMENTS=0	UNSAT TT=102.756 ASSIGNMENTS=0	? (problem) TT=80.994	? (problem) TT=76.363	No data	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=216.772	No data	? (TO) TT=1800.12	? (TO) TT=1800.09
csp/super-js/super-js-taillard-20-15/ normalized-super-js-taillard-20-15-3.xml		? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800	? (problem) TT=77.734	? (problem) TT=67.808	No data	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.06	? TT=212.925	No data	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/super-js/super-js-taillard-20-15/ normalized-super-js-taillard-20-15-4.xml		? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.05	? (problem) TT=79.466	? (problem) TT=74.062	No data	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.05	? TT=207.638	No data	? (TO) TT=1800.16	? (TO) TT=1800.03
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-12.xml		? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.21	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	? (problem) TT=70.502	? (problem) TT=68.338	No data	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=211.458	No data	? (TO) TT=1800.11	? (TO) TT=1800.04
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-20.xml		? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	? (problem) TT=76.613	? (problem) TT=72.206	No data	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=215.126	No data	? (TO) TT=1800.17	? (TO) TT=1800.07
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-21.xml	UNSAT TT=762.199	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.09	? (problem) TT=70.431	? (problem) TT=72.097	No data	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	? TT=216.429	No data	UNSAT TT=762.199	UNSAT TT=1038.4
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-22.xml		? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08	? (problem) TT=66.753	? (problem) TT=70.337	No data	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=243.926	No data	? (TO) TT=1800.06	? (TO) TT=1800.06
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-23.xml	UNSAT TT=1413.42	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (problem) TT=71.079	? (problem) TT=70.411	No data	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=219.748	No data	UNSAT TT=1413.42	? (TO) TT=1800.03
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-25.xml	UNSAT TT=956.216	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.37	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.11	? (problem) TT=71.932	? (problem) TT=76.71	No data	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.05	? (exit code) TT=211.438	No data	UNSAT TT=956.216	UNSAT TT=1447.59
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-27.xml		? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.07	? (problem) TT=77.641	? (problem) TT=75.802	No data	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? TT=220.5	No data	? (TO) TT=1800.07	? (TO) TT=1800.01
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-29.xml		? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.04	? (problem) TT=60.666	? (problem) TT=58.695	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? TT=224.362	No data	? (TO) TT=1800.06	? (TO) TT=1800
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-30.xml		? (TO) TT=1800.18	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (problem) TT=62.096	? (problem) TT=67.737	No data	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.03	? TT=219.588	No data	? (TO) TT=1800.05	? (TO) TT=1800.05
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-3.xml		? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (problem) TT=77.554	? (problem) TT=75.179	No data	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	? TT=259.624	No data	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-7.xml		? (TO) TT=1800.17	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (problem) TT=82.941	? (problem) TT=81.243	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.05	? TT=232.751	No data	? (TO) TT=1800.12	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-9.xml		? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? (problem) TT=75.024	? (problem) TT=75.224	No data	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=234.015	No data	? (TO) TT=1800.11	? (TO) TT=1800.02
csp/super-os/super-os-taillard-10/ normalized-super-os-taillard-10-11.xml	SAT TT=15.541	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=33.926 CHECKS=350186000 NODES=11847	? (TO) TT=1800.07	? (TO) TT=1800.06	? (problem) TT=62.499	? (problem) TT=62.842	No data	? (TO) TT=1800.08	SAT TT=26.048 ASSIGNMENTS=38744 CHECKS=79494000	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=206.107	No data	SAT TT=22.126	SAT TT=38.842
csp/super-os/super-os-taillard-10/ normalized-super-os-taillard-10-14.xml	SAT TT=1.48	? (TO) TT=1800.18	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=13.636 CHECKS=90996300 NODES=3520	SAT TT=8.643 ASSIGNMENTS=1191 CHECKS=3194460	SAT TT=9.269 ASSIGNMENTS=1191 CHECKS=3194460	? (problem) TT=59.264	? (problem) TT=54.778	No data	SAT TT=974.642 ASSIGNMENTS=912647 CHECKS=2143750000	SAT TT=424 ASSIGNMENTS=364739 CHECKS=1126220000	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=1.48 ASSIGNMENTS=1191 CHECKS=3194460	? TT=226.711	No data	SAT TT=11.509	SAT TT=32.419
csp/super-os/super-os-taillard-10/ normalized-super-os-taillard-10-18.xml	SAT TT=8.367	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=32.295 ASSIGNMENTS=785	SAT TT=32.386 ASSIGNMENTS=785	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=15.265 CHECKS=128648000 NODES=4614	SAT TT=16.03 ASSIGNMENTS=7774 CHECKS=22675100	SAT TT=16.686 ASSIGNMENTS=7774 CHECKS=22675100	? (problem) TT=53.383	? (problem) TT=54.5	No data	SAT TT=997.934 ASSIGNMENTS=957848 CHECKS=2930590000	SAT TT=71.765 ASSIGNMENTS=88294 CHECKS=232198000	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=8.367 ASSIGNMENTS=7774 CHECKS=22675100	? TT=251.51	No data	SAT TT=12.214	SAT TT=38.731
csp/super-os/super-os-taillard-10/ normalized-super-os-taillard-10-24.xml	UNSAT TT=1.667	? (TO) TT=1800.1	? (TO) TT=1800.13	UNSAT TT=1.667	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=2.649 ASSIGNMENTS=0	UNSAT TT=2.299 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=10.018 ASSIGNMENTS=0	UNSAT TT=461.757 ASSIGNMENTS=407846 CHECKS=1196220000	? (problem) TT=52.083	? (problem) TT=52.716	No data	? (TO) TT=1800.08	UNSAT TT=106.065 ASSIGNMENTS=122041 CHECKS=247794000	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=462.843 ASSIGNMENTS=407846 CHECKS=1196220000	? TT=319.152	No data	UNSAT TT=54.999	UNSAT TT=130.946
csp/super-os/super-os-taillard-15/ normalized-super-os-taillard-15-13.xml	SAT TT=69.457	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=97.003 CHECKS=4078650 NODES=459	? (TO) TT=1800.04	SAT TT=69.457 CHECKS=434335000 NODES=5112	? (TO) TT=1800.07	? (TO) TT=1800.03	? (problem) TT=63.653	? (problem) TT=68.148	No data	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? TT=199.337	No data	SAT TT=125.212	SAT TT=193.416
csp/super-os/super-os-taillard-15/ normalized-super-os-taillard-15-15.xml	SAT TT=58.161	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.43	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=58.161 CHECKS=327891000 NODES=3415	? (TO) TT=1800.03	? (TO) TT=1800.04	? (problem) TT=61.235	? (problem) TT=61.069	No data	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=210.91	No data	SAT TT=106.735	SAT TT=219.45
csp/super-os/super-os-taillard-15/ normalized-super-os-taillard-15-1.xml	SAT TT=209.49	? (TO) TT=1800.14	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.09	? (problem) TT=73.247	? (problem) TT=78.06	No data	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.07	? TT=219.585	No data	SAT TT=320.731	SAT TT=209.49
csp/super-os/super-os-taillard-15/ normalized-super-os-taillard-15-27.xml	UNSAT TT=5.647	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=5.689 ASSIGNMENTS=0	UNSAT TT=5.647 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=12.243 ASSIGNMENTS=0	UNSAT TT=210.911 ASSIGNMENTS=0	? (problem) TT=67.661	? (problem) TT=69.151	No data	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.05	? TT=211.236	No data	? (TO) TT=1800.29	? (TO) TT=1800.02
csp/super-os/super-os-taillard-15/ normalized-super-os-taillard-15-4.xml	SAT TT=119.549	? (TO) TT=1800.07	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (problem) TT=58.402	? (problem) TT=61.585	No data	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=204.858	No data	SAT TT=119.549	SAT TT=211.97
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-os/super-os-taillard-20/ normalized-super-os-taillard-20-27.xml	UNSAT TT=11.133	? (TO) TT=1800.18	? (TO) TT=1800.14	UNSAT TT=187.587	? (TO) TT=1800.15	? (TO) TT=1800.11	UNSAT TT=11.581 ASSIGNMENTS=0	UNSAT TT=11.133 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=19.935 ASSIGNMENTS=0	UNSAT TT=36.178 ASSIGNMENTS=0	? (problem) TT=71.285	? (problem) TT=71.519	No data	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=210.638	No data	? (MO) TT=368.937	? (MO) TT=313.651
csp/super-os/super-os-taillard-20/ normalized-super-os-taillard-20-29.xml	UNSAT TT=10.806	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.05	UNSAT TT=10.806 ASSIGNMENTS=0	UNSAT TT=10.914 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=17.778 ASSIGNMENTS=0	UNSAT TT=37.043 ASSIGNMENTS=0	? (problem) TT=72.002	? (problem) TT=68.94	No data	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=212.777	No data	? (MO) TT=116.549	? (MO) TT=308.866
csp/super-os/super-os-taillard-4/ normalized-super-os-taillard-4-19.xml	SAT TT=0.016	SAT TT=1.565 CHECKS=156605 NODES=33	SAT TT=2.021 CHECKS=3704380 NODES=201	SAT TT=0.057	SAT TT=1.496 CHECKS=2753300	SAT TT=1.139 CHECKS=2715650	SAT TT=1.352 ASSIGNMENTS=154	SAT TT=1.482 ASSIGNMENTS=154	SAT TT=2.027 CHECKS=2245 NODES=36	SAT TT=367.737 CHECKS=3799730000 NODES=1800140	SAT TT=1.869 CHECKS=10470900 NODES=3543	SAT TT=0.029 ASSIGNMENTS=35 CHECKS=7451	SAT TT=0.027 ASSIGNMENTS=35 CHECKS=7451	SAT TT=973.554	SAT TT=90.762	No data	SAT TT=0.018 ASSIGNMENTS=35 CHECKS=7451	SAT TT=0.016 ASSIGNMENTS=35 CHECKS=9203	SAT TT=0.632	SAT TT=0.063 ASSIGNMENTS=771 CHECKS=272258	SAT TT=0.016 ASSIGNMENTS=39 CHECKS=9313	SAT TT=23.692	No data	SAT TT=0.864	SAT TT=1.533
csp/super-os/super-os-taillard-4/ normalized-super-os-taillard-4-5.xml	UNSAT TT=0.029	UNSAT TT=178.73 CHECKS=4793640000 NODES=241577	UNSAT TT=141.366 CHECKS=3754730000 NODES=187153	? (TO) TT=1800.09	UNSAT TT=112.57 CHECKS=238311000	UNSAT TT=109.918 CHECKS=238178000	UNSAT TT=1.448 ASSIGNMENTS=52	UNSAT TT=1.454 ASSIGNMENTS=52	UNSAT TT=24.889 CHECKS=839275 NODES=40423	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.049 ASSIGNMENTS=123 CHECKS=158058	UNSAT TT=0.048 ASSIGNMENTS=123 CHECKS=158058	UNSAT TT=1744.3	? (MO) TT=1029.06	No data	UNSAT TT=0.029 ASSIGNMENTS=76 CHECKS=101688	UNSAT TT=0.379 ASSIGNMENTS=4075 CHECKS=2532890	UNSAT TT=2.937	UNSAT TT=39.33 ASSIGNMENTS=503985 CHECKS=215943000	UNSAT TT=0.035 ASSIGNMENTS=128 CHECKS=145218	UNSAT TT=693.351	No data	UNSAT TT=0.979	UNSAT TT=1.465
csp/super-os/super-os-taillard-4/ normalized-super-os-taillard-4-8.xml	UNSAT TT=0.023	UNSAT TT=1.563 CHECKS=3319480 NODES=180	UNSAT TT=1.478 CHECKS=3153710 NODES=0	UNSAT TT=0.068	UNSAT TT=0.765 CHECKS=860472	UNSAT TT=0.482 CHECKS=876304	UNSAT TT=1.477 ASSIGNMENTS=8	UNSAT TT=1.482 ASSIGNMENTS=8	UNSAT TT=1.995 CHECKS=14709 NODES=417	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=0.031 ASSIGNMENTS=32 CHECKS=45353	UNSAT TT=0.033 ASSIGNMENTS=32 CHECKS=45353	UNSAT TT=203.583	UNSAT TT=48.208	No data	UNSAT TT=0.023 ASSIGNMENTS=51 CHECKS=68035	UNSAT TT=0.029 ASSIGNMENTS=67 CHECKS=94030	UNSAT TT=0.69	UNSAT TT=1.352 ASSIGNMENTS=21467 CHECKS=7673110	UNSAT TT=0.029 ASSIGNMENTS=66 CHECKS=107876	UNSAT TT=15.405	No data	UNSAT TT=0.862	UNSAT TT=1.224
csp/super-os/super-os-taillard-5/ normalized-super-os-taillard-5-11.xml	SAT TT=0.038	SAT TT=2.27 CHECKS=773079 NODES=107	SAT TT=2.802 CHECKS=5985960 NODES=310	? (TO) TT=1800.03	SAT TT=23.297 CHECKS=44528100	SAT TT=17.008 CHECKS=29660500	SAT TT=1.981 ASSIGNMENTS=71	SAT TT=1.935 ASSIGNMENTS=71	SAT TT=4.093 CHECKS=13576 NODES=158	? (TO) TT=1800.01	SAT TT=1.776 CHECKS=5752390 NODES=1208	SAT TT=0.051 ASSIGNMENTS=136 CHECKS=96986	SAT TT=0.052 ASSIGNMENTS=136 CHECKS=96986	SAT TT=253.848	SAT TT=211.889	No data	SAT TT=0.038 ASSIGNMENTS=138 CHECKS=106781	SAT TT=0.551 ASSIGNMENTS=6258 CHECKS=3995560	SAT TT=6.311	SAT TT=1.472 ASSIGNMENTS=15367 CHECKS=7122800	SAT TT=0.05 ASSIGNMENTS=162 CHECKS=147688	SAT TT=68.235	No data	SAT TT=1.41	SAT TT=2.685
csp/super-os/super-os-taillard-5/ normalized-super-os-taillard-5-16.xml	SAT TT=0.076	SAT TT=2.75 CHECKS=1893670 NODES=133	SAT TT=2.601 CHECKS=2753900 NODES=99	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=34.9 CHECKS=76880000	SAT TT=2.543 ASSIGNMENTS=193	SAT TT=2.821 ASSIGNMENTS=193	SAT TT=4.596 CHECKS=5172 NODES=59	? (TO) TT=1800.03	SAT TT=2.01 CHECKS=4757220 NODES=809	SAT TT=0.098 ASSIGNMENTS=329 CHECKS=421074	SAT TT=0.099 ASSIGNMENTS=329 CHECKS=421074	SAT TT=678.548	SAT TT=317.87	No data	SAT TT=0.342 ASSIGNMENTS=1874 CHECKS=2101830	SAT TT=0.076 ASSIGNMENTS=500 CHECKS=355118	SAT TT=3.143	SAT TT=7.649 ASSIGNMENTS=75135 CHECKS=40938800	SAT TT=0.106 ASSIGNMENTS=402 CHECKS=564824	SAT TT=86.854	No data	SAT TT=1.472	SAT TT=2.64
csp/super-os/super-os-taillard-5/ normalized-super-os-taillard-5-1.xml	UNSAT TT=2.126	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=130.263 ASSIGNMENTS=26788	UNSAT TT=124.718 ASSIGNMENTS=26788	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=16.81 ASSIGNMENTS=54405 CHECKS=62914400	UNSAT TT=16.963 ASSIGNMENTS=54405 CHECKS=62914400	? (TO) TT=1800.04	? (MO) TT=865.18	No data	UNSAT TT=4.77 ASSIGNMENTS=26212 CHECKS=32630000	UNSAT TT=2.774 ASSIGNMENTS=19396 CHECKS=18705100	UNSAT TT=1023.27	UNSAT TT=57.902 ASSIGNMENTS=462261 CHECKS=368150000	UNSAT TT=8.701 ASSIGNMENTS=54405 CHECKS=62914400	? (TO) TT=1800.14	No data	UNSAT TT=2.126	UNSAT TT=3.046
csp/super-os/super-os-taillard-5/ normalized-super-os-taillard-5-21.xml	UNSAT TT=0.031	UNSAT TT=491.438 CHECKS=14325100000 NODES=509584	UNSAT TT=520.481 CHECKS=14063700000 NODES=498031	UNSAT TT=0.102	UNSAT TT=42.774 CHECKS=92871600	UNSAT TT=60.906 CHECKS=131502000	UNSAT TT=0.972 ASSIGNMENTS=0	UNSAT TT=0.934 ASSIGNMENTS=0	UNSAT TT=40.4 CHECKS=1252980 NODES=49683	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.056 ASSIGNMENTS=214 CHECKS=159730	UNSAT TT=0.058 ASSIGNMENTS=214 CHECKS=159730	UNSAT TT=177.786	UNSAT TT=204.122	No data	UNSAT TT=0.041 ASSIGNMENTS=216 CHECKS=144604	UNSAT TT=0.502 ASSIGNMENTS=5485 CHECKS=3274870	UNSAT TT=5.7	UNSAT TT=67.958 ASSIGNMENTS=803222 CHECKS=317940000	UNSAT TT=0.031 ASSIGNMENTS=64 CHECKS=45189	UNSAT TT=140.937	No data	UNSAT TT=1.344	UNSAT TT=2.487
csp/super-os/super-os-taillard-5/ normalized-super-os-taillard-5-4.xml	UNSAT TT=2.324	? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=459.997 ASSIGNMENTS=124339	UNSAT TT=469.615 ASSIGNMENTS=124339	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=32.983 ASSIGNMENTS=175271 CHECKS=179910000	UNSAT TT=35.059 ASSIGNMENTS=175271 CHECKS=179910000	? (TO) TT=1800.07	? (MO) TT=575.25	No data	UNSAT TT=13.243 ASSIGNMENTS=71777 CHECKS=88616500	UNSAT TT=3.876 ASSIGNMENTS=22676 CHECKS=25249100	? (TO) TT=1800.11	UNSAT TT=162.215 ASSIGNMENTS=1156670 CHECKS=1018270000	UNSAT TT=25.444 ASSIGNMENTS=175271 CHECKS=179910000	? (TO) TT=1800.11	No data	UNSAT TT=2.324	UNSAT TT=3.182
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-os/super-os-taillard-5/ normalized-super-os-taillard-5-5.xml	UNSAT TT=3.728	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.11	UNSAT TT=256.414 ASSIGNMENTS=50788	UNSAT TT=268.14 ASSIGNMENTS=50788	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=34.595 ASSIGNMENTS=163772 CHECKS=176711000	UNSAT TT=34.381 ASSIGNMENTS=163772 CHECKS=176711000	? (MO) TT=1499.41	? (MO) TT=676.39	No data	UNSAT TT=5.502 ASSIGNMENTS=26108 CHECKS=42141900	UNSAT TT=6.534 ASSIGNMENTS=38141 CHECKS=47407100	? (TO) TT=1800.1	UNSAT TT=36.729 ASSIGNMENTS=186687 CHECKS=230160000	UNSAT TT=26.471 ASSIGNMENTS=163772 CHECKS=176711000	? (TO) TT=1800.16	No data	UNSAT TT=3.728	UNSAT TT=3.795
csp/super-os/super-os-taillard-5/ normalized-super-os-taillard-5-7.xml	UNSAT TT=2.081	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=141.615 ASSIGNMENTS=30940	UNSAT TT=133.095 ASSIGNMENTS=30940	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=9.027 ASSIGNMENTS=9341 CHECKS=15738400	UNSAT TT=9.769 ASSIGNMENTS=9341 CHECKS=15738400	? (TO) TT=1800.02	? (MO) TT=1230.52	No data	UNSAT TT=9.454 ASSIGNMENTS=52508 CHECKS=63140700	UNSAT TT=3.585 ASSIGNMENTS=22593 CHECKS=24080800	? (TO) TT=1800.13	UNSAT TT=64.623 ASSIGNMENTS=576555 CHECKS=361599000	UNSAT TT=2.081 ASSIGNMENTS=9341 CHECKS=15738400	? (TO) TT=1800.17	No data	UNSAT TT=2.403	UNSAT TT=3.086
csp/super-os/super-os-taillard-7/ normalized-super-os-taillard-7-18.xml	SAT TT=0.312	SAT TT=184.901 CHECKS=140519000 NODES=160818	SAT TT=115.606 CHECKS=93446300 NODES=109431	? (TO) TT=1800.09	SAT TT=39.688 CHECKS=63888000	SAT TT=50.393 CHECKS=103007000	SAT TT=5.573 ASSIGNMENTS=214	SAT TT=5.671 ASSIGNMENTS=214	SAT TT=115.653 CHECKS=2902620 NODES=58290	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=0.312 ASSIGNMENTS=796 CHECKS=1325820	SAT TT=0.312 ASSIGNMENTS=796 CHECKS=1325820	? (MO) TT=1001.1	? (MO) TT=1075.7	No data	SAT TT=1.056 ASSIGNMENTS=3707 CHECKS=5811900	SAT TT=4.502 ASSIGNMENTS=22912 CHECKS=22702300	? (TO) TT=1800.08	SAT TT=154.062 ASSIGNMENTS=285920 CHECKS=687530000	SAT TT=0.347 ASSIGNMENTS=659 CHECKS=1378110	? TT=397.033	No data	SAT TT=3.23	SAT TT=8.838
csp/super-os/super-os-taillard-7/ normalized-super-os-taillard-7-19.xml	SAT TT=2.263	SAT TT=27.179 CHECKS=8623660 NODES=22968	SAT TT=165.97 CHECKS=110081000 NODES=192689	? (TO) TT=1800.1	SAT TT=39.38 CHECKS=70806600	? (TO) TT=1800.1	SAT TT=3.952 ASSIGNMENTS=131	SAT TT=4.269 ASSIGNMENTS=131	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=3.612 CHECKS=11738100 NODES=733	SAT TT=12.337 ASSIGNMENTS=13290 CHECKS=24527800	SAT TT=12.374 ASSIGNMENTS=13290 CHECKS=24527800	? (TO) TT=1800.03	? (TO) TT=1800	No data	SAT TT=113.908 ASSIGNMENTS=288752 CHECKS=700504000	SAT TT=2.263 ASSIGNMENTS=13094 CHECKS=10271400	? (TO) TT=1800.07	SAT TT=612.633 ASSIGNMENTS=1411850 CHECKS=2782110000	SAT TT=4.509 ASSIGNMENTS=13290 CHECKS=24527800	? TT=223.609	No data	SAT TT=3.545	SAT TT=8.902
csp/super-os/super-os-taillard-7/ normalized-super-os-taillard-7-2.xml	UNSAT TT=5.093	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.11	UNSAT TT=1754.43 ASSIGNMENTS=280618	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=17.851 ASSIGNMENTS=37185 CHECKS=47929000	UNSAT TT=17.431 ASSIGNMENTS=37185 CHECKS=47929000	? (MO) TT=1147.78	? (MO) TT=1070.88	No data	UNSAT TT=671.854 ASSIGNMENTS=1719570 CHECKS=3022110000	UNSAT TT=67.526 ASSIGNMENTS=193956 CHECKS=310867000	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=9.79 ASSIGNMENTS=37185 CHECKS=47929000	? TT=283.724	No data	UNSAT TT=5.093	UNSAT TT=10.831
csp/super-os/super-os-taillard-7/ normalized-super-os-taillard-7-30.xml	UNSAT TT=0.612	? (TO) TT=1800.11	? (TO) TT=1800.15	UNSAT TT=1339.18	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=1.484 ASSIGNMENTS=0	UNSAT TT=1.505 ASSIGNMENTS=0	UNSAT TT=1697.57 CHECKS=48716600 NODES=1574140	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=1.069 ASSIGNMENTS=3466 CHECKS=5256300	UNSAT TT=1.062 ASSIGNMENTS=3466 CHECKS=5256300	? (MO) TT=818.31	? (MO) TT=813	No data	UNSAT TT=3.129 ASSIGNMENTS=11144 CHECKS=17072700	UNSAT TT=2.165 ASSIGNMENTS=12377 CHECKS=10390900	UNSAT TT=278.265	UNSAT TT=191.779 ASSIGNMENTS=536219 CHECKS=869326000	UNSAT TT=0.612 ASSIGNMENTS=1688 CHECKS=3021770	? TT=225.593	No data	UNSAT TT=3.545	UNSAT TT=8.335
csp/super-queens/ normalized-super-queens-11.xml	UNSAT TT=0.006	UNSAT TT=0.666 CHECKS=8 NODES=0	UNSAT TT=0.682 CHECKS=8 NODES=0	UNSAT TT=0.026	UNSAT TT=0.016 CHECKS=820	UNSAT TT=0.011 CHECKS=1496	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.547 ASSIGNMENTS=0	UNSAT TT=0.466 CHECKS=154 NODES=3	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.681	UNSAT TT=0.678	No data	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.32	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.868	No data	UNSAT TT=0.527	UNSAT TT=0.524
csp/super-queens/ normalized-super-queens-13.xml	UNSAT TT=0.009	UNSAT TT=0.827 CHECKS=16 NODES=0	UNSAT TT=0.857 CHECKS=16 NODES=0	UNSAT TT=0.043	UNSAT TT=0.172 CHECKS=70159	UNSAT TT=0.102 CHECKS=317849	UNSAT TT=0.865 ASSIGNMENTS=0	UNSAT TT=0.871 ASSIGNMENTS=0	UNSAT TT=0.73 CHECKS=7336 NODES=156	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.017	UNSAT TT=1.018	No data	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.585	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.193	No data	UNSAT TT=0.774	UNSAT TT=0.832
csp/super-queens/ normalized-super-queens-1.xml	UNSAT TT=0.012	UNSAT TT=0.849 CHECKS=20 NODES=0	UNSAT TT=0.788 CHECKS=20 NODES=0	UNSAT TT=0.054	UNSAT TT=3.801 CHECKS=3906660	UNSAT TT=13.293 CHECKS=44362100	UNSAT TT=0.922 ASSIGNMENTS=0	UNSAT TT=1.003 ASSIGNMENTS=0	UNSAT TT=0.988 CHECKS=77829 NODES=1645	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.612	UNSAT TT=1.678	No data	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.376	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.538	No data	UNSAT TT=1.617	UNSAT TT=1.845
csp/super-queens/ normalized-super-queens-2.xml	UNSAT TT=1.119	UNSAT TT=5.091 CHECKS=238 NODES=0	UNSAT TT=4.956 CHECKS=238 NODES=0	UNSAT TT=3.155	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=19.796 ASSIGNMENTS=0	UNSAT TT=20.087 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=1.266 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.119 ASSIGNMENTS=0 CHECKS=1	? (MO) TT=1069.75	? (MO) TT=376.67	No data	UNSAT TT=1.254 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.259 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	UNSAT TT=1.164 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.237 ASSIGNMENTS=0 CHECKS=1	? TT=850.493	No data	? (TO) TT=1800.07	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-queens/ normalized-super-queens-3.xml	UNSAT TT=0.016	UNSAT TT=0.922 CHECKS=24 NODES=0	UNSAT TT=0.889 CHECKS=24 NODES=0	UNSAT TT=0.068	UNSAT TT=297.889 CHECKS=1066540000	UNSAT TT=167.405 CHECKS=616692000	UNSAT TT=1.123 ASSIGNMENTS=0	UNSAT TT=1.107 ASSIGNMENTS=0	UNSAT TT=4.773 CHECKS=1253330 NODES=25152	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=25.545	UNSAT TT=15.779	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=115.895	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=80.128	No data	UNSAT TT=20.751	UNSAT TT=31.719
csp/super-queens/ normalized-super-queens-4.xml	UNSAT TT=1.602	UNSAT TT=6.173 CHECKS=298 NODES=0	UNSAT TT=6.718 CHECKS=298 NODES=0	UNSAT TT=4.531	? (TO) TT=1800.11	? (TO) TT=1800.03	UNSAT TT=25.128 ASSIGNMENTS=0	UNSAT TT=25.187 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=1.716 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.706 ASSIGNMENTS=0 CHECKS=1	? (MO) TT=840.92	? (MO) TT=390.35	No data	UNSAT TT=1.602 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.692 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.01	UNSAT TT=1.633 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.714 ASSIGNMENTS=0 CHECKS=1	? TT=249.21	No data	? (TO) TT=1800.19	? (TO) TT=1800.06
csp/super-queens/ normalized-super-queens-5.xml	UNSAT TT=0.022	UNSAT TT=0.976 CHECKS=30 NODES=0	UNSAT TT=0.933 CHECKS=30 NODES=0	UNSAT TT=0.093	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=1.399 ASSIGNMENTS=0	UNSAT TT=1.51 ASSIGNMENTS=0	UNSAT TT=562.931 CHECKS=147078000 NODES=2584230	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.07	? (TO) TT=1800.12	No data	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.18	No data	? (TO) TT=1800.1	? (TO) TT=1800.13
csp/super-queens/ normalized-super-queens-6.xml	UNSAT TT=1.677	UNSAT TT=9.957 CHECKS=412 NODES=0	UNSAT TT=10.01 CHECKS=412 NODES=0	UNSAT TT=7.15	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=41.075 ASSIGNMENTS=0	UNSAT TT=39.877 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=1.775 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.716 ASSIGNMENTS=0 CHECKS=1	? (MO) TT=543.29	? (MO) TT=483.4	No data	UNSAT TT=1.685 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.677 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	UNSAT TT=1.748 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.737 ASSIGNMENTS=0 CHECKS=1	? TT=574.563	No data	? (MO) TT=66.568	? (MO) TT=1035.36
csp/super-queens/ normalized-super-queens-7.xml	UNSAT TT=2.521	UNSAT TT=14.383 CHECKS=532 NODES=0	UNSAT TT=13.477 CHECKS=532 NODES=0	UNSAT TT=10.101	? (TO) TT=1800.08	? (TO) TT=1800.13	UNSAT TT=52.485 ASSIGNMENTS=0	UNSAT TT=54.371 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=2.559 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.547 ASSIGNMENTS=0 CHECKS=1	? (MO) TT=685.4	? (MO) TT=744.49	No data	UNSAT TT=2.521 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.65 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.03	UNSAT TT=2.534 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.521 ASSIGNMENTS=0 CHECKS=1	? TT=473.059	No data	? (MO) TT=103.55	? (MO) TT=309.13
csp/super-queens/ normalized-super-queens-8.xml	UNSAT TT=0.04	UNSAT TT=1.12 CHECKS=40 NODES=0	UNSAT TT=1.036 CHECKS=40 NODES=0	UNSAT TT=0.142	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=2.053 ASSIGNMENTS=0	UNSAT TT=2.066 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.052 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.03	? (TO) TT=1800	No data	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.07	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.18	No data	? (TO) TT=1800.07	? (TO) TT=1800.08
csp/tdsp/ normalized-C1-1-20.xml	SAT TT=4.784	SAT TT=86.238 CHECKS=57861100 NODES=65274	SAT TT=1235.48 CHECKS=928176000 NODES=852887	SAT TT=1342.54	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.17	SAT TT=77.892 CHECKS=9735920 NODES=14134	SAT TT=47.121 CHECKS=50109200 NODES=58411	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800	? (problem) TT=68.54	? (problem) TT=64.586	No data	? (TO) TT=1800.06	SAT TT=20.575 ASSIGNMENTS=282451 CHECKS=55700500	? TT=0.309	? (TO) TT=1800.02	? (TO) TT=1800.06	? TT=534.728	No data	SAT TT=28.086	SAT TT=4.784
csp/tdsp/ normalized-C1-2-20.xml	SAT TT=5.284	? (TO) TT=1800.13	? (TO) TT=1800.16	SAT TT=1343.62	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.08	? (problem) TT=77.104	? (problem) TT=72.826	No data	? (TO) TT=1800.11	? (TO) TT=1800.09	? TT=0.361	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=763.551	No data	SAT TT=5.284	SAT TT=45.567
csp/tdsp/ normalized-C1-2-21.xml	SAT TT=0.69	SAT TT=22.048 CHECKS=14513200 NODES=9536	SAT TT=2.252 CHECKS=477386 NODES=599	SAT TT=1764.58	SAT TT=51.745 CHECKS=21923800	SAT TT=71.256 CHECKS=31521600	SAT TT=5.266 ASSIGNMENTS=1103	? (TO) TT=1800.16	SAT TT=80.764 CHECKS=11732000 NODES=16517	SAT TT=195.256 CHECKS=389309000 NODES=404081	SAT TT=30.784 CHECKS=1052750 NODES=891	SAT TT=1.011 ASSIGNMENTS=9945 CHECKS=2364700	SAT TT=1.016 ASSIGNMENTS=9945 CHECKS=2364700	? (problem) TT=79.246	? (problem) TT=80.583	No data	SAT TT=2.456 ASSIGNMENTS=27859 CHECKS=6214920	SAT TT=1.473 ASSIGNMENTS=15143 CHECKS=3786700	? TT=0.329	SAT TT=442.012 ASSIGNMENTS=3638160 CHECKS=747705000	SAT TT=0.69 ASSIGNMENTS=5605 CHECKS=1590770	? (TO) TT=1802.21	No data	SAT TT=1.087	SAT TT=1.551
csp/tdsp/ normalized-C2-1-15.xml	SAT TT=13.833	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.13	? (problem) TT=77.551	? (problem) TT=83.883	No data	? (TO) TT=1800.1	? (TO) TT=1800.01	? TT=0.412	? (TO) TT=1800.06	? (TO) TT=1800.04	? TT=690.107	No data	SAT TT=13.833	SAT TT=160.481
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tdsp/ normalized-C2-2-15.xml	SAT TT=5.175	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=54.063 ASSIGNMENTS=203502 CHECKS=94414500	SAT TT=56.208 ASSIGNMENTS=203502 CHECKS=94414500	? (problem) TT=114.428	? (problem) TT=101.036	No data	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=0.453	? (TO) TT=1800.09	SAT TT=48.643 ASSIGNMENTS=203502 CHECKS=94414500	? TT=860.842	No data	SAT TT=5.175	SAT TT=31.941
csp/tdsp/ normalized-C2-3-16.xml	SAT TT=1.024	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=38.132 CHECKS=14261600	SAT TT=94.718 CHECKS=35343600	SAT TT=96.591 ASSIGNMENTS=23864	? (TO) TT=1800.14	? (TO) TT=1800.04	SAT TT=605.575 CHECKS=1122470000 NODES=625967	SAT TT=90.583 CHECKS=946549 NODES=374	SAT TT=8.718 ASSIGNMENTS=1958 CHECKS=1792950	SAT TT=8.52 ASSIGNMENTS=1958 CHECKS=1792950	? (problem) TT=69.913	? (problem) TT=73.722	No data	? (TO) TT=1800.11	? (TO) TT=1800.05	? TT=0.404	? (TO) TT=1800.09	SAT TT=1.024 ASSIGNMENTS=1958 CHECKS=1792950	? (TO) TT=1802.19	No data	SAT TT=1.725	SAT TT=2.9
csp/tdsp/ normalized-C3-1-31.xml	SAT TT=6.587	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	Wrong Cert. TT=1198.58 ASSIGNMENTS=372916	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (problem) TT=87.409	? (problem) TT=86.749	No data	? (TO) TT=1800.02	? (TO) TT=1800.07	? TT=0.55	? (TO) TT=1800.11	? (TO) TT=1800.05	? TT=900.718	No data	SAT TT=6.587	SAT TT=8.783
csp/tdsp/ normalized-C3-2-30.xml		? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.34	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.06	? (problem) TT=74.183	? (problem) TT=80.031	No data	? (TO) TT=1800.03	? (TO) TT=1800.06	? TT=0.417	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=718.15	No data	? (TO) TT=1800.03	? (TO) TT=1800.01
csp/tdsp/ normalized-C4-1-60.xml	SAT TT=96.907	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=96.907 ASSIGNMENTS=468	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? (problem) TT=188.282	? (problem) TT=181.572	No data	? (TO) TT=1800.1	? (TO) TT=1800.06	? TT=0.473	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1801.01	No data	? (TO) TT=1800.03	? (TO) TT=1800.04
csp/tdsp/ normalized-C4-2-60.xml	SAT TT=1353.87	? (TO) TT=1800.1	? (TO) TT=1800.13	SAT TT=1353.87	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? (MO) TT=99.52	? (problem) TT=107.619	No data	? (TO) TT=1800.1	? (TO) TT=1800.08	? TT=0.629	? (TO) TT=1800.07	? (TO) TT=1800.08	? TT=794.093	No data	? (TO) TT=1800.02	? (TO) TT=1800.09
csp/tdsp/ normalized-C4-3-60.xml	SAT TT=104.074	? (TO) TT=1800.11	? (TO) TT=1800.06	SAT TT=1784.59	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=104.074 ASSIGNMENTS=750	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.14	? (problem) TT=159.833	? (problem) TT=170.942	No data	? (TO) TT=1800.04	? (TO) TT=1800.05	? TT=0.465	? (TO) TT=1800.06	? (TO) TT=1800.04	? TT=1707.04	No data	? (TO) TT=1800.1	? (TO) TT=1800.01
csp/tdsp/ normalized-C4-3-61.xml	SAT TT=12.237	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=297.475 ASSIGNMENTS=1202370 CHECKS=972831000	SAT TT=1745.81 ASSIGNMENTS=1202370 CHECKS=972831000	? (problem) TT=189.352	? (problem) TT=160.853	No data	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=0.633	SAT TT=423.799 ASSIGNMENTS=1611260 CHECKS=1481060000	SAT TT=287.246 ASSIGNMENTS=1202370 CHECKS=972831000	? (TO) TT=1800.9	No data	SAT TT=12.237	SAT TT=98.289
csp/tdsp/ normalized-C5-1-90.xml		? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (MO) TT=93.94	? (MO) TT=90.69	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=0.729	? (TO) TT=1800.08	? (TO) TT=1800.05	? TT=1166.35	No data	? (TO) TT=1800.1	? (TO) TT=1800.03
csp/tdsp/ normalized-C5-1-91.xml	SAT TT=257.173	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (MO) TT=96.51	? (MO) TT=95.37	No data	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=0.529	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=1176.37	No data	SAT TT=257.173	? (TO) TT=1800.01
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tdsp/ normalized-C5-2-91.xml	SAT TT=588.036	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.03	? (MO) TT=177.99	? (MO) TT=179.88	No data	? (TO) TT=1800.05	? (TO) TT=1800.04	? TT=0.594	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.29	No data	SAT TT=588.036	SAT TT=796.881
csp/tdsp/ normalized-C5-3-91.xml		? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.09	? (MO) TT=380.42	? (TO) TT=1800.09	? (TO) TT=1800.08	? (MO) TT=95.65	? (MO) TT=98.12	No data	? (TO) TT=1800.06	? (TO) TT=1800.04	? TT=0.73	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=665.229	No data	? (MO) TT=1682.37	? (TO) TT=1800.09
csp/tdsp/ normalized-C6-1-121.xml		? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.22	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (MO) TT=159.33	? (MO) TT=160.83	No data	? (TO) TT=1800.1	? (TO) TT=1800.05	? TT=0.632	? (TO) TT=1800.12	? (TO) TT=1800.07	? TT=1207.08	No data	? (MO) TT=1297.15	? (TO) TT=1800.08
csp/tdsp/ normalized-C6-3-121.xml		? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.06	? (MO) TT=141.94	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.02	? (MO) TT=242.65	? (MO) TT=260.23	No data	? (TO) TT=1800.06	? (TO) TT=1800.12	? TT=0.641	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1801.53	No data	? (MO) TT=1024.04	? (TO) TT=1800
csp/tdsp/ normalized-C7-1-240.xml		? (TO) TT=1800.18	? (TO) TT=1800.27	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.13	? (problem) TT=1620.89	? TT=204.381	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	? (MO) TT=518.58	? (MO) TT=529.92	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=1.365	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.26	No data	? TT=184.402	? TT=177.64
csp/tdsp/ normalized-C7-3-240.xml		? (TO) TT=1800.22	? (TO) TT=1800.24	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.51	? (problem) TT=56.485	? TT=204.269	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	? (MO) TT=785.97	? (MO) TT=784.96	No data	? (TO) TT=1800.14	? (TO) TT=1800.16	? TT=1.226	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.26	No data	? TT=182.376	? TT=180.267
csp/tightness0.1/ normalized-rand-2-40-8-753-100-0_ext.xml	SAT TT=1.975	SAT TT=2.019 CHECKS=2311260 NODES=3421	SAT TT=1.975 CHECKS=2123650 NODES=3208	SAT TT=6.008	SAT TT=85.343 CHECKS=71408100	SAT TT=15.617 CHECKS=15465800	SAT TT=11.295 ASSIGNMENTS=24029	SAT TT=12.278 ASSIGNMENTS=24029	SAT TT=6.905 CHECKS=709429 NODES=12491	SAT TT=2.535 CHECKS=8835820 NODES=29237	? (TO) TT=1800.09	SAT TT=10.591 ASSIGNMENTS=27583 CHECKS=22593400	SAT TT=11.211 ASSIGNMENTS=27583 CHECKS=22593400	SAT TT=5.783	SAT TT=4.016	No data	SAT TT=3.822 ASSIGNMENTS=32395 CHECKS=27389400	SAT TT=2.28 ASSIGNMENTS=19712 CHECKS=15147100	SAT TT=26.709	SAT TT=3.918 ASSIGNMENTS=31115 CHECKS=25700400	SAT TT=3.409 ASSIGNMENTS=27583 CHECKS=22593400	SAT TT=194.043	SAT TT=16.487 ASSIGNMENTS=9878 CHECKS=13289600	SAT TT=12.65	SAT TT=29.234
csp/tightness0.1/ normalized-rand-2-40-8-753-100-11_ext.xml	SAT TT=0.814	SAT TT=5.842 CHECKS=12934300 NODES=17802	SAT TT=4.962 CHECKS=11697900 NODES=16180	SAT TT=4.087	SAT TT=112.161 CHECKS=92454000	SAT TT=11.814 CHECKS=11446500	SAT TT=12.553 ASSIGNMENTS=26230	SAT TT=13.185 ASSIGNMENTS=26230	SAT TT=23.898 CHECKS=2770180 NODES=48955	SAT TT=1.067 CHECKS=1651080 NODES=5406	SAT TT=1.294 CHECKS=3602980 NODES=4697	SAT TT=11.068 ASSIGNMENTS=30110 CHECKS=25169800	SAT TT=11.397 ASSIGNMENTS=30110 CHECKS=25169800	SAT TT=10.71	SAT TT=4.658	No data	SAT TT=2.016 ASSIGNMENTS=16002 CHECKS=13240600	SAT TT=0.814 ASSIGNMENTS=7324 CHECKS=5146170	SAT TT=28.078	SAT TT=3.34 ASSIGNMENTS=28726 CHECKS=24076300	SAT TT=3.722 ASSIGNMENTS=30110 CHECKS=25169800	SAT TT=54.113	SAT TT=25.153 ASSIGNMENTS=32690 CHECKS=45766700	SAT TT=5.972	SAT TT=2.077
csp/tightness0.1/ normalized-rand-2-40-8-753-100-32_ext.xml	SAT TT=0.421	SAT TT=1.826 CHECKS=1797270 NODES=2687	SAT TT=2.17 CHECKS=2687810 NODES=4077	SAT TT=0.421	SAT TT=96.107 CHECKS=87280600	SAT TT=1.18 CHECKS=1054370	SAT TT=10.134 ASSIGNMENTS=22262	SAT TT=10.135 ASSIGNMENTS=22262	SAT TT=2.361 CHECKS=190970 NODES=3253	SAT TT=1.579 CHECKS=4809030 NODES=15962	SAT TT=1.136 CHECKS=3003320 NODES=4105	SAT TT=9.391 ASSIGNMENTS=13448 CHECKS=11234700	SAT TT=9.634 ASSIGNMENTS=13448 CHECKS=11234700	SAT TT=9.574	SAT TT=3.307	No data	SAT TT=2.064 ASSIGNMENTS=17950 CHECKS=14573100	SAT TT=0.969 ASSIGNMENTS=8804 CHECKS=6255620	SAT TT=76.867	SAT TT=0.933 ASSIGNMENTS=7976 CHECKS=6388720	SAT TT=1.679 ASSIGNMENTS=13448 CHECKS=11234700	SAT TT=72.917	SAT TT=2.794 ASSIGNMENTS=3734 CHECKS=4988570	SAT TT=6.412	SAT TT=3.199
csp/tightness0.1/ normalized-rand-2-40-8-753-100-41_ext.xml	SAT TT=0.134	SAT TT=5.728 CHECKS=12381300 NODES=18439	SAT TT=4.958 CHECKS=11441600 NODES=17104	SAT TT=12.334	SAT TT=2.367 CHECKS=2025950	SAT TT=3.148 CHECKS=3055130	SAT TT=1.562 ASSIGNMENTS=1094	SAT TT=1.261 ASSIGNMENTS=1094	SAT TT=7.202 CHECKS=760665 NODES=13738	SAT TT=7.757 CHECKS=40660700 NODES=135032	? (TO) TT=1800.01	SAT TT=0.148 ASSIGNMENTS=786 CHECKS=625484	SAT TT=0.147 ASSIGNMENTS=786 CHECKS=625484	SAT TT=36.349	SAT TT=56.771	No data	SAT TT=0.166 ASSIGNMENTS=1060 CHECKS=830357	SAT TT=0.484 ASSIGNMENTS=4912 CHECKS=2932930	SAT TT=6.949	SAT TT=2.756 ASSIGNMENTS=24295 CHECKS=19603800	SAT TT=0.134 ASSIGNMENTS=786 CHECKS=625484	SAT TT=13.684	SAT TT=3.054 ASSIGNMENTS=4365 CHECKS=5369940	SAT TT=6.202	SAT TT=21.241
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.1/ normalized-rand-2-40-8-753-100-48_ext.xml	SAT TT=0.972	SAT TT=2.351 CHECKS=2985560 NODES=4205	SAT TT=2.904 CHECKS=4720170 NODES=6769	SAT TT=5.734	SAT TT=5.027 CHECKS=3930650	SAT TT=11.861 CHECKS=10663000	SAT TT=11.137 ASSIGNMENTS=22220	SAT TT=10.308 ASSIGNMENTS=22220	SAT TT=19.916 CHECKS=2250870 NODES=40216	SAT TT=2.225 CHECKS=8462850 NODES=28055	? (TO) TT=1800.05	SAT TT=8.701 ASSIGNMENTS=13606 CHECKS=11009400	SAT TT=9.176 ASSIGNMENTS=13606 CHECKS=11009400	SAT TT=23.646	SAT TT=14.971	No data	SAT TT=1.63 ASSIGNMENTS=13322 CHECKS=10800500	SAT TT=0.972 ASSIGNMENTS=8745 CHECKS=6255490	SAT TT=86.993	SAT TT=6.131 ASSIGNMENTS=52750 CHECKS=43372200	SAT TT=1.673 ASSIGNMENTS=13606 CHECKS=11009400	SAT TT=500.845	SAT TT=5.827 ASSIGNMENTS=7614 CHECKS=9941790	SAT TT=12.289	SAT TT=5.043
csp/tightness0.1/ normalized-rand-2-40-8-753-100-56_ext.xml	SAT TT=0.605	SAT TT=1.401 CHECKS=770964 NODES=1087	SAT TT=2.319 CHECKS=3416050 NODES=4831	SAT TT=0.605	SAT TT=2.444 CHECKS=1978430	SAT TT=1.287 CHECKS=1136140	SAT TT=12.865 ASSIGNMENTS=27434	SAT TT=12.988 ASSIGNMENTS=27434	SAT TT=1.036 CHECKS=52278 NODES=742	SAT TT=6.4 CHECKS=30039200 NODES=99562	SAT TT=5.181 CHECKS=33388100 NODES=27497	SAT TT=9.402 ASSIGNMENTS=17371 CHECKS=15196300	SAT TT=9.747 ASSIGNMENTS=17371 CHECKS=15196300	SAT TT=5.52	SAT TT=19.198	No data	SAT TT=0.914 ASSIGNMENTS=7402 CHECKS=6586340	SAT TT=1 ASSIGNMENTS=8926 CHECKS=6561500	SAT TT=43.619	SAT TT=1.008 ASSIGNMENTS=7601 CHECKS=6589330	SAT TT=2.238 ASSIGNMENTS=17371 CHECKS=15196300	SAT TT=107.597	SAT TT=3.641 ASSIGNMENTS=725 CHECKS=898353	SAT TT=13.51	SAT TT=2.318
csp/tightness0.1/ normalized-rand-2-40-8-753-100-64_ext.xml	UNSAT TT=4.48	UNSAT TT=19.451 CHECKS=51706200 NODES=68370	UNSAT TT=18.988 CHECKS=50529900 NODES=66988	UNSAT TT=7.565	UNSAT TT=126.586 CHECKS=106877000	UNSAT TT=78.884 CHECKS=85934200	UNSAT TT=18.814 ASSIGNMENTS=38061	UNSAT TT=18.194 ASSIGNMENTS=38061	UNSAT TT=21.411 CHECKS=2679380 NODES=46312	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=11.255 ASSIGNMENTS=35900 CHECKS=30523100	UNSAT TT=12.012 ASSIGNMENTS=35900 CHECKS=30523100	UNSAT TT=35.707	UNSAT TT=87.765	No data	UNSAT TT=4.599 ASSIGNMENTS=36610 CHECKS=31199000	UNSAT TT=5.137 ASSIGNMENTS=41856 CHECKS=34839500	UNSAT TT=140.927	UNSAT TT=5.262 ASSIGNMENTS=40996 CHECKS=35306700	UNSAT TT=4.48 ASSIGNMENTS=35900 CHECKS=30523100	UNSAT TT=405.616	UNSAT TT=49.267 ASSIGNMENTS=61846 CHECKS=87881200	UNSAT TT=20.084	UNSAT TT=100.848
csp/tightness0.1/ normalized-rand-2-40-8-753-100-65_ext.xml	UNSAT TT=5.441	UNSAT TT=21.26 CHECKS=61447000 NODES=82502	UNSAT TT=19.554 CHECKS=56734600 NODES=75877	UNSAT TT=7.517	UNSAT TT=133.324 CHECKS=112496000	UNSAT TT=88.527 CHECKS=88418700	UNSAT TT=22.128 ASSIGNMENTS=46716	UNSAT TT=22.081 ASSIGNMENTS=46716	UNSAT TT=30.498 CHECKS=3360850 NODES=58208	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=13.201 ASSIGNMENTS=49942 CHECKS=42034400	UNSAT TT=13.966 ASSIGNMENTS=49942 CHECKS=42034400	UNSAT TT=91.123	UNSAT TT=117.818	No data	UNSAT TT=5.441 ASSIGNMENTS=47660 CHECKS=39920100	UNSAT TT=5.759 ASSIGNMENTS=51545 CHECKS=42585900	UNSAT TT=209.192	UNSAT TT=6.171 ASSIGNMENTS=49973 CHECKS=41936200	UNSAT TT=6.17 ASSIGNMENTS=49942 CHECKS=42034400	UNSAT TT=864.002	UNSAT TT=49.351 ASSIGNMENTS=73994 CHECKS=104987000	UNSAT TT=47.75	UNSAT TT=154.142
csp/tightness0.1/ normalized-rand-2-40-8-753-100-6_ext.xml	UNSAT TT=4.675	UNSAT TT=17.77 CHECKS=46673500 NODES=61059	UNSAT TT=17.752 CHECKS=47518000 NODES=62059	UNSAT TT=6.9	UNSAT TT=131.167 CHECKS=107708000	UNSAT TT=86.789 CHECKS=85574600	UNSAT TT=14.56 ASSIGNMENTS=31054	UNSAT TT=14.156 ASSIGNMENTS=31054	UNSAT TT=21.537 CHECKS=2608290 NODES=43881	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=11.181 ASSIGNMENTS=36233 CHECKS=31505300	UNSAT TT=12.437 ASSIGNMENTS=36233 CHECKS=31505300	UNSAT TT=41.172	UNSAT TT=46.928	No data	UNSAT TT=4.738 ASSIGNMENTS=39760 CHECKS=35004900	UNSAT TT=4.719 ASSIGNMENTS=41711 CHECKS=35276600	UNSAT TT=158.921	UNSAT TT=4.74 ASSIGNMENTS=39150 CHECKS=34291800	UNSAT TT=4.675 ASSIGNMENTS=36233 CHECKS=31505300	UNSAT TT=690.018	UNSAT TT=43.938 ASSIGNMENTS=49511 CHECKS=72785900	UNSAT TT=38.89	UNSAT TT=110.877
csp/tightness0.1/ normalized-rand-2-40-8-753-100-72_ext.xml	UNSAT TT=4.469	UNSAT TT=15.341 CHECKS=39670200 NODES=51808	UNSAT TT=13.756 CHECKS=38692800 NODES=50397	UNSAT TT=5.36	UNSAT TT=117.425 CHECKS=107844000	UNSAT TT=78.843 CHECKS=80736100	UNSAT TT=14.671 ASSIGNMENTS=31763	UNSAT TT=15.962 ASSIGNMENTS=31763	UNSAT TT=20.894 CHECKS=2599930 NODES=43924	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=12.616 ASSIGNMENTS=39867 CHECKS=34908000	UNSAT TT=11.975 ASSIGNMENTS=39867 CHECKS=34908000	UNSAT TT=49.533	UNSAT TT=51.694	No data	UNSAT TT=4.478 ASSIGNMENTS=34835 CHECKS=30400600	UNSAT TT=5.199 ASSIGNMENTS=41457 CHECKS=35167400	UNSAT TT=118.188	UNSAT TT=4.469 ASSIGNMENTS=36754 CHECKS=32177000	UNSAT TT=5.105 ASSIGNMENTS=39867 CHECKS=34908000	UNSAT TT=507.101	UNSAT TT=45.862 ASSIGNMENTS=47769 CHECKS=70588300	UNSAT TT=22.01	UNSAT TT=69.967
csp/tightness0.1/ normalized-rand-2-40-8-753-100-77_ext.xml	SAT TT=0.326	SAT TT=1.37 CHECKS=933727 NODES=1421	SAT TT=1.234 CHECKS=261015 NODES=411	SAT TT=1.22	SAT TT=1.636 CHECKS=1344400	SAT TT=2.324 CHECKS=2179850	SAT TT=3.943 ASSIGNMENTS=7339	SAT TT=4.201 ASSIGNMENTS=7339	SAT TT=4.818 CHECKS=485414 NODES=8507	SAT TT=0.831 CHECKS=311614 NODES=961	SAT TT=1.852 CHECKS=8604390 NODES=9604	SAT TT=8.789 ASSIGNMENTS=14865 CHECKS=12282400	SAT TT=9.461 ASSIGNMENTS=14865 CHECKS=12282400	SAT TT=11.544	SAT TT=3.224	No data	SAT TT=0.857 ASSIGNMENTS=7262 CHECKS=5971150	SAT TT=2.232 ASSIGNMENTS=20682 CHECKS=15887400	SAT TT=60.654	SAT TT=0.326 ASSIGNMENTS=2625 CHECKS=2122540	SAT TT=1.789 ASSIGNMENTS=14865 CHECKS=12282400	SAT TT=152.334	SAT TT=1.09 ASSIGNMENTS=521 CHECKS=620777	SAT TT=3.231	SAT TT=3.196
csp/tightness0.1/ normalized-rand-2-40-8-753-100-78_ext.xml	UNSAT TT=3.519	UNSAT TT=12.203 CHECKS=31217900 NODES=39710	UNSAT TT=11.193 CHECKS=30959200 NODES=39265	UNSAT TT=4.527	UNSAT TT=108.685 CHECKS=96040300	UNSAT TT=77.302 CHECKS=77403000	UNSAT TT=10.635 ASSIGNMENTS=20651	UNSAT TT=10.937 ASSIGNMENTS=20651	UNSAT TT=17.5 CHECKS=2278370 NODES=37137	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=11.187 ASSIGNMENTS=29659 CHECKS=26388100	UNSAT TT=11.9 ASSIGNMENTS=29659 CHECKS=26388100	UNSAT TT=45.903	UNSAT TT=55.682	No data	UNSAT TT=3.556 ASSIGNMENTS=29732 CHECKS=26427600	UNSAT TT=3.519 ASSIGNMENTS=28381 CHECKS=24033800	UNSAT TT=113.643	UNSAT TT=3.744 ASSIGNMENTS=28573 CHECKS=25395000	UNSAT TT=3.848 ASSIGNMENTS=29659 CHECKS=26388100	UNSAT TT=261.12	UNSAT TT=30.507 ASSIGNMENTS=39976 CHECKS=62490300	UNSAT TT=19.124	UNSAT TT=76.231
csp/tightness0.1/ normalized-rand-2-40-8-753-100-82_ext.xml	UNSAT TT=5.271	UNSAT TT=22.45 CHECKS=59935200 NODES=80448	UNSAT TT=22.964 CHECKS=61231200 NODES=81900	UNSAT TT=9.224	UNSAT TT=138.177 CHECKS=112322000	UNSAT TT=85.508 CHECKS=84703500	UNSAT TT=23.225 ASSIGNMENTS=48513	UNSAT TT=22.56 ASSIGNMENTS=48513	UNSAT TT=30.76 CHECKS=3579240 NODES=62128	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=13.821 ASSIGNMENTS=49943 CHECKS=41827600	UNSAT TT=12.778 ASSIGNMENTS=49943 CHECKS=41827600	UNSAT TT=65.562	UNSAT TT=70.233	No data	UNSAT TT=5.502 ASSIGNMENTS=44332 CHECKS=37272200	UNSAT TT=5.271 ASSIGNMENTS=46952 CHECKS=38587800	UNSAT TT=167.027	UNSAT TT=6 ASSIGNMENTS=48371 CHECKS=40602600	UNSAT TT=6.124 ASSIGNMENTS=49943 CHECKS=41827600	UNSAT TT=580.146	UNSAT TT=48.007 ASSIGNMENTS=66809 CHECKS=94248800	UNSAT TT=30.82	UNSAT TT=109.196
csp/tightness0.1/ normalized-rand-2-40-8-753-100-83_ext.xml	UNSAT TT=4.554	UNSAT TT=19.951 CHECKS=52732400 NODES=70053	UNSAT TT=19.225 CHECKS=55640900 NODES=73980	UNSAT TT=8.129	UNSAT TT=113.918 CHECKS=97439700	UNSAT TT=83.874 CHECKS=84936100	UNSAT TT=14.588 ASSIGNMENTS=32501	UNSAT TT=14.488 ASSIGNMENTS=32501	UNSAT TT=21.246 CHECKS=2529280 NODES=43372	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=13.151 ASSIGNMENTS=45401 CHECKS=39504000	UNSAT TT=12.327 ASSIGNMENTS=45401 CHECKS=39504000	UNSAT TT=55.66	UNSAT TT=57.261	No data	UNSAT TT=5.079 ASSIGNMENTS=40509 CHECKS=34873300	UNSAT TT=5.045 ASSIGNMENTS=41348 CHECKS=34602300	UNSAT TT=134.149	UNSAT TT=4.554 ASSIGNMENTS=38989 CHECKS=33407100	UNSAT TT=5.36 ASSIGNMENTS=45401 CHECKS=39504000	UNSAT TT=689.342	UNSAT TT=49.034 ASSIGNMENTS=58575 CHECKS=84318300	UNSAT TT=21.573	UNSAT TT=99.914
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.1/ normalized-rand-2-40-8-753-100-94_ext.xml	UNSAT TT=4.067	UNSAT TT=17.128 CHECKS=44537200 NODES=59512	UNSAT TT=15.942 CHECKS=45046000 NODES=60088	UNSAT TT=6.9	UNSAT TT=113.346 CHECKS=95060500	UNSAT TT=82.367 CHECKS=84345000	UNSAT TT=13.942 ASSIGNMENTS=30585	UNSAT TT=13.803 ASSIGNMENTS=30585	UNSAT TT=18.947 CHECKS=2434540 NODES=41103	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=11.249 ASSIGNMENTS=38114 CHECKS=32542900	UNSAT TT=12.603 ASSIGNMENTS=38114 CHECKS=32542900	UNSAT TT=49.324	UNSAT TT=67.783	No data	UNSAT TT=4.582 ASSIGNMENTS=36068 CHECKS=31049700	UNSAT TT=4.067 ASSIGNMENTS=35704 CHECKS=29618900	UNSAT TT=145.651	UNSAT TT=4.42 ASSIGNMENTS=34341 CHECKS=29580500	UNSAT TT=4.782 ASSIGNMENTS=38114 CHECKS=32542900	UNSAT TT=424.975	UNSAT TT=43.931 ASSIGNMENTS=52106 CHECKS=75092500	UNSAT TT=17.927	UNSAT TT=50.488
csp/tightness0.2/ normalized-rand-2-40-11-414-200-10_ext.xml	SAT TT=1.335	SAT TT=12.673 CHECKS=45884900 NODES=55001	SAT TT=12.941 CHECKS=46025500 NODES=55435	SAT TT=5.08	SAT TT=199.117 CHECKS=106847000	SAT TT=85.589 CHECKS=52501200	SAT TT=7.204 ASSIGNMENTS=13374	SAT TT=7.969 ASSIGNMENTS=13374	SAT TT=38.118 CHECKS=8037150 NODES=111501	SAT TT=1.335 CHECKS=4236290 NODES=18514	? (TO) TT=1800.08	SAT TT=9.883 ASSIGNMENTS=31044 CHECKS=16419300	SAT TT=10.14 ASSIGNMENTS=31044 CHECKS=16419300	SAT TT=8.786	SAT TT=33.544	No data	SAT TT=11.204 ASSIGNMENTS=109013 CHECKS=56988000	SAT TT=8.099 ASSIGNMENTS=77915 CHECKS=39905900	SAT TT=128.786	SAT TT=9.97 ASSIGNMENTS=94750 CHECKS=49665500	SAT TT=3.289 ASSIGNMENTS=31044 CHECKS=16419300	SAT TT=366.018	SAT TT=79.024 ASSIGNMENTS=86445 CHECKS=98478400	SAT TT=47.2	SAT TT=87.588
csp/tightness0.2/ normalized-rand-2-40-11-414-200-11_ext.xml	UNSAT TT=5.81	UNSAT TT=21.161 CHECKS=82398100 NODES=87241	UNSAT TT=20.306 CHECKS=83544300 NODES=88515	UNSAT TT=6.489	UNSAT TT=189.943 CHECKS=90907500	UNSAT TT=96.817 CHECKS=61060500	UNSAT TT=22.571 ASSIGNMENTS=41032	UNSAT TT=23.47 ASSIGNMENTS=41032	UNSAT TT=24.333 CHECKS=5460600 NODES=69751	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=13.813 ASSIGNMENTS=58160 CHECKS=32306500	UNSAT TT=13.136 ASSIGNMENTS=58160 CHECKS=32306500	UNSAT TT=89.777	UNSAT TT=164.961	No data	UNSAT TT=5.826 ASSIGNMENTS=57045 CHECKS=31577300	UNSAT TT=5.81 ASSIGNMENTS=58119 CHECKS=31399700	UNSAT TT=123.322	UNSAT TT=6.259 ASSIGNMENTS=56784 CHECKS=31331100	UNSAT TT=6.121 ASSIGNMENTS=58160 CHECKS=32306500	UNSAT TT=576.598	UNSAT TT=84.763 ASSIGNMENTS=88016 CHECKS=117872000	UNSAT TT=42.781	UNSAT TT=132.127
csp/tightness0.2/ normalized-rand-2-40-11-414-200-15_ext.xml	SAT TT=1.357	SAT TT=13.573 CHECKS=54300600 NODES=62324	SAT TT=15.051 CHECKS=55907600 NODES=63510	SAT TT=2.846	SAT TT=139.175 CHECKS=67663900	SAT TT=70.99 CHECKS=44138000	SAT TT=10.21 ASSIGNMENTS=18190	SAT TT=10.022 ASSIGNMENTS=18190	SAT TT=21.987 CHECKS=4615940 NODES=62433	SAT TT=2.397 CHECKS=12245800 NODES=53966	? (TO) TT=1800.08	SAT TT=13.635 ASSIGNMENTS=57402 CHECKS=30813600	SAT TT=13.737 ASSIGNMENTS=57402 CHECKS=30813600	SAT TT=80.32	SAT TT=6.383	No data	SAT TT=5.056 ASSIGNMENTS=51361 CHECKS=27660100	SAT TT=1.357 ASSIGNMENTS=13805 CHECKS=6693430	SAT TT=20.457	SAT TT=7.145 ASSIGNMENTS=65963 CHECKS=35584100	SAT TT=6.151 ASSIGNMENTS=57402 CHECKS=30813600	SAT TT=101.758	SAT TT=16.573 ASSIGNMENTS=12467 CHECKS=16102800	SAT TT=79.317	SAT TT=130.384
csp/tightness0.2/ normalized-rand-2-40-11-414-200-20_ext.xml	SAT TT=0.826	SAT TT=17.47 CHECKS=66234400 NODES=70882	SAT TT=16.764 CHECKS=68671800 NODES=72887	SAT TT=2.317	SAT TT=93.852 CHECKS=44421600	SAT TT=24.665 CHECKS=15656300	SAT TT=8.924 ASSIGNMENTS=15468	SAT TT=9.461 ASSIGNMENTS=15468	SAT TT=17.94 CHECKS=4165740 NODES=54381	SAT TT=10.95 CHECKS=70629000 NODES=310749	SAT TT=0.996 CHECKS=1303460 NODES=2918	SAT TT=11.414 ASSIGNMENTS=34943 CHECKS=19283000	SAT TT=11.278 ASSIGNMENTS=34943 CHECKS=19283000	SAT TT=37.067	SAT TT=56.59	No data	SAT TT=0.826 ASSIGNMENTS=7812 CHECKS=4366210	SAT TT=3.363 ASSIGNMENTS=30934 CHECKS=16263400	SAT TT=109.226	SAT TT=4.372 ASSIGNMENTS=43356 CHECKS=23857100	SAT TT=3.802 ASSIGNMENTS=34943 CHECKS=19283000	SAT TT=112.755	SAT TT=48.682 ASSIGNMENTS=50485 CHECKS=65520400	SAT TT=11.558	SAT TT=2.991
csp/tightness0.2/ normalized-rand-2-40-11-414-200-23_ext.xml	SAT TT=0.515	SAT TT=1.292 CHECKS=697289 NODES=951	SAT TT=1.503 CHECKS=1943940 NODES=2422	SAT TT=0.751	SAT TT=97.075 CHECKS=50286100	SAT TT=11.879 CHECKS=7494820	SAT TT=2.45 ASSIGNMENTS=3259	SAT TT=2.4 ASSIGNMENTS=3259	SAT TT=5.776 CHECKS=1116240 NODES=15028	SAT TT=1.166 CHECKS=3736110 NODES=16333	SAT TT=1.108 CHECKS=3663330 NODES=6647	SAT TT=0.55 ASSIGNMENTS=4821 CHECKS=2524320	SAT TT=0.515 ASSIGNMENTS=4821 CHECKS=2524320	SAT TT=7.794	SAT TT=3.77	No data	SAT TT=0.523 ASSIGNMENTS=4787 CHECKS=2474680	SAT TT=0.815 ASSIGNMENTS=8688 CHECKS=3895810	SAT TT=2.903	SAT TT=0.663 ASSIGNMENTS=6233 CHECKS=3193240	SAT TT=0.531 ASSIGNMENTS=4821 CHECKS=2524320	SAT TT=310.957	SAT TT=68.463 ASSIGNMENTS=46465 CHECKS=55873900	SAT TT=54.831	SAT TT=18.608
csp/tightness0.2/ normalized-rand-2-40-11-414-200-27_ext.xml	SAT TT=0.706	SAT TT=1.077 CHECKS=575397 NODES=705	SAT TT=0.973 CHECKS=202579 NODES=231	SAT TT=2.331	SAT TT=113.902 CHECKS=53754300	SAT TT=21.675 CHECKS=12933200	SAT TT=7.217 ASSIGNMENTS=12072	SAT TT=7.237 ASSIGNMENTS=12072	SAT TT=8.959 CHECKS=1844420 NODES=23571	SAT TT=1.68 CHECKS=6396050 NODES=27814	? (TO) TT=1800	SAT TT=11.267 ASSIGNMENTS=37778 CHECKS=20967100	SAT TT=11.796 ASSIGNMENTS=37778 CHECKS=20967100	SAT TT=5.598	SAT TT=16.196	No data	SAT TT=3.364 ASSIGNMENTS=30426 CHECKS=16717900	SAT TT=0.706 ASSIGNMENTS=8097 CHECKS=3654930	SAT TT=36.43	SAT TT=2.205 ASSIGNMENTS=21463 CHECKS=11744700	SAT TT=4 ASSIGNMENTS=37778 CHECKS=20967100	SAT TT=15.486	SAT TT=40.645 ASSIGNMENTS=41373 CHECKS=54075500	SAT TT=5.765	SAT TT=2.785
csp/tightness0.2/ normalized-rand-2-40-11-414-200-30_ext.xml	SAT TT=0.779	SAT TT=8.947 CHECKS=33146200 NODES=37515	SAT TT=9.612 CHECKS=33935300 NODES=38900	SAT TT=2.627	SAT TT=3.762 CHECKS=1990720	SAT TT=2.969 CHECKS=1866630	SAT TT=20.001 ASSIGNMENTS=38835	SAT TT=22.339 ASSIGNMENTS=38835	SAT TT=25.802 CHECKS=5520610 NODES=72829	SAT TT=0.779 CHECKS=808131 NODES=3448	? (TO) TT=1800.08	SAT TT=12.772 ASSIGNMENTS=58819 CHECKS=32059800	SAT TT=13.781 ASSIGNMENTS=58819 CHECKS=32059800	SAT TT=133.818	SAT TT=98.712	No data	SAT TT=6.45 ASSIGNMENTS=64578 CHECKS=35185200	SAT TT=2.18 ASSIGNMENTS=22063 CHECKS=11012100	SAT TT=126.248	SAT TT=7.255 ASSIGNMENTS=66234 CHECKS=35993800	SAT TT=6.339 ASSIGNMENTS=58819 CHECKS=32059800	SAT TT=235.204	SAT TT=46.589 ASSIGNMENTS=59445 CHECKS=71267200	SAT TT=47.482	SAT TT=108.88
csp/tightness0.2/ normalized-rand-2-40-11-414-200-32_ext.xml	SAT TT=1.552	SAT TT=16.122 CHECKS=63555600 NODES=76481	SAT TT=17.825 CHECKS=66778900 NODES=79808	SAT TT=6.252	SAT TT=16.958 CHECKS=8667890	SAT TT=17.036 CHECKS=10526600	SAT TT=19.908 ASSIGNMENTS=40744	SAT TT=21.665 ASSIGNMENTS=40744	SAT TT=17.024 CHECKS=3454960 NODES=47888	SAT TT=2.26 CHECKS=10021700 NODES=43838	? (TO) TT=1800.08	SAT TT=13.251 ASSIGNMENTS=54159 CHECKS=28163600	SAT TT=12.613 ASSIGNMENTS=54159 CHECKS=28163600	SAT TT=3.075	SAT TT=7.973	No data	SAT TT=5.396 ASSIGNMENTS=51682 CHECKS=26987700	SAT TT=1.552 ASSIGNMENTS=15627 CHECKS=7348760	SAT TT=44.834	SAT TT=4.627 ASSIGNMENTS=44613 CHECKS=22981600	SAT TT=5.565 ASSIGNMENTS=54159 CHECKS=28163600	SAT TT=105.554	SAT TT=22.231 ASSIGNMENTS=29265 CHECKS=32971500	SAT TT=3.712	SAT TT=11.935
csp/tightness0.2/ normalized-rand-2-40-11-414-200-54_ext.xml	SAT TT=4.077	SAT TT=19.597 CHECKS=79415700 NODES=88625	SAT TT=21.073 CHECKS=79353100 NODES=88900	SAT TT=7.702	SAT TT=200.04 CHECKS=98505800	SAT TT=75.883 CHECKS=46209600	SAT TT=30.094 ASSIGNMENTS=56237	SAT TT=30.031 ASSIGNMENTS=56237	SAT TT=31.078 CHECKS=6501710 NODES=87470	SAT TT=4.077 CHECKS=20559200 NODES=90495	? (TO) TT=1800.07	SAT TT=16.071 ASSIGNMENTS=81404 CHECKS=43664400	SAT TT=16.147 ASSIGNMENTS=81404 CHECKS=43664400	SAT TT=85.88	SAT TT=133.72	No data	SAT TT=9.026 ASSIGNMENTS=84632 CHECKS=45520700	SAT TT=8.803 ASSIGNMENTS=84446 CHECKS=44620000	SAT TT=222.283	SAT TT=8.811 ASSIGNMENTS=82253 CHECKS=44056100	SAT TT=8.721 ASSIGNMENTS=81404 CHECKS=43664400	SAT TT=439.944	SAT TT=93.709 ASSIGNMENTS=139766 CHECKS=176841000	SAT TT=64.083	SAT TT=116.789
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.2/ normalized-rand-2-40-11-414-200-57_ext.xml	SAT TT=0.649	SAT TT=17.468 CHECKS=63830500 NODES=72951	SAT TT=17.125 CHECKS=63390400 NODES=72268	SAT TT=0.808	SAT TT=141.101 CHECKS=69825800	SAT TT=74.759 CHECKS=48406800	SAT TT=3.004 ASSIGNMENTS=3662	SAT TT=2.604 ASSIGNMENTS=3662	SAT TT=37.598 CHECKS=8692410 NODES=118036	SAT TT=9.392 CHECKS=59987100 NODES=262731	? (TO) TT=1800.08	SAT TT=0.691 ASSIGNMENTS=5842 CHECKS=3137790	SAT TT=0.673 ASSIGNMENTS=5842 CHECKS=3137790	SAT TT=11.144	SAT TT=12.056	No data	SAT TT=0.734 ASSIGNMENTS=6637 CHECKS=3533550	SAT TT=3.804 ASSIGNMENTS=37212 CHECKS=19194800	SAT TT=13.446	SAT TT=9.381 ASSIGNMENTS=88965 CHECKS=47037100	SAT TT=0.649 ASSIGNMENTS=5842 CHECKS=3137790	SAT TT=126.891	SAT TT=19.332 ASSIGNMENTS=17512 CHECKS=21261500	SAT TT=5.733	SAT TT=49.283
csp/tightness0.2/ normalized-rand-2-40-11-414-200-6_ext.xml	SAT TT=1.019	SAT TT=23.722 CHECKS=98831400 NODES=104001	SAT TT=24.725 CHECKS=95058400 NODES=100263	SAT TT=4.92	SAT TT=162.858 CHECKS=74463900	SAT TT=25.275 CHECKS=14577800	SAT TT=18.459 ASSIGNMENTS=35711	SAT TT=20.256 ASSIGNMENTS=35711	SAT TT=17.245 CHECKS=3665850 NODES=46911	SAT TT=1.019 CHECKS=2601270 NODES=11412	? (TO) TT=1800.08	SAT TT=11.087 ASSIGNMENTS=33576 CHECKS=18513800	SAT TT=11.207 ASSIGNMENTS=33576 CHECKS=18513800	SAT TT=45.045	SAT TT=123.682	No data	SAT TT=6.096 ASSIGNMENTS=56615 CHECKS=31136500	SAT TT=3.81 ASSIGNMENTS=39211 CHECKS=20730400	SAT TT=113.115	SAT TT=2.134 ASSIGNMENTS=18678 CHECKS=10334500	SAT TT=3.66 ASSIGNMENTS=33576 CHECKS=18513800	SAT TT=489.865	SAT TT=33.257 ASSIGNMENTS=10728 CHECKS=14347700	SAT TT=3.199	SAT TT=9.352
csp/tightness0.2/ normalized-rand-2-40-11-414-200-71_ext.xml	SAT TT=2.33	SAT TT=12.254 CHECKS=44541800 NODES=50801	SAT TT=12.645 CHECKS=45699500 NODES=52008	SAT TT=5.991	SAT TT=96.899 CHECKS=45866000	SAT TT=75.768 CHECKS=48993900	SAT TT=20.01 ASSIGNMENTS=39269	SAT TT=22.129 ASSIGNMENTS=39269	SAT TT=34.012 CHECKS=7566420 NODES=100509	SAT TT=18.387 CHECKS=113190000 NODES=496730	? (TO) TT=1800.09	SAT TT=13.254 ASSIGNMENTS=62470 CHECKS=33931800	SAT TT=14.239 ASSIGNMENTS=62470 CHECKS=33931800	SAT TT=90.921	SAT TT=22.505	No data	SAT TT=6.554 ASSIGNMENTS=60847 CHECKS=33209100	SAT TT=2.33 ASSIGNMENTS=24753 CHECKS=12501400	SAT TT=252.57	SAT TT=8.374 ASSIGNMENTS=83006 CHECKS=44991400	SAT TT=6.779 ASSIGNMENTS=62470 CHECKS=33931800	SAT TT=614.04	SAT TT=52.851 ASSIGNMENTS=72360 CHECKS=88328500	SAT TT=50.045	SAT TT=26.859
csp/tightness0.2/ normalized-rand-2-40-11-414-200-76_ext.xml	UNSAT TT=7.452	UNSAT TT=31.281 CHECKS=121877000 NODES=132526	UNSAT TT=29.346 CHECKS=123009000 NODES=133243	UNSAT TT=8.456	UNSAT TT=212.981 CHECKS=100342000	UNSAT TT=119.067 CHECKS=69161000	UNSAT TT=29.351 ASSIGNMENTS=53891	UNSAT TT=26.943 ASSIGNMENTS=53891	UNSAT TT=35.126 CHECKS=7541860 NODES=96257	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=16.065 ASSIGNMENTS=74618 CHECKS=41395000	UNSAT TT=15.618 ASSIGNMENTS=74618 CHECKS=41395000	UNSAT TT=131.321	UNSAT TT=172.36	No data	UNSAT TT=8.189 ASSIGNMENTS=79674 CHECKS=44272500	UNSAT TT=7.452 ASSIGNMENTS=69214 CHECKS=37410600	UNSAT TT=161.757	UNSAT TT=8.367 ASSIGNMENTS=74830 CHECKS=41480300	UNSAT TT=7.594 ASSIGNMENTS=74618 CHECKS=41395000	UNSAT TT=998.02	UNSAT TT=98.186 ASSIGNMENTS=113396 CHECKS=148447000	UNSAT TT=64.731	UNSAT TT=194.528
csp/tightness0.2/ normalized-rand-2-40-11-414-200-84_ext.xml	SAT TT=1.359	SAT TT=9.968 CHECKS=38396900 NODES=43025	SAT TT=10.643 CHECKS=37562100 NODES=42184	SAT TT=2.262	SAT TT=19.525 CHECKS=9756160	SAT TT=18.785 CHECKS=11608700	SAT TT=7.508 ASSIGNMENTS=13093	SAT TT=7.015 ASSIGNMENTS=13093	SAT TT=21.338 CHECKS=4514630 NODES=60257	SAT TT=1.359 CHECKS=4991240 NODES=21967	? (TO) TT=1800.02	SAT TT=14.222 ASSIGNMENTS=61706 CHECKS=33066100	SAT TT=14.181 ASSIGNMENTS=61706 CHECKS=33066100	SAT TT=18.474	SAT TT=2.126	No data	SAT TT=5.191 ASSIGNMENTS=47439 CHECKS=24895900	SAT TT=3.674 ASSIGNMENTS=36213 CHECKS=18263800	SAT TT=88.899	SAT TT=1.909 ASSIGNMENTS=18415 CHECKS=9441660	SAT TT=6.745 ASSIGNMENTS=61706 CHECKS=33066100	SAT TT=125.734	SAT TT=21.204 ASSIGNMENTS=25142 CHECKS=27969000	SAT TT=2.21	SAT TT=5.315
csp/tightness0.2/ normalized-rand-2-40-11-414-200-85_ext.xml	SAT TT=0.664	SAT TT=7.344 CHECKS=26939700 NODES=30464	SAT TT=6.187 CHECKS=19317700 NODES=21896	SAT TT=4.307	SAT TT=37.061 CHECKS=18986000	SAT TT=6.071 CHECKS=3522100	SAT TT=17.423 ASSIGNMENTS=31800	SAT TT=17.559 ASSIGNMENTS=31800	SAT TT=5.23 CHECKS=1088760 NODES=14344	SAT TT=0.701 CHECKS=608275 NODES=2606	? (TO) TT=1800.06	SAT TT=0.674 ASSIGNMENTS=6270 CHECKS=3402800	SAT TT=0.664 ASSIGNMENTS=6270 CHECKS=3402800	SAT TT=4.367	SAT TT=20.946	No data	SAT TT=0.84 ASSIGNMENTS=7548 CHECKS=4187880	SAT TT=1.232 ASSIGNMENTS=12631 CHECKS=6112840	SAT TT=11.531	SAT TT=1.03 ASSIGNMENTS=9376 CHECKS=4900020	SAT TT=0.731 ASSIGNMENTS=6270 CHECKS=3402800	SAT TT=20.324	SAT TT=32.748 ASSIGNMENTS=19091 CHECKS=22519600	SAT TT=22.161	SAT TT=41.214
csp/tightness0.35/ normalized-rand-2-40-16-250-350-10_ext.xml	UNSAT TT=4.926	UNSAT TT=19.814 CHECKS=98960300 NODES=83547	UNSAT TT=19.252 CHECKS=96822600 NODES=82085	UNSAT TT=7.138	UNSAT TT=232.077 CHECKS=71037500	UNSAT TT=126.121 CHECKS=34182600	UNSAT TT=20.291 ASSIGNMENTS=28284	UNSAT TT=22.259 ASSIGNMENTS=28284	UNSAT TT=17.478 CHECKS=6773150 NODES=57331	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=13.098 ASSIGNMENTS=49080 CHECKS=19683800	UNSAT TT=12.801 ASSIGNMENTS=49080 CHECKS=19683800	UNSAT TT=56.429	UNSAT TT=278.284	No data	UNSAT TT=6.115 ASSIGNMENTS=57163 CHECKS=23350900	UNSAT TT=4.926 ASSIGNMENTS=51354 CHECKS=20282900	UNSAT TT=92.341	UNSAT TT=5.58 ASSIGNMENTS=52746 CHECKS=21185500	UNSAT TT=5.029 ASSIGNMENTS=49080 CHECKS=19683800	UNSAT TT=465.955	UNSAT TT=71.29 ASSIGNMENTS=81679 CHECKS=137294000	UNSAT TT=52.511	UNSAT TT=89.069
csp/tightness0.35/ normalized-rand-2-40-16-250-350-11_ext.xml	UNSAT TT=8.84	UNSAT TT=23.514 CHECKS=116782000 NODES=106386	UNSAT TT=22.892 CHECKS=115100000 NODES=104583	UNSAT TT=15.202	UNSAT TT=492.308 CHECKS=145087000	UNSAT TT=178.588 CHECKS=51171600	UNSAT TT=36.949 ASSIGNMENTS=52952	UNSAT TT=34.343 ASSIGNMENTS=52952	UNSAT TT=28.159 CHECKS=11845100 NODES=102097	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=16.869 ASSIGNMENTS=87553 CHECKS=35799000	UNSAT TT=16.686 ASSIGNMENTS=87553 CHECKS=35799000	UNSAT TT=179.181	UNSAT TT=459.885	No data	UNSAT TT=9.478 ASSIGNMENTS=92081 CHECKS=37428300	UNSAT TT=8.84 ASSIGNMENTS=86664 CHECKS=34724300	UNSAT TT=177.288	UNSAT TT=9.629 ASSIGNMENTS=91937 CHECKS=37159200	UNSAT TT=9.142 ASSIGNMENTS=87553 CHECKS=35799000	UNSAT TT=1384.29	UNSAT TT=129.149 ASSIGNMENTS=126745 CHECKS=201868000	UNSAT TT=122.224	UNSAT TT=332.342
csp/tightness0.35/ normalized-rand-2-40-16-250-350-22_ext.xml	SAT TT=0.185	SAT TT=1.158 CHECKS=1230090 NODES=1226	SAT TT=1.519 CHECKS=2462380 NODES=2464	SAT TT=4.975	SAT TT=261.846 CHECKS=89181800	SAT TT=85.042 CHECKS=24187800	SAT TT=5.618 ASSIGNMENTS=6914	SAT TT=5.241 ASSIGNMENTS=6914	SAT TT=3.802 CHECKS=1281850 NODES=12180	SAT TT=1.492 CHECKS=6031510 NODES=30365	? (TO) TT=1800	SAT TT=10.892 ASSIGNMENTS=42426 CHECKS=15985900	SAT TT=10.856 ASSIGNMENTS=42426 CHECKS=15985900	SAT TT=88.548	SAT TT=54.26	No data	SAT TT=1.689 ASSIGNMENTS=17124 CHECKS=6451090	SAT TT=3.658 ASSIGNMENTS=41609 CHECKS=15195200	SAT TT=171.872	SAT TT=0.185 ASSIGNMENTS=1770 CHECKS=576901	SAT TT=4.067 ASSIGNMENTS=42426 CHECKS=15985900	SAT TT=239.7	SAT TT=14.2 ASSIGNMENTS=16827 CHECKS=23380900	SAT TT=7.371	SAT TT=3.334
csp/tightness0.35/ normalized-rand-2-40-16-250-350-27_ext.xml	UNSAT TT=9.558	UNSAT TT=49.733 CHECKS=247559000 NODES=227760	UNSAT TT=44.68 CHECKS=239644000 NODES=221850	UNSAT TT=16.211	UNSAT TT=261.555 CHECKS=79730200	UNSAT TT=200.025 CHECKS=55288200	UNSAT TT=42.467 ASSIGNMENTS=60279	UNSAT TT=41.842 ASSIGNMENTS=60279	UNSAT TT=32.235 CHECKS=11991600 NODES=107919	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=17.201 ASSIGNMENTS=107884 CHECKS=42576600	UNSAT TT=18.878 ASSIGNMENTS=107884 CHECKS=42576600	UNSAT TT=221.736	UNSAT TT=496.352	No data	UNSAT TT=10.391 ASSIGNMENTS=108207 CHECKS=43101900	UNSAT TT=9.875 ASSIGNMENTS=98479 CHECKS=38283700	UNSAT TT=170.603	UNSAT TT=9.558 ASSIGNMENTS=94678 CHECKS=37169200	UNSAT TT=10.225 ASSIGNMENTS=107884 CHECKS=42576600	? (TO) TT=1800.15	UNSAT TT=131.073 ASSIGNMENTS=143832 CHECKS=217699000	UNSAT TT=107.513	UNSAT TT=352.225
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.35/ normalized-rand-2-40-16-250-350-2_ext.xml	UNSAT TT=10.17	UNSAT TT=28.436 CHECKS=150810000 NODES=141390	UNSAT TT=29.739 CHECKS=147848000 NODES=138677	UNSAT TT=16.932	UNSAT TT=276.787 CHECKS=82391400	UNSAT TT=191.468 CHECKS=56244400	UNSAT TT=44.411 ASSIGNMENTS=63359	UNSAT TT=44.221 ASSIGNMENTS=63359	UNSAT TT=33.779 CHECKS=14026900 NODES=124331	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=18.401 ASSIGNMENTS=105816 CHECKS=41683600	UNSAT TT=18.635 ASSIGNMENTS=105816 CHECKS=41683600	UNSAT TT=438.57	UNSAT TT=731.47	No data	UNSAT TT=11.896 ASSIGNMENTS=114937 CHECKS=45715700	UNSAT TT=11.572 ASSIGNMENTS=115255 CHECKS=44457100	UNSAT TT=261.35	UNSAT TT=10.816 ASSIGNMENTS=112877 CHECKS=44096700	UNSAT TT=10.17 ASSIGNMENTS=105816 CHECKS=41683600	? (TO) TT=1800.14	UNSAT TT=130.079 ASSIGNMENTS=157392 CHECKS=245774000	UNSAT TT=165.608	UNSAT TT=452.974
csp/tightness0.35/ normalized-rand-2-40-16-250-350-32_ext.xml	SAT TT=1.724	SAT TT=8.759 CHECKS=40779100 NODES=38798	SAT TT=10.425 CHECKS=50713100 NODES=49552	SAT TT=3.97	SAT TT=590.888 CHECKS=200298000	SAT TT=87.084 CHECKS=25666000	SAT TT=15.179 ASSIGNMENTS=20970	SAT TT=14.306 ASSIGNMENTS=20970	SAT TT=7.025 CHECKS=2678480 NODES=24647	SAT TT=2.417 CHECKS=11457600 NODES=57860	? (TO) TT=1800.05	SAT TT=13.378 ASSIGNMENTS=57868 CHECKS=22186900	SAT TT=13.239 ASSIGNMENTS=57868 CHECKS=22186900	SAT TT=9.099	SAT TT=84.621	No data	SAT TT=3.66 ASSIGNMENTS=39241 CHECKS=15158700	SAT TT=1.995 ASSIGNMENTS=21671 CHECKS=7673360	SAT TT=12.952	SAT TT=1.724 ASSIGNMENTS=18450 CHECKS=6834510	SAT TT=5.449 ASSIGNMENTS=57868 CHECKS=22186900	SAT TT=183.109	SAT TT=14.013 ASSIGNMENTS=15345 CHECKS=20080000	SAT TT=14.895	SAT TT=40.845
csp/tightness0.35/ normalized-rand-2-40-16-250-350-40_ext.xml	UNSAT TT=7.285	UNSAT TT=32.884 CHECKS=148983000 NODES=132460	UNSAT TT=29.6 CHECKS=148105000 NODES=131334	UNSAT TT=15.448	UNSAT TT=240.54 CHECKS=75354400	UNSAT TT=184.649 CHECKS=50218900	UNSAT TT=35.963 ASSIGNMENTS=54703	UNSAT TT=35.641 ASSIGNMENTS=54703	UNSAT TT=24.159 CHECKS=10151500 NODES=89268	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=16.279 ASSIGNMENTS=96977 CHECKS=38521800	UNSAT TT=17.949 ASSIGNMENTS=96977 CHECKS=38521800	UNSAT TT=205.608	UNSAT TT=581.185	No data	UNSAT TT=9.375 ASSIGNMENTS=97140 CHECKS=38665900	UNSAT TT=9.792 ASSIGNMENTS=95720 CHECKS=37609600	UNSAT TT=155.985	UNSAT TT=7.285 ASSIGNMENTS=76113 CHECKS=30098400	UNSAT TT=10.003 ASSIGNMENTS=96977 CHECKS=38521800	UNSAT TT=1293.86	UNSAT TT=126.999 ASSIGNMENTS=124000 CHECKS=194207000	UNSAT TT=136.817	UNSAT TT=330.196
csp/tightness0.35/ normalized-rand-2-40-16-250-350-53_ext.xml	UNSAT TT=16.006	UNSAT TT=69.716 CHECKS=373919000 NODES=354527	UNSAT TT=75.712 CHECKS=378104000 NODES=358747	UNSAT TT=22.365	UNSAT TT=1036.61 CHECKS=342167000	UNSAT TT=296.073 CHECKS=84568500	UNSAT TT=70.417 ASSIGNMENTS=109780	UNSAT TT=64.392 ASSIGNMENTS=109780	UNSAT TT=52.834 CHECKS=20499100 NODES=186797	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=23.795 ASSIGNMENTS=172849 CHECKS=68487600	UNSAT TT=25.105 ASSIGNMENTS=172849 CHECKS=68487600	UNSAT TT=622.143	UNSAT TT=1238.71	No data	UNSAT TT=18.579 ASSIGNMENTS=182024 CHECKS=72550500	UNSAT TT=16.535 ASSIGNMENTS=162947 CHECKS=64006100	UNSAT TT=374.462	UNSAT TT=16.006 ASSIGNMENTS=156891 CHECKS=61725800	UNSAT TT=17.598 ASSIGNMENTS=172849 CHECKS=68487600	? (TO) TT=1800.16	UNSAT TT=232.708 ASSIGNMENTS=247548 CHECKS=353321000	UNSAT TT=221.912	UNSAT TT=761.304
csp/tightness0.35/ normalized-rand-2-40-16-250-350-55_ext.xml	UNSAT TT=6.08	UNSAT TT=21.062 CHECKS=112365000 NODES=99419	UNSAT TT=22.39 CHECKS=112169000 NODES=99445	UNSAT TT=9.092	UNSAT TT=210.022 CHECKS=61191100	UNSAT TT=334.239 CHECKS=94736900	UNSAT TT=25.521 ASSIGNMENTS=36866	UNSAT TT=24.873 ASSIGNMENTS=36866	UNSAT TT=19.726 CHECKS=7595620 NODES=67522	? (TO) TT=1800	? (TO) TT=1800.08	UNSAT TT=13.327 ASSIGNMENTS=65564 CHECKS=26233000	UNSAT TT=14.607 ASSIGNMENTS=65564 CHECKS=26233000	UNSAT TT=83.332	UNSAT TT=252.883	No data	UNSAT TT=6.336 ASSIGNMENTS=61060 CHECKS=24315500	UNSAT TT=6.082 ASSIGNMENTS=63774 CHECKS=24601700	UNSAT TT=103.546	UNSAT TT=6.08 ASSIGNMENTS=61979 CHECKS=24707000	UNSAT TT=6.742 ASSIGNMENTS=65564 CHECKS=26233000	UNSAT TT=838.688	UNSAT TT=121.013 ASSIGNMENTS=110865 CHECKS=175180000	UNSAT TT=72.001	UNSAT TT=156.595
csp/tightness0.35/ normalized-rand-2-40-16-250-350-64_ext.xml	SAT TT=3.135	SAT TT=14.875 CHECKS=71699600 NODES=63505	SAT TT=14.341 CHECKS=74925500 NODES=65404	SAT TT=3.135	SAT TT=104.793 CHECKS=29578700	SAT TT=99.121 CHECKS=26818100	SAT TT=8.765 ASSIGNMENTS=10046	SAT TT=8.646 ASSIGNMENTS=10046	SAT TT=10.695 CHECKS=4367420 NODES=36422	SAT TT=6.723 CHECKS=42584000 NODES=215270	? (TO) TT=1800.08	SAT TT=11.032 ASSIGNMENTS=33744 CHECKS=13737600	SAT TT=11.422 ASSIGNMENTS=33744 CHECKS=13737600	SAT TT=44.122	SAT TT=156.017	No data	SAT TT=3.192 ASSIGNMENTS=32395 CHECKS=13039100	SAT TT=4.212 ASSIGNMENTS=40363 CHECKS=15709600	SAT TT=18.865	SAT TT=3.866 ASSIGNMENTS=38548 CHECKS=15488800	SAT TT=3.394 ASSIGNMENTS=33744 CHECKS=13737600	SAT TT=70.148	SAT TT=47.813 ASSIGNMENTS=30534 CHECKS=51608300	SAT TT=30.288	SAT TT=61.678
csp/tightness0.35/ normalized-rand-2-40-16-250-350-72_ext.xml	SAT TT=0.596	SAT TT=10.944 CHECKS=50366800 NODES=47006	SAT TT=10.363 CHECKS=52387200 NODES=48941	SAT TT=3.887	SAT TT=10.592 CHECKS=3399620	SAT TT=11.77 CHECKS=3365360	SAT TT=3.677 ASSIGNMENTS=3711	SAT TT=3.366 ASSIGNMENTS=3711	SAT TT=10.531 CHECKS=4085900 NODES=36646	SAT TT=4.547 CHECKS=25798600 NODES=129759	? (TO) TT=1800.03	SAT TT=1.45 ASSIGNMENTS=13485 CHECKS=5337640	SAT TT=1.465 ASSIGNMENTS=13485 CHECKS=5337640	SAT TT=23.131	SAT TT=64.916	No data	SAT TT=1.435 ASSIGNMENTS=13749 CHECKS=5421910	SAT TT=0.596 ASSIGNMENTS=6893 CHECKS=2095540	SAT TT=56.706	SAT TT=3.573 ASSIGNMENTS=34780 CHECKS=13547900	SAT TT=1.416 ASSIGNMENTS=13485 CHECKS=5337640	SAT TT=36.306	SAT TT=75.32 ASSIGNMENTS=9598 CHECKS=14305800	SAT TT=63.687	SAT TT=23.107
csp/tightness0.35/ normalized-rand-2-40-16-250-350-7_ext.xml	UNSAT TT=10.151	UNSAT TT=61.579 CHECKS=308670000 NODES=278461	UNSAT TT=61.402 CHECKS=308969000 NODES=278608	UNSAT TT=18.466	UNSAT TT=783.628 CHECKS=263363000	UNSAT TT=198.473 CHECKS=54370500	UNSAT TT=37.523 ASSIGNMENTS=61281	UNSAT TT=37.354 ASSIGNMENTS=61281	UNSAT TT=31.102 CHECKS=12559400 NODES=114028	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=19.671 ASSIGNMENTS=118389 CHECKS=47383100	UNSAT TT=19.815 ASSIGNMENTS=118389 CHECKS=47383100	UNSAT TT=323.94	UNSAT TT=799.014	No data	UNSAT TT=10.151 ASSIGNMENTS=100350 CHECKS=39256200	UNSAT TT=10.781 ASSIGNMENTS=107636 CHECKS=42318600	UNSAT TT=197.672	UNSAT TT=11.409 ASSIGNMENTS=112405 CHECKS=44698600	UNSAT TT=12.111 ASSIGNMENTS=118389 CHECKS=47383100	? (TO) TT=1800.12	UNSAT TT=216.347 ASSIGNMENTS=180304 CHECKS=268260000	UNSAT TT=132.065	UNSAT TT=448.671
csp/tightness0.35/ normalized-rand-2-40-16-250-350-8_ext.xml	UNSAT TT=2.986	UNSAT TT=25.784 CHECKS=143612000 NODES=116336	UNSAT TT=25.582 CHECKS=142687000 NODES=115500	UNSAT TT=7.598	UNSAT TT=124.193 CHECKS=37011200	UNSAT TT=97.773 CHECKS=28356700	UNSAT TT=15.101 ASSIGNMENTS=17364	UNSAT TT=15.025 ASSIGNMENTS=17364	UNSAT TT=10.786 CHECKS=4256100 NODES=34949	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=10.856 ASSIGNMENTS=29776 CHECKS=12377800	UNSAT TT=10.787 ASSIGNMENTS=29776 CHECKS=12377800	UNSAT TT=40.118	UNSAT TT=114.572	No data	UNSAT TT=3.431 ASSIGNMENTS=31716 CHECKS=13333900	UNSAT TT=2.986 ASSIGNMENTS=29014 CHECKS=11379600	UNSAT TT=58.282	UNSAT TT=3.501 ASSIGNMENTS=31888 CHECKS=13181800	UNSAT TT=2.997 ASSIGNMENTS=29776 CHECKS=12377800	UNSAT TT=369.26	UNSAT TT=59.311 ASSIGNMENTS=42164 CHECKS=71985000	UNSAT TT=30.448	UNSAT TT=69.309
csp/tightness0.35/ normalized-rand-2-40-16-250-350-90_ext.xml	UNSAT TT=7.626	UNSAT TT=30.275 CHECKS=164079000 NODES=145182	UNSAT TT=31.928 CHECKS=162421000 NODES=143626	UNSAT TT=10.327	UNSAT TT=448.827 CHECKS=142209000	UNSAT TT=185.717 CHECKS=51488300	UNSAT TT=29.748 ASSIGNMENTS=46323	UNSAT TT=29.73 ASSIGNMENTS=46323	UNSAT TT=26.6 CHECKS=10113400 NODES=90778	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=15.704 ASSIGNMENTS=82408 CHECKS=32375100	UNSAT TT=16.077 ASSIGNMENTS=82408 CHECKS=32375100	UNSAT TT=197.255	UNSAT TT=459.957	No data	UNSAT TT=7.626 ASSIGNMENTS=81213 CHECKS=31679600	UNSAT TT=7.919 ASSIGNMENTS=81747 CHECKS=31132800	UNSAT TT=218.422	UNSAT TT=8.178 ASSIGNMENTS=80447 CHECKS=31336300	UNSAT TT=8.214 ASSIGNMENTS=82408 CHECKS=32375100	? (TO) TT=1800.13	UNSAT TT=125.827 ASSIGNMENTS=123425 CHECKS=201909000	UNSAT TT=139.367	UNSAT TT=319.362
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.35/ normalized-rand-2-40-16-250-350-95_ext.xml	UNSAT TT=14.854	UNSAT TT=58.926 CHECKS=249233000 NODES=239111	UNSAT TT=46.265 CHECKS=247402000 NODES=237855	UNSAT TT=21.467	UNSAT TT=424.102 CHECKS=131550000	UNSAT TT=318.027 CHECKS=92312600	UNSAT TT=63.959 ASSIGNMENTS=96838	UNSAT TT=59.048 ASSIGNMENTS=96838	UNSAT TT=51.448 CHECKS=20931800 NODES=196433	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=21.602 ASSIGNMENTS=161097 CHECKS=61825500	UNSAT TT=23.387 ASSIGNMENTS=161097 CHECKS=61825500	UNSAT TT=572.646	UNSAT TT=1283.16	No data	UNSAT TT=14.854 ASSIGNMENTS=161924 CHECKS=62137500	UNSAT TT=15.257 ASSIGNMENTS=157108 CHECKS=59524700	UNSAT TT=396.441	UNSAT TT=17.654 ASSIGNMENTS=176286 CHECKS=67568700	UNSAT TT=15.733 ASSIGNMENTS=161097 CHECKS=61825500	? (TO) TT=1800.15	UNSAT TT=230.722 ASSIGNMENTS=235446 CHECKS=341990000	UNSAT TT=319.801	UNSAT TT=780.711
csp/tightness0.5/ normalized-rand-2-40-25-180-500-11_ext.xml	UNSAT TT=6.063	UNSAT TT=14.883 CHECKS=98706700 NODES=68220	UNSAT TT=15.256 CHECKS=101317000 NODES=69309	UNSAT TT=64.031	UNSAT TT=399.464 CHECKS=45344500	UNSAT TT=377.411 CHECKS=31813500	UNSAT TT=42.585 ASSIGNMENTS=36874	UNSAT TT=38.954 ASSIGNMENTS=36874	UNSAT TT=16.063 CHECKS=9837400 NODES=50990	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=14.656 ASSIGNMENTS=56056 CHECKS=20028800	UNSAT TT=13.571 ASSIGNMENTS=56056 CHECKS=20028800	UNSAT TT=361.479	UNSAT TT=343.182	No data	UNSAT TT=6.877 ASSIGNMENTS=56795 CHECKS=20320500	UNSAT TT=6.33 ASSIGNMENTS=54649 CHECKS=18834400	UNSAT TT=99.061	UNSAT TT=6.063 ASSIGNMENTS=53690 CHECKS=18965100	UNSAT TT=6.323 ASSIGNMENTS=56056 CHECKS=20028800	UNSAT TT=567.168	UNSAT TT=80.69 ASSIGNMENTS=69879 CHECKS=99886500	UNSAT TT=84.855	UNSAT TT=198.27
csp/tightness0.5/ normalized-rand-2-40-25-180-500-12_ext.xml	UNSAT TT=12.856	UNSAT TT=265.058 CHECKS=1704590000 NODES=1188700	UNSAT TT=267.851 CHECKS=1705090000 NODES=1188620	UNSAT TT=162.069	? (TO) TT=1800.09	UNSAT TT=784.198 CHECKS=64887600	UNSAT TT=69.521 ASSIGNMENTS=62598	UNSAT TT=63.895 ASSIGNMENTS=62598	UNSAT TT=38.41 CHECKS=24308000 NODES=139559	? (TO) TT=1800	? (TO) TT=1800.09	UNSAT TT=20.973 ASSIGNMENTS=118525 CHECKS=40774400	UNSAT TT=21.112 ASSIGNMENTS=118525 CHECKS=40774400	? (TO) TT=1800.04	? (TO) TT=1800.04	No data	UNSAT TT=12.856 ASSIGNMENTS=123123 CHECKS=42677100	UNSAT TT=12.857 ASSIGNMENTS=116626 CHECKS=39448600	UNSAT TT=538.328	UNSAT TT=13.196 ASSIGNMENTS=117144 CHECKS=39884500	UNSAT TT=13.541 ASSIGNMENTS=118525 CHECKS=40774400	? (TO) TT=1800.07	UNSAT TT=170.056 ASSIGNMENTS=148691 CHECKS=226208000	UNSAT TT=482.879	? (TO) TT=1800.05
csp/tightness0.5/ normalized-rand-2-40-25-180-500-16_ext.xml	UNSAT TT=5.862	UNSAT TT=13.09 CHECKS=84442600 NODES=56760	UNSAT TT=13.92 CHECKS=84756500 NODES=56981	UNSAT TT=120.075	UNSAT TT=991.295 CHECKS=134136000	UNSAT TT=1135.57 CHECKS=92165100	UNSAT TT=29.779 ASSIGNMENTS=25740	UNSAT TT=29.268 ASSIGNMENTS=25740	UNSAT TT=15.373 CHECKS=9902800 NODES=54772	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=13.477 ASSIGNMENTS=50469 CHECKS=17538200	UNSAT TT=13.417 ASSIGNMENTS=50469 CHECKS=17538200	UNSAT TT=349.297	UNSAT TT=375.948	No data	UNSAT TT=5.897 ASSIGNMENTS=50694 CHECKS=17704700	UNSAT TT=5.971 ASSIGNMENTS=52296 CHECKS=17579100	UNSAT TT=164.188	UNSAT TT=6.051 ASSIGNMENTS=51518 CHECKS=17816300	UNSAT TT=5.862 ASSIGNMENTS=50469 CHECKS=17538200	UNSAT TT=746.399	UNSAT TT=81.469 ASSIGNMENTS=73003 CHECKS=118625000	UNSAT TT=112.943	UNSAT TT=197.742
csp/tightness0.5/ normalized-rand-2-40-25-180-500-18_ext.xml	UNSAT TT=6.126	UNSAT TT=22.292 CHECKS=138580000 NODES=89378	UNSAT TT=22.879 CHECKS=140973000 NODES=90547	UNSAT TT=52.561	UNSAT TT=946.917 CHECKS=145930000	UNSAT TT=332.666 CHECKS=29344700	UNSAT TT=27.812 ASSIGNMENTS=25540	UNSAT TT=27.916 ASSIGNMENTS=25540	UNSAT TT=20.118 CHECKS=12241200 NODES=63901	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=15.275 ASSIGNMENTS=58551 CHECKS=21052300	UNSAT TT=14.814 ASSIGNMENTS=58551 CHECKS=21052300	UNSAT TT=541.562	UNSAT TT=591.22	No data	UNSAT TT=7.049 ASSIGNMENTS=58781 CHECKS=21121500	UNSAT TT=7.007 ASSIGNMENTS=57207 CHECKS=19962200	UNSAT TT=184.877	UNSAT TT=6.126 ASSIGNMENTS=54971 CHECKS=19534200	UNSAT TT=6.946 ASSIGNMENTS=58551 CHECKS=21052300	UNSAT TT=1249.56	UNSAT TT=139.697 ASSIGNMENTS=66908 CHECKS=112362000	UNSAT TT=176.847	UNSAT TT=304.714
csp/tightness0.5/ normalized-rand-2-40-25-180-500-19_ext.xml	SAT TT=0.274	SAT TT=1.932 CHECKS=6959850 NODES=4410	SAT TT=2.272 CHECKS=7330000 NODES=4539	SAT TT=22.814	SAT TT=13.347 CHECKS=1357640	SAT TT=62.418 CHECKS=4371710	SAT TT=3.338 ASSIGNMENTS=1886	SAT TT=3.731 ASSIGNMENTS=1886	SAT TT=1.209 CHECKS=358321 NODES=1660	SAT TT=8.926 CHECKS=55693200 NODES=253812	? (TO) TT=1800.06	SAT TT=0.382 ASSIGNMENTS=2515 CHECKS=864748	SAT TT=0.382 ASSIGNMENTS=2515 CHECKS=864748	SAT TT=5.893	SAT TT=30.06	No data	SAT TT=0.274 ASSIGNMENTS=1942 CHECKS=666487	SAT TT=0.431 ASSIGNMENTS=4843 CHECKS=1124880	SAT TT=3.949	SAT TT=0.295 ASSIGNMENTS=2163 CHECKS=619689	SAT TT=0.366 ASSIGNMENTS=2515 CHECKS=864748	SAT TT=13.116	SAT TT=1.847 ASSIGNMENTS=339 CHECKS=520707	SAT TT=2.732	SAT TT=4.709
csp/tightness0.5/ normalized-rand-2-40-25-180-500-24_ext.xml	UNSAT TT=22.399	UNSAT TT=68.523 CHECKS=420758000 NODES=301210	UNSAT TT=68.151 CHECKS=422330000 NODES=302320	UNSAT TT=208.771	? (TO) TT=1800.1	UNSAT TT=1696.83 CHECKS=149834000	UNSAT TT=98.98 ASSIGNMENTS=106081	UNSAT TT=107.64 ASSIGNMENTS=106081	UNSAT TT=74.724 CHECKS=42436900 NODES=260538	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=30.141 ASSIGNMENTS=211146 CHECKS=69777100	UNSAT TT=30.801 ASSIGNMENTS=211146 CHECKS=69777100	? (TO) TT=1800.02	? (TO) TT=1800.01	No data	UNSAT TT=22.698 ASSIGNMENTS=209825 CHECKS=69354000	UNSAT TT=26.677 ASSIGNMENTS=252219 CHECKS=82275800	UNSAT TT=666.443	UNSAT TT=22.399 ASSIGNMENTS=208230 CHECKS=68551700	UNSAT TT=22.679 ASSIGNMENTS=211146 CHECKS=69777100	? (TO) TT=1800.16	UNSAT TT=509.071 ASSIGNMENTS=365949 CHECKS=495527000	UNSAT TT=926.28	? (TO) TT=1800.1
csp/tightness0.5/ normalized-rand-2-40-25-180-500-35_ext.xml	SAT TT=2.163	SAT TT=14.077 CHECKS=89695100 NODES=65793	SAT TT=15.121 CHECKS=90333700 NODES=65910	SAT TT=2.762	SAT TT=177.733 CHECKS=21269900	SAT TT=494.751 CHECKS=42136300	SAT TT=14.634 ASSIGNMENTS=13267	SAT TT=14.423 ASSIGNMENTS=13267	SAT TT=11.497 CHECKS=6439490 NODES=36400	SAT TT=50.159 CHECKS=363498000 NODES=1656770	? (TO) TT=1800.02	SAT TT=9.571 ASSIGNMENTS=20561 CHECKS=6775240	SAT TT=9.818 ASSIGNMENTS=20561 CHECKS=6775240	SAT TT=1508.34	SAT TT=355.002	No data	SAT TT=7.157 ASSIGNMENTS=63026 CHECKS=21400200	SAT TT=3.914 ASSIGNMENTS=36077 CHECKS=11681200	SAT TT=31.476	SAT TT=6.672 ASSIGNMENTS=59468 CHECKS=19918400	SAT TT=2.163 ASSIGNMENTS=20561 CHECKS=6775240	SAT TT=347.621	SAT TT=47.41 ASSIGNMENTS=24689 CHECKS=32454100	SAT TT=60.751	SAT TT=27.804
csp/tightness0.5/ normalized-rand-2-40-25-180-500-37_ext.xml	UNSAT TT=25.124	UNSAT TT=97.268 CHECKS=620314000 NODES=470657	UNSAT TT=101.141 CHECKS=620452000 NODES=469967	UNSAT TT=250.405	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=119.044 ASSIGNMENTS=125338	UNSAT TT=116.841 ASSIGNMENTS=125338	UNSAT TT=78.06 CHECKS=44545300 NODES=278710	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=32.028 ASSIGNMENTS=252577 CHECKS=82983100	UNSAT TT=36.068 ASSIGNMENTS=252577 CHECKS=82983100	? (TO) TT=1800.06	? (TO) TT=1800.07	No data	UNSAT TT=26.114 ASSIGNMENTS=249460 CHECKS=81567300	UNSAT TT=25.792 ASSIGNMENTS=247250 CHECKS=80635800	UNSAT TT=922.387	UNSAT TT=25.134 ASSIGNMENTS=255902 CHECKS=83131700	UNSAT TT=25.124 ASSIGNMENTS=252577 CHECKS=82983100	? (TO) TT=1800.11	UNSAT TT=466.743 ASSIGNMENTS=348303 CHECKS=507433000	UNSAT TT=1588.52	? (TO) TT=1800.11
csp/tightness0.5/ normalized-rand-2-40-25-180-500-46_ext.xml	SAT TT=0.563	SAT TT=1.144 CHECKS=1444140 NODES=1043	SAT TT=2.779 CHECKS=12221200 NODES=8171	SAT TT=5.113	SAT TT=317.01 CHECKS=37658100	SAT TT=51.243 CHECKS=3698310	SAT TT=5.198 ASSIGNMENTS=3659	SAT TT=5.022 ASSIGNMENTS=3659	SAT TT=6.365 CHECKS=3584060 NODES=20101	SAT TT=11.589 CHECKS=79594500 NODES=367188	SAT TT=0.986 CHECKS=1125610 NODES=3583	SAT TT=8.876 ASSIGNMENTS=16512 CHECKS=5642340	SAT TT=9.51 ASSIGNMENTS=16512 CHECKS=5642340	SAT TT=31.272	SAT TT=367.949	No data	SAT TT=0.902 ASSIGNMENTS=7375 CHECKS=2532160	SAT TT=0.563 ASSIGNMENTS=6345 CHECKS=1470540	SAT TT=18.55	SAT TT=0.966 ASSIGNMENTS=8383 CHECKS=2684700	SAT TT=1.805 ASSIGNMENTS=16512 CHECKS=5642340	SAT TT=17.486	SAT TT=2.068 ASSIGNMENTS=1003 CHECKS=1672430	SAT TT=68.686	SAT TT=21.216
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.5/ normalized-rand-2-40-25-180-500-51_ext.xml	SAT TT=4.494	SAT TT=62.174 CHECKS=373763000 NODES=301978	SAT TT=62.594 CHECKS=374849000 NODES=302821	SAT TT=126.557	SAT TT=361.085 CHECKS=51528900	SAT TT=567.93 CHECKS=47366100	SAT TT=9.092 ASSIGNMENTS=8431	SAT TT=9.519 ASSIGNMENTS=8431	SAT TT=13.556 CHECKS=7406600 NODES=46690	SAT TT=212.951 CHECKS=1441960000 NODES=6520200	? (TO) TT=1800.01	SAT TT=12.584 ASSIGNMENTS=46157 CHECKS=14332800	SAT TT=12.515 ASSIGNMENTS=46157 CHECKS=14332800	SAT TT=203.471	SAT TT=677.931	No data	SAT TT=4.596 ASSIGNMENTS=44403 CHECKS=13867000	SAT TT=4.494 ASSIGNMENTS=44528 CHECKS=13465000	SAT TT=197.629	SAT TT=6.948 ASSIGNMENTS=66763 CHECKS=20966200	SAT TT=4.691 ASSIGNMENTS=46157 CHECKS=14332800	SAT TT=1123.72	SAT TT=44.295 ASSIGNMENTS=13249 CHECKS=17500900	SAT TT=32.049	SAT TT=24.758
csp/tightness0.5/ normalized-rand-2-40-25-180-500-68_ext.xml	SAT TT=0.109	SAT TT=1.039 CHECKS=32389 NODES=60	SAT TT=0.914 CHECKS=107526 NODES=59	SAT TT=2.875	SAT TT=19.883 CHECKS=2353380	SAT TT=4.624 CHECKS=278301	SAT TT=4.267 ASSIGNMENTS=2618	SAT TT=4.625 ASSIGNMENTS=2618	SAT TT=1.129 CHECKS=232302 NODES=1059	SAT TT=2.249 CHECKS=8428070 NODES=38438	? (TO) TT=1800.02	SAT TT=0.324 ASSIGNMENTS=1945 CHECKS=682630	SAT TT=0.317 ASSIGNMENTS=1945 CHECKS=682630	SAT TT=8.552	SAT TT=38	No data	SAT TT=0.109 ASSIGNMENTS=359 CHECKS=128978	SAT TT=0.787 ASSIGNMENTS=7606 CHECKS=2057380	SAT TT=9.887	SAT TT=0.601 ASSIGNMENTS=4660 CHECKS=1507310	SAT TT=0.301 ASSIGNMENTS=1945 CHECKS=682630	SAT TT=3.311	SAT TT=1.172 ASSIGNMENTS=417 CHECKS=710609	SAT TT=2.898	SAT TT=2.748
csp/tightness0.5/ normalized-rand-2-40-25-180-500-75_ext.xml	SAT TT=2.714	SAT TT=38.102 CHECKS=234881000 NODES=160583	SAT TT=39.777 CHECKS=242843000 NODES=166105	SAT TT=73.935	SAT TT=1530 CHECKS=230947000	SAT TT=56.519 CHECKS=4514980	SAT TT=16.025 ASSIGNMENTS=14021	SAT TT=16.112 ASSIGNMENTS=14021	SAT TT=8.583 CHECKS=4781990 NODES=25866	SAT TT=90.814 CHECKS=668740000 NODES=3068630	? (TO) TT=1800.08	SAT TT=11.434 ASSIGNMENTS=33929 CHECKS=11912500	SAT TT=11.581 ASSIGNMENTS=33929 CHECKS=11912500	SAT TT=8.655	SAT TT=21.393	No data	SAT TT=4.719 ASSIGNMENTS=40253 CHECKS=14127900	SAT TT=2.714 ASSIGNMENTS=24250 CHECKS=7982500	SAT TT=128.118	SAT TT=4.003 ASSIGNMENTS=34543 CHECKS=11832700	SAT TT=3.99 ASSIGNMENTS=33929 CHECKS=11912500	SAT TT=1771.56	SAT TT=34.027 ASSIGNMENTS=18002 CHECKS=28835200	SAT TT=78.668	SAT TT=117.269
csp/tightness0.5/ normalized-rand-2-40-25-180-500-79_ext.xml	SAT TT=0.692	SAT TT=45.27 CHECKS=272556000 NODES=212904	SAT TT=43.12 CHECKS=272684000 NODES=212887	SAT TT=484.618	SAT TT=37.773 CHECKS=4414900	SAT TT=42.083 CHECKS=3212420	SAT TT=4.234 ASSIGNMENTS=3113	SAT TT=4.273 ASSIGNMENTS=3113	SAT TT=4.559 CHECKS=2191790 NODES=13059	SAT TT=212.025 CHECKS=1553370000 NODES=7014260	? (TO) TT=1800.04	SAT TT=0.744 ASSIGNMENTS=5978 CHECKS=1989610	SAT TT=0.726 ASSIGNMENTS=5978 CHECKS=1989610	SAT TT=148.478	? (TO) TT=1800.01	No data	SAT TT=0.692 ASSIGNMENTS=5836 CHECKS=1951410	SAT TT=28.649 ASSIGNMENTS=285148 CHECKS=95037500	SAT TT=4.914	SAT TT=1.4 ASSIGNMENTS=12466 CHECKS=4027310	SAT TT=0.711 ASSIGNMENTS=5978 CHECKS=1989610	? (TO) TT=1800.18	SAT TT=281.572 ASSIGNMENTS=5005 CHECKS=4815540	SAT TT=991.88	SAT TT=150.535
csp/tightness0.5/ normalized-rand-2-40-25-180-500-93_ext.xml	UNSAT TT=2.502	UNSAT TT=13.673 CHECKS=86255100 NODES=53734	UNSAT TT=13.946 CHECKS=86884400 NODES=54138	UNSAT TT=51.359	UNSAT TT=372.187 CHECKS=46751100	UNSAT TT=183.685 CHECKS=13938600	UNSAT TT=12.334 ASSIGNMENTS=10075	UNSAT TT=12.294 ASSIGNMENTS=10075	UNSAT TT=8.234 CHECKS=4699730 NODES=24654	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=9.757 ASSIGNMENTS=24565 CHECKS=8817960	UNSAT TT=10.611 ASSIGNMENTS=24565 CHECKS=8817960	UNSAT TT=74.062	UNSAT TT=133.234	No data	UNSAT TT=3.259 ASSIGNMENTS=26661 CHECKS=9514670	UNSAT TT=2.502 ASSIGNMENTS=21665 CHECKS=7242970	UNSAT TT=58.166	UNSAT TT=3.109 ASSIGNMENTS=25452 CHECKS=8963550	UNSAT TT=3.026 ASSIGNMENTS=24565 CHECKS=8817960	UNSAT TT=142.049	UNSAT TT=44.763 ASSIGNMENTS=34598 CHECKS=67619600	UNSAT TT=40.441	UNSAT TT=46.568
csp/tightness0.5/ normalized-rand-2-40-25-180-500-9_ext.xml	SAT TT=0.707	SAT TT=33.367 CHECKS=226193000 NODES=158281	SAT TT=33.751 CHECKS=227224000 NODES=158643	SAT TT=57.696	SAT TT=312.954 CHECKS=44424200	SAT TT=457.101 CHECKS=40430200	SAT TT=5.939 ASSIGNMENTS=3518	SAT TT=6.022 ASSIGNMENTS=3518	SAT TT=8.63 CHECKS=5085470 NODES=28383	SAT TT=6.034 CHECKS=38566600 NODES=173758	? (TO) TT=1800.07	SAT TT=1.25 ASSIGNMENTS=10471 CHECKS=3496240	SAT TT=1.251 ASSIGNMENTS=10471 CHECKS=3496240	SAT TT=31.501	SAT TT=169.653	No data	SAT TT=0.707 ASSIGNMENTS=6124 CHECKS=2065640	SAT TT=1.3 ASSIGNMENTS=13015 CHECKS=3931700	SAT TT=76.996	SAT TT=2.298 ASSIGNMENTS=21397 CHECKS=7220860	SAT TT=1.143 ASSIGNMENTS=10471 CHECKS=3496240	SAT TT=534.796	SAT TT=4.933 ASSIGNMENTS=4667 CHECKS=7128370	SAT TT=3.871	SAT TT=3.878
csp/tightness0.65/ normalized-rand-2-40-40-135-650-11_ext.xml	SAT TT=2.336	SAT TT=5.206 CHECKS=33986000 NODES=16590	SAT TT=4.896 CHECKS=34362800 NODES=16822	SAT TT=36.593	SAT TT=237.673 CHECKS=6858870	SAT TT=26.232 CHECKS=827668	SAT TT=3.325 ASSIGNMENTS=1126	SAT TT=3.645 ASSIGNMENTS=1126	SAT TT=5.845 CHECKS=11713300 NODES=16352	SAT TT=6.508 CHECKS=39915000 NODES=146660	? (TO) TT=1800.06	SAT TT=12.981 ASSIGNMENTS=16590 CHECKS=33986000	SAT TT=12.175 ASSIGNMENTS=16590 CHECKS=33986000	SAT TT=5.868	SAT TT=25.879	No data	SAT TT=2.336 ASSIGNMENTS=15328 CHECKS=4472980	SAT TT=2.921 ASSIGNMENTS=19372 CHECKS=5056520	SAT TT=66.764	SAT TT=2.57 ASSIGNMENTS=17235 CHECKS=4776940	SAT TT=2.466 ASSIGNMENTS=15144 CHECKS=4403040	SAT TT=18.198	SAT TT=19.674 ASSIGNMENTS=16448 CHECKS=19267100	SAT TT=22.296	SAT TT=101.563
csp/tightness0.65/ normalized-rand-2-40-40-135-650-13_ext.xml	UNSAT TT=4.091	UNSAT TT=7.346 CHECKS=47834200 NODES=25888	UNSAT TT=7.554 CHECKS=48020400 NODES=25906	UNSAT TT=154.653	UNSAT TT=775.698 CHECKS=24210200	UNSAT TT=971.086 CHECKS=32139800	UNSAT TT=31.33 ASSIGNMENTS=16603	UNSAT TT=31.533 ASSIGNMENTS=16603	UNSAT TT=9.431 CHECKS=19503400 NODES=26824	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=14.707 ASSIGNMENTS=25888 CHECKS=47834200	UNSAT TT=11.15 ASSIGNMENTS=26607 CHECKS=8067130	UNSAT TT=123.939	UNSAT TT=265.701	No data	UNSAT TT=4.412 ASSIGNMENTS=27223 CHECKS=8288010	UNSAT TT=4.216 ASSIGNMENTS=28019 CHECKS=7908720	UNSAT TT=162.305	UNSAT TT=4.226 ASSIGNMENTS=26471 CHECKS=7742010	UNSAT TT=4.091 ASSIGNMENTS=26607 CHECKS=8067130	UNSAT TT=321.811	UNSAT TT=39.393 ASSIGNMENTS=36099 CHECKS=38989400	UNSAT TT=145.376	UNSAT TT=169.924
csp/tightness0.65/ normalized-rand-2-40-40-135-650-14_ext.xml	UNSAT TT=2.326	UNSAT TT=57.361 CHECKS=455172000 NODES=204711	UNSAT TT=59.345 CHECKS=461114000 NODES=208029	UNSAT TT=60.148	UNSAT TT=400.334 CHECKS=12351300	UNSAT TT=316.693 CHECKS=10400300	UNSAT TT=16.831 ASSIGNMENTS=8446	UNSAT TT=15.103 ASSIGNMENTS=8446	UNSAT TT=6.859 CHECKS=13732400 NODES=17954	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=62.388 ASSIGNMENTS=204711 CHECKS=455172000	UNSAT TT=62.15 ASSIGNMENTS=204711 CHECKS=455172000	UNSAT TT=61.268	UNSAT TT=144.597	No data	UNSAT TT=2.79 ASSIGNMENTS=15895 CHECKS=5075580	UNSAT TT=2.326 ASSIGNMENTS=15873 CHECKS=4608090	UNSAT TT=130.146	UNSAT TT=2.873 ASSIGNMENTS=16756 CHECKS=5135360	UNSAT TT=2.952 ASSIGNMENTS=17126 CHECKS=5428820	UNSAT TT=118.832	UNSAT TT=34.774 ASSIGNMENTS=17709 CHECKS=20911300	UNSAT TT=131.838	UNSAT TT=125.052
csp/tightness0.65/ normalized-rand-2-40-40-135-650-26_ext.xml	SAT TT=0.471	SAT TT=1.891 CHECKS=6285740 NODES=3627	SAT TT=1.864 CHECKS=6299260 NODES=3572	SAT TT=109.292	SAT TT=122.408 CHECKS=3143080	SAT TT=81.04 CHECKS=2242070	SAT TT=12.51 ASSIGNMENTS=6600	SAT TT=13.988 ASSIGNMENTS=6600	SAT TT=2.185 CHECKS=3132170 NODES=4261	SAT TT=20.946 CHECKS=152410000 NODES=577060	? (TO) TT=1800	SAT TT=0.526 ASSIGNMENTS=2634 CHECKS=784827	SAT TT=0.518 ASSIGNMENTS=2634 CHECKS=784827	SAT TT=15.707	SAT TT=174.94	No data	SAT TT=0.552 ASSIGNMENTS=2857 CHECKS=877817	SAT TT=0.779 ASSIGNMENTS=6149 CHECKS=1353750	SAT TT=17.714	SAT TT=0.471 ASSIGNMENTS=2889 CHECKS=674050	SAT TT=0.514 ASSIGNMENTS=2634 CHECKS=784827	SAT TT=4.544	SAT TT=3.408 ASSIGNMENTS=495 CHECKS=558026	SAT TT=21.598	SAT TT=24.047
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.65/ normalized-rand-2-40-40-135-650-32_ext.xml	SAT TT=1.907	SAT TT=5.902 CHECKS=38170800 NODES=21251	SAT TT=5.875 CHECKS=34559400 NODES=19257	SAT TT=18.598	SAT TT=5.113 CHECKS=182242	SAT TT=301.085 CHECKS=10191700	SAT TT=4.871 ASSIGNMENTS=1854	SAT TT=4.251 ASSIGNMENTS=1854	SAT TT=4.06 CHECKS=7158330 NODES=10873	SAT TT=35.406 CHECKS=262726000 NODES=1053630	? (TO) TT=1800.07	SAT TT=13.377 ASSIGNMENTS=21251 CHECKS=38170800	SAT TT=13.473 ASSIGNMENTS=21251 CHECKS=38170800	SAT TT=24.002	SAT TT=109.969	No data	SAT TT=2.013 ASSIGNMENTS=12987 CHECKS=3860290	SAT TT=1.907 ASSIGNMENTS=13277 CHECKS=3482840	SAT TT=68.312	SAT TT=2.855 ASSIGNMENTS=18211 CHECKS=5353010	SAT TT=2.168 ASSIGNMENTS=13586 CHECKS=4042520	SAT TT=33.642	SAT TT=41.134 ASSIGNMENTS=36535 CHECKS=38335200	SAT TT=6.694	SAT TT=115.074
csp/tightness0.65/ normalized-rand-2-40-40-135-650-37_ext.xml	UNSAT TT=8.018	UNSAT TT=33.779 CHECKS=249485000 NODES=128725	UNSAT TT=34.525 CHECKS=253644000 NODES=131022	UNSAT TT=161.833	UNSAT TT=703.948 CHECKS=26614600	? (TO) TT=1800.02	UNSAT TT=54.525 ASSIGNMENTS=29038	UNSAT TT=49.666 ASSIGNMENTS=29038	UNSAT TT=17.742 CHECKS=36735900 NODES=55354	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=39.25 ASSIGNMENTS=128725 CHECKS=249485000	UNSAT TT=15.742 ASSIGNMENTS=53553 CHECKS=15553200	UNSAT TT=639.895	UNSAT TT=845.957	No data	UNSAT TT=8.098 ASSIGNMENTS=52115 CHECKS=15230700	UNSAT TT=8.128 ASSIGNMENTS=54442 CHECKS=15308100	UNSAT TT=232.065	UNSAT TT=8.018 ASSIGNMENTS=53348 CHECKS=15242600	UNSAT TT=8.199 ASSIGNMENTS=53553 CHECKS=15553200	UNSAT TT=1373.27	UNSAT TT=124.017 ASSIGNMENTS=112779 CHECKS=97947700	UNSAT TT=524.605	UNSAT TT=744.873
csp/tightness0.65/ normalized-rand-2-40-40-135-650-48_ext.xml	SAT TT=4.948	SAT TT=18.056 CHECKS=121208000 NODES=63108	SAT TT=17.89 CHECKS=121568000 NODES=63286	SAT TT=71.99	SAT TT=123.765 CHECKS=3448400	SAT TT=711.318 CHECKS=28558400	SAT TT=11.572 ASSIGNMENTS=5841	SAT TT=11.21 ASSIGNMENTS=5841	SAT TT=11.238 CHECKS=21011900 NODES=30321	SAT TT=1116.76 CHECKS=8563720000 NODES=34146400	? (TO) TT=1800.05	SAT TT=23.717 ASSIGNMENTS=63108 CHECKS=121208000	SAT TT=24.247 ASSIGNMENTS=63108 CHECKS=121208000	SAT TT=309.114	SAT TT=192.249	No data	SAT TT=5.193 ASSIGNMENTS=32597 CHECKS=10330700	SAT TT=4.948 ASSIGNMENTS=32771 CHECKS=9811360	SAT TT=183.765	SAT TT=6.289 ASSIGNMENTS=38944 CHECKS=12198300	SAT TT=5.041 ASSIGNMENTS=31428 CHECKS=9979300	SAT TT=12.316	SAT TT=44.733 ASSIGNMENTS=37699 CHECKS=40459100	SAT TT=604.339	SAT TT=33.317
csp/tightness0.65/ normalized-rand-2-40-40-135-650-51_ext.xml	SAT TT=1.786	SAT TT=3.816 CHECKS=20231200 NODES=11461	SAT TT=2.973 CHECKS=16095400 NODES=9210	SAT TT=72.34	SAT TT=19.832 CHECKS=717690	SAT TT=225.051 CHECKS=7278590	SAT TT=6.366 ASSIGNMENTS=2820	SAT TT=6.4 ASSIGNMENTS=2820	SAT TT=12.905 CHECKS=23520100 NODES=35499	SAT TT=28.861 CHECKS=211326000 NODES=811907	? (TO) TT=1800.08	SAT TT=10.471 ASSIGNMENTS=11461 CHECKS=20231200	SAT TT=11.386 ASSIGNMENTS=23622 CHECKS=6839540	SAT TT=23.543	SAT TT=74.06	No data	SAT TT=1.786 ASSIGNMENTS=11225 CHECKS=3254760	SAT TT=3.473 ASSIGNMENTS=23352 CHECKS=6419500	SAT TT=108.076	SAT TT=4.373 ASSIGNMENTS=28841 CHECKS=8239800	SAT TT=3.371 ASSIGNMENTS=23622 CHECKS=6839540	SAT TT=63.548	SAT TT=27.804 ASSIGNMENTS=18548 CHECKS=17170200	SAT TT=24.637	SAT TT=16.975
csp/tightness0.65/ normalized-rand-2-40-40-135-650-63_ext.xml	SAT TT=3.281	SAT TT=9.188 CHECKS=61473200 NODES=32338	SAT TT=8.502 CHECKS=61155800 NODES=32217	SAT TT=84.094	SAT TT=365.296 CHECKS=11611100	SAT TT=319.76 CHECKS=10401000	SAT TT=15.907 ASSIGNMENTS=7082	SAT TT=14.832 ASSIGNMENTS=7082	SAT TT=8.279 CHECKS=15091400 NODES=23104	SAT TT=4.377 CHECKS=25078500 NODES=95745	? (TO) TT=1800.02	SAT TT=15.699 ASSIGNMENTS=32338 CHECKS=61473200	SAT TT=16.203 ASSIGNMENTS=32338 CHECKS=61473200	SAT TT=248.752	SAT TT=246.927	No data	SAT TT=5.045 ASSIGNMENTS=34916 CHECKS=10375600	SAT TT=3.281 ASSIGNMENTS=24500 CHECKS=6610420	SAT TT=135.082	SAT TT=3.946 ASSIGNMENTS=26269 CHECKS=7526300	SAT TT=3.705 ASSIGNMENTS=26497 CHECKS=7651220	SAT TT=48.135	SAT TT=35.96 ASSIGNMENTS=35013 CHECKS=32176400	SAT TT=90.365	SAT TT=16.569
csp/tightness0.65/ normalized-rand-2-40-40-135-650-66_ext.xml	UNSAT TT=12.395	UNSAT TT=97.593 CHECKS=818955000 NODES=426501	UNSAT TT=105.006 CHECKS=820469000 NODES=427056	UNSAT TT=272.438	UNSAT TT=1776.62 CHECKS=60706600	? (TO) TT=1800.09	UNSAT TT=66.692 ASSIGNMENTS=39404	UNSAT TT=71.548 ASSIGNMENTS=39404	UNSAT TT=28.161 CHECKS=54912200 NODES=83867	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=103.933 ASSIGNMENTS=426501 CHECKS=818955000	UNSAT TT=104.667 ASSIGNMENTS=426501 CHECKS=818955000	UNSAT TT=938.641	UNSAT TT=1187.07	No data	UNSAT TT=13.106 ASSIGNMENTS=85887 CHECKS=25612200	UNSAT TT=12.395 ASSIGNMENTS=82771 CHECKS=23925600	UNSAT TT=510.318	UNSAT TT=13.013 ASSIGNMENTS=85044 CHECKS=25288600	UNSAT TT=12.656 ASSIGNMENTS=83604 CHECKS=24830500	? (TO) TT=1800.15	UNSAT TT=166.349 ASSIGNMENTS=153320 CHECKS=155492000	UNSAT TT=780.584	? (TO) TT=1800.07
csp/tightness0.65/ normalized-rand-2-40-40-135-650-70_ext.xml	SAT TT=3.74	SAT TT=6.515 CHECKS=39004600 NODES=20092	SAT TT=6.443 CHECKS=38539200 NODES=19833	SAT TT=75.686	SAT TT=522.009 CHECKS=21610700	SAT TT=316.111 CHECKS=13090600	SAT TT=21.138 ASSIGNMENTS=11662	SAT TT=21.962 ASSIGNMENTS=11662	SAT TT=12.433 CHECKS=25601600 NODES=34965	SAT TT=901.116 CHECKS=6821140000 NODES=26857200	? (TO) TT=1800	SAT TT=13.481 ASSIGNMENTS=20092 CHECKS=39004600	SAT TT=13.747 ASSIGNMENTS=20092 CHECKS=39004600	SAT TT=367.683	SAT TT=1041.18	No data	SAT TT=3.773 ASSIGNMENTS=24636 CHECKS=7938720	SAT TT=3.74 ASSIGNMENTS=26188 CHECKS=7914870	SAT TT=101.726	SAT TT=3.925 ASSIGNMENTS=23981 CHECKS=7582210	SAT TT=5.622 ASSIGNMENTS=34980 CHECKS=11249900	SAT TT=1060.28	SAT TT=23.759 ASSIGNMENTS=19657 CHECKS=23620900	SAT TT=703.209	SAT TT=393.754
csp/tightness0.65/ normalized-rand-2-40-40-135-650-74_ext.xml	SAT TT=0.696	SAT TT=4.763 CHECKS=30214000 NODES=16828	SAT TT=5.377 CHECKS=31867700 NODES=17500	SAT TT=135.664	SAT TT=152.482 CHECKS=4473940	SAT TT=256.67 CHECKS=10904300	SAT TT=8.117 ASSIGNMENTS=4070	SAT TT=7.993 ASSIGNMENTS=4070	SAT TT=6.192 CHECKS=12181900 NODES=17281	SAT TT=126.41 CHECKS=949446000 NODES=3706440	? (TO) TT=1800	SAT TT=12.828 ASSIGNMENTS=16828 CHECKS=30214000	SAT TT=11.892 ASSIGNMENTS=31349 CHECKS=9701100	SAT TT=20.882	SAT TT=79.775	No data	SAT TT=0.696 ASSIGNMENTS=3793 CHECKS=1182370	SAT TT=3.048 ASSIGNMENTS=22028 CHECKS=6228520	SAT TT=79.84	SAT TT=4.063 ASSIGNMENTS=25123 CHECKS=7521110	SAT TT=5.082 ASSIGNMENTS=31349 CHECKS=9701100	SAT TT=4.806	SAT TT=54.093 ASSIGNMENTS=20066 CHECKS=19911900	SAT TT=77.156	SAT TT=51.743
csp/tightness0.65/ normalized-rand-2-40-40-135-650-79_ext.xml	UNSAT TT=10.703	UNSAT TT=62.675 CHECKS=476677000 NODES=235388	UNSAT TT=62.105 CHECKS=479262000 NODES=236206	? (TO) TT=1800.02	UNSAT TT=916.91 CHECKS=37439700	UNSAT TT=922.389 CHECKS=37548600	UNSAT TT=100.317 ASSIGNMENTS=54949	UNSAT TT=98.776 ASSIGNMENTS=54949	UNSAT TT=26.598 CHECKS=52485700 NODES=73526	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=65.003 ASSIGNMENTS=235388 CHECKS=476677000	UNSAT TT=17.318 ASSIGNMENTS=66688 CHECKS=21093200	UNSAT TT=994.242	UNSAT TT=909.427	No data	UNSAT TT=12.316 ASSIGNMENTS=75907 CHECKS=23917500	UNSAT TT=11.34 ASSIGNMENTS=72722 CHECKS=22285200	UNSAT TT=257.749	UNSAT TT=11.479 ASSIGNMENTS=71955 CHECKS=22535800	UNSAT TT=10.703 ASSIGNMENTS=66688 CHECKS=21093200	? (TO) TT=1800.21	UNSAT TT=168.054 ASSIGNMENTS=135627 CHECKS=142091000	UNSAT TT=530.657	UNSAT TT=921.963
csp/tightness0.65/ normalized-rand-2-40-40-135-650-91_ext.xml	SAT TT=0.613	SAT TT=29.855 CHECKS=203585000 NODES=124695	SAT TT=30.049 CHECKS=208693000 NODES=127313	SAT TT=80.451	SAT TT=1353.56 CHECKS=54716600	SAT TT=185.962 CHECKS=7941450	SAT TT=33.515 ASSIGNMENTS=22963	SAT TT=34.139 ASSIGNMENTS=22963	SAT TT=1.888 CHECKS=2189170 NODES=3682	SAT TT=32.003 CHECKS=236824000 NODES=895244	? (TO) TT=1800.09	SAT TT=0.76 ASSIGNMENTS=4220 CHECKS=1280630	SAT TT=0.765 ASSIGNMENTS=4220 CHECKS=1280630	SAT TT=318.486	SAT TT=231.433	No data	SAT TT=0.794 ASSIGNMENTS=4315 CHECKS=1352920	SAT TT=0.788 ASSIGNMENTS=6099 CHECKS=1330250	SAT TT=378.385	SAT TT=0.613 ASSIGNMENTS=4027 CHECKS=982401	SAT TT=0.736 ASSIGNMENTS=4220 CHECKS=1280630	SAT TT=300.726	SAT TT=1.254 ASSIGNMENTS=1144 CHECKS=937602	SAT TT=72.01	SAT TT=94.016
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.65/ normalized-rand-2-40-40-135-650-96_ext.xml	SAT TT=9.229	SAT TT=63.102 CHECKS=496417000 NODES=255095	SAT TT=67.049 CHECKS=485863000 NODES=250474	SAT TT=625.636	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=88.08 ASSIGNMENTS=50516	SAT TT=81.93 ASSIGNMENTS=50516	SAT TT=9.229 CHECKS=16352000 NODES=23994	? (TO) TT=1800	? (TO) TT=1800.1	SAT TT=70.293 ASSIGNMENTS=255095 CHECKS=496417000	SAT TT=70.185 ASSIGNMENTS=255095 CHECKS=496417000	SAT TT=845.006	SAT TT=1377.13	No data	SAT TT=11.513 ASSIGNMENTS=71651 CHECKS=22762300	SAT TT=11.155 ASSIGNMENTS=72144 CHECKS=22296400	SAT TT=149.001	SAT TT=10.705 ASSIGNMENTS=71976 CHECKS=22626900	SAT TT=10.765 ASSIGNMENTS=71919 CHECKS=22833100	SAT TT=482.87	SAT TT=91.417 ASSIGNMENTS=80426 CHECKS=87527900	SAT TT=1030.9	SAT TT=635.025
csp/tightness0.8/ normalized-rand-2-40-80-103-800-10_ext.xml	SAT TT=1.146	SAT TT=1.454 CHECKS=4874340 NODES=1134	SAT TT=1.649 CHECKS=5154220 NODES=1145	SAT TT=1624.05	SAT TT=12.724 CHECKS=104431	SAT TT=99.945 CHECKS=943372	SAT TT=8.022 ASSIGNMENTS=740	SAT TT=8.286 ASSIGNMENTS=740	SAT TT=3.668 CHECKS=11632000 NODES=4498	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=1.444 ASSIGNMENTS=4466 CHECKS=1319020	SAT TT=1.452 ASSIGNMENTS=4466 CHECKS=1319020	SAT TT=18.332	SAT TT=16.918	No data	SAT TT=1.146 ASSIGNMENTS=3627 CHECKS=1015140	SAT TT=1.2 ASSIGNMENTS=5164 CHECKS=1017510	SAT TT=18.2	SAT TT=1.249 ASSIGNMENTS=4537 CHECKS=988663	SAT TT=1.523 ASSIGNMENTS=4466 CHECKS=1319020	SAT TT=25.081	SAT TT=13.819 ASSIGNMENTS=3518 CHECKS=12785700	SAT TT=115.677	SAT TT=5.493
csp/tightness0.8/ normalized-rand-2-40-80-103-800-12_ext.xml	SAT TT=0.632	SAT TT=3.749 CHECKS=26443800 NODES=8535	SAT TT=3.74 CHECKS=27829900 NODES=8691	SAT TT=225.054	SAT TT=55.047 CHECKS=724692	SAT TT=19.924 CHECKS=237718	SAT TT=13.147 ASSIGNMENTS=2655	SAT TT=14.357 ASSIGNMENTS=2655	SAT TT=2.4 CHECKS=3766740 NODES=1865	SAT TT=986.632 CHECKS=7995830000 NODES=21285700	? (TO) TT=1800.09	SAT TT=1.125 ASSIGNMENTS=4013 CHECKS=1010520	SAT TT=1.139 ASSIGNMENTS=4013 CHECKS=1010520	SAT TT=20.202	SAT TT=13.827	No data	SAT TT=1.74 ASSIGNMENTS=6361 CHECKS=1653570	SAT TT=0.955 ASSIGNMENTS=4872 CHECKS=827361	SAT TT=9.335	SAT TT=0.632 ASSIGNMENTS=2838 CHECKS=417431	SAT TT=1.09 ASSIGNMENTS=4013 CHECKS=1010520	SAT TT=49.561	SAT TT=6.971 ASSIGNMENTS=1198 CHECKS=2685680	SAT TT=8.953	SAT TT=36.125
csp/tightness0.8/ normalized-rand-2-40-80-103-800-18_ext.xml	UNSAT TT=1.166	UNSAT TT=5.681 CHECKS=57554800 NODES=9479	UNSAT TT=5.767 CHECKS=57966200 NODES=9540	UNSAT TT=27.667	UNSAT TT=176.381 CHECKS=1585820	UNSAT TT=278.889 CHECKS=2393190	UNSAT TT=10.748 ASSIGNMENTS=758	UNSAT TT=10.661 ASSIGNMENTS=758	UNSAT TT=3.384 CHECKS=11292700 NODES=3483	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=1.217 ASSIGNMENTS=3404 CHECKS=1047280	UNSAT TT=1.314 ASSIGNMENTS=3404 CHECKS=1047280	UNSAT TT=31.448	UNSAT TT=51.246	No data	UNSAT TT=1.166 ASSIGNMENTS=3307 CHECKS=1019580	UNSAT TT=1.554 ASSIGNMENTS=6204 CHECKS=1252680	UNSAT TT=32.229	UNSAT TT=1.639 ASSIGNMENTS=5950 CHECKS=1272600	UNSAT TT=1.293 ASSIGNMENTS=3404 CHECKS=1047280	UNSAT TT=17.493	UNSAT TT=19.58 ASSIGNMENTS=4203 CHECKS=21444900	UNSAT TT=38.356	UNSAT TT=31.352
csp/tightness0.8/ normalized-rand-2-40-80-103-800-19_ext.xml	SAT TT=0.579	SAT TT=7.868 CHECKS=65418300 NODES=25820	SAT TT=6.669 CHECKS=53814500 NODES=21977	SAT TT=359.621	SAT TT=142.541 CHECKS=2427760	SAT TT=494.927 CHECKS=7863260	SAT TT=50.317 ASSIGNMENTS=17111	SAT TT=54.889 ASSIGNMENTS=17111	SAT TT=2.578 CHECKS=5062190 NODES=3579	SAT TT=596.273 CHECKS=4333570000 NODES=12240400	? (TO) TT=1800.03	SAT TT=14.698 ASSIGNMENTS=25820 CHECKS=65418300	SAT TT=15.691 ASSIGNMENTS=25820 CHECKS=65418300	SAT TT=96.09	SAT TT=198.966	No data	SAT TT=13.093 ASSIGNMENTS=69911 CHECKS=15692300	SAT TT=0.7 ASSIGNMENTS=4140 CHECKS=585903	SAT TT=672.434	SAT TT=0.579 ASSIGNMENTS=2755 CHECKS=366023	SAT TT=12.321 ASSIGNMENTS=65810 CHECKS=14936000	SAT TT=169.375	SAT TT=7.484 ASSIGNMENTS=4786 CHECKS=7025300	SAT TT=44.396	SAT TT=996.379
csp/tightness0.8/ normalized-rand-2-40-80-103-800-20_ext.xml	UNSAT TT=1.8	UNSAT TT=95.942 CHECKS=1149600000 NODES=223778	UNSAT TT=99.626 CHECKS=1150850000 NODES=223828	UNSAT TT=258.453	UNSAT TT=241.889 CHECKS=2778470	UNSAT TT=310.059 CHECKS=3387450	UNSAT TT=15.127 ASSIGNMENTS=2263	UNSAT TT=15.076 ASSIGNMENTS=2263	UNSAT TT=4.07 CHECKS=12861600 NODES=5303	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=99.864 ASSIGNMENTS=223778 CHECKS=1149600000	UNSAT TT=98.887 ASSIGNMENTS=223778 CHECKS=1149600000	UNSAT TT=38.541	UNSAT TT=46.939	No data	UNSAT TT=2.041 ASSIGNMENTS=6814 CHECKS=1852940	UNSAT TT=1.806 ASSIGNMENTS=8158 CHECKS=1687420	UNSAT TT=38.219	UNSAT TT=1.921 ASSIGNMENTS=7844 CHECKS=1711760	UNSAT TT=1.8 ASSIGNMENTS=6142 CHECKS=1648580	UNSAT TT=61.572	UNSAT TT=22.197 ASSIGNMENTS=9621 CHECKS=21726000	UNSAT TT=152.468	UNSAT TT=117.865
csp/tightness0.8/ normalized-rand-2-40-80-103-800-25_ext.xml	UNSAT TT=1.317	UNSAT TT=11.54 CHECKS=121831000 NODES=27326	UNSAT TT=10.697 CHECKS=122205000 NODES=27385	UNSAT TT=426.383	UNSAT TT=376.495 CHECKS=3937530	UNSAT TT=349.865 CHECKS=3891640	UNSAT TT=19.663 ASSIGNMENTS=1932	UNSAT TT=18.331 ASSIGNMENTS=1932	UNSAT TT=3.477 CHECKS=10055600 NODES=4638	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=1.43 ASSIGNMENTS=4838 CHECKS=1283050	UNSAT TT=1.445 ASSIGNMENTS=4838 CHECKS=1283050	UNSAT TT=33.749	UNSAT TT=87.546	No data	UNSAT TT=1.326 ASSIGNMENTS=4888 CHECKS=1307410	UNSAT TT=1.511 ASSIGNMENTS=6650 CHECKS=1353690	UNSAT TT=52.635	UNSAT TT=1.524 ASSIGNMENTS=6028 CHECKS=1314430	UNSAT TT=1.317 ASSIGNMENTS=4838 CHECKS=1283050	UNSAT TT=58.156	UNSAT TT=29.435 ASSIGNMENTS=9386 CHECKS=39122100	UNSAT TT=103.931	UNSAT TT=74.42
csp/tightness0.8/ normalized-rand-2-40-80-103-800-27_ext.xml	SAT TT=53.015	SAT TT=753.249 CHECKS=7411610000 NODES=2310980	SAT TT=684.183 CHECKS=7399070000 NODES=2309980	SAT TT=199.058	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=258.663 ASSIGNMENTS=86106	SAT TT=247.694 ASSIGNMENTS=86106	SAT TT=143.474 CHECKS=583305000 NODES=349119	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=701.114 ASSIGNMENTS=2310980 CHECKS=7411610000	SAT TT=698.427 ASSIGNMENTS=2310980 CHECKS=7411610000	? (TO) TT=1800.04	? (TO) TT=1800.06	No data	SAT TT=53.107 ASSIGNMENTS=239584 CHECKS=65832600	SAT TT=53.015 ASSIGNMENTS=240981 CHECKS=65903200	? (TO) TT=1800.02	SAT TT=59.6 ASSIGNMENTS=287615 CHECKS=78290500	SAT TT=97.933 ASSIGNMENTS=443912 CHECKS=122034000	? (TO) TT=1800.22	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08
csp/tightness0.8/ normalized-rand-2-40-80-103-800-29_ext.xml	UNSAT TT=3.491	UNSAT TT=24.463 CHECKS=271245000 NODES=59596	UNSAT TT=22.623 CHECKS=269729000 NODES=59403	? (TO) TT=1800.1	UNSAT TT=712.549 CHECKS=7372400	UNSAT TT=728.915 CHECKS=7904310	UNSAT TT=21.199 ASSIGNMENTS=3739	UNSAT TT=22.999 ASSIGNMENTS=3739	UNSAT TT=7.579 CHECKS=29516100 NODES=11771	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=32.33 ASSIGNMENTS=59596 CHECKS=271245000	UNSAT TT=30.218 ASSIGNMENTS=59596 CHECKS=271245000	UNSAT TT=104.756	UNSAT TT=179.973	No data	UNSAT TT=3.565 ASSIGNMENTS=11781 CHECKS=3283790	UNSAT TT=3.607 ASSIGNMENTS=14055 CHECKS=3394220	UNSAT TT=93.999	UNSAT TT=3.63 ASSIGNMENTS=13087 CHECKS=3203870	UNSAT TT=3.491 ASSIGNMENTS=11702 CHECKS=3164870	UNSAT TT=102.674	UNSAT TT=54.718 ASSIGNMENTS=17705 CHECKS=58329700	UNSAT TT=208.743	UNSAT TT=174.39
csp/tightness0.8/ normalized-rand-2-40-80-103-800-3_ext.xml	UNSAT TT=0.871	UNSAT TT=13.132 CHECKS=159175000 NODES=27439	UNSAT TT=13.713 CHECKS=158359000 NODES=27260	UNSAT TT=45.246	UNSAT TT=151.976 CHECKS=1182950	UNSAT TT=82.537 CHECKS=643111	UNSAT TT=8.219 ASSIGNMENTS=318	UNSAT TT=8.562 ASSIGNMENTS=318	UNSAT TT=2.57 CHECKS=6415660 NODES=2113	? (TO) TT=1800.04	? (TO) TT=1800.13	UNSAT TT=0.943 ASSIGNMENTS=2161 CHECKS=640889	UNSAT TT=0.913 ASSIGNMENTS=2161 CHECKS=640889	UNSAT TT=20.617	UNSAT TT=25.829	No data	UNSAT TT=0.871 ASSIGNMENTS=2020 CHECKS=614218	UNSAT TT=1.083 ASSIGNMENTS=4834 CHECKS=859058	UNSAT TT=21.187	UNSAT TT=1.067 ASSIGNMENTS=4216 CHECKS=824827	UNSAT TT=0.911 ASSIGNMENTS=2161 CHECKS=640889	UNSAT TT=13.711	UNSAT TT=9.385 ASSIGNMENTS=1851 CHECKS=9116350	UNSAT TT=18.253	UNSAT TT=20.455
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.8/ normalized-rand-2-40-80-103-800-40_ext.xml	UNSAT TT=9.371	UNSAT TT=23.222 CHECKS=267717000 NODES=65285	UNSAT TT=22.544 CHECKS=266338000 NODES=64920	UNSAT TT=644.979	UNSAT TT=1684.12 CHECKS=21260100	? (TO) TT=1800.06	UNSAT TT=56.784 ASSIGNMENTS=12517	UNSAT TT=61.112 ASSIGNMENTS=12517	UNSAT TT=22.304 CHECKS=88047300 NODES=40863	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=29.91 ASSIGNMENTS=65285 CHECKS=267717000	UNSAT TT=32.273 ASSIGNMENTS=65285 CHECKS=267717000	UNSAT TT=884.866	? (TO) TT=1800.03	No data	UNSAT TT=9.371 ASSIGNMENTS=36321 CHECKS=10607500	UNSAT TT=9.851 ASSIGNMENTS=37616 CHECKS=10424200	UNSAT TT=459.854	UNSAT TT=10.381 ASSIGNMENTS=38770 CHECKS=10887900	UNSAT TT=9.446 ASSIGNMENTS=36885 CHECKS=10762600	UNSAT TT=1497.71	UNSAT TT=161.527 ASSIGNMENTS=32038 CHECKS=122084000	UNSAT TT=1160.94	UNSAT TT=1170.43
csp/tightness0.8/ normalized-rand-2-40-80-103-800-52_ext.xml	SAT TT=0.908	SAT TT=288.358 CHECKS=3221640000 NODES=893290	SAT TT=292.547 CHECKS=3221280000 NODES=894611	SAT TT=221.402	SAT TT=555.245 CHECKS=6972770	SAT TT=366.001 CHECKS=4633450	SAT TT=21.765 ASSIGNMENTS=4453	SAT TT=21.479 ASSIGNMENTS=4453	SAT TT=18.013 CHECKS=69757100 NODES=36853	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=0.908 ASSIGNMENTS=3077 CHECKS=835991	SAT TT=0.968 ASSIGNMENTS=3077 CHECKS=835991	SAT TT=1079.45	SAT TT=880.097	No data	SAT TT=4.372 ASSIGNMENTS=17966 CHECKS=4825380	SAT TT=5.284 ASSIGNMENTS=21906 CHECKS=5309910	SAT TT=32.207	SAT TT=6.903 ASSIGNMENTS=28075 CHECKS=6991600	SAT TT=0.961 ASSIGNMENTS=3077 CHECKS=835991	SAT TT=101.803	SAT TT=82.97 ASSIGNMENTS=28044 CHECKS=75189300	SAT TT=909.583	SAT TT=31.723
csp/tightness0.8/ normalized-rand-2-40-80-103-800-53_ext.xml	UNSAT TT=1.919	UNSAT TT=251.634 CHECKS=2805370000 NODES=731824	UNSAT TT=255.015 CHECKS=2814340000 NODES=733594	? (TO) TT=1800.06	UNSAT TT=346.306 CHECKS=3687060	UNSAT TT=366.982 CHECKS=3619030	UNSAT TT=15.43 ASSIGNMENTS=2365	UNSAT TT=14.958 ASSIGNMENTS=2365	UNSAT TT=5.811 CHECKS=19986200 NODES=8501	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=260.642 ASSIGNMENTS=731824 CHECKS=2805370000	UNSAT TT=241.211 ASSIGNMENTS=731824 CHECKS=2805370000	UNSAT TT=43.695	UNSAT TT=125.161	No data	UNSAT TT=2.357 ASSIGNMENTS=7571 CHECKS=2142820	UNSAT TT=1.919 ASSIGNMENTS=9343 CHECKS=1892160	UNSAT TT=51.992	UNSAT TT=2.177 ASSIGNMENTS=9059 CHECKS=1957520	UNSAT TT=2.258 ASSIGNMENTS=7491 CHECKS=2098610	UNSAT TT=53.171	UNSAT TT=46.388 ASSIGNMENTS=14584 CHECKS=44735700	UNSAT TT=156.995	UNSAT TT=121.437
csp/tightness0.8/ normalized-rand-2-40-80-103-800-59_ext.xml	UNSAT TT=5.223	UNSAT TT=58.415 CHECKS=681008000 NODES=153620	UNSAT TT=54.271 CHECKS=681275000 NODES=153910	UNSAT TT=226.366	UNSAT TT=1785.43 CHECKS=19105800	UNSAT TT=1473.4 CHECKS=16245700	UNSAT TT=33.179 ASSIGNMENTS=6675	UNSAT TT=34.042 ASSIGNMENTS=6675	UNSAT TT=13.342 CHECKS=59120300 NODES=25371	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=65.12 ASSIGNMENTS=153620 CHECKS=681008000	UNSAT TT=61.11 ASSIGNMENTS=153620 CHECKS=681008000	UNSAT TT=198.332	UNSAT TT=1139.76	No data	UNSAT TT=7.453 ASSIGNMENTS=24534 CHECKS=7276250	UNSAT TT=5.223 ASSIGNMENTS=19037 CHECKS=5144750	UNSAT TT=324.005	UNSAT TT=5.33 ASSIGNMENTS=18992 CHECKS=5243020	UNSAT TT=7.374 ASSIGNMENTS=24701 CHECKS=7274790	UNSAT TT=500.733	UNSAT TT=92.639 ASSIGNMENTS=29153 CHECKS=94093500	UNSAT TT=497.565	UNSAT TT=594.634
csp/tightness0.8/ normalized-rand-2-40-80-103-800-64_ext.xml	UNSAT TT=6.442	UNSAT TT=19.133 CHECKS=226752000 NODES=51577	UNSAT TT=20.521 CHECKS=225287000 NODES=51225	UNSAT TT=387.306	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=38.735 ASSIGNMENTS=9201	UNSAT TT=39.814 ASSIGNMENTS=9201	UNSAT TT=13.345 CHECKS=54514400 NODES=25027	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=26.856 ASSIGNMENTS=51577 CHECKS=226752000	UNSAT TT=27.309 ASSIGNMENTS=51577 CHECKS=226752000	UNSAT TT=335.394	UNSAT TT=843.317	No data	UNSAT TT=7.112 ASSIGNMENTS=24913 CHECKS=6958560	UNSAT TT=6.442 ASSIGNMENTS=25440 CHECKS=6418090	UNSAT TT=190.947	UNSAT TT=7.336 ASSIGNMENTS=26156 CHECKS=7088920	UNSAT TT=6.764 ASSIGNMENTS=25282 CHECKS=7039350	UNSAT TT=402.326	UNSAT TT=170.184 ASSIGNMENTS=54511 CHECKS=168153000	UNSAT TT=867.416	UNSAT TT=622.721
csp/tightness0.8/ normalized-rand-2-40-80-103-800-66_ext.xml	SAT TT=0.558	SAT TT=48.956 CHECKS=539963000 NODES=136217	SAT TT=46.05 CHECKS=546583000 NODES=137854	SAT TT=38.315	SAT TT=78.075 CHECKS=957819	SAT TT=946.881 CHECKS=12143600	SAT TT=10.335 ASSIGNMENTS=1439	SAT TT=10.225 ASSIGNMENTS=1439	SAT TT=17.74 CHECKS=75495000 NODES=38955	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT TT=0.558 ASSIGNMENTS=1642 CHECKS=458393	SAT TT=0.564 ASSIGNMENTS=1642 CHECKS=458393	SAT TT=175.549	SAT TT=17.067	No data	SAT TT=11.156 ASSIGNMENTS=45498 CHECKS=11444300	SAT TT=1.462 ASSIGNMENTS=6574 CHECKS=1346520	SAT TT=41.222	SAT TT=11.248 ASSIGNMENTS=47337 CHECKS=11358300	SAT TT=0.584 ASSIGNMENTS=1642 CHECKS=458393	SAT TT=39.002	SAT TT=186.139 ASSIGNMENTS=76568 CHECKS=199646000	SAT TT=1018.84	SAT TT=271.827
csp/tightness0.8/ normalized-rand-2-40-80-103-800-68_ext.xml	SAT TT=1.651	SAT TT=13.594 CHECKS=133753000 NODES=36844	SAT TT=12.069 CHECKS=116202000 NODES=32038	? (TO) TT=1800.02	SAT TT=142.163 CHECKS=1795390	SAT TT=258.926 CHECKS=3346700	SAT TT=63.689 ASSIGNMENTS=14635	SAT TT=64.311 ASSIGNMENTS=14635	SAT TT=8.435 CHECKS=33391500 NODES=17639	SAT TT=216.329 CHECKS=1580670000 NODES=4304140	? (TO) TT=1800.1	SAT TT=20.055 ASSIGNMENTS=36844 CHECKS=133753000	SAT TT=20.235 ASSIGNMENTS=36844 CHECKS=133753000	SAT TT=16.896	SAT TT=1186.11	No data	SAT TT=3.315 ASSIGNMENTS=13474 CHECKS=3449860	SAT TT=3.282 ASSIGNMENTS=14946 CHECKS=3398240	SAT TT=55.504	SAT TT=1.651 ASSIGNMENTS=7344 CHECKS=1509120	SAT TT=1.84 ASSIGNMENTS=7115 CHECKS=1879690	SAT TT=47.105	SAT TT=35.969 ASSIGNMENTS=12551 CHECKS=29937500	? (TO) TT=1800.08	SAT TT=432.978
csp/tightness0.8/ normalized-rand-2-40-80-103-800-70_ext.xml	SAT TT=5.446	SAT TT=5.497 CHECKS=47310000 NODES=10314	SAT TT=5.446 CHECKS=48343100 NODES=10706	SAT TT=759.024	SAT TT=168.453 CHECKS=1910140	SAT TT=924.751 CHECKS=11638200	SAT TT=53.5 ASSIGNMENTS=14390	SAT TT=58.867 ASSIGNMENTS=14390	SAT TT=12.098 CHECKS=53588700 NODES=21311	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=12.431 ASSIGNMENTS=10314 CHECKS=47310000	SAT TT=12.692 ASSIGNMENTS=10314 CHECKS=47310000	SAT TT=367.634	? (TO) TT=1800.03	No data	SAT TT=6.161 ASSIGNMENTS=21204 CHECKS=6191930	SAT TT=7.832 ASSIGNMENTS=27678 CHECKS=7652880	SAT TT=113.699	SAT TT=7.276 ASSIGNMENTS=25917 CHECKS=7158860	SAT TT=6.871 ASSIGNMENTS=23723 CHECKS=6831240	SAT TT=334.531	SAT TT=96.811 ASSIGNMENTS=24276 CHECKS=81580200	SAT TT=553.174	SAT TT=1233.58
csp/tightness0.8/ normalized-rand-2-40-80-103-800-78_ext.xml	UNSAT TT=68.507	UNSAT TT=244.678 CHECKS=2586760000 NODES=642417	UNSAT TT=221.776 CHECKS=2525690000 NODES=628790	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=319.451 ASSIGNMENTS=88116	UNSAT TT=317.459 ASSIGNMENTS=88116	UNSAT TT=159.874 CHECKS=719246000 NODES=390325	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=232.83 ASSIGNMENTS=642417 CHECKS=2586760000	UNSAT TT=243.115 ASSIGNMENTS=642417 CHECKS=2586760000	? (TO) TT=1800.08	? (TO) TT=1800.01	No data	UNSAT TT=70.617 ASSIGNMENTS=334380 CHECKS=85242100	UNSAT TT=68.507 ASSIGNMENTS=333199 CHECKS=84437500	? (TO) TT=1800.1	UNSAT TT=74.303 ASSIGNMENTS=333391 CHECKS=84617700	UNSAT TT=77.286 ASSIGNMENTS=347332 CHECKS=88263500	? (TO) TT=1800.19	UNSAT TT=1601.43 ASSIGNMENTS=611665 CHECKS=1771870000	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/tightness0.8/ normalized-rand-2-40-80-103-800-7_ext.xml	SAT TT=0.4	SAT TT=19.068 CHECKS=219500000 NODES=51888	SAT TT=19.029 CHECKS=221003000 NODES=51920	SAT TT=1521.05	SAT TT=161.565 CHECKS=1281270	SAT TT=67.749 CHECKS=520826	SAT TT=5.414 ASSIGNMENTS=57	SAT TT=5.237 ASSIGNMENTS=57	SAT TT=1.966 CHECKS=1699440 NODES=766	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=0.403 ASSIGNMENTS=924 CHECKS=240012	SAT TT=0.4 ASSIGNMENTS=924 CHECKS=240012	SAT TT=19.702	SAT TT=16.205	No data	SAT TT=0.563 ASSIGNMENTS=1395 CHECKS=358778	SAT TT=0.666 ASSIGNMENTS=3678 CHECKS=494878	SAT TT=2.412	SAT TT=0.67 ASSIGNMENTS=2936 CHECKS=439463	SAT TT=0.417 ASSIGNMENTS=924 CHECKS=240012	SAT TT=12.416	SAT TT=0.592 ASSIGNMENTS=77 CHECKS=203125	SAT TT=21.938	SAT TT=5.854
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.8/ normalized-rand-2-40-80-103-800-80_ext.xml	SAT TT=0.836	SAT TT=18.899 CHECKS=216847000 NODES=40895	SAT TT=19.062 CHECKS=216831000 NODES=40836	? (TO) TT=1800.07	SAT TT=133.197 CHECKS=1214460	SAT TT=350.397 CHECKS=3398660	SAT TT=8.793 ASSIGNMENTS=765	SAT TT=8.804 ASSIGNMENTS=765	SAT TT=2.93 CHECKS=6699580 NODES=2511	SAT TT=383.186 CHECKS=3086380000 NODES=7851690	? (TO) TT=1800.06	SAT TT=0.915 ASSIGNMENTS=2387 CHECKS=693937	SAT TT=0.918 ASSIGNMENTS=2387 CHECKS=693937	SAT TT=16.273	SAT TT=13.71	No data	SAT TT=0.893 ASSIGNMENTS=2317 CHECKS=687610	SAT TT=1.241 ASSIGNMENTS=5300 CHECKS=1008780	SAT TT=34.429	SAT TT=1.304 ASSIGNMENTS=4827 CHECKS=973814	SAT TT=0.836 ASSIGNMENTS=2387 CHECKS=693937	SAT TT=15.737	SAT TT=7.765 ASSIGNMENTS=2090 CHECKS=8890990	SAT TT=35.724	SAT TT=14.168
csp/tightness0.8/ normalized-rand-2-40-80-103-800-83_ext.xml	UNSAT TT=2.005	UNSAT TT=98.035 CHECKS=1147030000 NODES=218148	UNSAT TT=98.474 CHECKS=1152310000 NODES=218967	UNSAT TT=173.602	UNSAT TT=412.799 CHECKS=3886780	UNSAT TT=390.665 CHECKS=3534430	UNSAT TT=14.906 ASSIGNMENTS=2435	UNSAT TT=14.732 ASSIGNMENTS=2435	UNSAT TT=5.716 CHECKS=20167300 NODES=6804	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=97.312 ASSIGNMENTS=218148 CHECKS=1147030000	UNSAT TT=96.857 ASSIGNMENTS=218148 CHECKS=1147030000	UNSAT TT=41.519	UNSAT TT=125.422	No data	UNSAT TT=2.398 ASSIGNMENTS=7018 CHECKS=2083480	UNSAT TT=2.02 ASSIGNMENTS=7823 CHECKS=1846380	UNSAT TT=107.039	UNSAT TT=2.13 ASSIGNMENTS=7418 CHECKS=1870410	UNSAT TT=2.005 ASSIGNMENTS=5798 CHECKS=1757310	UNSAT TT=38.151	UNSAT TT=44.278 ASSIGNMENTS=7185 CHECKS=27893000	UNSAT TT=137.177	UNSAT TT=103.519
csp/tightness0.8/ normalized-rand-2-40-80-103-800-87_ext.xml	UNSAT TT=4.94	UNSAT TT=39.63 CHECKS=455654000 NODES=96048	UNSAT TT=39.689 CHECKS=456290000 NODES=96252	UNSAT TT=438.328	UNSAT TT=903.515 CHECKS=9473270	UNSAT TT=874.617 CHECKS=9017280	UNSAT TT=31.577 ASSIGNMENTS=6763	UNSAT TT=31.794 ASSIGNMENTS=6763	UNSAT TT=12.045 CHECKS=47368800 NODES=20418	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=44.211 ASSIGNMENTS=96048 CHECKS=455654000	UNSAT TT=44.06 ASSIGNMENTS=96048 CHECKS=455654000	UNSAT TT=164.245	UNSAT TT=507.189	No data	UNSAT TT=5.922 ASSIGNMENTS=18377 CHECKS=5483730	UNSAT TT=4.94 ASSIGNMENTS=18055 CHECKS=4749080	UNSAT TT=207.054	UNSAT TT=5.042 ASSIGNMENTS=17755 CHECKS=4857890	UNSAT TT=5.91 ASSIGNMENTS=18870 CHECKS=5574300	UNSAT TT=220.212	UNSAT TT=94.299 ASSIGNMENTS=29704 CHECKS=92039000	UNSAT TT=527.342	UNSAT TT=452.813
csp/tightness0.8/ normalized-rand-2-40-80-103-800-88_ext.xml	SAT TT=1.215	SAT TT=2.115 CHECKS=9927840 NODES=2142	SAT TT=2.002 CHECKS=10181300 NODES=2168	SAT TT=90.808	SAT TT=355.853 CHECKS=3631400	SAT TT=107.778 CHECKS=1136260	SAT TT=14.753 ASSIGNMENTS=2380	SAT TT=15.752 ASSIGNMENTS=2380	SAT TT=2.515 CHECKS=5173550 NODES=2197	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=1.221 ASSIGNMENTS=3747 CHECKS=1048980	SAT TT=1.219 ASSIGNMENTS=3747 CHECKS=1048980	SAT TT=17.947	SAT TT=540.703	No data	SAT TT=1.54 ASSIGNMENTS=4894 CHECKS=1364860	SAT TT=3.406 ASSIGNMENTS=13606 CHECKS=3401380	SAT TT=24.003	SAT TT=1.816 ASSIGNMENTS=6876 CHECKS=1593080	SAT TT=1.215 ASSIGNMENTS=3747 CHECKS=1048980	SAT TT=6.72	SAT TT=27.834 ASSIGNMENTS=9806 CHECKS=28851300	SAT TT=56.885	SAT TT=278.711
csp/tightness0.8/ normalized-rand-2-40-80-103-800-8_ext.xml	SAT TT=1.009	SAT TT=1.048 CHECKS=753216 NODES=250	SAT TT=1.009 CHECKS=584462 NODES=152	SAT TT=34.411	SAT TT=36.706 CHECKS=369244	SAT TT=298.831 CHECKS=3308940	SAT TT=7.947 ASSIGNMENTS=788	SAT TT=7.884 ASSIGNMENTS=788	SAT TT=5.769 CHECKS=22785700 NODES=9653	SAT TT=1751.89 CHECKS=13871100000 NODES=37552300	? (TO) TT=1800.07	SAT TT=8.821 ASSIGNMENTS=250 CHECKS=753216	SAT TT=8.678 ASSIGNMENTS=250 CHECKS=753216	SAT TT=41.765	SAT TT=150.065	No data	SAT TT=2.755 ASSIGNMENTS=9249 CHECKS=2553310	SAT TT=1.863 ASSIGNMENTS=8691 CHECKS=1864680	SAT TT=70.249	SAT TT=1.458 ASSIGNMENTS=6330 CHECKS=1343550	SAT TT=2.764 ASSIGNMENTS=9092 CHECKS=2511920	SAT TT=22.932	SAT TT=46.07 ASSIGNMENTS=14735 CHECKS=45048000	SAT TT=226.085	SAT TT=70.015
csp/tightness0.8/ normalized-rand-2-40-80-103-800-94_ext.xml	UNSAT TT=8.811	UNSAT TT=93.702 CHECKS=1050230000 NODES=262059	UNSAT TT=93.381 CHECKS=1053410000 NODES=263638	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=1482.3 CHECKS=17996400	UNSAT TT=72.66 ASSIGNMENTS=15672	UNSAT TT=79.213 ASSIGNMENTS=15672	UNSAT TT=20.341 CHECKS=88322200 NODES=36860	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=93.998 ASSIGNMENTS=262059 CHECKS=1050230000	UNSAT TT=94.293 ASSIGNMENTS=262059 CHECKS=1050230000	UNSAT TT=477.199	UNSAT TT=971.779	No data	UNSAT TT=10.09 ASSIGNMENTS=34045 CHECKS=9981010	UNSAT TT=8.811 ASSIGNMENTS=30998 CHECKS=8737280	UNSAT TT=1094.44	UNSAT TT=10.849 ASSIGNMENTS=38542 CHECKS=10769000	UNSAT TT=10.735 ASSIGNMENTS=37561 CHECKS=10823600	UNSAT TT=1281.88	UNSAT TT=611.056 ASSIGNMENTS=241844 CHECKS=625266000	UNSAT TT=980.026	UNSAT TT=1083.25
csp/tightness0.9/ normalized-rand-2-40-180-84-900-11_ext.xml	UNSAT TT=0.713	UNSAT TT=314.839 CHECKS=5692960000 NODES=569937	UNSAT TT=319.869 CHECKS=5698370000 NODES=570251	UNSAT TT=157.045	UNSAT TT=212.516 CHECKS=346816	UNSAT TT=229.288 CHECKS=352287	UNSAT TT=45.233 ASSIGNMENTS=147	UNSAT TT=41.633 ASSIGNMENTS=147	UNSAT TT=3.099 CHECKS=8634910 NODES=737	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=0.779 ASSIGNMENTS=686 CHECKS=158250	UNSAT TT=0.781 ASSIGNMENTS=686 CHECKS=158250	UNSAT TT=44.15	UNSAT TT=29.717	No data	UNSAT TT=0.713 ASSIGNMENTS=674 CHECKS=160694	UNSAT TT=1.743 ASSIGNMENTS=4121 CHECKS=534783	UNSAT TT=18.716	UNSAT TT=3.409 ASSIGNMENTS=6857 CHECKS=888524	UNSAT TT=0.718 ASSIGNMENTS=686 CHECKS=158250	UNSAT TT=49.536	UNSAT TT=9.715 ASSIGNMENTS=850 CHECKS=9762720	UNSAT TT=39.192	UNSAT TT=41.942
csp/tightness0.9/ normalized-rand-2-40-180-84-900-16_ext.xml	UNSAT TT=15.493	UNSAT TT=22.24 CHECKS=347445000 NODES=38062	UNSAT TT=22.931 CHECKS=347449000 NODES=37997	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.05	UNSAT TT=1090.27 ASSIGNMENTS=84368	UNSAT TT=1066.78 ASSIGNMENTS=84368	UNSAT TT=34.892 CHECKS=309271000 NODES=33383	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=30.659 ASSIGNMENTS=38062 CHECKS=347445000	UNSAT TT=30.261 ASSIGNMENTS=38062 CHECKS=347445000	UNSAT TT=985.753	? (TO) TT=1800.04	No data	UNSAT TT=15.493 ASSIGNMENTS=27713 CHECKS=7006960	UNSAT TT=16.299 ASSIGNMENTS=28940 CHECKS=6902440	UNSAT TT=1225.68	UNSAT TT=17.783 ASSIGNMENTS=31433 CHECKS=7074910	UNSAT TT=16.474 ASSIGNMENTS=27873 CHECKS=7039320	UNSAT TT=741.981	UNSAT TT=286.411 ASSIGNMENTS=35144 CHECKS=337401000	? (TO) TT=1800	? (TO) TT=1800.06
csp/tightness0.9/ normalized-rand-2-40-180-84-900-24_ext.xml	SAT TT=0.326	SAT TT=1.336 CHECKS=1575340 NODES=202	SAT TT=1.272 CHECKS=1250840 NODES=117	SAT TT=7.067	SAT TT=15.941 CHECKS=34752	SAT TT=13.055 CHECKS=19037	SAT TT=39.847 ASSIGNMENTS=61	SAT TT=39.902 ASSIGNMENTS=61	SAT TT=2.804 CHECKS=1516680 NODES=186	SAT TT=1119.69 CHECKS=8586650000 NODES=14299700	? (TO) TT=1800.09	SAT TT=0.41 ASSIGNMENTS=194 CHECKS=44555	SAT TT=0.425 ASSIGNMENTS=194 CHECKS=44555	SAT TT=36.543	SAT TT=26.082	No data	SAT TT=0.326 ASSIGNMENTS=94 CHECKS=22573	SAT TT=1.292 ASSIGNMENTS=3544 CHECKS=435880	SAT TT=3.958	SAT TT=2.818 ASSIGNMENTS=5894 CHECKS=737160	SAT TT=0.394 ASSIGNMENTS=194 CHECKS=44555	SAT TT=5.505	SAT TT=1.251 ASSIGNMENTS=91 CHECKS=602695	SAT TT=7.636	SAT TT=15.062
csp/tightness0.9/ normalized-rand-2-40-180-84-900-25_ext.xml	UNSAT TT=0.996	UNSAT TT=54.297 CHECKS=876965000 NODES=69088	UNSAT TT=52.369 CHECKS=871186000 NODES=68673	UNSAT TT=26.083	UNSAT TT=284.368 CHECKS=414123	UNSAT TT=259.056 CHECKS=415823	UNSAT TT=51.592 ASSIGNMENTS=170	UNSAT TT=51.518 ASSIGNMENTS=170	UNSAT TT=3.473 CHECKS=11491100 NODES=809	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=1.01 ASSIGNMENTS=924 CHECKS=237477	UNSAT TT=1.02 ASSIGNMENTS=924 CHECKS=237477	UNSAT TT=39.219	UNSAT TT=27.804	No data	UNSAT TT=0.996 ASSIGNMENTS=911 CHECKS=230559	UNSAT TT=1.837 ASSIGNMENTS=4234 CHECKS=562320	UNSAT TT=85.185	UNSAT TT=4.278 ASSIGNMENTS=7305 CHECKS=1021140	UNSAT TT=1.027 ASSIGNMENTS=924 CHECKS=237477	UNSAT TT=15.622	UNSAT TT=14.995 ASSIGNMENTS=890 CHECKS=16814900	UNSAT TT=38.381	UNSAT TT=32.106
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.9/ normalized-rand-2-40-180-84-900-27_ext.xml	UNSAT TT=199.617	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=890.75 ASSIGNMENTS=82091	UNSAT TT=960.478 ASSIGNMENTS=82091	UNSAT TT=376.677 CHECKS=3741860000 NODES=456619	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=1242.23 ASSIGNMENTS=82091	UNSAT TT=461.099 ASSIGNMENTS=479097 CHECKS=113392000	? (TO) TT=1800.07	? (TO) TT=1800.05	No data	UNSAT TT=200.722 ASSIGNMENTS=473910 CHECKS=112119000	UNSAT TT=207.352 ASSIGNMENTS=471236 CHECKS=111065000	? (TO) TT=1800.07	UNSAT TT=199.617 ASSIGNMENTS=475776 CHECKS=112089000	UNSAT TT=215.45 ASSIGNMENTS=479097 CHECKS=113392000	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.14
csp/tightness0.9/ normalized-rand-2-40-180-84-900-28_ext.xml	UNSAT TT=1.071	UNSAT TT=14.549 CHECKS=252327000 NODES=19994	UNSAT TT=14.628 CHECKS=252618000 NODES=19936	UNSAT TT=253.088	UNSAT TT=278.296 CHECKS=469348	UNSAT TT=261.22 CHECKS=457203	UNSAT TT=51.318 ASSIGNMENTS=181	UNSAT TT=51.121 ASSIGNMENTS=181	UNSAT TT=3.856 CHECKS=15065300 NODES=1432	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=1.184 ASSIGNMENTS=1366 CHECKS=287383	UNSAT TT=1.186 ASSIGNMENTS=1366 CHECKS=287383	UNSAT TT=46.09	UNSAT TT=31.621	No data	UNSAT TT=1.16 ASSIGNMENTS=1362 CHECKS=279786	UNSAT TT=2.128 ASSIGNMENTS=5150 CHECKS=649988	UNSAT TT=43.668	UNSAT TT=4.103 ASSIGNMENTS=7468 CHECKS=1057510	UNSAT TT=1.071 ASSIGNMENTS=1366 CHECKS=287383	UNSAT TT=12.843	UNSAT TT=20.057 ASSIGNMENTS=1089 CHECKS=17372500	UNSAT TT=23.759	UNSAT TT=23.286
csp/tightness0.9/ normalized-rand-2-40-180-84-900-29_ext.xml	UNSAT TT=2.001	UNSAT TT=32.047 CHECKS=514884000 NODES=36721	UNSAT TT=32.547 CHECKS=514481000 NODES=36652	? (TO) TT=1800.08	UNSAT TT=740.909 CHECKS=1230620	UNSAT TT=727.301 CHECKS=1259520	UNSAT TT=54.996 ASSIGNMENTS=593	UNSAT TT=60.189 ASSIGNMENTS=593	UNSAT TT=5.309 CHECKS=25826800 NODES=2013	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=39.666 ASSIGNMENTS=36721 CHECKS=514884000	UNSAT TT=39.841 ASSIGNMENTS=36721 CHECKS=514884000	UNSAT TT=65.949	UNSAT TT=63.471	No data	UNSAT TT=2.353 ASSIGNMENTS=2583 CHECKS=665644	UNSAT TT=3.002 ASSIGNMENTS=5371 CHECKS=956554	UNSAT TT=162.191	UNSAT TT=4.84 ASSIGNMENTS=8102 CHECKS=1368110	UNSAT TT=2.001 ASSIGNMENTS=2242 CHECKS=606160	UNSAT TT=47.241	UNSAT TT=30.279 ASSIGNMENTS=2322 CHECKS=33801000	UNSAT TT=86.016	UNSAT TT=72.974
csp/tightness0.9/ normalized-rand-2-40-180-84-900-2_ext.xml	UNSAT TT=3.9	UNSAT TT=6.649 CHECKS=88737400 NODES=7321	UNSAT TT=6.808 CHECKS=89505200 NODES=7333	? (TO) TT=1800.08	UNSAT TT=1291.26 CHECKS=2535860	UNSAT TT=1303.36 CHECKS=2575010	UNSAT TT=79.635 ASSIGNMENTS=2210	UNSAT TT=74.105 ASSIGNMENTS=2210	UNSAT TT=8.667 CHECKS=61847900 NODES=5601	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=14.974 ASSIGNMENTS=7321 CHECKS=88737400	UNSAT TT=14.932 ASSIGNMENTS=7321 CHECKS=88737400	UNSAT TT=125.894	UNSAT TT=311.435	No data	UNSAT TT=4.39 ASSIGNMENTS=5748 CHECKS=1528310	UNSAT TT=4.276 ASSIGNMENTS=7811 CHECKS=1634790	UNSAT TT=183.602	UNSAT TT=6.105 ASSIGNMENTS=10383 CHECKS=1913870	UNSAT TT=3.9 ASSIGNMENTS=5700 CHECKS=1504240	UNSAT TT=97.362	UNSAT TT=92.649 ASSIGNMENTS=7483 CHECKS=91032400	UNSAT TT=211.8	UNSAT TT=260.523
csp/tightness0.9/ normalized-rand-2-40-180-84-900-35_ext.xml	UNSAT TT=3.057	UNSAT TT=6.593 CHECKS=89679500 NODES=6945	UNSAT TT=6.011 CHECKS=87833600 NODES=6714	? (TO) TT=1800.05	UNSAT TT=793.705 CHECKS=1467660	UNSAT TT=860.92 CHECKS=1513900	UNSAT TT=121.755 ASSIGNMENTS=4428	UNSAT TT=121.594 ASSIGNMENTS=4428	UNSAT TT=6.795 CHECKS=42666000 NODES=3628	? (TO) TT=1800	? (TO) TT=1800.03	UNSAT TT=14.438 ASSIGNMENTS=6945 CHECKS=89679500	UNSAT TT=14.268 ASSIGNMENTS=6945 CHECKS=89679500	UNSAT TT=145.775	UNSAT TT=103.776	No data	UNSAT TT=3.227 ASSIGNMENTS=4171 CHECKS=1132900	UNSAT TT=3.304 ASSIGNMENTS=6742 CHECKS=1310730	UNSAT TT=165.312	UNSAT TT=6.596 ASSIGNMENTS=11590 CHECKS=2143320	UNSAT TT=3.057 ASSIGNMENTS=3734 CHECKS=1020140	UNSAT TT=84.306	UNSAT TT=47.046 ASSIGNMENTS=2790 CHECKS=47208000	UNSAT TT=293.578	UNSAT TT=271.67
csp/tightness0.9/ normalized-rand-2-40-180-84-900-40_ext.xml	UNSAT TT=5.525	UNSAT TT=160.064 CHECKS=2791510000 NODES=266315	UNSAT TT=158.754 CHECKS=2789250000 NODES=266048	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=126.404 ASSIGNMENTS=4700	UNSAT TT=137.608 ASSIGNMENTS=4700	UNSAT TT=12.278 CHECKS=89963400 NODES=10033	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=181.952 ASSIGNMENTS=266315 CHECKS=2791510000	UNSAT TT=181.968 ASSIGNMENTS=266315 CHECKS=2791510000	UNSAT TT=425.151	? (TO) TT=1800	No data	UNSAT TT=5.951 ASSIGNMENTS=10796 CHECKS=2662890	UNSAT TT=6.488 ASSIGNMENTS=12684 CHECKS=2930820	UNSAT TT=285.834	UNSAT TT=9.108 ASSIGNMENTS=16552 CHECKS=3657740	UNSAT TT=5.525 ASSIGNMENTS=10005 CHECKS=2462960	UNSAT TT=731.147	UNSAT TT=156.628 ASSIGNMENTS=16819 CHECKS=170627000	UNSAT TT=750.8	UNSAT TT=732.718
csp/tightness0.9/ normalized-rand-2-40-180-84-900-43_ext.xml	UNSAT TT=1.04	UNSAT TT=14.761 CHECKS=247485000 NODES=28820	UNSAT TT=16.025 CHECKS=247949000 NODES=28793	? (TO) TT=1800.07	UNSAT TT=281.022 CHECKS=488973	UNSAT TT=267.509 CHECKS=465787	UNSAT TT=48.464 ASSIGNMENTS=371	UNSAT TT=46.684 ASSIGNMENTS=371	UNSAT TT=4.411 CHECKS=18868200 NODES=1777	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=1.057 ASSIGNMENTS=1338 CHECKS=288827	UNSAT TT=1.056 ASSIGNMENTS=1338 CHECKS=288827	UNSAT TT=59.397	UNSAT TT=103.072	No data	UNSAT TT=1.04 ASSIGNMENTS=1288 CHECKS=286777	UNSAT TT=3.655 ASSIGNMENTS=7071 CHECKS=1324390	UNSAT TT=37.204	UNSAT TT=4.469 ASSIGNMENTS=8585 CHECKS=1306120	UNSAT TT=1.113 ASSIGNMENTS=1338 CHECKS=288827	UNSAT TT=61.861	UNSAT TT=17.428 ASSIGNMENTS=1771 CHECKS=20229100	UNSAT TT=64.999	UNSAT TT=105.468
csp/tightness0.9/ normalized-rand-2-40-180-84-900-45_ext.xml	UNSAT TT=1.308	UNSAT TT=14.456 CHECKS=240873000 NODES=19683	UNSAT TT=14.844 CHECKS=241481000 NODES=19674	UNSAT TT=32.307	UNSAT TT=580.318 CHECKS=895959	UNSAT TT=570.998 CHECKS=900796	UNSAT TT=53.207 ASSIGNMENTS=382	UNSAT TT=53.528 ASSIGNMENTS=382	UNSAT TT=4.51 CHECKS=19088300 NODES=1825	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=1.326 ASSIGNMENTS=1701 CHECKS=348564	UNSAT TT=1.368 ASSIGNMENTS=1701 CHECKS=348564	UNSAT TT=43.328	UNSAT TT=45.47	No data	UNSAT TT=1.313 ASSIGNMENTS=1708 CHECKS=346988	UNSAT TT=2.03 ASSIGNMENTS=4664 CHECKS=656212	UNSAT TT=67.801	UNSAT TT=4.005 ASSIGNMENTS=7620 CHECKS=1026180	UNSAT TT=1.308 ASSIGNMENTS=1701 CHECKS=348564	UNSAT TT=15.798	UNSAT TT=26.418 ASSIGNMENTS=2425 CHECKS=33811600	UNSAT TT=59.625	UNSAT TT=69.758
csp/tightness0.9/ normalized-rand-2-40-180-84-900-48_ext.xml	SAT TT=3.998	SAT TT=4.367 CHECKS=44720500 NODES=4482	SAT TT=3.998 CHECKS=44511400 NODES=4388	SAT TT=481.941	SAT TT=520.058 CHECKS=1457680	SAT TT=782.003 CHECKS=2345850	SAT TT=69.813 ASSIGNMENTS=2969	SAT TT=76.804 ASSIGNMENTS=2969	SAT TT=28.827 CHECKS=261271000 NODES=30520	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=11.679 ASSIGNMENTS=4482 CHECKS=44720500	SAT TT=12.242 ASSIGNMENTS=4482 CHECKS=44720500	SAT TT=61.862	SAT TT=233.298	No data	SAT TT=10.519 ASSIGNMENTS=19423 CHECKS=4915870	SAT TT=11.838 ASSIGNMENTS=23821 CHECKS=5535890	SAT TT=1280.42	SAT TT=14.221 ASSIGNMENTS=29699 CHECKS=6553980	SAT TT=10.029 ASSIGNMENTS=19702 CHECKS=4979920	SAT TT=59.558	SAT TT=273.369 ASSIGNMENTS=36542 CHECKS=285848000	? (TO) TT=1800.1	SAT TT=888.547
csp/tightness0.9/ normalized-rand-2-40-180-84-900-4_ext.xml	UNSAT TT=1.393	UNSAT TT=13.2 CHECKS=204730000 NODES=14449	UNSAT TT=13.116 CHECKS=205855000 NODES=14504	UNSAT TT=34.805	UNSAT TT=691.106 CHECKS=1234650	UNSAT TT=659.929 CHECKS=1273540	UNSAT TT=51.595 ASSIGNMENTS=229	UNSAT TT=53.438 ASSIGNMENTS=229	UNSAT TT=5.075 CHECKS=29691800 NODES=2227	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=1.53 ASSIGNMENTS=1662 CHECKS=415490	UNSAT TT=1.393 ASSIGNMENTS=1662 CHECKS=415490	UNSAT TT=48.598	UNSAT TT=38.56	No data	UNSAT TT=1.516 ASSIGNMENTS=1699 CHECKS=420606	UNSAT TT=2.159 ASSIGNMENTS=4676 CHECKS=670650	UNSAT TT=96.244	UNSAT TT=4.347 ASSIGNMENTS=7964 CHECKS=1155450	UNSAT TT=1.535 ASSIGNMENTS=1662 CHECKS=415490	UNSAT TT=17.478	UNSAT TT=42.39 ASSIGNMENTS=1920 CHECKS=30550800	UNSAT TT=40.096	UNSAT TT=45.56
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.9/ normalized-rand-2-40-180-84-900-52_ext.xml	SAT TT=11.041	SAT TT=63.535 CHECKS=1089030000 NODES=121710	SAT TT=61.532 CHECKS=1077700000 NODES=120544	? (TO) TT=1800.05	SAT TT=733.03 CHECKS=1918180	SAT TT=434.212 CHECKS=1024550	SAT TT=64.205 ASSIGNMENTS=1539	SAT TT=64.053 ASSIGNMENTS=1539	SAT TT=59.69 CHECKS=524471000 NODES=62436	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=74.484 ASSIGNMENTS=121710 CHECKS=1089030000	SAT TT=74.87 ASSIGNMENTS=121710 CHECKS=1089030000	SAT TT=559.358	SAT TT=67.269	No data	SAT TT=35.432 ASSIGNMENTS=56139 CHECKS=14694900	SAT TT=26.885 ASSIGNMENTS=51035 CHECKS=13159800	SAT TT=254.319	SAT TT=11.041 ASSIGNMENTS=21592 CHECKS=4791240	SAT TT=20.59 ASSIGNMENTS=33033 CHECKS=8814930	? (TO) TT=1800.15	SAT TT=140.837 ASSIGNMENTS=17931 CHECKS=169497000	? (TO) TT=1800.09	SAT TT=1282.3
csp/tightness0.9/ normalized-rand-2-40-180-84-900-61_ext.xml	SAT TT=0.428	SAT TT=1.385 CHECKS=1432800 NODES=228	SAT TT=1.311 CHECKS=1862570 NODES=222	SAT TT=9.958	SAT TT=65.868 CHECKS=228275	SAT TT=64.751 CHECKS=255476	SAT TT=40.839 ASSIGNMENTS=58	SAT TT=40.894 ASSIGNMENTS=58	SAT TT=3.701 CHECKS=11636900 NODES=1930	SAT TT=591.486 CHECKS=5014820000 NODES=7217080	? (TO) TT=1800.06	SAT TT=0.47 ASSIGNMENTS=417 CHECKS=73682	SAT TT=0.457 ASSIGNMENTS=417 CHECKS=73682	SAT TT=41.312	SAT TT=26.016	No data	SAT TT=0.428 ASSIGNMENTS=318 CHECKS=67120	SAT TT=0.565 ASSIGNMENTS=903 CHECKS=109088	SAT TT=8.404	SAT TT=2.887 ASSIGNMENTS=5944 CHECKS=731140	SAT TT=0.449 ASSIGNMENTS=417 CHECKS=73682	SAT TT=9.007	SAT TT=9.284 ASSIGNMENTS=1677 CHECKS=8812940	SAT TT=28.34	SAT TT=48.979
csp/tightness0.9/ normalized-rand-2-40-180-84-900-63_ext.xml	UNSAT TT=4.392	UNSAT TT=81.2 CHECKS=1398200000 NODES=109127	UNSAT TT=84.978 CHECKS=1398830000 NODES=108982	UNSAT TT=323.842	UNSAT TT=1407.72 CHECKS=3464190	UNSAT TT=1407.51 CHECKS=3484660	UNSAT TT=93.031 ASSIGNMENTS=3296	UNSAT TT=92.924 ASSIGNMENTS=3296	UNSAT TT=11.036 CHECKS=84012700 NODES=8668	? (TO) TT=1800.04	? (TO) TT=1800.1	UNSAT TT=101.574 ASSIGNMENTS=109127 CHECKS=1398200000	UNSAT TT=100.076 ASSIGNMENTS=109127 CHECKS=1398200000	UNSAT TT=171.335	UNSAT TT=609.669	No data	UNSAT TT=4.392 ASSIGNMENTS=7724 CHECKS=1884140	UNSAT TT=5.016 ASSIGNMENTS=9954 CHECKS=2067740	UNSAT TT=204.886	UNSAT TT=7.128 ASSIGNMENTS=12640 CHECKS=2432900	UNSAT TT=5.024 ASSIGNMENTS=7957 CHECKS=1941630	UNSAT TT=577.875	UNSAT TT=165.574 ASSIGNMENTS=11964 CHECKS=149260000	UNSAT TT=446.259	UNSAT TT=495.818
csp/tightness0.9/ normalized-rand-2-40-180-84-900-68_ext.xml	SAT TT=0.488	SAT TT=1.356 CHECKS=2532180 NODES=327	SAT TT=1.634 CHECKS=3662060 NODES=394	SAT TT=10.686	SAT TT=393.989 CHECKS=1378710	SAT TT=126.078 CHECKS=406777	SAT TT=39.588 ASSIGNMENTS=95	SAT TT=37.704 ASSIGNMENTS=95	SAT TT=3.424 CHECKS=6915540 NODES=1002	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=0.598 ASSIGNMENTS=632 CHECKS=159340	SAT TT=0.602 ASSIGNMENTS=632 CHECKS=159340	SAT TT=43.909	SAT TT=78.16	No data	SAT TT=0.488 ASSIGNMENTS=444 CHECKS=104833	SAT TT=1.727 ASSIGNMENTS=4785 CHECKS=686225	SAT TT=12.641	SAT TT=2.997 ASSIGNMENTS=6328 CHECKS=796250	SAT TT=0.591 ASSIGNMENTS=632 CHECKS=159340	SAT TT=14.659	SAT TT=10.146 ASSIGNMENTS=851 CHECKS=4037240	SAT TT=405.921	SAT TT=144.812
csp/tightness0.9/ normalized-rand-2-40-180-84-900-72_ext.xml	SAT TT=0.831	SAT TT=10.651 CHECKS=149932000 NODES=17291	SAT TT=10.945 CHECKS=151028000 NODES=17347	SAT TT=21.182	SAT TT=21.831 CHECKS=40528	SAT TT=104.832 CHECKS=336216	SAT TT=44.318 ASSIGNMENTS=586	SAT TT=44.663 ASSIGNMENTS=586	SAT TT=4.668 CHECKS=17744400 NODES=2456	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=18.339 ASSIGNMENTS=17291 CHECKS=149932000	SAT TT=18.504 ASSIGNMENTS=17291 CHECKS=149932000	SAT TT=44.847	SAT TT=209.094	No data	SAT TT=2.113 ASSIGNMENTS=3974 CHECKS=912340	SAT TT=1.565 ASSIGNMENTS=4135 CHECKS=567728	SAT TT=472.672	SAT TT=0.831 ASSIGNMENTS=1225 CHECKS=153476	SAT TT=2.238 ASSIGNMENTS=4312 CHECKS=988044	SAT TT=149.296	SAT TT=11.994 ASSIGNMENTS=1149 CHECKS=6836740	SAT TT=456.133	SAT TT=106.891
csp/tightness0.9/ normalized-rand-2-40-180-84-900-76_ext.xml	UNSAT TT=4.922	UNSAT TT=45.369 CHECKS=732269000 NODES=66287	UNSAT TT=45.16 CHECKS=730616000 NODES=66040	? (TO) TT=1800.06	UNSAT TT=1785.46 CHECKS=3900550	UNSAT TT=1571.03 CHECKS=3573340	UNSAT TT=71.816 ASSIGNMENTS=1970	UNSAT TT=71.431 ASSIGNMENTS=1970	UNSAT TT=10.096 CHECKS=72080000 NODES=5987	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=52.58 ASSIGNMENTS=66287 CHECKS=732269000	UNSAT TT=52.547 ASSIGNMENTS=66287 CHECKS=732269000	UNSAT TT=166.332	UNSAT TT=971.285	No data	UNSAT TT=5.579 ASSIGNMENTS=6935 CHECKS=2066750	UNSAT TT=4.922 ASSIGNMENTS=9838 CHECKS=2101120	UNSAT TT=202.769	UNSAT TT=6.384 ASSIGNMENTS=11976 CHECKS=2275050	UNSAT TT=6.034 ASSIGNMENTS=8098 CHECKS=2430060	UNSAT TT=331.78	UNSAT TT=112.657 ASSIGNMENTS=8444 CHECKS=127594000	UNSAT TT=1426.5	UNSAT TT=1114.87
csp/tightness0.9/ normalized-rand-2-40-180-84-900-79_ext.xml	UNSAT TT=2.754	UNSAT TT=159.681 CHECKS=2659890000 NODES=182861	UNSAT TT=146.574 CHECKS=2640610000 NODES=181325	UNSAT TT=65.079	UNSAT TT=1291.62 CHECKS=2549020	UNSAT TT=648.633 CHECKS=1461950	UNSAT TT=58.123 ASSIGNMENTS=676	UNSAT TT=57.528 ASSIGNMENTS=676	UNSAT TT=9.505 CHECKS=72990000 NODES=5722	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=172.08 ASSIGNMENTS=182861 CHECKS=2659890000	UNSAT TT=167.602 ASSIGNMENTS=182861 CHECKS=2659890000	UNSAT TT=72.321	UNSAT TT=68.279	No data	UNSAT TT=2.901 ASSIGNMENTS=3557 CHECKS=1078670	UNSAT TT=3.145 ASSIGNMENTS=5835 CHECKS=1153620	UNSAT TT=183.526	UNSAT TT=4.618 ASSIGNMENTS=8796 CHECKS=1497970	UNSAT TT=2.754 ASSIGNMENTS=3740 CHECKS=1108640	UNSAT TT=36.423	UNSAT TT=96.746 ASSIGNMENTS=6289 CHECKS=99246700	UNSAT TT=517.985	UNSAT TT=307.51
csp/tightness0.9/ normalized-rand-2-40-180-84-900-80_ext.xml	UNSAT TT=3.974	UNSAT TT=50.224 CHECKS=855439000 NODES=69668	UNSAT TT=49.92 CHECKS=857833000 NODES=69877	UNSAT TT=574.272	UNSAT TT=1271.64 CHECKS=2729500	UNSAT TT=1284.72 CHECKS=2932790	UNSAT TT=58.206 ASSIGNMENTS=1354	UNSAT TT=63.269 ASSIGNMENTS=1354	UNSAT TT=9.476 CHECKS=68278100 NODES=6301	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=57.172 ASSIGNMENTS=69668 CHECKS=855439000	UNSAT TT=59.386 ASSIGNMENTS=69668 CHECKS=855439000	UNSAT TT=96.681	UNSAT TT=377.746	No data	UNSAT TT=4.328 ASSIGNMENTS=6009 CHECKS=1733950	UNSAT TT=3.974 ASSIGNMENTS=7598 CHECKS=1575290	UNSAT TT=110.914	UNSAT TT=5.734 ASSIGNMENTS=10520 CHECKS=1903800	UNSAT TT=4.951 ASSIGNMENTS=6148 CHECKS=1777340	UNSAT TT=58.56	UNSAT TT=103.494 ASSIGNMENTS=7768 CHECKS=102430000	UNSAT TT=374.199	UNSAT TT=430.285
csp/tightness0.9/ normalized-rand-2-40-180-84-900-8_ext.xml	SAT TT=0.737	SAT TT=1.159 CHECKS=338410 NODES=81	SAT TT=1.203 CHECKS=815258 NODES=77	SAT TT=8.941	SAT TT=32.047 CHECKS=73738	SAT TT=423.407 CHECKS=1367890	SAT TT=37.778 ASSIGNMENTS=68	SAT TT=40.417 ASSIGNMENTS=68	SAT TT=3.321 CHECKS=6476090 NODES=964	? (TO) TT=1800.01	? (TO) TT=1800	SAT TT=0.754 ASSIGNMENTS=1201 CHECKS=241911	SAT TT=0.737 ASSIGNMENTS=1201 CHECKS=241911	SAT TT=41.482	SAT TT=40.945	No data	SAT TT=0.771 ASSIGNMENTS=1172 CHECKS=236580	SAT TT=1.306 ASSIGNMENTS=3797 CHECKS=484710	SAT TT=79.696	SAT TT=3.405 ASSIGNMENTS=7602 CHECKS=1052690	SAT TT=0.785 ASSIGNMENTS=1201 CHECKS=241911	SAT TT=35.639	SAT TT=6.735 ASSIGNMENTS=910 CHECKS=6642070	SAT TT=12.157	SAT TT=304.633
csp/tightness0.9/ normalized-rand-2-40-180-84-900-91_ext.xml	SAT TT=0.354	SAT TT=2.726 CHECKS=26497700 NODES=2486	SAT TT=2.908 CHECKS=26916900 NODES=2459	SAT TT=16.584	SAT TT=13.865 CHECKS=19349	SAT TT=18.032 CHECKS=22827	SAT TT=41.069 ASSIGNMENTS=90	SAT TT=38.181 ASSIGNMENTS=90	SAT TT=2.587 CHECKS=284009 NODES=63	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=0.363 ASSIGNMENTS=163 CHECKS=34597	SAT TT=0.403 ASSIGNMENTS=163 CHECKS=34597	SAT TT=36.486	SAT TT=25.449	No data	SAT TT=1.818 ASSIGNMENTS=3015 CHECKS=690912	SAT TT=1.856 ASSIGNMENTS=4887 CHECKS=747376	SAT TT=34.495	SAT TT=3.774 ASSIGNMENTS=7696 CHECKS=1126120	SAT TT=0.354 ASSIGNMENTS=163 CHECKS=34597	SAT TT=54.833	SAT TT=2.462 ASSIGNMENTS=254 CHECKS=1353100	SAT TT=13.283	SAT TT=276.205
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.9/ normalized-rand-2-40-180-84-900-93_ext.xml	UNSAT TT=0.849	UNSAT TT=15.801 CHECKS=255638000 NODES=23545	UNSAT TT=15.903 CHECKS=257350000 NODES=23599	UNSAT TT=540.106	UNSAT TT=296.629 CHECKS=424731	UNSAT TT=274.433 CHECKS=422385	UNSAT TT=47.431 ASSIGNMENTS=116	UNSAT TT=47.369 ASSIGNMENTS=116	UNSAT TT=3.686 CHECKS=10178300 NODES=957	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.955 ASSIGNMENTS=899 CHECKS=206021	UNSAT TT=0.982 ASSIGNMENTS=899 CHECKS=206021	UNSAT TT=42.265	UNSAT TT=26.639	No data	UNSAT TT=0.849 ASSIGNMENTS=1028 CHECKS=203804	UNSAT TT=1.779 ASSIGNMENTS=4400 CHECKS=541788	UNSAT TT=20.28	UNSAT TT=3.883 ASSIGNMENTS=7445 CHECKS=962060	UNSAT TT=0.945 ASSIGNMENTS=899 CHECKS=206021	UNSAT TT=16.068	UNSAT TT=13.337 ASSIGNMENTS=837 CHECKS=13493000	UNSAT TT=20.84	UNSAT TT=26.419
csp/travellingSalesman-20/ normalized-tsp-20-142_ext.xml	SAT TT=10.242	SAT TT=10.242 CHECKS=9218830 NODES=15329	SAT TT=20.578 CHECKS=21333800 NODES=34447	SAT TT=53.443	? (TO) TT=1800.02	SAT TT=675.219 CHECKS=5830190	SAT TT=75.984 ASSIGNMENTS=6158	SAT TT=21.665 ASSIGNMENTS=99	SAT TT=94.388 CHECKS=416661000 NODES=9376	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=25.065 ASSIGNMENTS=13319 CHECKS=7040200	SAT TT=16.777 ASSIGNMENTS=15329 CHECKS=9218830	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=32.703 CHECKS=6168390	SAT TT=23.967 ASSIGNMENTS=19287 CHECKS=10293700	SAT TT=8.719 ASSIGNMENTS=7688 CHECKS=3634910	? (problem) TT=3.36	SAT TT=77.149 ASSIGNMENTS=53190 CHECKS=28084900	SAT TT=17.69 ASSIGNMENTS=13319 CHECKS=7040200	? TT=324.053	SAT TT=975.861 ASSIGNMENTS=9951 CHECKS=897751000	SAT TT=185.403	SAT TT=489.51
csp/travellingSalesman-20/ normalized-tsp-20-190_ext.xml	SAT TT=1.151	SAT TT=3.439 CHECKS=2188490 NODES=5756	SAT TT=4.076 CHECKS=2730900 NODES=6575	SAT TT=9.297	SAT TT=60.96 CHECKS=1787300	SAT TT=73.666 CHECKS=1937770	SAT TT=11.547 ASSIGNMENTS=1959	SAT TT=9.963 ASSIGNMENTS=1679	SAT TT=59.944 CHECKS=9677140 NODES=305	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=1.236 ASSIGNMENTS=2099 CHECKS=739623	SAT TT=1.151 ASSIGNMENTS=2099 CHECKS=739623	SAT TT=664.347	SAT TT=887.381	SAT TT=3.369 CHECKS=801590	SAT TT=1.424 ASSIGNMENTS=2362 CHECKS=865825	SAT TT=4.023 ASSIGNMENTS=7277 CHECKS=2487280	? (problem) TT=2.491	SAT TT=8.117 ASSIGNMENTS=14641 CHECKS=5384060	SAT TT=1.216 ASSIGNMENTS=2099 CHECKS=739623	? TT=709.602	SAT TT=363.049 ASSIGNMENTS=10233 CHECKS=444469000	SAT TT=73.262	SAT TT=91.892
csp/travellingSalesman-20/ normalized-tsp-20-193_ext.xml	SAT TT=2.552	SAT TT=54.53 CHECKS=62746000 NODES=67406	SAT TT=2.552 CHECKS=1511900 NODES=1281	SAT TT=540.98	SAT TT=1712.83 CHECKS=27330400	? (TO) TT=1800.05	SAT TT=33.015 ASSIGNMENTS=71	SAT TT=46.048 ASSIGNMENTS=978	SAT TT=126.635 CHECKS=855654000 NODES=10435	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=60.142 ASSIGNMENTS=67406 CHECKS=62746000	SAT TT=60.494 ASSIGNMENTS=67406 CHECKS=62746000	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=7.362 CHECKS=1140660	SAT TT=4.821 ASSIGNMENTS=2295 CHECKS=1368850	SAT TT=14.805 ASSIGNMENTS=8925 CHECKS=4463300	? (exit code) TT=4.655	SAT TT=140.605 ASSIGNMENTS=68223 CHECKS=33556500	SAT TT=46.212 ASSIGNMENTS=22866 CHECKS=12811200	? TT=389.161	? (TO) TT=1800.1	SAT TT=194.551	SAT TT=205.286
csp/travellingSalesman-20/ normalized-tsp-20-1_ext.xml	SAT TT=0.181	SAT TT=1.236 CHECKS=150571 NODES=313	SAT TT=1.698 CHECKS=728854 NODES=300	SAT TT=1.819	SAT TT=51.398 CHECKS=1149590	SAT TT=9.095 CHECKS=54257	SAT TT=4.438 ASSIGNMENTS=24	SAT TT=4.799 ASSIGNMENTS=77	SAT TT=61.6 CHECKS=9497300 NODES=209	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=0.225 ASSIGNMENTS=193 CHECKS=101838	SAT TT=0.226 ASSIGNMENTS=193 CHECKS=101838	SAT TT=497.808	SAT TT=391.411	SAT TT=0.498 CHECKS=65472	SAT TT=0.181 ASSIGNMENTS=163 CHECKS=81350	SAT TT=1.14 ASSIGNMENTS=1617 CHECKS=584545	? (problem) TT=2.523	SAT TT=1.65 ASSIGNMENTS=1666 CHECKS=798510	SAT TT=0.213 ASSIGNMENTS=193 CHECKS=101838	? TT=429.417	SAT TT=335.035 ASSIGNMENTS=310 CHECKS=467160000	SAT TT=51.467	SAT TT=75.115
csp/travellingSalesman-20/ normalized-tsp-20-29_ext.xml	SAT TT=0.061	SAT TT=1.07 CHECKS=55615 NODES=114	SAT TT=1.571 CHECKS=415924 NODES=82	SAT TT=1.018	SAT TT=21.622 CHECKS=697377	SAT TT=4.491 CHECKS=37365	SAT TT=3.057 ASSIGNMENTS=8	SAT TT=3.24 ASSIGNMENTS=14	SAT TT=61.109 CHECKS=7274290 NODES=106	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=0.078 ASSIGNMENTS=35 CHECKS=22156	SAT TT=0.077 ASSIGNMENTS=35 CHECKS=22156	SAT TT=308.944	SAT TT=400.892	SAT TT=0.26 CHECKS=28746	SAT TT=0.061 ASSIGNMENTS=36 CHECKS=22435	SAT TT=0.403 ASSIGNMENTS=716 CHECKS=274860	? (problem) TT=1.851	SAT TT=1.482 ASSIGNMENTS=2706 CHECKS=1013960	SAT TT=0.066 ASSIGNMENTS=35 CHECKS=22156	? TT=926.379	SAT TT=136.002 ASSIGNMENTS=227 CHECKS=277677000	SAT TT=30.113	SAT TT=51.681
csp/travellingSalesman-20/ normalized-tsp-20-2_ext.xml	SAT TT=0.498	SAT TT=2.875 CHECKS=1411860 NODES=2851	SAT TT=4.368 CHECKS=3093010 NODES=6051	SAT TT=6.885	SAT TT=244.535 CHECKS=6732120	SAT TT=53.079 CHECKS=603545	SAT TT=10.327 ASSIGNMENTS=41	SAT TT=32.294 ASSIGNMENTS=5829	SAT TT=68.168 CHECKS=81058300 NODES=3196	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=0.512 ASSIGNMENTS=412 CHECKS=202419	SAT TT=0.508 ASSIGNMENTS=412 CHECKS=202419	SAT TT=1579.05	SAT TT=971.699	SAT TT=8.669 CHECKS=1915480	SAT TT=2.898 ASSIGNMENTS=2591 CHECKS=1192980	SAT TT=3.556 ASSIGNMENTS=4241 CHECKS=1467260	? (problem) TT=3.457	SAT TT=19.667 ASSIGNMENTS=18942 CHECKS=8008830	SAT TT=0.498 ASSIGNMENTS=412 CHECKS=202419	? TT=318.289	SAT TT=747.122 ASSIGNMENTS=3799 CHECKS=600519000	SAT TT=79.588	SAT TT=186.015
csp/travellingSalesman-20/ normalized-tsp-20-30_ext.xml	SAT TT=0.084	SAT TT=1.02 CHECKS=87176 NODES=128	SAT TT=1.382 CHECKS=579593 NODES=106	SAT TT=1.557	SAT TT=52.268 CHECKS=899367	SAT TT=8.865 CHECKS=40889	SAT TT=7.596 ASSIGNMENTS=155	SAT TT=7.515 ASSIGNMENTS=65	SAT TT=61.734 CHECKS=7791010 NODES=90	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=0.14 ASSIGNMENTS=90 CHECKS=47102	SAT TT=0.136 ASSIGNMENTS=90 CHECKS=47102	SAT TT=527.82	SAT TT=606.612	SAT TT=0.31 CHECKS=26705	SAT TT=0.084 ASSIGNMENTS=48 CHECKS=27579	SAT TT=2.179 ASSIGNMENTS=3453 CHECKS=1222830	? (problem) TT=2.248	SAT TT=10.869 ASSIGNMENTS=13649 CHECKS=5999530	SAT TT=0.124 ASSIGNMENTS=90 CHECKS=47102	? (exit code) TT=689.05	SAT TT=165.595 ASSIGNMENTS=237 CHECKS=342440000	SAT TT=43.26	SAT TT=67.13
csp/travellingSalesman-20/ normalized-tsp-20-366_ext.xml	SAT TT=0.847	SAT TT=14.939 CHECKS=12285300 NODES=26549	SAT TT=11.497 CHECKS=8946030 NODES=19124	SAT TT=49.665	SAT TT=303.318 CHECKS=8828180	SAT TT=104.221 CHECKS=1367690	SAT TT=14.989 ASSIGNMENTS=75	SAT TT=21.281 ASSIGNMENTS=1455	SAT TT=65.125 CHECKS=47412300 NODES=1804	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=0.847 ASSIGNMENTS=777 CHECKS=353892	SAT TT=0.849 ASSIGNMENTS=777 CHECKS=353892	SAT TT=1618.04	? (TO) TT=1800.05	SAT TT=9.699 CHECKS=2002110	SAT TT=1.03 ASSIGNMENTS=928 CHECKS=433979	SAT TT=0.464 ASSIGNMENTS=553 CHECKS=179499	? (problem) TT=3.335	SAT TT=9.532 ASSIGNMENTS=6967 CHECKS=3323480	SAT TT=0.849 ASSIGNMENTS=777 CHECKS=353892	? TT=384.203	SAT TT=508.933 ASSIGNMENTS=1495 CHECKS=25274100	SAT TT=87.488	SAT TT=125.738
csp/travellingSalesman-20/ normalized-tsp-20-453_ext.xml	SAT TT=4.835	SAT TT=23.8 CHECKS=22762500 NODES=43000	SAT TT=12.865 CHECKS=11750700 NODES=23906	SAT TT=4.835	SAT TT=1769.17 CHECKS=57999700	SAT TT=222.626 CHECKS=2756500	SAT TT=24.083 ASSIGNMENTS=925	SAT TT=20.584 ASSIGNMENTS=77	SAT TT=125.594 CHECKS=763309000 NODES=28370	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=42.632 ASSIGNMENTS=30270 CHECKS=14294500	SAT TT=31.129 ASSIGNMENTS=43000 CHECKS=22762500	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=101.894 CHECKS=20811900	SAT TT=12.007 ASSIGNMENTS=11596 CHECKS=5647870	SAT TT=28.356 ASSIGNMENTS=26938 CHECKS=12274800	? (problem) TT=3.347	SAT TT=52.416 ASSIGNMENTS=37820 CHECKS=18129100	SAT TT=35.201 ASSIGNMENTS=30270 CHECKS=14294500	? TT=539.362	SAT TT=1562.8 ASSIGNMENTS=24862 CHECKS=822640000	SAT TT=107.608	SAT TT=403.189
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/travellingSalesman-20/ normalized-tsp-20-68_ext.xml	SAT TT=0.037	SAT TT=0.915 CHECKS=27423 NODES=63	SAT TT=1.022 CHECKS=25468 NODES=0	SAT TT=0.465	SAT TT=0.953 CHECKS=43123	SAT TT=0.644 CHECKS=9589	SAT TT=0.726 ASSIGNMENTS=2	SAT TT=0.831 ASSIGNMENTS=2	SAT TT=60.859 CHECKS=3907940 NODES=67	SAT TT=35.719 CHECKS=29836800 NODES=76501000	? (TO) TT=1800.07	SAT TT=0.045 ASSIGNMENTS=8 CHECKS=5214	SAT TT=0.049 ASSIGNMENTS=8 CHECKS=5214	SAT TT=222.764	SAT TT=221.204	SAT TT=0.159 CHECKS=7000	SAT TT=0.037 ASSIGNMENTS=8 CHECKS=5214	SAT TT=0.036 ASSIGNMENTS=14 CHECKS=5487	? (problem) TT=1.533	SAT TT=0.041 ASSIGNMENTS=18 CHECKS=10103	SAT TT=0.038 ASSIGNMENTS=8 CHECKS=5214	SAT TT=848.183	SAT TT=31.856 ASSIGNMENTS=76 CHECKS=120644000	SAT TT=16.538	SAT TT=20.333
csp/travellingSalesman-20/ normalized-tsp-20-727_ext.xml	SAT TT=0.534	SAT TT=1.569 CHECKS=455443 NODES=842	SAT TT=1.674 CHECKS=502572 NODES=844	SAT TT=5.058	SAT TT=49.545 CHECKS=543202	SAT TT=70.492 CHECKS=564513	SAT TT=14.12 ASSIGNMENTS=260	SAT TT=31.844 ASSIGNMENTS=4049	SAT TT=69.235 CHECKS=93199500 NODES=2674	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=1.116 ASSIGNMENTS=831 CHECKS=387852	SAT TT=1.128 ASSIGNMENTS=831 CHECKS=387852	? (TO) TT=1800.03	SAT TT=600.775	SAT TT=2.555 CHECKS=438262	SAT TT=0.534 ASSIGNMENTS=368 CHECKS=189577	SAT TT=4.221 ASSIGNMENTS=4028 CHECKS=1499020	? (exit code) TT=5.079	SAT TT=28.301 ASSIGNMENTS=21220 CHECKS=9339350	SAT TT=1.106 ASSIGNMENTS=831 CHECKS=387852	? TT=358.587	SAT TT=1034.99 ASSIGNMENTS=7769 CHECKS=854726000	SAT TT=152.243	SAT TT=299.586
csp/travellingSalesman-20/ normalized-tsp-20-75_ext.xml	SAT TT=2.21	SAT TT=3.759 CHECKS=2698900 NODES=3331	SAT TT=4.407 CHECKS=3738990 NODES=4646	SAT TT=73.535	SAT TT=601.043 CHECKS=14335900	SAT TT=719.874 CHECKS=6059460	SAT TT=21.146 ASSIGNMENTS=691	SAT TT=87.787 ASSIGNMENTS=12780	SAT TT=106.194 CHECKS=595741000 NODES=9695	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=9.507 ASSIGNMENTS=1817 CHECKS=952951	SAT TT=10.817 ASSIGNMENTS=3331 CHECKS=2698900	SAT TT=1421.2	? (TO) TT=1800	SAT TT=2.306 CHECKS=386199	SAT TT=3.225 ASSIGNMENTS=2465 CHECKS=1300540	SAT TT=6.744 ASSIGNMENTS=6131 CHECKS=2685810	? (problem) TT=3.385	SAT TT=57.926 ASSIGNMENTS=42050 CHECKS=20724000	SAT TT=2.21 ASSIGNMENTS=1817 CHECKS=952951	? TT=375.49	SAT TT=913.522 ASSIGNMENTS=2278 CHECKS=742750000	SAT TT=226.043	SAT TT=258.672
csp/travellingSalesman-20/ normalized-tsp-20-76_ext.xml	SAT TT=1.483	SAT TT=2.685 CHECKS=1311540 NODES=3635	SAT TT=2.225 CHECKS=988345 NODES=1822	SAT TT=3.659	SAT TT=96.672 CHECKS=2429350	SAT TT=76.205 CHECKS=1074660	SAT TT=16.031 ASSIGNMENTS=1399	SAT TT=18.445 ASSIGNMENTS=1622	SAT TT=69.064 CHECKS=80899200 NODES=4671	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=10.923 ASSIGNMENTS=3539 CHECKS=1619760	SAT TT=10.034 ASSIGNMENTS=3635 CHECKS=1311540	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=17.342 CHECKS=3696110	SAT TT=1.483 ASSIGNMENTS=1551 CHECKS=646622	SAT TT=4.069 ASSIGNMENTS=4828 CHECKS=1736260	? (problem) TT=3.435	SAT TT=18.76 ASSIGNMENTS=17805 CHECKS=8010070	SAT TT=3.617 ASSIGNMENTS=3539 CHECKS=1619760	? (TO) TT=1802.16	SAT TT=839.087 ASSIGNMENTS=5073 CHECKS=513133000	SAT TT=97.944	SAT TT=453.966
csp/travellingSalesman-20/ normalized-tsp-20-8_ext.xml	SAT TT=0.062	SAT TT=1.267 CHECKS=137754 NODES=286	SAT TT=1.117 CHECKS=273165 NODES=0	SAT TT=0.792	SAT TT=40.93 CHECKS=1095950	SAT TT=8.458 CHECKS=126197	SAT TT=4.603 ASSIGNMENTS=16	SAT TT=4.909 ASSIGNMENTS=40	SAT TT=61.489 CHECKS=6093430 NODES=78	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.08 ASSIGNMENTS=42 CHECKS=25297	SAT TT=0.076 ASSIGNMENTS=42 CHECKS=25297	SAT TT=319.669	SAT TT=350.046	SAT TT=0.315 CHECKS=34882	SAT TT=0.062 ASSIGNMENTS=40 CHECKS=24174	SAT TT=0.604 ASSIGNMENTS=1201 CHECKS=414812	? (problem) TT=1.953	SAT TT=2.04 ASSIGNMENTS=2881 CHECKS=1225080	SAT TT=0.067 ASSIGNMENTS=42 CHECKS=25297	? (TO) TT=1800.18	SAT TT=129.223 ASSIGNMENTS=183 CHECKS=292563000	SAT TT=30.283	SAT TT=60.079
csp/travellingSalesman-20/ normalized-tsp-20-901_ext.xml	SAT TT=4.18	SAT TT=7.178 CHECKS=5921700 NODES=9633	SAT TT=7.123 CHECKS=5920580 NODES=8752	SAT TT=16.594	SAT TT=567.789 CHECKS=15155300	SAT TT=50.539 CHECKS=432921	SAT TT=21.538 ASSIGNMENTS=691	SAT TT=44.929 ASSIGNMENTS=2222	SAT TT=81.998 CHECKS=257332000 NODES=7478	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=12.038 ASSIGNMENTS=3548 CHECKS=1892880	SAT TT=14.475 ASSIGNMENTS=9633 CHECKS=5921700	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=16.911 CHECKS=2928260	SAT TT=5.582 ASSIGNMENTS=4510 CHECKS=2307920	SAT TT=9.234 ASSIGNMENTS=8237 CHECKS=3818210	? (problem) TT=3.85	SAT TT=40.4 ASSIGNMENTS=27731 CHECKS=13489700	SAT TT=4.18 ASSIGNMENTS=3548 CHECKS=1892880	? TT=386.497	SAT TT=1755.52 ASSIGNMENTS=23498 CHECKS=1111920000	SAT TT=162.054	SAT TT=170.213
csp/travellingSalesman-25/ normalized-tsp-25-13_ext.xml	SAT TT=0.601	SAT TT=2.191 CHECKS=1079220 NODES=1423	SAT TT=2.539 CHECKS=1798740 NODES=1559	SAT TT=5.87	SAT TT=53.293 CHECKS=2379720	SAT TT=22.963 CHECKS=556130	SAT TT=9.261 ASSIGNMENTS=457	SAT TT=7.441 ASSIGNMENTS=88	SAT TT=63.501 CHECKS=30946800 NODES=996	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=0.64 ASSIGNMENTS=586 CHECKS=507534	SAT TT=0.649 ASSIGNMENTS=586 CHECKS=507534	SAT TT=525.698	SAT TT=982.817	SAT TT=3.929 CHECKS=1044070	SAT TT=0.601 ASSIGNMENTS=537 CHECKS=498017	SAT TT=1.718 ASSIGNMENTS=2726 CHECKS=1477440	? (problem) TT=2.535	SAT TT=12.748 ASSIGNMENTS=17546 CHECKS=10955700	SAT TT=0.637 ASSIGNMENTS=586 CHECKS=507534	? TT=277.68	SAT TT=515.728 ASSIGNMENTS=2167 CHECKS=427624000	SAT TT=101.243	SAT TT=204.16
csp/travellingSalesman-25/ normalized-tsp-25-163_ext.xml	SAT TT=30.541	SAT TT=233.006 CHECKS=253863000 NODES=278834	SAT TT=225.334 CHECKS=245694000 NODES=276748	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=199.114 ASSIGNMENTS=15783	SAT TT=1219.7 ASSIGNMENTS=127815	SAT TT=69.97 CHECKS=101620000 NODES=1822	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=232.574 ASSIGNMENTS=278834 CHECKS=253863000	SAT TT=227.297 ASSIGNMENTS=278834 CHECKS=253863000	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=30.541 CHECKS=6163350	SAT TT=102.723 ASSIGNMENTS=54066 CHECKS=37747700	SAT TT=117.664 ASSIGNMENTS=69322 CHECKS=47735500	? (exit code) TT=6.382	SAT TT=238.5 ASSIGNMENTS=130859 CHECKS=93535300	SAT TT=71.373 ASSIGNMENTS=39660 CHECKS=28357600	? (TO) TT=1802.19	? (TO) TT=1800.06	SAT TT=974.008	SAT TT=674.203
csp/travellingSalesman-25/ normalized-tsp-25-190_ext.xml	SAT TT=8.242	SAT TT=84.627 CHECKS=92426700 NODES=133713	SAT TT=78.199 CHECKS=91213500 NODES=130982	SAT TT=305.656	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=220.4 ASSIGNMENTS=34096	SAT TT=31.949 ASSIGNMENTS=1055	SAT TT=97.439 CHECKS=379382000 NODES=14056	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=15.967 ASSIGNMENTS=7136 CHECKS=4386280	SAT TT=85.524 ASSIGNMENTS=133713 CHECKS=92426700	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=251.611 CHECKS=51777300	SAT TT=48.065 ASSIGNMENTS=40657 CHECKS=25303500	SAT TT=53.75 ASSIGNMENTS=51168 CHECKS=32026800	? (problem) TT=3.697	SAT TT=124.375 ASSIGNMENTS=103237 CHECKS=65835200	SAT TT=8.242 ASSIGNMENTS=7136 CHECKS=4386280	? TT=300.691	? (TO) TT=1800.07	SAT TT=1152.68	SAT TT=1001.65
csp/travellingSalesman-25/ normalized-tsp-25-312_ext.xml	SAT TT=28.665	SAT TT=34.638 CHECKS=33646900 NODES=46902	SAT TT=28.665 CHECKS=27625300 NODES=41092	SAT TT=113.687	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=343.335 ASSIGNMENTS=48477	SAT TT=65.812 ASSIGNMENTS=3518	SAT TT=110.582 CHECKS=512206000 NODES=17119	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=40.883 ASSIGNMENTS=28169 CHECKS=18077500	SAT TT=38.304 ASSIGNMENTS=46902 CHECKS=33646900	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=84.161 CHECKS=18173900	SAT TT=77.782 ASSIGNMENTS=59683 CHECKS=39108800	SAT TT=104.706 ASSIGNMENTS=82081 CHECKS=53555400	? (problem) TT=4.45	SAT TT=108.21 ASSIGNMENTS=81072 CHECKS=54531000	SAT TT=36.418 ASSIGNMENTS=28169 CHECKS=18077500	? TT=310.35	? (TO) TT=1800.1	SAT TT=919.528	SAT TT=553.232
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/travellingSalesman-25/ normalized-tsp-25-38_ext.xml	SAT TT=1.25	SAT TT=4.636 CHECKS=4367910 NODES=4658	SAT TT=2.077 CHECKS=1372170 NODES=759	SAT TT=8.603	SAT TT=48.842 CHECKS=1211410	SAT TT=87.543 CHECKS=1725220	SAT TT=15.036 ASSIGNMENTS=585	SAT TT=18.07 ASSIGNMENTS=1200	SAT TT=66.748 CHECKS=60173900 NODES=2439	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=1.34 ASSIGNMENTS=1363 CHECKS=1044830	SAT TT=1.355 ASSIGNMENTS=1363 CHECKS=1044830	SAT TT=622.083	SAT TT=956.936	SAT TT=12.118 CHECKS=2881900	SAT TT=1.487 ASSIGNMENTS=1471 CHECKS=1137290	SAT TT=2.857 ASSIGNMENTS=4006 CHECKS=2111720	? (problem) TT=2.59	SAT TT=20.493 ASSIGNMENTS=25748 CHECKS=16179300	SAT TT=1.25 ASSIGNMENTS=1363 CHECKS=1044830	? TT=379.382	SAT TT=630 ASSIGNMENTS=3563 CHECKS=523083000	SAT TT=108.604	SAT TT=111.123
csp/travellingSalesman-25/ normalized-tsp-25-3_ext.xml	SAT TT=0.957	SAT TT=2.566 CHECKS=1555160 NODES=2427	SAT TT=2.754 CHECKS=1630700 NODES=2176	SAT TT=19.438	SAT TT=169.158 CHECKS=6890250	SAT TT=29.659 CHECKS=545588	SAT TT=11.818 ASSIGNMENTS=315	SAT TT=11.903 ASSIGNMENTS=306	SAT TT=62.491 CHECKS=17013400 NODES=369	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=1.306 ASSIGNMENTS=1138 CHECKS=958470	SAT TT=1.318 ASSIGNMENTS=1138 CHECKS=958470	SAT TT=1083.22	SAT TT=995.618	SAT TT=7.618 CHECKS=1912290	SAT TT=0.957 ASSIGNMENTS=812 CHECKS=640423	SAT TT=3.629 ASSIGNMENTS=4239 CHECKS=2406170	? (problem) TT=2.91	SAT TT=22.268 ASSIGNMENTS=23031 CHECKS=15955700	SAT TT=1.392 ASSIGNMENTS=1138 CHECKS=958470	? TT=290.914	SAT TT=603.501 ASSIGNMENTS=3637 CHECKS=412463000	SAT TT=103.758	SAT TT=65.753
csp/travellingSalesman-25/ normalized-tsp-25-456_ext.xml	SAT TT=46.001	SAT TT=479.281 CHECKS=416315000 NODES=786780	SAT TT=119.892 CHECKS=103716000 NODES=201812	SAT TT=48.808	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=227.317 ASSIGNMENTS=23374	SAT TT=501.047 ASSIGNMENTS=56787	SAT TT=119.883 CHECKS=633761000 NODES=18153	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=53.805 ASSIGNMENTS=27953 CHECKS=19009000	SAT TT=288.549 ASSIGNMENTS=27953 CHECKS=19009000	? (TO) TT=1800.08	SAT TT=1316.55	SAT TT=189.929 CHECKS=34704300	SAT TT=57.267 ASSIGNMENTS=36279 CHECKS=23174800	SAT TT=98.152 ASSIGNMENTS=67970 CHECKS=41768600	? (problem) TT=4.198	SAT TT=88.537 ASSIGNMENTS=54605 CHECKS=36191600	SAT TT=46.001 ASSIGNMENTS=27953 CHECKS=19009000	? TT=498.581	? (TO) TT=1800.07	SAT TT=677.635	SAT TT=491.277
csp/travellingSalesman-25/ normalized-tsp-25-48_ext.xml	SAT TT=6.998	SAT TT=150.584 CHECKS=166718000 NODES=200370	SAT TT=297.661 CHECKS=324799000 NODES=412625	? (TO) TT=1800.1	SAT TT=974.08 CHECKS=28519400	? (TO) TT=1800.08	SAT TT=745.284 ASSIGNMENTS=113458	SAT TT=685.334 ASSIGNMENTS=79258	SAT TT=231.719 CHECKS=1649490000 NODES=66348	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=154.565 ASSIGNMENTS=200370 CHECKS=166718000	SAT TT=145.812 ASSIGNMENTS=200370 CHECKS=166718000	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=288.794 CHECKS=55720800	SAT TT=15.667 ASSIGNMENTS=13915 CHECKS=8292820	SAT TT=226.105 ASSIGNMENTS=166815 CHECKS=97254200	? (problem) TT=4.309	SAT TT=158.234 ASSIGNMENTS=119858 CHECKS=75254300	SAT TT=6.998 ASSIGNMENTS=5528 CHECKS=3262660	? TT=297.374	? (TO) TT=1800.1	SAT TT=541.317	SAT TT=780.969
csp/travellingSalesman-25/ normalized-tsp-25-523_ext.xml	SAT TT=3.199	SAT TT=42.131 CHECKS=41220300 NODES=70107	SAT TT=112.781 CHECKS=111180000 NODES=186041	SAT TT=57.901	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=202.175 ASSIGNMENTS=34627	SAT TT=135.822 ASSIGNMENTS=20459	SAT TT=712.675 CHECKS=6284450000 NODES=369813	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=34.09 ASSIGNMENTS=24701 CHECKS=14158200	SAT TT=49.232 ASSIGNMENTS=70107 CHECKS=41220300	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=257.594 CHECKS=58240800	SAT TT=3.199 ASSIGNMENTS=2781 CHECKS=1685930	SAT TT=19.931 ASSIGNMENTS=19492 CHECKS=11381800	? (problem) TT=3.977	SAT TT=107.332 ASSIGNMENTS=99763 CHECKS=59854400	SAT TT=26.292 ASSIGNMENTS=24701 CHECKS=14158200	? TT=344.602	? (TO) TT=1800.12	SAT TT=1655.33	SAT TT=908.703
csp/travellingSalesman-25/ normalized-tsp-25-54_ext.xml	SAT TT=0.512	SAT TT=1.416 CHECKS=412071 NODES=432	SAT TT=1.883 CHECKS=947880 NODES=134	SAT TT=4.494	SAT TT=38.083 CHECKS=1432860	SAT TT=19.789 CHECKS=315283	SAT TT=5.535 ASSIGNMENTS=24	SAT TT=5.212 ASSIGNMENTS=55	SAT TT=63.363 CHECKS=26943500 NODES=1326	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=0.664 ASSIGNMENTS=640 CHECKS=417477	SAT TT=0.657 ASSIGNMENTS=640 CHECKS=417477	SAT TT=471.178	SAT TT=714.616	SAT TT=2.542 CHECKS=623993	SAT TT=0.52 ASSIGNMENTS=486 CHECKS=364152	SAT TT=0.442 ASSIGNMENTS=658 CHECKS=330094	? (problem) TT=2.534	SAT TT=6.606 ASSIGNMENTS=10828 CHECKS=5522150	SAT TT=0.597 ASSIGNMENTS=640 CHECKS=417477	? (exit code) TT=303.238	SAT TT=188.524 ASSIGNMENTS=108 CHECKS=5415000	SAT TT=67.067	SAT TT=67.766
csp/travellingSalesman-25/ normalized-tsp-25-561_ext.xml	SAT TT=4.074	SAT TT=4.074 CHECKS=3005660 NODES=4342	SAT TT=21.122 CHECKS=26034100 NODES=31070	SAT TT=90.067	? (TO) TT=1800.02	SAT TT=832.061 CHECKS=11624000	SAT TT=43.493 ASSIGNMENTS=1756	SAT TT=75.279 ASSIGNMENTS=7125	SAT TT=70.478 CHECKS=104823000 NODES=3032	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=15.15 ASSIGNMENTS=5831 CHECKS=3568410	SAT TT=11.491 ASSIGNMENTS=4342 CHECKS=3005660	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=52.256 CHECKS=11261500	SAT TT=5.045 ASSIGNMENTS=3879 CHECKS=2625400	SAT TT=17.359 ASSIGNMENTS=13591 CHECKS=9336340	? (problem) TT=4.063	SAT TT=49.235 ASSIGNMENTS=28744 CHECKS=21876400	SAT TT=7.169 ASSIGNMENTS=5831 CHECKS=3568410	? TT=360.515	SAT TT=1688.72 ASSIGNMENTS=1895 CHECKS=680034000	SAT TT=329.202	SAT TT=213.395
csp/travellingSalesman-25/ normalized-tsp-25-66_ext.xml	SAT TT=0.317	SAT TT=1.966 CHECKS=720062 NODES=1185	SAT TT=1.626 CHECKS=434240 NODES=361	SAT TT=3.146	SAT TT=54.164 CHECKS=2249880	SAT TT=28.646 CHECKS=871493	SAT TT=10.624 ASSIGNMENTS=530	SAT TT=10.395 ASSIGNMENTS=105	SAT TT=62.007 CHECKS=14287800 NODES=520	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=0.509 ASSIGNMENTS=625 CHECKS=392033	SAT TT=0.511 ASSIGNMENTS=625 CHECKS=392033	SAT TT=357.282	SAT TT=344.788	SAT TT=3.495 CHECKS=1070320	SAT TT=2.46 ASSIGNMENTS=3110 CHECKS=2093820	SAT TT=1.552 ASSIGNMENTS=2587 CHECKS=1249550	? (problem) TT=2.003	SAT TT=16.845 ASSIGNMENTS=22087 CHECKS=12976700	SAT TT=0.495 ASSIGNMENTS=625 CHECKS=392033	? (exit code) TT=479.173	SAT TT=172.768 ASSIGNMENTS=264 CHECKS=375958000	SAT TT=32.277	SAT TT=71.388
csp/travellingSalesman-25/ normalized-tsp-25-681_ext.xml	SAT TT=45.928	SAT TT=45.928 CHECKS=43862700 NODES=66094	SAT TT=79.278 CHECKS=77594100 NODES=116988	SAT TT=276.753	SAT TT=569.302 CHECKS=23597100	? (TO) TT=1800.05	SAT TT=141.997 ASSIGNMENTS=17903	SAT TT=82.457 ASSIGNMENTS=7372	SAT TT=322.927 CHECKS=2663680000 NODES=118028	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=75.263 ASSIGNMENTS=57891 CHECKS=40450000	SAT TT=49.947 ASSIGNMENTS=66094 CHECKS=43862700	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=115.048 CHECKS=24357600	SAT TT=61.643 ASSIGNMENTS=48393 CHECKS=34319000	SAT TT=65.293 ASSIGNMENTS=56215 CHECKS=38340000	? (problem) TT=4.539	SAT TT=84.272 ASSIGNMENTS=67197 CHECKS=45101800	SAT TT=66.883 ASSIGNMENTS=57891 CHECKS=40450000	? TT=500.417	? (TO) TT=1800.05	SAT TT=518.846	SAT TT=1333.29
csp/travellingSalesman-25/ normalized-tsp-25-715_ext.xml	SAT TT=184.488	SAT TT=446.391 CHECKS=454181000 NODES=568001	SAT TT=271.525 CHECKS=284879000 NODES=338824	SAT TT=568.085	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=682.113 ASSIGNMENTS=65222	? (TO) TT=1800.13	SAT TT=227.11 CHECKS=1920630000 NODES=41304	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=196.048 ASSIGNMENTS=114025 CHECKS=85295500	SAT TT=417.469 ASSIGNMENTS=114025 CHECKS=85295500	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=398.841 CHECKS=77697700	SAT TT=346.066 ASSIGNMENTS=222639 CHECKS=158463000	SAT TT=40.029 ASSIGNMENTS=25261 CHECKS=19380400	? (problem) TT=3.81	SAT TT=248.577 ASSIGNMENTS=144009 CHECKS=113010000	SAT TT=184.488 ASSIGNMENTS=114025 CHECKS=85295500	? TT=384.098	? (TO) TT=1800.08	SAT TT=1113.77	SAT TT=480.475
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/travellingSalesman-25/ normalized-tsp-25-843_ext.xml	SAT TT=17.836	SAT TT=28.987 CHECKS=27667000 NODES=40479	SAT TT=33.106 CHECKS=31827200 NODES=46706	SAT TT=17.836	SAT TT=503.377 CHECKS=23112300	SAT TT=841.778 CHECKS=15113300	SAT TT=41.96 ASSIGNMENTS=3536	SAT TT=71.354 ASSIGNMENTS=4920	SAT TT=79.303 CHECKS=189322000 NODES=5868	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=39.324 ASSIGNMENTS=27437 CHECKS=18693900	SAT TT=34.453 ASSIGNMENTS=40479 CHECKS=27667000	SAT TT=1750.43	SAT TT=1573.32	SAT TT=187.681 CHECKS=37074400	SAT TT=20.125 ASSIGNMENTS=16360 CHECKS=11354100	SAT TT=36.722 ASSIGNMENTS=32898 CHECKS=21889700	? (problem) TT=2.789	SAT TT=73.339 ASSIGNMENTS=56871 CHECKS=40028800	SAT TT=29.816 ASSIGNMENTS=27437 CHECKS=18693900	? TT=304.725	SAT TT=960.188 ASSIGNMENTS=10516 CHECKS=774436000	SAT TT=205.76	SAT TT=133.742
csp/ukHerald/ normalized-crossword-m1-uk-05-02.xml	SAT TT=0.046	SAT TT=0.948 CHECKS=2899 NODES=23	SAT TT=0.915 CHECKS=2305 NODES=0	SAT TT=3.217	SAT TT=1.491 CHECKS=4152	SAT TT=1.11 CHECKS=2268	? (TO) TT=1800.08	SAT TT=1.612 ASSIGNMENTS=15	SAT TT=103.121 CHECKS=8225240 NODES=27	SAT TT=460.797 CHECKS=1447100000 NODES=1648800000	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.1	No data	SAT TT=4.211 ASSIGNMENTS=6009 CHECKS=942989	SAT TT=0.193 ASSIGNMENTS=477 CHECKS=36087	SAT TT=1.68	SAT TT=0.046 ASSIGNMENTS=9 CHECKS=1290	SAT TT=0.139 ASSIGNMENTS=159 CHECKS=18459	? (MO) TT=32.444	No data	SAT TT=17.515	SAT TT=21.08
csp/ukHerald/ normalized-crossword-m1-uk-05-05.xml	SAT TT=0.038	SAT TT=0.892 CHECKS=5817 NODES=17	SAT TT=0.873 CHECKS=8932 NODES=0	SAT TT=1.492	SAT TT=0.585 CHECKS=3876	SAT TT=0.318 CHECKS=1616	SAT TT=1.425 ASSIGNMENTS=100	SAT TT=1.02 ASSIGNMENTS=13	SAT TT=108.664 CHECKS=2733030 NODES=18	SAT TT=54.492 CHECKS=1990580 NODES=3750010	SAT TT=48.045 CHECKS=2307500 NODES=61	SAT TT=0.956 ASSIGNMENTS=4755 CHECKS=878016	SAT TT=0.897 ASSIGNMENTS=4755 CHECKS=878016	? (TO) TT=1800.03	? (TO) TT=1800.01	No data	SAT TT=1.142 ASSIGNMENTS=6468 CHECKS=1185040	SAT TT=0.459 ASSIGNMENTS=1998 CHECKS=176846	SAT TT=0.955	SAT TT=0.038 ASSIGNMENTS=31 CHECKS=2760	SAT TT=0.115 ASSIGNMENTS=234 CHECKS=27385	? (MO) TT=45.596	No data	SAT TT=6.169	SAT TT=6.93
csp/ukHerald/ normalized-crossword-m1-uk-15-01.xml	SAT TT=0.523	SAT TT=2.44 CHECKS=96913 NODES=193	SAT TT=3.612 CHECKS=197374 NODES=193	? (TO) TT=1800.06	SAT TT=13.571 CHECKS=42875	SAT TT=13.68 CHECKS=45565	SAT TT=16.976 ASSIGNMENTS=108	SAT TT=36.537 ASSIGNMENTS=72	SAT TT=271.525 CHECKS=816286000 NODES=231	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=0.595 ASSIGNMENTS=114 CHECKS=49434	SAT TT=0.681 ASSIGNMENTS=114 CHECKS=49434	? (TO) TT=1800.05	? (TO) TT=1800.06	No data	SAT TT=0.592 ASSIGNMENTS=107 CHECKS=46263	SAT TT=56.272 ASSIGNMENTS=18777 CHECKS=15974000	SAT TT=38.014	SAT TT=18.061 ASSIGNMENTS=5545 CHECKS=2916720	SAT TT=0.523 ASSIGNMENTS=88 CHECKS=43588	? (MO) TT=34.453	No data	? (TO) TT=1800.06	? (TO) TT=1800.05
csp/ukHerald/ normalized-crossword-m1-uk-15-02.xml	SAT TT=0.601	SAT TT=3.29 CHECKS=189251 NODES=341	SAT TT=3.558 CHECKS=264556 NODES=200	? (TO) TT=1800.08	SAT TT=26.614 CHECKS=282581	SAT TT=14.166 CHECKS=105858	SAT TT=20.367 ASSIGNMENTS=84	SAT TT=49.898 ASSIGNMENTS=95	SAT TT=249.371 CHECKS=568097000 NODES=304	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=1.459 ASSIGNMENTS=150 CHECKS=154585	SAT TT=1.495 ASSIGNMENTS=150 CHECKS=154585	? (TO) TT=1800.02	? (TO) TT=1800.02	No data	SAT TT=1.892 ASSIGNMENTS=174 CHECKS=213851	SAT TT=51.806 ASSIGNMENTS=18346 CHECKS=20437400	SAT TT=180.021	SAT TT=84.927 ASSIGNMENTS=25311 CHECKS=18957800	SAT TT=0.601 ASSIGNMENTS=90 CHECKS=56622	? TT=93.953	No data	? (TO) TT=1800.04	? (MO) TT=8.53
csp/ukHerald/ normalized-crossword-m1-uk-15-03.xml	SAT TT=0.435	SAT TT=3.011 CHECKS=164281 NODES=193	SAT TT=3.844 CHECKS=295964 NODES=193	SAT TT=43.554	SAT TT=23.499 CHECKS=64065	SAT TT=21.954 CHECKS=65746	SAT TT=16.759 ASSIGNMENTS=96	SAT TT=62.969 ASSIGNMENTS=85	SAT TT=211.905 CHECKS=569706000 NODES=277	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.477 ASSIGNMENTS=100 CHECKS=57505	SAT TT=0.475 ASSIGNMENTS=100 CHECKS=57505	? (TO) TT=1800.06	? (TO) TT=1800.07	No data	SAT TT=0.435 ASSIGNMENTS=100 CHECKS=57505	SAT TT=48.676 ASSIGNMENTS=32342 CHECKS=25682200	? (TO) TT=1800.01	SAT TT=57.119 ASSIGNMENTS=19822 CHECKS=13527000	SAT TT=0.461 ASSIGNMENTS=97 CHECKS=59762	? (MO) TT=32.129	No data	? (TO) TT=1800.18	? (TO) TT=1800.1
csp/ukHerald/ normalized-crossword-m1-uk-15-07.xml	SAT TT=0.72	SAT TT=3.169 CHECKS=131821 NODES=339	SAT TT=5.196 CHECKS=301246 NODES=563	? (TO) TT=1800.08	SAT TT=28.692 CHECKS=53325	SAT TT=25.231 CHECKS=41955	SAT TT=20.794 ASSIGNMENTS=81	SAT TT=57.916 ASSIGNMENTS=398	SAT TT=155.299 CHECKS=352556000 NODES=282	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=0.72 ASSIGNMENTS=93 CHECKS=52502	SAT TT=0.741 ASSIGNMENTS=93 CHECKS=52502	? (TO) TT=1800	? (TO) TT=1800.08	No data	SAT TT=0.831 ASSIGNMENTS=89 CHECKS=53188	SAT TT=76.223 ASSIGNMENTS=21195 CHECKS=18353600	SAT TT=42.588	SAT TT=60.925 ASSIGNMENTS=15212 CHECKS=8491090	SAT TT=3.478 ASSIGNMENTS=253 CHECKS=259613	? (MO) TT=32.317	No data	? (MO) TT=6.367	? (MO) TT=6.318
csp/ukHerald/ normalized-crossword-m1-uk-15-08.xml	SAT TT=0.489	SAT TT=2.831 CHECKS=175189 NODES=192	SAT TT=3.323 CHECKS=321226 NODES=193	? (TO) TT=1800.06	SAT TT=21.768 CHECKS=57960	SAT TT=20.096 CHECKS=55098	SAT TT=13.178 ASSIGNMENTS=101	SAT TT=54.732 ASSIGNMENTS=92	SAT TT=194.18 CHECKS=355224000 NODES=336	? (TO) TT=1800.03	? (TO) TT=1800	SAT TT=0.508 ASSIGNMENTS=106 CHECKS=53264	SAT TT=0.509 ASSIGNMENTS=106 CHECKS=53264	? (TO) TT=1800.01	? (TO) TT=1800.01	No data	SAT TT=0.497 ASSIGNMENTS=106 CHECKS=53264	SAT TT=34.811 ASSIGNMENTS=27410 CHECKS=21478700	? (TO) TT=1800.07	SAT TT=57.259 ASSIGNMENTS=25215 CHECKS=13960600	SAT TT=0.489 ASSIGNMENTS=113 CHECKS=53723	? TT=83.108	No data	SAT TT=1760.92	? (TO) TT=1800.04
csp/ukHerald/ normalized-crossword-m1-uk-15-09.xml	SAT TT=0.372	SAT TT=2.573 CHECKS=130241 NODES=192	SAT TT=3.334 CHECKS=240541 NODES=190	? (TO) TT=1800.12	SAT TT=21.763 CHECKS=52515	SAT TT=20.271 CHECKS=55401	SAT TT=15.21 ASSIGNMENTS=112	SAT TT=62.966 ASSIGNMENTS=104	SAT TT=196.766 CHECKS=346094000 NODES=252	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=0.414 ASSIGNMENTS=108 CHECKS=54672	SAT TT=0.441 ASSIGNMENTS=108 CHECKS=54672	? (TO) TT=1800.01	? (TO) TT=1800.1	No data	SAT TT=0.408 ASSIGNMENTS=108 CHECKS=54672	SAT TT=33.865 ASSIGNMENTS=29957 CHECKS=18910800	? (TO) TT=1800.07	SAT TT=60.154 ASSIGNMENTS=28153 CHECKS=16552900	SAT TT=0.372 ASSIGNMENTS=102 CHECKS=53487	? (MO) TT=38.593	No data	SAT TT=1323.61	? (TO) TT=1800
csp/ukHerald/ normalized-crossword-m1-uk-15-10.xml	SAT TT=0.912	SAT TT=3.116 CHECKS=154549 NODES=194	SAT TT=4.127 CHECKS=244835 NODES=194	? (TO) TT=1800.08	SAT TT=29.029 CHECKS=226542	SAT TT=13.128 CHECKS=54908	SAT TT=21.926 ASSIGNMENTS=67	SAT TT=144.075 ASSIGNMENTS=580	SAT TT=137.068 CHECKS=213827000 NODES=311	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.944 ASSIGNMENTS=99 CHECKS=107863	SAT TT=0.953 ASSIGNMENTS=99 CHECKS=107863	? (TO) TT=1800.01	? (TO) TT=1800.08	No data	SAT TT=1.12 ASSIGNMENTS=113 CHECKS=125368	SAT TT=75.587 ASSIGNMENTS=23894 CHECKS=25025700	SAT TT=1187.63	SAT TT=57.147 ASSIGNMENTS=12945 CHECKS=10499400	SAT TT=0.912 ASSIGNMENTS=89 CHECKS=95330	? TT=76.313	No data	? (MO) TT=6.336	? (MO) TT=9.609
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukHerald/ normalized-crossword-m1-uk-19-01.xml	SAT TT=0.883	SAT TT=5.176 CHECKS=562361 NODES=309	SAT TT=6.925 CHECKS=966890 NODES=309	? (TO) TT=1800.07	SAT TT=68.764 CHECKS=746010	SAT TT=27.379 CHECKS=149285	SAT TT=29.125 ASSIGNMENTS=146	SAT TT=65.627 ASSIGNMENTS=148	SAT TT=177.186 CHECKS=394318000 NODES=605	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.955 ASSIGNMENTS=168 CHECKS=175819	SAT TT=0.948 ASSIGNMENTS=168 CHECKS=175819	? (TO) TT=1800.08	? (TO) TT=1800.08	No data	SAT TT=0.883 ASSIGNMENTS=168 CHECKS=175819	SAT TT=13.812 ASSIGNMENTS=3627 CHECKS=5037440	? (TO) TT=1800.07	SAT TT=112.345 ASSIGNMENTS=37431 CHECKS=51947300	SAT TT=1.044 ASSIGNMENTS=175 CHECKS=193230	? TT=79.855	No data	? (TO) TT=1800.13	? (MO) TT=6.34
csp/ukHerald/ normalized-crossword-m1-uk-19-04.xml	SAT TT=0.884	SAT TT=4.284 CHECKS=402686 NODES=303	SAT TT=5.829 CHECKS=785714 NODES=304	? (TO) TT=1800.06	SAT TT=43.358 CHECKS=212130	SAT TT=37.909 CHECKS=184866	SAT TT=26.109 ASSIGNMENTS=178	SAT TT=64.389 ASSIGNMENTS=146	SAT TT=256.306 CHECKS=652979000 NODES=549	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=0.889 ASSIGNMENTS=173 CHECKS=151353	SAT TT=0.998 ASSIGNMENTS=173 CHECKS=151353	? (TO) TT=1800.03	? (TO) TT=1800.07	No data	SAT TT=0.884 ASSIGNMENTS=172 CHECKS=153766	SAT TT=76.836 ASSIGNMENTS=25743 CHECKS=45344000	? (TO) TT=1800.09	SAT TT=53.358 ASSIGNMENTS=10581 CHECKS=10652000	SAT TT=0.989 ASSIGNMENTS=196 CHECKS=208081	? (MO) TT=40.503	No data	? (TO) TT=1800.06	? (TO) TT=1800
csp/ukHerald/ normalized-crossword-m1-uk-19-05.xml	SAT TT=0.578	SAT TT=3.988 CHECKS=415238 NODES=294	SAT TT=5.809 CHECKS=711803 NODES=294	? (TO) TT=1800.07	SAT TT=20.76 CHECKS=199060	SAT TT=15.169 CHECKS=164919	SAT TT=30.108 ASSIGNMENTS=145	SAT TT=64.699 ASSIGNMENTS=153	SAT TT=233.301 CHECKS=532002000 NODES=352	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=0.613 ASSIGNMENTS=149 CHECKS=142805	SAT TT=0.627 ASSIGNMENTS=149 CHECKS=142805	? (TO) TT=1800.04	? (TO) TT=1800.09	No data	SAT TT=0.578 ASSIGNMENTS=149 CHECKS=142805	SAT TT=2.763 ASSIGNMENTS=808 CHECKS=1224110	? (TO) TT=1800	SAT TT=30.603 ASSIGNMENTS=9426 CHECKS=16563700	SAT TT=0.614 ASSIGNMENTS=152 CHECKS=151127	? (MO) TT=30.333	No data	? (TO) TT=1800.09	? (TO) TT=1800.04
csp/ukHerald/ normalized-crossword-m1-uk-19-08.xml	SAT TT=0.977	SAT TT=5.455 CHECKS=605917 NODES=306	SAT TT=7.162 CHECKS=1047760 NODES=301	? (TO) TT=1800.08	SAT TT=26.145 CHECKS=195273	SAT TT=17.47 CHECKS=150606	SAT TT=31.761 ASSIGNMENTS=157	SAT TT=69.351 ASSIGNMENTS=445	SAT TT=186.606 CHECKS=270481000 NODES=576	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=0.977 ASSIGNMENTS=188 CHECKS=193713	SAT TT=1.043 ASSIGNMENTS=188 CHECKS=193713	? (TO) TT=1800.09	? (TO) TT=1800.06	No data	SAT TT=1.042 ASSIGNMENTS=183 CHECKS=192874	SAT TT=3.072 ASSIGNMENTS=835 CHECKS=1164130	SAT TT=84.294	SAT TT=57.431 ASSIGNMENTS=18956 CHECKS=30979000	SAT TT=0.982 ASSIGNMENTS=165 CHECKS=174481	? (MO) TT=32.194	No data	? (MO) TT=7.03	? (TO) TT=1800.03
csp/ukHerald/ normalized-crossword-m1-uk-19-10.xml	SAT TT=0.768	SAT TT=5.392 CHECKS=620917 NODES=297	SAT TT=7.56 CHECKS=1227720 NODES=296	? (TO) TT=1800.08	SAT TT=20.186 CHECKS=256793	SAT TT=14.809 CHECKS=234835	SAT TT=32.523 ASSIGNMENTS=155	SAT TT=65.847 ASSIGNMENTS=135	SAT TT=206.331 CHECKS=533569000 NODES=508	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=0.768 ASSIGNMENTS=155 CHECKS=178397	SAT TT=0.825 ASSIGNMENTS=155 CHECKS=178397	? (TO) TT=1800.07	? (TO) TT=1800.06	No data	SAT TT=0.812 ASSIGNMENTS=155 CHECKS=178397	SAT TT=1.262 ASSIGNMENTS=384 CHECKS=531593	SAT TT=19.472	SAT TT=87.007 ASSIGNMENTS=33061 CHECKS=71046500	SAT TT=0.82 ASSIGNMENTS=147 CHECKS=189234	? TT=79.018	No data	? (TO) TT=1800.08	? (TO) TT=1800.04
csp/ukHerald/ normalized-crossword-m1-uk-21-02.xml	SAT TT=1.214	SAT TT=5.768 CHECKS=519482 NODES=374	SAT TT=8.513 CHECKS=960284 NODES=648	? (TO) TT=1800.14	SAT TT=37.847 CHECKS=229293	SAT TT=29.984 CHECKS=160252	SAT TT=35.257 ASSIGNMENTS=169	SAT TT=209.427 ASSIGNMENTS=8461	SAT TT=362.062 CHECKS=1270520000 NODES=702	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=1.36 ASSIGNMENTS=232 CHECKS=266580	SAT TT=1.354 ASSIGNMENTS=232 CHECKS=266580	? (TO) TT=1800.06	? (TO) TT=1800.08	No data	SAT TT=1.315 ASSIGNMENTS=232 CHECKS=259831	SAT TT=47.348 ASSIGNMENTS=12305 CHECKS=18195500	SAT TT=143.473	SAT TT=124.792 ASSIGNMENTS=32369 CHECKS=47701200	SAT TT=1.214 ASSIGNMENTS=180 CHECKS=209962	? TT=65.758	No data	? (TO) TT=1800.15	? (MO) TT=6.281
csp/ukHerald/ normalized-crossword-m1-uk-21-04.xml	SAT TT=5.888	SAT TT=11.48 CHECKS=1494660 NODES=2095	SAT TT=9.823 CHECKS=716755 NODES=1111	? (TO) TT=1800.16	SAT TT=59.402 CHECKS=867483	SAT TT=153.594 CHECKS=1937540	SAT TT=114.376 ASSIGNMENTS=779	? (TO) TT=1800.11	SAT TT=252.471 CHECKS=782416000 NODES=665	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=18.114 ASSIGNMENTS=1973 CHECKS=1698940	SAT TT=18.213 ASSIGNMENTS=1973 CHECKS=1698940	? (TO) TT=1800.1	? (TO) TT=1800.06	No data	SAT TT=11.017 ASSIGNMENTS=1334 CHECKS=2083100	SAT TT=58.316 ASSIGNMENTS=11441 CHECKS=17480000	? (MO) TT=37.79	SAT TT=46.807 ASSIGNMENTS=10147 CHECKS=15381800	SAT TT=5.888 ASSIGNMENTS=792 CHECKS=1339600	? TT=82.69	No data	? (TO) TT=1800.21	? (TO) TT=1800.17
csp/ukHerald/ normalized-crossword-m1-uk-23-01.xml	SAT TT=1.35	SAT TT=12.021 CHECKS=1354100 NODES=2088	SAT TT=13.91 CHECKS=1362450 NODES=1630	? (TO) TT=1800.11	SAT TT=53.6 CHECKS=763199	SAT TT=43.096 CHECKS=575273	SAT TT=69.315 ASSIGNMENTS=157	? (TO) TT=1800.06	SAT TT=175.647 CHECKS=196994000 NODES=994	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=2.01 ASSIGNMENTS=263 CHECKS=449526	SAT TT=1.884 ASSIGNMENTS=263 CHECKS=449526	? (TO) TT=1800.01	? (TO) TT=1800.08	No data	SAT TT=2.387 ASSIGNMENTS=332 CHECKS=613928	SAT TT=71.243 ASSIGNMENTS=9228 CHECKS=18808600	? (MO) TT=41.13	SAT TT=374.255 ASSIGNMENTS=54622 CHECKS=133821000	SAT TT=1.35 ASSIGNMENTS=183 CHECKS=249968	? TT=93.939	No data	? (MO) TT=7.406	? (MO) TT=6.98
csp/ukHerald/ normalized-crossword-m1-uk-23-02.xml	SAT TT=1.471	SAT TT=9.087 CHECKS=1290960 NODES=737	SAT TT=10.085 CHECKS=1446230 NODES=443	? (TO) TT=1800.15	SAT TT=47.458 CHECKS=408161	SAT TT=35.499 CHECKS=339184	SAT TT=44.654 ASSIGNMENTS=199	SAT TT=958.567 ASSIGNMENTS=30636	SAT TT=335.906 CHECKS=918327000 NODES=721	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1.681 ASSIGNMENTS=225 CHECKS=317981	SAT TT=1.942 ASSIGNMENTS=225 CHECKS=317981	? (TO) TT=1800.08	? (TO) TT=1800	No data	SAT TT=1.71 ASSIGNMENTS=227 CHECKS=322505	SAT TT=11.792 ASSIGNMENTS=2614 CHECKS=4719430	? (MO) TT=39.95	SAT TT=168.643 ASSIGNMENTS=42650 CHECKS=77359600	SAT TT=1.471 ASSIGNMENTS=209 CHECKS=300938	? TT=94.037	No data	? (MO) TT=8.12	? (MO) TT=8.17
csp/ukHerald/ normalized-crossword-m1-uk-23-07.xml	SAT TT=1.539	SAT TT=7.453 CHECKS=623282 NODES=454	SAT TT=12.283 CHECKS=1631290 NODES=877	? (TO) TT=1800.18	Signal TT=21.229	SAT TT=46.736 CHECKS=261306	SAT TT=59.87 ASSIGNMENTS=376	? (TO) TT=1800.12	SAT TT=440.563 CHECKS=1599670000 NODES=806	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=1.622 ASSIGNMENTS=192 CHECKS=278495	SAT TT=1.625 ASSIGNMENTS=192 CHECKS=278495	? (TO) TT=1800.08	? (TO) TT=1800.04	No data	SAT TT=1.539 ASSIGNMENTS=192 CHECKS=278495	SAT TT=72.53 ASSIGNMENTS=12606 CHECKS=25315800	? (MO) TT=40.64	SAT TT=418.712 ASSIGNMENTS=86335 CHECKS=163247000	SAT TT=2.155 ASSIGNMENTS=284 CHECKS=463154	? (MO) TT=36.778	No data	? (MO) TT=8	? (MO) TT=7.243
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukHerald/ normalized-crossword-m1-uk-23-09.xml	SAT TT=1.388	SAT TT=12.913 CHECKS=2032160 NODES=1459	SAT TT=15.423 CHECKS=1762240 NODES=1294	? (TO) TT=1800.12	SAT TT=53.079 CHECKS=1452100	SAT TT=41.87 CHECKS=685117	SAT TT=68.736 ASSIGNMENTS=257	SAT TT=519.31 ASSIGNMENTS=9059	SAT TT=720.149 CHECKS=3126790000 NODES=859	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=1.897 ASSIGNMENTS=232 CHECKS=622054	SAT TT=1.888 ASSIGNMENTS=232 CHECKS=622054	? (TO) TT=1800.02	? (TO) TT=1800.1	No data	SAT TT=2.341 ASSIGNMENTS=290 CHECKS=769641	SAT TT=57.252 ASSIGNMENTS=10767 CHECKS=29627900	? (MO) TT=40.3	SAT TT=232.74 ASSIGNMENTS=46448 CHECKS=129061000	SAT TT=1.388 ASSIGNMENTS=194 CHECKS=401189	? (MO) TT=35.066	No data	? (MO) TT=6.327	? (TO) TT=1800.14
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle01.xml	SAT TT=0.004	SAT TT=0.64 CHECKS=215 NODES=3	SAT TT=0.682 CHECKS=166 NODES=0	SAT TT=0.025	SAT TT=0.008 CHECKS=54	SAT TT=0.008 CHECKS=45	SAT TT=0.445 ASSIGNMENTS=4	SAT TT=0.493 ASSIGNMENTS=4	SAT TT=0.398 CHECKS=141 NODES=3	SAT TT=0.393 CHECKS=355 NODES=1	SAT TT=0.374 CHECKS=359 NODES=1	SAT TT=0.016 ASSIGNMENTS=3 CHECKS=10	SAT TT=0.015 ASSIGNMENTS=3 CHECKS=10	SAT TT=1.003	SAT TT=0.919	No data	SAT TT=0.004 ASSIGNMENTS=3 CHECKS=10	SAT TT=0.007 ASSIGNMENTS=3 CHECKS=13	SAT TT=0.27	SAT TT=0.006 ASSIGNMENTS=3 CHECKS=13	SAT TT=0.006 ASSIGNMENTS=3 CHECKS=13	SAT TT=0.903	No data	SAT TT=0.478	SAT TT=0.486
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle03.xml	SAT TT=0.026	SAT TT=0.803 CHECKS=1815 NODES=14	SAT TT=0.813 CHECKS=1513 NODES=0	SAT TT=0.349	SAT TT=0.259 CHECKS=1109	SAT TT=0.214 CHECKS=918	SAT TT=1.17 ASSIGNMENTS=80	SAT TT=1.025 ASSIGNMENTS=10	SAT TT=130.827 CHECKS=315682 NODES=14	SAT TT=70.561 CHECKS=530593 NODES=300015	SAT TT=84.724 CHECKS=761223 NODES=18	SAT TT=0.236 ASSIGNMENTS=1077 CHECKS=65303	SAT TT=0.253 ASSIGNMENTS=1077 CHECKS=65303	? (TO) TT=1800.07	? (TO) TT=1800.05	No data	SAT TT=0.226 ASSIGNMENTS=769 CHECKS=51674	SAT TT=0.027 ASSIGNMENTS=53 CHECKS=2106	SAT TT=0.635	SAT TT=0.028 ASSIGNMENTS=51 CHECKS=2632	SAT TT=0.026 ASSIGNMENTS=80 CHECKS=4357	? (TO) TT=1800.15	No data	SAT TT=1.805	SAT TT=2.543
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle04.xml	SAT TT=0.047	SAT TT=0.871 CHECKS=2467 NODES=19	SAT TT=0.887 CHECKS=5240 NODES=19	SAT TT=1.862	SAT TT=0.626 CHECKS=1738	SAT TT=0.477 CHECKS=1127	SAT TT=1.489 ASSIGNMENTS=66	SAT TT=1.215 ASSIGNMENTS=15	SAT TT=116.504 CHECKS=2756070 NODES=20	SAT TT=55.429 CHECKS=3288410 NODES=2550010	SAT TT=119.606 CHECKS=111861000 NODES=4952	SAT TT=0.375 ASSIGNMENTS=997 CHECKS=75703	SAT TT=0.354 ASSIGNMENTS=997 CHECKS=75703	? (TO) TT=1800	? (TO) TT=1800.07	No data	SAT TT=0.475 ASSIGNMENTS=1832 CHECKS=125766	SAT TT=0.182 ASSIGNMENTS=424 CHECKS=23238	SAT TT=0.96	SAT TT=0.047 ASSIGNMENTS=27 CHECKS=1367	SAT TT=0.074 ASSIGNMENTS=363 CHECKS=12708	? (MO) TT=46.073	No data	SAT TT=6.754	SAT TT=8.954
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle07.xml	SAT TT=0.076	SAT TT=0.905 CHECKS=4691 NODES=30	SAT TT=1.032 CHECKS=5537 NODES=0	SAT TT=2.087	SAT TT=0.941 CHECKS=2908	SAT TT=0.824 CHECKS=1868	SAT TT=7.555 ASSIGNMENTS=824	SAT TT=1.463 ASSIGNMENTS=22	SAT TT=121.185 CHECKS=5122460 NODES=31	SAT TT=146.875 CHECKS=195718000 NODES=294000000	SAT TT=1022.98 CHECKS=1455280000 NODES=85341	SAT TT=0.357 ASSIGNMENTS=968 CHECKS=86777	SAT TT=0.39 ASSIGNMENTS=968 CHECKS=86777	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	SAT TT=0.602 ASSIGNMENTS=1462 CHECKS=144297	SAT TT=0.171 ASSIGNMENTS=318 CHECKS=27838	SAT TT=1.392	SAT TT=0.081 ASSIGNMENTS=128 CHECKS=7361	SAT TT=0.076 ASSIGNMENTS=113 CHECKS=8072	? TT=99.585	No data	SAT TT=12.823	SAT TT=14.045
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle08.xml	SAT TT=0.113	SAT TT=1.389 CHECKS=13338 NODES=41	SAT TT=1.273 CHECKS=10461 NODES=0	SAT TT=3.552	SAT TT=1.751 CHECKS=4697	SAT TT=1.662 CHECKS=5619	SAT TT=3.061 ASSIGNMENTS=282	SAT TT=2.55 ASSIGNMENTS=28	SAT TT=121.85 CHECKS=229328 NODES=41	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=0.657 ASSIGNMENTS=1746 CHECKS=361913	SAT TT=0.659 ASSIGNMENTS=1746 CHECKS=361913	? (TO) TT=1800.02	? (TO) TT=1800.04	No data	SAT TT=0.643 ASSIGNMENTS=1546 CHECKS=335204	SAT TT=2.161 ASSIGNMENTS=1725 CHECKS=282309	SAT TT=3.287	SAT TT=0.113 ASSIGNMENTS=24 CHECKS=2799	SAT TT=0.151 ASSIGNMENTS=171 CHECKS=31449	? (TO) TT=1800.18	No data	SAT TT=203.699	SAT TT=221.05
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle09.xml	SAT TT=0.16	SAT TT=1.111 CHECKS=6784 NODES=35	SAT TT=1.273 CHECKS=6058 NODES=0	SAT TT=4.772	SAT TT=1.786 CHECKS=2683	SAT TT=2.547 CHECKS=4877	SAT TT=4.565 ASSIGNMENTS=280	SAT TT=2.616 ASSIGNMENTS=23	SAT TT=130.85 CHECKS=4519480 NODES=35	? (TO) TT=1800	? (TO) TT=1800.04	SAT TT=1.487 ASSIGNMENTS=1833 CHECKS=497320	SAT TT=1.476 ASSIGNMENTS=1833 CHECKS=497320	? (TO) TT=1800.02	? (TO) TT=1800.1	No data	SAT TT=1.305 ASSIGNMENTS=1569 CHECKS=437323	SAT TT=7.109 ASSIGNMENTS=4093 CHECKS=539529	SAT TT=3.394	SAT TT=0.27 ASSIGNMENTS=118 CHECKS=13089	SAT TT=0.16 ASSIGNMENTS=125 CHECKS=18633	? (MO) TT=32.903	No data	SAT TT=211.699	SAT TT=226.039
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle10.xml	SAT TT=0.108	SAT TT=1.151 CHECKS=24482 NODES=40	SAT TT=1.127 CHECKS=16158 NODES=0	SAT TT=1355.1	SAT TT=2.545 CHECKS=7703	SAT TT=1.988 CHECKS=6570	SAT TT=3.312 ASSIGNMENTS=29	SAT TT=2.95 ASSIGNMENTS=28	SAT TT=129.193 CHECKS=106246 NODES=40	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=0.121 ASSIGNMENTS=24 CHECKS=5277	SAT TT=0.122 ASSIGNMENTS=24 CHECKS=5277	? (TO) TT=1800.08	? (TO) TT=1800.07	No data	SAT TT=0.11 ASSIGNMENTS=24 CHECKS=5277	SAT TT=10.354 ASSIGNMENTS=7536 CHECKS=1293040	SAT TT=468.74	SAT TT=0.174 ASSIGNMENTS=105 CHECKS=18614	SAT TT=0.108 ASSIGNMENTS=29 CHECKS=5271	? (TO) TT=1800.09	No data	SAT TT=291.449	SAT TT=281.36
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle11.xml	SAT TT=0.227	SAT TT=1.148 CHECKS=5174 NODES=38	SAT TT=1.146 CHECKS=1221 NODES=0	SAT TT=1350.29	SAT TT=1.981 CHECKS=2350	SAT TT=1.66 CHECKS=2096	SAT TT=3.891 ASSIGNMENTS=165	SAT TT=3.364 ASSIGNMENTS=19	SAT TT=106.108 CHECKS=183813000 NODES=38	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=0.66 ASSIGNMENTS=1031 CHECKS=180780	SAT TT=0.714 ASSIGNMENTS=1031 CHECKS=180780	? (TO) TT=1800.08	? (TO) TT=1800.09	No data	SAT TT=0.706 ASSIGNMENTS=1029 CHECKS=177782	SAT TT=0.391 ASSIGNMENTS=119 CHECKS=18880	SAT TT=3.388	SAT TT=0.635 ASSIGNMENTS=295 CHECKS=32235	SAT TT=0.227 ASSIGNMENTS=131 CHECKS=18151	? TT=75.756	No data	SAT TT=204.964	SAT TT=233.893
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle12.xml	SAT TT=0.102	SAT TT=1.255 CHECKS=25332 NODES=52	SAT TT=1.203 CHECKS=47841 NODES=52	SAT TT=2.954	SAT TT=1.23 CHECKS=7820	SAT TT=1.001 CHECKS=7088	SAT TT=3.715 ASSIGNMENTS=290	SAT TT=2.739 ASSIGNMENTS=30	SAT TT=123.203 CHECKS=6973150 NODES=53	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=0.997 ASSIGNMENTS=3328 CHECKS=1101320	SAT TT=1.007 ASSIGNMENTS=3328 CHECKS=1101320	? (TO) TT=1800.08	? (TO) TT=1800.03	No data	SAT TT=1.569 ASSIGNMENTS=5479 CHECKS=1486600	SAT TT=3.133 ASSIGNMENTS=13071 CHECKS=2459550	? (TO) TT=1800.09	SAT TT=0.369 ASSIGNMENTS=740 CHECKS=158692	SAT TT=0.102 ASSIGNMENTS=129 CHECKS=57234	? (MO) TT=39.414	No data	SAT TT=14.77	SAT TT=18.98
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle13.xml	SAT TT=0.162	SAT TT=1.699 CHECKS=44249 NODES=65	SAT TT=1.808 CHECKS=82027 NODES=65	SAT TT=1363.7	SAT TT=3.676 CHECKS=27505	SAT TT=3.337 CHECKS=27447	SAT TT=4.417 ASSIGNMENTS=43	SAT TT=5.291 ASSIGNMENTS=34	SAT TT=134.676 CHECKS=1416850 NODES=68	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=0.173 ASSIGNMENTS=46 CHECKS=11081	SAT TT=0.192 ASSIGNMENTS=46 CHECKS=11081	? (TO) TT=1800.06	? (TO) TT=1800.08	No data	SAT TT=0.171 ASSIGNMENTS=46 CHECKS=11081	SAT TT=10.987 ASSIGNMENTS=17069 CHECKS=4218740	SAT TT=4.502	SAT TT=0.316 ASSIGNMENTS=289 CHECKS=74490	SAT TT=0.162 ASSIGNMENTS=39 CHECKS=11221	? (MO) TT=42.922	No data	SAT TT=644.536	SAT TT=636.278
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle15.xml	SAT TT=0.115	SAT TT=1.621 CHECKS=69791 NODES=98	SAT TT=1.947 CHECKS=143798 NODES=98	SAT TT=12.197	SAT TT=6.078 CHECKS=46430	SAT TT=5.603 CHECKS=56144	SAT TT=5.349 ASSIGNMENTS=66	SAT TT=8.325 ASSIGNMENTS=55	SAT TT=129.709 CHECKS=356010 NODES=102	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.129 ASSIGNMENTS=68 CHECKS=22090	SAT TT=0.122 ASSIGNMENTS=68 CHECKS=22090	? (TO) TT=1800.03	? (TO) TT=1800.06	No data	SAT TT=0.116 ASSIGNMENTS=68 CHECKS=22090	SAT TT=9.577 ASSIGNMENTS=26553 CHECKS=8537890	SAT TT=4.917	SAT TT=2.744 ASSIGNMENTS=2814 CHECKS=1438050	SAT TT=0.115 ASSIGNMENTS=66 CHECKS=24137	? (MO) TT=41.38	No data	SAT TT=58.842	SAT TT=77.107
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle16.xml	SAT TT=0.284	SAT TT=2.207 CHECKS=140913 NODES=136	SAT TT=2.703 CHECKS=335213 NODES=136	SAT TT=14.623	SAT TT=6.019 CHECKS=40202	SAT TT=4.563 CHECKS=40753	SAT TT=7.583 ASSIGNMENTS=100	SAT TT=21.422 ASSIGNMENTS=78	SAT TT=205.709 CHECKS=468002000 NODES=218	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=0.305 ASSIGNMENTS=96 CHECKS=36156	SAT TT=0.307 ASSIGNMENTS=96 CHECKS=36156	? (TO) TT=1800.01	? (TO) TT=1800.07	No data	SAT TT=0.304 ASSIGNMENTS=96 CHECKS=36156	SAT TT=19.123 ASSIGNMENTS=25436 CHECKS=14858700	SAT TT=7.324	SAT TT=5.752 ASSIGNMENTS=4365 CHECKS=2302620	SAT TT=0.284 ASSIGNMENTS=93 CHECKS=36316	? (MO) TT=57.712	No data	SAT TT=296.957	SAT TT=301.171
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle17.xml	SAT TT=0.423	SAT TT=2.884 CHECKS=236831 NODES=183	SAT TT=3.682 CHECKS=514465 NODES=180	? (TO) TT=1800.14	SAT TT=12.03 CHECKS=68615	SAT TT=9.645 CHECKS=66258	SAT TT=12.831 ASSIGNMENTS=105	SAT TT=58.022 ASSIGNMENTS=95	SAT TT=196.235 CHECKS=355008000 NODES=274	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=0.463 ASSIGNMENTS=114 CHECKS=64953	SAT TT=0.464 ASSIGNMENTS=114 CHECKS=64953	? (TO) TT=1800.05	? (TO) TT=1800.09	No data	SAT TT=0.447 ASSIGNMENTS=114 CHECKS=64953	SAT TT=34.202 ASSIGNMENTS=26549 CHECKS=23662900	? (TO) TT=1800.05	SAT TT=25.903 ASSIGNMENTS=6615 CHECKS=7068150	SAT TT=0.423 ASSIGNMENTS=102 CHECKS=63464	? TT=82.801	No data	SAT TT=1641.3	? (TO) TT=1800.08
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle19.xml	SAT TT=0.894	SAT TT=3.011 CHECKS=169772 NODES=190	SAT TT=3.985 CHECKS=298553 NODES=190	? (TO) TT=1800.1	SAT TT=12.452 CHECKS=54182	SAT TT=12.883 CHECKS=58255	SAT TT=15.345 ASSIGNMENTS=101	SAT TT=44.029 ASSIGNMENTS=76	SAT TT=153.966 CHECKS=295613000 NODES=250	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=0.934 ASSIGNMENTS=128 CHECKS=78071	SAT TT=0.901 ASSIGNMENTS=128 CHECKS=78071	? (TO) TT=1800.04	? (TO) TT=1800.01	No data	SAT TT=1.079 ASSIGNMENTS=162 CHECKS=99529	SAT TT=42.008 ASSIGNMENTS=27790 CHECKS=20524300	? (TO) TT=1800.01	SAT TT=47.406 ASSIGNMENTS=17135 CHECKS=10247800	SAT TT=0.894 ASSIGNMENTS=135 CHECKS=71067	? TT=82.311	No data	? (TO) TT=1800.01	? (TO) TT=1800.06
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle22.xml	SAT TT=0.219	SAT TT=2.08 CHECKS=126191 NODES=193	SAT TT=2.39 CHECKS=177480 NODES=135	? (TO) TT=1800.12	SAT TT=8.853 CHECKS=47363	SAT TT=7.246 CHECKS=48707	SAT TT=11.823 ASSIGNMENTS=67	SAT TT=24.841 ASSIGNMENTS=87	SAT TT=133.931 CHECKS=2587760 NODES=134	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=0.245 ASSIGNMENTS=81 CHECKS=38680	SAT TT=0.238 ASSIGNMENTS=81 CHECKS=38680	? (TO) TT=1800	? (TO) TT=1800.05	No data	SAT TT=0.219 ASSIGNMENTS=81 CHECKS=38680	SAT TT=27.076 ASSIGNMENTS=18427 CHECKS=10550200	SAT TT=27.304	SAT TT=9.226 ASSIGNMENTS=3810 CHECKS=3286960	SAT TT=0.226 ASSIGNMENTS=63 CHECKS=36795	? (MO) TT=34.985	No data	SAT TT=645.075	SAT TT=849.984
csp/ukVg/ normalized-crossword-m1c-uk-vg10-10_ext.xml		? (TO) TT=1800.6	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.05	? TT=31.162	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.12
csp/ukVg/ normalized-crossword-m1c-uk-vg10-11_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? TT=35.157	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.16
csp/ukVg/ normalized-crossword-m1c-uk-vg10-13_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.06	? TT=31.954	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.03
csp/ukVg/ normalized-crossword-m1c-uk-vg11-11_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? TT=33.008	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukVg/ normalized-crossword-m1c-uk-vg11-12_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	? TT=31.497	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.14
csp/ukVg/ normalized-crossword-m1c-uk-vg11-13_ext.xml	UNSAT TT=1649.07	UNSAT TT=1649.07 CHECKS=152751 NODES=150905	UNSAT TT=1674.24 CHECKS=156403 NODES=148863	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=1653.12 ASSIGNMENTS=150905 CHECKS=152751	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=35.679	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08
csp/ukVg/ normalized-crossword-m1c-uk-vg11-14_ext.xml	UNSAT TT=508.719	UNSAT TT=543.041 CHECKS=79294 NODES=33832	UNSAT TT=571.055 CHECKS=82460 NODES=34640	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=508.719 ASSIGNMENTS=33832 CHECKS=79294	UNSAT TT=549.733 ASSIGNMENTS=33832 CHECKS=79294	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=1056.8 ASSIGNMENTS=27370 CHECKS=6778740	UNSAT TT=917.131 ASSIGNMENTS=26842 CHECKS=6095480	? (TO) TT=1800.07	UNSAT TT=755.616 ASSIGNMENTS=23182 CHECKS=5251280	UNSAT TT=671.838 ASSIGNMENTS=16800 CHECKS=4301810	? TT=33.808	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.19
csp/ukVg/ normalized-crossword-m1c-uk-vg11-15_ext.xml	UNSAT TT=170.271	UNSAT TT=181.952 CHECKS=17600 NODES=10428	UNSAT TT=209.726 CHECKS=17664 NODES=10421	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=512.519 ASSIGNMENTS=2560	? (TO) TT=1800.11	UNSAT TT=506.182 CHECKS=0 NODES=9296	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=206.757 ASSIGNMENTS=10428 CHECKS=17600	UNSAT TT=192.501 ASSIGNMENTS=10428 CHECKS=17600	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=361.343 CHECKS=919661	UNSAT TT=222.192 ASSIGNMENTS=6231 CHECKS=1600700	UNSAT TT=271.865 ASSIGNMENTS=9617 CHECKS=2006630	? (TO) TT=1800.09	UNSAT TT=238.24 ASSIGNMENTS=8604 CHECKS=1952030	UNSAT TT=170.271 ASSIGNMENTS=5212 CHECKS=1311370	? TT=73.429	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02
csp/ukVg/ normalized-crossword-m1c-uk-vg12-14_ext.xml	UNSAT TT=305.384	UNSAT TT=305.384 CHECKS=30734 NODES=20719	UNSAT TT=317.247 CHECKS=28212 NODES=20620	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.17	UNSAT TT=1114.73 CHECKS=0 NODES=23442	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=323.076 ASSIGNMENTS=20719 CHECKS=30734	UNSAT TT=309.248 ASSIGNMENTS=20719 CHECKS=30734	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=1587.08 CHECKS=2752970	UNSAT TT=486.914 ASSIGNMENTS=14506 CHECKS=3844850	UNSAT TT=536.793 ASSIGNMENTS=17024 CHECKS=4058120	? (TO) TT=1800.07	UNSAT TT=526.095 ASSIGNMENTS=17273 CHECKS=4131640	UNSAT TT=500.137 ASSIGNMENTS=14964 CHECKS=3859320	? TT=86.233	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.19
csp/ukVg/ normalized-crossword-m1c-uk-vg12-16_ext.xml	UNSAT TT=38.795	UNSAT TT=38.795 CHECKS=5 NODES=2209	UNSAT TT=42.263 CHECKS=0 NODES=2398	? (TO) TT=1800.09	UNSAT TT=467.097 CHECKS=264717	UNSAT TT=408.287 CHECKS=234527	UNSAT TT=168.867 ASSIGNMENTS=707	UNSAT TT=939.667 ASSIGNMENTS=2877	UNSAT TT=102.551 CHECKS=0 NODES=2366	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=42.333 ASSIGNMENTS=2209 CHECKS=5	UNSAT TT=42.616 ASSIGNMENTS=2209 CHECKS=5	UNSAT TT=1462.49	? (TO) TT=1800.06	UNSAT TT=257.618 CHECKS=343782	UNSAT TT=53.41 ASSIGNMENTS=2067 CHECKS=519786	UNSAT TT=127.349 ASSIGNMENTS=5267 CHECKS=1073550	UNSAT TT=1368.84	UNSAT TT=73.76 ASSIGNMENTS=3582 CHECKS=752543	UNSAT TT=70.839 ASSIGNMENTS=2511 CHECKS=639936	? TT=87.237	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.15
csp/ukVg/ normalized-crossword-m1c-uk-vg13-17_ext.xml	UNSAT TT=10.203	UNSAT TT=10.203 CHECKS=0 NODES=665	UNSAT TT=13.982 CHECKS=0 NODES=657	? (TO) TT=1800.11	UNSAT TT=254.979 CHECKS=122994	UNSAT TT=129.931 CHECKS=105244	UNSAT TT=85.207 ASSIGNMENTS=182	UNSAT TT=258.596 ASSIGNMENTS=668	UNSAT TT=36.997 CHECKS=0 NODES=1012	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=17.5 ASSIGNMENTS=665 CHECKS=0	UNSAT TT=17.989 ASSIGNMENTS=665 CHECKS=0	UNSAT TT=416.052	UNSAT TT=526.803	UNSAT TT=53.044 CHECKS=111322	UNSAT TT=14.532 ASSIGNMENTS=559 CHECKS=150201	UNSAT TT=82.749 ASSIGNMENTS=3869 CHECKS=784609	UNSAT TT=167.471	UNSAT TT=58.73 ASSIGNMENTS=3026 CHECKS=625114	UNSAT TT=15.049 ASSIGNMENTS=638 CHECKS=164400	? TT=86.224	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02
csp/ukVg/ normalized-crossword-m1c-uk-vg14-14_ext.xml	UNSAT TT=79.57	UNSAT TT=79.991 CHECKS=480 NODES=5840	UNSAT TT=79.57 CHECKS=963 NODES=5662	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=1604.1 CHECKS=1478390	UNSAT TT=402.103 ASSIGNMENTS=2468	UNSAT TT=614.57 ASSIGNMENTS=3039	UNSAT TT=283.494 CHECKS=0 NODES=7549	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=83.72 ASSIGNMENTS=5922 CHECKS=420	UNSAT TT=83.038 ASSIGNMENTS=5922 CHECKS=420	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=336.901 CHECKS=799726	UNSAT TT=111.984 ASSIGNMENTS=4499 CHECKS=1232550	UNSAT TT=183.889 ASSIGNMENTS=8276 CHECKS=1908730	? (TO) TT=1800.05	UNSAT TT=140.591 ASSIGNMENTS=6277 CHECKS=1508090	UNSAT TT=130.215 ASSIGNMENTS=5342 CHECKS=1451260	? TT=76.966	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01
csp/ukVg/ normalized-crossword-m1c-uk-vg14-15_ext.xml	UNSAT TT=29.205	UNSAT TT=34.985 CHECKS=3 NODES=2576	UNSAT TT=29.205 CHECKS=18 NODES=2138	? (TO) TT=1800.18	UNSAT TT=396.224 CHECKS=274500	UNSAT TT=912.039 CHECKS=443023	UNSAT TT=155.406 ASSIGNMENTS=682	UNSAT TT=706.428 ASSIGNMENTS=2952	UNSAT TT=80.269 CHECKS=0 NODES=2410	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=40.873 ASSIGNMENTS=2576 CHECKS=3	UNSAT TT=40.616 ASSIGNMENTS=2576 CHECKS=3	UNSAT TT=1614.61	? (TO) TT=1800.08	UNSAT TT=174.172 CHECKS=311632	UNSAT TT=68.42 ASSIGNMENTS=2566 CHECKS=748872	UNSAT TT=113.346 ASSIGNMENTS=5186 CHECKS=1153980	UNSAT TT=662.595	UNSAT TT=89.852 ASSIGNMENTS=4155 CHECKS=1026320	UNSAT TT=68.147 ASSIGNMENTS=2609 CHECKS=722854	? TT=81.513	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.08
csp/ukVg/ normalized-crossword-m1c-uk-vg14-17_ext.xml	UNSAT TT=7.038	UNSAT TT=7.038 CHECKS=0 NODES=513	UNSAT TT=12.065 CHECKS=0 NODES=487	? (TO) TT=1800.16	UNSAT TT=164.038 CHECKS=108823	UNSAT TT=127.567 CHECKS=77190	UNSAT TT=77.465 ASSIGNMENTS=108	UNSAT TT=144.509 ASSIGNMENTS=318	UNSAT TT=27.853 CHECKS=0 NODES=763	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=13.912 ASSIGNMENTS=513 CHECKS=0	UNSAT TT=14.363 ASSIGNMENTS=513 CHECKS=0	UNSAT TT=222.155	UNSAT TT=324.394	UNSAT TT=39.93 CHECKS=93400	UNSAT TT=11.404 ASSIGNMENTS=423 CHECKS=122354	UNSAT TT=77.165 ASSIGNMENTS=3730 CHECKS=818417	UNSAT TT=104.578	UNSAT TT=57.626 ASSIGNMENTS=3191 CHECKS=638545	UNSAT TT=10.07 ASSIGNMENTS=395 CHECKS=108025	? TT=83.552	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukVg/ normalized-crossword-m1c-uk-vg14-18_ext.xml	UNSAT TT=3.549	UNSAT TT=3.549 CHECKS=0 NODES=177	UNSAT TT=42.943 CHECKS=0 NODES=151	? (TO) TT=1800.14	UNSAT TT=102.556 CHECKS=72154	UNSAT TT=45.157 CHECKS=39108	UNSAT TT=66.714 ASSIGNMENTS=14	UNSAT TT=65.483 ASSIGNMENTS=14	UNSAT TT=13.385 CHECKS=0 NODES=313	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=10.699 ASSIGNMENTS=177 CHECKS=0	UNSAT TT=11.018 ASSIGNMENTS=177 CHECKS=0	UNSAT TT=146.397	UNSAT TT=132.575	UNSAT TT=13.268 CHECKS=32202	UNSAT TT=4.51 ASSIGNMENTS=163 CHECKS=49317	UNSAT TT=75.601 ASSIGNMENTS=3483 CHECKS=802072	UNSAT TT=103.107	UNSAT TT=47.335 ASSIGNMENTS=2916 CHECKS=520984	UNSAT TT=4.913 ASSIGNMENTS=187 CHECKS=53046	? TT=77.251	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.07
csp/ukVg/ normalized-crossword-m1c-uk-vg15-17_ext.xml	UNSAT TT=3.382	UNSAT TT=3.382 CHECKS=0 NODES=264	UNSAT TT=13.866 CHECKS=0 NODES=192	? (TO) TT=1800.11	UNSAT TT=56.107 CHECKS=60784	UNSAT TT=51.633 CHECKS=43935	UNSAT TT=80.027 ASSIGNMENTS=67	UNSAT TT=74.524 ASSIGNMENTS=44	UNSAT TT=10.247 CHECKS=0 NODES=365	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=10.936 ASSIGNMENTS=264 CHECKS=0	UNSAT TT=10.923 ASSIGNMENTS=264 CHECKS=0	UNSAT TT=163.562	UNSAT TT=193.365	UNSAT TT=17.343 CHECKS=41821	UNSAT TT=5.138 ASSIGNMENTS=188 CHECKS=61515	UNSAT TT=72.085 ASSIGNMENTS=3535 CHECKS=825732	UNSAT TT=82.475	UNSAT TT=53.06 ASSIGNMENTS=3367 CHECKS=664354	UNSAT TT=3.587 ASSIGNMENTS=122 CHECKS=40673	? TT=75.479	? (TO) TT=1800.02	UNSAT TT=920.155	? (TO) TT=1800.04
csp/ukVg/ normalized-crossword-m1c-uk-vg15-18_ext.xml	UNSAT TT=1.63	UNSAT TT=1.63 CHECKS=0 NODES=87	UNSAT TT=6.733 CHECKS=0 NODES=0	? (TO) TT=1800.16	UNSAT TT=59.197 CHECKS=61585	UNSAT TT=20.441 CHECKS=19258	UNSAT TT=25.651 ASSIGNMENTS=0	UNSAT TT=23.81 ASSIGNMENTS=0	UNSAT TT=3.55 CHECKS=0 NODES=132	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=8.675 ASSIGNMENTS=87 CHECKS=0	UNSAT TT=8.586 ASSIGNMENTS=87 CHECKS=0	UNSAT TT=86.55	UNSAT TT=78.449	UNSAT TT=6.36 CHECKS=11709	UNSAT TT=2.115 ASSIGNMENTS=79 CHECKS=23691	UNSAT TT=66.358 ASSIGNMENTS=3313 CHECKS=828342	UNSAT TT=38.467	UNSAT TT=11.554 ASSIGNMENTS=573 CHECKS=137755	UNSAT TT=2.299 ASSIGNMENTS=87 CHECKS=27655	? TT=84.275	? (TO) TT=1800.01	UNSAT TT=907.757	? (TO) TT=1800.01
csp/ukVg/ normalized-crossword-m1c-uk-vg15-19_ext.xml	UNSAT TT=0.888	UNSAT TT=1.372 CHECKS=0 NODES=25	UNSAT TT=1.585 CHECKS=0 NODES=0	? (TO) TT=1800.08	UNSAT TT=33.463 CHECKS=31841	UNSAT TT=15.913 CHECKS=16600	UNSAT TT=6.142 ASSIGNMENTS=0	UNSAT TT=6.517 ASSIGNMENTS=0	UNSAT TT=2.625 CHECKS=0 NODES=68	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=1.208 ASSIGNMENTS=38 CHECKS=12742	UNSAT TT=1.134 ASSIGNMENTS=38 CHECKS=12742	UNSAT TT=75.577	UNSAT TT=64.012	UNSAT TT=3.674 CHECKS=7968	UNSAT TT=0.888 ASSIGNMENTS=28 CHECKS=9863	UNSAT TT=27.619 ASSIGNMENTS=1377 CHECKS=333190	UNSAT TT=11.21	UNSAT TT=1.864 ASSIGNMENTS=88 CHECKS=19550	UNSAT TT=1.194 ASSIGNMENTS=38 CHECKS=12742	? TT=104.661	? (TO) TT=1800.02	UNSAT TT=844.553	? (TO) TT=1800.1
csp/ukVg/ normalized-crossword-m1c-uk-vg16-16_ext.xml	UNSAT TT=3.384	UNSAT TT=3.384 CHECKS=0 NODES=328	UNSAT TT=9.339 CHECKS=0 NODES=254	? (TO) TT=1800.16	UNSAT TT=78.065 CHECKS=120959	UNSAT TT=40.329 CHECKS=67675	UNSAT TT=71.617 ASSIGNMENTS=43	UNSAT TT=85.056 ASSIGNMENTS=86	UNSAT TT=10.397 CHECKS=0 NODES=532	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=10.52 ASSIGNMENTS=325 CHECKS=0	UNSAT TT=10.516 ASSIGNMENTS=325 CHECKS=0	UNSAT TT=211.536	UNSAT TT=204.513	UNSAT TT=11.289 CHECKS=39904	UNSAT TT=8.187 ASSIGNMENTS=308 CHECKS=100733	UNSAT TT=71.562 ASSIGNMENTS=3594 CHECKS=858302	UNSAT TT=75.162	UNSAT TT=63.421 ASSIGNMENTS=3726 CHECKS=778362	UNSAT TT=8.236 ASSIGNMENTS=336 CHECKS=106580	? TT=81.072	? (TO) TT=1800.02	UNSAT TT=907.752	? (TO) TT=1800.05
csp/ukVg/ normalized-crossword-m1c-uk-vg16-17_ext.xml	UNSAT TT=2.626	UNSAT TT=2.626 CHECKS=0 NODES=207	UNSAT TT=18.425 CHECKS=0 NODES=116	? (TO) TT=1800.18	UNSAT TT=42.553 CHECKS=62397	UNSAT TT=29.109 CHECKS=47982	UNSAT TT=69.328 ASSIGNMENTS=7	UNSAT TT=64.868 ASSIGNMENTS=15	UNSAT TT=4.586 CHECKS=0 NODES=217	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=9.616 ASSIGNMENTS=207 CHECKS=0	UNSAT TT=10.023 ASSIGNMENTS=207 CHECKS=0	UNSAT TT=186.349	UNSAT TT=101.223	UNSAT TT=7.96 CHECKS=23759	UNSAT TT=3.243 ASSIGNMENTS=126 CHECKS=41897	UNSAT TT=64.577 ASSIGNMENTS=3407 CHECKS=832445	UNSAT TT=94.13	UNSAT TT=28.156 ASSIGNMENTS=1587 CHECKS=341492	UNSAT TT=3.503 ASSIGNMENTS=134 CHECKS=41365	? TT=68.994	? (TO) TT=1800.01	UNSAT TT=478.273	? (TO) TT=1800.05
csp/ukVg/ normalized-crossword-m1c-uk-vg16-18_ext.xml	UNSAT TT=0.812	UNSAT TT=1.288 CHECKS=0 NODES=31	UNSAT TT=1.278 CHECKS=0 NODES=0	? (TO) TT=1800.12	UNSAT TT=24.851 CHECKS=32026	UNSAT TT=10.055 CHECKS=13711	UNSAT TT=14.41 ASSIGNMENTS=0	UNSAT TT=14.343 ASSIGNMENTS=0	UNSAT TT=1.721 CHECKS=0 NODES=61	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=0.879 ASSIGNMENTS=25 CHECKS=10417	UNSAT TT=0.946 ASSIGNMENTS=25 CHECKS=10417	UNSAT TT=66.746	UNSAT TT=51.674	UNSAT TT=3.055 CHECKS=6923	UNSAT TT=0.812 ASSIGNMENTS=21 CHECKS=8924	UNSAT TT=69.264 ASSIGNMENTS=3169 CHECKS=806347	UNSAT TT=13.511	UNSAT TT=1.49 ASSIGNMENTS=65 CHECKS=18205	UNSAT TT=0.967 ASSIGNMENTS=25 CHECKS=10417	? TT=70.643	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/ukVg/ normalized-crossword-m1c-uk-vg16-19_ext.xml	UNSAT TT=0.472	UNSAT TT=1.064 CHECKS=0 NODES=19	UNSAT TT=1.07 CHECKS=0 NODES=0	? (TO) TT=1800.14	UNSAT TT=5.74 CHECKS=5136	UNSAT TT=8.379 CHECKS=7750	UNSAT TT=2.93 ASSIGNMENTS=0	UNSAT TT=2.881 ASSIGNMENTS=0	UNSAT TT=0.929 CHECKS=0 NODES=18	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=0.483 ASSIGNMENTS=12 CHECKS=4481	UNSAT TT=0.487 ASSIGNMENTS=12 CHECKS=4481	UNSAT TT=58.166	UNSAT TT=55.002	UNSAT TT=1.558 CHECKS=4042	UNSAT TT=0.472 ASSIGNMENTS=11 CHECKS=4508	UNSAT TT=3.155 ASSIGNMENTS=153 CHECKS=38817	UNSAT TT=4.781	UNSAT TT=0.957 ASSIGNMENTS=39 CHECKS=10003	UNSAT TT=0.473 ASSIGNMENTS=12 CHECKS=4481	? TT=77.604	? (TO) TT=1800.02	UNSAT TT=326.949	? (TO) TT=1800.07
csp/ukVg/ normalized-crossword-m1c-uk-vg4-4_ext.xml	SAT TT=0.016	SAT TT=0.69 CHECKS=9 NODES=16	SAT TT=0.727 CHECKS=9 NODES=0	SAT TT=0.39	SAT TT=0.344 CHECKS=401	SAT TT=0.388 CHECKS=468	SAT TT=0.804 ASSIGNMENTS=15	SAT TT=1.038 ASSIGNMENTS=12	SAT TT=1.005 CHECKS=372458 NODES=16	SAT TT=0.926 CHECKS=4281270 NODES=2550060	SAT TT=2.792 CHECKS=8260180 NODES=2638	SAT TT=0.03 ASSIGNMENTS=14 CHECKS=152	SAT TT=0.029 ASSIGNMENTS=14 CHECKS=152	SAT TT=7.601	SAT TT=5.896	SAT TT=0.029 CHECKS=56	SAT TT=0.016 ASSIGNMENTS=14 CHECKS=152	SAT TT=0.016 ASSIGNMENTS=12 CHECKS=181	SAT TT=0.937	SAT TT=0.016 ASSIGNMENTS=9 CHECKS=121	SAT TT=0.018 ASSIGNMENTS=14 CHECKS=152	SAT TT=13.736	SAT TT=0.036 ASSIGNMENTS=16 CHECKS=14574	SAT TT=2.576	SAT TT=3.818
csp/ukVg/ normalized-crossword-m1c-uk-vg4-6_ext.xml	SAT TT=0.106	SAT TT=0.853 CHECKS=10 NODES=24	SAT TT=0.886 CHECKS=10 NODES=25	SAT TT=3.634	SAT TT=1.471 CHECKS=1082	SAT TT=1.426 CHECKS=956	SAT TT=2.029 ASSIGNMENTS=16	SAT TT=1.947 ASSIGNMENTS=12	SAT TT=102.866 CHECKS=210186000 NODES=25	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=0.128 ASSIGNMENTS=39 CHECKS=1400	SAT TT=0.119 ASSIGNMENTS=39 CHECKS=1400	SAT TT=28.204	SAT TT=24.313	SAT TT=0.112 CHECKS=182	SAT TT=0.106 ASSIGNMENTS=38 CHECKS=1356	SAT TT=0.065 ASSIGNMENTS=11 CHECKS=251	SAT TT=2.141	SAT TT=0.115 ASSIGNMENTS=47 CHECKS=1079	SAT TT=0.118 ASSIGNMENTS=39 CHECKS=1400	? TT=82.949	SAT TT=0.438 ASSIGNMENTS=24 CHECKS=982254	SAT TT=75.095	SAT TT=80.714
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukVg/ normalized-crossword-m1c-uk-vg4-7_ext.xml	SAT TT=0.176	SAT TT=0.945 CHECKS=11 NODES=31	SAT TT=1.183 CHECKS=11 NODES=28	SAT TT=4.031	SAT TT=2.417 CHECKS=1361	SAT TT=2.882 CHECKS=1570	SAT TT=3.417 ASSIGNMENTS=28	SAT TT=2.878 ASSIGNMENTS=19	SAT TT=1.514 CHECKS=191343 NODES=32	? (TO) TT=1800	? (TO) TT=1800.1	SAT TT=0.459 ASSIGNMENTS=90 CHECKS=5083	SAT TT=0.462 ASSIGNMENTS=90 CHECKS=5083	SAT TT=51.223	SAT TT=76.373	SAT TT=0.176 CHECKS=423	SAT TT=0.36 ASSIGNMENTS=80 CHECKS=4299	SAT TT=0.1 ASSIGNMENTS=10 CHECKS=349	SAT TT=3.502	SAT TT=0.217 ASSIGNMENTS=64 CHECKS=1742	SAT TT=0.467 ASSIGNMENTS=90 CHECKS=5083	? TT=79.239	SAT TT=0.302 ASSIGNMENTS=52 CHECKS=78618	SAT TT=279.089	SAT TT=291.974
csp/ukVg/ normalized-crossword-m1c-uk-vg5-5_ext.xml	SAT TT=0.046	SAT TT=0.99 CHECKS=11 NODES=25	SAT TT=1.048 CHECKS=11 NODES=0	SAT TT=3.91	SAT TT=1.713 CHECKS=1839	SAT TT=1.637 CHECKS=1407	SAT TT=1.606 ASSIGNMENTS=12	SAT TT=1.645 ASSIGNMENTS=21	SAT TT=40.173 CHECKS=11506900 NODES=26	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=0.058 ASSIGNMENTS=16 CHECKS=438	SAT TT=0.059 ASSIGNMENTS=16 CHECKS=438	SAT TT=27.144	SAT TT=32.925	SAT TT=0.064 CHECKS=124	SAT TT=0.05 ASSIGNMENTS=16 CHECKS=438	SAT TT=0.035 ASSIGNMENTS=11 CHECKS=230	SAT TT=2.055	SAT TT=0.046 ASSIGNMENTS=19 CHECKS=468	SAT TT=0.046 ASSIGNMENTS=16 CHECKS=438	? (MO) TT=40.019	SAT TT=0.116 ASSIGNMENTS=30 CHECKS=122481	SAT TT=27.455	SAT TT=32.772
csp/ukVg/ normalized-crossword-m1c-uk-vg5-6_ext.xml	SAT TT=0.133	SAT TT=0.945 CHECKS=11 NODES=32	SAT TT=1.016 CHECKS=11 NODES=31	SAT TT=5.697	SAT TT=2.307 CHECKS=1543	SAT TT=2.255 CHECKS=1705	SAT TT=3.724 ASSIGNMENTS=55	SAT TT=2.858 ASSIGNMENTS=17	SAT TT=154.892 CHECKS=426171000 NODES=72	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=0.572 ASSIGNMENTS=180 CHECKS=10013	SAT TT=0.542 ASSIGNMENTS=180 CHECKS=10013	SAT TT=420.064	SAT TT=267.772	SAT TT=0.156 CHECKS=163	SAT TT=0.133 ASSIGNMENTS=30 CHECKS=1320	SAT TT=1.288 ASSIGNMENTS=501 CHECKS=21554	SAT TT=3.049	SAT TT=1.419 ASSIGNMENTS=641 CHECKS=23131	SAT TT=0.515 ASSIGNMENTS=180 CHECKS=10013	? (exit code) TT=146.12	SAT TT=3.084 ASSIGNMENTS=38 CHECKS=1336660	SAT TT=99.8	SAT TT=138.289
csp/ukVg/ normalized-crossword-m1c-uk-vg5-7_ext.xml	SAT TT=0.699	SAT TT=0.96 CHECKS=47 NODES=42	SAT TT=1.236 CHECKS=34 NODES=42	SAT TT=1416.94	SAT TT=149.309 CHECKS=100172	SAT TT=90.296 CHECKS=76471	SAT TT=9.738 ASSIGNMENTS=129	SAT TT=5.609 ASSIGNMENTS=61	SAT TT=38.877 CHECKS=103680000 NODES=1215	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=1.266 ASSIGNMENTS=221 CHECKS=14388	SAT TT=1.255 ASSIGNMENTS=221 CHECKS=14388	SAT TT=528.822	SAT TT=701.316	SAT TT=0.699 CHECKS=15528	SAT TT=2.414 ASSIGNMENTS=400 CHECKS=25462	SAT TT=18.262 ASSIGNMENTS=4083 CHECKS=205746	SAT TT=19.161	SAT TT=62.832 ASSIGNMENTS=10805 CHECKS=791637	SAT TT=1.293 ASSIGNMENTS=221 CHECKS=14388	? (MO) TT=31.629	SAT TT=14.934 ASSIGNMENTS=296 CHECKS=17648200	SAT TT=730.148	SAT TT=1049.96
csp/ukVg/ normalized-crossword-m1c-uk-vg5-8_ext.xml	SAT TT=2.561	SAT TT=4.463 CHECKS=8876 NODES=5219	SAT TT=2.561 CHECKS=1635 NODES=1448	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=320.102 ASSIGNMENTS=4577	SAT TT=1160.08 ASSIGNMENTS=11417	SAT TT=77.62 CHECKS=547313000 NODES=9607	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=11.508 ASSIGNMENTS=5219 CHECKS=8876	SAT TT=11.748 ASSIGNMENTS=5219 CHECKS=8876	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=7.914 CHECKS=228306	SAT TT=117.387 ASSIGNMENTS=11429 CHECKS=876022	SAT TT=195.878 ASSIGNMENTS=20812 CHECKS=1619500	SAT TT=22.647	SAT TT=34.063 ASSIGNMENTS=3934 CHECKS=266765	SAT TT=130.186 ASSIGNMENTS=12322 CHECKS=942620	? (MO) TT=33.028	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.04
csp/ukVg/ normalized-crossword-m1c-uk-vg5-9_ext.xml	SAT TT=16.074	SAT TT=16.074 CHECKS=32744 NODES=21532	SAT TT=72.609 CHECKS=147081 NODES=89910	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=1507.41 ASSIGNMENTS=15801	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=467.044 ASSIGNMENTS=36518 CHECKS=3189880	SAT TT=22.854 ASSIGNMENTS=21532 CHECKS=32744	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=194.45 CHECKS=5392520	SAT TT=496.763 ASSIGNMENTS=38187 CHECKS=3325500	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=503.565 ASSIGNMENTS=36518 CHECKS=3189880	? TT=89.432	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.01
csp/ukVg/ normalized-crossword-m1c-uk-vg6-10_ext.xml		? (TO) TT=1800.22	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=81.915	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.06
csp/ukVg/ normalized-crossword-m1c-uk-vg6-6_ext.xml	SAT TT=0.459	SAT TT=1.148 CHECKS=69 NODES=137	SAT TT=1.094 CHECKS=65 NODES=79	SAT TT=7.007	SAT TT=4.526 CHECKS=2460	SAT TT=8.974 CHECKS=9014	SAT TT=21.65 ASSIGNMENTS=580	SAT TT=3.005 ASSIGNMENTS=10	SAT TT=183.148 CHECKS=575147000 NODES=38	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=8.137 ASSIGNMENTS=465 CHECKS=227	SAT TT=8.399 ASSIGNMENTS=465 CHECKS=227	? (TO) TT=1800.09	SAT TT=365.629	SAT TT=0.459 CHECKS=11234	SAT TT=8.232 ASSIGNMENTS=1565 CHECKS=111821	SAT TT=11.573 ASSIGNMENTS=2598 CHECKS=128071	SAT TT=4.699	SAT TT=2.047 ASSIGNMENTS=720 CHECKS=27902	SAT TT=6.409 ASSIGNMENTS=1300 CHECKS=90211	? TT=78.021	SAT TT=82.958 ASSIGNMENTS=714 CHECKS=18200700	SAT TT=392.25	SAT TT=547.982
csp/ukVg/ normalized-crossword-m1c-uk-vg6-7_ext.xml	SAT TT=5.381	SAT TT=5.381 CHECKS=3796 NODES=3533	SAT TT=24.408 CHECKS=77241 NODES=39109	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=1210.34 ASSIGNMENTS=10632	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=10.556 ASSIGNMENTS=3533 CHECKS=3796	SAT TT=11.216 ASSIGNMENTS=3533 CHECKS=3796	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=54.733 CHECKS=1573290	SAT TT=552.86 ASSIGNMENTS=58244 CHECKS=5050430	? (TO) TT=1800.01	SAT TT=528.423	? (TO) TT=1800.07	? (TO) TT=1800.03	? TT=52.165	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04
csp/ukVg/ normalized-crossword-m1c-uk-vg6-8_ext.xml	SAT TT=1256.66	SAT TT=1256.66 CHECKS=3690100 NODES=1339970	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.03	? TT=74.485	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukVg/ normalized-crossword-m1c-uk-vg7-10_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? TT=81.377	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05
csp/ukVg/ normalized-crossword-m1c-uk-vg7-7_ext.xml	SAT TT=2.745	SAT TT=54.917 CHECKS=106087 NODES=51269	SAT TT=60.657 CHECKS=128699 NODES=54631	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=680.342 CHECKS=516489	? (TO) TT=1800.16	SAT TT=64.423 ASSIGNMENTS=585	SAT TT=718.124 CHECKS=0 NODES=281683	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=80.814 ASSIGNMENTS=64644 CHECKS=139493	SAT TT=78.154 ASSIGNMENTS=64644 CHECKS=139493	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=2.745 CHECKS=47438	? (TO) TT=1800.02	SAT TT=468.604 ASSIGNMENTS=34130 CHECKS=3237800	SAT TT=10.18	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=103.181	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08
csp/ukVg/ normalized-crossword-m1c-uk-vg7-8_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.08	? TT=93.692	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.01
csp/ukVg/ normalized-crossword-m1c-uk-vg7-9_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? TT=85.873	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1
csp/ukVg/ normalized-crossword-m1c-uk-vg8-10_ext.xml		? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=29.433	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08
csp/ukVg/ normalized-crossword-m1c-uk-vg8-11_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=31.915	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.01
csp/ukVg/ normalized-crossword-m1c-uk-vg8-12_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=29.554	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.05
csp/ukVg/ normalized-crossword-m1c-uk-vg9-10_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=31.887	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.23
csp/ukVg/ normalized-crossword-m1c-uk-vg9-11_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1969.92	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.11	? TT=28.901	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.21
csp/ukVg/ normalized-crossword-m1c-uk-vg9-12_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=26.447	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukVg/ normalized-crossword-m1c-uk-vg9-13_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.03	? TT=34.185	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.09
csp/ukVg/ normalized-crossword-m1c-uk-vg9-9_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.09	? TT=31.022	? (TO) TT=1800.06	? (TO) TT=1800.22	? (TO) TT=1800.14
csp/varDimacs/ normalized-bf-0432-007_ext.xml	SAT TT=0.056	SAT TT=1.876 CHECKS=6817 NODES=970	SAT TT=1.541 CHECKS=10254 NODES=0	SAT TT=0.291	SAT TT=0.285 CHECKS=206777	SAT TT=0.209 CHECKS=205195	SAT TT=1.131 ASSIGNMENTS=120	SAT TT=1.294 ASSIGNMENTS=152	SAT TT=1.22 CHECKS=5273 NODES=971	SAT TT=3.403 CHECKS=2297330 NODES=150829	SAT TT=1.372 CHECKS=390545 NODES=431	SAT TT=0.078 ASSIGNMENTS=117 CHECKS=4640	SAT TT=0.068 ASSIGNMENTS=117 CHECKS=4640	SAT TT=2.535	SAT TT=2.849	SAT TT=0.113 CHECKS=3655	SAT TT=0.056 ASSIGNMENTS=117 CHECKS=4640	SAT TT=0.06 ASSIGNMENTS=136 CHECKS=4702	SAT TT=0.92	SAT TT=0.059 ASSIGNMENTS=134 CHECKS=4640	SAT TT=0.056 ASSIGNMENTS=117 CHECKS=4640	SAT TT=2.121	SAT TT=0.332 ASSIGNMENTS=972 CHECKS=13329	SAT TT=1.322	SAT TT=1.835
csp/varDimacs/ normalized-bf-1355-075_ext.xml	SAT TT=0.078	SAT TT=2.762 CHECKS=6117 NODES=1818	SAT TT=2.616 CHECKS=6163 NODES=0	SAT TT=0.368	SAT TT=1.381 CHECKS=86913	SAT TT=1.442 CHECKS=89213	SAT TT=1.465 ASSIGNMENTS=1108	SAT TT=2.855 ASSIGNMENTS=1335	SAT TT=1.757 CHECKS=4623 NODES=1818	SAT TT=1.473 CHECKS=27467 NODES=205	SAT TT=1.453 CHECKS=365956 NODES=233	SAT TT=0.1 ASSIGNMENTS=1129 CHECKS=5504	SAT TT=0.099 ASSIGNMENTS=1129 CHECKS=5504	SAT TT=3.395	SAT TT=3.387	SAT TT=0.217 CHECKS=4944	SAT TT=0.078 ASSIGNMENTS=1129 CHECKS=5504	SAT TT=0.074 ASSIGNMENTS=1239 CHECKS=5504	SAT TT=0.966	SAT TT=0.102 ASSIGNMENTS=1146 CHECKS=5504	SAT TT=0.087 ASSIGNMENTS=1129 CHECKS=5504	SAT TT=2.88	SAT TT=0.639 ASSIGNMENTS=1818 CHECKS=11948	SAT TT=1.847	SAT TT=1.45
csp/varDimacs/ normalized-bf-1355-638_ext.xml	SAT TT=0.018	SAT TT=1.231 CHECKS=1678 NODES=532	SAT TT=1.158 CHECKS=1343 NODES=0	SAT TT=0.091	SAT TT=0.225 CHECKS=14973	SAT TT=0.244 CHECKS=14817	SAT TT=0.67 ASSIGNMENTS=288	SAT TT=0.793 ASSIGNMENTS=531	SAT TT=0.542 CHECKS=776 NODES=532	SAT TT=0.496 CHECKS=3878 NODES=4	SAT TT=0.537 CHECKS=4920 NODES=6	SAT TT=0.029 ASSIGNMENTS=288 CHECKS=800	SAT TT=0.032 ASSIGNMENTS=288 CHECKS=800	SAT TT=1.603	SAT TT=1.623	SAT TT=0.046 CHECKS=800	SAT TT=0.018 ASSIGNMENTS=288 CHECKS=800	SAT TT=0.018 ASSIGNMENTS=360 CHECKS=800	SAT TT=0.501	SAT TT=0.02 ASSIGNMENTS=321 CHECKS=800	SAT TT=0.019 ASSIGNMENTS=288 CHECKS=800	SAT TT=1.112	SAT TT=0.053 ASSIGNMENTS=532 CHECKS=1380	SAT TT=1.222	SAT TT=1.088
csp/varDimacs/ normalized-bf-2670-001_ext.xml	SAT TT=0.049	SAT TT=2.659 CHECKS=4470 NODES=1244	SAT TT=1.824 CHECKS=7213 NODES=0	SAT TT=0.236	SAT TT=0.625 CHECKS=184762	SAT TT=0.644 CHECKS=176694	SAT TT=1.198 ASSIGNMENTS=371	SAT TT=1.296 ASSIGNMENTS=381	SAT TT=1.187 CHECKS=3217 NODES=1245	SAT TT=5.974 CHECKS=4512490 NODES=300591	SAT TT=1.181 CHECKS=230659 NODES=270	SAT TT=0.059 ASSIGNMENTS=366 CHECKS=3080	SAT TT=0.064 ASSIGNMENTS=366 CHECKS=3080	SAT TT=2.462	SAT TT=2.837	SAT TT=0.082 CHECKS=2125	SAT TT=0.049 ASSIGNMENTS=366 CHECKS=3080	SAT TT=0.046 ASSIGNMENTS=356 CHECKS=3075	SAT TT=1.095	SAT TT=0.054 ASSIGNMENTS=499 CHECKS=4382	SAT TT=0.051 ASSIGNMENTS=366 CHECKS=3080	SAT TT=2.161	SAT TT=0.311 ASSIGNMENTS=1246 CHECKS=6522	SAT TT=1.421	SAT TT=1.31
csp/varDimacs/ normalized-hole-06_ext.xml	UNSAT TT=0.014	UNSAT TT=0.779 CHECKS=1063 NODES=59	UNSAT TT=0.809 CHECKS=1305 NODES=37	UNSAT TT=0.054	UNSAT TT=0.016 CHECKS=3030	UNSAT TT=0.014 CHECKS=2770	UNSAT TT=0.652 ASSIGNMENTS=961	UNSAT TT=0.742 ASSIGNMENTS=1308	UNSAT TT=0.572 CHECKS=52280 NODES=2581	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.028 ASSIGNMENTS=957 CHECKS=37516	UNSAT TT=0.03 ASSIGNMENTS=957 CHECKS=37516	UNSAT TT=0.586	UNSAT TT=0.792	UNSAT TT=0.069 CHECKS=97166	UNSAT TT=0.017 ASSIGNMENTS=999 CHECKS=39159	UNSAT TT=0.039 ASSIGNMENTS=5904 CHECKS=135253	UNSAT TT=0.354	UNSAT TT=0.018 ASSIGNMENTS=1350 CHECKS=50889	UNSAT TT=0.017 ASSIGNMENTS=957 CHECKS=37516	UNSAT TT=1.111	UNSAT TT=0.101 ASSIGNMENTS=4312 CHECKS=139382	UNSAT TT=0.591	UNSAT TT=0.626
csp/varDimacs/ normalized-hole-07_ext.xml	UNSAT TT=0.021	UNSAT TT=0.905 CHECKS=2028 NODES=99	UNSAT TT=0.864 CHECKS=2591 NODES=80	UNSAT TT=0.243	UNSAT TT=0.021 CHECKS=4506	UNSAT TT=0.021 CHECKS=5418	UNSAT TT=1.648 ASSIGNMENTS=7482	UNSAT TT=2.193 ASSIGNMENTS=10277	UNSAT TT=1.749 CHECKS=405626 NODES=18657	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.119 ASSIGNMENTS=7681 CHECKS=361895	UNSAT TT=0.107 ASSIGNMENTS=7681 CHECKS=361895	UNSAT TT=0.908	UNSAT TT=0.769	UNSAT TT=0.814 CHECKS=1431910	UNSAT TT=0.092 ASSIGNMENTS=7317 CHECKS=345794	UNSAT TT=0.127 ASSIGNMENTS=14802 CHECKS=519119	UNSAT TT=0.579	UNSAT TT=0.122 ASSIGNMENTS=9693 CHECKS=450256	UNSAT TT=0.096 ASSIGNMENTS=7681 CHECKS=361895	UNSAT TT=1.271	UNSAT TT=1.09 ASSIGNMENTS=37832 CHECKS=1340760	UNSAT TT=0.776	UNSAT TT=0.764
csp/varDimacs/ normalized-hole-08_ext.xml	UNSAT TT=0.027	UNSAT TT=0.875 CHECKS=3187 NODES=135	UNSAT TT=0.994 CHECKS=4977 NODES=155	UNSAT TT=2.743	UNSAT TT=0.027 CHECKS=3704	UNSAT TT=0.028 CHECKS=8420	UNSAT TT=12.096 ASSIGNMENTS=70072	UNSAT TT=15.331 ASSIGNMENTS=94447	UNSAT TT=14.751 CHECKS=3410600 NODES=148586	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=1.063 ASSIGNMENTS=71191 CHECKS=3925030	UNSAT TT=1.062 ASSIGNMENTS=71191 CHECKS=3925030	UNSAT TT=4.083	UNSAT TT=0.897	UNSAT TT=11.61 CHECKS=18367500	UNSAT TT=0.913 ASSIGNMENTS=69085 CHECKS=3813590	UNSAT TT=0.976 ASSIGNMENTS=78597 CHECKS=4024450	UNSAT TT=1.989	UNSAT TT=1.156 ASSIGNMENTS=82172 CHECKS=4501850	UNSAT TT=0.954 ASSIGNMENTS=71191 CHECKS=3925030	UNSAT TT=1.733	UNSAT TT=11.924 ASSIGNMENTS=334930 CHECKS=12225300	UNSAT TT=1.352	UNSAT TT=1.892
csp/varDimacs/ normalized-hole-09_ext.xml	UNSAT TT=0.038	UNSAT TT=0.963 CHECKS=6415 NODES=239	UNSAT TT=1.016 CHECKS=19112 NODES=500	UNSAT TT=40.735	UNSAT TT=0.039 CHECKS=11335	UNSAT TT=0.038 CHECKS=15145	UNSAT TT=148.821 ASSIGNMENTS=777211	UNSAT TT=195.656 ASSIGNMENTS=985147	UNSAT TT=177.532 CHECKS=38057000 NODES=1577550	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=18.478 ASSIGNMENTS=715860 CHECKS=44828500	UNSAT TT=18.476 ASSIGNMENTS=715860 CHECKS=44828500	UNSAT TT=189.036	UNSAT TT=1.436	UNSAT TT=149.96 CHECKS=236616000	UNSAT TT=10.79 ASSIGNMENTS=719138 CHECKS=44880400	UNSAT TT=12.863 ASSIGNMENTS=888577 CHECKS=52786200	UNSAT TT=20.23	UNSAT TT=12.174 ASSIGNMENTS=795704 CHECKS=48120400	UNSAT TT=9.983 ASSIGNMENTS=715860 CHECKS=44828500	UNSAT TT=3.222	UNSAT TT=146.409 ASSIGNMENTS=4125000 CHECKS=164531000	UNSAT TT=5.656	UNSAT TT=18.116
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/varDimacs/ normalized-hole-10_ext.xml	UNSAT TT=0.051	UNSAT TT=1.069 CHECKS=14042 NODES=445	UNSAT TT=1.177 CHECKS=27659 NODES=688	UNSAT TT=629.498	UNSAT TT=0.057 CHECKS=20182	UNSAT TT=0.051 CHECKS=18608	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=148.247 ASSIGNMENTS=8280720 CHECKS=580867000	UNSAT TT=148.522 ASSIGNMENTS=8280720 CHECKS=580867000	? (TO) TT=1800.05	UNSAT TT=2.557	? (TO) TT=1800.1	UNSAT TT=146.981 ASSIGNMENTS=8735530 CHECKS=606514000	UNSAT TT=160.841 ASSIGNMENTS=10378100 CHECKS=704735000	UNSAT TT=230.271	UNSAT TT=186.653 ASSIGNMENTS=10840100 CHECKS=727304000	UNSAT TT=140.25 ASSIGNMENTS=8280720 CHECKS=580867000	UNSAT TT=28.67	UNSAT TT=1791.38 ASSIGNMENTS=50856700 CHECKS=2167480000	UNSAT TT=68.662	UNSAT TT=345.117
csp/wordsHerald/ normalized-crossword-m1-words-05-01.xml	SAT TT=0.045	SAT TT=0.952 CHECKS=4459 NODES=30	SAT TT=1.1 CHECKS=18642 NODES=60	SAT TT=4.131	SAT TT=1.209 CHECKS=35034	SAT TT=1.095 CHECKS=33362	SAT TT=8.139 ASSIGNMENTS=719	SAT TT=1.986 ASSIGNMENTS=33	SAT TT=66.275 CHECKS=62943700 NODES=105	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=16.65 ASSIGNMENTS=719	SAT TT=7.495 ASSIGNMENTS=162 CHECKS=17924	? (TO) TT=1800.09	? (TO) TT=1800.04	No data	SAT TT=4.257 ASSIGNMENTS=4006 CHECKS=2090980	SAT TT=1.877 ASSIGNMENTS=8321 CHECKS=914459	SAT TT=1.049	SAT TT=0.543 ASSIGNMENTS=652 CHECKS=244430	SAT TT=0.045 ASSIGNMENTS=162 CHECKS=17924	? (MO) TT=45.153	No data	SAT TT=10.01	SAT TT=19.734
csp/wordsHerald/ normalized-crossword-m1-words-05-03.xml	SAT TT=0.037	SAT TT=0.839 CHECKS=742 NODES=21	SAT TT=0.915 CHECKS=891 NODES=0	SAT TT=2.01	SAT TT=0.296 CHECKS=1560	SAT TT=0.245 CHECKS=1513	SAT TT=2.378 ASSIGNMENTS=186	SAT TT=1.21 ASSIGNMENTS=10	SAT TT=82.834 CHECKS=14117600 NODES=22	SAT TT=416.227 CHECKS=1958090000 NODES=-1986620000	? (TO) TT=1800.05	SAT TT=0.938 ASSIGNMENTS=1828 CHECKS=246965	SAT TT=0.925 ASSIGNMENTS=1828 CHECKS=246965	? (TO) TT=1800.08	? (TO) TT=1800.03	No data	SAT TT=2.106 ASSIGNMENTS=3784 CHECKS=566325	SAT TT=1.689 ASSIGNMENTS=4360 CHECKS=400578	SAT TT=0.945	SAT TT=0.087 ASSIGNMENTS=162 CHECKS=17362	SAT TT=0.037 ASSIGNMENTS=63 CHECKS=5430	? (MO) TT=33.852	No data	SAT TT=4.911	SAT TT=6.251
csp/wordsHerald/ normalized-crossword-m1-words-05-04.xml	SAT TT=0.031	SAT TT=0.833 CHECKS=2050 NODES=19	SAT TT=0.876 CHECKS=4427 NODES=20	SAT TT=1.712	SAT TT=0.384 CHECKS=3178	SAT TT=0.27 CHECKS=2015	SAT TT=1.298 ASSIGNMENTS=64	SAT TT=1.03 ASSIGNMENTS=15	SAT TT=128.584 CHECKS=7367150 NODES=20	SAT TT=91.565 CHECKS=78564900 NODES=88050000	? (TO) TT=1800.05	SAT TT=0.372 ASSIGNMENTS=1135 CHECKS=99727	SAT TT=0.389 ASSIGNMENTS=1135 CHECKS=99727	? (TO) TT=1800.07	? (TO) TT=1800.06	No data	SAT TT=0.44 ASSIGNMENTS=1541 CHECKS=130648	SAT TT=0.289 ASSIGNMENTS=1199 CHECKS=70623	SAT TT=0.641	SAT TT=0.041 ASSIGNMENTS=81 CHECKS=4996	SAT TT=0.031 ASSIGNMENTS=54 CHECKS=3932	? (MO) TT=44.249	No data	SAT TT=2.812	SAT TT=3.571
csp/wordsHerald/ normalized-crossword-m1-words-05-08.xml	SAT TT=0.039	SAT TT=0.925 CHECKS=1544 NODES=23	SAT TT=0.879 CHECKS=1406 NODES=0	SAT TT=2.668	SAT TT=0.418 CHECKS=2565	SAT TT=0.301 CHECKS=1990	SAT TT=1.828 ASSIGNMENTS=134	SAT TT=1.453 ASSIGNMENTS=17	SAT TT=113.3 CHECKS=19294200 NODES=24	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.538 ASSIGNMENTS=1151 CHECKS=162787	SAT TT=0.527 ASSIGNMENTS=1151 CHECKS=162787	? (TO) TT=1800.05	? (TO) TT=1800.06	No data	SAT TT=1.45 ASSIGNMENTS=3273 CHECKS=510343	SAT TT=1.496 ASSIGNMENTS=5671 CHECKS=465268	SAT TT=1.058	SAT TT=0.042 ASSIGNMENTS=55 CHECKS=6799	SAT TT=0.039 ASSIGNMENTS=98 CHECKS=7894	? (MO) TT=32.76	No data	SAT TT=5.947	SAT TT=7.65
csp/wordsHerald/ normalized-crossword-m1-words-05-10.xml	SAT TT=0.03	SAT TT=0.867 CHECKS=3843 NODES=17	SAT TT=0.866 CHECKS=3799 NODES=0	SAT TT=1.075	SAT TT=0.204 CHECKS=1974	SAT TT=0.169 CHECKS=2064	SAT TT=1.544 ASSIGNMENTS=223	SAT TT=1.052 ASSIGNMENTS=11	SAT TT=121.587 CHECKS=5454510 NODES=17	SAT TT=79.937 CHECKS=6277100 NODES=8550010	SAT TT=87.306 CHECKS=45158600 NODES=8526	SAT TT=0.39 ASSIGNMENTS=1397 CHECKS=257440	SAT TT=0.39 ASSIGNMENTS=1397 CHECKS=257440	? (TO) TT=1800.09	? (TO) TT=1800.06	No data	SAT TT=0.503 ASSIGNMENTS=2102 CHECKS=388492	SAT TT=0.135 ASSIGNMENTS=507 CHECKS=44182	SAT TT=0.591	SAT TT=0.032 ASSIGNMENTS=46 CHECKS=5560	SAT TT=0.03 ASSIGNMENTS=75 CHECKS=4517	? (MO) TT=42.651	No data	SAT TT=2.653	SAT TT=3.063
csp/wordsHerald/ normalized-crossword-m1-words-15-02.xml	SAT TT=1.075	SAT TT=4.761 CHECKS=809987 NODES=976	SAT TT=6.345 CHECKS=1192720 NODES=1361	? (TO) TT=1800.07	SAT TT=59.89 CHECKS=2808580	SAT TT=16.86 CHECKS=984087	SAT TT=21.5 ASSIGNMENTS=369	SAT TT=102.681 ASSIGNMENTS=1364	SAT TT=885.714 CHECKS=4645810000 NODES=928	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=1.075 ASSIGNMENTS=297 CHECKS=533197	SAT TT=1.098 ASSIGNMENTS=297 CHECKS=533197	? (TO) TT=1800.1	? (TO) TT=1800.04	No data	SAT TT=1.227 ASSIGNMENTS=361 CHECKS=643439	SAT TT=24.837 ASSIGNMENTS=11671 CHECKS=18541500	SAT TT=21.678	SAT TT=185.859 ASSIGNMENTS=90940 CHECKS=90050100	SAT TT=1.801 ASSIGNMENTS=454 CHECKS=899974	? (MO) TT=33.437	No data	? (TO) TT=1800.02	? (TO) TT=1800.01
csp/wordsHerald/ normalized-crossword-m1-words-15-04.xml	SAT TT=9.996	SAT TT=19.365 CHECKS=4697600 NODES=8733	SAT TT=9.996 CHECKS=1955800 NODES=3680	? (TO) TT=1800.12	SAT TT=169.242 CHECKS=11930400	SAT TT=265.575 CHECKS=23472400	SAT TT=63.387 ASSIGNMENTS=2814	SAT TT=120.063 ASSIGNMENTS=4486	SAT TT=698.756 CHECKS=3984310000 NODES=907	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=23.795 ASSIGNMENTS=8733 CHECKS=4697600	SAT TT=24.006 ASSIGNMENTS=8733 CHECKS=4697600	? (TO) TT=1800.01	? (TO) TT=1800.07	No data	SAT TT=22.528 ASSIGNMENTS=9940 CHECKS=16109000	SAT TT=67.573 ASSIGNMENTS=24827 CHECKS=40432900	SAT TT=800.625	SAT TT=244.611 ASSIGNMENTS=87647 CHECKS=117981000	SAT TT=68.244 ASSIGNMENTS=16330 CHECKS=42120800	? (MO) TT=36.649	No data	? (TO) TT=1800.02	? (TO) TT=1800.05
csp/wordsHerald/ normalized-crossword-m1-words-15-06.xml	SAT TT=30.486	SAT TT=30.486 CHECKS=3973860 NODES=20398	SAT TT=30.869 CHECKS=5213310 NODES=18243	? (TO) TT=1800.13	? (TO) TT=1800.08	SAT TT=97.157 CHECKS=4793650	SAT TT=366.88 ASSIGNMENTS=11944	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=40.931 ASSIGNMENTS=9597 CHECKS=15938200	SAT TT=36.698 ASSIGNMENTS=20398 CHECKS=3973860	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	SAT TT=185.599 ASSIGNMENTS=49529 CHECKS=79345300	SAT TT=57.904 ASSIGNMENTS=19307 CHECKS=28690800	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=33.13 ASSIGNMENTS=9597 CHECKS=15938200	? (MO) TT=45.044	No data	? (TO) TT=1800.04	? (TO) TT=1800.05
csp/wordsHerald/ normalized-crossword-m1-words-15-08.xml	SAT TT=0.246	SAT TT=2.435 CHECKS=149593 NODES=351	SAT TT=2.83 CHECKS=268775 NODES=333	? (TO) TT=1800.11	SAT TT=42.014 CHECKS=1247230	SAT TT=10.717 CHECKS=229204	SAT TT=11.066 ASSIGNMENTS=80	SAT TT=39.092 ASSIGNMENTS=142	SAT TT=217.1 CHECKS=610744000 NODES=297	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=0.303 ASSIGNMENTS=129 CHECKS=102862	SAT TT=0.306 ASSIGNMENTS=129 CHECKS=102862	? (TO) TT=1800.03	? (TO) TT=1800.07	No data	SAT TT=0.295 ASSIGNMENTS=132 CHECKS=103219	SAT TT=20.943 ASSIGNMENTS=17755 CHECKS=22652000	? (TO) TT=1800.05	SAT TT=81.976 ASSIGNMENTS=53012 CHECKS=36679900	SAT TT=0.246 ASSIGNMENTS=84 CHECKS=68738	? (MO) TT=40.682	No data	SAT TT=322.61	? (TO) TT=1800.01
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsHerald/ normalized-crossword-m1-words-19-01.xml	SAT TT=0.593	SAT TT=5.058 CHECKS=760956 NODES=503	SAT TT=6.509 CHECKS=1050920 NODES=496	? (TO) TT=1800.06	SAT TT=49.747 CHECKS=2618860	SAT TT=11.511 CHECKS=602217	SAT TT=24.86 ASSIGNMENTS=131	SAT TT=68.85 ASSIGNMENTS=217	SAT TT=270.747 CHECKS=887003000 NODES=603	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=1.726 ASSIGNMENTS=600 CHECKS=1430960	SAT TT=1.629 ASSIGNMENTS=600 CHECKS=1430960	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	SAT TT=2.327 ASSIGNMENTS=853 CHECKS=2081220	SAT TT=18.595 ASSIGNMENTS=8403 CHECKS=18053700	SAT TT=29.87	SAT TT=106.369 ASSIGNMENTS=63797 CHECKS=116453000	SAT TT=0.593 ASSIGNMENTS=176 CHECKS=273748	? (MO) TT=32.322	No data	? (TO) TT=1800.11	? (TO) TT=1800.04
csp/wordsHerald/ normalized-crossword-m1-words-19-03.xml	SAT TT=4.442	SAT TT=23.536 CHECKS=5295640 NODES=7838	SAT TT=57.325 CHECKS=13343700 NODES=25509	? (TO) TT=1800.14	SAT TT=694.114 CHECKS=47077200	SAT TT=308.625 CHECKS=26102900	SAT TT=64.253 ASSIGNMENTS=1641	SAT TT=76.115 ASSIGNMENTS=593	SAT TT=283.064 CHECKS=101780000 NODES=2509	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=26.111 ASSIGNMENTS=6853 CHECKS=3811780	SAT TT=25.385 ASSIGNMENTS=6853 CHECKS=3811780	? (TO) TT=1800.04	? (TO) TT=1800.01	No data	SAT TT=1069.06 ASSIGNMENTS=508283 CHECKS=824675000	SAT TT=59.471 ASSIGNMENTS=19162 CHECKS=45669500	? (TO) TT=1800.06	SAT TT=379.566 ASSIGNMENTS=114280 CHECKS=151196000	SAT TT=4.442 ASSIGNMENTS=1481 CHECKS=2499540	? (MO) TT=43.88	No data	? (TO) TT=1800.11	? (TO) TT=1800.05
csp/wordsHerald/ normalized-crossword-m1-words-19-05.xml	SAT TT=1.032	SAT TT=5.636 CHECKS=733248 NODES=1356	SAT TT=6.144 CHECKS=1006730 NODES=1238	? (TO) TT=1800.05	SAT TT=82.476 CHECKS=9465730	SAT TT=9.213 CHECKS=606844	SAT TT=42.543 ASSIGNMENTS=930	SAT TT=68.104 ASSIGNMENTS=229	SAT TT=321.919 CHECKS=1013880000 NODES=441	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1.035 ASSIGNMENTS=226 CHECKS=814865	SAT TT=1.032 ASSIGNMENTS=226 CHECKS=814865	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	SAT TT=1.76 ASSIGNMENTS=459 CHECKS=1710190	SAT TT=16.346 ASSIGNMENTS=6350 CHECKS=17188500	? (TO) TT=1800.04	SAT TT=181.857 ASSIGNMENTS=65016 CHECKS=192796000	SAT TT=1.033 ASSIGNMENTS=220 CHECKS=856671	? (MO) TT=43.143	No data	SAT TT=987.205	? (TO) TT=1800.06
csp/wordsHerald/ normalized-crossword-m1-words-19-08.xml	SAT TT=0.586	SAT TT=5.69 CHECKS=1004380 NODES=561	SAT TT=7.052 CHECKS=1524340 NODES=784	? (TO) TT=1800.09	SAT TT=14.042 CHECKS=608688	SAT TT=7.573 CHECKS=622707	SAT TT=25.691 ASSIGNMENTS=101	SAT TT=65.609 ASSIGNMENTS=146	SAT TT=225.689 CHECKS=539741000 NODES=582	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=0.605 ASSIGNMENTS=140 CHECKS=278988	SAT TT=0.607 ASSIGNMENTS=140 CHECKS=278988	? (TO) TT=1800.03	? (TO) TT=1800.04	No data	SAT TT=0.586 ASSIGNMENTS=140 CHECKS=278988	SAT TT=19.286 ASSIGNMENTS=8133 CHECKS=21189900	? (TO) TT=1800.09	SAT TT=82.569 ASSIGNMENTS=41746 CHECKS=99388800	SAT TT=0.623 ASSIGNMENTS=173 CHECKS=360717	? (MO) TT=31.39	No data	? (TO) TT=1800.02	? (TO) TT=1800.01
csp/wordsHerald/ normalized-crossword-m1-words-21-01.xml	SAT TT=45.202	SAT TT=367.338 CHECKS=88943200 NODES=84365	SAT TT=221.297 CHECKS=64692400 NODES=60778	? (TO) TT=1800.11	SAT TT=528.771 CHECKS=55155700	SAT TT=163.009 CHECKS=17593000	SAT TT=617.182 ASSIGNMENTS=19270	SAT TT=931.838 ASSIGNMENTS=29933	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=101.311 ASSIGNMENTS=20939 CHECKS=74833500	SAT TT=371.378 ASSIGNMENTS=84365 CHECKS=88943200	? (TO) TT=1800.01	? (TO) TT=1800.05	No data	SAT TT=295.914 ASSIGNMENTS=75157 CHECKS=232868000	SAT TT=45.202 ASSIGNMENTS=10974 CHECKS=32270200	? (TO) TT=1800.04	SAT TT=402.652 ASSIGNMENTS=112731 CHECKS=293581000	SAT TT=92.725 ASSIGNMENTS=20939 CHECKS=74833500	? (MO) TT=33.649	No data	? (TO) TT=1800.15	? (TO) TT=1800.06
csp/wordsHerald/ normalized-crossword-m1-words-21-05.xml	SAT TT=4.563	SAT TT=11.862 CHECKS=2069950 NODES=4123	SAT TT=8.487 CHECKS=753379 NODES=2024	? (TO) TT=1800.12	SAT TT=69.995 CHECKS=5019410	SAT TT=67.967 CHECKS=5581790	SAT TT=111.201 ASSIGNMENTS=2879	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=19.188 ASSIGNMENTS=4123 CHECKS=2069950	SAT TT=18.617 ASSIGNMENTS=4123 CHECKS=2069950	? (TO) TT=1800.05	? (TO) TT=1800.1	No data	SAT TT=167.46 ASSIGNMENTS=50958 CHECKS=121384000	SAT TT=21.379 ASSIGNMENTS=9002 CHECKS=16298200	SAT TT=146.865	SAT TT=41.804 ASSIGNMENTS=21655 CHECKS=36903600	SAT TT=4.563 ASSIGNMENTS=1684 CHECKS=3836930	? (MO) TT=43.08	No data	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/wordsHerald/ normalized-crossword-m1-words-21-07.xml	SAT TT=0.999	SAT TT=29.928 CHECKS=9495560 NODES=6682	SAT TT=13.178 CHECKS=3260890 NODES=3057	? (TO) TT=1800.11	SAT TT=97.58 CHECKS=7500180	SAT TT=41.712 CHECKS=3116670	SAT TT=68.122 ASSIGNMENTS=1497	? (TO) TT=1800.16	SAT TT=1084.61 CHECKS=5453890000 NODES=1637	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=1.504 ASSIGNMENTS=431 CHECKS=1012080	SAT TT=1.515 ASSIGNMENTS=431 CHECKS=1012080	? (TO) TT=1800.05	? (TO) TT=1800.05	No data	SAT TT=5.341 ASSIGNMENTS=1884 CHECKS=5020640	SAT TT=21.829 ASSIGNMENTS=8561 CHECKS=16650400	? (TO) TT=1800.08	SAT TT=154.62 ASSIGNMENTS=76763 CHECKS=133447000	SAT TT=0.999 ASSIGNMENTS=309 CHECKS=639214	? (MO) TT=48.195	No data	? (TO) TT=1800.12	? (TO) TT=1800.01
csp/wordsHerald/ normalized-crossword-m1-words-21-08.xml	SAT TT=0.628	SAT TT=5.714 CHECKS=613531 NODES=469	SAT TT=7.377 CHECKS=1019940 NODES=699	? (TO) TT=1800.07	SAT TT=50.986 CHECKS=2788160	SAT TT=15.922 CHECKS=977795	SAT TT=39.84 ASSIGNMENTS=870	? (TO) TT=1800.07	SAT TT=612.412 CHECKS=2687100000 NODES=982	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=0.677 ASSIGNMENTS=193 CHECKS=351784	SAT TT=0.677 ASSIGNMENTS=193 CHECKS=351784	? (TO) TT=1800.1	? (TO) TT=1800.02	No data	SAT TT=0.628 ASSIGNMENTS=186 CHECKS=343283	SAT TT=21.557 ASSIGNMENTS=9616 CHECKS=23259500	SAT TT=182.1	SAT TT=193.662 ASSIGNMENTS=99617 CHECKS=223470000	SAT TT=0.74 ASSIGNMENTS=201 CHECKS=376638	? (MO) TT=34.98	No data	? (TO) TT=1800.06	? (TO) TT=1800.01
csp/wordsHerald/ normalized-crossword-m1-words-21-10.xml		? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	No data	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.1	? (MO) TT=34.181	No data	? (TO) TT=1800.15	? (TO) TT=1800.03
csp/wordsHerald/ normalized-crossword-m1-words-23-03.xml	SAT TT=22.069	SAT TT=308.21 CHECKS=104121000 NODES=61251	SAT TT=196.868 CHECKS=65045800 NODES=35278	? (TO) TT=1800.07	SAT TT=457.118 CHECKS=47181600	SAT TT=190.128 CHECKS=21206600	SAT TT=219.231 ASSIGNMENTS=6191	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=29.15 ASSIGNMENTS=6131 CHECKS=19540800	SAT TT=302.926 ASSIGNMENTS=61251 CHECKS=104121000	? (TO) TT=1800	? (TO) TT=1800.09	No data	SAT TT=121.893 ASSIGNMENTS=39827 CHECKS=106420000	SAT TT=31.339 ASSIGNMENTS=10392 CHECKS=26664300	? (TO) TT=1800	SAT TT=218.832 ASSIGNMENTS=75323 CHECKS=177307000	SAT TT=22.069 ASSIGNMENTS=6131 CHECKS=19540800	? (MO) TT=32.699	No data	? (MO) TT=6.03	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsHerald/ normalized-crossword-m1-words-23-07.xml	SAT TT=3.82	SAT TT=12.955 CHECKS=2664720 NODES=2396	SAT TT=11.567 CHECKS=1423230 NODES=1736	? (TO) TT=1800.1	SAT TT=85.248 CHECKS=8815670	SAT TT=147.809 CHECKS=20175000	SAT TT=47.977 ASSIGNMENTS=348	? (TO) TT=1800.16	SAT TT=956.227 CHECKS=5250500000 NODES=1854	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=12.53 ASSIGNMENTS=1070 CHECKS=3017620	SAT TT=19.733 ASSIGNMENTS=2396 CHECKS=2664720	? (TO) TT=1800.01	? (TO) TT=1800.06	No data	SAT TT=5.745 ASSIGNMENTS=1441 CHECKS=4922340	SAT TT=35.52 ASSIGNMENTS=10083 CHECKS=29737000	SAT TT=82.735	SAT TT=363.073 ASSIGNMENTS=127404 CHECKS=333911000	SAT TT=3.82 ASSIGNMENTS=1070 CHECKS=3017620	? (MO) TT=37.759	No data	? (TO) TT=1800.1	? (TO) TT=1800.02
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle04.xml	SAT TT=0.026	SAT TT=0.813 CHECKS=2050 NODES=19	SAT TT=0.899 CHECKS=4427 NODES=20	SAT TT=1.706	SAT TT=0.283 CHECKS=1719	SAT TT=0.221 CHECKS=1413	SAT TT=1.253 ASSIGNMENTS=64	SAT TT=1.274 ASSIGNMENTS=15	SAT TT=135.292 CHECKS=7367150 NODES=20	SAT TT=80.531 CHECKS=78564900 NODES=88050000	? (TO) TT=1800.03	SAT TT=0.38 ASSIGNMENTS=1135 CHECKS=99727	SAT TT=0.381 ASSIGNMENTS=1135 CHECKS=99727	? (TO) TT=1800.05	? (TO) TT=1800.07	No data	SAT TT=0.442 ASSIGNMENTS=1541 CHECKS=130648	SAT TT=0.026 ASSIGNMENTS=22 CHECKS=1452	SAT TT=0.635	SAT TT=0.042 ASSIGNMENTS=81 CHECKS=4996	SAT TT=0.031 ASSIGNMENTS=54 CHECKS=3932	? (MO) TT=43.125	No data	SAT TT=3.303	SAT TT=3.833
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle06.xml	SAT TT=0.048	SAT TT=0.859 CHECKS=2857 NODES=23	SAT TT=0.868 CHECKS=1829 NODES=0	SAT TT=3.158	SAT TT=0.393 CHECKS=2232	SAT TT=0.463 CHECKS=3371	SAT TT=74.566 ASSIGNMENTS=13092	SAT TT=1.329 ASSIGNMENTS=13	SAT TT=90.101 CHECKS=15202600 NODES=26	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=1.318 ASSIGNMENTS=2060 CHECKS=373853	SAT TT=1.317 ASSIGNMENTS=2060 CHECKS=373853	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	SAT TT=5.777 ASSIGNMENTS=7762 CHECKS=1552520	SAT TT=0.524 ASSIGNMENTS=1564 CHECKS=154848	SAT TT=0.911	SAT TT=0.048 ASSIGNMENTS=86 CHECKS=9906	SAT TT=0.049 ASSIGNMENTS=118 CHECKS=11436	? (MO) TT=38.2	No data	SAT TT=7.422	SAT TT=7.228
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle08.xml	SAT TT=0.045	SAT TT=1.162 CHECKS=12830 NODES=41	SAT TT=1.053 CHECKS=23376 NODES=42	SAT TT=1341.66	SAT TT=0.573 CHECKS=4576	SAT TT=0.493 CHECKS=5474	SAT TT=2.028 ASSIGNMENTS=26	SAT TT=2.106 ASSIGNMENTS=21	SAT TT=130.198 CHECKS=496657 NODES=44	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=0.058 ASSIGNMENTS=21 CHECKS=2877	SAT TT=0.059 ASSIGNMENTS=21 CHECKS=2877	? (TO) TT=1800.06	? (TO) TT=1800.06	No data	SAT TT=0.045 ASSIGNMENTS=21 CHECKS=2877	SAT TT=0.713 ASSIGNMENTS=1177 CHECKS=243683	SAT TT=1.369	SAT TT=0.145 ASSIGNMENTS=200 CHECKS=32984	SAT TT=0.11 ASSIGNMENTS=81 CHECKS=25054	? (TO) TT=1800.18	No data	SAT TT=29.779	SAT TT=32.801
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle09.xml	SAT TT=0.102	SAT TT=0.931 CHECKS=3535 NODES=35	SAT TT=1.035 CHECKS=10310 NODES=35	SAT TT=4.895	SAT TT=1.015 CHECKS=10238	SAT TT=1.028 CHECKS=10000	SAT TT=14.927 ASSIGNMENTS=887	SAT TT=2.256 ASSIGNMENTS=17	SAT TT=123.789 CHECKS=10306000 NODES=43	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=1.424 ASSIGNMENTS=956 CHECKS=308392	SAT TT=1.333 ASSIGNMENTS=956 CHECKS=308392	? (TO) TT=1800.02	? (TO) TT=1800.04	No data	SAT TT=0.721 ASSIGNMENTS=755 CHECKS=242690	SAT TT=4.18 ASSIGNMENTS=4929 CHECKS=831056	SAT TT=1.339	SAT TT=0.264 ASSIGNMENTS=285 CHECKS=51922	SAT TT=0.102 ASSIGNMENTS=87 CHECKS=19959	? (MO) TT=37.533	No data	SAT TT=33.757	SAT TT=38.675
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle10.xml	SAT TT=0.048	SAT TT=1.04 CHECKS=17681 NODES=44	SAT TT=1.042 CHECKS=17274 NODES=0	SAT TT=2.513	SAT TT=0.894 CHECKS=11376	SAT TT=0.636 CHECKS=9131	SAT TT=2.414 ASSIGNMENTS=17	SAT TT=2.371 ASSIGNMENTS=17	SAT TT=122.034 CHECKS=162704 NODES=40	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=0.06 ASSIGNMENTS=21 CHECKS=5716	SAT TT=0.061 ASSIGNMENTS=21 CHECKS=5716	? (TO) TT=1800.01	? (TO) TT=1800.08	No data	SAT TT=0.048 ASSIGNMENTS=21 CHECKS=5716	SAT TT=3.757 ASSIGNMENTS=11337 CHECKS=1799110	SAT TT=2.52	SAT TT=0.178 ASSIGNMENTS=221 CHECKS=63884	SAT TT=0.051 ASSIGNMENTS=22 CHECKS=6151	? (TO) TT=1800.11	No data	SAT TT=35.548	SAT TT=44.014
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle13.xml	SAT TT=0.067	SAT TT=1.285 CHECKS=37184 NODES=66	SAT TT=1.538 CHECKS=68604 NODES=66	SAT TT=3.583	SAT TT=1.071 CHECKS=18237	SAT TT=2.715 CHECKS=83837	SAT TT=3.444 ASSIGNMENTS=29	SAT TT=4.114 ASSIGNMENTS=25	SAT TT=130.187 CHECKS=2597130 NODES=69	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.08 ASSIGNMENTS=35 CHECKS=14078	SAT TT=0.078 ASSIGNMENTS=35 CHECKS=14078	? (TO) TT=1800.07	? (TO) TT=1800.05	No data	SAT TT=0.068 ASSIGNMENTS=35 CHECKS=14078	SAT TT=4.562 ASSIGNMENTS=11962 CHECKS=4015900	SAT TT=1.985	SAT TT=1.105 ASSIGNMENTS=1685 CHECKS=776283	SAT TT=0.067 ASSIGNMENTS=34 CHECKS=14008	? (TO) TT=1802.2	No data	SAT TT=36.178	SAT TT=45.008
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle14.xml	SAT TT=0.342	SAT TT=1.311 CHECKS=12479 NODES=67	SAT TT=1.287 CHECKS=25830 NODES=62	SAT TT=44.41	SAT TT=1.629 CHECKS=8750	SAT TT=2.681 CHECKS=24960	SAT TT=152.324 ASSIGNMENTS=9815	SAT TT=3.195 ASSIGNMENTS=26	SAT TT=139.966 CHECKS=21934100 NODES=66	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=162.135 ASSIGNMENTS=9815	SAT TT=152.612 ASSIGNMENTS=9815	? (TO) TT=1800.05	? (TO) TT=1800.06	No data	SAT TT=35.039 ASSIGNMENTS=30934 CHECKS=14212700	SAT TT=7.333 ASSIGNMENTS=7491 CHECKS=2518680	SAT TT=2.279	SAT TT=1.278 ASSIGNMENTS=1324 CHECKS=390392	SAT TT=0.342 ASSIGNMENTS=316 CHECKS=143687	? (MO) TT=31.058	No data	SAT TT=47.034	SAT TT=60.263
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle15.xml	SAT TT=0.08	SAT TT=1.695 CHECKS=59238 NODES=107	SAT TT=1.884 CHECKS=127940 NODES=159	SAT TT=10.715	SAT TT=3.584 CHECKS=78570	SAT TT=2.393 CHECKS=56888	SAT TT=4.623 ASSIGNMENTS=55	SAT TT=6.963 ASSIGNMENTS=52	SAT TT=132.085 CHECKS=1292310 NODES=197	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=0.091 ASSIGNMENTS=39 CHECKS=23590	SAT TT=0.09 ASSIGNMENTS=39 CHECKS=23590	? (TO) TT=1800	? (TO) TT=1800.07	No data	SAT TT=0.08 ASSIGNMENTS=39 CHECKS=23590	SAT TT=7.902 ASSIGNMENTS=20432 CHECKS=8558900	SAT TT=2.704	SAT TT=2.038 ASSIGNMENTS=2831 CHECKS=1780010	SAT TT=0.088 ASSIGNMENTS=56 CHECKS=28723	? TT=52.103	No data	SAT TT=24.442	SAT TT=44.505
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle16.xml	SAT TT=0.161	SAT TT=1.812 CHECKS=125604 NODES=137	SAT TT=2.364 CHECKS=251161 NODES=137	SAT TT=12.419	SAT TT=3.572 CHECKS=86776	SAT TT=2.398 CHECKS=95361	SAT TT=6.157 ASSIGNMENTS=79	SAT TT=23.059 ASSIGNMENTS=58	SAT TT=239.169 CHECKS=626844000 NODES=203	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=0.187 ASSIGNMENTS=86 CHECKS=45919	SAT TT=0.183 ASSIGNMENTS=86 CHECKS=45919	? (TO) TT=1800.09	? (TO) TT=1800.01	No data	SAT TT=0.169 ASSIGNMENTS=86 CHECKS=45919	SAT TT=13.393 ASSIGNMENTS=16473 CHECKS=17541000	SAT TT=3.985	SAT TT=3.928 ASSIGNMENTS=4020 CHECKS=2634130	SAT TT=0.161 ASSIGNMENTS=77 CHECKS=42503	? (MO) TT=46.953	No data	SAT TT=59.766	SAT TT=63.373
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle17.xml	SAT TT=0.278	SAT TT=2.903 CHECKS=344769 NODES=317	SAT TT=3.129 CHECKS=605257 NODES=342	SAT TT=16.272	SAT TT=5.747 CHECKS=113563	SAT TT=3.569 CHECKS=113563	SAT TT=10.876 ASSIGNMENTS=111	SAT TT=55.246 ASSIGNMENTS=83	SAT TT=223.522 CHECKS=535080000 NODES=303	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=0.297 ASSIGNMENTS=89 CHECKS=79736	SAT TT=0.292 ASSIGNMENTS=89 CHECKS=79736	? (TO) TT=1800.07	? (TO) TT=1800.1	No data	SAT TT=0.278 ASSIGNMENTS=89 CHECKS=79736	SAT TT=26.692 ASSIGNMENTS=17414 CHECKS=29632700	? (TO) TT=1800.09	SAT TT=57.409 ASSIGNMENTS=36406 CHECKS=30307700	SAT TT=0.305 ASSIGNMENTS=124 CHECKS=98066	? TT=100.36	No data	SAT TT=453.943	? (TO) TT=1800.06
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle18.xml	SAT TT=0.231	SAT TT=2.458 CHECKS=201114 NODES=187	SAT TT=2.912 CHECKS=345168 NODES=187	? (TO) TT=1800.1	SAT TT=40.341 CHECKS=2243140	SAT TT=3.789 CHECKS=233423	SAT TT=11.418 ASSIGNMENTS=90	SAT TT=63.201 ASSIGNMENTS=165	SAT TT=127.826 CHECKS=2479220 NODES=279	? (TO) TT=1800.05	? (TO) TT=1800	SAT TT=0.243 ASSIGNMENTS=110 CHECKS=84297	SAT TT=0.247 ASSIGNMENTS=110 CHECKS=84297	? (TO) TT=1800.08	? (TO) TT=1800.02	No data	SAT TT=0.233 ASSIGNMENTS=110 CHECKS=84297	SAT TT=16.837 ASSIGNMENTS=20772 CHECKS=24590200	SAT TT=1520.13	SAT TT=90.702 ASSIGNMENTS=57346 CHECKS=46910300	SAT TT=0.231 ASSIGNMENTS=103 CHECKS=82641	? (MO) TT=64.548	No data	SAT TT=87.269	SAT TT=517.768
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle19.xml	SAT TT=0.279	SAT TT=2.476 CHECKS=139837 NODES=338	SAT TT=2.798 CHECKS=204719 NODES=340	? (TO) TT=1800.13	SAT TT=6.689 CHECKS=158595	SAT TT=5.78 CHECKS=211835	SAT TT=12.175 ASSIGNMENTS=70	SAT TT=43.473 ASSIGNMENTS=57	SAT TT=239.318 CHECKS=870521000 NODES=360	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=0.831 ASSIGNMENTS=209 CHECKS=304176	SAT TT=0.845 ASSIGNMENTS=209 CHECKS=304176	? (TO) TT=1800.01	? (TO) TT=1800.08	No data	SAT TT=0.751 ASSIGNMENTS=249 CHECKS=305184	SAT TT=21.939 ASSIGNMENTS=18024 CHECKS=20727600	? (TO) TT=1800.09	SAT TT=31.91 ASSIGNMENTS=17863 CHECKS=13366500	SAT TT=0.279 ASSIGNMENTS=85 CHECKS=69863	? (MO) TT=41.617	No data	SAT TT=561.941	? (TO) TT=1800.05
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle20.xml	SAT TT=0.124	SAT TT=1.091 CHECKS=6921 NODES=53	SAT TT=1.136 CHECKS=14969 NODES=53	SAT TT=29.463	SAT TT=1.233 CHECKS=6491	SAT TT=1.299 CHECKS=7544	SAT TT=6.287 ASSIGNMENTS=543	SAT TT=2.689 ASSIGNMENTS=24	SAT TT=139.521 CHECKS=19814900 NODES=74	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=13.121 ASSIGNMENTS=543	SAT TT=13.857 ASSIGNMENTS=543	? (TO) TT=1800.05	? (TO) TT=1800.06	No data	SAT TT=3.392 ASSIGNMENTS=3790 CHECKS=1634580	SAT TT=5.522 ASSIGNMENTS=6902 CHECKS=1603950	SAT TT=1.6	SAT TT=0.623 ASSIGNMENTS=659 CHECKS=164502	SAT TT=0.124 ASSIGNMENTS=215 CHECKS=43627	? (MO) TT=35.984	No data	SAT TT=44.694	SAT TT=47.547
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle21.xml	SAT TT=0.121	SAT TT=1.848 CHECKS=104321 NODES=133	SAT TT=1.999 CHECKS=190961 NODES=132	SAT TT=8.471	SAT TT=7.255 CHECKS=215628	SAT TT=6.795 CHECKS=256717	SAT TT=5.875 ASSIGNMENTS=70	SAT TT=18.171 ASSIGNMENTS=60	SAT TT=278.965 CHECKS=867019000 NODES=168	? (TO) TT=1800.01	? (TO) TT=1800	SAT TT=0.133 ASSIGNMENTS=66 CHECKS=40534	SAT TT=0.146 ASSIGNMENTS=66 CHECKS=40534	? (TO) TT=1800.07	? (TO) TT=1800.03	No data	SAT TT=0.121 ASSIGNMENTS=66 CHECKS=40534	SAT TT=8.903 ASSIGNMENTS=16160 CHECKS=10297800	? (TO) TT=1800.01	SAT TT=3.343 ASSIGNMENTS=3938 CHECKS=2227030	SAT TT=0.132 ASSIGNMENTS=72 CHECKS=37999	? (MO) TT=40.571	No data	SAT TT=79.779	SAT TT=74.871
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle22.xml	SAT TT=0.169	SAT TT=3.626 CHECKS=724469 NODES=925	SAT TT=3.858 CHECKS=756368 NODES=758	? (TO) TT=1800.12	SAT TT=44.584 CHECKS=2875320	SAT TT=8.701 CHECKS=636622	SAT TT=11.511 ASSIGNMENTS=67	SAT TT=406.519 ASSIGNMENTS=64957	SAT TT=132.266 CHECKS=8054480 NODES=193	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=0.174 ASSIGNMENTS=84 CHECKS=92978	SAT TT=0.169 ASSIGNMENTS=84 CHECKS=92978	? (TO) TT=1800.06	? (TO) TT=1800	No data	SAT TT=0.176 ASSIGNMENTS=104 CHECKS=113613	SAT TT=11.646 ASSIGNMENTS=9766 CHECKS=10421400	SAT TT=6.404	SAT TT=5.63 ASSIGNMENTS=3504 CHECKS=4149620	SAT TT=13.742 ASSIGNMENTS=7949 CHECKS=12476300	? (MO) TT=36.573	No data	SAT TT=50.268	SAT TT=210.122
csp/wordsVg/ normalized-crossword-m1c-words-vg10-10_ext.xml	UNSAT TT=12.172	UNSAT TT=12.172 CHECKS=444 NODES=2355	UNSAT TT=12.89 CHECKS=624 NODES=2425	? (TO) TT=1800.06	UNSAT TT=396.931 CHECKS=556355	UNSAT TT=158.644 CHECKS=271973	UNSAT TT=66.186 ASSIGNMENTS=888	UNSAT TT=179.316 ASSIGNMENTS=1883	UNSAT TT=37.106 CHECKS=0 NODES=2833	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=20.535 ASSIGNMENTS=2572 CHECKS=399	UNSAT TT=20.091 ASSIGNMENTS=2572 CHECKS=399	UNSAT TT=1359.99	UNSAT TT=1084.31	UNSAT TT=47.573 CHECKS=315477	UNSAT TT=18.318 ASSIGNMENTS=1990 CHECKS=388412	UNSAT TT=38.354 ASSIGNMENTS=5465 CHECKS=759391	UNSAT TT=195.076	UNSAT TT=24.451 ASSIGNMENTS=3293 CHECKS=484948	UNSAT TT=20.34 ASSIGNMENTS=2231 CHECKS=443768	? TT=29.601	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.05
csp/wordsVg/ normalized-crossword-m1c-words-vg10-12_ext.xml	UNSAT TT=1.274	UNSAT TT=2.402 CHECKS=28 NODES=269	UNSAT TT=3.357 CHECKS=0 NODES=255	? (TO) TT=1800.13	UNSAT TT=63.249 CHECKS=90622	UNSAT TT=29.592 CHECKS=34744	UNSAT TT=36.986 ASSIGNMENTS=22	UNSAT TT=37.036 ASSIGNMENTS=10	UNSAT TT=6.226 CHECKS=0 NODES=483	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=1.3 ASSIGNMENTS=122 CHECKS=24854	UNSAT TT=1.274 ASSIGNMENTS=122 CHECKS=24854	UNSAT TT=127.379	UNSAT TT=93.979	UNSAT TT=6.585 CHECKS=29983	UNSAT TT=2.293 ASSIGNMENTS=243 CHECKS=44095	UNSAT TT=24.794 ASSIGNMENTS=3581 CHECKS=510438	UNSAT TT=27.947	UNSAT TT=12.295 ASSIGNMENTS=1842 CHECKS=247245	UNSAT TT=1.275 ASSIGNMENTS=122 CHECKS=24854	? TT=31.676	? (TO) TT=1800.02	UNSAT TT=1177.75	? (TO) TT=1800.09
csp/wordsVg/ normalized-crossword-m1c-words-vg10-14_ext.xml	UNSAT TT=0.239	UNSAT TT=1.183 CHECKS=0 NODES=15	UNSAT TT=1.037 CHECKS=0 NODES=0	? (TO) TT=1800.1	UNSAT TT=10.131 CHECKS=13603	UNSAT TT=6.208 CHECKS=8493	UNSAT TT=4.667 ASSIGNMENTS=0	UNSAT TT=4.891 ASSIGNMENTS=0	UNSAT TT=1.116 CHECKS=0 NODES=24	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.254 ASSIGNMENTS=18 CHECKS=4771	UNSAT TT=0.257 ASSIGNMENTS=18 CHECKS=4771	UNSAT TT=38.626	UNSAT TT=30.151	UNSAT TT=1.091 CHECKS=3925	UNSAT TT=0.239 ASSIGNMENTS=15 CHECKS=4360	UNSAT TT=5.953 ASSIGNMENTS=808 CHECKS=115363	UNSAT TT=4.411	UNSAT TT=0.444 ASSIGNMENTS=54 CHECKS=8945	UNSAT TT=0.245 ASSIGNMENTS=18 CHECKS=4771	? TT=33.512	? (TO) TT=1800.06	UNSAT TT=268.98	UNSAT TT=280.426
csp/wordsVg/ normalized-crossword-m1c-words-vg11-13_ext.xml	UNSAT TT=0.307	UNSAT TT=1.094 CHECKS=0 NODES=29	UNSAT TT=1.388 CHECKS=0 NODES=0	? (TO) TT=1800.07	UNSAT TT=17.265 CHECKS=25379	UNSAT TT=6.947 CHECKS=10724	UNSAT TT=7.261 ASSIGNMENTS=0	UNSAT TT=7.164 ASSIGNMENTS=0	UNSAT TT=1.15 CHECKS=0 NODES=49	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.423 ASSIGNMENTS=31 CHECKS=7704	UNSAT TT=0.425 ASSIGNMENTS=31 CHECKS=7704	UNSAT TT=35.874	UNSAT TT=26.937	UNSAT TT=1.194 CHECKS=5838	UNSAT TT=0.307 ASSIGNMENTS=23 CHECKS=5323	UNSAT TT=15.931 ASSIGNMENTS=2230 CHECKS=338585	UNSAT TT=7.377	UNSAT TT=2.081 ASSIGNMENTS=299 CHECKS=41597	UNSAT TT=0.411 ASSIGNMENTS=31 CHECKS=7704	? TT=30.737	? (TO) TT=1800.06	UNSAT TT=353.938	? (TO) TT=1800.04
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsVg/ normalized-crossword-m1c-words-vg11-14_ext.xml	UNSAT TT=0.099	UNSAT TT=0.887 CHECKS=0 NODES=5	UNSAT TT=0.918 CHECKS=0 NODES=0	UNSAT TT=376.223	UNSAT TT=5.55 CHECKS=6351	UNSAT TT=3.258 CHECKS=3448	UNSAT TT=1.386 ASSIGNMENTS=0	UNSAT TT=1.363 ASSIGNMENTS=0	UNSAT TT=0.756 CHECKS=0 NODES=10	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.127 ASSIGNMENTS=8 CHECKS=1506	UNSAT TT=0.128 ASSIGNMENTS=8 CHECKS=1506	UNSAT TT=25.941	UNSAT TT=20.396	UNSAT TT=0.406 CHECKS=1314	UNSAT TT=0.099 ASSIGNMENTS=5 CHECKS=1441	UNSAT TT=0.533 ASSIGNMENTS=65 CHECKS=9670	UNSAT TT=2.991	UNSAT TT=0.303 ASSIGNMENTS=33 CHECKS=5148	UNSAT TT=0.12 ASSIGNMENTS=8 CHECKS=1506	? TT=32.117	? (TO) TT=1800.06	UNSAT TT=173.817	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg11-15_ext.xml	UNSAT TT=0.053	UNSAT TT=0.99 CHECKS=0 NODES=0	UNSAT TT=0.823 CHECKS=0 NODES=0	UNSAT TT=101.607	UNSAT TT=0.718 CHECKS=93	UNSAT TT=0.713 CHECKS=93	UNSAT TT=0.557 ASSIGNMENTS=0	UNSAT TT=0.51 ASSIGNMENTS=0	UNSAT TT=0.631 CHECKS=0 NODES=0	UNSAT TT=0.862 CHECKS=0 NODES=0	UNSAT TT=0.66 CHECKS=0 NODES=0	UNSAT TT=0.066 ASSIGNMENTS=0 CHECKS=357	UNSAT TT=0.069 ASSIGNMENTS=0 CHECKS=357	UNSAT TT=23.44	UNSAT TT=18.886	UNSAT TT=0.241 CHECKS=664	UNSAT TT=0.055 ASSIGNMENTS=0 CHECKS=357	UNSAT TT=0.055 ASSIGNMENTS=0 CHECKS=357	UNSAT TT=2.396	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=357	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=357	? TT=32.248	? (TO) TT=1800.06	UNSAT TT=168.63	UNSAT TT=428.884
csp/wordsVg/ normalized-crossword-m1c-words-vg12-13_ext.xml	UNSAT TT=0.13	UNSAT TT=0.854 CHECKS=0 NODES=6	UNSAT TT=0.887 CHECKS=0 NODES=0	? (TO) TT=1800.08	UNSAT TT=3.643 CHECKS=4275	UNSAT TT=4.11 CHECKS=5036	UNSAT TT=1.495 ASSIGNMENTS=0	UNSAT TT=1.666 ASSIGNMENTS=0	UNSAT TT=0.672 CHECKS=0 NODES=12	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.158 ASSIGNMENTS=10 CHECKS=2195	UNSAT TT=0.158 ASSIGNMENTS=10 CHECKS=2195	UNSAT TT=23.852	UNSAT TT=18.682	UNSAT TT=0.301 CHECKS=1198	UNSAT TT=0.13 ASSIGNMENTS=6 CHECKS=1935	UNSAT TT=0.853 ASSIGNMENTS=100 CHECKS=16127	UNSAT TT=3.367	UNSAT TT=0.343 ASSIGNMENTS=30 CHECKS=6295	UNSAT TT=0.144 ASSIGNMENTS=10 CHECKS=2195	? (exit code) TT=77.999	? (TO) TT=1800.05	UNSAT TT=191.747	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg12-15_ext.xml	UNSAT TT=0.039	UNSAT TT=0.769 CHECKS=0 NODES=0	UNSAT TT=0.832 CHECKS=0 NODES=0	UNSAT TT=66.932	UNSAT TT=0.468 CHECKS=43	UNSAT TT=0.537 CHECKS=43	UNSAT TT=0.475 ASSIGNMENTS=0	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.517 CHECKS=0 NODES=0	UNSAT TT=0.674 CHECKS=0 NODES=0	UNSAT TT=0.66 CHECKS=0 NODES=0	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=58	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=58	UNSAT TT=16.157	UNSAT TT=14.507	UNSAT TT=0.068 CHECKS=70	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=58	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=58	UNSAT TT=1.866	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=58	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=58	? TT=69.507	? (TO) TT=1800.09	UNSAT TT=122.934	UNSAT TT=210.892
csp/wordsVg/ normalized-crossword-m1c-words-vg12-16_ext.xml	UNSAT TT=0.028	UNSAT TT=0.792 CHECKS=0 NODES=0	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=23.98	UNSAT TT=0.44 CHECKS=29	UNSAT TT=0.421 CHECKS=29	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.521 ASSIGNMENTS=0	UNSAT TT=0.647 CHECKS=0 NODES=0	UNSAT TT=0.487 CHECKS=0 NODES=0	UNSAT TT=0.787 CHECKS=0 NODES=0	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=13	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=13	UNSAT TT=16.299	UNSAT TT=14.727	UNSAT TT=0.062 CHECKS=76	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=13	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=13	UNSAT TT=1.889	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=13	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=13	? (exit code) TT=83.74	? (TO) TT=1800.04	UNSAT TT=92.183	UNSAT TT=125.154
csp/wordsVg/ normalized-crossword-m1c-words-vg13-13_ext.xml	UNSAT TT=0.069	UNSAT TT=0.826 CHECKS=0 NODES=6	UNSAT TT=0.816 CHECKS=0 NODES=0	UNSAT TT=568.889	UNSAT TT=1.153 CHECKS=1783	UNSAT TT=1.035 CHECKS=1435	UNSAT TT=0.732 ASSIGNMENTS=0	UNSAT TT=0.743 ASSIGNMENTS=0	UNSAT TT=0.798 CHECKS=0 NODES=4	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.092 ASSIGNMENTS=3 CHECKS=1042	UNSAT TT=0.088 ASSIGNMENTS=3 CHECKS=1042	UNSAT TT=19.48	UNSAT TT=15.405	UNSAT TT=0.152 CHECKS=866	UNSAT TT=0.069 ASSIGNMENTS=2 CHECKS=824	UNSAT TT=0.14 ASSIGNMENTS=18 CHECKS=2354	UNSAT TT=2.101	UNSAT TT=0.154 ASSIGNMENTS=19 CHECKS=2325	UNSAT TT=0.073 ASSIGNMENTS=3 CHECKS=1042	? TT=62.275	? (TO) TT=1800.11	UNSAT TT=118.866	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg13-16_ext.xml	UNSAT TT=0.034	UNSAT TT=0.765 CHECKS=0 NODES=0	UNSAT TT=0.782 CHECKS=0 NODES=0	UNSAT TT=16.932	UNSAT TT=0.297 CHECKS=29	UNSAT TT=0.294 CHECKS=29	UNSAT TT=0.549 ASSIGNMENTS=0	UNSAT TT=0.653 ASSIGNMENTS=0	UNSAT TT=0.572 CHECKS=0 NODES=0	UNSAT TT=0.458 CHECKS=0 NODES=0	UNSAT TT=0.555 CHECKS=0 NODES=0	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=30	UNSAT TT=0.049 ASSIGNMENTS=0 CHECKS=30	UNSAT TT=12.203	UNSAT TT=11.306	UNSAT TT=0.049 CHECKS=83	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=30	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=30	UNSAT TT=1.327	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=30	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=30	? TT=108.571	? (TO) TT=1800.03	UNSAT TT=50.915	UNSAT TT=78.127
csp/wordsVg/ normalized-crossword-m1c-words-vg13-17_ext.xml	UNSAT TT=0.033	UNSAT TT=0.804 CHECKS=0 NODES=0	UNSAT TT=0.752 CHECKS=0 NODES=0	UNSAT TT=18.398	UNSAT TT=0.329 CHECKS=30	UNSAT TT=0.288 CHECKS=30	UNSAT TT=0.465 ASSIGNMENTS=0	UNSAT TT=0.603 ASSIGNMENTS=0	UNSAT TT=0.459 CHECKS=0 NODES=0	UNSAT TT=0.456 CHECKS=0 NODES=0	UNSAT TT=0.445 CHECKS=0 NODES=0	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=31	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=31	UNSAT TT=12.814	UNSAT TT=9.976	UNSAT TT=0.045 CHECKS=55	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=31	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=31	UNSAT TT=1.49	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=31	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=31	? TT=82.639	? (TO) TT=1800.09	UNSAT TT=50.075	UNSAT TT=76.339
csp/wordsVg/ normalized-crossword-m1c-words-vg14-14_ext.xml	UNSAT TT=0.035	UNSAT TT=0.915 CHECKS=0 NODES=0	UNSAT TT=0.774 CHECKS=0 NODES=0	UNSAT TT=118.394	UNSAT TT=0.361 CHECKS=98	UNSAT TT=0.363 CHECKS=98	UNSAT TT=0.512 ASSIGNMENTS=0	UNSAT TT=0.461 ASSIGNMENTS=0	UNSAT TT=0.442 CHECKS=0 NODES=0	UNSAT TT=0.42 CHECKS=0 NODES=0	UNSAT TT=0.436 CHECKS=0 NODES=0	UNSAT TT=0.049 ASSIGNMENTS=0 CHECKS=57	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=57	UNSAT TT=11.373	UNSAT TT=9.512	UNSAT TT=0.052 CHECKS=291	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=57	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=57	UNSAT TT=1.232	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=57	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=57	? TT=80.729	? (TO) TT=1800.04	UNSAT TT=43.788	UNSAT TT=77.833
csp/wordsVg/ normalized-crossword-m1c-words-vg14-16_ext.xml	UNSAT TT=0.026	UNSAT TT=0.904 CHECKS=0 NODES=0	UNSAT TT=0.903 CHECKS=0 NODES=0	UNSAT TT=16.945	UNSAT TT=0.182 CHECKS=30	UNSAT TT=0.179 CHECKS=30	UNSAT TT=0.464 ASSIGNMENTS=0	UNSAT TT=0.467 ASSIGNMENTS=0	UNSAT TT=0.451 CHECKS=0 NODES=0	UNSAT TT=0.459 CHECKS=0 NODES=0	UNSAT TT=0.41 CHECKS=0 NODES=0	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=9.247	UNSAT TT=7.763	UNSAT TT=0.035 CHECKS=97	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=1.103	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=15	? TT=108.428	? (TO) TT=1800.07	UNSAT TT=22.311	UNSAT TT=32.982
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsVg/ normalized-crossword-m1c-words-vg14-17_ext.xml	UNSAT TT=0.026	UNSAT TT=0.76 CHECKS=0 NODES=0	UNSAT TT=0.781 CHECKS=0 NODES=0	UNSAT TT=16.327	UNSAT TT=0.171 CHECKS=31	UNSAT TT=0.173 CHECKS=31	UNSAT TT=0.458 ASSIGNMENTS=0	UNSAT TT=0.452 ASSIGNMENTS=0	UNSAT TT=0.432 CHECKS=0 NODES=0	UNSAT TT=0.409 CHECKS=0 NODES=0	UNSAT TT=0.433 CHECKS=0 NODES=0	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=9.541	UNSAT TT=8.016	UNSAT TT=0.037 CHECKS=64	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.941	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=15	? TT=89.863	? (TO) TT=1800.05	UNSAT TT=22.494	UNSAT TT=33.116
csp/wordsVg/ normalized-crossword-m1c-words-vg14-18_ext.xml	UNSAT TT=0.025	UNSAT TT=0.759 CHECKS=0 NODES=0	UNSAT TT=0.788 CHECKS=0 NODES=0	UNSAT TT=15.821	UNSAT TT=0.194 CHECKS=32	UNSAT TT=0.184 CHECKS=32	UNSAT TT=0.556 ASSIGNMENTS=0	UNSAT TT=0.532 ASSIGNMENTS=0	UNSAT TT=0.434 CHECKS=0 NODES=0	UNSAT TT=0.43 CHECKS=0 NODES=0	UNSAT TT=0.431 CHECKS=0 NODES=0	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=9.22	UNSAT TT=7.502	UNSAT TT=0.03 CHECKS=54	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=1.062	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=15	? TT=80.81	? (TO) TT=1800.09	UNSAT TT=22.551	UNSAT TT=31.529
csp/wordsVg/ normalized-crossword-m1c-words-vg15-15_ext.xml	UNSAT TT=0.024	UNSAT TT=0.878 CHECKS=0 NODES=0	UNSAT TT=0.786 CHECKS=0 NODES=0	UNSAT TT=14.499	UNSAT TT=0.202 CHECKS=61	UNSAT TT=0.201 CHECKS=61	UNSAT TT=0.461 ASSIGNMENTS=0	UNSAT TT=0.447 ASSIGNMENTS=0	UNSAT TT=0.412 CHECKS=0 NODES=0	UNSAT TT=0.403 CHECKS=0 NODES=0	UNSAT TT=0.471 CHECKS=0 NODES=0	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=8.256	UNSAT TT=7.704	UNSAT TT=0.031 CHECKS=107	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.929	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=15	? TT=84.554	? (TO) TT=1800.01	UNSAT TT=19.613	UNSAT TT=28.02
csp/wordsVg/ normalized-crossword-m1c-words-vg15-16_ext.xml	UNSAT TT=0.026	UNSAT TT=0.793 CHECKS=0 NODES=0	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=11.076	UNSAT TT=0.124 CHECKS=31	UNSAT TT=0.123 CHECKS=31	UNSAT TT=0.548 ASSIGNMENTS=0	UNSAT TT=0.445 ASSIGNMENTS=0	UNSAT TT=0.443 CHECKS=0 NODES=0	UNSAT TT=0.487 CHECKS=0 NODES=0	UNSAT TT=0.521 CHECKS=0 NODES=0	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=6.892	UNSAT TT=6.277	UNSAT TT=0.032 CHECKS=60	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.868	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=16	? TT=82.058	? (TO) TT=1800.04	UNSAT TT=12.818	UNSAT TT=21.692
csp/wordsVg/ normalized-crossword-m1c-words-vg15-19_ext.xml	UNSAT TT=0.016	UNSAT TT=0.81 CHECKS=0 NODES=0	UNSAT TT=0.798 CHECKS=0 NODES=0	UNSAT TT=8.53	UNSAT TT=0.12 CHECKS=20	UNSAT TT=0.115 CHECKS=20	UNSAT TT=0.529 ASSIGNMENTS=0	UNSAT TT=0.536 ASSIGNMENTS=0	UNSAT TT=0.396 CHECKS=0 NODES=0	UNSAT TT=0.411 CHECKS=0 NODES=0	UNSAT TT=0.41 CHECKS=0 NODES=0	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=7.108	UNSAT TT=5.989	UNSAT TT=0.025 CHECKS=13	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.735	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=16	? TT=79.532	? (TO) TT=1800.05	UNSAT TT=11.325	UNSAT TT=17.094
csp/wordsVg/ normalized-crossword-m1c-words-vg4-4_ext.xml	SAT TT=0.011	SAT TT=0.806 CHECKS=9 NODES=16	SAT TT=0.818 CHECKS=9 NODES=0	SAT TT=0.232	SAT TT=0.19 CHECKS=485	SAT TT=0.217 CHECKS=580	SAT TT=0.964 ASSIGNMENTS=8	SAT TT=0.714 ASSIGNMENTS=13	SAT TT=1.264 CHECKS=969108 NODES=16	SAT TT=4.428 CHECKS=37403000 NODES=21000000	SAT TT=49.586 CHECKS=138264000 NODES=8795	SAT TT=0.025 ASSIGNMENTS=10 CHECKS=179	SAT TT=0.024 ASSIGNMENTS=10 CHECKS=179	SAT TT=4.324	SAT TT=3.86	SAT TT=0.021 CHECKS=89	SAT TT=0.012 ASSIGNMENTS=10 CHECKS=179	SAT TT=0.011 ASSIGNMENTS=8 CHECKS=193	SAT TT=0.507	SAT TT=0.011 ASSIGNMENTS=6 CHECKS=145	SAT TT=0.012 ASSIGNMENTS=10 CHECKS=179	SAT TT=30.552	SAT TT=0.029 ASSIGNMENTS=16 CHECKS=22445	SAT TT=1.652	SAT TT=2.169
csp/wordsVg/ normalized-crossword-m1c-words-vg4-6_ext.xml	SAT TT=0.037	SAT TT=0.914 CHECKS=20 NODES=31	SAT TT=0.788 CHECKS=10 NODES=24	SAT TT=5.522	SAT TT=0.483 CHECKS=1233	SAT TT=0.993 CHECKS=4312	SAT TT=1.336 ASSIGNMENTS=16	SAT TT=1.625 ASSIGNMENTS=22	SAT TT=201.178 CHECKS=714908000 NODES=65	? (TO) TT=1800	? (TO) TT=1800.04	SAT TT=0.051 ASSIGNMENTS=21 CHECKS=925	SAT TT=0.049 ASSIGNMENTS=21 CHECKS=925	SAT TT=24.336	SAT TT=89.032	SAT TT=0.057 CHECKS=218	SAT TT=0.04 ASSIGNMENTS=21 CHECKS=925	SAT TT=0.091 ASSIGNMENTS=83 CHECKS=3631	SAT TT=1.143	SAT TT=0.054 ASSIGNMENTS=49 CHECKS=1545	SAT TT=0.037 ASSIGNMENTS=21 CHECKS=925	? TT=88.422	SAT TT=0.549 ASSIGNMENTS=31 CHECKS=1275210	SAT TT=18.231	SAT TT=20.028
csp/wordsVg/ normalized-crossword-m1c-words-vg4-8_ext.xml	SAT TT=0.974	SAT TT=1.84 CHECKS=1545 NODES=1546	SAT TT=1.712 CHECKS=1975 NODES=1646	SAT TT=484.152	SAT TT=11.128 CHECKS=40259	SAT TT=9.851 CHECKS=33180	SAT TT=7.951 ASSIGNMENTS=436	SAT TT=3.219 ASSIGNMENTS=39	SAT TT=3.652 CHECKS=28784600 NODES=936	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.116 ASSIGNMENTS=542 CHECKS=42666	SAT TT=1.114 ASSIGNMENTS=542 CHECKS=42666	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.974 CHECKS=43766	SAT TT=4.415 ASSIGNMENTS=2016 CHECKS=164176	SAT TT=1.781 ASSIGNMENTS=1099 CHECKS=59647	SAT TT=7.324	SAT TT=1.033 ASSIGNMENTS=683 CHECKS=36816	SAT TT=1.099 ASSIGNMENTS=542 CHECKS=42666	? TT=87.035	? (TO) TT=1800.08	SAT TT=279.292	? (TO) TT=1800.13
csp/wordsVg/ normalized-crossword-m1c-words-vg5-7_ext.xml	SAT TT=3.18	SAT TT=3.18 CHECKS=4205 NODES=3991	SAT TT=16.22 CHECKS=74393 NODES=29537	? (TO) TT=1800.03	SAT TT=1233.7 CHECKS=4034100	SAT TT=679.765 CHECKS=2142610	SAT TT=124.473 ASSIGNMENTS=8385	SAT TT=1248.51 ASSIGNMENTS=48797	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=10.52 ASSIGNMENTS=3991 CHECKS=4205	SAT TT=10.1 ASSIGNMENTS=3991 CHECKS=4205	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=26.911 CHECKS=1061090	SAT TT=76.013 ASSIGNMENTS=30776 CHECKS=2636340	SAT TT=30.819 ASSIGNMENTS=13285 CHECKS=997653	SAT TT=935.789	SAT TT=292.342 ASSIGNMENTS=120850 CHECKS=10029800	SAT TT=53.217 ASSIGNMENTS=23732 CHECKS=1976390	? (MO) TT=33.837	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11
csp/wordsVg/ normalized-crossword-m1c-words-vg5-8_ext.xml	UNSAT TT=307.298	UNSAT TT=307.298 CHECKS=1191930 NODES=431363	UNSAT TT=357.151 CHECKS=1360750 NODES=539564	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=824.685 ASSIGNMENTS=212436 CHECKS=19484800	UNSAT TT=813.226 ASSIGNMENTS=212436 CHECKS=19484800	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=701.392 CHECKS=22958800	UNSAT TT=528.036 ASSIGNMENTS=185261 CHECKS=17560200	UNSAT TT=606.044 ASSIGNMENTS=200284 CHECKS=19178800	? (TO) TT=1800.04	UNSAT TT=577.449 ASSIGNMENTS=187959 CHECKS=17787200	UNSAT TT=607.972 ASSIGNMENTS=212436 CHECKS=19484800	? (MO) TT=31.078	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsVg/ normalized-crossword-m1c-words-vg5-9_ext.xml	UNSAT TT=138.233	UNSAT TT=162.747 CHECKS=395997 NODES=180738	UNSAT TT=138.233 CHECKS=296146 NODES=149872	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=750.89 ASSIGNMENTS=38664	UNSAT TT=821.525 ASSIGNMENTS=28579	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.03	UNSAT TT=159.848 ASSIGNMENTS=180738 CHECKS=395997	UNSAT TT=162.573 ASSIGNMENTS=180738 CHECKS=395997	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=403.078 CHECKS=10695600	UNSAT TT=255.868 ASSIGNMENTS=72007 CHECKS=7473690	UNSAT TT=230.804 ASSIGNMENTS=66358 CHECKS=6728890	? (TO) TT=1800.02	UNSAT TT=224.855 ASSIGNMENTS=63104 CHECKS=6593790	UNSAT TT=202.435 ASSIGNMENTS=57395 CHECKS=6080460	? (MO) TT=31.734	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09
csp/wordsVg/ normalized-crossword-m1c-words-vg6-10_ext.xml	UNSAT TT=68.176	UNSAT TT=74.684 CHECKS=80827 NODES=46555	UNSAT TT=69.459 CHECKS=63229 NODES=38966	? (TO) TT=1800.08	UNSAT TT=1255.31 CHECKS=2136320	UNSAT TT=913.349 CHECKS=1526180	UNSAT TT=157.28 ASSIGNMENTS=5391	UNSAT TT=918.097 ASSIGNMENTS=17271	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=80.856 ASSIGNMENTS=46555 CHECKS=80827	UNSAT TT=81.429 ASSIGNMENTS=46555 CHECKS=80827	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=219.464 CHECKS=2848640	UNSAT TT=85.97 ASSIGNMENTS=15932 CHECKS=2176830	UNSAT TT=85.72 ASSIGNMENTS=16531 CHECKS=2010940	UNSAT TT=874.653	UNSAT TT=68.176 ASSIGNMENTS=14219 CHECKS=1795420	UNSAT TT=72.915 ASSIGNMENTS=13221 CHECKS=1767860	? TT=74.011	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg6-6_ext.xml	SAT TT=0.329	SAT TT=0.984 CHECKS=344 NODES=235	SAT TT=1.155 CHECKS=110 NODES=139	SAT TT=922.487	SAT TT=15.876 CHECKS=54494	SAT TT=3.341 CHECKS=9718	SAT TT=4.33 ASSIGNMENTS=135	SAT TT=8.528 ASSIGNMENTS=284	SAT TT=607.591 CHECKS=3562100000 NODES=373	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=0.89 ASSIGNMENTS=375 CHECKS=25267	SAT TT=0.935 ASSIGNMENTS=375 CHECKS=25267	SAT TT=195.146	SAT TT=129.62	SAT TT=0.329 CHECKS=12398	SAT TT=0.632 ASSIGNMENTS=263 CHECKS=17852	SAT TT=7.361 ASSIGNMENTS=3892 CHECKS=225798	SAT TT=14.558	SAT TT=1.202 ASSIGNMENTS=772 CHECKS=39992	SAT TT=0.871 ASSIGNMENTS=375 CHECKS=25267	? TT=78.757	SAT TT=1.93 ASSIGNMENTS=40 CHECKS=5034760	SAT TT=605.979	SAT TT=395.396
csp/wordsVg/ normalized-crossword-m1c-words-vg6-7_ext.xml	UNSAT TT=1005.97	UNSAT TT=1005.97 CHECKS=3474640 NODES=1224090	UNSAT TT=1028.96 CHECKS=3544520 NODES=1241430	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=76.462	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg7-10_ext.xml	UNSAT TT=61.528	UNSAT TT=61.528 CHECKS=48414 NODES=29536	UNSAT TT=62.877 CHECKS=46695 NODES=25763	? (TO) TT=1800.11	UNSAT TT=1767.78 CHECKS=2260520	UNSAT TT=1174.03 CHECKS=1702450	UNSAT TT=599.454 ASSIGNMENTS=14881	UNSAT TT=805.409 ASSIGNMENTS=13360	UNSAT TT=180.598 CHECKS=0 NODES=28641	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=69.717 ASSIGNMENTS=29536 CHECKS=48414	UNSAT TT=67.65 ASSIGNMENTS=29536 CHECKS=48414	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=313.011 CHECKS=2834840	UNSAT TT=120.43 ASSIGNMENTS=18632 CHECKS=2703850	UNSAT TT=128.536 ASSIGNMENTS=20404 CHECKS=2816800	UNSAT TT=943.241	UNSAT TT=104.145 ASSIGNMENTS=16293 CHECKS=2396050	UNSAT TT=117.566 ASSIGNMENTS=18216 CHECKS=2689390	? TT=86.202	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/wordsVg/ normalized-crossword-m1c-words-vg7-11_ext.xml	UNSAT TT=17.7	UNSAT TT=18.683 CHECKS=5627 NODES=6585	UNSAT TT=17.7 CHECKS=3807 NODES=5779	? (TO) TT=1800.04	UNSAT TT=268.487 CHECKS=398580	UNSAT TT=237.829 CHECKS=361626	UNSAT TT=53.081 ASSIGNMENTS=1231	UNSAT TT=154.36 ASSIGNMENTS=2138	UNSAT TT=56.137 CHECKS=0 NODES=7468	? (TO) TT=1800.01	? (TO) TT=1800.09	UNSAT TT=26.322 ASSIGNMENTS=6585 CHECKS=5627	UNSAT TT=27.567 ASSIGNMENTS=6585 CHECKS=5627	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=70.242 CHECKS=569138	UNSAT TT=27.848 ASSIGNMENTS=4119 CHECKS=656014	UNSAT TT=41.782 ASSIGNMENTS=6904 CHECKS=872345	UNSAT TT=275.404	UNSAT TT=30.875 ASSIGNMENTS=4658 CHECKS=672887	UNSAT TT=27.376 ASSIGNMENTS=3794 CHECKS=588277	? TT=89.713	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg7-7_ext.xml	SAT TT=42.386	SAT TT=89.503 CHECKS=245428 NODES=81118	SAT TT=86.625 CHECKS=254815 NODES=80512	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=343.776 ASSIGNMENTS=13195	SAT TT=1516.06 ASSIGNMENTS=38642	SAT TT=72.1 CHECKS=0 NODES=34780	? (TO) TT=1800.01	? (TO) TT=1800.13	SAT TT=62.636 ASSIGNMENTS=56255 CHECKS=191430	SAT TT=64.281 ASSIGNMENTS=56255 CHECKS=191430	? (TO) TT=1800	? (TO) TT=1800	SAT TT=644.918 CHECKS=12405900	SAT TT=228.488 ASSIGNMENTS=47786 CHECKS=5146290	SAT TT=330.483 ASSIGNMENTS=70519 CHECKS=7328750	? (TO) TT=1800.05	SAT TT=42.386 ASSIGNMENTS=9246 CHECKS=1009290	SAT TT=146.834 ASSIGNMENTS=32967 CHECKS=3586880	? TT=87.722	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.04
csp/wordsVg/ normalized-crossword-m1c-words-vg7-8_ext.xml	UNSAT TT=482.525	UNSAT TT=482.525 CHECKS=1306110 NODES=362557	UNSAT TT=540.328 CHECKS=1456270 NODES=402965	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.12	UNSAT TT=1575.42 CHECKS=0 NODES=459316	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=1525.7 CHECKS=24583200	UNSAT TT=1011.57 ASSIGNMENTS=176374 CHECKS=21345000	UNSAT TT=1041.51 ASSIGNMENTS=190386 CHECKS=23437500	? (TO) TT=1800.05	UNSAT TT=1103.11 ASSIGNMENTS=187539 CHECKS=23116300	UNSAT TT=874.042 ASSIGNMENTS=163505 CHECKS=19945100	? TT=88.319	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05
csp/wordsVg/ normalized-crossword-m1c-words-vg7-9_ext.xml	UNSAT TT=205.883	UNSAT TT=229.929 CHECKS=341501 NODES=117941	UNSAT TT=205.883 CHECKS=309939 NODES=104461	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=601.414 ASSIGNMENTS=18012	? (TO) TT=1800.12	UNSAT TT=695.471 CHECKS=0 NODES=152135	? (TO) TT=1800	? (TO) TT=1800.09	UNSAT TT=553.936 ASSIGNMENTS=67552 CHECKS=9134720	UNSAT TT=585.674 ASSIGNMENTS=67552 CHECKS=9134720	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=604.447 CHECKS=6786270	UNSAT TT=530.53 ASSIGNMENTS=81405 CHECKS=11396800	UNSAT TT=390.686 ASSIGNMENTS=60537 CHECKS=8012880	? (TO) TT=1800.09	UNSAT TT=353.875 ASSIGNMENTS=59728 CHECKS=7867780	UNSAT TT=433.659 ASSIGNMENTS=67552 CHECKS=9134720	? TT=86.172	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.04
csp/wordsVg/ normalized-crossword-m1c-words-vg8-11_ext.xml	UNSAT TT=14.987	UNSAT TT=14.987 CHECKS=5427 NODES=3503	UNSAT TT=16.36 CHECKS=4384 NODES=3675	? (TO) TT=1800.05	UNSAT TT=151.909 CHECKS=213522	UNSAT TT=226.321 CHECKS=288234	UNSAT TT=68.522 ASSIGNMENTS=1139	UNSAT TT=108.321 ASSIGNMENTS=1355	UNSAT TT=64.987 CHECKS=0 NODES=7168	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=20.923 ASSIGNMENTS=3503 CHECKS=5427	UNSAT TT=21.123 ASSIGNMENTS=3503 CHECKS=5427	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=54.614 CHECKS=321395	UNSAT TT=17.807 ASSIGNMENTS=2270 CHECKS=383933	UNSAT TT=40.622 ASSIGNMENTS=5935 CHECKS=770052	UNSAT TT=224.578	UNSAT TT=27.874 ASSIGNMENTS=3911 CHECKS=568179	UNSAT TT=18.03 ASSIGNMENTS=2331 CHECKS=385833	? TT=30.182	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsVg/ normalized-crossword-m1c-words-vg8-12_ext.xml	UNSAT TT=2.994	UNSAT TT=4.533 CHECKS=319 NODES=859	UNSAT TT=5.223 CHECKS=262 NODES=860	? (TO) TT=1800.04	UNSAT TT=81.204 CHECKS=111491	UNSAT TT=47.421 CHECKS=75110	UNSAT TT=27.659 ASSIGNMENTS=214	UNSAT TT=38.474 ASSIGNMENTS=283	UNSAT TT=18.832 CHECKS=0 NODES=1276	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=11.966 ASSIGNMENTS=859 CHECKS=319	UNSAT TT=12.689 ASSIGNMENTS=859 CHECKS=319	UNSAT TT=538.073	UNSAT TT=372.307	UNSAT TT=6.247 CHECKS=39626	UNSAT TT=2.994 ASSIGNMENTS=328 CHECKS=61768	UNSAT TT=25.34 ASSIGNMENTS=4172 CHECKS=530408	UNSAT TT=34.749	UNSAT TT=10.763 ASSIGNMENTS=1718 CHECKS=230100	UNSAT TT=3.039 ASSIGNMENTS=328 CHECKS=62934	? TT=27.252	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800
csp/wordsVg/ normalized-crossword-m1c-words-vg8-8_ext.xml	UNSAT TT=256.285	UNSAT TT=256.285 CHECKS=426947 NODES=134285	UNSAT TT=303.051 CHECKS=519285 NODES=150321	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=1532.94 ASSIGNMENTS=42898	? (TO) TT=1800.14	UNSAT TT=945.495 CHECKS=0 NODES=187913	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=715.543 ASSIGNMENTS=86725 CHECKS=11935100	UNSAT TT=739.616 ASSIGNMENTS=86725 CHECKS=11935100	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=595.667 CHECKS=7742600	UNSAT TT=586.258 ASSIGNMENTS=85013 CHECKS=11811600	UNSAT TT=571.922 ASSIGNMENTS=84026 CHECKS=11362200	? (TO) TT=1800.08	UNSAT TT=526.102 ASSIGNMENTS=82817 CHECKS=11378900	UNSAT TT=559.285 ASSIGNMENTS=86725 CHECKS=11935100	? TT=27.985	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.01
csp/wordsVg/ normalized-crossword-m1c-words-vg8-9_ext.xml	UNSAT TT=157.179	UNSAT TT=157.179 CHECKS=203242 NODES=68003	UNSAT TT=206.856 CHECKS=219348 NODES=84429	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=1211.58 ASSIGNMENTS=29613	? (TO) TT=1800.08	UNSAT TT=502.983 CHECKS=0 NODES=79532	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=161.908 ASSIGNMENTS=68003 CHECKS=203242	UNSAT TT=375.816 ASSIGNMENTS=33324 CHECKS=4975340	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=279.881 CHECKS=2741370	UNSAT TT=230.623 ASSIGNMENTS=30065 CHECKS=4530170	UNSAT TT=233.677 ASSIGNMENTS=31296 CHECKS=4457640	? (TO) TT=1800.08	UNSAT TT=215.221 ASSIGNMENTS=28633 CHECKS=4184700	UNSAT TT=236.248 ASSIGNMENTS=33324 CHECKS=4975340	? TT=35.786	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02
csp/wordsVg/ normalized-crossword-m1c-words-vg9-10_ext.xml	UNSAT TT=25.952	UNSAT TT=25.952 CHECKS=3137 NODES=5749	UNSAT TT=26.456 CHECKS=3604 NODES=5760	? (TO) TT=1800.07	UNSAT TT=731.397 CHECKS=730952	UNSAT TT=384.645 CHECKS=481514	UNSAT TT=97.258 ASSIGNMENTS=1737	UNSAT TT=1654.54 ASSIGNMENTS=17873	UNSAT TT=83.236 CHECKS=0 NODES=7129	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=31.387 ASSIGNMENTS=5749 CHECKS=3137	UNSAT TT=31.94 ASSIGNMENTS=5749 CHECKS=3137	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=124.13 CHECKS=796497	UNSAT TT=47.702 ASSIGNMENTS=5299 CHECKS=909166	UNSAT TT=55.867 ASSIGNMENTS=7798 CHECKS=1107920	UNSAT TT=344.076	UNSAT TT=45.792 ASSIGNMENTS=5835 CHECKS=879127	UNSAT TT=68.572 ASSIGNMENTS=8274 CHECKS=1297820	? TT=31.916	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03
csp/wordsVg/ normalized-crossword-m1c-words-vg9-11_ext.xml	UNSAT TT=9.688	UNSAT TT=9.688 CHECKS=628 NODES=1930	UNSAT TT=11.253 CHECKS=706 NODES=1898	? (TO) TT=1800.12	UNSAT TT=331.904 CHECKS=360313	UNSAT TT=122.437 CHECKS=151365	UNSAT TT=46.97 ASSIGNMENTS=486	UNSAT TT=84.602 ASSIGNMENTS=897	UNSAT TT=29.583 CHECKS=0 NODES=2185	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=17.041 ASSIGNMENTS=1930 CHECKS=628	UNSAT TT=16.863 ASSIGNMENTS=1930 CHECKS=628	UNSAT TT=948.661	UNSAT TT=1110.34	UNSAT TT=31.108 CHECKS=162880	UNSAT TT=12.807 ASSIGNMENTS=1424 CHECKS=241581	UNSAT TT=35.179 ASSIGNMENTS=4847 CHECKS=657431	UNSAT TT=113.591	UNSAT TT=18.707 ASSIGNMENTS=2778 CHECKS=406946	UNSAT TT=15.741 ASSIGNMENTS=1788 CHECKS=312446	? TT=29.779	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07
csp/wordsVg/ normalized-crossword-m1c-words-vg9-12_ext.xml	UNSAT TT=3.542	UNSAT TT=3.855 CHECKS=72 NODES=593	UNSAT TT=5.1 CHECKS=100 NODES=588	? (TO) TT=1800.14	UNSAT TT=103.125 CHECKS=123784	UNSAT TT=64.532 CHECKS=69241	UNSAT TT=30.268 ASSIGNMENTS=119	UNSAT TT=36.959 ASSIGNMENTS=133	UNSAT TT=10.905 CHECKS=0 NODES=780	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=11.015 ASSIGNMENTS=593 CHECKS=72	UNSAT TT=11.386 ASSIGNMENTS=593 CHECKS=72	UNSAT TT=353.65	UNSAT TT=261.355	UNSAT TT=13.454 CHECKS=62134	UNSAT TT=3.542 ASSIGNMENTS=396 CHECKS=70514	UNSAT TT=26.578 ASSIGNMENTS=3882 CHECKS=499662	UNSAT TT=31.826	UNSAT TT=11.595 ASSIGNMENTS=1776 CHECKS=242355	UNSAT TT=5.186 ASSIGNMENTS=599 CHECKS=102215	? TT=24.807	? (TO) TT=1800.03	UNSAT TT=1550.59	? (TO) TT=1800.07
csp/wordsVg/ normalized-crossword-m1c-words-vg9-13_ext.xml	UNSAT TT=1.217	UNSAT TT=1.769 CHECKS=0 NODES=161	UNSAT TT=4.298 CHECKS=0 NODES=161	? (TO) TT=1800.1	UNSAT TT=62.482 CHECKS=83238	UNSAT TT=28.338 CHECKS=30748	UNSAT TT=25.693 ASSIGNMENTS=0	UNSAT TT=25.182 ASSIGNMENTS=0	UNSAT TT=4.139 CHECKS=0 NODES=214	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=1.241 ASSIGNMENTS=120 CHECKS=24524	UNSAT TT=1.227 ASSIGNMENTS=120 CHECKS=24524	UNSAT TT=124.56	UNSAT TT=77.744	UNSAT TT=5.52 CHECKS=22357	UNSAT TT=1.308 ASSIGNMENTS=138 CHECKS=25506	UNSAT TT=24.231 ASSIGNMENTS=3439 CHECKS=457977	UNSAT TT=16.551	UNSAT TT=8.597 ASSIGNMENTS=1554 CHECKS=181939	UNSAT TT=1.217 ASSIGNMENTS=120 CHECKS=24524	? TT=24.597	? (TO) TT=1800.03	UNSAT TT=567.205	? (TO) TT=1800.02

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	2274	2268	1998	1753	1776	1912	2377	1913	940	531	2744	2740	748	748	576	2510	1973	1036	2512	2610	1190	472	2215	2181
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	2274	2268	1998	1753	1776	1912	2377	1913	940	531	2744	2740	748	748	576	2510	1973	1036	2512	2610	1190	472	2215	2181
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	86	79	224	59	90	22	27	6	70	3	63	54	6	12	120	602	242	39	387	742	7	4	139	105
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0