CSP 2008 Competition: results by benchmark

Results by benchmark for category all categories

This page displays the results of the different solvers for each benchmark for category all categories

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
mddc-solv 2008-06-09
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
spider 2008-06-14
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-100/ normalized-aim-100-1-6-sat-1_ext.xml	SAT TT=0.009	SAT TT=0.837 CHECKS=1705 NODES=236	SAT TT=0.854 CHECKS=3280 NODES=357	SAT TT=30.865	SAT TT=0.013 CHECKS=1438	SAT TT=0.017 CHECKS=4422	SAT TT=0.509 ASSIGNMENTS=15	SAT TT=0.467 ASSIGNMENTS=8	SAT TT=0.423 CHECKS=809 NODES=151	? (TO) TT=1800.04	SAT TT=0.443 CHECKS=153439 NODES=1104	SAT TT=0.022 ASSIGNMENTS=81 CHECKS=2550	SAT TT=0.023 ASSIGNMENTS=81 CHECKS=2550	SAT TT=0.971	SAT TT=1.179	SAT TT=0.057 CHECKS=4633	SAT TT=0.009 ASSIGNMENTS=80 CHECKS=2661	SAT TT=0.035 ASSIGNMENTS=5759 CHECKS=89684	SAT TT=0.431	SAT TT=0.013 ASSIGNMENTS=353 CHECKS=12552	SAT TT=0.011 ASSIGNMENTS=81 CHECKS=2550	SAT TT=0.973	SAT TT=0.025 ASSIGNMENTS=105 CHECKS=1900	SAT TT=0.743	SAT TT=0.742
csp/aim-100/ normalized-aim-100-1-6-sat-2_ext.xml	SAT TT=0.013	SAT TT=0.836 CHECKS=6717 NODES=839	SAT TT=0.862 CHECKS=3778 NODES=490	SAT TT=154.458	SAT TT=0.023 CHECKS=7555	SAT TT=0.041 CHECKS=31706	SAT TT=0.501 ASSIGNMENTS=33	SAT TT=0.479 ASSIGNMENTS=17	SAT TT=0.496 CHECKS=2236 NODES=308	? (TO) TT=1800.05	SAT TT=0.419 CHECKS=145002 NODES=943	SAT TT=0.024 ASSIGNMENTS=274 CHECKS=7201	SAT TT=0.025 ASSIGNMENTS=274 CHECKS=7201	SAT TT=1.1	SAT TT=0.909	SAT TT=0.046 CHECKS=9881	SAT TT=0.013 ASSIGNMENTS=407 CHECKS=10178	SAT TT=0.031 ASSIGNMENTS=5908 CHECKS=85589	SAT TT=0.427	SAT TT=0.013 ASSIGNMENTS=357 CHECKS=8522	SAT TT=0.013 ASSIGNMENTS=274 CHECKS=7201	SAT TT=0.873	SAT TT=0.026 ASSIGNMENTS=227 CHECKS=5363	SAT TT=0.661	SAT TT=0.694
csp/aim-100/ normalized-aim-100-1-6-sat-3_ext.xml	SAT TT=0.011	SAT TT=0.837 CHECKS=5946 NODES=929	SAT TT=0.968 CHECKS=7737 NODES=937	SAT TT=110.652	SAT TT=0.014 CHECKS=3166	SAT TT=0.038 CHECKS=30860	SAT TT=0.527 ASSIGNMENTS=273	SAT TT=0.553 ASSIGNMENTS=327	SAT TT=0.449 CHECKS=1065 NODES=174	? (TO) TT=1800.06	SAT TT=2.144 CHECKS=12091200 NODES=73135	SAT TT=0.022 ASSIGNMENTS=203 CHECKS=5090	SAT TT=0.022 ASSIGNMENTS=203 CHECKS=5090	SAT TT=0.906	SAT TT=0.975	SAT TT=0.045 CHECKS=10042	SAT TT=0.012 ASSIGNMENTS=413 CHECKS=10441	SAT TT=0.03 ASSIGNMENTS=6055 CHECKS=77553	SAT TT=0.346	SAT TT=0.012 ASSIGNMENTS=372 CHECKS=6794	SAT TT=0.011 ASSIGNMENTS=203 CHECKS=5090	SAT TT=0.902	SAT TT=0.041 ASSIGNMENTS=540 CHECKS=25724	SAT TT=0.645	SAT TT=0.689
csp/aim-100/ normalized-aim-100-1-6-sat-4_ext.xml	SAT TT=0.011	SAT TT=0.77 CHECKS=1103 NODES=215	SAT TT=0.819 CHECKS=1526 NODES=212	SAT TT=1.302	SAT TT=0.022 CHECKS=7911	SAT TT=0.02 CHECKS=7522	SAT TT=0.528 ASSIGNMENTS=230	SAT TT=0.552 ASSIGNMENTS=79	SAT TT=0.4 CHECKS=1190 NODES=177	? (TO) TT=1800.05	SAT TT=0.501 CHECKS=298671 NODES=1688	SAT TT=0.023 ASSIGNMENTS=168 CHECKS=4432	SAT TT=0.023 ASSIGNMENTS=168 CHECKS=4432	SAT TT=0.929	SAT TT=1.105	SAT TT=0.039 CHECKS=2257	SAT TT=0.012 ASSIGNMENTS=186 CHECKS=4657	SAT TT=0.032 ASSIGNMENTS=5793 CHECKS=86640	SAT TT=0.354	SAT TT=0.011 ASSIGNMENTS=265 CHECKS=4661	SAT TT=0.011 ASSIGNMENTS=168 CHECKS=4432	SAT TT=0.805	SAT TT=0.024 ASSIGNMENTS=317 CHECKS=15269	SAT TT=0.696	SAT TT=0.648
csp/aim-100/ normalized-aim-100-1-6-unsat-1_ext.xml	UNSAT TT=0.023	UNSAT TT=1.061 CHECKS=54585 NODES=5225	UNSAT TT=1.07 CHECKS=50025 NODES=4694	? (TO) TT=1800.04	UNSAT TT=0.102 CHECKS=61774	UNSAT TT=0.089 CHECKS=64928	UNSAT TT=1.032 ASSIGNMENTS=5914	UNSAT TT=0.82 ASSIGNMENTS=1391	UNSAT TT=0.456 CHECKS=7064 NODES=589	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=0.041 ASSIGNMENTS=2886 CHECKS=60434	UNSAT TT=0.04 ASSIGNMENTS=2886 CHECKS=60434	UNSAT TT=0.565	UNSAT TT=0.696	UNSAT TT=0.07 CHECKS=26332	UNSAT TT=0.024 ASSIGNMENTS=2881 CHECKS=63131	UNSAT TT=0.031 ASSIGNMENTS=8029 CHECKS=90757	UNSAT TT=0.445	UNSAT TT=0.023 ASSIGNMENTS=2017 CHECKS=35977	UNSAT TT=0.025 ASSIGNMENTS=2886 CHECKS=60434	UNSAT TT=0.821	UNSAT TT=0.066 ASSIGNMENTS=887 CHECKS=32392	UNSAT TT=0.66	UNSAT TT=0.648
csp/aim-100/ normalized-aim-100-1-6-unsat-2_ext.xml	UNSAT TT=0.015	UNSAT TT=0.962 CHECKS=19505 NODES=1835	UNSAT TT=0.926 CHECKS=19461 NODES=1768	UNSAT TT=201.423	UNSAT TT=0.058 CHECKS=29844	UNSAT TT=0.171 CHECKS=131979	UNSAT TT=0.712 ASSIGNMENTS=1705	UNSAT TT=0.607 ASSIGNMENTS=388	UNSAT TT=0.525 CHECKS=5820 NODES=494	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=0.04 ASSIGNMENTS=2271 CHECKS=56365	UNSAT TT=0.037 ASSIGNMENTS=2271 CHECKS=56365	UNSAT TT=0.572	UNSAT TT=0.57	UNSAT TT=0.069 CHECKS=25720	UNSAT TT=0.028 ASSIGNMENTS=2350 CHECKS=61699	UNSAT TT=0.038 ASSIGNMENTS=7613 CHECKS=107465	UNSAT TT=0.366	UNSAT TT=0.015 ASSIGNMENTS=620 CHECKS=13227	UNSAT TT=0.023 ASSIGNMENTS=2271 CHECKS=56365	UNSAT TT=0.799	UNSAT TT=0.059 ASSIGNMENTS=1466 CHECKS=65779	UNSAT TT=0.65	UNSAT TT=0.678
csp/aim-100/ normalized-aim-100-1-6-unsat-3_ext.xml	UNSAT TT=0.068	UNSAT TT=1.089 CHECKS=71698 NODES=6813	UNSAT TT=1.282 CHECKS=105326 NODES=9372	? (TO) TT=1800.08	UNSAT TT=0.448 CHECKS=317483	UNSAT TT=0.226 CHECKS=192589	UNSAT TT=2.701 ASSIGNMENTS=27877	UNSAT TT=0.713 ASSIGNMENTS=1207	UNSAT TT=0.898 CHECKS=114616 NODES=7084	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.09 ASSIGNMENTS=10409 CHECKS=226716	UNSAT TT=0.094 ASSIGNMENTS=10409 CHECKS=226716	UNSAT TT=0.715	UNSAT TT=0.557	UNSAT TT=0.127 CHECKS=72138	UNSAT TT=0.068 ASSIGNMENTS=9660 CHECKS=213423	UNSAT TT=0.067 ASSIGNMENTS=13197 CHECKS=210238	UNSAT TT=0.618	UNSAT TT=0.084 ASSIGNMENTS=10146 CHECKS=239740	UNSAT TT=0.07 ASSIGNMENTS=10409 CHECKS=226716	UNSAT TT=0.817	UNSAT TT=0.617 ASSIGNMENTS=21358 CHECKS=700509	UNSAT TT=0.668	UNSAT TT=0.689
csp/aim-100/ normalized-aim-100-1-6-unsat-4_ext.xml	UNSAT TT=0.028	UNSAT TT=1.012 CHECKS=28155 NODES=3311	UNSAT TT=1.02 CHECKS=33338 NODES=3713	? (TO) TT=1800.1	UNSAT TT=0.145 CHECKS=87309	UNSAT TT=0.15 CHECKS=118548	UNSAT TT=1.276 ASSIGNMENTS=8856	UNSAT TT=1.814 ASSIGNMENTS=11034	UNSAT TT=0.47 CHECKS=6361 NODES=596	? (TO) TT=1800.09	? (TO) TT=1800	UNSAT TT=0.076 ASSIGNMENTS=8133 CHECKS=178844	UNSAT TT=0.077 ASSIGNMENTS=8133 CHECKS=178844	UNSAT TT=0.705	UNSAT TT=0.564	UNSAT TT=0.071 CHECKS=21643	UNSAT TT=0.037 ASSIGNMENTS=5255 CHECKS=118129	UNSAT TT=0.034 ASSIGNMENTS=8264 CHECKS=82592	UNSAT TT=0.441	UNSAT TT=0.028 ASSIGNMENTS=2732 CHECKS=52884	UNSAT TT=0.052 ASSIGNMENTS=8133 CHECKS=178844	UNSAT TT=0.868	UNSAT TT=0.085 ASSIGNMENTS=2108 CHECKS=68085	UNSAT TT=0.666	UNSAT TT=0.705
csp/aim-100/ normalized-aim-100-2-0-sat-1_ext.xml	SAT TT=0.013	SAT TT=0.868 CHECKS=6443 NODES=838	SAT TT=0.929 CHECKS=8534 NODES=938	SAT TT=193.579	SAT TT=0.066 CHECKS=40312	SAT TT=0.036 CHECKS=23149	SAT TT=0.638 ASSIGNMENTS=707	SAT TT=0.834 ASSIGNMENTS=1272	SAT TT=0.537 CHECKS=3027 NODES=272	SAT TT=18.447 CHECKS=66901000 NODES=3076570	SAT TT=0.59 CHECKS=1001320 NODES=5272	SAT TT=0.024 ASSIGNMENTS=490 CHECKS=12713	SAT TT=0.026 ASSIGNMENTS=490 CHECKS=12713	SAT TT=1.076	SAT TT=0.94	SAT TT=0.049 CHECKS=11863	SAT TT=0.015 ASSIGNMENTS=561 CHECKS=19429	SAT TT=0.043 ASSIGNMENTS=5316 CHECKS=136211	SAT TT=0.392	SAT TT=0.013 ASSIGNMENTS=450 CHECKS=9729	SAT TT=0.013 ASSIGNMENTS=490 CHECKS=12713	SAT TT=0.827	SAT TT=0.065 ASSIGNMENTS=1130 CHECKS=63380	SAT TT=0.735	SAT TT=0.708
csp/aim-100/ normalized-aim-100-2-0-sat-2_ext.xml	SAT TT=0.016	SAT TT=0.96 CHECKS=26691 NODES=2591	SAT TT=1.025 CHECKS=25652 NODES=2414	SAT TT=54.542	SAT TT=0.178 CHECKS=151621	SAT TT=0.136 CHECKS=154655	SAT TT=0.896 ASSIGNMENTS=2354	SAT TT=1.103 ASSIGNMENTS=3374	SAT TT=0.525 CHECKS=19967 NODES=928	SAT TT=604.591 CHECKS=2285100000 NODES=100912000	SAT TT=1532.64 CHECKS=11544600000 NODES=31098400	SAT TT=0.031 ASSIGNMENTS=822 CHECKS=33873	SAT TT=0.03 ASSIGNMENTS=822 CHECKS=33873	SAT TT=1.025	SAT TT=1.244	SAT TT=0.065 CHECKS=32651	SAT TT=0.016 ASSIGNMENTS=800 CHECKS=32848	SAT TT=0.044 ASSIGNMENTS=5354 CHECKS=142545	SAT TT=0.406	SAT TT=0.016 ASSIGNMENTS=585 CHECKS=17249	SAT TT=0.019 ASSIGNMENTS=822 CHECKS=33873	SAT TT=0.876	SAT TT=0.076 ASSIGNMENTS=639 CHECKS=29969	SAT TT=0.673	SAT TT=0.796
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-100/ normalized-aim-100-2-0-sat-3_ext.xml	SAT TT=0.013	SAT TT=0.859 CHECKS=5023 NODES=570	SAT TT=0.822 CHECKS=1673 NODES=233	SAT TT=2.442	SAT TT=0.015 CHECKS=4055	SAT TT=0.118 CHECKS=147710	SAT TT=0.591 ASSIGNMENTS=338	SAT TT=0.485 ASSIGNMENTS=7	SAT TT=0.524 CHECKS=2766 NODES=256	SAT TT=439.907 CHECKS=1594820000 NODES=77786100	? (TO) TT=1800.04	SAT TT=0.034 ASSIGNMENTS=968 CHECKS=42795	SAT TT=0.033 ASSIGNMENTS=968 CHECKS=42795	SAT TT=1.124	SAT TT=1.032	SAT TT=0.077 CHECKS=12697	SAT TT=0.023 ASSIGNMENTS=1443 CHECKS=55357	SAT TT=0.046 ASSIGNMENTS=5382 CHECKS=136304	SAT TT=0.441	SAT TT=0.013 ASSIGNMENTS=563 CHECKS=15966	SAT TT=0.02 ASSIGNMENTS=968 CHECKS=42795	SAT TT=1.007	SAT TT=0.055 ASSIGNMENTS=724 CHECKS=31913	SAT TT=0.748	SAT TT=0.719
csp/aim-100/ normalized-aim-100-2-0-sat-4_ext.xml	SAT TT=0.015	SAT TT=0.923 CHECKS=8479 NODES=977	SAT TT=0.891 CHECKS=10400 NODES=1197	SAT TT=332.479	SAT TT=0.089 CHECKS=63789	SAT TT=0.058 CHECKS=65978	SAT TT=0.574 ASSIGNMENTS=279	SAT TT=0.682 ASSIGNMENTS=768	SAT TT=0.424 CHECKS=2819 NODES=255	SAT TT=796.756 CHECKS=3027680000 NODES=143701000	SAT TT=0.515 CHECKS=173781 NODES=1221	SAT TT=0.026 ASSIGNMENTS=271 CHECKS=12723	SAT TT=0.019 ASSIGNMENTS=271 CHECKS=12723	SAT TT=1.04	SAT TT=1.096	SAT TT=0.065 CHECKS=19179	SAT TT=0.015 ASSIGNMENTS=445 CHECKS=23246	SAT TT=0.045 ASSIGNMENTS=5460 CHECKS=141277	SAT TT=0.417	SAT TT=0.025 ASSIGNMENTS=1439 CHECKS=58079	SAT TT=0.015 ASSIGNMENTS=271 CHECKS=12723	SAT TT=0.891	SAT TT=0.033 ASSIGNMENTS=247 CHECKS=7456	SAT TT=0.676	SAT TT=0.713
csp/aim-100/ normalized-aim-100-2-0-unsat-1_ext.xml	UNSAT TT=0.011	UNSAT TT=0.812 CHECKS=1576 NODES=238	UNSAT TT=0.803 CHECKS=1036 NODES=147	UNSAT TT=388.858	UNSAT TT=0.024 CHECKS=6978	UNSAT TT=0.025 CHECKS=10526	UNSAT TT=0.533 ASSIGNMENTS=203	UNSAT TT=0.664 ASSIGNMENTS=120	UNSAT TT=0.435 CHECKS=1422 NODES=89	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.025 ASSIGNMENTS=181 CHECKS=6009	UNSAT TT=0.025 ASSIGNMENTS=181 CHECKS=6009	UNSAT TT=0.804	UNSAT TT=0.601	UNSAT TT=0.04 CHECKS=2754	UNSAT TT=0.013 ASSIGNMENTS=173 CHECKS=5951	UNSAT TT=0.041 ASSIGNMENTS=5820 CHECKS=122320	UNSAT TT=0.397	UNSAT TT=0.012 ASSIGNMENTS=228 CHECKS=3612	UNSAT TT=0.011 ASSIGNMENTS=181 CHECKS=6009	UNSAT TT=0.876	UNSAT TT=0.023 ASSIGNMENTS=74 CHECKS=3047	UNSAT TT=0.74	UNSAT TT=0.741
csp/aim-100/ normalized-aim-100-2-0-unsat-2_ext.xml	UNSAT TT=0.013	UNSAT TT=0.99 CHECKS=8547 NODES=869	UNSAT TT=0.945 CHECKS=15082 NODES=1327	? (TO) TT=1800.07	UNSAT TT=0.079 CHECKS=49886	UNSAT TT=0.135 CHECKS=119309	UNSAT TT=0.671 ASSIGNMENTS=957	UNSAT TT=0.602 ASSIGNMENTS=371	UNSAT TT=0.481 CHECKS=7666 NODES=439	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.027 ASSIGNMENTS=872 CHECKS=26851	UNSAT TT=0.029 ASSIGNMENTS=872 CHECKS=26851	UNSAT TT=0.615	UNSAT TT=0.739	UNSAT TT=0.059 CHECKS=15480	UNSAT TT=0.017 ASSIGNMENTS=875 CHECKS=27836	UNSAT TT=0.043 ASSIGNMENTS=5835 CHECKS=130309	UNSAT TT=0.393	UNSAT TT=0.013 ASSIGNMENTS=427 CHECKS=8833	UNSAT TT=0.018 ASSIGNMENTS=872 CHECKS=26851	UNSAT TT=0.872	UNSAT TT=0.032 ASSIGNMENTS=263 CHECKS=13063	UNSAT TT=0.74	UNSAT TT=0.711
csp/aim-100/ normalized-aim-100-2-0-unsat-3_ext.xml	UNSAT TT=0.014	UNSAT TT=0.875 CHECKS=5497 NODES=672	UNSAT TT=0.88 CHECKS=4609 NODES=485	? (TO) TT=1800.05	UNSAT TT=0.098 CHECKS=61315	UNSAT TT=0.075 CHECKS=60036	UNSAT TT=0.765 ASSIGNMENTS=1532	UNSAT TT=1.178 ASSIGNMENTS=3895	UNSAT TT=0.439 CHECKS=1450 NODES=118	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.027 ASSIGNMENTS=718 CHECKS=17966	UNSAT TT=0.027 ASSIGNMENTS=718 CHECKS=17966	UNSAT TT=0.607	UNSAT TT=0.716	UNSAT TT=0.055 CHECKS=14314	UNSAT TT=0.016 ASSIGNMENTS=781 CHECKS=21279	UNSAT TT=0.043 ASSIGNMENTS=5849 CHECKS=128601	UNSAT TT=0.426	UNSAT TT=0.014 ASSIGNMENTS=311 CHECKS=5465	UNSAT TT=0.014 ASSIGNMENTS=718 CHECKS=17966	UNSAT TT=0.813	UNSAT TT=0.033 ASSIGNMENTS=428 CHECKS=20560	UNSAT TT=0.71	UNSAT TT=0.708
csp/aim-100/ normalized-aim-100-2-0-unsat-4_ext.xml	UNSAT TT=0.013	UNSAT TT=0.87 CHECKS=4386 NODES=605	UNSAT TT=0.871 CHECKS=4646 NODES=533	? (TO) TT=1800.07	UNSAT TT=0.057 CHECKS=28397	UNSAT TT=0.048 CHECKS=33238	UNSAT TT=0.678 ASSIGNMENTS=1228	UNSAT TT=0.748 ASSIGNMENTS=860	UNSAT TT=0.438 CHECKS=1931 NODES=160	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=0.027 ASSIGNMENTS=1286 CHECKS=26574	UNSAT TT=0.03 ASSIGNMENTS=1286 CHECKS=26574	UNSAT TT=0.595	UNSAT TT=0.592	UNSAT TT=0.061 CHECKS=12185	UNSAT TT=0.015 ASSIGNMENTS=693 CHECKS=17969	UNSAT TT=0.047 ASSIGNMENTS=6023 CHECKS=128980	UNSAT TT=0.394	UNSAT TT=0.013 ASSIGNMENTS=392 CHECKS=8781	UNSAT TT=0.017 ASSIGNMENTS=1286 CHECKS=26574	UNSAT TT=0.868	UNSAT TT=0.029 ASSIGNMENTS=316 CHECKS=20565	UNSAT TT=0.728	UNSAT TT=0.734
csp/aim-100/ normalized-aim-100-3-4-sat-1_ext.xml	SAT TT=0.017	SAT TT=0.943 CHECKS=6661 NODES=482	SAT TT=0.983 CHECKS=4564 NODES=260	SAT TT=0.096	SAT TT=0.04 CHECKS=20518	SAT TT=0.059 CHECKS=47645	SAT TT=0.588 ASSIGNMENTS=72	SAT TT=0.65 ASSIGNMENTS=43	SAT TT=0.49 CHECKS=6534 NODES=225	SAT TT=0.598 CHECKS=513932 NODES=13417	SAT TT=0.752 CHECKS=1443200 NODES=6733	SAT TT=0.031 ASSIGNMENTS=294 CHECKS=39044	SAT TT=0.034 ASSIGNMENTS=294 CHECKS=39044	SAT TT=1.109	SAT TT=1.333	SAT TT=0.073 CHECKS=26182	SAT TT=0.017 ASSIGNMENTS=146 CHECKS=12809	SAT TT=0.023 ASSIGNMENTS=502 CHECKS=47403	SAT TT=0.522	SAT TT=0.018 ASSIGNMENTS=288 CHECKS=24805	SAT TT=0.022 ASSIGNMENTS=294 CHECKS=39044	SAT TT=1.08	SAT TT=0.036 ASSIGNMENTS=356 CHECKS=32039	SAT TT=0.804	SAT TT=0.932
csp/aim-100/ normalized-aim-100-3-4-sat-2_ext.xml	SAT TT=0.016	SAT TT=0.941 CHECKS=15528 NODES=937	SAT TT=0.981 CHECKS=6237 NODES=487	SAT TT=0.138	SAT TT=0.045 CHECKS=25461	SAT TT=0.18 CHECKS=214568	SAT TT=0.757 ASSIGNMENTS=456	SAT TT=0.762 ASSIGNMENTS=225	SAT TT=0.5 CHECKS=5724 NODES=223	SAT TT=0.519 CHECKS=66552 NODES=1641	SAT TT=0.507 CHECKS=67361 NODES=597	SAT TT=0.027 ASSIGNMENTS=76 CHECKS=6737	SAT TT=0.027 ASSIGNMENTS=76 CHECKS=6737	SAT TT=1.25	SAT TT=1.214	SAT TT=0.078 CHECKS=22749	SAT TT=0.016 ASSIGNMENTS=112 CHECKS=11424	SAT TT=0.107 ASSIGNMENTS=4400 CHECKS=410169	SAT TT=0.528	SAT TT=0.018 ASSIGNMENTS=238 CHECKS=13364	SAT TT=0.016 ASSIGNMENTS=76 CHECKS=6737	SAT TT=1.007	SAT TT=0.037 ASSIGNMENTS=127 CHECKS=10643	SAT TT=0.879	SAT TT=0.921
csp/aim-100/ normalized-aim-100-3-4-sat-3_ext.xml	SAT TT=0.017	SAT TT=0.946 CHECKS=8184 NODES=554	SAT TT=1.105 CHECKS=6108 NODES=383	SAT TT=0.404	SAT TT=0.049 CHECKS=27040	SAT TT=0.079 CHECKS=81656	SAT TT=0.668 ASSIGNMENTS=237	SAT TT=0.854 ASSIGNMENTS=407	SAT TT=0.498 CHECKS=12536 NODES=319	SAT TT=1.883 CHECKS=5109430 NODES=135596	SAT TT=0.605 CHECKS=884700 NODES=4991	SAT TT=0.029 ASSIGNMENTS=213 CHECKS=24325	SAT TT=0.03 ASSIGNMENTS=213 CHECKS=24325	SAT TT=1.368	SAT TT=1.116	SAT TT=0.073 CHECKS=18507	SAT TT=0.017 ASSIGNMENTS=179 CHECKS=19251	SAT TT=0.101 ASSIGNMENTS=4148 CHECKS=370323	SAT TT=0.513	SAT TT=0.017 ASSIGNMENTS=195 CHECKS=12246	SAT TT=0.018 ASSIGNMENTS=213 CHECKS=24325	SAT TT=1.064	SAT TT=0.045 ASSIGNMENTS=306 CHECKS=35529	SAT TT=0.82	SAT TT=0.8
csp/aim-100/ normalized-aim-100-3-4-sat-4_ext.xml	SAT TT=0.015	SAT TT=1.043 CHECKS=12276 NODES=818	SAT TT=0.999 CHECKS=14267 NODES=951	SAT TT=0.122	SAT TT=0.038 CHECKS=16731	SAT TT=0.085 CHECKS=97262	SAT TT=0.753 ASSIGNMENTS=223	SAT TT=0.623 ASSIGNMENTS=78	SAT TT=0.501 CHECKS=3037 NODES=152	SAT TT=0.591 CHECKS=462611 NODES=12097	SAT TT=0.5 CHECKS=42780 NODES=370	SAT TT=0.027 ASSIGNMENTS=85 CHECKS=8617	SAT TT=0.028 ASSIGNMENTS=85 CHECKS=8617	SAT TT=1.115	SAT TT=1.184	SAT TT=0.062 CHECKS=7732	SAT TT=0.016 ASSIGNMENTS=102 CHECKS=11081	SAT TT=0.087 ASSIGNMENTS=4132 CHECKS=349463	SAT TT=0.442	SAT TT=0.023 ASSIGNMENTS=432 CHECKS=38569	SAT TT=0.015 ASSIGNMENTS=85 CHECKS=8617	SAT TT=0.961	SAT TT=0.057 ASSIGNMENTS=347 CHECKS=41517	SAT TT=0.831	SAT TT=0.872
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-100/ normalized-aim-100-6-0-sat-1_ext.xml	SAT TT=0.016	SAT TT=0.965 CHECKS=2044 NODES=127	SAT TT=0.982 CHECKS=2530 NODES=0	SAT TT=0.111	SAT TT=0.028 CHECKS=6997	SAT TT=0.033 CHECKS=12271	SAT TT=0.605 ASSIGNMENTS=1	SAT TT=0.622 ASSIGNMENTS=1	SAT TT=0.548 CHECKS=3151 NODES=123	SAT TT=3.935 CHECKS=10146500 NODES=150955	SAT TT=0.588 CHECKS=46368 NODES=200	SAT TT=0.032 ASSIGNMENTS=23 CHECKS=7338	SAT TT=0.033 ASSIGNMENTS=23 CHECKS=7338	SAT TT=1.338	SAT TT=1.222	SAT TT=0.067 CHECKS=4888	SAT TT=0.016 ASSIGNMENTS=17 CHECKS=3926	SAT TT=0.02 ASSIGNMENTS=32 CHECKS=9463	SAT TT=0.523	SAT TT=0.02 ASSIGNMENTS=66 CHECKS=5961	SAT TT=0.018 ASSIGNMENTS=23 CHECKS=7338	SAT TT=1.076	SAT TT=0.043 ASSIGNMENTS=146 CHECKS=24760	SAT TT=0.969	SAT TT=1.051
csp/aim-100/ normalized-aim-100-6-0-sat-2_ext.xml	SAT TT=0.018	SAT TT=1.039 CHECKS=4821 NODES=226	SAT TT=1.02 CHECKS=5772 NODES=210	SAT TT=0.118	SAT TT=0.041 CHECKS=15112	SAT TT=0.032 CHECKS=10693	SAT TT=0.792 ASSIGNMENTS=1	SAT TT=0.624 ASSIGNMENTS=1	SAT TT=0.694 CHECKS=2725 NODES=115	SAT TT=0.808 CHECKS=23695 NODES=236	SAT TT=0.598 CHECKS=63307 NODES=347	SAT TT=0.032 ASSIGNMENTS=27 CHECKS=6514	SAT TT=0.032 ASSIGNMENTS=27 CHECKS=6514	SAT TT=1.435	SAT TT=1.296	SAT TT=0.073 CHECKS=4909	SAT TT=0.02 ASSIGNMENTS=18 CHECKS=5475	SAT TT=0.024 ASSIGNMENTS=128 CHECKS=26139	SAT TT=0.56	SAT TT=0.018 ASSIGNMENTS=31 CHECKS=4629	SAT TT=0.021 ASSIGNMENTS=27 CHECKS=6514	SAT TT=1.14	SAT TT=0.043 ASSIGNMENTS=154 CHECKS=23821	SAT TT=0.904	SAT TT=1.104
csp/aim-100/ normalized-aim-100-6-0-sat-3_ext.xml	SAT TT=0.019	SAT TT=0.92 CHECKS=1876 NODES=116	SAT TT=0.938 CHECKS=3048 NODES=0	SAT TT=0.089	SAT TT=0.029 CHECKS=6762	SAT TT=0.031 CHECKS=11254	SAT TT=0.782 ASSIGNMENTS=1	SAT TT=0.633 ASSIGNMENTS=1	SAT TT=0.598 CHECKS=4664 NODES=146	SAT TT=3.681 CHECKS=10094400 NODES=150168	SAT TT=0.593 CHECKS=46215 NODES=171	SAT TT=0.032 ASSIGNMENTS=30 CHECKS=7329	SAT TT=0.033 ASSIGNMENTS=30 CHECKS=7329	SAT TT=1.445	SAT TT=1.222	SAT TT=0.068 CHECKS=5839	SAT TT=0.019 ASSIGNMENTS=22 CHECKS=6290	SAT TT=0.021 ASSIGNMENTS=72 CHECKS=13300	SAT TT=0.631	SAT TT=0.02 ASSIGNMENTS=65 CHECKS=5689	SAT TT=0.019 ASSIGNMENTS=30 CHECKS=7329	SAT TT=1.114	SAT TT=0.044 ASSIGNMENTS=172 CHECKS=29147	SAT TT=0.898	SAT TT=0.864
csp/aim-100/ normalized-aim-100-6-0-sat-4_ext.xml	SAT TT=0.017	SAT TT=1.004 CHECKS=3682 NODES=177	SAT TT=1.05 CHECKS=7157 NODES=289	SAT TT=0.121	SAT TT=0.034 CHECKS=11086	SAT TT=0.026 CHECKS=4382	SAT TT=0.78 ASSIGNMENTS=1	SAT TT=0.719 ASSIGNMENTS=1	SAT TT=0.632 CHECKS=7841 NODES=182	SAT TT=6.771 CHECKS=20423200 NODES=300527	SAT TT=0.593 CHECKS=34954 NODES=70	SAT TT=0.03 ASSIGNMENTS=4 CHECKS=1706	SAT TT=0.031 ASSIGNMENTS=4 CHECKS=1706	SAT TT=1.352	SAT TT=1.318	SAT TT=0.072 CHECKS=1088	SAT TT=0.019 ASSIGNMENTS=4 CHECKS=1706	SAT TT=0.021 ASSIGNMENTS=57 CHECKS=12723	SAT TT=0.525	SAT TT=0.017 ASSIGNMENTS=19 CHECKS=2722	SAT TT=0.018 ASSIGNMENTS=4 CHECKS=1706	SAT TT=1.131	SAT TT=0.054 ASSIGNMENTS=200 CHECKS=39342	SAT TT=0.911	SAT TT=0.927
csp/aim-200/ normalized-aim-200-1-6-sat-1_ext.xml	SAT TT=0.021	SAT TT=1.023 CHECKS=11029 NODES=1166	SAT TT=1.009 CHECKS=11207 NODES=1361	? (TO) TT=1800.1	SAT TT=0.025 CHECKS=5722	SAT TT=0.204 CHECKS=165656	SAT TT=0.641 ASSIGNMENTS=109	SAT TT=0.743 ASSIGNMENTS=19	SAT TT=0.603 CHECKS=8905 NODES=650	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=0.037 ASSIGNMENTS=1258 CHECKS=41486	SAT TT=0.039 ASSIGNMENTS=1258 CHECKS=41486	SAT TT=1.269	SAT TT=1.478	SAT TT=0.071 CHECKS=11265	SAT TT=0.021 ASSIGNMENTS=609 CHECKS=20957	SAT TT=0.05 ASSIGNMENTS=9439 CHECKS=133351	SAT TT=0.498	SAT TT=0.036 ASSIGNMENTS=1849 CHECKS=77436	SAT TT=0.024 ASSIGNMENTS=1258 CHECKS=41486	SAT TT=1.097	SAT TT=0.097 ASSIGNMENTS=1397 CHECKS=86627	SAT TT=0.945	SAT TT=1.021
csp/aim-200/ normalized-aim-200-1-6-sat-2_ext.xml	SAT TT=0.026	SAT TT=1.038 CHECKS=21578 NODES=2333	SAT TT=1.121 CHECKS=27461 NODES=2783	? (TO) TT=1800.1	SAT TT=0.026 CHECKS=7575	SAT TT=0.128 CHECKS=90276	SAT TT=0.853 ASSIGNMENTS=1705	SAT TT=1.215 ASSIGNMENTS=2429	SAT TT=0.661 CHECKS=19083 NODES=1445	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.044 ASSIGNMENTS=1785 CHECKS=71585	SAT TT=0.047 ASSIGNMENTS=1785 CHECKS=71585	SAT TT=1.26	SAT TT=1.469	SAT TT=0.112 CHECKS=63908	SAT TT=0.027 ASSIGNMENTS=1700 CHECKS=57651	SAT TT=0.047 ASSIGNMENTS=8708 CHECKS=122936	SAT TT=0.512	SAT TT=0.04 ASSIGNMENTS=2623 CHECKS=85927	SAT TT=0.03 ASSIGNMENTS=1785 CHECKS=71585	SAT TT=1.222	SAT TT=0.102 ASSIGNMENTS=530 CHECKS=35411	SAT TT=0.819	SAT TT=0.82
csp/aim-200/ normalized-aim-200-1-6-sat-3_ext.xml	SAT TT=0.023	SAT TT=1.179 CHECKS=32189 NODES=2509	SAT TT=1.069 CHECKS=15908 NODES=1648	? (TO) TT=1800.03	SAT TT=0.025 CHECKS=8897	SAT TT=0.146 CHECKS=106726	SAT TT=0.849 ASSIGNMENTS=1238	SAT TT=1.042 ASSIGNMENTS=1571	SAT TT=0.623 CHECKS=15885 NODES=959	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=0.045 ASSIGNMENTS=1565 CHECKS=70607	SAT TT=0.044 ASSIGNMENTS=1565 CHECKS=70607	SAT TT=1.481	SAT TT=1.238	SAT TT=0.116 CHECKS=76676	SAT TT=0.031 ASSIGNMENTS=1334 CHECKS=71623	SAT TT=0.042 ASSIGNMENTS=8616 CHECKS=102589	SAT TT=0.503	SAT TT=0.023 ASSIGNMENTS=986 CHECKS=25428	SAT TT=0.033 ASSIGNMENTS=1565 CHECKS=70607	SAT TT=1.179	SAT TT=0.132 ASSIGNMENTS=527 CHECKS=25946	SAT TT=0.954	SAT TT=1.016
csp/aim-200/ normalized-aim-200-1-6-sat-4_ext.xml	SAT TT=0.018	SAT TT=0.964 CHECKS=7397 NODES=1227	SAT TT=0.992 CHECKS=8749 NODES=1302	? (TO) TT=1800.08	SAT TT=0.832 CHECKS=539750	SAT TT=0.222 CHECKS=158736	SAT TT=0.809 ASSIGNMENTS=1357	SAT TT=1.338 ASSIGNMENTS=3798	SAT TT=0.632 CHECKS=7270 NODES=805	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=0.357 ASSIGNMENTS=41221 CHECKS=1176040	SAT TT=0.358 ASSIGNMENTS=41221 CHECKS=1176040	SAT TT=1.212	SAT TT=1.349	SAT TT=0.137 CHECKS=59179	SAT TT=0.05 ASSIGNMENTS=3998 CHECKS=144523	SAT TT=0.053 ASSIGNMENTS=9562 CHECKS=142737	SAT TT=0.512	SAT TT=0.018 ASSIGNMENTS=754 CHECKS=15506	SAT TT=0.303 ASSIGNMENTS=41221 CHECKS=1176040	SAT TT=1.168	SAT TT=0.174 ASSIGNMENTS=615 CHECKS=26419	SAT TT=0.896	SAT TT=1.013
csp/aim-200/ normalized-aim-200-1-6-unsat-1_ext.xml	UNSAT TT=0.1	UNSAT TT=1.264 CHECKS=67766 NODES=6260	UNSAT TT=1.451 CHECKS=110235 NODES=9963	? (TO) TT=1800.04	UNSAT TT=0.256 CHECKS=120605	UNSAT TT=0.205 CHECKS=104252	UNSAT TT=4.365 ASSIGNMENTS=39464	UNSAT TT=0.72 ASSIGNMENTS=388	UNSAT TT=1.024 CHECKS=37586 NODES=2541	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=0.312 ASSIGNMENTS=27682 CHECKS=850312	UNSAT TT=0.31 ASSIGNMENTS=27682 CHECKS=850312	UNSAT TT=0.861	UNSAT TT=0.726	UNSAT TT=0.15 CHECKS=62782	UNSAT TT=0.1 ASSIGNMENTS=11794 CHECKS=290551	UNSAT TT=0.075 ASSIGNMENTS=14419 CHECKS=218094	UNSAT TT=0.664	UNSAT TT=0.102 ASSIGNMENTS=8725 CHECKS=213659	UNSAT TT=0.263 ASSIGNMENTS=27682 CHECKS=850312	UNSAT TT=1.03	UNSAT TT=0.916 ASSIGNMENTS=14738 CHECKS=706070	UNSAT TT=0.918	UNSAT TT=0.819
csp/aim-200/ normalized-aim-200-1-6-unsat-2_ext.xml	UNSAT TT=0.093	UNSAT TT=3.051 CHECKS=677790 NODES=48377	UNSAT TT=2.433 CHECKS=421570 NODES=31169	? (TO) TT=1800.03	UNSAT TT=3.092 CHECKS=1519030	UNSAT TT=1.667 CHECKS=770360	UNSAT TT=37.926 ASSIGNMENTS=461040	UNSAT TT=0.801 ASSIGNMENTS=874	UNSAT TT=1.841 CHECKS=144456 NODES=8846	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.978 ASSIGNMENTS=108309 CHECKS=2758150	UNSAT TT=1.067 ASSIGNMENTS=108309 CHECKS=2758150	UNSAT TT=0.828	UNSAT TT=0.813	UNSAT TT=0.143 CHECKS=67087	UNSAT TT=1.139 ASSIGNMENTS=149653 CHECKS=3776660	UNSAT TT=0.073 ASSIGNMENTS=14253 CHECKS=194678	UNSAT TT=1.602	UNSAT TT=0.093 ASSIGNMENTS=7273 CHECKS=175856	UNSAT TT=0.908 ASSIGNMENTS=108309 CHECKS=2758150	UNSAT TT=1.058	UNSAT TT=1.673 ASSIGNMENTS=35817 CHECKS=1422050	UNSAT TT=0.83	UNSAT TT=0.863
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-200/ normalized-aim-200-1-6-unsat-3_ext.xml	UNSAT TT=0.276	UNSAT TT=1.389 CHECKS=104910 NODES=9817	UNSAT TT=1.507 CHECKS=130883 NODES=11569	? (TO) TT=1800.09	UNSAT TT=0.422 CHECKS=170407	UNSAT TT=78.245 CHECKS=35596400	UNSAT TT=7.519 ASSIGNMENTS=84406	UNSAT TT=2.227 ASSIGNMENTS=10764	UNSAT TT=2.588 CHECKS=216789 NODES=16453	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=0.703 ASSIGNMENTS=73965 CHECKS=1857130	UNSAT TT=0.698 ASSIGNMENTS=73965 CHECKS=1857130	UNSAT TT=0.865	UNSAT TT=0.87	UNSAT TT=0.276 CHECKS=139662	UNSAT TT=0.507 ASSIGNMENTS=66263 CHECKS=1642260	UNSAT TT=0.109 ASSIGNMENTS=19351 CHECKS=326320	UNSAT TT=1.324	UNSAT TT=0.294 ASSIGNMENTS=27068 CHECKS=612829	UNSAT TT=0.593 ASSIGNMENTS=73965 CHECKS=1857130	UNSAT TT=1.103	UNSAT TT=3.412 ASSIGNMENTS=62281 CHECKS=2719140	UNSAT TT=0.912	UNSAT TT=0.896
csp/aim-200/ normalized-aim-200-1-6-unsat-4_ext.xml	UNSAT TT=0.05	UNSAT TT=1.056 CHECKS=15911 NODES=1987	UNSAT TT=1.538 CHECKS=11586 NODES=1400	? (TO) TT=1800.05	UNSAT TT=0.178 CHECKS=77417	UNSAT TT=0.318 CHECKS=180038	UNSAT TT=1.119 ASSIGNMENTS=5150	UNSAT TT=1.109 ASSIGNMENTS=2687	UNSAT TT=0.681 CHECKS=16675 NODES=1360	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=0.086 ASSIGNMENTS=7381 CHECKS=203222	UNSAT TT=0.091 ASSIGNMENTS=7381 CHECKS=203222	UNSAT TT=0.674	UNSAT TT=0.683	UNSAT TT=0.087 CHECKS=31357	UNSAT TT=0.083 ASSIGNMENTS=10013 CHECKS=256527	UNSAT TT=0.05 ASSIGNMENTS=12665 CHECKS=137656	UNSAT TT=0.56	UNSAT TT=0.05 ASSIGNMENTS=4130 CHECKS=90804	UNSAT TT=0.071 ASSIGNMENTS=7381 CHECKS=203222	UNSAT TT=0.959	UNSAT TT=0.24 ASSIGNMENTS=4722 CHECKS=221193	UNSAT TT=0.825	UNSAT TT=0.821
csp/aim-200/ normalized-aim-200-2-0-sat-1_ext.xml	SAT TT=0.046	SAT TT=2.502 CHECKS=509422 NODES=31016	SAT TT=1.179 CHECKS=33816 NODES=3318	? (TO) TT=1800.09	SAT TT=0.046 CHECKS=28612	SAT TT=18.735 CHECKS=16294500	SAT TT=7.138 ASSIGNMENTS=47554	SAT TT=29.794 ASSIGNMENTS=202059	SAT TT=0.812 CHECKS=37256 NODES=2001	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=0.709 ASSIGNMENTS=58735 CHECKS=2402750	SAT TT=0.653 ASSIGNMENTS=58735 CHECKS=2402750	SAT TT=1.503	SAT TT=1.287	SAT TT=0.37 CHECKS=292603	SAT TT=0.603 ASSIGNMENTS=54680 CHECKS=2571650	SAT TT=0.102 ASSIGNMENTS=12374 CHECKS=350327	SAT TT=0.531	SAT TT=0.091 ASSIGNMENTS=6849 CHECKS=246887	SAT TT=0.591 ASSIGNMENTS=58735 CHECKS=2402750	SAT TT=1.268	SAT TT=0.475 ASSIGNMENTS=8167 CHECKS=384294	SAT TT=0.935	SAT TT=0.936
csp/aim-200/ normalized-aim-200-2-0-sat-2_ext.xml	SAT TT=0.032	SAT TT=1.385 CHECKS=90938 NODES=7751	SAT TT=1.349 CHECKS=33199 NODES=3333	? (TO) TT=1800.07	SAT TT=0.032 CHECKS=17918	SAT TT=6.167 CHECKS=5789110	SAT TT=0.892 ASSIGNMENTS=1436	SAT TT=3.513 ASSIGNMENTS=19117	SAT TT=0.781 CHECKS=8773 NODES=742	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=0.307 ASSIGNMENTS=23234 CHECKS=1092160	SAT TT=0.31 ASSIGNMENTS=23234 CHECKS=1092160	SAT TT=1.207	SAT TT=1.204	SAT TT=0.251 CHECKS=190932	SAT TT=0.521 ASSIGNMENTS=41838 CHECKS=2010540	SAT TT=0.097 ASSIGNMENTS=9997 CHECKS=325862	SAT TT=0.533	SAT TT=0.069 ASSIGNMENTS=4727 CHECKS=180051	SAT TT=0.271 ASSIGNMENTS=23234 CHECKS=1092160	SAT TT=1.112	SAT TT=0.968 ASSIGNMENTS=14745 CHECKS=862607	SAT TT=0.894	SAT TT=0.895
csp/aim-200/ normalized-aim-200-2-0-sat-3_ext.xml	SAT TT=0.032	SAT TT=1.125 CHECKS=14497 NODES=1701	SAT TT=1.042 CHECKS=7096 NODES=925	? (TO) TT=1800.05	SAT TT=0.255 CHECKS=168239	SAT TT=0.316 CHECKS=226718	SAT TT=1.743 ASSIGNMENTS=6899	SAT TT=1.063 ASSIGNMENTS=1944	SAT TT=0.606 CHECKS=9252 NODES=730	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.091 ASSIGNMENTS=5275 CHECKS=225910	SAT TT=0.089 ASSIGNMENTS=5275 CHECKS=225910	SAT TT=1.203	SAT TT=1.613	SAT TT=0.171 CHECKS=142569	SAT TT=0.085 ASSIGNMENTS=6760 CHECKS=300611	SAT TT=0.061 ASSIGNMENTS=7833 CHECKS=194761	SAT TT=0.665	SAT TT=0.032 ASSIGNMENTS=1322 CHECKS=42443	SAT TT=0.071 ASSIGNMENTS=5275 CHECKS=225910	SAT TT=1.115	SAT TT=0.151 ASSIGNMENTS=2780 CHECKS=157815	SAT TT=0.942	SAT TT=0.875
csp/aim-200/ normalized-aim-200-2-0-sat-4_ext.xml	SAT TT=0.175	SAT TT=2.376 CHECKS=376081 NODES=28342	SAT TT=1.705 CHECKS=196506 NODES=16455	? (TO) TT=1800.04	SAT TT=4.083 CHECKS=2413160	SAT TT=2.077 CHECKS=1719160	SAT TT=46.733 ASSIGNMENTS=353502	? (TO) TT=1800.06	SAT TT=1.91 CHECKS=196169 NODES=8579	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=0.206 ASSIGNMENTS=14504 CHECKS=662745	SAT TT=0.206 ASSIGNMENTS=14504 CHECKS=662745	SAT TT=1.448	SAT TT=1.523	SAT TT=0.711 CHECKS=712031	SAT TT=0.285 ASSIGNMENTS=26656 CHECKS=1104880	SAT TT=0.094 ASSIGNMENTS=11292 CHECKS=324048	SAT TT=0.499	SAT TT=0.262 ASSIGNMENTS=15794 CHECKS=829886	SAT TT=0.175 ASSIGNMENTS=14504 CHECKS=662745	SAT TT=1.414	SAT TT=0.793 ASSIGNMENTS=9140 CHECKS=390879	SAT TT=0.873	SAT TT=0.969
csp/aim-200/ normalized-aim-200-2-0-unsat-1_ext.xml	UNSAT TT=0.124	UNSAT TT=1.496 CHECKS=100732 NODES=8897	UNSAT TT=1.127 CHECKS=30931 NODES=3274	? (TO) TT=1800.09	UNSAT TT=0.492 CHECKS=220768	UNSAT TT=0.183 CHECKS=107427	UNSAT TT=3.701 ASSIGNMENTS=30063	UNSAT TT=11.176 ASSIGNMENTS=66909	UNSAT TT=0.664 CHECKS=8545 NODES=667	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.194 ASSIGNMENTS=18507 CHECKS=542051	UNSAT TT=0.192 ASSIGNMENTS=18507 CHECKS=542051	UNSAT TT=0.76	UNSAT TT=0.76	UNSAT TT=0.146 CHECKS=69081	UNSAT TT=0.175 ASSIGNMENTS=19989 CHECKS=615076	UNSAT TT=0.084 ASSIGNMENTS=11603 CHECKS=254715	UNSAT TT=0.95	UNSAT TT=0.124 ASSIGNMENTS=10621 CHECKS=276575	UNSAT TT=0.155 ASSIGNMENTS=18507 CHECKS=542051	UNSAT TT=1.129	UNSAT TT=0.136 ASSIGNMENTS=1919 CHECKS=101622	UNSAT TT=0.94	UNSAT TT=1.054
csp/aim-200/ normalized-aim-200-2-0-unsat-2_ext.xml	UNSAT TT=0.046	UNSAT TT=1.146 CHECKS=26963 NODES=2887	UNSAT TT=1.199 CHECKS=34097 NODES=3269	? (TO) TT=1800.11	UNSAT TT=0.224 CHECKS=87525	UNSAT TT=0.357 CHECKS=181892	UNSAT TT=1.433 ASSIGNMENTS=4914	UNSAT TT=4.173 ASSIGNMENTS=19399	UNSAT TT=0.93 CHECKS=31031 NODES=2304	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.062 ASSIGNMENTS=3620 CHECKS=111557	UNSAT TT=0.061 ASSIGNMENTS=3620 CHECKS=111557	UNSAT TT=0.979	UNSAT TT=0.776	UNSAT TT=0.13 CHECKS=49335	UNSAT TT=0.073 ASSIGNMENTS=6305 CHECKS=214256	UNSAT TT=0.075 ASSIGNMENTS=10094 CHECKS=221725	UNSAT TT=0.584	UNSAT TT=0.046 ASSIGNMENTS=2686 CHECKS=74315	UNSAT TT=0.046 ASSIGNMENTS=3620 CHECKS=111557	UNSAT TT=1.125	UNSAT TT=0.157 ASSIGNMENTS=2646 CHECKS=145444	UNSAT TT=0.952	UNSAT TT=0.957
csp/aim-200/ normalized-aim-200-2-0-unsat-3_ext.xml	UNSAT TT=0.023	UNSAT TT=0.964 CHECKS=3008 NODES=498	UNSAT TT=1.008 CHECKS=2641 NODES=396	? (TO) TT=1800.06	UNSAT TT=0.176 CHECKS=79911	UNSAT TT=0.189 CHECKS=110388	UNSAT TT=1.082 ASSIGNMENTS=2556	UNSAT TT=2.867 ASSIGNMENTS=11250	UNSAT TT=0.742 CHECKS=16718 NODES=1263	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.057 ASSIGNMENTS=3802 CHECKS=120210	UNSAT TT=0.061 ASSIGNMENTS=3802 CHECKS=120210	UNSAT TT=0.747	UNSAT TT=0.751	UNSAT TT=0.095 CHECKS=30919	UNSAT TT=0.03 ASSIGNMENTS=1966 CHECKS=68850	UNSAT TT=0.068 ASSIGNMENTS=8470 CHECKS=193920	UNSAT TT=0.576	UNSAT TT=0.023 ASSIGNMENTS=862 CHECKS=17811	UNSAT TT=0.046 ASSIGNMENTS=3802 CHECKS=120210	UNSAT TT=1.065	UNSAT TT=0.059 ASSIGNMENTS=566 CHECKS=29479	UNSAT TT=0.951	UNSAT TT=0.898
csp/aim-200/ normalized-aim-200-2-0-unsat-4_ext.xml	UNSAT TT=0.027	UNSAT TT=1.121 CHECKS=17162 NODES=1811	UNSAT TT=1.147 CHECKS=17871 NODES=1904	? (TO) TT=1800.02	UNSAT TT=0.173 CHECKS=84008	UNSAT TT=0.153 CHECKS=81889	UNSAT TT=1.032 ASSIGNMENTS=3557	UNSAT TT=3.432 ASSIGNMENTS=17814	UNSAT TT=0.603 CHECKS=3927 NODES=321	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=0.055 ASSIGNMENTS=3197 CHECKS=87383	UNSAT TT=0.05 ASSIGNMENTS=3197 CHECKS=87383	UNSAT TT=0.771	UNSAT TT=0.764	UNSAT TT=0.1 CHECKS=35971	UNSAT TT=0.041 ASSIGNMENTS=3174 CHECKS=90460	UNSAT TT=0.061 ASSIGNMENTS=8835 CHECKS=190029	UNSAT TT=0.711	UNSAT TT=0.027 ASSIGNMENTS=1056 CHECKS=25418	UNSAT TT=0.039 ASSIGNMENTS=3197 CHECKS=87383	UNSAT TT=1.055	UNSAT TT=0.072 ASSIGNMENTS=438 CHECKS=23736	UNSAT TT=0.921	UNSAT TT=0.897
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-200/ normalized-aim-200-3-4-sat-1_ext.xml	SAT TT=0.116	SAT TT=1.438 CHECKS=93593 NODES=5310	SAT TT=1.421 CHECKS=73136 NODES=4319	SAT TT=413.578	SAT TT=0.518 CHECKS=369488	SAT TT=0.492 CHECKS=467978	SAT TT=1.556 ASSIGNMENTS=1852	SAT TT=10.808 ASSIGNMENTS=31820	SAT TT=0.715 CHECKS=10639 NODES=442	SAT TT=352.153 CHECKS=1088850000 NODES=28182200	SAT TT=1.366 CHECKS=4638590 NODES=16290	SAT TT=0.14 ASSIGNMENTS=3560 CHECKS=486082	SAT TT=0.139 ASSIGNMENTS=3560 CHECKS=486082	SAT TT=1.529	SAT TT=1.409	SAT TT=0.462 CHECKS=418968	SAT TT=0.233 ASSIGNMENTS=7498 CHECKS=1105960	SAT TT=0.176 ASSIGNMENTS=7192 CHECKS=692968	SAT TT=0.769	SAT TT=0.183 ASSIGNMENTS=4164 CHECKS=691528	SAT TT=0.116 ASSIGNMENTS=3560 CHECKS=486082	SAT TT=1.397	SAT TT=1.176 ASSIGNMENTS=8014 CHECKS=1132020	SAT TT=1.049	SAT TT=1.157
csp/aim-200/ normalized-aim-200-3-4-sat-2_ext.xml	SAT TT=0.034	SAT TT=1.338 CHECKS=40974 NODES=2306	SAT TT=1.666 CHECKS=112624 NODES=5354	SAT TT=107.806	SAT TT=1.966 CHECKS=1477930	SAT TT=13.628 CHECKS=12124700	SAT TT=1.235 ASSIGNMENTS=1220	SAT TT=6.407 ASSIGNMENTS=16146	SAT TT=2.126 CHECKS=253720 NODES=4472	SAT TT=166.171 CHECKS=502942000 NODES=13125200	SAT TT=0.649 CHECKS=195193 NODES=1584	SAT TT=0.044 ASSIGNMENTS=437 CHECKS=56321	SAT TT=0.047 ASSIGNMENTS=437 CHECKS=56321	SAT TT=1.463	SAT TT=1.35	SAT TT=0.165 CHECKS=117131	SAT TT=0.051 ASSIGNMENTS=943 CHECKS=135046	SAT TT=0.197 ASSIGNMENTS=7621 CHECKS=864733	SAT TT=0.71	SAT TT=0.034 ASSIGNMENTS=514 CHECKS=51939	SAT TT=0.034 ASSIGNMENTS=437 CHECKS=56321	SAT TT=1.515	SAT TT=0.262 ASSIGNMENTS=557 CHECKS=73910	SAT TT=1.182	SAT TT=1.196
csp/aim-200/ normalized-aim-200-3-4-sat-3_ext.xml	SAT TT=0.045	SAT TT=3.706 CHECKS=798771 NODES=33688	SAT TT=1.442 CHECKS=91923 NODES=5269	SAT TT=60.547	SAT TT=0.523 CHECKS=387775	SAT TT=19.96 CHECKS=20156900	SAT TT=1.18 ASSIGNMENTS=810	SAT TT=1.378 ASSIGNMENTS=1644	SAT TT=0.751 CHECKS=24165 NODES=722	SAT TT=216.284 CHECKS=622232000 NODES=16217800	SAT TT=0.666 CHECKS=395939 NODES=2427	SAT TT=0.081 ASSIGNMENTS=1137 CHECKS=202171	SAT TT=0.073 ASSIGNMENTS=1137 CHECKS=202171	SAT TT=1.317	SAT TT=1.322	SAT TT=0.217 CHECKS=183005	SAT TT=0.055 ASSIGNMENTS=883 CHECKS=168949	SAT TT=0.279 ASSIGNMENTS=9229 CHECKS=1203210	SAT TT=0.619	SAT TT=0.045 ASSIGNMENTS=1158 CHECKS=115570	SAT TT=0.062 ASSIGNMENTS=1137 CHECKS=202171	SAT TT=1.416	SAT TT=0.965 ASSIGNMENTS=3868 CHECKS=631658	SAT TT=0.922	SAT TT=1.094
csp/aim-200/ normalized-aim-200-3-4-sat-4_ext.xml	SAT TT=0.055	SAT TT=1.184 CHECKS=10487 NODES=924	SAT TT=1.327 CHECKS=24349 NODES=1947	SAT TT=311.112	SAT TT=0.335 CHECKS=230256	SAT TT=0.551 CHECKS=559767	SAT TT=15.809 ASSIGNMENTS=42294	SAT TT=6.634 ASSIGNMENTS=18009	SAT TT=0.758 CHECKS=25332 NODES=607	SAT TT=281.764 CHECKS=874114000 NODES=22651800	? (TO) TT=1800.03	SAT TT=0.084 ASSIGNMENTS=1574 CHECKS=247251	SAT TT=0.087 ASSIGNMENTS=1574 CHECKS=247251	SAT TT=1.63	SAT TT=1.492	SAT TT=0.416 CHECKS=419268	SAT TT=0.223 ASSIGNMENTS=6134 CHECKS=985469	SAT TT=0.135 ASSIGNMENTS=5594 CHECKS=561550	SAT TT=0.665	SAT TT=0.055 ASSIGNMENTS=1203 CHECKS=140078	SAT TT=0.072 ASSIGNMENTS=1574 CHECKS=247251	SAT TT=1.281	SAT TT=0.212 ASSIGNMENTS=742 CHECKS=106897	SAT TT=1.065	SAT TT=1.054
csp/aim-200/ normalized-aim-200-6-0-sat-1_ext.xml	SAT TT=0.036	SAT TT=1.345 CHECKS=9742 NODES=442	SAT TT=1.097 CHECKS=4705 NODES=0	SAT TT=0.523	SAT TT=0.111 CHECKS=45356	SAT TT=0.196 CHECKS=159928	SAT TT=0.935 ASSIGNMENTS=8	SAT TT=0.788 ASSIGNMENTS=2	SAT TT=0.803 CHECKS=3850 NODES=223	SAT TT=5.497 CHECKS=10526400 NODES=152155	SAT TT=0.823 CHECKS=149257 NODES=667	SAT TT=0.057 ASSIGNMENTS=158 CHECKS=62878	SAT TT=0.058 ASSIGNMENTS=158 CHECKS=62878	SAT TT=1.688	SAT TT=1.588	SAT TT=0.22 CHECKS=147498	SAT TT=0.04 ASSIGNMENTS=124 CHECKS=39264	SAT TT=0.15 ASSIGNMENTS=2367 CHECKS=624995	SAT TT=0.672	SAT TT=0.036 ASSIGNMENTS=26 CHECKS=5553	SAT TT=0.044 ASSIGNMENTS=158 CHECKS=62878	SAT TT=1.758	SAT TT=0.105 ASSIGNMENTS=385 CHECKS=60565	SAT TT=0.995	SAT TT=1.02
csp/aim-200/ normalized-aim-200-6-0-sat-2_ext.xml	SAT TT=0.052	SAT TT=1.216 CHECKS=11440 NODES=519	SAT TT=1.158 CHECKS=8092 NODES=383	SAT TT=31.235	SAT TT=0.533 CHECKS=356619	SAT TT=0.197 CHECKS=155651	SAT TT=1.283 ASSIGNMENTS=411	SAT TT=0.783 ASSIGNMENTS=39	SAT TT=0.926 CHECKS=29892 NODES=447	SAT TT=4.999 CHECKS=10526500 NODES=150831	SAT TT=0.769 CHECKS=119405 NODES=156	SAT TT=0.092 ASSIGNMENTS=721 CHECKS=279403	SAT TT=0.096 ASSIGNMENTS=721 CHECKS=279403	SAT TT=1.499	SAT TT=1.737	SAT TT=0.105 CHECKS=26070	SAT TT=0.073 ASSIGNMENTS=614 CHECKS=250029	SAT TT=0.208 ASSIGNMENTS=4241 CHECKS=1039110	SAT TT=0.729	SAT TT=0.052 ASSIGNMENTS=566 CHECKS=121971	SAT TT=0.085 ASSIGNMENTS=721 CHECKS=279403	SAT TT=1.866	SAT TT=0.189 ASSIGNMENTS=748 CHECKS=223057	SAT TT=0.973	SAT TT=1.068
csp/aim-200/ normalized-aim-200-6-0-sat-3_ext.xml	SAT TT=0.034	SAT TT=1.231 CHECKS=15252 NODES=617	SAT TT=1.189 CHECKS=6741 NODES=321	SAT TT=59.204	SAT TT=0.08 CHECKS=35355	SAT TT=0.548 CHECKS=483646	SAT TT=0.806 ASSIGNMENTS=14	SAT TT=0.853 ASSIGNMENTS=4	SAT TT=0.785 CHECKS=9732 NODES=253	SAT TT=9.23 CHECKS=20811000 NODES=300337	SAT TT=0.827 CHECKS=130517 NODES=310	SAT TT=0.049 ASSIGNMENTS=74 CHECKS=24294	SAT TT=0.05 ASSIGNMENTS=74 CHECKS=24294	SAT TT=1.755	SAT TT=1.581	SAT TT=0.125 CHECKS=48290	SAT TT=0.045 ASSIGNMENTS=235 CHECKS=83036	SAT TT=0.047 ASSIGNMENTS=256 CHECKS=70039	SAT TT=0.67	SAT TT=0.04 ASSIGNMENTS=272 CHECKS=27161	SAT TT=0.034 ASSIGNMENTS=74 CHECKS=24294	SAT TT=1.914	SAT TT=0.129 ASSIGNMENTS=266 CHECKS=31352	SAT TT=1.07	SAT TT=1.234
csp/aim-200/ normalized-aim-200-6-0-sat-4_ext.xml	SAT TT=0.04	SAT TT=1.452 CHECKS=63138 NODES=2466	SAT TT=1.201 CHECKS=5346 NODES=0	SAT TT=11.757	SAT TT=0.209 CHECKS=106012	SAT TT=0.363 CHECKS=295753	SAT TT=0.996 ASSIGNMENTS=306	SAT TT=0.744 ASSIGNMENTS=28	SAT TT=0.976 CHECKS=28293 NODES=456	SAT TT=23.469 CHECKS=51751700 NODES=750589	SAT TT=0.818 CHECKS=120736 NODES=229	SAT TT=0.068 ASSIGNMENTS=420 CHECKS=151332	SAT TT=0.067 ASSIGNMENTS=420 CHECKS=151332	SAT TT=1.589	SAT TT=1.49	SAT TT=0.427 CHECKS=357619	SAT TT=0.129 ASSIGNMENTS=1323 CHECKS=533288	SAT TT=0.237 ASSIGNMENTS=4339 CHECKS=1104890	SAT TT=0.662	SAT TT=0.04 ASSIGNMENTS=300 CHECKS=37101	SAT TT=0.061 ASSIGNMENTS=420 CHECKS=151332	SAT TT=1.91	SAT TT=0.257 ASSIGNMENTS=341 CHECKS=76300	SAT TT=1.226	SAT TT=1.019
csp/aim-50/ normalized-aim-50-1-6-sat-1_ext.xml	SAT TT=0.007	SAT TT=0.745 CHECKS=2808 NODES=322	SAT TT=0.771 CHECKS=1463 NODES=207	SAT TT=0.086	SAT TT=0.009 CHECKS=1187	SAT TT=0.021 CHECKS=17728	SAT TT=0.434 ASSIGNMENTS=7	SAT TT=0.405 ASSIGNMENTS=3	SAT TT=0.392 CHECKS=1226 NODES=130	SAT TT=127.314 CHECKS=468919000 NODES=81600600	SAT TT=0.373 CHECKS=127074 NODES=1243	SAT TT=0.023 ASSIGNMENTS=309 CHECKS=9070	SAT TT=0.023 ASSIGNMENTS=309 CHECKS=9070	SAT TT=0.782	SAT TT=0.861	SAT TT=0.034 CHECKS=2062	SAT TT=0.009 ASSIGNMENTS=312 CHECKS=7820	SAT TT=0.021 ASSIGNMENTS=4316 CHECKS=62439	SAT TT=0.322	SAT TT=0.007 ASSIGNMENTS=77 CHECKS=964	SAT TT=0.011 ASSIGNMENTS=309 CHECKS=9070	SAT TT=0.737	SAT TT=0.015 ASSIGNMENTS=124 CHECKS=2506	SAT TT=0.59	SAT TT=0.607
csp/aim-50/ normalized-aim-50-1-6-sat-2_ext.xml	SAT TT=0.006	SAT TT=0.766 CHECKS=792 NODES=132	SAT TT=0.68 CHECKS=325 NODES=0	SAT TT=0.136	SAT TT=0.012 CHECKS=958	SAT TT=0.011 CHECKS=2502	SAT TT=0.427 ASSIGNMENTS=1	SAT TT=0.436 ASSIGNMENTS=1	SAT TT=0.366 CHECKS=1717 NODES=118	SAT TT=2.881 CHECKS=8895340 NODES=1800060	SAT TT=0.347 CHECKS=25091 NODES=284	SAT TT=0.02 ASSIGNMENTS=51 CHECKS=1416	SAT TT=0.02 ASSIGNMENTS=51 CHECKS=1416	SAT TT=0.974	SAT TT=0.796	SAT TT=0.034 CHECKS=1167	SAT TT=0.008 ASSIGNMENTS=57 CHECKS=2605	SAT TT=0.01 ASSIGNMENTS=769 CHECKS=11858	SAT TT=0.318	SAT TT=0.006 ASSIGNMENTS=80 CHECKS=973	SAT TT=0.008 ASSIGNMENTS=51 CHECKS=1416	SAT TT=0.794	SAT TT=0.013 ASSIGNMENTS=103 CHECKS=1825	SAT TT=0.555	SAT TT=0.582
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-50/ normalized-aim-50-1-6-sat-3_ext.xml	SAT TT=0.007	SAT TT=0.755 CHECKS=801 NODES=130	SAT TT=0.736 CHECKS=259 NODES=0	SAT TT=0.063	SAT TT=0.013 CHECKS=2004	SAT TT=0.014 CHECKS=4294	SAT TT=0.398 ASSIGNMENTS=2	SAT TT=0.418 ASSIGNMENTS=4	SAT TT=0.344 CHECKS=211 NODES=51	SAT TT=3.811 CHECKS=13156100 NODES=972600	SAT TT=0.378 CHECKS=55885 NODES=579	SAT TT=0.02 ASSIGNMENTS=48 CHECKS=1390	SAT TT=0.021 ASSIGNMENTS=48 CHECKS=1390	SAT TT=0.868	SAT TT=0.978	SAT TT=0.054 CHECKS=914	SAT TT=0.007 ASSIGNMENTS=58 CHECKS=1462	SAT TT=0.011 ASSIGNMENTS=959 CHECKS=14978	SAT TT=0.343	SAT TT=0.009 ASSIGNMENTS=96 CHECKS=1636	SAT TT=0.008 ASSIGNMENTS=48 CHECKS=1390	SAT TT=0.78	SAT TT=0.016 ASSIGNMENTS=62 CHECKS=1662	SAT TT=0.595	SAT TT=0.564
csp/aim-50/ normalized-aim-50-1-6-sat-4_ext.xml	SAT TT=0.007	SAT TT=0.765 CHECKS=2457 NODES=286	SAT TT=0.722 CHECKS=282 NODES=0	SAT TT=0.057	SAT TT=0.009 CHECKS=415	SAT TT=0.012 CHECKS=2887	SAT TT=0.416 ASSIGNMENTS=1	SAT TT=0.412 ASSIGNMENTS=1	SAT TT=0.342 CHECKS=572 NODES=77	SAT TT=0.462 CHECKS=341987 NODES=48334	SAT TT=0.38 CHECKS=72731 NODES=813	SAT TT=0.021 ASSIGNMENTS=68 CHECKS=2555	SAT TT=0.02 ASSIGNMENTS=68 CHECKS=2555	SAT TT=0.775	SAT TT=1.055	SAT TT=0.039 CHECKS=3290	SAT TT=0.007 ASSIGNMENTS=71 CHECKS=2622	SAT TT=0.016 ASSIGNMENTS=1334 CHECKS=23081	SAT TT=0.323	SAT TT=0.008 ASSIGNMENTS=35 CHECKS=518	SAT TT=0.009 ASSIGNMENTS=68 CHECKS=2555	SAT TT=0.726	SAT TT=0.015 ASSIGNMENTS=52 CHECKS=1636	SAT TT=0.579	SAT TT=0.582
csp/aim-50/ normalized-aim-50-1-6-unsat-1_ext.xml	UNSAT TT=0.006	UNSAT TT=0.737 CHECKS=941 NODES=95	UNSAT TT=0.732 CHECKS=240 NODES=0	UNSAT TT=0.039	UNSAT TT=0.01 CHECKS=239	UNSAT TT=0.018 CHECKS=8453	UNSAT TT=0.38 ASSIGNMENTS=0	UNSAT TT=0.424 ASSIGNMENTS=0	UNSAT TT=0.393 CHECKS=952 NODES=47	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.019 ASSIGNMENTS=44 CHECKS=1225	UNSAT TT=0.019 ASSIGNMENTS=44 CHECKS=1225	UNSAT TT=0.608	UNSAT TT=0.475	UNSAT TT=0.04 CHECKS=1257	UNSAT TT=0.009 ASSIGNMENTS=37 CHECKS=1141	UNSAT TT=0.012 ASSIGNMENTS=829 CHECKS=12395	UNSAT TT=0.32	UNSAT TT=0.006 ASSIGNMENTS=22 CHECKS=311	UNSAT TT=0.007 ASSIGNMENTS=44 CHECKS=1225	UNSAT TT=0.767	UNSAT TT=0.012 ASSIGNMENTS=101 CHECKS=5836	UNSAT TT=0.582	UNSAT TT=0.568
csp/aim-50/ normalized-aim-50-1-6-unsat-2_ext.xml	UNSAT TT=0.009	UNSAT TT=0.807 CHECKS=6668 NODES=749	UNSAT TT=0.81 CHECKS=4868 NODES=561	UNSAT TT=0.218	UNSAT TT=0.024 CHECKS=13259	UNSAT TT=0.031 CHECKS=25479	UNSAT TT=0.51 ASSIGNMENTS=449	UNSAT TT=0.458 ASSIGNMENTS=144	UNSAT TT=0.387 CHECKS=2178 NODES=183	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.022 ASSIGNMENTS=425 CHECKS=10996	UNSAT TT=0.023 ASSIGNMENTS=425 CHECKS=10996	UNSAT TT=0.623	UNSAT TT=0.673	UNSAT TT=0.043 CHECKS=8096	UNSAT TT=0.01 ASSIGNMENTS=548 CHECKS=11986	UNSAT TT=0.025 ASSIGNMENTS=4874 CHECKS=58579	UNSAT TT=0.329	UNSAT TT=0.01 ASSIGNMENTS=329 CHECKS=7318	UNSAT TT=0.009 ASSIGNMENTS=425 CHECKS=10996	UNSAT TT=0.772	UNSAT TT=0.019 ASSIGNMENTS=272 CHECKS=9590	UNSAT TT=0.591	UNSAT TT=0.594
csp/aim-50/ normalized-aim-50-1-6-unsat-3_ext.xml	UNSAT TT=0.007	UNSAT TT=0.733 CHECKS=764 NODES=63	UNSAT TT=0.741 CHECKS=704 NODES=34	UNSAT TT=0.873	UNSAT TT=0.011 CHECKS=202	UNSAT TT=0.041 CHECKS=31111	UNSAT TT=0.4 ASSIGNMENTS=0	UNSAT TT=0.439 ASSIGNMENTS=0	UNSAT TT=0.374 CHECKS=737 NODES=28	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.021 ASSIGNMENTS=72 CHECKS=2689	UNSAT TT=0.021 ASSIGNMENTS=72 CHECKS=2689	UNSAT TT=0.464	UNSAT TT=0.499	UNSAT TT=0.065 CHECKS=2453	UNSAT TT=0.008 ASSIGNMENTS=82 CHECKS=2919	UNSAT TT=0.011 ASSIGNMENTS=355 CHECKS=4198	UNSAT TT=0.32	UNSAT TT=0.008 ASSIGNMENTS=104 CHECKS=1216	UNSAT TT=0.007 ASSIGNMENTS=72 CHECKS=2689	UNSAT TT=0.723	UNSAT TT=0.014 ASSIGNMENTS=23 CHECKS=1135	UNSAT TT=0.588	UNSAT TT=0.589
csp/aim-50/ normalized-aim-50-1-6-unsat-4_ext.xml	UNSAT TT=0.007	UNSAT TT=0.737 CHECKS=755 NODES=100	UNSAT TT=0.816 CHECKS=564 NODES=64	UNSAT TT=0.047	UNSAT TT=0.01 CHECKS=718	UNSAT TT=0.012 CHECKS=3711	UNSAT TT=0.427 ASSIGNMENTS=0	UNSAT TT=0.406 ASSIGNMENTS=0	UNSAT TT=0.376 CHECKS=580 NODES=41	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.018 ASSIGNMENTS=46 CHECKS=1148	UNSAT TT=0.021 ASSIGNMENTS=46 CHECKS=1148	UNSAT TT=0.498	UNSAT TT=0.523	UNSAT TT=0.057 CHECKS=803	UNSAT TT=0.008 ASSIGNMENTS=36 CHECKS=928	UNSAT TT=0.023 ASSIGNMENTS=4581 CHECKS=55443	UNSAT TT=0.341	UNSAT TT=0.007 ASSIGNMENTS=107 CHECKS=1264	UNSAT TT=0.009 ASSIGNMENTS=46 CHECKS=1148	UNSAT TT=0.752	UNSAT TT=0.012 ASSIGNMENTS=8 CHECKS=544	UNSAT TT=0.604	UNSAT TT=0.588
csp/aim-50/ normalized-aim-50-2-0-sat-1_ext.xml	SAT TT=0.008	SAT TT=0.872 CHECKS=975 NODES=138	SAT TT=0.789 CHECKS=1173 NODES=116	SAT TT=0.208	SAT TT=0.012 CHECKS=1194	SAT TT=0.014 CHECKS=5931	SAT TT=0.393 ASSIGNMENTS=1	SAT TT=0.455 ASSIGNMENTS=1	SAT TT=0.394 CHECKS=1432 NODES=141	SAT TT=0.523 CHECKS=675763 NODES=58813	SAT TT=0.386 CHECKS=25855 NODES=240	SAT TT=0.021 ASSIGNMENTS=146 CHECKS=3780	SAT TT=0.021 ASSIGNMENTS=146 CHECKS=3780	SAT TT=0.82	SAT TT=0.855	SAT TT=0.041 CHECKS=3253	SAT TT=0.009 ASSIGNMENTS=112 CHECKS=3026	SAT TT=0.023 ASSIGNMENTS=2792 CHECKS=62123	SAT TT=0.332	SAT TT=0.008 ASSIGNMENTS=134 CHECKS=2470	SAT TT=0.01 ASSIGNMENTS=146 CHECKS=3780	SAT TT=0.759	SAT TT=0.017 ASSIGNMENTS=111 CHECKS=4357	SAT TT=0.609	SAT TT=0.604
csp/aim-50/ normalized-aim-50-2-0-sat-2_ext.xml	SAT TT=0.007	SAT TT=0.852 CHECKS=3854 NODES=447	SAT TT=0.774 CHECKS=2871 NODES=322	SAT TT=0.081	SAT TT=0.012 CHECKS=2288	SAT TT=0.013 CHECKS=5550	SAT TT=0.464 ASSIGNMENTS=53	SAT TT=0.436 ASSIGNMENTS=34	SAT TT=0.352 CHECKS=544 NODES=78	SAT TT=0.481 CHECKS=367759 NODES=17603	SAT TT=0.4 CHECKS=56849 NODES=543	SAT TT=0.02 ASSIGNMENTS=94 CHECKS=3025	SAT TT=0.041 ASSIGNMENTS=94 CHECKS=3025	SAT TT=0.867	SAT TT=1.051	SAT TT=0.042 CHECKS=1464	SAT TT=0.009 ASSIGNMENTS=79 CHECKS=2594	SAT TT=0.017 ASSIGNMENTS=1683 CHECKS=39770	SAT TT=0.33	SAT TT=0.007 ASSIGNMENTS=116 CHECKS=2247	SAT TT=0.009 ASSIGNMENTS=94 CHECKS=3025	SAT TT=0.818	SAT TT=0.016 ASSIGNMENTS=184 CHECKS=5885	SAT TT=0.597	SAT TT=0.584
csp/aim-50/ normalized-aim-50-2-0-sat-3_ext.xml	SAT TT=0.009	SAT TT=0.872 CHECKS=881 NODES=142	SAT TT=0.763 CHECKS=1040 NODES=148	SAT TT=0.071	SAT TT=0.013 CHECKS=4067	SAT TT=0.015 CHECKS=6206	SAT TT=0.443 ASSIGNMENTS=100	SAT TT=0.473 ASSIGNMENTS=65	SAT TT=0.356 CHECKS=716 NODES=78	SAT TT=0.554 CHECKS=602614 NODES=31975	SAT TT=0.42 CHECKS=158615 NODES=1353	SAT TT=0.021 ASSIGNMENTS=75 CHECKS=2280	SAT TT=0.02 ASSIGNMENTS=75 CHECKS=2280	SAT TT=0.854	SAT TT=0.843	SAT TT=0.052 CHECKS=2288	SAT TT=0.009 ASSIGNMENTS=73 CHECKS=2204	SAT TT=0.012 ASSIGNMENTS=312 CHECKS=8475	SAT TT=0.323	SAT TT=0.009 ASSIGNMENTS=102 CHECKS=2205	SAT TT=0.01 ASSIGNMENTS=75 CHECKS=2280	SAT TT=0.748	SAT TT=0.02 ASSIGNMENTS=249 CHECKS=8598	SAT TT=0.599	SAT TT=0.61
csp/aim-50/ normalized-aim-50-2-0-sat-4_ext.xml	SAT TT=0.006	SAT TT=0.724 CHECKS=1267 NODES=155	SAT TT=0.773 CHECKS=1476 NODES=119	SAT TT=0.053	SAT TT=0.011 CHECKS=1430	SAT TT=0.013 CHECKS=5796	SAT TT=0.437 ASSIGNMENTS=5	SAT TT=0.425 ASSIGNMENTS=7	SAT TT=0.39 CHECKS=447 NODES=68	SAT TT=0.42 CHECKS=80401 NODES=3778	SAT TT=0.378 CHECKS=10336 NODES=126	SAT TT=0.019 ASSIGNMENTS=24 CHECKS=895	SAT TT=0.02 ASSIGNMENTS=24 CHECKS=895	SAT TT=1.001	SAT TT=0.797	SAT TT=0.045 CHECKS=1258	SAT TT=0.008 ASSIGNMENTS=44 CHECKS=1272	SAT TT=0.013 ASSIGNMENTS=381 CHECKS=10817	SAT TT=0.33	SAT TT=0.008 ASSIGNMENTS=27 CHECKS=629	SAT TT=0.006 ASSIGNMENTS=24 CHECKS=895	SAT TT=0.742	SAT TT=0.013 ASSIGNMENTS=89 CHECKS=2794	SAT TT=0.609	SAT TT=0.606
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-50/ normalized-aim-50-2-0-unsat-1_ext.xml	UNSAT TT=0.01	UNSAT TT=0.85 CHECKS=1930 NODES=195	UNSAT TT=0.804 CHECKS=1863 NODES=158	UNSAT TT=0.174	UNSAT TT=0.021 CHECKS=8972	UNSAT TT=0.024 CHECKS=20978	UNSAT TT=0.586 ASSIGNMENTS=418	UNSAT TT=0.545 ASSIGNMENTS=233	UNSAT TT=0.412 CHECKS=1335 NODES=84	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.022 ASSIGNMENTS=220 CHECKS=6449	UNSAT TT=0.02 ASSIGNMENTS=220 CHECKS=6449	UNSAT TT=0.512	UNSAT TT=0.509	UNSAT TT=0.051 CHECKS=2903	UNSAT TT=0.012 ASSIGNMENTS=230 CHECKS=6566	UNSAT TT=0.033 ASSIGNMENTS=4355 CHECKS=93427	UNSAT TT=0.324	UNSAT TT=0.01 ASSIGNMENTS=129 CHECKS=2483	UNSAT TT=0.01 ASSIGNMENTS=220 CHECKS=6449	UNSAT TT=0.74	UNSAT TT=0.018 ASSIGNMENTS=193 CHECKS=10384	UNSAT TT=0.634	UNSAT TT=0.62
csp/aim-50/ normalized-aim-50-2-0-unsat-2_ext.xml	UNSAT TT=0.008	UNSAT TT=0.743 CHECKS=1886 NODES=282	UNSAT TT=0.954 CHECKS=2284 NODES=265	UNSAT TT=0.192	UNSAT TT=0.016 CHECKS=4599	UNSAT TT=0.015 CHECKS=6469	UNSAT TT=0.427 ASSIGNMENTS=95	UNSAT TT=0.454 ASSIGNMENTS=16	UNSAT TT=0.361 CHECKS=1060 NODES=71	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.022 ASSIGNMENTS=111 CHECKS=2894	UNSAT TT=0.02 ASSIGNMENTS=111 CHECKS=2894	UNSAT TT=0.471	UNSAT TT=0.65	UNSAT TT=0.061 CHECKS=2530	UNSAT TT=0.01 ASSIGNMENTS=83 CHECKS=2249	UNSAT TT=0.032 ASSIGNMENTS=4064 CHECKS=96877	UNSAT TT=0.322	UNSAT TT=0.011 ASSIGNMENTS=122 CHECKS=2645	UNSAT TT=0.008 ASSIGNMENTS=111 CHECKS=2894	UNSAT TT=0.734	UNSAT TT=0.014 ASSIGNMENTS=120 CHECKS=4430	UNSAT TT=0.593	UNSAT TT=0.605
csp/aim-50/ normalized-aim-50-2-0-unsat-3_ext.xml	UNSAT TT=0.008	UNSAT TT=0.777 CHECKS=2217 NODES=251	UNSAT TT=0.82 CHECKS=2163 NODES=253	UNSAT TT=0.146	UNSAT TT=0.015 CHECKS=3622	UNSAT TT=0.02 CHECKS=13042	UNSAT TT=0.435 ASSIGNMENTS=82	UNSAT TT=0.468 ASSIGNMENTS=131	UNSAT TT=0.386 CHECKS=954 NODES=51	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.022 ASSIGNMENTS=157 CHECKS=4921	UNSAT TT=0.021 ASSIGNMENTS=157 CHECKS=4921	UNSAT TT=0.509	UNSAT TT=0.517	UNSAT TT=0.064 CHECKS=3056	UNSAT TT=0.01 ASSIGNMENTS=174 CHECKS=5493	UNSAT TT=0.032 ASSIGNMENTS=4133 CHECKS=84382	UNSAT TT=0.318	UNSAT TT=0.009 ASSIGNMENTS=125 CHECKS=2453	UNSAT TT=0.008 ASSIGNMENTS=157 CHECKS=4921	UNSAT TT=0.789	UNSAT TT=0.015 ASSIGNMENTS=56 CHECKS=2720	UNSAT TT=0.62	UNSAT TT=0.603
csp/aim-50/ normalized-aim-50-2-0-unsat-4_ext.xml	UNSAT TT=0.008	UNSAT TT=0.795 CHECKS=1880 NODES=238	UNSAT TT=0.825 CHECKS=1227 NODES=130	UNSAT TT=0.199	UNSAT TT=0.017 CHECKS=4459	UNSAT TT=0.016 CHECKS=6916	UNSAT TT=0.449 ASSIGNMENTS=132	UNSAT TT=0.503 ASSIGNMENTS=147	UNSAT TT=0.389 CHECKS=872 NODES=55	? (TO) TT=1800.12	? (TO) TT=1800.02	UNSAT TT=0.024 ASSIGNMENTS=114 CHECKS=3134	UNSAT TT=0.021 ASSIGNMENTS=114 CHECKS=3134	UNSAT TT=0.637	UNSAT TT=0.482	UNSAT TT=0.05 CHECKS=1757	UNSAT TT=0.008 ASSIGNMENTS=121 CHECKS=3225	UNSAT TT=0.028 ASSIGNMENTS=4382 CHECKS=81259	UNSAT TT=0.35	UNSAT TT=0.011 ASSIGNMENTS=196 CHECKS=3789	UNSAT TT=0.01 ASSIGNMENTS=114 CHECKS=3134	UNSAT TT=0.739	UNSAT TT=0.013 ASSIGNMENTS=77 CHECKS=3050	UNSAT TT=0.603	UNSAT TT=0.601
csp/aim-50/ normalized-aim-50-3-4-sat-1_ext.xml	SAT TT=0.008	SAT TT=0.803 CHECKS=702 NODES=73	SAT TT=0.782 CHECKS=870 NODES=58	SAT TT=0.054	SAT TT=0.013 CHECKS=1312	SAT TT=0.013 CHECKS=1102	SAT TT=0.469 ASSIGNMENTS=6	SAT TT=0.518 ASSIGNMENTS=18	SAT TT=0.419 CHECKS=1913 NODES=90	SAT TT=0.407 CHECKS=89249 NODES=2318	SAT TT=0.48 CHECKS=9018 NODES=54	SAT TT=0.022 ASSIGNMENTS=5 CHECKS=468	SAT TT=0.023 ASSIGNMENTS=5 CHECKS=468	SAT TT=1.105	SAT TT=1.088	SAT TT=0.066 CHECKS=1814	SAT TT=0.009 ASSIGNMENTS=5 CHECKS=468	SAT TT=0.011 ASSIGNMENTS=68 CHECKS=4270	SAT TT=0.409	SAT TT=0.011 ASSIGNMENTS=89 CHECKS=3931	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=468	SAT TT=0.863	SAT TT=0.019 ASSIGNMENTS=136 CHECKS=11187	SAT TT=0.628	SAT TT=0.665
csp/aim-50/ normalized-aim-50-3-4-sat-2_ext.xml	SAT TT=0.01	SAT TT=0.919 CHECKS=3802 NODES=274	SAT TT=0.828 CHECKS=4071 NODES=241	SAT TT=0.053	SAT TT=0.019 CHECKS=7001	SAT TT=0.021 CHECKS=13117	SAT TT=0.513 ASSIGNMENTS=70	SAT TT=0.461 ASSIGNMENTS=21	SAT TT=0.373 CHECKS=530 NODES=52	SAT TT=0.437 CHECKS=91486 NODES=2315	SAT TT=0.442 CHECKS=137244 NODES=1014	SAT TT=0.022 ASSIGNMENTS=51 CHECKS=3704	SAT TT=0.022 ASSIGNMENTS=51 CHECKS=3704	SAT TT=0.906	SAT TT=1.167	SAT TT=0.055 CHECKS=7101	SAT TT=0.011 ASSIGNMENTS=63 CHECKS=5922	SAT TT=0.015 ASSIGNMENTS=333 CHECKS=25840	SAT TT=0.41	SAT TT=0.011 ASSIGNMENTS=21 CHECKS=931	SAT TT=0.01 ASSIGNMENTS=51 CHECKS=3704	SAT TT=0.871	SAT TT=0.03 ASSIGNMENTS=132 CHECKS=12635	SAT TT=0.662	SAT TT=0.651
csp/aim-50/ normalized-aim-50-3-4-sat-3_ext.xml	SAT TT=0.009	SAT TT=0.826 CHECKS=1107 NODES=80	SAT TT=0.824 CHECKS=1336 NODES=79	SAT TT=0.053	SAT TT=0.018 CHECKS=4045	SAT TT=0.02 CHECKS=11825	SAT TT=0.52 ASSIGNMENTS=54	SAT TT=0.471 ASSIGNMENTS=24	SAT TT=0.434 CHECKS=2493 NODES=102	SAT TT=0.478 CHECKS=39482 NODES=976	SAT TT=0.43 CHECKS=56821 NODES=506	SAT TT=0.023 ASSIGNMENTS=123 CHECKS=11368	SAT TT=0.024 ASSIGNMENTS=123 CHECKS=11368	SAT TT=1.102	SAT TT=0.958	SAT TT=0.069 CHECKS=3510	SAT TT=0.011 ASSIGNMENTS=73 CHECKS=6572	SAT TT=0.01 ASSIGNMENTS=51 CHECKS=3887	SAT TT=0.371	SAT TT=0.009 ASSIGNMENTS=14 CHECKS=691	SAT TT=0.013 ASSIGNMENTS=123 CHECKS=11368	SAT TT=0.787	SAT TT=0.03 ASSIGNMENTS=139 CHECKS=13576	SAT TT=0.692	SAT TT=0.676
csp/aim-50/ normalized-aim-50-3-4-sat-4_ext.xml	SAT TT=0.01	SAT TT=0.783 CHECKS=1943 NODES=128	SAT TT=0.78 CHECKS=974 NODES=53	SAT TT=0.047	SAT TT=0.016 CHECKS=2349	SAT TT=0.016 CHECKS=4471	SAT TT=0.486 ASSIGNMENTS=27	SAT TT=0.531 ASSIGNMENTS=23	SAT TT=0.406 CHECKS=829 NODES=68	SAT TT=0.396 CHECKS=29535 NODES=722	SAT TT=0.43 CHECKS=34591 NODES=336	SAT TT=0.022 ASSIGNMENTS=16 CHECKS=1416	SAT TT=0.02 ASSIGNMENTS=16 CHECKS=1416	SAT TT=0.886	SAT TT=1.144	SAT TT=0.059 CHECKS=4843	SAT TT=0.011 ASSIGNMENTS=12 CHECKS=1441	SAT TT=0.01 ASSIGNMENTS=84 CHECKS=6231	SAT TT=0.364	SAT TT=0.012 ASSIGNMENTS=79 CHECKS=3690	SAT TT=0.01 ASSIGNMENTS=16 CHECKS=1416	SAT TT=0.832	SAT TT=0.019 ASSIGNMENTS=89 CHECKS=6215	SAT TT=0.642	SAT TT=0.668
csp/aim-50/ normalized-aim-50-6-0-sat-1_ext.xml	SAT TT=0.013	SAT TT=0.837 CHECKS=1164 NODES=72	SAT TT=0.854 CHECKS=2424 NODES=57	SAT TT=0.06	SAT TT=0.016 CHECKS=1797	SAT TT=0.016 CHECKS=2552	SAT TT=0.566 ASSIGNMENTS=1	SAT TT=0.542 ASSIGNMENTS=1	SAT TT=0.459 CHECKS=2475 NODES=73	SAT TT=0.653 CHECKS=203734 NODES=2882	SAT TT=0.443 CHECKS=10561 NODES=23	SAT TT=0.026 ASSIGNMENTS=15 CHECKS=1722	SAT TT=0.025 ASSIGNMENTS=15 CHECKS=1722	SAT TT=1.211	SAT TT=1.374	SAT TT=0.057 CHECKS=1288	SAT TT=0.013 ASSIGNMENTS=11 CHECKS=1547	SAT TT=0.013 ASSIGNMENTS=4 CHECKS=1044	SAT TT=0.488	SAT TT=0.013 ASSIGNMENTS=25 CHECKS=2130	SAT TT=0.013 ASSIGNMENTS=15 CHECKS=1722	SAT TT=0.86	SAT TT=0.023 ASSIGNMENTS=84 CHECKS=12073	SAT TT=0.767	SAT TT=0.767
csp/aim-50/ normalized-aim-50-6-0-sat-2_ext.xml	SAT TT=0.013	SAT TT=0.855 CHECKS=2005 NODES=100	SAT TT=0.807 CHECKS=1471 NODES=0	SAT TT=0.062	SAT TT=37.557 CHECKS=3611	SAT TT=0.019 CHECKS=2469	SAT TT=0.528 ASSIGNMENTS=1	SAT TT=0.55 ASSIGNMENTS=1	SAT TT=0.447 CHECKS=595 NODES=51	SAT TT=0.47 CHECKS=7082 NODES=47	SAT TT=0.47 CHECKS=19811 NODES=112	SAT TT=0.024 ASSIGNMENTS=4 CHECKS=1112	SAT TT=0.023 ASSIGNMENTS=4 CHECKS=1112	SAT TT=1.095	SAT TT=1.221	SAT TT=0.083 CHECKS=794	SAT TT=0.013 ASSIGNMENTS=5 CHECKS=1073	SAT TT=0.011 ASSIGNMENTS=6 CHECKS=1646	SAT TT=0.419	SAT TT=0.015 ASSIGNMENTS=22 CHECKS=1876	SAT TT=0.013 ASSIGNMENTS=4 CHECKS=1112	SAT TT=0.928	SAT TT=0.024 ASSIGNMENTS=58 CHECKS=5545	SAT TT=0.81	SAT TT=0.776
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-50/ normalized-aim-50-6-0-sat-3_ext.xml	SAT TT=0.011	SAT TT=0.857 CHECKS=1587 NODES=78	SAT TT=0.779 CHECKS=626 NODES=0	SAT TT=0.061	SAT TT=0.017 CHECKS=3978	SAT TT=0.016 CHECKS=3352	SAT TT=0.575 ASSIGNMENTS=1	SAT TT=0.575 ASSIGNMENTS=1	SAT TT=0.448 CHECKS=513 NODES=50	SAT TT=0.623 CHECKS=16066 NODES=190	SAT TT=0.461 CHECKS=17584 NODES=103	SAT TT=0.025 ASSIGNMENTS=18 CHECKS=2370	SAT TT=0.024 ASSIGNMENTS=18 CHECKS=2370	SAT TT=1.028	SAT TT=1.206	SAT TT=0.089 CHECKS=3722	SAT TT=0.012 ASSIGNMENTS=16 CHECKS=2268	SAT TT=0.012 ASSIGNMENTS=2 CHECKS=860	SAT TT=0.478	SAT TT=0.012 ASSIGNMENTS=6 CHECKS=1200	SAT TT=0.011 ASSIGNMENTS=18 CHECKS=2370	SAT TT=0.9	SAT TT=0.023 ASSIGNMENTS=59 CHECKS=5750	SAT TT=0.76	SAT TT=0.862
csp/aim-50/ normalized-aim-50-6-0-sat-4_ext.xml	SAT TT=0.011	SAT TT=0.849 CHECKS=1771 NODES=88	SAT TT=0.872 CHECKS=1681 NODES=0	SAT TT=0.062	SAT TT=0.017 CHECKS=2589	SAT TT=0.018 CHECKS=5098	SAT TT=0.536 ASSIGNMENTS=1	SAT TT=0.506 ASSIGNMENTS=1	SAT TT=0.439 CHECKS=596 NODES=51	SAT TT=2.912 CHECKS=9820330 NODES=150048	SAT TT=0.439 CHECKS=22347 NODES=150	SAT TT=0.024 ASSIGNMENTS=14 CHECKS=2724	SAT TT=0.022 ASSIGNMENTS=14 CHECKS=2724	SAT TT=1.202	SAT TT=0.998	SAT TT=0.07 CHECKS=4370	SAT TT=0.012 ASSIGNMENTS=21 CHECKS=3527	SAT TT=0.012 ASSIGNMENTS=15 CHECKS=2665	SAT TT=0.417	SAT TT=0.013 ASSIGNMENTS=8 CHECKS=1200	SAT TT=0.011 ASSIGNMENTS=14 CHECKS=2724	SAT TT=0.855	SAT TT=0.025 ASSIGNMENTS=64 CHECKS=7161	SAT TT=0.749	SAT TT=0.903
csp/allIntervalSeries/ normalized-series-100.xml	SAT TT=0.759	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=1.26	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.03	? (MO) TT=1221.49	No data	? (TO) TT=1800.05	SAT TT=4.225 ASSIGNMENTS=774 CHECKS=646882	? (TO) TT=1800.07	SAT TT=0.759 ASSIGNMENTS=1 CHECKS=54843	? (TO) TT=1800.02	? TT=140.01	No data	? (TO) TT=1800.06	? (TO) TT=1800.06
csp/allIntervalSeries/ normalized-series-10.xml	SAT TT=0.009	SAT TT=0.931 CHECKS=108808 NODES=447	SAT TT=0.902 CHECKS=90998 NODES=255	SAT TT=0.038	SAT TT=0.163 CHECKS=385886	SAT TT=0.249 CHECKS=972583	SAT TT=0.885 ASSIGNMENTS=60	SAT TT=0.783 ASSIGNMENTS=4	SAT TT=0.7 CHECKS=76601 NODES=255	SAT TT=1.075 CHECKS=1842810 NODES=17623	SAT TT=0.697 CHECKS=14838 NODES=58	SAT TT=0.135 ASSIGNMENTS=1577 CHECKS=148870	SAT TT=0.126 ASSIGNMENTS=1577 CHECKS=148870	SAT TT=1.521	SAT TT=1.34	No data	SAT TT=0.116 ASSIGNMENTS=1413 CHECKS=141957	SAT TT=0.01 ASSIGNMENTS=15 CHECKS=1335	SAT TT=0.56	SAT TT=0.009 ASSIGNMENTS=1 CHECKS=528	SAT TT=0.013 ASSIGNMENTS=44 CHECKS=4486	SAT TT=2.591	No data	SAT TT=0.879	SAT TT=0.905
csp/allIntervalSeries/ normalized-series-12.xml	SAT TT=0.011	SAT TT=1.159 CHECKS=503774 NODES=1618	SAT TT=2.304 CHECKS=2364350 NODES=7549	SAT TT=0.044	SAT TT=3.242 CHECKS=14991800	SAT TT=5.181 CHECKS=22998500	SAT TT=1.093 ASSIGNMENTS=532	SAT TT=0.922 ASSIGNMENTS=24	SAT TT=3.425 CHECKS=4641930 NODES=10563	SAT TT=5.435 CHECKS=22957200 NODES=154803	? (TO) TT=1800.02	SAT TT=7.066 ASSIGNMENTS=94 CHECKS=10289	SAT TT=9.438 ASSIGNMENTS=6501 CHECKS=2065960	SAT TT=2.599	SAT TT=1.955	No data	SAT TT=2.29 ASSIGNMENTS=24656 CHECKS=2896690	SAT TT=0.012 ASSIGNMENTS=9 CHECKS=1094	SAT TT=10.128	SAT TT=0.011 ASSIGNMENTS=1 CHECKS=767	SAT TT=0.019 ASSIGNMENTS=94 CHECKS=10289	SAT TT=3.375	No data	SAT TT=2.168	SAT TT=0.824
csp/allIntervalSeries/ normalized-series-15.xml	SAT TT=0.015	SAT TT=69.795 CHECKS=129056000 NODES=342327	SAT TT=64.78 CHECKS=129145000 NODES=342327	SAT TT=0.052	SAT TT=115.591 CHECKS=509513000	SAT TT=22.237 CHECKS=94409100	SAT TT=1.397 ASSIGNMENTS=1106	SAT TT=1.084 ASSIGNMENTS=56	SAT TT=345.999 CHECKS=723681000 NODES=1099340	SAT TT=73.429 CHECKS=437560000 NODES=1911200	? (TO) TT=1800.08	SAT TT=8.942 ASSIGNMENTS=1106	SAT TT=363.23 ASSIGNMENTS=1639580 CHECKS=770219000	SAT TT=32.124	SAT TT=5.566	No data	SAT TT=8.622 ASSIGNMENTS=71133 CHECKS=10765900	SAT TT=0.106 ASSIGNMENTS=928 CHECKS=119954	? (TO) TT=1800.09	SAT TT=0.015 ASSIGNMENTS=1 CHECKS=1208	SAT TT=0.151 ASSIGNMENTS=1220 CHECKS=174310	SAT TT=337.443	No data	SAT TT=65.561	SAT TT=3.613
csp/allIntervalSeries/ normalized-series-16.xml	SAT TT=0.015	SAT TT=192.347 CHECKS=386221000 NODES=775841	SAT TT=193.628 CHECKS=386377000 NODES=775841	SAT TT=0.052	SAT TT=20.218 CHECKS=93087300	SAT TT=564.099 CHECKS=2790740000	SAT TT=1.079 ASSIGNMENTS=42	SAT TT=1.114 ASSIGNMENTS=6	SAT TT=1755.05 CHECKS=3789000000 NODES=4952830	SAT TT=103.969 CHECKS=584581000 NODES=2250530	? (TO) TT=1800.08	SAT TT=8.387 ASSIGNMENTS=42	SAT TT=511.855 ASSIGNMENTS=1323 CHECKS=166289	SAT TT=293.332	SAT TT=4.222	No data	SAT TT=0.863 ASSIGNMENTS=6550 CHECKS=1002750	SAT TT=0.019 ASSIGNMENTS=42 CHECKS=5917	? (TO) TT=1800.05	SAT TT=0.015 ASSIGNMENTS=1 CHECKS=1377	SAT TT=0.151 ASSIGNMENTS=1323 CHECKS=166289	? (TO) TT=1800.19	No data	SAT TT=3.945	SAT TT=30.232
csp/allIntervalSeries/ normalized-series-18.xml	SAT TT=0.016	? (TO) TT=1800.08	? (TO) TT=1800.14	SAT TT=0.065	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=2.631 ASSIGNMENTS=4139	SAT TT=1.316 ASSIGNMENTS=91	? (TO) TT=1800.03	SAT TT=955.655 CHECKS=5617760000 NODES=17170000	? (TO) TT=1800.08	SAT TT=10.211 ASSIGNMENTS=4139	SAT TT=512.382 ASSIGNMENTS=3463 CHECKS=566291	SAT TT=190.383	SAT TT=13.327	No data	SAT TT=457.807 ASSIGNMENTS=2807590 CHECKS=528970000	SAT TT=0.019 ASSIGNMENTS=1 CHECKS=1748	? (TO) TT=1800.1	SAT TT=0.016 ASSIGNMENTS=1 CHECKS=1748	SAT TT=0.454 ASSIGNMENTS=3463 CHECKS=566291	? (TO) TT=1800.16	No data	SAT TT=327.544	SAT TT=115.297
csp/allIntervalSeries/ normalized-series-20.xml	SAT TT=0.022	? (TO) TT=1800.11	SAT TT=338.246 CHECKS=688420000 NODES=942071	SAT TT=0.071	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=1.657 ASSIGNMENTS=1440	SAT TT=1.205 ASSIGNMENTS=19	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=9.206 ASSIGNMENTS=1440	SAT TT=513.083 ASSIGNMENTS=6771 CHECKS=1368540	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	SAT TT=13.884 ASSIGNMENTS=87320 CHECKS=17166300	SAT TT=0.172 ASSIGNMENTS=1067 CHECKS=189121	? (TO) TT=1800.09	SAT TT=0.022 ASSIGNMENTS=1 CHECKS=2163	SAT TT=1.204 ASSIGNMENTS=6771 CHECKS=1368540	? (TO) TT=1800.17	No data	? (TO) TT=1800.13	SAT TT=1024.22
csp/allIntervalSeries/ normalized-series-25.xml	SAT TT=0.031	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=0.103	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1507.95 ASSIGNMENTS=1826070	SAT TT=1.89 ASSIGNMENTS=111	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=1524.27 ASSIGNMENTS=1826070	SAT TT=515.015 ASSIGNMENTS=11798 CHECKS=3002610	? (TO) TT=1800.06	? (TO) TT=1800.1	No data	SAT TT=186.661 ASSIGNMENTS=853357 CHECKS=207638000	SAT TT=0.159 ASSIGNMENTS=525 CHECKS=125961	? (TO) TT=1800.12	SAT TT=0.031 ASSIGNMENTS=1 CHECKS=3393	SAT TT=2.687 ASSIGNMENTS=11798 CHECKS=3002610	? (TO) TT=1800.2	No data	? (TO) TT=1800.05	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allIntervalSeries/ normalized-series-30.xml	SAT TT=0.039	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=0.135	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=2.259 ASSIGNMENTS=459	SAT TT=2.019 ASSIGNMENTS=12	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=9.521 ASSIGNMENTS=459	SAT TT=512.894 ASSIGNMENTS=2578 CHECKS=713222	? (TO) TT=1800.04	? (TO) TT=1800.07	No data	SAT TT=9.658 ASSIGNMENTS=19341 CHECKS=6642560	SAT TT=0.769 ASSIGNMENTS=2170 CHECKS=581724	? (TO) TT=1800.11	SAT TT=0.039 ASSIGNMENTS=1 CHECKS=4898	SAT TT=0.843 ASSIGNMENTS=2578 CHECKS=713222	? (TO) TT=1800.2	No data	? (TO) TT=1800.05	? (TO) TT=1800.06
csp/allIntervalSeries/ normalized-series-35.xml	SAT TT=0.061	? (TO) TT=1800.15	? (TO) TT=1800.04	SAT TT=0.163	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.13	SAT TT=2.067 ASSIGNMENTS=64	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800	No data	? (TO) TT=1800.01	SAT TT=0.233 ASSIGNMENTS=361 CHECKS=115179	? (TO) TT=1800.09	SAT TT=0.061 ASSIGNMENTS=1 CHECKS=6678	? (TO) TT=1800.08	? (TO) TT=1800.2	No data	? (TO) TT=1800.06	? (TO) TT=1800.05
csp/allIntervalSeries/ normalized-series-70.xml	SAT TT=0.276	? (TO) TT=1800.06	? (TO) TT=1800.16	SAT TT=0.604	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.02	? (MO) TT=1057.9	No data	? (TO) TT=1800.04	SAT TT=6.169 ASSIGNMENTS=2289 CHECKS=1375520	? (TO) TT=1800.12	SAT TT=0.276 ASSIGNMENTS=1 CHECKS=26838	? (TO) TT=1800.07	? TT=63.443	No data	? (TO) TT=1800.01	? (TO) TT=1800.1
csp/allIntervalSeries/ normalized-series-80.xml	SAT TT=0.409	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=0.857	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=19.625 ASSIGNMENTS=2704	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (MO) TT=1151.8	No data	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=0.409 ASSIGNMENTS=1 CHECKS=35073	? (TO) TT=1800.03	? TT=124.445	No data	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/allIntervalSeries/ normalized-series-8.xml	SAT TT=0.008	SAT TT=0.758 CHECKS=3074 NODES=26	SAT TT=0.786 CHECKS=19140 NODES=107	SAT TT=0.03	SAT TT=0.045 CHECKS=45074	SAT TT=0.023 CHECKS=53567	SAT TT=0.706 ASSIGNMENTS=12	SAT TT=0.727 ASSIGNMENTS=4	SAT TT=0.594 CHECKS=15712 NODES=95	SAT TT=0.59 CHECKS=85743 NODES=1229	SAT TT=0.606 CHECKS=7654 NODES=48	SAT TT=0.025 ASSIGNMENTS=96 CHECKS=7794	SAT TT=0.026 ASSIGNMENTS=96 CHECKS=7794	SAT TT=1.282	SAT TT=1.198	No data	SAT TT=0.014 ASSIGNMENTS=91 CHECKS=7519	SAT TT=0.01 ASSIGNMENTS=17 CHECKS=920	SAT TT=0.371	SAT TT=0.009 ASSIGNMENTS=1 CHECKS=333	SAT TT=0.008 ASSIGNMENTS=11 CHECKS=998	SAT TT=2.117	No data	SAT TT=0.575	SAT TT=0.696
csp/allIntervalSeries/ normalized-series-90.xml	SAT TT=0.526	? (TO) TT=1800.06	? (TO) TT=1800.12	SAT TT=1.076	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (MO) TT=1511.74	No data	? (TO) TT=1800.08	SAT TT=7.14 ASSIGNMENTS=2154 CHECKS=1572860	? (TO) TT=1800.05	SAT TT=0.526 ASSIGNMENTS=1 CHECKS=44408	? (TO) TT=1800.08	? TT=123.138	No data	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/allIntervalSeries/ normalized-series-9.xml	SAT TT=0.007	SAT TT=0.852 CHECKS=28486 NODES=197	SAT TT=0.85 CHECKS=59094 NODES=258	SAT TT=0.035	SAT TT=0.127 CHECKS=252484	SAT TT=0.089 CHECKS=305730	SAT TT=0.781 ASSIGNMENTS=35	SAT TT=0.745 ASSIGNMENTS=7	SAT TT=0.769 CHECKS=151825 NODES=741	SAT TT=0.725 CHECKS=343553 NODES=3987	SAT TT=10.878 CHECKS=69966000 NODES=95857	SAT TT=0.047 ASSIGNMENTS=444 CHECKS=37662	SAT TT=0.048 ASSIGNMENTS=444 CHECKS=37662	SAT TT=1.338	SAT TT=1.362	No data	SAT TT=0.03 ASSIGNMENTS=366 CHECKS=31863	SAT TT=0.013 ASSIGNMENTS=50 CHECKS=4023	SAT TT=0.406	SAT TT=0.007 ASSIGNMENTS=1 CHECKS=425	SAT TT=0.01 ASSIGNMENTS=9 CHECKS=1285	SAT TT=1.894	No data	SAT TT=0.654	SAT TT=0.63
csp/allsquares/ normalized-squares-10-10.xml	SAT TT=0.026	? TT=0.903	? TT=0.855	SAT TT=0.46	SAT TT=0.727 CHECKS=164427	SAT TT=0.255 CHECKS=154527	SAT TT=1.216 ASSIGNMENTS=17	SAT TT=1.433 ASSIGNMENTS=20	No data	No data	No data	SAT TT=0.04 ASSIGNMENTS=25 CHECKS=8352	SAT TT=0.038 ASSIGNMENTS=25 CHECKS=8352	No data	No data	No data	SAT TT=0.026 ASSIGNMENTS=18 CHECKS=6836	SAT TT=0.03 ASSIGNMENTS=47 CHECKS=17524	? (exit code) TT=0.531	SAT TT=0.213 ASSIGNMENTS=1306 CHECKS=360033	SAT TT=0.027 ASSIGNMENTS=25 CHECKS=8353	? TT=2.381	No data	SAT TT=1.22	SAT TT=1.599
csp/allsquares/ normalized-squares-11-11.xml	SAT TT=0.03	? TT=0.847	? TT=0.844	SAT TT=1158.8	SAT TT=0.978 CHECKS=251586	SAT TT=0.225 CHECKS=118247	SAT TT=1.318 ASSIGNMENTS=20	SAT TT=1.536 ASSIGNMENTS=21	No data	No data	No data	SAT TT=0.043 ASSIGNMENTS=26 CHECKS=10371	SAT TT=0.045 ASSIGNMENTS=26 CHECKS=10371	No data	No data	No data	SAT TT=0.03 ASSIGNMENTS=20 CHECKS=8737	SAT TT=0.033 ASSIGNMENTS=40 CHECKS=10721	? (exit code) TT=0.569	SAT TT=0.043 ASSIGNMENTS=138 CHECKS=14464	SAT TT=0.032 ASSIGNMENTS=26 CHECKS=10361	? TT=2.807	No data	SAT TT=1.518	SAT TT=1.762
csp/allsquares/ normalized-squares-12-12.xml	SAT TT=0.036	? TT=0.889	? TT=0.916	? (TO) TT=1800.09	SAT TT=0.95 CHECKS=157703	SAT TT=0.587 CHECKS=284867	SAT TT=1.463 ASSIGNMENTS=20	SAT TT=1.733 ASSIGNMENTS=25	No data	No data	No data	SAT TT=0.048 ASSIGNMENTS=27 CHECKS=12296	SAT TT=0.048 ASSIGNMENTS=27 CHECKS=12296	No data	No data	No data	SAT TT=0.036 ASSIGNMENTS=29 CHECKS=11812	SAT TT=0.048 ASSIGNMENTS=92 CHECKS=40323	? (exit code) TT=0.524	SAT TT=0.087 ASSIGNMENTS=295 CHECKS=75984	SAT TT=0.037 ASSIGNMENTS=27 CHECKS=12296	? TT=2.877	No data	SAT TT=1.862	SAT TT=2.017
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-13-13.xml	SAT TT=0.044	? TT=0.968	? TT=1.068	SAT TT=1338.97	SAT TT=1.564 CHECKS=371572	SAT TT=0.861 CHECKS=394761	SAT TT=1.549 ASSIGNMENTS=22	SAT TT=1.895 ASSIGNMENTS=28	No data	No data	No data	SAT TT=0.057 ASSIGNMENTS=30 CHECKS=15401	SAT TT=0.055 ASSIGNMENTS=30 CHECKS=15401	No data	No data	No data	SAT TT=0.046 ASSIGNMENTS=33 CHECKS=14808	SAT TT=0.084 ASSIGNMENTS=281 CHECKS=134758	? (exit code) TT=0.602	SAT TT=0.135 ASSIGNMENTS=464 CHECKS=158488	SAT TT=0.044 ASSIGNMENTS=30 CHECKS=15402	? TT=3.504	No data	SAT TT=1.898	SAT TT=2.755
csp/allsquares/ normalized-squares-14-14.xml	SAT TT=0.051	? TT=0.999	? TT=1.141	? (TO) TT=1800.11	SAT TT=8.927 CHECKS=9859980	SAT TT=1.576 CHECKS=807176	SAT TT=1.886 ASSIGNMENTS=23	SAT TT=1.889 ASSIGNMENTS=30	No data	No data	No data	SAT TT=0.064 ASSIGNMENTS=33 CHECKS=18941	SAT TT=0.064 ASSIGNMENTS=33 CHECKS=18941	No data	No data	No data	SAT TT=0.054 ASSIGNMENTS=35 CHECKS=18128	SAT TT=0.054 ASSIGNMENTS=36 CHECKS=26750	? (exit code) TT=0.615	SAT TT=0.189 ASSIGNMENTS=395 CHECKS=238430	SAT TT=0.051 ASSIGNMENTS=33 CHECKS=18942	? TT=3.751	No data	SAT TT=1.933	SAT TT=3.25
csp/allsquares/ normalized-squares-15-15.xml	SAT TT=0.072	? TT=1.176	? TT=1.176	SAT TT=1340.21	SAT TT=2.422 CHECKS=1193690	SAT TT=1.673 CHECKS=735506	SAT TT=2.143 ASSIGNMENTS=116	SAT TT=2.076 ASSIGNMENTS=29	No data	No data	No data	SAT TT=0.084 ASSIGNMENTS=69 CHECKS=43128	SAT TT=0.08 ASSIGNMENTS=69 CHECKS=43128	No data	No data	No data	SAT TT=0.102 ASSIGNMENTS=192 CHECKS=148958	SAT TT=0.164 ASSIGNMENTS=477 CHECKS=291107	? (exit code) TT=0.415	SAT TT=2.632 ASSIGNMENTS=6749 CHECKS=2890200	SAT TT=0.072 ASSIGNMENTS=76 CHECKS=45774	? TT=4.644	No data	SAT TT=2.568	SAT TT=4.207
csp/allsquares/ normalized-squares-16-16.xml	SAT TT=1.606	? TT=1.124	? TT=1.196	SAT TT=1345.67	? (TO) TT=1800.11	SAT TT=441.93 CHECKS=271392000	SAT TT=7.198 ASSIGNMENTS=3518	SAT TT=2.982 ASSIGNMENTS=644	No data	No data	No data	SAT TT=8.952 ASSIGNMENTS=2085 CHECKS=3836690	SAT TT=8.686 ASSIGNMENTS=2085 CHECKS=3836690	No data	No data	No data	SAT TT=2.092 ASSIGNMENTS=3671 CHECKS=5710140	SAT TT=2.965 ASSIGNMENTS=8878 CHECKS=7771260	? (exit code) TT=0.62	SAT TT=105.031 ASSIGNMENTS=125029 CHECKS=231010000	SAT TT=1.606 ASSIGNMENTS=2085 CHECKS=3836690	? TT=5.639	No data	SAT TT=2.904	SAT TT=4.889
csp/allsquares/ normalized-squares-17-17.xml	SAT TT=2.544	? TT=1.211	? TT=1.28	SAT TT=1349.81	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=2.544 ASSIGNMENTS=345	SAT TT=245.195 ASSIGNMENTS=118078	No data	No data	No data	SAT TT=19.356 ASSIGNMENTS=12856 CHECKS=24916400	SAT TT=18.768 ASSIGNMENTS=12856 CHECKS=24916400	No data	No data	No data	SAT TT=21.678 ASSIGNMENTS=30007 CHECKS=47136800	SAT TT=4.3 ASSIGNMENTS=9433 CHECKS=9578080	? (exit code) TT=0.686	SAT TT=315.266 ASSIGNMENTS=371137 CHECKS=613994000	SAT TT=11.179 ASSIGNMENTS=12856 CHECKS=24916400	? TT=7.896	No data	SAT TT=3.591	SAT TT=6.878
csp/allsquares/ normalized-squares-18-18.xml	SAT TT=1.249	? TT=1.289	? TT=1.288	SAT TT=1345.02	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=9.502 ASSIGNMENTS=4461	SAT TT=1426.5 ASSIGNMENTS=417690	No data	No data	No data	SAT TT=1.249 ASSIGNMENTS=2359 CHECKS=2612060	SAT TT=1.348 ASSIGNMENTS=2359 CHECKS=2612060	No data	No data	No data	SAT TT=5.589 ASSIGNMENTS=7184 CHECKS=11904600	SAT TT=5.215 ASSIGNMENTS=10355 CHECKS=10537200	? (exit code) TT=0.44	SAT TT=161.752 ASSIGNMENTS=164092 CHECKS=259915000	SAT TT=37.89 ASSIGNMENTS=47361 CHECKS=69118000	? TT=8.638	No data	SAT TT=4.578	SAT TT=7.945
csp/allsquares/ normalized-squares-19-19.xml	SAT TT=13.899	? TT=1.47	? TT=1.412	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.1	SAT TT=32.908 ASSIGNMENTS=18975	? (TO) TT=1800.07	No data	No data	No data	SAT TT=135.083 ASSIGNMENTS=110688 CHECKS=192957000	SAT TT=132.876 ASSIGNMENTS=110688 CHECKS=192957000	No data	No data	No data	SAT TT=84.222 ASSIGNMENTS=66683 CHECKS=149081000	SAT TT=37.588 ASSIGNMENTS=33753 CHECKS=66361300	? (exit code) TT=0.717	SAT TT=884.867 ASSIGNMENTS=509242 CHECKS=1182770000	SAT TT=119.813 ASSIGNMENTS=110688 CHECKS=192957000	? TT=11.04	No data	SAT TT=25.384	SAT TT=13.899
csp/allsquares/ normalized-squares-20-20.xml	SAT TT=6.734	? TT=1.552	? TT=1.554	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=1278.01 ASSIGNMENTS=1088810	? (TO) TT=1800.11	No data	No data	No data	SAT TT=147.321 ASSIGNMENTS=111914 CHECKS=246693000	SAT TT=153.787 ASSIGNMENTS=111914 CHECKS=246693000	No data	No data	No data	SAT TT=139.875 ASSIGNMENTS=110439 CHECKS=224651000	SAT TT=744.468 ASSIGNMENTS=545008 CHECKS=1117940000	? (exit code) TT=0.727	SAT TT=771.309 ASSIGNMENTS=462808 CHECKS=1063180000	SAT TT=147.743 ASSIGNMENTS=111914 CHECKS=246693000	? TT=14.328	No data	SAT TT=6.734	SAT TT=13.653
csp/allsquares/ normalized-squares-21-21.xml	SAT TT=29.692	? TT=1.691	? TT=1.687	SAT TT=1351.22	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.12	No data	No data	No data	SAT TT=351.29 ASSIGNMENTS=240563 CHECKS=459067000	SAT TT=347.62 ASSIGNMENTS=240563 CHECKS=459067000	No data	No data	No data	SAT TT=161.767 ASSIGNMENTS=92794 CHECKS=238589000	SAT TT=429.572 ASSIGNMENTS=279921 CHECKS=568725000	? (exit code) TT=0.472	? (TO) TT=1800.08	SAT TT=346.911 ASSIGNMENTS=240563 CHECKS=459067000	? TT=18.025	No data	SAT TT=65.959	SAT TT=29.692
csp/allsquares/ normalized-squares-22-22.xml	SAT TT=268.547	? TT=1.893	? TT=1.877	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.15	No data	No data	No data	SAT TT=388.702 ASSIGNMENTS=211898 CHECKS=471170000	SAT TT=386.623 ASSIGNMENTS=211898 CHECKS=471170000	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.03	? (exit code) TT=0.76	? (TO) TT=1800.09	SAT TT=357.59 ASSIGNMENTS=211898 CHECKS=471170000	? TT=20.968	No data	SAT TT=268.547	SAT TT=486.31
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-2-2.xml	SAT TT=0.005	? TT=0.642	? TT=0.569	SAT TT=0.026	SAT TT=0.008 CHECKS=191	SAT TT=0.009 CHECKS=210	SAT TT=0.48 ASSIGNMENTS=2	SAT TT=0.61 ASSIGNMENTS=3	No data	No data	No data	SAT TT=0.019 ASSIGNMENTS=1 CHECKS=46	SAT TT=0.019 ASSIGNMENTS=1 CHECKS=46	No data	No data	No data	SAT TT=0.005 ASSIGNMENTS=1 CHECKS=46	SAT TT=0.008 ASSIGNMENTS=2 CHECKS=49	? (exit code) TT=0.191	SAT TT=0.007 ASSIGNMENTS=1 CHECKS=46	SAT TT=0.005 ASSIGNMENTS=1 CHECKS=46	? TT=0.907	No data	SAT TT=0.49	SAT TT=0.476
csp/allsquares/ normalized-squares-23-23.xml	SAT TT=424.381	? TT=2.029	? TT=2.036	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.04	? (exit code) TT=1.034	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=26.973	No data	SAT TT=424.381	SAT TT=867.627
csp/allsquares/ normalized-squares-24-24.xml	SAT TT=30.729	? TT=2.321	? TT=2.302	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.1	No data	No data	No data	SAT TT=212.445 ASSIGNMENTS=105979 CHECKS=355261000	? (TO) TT=1800.01	? (exit code) TT=0.554	? (TO) TT=1800.02	SAT TT=1017.5 ASSIGNMENTS=510581 CHECKS=1416400000	? TT=33.747	No data	SAT TT=43.762	SAT TT=30.729
csp/allsquares/ normalized-squares-25-25.xml	SAT TT=177.971	? TT=2.685	? TT=2.475	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.11	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.07	? (exit code) TT=0.846	? (TO) TT=1800.08	? (TO) TT=1800.02	? TT=41.009	No data	SAT TT=267.101	SAT TT=177.971
csp/allsquares/ normalized-squares-26-26.xml	SAT TT=11.424	? TT=2.468	? TT=2.645	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=11.424 ASSIGNMENTS=4096	? (TO) TT=1800.14	No data	No data	No data	SAT TT=18.141 ASSIGNMENTS=4096	SAT TT=1026.79 ASSIGNMENTS=4096	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.05	? (exit code) TT=0.82	? (TO) TT=1800.08	? (TO) TT=1800.05	? TT=50.418	No data	SAT TT=18.541	SAT TT=44.394
csp/allsquares/ normalized-squares-27-27.xml	SAT TT=219.941	? TT=2.171	? TT=2.241	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.14	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.07	? (exit code) TT=0.521	? (TO) TT=1800.1	? (TO) TT=1800.06	? TT=61.371	No data	SAT TT=219.941	SAT TT=489.652
csp/allsquares/ normalized-squares-28-28.xml	SAT TT=66.947	? TT=2.091	? TT=1.926	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.08	SAT TT=139.912 ASSIGNMENTS=88693 CHECKS=276034000	? (exit code) TT=0.84	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=77.649	No data	SAT TT=118.323	SAT TT=66.947
csp/allsquares/ normalized-squares-29-29.xml	SAT TT=1015.17	? TT=1.744	? TT=1.758	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.11	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.04	? (exit code) TT=0.939	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=169.094	No data	SAT TT=1015.17	? (TO) TT=1800.02
csp/allsquares/ normalized-squares-30-30.xml	SAT TT=341.973	? TT=1.879	? TT=1.703	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.22	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.09	? (exit code) TT=0.585	? (TO) TT=1800.1	? (TO) TT=1800.1	? TT=710.032	No data	SAT TT=1749.98	SAT TT=341.973
csp/allsquares/ normalized-squares-31-31.xml	SAT TT=353.916	? TT=1.872	? TT=1.857	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.05	? (exit code) TT=0.961	? (TO) TT=1800.02	? (TO) TT=1800.08	? (MO) TT=90.582	No data	SAT TT=885.136	SAT TT=353.916
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-32-32.xml	SAT TT=474.828	? TT=2.092	? TT=1.878	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.05	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.11	? (exit code) TT=1.175	? (TO) TT=1800.04	? (TO) TT=1800.07	? (MO) TT=118.345	No data	SAT TT=1349.87	SAT TT=474.828
csp/allsquares/ normalized-squares-33-33.xml	SAT TT=542.258	? TT=2.084	? TT=2.085	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.09	? (exit code) TT=0.53	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=233.51	No data	SAT TT=1759.2	SAT TT=542.258
csp/allsquares/ normalized-squares-3-3.xml	SAT TT=0.005	? TT=0.609	? TT=0.598	SAT TT=0.029	SAT TT=0.018 CHECKS=3072	SAT TT=0.009 CHECKS=1396	SAT TT=0.58 ASSIGNMENTS=6	SAT TT=0.609 ASSIGNMENTS=5	No data	No data	No data	SAT TT=0.02 ASSIGNMENTS=4 CHECKS=245	SAT TT=0.02 ASSIGNMENTS=4 CHECKS=245	No data	No data	No data	SAT TT=0.008 ASSIGNMENTS=4 CHECKS=245	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=253	? (exit code) TT=0.179	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=241	SAT TT=0.005 ASSIGNMENTS=4 CHECKS=245	? TT=0.9	No data	SAT TT=0.526	SAT TT=0.554
csp/allsquares/ normalized-squares-34-34.xml		? TT=2.045	? TT=2.038	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.06	? (exit code) TT=1.242	? (TO) TT=1800.04	? (TO) TT=1800.06	? (MO) TT=106.499	No data	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/allsquares/ normalized-squares-35-35.xml		? TT=2.016	? TT=2.022	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.12	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.06	? (exit code) TT=1.076	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1802.17	No data	? (TO) TT=1800.32	? (TO) TT=1800.06
csp/allsquares/ normalized-squares-36-36.xml		? TT=1.926	? TT=2.2	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.13	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.07	? (exit code) TT=0.637	? (TO) TT=1800.09	? (TO) TT=1800.02	? TT=202.725	No data	? (TO) TT=1800.27	? (TO) TT=1800.05
csp/allsquares/ normalized-squares-37-37.xml		? TT=2.08	? TT=1.946	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.09	? (exit code) TT=1.096	? (TO) TT=1800.06	? (TO) TT=1800.04	? TT=229.329	No data	? (TO) TT=1800.33	? (TO) TT=1800.3
csp/allsquares/ normalized-squares-38-38.xml		? TT=1.956	? TT=1.963	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.02	? (exit code) TT=1.138	? (TO) TT=1800.02	? (TO) TT=1800.08	? (MO) TT=108.77	No data	? (MO) TT=55.763	? (TO) TT=1800.18
csp/allsquares/ normalized-squares-4-4.xml	SAT TT=0.007	? TT=0.606	? TT=0.644	SAT TT=0.033	SAT TT=0.038 CHECKS=2979	SAT TT=0.013 CHECKS=5931	SAT TT=0.641 ASSIGNMENTS=7	SAT TT=0.669 ASSIGNMENTS=7	No data	No data	No data	SAT TT=0.02 ASSIGNMENTS=5 CHECKS=529	SAT TT=0.018 ASSIGNMENTS=5 CHECKS=529	No data	No data	No data	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=529	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=574	? (exit code) TT=0.286	SAT TT=0.011 ASSIGNMENTS=15 CHECKS=608	SAT TT=0.007 ASSIGNMENTS=6 CHECKS=529	? TT=1.019	No data	SAT TT=0.714	SAT TT=0.716
csp/allsquares/ normalized-squares-5-5.xml	SAT TT=0.01	? TT=0.689	? TT=0.649	SAT TT=0.039	SAT TT=0.084 CHECKS=6906	SAT TT=0.032 CHECKS=21882	SAT TT=0.819 ASSIGNMENTS=8	SAT TT=0.807 ASSIGNMENTS=8	No data	No data	No data	SAT TT=0.021 ASSIGNMENTS=7 CHECKS=959	SAT TT=0.021 ASSIGNMENTS=7 CHECKS=959	No data	No data	No data	SAT TT=0.01 ASSIGNMENTS=7 CHECKS=959	SAT TT=0.01 ASSIGNMENTS=12 CHECKS=1155	? (exit code) TT=0.29	SAT TT=0.012 ASSIGNMENTS=17 CHECKS=889	SAT TT=0.011 ASSIGNMENTS=7 CHECKS=959	? TT=1.719	No data	SAT TT=0.769	SAT TT=0.904
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-6-6.xml	SAT TT=0.012	? TT=0.684	? TT=0.709	SAT TT=0.044	SAT TT=0.161 CHECKS=11392	SAT TT=0.031 CHECKS=20429	SAT TT=0.869 ASSIGNMENTS=11	SAT TT=0.989 ASSIGNMENTS=10	No data	No data	No data	SAT TT=0.024 ASSIGNMENTS=9 CHECKS=1603	SAT TT=0.024 ASSIGNMENTS=9 CHECKS=1603	No data	No data	No data	SAT TT=0.013 ASSIGNMENTS=9 CHECKS=1603	SAT TT=0.013 ASSIGNMENTS=17 CHECKS=1707	? (exit code) TT=0.252	SAT TT=0.013 ASSIGNMENTS=31 CHECKS=1776	SAT TT=0.012 ASSIGNMENTS=10 CHECKS=1603	? TT=1.673	No data	SAT TT=0.806	SAT TT=0.925
csp/allsquares/ normalized-squares-7-7.xml	SAT TT=0.014	? TT=0.692	? TT=0.668	SAT TT=0.05	SAT TT=0.259 CHECKS=32212	SAT TT=0.046 CHECKS=29555	SAT TT=0.905 ASSIGNMENTS=11	SAT TT=0.95 ASSIGNMENTS=12	No data	No data	No data	SAT TT=0.025 ASSIGNMENTS=10 CHECKS=2376	SAT TT=0.025 ASSIGNMENTS=10 CHECKS=2376	No data	No data	No data	SAT TT=0.015 ASSIGNMENTS=10 CHECKS=2376	SAT TT=0.014 ASSIGNMENTS=18 CHECKS=2739	? (exit code) TT=0.383	SAT TT=0.016 ASSIGNMENTS=54 CHECKS=3631	SAT TT=0.014 ASSIGNMENTS=10 CHECKS=2376	? TT=1.846	No data	SAT TT=0.913	SAT TT=0.938
csp/allsquares/ normalized-squares-8-8.xml	SAT TT=0.016	? TT=0.797	? TT=0.736	SAT TT=0.061	SAT TT=0.466 CHECKS=131200	SAT TT=0.074 CHECKS=46781	SAT TT=1.031 ASSIGNMENTS=12	SAT TT=1.157 ASSIGNMENTS=15	No data	No data	No data	SAT TT=0.029 ASSIGNMENTS=10 CHECKS=3573	SAT TT=0.029 ASSIGNMENTS=10 CHECKS=3573	No data	No data	No data	SAT TT=0.017 ASSIGNMENTS=10 CHECKS=3527	SAT TT=0.018 ASSIGNMENTS=12 CHECKS=3536	? (exit code) TT=0.436	SAT TT=0.022 ASSIGNMENTS=68 CHECKS=8493	SAT TT=0.016 ASSIGNMENTS=11 CHECKS=3527	? TT=2.064	No data	SAT TT=0.935	SAT TT=1.016
csp/allsquares/ normalized-squares-9-9.xml	SAT TT=0.021	? TT=0.737	? TT=0.745	SAT TT=0.086	SAT TT=0.551 CHECKS=147320	SAT TT=0.198 CHECKS=143946	SAT TT=1.204 ASSIGNMENTS=15	SAT TT=1.253 ASSIGNMENTS=17	No data	No data	No data	SAT TT=0.031 ASSIGNMENTS=19 CHECKS=5239	SAT TT=0.034 ASSIGNMENTS=19 CHECKS=5239	No data	No data	No data	SAT TT=0.021 ASSIGNMENTS=14 CHECKS=5142	SAT TT=0.022 ASSIGNMENTS=22 CHECKS=8931	? (exit code) TT=0.359	SAT TT=0.033 ASSIGNMENTS=133 CHECKS=19193	SAT TT=0.021 ASSIGNMENTS=17 CHECKS=5400	? TT=2.135	No data	SAT TT=1.196	SAT TT=1.116
csp/allsquaresUnsat/ normalized-squaresUnsat-10-10.xml	UNSAT TT=0.028	? TT=0.842	? TT=0.801	UNSAT TT=144.791	UNSAT TT=2.387 CHECKS=1745340	UNSAT TT=2.957 CHECKS=2574600	UNSAT TT=1.104 ASSIGNMENTS=0	UNSAT TT=1.109 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.038 ASSIGNMENTS=13 CHECKS=11406	UNSAT TT=0.039 ASSIGNMENTS=13 CHECKS=11406	No data	No data	No data	UNSAT TT=0.04 ASSIGNMENTS=84 CHECKS=44203	UNSAT TT=0.582 ASSIGNMENTS=4941 CHECKS=1657480	? (exit code) TT=0.533	UNSAT TT=0.042 ASSIGNMENTS=145 CHECKS=29681	UNSAT TT=0.028 ASSIGNMENTS=13 CHECKS=11406	? TT=2.406	No data	UNSAT TT=1.157	UNSAT TT=1.524
csp/allsquaresUnsat/ normalized-squaresUnsat-11-11.xml	UNSAT TT=0.039	? TT=0.945	? TT=0.898	UNSAT TT=1789.63	UNSAT TT=5.609 CHECKS=3934750	UNSAT TT=6.678 CHECKS=5397490	UNSAT TT=1.304 ASSIGNMENTS=0	UNSAT TT=1.234 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.043 ASSIGNMENTS=11 CHECKS=11735	UNSAT TT=0.044 ASSIGNMENTS=11 CHECKS=11735	No data	No data	No data	UNSAT TT=0.04 ASSIGNMENTS=59 CHECKS=41721	UNSAT TT=0.646 ASSIGNMENTS=5291 CHECKS=1983410	? (exit code) TT=0.566	UNSAT TT=0.298 ASSIGNMENTS=1786 CHECKS=403268	UNSAT TT=0.039 ASSIGNMENTS=50 CHECKS=26440	? TT=2.518	No data	UNSAT TT=1.376	UNSAT TT=1.591
csp/allsquaresUnsat/ normalized-squaresUnsat-12-12.xml	UNSAT TT=0.041	? TT=0.941	? TT=0.869	UNSAT TT=1345.04	UNSAT TT=8.406 CHECKS=6015970	UNSAT TT=9.924 CHECKS=7311620	UNSAT TT=1.218 ASSIGNMENTS=0	UNSAT TT=1.243 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.048 ASSIGNMENTS=19 CHECKS=14649	UNSAT TT=0.05 ASSIGNMENTS=19 CHECKS=14649	No data	No data	No data	UNSAT TT=0.048 ASSIGNMENTS=51 CHECKS=38810	UNSAT TT=0.796 ASSIGNMENTS=5811 CHECKS=2226820	? (exit code) TT=0.389	UNSAT TT=0.411 ASSIGNMENTS=2170 CHECKS=530746	UNSAT TT=0.041 ASSIGNMENTS=29 CHECKS=19176	? TT=2.812	No data	UNSAT TT=1.498	UNSAT TT=2.366
csp/allsquaresUnsat/ normalized-squaresUnsat-13-13.xml	UNSAT TT=0.042	? TT=0.951	? TT=1.05	UNSAT TT=1344.95	UNSAT TT=16.32 CHECKS=10257700	UNSAT TT=16.92 CHECKS=11278300	UNSAT TT=1.339 ASSIGNMENTS=0	UNSAT TT=1.331 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.054 ASSIGNMENTS=19 CHECKS=16161	UNSAT TT=0.053 ASSIGNMENTS=19 CHECKS=16161	No data	No data	No data	UNSAT TT=0.05 ASSIGNMENTS=43 CHECKS=42246	UNSAT TT=0.672 ASSIGNMENTS=4732 CHECKS=1966700	? (exit code) TT=0.684	UNSAT TT=0.185 ASSIGNMENTS=724 CHECKS=191981	UNSAT TT=0.042 ASSIGNMENTS=19 CHECKS=16286	? TT=3.303	No data	UNSAT TT=1.565	UNSAT TT=2.564
csp/allsquaresUnsat/ normalized-squaresUnsat-14-14.xml	UNSAT TT=0.051	? TT=1.004	? TT=0.986	? (TO) TT=1800.02	UNSAT TT=31.416 CHECKS=18151600	UNSAT TT=34.403 CHECKS=21077700	UNSAT TT=1.574 ASSIGNMENTS=0	UNSAT TT=1.611 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.063 ASSIGNMENTS=19 CHECKS=17825	UNSAT TT=0.064 ASSIGNMENTS=19 CHECKS=17825	No data	No data	No data	UNSAT TT=0.077 ASSIGNMENTS=104 CHECKS=74750	UNSAT TT=0.651 ASSIGNMENTS=3001 CHECKS=1447650	? (exit code) TT=0.684	UNSAT TT=0.12 ASSIGNMENTS=260 CHECKS=119424	UNSAT TT=0.051 ASSIGNMENTS=26 CHECKS=22403	? TT=3.697	No data	UNSAT TT=1.975	UNSAT TT=3.043
csp/allsquaresUnsat/ normalized-squaresUnsat-15-15.xml	UNSAT TT=0.06	? TT=1.061	? TT=1.066	UNSAT TT=1343.45	UNSAT TT=1.086 CHECKS=982	UNSAT TT=0.06 CHECKS=982	UNSAT TT=1.335 ASSIGNMENTS=0	UNSAT TT=1.428 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.071 ASSIGNMENTS=19 CHECKS=19530	UNSAT TT=0.072 ASSIGNMENTS=19 CHECKS=19530	No data	No data	No data	UNSAT TT=0.07 ASSIGNMENTS=38 CHECKS=45955	UNSAT TT=1.277 ASSIGNMENTS=6843 CHECKS=3277530	? (exit code) TT=0.42	UNSAT TT=0.158 ASSIGNMENTS=344 CHECKS=110887	UNSAT TT=0.064 ASSIGNMENTS=26 CHECKS=24464	? TT=4.462	No data	UNSAT TT=2.618	UNSAT TT=3.726
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-16-16.xml	UNSAT TT=0.064	? TT=1.249	? TT=1.119	UNSAT TT=1345.01	UNSAT TT=1.232 CHECKS=1106	UNSAT TT=0.065 CHECKS=1106	UNSAT TT=1.428 ASSIGNMENTS=0	UNSAT TT=1.597 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.081 ASSIGNMENTS=19 CHECKS=21276	UNSAT TT=0.082 ASSIGNMENTS=19 CHECKS=21276	No data	No data	No data	UNSAT TT=0.082 ASSIGNMENTS=40 CHECKS=51044	UNSAT TT=1.61 ASSIGNMENTS=7330 CHECKS=3696930	? (exit code) TT=0.65	UNSAT TT=0.805 ASSIGNMENTS=1149 CHECKS=453440	UNSAT TT=0.064 ASSIGNMENTS=20 CHECKS=24076	? TT=5.466	No data	UNSAT TT=2.549	UNSAT TT=4.445
csp/allsquaresUnsat/ normalized-squaresUnsat-17-17.xml	UNSAT TT=0.076	? TT=1.324	? TT=1.193	UNSAT TT=1352.53	UNSAT TT=1.458 CHECKS=1238	UNSAT TT=0.076 CHECKS=1238	UNSAT TT=1.533 ASSIGNMENTS=0	UNSAT TT=1.338 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=17.438 ASSIGNMENTS=10642 CHECKS=19776700	UNSAT TT=16.786 ASSIGNMENTS=10642 CHECKS=19776700	No data	No data	No data	UNSAT TT=19.168 ASSIGNMENTS=25918 CHECKS=40754600	UNSAT TT=34.395 ASSIGNMENTS=47618 CHECKS=76834000	? (exit code) TT=0.846	UNSAT TT=334.904 ASSIGNMENTS=399963 CHECKS=596071000	UNSAT TT=10.466 ASSIGNMENTS=10642 CHECKS=19776700	? TT=6.721	No data	UNSAT TT=6.479	UNSAT TT=9.461
csp/allsquaresUnsat/ normalized-squaresUnsat-18-18.xml	UNSAT TT=48.241	? TT=1.29	? TT=1.365	UNSAT TT=1584.82	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.16	No data	No data	No data	UNSAT TT=213.202 ASSIGNMENTS=183848 CHECKS=378246000	UNSAT TT=202.911 ASSIGNMENTS=183848 CHECKS=378246000	No data	No data	No data	UNSAT TT=246.526 ASSIGNMENTS=256838 CHECKS=500899000	UNSAT TT=152.011 ASSIGNMENTS=145952 CHECKS=264378000	? (exit code) TT=0.449	UNSAT TT=484.343 ASSIGNMENTS=397120 CHECKS=706295000	UNSAT TT=187.797 ASSIGNMENTS=183848 CHECKS=378246000	? TT=9.19	No data	UNSAT TT=64.219	UNSAT TT=48.241
csp/allsquaresUnsat/ normalized-squaresUnsat-19-19.xml	UNSAT TT=0.102	? TT=1.425	? TT=1.402	UNSAT TT=1489.26	UNSAT TT=1.835 CHECKS=1506	UNSAT TT=0.102 CHECKS=1506	UNSAT TT=1.422 ASSIGNMENTS=0	UNSAT TT=1.559 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=146.681 ASSIGNMENTS=101469 CHECKS=217456000	UNSAT TT=146.874 ASSIGNMENTS=101469 CHECKS=217456000	No data	No data	No data	UNSAT TT=152.378 ASSIGNMENTS=132277 CHECKS=269853000	UNSAT TT=105.22 ASSIGNMENTS=96427 CHECKS=147682000	? (exit code) TT=0.728	UNSAT TT=529.969 ASSIGNMENTS=363851 CHECKS=712207000	UNSAT TT=134.102 ASSIGNMENTS=101469 CHECKS=217456000	? TT=10.632	No data	UNSAT TT=43.34	UNSAT TT=41.562
csp/allsquaresUnsat/ normalized-squaresUnsat-20-20.xml	UNSAT TT=0.107	? TT=1.617	? TT=1.495	? (TO) TT=1800.02	UNSAT TT=2.077 CHECKS=1662	UNSAT TT=0.107 CHECKS=1662	UNSAT TT=1.547 ASSIGNMENTS=0	UNSAT TT=1.841 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=1362.46 ASSIGNMENTS=972280 CHECKS=1949310000	UNSAT TT=1016.42 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=1663.26 ASSIGNMENTS=1211670 CHECKS=2380190000	UNSAT TT=233.569 ASSIGNMENTS=158054 CHECKS=348657000	? (exit code) TT=0.739	UNSAT TT=1018.17 ASSIGNMENTS=588256 CHECKS=1099680000	UNSAT TT=1355.48 ASSIGNMENTS=972280 CHECKS=1949310000	? TT=14.071	No data	UNSAT TT=117.254	UNSAT TT=141.548
csp/allsquaresUnsat/ normalized-squaresUnsat-21-21.xml	UNSAT TT=0.13	? TT=1.757	? TT=1.695	? (TO) TT=1800.05	UNSAT TT=2.196 CHECKS=1806	UNSAT TT=0.13 CHECKS=1806	UNSAT TT=1.949 ASSIGNMENTS=0	UNSAT TT=1.617 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=1665.15 ASSIGNMENTS=0	UNSAT TT=1017.49 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.1	UNSAT TT=1438.28 ASSIGNMENTS=844124 CHECKS=1853250000	? (exit code) TT=0.44	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=17.748	No data	UNSAT TT=217.067	UNSAT TT=270.054
csp/allsquaresUnsat/ normalized-squaresUnsat-22-22.xml	UNSAT TT=0.146	? TT=1.828	? TT=1.82	? (TO) TT=1800.06	UNSAT TT=2.626 CHECKS=1978	UNSAT TT=0.146 CHECKS=1978	UNSAT TT=1.641 ASSIGNMENTS=0	UNSAT TT=2.198 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=1017.24 ASSIGNMENTS=0	UNSAT TT=1017.05 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.08	? (exit code) TT=0.77	? (TO) TT=1800.11	? (TO) TT=1800.1	? TT=21.811	No data	UNSAT TT=343.792	UNSAT TT=335.978
csp/allsquaresUnsat/ normalized-squaresUnsat-2-2.xml	UNSAT TT=0.006	? TT=0.593	? TT=0.553	UNSAT TT=0.026	UNSAT TT=0.01 CHECKS=53	UNSAT TT=0.008 CHECKS=53	UNSAT TT=0.506 ASSIGNMENTS=0	UNSAT TT=0.513 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=15	No data	No data	No data	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=15	? (exit code) TT=0.193	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=15	? TT=0.906	No data	UNSAT TT=0.488	UNSAT TT=0.504
csp/allsquaresUnsat/ normalized-squaresUnsat-23-23.xml	UNSAT TT=0.168	? TT=2.011	? TT=2.009	? (TO) TT=1800.04	UNSAT TT=2.701 CHECKS=2138	UNSAT TT=0.168 CHECKS=2138	UNSAT TT=1.689 ASSIGNMENTS=0	UNSAT TT=1.827 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=890.69 ASSIGNMENTS=0	UNSAT TT=1016.83 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.06	? (exit code) TT=0.807	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=26.041	No data	UNSAT TT=402.254	UNSAT TT=469.765
csp/allsquaresUnsat/ normalized-squaresUnsat-24-24.xml		? TT=2.515	? TT=2.276	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.14	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.07	? (exit code) TT=0.497	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=33.356	No data	? (TO) TT=1800.07	? (TO) TT=1800.02
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-25-25.xml	UNSAT TT=0.192	? TT=2.533	? TT=2.484	? (TO) TT=1800.07	UNSAT TT=3.294 CHECKS=2502	UNSAT TT=0.192 CHECKS=2502	UNSAT TT=2.044 ASSIGNMENTS=0	UNSAT TT=2.224 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=891.527 ASSIGNMENTS=0	UNSAT TT=1016.9 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.05	? (exit code) TT=0.796	? (TO) TT=1800.02	? (TO) TT=1800.05	? TT=40.292	No data	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/allsquaresUnsat/ normalized-squaresUnsat-26-26.xml		? TT=2.475	? TT=2.436	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.17	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.11	? (exit code) TT=1.073	? (TO) TT=1800	? (TO) TT=1800.02	? TT=49.053	No data	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-27-27.xml	UNSAT TT=0.256	? TT=2.292	? TT=2.583	? (TO) TT=1800.05	UNSAT TT=4.331 CHECKS=2918	UNSAT TT=0.256 CHECKS=2918	UNSAT TT=2.226 ASSIGNMENTS=0	UNSAT TT=2.106 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=9.804 ASSIGNMENTS=0	UNSAT TT=1017.87 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.01	? (exit code) TT=0.511	? (TO) TT=1800.06	? (TO) TT=1800.03	? TT=57.082	No data	? (TO) TT=1800.06	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-28-28.xml		? TT=2.179	? TT=2.216	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.15	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (exit code) TT=1.115	? (TO) TT=1800.05	? (TO) TT=1800.1	? TT=73.045	No data	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/allsquaresUnsat/ normalized-squaresUnsat-29-29.xml	UNSAT TT=0.313	? TT=1.998	? TT=1.923	? (TO) TT=1800.03	UNSAT TT=5.162 CHECKS=3366	UNSAT TT=0.313 CHECKS=3366	UNSAT TT=2.201 ASSIGNMENTS=0	UNSAT TT=2.43 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=9.919 ASSIGNMENTS=0	UNSAT TT=1017.56 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	? (exit code) TT=0.934	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=130.964	No data	? (TO) TT=1800.03	? (TO) TT=1800.07
csp/allsquaresUnsat/ normalized-squaresUnsat-30-30.xml	UNSAT TT=0.349	? TT=1.724	? TT=1.735	? (TO) TT=1800.03	UNSAT TT=5.732 CHECKS=3602	UNSAT TT=0.349 CHECKS=3602	UNSAT TT=2.453 ASSIGNMENTS=0	UNSAT TT=2.552 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=10.332 ASSIGNMENTS=0	UNSAT TT=1017.9 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.08	? (exit code) TT=0.508	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=453.483	No data	? (TO) TT=1800.05	? (TO) TT=1800.02
csp/allsquaresUnsat/ normalized-squaresUnsat-31-31.xml	UNSAT TT=0.383	? TT=1.773	? TT=1.881	? (TO) TT=1800.05	UNSAT TT=6.299 CHECKS=3846	UNSAT TT=0.383 CHECKS=3846	UNSAT TT=2.676 ASSIGNMENTS=0	UNSAT TT=2.767 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=10.099 ASSIGNMENTS=0	UNSAT TT=1018.17 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.07	? (TO) TT=1800.04	? (exit code) TT=0.964	? (TO) TT=1800.04	? (TO) TT=1800.05	? (MO) TT=97.302	No data	? (TO) TT=1800.12	? (TO) TT=1800.1
csp/allsquaresUnsat/ normalized-squaresUnsat-32-32.xml		? TT=1.948	? TT=1.825	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.03	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.08	? (TO) TT=1800.09	? (exit code) TT=1.182	? (TO) TT=1800.04	? (TO) TT=1800.11	? (MO) TT=91.645	No data	? (TO) TT=1800.09	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-33-33.xml		? TT=2.102	? TT=1.988	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.08	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.08	? (exit code) TT=0.541	? (TO) TT=1800.03	? (TO) TT=1800.07	? (MO) TT=112.026	No data	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/allsquaresUnsat/ normalized-squaresUnsat-3-3.xml	UNSAT TT=0.006	? TT=0.631	? TT=0.563	UNSAT TT=0.03	UNSAT TT=0.012 CHECKS=92	UNSAT TT=0.01 CHECKS=92	UNSAT TT=0.511 ASSIGNMENTS=0	UNSAT TT=0.503 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=22	No data	No data	No data	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=22	? (exit code) TT=0.186	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=22	? TT=0.979	No data	UNSAT TT=0.535	UNSAT TT=0.53
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-34-34.xml		? TT=2.128	? TT=2.046	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.11	? (exit code) TT=1.114	? (TO) TT=1800.04	? (TO) TT=1800.07	? (MO) TT=107.77	No data	? (TO) TT=1800.09	? (TO) TT=1800.02
csp/allsquaresUnsat/ normalized-squaresUnsat-35-35.xml	UNSAT TT=0.547	? TT=1.967	? TT=2.063	? (TO) TT=1800.1	UNSAT TT=7.996 CHECKS=4902	UNSAT TT=0.547 CHECKS=4902	UNSAT TT=2.703 ASSIGNMENTS=0	UNSAT TT=2.734 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=10.504 ASSIGNMENTS=0	UNSAT TT=1018.23 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.07	? (exit code) TT=1.068	? (TO) TT=1800.03	? (TO) TT=1800.11	? (MO) TT=101.483	No data	? (TO) TT=1800.22	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-36-36.xml	UNSAT TT=0.596	? TT=2.129	? TT=1.942	? (TO) TT=1800.07	UNSAT TT=8.625 CHECKS=5186	UNSAT TT=0.596 CHECKS=5186	UNSAT TT=2.892 ASSIGNMENTS=0	UNSAT TT=3.057 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=10.856 ASSIGNMENTS=0	UNSAT TT=1018.62 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.08	? (exit code) TT=0.635	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1802.14	No data	? (TO) TT=1800.13	? (TO) TT=1800.09
csp/allsquaresUnsat/ normalized-squaresUnsat-37-37.xml	UNSAT TT=0.641	? TT=1.975	? TT=2.107	? (TO) TT=1800.11	UNSAT TT=8.323 CHECKS=5478	UNSAT TT=0.641 CHECKS=5478	UNSAT TT=3.066 ASSIGNMENTS=0	UNSAT TT=3.41 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=10.728 ASSIGNMENTS=0	UNSAT TT=1018.24 ASSIGNMENTS=0	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.07	? (exit code) TT=1.36	? (TO) TT=1800.03	? (TO) TT=1800.04	? TT=400.357	No data	? (TO) TT=1800.32	? (TO) TT=1800.01
csp/allsquaresUnsat/ normalized-squaresUnsat-38-38.xml		? TT=1.945	? TT=1.966	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.04	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.08	? (exit code) TT=1.354	? (TO) TT=1800.11	? (TO) TT=1800.01	? TT=208.941	No data	? (MO) TT=59.215	? (TO) TT=1800.2
csp/allsquaresUnsat/ normalized-squaresUnsat-4-4.xml	UNSAT TT=0.006	? TT=0.61	? TT=0.6	UNSAT TT=0.032	UNSAT TT=0.028 CHECKS=120	UNSAT TT=0.01 CHECKS=120	UNSAT TT=0.551 ASSIGNMENTS=0	UNSAT TT=0.754 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=160	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=160	No data	No data	No data	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=160	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=160	? (exit code) TT=0.265	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=160	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=160	? TT=0.972	No data	UNSAT TT=0.668	UNSAT TT=0.66
csp/allsquaresUnsat/ normalized-squaresUnsat-5-5.xml	UNSAT TT=0.008	? TT=0.687	? TT=0.614	UNSAT TT=0.037	UNSAT TT=0.055 CHECKS=175	UNSAT TT=0.01 CHECKS=175	UNSAT TT=0.602 ASSIGNMENTS=0	UNSAT TT=0.598 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=266	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=266	No data	No data	No data	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=266	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=266	? (exit code) TT=0.284	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=266	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=266	? TT=1.531	No data	UNSAT TT=0.73	UNSAT TT=0.731
csp/allsquaresUnsat/ normalized-squaresUnsat-6-6.xml	UNSAT TT=0.01	? TT=0.655	? TT=0.749	UNSAT TT=0.043	UNSAT TT=0.124 CHECKS=219	UNSAT TT=0.013 CHECKS=219	UNSAT TT=0.7 ASSIGNMENTS=0	UNSAT TT=0.709 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=399	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=399	No data	No data	No data	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=399	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=399	? (exit code) TT=0.249	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=399	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=399	? TT=1.653	No data	UNSAT TT=0.846	UNSAT TT=0.863
csp/allsquaresUnsat/ normalized-squaresUnsat-7-7.xml	UNSAT TT=0.012	? TT=0.669	? TT=0.675	UNSAT TT=0.047	UNSAT TT=0.206 CHECKS=290	UNSAT TT=0.014 CHECKS=290	UNSAT TT=0.689 ASSIGNMENTS=0	UNSAT TT=0.703 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=563	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=563	No data	No data	No data	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=563	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=563	? (exit code) TT=0.38	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=563	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=563	? TT=1.795	No data	UNSAT TT=1.075	UNSAT TT=0.947
csp/allsquaresUnsat/ normalized-squaresUnsat-8-8.xml	UNSAT TT=0.017	? TT=0.76	? TT=0.711	UNSAT TT=0.06	UNSAT TT=0.259 CHECKS=350	UNSAT TT=0.018 CHECKS=350	UNSAT TT=0.764 ASSIGNMENTS=0	UNSAT TT=0.898 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=754	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=754	No data	No data	No data	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	? (exit code) TT=0.475	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	? TT=1.959	No data	UNSAT TT=0.981	UNSAT TT=0.965
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-9-9.xml	UNSAT TT=0.025	? TT=0.826	? TT=0.751	UNSAT TT=1.675	UNSAT TT=0.616 CHECKS=188089	UNSAT TT=0.199 CHECKS=141270	UNSAT TT=1.024 ASSIGNMENTS=0	UNSAT TT=0.986 ASSIGNMENTS=0	No data	No data	No data	UNSAT TT=0.036 ASSIGNMENTS=12 CHECKS=10492	UNSAT TT=0.035 ASSIGNMENTS=12 CHECKS=10492	No data	No data	No data	UNSAT TT=0.034 ASSIGNMENTS=67 CHECKS=40428	UNSAT TT=0.098 ASSIGNMENTS=709 CHECKS=234513	? (exit code) TT=0.325	UNSAT TT=0.047 ASSIGNMENTS=253 CHECKS=49485	UNSAT TT=0.025 ASSIGNMENTS=21 CHECKS=12542	? TT=2.305	No data	UNSAT TT=1.072	UNSAT TT=1.111
csp/bddLarge/ normalized-bdd-21-2713-15-79-10_ext.xml	UNSAT TT=20.161	UNSAT TT=75.449 CHECKS=3377 NODES=1579	? (MO) TT=1.737	? (problem) TT=540.272	? (TO) TT=1800.14	? (TO) TT=1800.18	UNSAT TT=502.74 ASSIGNMENTS=1017	UNSAT TT=932.526 ASSIGNMENTS=1413	UNSAT TT=104.103 CHECKS=96745200 NODES=2174	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=43.467 ASSIGNMENTS=1080 CHECKS=2744120	UNSAT TT=43.568 ASSIGNMENTS=1080 CHECKS=2744120	? (MO) TT=1764.19	? (MO) TT=1775.55	UNSAT TT=20.161 CHECKS=1905990	UNSAT TT=29.044 ASSIGNMENTS=953 CHECKS=2516650	UNSAT TT=138.93 ASSIGNMENTS=5088 CHECKS=11761200	? (MO) TT=9.6	UNSAT TT=31.676 ASSIGNMENTS=990 CHECKS=2587020	UNSAT TT=34.385 ASSIGNMENTS=1080 CHECKS=2744120	? TT=92.272	UNSAT TT=1.681 ASSIGNMENTS=2103 CHECKS=195944	? TT=82.751	? TT=77.592
csp/bddLarge/ normalized-bdd-21-2713-15-79-11_ext.xml	UNSAT TT=17.451	UNSAT TT=73.451 CHECKS=4068 NODES=1788	UNSAT TT=80.089 CHECKS=3913 NODES=1688	? (problem) TT=562.562	? (TO) TT=1800.22	? (TO) TT=1800.22	UNSAT TT=911.868 ASSIGNMENTS=1049	UNSAT TT=948.987 ASSIGNMENTS=1358	UNSAT TT=97.693 CHECKS=95507400 NODES=2241	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=49.223 ASSIGNMENTS=1051 CHECKS=3479530	UNSAT TT=46.629 ASSIGNMENTS=1051 CHECKS=3479530	? (MO) TT=1737.24	? (TO) TT=1800	UNSAT TT=17.451 CHECKS=2083980	UNSAT TT=38.9 ASSIGNMENTS=1045 CHECKS=3517360	UNSAT TT=130.019 ASSIGNMENTS=5016 CHECKS=11739500	? (MO) TT=7.4	UNSAT TT=39.778 ASSIGNMENTS=1092 CHECKS=3604380	UNSAT TT=37.212 ASSIGNMENTS=1051 CHECKS=3479530	? TT=98.06	UNSAT TT=1.684 ASSIGNMENTS=2174 CHECKS=182016	? TT=278.531	? TT=175.473
csp/bddLarge/ normalized-bdd-21-2713-15-79-12_ext.xml	UNSAT TT=23.58	UNSAT TT=76.401 CHECKS=4420 NODES=1946	UNSAT TT=76.343 CHECKS=3818 NODES=1663	? (problem) TT=530.24	? (TO) TT=1800.19	? (TO) TT=1800.18	UNSAT TT=597.324 ASSIGNMENTS=1096	UNSAT TT=918.954 ASSIGNMENTS=1376	UNSAT TT=99.969 CHECKS=101402000 NODES=2194	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=47.555 ASSIGNMENTS=1020 CHECKS=3227590	UNSAT TT=44.215 ASSIGNMENTS=1020 CHECKS=3227590	? (MO) TT=1792.49	? (MO) TT=1749.75	UNSAT TT=23.58 CHECKS=2283190	UNSAT TT=41.345 ASSIGNMENTS=1099 CHECKS=3385670	UNSAT TT=133.813 ASSIGNMENTS=5056 CHECKS=11798900	? (MO) TT=7.58	UNSAT TT=40.519 ASSIGNMENTS=1044 CHECKS=3212260	UNSAT TT=38.918 ASSIGNMENTS=1020 CHECKS=3227590	? TT=87.828	UNSAT TT=2.379 ASSIGNMENTS=2380 CHECKS=388061	? TT=173.51	? TT=171.019
csp/bddLarge/ normalized-bdd-21-2713-15-79-13_ext.xml	SAT TT=1.829	SAT TT=10.945 CHECKS=2800 NODES=84	SAT TT=13.537 CHECKS=2784 NODES=63	? (problem) TT=528.163	SAT TT=1429.09 CHECKS=3023260	SAT TT=154.394 CHECKS=223124	SAT TT=378.668 ASSIGNMENTS=1008	SAT TT=112.528 ASSIGNMENTS=264	SAT TT=129.181 CHECKS=127266000 NODES=3166	SAT TT=173.695 CHECKS=252842000 NODES=4656	SAT TT=4.292 CHECKS=865242 NODES=11	SAT TT=33.92 ASSIGNMENTS=996 CHECKS=2326930	SAT TT=36.259 ASSIGNMENTS=996 CHECKS=2326930	? (TO) TT=1800.09	? (MO) TT=1740.44	SAT TT=4.989 CHECKS=560173	SAT TT=25.485 ASSIGNMENTS=1011 CHECKS=2348490	SAT TT=126.027 ASSIGNMENTS=4913 CHECKS=11824300	? (MO) TT=7.67	SAT TT=1.829 ASSIGNMENTS=23 CHECKS=64014	SAT TT=25.527 ASSIGNMENTS=996 CHECKS=2326930	? TT=88.127	SAT TT=1.812 ASSIGNMENTS=2137 CHECKS=156346	? TT=118.121	? TT=108.251
csp/bddLarge/ normalized-bdd-21-2713-15-79-14_ext.xml	UNSAT TT=20.182	UNSAT TT=76.442 CHECKS=4337 NODES=1797	UNSAT TT=78.339 CHECKS=4293 NODES=1797	? (problem) TT=544.606	? (TO) TT=1800.18	? (TO) TT=1800.22	UNSAT TT=553.099 ASSIGNMENTS=1063	UNSAT TT=1088.96 ASSIGNMENTS=1378	UNSAT TT=96.332 CHECKS=94786000 NODES=2179	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=40.446 ASSIGNMENTS=1064 CHECKS=2658980	UNSAT TT=40.31 ASSIGNMENTS=1064 CHECKS=2658980	? (MO) TT=1730.2	? (TO) TT=1800.07	UNSAT TT=20.182 CHECKS=2077040	UNSAT TT=29.608 ASSIGNMENTS=1045 CHECKS=2543630	UNSAT TT=118.182 ASSIGNMENTS=4753 CHECKS=11415200	? (MO) TT=7.41	UNSAT TT=28.473 ASSIGNMENTS=1036 CHECKS=2370010	UNSAT TT=29.492 ASSIGNMENTS=1064 CHECKS=2658980	? TT=93.322	UNSAT TT=1.807 ASSIGNMENTS=2180 CHECKS=231236	? TT=156.024	? TT=149.998
csp/bddLarge/ normalized-bdd-21-2713-15-79-15_ext.xml	UNSAT TT=18.489	UNSAT TT=75.053 CHECKS=3364 NODES=1552	UNSAT TT=89.695 CHECKS=3657 NODES=1544	? (problem) TT=526.969	? (TO) TT=1800.16	? (TO) TT=1800.16	UNSAT TT=418.5 ASSIGNMENTS=949	UNSAT TT=1090.46 ASSIGNMENTS=1408	UNSAT TT=95.81 CHECKS=90291000 NODES=2275	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=32.96 ASSIGNMENTS=972 CHECKS=2279050	UNSAT TT=34.558 ASSIGNMENTS=972 CHECKS=2279050	? (MO) TT=1795.53	? (MO) TT=1699.29	UNSAT TT=18.489 CHECKS=1939770	UNSAT TT=27.632 ASSIGNMENTS=950 CHECKS=2297690	UNSAT TT=129.538 ASSIGNMENTS=4968 CHECKS=11733700	? (MO) TT=7.59	UNSAT TT=28.547 ASSIGNMENTS=988 CHECKS=2377590	UNSAT TT=26.737 ASSIGNMENTS=972 CHECKS=2279050	? TT=95.974	UNSAT TT=1.578 ASSIGNMENTS=2075 CHECKS=144580	? TT=151.406	? TT=135.077
csp/bddLarge/ normalized-bdd-21-2713-15-79-16_ext.xml	UNSAT TT=20.834	UNSAT TT=75.513 CHECKS=2848 NODES=1647	UNSAT TT=87.346 CHECKS=2839 NODES=1666	? (problem) TT=551.773	? (TO) TT=1800.22	? (TO) TT=1800.14	UNSAT TT=517.709 ASSIGNMENTS=976	UNSAT TT=987.725 ASSIGNMENTS=1403	UNSAT TT=103.609 CHECKS=95101700 NODES=2251	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=39.029 ASSIGNMENTS=993 CHECKS=2558580	UNSAT TT=40.195 ASSIGNMENTS=993 CHECKS=2558580	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=20.834 CHECKS=1878100	UNSAT TT=30.634 ASSIGNMENTS=996 CHECKS=2564460	UNSAT TT=133.136 ASSIGNMENTS=5002 CHECKS=11662400	? (MO) TT=7.6	UNSAT TT=29.869 ASSIGNMENTS=1044 CHECKS=2653780	UNSAT TT=30.352 ASSIGNMENTS=993 CHECKS=2558580	? TT=87.929	UNSAT TT=2.027 ASSIGNMENTS=2094 CHECKS=258122	? TT=134.739	? TT=140.713
csp/bddLarge/ normalized-bdd-21-2713-15-79-17_ext.xml	UNSAT TT=17.901	UNSAT TT=77.791 CHECKS=2796 NODES=1534	UNSAT TT=78.278 CHECKS=2833 NODES=1546	? (problem) TT=535.58	? (TO) TT=1800.16	? (TO) TT=1800.15	UNSAT TT=665.002 ASSIGNMENTS=930	UNSAT TT=1087.51 ASSIGNMENTS=1353	UNSAT TT=126.499 CHECKS=121332000 NODES=3085	? (TO) TT=1800.01	? (TO) TT=1800.09	UNSAT TT=42.007 ASSIGNMENTS=918 CHECKS=2666600	UNSAT TT=38.352 ASSIGNMENTS=918 CHECKS=2666600	? (MO) TT=1774.34	? (MO) TT=1743.5	UNSAT TT=17.901 CHECKS=1868550	UNSAT TT=29.664 ASSIGNMENTS=936 CHECKS=2712710	UNSAT TT=134.993 ASSIGNMENTS=4888 CHECKS=11483900	? (MO) TT=7.01	UNSAT TT=33.097 ASSIGNMENTS=972 CHECKS=2785700	UNSAT TT=30.193 ASSIGNMENTS=918 CHECKS=2666600	? TT=92.833	UNSAT TT=1.544 ASSIGNMENTS=2103 CHECKS=147952	? TT=147.356	? TT=141.49
csp/bddLarge/ normalized-bdd-21-2713-15-79-18_ext.xml	UNSAT TT=17.426	UNSAT TT=73.469 CHECKS=3539 NODES=1698	UNSAT TT=80.459 CHECKS=4097 NODES=1805	? (problem) TT=363.737	? (TO) TT=1800.18	? (TO) TT=1800.17	UNSAT TT=501.132 ASSIGNMENTS=1001	UNSAT TT=911.154 ASSIGNMENTS=1349	UNSAT TT=100.868 CHECKS=90786100 NODES=2209	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=35.383 ASSIGNMENTS=931 CHECKS=2229850	UNSAT TT=36.148 ASSIGNMENTS=931 CHECKS=2229850	? (MO) TT=1786.03	? (TO) TT=1800	UNSAT TT=17.426 CHECKS=1998940	UNSAT TT=28.616 ASSIGNMENTS=997 CHECKS=2507850	UNSAT TT=143.498 ASSIGNMENTS=5280 CHECKS=12357500	? (MO) TT=7.4	UNSAT TT=29.391 ASSIGNMENTS=1048 CHECKS=2608780	UNSAT TT=25.151 ASSIGNMENTS=931 CHECKS=2229850	? TT=91.204	UNSAT TT=1.715 ASSIGNMENTS=2107 CHECKS=146214	? TT=112.317	? TT=107.073
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddLarge/ normalized-bdd-21-2713-15-79-19_ext.xml	SAT TT=12.706	SAT TT=24.235 CHECKS=3185 NODES=321	SAT TT=28.389 CHECKS=3237 NODES=317	? (problem) TT=521.08	SAT TT=562.963 CHECKS=1050710	SAT TT=941.565 CHECKS=1870630	SAT TT=393.514 ASSIGNMENTS=876	SAT TT=1001.32 ASSIGNMENTS=1236	SAT TT=119.394 CHECKS=120110000 NODES=2190	SAT TT=13.143 CHECKS=17534700 NODES=318	SAT TT=39.935 CHECKS=66394700 NODES=1169	SAT TT=36.854 ASSIGNMENTS=884 CHECKS=2219740	SAT TT=36.295 ASSIGNMENTS=884 CHECKS=2219740	? (TO) TT=1800.01	? (MO) TT=1766.44	SAT TT=12.706 CHECKS=1298280	SAT TT=26.447 ASSIGNMENTS=905 CHECKS=2287370	SAT TT=143.58 ASSIGNMENTS=5223 CHECKS=12342200	? (MO) TT=6.89	SAT TT=31.06 ASSIGNMENTS=972 CHECKS=2451620	SAT TT=27.76 ASSIGNMENTS=884 CHECKS=2219740	? TT=95.267	SAT TT=1.799 ASSIGNMENTS=2053 CHECKS=183799	? TT=143.301	? TT=151.378
csp/bddLarge/ normalized-bdd-21-2713-15-79-1_ext.xml	UNSAT TT=21.264	UNSAT TT=79.051 CHECKS=3188 NODES=1542	UNSAT TT=91.595 CHECKS=3075 NODES=1592	? (problem) TT=554.699	? (TO) TT=1800.13	? (TO) TT=1800.15	UNSAT TT=681.082 ASSIGNMENTS=988	UNSAT TT=986.172 ASSIGNMENTS=1474	UNSAT TT=107.558 CHECKS=98932400 NODES=2240	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=40.515 ASSIGNMENTS=975 CHECKS=2814450	UNSAT TT=42.407 ASSIGNMENTS=975 CHECKS=2814450	? (MO) TT=1708.4	? (TO) TT=1800.02	UNSAT TT=21.264 CHECKS=1971060	UNSAT TT=33.669 ASSIGNMENTS=985 CHECKS=2835870	UNSAT TT=140.165 ASSIGNMENTS=4787 CHECKS=11448900	? (MO) TT=7.18	UNSAT TT=34.457 ASSIGNMENTS=1095 CHECKS=3045100	UNSAT TT=33.91 ASSIGNMENTS=975 CHECKS=2814450	? TT=97.517	UNSAT TT=1.606 ASSIGNMENTS=2120 CHECKS=162036	? TT=151.893	? TT=162.59
csp/bddLarge/ normalized-bdd-21-2713-15-79-20_ext.xml	UNSAT TT=20.718	UNSAT TT=88.17 CHECKS=3545 NODES=1668	UNSAT TT=85.059 CHECKS=3548 NODES=1651	? (problem) TT=557.04	? (TO) TT=1800.18	? (TO) TT=1800.15	UNSAT TT=541.651 ASSIGNMENTS=1033	UNSAT TT=1151.26 ASSIGNMENTS=1430	UNSAT TT=105.423 CHECKS=102038000 NODES=2222	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=35.547 ASSIGNMENTS=1042 CHECKS=2604580	UNSAT TT=37.139 ASSIGNMENTS=1042 CHECKS=2604580	? (MO) TT=1753.71	? (MO) TT=1773.83	UNSAT TT=20.718 CHECKS=2070290	UNSAT TT=27.151 ASSIGNMENTS=1041 CHECKS=2600350	UNSAT TT=120.811 ASSIGNMENTS=4747 CHECKS=11343200	? (MO) TT=8.2	UNSAT TT=27.744 ASSIGNMENTS=1078 CHECKS=2664880	UNSAT TT=29.358 ASSIGNMENTS=1042 CHECKS=2604580	? TT=85.767	UNSAT TT=1.738 ASSIGNMENTS=2165 CHECKS=182874	? TT=199.88	? TT=194.024
csp/bddLarge/ normalized-bdd-21-2713-15-79-21_ext.xml	UNSAT TT=18.996	UNSAT TT=70.61 CHECKS=3717 NODES=1633	UNSAT TT=72.345 CHECKS=3676 NODES=1644	? (problem) TT=523.827	? (TO) TT=1800.2	? (TO) TT=1800.15	UNSAT TT=629.111 ASSIGNMENTS=998	UNSAT TT=1171.35 ASSIGNMENTS=1513	UNSAT TT=127.925 CHECKS=132136000 NODES=3066	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=38.647 ASSIGNMENTS=991 CHECKS=2586350	UNSAT TT=36.693 ASSIGNMENTS=991 CHECKS=2586350	? (MO) TT=1707.37	? (TO) TT=1800.05	UNSAT TT=18.996 CHECKS=2045950	UNSAT TT=32.226 ASSIGNMENTS=1026 CHECKS=2612970	UNSAT TT=128.656 ASSIGNMENTS=4740 CHECKS=11184900	? (MO) TT=7.41	UNSAT TT=26.622 ASSIGNMENTS=997 CHECKS=2244880	UNSAT TT=30.417 ASSIGNMENTS=991 CHECKS=2586350	? TT=107.501	UNSAT TT=1.98 ASSIGNMENTS=2248 CHECKS=238372	? TT=169.887	? TT=160.315
csp/bddLarge/ normalized-bdd-21-2713-15-79-22_ext.xml	SAT TT=1.674	SAT TT=20.597 CHECKS=2847 NODES=176	SAT TT=8.439 CHECKS=2713 NODES=0	? (problem) TT=523.495	SAT TT=1014.21 CHECKS=2266570	SAT TT=187.636 CHECKS=359718	SAT TT=12.879 ASSIGNMENTS=12	SAT TT=12.889 ASSIGNMENTS=16	SAT TT=29.545 CHECKS=141102 NODES=21	SAT TT=52.193 CHECKS=70578300 NODES=1297	SAT TT=176.532 CHECKS=84183200 NODES=1476	SAT TT=1.674 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.674 ASSIGNMENTS=11 CHECKS=40695	? (TO) TT=1800.01	? (MO) TT=1758.46	SAT TT=7.559 CHECKS=777147	SAT TT=1.676 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.785 ASSIGNMENTS=12 CHECKS=40695	? (MO) TT=6.81	SAT TT=1.706 ASSIGNMENTS=15 CHECKS=40695	SAT TT=1.675 ASSIGNMENTS=11 CHECKS=40695	? TT=104.144	SAT TT=0.38 ASSIGNMENTS=21 CHECKS=6883	? TT=168.226	? TT=170.135
csp/bddLarge/ normalized-bdd-21-2713-15-79-23_ext.xml	UNSAT TT=22.809	UNSAT TT=74.582 CHECKS=4326 NODES=1854	UNSAT TT=76.905 CHECKS=4041 NODES=1801	? (problem) TT=572.871	? (TO) TT=1800.17	? (TO) TT=1800.15	UNSAT TT=1093.63 ASSIGNMENTS=1162	UNSAT TT=1028.95 ASSIGNMENTS=1505	UNSAT TT=97.584 CHECKS=95862300 NODES=2202	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=44.808 ASSIGNMENTS=1124 CHECKS=3237550	UNSAT TT=48.073 ASSIGNMENTS=1124 CHECKS=3237550	? (MO) TT=1751.48	? (TO) TT=1800.02	UNSAT TT=22.809 CHECKS=2331460	UNSAT TT=44.149 ASSIGNMENTS=1235 CHECKS=3864730	UNSAT TT=138.79 ASSIGNMENTS=5229 CHECKS=12165000	? (MO) TT=7.2	UNSAT TT=34.917 ASSIGNMENTS=1113 CHECKS=3053670	UNSAT TT=39.371 ASSIGNMENTS=1124 CHECKS=3237550	? TT=94.747	UNSAT TT=2.113 ASSIGNMENTS=2360 CHECKS=280553	? TT=141.156	? TT=129.483
csp/bddLarge/ normalized-bdd-21-2713-15-79-24_ext.xml	SAT TT=1.521	SAT TT=63.096 CHECKS=4879 NODES=1171	SAT TT=7.305 CHECKS=2713 NODES=0	? (problem) TT=560.595	SAT TT=184.045 CHECKS=340856	? (TO) TT=1800.15	SAT TT=14.671 ASSIGNMENTS=11	SAT TT=13.35 ASSIGNMENTS=12	SAT TT=29.266 CHECKS=260494 NODES=21	SAT TT=207.989 CHECKS=367836000 NODES=6774	SAT TT=330.506 CHECKS=71950900 NODES=1247	SAT TT=1.64 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.654 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=1794.2	? (MO) TT=1765.67	SAT TT=7.031 CHECKS=700049	SAT TT=1.644 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.661 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=7.88	SAT TT=1.567 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.521 ASSIGNMENTS=10 CHECKS=40695	? TT=93.055	SAT TT=0.386 ASSIGNMENTS=21 CHECKS=5545	? TT=132.094	? TT=124.069
csp/bddLarge/ normalized-bdd-21-2713-15-79-25_ext.xml	UNSAT TT=21.108	UNSAT TT=81.523 CHECKS=1797 NODES=1652	UNSAT TT=96.102 CHECKS=1492 NODES=1642	? (problem) TT=571.979	? (TO) TT=1800.19	? (TO) TT=1800.2	UNSAT TT=421.713 ASSIGNMENTS=1085	UNSAT TT=931.27 ASSIGNMENTS=1341	UNSAT TT=97.406 CHECKS=93518300 NODES=2214	? (TO) TT=1800	? (TO) TT=1800.01	UNSAT TT=40.802 ASSIGNMENTS=1057 CHECKS=2495840	UNSAT TT=38.952 ASSIGNMENTS=1057 CHECKS=2495840	? (MO) TT=1797.16	? (TO) TT=1800.09	UNSAT TT=21.108 CHECKS=1966000	UNSAT TT=31.174 ASSIGNMENTS=1057 CHECKS=2539990	UNSAT TT=138.226 ASSIGNMENTS=4779 CHECKS=11388300	? (MO) TT=7.4	UNSAT TT=32.27 ASSIGNMENTS=1140 CHECKS=2708360	UNSAT TT=29.836 ASSIGNMENTS=1057 CHECKS=2495840	? TT=88.911	UNSAT TT=2.156 ASSIGNMENTS=2213 CHECKS=297305	? TT=160.342	? TT=156.877
csp/bddLarge/ normalized-bdd-21-2713-15-79-26_ext.xml	UNSAT TT=23.759	UNSAT TT=98.128 CHECKS=1368 NODES=1693	UNSAT TT=104.274 CHECKS=1370 NODES=1683	? (problem) TT=533.471	? (TO) TT=1800.22	? (TO) TT=1800.18	UNSAT TT=602.975 ASSIGNMENTS=956	UNSAT TT=1202.17 ASSIGNMENTS=1409	UNSAT TT=107.385 CHECKS=101914000 NODES=2214	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=42.613 ASSIGNMENTS=979 CHECKS=2764020	UNSAT TT=42.652 ASSIGNMENTS=979 CHECKS=2764020	? (MO) TT=1769.31	? (MO) TT=1771.59	UNSAT TT=23.759 CHECKS=2038140	UNSAT TT=31.94 ASSIGNMENTS=939 CHECKS=2658320	UNSAT TT=131.122 ASSIGNMENTS=4930 CHECKS=11677200	? (MO) TT=7.39	UNSAT TT=33.012 ASSIGNMENTS=999 CHECKS=2767690	UNSAT TT=33.678 ASSIGNMENTS=979 CHECKS=2764020	? TT=93.217	UNSAT TT=1.691 ASSIGNMENTS=2097 CHECKS=177503	? TT=167.076	? TT=166.835
csp/bddLarge/ normalized-bdd-21-2713-15-79-27_ext.xml	UNSAT TT=21.921	UNSAT TT=82.754 CHECKS=2387 NODES=1534	UNSAT TT=87.021 CHECKS=2342 NODES=1537	? (problem) TT=531.873	? (TO) TT=1800.24	? (TO) TT=1800.15	UNSAT TT=330.266 ASSIGNMENTS=973	UNSAT TT=1257.88 ASSIGNMENTS=1490	UNSAT TT=130.771 CHECKS=127027000 NODES=3086	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=35.764 ASSIGNMENTS=944 CHECKS=2194040	UNSAT TT=36.166 ASSIGNMENTS=944 CHECKS=2194040	? (TO) TT=1800.05	? (MO) TT=1672.59	UNSAT TT=21.921 CHECKS=1926410	UNSAT TT=27.884 ASSIGNMENTS=976 CHECKS=2287120	UNSAT TT=144.546 ASSIGNMENTS=5284 CHECKS=12327000	? (MO) TT=7.38	UNSAT TT=30.34 ASSIGNMENTS=1012 CHECKS=2360410	UNSAT TT=27.207 ASSIGNMENTS=944 CHECKS=2194040	? TT=90.256	UNSAT TT=1.77 ASSIGNMENTS=2113 CHECKS=227342	? TT=126.605	? TT=134.017
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddLarge/ normalized-bdd-21-2713-15-79-28_ext.xml	UNSAT TT=20.517	UNSAT TT=77.034 CHECKS=4120 NODES=1576	UNSAT TT=82.767 CHECKS=4052 NODES=1582	? (problem) TT=531.038	? (TO) TT=1800.16	? (TO) TT=1800.22	UNSAT TT=413.635 ASSIGNMENTS=1004	UNSAT TT=1060.19 ASSIGNMENTS=1306	UNSAT TT=126.338 CHECKS=135596000 NODES=3184	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=35.451 ASSIGNMENTS=953 CHECKS=2253460	UNSAT TT=34.492 ASSIGNMENTS=953 CHECKS=2253460	? (TO) TT=1800	? (MO) TT=1787.75	UNSAT TT=20.517 CHECKS=2042390	UNSAT TT=26.304 ASSIGNMENTS=959 CHECKS=2307450	UNSAT TT=118.932 ASSIGNMENTS=4754 CHECKS=11379900	? (MO) TT=8.94	UNSAT TT=29.614 ASSIGNMENTS=1037 CHECKS=2460350	UNSAT TT=28.019 ASSIGNMENTS=953 CHECKS=2253460	? TT=97.051	UNSAT TT=1.818 ASSIGNMENTS=2236 CHECKS=223828	? TT=149.407	? TT=149.912
csp/bddLarge/ normalized-bdd-21-2713-15-79-29_ext.xml	UNSAT TT=19.765	UNSAT TT=80.187 CHECKS=2747 NODES=1642	UNSAT TT=84.888 CHECKS=2547 NODES=1654	? (problem) TT=564.747	? (TO) TT=1800.22	? (TO) TT=1800.13	UNSAT TT=820.25 ASSIGNMENTS=1031	UNSAT TT=1099.31 ASSIGNMENTS=1459	UNSAT TT=119.048 CHECKS=124596000 NODES=3110	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=49.585 ASSIGNMENTS=1137 CHECKS=3521360	UNSAT TT=49.579 ASSIGNMENTS=1137 CHECKS=3521360	? (TO) TT=1800.02	? (MO) TT=1677	UNSAT TT=19.765 CHECKS=2134890	UNSAT TT=39.881 ASSIGNMENTS=1137 CHECKS=3490600	UNSAT TT=133.568 ASSIGNMENTS=4952 CHECKS=11626300	? (MO) TT=7.4	UNSAT TT=39.112 ASSIGNMENTS=1140 CHECKS=3542300	UNSAT TT=40.714 ASSIGNMENTS=1137 CHECKS=3521360	? TT=91.676	UNSAT TT=1.833 ASSIGNMENTS=2178 CHECKS=178302	? TT=84.678	? TT=85.312
csp/bddLarge/ normalized-bdd-21-2713-15-79-2_ext.xml	UNSAT TT=21.554	UNSAT TT=89.376 CHECKS=1339 NODES=1571	UNSAT TT=104.163 CHECKS=1345 NODES=1666	? (problem) TT=570.639	? (TO) TT=1800.18	? (TO) TT=1800.17	UNSAT TT=442.809 ASSIGNMENTS=962	UNSAT TT=1194.14 ASSIGNMENTS=1509	UNSAT TT=125.819 CHECKS=133972000 NODES=3131	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=37.628 ASSIGNMENTS=963 CHECKS=2328100	UNSAT TT=37.107 ASSIGNMENTS=963 CHECKS=2328100	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=21.554 CHECKS=1938450	UNSAT TT=29.372 ASSIGNMENTS=962 CHECKS=2328390	UNSAT TT=138.306 ASSIGNMENTS=4973 CHECKS=11741900	? (MO) TT=7.29	UNSAT TT=29.98 ASSIGNMENTS=1034 CHECKS=2295360	UNSAT TT=29.067 ASSIGNMENTS=963 CHECKS=2328100	? TT=90.104	UNSAT TT=1.831 ASSIGNMENTS=2103 CHECKS=202244	? TT=147.454	? TT=148.083
csp/bddLarge/ normalized-bdd-21-2713-15-79-30_ext.xml	UNSAT TT=21.331	UNSAT TT=83.927 CHECKS=2535 NODES=1457	UNSAT TT=96.291 CHECKS=3024 NODES=1471	? (problem) TT=560.038	? (TO) TT=1800.15	? (TO) TT=1800.2	UNSAT TT=225.84 ASSIGNMENTS=914	UNSAT TT=903.81 ASSIGNMENTS=1439	UNSAT TT=100.898 CHECKS=94215000 NODES=2171	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=34.278 ASSIGNMENTS=962 CHECKS=2120180	UNSAT TT=34.163 ASSIGNMENTS=962 CHECKS=2120180	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=21.331 CHECKS=1854620	UNSAT TT=26.104 ASSIGNMENTS=937 CHECKS=2167260	UNSAT TT=120.832 ASSIGNMENTS=4961 CHECKS=11627100	? (MO) TT=6.75	UNSAT TT=26.655 ASSIGNMENTS=992 CHECKS=2235430	UNSAT TT=27.932 ASSIGNMENTS=962 CHECKS=2120180	? TT=91.612	UNSAT TT=1.564 ASSIGNMENTS=2076 CHECKS=141327	? TT=144.477	? TT=149.962
csp/bddLarge/ normalized-bdd-21-2713-15-79-31_ext.xml	SAT TT=1.416	SAT TT=25.094 CHECKS=2948 NODES=295	SAT TT=7.568 CHECKS=2713 NODES=0	? (problem) TT=550.534	SAT TT=835.331 CHECKS=1404870	SAT TT=78.225 CHECKS=96014	SAT TT=14.484 ASSIGNMENTS=12	SAT TT=14.192 ASSIGNMENTS=13	SAT TT=29.282 CHECKS=219837 NODES=21	SAT TT=47.308 CHECKS=62951700 NODES=1156	SAT TT=171.452 CHECKS=266278000 NODES=4392	SAT TT=1.518 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.552 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=1775.42	? (TO) TT=1800.04	SAT TT=10.77 CHECKS=960413	SAT TT=1.416 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.521 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=7.6	SAT TT=1.512 ASSIGNMENTS=12 CHECKS=40695	SAT TT=1.519 ASSIGNMENTS=11 CHECKS=40695	? TT=95.87	SAT TT=0.378 ASSIGNMENTS=21 CHECKS=9428	? TT=139.997	? TT=151.922
csp/bddLarge/ normalized-bdd-21-2713-15-79-32_ext.xml	SAT TT=3.027	SAT TT=11.171 CHECKS=2856 NODES=71	SAT TT=17.687 CHECKS=2931 NODES=136	? (problem) TT=557.038	SAT TT=730.293 CHECKS=1490360	SAT TT=82.244 CHECKS=73361	SAT TT=626.32 ASSIGNMENTS=924	SAT TT=402.452 ASSIGNMENTS=636	SAT TT=116.036 CHECKS=118115000 NODES=2203	SAT TT=156.758 CHECKS=229957000 NODES=4233	SAT TT=5.284 CHECKS=954016 NODES=12	SAT TT=36.966 ASSIGNMENTS=836 CHECKS=2338640	SAT TT=34.601 ASSIGNMENTS=836 CHECKS=2338640	? (MO) TT=1684.51	? (MO) TT=1764.72	SAT TT=3.027 CHECKS=270372	SAT TT=27.435 ASSIGNMENTS=841 CHECKS=2364290	SAT TT=128.792 ASSIGNMENTS=4840 CHECKS=11519000	? (MO) TT=7.2	SAT TT=25.547 ASSIGNMENTS=813 CHECKS=2211900	SAT TT=27.928 ASSIGNMENTS=836 CHECKS=2338640	? TT=90.115	SAT TT=1.888 ASSIGNMENTS=2046 CHECKS=250096	? TT=151.479	? TT=136.284
csp/bddLarge/ normalized-bdd-21-2713-15-79-33_ext.xml	UNSAT TT=22.624	UNSAT TT=81.111 CHECKS=3946 NODES=1895	UNSAT TT=86.823 CHECKS=4783 NODES=2058	? (problem) TT=524.143	? (TO) TT=1800.17	? (TO) TT=1800.13	UNSAT TT=340.465 ASSIGNMENTS=1126	UNSAT TT=1023.77 ASSIGNMENTS=1344	UNSAT TT=97.739 CHECKS=95900300 NODES=2183	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=33.247 ASSIGNMENTS=970 CHECKS=2060490	UNSAT TT=34.564 ASSIGNMENTS=970 CHECKS=2060490	? (MO) TT=1761.8	? (MO) TT=1704.85	UNSAT TT=22.624 CHECKS=2236630	UNSAT TT=28.275 ASSIGNMENTS=1096 CHECKS=2374740	UNSAT TT=134.257 ASSIGNMENTS=4760 CHECKS=11402500	? (MO) TT=7.1	UNSAT TT=30.053 ASSIGNMENTS=1150 CHECKS=2472890	UNSAT TT=25.261 ASSIGNMENTS=970 CHECKS=2060490	? TT=90.335	UNSAT TT=2.036 ASSIGNMENTS=2238 CHECKS=299933	? TT=181.85	? TT=173.487
csp/bddLarge/ normalized-bdd-21-2713-15-79-34_ext.xml	SAT TT=2.241	SAT TT=67.185 CHECKS=4695 NODES=1123	SAT TT=68.939 CHECKS=4700 NODES=1124	? (problem) TT=517.224	? (TO) TT=1800.18	SAT TT=265.753 CHECKS=474798	SAT TT=609.566 ASSIGNMENTS=1066	SAT TT=946.836 ASSIGNMENTS=1070	SAT TT=95.502 CHECKS=92391700 NODES=2211	SAT TT=64.401 CHECKS=93727100 NODES=1722	SAT TT=783.315 CHECKS=1057450000 NODES=17108	SAT TT=48.646 ASSIGNMENTS=1105 CHECKS=3179260	SAT TT=48.076 ASSIGNMENTS=1105 CHECKS=3179260	? (MO) TT=1705.64	? (TO) TT=1800	SAT TT=13.906 CHECKS=1340990	SAT TT=36.212 ASSIGNMENTS=1069 CHECKS=3029320	SAT TT=137.616 ASSIGNMENTS=4952 CHECKS=11539100	? (MO) TT=6.91	SAT TT=2.241 ASSIGNMENTS=23 CHECKS=62038	SAT TT=38.703 ASSIGNMENTS=1105 CHECKS=3179260	? TT=90.337	SAT TT=1.93 ASSIGNMENTS=2218 CHECKS=198321	? TT=185.216	? TT=175.483
csp/bddLarge/ normalized-bdd-21-2713-15-79-35_ext.xml	SAT TT=1.302	SAT TT=69.451 CHECKS=5172 NODES=1378	SAT TT=74.186 CHECKS=4964 NODES=1347	? (problem) TT=527.731	SAT TT=631.137 CHECKS=1280510	SAT TT=675.649 CHECKS=1275640	SAT TT=553.814 ASSIGNMENTS=954	SAT TT=556.58 ASSIGNMENTS=868	SAT TT=96.699 CHECKS=94045200 NODES=2201	SAT TT=147.74 CHECKS=260319000 NODES=4793	? (TO) TT=1800.09	SAT TT=42.673 ASSIGNMENTS=996 CHECKS=2734450	SAT TT=44.302 ASSIGNMENTS=996 CHECKS=2734450	? (TO) TT=1800.02	? (MO) TT=1796.56	SAT TT=1.302 CHECKS=87052	SAT TT=33.955 ASSIGNMENTS=964 CHECKS=2680310	SAT TT=133.788 ASSIGNMENTS=5065 CHECKS=11840400	? (MO) TT=7.5	SAT TT=33.097 ASSIGNMENTS=997 CHECKS=2740220	SAT TT=34.676 ASSIGNMENTS=996 CHECKS=2734450	? TT=87.471	SAT TT=1.681 ASSIGNMENTS=2096 CHECKS=205316	? TT=141.829	? TT=141.975
csp/bddLarge/ normalized-bdd-21-2713-15-79-3_ext.xml	UNSAT TT=20.884	UNSAT TT=71.732 CHECKS=3499 NODES=1584	UNSAT TT=87.981 CHECKS=3032 NODES=1500	? (problem) TT=515.502	? (TO) TT=1800.21	? (TO) TT=1800.16	UNSAT TT=373.027 ASSIGNMENTS=945	UNSAT TT=1136.28 ASSIGNMENTS=1415	UNSAT TT=99.899 CHECKS=99449700 NODES=2183	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=35.265 ASSIGNMENTS=923 CHECKS=2101300	UNSAT TT=32.607 ASSIGNMENTS=923 CHECKS=2101300	? (TO) TT=1800	? (MO) TT=1757.63	UNSAT TT=20.884 CHECKS=1912900	UNSAT TT=27.83 ASSIGNMENTS=955 CHECKS=2188010	UNSAT TT=137.473 ASSIGNMENTS=5229 CHECKS=12318400	? (MO) TT=7.6	UNSAT TT=28.369 ASSIGNMENTS=1016 CHECKS=2276350	UNSAT TT=24.649 ASSIGNMENTS=923 CHECKS=2101300	? TT=89.025	UNSAT TT=1.856 ASSIGNMENTS=2093 CHECKS=192376	? TT=238.94	? TT=232.528
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddLarge/ normalized-bdd-21-2713-15-79-4_ext.xml	SAT TT=1.586	SAT TT=21.646 CHECKS=2932 NODES=226	SAT TT=7.677 CHECKS=2713 NODES=0	? (problem) TT=525.085	SAT TT=772.201 CHECKS=1426610	SAT TT=1181.53 CHECKS=2432610	SAT TT=14.224 ASSIGNMENTS=13	SAT TT=13.406 ASSIGNMENTS=22	SAT TT=31.338 CHECKS=192623 NODES=21	SAT TT=16.492 CHECKS=14935400 NODES=271	SAT TT=123.605 CHECKS=79153300 NODES=1412	SAT TT=1.614 ASSIGNMENTS=12 CHECKS=40695	SAT TT=1.723 ASSIGNMENTS=12 CHECKS=40695	? (MO) TT=1745.33	? (MO) TT=1790.98	SAT TT=5.711 CHECKS=556387	SAT TT=1.706 ASSIGNMENTS=12 CHECKS=40695	SAT TT=1.721 ASSIGNMENTS=12 CHECKS=40695	? (MO) TT=7.07	SAT TT=1.613 ASSIGNMENTS=21 CHECKS=40695	SAT TT=1.586 ASSIGNMENTS=12 CHECKS=40695	? TT=97.744	SAT TT=0.384 ASSIGNMENTS=21 CHECKS=9939	? TT=150.631	? TT=142.071
csp/bddLarge/ normalized-bdd-21-2713-15-79-5_ext.xml	SAT TT=1.335	SAT TT=56.391 CHECKS=3713 NODES=893	SAT TT=7.571 CHECKS=2713 NODES=0	? (problem) TT=523.602	SAT TT=666.73 CHECKS=1414240	SAT TT=881.401 CHECKS=1754550	SAT TT=13.055 ASSIGNMENTS=12	SAT TT=14.067 ASSIGNMENTS=12	SAT TT=29.538 CHECKS=255057 NODES=21	SAT TT=39.547 CHECKS=59021300 NODES=1082	SAT TT=1181.2 CHECKS=1191160000 NODES=18178	SAT TT=1.514 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.521 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=1750.97	? (MO) TT=1743.03	SAT TT=1.335 CHECKS=105438	SAT TT=1.524 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.497 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=7.1	SAT TT=1.465 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.47 ASSIGNMENTS=11 CHECKS=40695	? TT=98.243	SAT TT=0.372 ASSIGNMENTS=21 CHECKS=9361	? TT=217.428	? TT=198.989
csp/bddLarge/ normalized-bdd-21-2713-15-79-6_ext.xml	UNSAT TT=22.888	UNSAT TT=76.181 CHECKS=5316 NODES=2097	UNSAT TT=76.052 CHECKS=4113 NODES=1850	? (problem) TT=571.072	? (TO) TT=1800.12	? (TO) TT=1800.21	UNSAT TT=972.952 ASSIGNMENTS=1218	UNSAT TT=965.503 ASSIGNMENTS=1466	UNSAT TT=97.879 CHECKS=100176000 NODES=2195	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=38.699 ASSIGNMENTS=975 CHECKS=2554150	UNSAT TT=36.126 ASSIGNMENTS=975 CHECKS=2554150	? (MO) TT=1785.81	? (MO) TT=1695.23	UNSAT TT=22.888 CHECKS=2355680	UNSAT TT=33.071 ASSIGNMENTS=1071 CHECKS=2793970	UNSAT TT=151.94 ASSIGNMENTS=5177 CHECKS=12005300	? (MO) TT=7	UNSAT TT=32.418 ASSIGNMENTS=1089 CHECKS=2868430	UNSAT TT=29.988 ASSIGNMENTS=975 CHECKS=2554150	? TT=104.317	UNSAT TT=2.39 ASSIGNMENTS=2339 CHECKS=411939	? TT=150.56	? TT=152.108
csp/bddLarge/ normalized-bdd-21-2713-15-79-7_ext.xml	UNSAT TT=20.045	UNSAT TT=73.817 CHECKS=3979 NODES=1823	UNSAT TT=80.599 CHECKS=3864 NODES=1828	? (problem) TT=571.431	? (TO) TT=1800.21	? (TO) TT=1800.16	UNSAT TT=880.847 ASSIGNMENTS=1112	UNSAT TT=1022.82 ASSIGNMENTS=1421	UNSAT TT=101.629 CHECKS=92677300 NODES=2239	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=47.983 ASSIGNMENTS=1083 CHECKS=3176710	UNSAT TT=48.465 ASSIGNMENTS=1083 CHECKS=3176710	? (TO) TT=1800	? (MO) TT=1688.72	UNSAT TT=20.045 CHECKS=2500500	UNSAT TT=37.42 ASSIGNMENTS=1037 CHECKS=3267150	UNSAT TT=131.437 ASSIGNMENTS=4955 CHECKS=11741300	? (MO) TT=7.6	UNSAT TT=36.206 ASSIGNMENTS=1075 CHECKS=3342090	UNSAT TT=36.466 ASSIGNMENTS=1083 CHECKS=3176710	? TT=93.456	UNSAT TT=1.861 ASSIGNMENTS=2138 CHECKS=206666	? TT=80.34	? TT=80.275
csp/bddLarge/ normalized-bdd-21-2713-15-79-8_ext.xml	SAT TT=1.479	SAT TT=39.424 CHECKS=4801 NODES=526	SAT TT=7.722 CHECKS=2713 NODES=0	? (problem) TT=528.732	SAT TT=646.048 CHECKS=1134900	SAT TT=454.389 CHECKS=715287	SAT TT=12.961 ASSIGNMENTS=11	SAT TT=12.866 ASSIGNMENTS=14	SAT TT=31.814 CHECKS=210120 NODES=21	SAT TT=42.29 CHECKS=74186000 NODES=1363	SAT TT=619.153 CHECKS=821644000 NODES=12224	SAT TT=1.809 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.793 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=1769.14	? (MO) TT=1794.91	SAT TT=15.893 CHECKS=1356620	SAT TT=1.786 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.747 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=7.4	SAT TT=1.479 ASSIGNMENTS=13 CHECKS=40695	SAT TT=1.783 ASSIGNMENTS=10 CHECKS=40695	? TT=100.806	SAT TT=0.376 ASSIGNMENTS=21 CHECKS=6325	? TT=134.363	? TT=142.448
csp/bddLarge/ normalized-bdd-21-2713-15-79-9_ext.xml	UNSAT TT=19.999	UNSAT TT=83.219 CHECKS=3030 NODES=1531	UNSAT TT=91.779 CHECKS=3319 NODES=1552	? (problem) TT=571.444	? (TO) TT=1800.19	? (TO) TT=1800.13	UNSAT TT=556.598 ASSIGNMENTS=978	UNSAT TT=1237.96 ASSIGNMENTS=1447	UNSAT TT=117.461 CHECKS=125061000 NODES=2181	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=36.518 ASSIGNMENTS=1034 CHECKS=2599890	UNSAT TT=39.232 ASSIGNMENTS=1034 CHECKS=2599890	? (MO) TT=1779.2	? (MO) TT=1717.1	UNSAT TT=19.999 CHECKS=1966230	UNSAT TT=30.788 ASSIGNMENTS=997 CHECKS=2518740	UNSAT TT=141.407 ASSIGNMENTS=4864 CHECKS=11536200	? (MO) TT=7.4	UNSAT TT=31.853 ASSIGNMENTS=1044 CHECKS=2608730	UNSAT TT=30.368 ASSIGNMENTS=1034 CHECKS=2599890	? TT=86	UNSAT TT=1.665 ASSIGNMENTS=2129 CHECKS=177514	? TT=135.336	? TT=135.77
csp/bddSmall/ normalized-bdd-21-133-18-78-10_ext.xml	SAT TT=0.714	SAT TT=31.417 CHECKS=11568 NODES=4444	SAT TT=4.436 CHECKS=133 NODES=0	SAT TT=143.153	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=6.573 ASSIGNMENTS=17	SAT TT=6.797 ASSIGNMENTS=22	SAT TT=12.562 CHECKS=10640 NODES=21	SAT TT=9.581 CHECKS=17916700 NODES=4623	SAT TT=2 CHECKS=1295600 NODES=299	SAT TT=0.786 ASSIGNMENTS=16 CHECKS=2394	SAT TT=0.714 ASSIGNMENTS=16 CHECKS=2394	? (MO) TT=597.44	? (MO) TT=557.11	SAT TT=8.114 CHECKS=1016120	SAT TT=0.77 ASSIGNMENTS=16 CHECKS=2394	SAT TT=0.704 ASSIGNMENTS=16 CHECKS=2394	? (MO) TT=6.9	SAT TT=0.793 ASSIGNMENTS=21 CHECKS=2394	SAT TT=0.787 ASSIGNMENTS=16 CHECKS=2394	? TT=100.094	SAT TT=0.999 ASSIGNMENTS=21 CHECKS=775	? TT=95.111	? TT=108.712
csp/bddSmall/ normalized-bdd-21-133-18-78-11_ext.xml	SAT TT=0.801	SAT TT=39.633 CHECKS=26849 NODES=8913	SAT TT=51.35 CHECKS=28653 NODES=9183	SAT TT=227.687	SAT TT=910.008 CHECKS=181944	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.13	SAT TT=74.59 CHECKS=66037600 NODES=24505	SAT TT=2.407 CHECKS=1448240 NODES=370	SAT TT=84.083 CHECKS=122010000 NODES=19217	SAT TT=24.1 ASSIGNMENTS=10143 CHECKS=1645510	SAT TT=22.712 ASSIGNMENTS=10143 CHECKS=1645510	? (MO) TT=581.37	? (MO) TT=541.75	SAT TT=3.245 CHECKS=268178	SAT TT=15.351 ASSIGNMENTS=9960 CHECKS=1647540	SAT TT=23.924 ASSIGNMENTS=16692 CHECKS=2346960	? (MO) TT=7.29	SAT TT=0.801 ASSIGNMENTS=29 CHECKS=4050	SAT TT=15.959 ASSIGNMENTS=10143 CHECKS=1645510	? TT=105.684	SAT TT=7.553 ASSIGNMENTS=18609 CHECKS=1471740	? TT=223.17	? TT=227.275
csp/bddSmall/ normalized-bdd-21-133-18-78-12_ext.xml	UNSAT TT=12.089	UNSAT TT=49.652 CHECKS=80918 NODES=21031	UNSAT TT=61.526 CHECKS=62322 NODES=16438	UNSAT TT=251.288	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.09	UNSAT TT=61.7 CHECKS=62633200 NODES=24042	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=25.876 ASSIGNMENTS=11516 CHECKS=1773070	UNSAT TT=27.005 ASSIGNMENTS=11516 CHECKS=1773070	? (MO) TT=592.97	? (MO) TT=557.54	UNSAT TT=12.089 CHECKS=1464290	UNSAT TT=18.785 ASSIGNMENTS=11986 CHECKS=1778540	UNSAT TT=21.749 ASSIGNMENTS=16635 CHECKS=2347980	? (MO) TT=7.1	UNSAT TT=16.496 ASSIGNMENTS=10496 CHECKS=1486790	UNSAT TT=18.511 ASSIGNMENTS=11516 CHECKS=1773070	? TT=106.065	UNSAT TT=5.743 ASSIGNMENTS=19103 CHECKS=976016	? TT=221.837	? TT=221.075
csp/bddSmall/ normalized-bdd-21-133-18-78-13_ext.xml	UNSAT TT=15.11	UNSAT TT=86.699 CHECKS=62729 NODES=17802	UNSAT TT=93.276 CHECKS=54869 NODES=16026	UNSAT TT=271.282	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.12	UNSAT TT=70.573 CHECKS=63872600 NODES=23912	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=23.505 ASSIGNMENTS=10062 CHECKS=1513130	UNSAT TT=23.537 ASSIGNMENTS=10062 CHECKS=1513130	? (MO) TT=543.38	? (MO) TT=552.42	UNSAT TT=19.475 CHECKS=1320750	UNSAT TT=16.015 ASSIGNMENTS=10652 CHECKS=1582110	UNSAT TT=21.701 ASSIGNMENTS=14811 CHECKS=2110990	? (MO) TT=7.3	UNSAT TT=16.736 ASSIGNMENTS=10564 CHECKS=1543190	UNSAT TT=15.11 ASSIGNMENTS=10062 CHECKS=1513130	? TT=90.725	UNSAT TT=9.541 ASSIGNMENTS=18943 CHECKS=1798090	? TT=125.03	? TT=126.479
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-14_ext.xml	UNSAT TT=12.937	UNSAT TT=55.155 CHECKS=71926 NODES=19555	UNSAT TT=70.867 CHECKS=71691 NODES=19487	UNSAT TT=242.868	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	UNSAT TT=89.287 CHECKS=82401600 NODES=34610	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=23.022 ASSIGNMENTS=10037 CHECKS=1516500	UNSAT TT=25.235 ASSIGNMENTS=10037 CHECKS=1516500	? (MO) TT=595.56	? (MO) TT=568.02	UNSAT TT=12.937 CHECKS=1282110	UNSAT TT=16.472 ASSIGNMENTS=10610 CHECKS=1474700	UNSAT TT=24.076 ASSIGNMENTS=15503 CHECKS=2217940	? (MO) TT=7.01	UNSAT TT=16.64 ASSIGNMENTS=11579 CHECKS=1536460	UNSAT TT=16.798 ASSIGNMENTS=10037 CHECKS=1516500	? TT=79.517	UNSAT TT=7.554 ASSIGNMENTS=19169 CHECKS=1444690	? TT=239.534	? TT=234.845
csp/bddSmall/ normalized-bdd-21-133-18-78-15_ext.xml	UNSAT TT=13.111	UNSAT TT=60.022 CHECKS=56615 NODES=17053	UNSAT TT=68.782 CHECKS=63200 NODES=18124	UNSAT TT=248.323	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.1	UNSAT TT=66.274 CHECKS=65794900 NODES=24053	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=24.985 ASSIGNMENTS=10147 CHECKS=1682160	UNSAT TT=23.332 ASSIGNMENTS=10147 CHECKS=1682160	? (MO) TT=555.51	? (MO) TT=558.69	UNSAT TT=13.111 CHECKS=1322890	UNSAT TT=17.438 ASSIGNMENTS=11469 CHECKS=1762530	UNSAT TT=21.585 ASSIGNMENTS=15567 CHECKS=2236000	? (MO) TT=7.78	UNSAT TT=17.222 ASSIGNMENTS=11661 CHECKS=1765920	UNSAT TT=16.425 ASSIGNMENTS=10147 CHECKS=1682160	? TT=95.284	UNSAT TT=7.372 ASSIGNMENTS=19762 CHECKS=1466590	? TT=122.463	? TT=122.985
csp/bddSmall/ normalized-bdd-21-133-18-78-16_ext.xml	UNSAT TT=15.544	UNSAT TT=58.602 CHECKS=67531 NODES=18434	UNSAT TT=66.19 CHECKS=70573 NODES=18531	UNSAT TT=275.808	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.13	UNSAT TT=64.081 CHECKS=60196900 NODES=24854	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=24.869 ASSIGNMENTS=11172 CHECKS=1573320	UNSAT TT=25.689 ASSIGNMENTS=11172 CHECKS=1573320	? (MO) TT=555.69	? (MO) TT=547.18	UNSAT TT=15.591 CHECKS=1373920	UNSAT TT=17.417 ASSIGNMENTS=10548 CHECKS=1663600	UNSAT TT=23.438 ASSIGNMENTS=15901 CHECKS=2259680	? (MO) TT=7.32	UNSAT TT=15.83 ASSIGNMENTS=10231 CHECKS=1571370	UNSAT TT=15.544 ASSIGNMENTS=11172 CHECKS=1573320	? TT=95.583	UNSAT TT=9.907 ASSIGNMENTS=20868 CHECKS=2298450	? TT=147.18	? TT=142.222
csp/bddSmall/ normalized-bdd-21-133-18-78-17_ext.xml	SAT TT=0.725	SAT TT=33.241 CHECKS=10260 NODES=4826	SAT TT=4.408 CHECKS=133 NODES=0	SAT TT=153.943	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=6.975 ASSIGNMENTS=14	SAT TT=6.953 ASSIGNMENTS=15	SAT TT=12.487 CHECKS=15673 NODES=21	SAT TT=3.259 CHECKS=4355540 NODES=1120	SAT TT=70.471 CHECKS=105941000 NODES=17944	SAT TT=0.796 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.793 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=549.44	? (MO) TT=597.14	SAT TT=5.053 CHECKS=485363	SAT TT=0.79 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.779 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.43	SAT TT=0.725 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.772 ASSIGNMENTS=13 CHECKS=2394	? TT=99.236	SAT TT=0.993 ASSIGNMENTS=21 CHECKS=417	? TT=122.009	? TT=126.753
csp/bddSmall/ normalized-bdd-21-133-18-78-18_ext.xml	SAT TT=0.768	SAT TT=29.54 CHECKS=9000 NODES=4153	SAT TT=4.221 CHECKS=133 NODES=0	SAT TT=133.505	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=7.502 ASSIGNMENTS=15	SAT TT=6.72 ASSIGNMENTS=14	SAT TT=13.25 CHECKS=16276 NODES=21	SAT TT=32.463 CHECKS=77831800 NODES=20092	SAT TT=33.902 CHECKS=48272100 NODES=7918	SAT TT=0.774 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.769 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=594.57	? (MO) TT=588.16	SAT TT=2.428 CHECKS=174515	SAT TT=0.768 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.759 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.4	SAT TT=0.792 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.786 ASSIGNMENTS=15 CHECKS=2394	? TT=91.612	SAT TT=0.967 ASSIGNMENTS=21 CHECKS=717	? TT=217.324	? TT=227.368
csp/bddSmall/ normalized-bdd-21-133-18-78-19_ext.xml	UNSAT TT=11.976	UNSAT TT=55.298 CHECKS=85411 NODES=22034	UNSAT TT=62.258 CHECKS=70291 NODES=19050	UNSAT TT=242.671	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.12	UNSAT TT=62.824 CHECKS=62000600 NODES=24023	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=24.023 ASSIGNMENTS=11246 CHECKS=1675490	UNSAT TT=23.837 ASSIGNMENTS=11246 CHECKS=1675490	? (MO) TT=587.62	? (MO) TT=602.08	UNSAT TT=11.976 CHECKS=1313320	UNSAT TT=12.724 ASSIGNMENTS=10054 CHECKS=1471910	UNSAT TT=22.387 ASSIGNMENTS=15374 CHECKS=2235730	? (MO) TT=7.18	UNSAT TT=14.695 ASSIGNMENTS=10442 CHECKS=1606760	UNSAT TT=16.127 ASSIGNMENTS=11246 CHECKS=1675490	? TT=85.245	UNSAT TT=6.562 ASSIGNMENTS=20063 CHECKS=1244730	? TT=231.844	? TT=254.803
csp/bddSmall/ normalized-bdd-21-133-18-78-1_ext.xml	SAT TT=0.719	SAT TT=33.089 CHECKS=18106 NODES=6241	SAT TT=4.345 CHECKS=133 NODES=0	SAT TT=146.005	? (TO) TT=1800.07	SAT TT=569.106 CHECKS=114108	SAT TT=7.389 ASSIGNMENTS=14	SAT TT=7.363 ASSIGNMENTS=16	SAT TT=13.338 CHECKS=16817 NODES=21	SAT TT=1.695 CHECKS=544442 NODES=136	SAT TT=229.192 CHECKS=257826000 NODES=19620	SAT TT=0.77 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.779 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=600.22	? (MO) TT=553.03	SAT TT=13.331 CHECKS=1161870	SAT TT=0.733 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.73 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=7.89	SAT TT=0.719 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.797 ASSIGNMENTS=13 CHECKS=2394	? TT=81.62	SAT TT=0.955 ASSIGNMENTS=21 CHECKS=590	? TT=98.121	? TT=100.159
csp/bddSmall/ normalized-bdd-21-133-18-78-20_ext.xml	SAT TT=0.731	SAT TT=41.671 CHECKS=38439 NODES=11735	SAT TT=3.951 CHECKS=133 NODES=0	SAT TT=144.413	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT TT=6.598 ASSIGNMENTS=15	SAT TT=7.258 ASSIGNMENTS=16	SAT TT=12.38 CHECKS=10119 NODES=21	SAT TT=5.196 CHECKS=9473980 NODES=2442	SAT TT=103.362 CHECKS=131512000 NODES=14884	SAT TT=0.789 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.794 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=596.18	? (MO) TT=557.43	SAT TT=3.753 CHECKS=381201	SAT TT=0.785 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.724 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=7.54	SAT TT=0.802 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.731 ASSIGNMENTS=14 CHECKS=2394	? TT=84.077	SAT TT=1.051 ASSIGNMENTS=21 CHECKS=467	? TT=238.746	? TT=238.797
csp/bddSmall/ normalized-bdd-21-133-18-78-21_ext.xml	UNSAT TT=14.384	UNSAT TT=58.504 CHECKS=63268 NODES=18664	UNSAT TT=65.704 CHECKS=59131 NODES=17021	UNSAT TT=254.492	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.15	UNSAT TT=69.807 CHECKS=61116800 NODES=24456	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=24.71 ASSIGNMENTS=10706 CHECKS=1579960	UNSAT TT=22.846 ASSIGNMENTS=10706 CHECKS=1579960	? (MO) TT=557.11	? (MO) TT=574.39	UNSAT TT=14.384 CHECKS=1300580	UNSAT TT=15.93 ASSIGNMENTS=10747 CHECKS=1588220	UNSAT TT=22.185 ASSIGNMENTS=15139 CHECKS=2149850	? (MO) TT=6.91	UNSAT TT=16.467 ASSIGNMENTS=10738 CHECKS=1561600	UNSAT TT=14.944 ASSIGNMENTS=10706 CHECKS=1579960	? TT=105.625	UNSAT TT=7.115 ASSIGNMENTS=19450 CHECKS=1444360	? TT=229.884	? TT=227.686
csp/bddSmall/ normalized-bdd-21-133-18-78-22_ext.xml	UNSAT TT=12.404	UNSAT TT=60.515 CHECKS=69110 NODES=18827	UNSAT TT=67.062 CHECKS=62628 NODES=17039	UNSAT TT=235.217	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.14	UNSAT TT=66.403 CHECKS=60842600 NODES=24631	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=23.446 ASSIGNMENTS=10793 CHECKS=1600220	UNSAT TT=23.872 ASSIGNMENTS=10793 CHECKS=1600220	? (MO) TT=548.73	? (MO) TT=549.57	UNSAT TT=12.404 CHECKS=1220260	UNSAT TT=15.949 ASSIGNMENTS=10733 CHECKS=1618230	UNSAT TT=25.586 ASSIGNMENTS=17896 CHECKS=2503990	? (MO) TT=7.99	UNSAT TT=18.216 ASSIGNMENTS=10580 CHECKS=1784720	UNSAT TT=14.781 ASSIGNMENTS=10793 CHECKS=1600220	? TT=97.181	UNSAT TT=6.423 ASSIGNMENTS=18262 CHECKS=1358800	? TT=99.573	? TT=93.276
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-23_ext.xml	SAT TT=0.754	SAT TT=32.66 CHECKS=12478 NODES=4701	SAT TT=4.176 CHECKS=133 NODES=0	SAT TT=149.269	SAT TT=69.429 CHECKS=8047	? (TO) TT=1800.04	SAT TT=6.864 ASSIGNMENTS=15	SAT TT=7.328 ASSIGNMENTS=14	SAT TT=12.74 CHECKS=12991 NODES=21	SAT TT=20.616 CHECKS=43141400 NODES=11130	SAT TT=13.393 CHECKS=20080300 NODES=4961	SAT TT=0.773 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.789 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=548.53	? (MO) TT=588.33	SAT TT=2.171 CHECKS=127107	SAT TT=0.772 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.778 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=7.3	SAT TT=0.754 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.756 ASSIGNMENTS=14 CHECKS=2394	? TT=86.479	SAT TT=1.072 ASSIGNMENTS=21 CHECKS=360	? TT=292.122	? TT=296.447
csp/bddSmall/ normalized-bdd-21-133-18-78-24_ext.xml	UNSAT TT=13.798	UNSAT TT=54.411 CHECKS=68899 NODES=18430	UNSAT TT=67.062 CHECKS=57164 NODES=16641	UNSAT TT=272.993	? (TO) TT=1800.01	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=64.678 CHECKS=56626400 NODES=24515	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=25.874 ASSIGNMENTS=10291 CHECKS=1883190	UNSAT TT=25.933 ASSIGNMENTS=10291 CHECKS=1883190	? (MO) TT=560.1	? (MO) TT=561.91	UNSAT TT=14.311 CHECKS=1442150	UNSAT TT=15.214 ASSIGNMENTS=9579 CHECKS=1579640	UNSAT TT=21.111 ASSIGNMENTS=14879 CHECKS=2140840	? (MO) TT=7.79	UNSAT TT=13.798 ASSIGNMENTS=9266 CHECKS=1466150	UNSAT TT=16.499 ASSIGNMENTS=10291 CHECKS=1883190	? TT=88.236	UNSAT TT=7.636 ASSIGNMENTS=18876 CHECKS=1555390	? TT=262.944	? TT=259.693
csp/bddSmall/ normalized-bdd-21-133-18-78-25_ext.xml	SAT TT=0.717	SAT TT=44.395 CHECKS=17754 NODES=6507	SAT TT=4.215 CHECKS=133 NODES=0	SAT TT=142.159	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=7.31 ASSIGNMENTS=15	SAT TT=7.26 ASSIGNMENTS=18	SAT TT=13.383 CHECKS=11014 NODES=21	SAT TT=12.931 CHECKS=25220700 NODES=6506	SAT TT=1451.47 CHECKS=1415560000 NODES=35730	SAT TT=0.793 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.807 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=561.47	? (MO) TT=556.14	SAT TT=16.122 CHECKS=1247380	SAT TT=0.717 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.778 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=7.93	SAT TT=0.77 ASSIGNMENTS=17 CHECKS=2394	SAT TT=0.727 ASSIGNMENTS=14 CHECKS=2394	? TT=87.429	SAT TT=0.952 ASSIGNMENTS=21 CHECKS=917	? TT=274.729	? TT=296.427
csp/bddSmall/ normalized-bdd-21-133-18-78-26_ext.xml	SAT TT=0.723	SAT TT=24.775 CHECKS=8361 NODES=3300	SAT TT=3.975 CHECKS=133 NODES=0	SAT TT=145.535	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=6.415 ASSIGNMENTS=15	SAT TT=7.21 ASSIGNMENTS=15	SAT TT=12.383 CHECKS=17186 NODES=21	SAT TT=7.71 CHECKS=15585400 NODES=4019	SAT TT=98.444 CHECKS=128900000 NODES=16365	SAT TT=0.737 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.768 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=590.36	? (MO) TT=574.77	SAT TT=5.341 CHECKS=502716	SAT TT=0.792 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.759 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=7.1	SAT TT=0.723 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.758 ASSIGNMENTS=14 CHECKS=2394	? TT=87.596	SAT TT=0.965 ASSIGNMENTS=21 CHECKS=607	? TT=264.571	? TT=239.915
csp/bddSmall/ normalized-bdd-21-133-18-78-27_ext.xml	SAT TT=0.713	SAT TT=26.707 CHECKS=7401 NODES=2951	SAT TT=4.369 CHECKS=133 NODES=0	SAT TT=134.465	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=7.487 ASSIGNMENTS=15	SAT TT=7.358 ASSIGNMENTS=16	SAT TT=12.62 CHECKS=8393 NODES=21	SAT TT=4.743 CHECKS=7221190 NODES=1861	SAT TT=249.066 CHECKS=263496000 NODES=17084	SAT TT=0.713 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.794 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=596.49	? (MO) TT=549.89	SAT TT=0.775 CHECKS=27164	SAT TT=0.783 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.777 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=6.78	SAT TT=0.798 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.787 ASSIGNMENTS=14 CHECKS=2394	? TT=91.623	SAT TT=1.051 ASSIGNMENTS=21 CHECKS=501	? TT=292.533	? TT=277.87
csp/bddSmall/ normalized-bdd-21-133-18-78-28_ext.xml	UNSAT TT=12.778	UNSAT TT=49.741 CHECKS=72626 NODES=20985	UNSAT TT=62.727 CHECKS=68387 NODES=20089	UNSAT TT=252.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.18	UNSAT TT=61.839 CHECKS=60510700 NODES=23937	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=24.121 ASSIGNMENTS=10326 CHECKS=1530210	UNSAT TT=24.674 ASSIGNMENTS=10326 CHECKS=1530210	? (MO) TT=574.22	? (MO) TT=540.41	UNSAT TT=12.778 CHECKS=1366560	UNSAT TT=17.569 ASSIGNMENTS=11822 CHECKS=1778470	UNSAT TT=20.043 ASSIGNMENTS=14997 CHECKS=2178820	? (MO) TT=6.81	UNSAT TT=14.987 ASSIGNMENTS=10020 CHECKS=1443980	UNSAT TT=16.394 ASSIGNMENTS=10326 CHECKS=1530210	? TT=89.438	UNSAT TT=6.846 ASSIGNMENTS=19022 CHECKS=1332520	? TT=93.414	? TT=105.629
csp/bddSmall/ normalized-bdd-21-133-18-78-29_ext.xml	UNSAT TT=12.13	UNSAT TT=63.654 CHECKS=65648 NODES=17331	UNSAT TT=73.221 CHECKS=65288 NODES=16953	UNSAT TT=223.995	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.12	UNSAT TT=68.696 CHECKS=61114500 NODES=24648	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=25.944 ASSIGNMENTS=11498 CHECKS=1641480	UNSAT TT=25.348 ASSIGNMENTS=11498 CHECKS=1641480	? (MO) TT=553.35	? (MO) TT=590.91	UNSAT TT=12.13 CHECKS=1386000	UNSAT TT=16.527 ASSIGNMENTS=11769 CHECKS=1721300	UNSAT TT=19.961 ASSIGNMENTS=14800 CHECKS=2093360	? (MO) TT=7.29	UNSAT TT=15.019 ASSIGNMENTS=10851 CHECKS=1499380	UNSAT TT=17.372 ASSIGNMENTS=11498 CHECKS=1641480	? TT=97.33	UNSAT TT=7.028 ASSIGNMENTS=18668 CHECKS=1419660	? TT=135.204	? TT=131.137
csp/bddSmall/ normalized-bdd-21-133-18-78-2_ext.xml	SAT TT=1.264	SAT TT=32.214 CHECKS=22972 NODES=7545	SAT TT=40.965 CHECKS=26351 NODES=8437	SAT TT=158.923	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=72.653 CHECKS=64942100 NODES=26049	SAT TT=1.774 CHECKS=663297 NODES=166	SAT TT=203.114 CHECKS=223101000 NODES=16656	SAT TT=20.768 ASSIGNMENTS=8312 CHECKS=1292560	SAT TT=22.05 ASSIGNMENTS=8312 CHECKS=1292560	? (MO) TT=555.84	? (MO) TT=572.55	SAT TT=1.264 CHECKS=89502	SAT TT=12.254 ASSIGNMENTS=8245 CHECKS=1242660	SAT TT=0.883 ASSIGNMENTS=94 CHECKS=14021	? (MO) TT=7.05	SAT TT=9.321 ASSIGNMENTS=5863 CHECKS=1049050	SAT TT=13.859 ASSIGNMENTS=8312 CHECKS=1292560	? TT=85.614	SAT TT=1.786 ASSIGNMENTS=1902 CHECKS=171788	? TT=98.403	? TT=98.761
csp/bddSmall/ normalized-bdd-21-133-18-78-30_ext.xml	UNSAT TT=16.415	UNSAT TT=61.912 CHECKS=54050 NODES=16986	UNSAT TT=71.147 CHECKS=58082 NODES=17559	UNSAT TT=250.307	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.11	UNSAT TT=71.227 CHECKS=59540100 NODES=24841	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=25.377 ASSIGNMENTS=11079 CHECKS=1742230	UNSAT TT=25.54 ASSIGNMENTS=11079 CHECKS=1742230	? (MO) TT=559.07	? (MO) TT=583.01	UNSAT TT=18.758 CHECKS=1431650	UNSAT TT=16.415 ASSIGNMENTS=11699 CHECKS=1598120	UNSAT TT=21.7 ASSIGNMENTS=16896 CHECKS=2347340	? (MO) TT=7.46	UNSAT TT=16.997 ASSIGNMENTS=12139 CHECKS=1662080	UNSAT TT=16.925 ASSIGNMENTS=11079 CHECKS=1742230	? TT=80.288	UNSAT TT=10.509 ASSIGNMENTS=22003 CHECKS=1576020	? TT=224.487	? TT=247.41
csp/bddSmall/ normalized-bdd-21-133-18-78-31_ext.xml	UNSAT TT=14.791	UNSAT TT=95.062 CHECKS=59416 NODES=17473	UNSAT TT=106.809 CHECKS=55033 NODES=18090	UNSAT TT=242.139	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=1554.51 ASSIGNMENTS=10289	? (TO) TT=1800.05	UNSAT TT=68.224 CHECKS=58346500 NODES=24228	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=22.982 ASSIGNMENTS=10508 CHECKS=1470000	UNSAT TT=21.747 ASSIGNMENTS=10508 CHECKS=1470000	? (MO) TT=558.83	? (MO) TT=591.98	UNSAT TT=18.057 CHECKS=1374040	UNSAT TT=15.381 ASSIGNMENTS=10624 CHECKS=1470240	UNSAT TT=20.571 ASSIGNMENTS=14711 CHECKS=2073900	? (MO) TT=6.84	UNSAT TT=16.03 ASSIGNMENTS=10964 CHECKS=1515920	UNSAT TT=14.791 ASSIGNMENTS=10508 CHECKS=1470000	? TT=90.919	UNSAT TT=7.92 ASSIGNMENTS=17936 CHECKS=1426550	? TT=262.218	? TT=256.199
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-32_ext.xml	SAT TT=0.72	SAT TT=9.431 CHECKS=551 NODES=316	SAT TT=4.181 CHECKS=133 NODES=0	SAT TT=144.006	? (TO) TT=1800.08	SAT TT=137.203 CHECKS=24194	SAT TT=7.106 ASSIGNMENTS=15	SAT TT=7.295 ASSIGNMENTS=17	SAT TT=13.23 CHECKS=10919 NODES=21	SAT TT=12.541 CHECKS=25508400 NODES=6582	SAT TT=22.129 CHECKS=35857900 NODES=6831	SAT TT=0.779 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.785 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=593.4	? (MO) TT=589.35	SAT TT=3.804 CHECKS=396554	SAT TT=0.72 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.781 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=6.91	SAT TT=0.781 ASSIGNMENTS=16 CHECKS=2394	SAT TT=0.758 ASSIGNMENTS=14 CHECKS=2394	? TT=95.526	SAT TT=1.03 ASSIGNMENTS=21 CHECKS=579	? TT=100.247	? TT=99.489
csp/bddSmall/ normalized-bdd-21-133-18-78-33_ext.xml	UNSAT TT=16.157	UNSAT TT=58.092 CHECKS=58833 NODES=19701	UNSAT TT=62.823 CHECKS=65779 NODES=19303	UNSAT TT=251.674	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.08	UNSAT TT=69.614 CHECKS=65493200 NODES=24400	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=26.887 ASSIGNMENTS=12381 CHECKS=1850770	UNSAT TT=26.966 ASSIGNMENTS=12381 CHECKS=1850770	? (MO) TT=577.3	? (MO) TT=578.12	UNSAT TT=21.246 CHECKS=1332060	UNSAT TT=16.157 ASSIGNMENTS=11345 CHECKS=1605130	UNSAT TT=25.087 ASSIGNMENTS=16918 CHECKS=2396730	? (MO) TT=7.11	UNSAT TT=16.478 ASSIGNMENTS=11335 CHECKS=1520940	UNSAT TT=17.331 ASSIGNMENTS=12381 CHECKS=1850770	? TT=80.257	UNSAT TT=8.136 ASSIGNMENTS=20011 CHECKS=2016650	? TT=163.377	? TT=164.594
csp/bddSmall/ normalized-bdd-21-133-18-78-34_ext.xml	SAT TT=4.658	SAT TT=33.215 CHECKS=22442 NODES=7265	SAT TT=35.779 CHECKS=16011 NODES=5864	SAT TT=153.264	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=900.01 ASSIGNMENTS=6026	? (TO) TT=1800.08	SAT TT=55.574 CHECKS=53835200 NODES=22016	SAT TT=9.887 CHECKS=19526500 NODES=5036	SAT TT=180.709 CHECKS=226250000 NODES=22308	SAT TT=18.784 ASSIGNMENTS=7106 CHECKS=982989	SAT TT=18.697 ASSIGNMENTS=7106 CHECKS=982989	? (MO) TT=607.36	? (MO) TT=597.19	SAT TT=11.356 CHECKS=1107490	SAT TT=8.536 ASSIGNMENTS=6107 CHECKS=855725	SAT TT=9.679 ASSIGNMENTS=7298 CHECKS=1046620	? (MO) TT=7.31	SAT TT=4.658 ASSIGNMENTS=3425 CHECKS=483507	SAT TT=9.61 ASSIGNMENTS=7106 CHECKS=982989	? TT=93.958	SAT TT=7.008 ASSIGNMENTS=18307 CHECKS=1522910	? TT=119.179	? TT=109.337
csp/bddSmall/ normalized-bdd-21-133-18-78-35_ext.xml	UNSAT TT=13.553	UNSAT TT=71.316 CHECKS=59807 NODES=16866	UNSAT TT=75.633 CHECKS=56666 NODES=18545	UNSAT TT=196.748	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=67.369 CHECKS=57562200 NODES=24814	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=22.404 ASSIGNMENTS=11159 CHECKS=1524050	UNSAT TT=23.573 ASSIGNMENTS=11159 CHECKS=1524050	? (MO) TT=548.18	? (MO) TT=564.11	UNSAT TT=13.553 CHECKS=1256280	UNSAT TT=15.873 ASSIGNMENTS=10981 CHECKS=1506470	UNSAT TT=19.84 ASSIGNMENTS=14907 CHECKS=2150450	? (MO) TT=8.09	UNSAT TT=14.543 ASSIGNMENTS=10842 CHECKS=1486900	UNSAT TT=15.578 ASSIGNMENTS=11159 CHECKS=1524050	? TT=90.875	UNSAT TT=5.961 ASSIGNMENTS=19155 CHECKS=1123370	? TT=216.29	? TT=216.235
csp/bddSmall/ normalized-bdd-21-133-18-78-3_ext.xml	SAT TT=0.709	SAT TT=25.143 CHECKS=18934 NODES=5967	SAT TT=4.178 CHECKS=133 NODES=0	SAT TT=148.908	SAT TT=1056.7 CHECKS=223126	SAT TT=367.975 CHECKS=80899	SAT TT=6.593 ASSIGNMENTS=15	SAT TT=7.377 ASSIGNMENTS=15	SAT TT=13.35 CHECKS=11371 NODES=21	SAT TT=35.732 CHECKS=78450700 NODES=20255	SAT TT=186.843 CHECKS=230954000 NODES=22708	SAT TT=0.782 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.797 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=586.49	? (MO) TT=567.8	SAT TT=2.902 CHECKS=296067	SAT TT=0.78 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.762 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.6	SAT TT=0.778 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.709 ASSIGNMENTS=14 CHECKS=2394	? TT=87.334	SAT TT=1.06 ASSIGNMENTS=21 CHECKS=965	? TT=313.581	? TT=311.655
csp/bddSmall/ normalized-bdd-21-133-18-78-4_ext.xml	SAT TT=0.815	SAT TT=28.103 CHECKS=8638 NODES=3826	SAT TT=32.354 CHECKS=13615 NODES=4494	SAT TT=259.118	? (TO) TT=1800.03	SAT TT=458.504 CHECKS=120760	? (TO) TT=1800.1	SAT TT=1640.61 ASSIGNMENTS=5576	SAT TT=66.172 CHECKS=65313800 NODES=24481	SAT TT=12.115 CHECKS=24136800 NODES=6228	SAT TT=113.595 CHECKS=141529000 NODES=18435	SAT TT=23.907 ASSIGNMENTS=10886 CHECKS=1704260	SAT TT=25.224 ASSIGNMENTS=10886 CHECKS=1704260	? (MO) TT=557.78	? (MO) TT=575.58	SAT TT=4.393 CHECKS=385744	SAT TT=11.574 ASSIGNMENTS=7985 CHECKS=1296240	SAT TT=22.367 ASSIGNMENTS=15321 CHECKS=2252060	? (MO) TT=7.6	SAT TT=0.815 ASSIGNMENTS=29 CHECKS=4102	SAT TT=15.737 ASSIGNMENTS=10886 CHECKS=1704260	? TT=88.466	SAT TT=5.102 ASSIGNMENTS=10422 CHECKS=1187820	? TT=239.902	? TT=240.824
csp/bddSmall/ normalized-bdd-21-133-18-78-5_ext.xml	SAT TT=0.723	SAT TT=31.826 CHECKS=23174 NODES=7261	SAT TT=4.335 CHECKS=133 NODES=0	SAT TT=146.667	? (TO) TT=1800.11	SAT TT=1210.76 CHECKS=264689	SAT TT=6.373 ASSIGNMENTS=14	SAT TT=6.91 ASSIGNMENTS=15	SAT TT=12.62 CHECKS=13070 NODES=21	SAT TT=5.479 CHECKS=8566250 NODES=2210	SAT TT=204.982 CHECKS=228402000 NODES=20969	SAT TT=0.742 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.723 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=558.1	? (MO) TT=581.74	SAT TT=4.416 CHECKS=376924	SAT TT=0.776 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.763 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=6.8	SAT TT=0.808 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.777 ASSIGNMENTS=13 CHECKS=2394	? TT=93.341	SAT TT=1.033 ASSIGNMENTS=21 CHECKS=411	? TT=238.441	? TT=246.13
csp/bddSmall/ normalized-bdd-21-133-18-78-6_ext.xml	UNSAT TT=14.88	UNSAT TT=58.165 CHECKS=39854 NODES=15245	UNSAT TT=75.614 CHECKS=36826 NODES=14492	UNSAT TT=284.58	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.06	UNSAT TT=70.985 CHECKS=61066800 NODES=24384	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=24.373 ASSIGNMENTS=11325 CHECKS=1587550	UNSAT TT=24.91 ASSIGNMENTS=11325 CHECKS=1587550	? (MO) TT=548.39	? (MO) TT=578.82	UNSAT TT=18.274 CHECKS=1373470	UNSAT TT=15.86 ASSIGNMENTS=10771 CHECKS=1560070	UNSAT TT=21.542 ASSIGNMENTS=15723 CHECKS=2247850	? (MO) TT=6.8	UNSAT TT=14.88 ASSIGNMENTS=10514 CHECKS=1467170	UNSAT TT=15.696 ASSIGNMENTS=11325 CHECKS=1587550	? TT=81.781	UNSAT TT=7.522 ASSIGNMENTS=18438 CHECKS=1510260	? TT=212.353	? TT=221.729
csp/bddSmall/ normalized-bdd-21-133-18-78-7_ext.xml	SAT TT=0.813	SAT TT=24.206 CHECKS=18492 NODES=6060	SAT TT=30.109 CHECKS=16344 NODES=5691	SAT TT=215.53	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=71.042 CHECKS=64632500 NODES=24477	SAT TT=7.2 CHECKS=12071900 NODES=3113	SAT TT=58.298 CHECKS=81116600 NODES=13809	SAT TT=23.952 ASSIGNMENTS=11935 CHECKS=1731840	SAT TT=23.728 ASSIGNMENTS=11935 CHECKS=1731840	? (MO) TT=587.91	? (MO) TT=589.29	SAT TT=10.423 CHECKS=1170080	SAT TT=14.717 ASSIGNMENTS=10260 CHECKS=1590280	SAT TT=20.27 ASSIGNMENTS=14689 CHECKS=2231340	? (MO) TT=7.11	SAT TT=0.813 ASSIGNMENTS=31 CHECKS=4119	SAT TT=16.372 ASSIGNMENTS=11935 CHECKS=1731840	? TT=85.604	SAT TT=6.664 ASSIGNMENTS=19737 CHECKS=1193090	? TT=109.834	? TT=117.544
csp/bddSmall/ normalized-bdd-21-133-18-78-8_ext.xml	SAT TT=0.716	SAT TT=19.655 CHECKS=4897 NODES=1923	SAT TT=4.354 CHECKS=133 NODES=0	SAT TT=135.041	SAT TT=502.312 CHECKS=108116	? (TO) TT=1800.1	SAT TT=7.098 ASSIGNMENTS=14	SAT TT=6.61 ASSIGNMENTS=19	SAT TT=13.442 CHECKS=10029 NODES=21	SAT TT=50.773 CHECKS=115221000 NODES=29765	SAT TT=323.324 CHECKS=346201000 NODES=22271	SAT TT=0.729 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.771 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=587.22	? (MO) TT=546.07	SAT TT=9.759 CHECKS=922513	SAT TT=0.716 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.72 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.12	SAT TT=0.772 ASSIGNMENTS=18 CHECKS=2394	SAT TT=0.766 ASSIGNMENTS=13 CHECKS=2394	? TT=81.822	SAT TT=1.031 ASSIGNMENTS=21 CHECKS=342	? TT=93.153	? TT=102.929
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-9_ext.xml	SAT TT=0.744	SAT TT=18.886 CHECKS=5197 NODES=2236	SAT TT=4.171 CHECKS=133 NODES=0	SAT TT=221.13	SAT TT=406.132 CHECKS=99353	? (TO) TT=1800.06	? (TO) TT=1800.14	SAT TT=6.751 ASSIGNMENTS=17	SAT TT=12.602 CHECKS=13421 NODES=21	SAT TT=3.132 CHECKS=4255100 NODES=1094	SAT TT=115.992 CHECKS=148509000 NODES=16458	SAT TT=20.033 ASSIGNMENTS=7765 CHECKS=1113110	SAT TT=19.065 ASSIGNMENTS=7765 CHECKS=1113110	? (MO) TT=598.82	? (MO) TT=576.94	SAT TT=3.339 CHECKS=376742	SAT TT=13.69 ASSIGNMENTS=9668 CHECKS=1345280	SAT TT=0.967 ASSIGNMENTS=215 CHECKS=33232	? (MO) TT=7.39	SAT TT=0.744 ASSIGNMENTS=16 CHECKS=2394	SAT TT=11.142 ASSIGNMENTS=7765 CHECKS=1113110	? TT=95.04	SAT TT=1.187 ASSIGNMENTS=222 CHECKS=27801	? TT=104.127	? TT=105.206
csp/BH-4-13/ normalized-BlackHole-4-13-e-0_ext.xml	UNSAT TT=0.179	UNSAT TT=1.315 CHECKS=59584 NODES=0	UNSAT TT=1.301 CHECKS=59584 NODES=0	UNSAT TT=0.632	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=1.527 ASSIGNMENTS=0	UNSAT TT=1.857 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.197 ASSIGNMENTS=0 CHECKS=13846	UNSAT TT=0.189 ASSIGNMENTS=0 CHECKS=13846	? (TO) TT=1800.06	? (MO) TT=1501.33	No data	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13846	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13846	? (TO) TT=1800.06	UNSAT TT=0.179 ASSIGNMENTS=0 CHECKS=13846	UNSAT TT=0.181 ASSIGNMENTS=0 CHECKS=13846	? (TO) TT=1800.2	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.05
csp/BH-4-13/ normalized-BlackHole-4-13-e-1_ext.xml	UNSAT TT=0.186	UNSAT TT=1.277 CHECKS=59585 NODES=0	UNSAT TT=1.406 CHECKS=59585 NODES=0	UNSAT TT=0.625	? (TO) TT=1800.05	? (TO) TT=1800.12	UNSAT TT=1.833 ASSIGNMENTS=0	UNSAT TT=1.86 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.198 ASSIGNMENTS=0 CHECKS=13950	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=13950	? (TO) TT=1800.04	? (MO) TT=1771.6	No data	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=13950	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13950	? (TO) TT=1800.08	UNSAT TT=0.198 ASSIGNMENTS=0 CHECKS=13950	UNSAT TT=0.201 ASSIGNMENTS=0 CHECKS=13950	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.13
csp/BH-4-13/ normalized-BlackHole-4-13-e-2_ext.xml	UNSAT TT=0.185	UNSAT TT=1.357 CHECKS=59488 NODES=0	UNSAT TT=1.272 CHECKS=59488 NODES=0	UNSAT TT=0.635	? (TO) TT=1800.11	? (TO) TT=1800.07	UNSAT TT=1.651 ASSIGNMENTS=0	UNSAT TT=1.551 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=0.195 ASSIGNMENTS=0 CHECKS=14006	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=14006	? (TO) TT=1800.08	? (MO) TT=1454.74	No data	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=14006	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=14006	? (TO) TT=1800.05	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=14006	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=14006	? (TO) TT=1800.21	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/BH-4-13/ normalized-BlackHole-4-13-e-3_ext.xml	UNSAT TT=0.184	UNSAT TT=1.368 CHECKS=59488 NODES=0	UNSAT TT=1.357 CHECKS=59488 NODES=0	UNSAT TT=0.591	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=1.579 ASSIGNMENTS=0	UNSAT TT=1.722 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13900	UNSAT TT=0.19 ASSIGNMENTS=0 CHECKS=13900	? (TO) TT=1800.07	? (TO) TT=1800.03	No data	UNSAT TT=0.189 ASSIGNMENTS=0 CHECKS=13900	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13900	? (TO) TT=1800.1	UNSAT TT=0.184 ASSIGNMENTS=0 CHECKS=13900	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=13900	? (TO) TT=1800.2	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.05
csp/BH-4-13/ normalized-BlackHole-4-13-m-0_ext.xml	UNSAT TT=0.185	UNSAT TT=1.395 CHECKS=59488 NODES=0	UNSAT TT=1.281 CHECKS=59488 NODES=0	UNSAT TT=1341.56	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=1.933 ASSIGNMENTS=0	UNSAT TT=1.66 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=13847	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=13847	? (TO) TT=1800.01	? (TO) TT=1800.02	No data	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13847	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13847	? (TO) TT=1800.08	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13847	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=13847	? (TO) TT=1800.27	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.12
csp/BH-4-13/ normalized-BlackHole-4-13-m-1_ext.xml	UNSAT TT=0.184	UNSAT TT=1.277 CHECKS=59488 NODES=0	UNSAT TT=1.313 CHECKS=59488 NODES=0	UNSAT TT=1339.46	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=1.601 ASSIGNMENTS=0	UNSAT TT=1.568 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=0.202 ASSIGNMENTS=0 CHECKS=14005	UNSAT TT=0.197 ASSIGNMENTS=0 CHECKS=14005	? (TO) TT=1800.06	? (MO) TT=1543.57	No data	UNSAT TT=0.184 ASSIGNMENTS=0 CHECKS=14005	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=14005	? (TO) TT=1800	UNSAT TT=0.192 ASSIGNMENTS=0 CHECKS=14005	UNSAT TT=0.192 ASSIGNMENTS=0 CHECKS=14005	? (TO) TT=1800.23	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.14
csp/BH-4-13/ normalized-BlackHole-4-13-m-2_ext.xml	UNSAT TT=0.186	UNSAT TT=1.393 CHECKS=59489 NODES=0	UNSAT TT=1.271 CHECKS=59489 NODES=0	UNSAT TT=0.63	? (TO) TT=1800.12	? (TO) TT=1800.06	UNSAT TT=1.638 ASSIGNMENTS=0	UNSAT TT=1.857 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.1	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=14108	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=14108	? (TO) TT=1800.05	? (TO) TT=1800.07	No data	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=14108	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=14108	? (TO) TT=1800.07	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=14108	UNSAT TT=0.189 ASSIGNMENTS=0 CHECKS=14108	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/BH-4-4/ normalized-BlackHole-4-4-e-0_ext.xml	UNSAT TT=0.016	UNSAT TT=0.777 CHECKS=5952 NODES=0	UNSAT TT=0.84 CHECKS=5952 NODES=0	UNSAT TT=0.07	UNSAT TT=5.102 CHECKS=3152700	UNSAT TT=2.781 CHECKS=2102480	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.598 ASSIGNMENTS=0	UNSAT TT=1.718 CHECKS=81673 NODES=5880	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=1.235	UNSAT TT=1.4	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=2.527	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=1.94	UNSAT TT=420.986 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.057	UNSAT TT=1.311
csp/BH-4-4/ normalized-BlackHole-4-4-e-1_ext.xml	UNSAT TT=0.016	UNSAT TT=0.843 CHECKS=5952 NODES=0	UNSAT TT=0.827 CHECKS=5952 NODES=0	UNSAT TT=0.077	UNSAT TT=5.426 CHECKS=3127470	UNSAT TT=2.546 CHECKS=2112960	UNSAT TT=0.555 ASSIGNMENTS=0	UNSAT TT=0.65 ASSIGNMENTS=0	UNSAT TT=1.788 CHECKS=79133 NODES=5623	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=1.532	UNSAT TT=1.361	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=2.537	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=2.012	UNSAT TT=429.179 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=0.978	UNSAT TT=1.041
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-4/ normalized-BlackHole-4-4-e-2_ext.xml	UNSAT TT=0.015	UNSAT TT=0.84 CHECKS=5952 NODES=0	UNSAT TT=0.829 CHECKS=5952 NODES=0	UNSAT TT=0.073	UNSAT TT=4.623 CHECKS=2635430	UNSAT TT=2.742 CHECKS=2122950	UNSAT TT=0.594 ASSIGNMENTS=0	UNSAT TT=0.574 ASSIGNMENTS=0	UNSAT TT=1.703 CHECKS=80971 NODES=5841	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=1.275	UNSAT TT=1.33	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=2.542	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=1.934	UNSAT TT=419.059 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.075	UNSAT TT=1.088
csp/BH-4-4/ normalized-BlackHole-4-4-e-3_ext.xml	UNSAT TT=0.015	UNSAT TT=0.926 CHECKS=5952 NODES=0	UNSAT TT=0.857 CHECKS=5952 NODES=0	UNSAT TT=0.075	UNSAT TT=5.107 CHECKS=3119390	UNSAT TT=2.793 CHECKS=2122970	UNSAT TT=0.555 ASSIGNMENTS=0	UNSAT TT=0.557 ASSIGNMENTS=0	UNSAT TT=1.905 CHECKS=80874 NODES=5840	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=1.524	UNSAT TT=1.508	No data	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=2.472	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=2.037	UNSAT TT=450.57 ASSIGNMENTS=1231830 CHECKS=890535000	UNSAT TT=0.97	UNSAT TT=1.281
csp/BH-4-4/ normalized-BlackHole-4-4-e-4_ext.xml	UNSAT TT=0.016	UNSAT TT=0.828 CHECKS=5952 NODES=0	UNSAT TT=0.801 CHECKS=5952 NODES=0	UNSAT TT=0.076	UNSAT TT=5.433 CHECKS=3141050	UNSAT TT=2.79 CHECKS=2122930	UNSAT TT=0.69 ASSIGNMENTS=0	UNSAT TT=0.558 ASSIGNMENTS=0	UNSAT TT=1.715 CHECKS=81605 NODES=5880	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=1.641	UNSAT TT=1.336	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=2.505	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=1.798	UNSAT TT=450.615 ASSIGNMENTS=1231830 CHECKS=890535000	UNSAT TT=1.061	UNSAT TT=0.982
csp/BH-4-4/ normalized-BlackHole-4-4-e-5_ext.xml	UNSAT TT=0.016	UNSAT TT=0.795 CHECKS=5952 NODES=0	UNSAT TT=0.778 CHECKS=5952 NODES=0	UNSAT TT=0.076	UNSAT TT=5.431 CHECKS=3130040	UNSAT TT=2.769 CHECKS=2114300	UNSAT TT=0.556 ASSIGNMENTS=0	UNSAT TT=0.578 ASSIGNMENTS=0	UNSAT TT=1.863 CHECKS=81626 NODES=5880	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.671	UNSAT TT=1.263	No data	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=2.552	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.778	UNSAT TT=448.105 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=0.975	UNSAT TT=0.976
csp/BH-4-4/ normalized-BlackHole-4-4-e-6_ext.xml	UNSAT TT=0.016	UNSAT TT=0.823 CHECKS=5952 NODES=0	UNSAT TT=0.79 CHECKS=5952 NODES=0	UNSAT TT=0.075	UNSAT TT=5.077 CHECKS=3183010	UNSAT TT=2.768 CHECKS=2140010	UNSAT TT=0.557 ASSIGNMENTS=0	UNSAT TT=0.562 ASSIGNMENTS=0	UNSAT TT=1.976 CHECKS=80410 NODES=5889	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=1.691	UNSAT TT=1.54	No data	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=2.653	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=2.085	UNSAT TT=453.138 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.104	UNSAT TT=1.327
csp/BH-4-4/ normalized-BlackHole-4-4-e-7_ext.xml	UNSAT TT=0.017	UNSAT TT=0.833 CHECKS=5952 NODES=0	UNSAT TT=0.788 CHECKS=5952 NODES=0	UNSAT TT=0.075	UNSAT TT=5.441 CHECKS=3081900	UNSAT TT=2.591 CHECKS=2153790	UNSAT TT=0.591 ASSIGNMENTS=0	UNSAT TT=0.629 ASSIGNMENTS=0	UNSAT TT=1.828 CHECKS=79569 NODES=5836	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.393	UNSAT TT=1.406	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=2.536	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.803	UNSAT TT=418.115 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.309	UNSAT TT=1.047
csp/BH-4-4/ normalized-BlackHole-4-4-e-8_ext.xml	UNSAT TT=0.016	UNSAT TT=0.826 CHECKS=5952 NODES=0	UNSAT TT=0.924 CHECKS=5952 NODES=0	UNSAT TT=0.07	UNSAT TT=5.004 CHECKS=3080150	UNSAT TT=2.767 CHECKS=2122160	UNSAT TT=0.556 ASSIGNMENTS=0	UNSAT TT=0.561 ASSIGNMENTS=0	UNSAT TT=1.707 CHECKS=80400 NODES=5890	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=1.511	UNSAT TT=1.385	No data	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=2.508	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=2.066	UNSAT TT=448.144 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.197	UNSAT TT=1.029
csp/BH-4-4/ normalized-BlackHole-4-4-e-9_ext.xml	UNSAT TT=0.016	UNSAT TT=0.817 CHECKS=5952 NODES=0	UNSAT TT=0.86 CHECKS=5952 NODES=0	UNSAT TT=0.076	UNSAT TT=5.096 CHECKS=3096090	UNSAT TT=2.734 CHECKS=2132950	UNSAT TT=0.565 ASSIGNMENTS=0	UNSAT TT=0.73 ASSIGNMENTS=0	UNSAT TT=1.845 CHECKS=81620 NODES=5882	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=1.404	UNSAT TT=1.28	No data	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=2.366	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=1.978	UNSAT TT=437.595 ASSIGNMENTS=1231830 CHECKS=890535000	UNSAT TT=0.978	UNSAT TT=1.025
csp/BH-4-7/ normalized-BlackHole-4-7-e-0_ext.xml	UNSAT TT=0.042	UNSAT TT=0.957 CHECKS=10265 NODES=0	UNSAT TT=0.924 CHECKS=10265 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.718 ASSIGNMENTS=0	UNSAT TT=0.749 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.09	? (TO) TT=1800.07	No data	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.11	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.2	? (TO) TT=1800.02	UNSAT TT=792.95	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-e-1_ext.xml	UNSAT TT=0.041	UNSAT TT=0.979 CHECKS=10265 NODES=0	UNSAT TT=0.923 CHECKS=10265 NODES=0	UNSAT TT=0.174	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=0.739 ASSIGNMENTS=0	UNSAT TT=0.723 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.05	? (TO) TT=1800.02	No data	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.02	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.18	? (TO) TT=1800.09	UNSAT TT=894.724	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-7/ normalized-BlackHole-4-7-e-2_ext.xml	UNSAT TT=0.044	UNSAT TT=0.936 CHECKS=10313 NODES=0	UNSAT TT=1.002 CHECKS=10313 NODES=0	UNSAT TT=0.165	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.72 ASSIGNMENTS=0	UNSAT TT=0.736 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.055 ASSIGNMENTS=0 CHECKS=4043	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=4043	? (TO) TT=1800.01	? (TO) TT=1800.06	No data	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4043	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=4043	? (TO) TT=1800.09	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4043	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4043	? (TO) TT=1800.14	? (TO) TT=1800.11	UNSAT TT=1359.03	? (TO) TT=1800.04
csp/BH-4-7/ normalized-BlackHole-4-7-e-3_ext.xml	UNSAT TT=0.042	UNSAT TT=0.967 CHECKS=10264 NODES=0	UNSAT TT=1 CHECKS=10264 NODES=0	UNSAT TT=74.257	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.732 ASSIGNMENTS=0	UNSAT TT=0.737 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.09	? (TO) TT=1800.07	No data	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.08	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.22	? (TO) TT=1800.06	UNSAT TT=842.823	? (TO) TT=1800.07
csp/BH-4-7/ normalized-BlackHole-4-7-e-4_ext.xml	UNSAT TT=0.045	UNSAT TT=1.094 CHECKS=10312 NODES=0	UNSAT TT=0.91 CHECKS=10312 NODES=0	UNSAT TT=0.174	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.815 ASSIGNMENTS=0	UNSAT TT=0.941 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.07	? (TO) TT=1800.06	No data	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.11	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.1	? (TO) TT=1800.05	UNSAT TT=797.83	? (TO) TT=1800.09
csp/BH-4-7/ normalized-BlackHole-4-7-e-5_ext.xml	UNSAT TT=0.043	UNSAT TT=0.952 CHECKS=10264 NODES=0	UNSAT TT=0.92 CHECKS=10264 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=0.959 ASSIGNMENTS=0	UNSAT TT=0.768 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4042	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=4042	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4042	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4042	? (TO) TT=1800.1	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4042	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4042	? (TO) TT=1800.16	? (TO) TT=1800.02	UNSAT TT=1190.02	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-e-6_ext.xml	UNSAT TT=0.043	UNSAT TT=0.992 CHECKS=10264 NODES=0	UNSAT TT=0.971 CHECKS=10264 NODES=0	UNSAT TT=0.177	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.717 ASSIGNMENTS=0	UNSAT TT=0.909 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.06	? (TO) TT=1800.04	No data	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.13	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=1571.33	? (TO) TT=1800.08
csp/BH-4-7/ normalized-BlackHole-4-7-e-7_ext.xml	UNSAT TT=0.041	UNSAT TT=0.91 CHECKS=10265 NODES=0	UNSAT TT=0.933 CHECKS=10265 NODES=0	UNSAT TT=0.175	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.928 ASSIGNMENTS=0	UNSAT TT=0.943 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.05	? (TO) TT=1800.01	No data	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.05	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.14	? (TO) TT=1800.05	UNSAT TT=820.818	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-e-8_ext.xml	UNSAT TT=0.04	UNSAT TT=0.967 CHECKS=10264 NODES=0	UNSAT TT=0.917 CHECKS=10264 NODES=0	UNSAT TT=0.165	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.798 ASSIGNMENTS=0	UNSAT TT=0.75 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.05	? (TO) TT=1800.02	No data	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.1	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.14	? (TO) TT=1800.03	UNSAT TT=827.602	? (TO) TT=1800.05
csp/BH-4-7/ normalized-BlackHole-4-7-e-9_ext.xml	UNSAT TT=0.041	UNSAT TT=1.004 CHECKS=10312 NODES=0	UNSAT TT=0.912 CHECKS=10312 NODES=0	UNSAT TT=0.174	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.931 ASSIGNMENTS=0	UNSAT TT=0.939 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.09	? (TO) TT=1800.08	No data	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.03	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.19	? (TO) TT=1800.03	UNSAT TT=883.361	? (TO) TT=1800.05
csp/BH-4-7/ normalized-BlackHole-4-7-h-0_ext.xml	UNSAT TT=0.042	UNSAT TT=0.929 CHECKS=10264 NODES=0	UNSAT TT=0.923 CHECKS=10264 NODES=0	UNSAT TT=0.177	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.71 ASSIGNMENTS=0	UNSAT TT=0.781 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.02	? (TO) TT=1800.09	No data	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.11	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.17	? (TO) TT=1800.05	UNSAT TT=1692.7	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-h-1_ext.xml	UNSAT TT=0.042	UNSAT TT=1.081 CHECKS=10264 NODES=0	UNSAT TT=0.925 CHECKS=10264 NODES=0	UNSAT TT=68.847	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.802 ASSIGNMENTS=0	UNSAT TT=0.982 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.06	? (TO) TT=1800.07	No data	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.04	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.14	? (TO) TT=1800.08	UNSAT TT=690.887	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-7/ normalized-BlackHole-4-7-h-2_ext.xml	UNSAT TT=0.044	UNSAT TT=0.963 CHECKS=10265 NODES=0	UNSAT TT=1.002 CHECKS=10265 NODES=0	UNSAT TT=0.176	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=0.929 ASSIGNMENTS=0	UNSAT TT=0.95 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=4014	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4014	? (TO) TT=1800.02	? (TO) TT=1800.03	No data	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4014	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4014	? (TO) TT=1800.11	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4014	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4014	? (TO) TT=1800.17	? (TO) TT=1800.02	UNSAT TT=887.297	? (TO) TT=1800.12
csp/BH-4-7/ normalized-BlackHole-4-7-h-3_ext.xml	UNSAT TT=0.04	UNSAT TT=0.976 CHECKS=10265 NODES=0	UNSAT TT=1.078 CHECKS=10265 NODES=0	UNSAT TT=0.176	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.753 ASSIGNMENTS=0	UNSAT TT=0.774 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.03	? (TO) TT=1800.02	No data	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.05	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=960.49	? (TO) TT=1800.05
csp/BH-4-7/ normalized-BlackHole-4-7-h-4_ext.xml	UNSAT TT=0.042	UNSAT TT=0.976 CHECKS=10312 NODES=0	UNSAT TT=0.959 CHECKS=10312 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.708 ASSIGNMENTS=0	UNSAT TT=0.948 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.04	? (TO) TT=1800.08	No data	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.12	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.12	? (TO) TT=1800.06	UNSAT TT=763.982	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-h-5_ext.xml	UNSAT TT=0.045	UNSAT TT=1.003 CHECKS=10264 NODES=0	UNSAT TT=0.917 CHECKS=10264 NODES=0	UNSAT TT=0.177	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.935 ASSIGNMENTS=0	UNSAT TT=0.946 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.04	? (TO) TT=1800.02	No data	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.1	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.17	? (TO) TT=1800.08	UNSAT TT=996.538	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-h-6_ext.xml	UNSAT TT=0.041	UNSAT TT=1.065 CHECKS=10313 NODES=0	UNSAT TT=0.913 CHECKS=10313 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.945 ASSIGNMENTS=0	UNSAT TT=0.944 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3984	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3984	? (TO) TT=1800.07	? (TO) TT=1800.03	No data	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3984	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3984	? (TO) TT=1800.08	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=3984	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3984	? (TO) TT=1800.13	? (TO) TT=1800.09	UNSAT TT=831.31	? (TO) TT=1800.11
csp/BH-4-7/ normalized-BlackHole-4-7-h-7_ext.xml	UNSAT TT=0.046	UNSAT TT=1.012 CHECKS=10312 NODES=0	UNSAT TT=1.022 CHECKS=10312 NODES=0	UNSAT TT=0.164	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.707 ASSIGNMENTS=0	UNSAT TT=0.952 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.08	? (TO) TT=1800.07	No data	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.07	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=1374.78	? (TO) TT=1800.07
csp/BH-4-7/ normalized-BlackHole-4-7-h-8_ext.xml	UNSAT TT=0.045	UNSAT TT=0.982 CHECKS=10313 NODES=0	UNSAT TT=0.918 CHECKS=10313 NODES=0	UNSAT TT=0.175	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.924 ASSIGNMENTS=0	UNSAT TT=0.945 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.05	? (TO) TT=1800.02	No data	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.08	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.13	? (TO) TT=1800.05	UNSAT TT=556.01	? (TO) TT=1800.06
csp/BH-4-7/ normalized-BlackHole-4-7-h-9_ext.xml	UNSAT TT=0.043	UNSAT TT=1.108 CHECKS=10264 NODES=0	UNSAT TT=0.914 CHECKS=10264 NODES=0	UNSAT TT=74.22	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.92 ASSIGNMENTS=0	UNSAT TT=0.783 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.052 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.08	? (TO) TT=1800.09	No data	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.07	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.19	? (TO) TT=1800.09	UNSAT TT=794.336	? (TO) TT=1800.1
csp/bibd10-11/ normalized-bibd-10-120-36-3-8_glb.xml	SAT TT=21.153	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.15	No data	No data	No data	? (TO) TT=1800	? (TO) TT=1800.06	No data	No data	No data	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? TT=6.151	No data	SAT TT=29.399	SAT TT=21.153
csp/bibd10-11/ normalized-bibd-10-30-9-3-2_glb.xml	SAT TT=0.104	SAT TT=723.966 CHECKS=109759000 NODES=2889730	SAT TT=72.094 CHECKS=7950540 NODES=278290	SAT TT=3.29	SAT TT=15.525 CHECKS=2472780	SAT TT=19.371 CHECKS=4553240	SAT TT=39.83 ASSIGNMENTS=102877	SAT TT=37.398 ASSIGNMENTS=102877	No data	No data	No data	SAT TT=0.12 ASSIGNMENTS=272 CHECKS=21118	SAT TT=0.119 ASSIGNMENTS=272 CHECKS=21118	No data	No data	No data	SAT TT=0.106 ASSIGNMENTS=330 CHECKS=26648	? (TO) TT=1800.06	SAT TT=1.211	SAT TT=0.305 ASSIGNMENTS=3695 CHECKS=264240	SAT TT=0.104 ASSIGNMENTS=186 CHECKS=6883	? TT=3.558	No data	SAT TT=3.351	SAT TT=4.313
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd10-11/ normalized-bibd-10-60-18-3-4_glb.xml	SAT TT=0.233	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.13	SAT TT=977.381 CHECKS=96017400	? (TO) TT=1800.14	? (TO) TT=1800.11	No data	No data	No data	SAT TT=0.534 ASSIGNMENTS=6638 CHECKS=576362	SAT TT=0.497 ASSIGNMENTS=6638 CHECKS=576362	No data	No data	No data	SAT TT=0.33 ASSIGNMENTS=2533 CHECKS=232268	? (TO) TT=1800.1	SAT TT=3.246	SAT TT=8.057 ASSIGNMENTS=48223 CHECKS=4971410	SAT TT=0.233 ASSIGNMENTS=605 CHECKS=38199	? TT=4.839	No data	SAT TT=7.121	SAT TT=7.625
csp/bibd10-11/ normalized-bibd-10-90-27-3-6_glb.xml	SAT TT=0.509	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=35.836 CHECKS=2350580	? (TO) TT=1800.09	? (TO) TT=1800.12	No data	No data	No data	SAT TT=368.908 ASSIGNMENTS=3374 CHECKS=259943	SAT TT=675.111 ASSIGNMENTS=3374 CHECKS=259943	No data	No data	No data	SAT TT=2.641 ASSIGNMENTS=35752 CHECKS=3651970	SAT TT=1.158 ASSIGNMENTS=165092 CHECKS=1831780	SAT TT=613.928	SAT TT=22.16 ASSIGNMENTS=126231 CHECKS=13222700	SAT TT=0.509 ASSIGNMENTS=3374 CHECKS=259943	? TT=5.211	No data	SAT TT=13.746	SAT TT=12.49
csp/bibd10-11/ normalized-bibd-11-110-30-3-6_glb.xml	SAT TT=11.467	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.14	No data	No data	No data	? (TO) TT=1800.06	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.07	SAT TT=11.467 ASSIGNMENTS=395622 CHECKS=18522800	? (TO) TT=1800.06	SAT TT=1408.18 ASSIGNMENTS=4600210 CHECKS=560875000	? (TO) TT=1800.08	? TT=6.242	No data	SAT TT=149.712	SAT TT=29.065
csp/bibd10-11/ normalized-bibd-11-55-15-3-3_glb.xml	SAT TT=0.364	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	No data	No data	No data	SAT TT=0.532 ASSIGNMENTS=6640 CHECKS=495336	SAT TT=0.53 ASSIGNMENTS=6640 CHECKS=495336	No data	No data	No data	SAT TT=0.364 ASSIGNMENTS=3693 CHECKS=266337	? (TO) TT=1800.04	SAT TT=12.032	SAT TT=4.382 ASSIGNMENTS=31955 CHECKS=3649540	? (TO) TT=1800.1	? TT=4.657	No data	SAT TT=6.579	SAT TT=9.842
csp/bibd12-13/ normalized-bibd-12-132-33-3-6_glb.xml	SAT TT=29	? (TO) TT=1800.09	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.17	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.05	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	? TT=7.101	No data	SAT TT=309.765	SAT TT=29
csp/bibd12-13/ normalized-bibd-12-44-11-3-2_glb.xml	SAT TT=0.26	? (TO) TT=1800.16	SAT TT=1288.14 CHECKS=215793000 NODES=2312320	SAT TT=108.413	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	No data	No data	No data	SAT TT=0.338 ASSIGNMENTS=2621 CHECKS=194100	SAT TT=0.351 ASSIGNMENTS=2621 CHECKS=194100	No data	No data	No data	SAT TT=0.327 ASSIGNMENTS=2658 CHECKS=217704	SAT TT=30.944 ASSIGNMENTS=704301 CHECKS=81939300	SAT TT=1.957	SAT TT=4.091 ASSIGNMENTS=33798 CHECKS=3425580	SAT TT=0.26 ASSIGNMENTS=686 CHECKS=59493	? TT=4.909	No data	SAT TT=5.998	SAT TT=8.49
csp/bibd12-13/ normalized-bibd-12-88-22-3-4_glb.xml	SAT TT=10.057	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=67.423 CHECKS=4485680	? (TO) TT=1800.07	? (TO) TT=1800.12	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.04	No data	No data	No data	SAT TT=29.741 ASSIGNMENTS=354353 CHECKS=39366900	? (TO) TT=1800.09	SAT TT=10.057	SAT TT=61.92 ASSIGNMENTS=194330 CHECKS=26122000	? (TO) TT=1800.06	? TT=6.138	No data	SAT TT=28.086	SAT TT=19.531
csp/bibd12-13/ normalized-bibd-13-104-24-3-4_glb.xml	SAT TT=23.442	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=407.822 CHECKS=18513700	? (TO) TT=1800.08	? (TO) TT=1800.1	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.02	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.03	? TT=6.62	No data	SAT TT=167.034	SAT TT=23.442
csp/bibd12-13/ normalized-bibd-13-26-6-3-1_glb.xml	SAT TT=0.16	SAT TT=7.836 CHECKS=392839 NODES=8814	SAT TT=199.569 CHECKS=14738900 NODES=495323	SAT TT=11.72	SAT TT=18.987 CHECKS=2453470	SAT TT=12.334 CHECKS=2490340	SAT TT=54.837 ASSIGNMENTS=84247	SAT TT=52.862 ASSIGNMENTS=84247	No data	No data	No data	SAT TT=0.183 ASSIGNMENTS=707 CHECKS=54023	SAT TT=0.183 ASSIGNMENTS=707 CHECKS=54023	No data	No data	No data	SAT TT=0.16 ASSIGNMENTS=686 CHECKS=59214	SAT TT=1303.38 ASSIGNMENTS=25891600 CHECKS=4041350000	SAT TT=1.758	SAT TT=1.417 ASSIGNMENTS=15474 CHECKS=1918200	SAT TT=0.161 ASSIGNMENTS=244 CHECKS=13099	? TT=3.957	No data	SAT TT=4.043	SAT TT=4.546
csp/bibd12-13/ normalized-bibd-13-52-12-3-2_glb.xml	SAT TT=0.938	? (TO) TT=1800.16	? (TO) TT=1800.18	SAT TT=800.117	? (TO) TT=1800.07	SAT TT=146.969 CHECKS=12437800	? (TO) TT=1800.1	? (TO) TT=1800.14	No data	No data	No data	SAT TT=0.938 ASSIGNMENTS=10516 CHECKS=1175410	SAT TT=0.938 ASSIGNMENTS=10516 CHECKS=1175410	No data	No data	No data	SAT TT=1.732 ASSIGNMENTS=24811 CHECKS=2231020	? (TO) TT=1800.04	SAT TT=2.758	SAT TT=6.46 ASSIGNMENTS=38073 CHECKS=4480870	SAT TT=590.666 ASSIGNMENTS=6738700 CHECKS=804298000	? TT=5.664	No data	SAT TT=9.305	SAT TT=10.62
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd12-13/ normalized-bibd-13-78-18-3-3_glb.xml	SAT TT=25.354	? (TO) TT=1800.18	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=61.537 CHECKS=3239740	? (TO) TT=1800.11	? (TO) TT=1800.13	No data	No data	No data	? (TO) TT=1800.01	? (TO) TT=1800.1	No data	No data	No data	SAT TT=30.774 ASSIGNMENTS=489695 CHECKS=41055900	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=45.829 ASSIGNMENTS=161298 CHECKS=22615600	? (TO) TT=1800.05	? TT=6.272	No data	SAT TT=25.354	SAT TT=79.565
csp/bibd6/ normalized-bibd-6-100-50-3-20_glb.xml	SAT TT=0.145	SAT TT=5.682 CHECKS=46762 NODES=7452	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=60.266 CHECKS=6299730	SAT TT=76.783 CHECKS=8497670	? (TO) TT=1800.07	? (TO) TT=1800.13	No data	No data	No data	SAT TT=368.47 ASSIGNMENTS=623 CHECKS=28068	SAT TT=674.154 ASSIGNMENTS=623 CHECKS=28068	No data	No data	No data	? (TO) TT=1800.04	SAT TT=28.643 ASSIGNMENTS=781021 CHECKS=42627200	SAT TT=21.47	? (TO) TT=1800.11	SAT TT=0.145 ASSIGNMENTS=623 CHECKS=28068	? TT=3.632	No data	SAT TT=113.607	SAT TT=7.496
csp/bibd6/ normalized-bibd-6-10-5-3-2_glb.xml	SAT TT=0.017	SAT TT=1.095 CHECKS=2794 NODES=440	SAT TT=1.205 CHECKS=17312 NODES=1613	SAT TT=0.075	SAT TT=0.096 CHECKS=9868	SAT TT=0.04 CHECKS=5055	SAT TT=0.825 ASSIGNMENTS=74	SAT TT=0.886 ASSIGNMENTS=74	No data	No data	No data	SAT TT=0.03 ASSIGNMENTS=24 CHECKS=720	SAT TT=0.03 ASSIGNMENTS=24 CHECKS=720	No data	No data	No data	SAT TT=0.018 ASSIGNMENTS=24 CHECKS=720	SAT TT=0.024 ASSIGNMENTS=545 CHECKS=20936	SAT TT=0.542	SAT TT=0.019 ASSIGNMENTS=268 CHECKS=8775	SAT TT=0.017 ASSIGNMENTS=24 CHECKS=720	? TT=1.119	No data	SAT TT=1.277	SAT TT=1.284
csp/bibd6/ normalized-bibd-6-20-10-3-4_glb.xml	SAT TT=0.028	SAT TT=1.864 CHECKS=5680 NODES=832	SAT TT=2.921 CHECKS=130244 NODES=10142	SAT TT=0.429	SAT TT=0.369 CHECKS=70107	SAT TT=0.229 CHECKS=55893	SAT TT=1.735 ASSIGNMENTS=3135	SAT TT=1.542 ASSIGNMENTS=3135	No data	No data	No data	SAT TT=0.041 ASSIGNMENTS=62 CHECKS=2035	SAT TT=0.039 ASSIGNMENTS=62 CHECKS=2035	No data	No data	No data	SAT TT=0.03 ASSIGNMENTS=62 CHECKS=2035	SAT TT=0.12 ASSIGNMENTS=13120 CHECKS=283293	SAT TT=0.724	SAT TT=0.028 ASSIGNMENTS=52 CHECKS=1440	SAT TT=0.029 ASSIGNMENTS=84 CHECKS=3877	? TT=1.73	No data	SAT TT=1.514	SAT TT=1.999
csp/bibd6/ normalized-bibd-6-30-15-3-6_glb.xml	SAT TT=0.082	SAT TT=3.2 CHECKS=9898 NODES=1527	SAT TT=3.256 CHECKS=43947 NODES=5537	SAT TT=105.615	SAT TT=0.82 CHECKS=171996	SAT TT=0.611 CHECKS=137634	SAT TT=4.232 ASSIGNMENTS=20540	SAT TT=4.205 ASSIGNMENTS=20540	No data	No data	No data	SAT TT=0.284 ASSIGNMENTS=9635 CHECKS=572445	SAT TT=0.284 ASSIGNMENTS=9635 CHECKS=572445	No data	No data	No data	SAT TT=0.267 ASSIGNMENTS=9950 CHECKS=595078	SAT TT=9.563 ASSIGNMENTS=323773 CHECKS=29408500	SAT TT=0.847	SAT TT=0.082 ASSIGNMENTS=1438 CHECKS=69881	SAT TT=0.311 ASSIGNMENTS=11914 CHECKS=739122	? TT=2.077	No data	SAT TT=2.175	SAT TT=2.041
csp/bibd6/ normalized-bibd-6-40-20-3-8_glb.xml	SAT TT=0.06	SAT TT=6.187 CHECKS=10479 NODES=1748	SAT TT=448.664 CHECKS=52963300 NODES=3487080	? (TO) TT=1800.03	SAT TT=9.36 CHECKS=2057880	SAT TT=3.493 CHECKS=782573	SAT TT=3.37 ASSIGNMENTS=12310	SAT TT=3.639 ASSIGNMENTS=12310	No data	No data	No data	SAT TT=0.067 ASSIGNMENTS=272 CHECKS=15748	SAT TT=0.07 ASSIGNMENTS=272 CHECKS=15748	No data	No data	No data	SAT TT=0.06 ASSIGNMENTS=275 CHECKS=16422	SAT TT=1.052 ASSIGNMENTS=47078 CHECKS=2578880	SAT TT=1.164	SAT TT=0.232 ASSIGNMENTS=4800 CHECKS=283923	SAT TT=0.813 ASSIGNMENTS=23484 CHECKS=1867720	? TT=2.216	No data	SAT TT=2.342	SAT TT=2.707
csp/bibd6/ normalized-bibd-6-50-25-3-10_glb.xml	SAT TT=0.074	SAT TT=12.777 CHECKS=19849 NODES=3419	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=13.371 CHECKS=2692130	SAT TT=4.295 CHECKS=779543	SAT TT=2.786 ASSIGNMENTS=5051	SAT TT=2.826 ASSIGNMENTS=5051	No data	No data	No data	SAT TT=0.196 ASSIGNMENTS=2728 CHECKS=243038	SAT TT=0.193 ASSIGNMENTS=2728 CHECKS=243038	No data	No data	No data	SAT TT=0.159 ASSIGNMENTS=2728 CHECKS=243038	SAT TT=0.277 ASSIGNMENTS=33082 CHECKS=542137	SAT TT=1.047	SAT TT=1.204 ASSIGNMENTS=23249 CHECKS=1586990	SAT TT=0.074 ASSIGNMENTS=402 CHECKS=19997	? TT=2.503	No data	SAT TT=3.064	SAT TT=2.94
csp/bibd6/ normalized-bibd-6-60-30-3-12_glb.xml	SAT TT=1.132	SAT TT=20 CHECKS=16299 NODES=2887	SAT TT=18.768 CHECKS=565247 NODES=19954	? (TO) TT=1800.06	SAT TT=14.793 CHECKS=2304870	SAT TT=23.755 CHECKS=3943900	? (TO) TT=1800.12	? (TO) TT=1800.12	No data	No data	No data	SAT TT=9.959 ASSIGNMENTS=59948 CHECKS=4536220	SAT TT=360.193 ASSIGNMENTS=1832390 CHECKS=65255500	No data	No data	No data	? (TO) TT=1800.1	SAT TT=3.723 ASSIGNMENTS=104134 CHECKS=7917050	SAT TT=1.132	? (TO) TT=1800.03	SAT TT=2.191 ASSIGNMENTS=59948 CHECKS=4536220	? TT=2.834	No data	SAT TT=2.669	SAT TT=3.376
csp/bibd6/ normalized-bibd-6-70-35-3-14_glb.xml	SAT TT=0.091	SAT TT=36.01 CHECKS=18935 NODES=3157	? (TO) TT=1800.13	? (TO) TT=1800.12	SAT TT=36.904 CHECKS=5708050	SAT TT=41.456 CHECKS=6101730	SAT TT=77.36 ASSIGNMENTS=267550	SAT TT=83.456 ASSIGNMENTS=267550	No data	No data	No data	SAT TT=7.603 ASSIGNMENTS=321 CHECKS=12417	SAT TT=674.152 ASSIGNMENTS=321 CHECKS=12417	No data	No data	No data	? (TO) TT=1800.09	SAT TT=773.342 ASSIGNMENTS=13978100 CHECKS=1590520000	SAT TT=1.373	SAT TT=3.362 ASSIGNMENTS=36156 CHECKS=3103070	SAT TT=0.091 ASSIGNMENTS=321 CHECKS=12417	? TT=3.146	No data	SAT TT=3.161	SAT TT=4.336
csp/bibd6/ normalized-bibd-6-80-40-3-16_glb.xml	SAT TT=0.105	SAT TT=4.149 CHECKS=26033 NODES=4524	? (TO) TT=1800.17	? (TO) TT=1800.05	SAT TT=11.218 CHECKS=1367770	SAT TT=45.7 CHECKS=6134450	? (TO) TT=1800.09	? (TO) TT=1800.08	No data	No data	No data	SAT TT=367.771 ASSIGNMENTS=286 CHECKS=10490	SAT TT=673.67 ASSIGNMENTS=286 CHECKS=10490	No data	No data	No data	SAT TT=256.839 ASSIGNMENTS=10116200 CHECKS=440831000	SAT TT=14.713 ASSIGNMENTS=340188 CHECKS=24217700	SAT TT=2.407	SAT TT=2.767 ASSIGNMENTS=30151 CHECKS=2745450	SAT TT=0.105 ASSIGNMENTS=286 CHECKS=10490	? TT=3.059	No data	SAT TT=7.464	SAT TT=5.607
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd6/ normalized-bibd-6-90-45-3-18_glb.xml	SAT TT=1.295	SAT TT=4.099 CHECKS=16396 NODES=3777	SAT TT=676.199 CHECKS=85573200 NODES=1415260	? (TO) TT=1800.09	SAT TT=105.604 CHECKS=12362100	SAT TT=182.167 CHECKS=21784700	? (TO) TT=1800.13	? (TO) TT=1800.11	No data	No data	No data	SAT TT=369.213 ASSIGNMENTS=15562 CHECKS=1716710	SAT TT=675.973 ASSIGNMENTS=15562 CHECKS=1716710	No data	No data	No data	? (TO) TT=1800.11	SAT TT=90.771 ASSIGNMENTS=1259360 CHECKS=141450000	SAT TT=5.814	? (TO) TT=1800.1	SAT TT=1.295 ASSIGNMENTS=15562 CHECKS=1716710	? TT=3.674	No data	SAT TT=48.7	SAT TT=5.721
csp/bibd7/ normalized-bibd-7-07-3-3-1_glb.xml	SAT TT=0.016	SAT TT=1.047 CHECKS=1719 NODES=233	SAT TT=1.091 CHECKS=2464 NODES=216	SAT TT=0.071	SAT TT=0.083 CHECKS=3577	SAT TT=0.047 CHECKS=8159	SAT TT=0.881 ASSIGNMENTS=29	SAT TT=0.824 ASSIGNMENTS=29	No data	No data	No data	SAT TT=0.03 ASSIGNMENTS=23 CHECKS=911	SAT TT=0.028 ASSIGNMENTS=23 CHECKS=911	No data	No data	No data	SAT TT=0.016 ASSIGNMENTS=23 CHECKS=911	SAT TT=0.019 ASSIGNMENTS=111 CHECKS=4968	SAT TT=0.622	SAT TT=0.019 ASSIGNMENTS=69 CHECKS=2031	SAT TT=0.016 ASSIGNMENTS=23 CHECKS=939	? TT=1.2	No data	SAT TT=1.447	SAT TT=1.195
csp/bibd7/ normalized-bibd-7-14-6-3-2_glb.xml	SAT TT=0.026	SAT TT=1.516 CHECKS=32569 NODES=1640	SAT TT=1.671 CHECKS=39651 NODES=2182	SAT TT=0.128	SAT TT=0.3 CHECKS=61353	SAT TT=0.172 CHECKS=48698	SAT TT=1.143 ASSIGNMENTS=325	SAT TT=1.177 ASSIGNMENTS=325	No data	No data	No data	SAT TT=0.038 ASSIGNMENTS=53 CHECKS=2300	SAT TT=0.038 ASSIGNMENTS=53 CHECKS=2300	No data	No data	No data	SAT TT=0.027 ASSIGNMENTS=51 CHECKS=2299	SAT TT=0.026 ASSIGNMENTS=68 CHECKS=1372	SAT TT=0.712	SAT TT=0.03 ASSIGNMENTS=110 CHECKS=3128	SAT TT=0.03 ASSIGNMENTS=171 CHECKS=12297	? TT=1.694	No data	SAT TT=1.52	SAT TT=1.66
csp/bibd7/ normalized-bibd-7-21-9-3-3_glb.xml	SAT TT=0.035	SAT TT=2.131 CHECKS=57506 NODES=3420	SAT TT=2.307 CHECKS=99781 NODES=5313	SAT TT=0.469	SAT TT=0.674 CHECKS=155722	SAT TT=0.452 CHECKS=115293	SAT TT=1.455 ASSIGNMENTS=1058	SAT TT=1.37 ASSIGNMENTS=1058	No data	No data	No data	SAT TT=0.058 ASSIGNMENTS=417 CHECKS=15349	SAT TT=0.057 ASSIGNMENTS=417 CHECKS=15349	No data	No data	No data	SAT TT=0.088 ASSIGNMENTS=3788 CHECKS=146645	SAT TT=0.312 ASSIGNMENTS=25419 CHECKS=907503	SAT TT=1.074	SAT TT=0.069 ASSIGNMENTS=1345 CHECKS=59358	SAT TT=0.035 ASSIGNMENTS=80 CHECKS=2836	? TT=1.909	No data	SAT TT=1.687	SAT TT=1.833
csp/bibd7/ normalized-bibd-7-28-12-3-4_glb.xml	SAT TT=0.048	SAT TT=2.814 CHECKS=34640 NODES=4038	SAT TT=28.574 CHECKS=4774700 NODES=169506	SAT TT=10.583	SAT TT=1.176 CHECKS=226301	SAT TT=0.745 CHECKS=188058	SAT TT=1.893 ASSIGNMENTS=1115	SAT TT=1.663 ASSIGNMENTS=1115	No data	No data	No data	SAT TT=0.996 ASSIGNMENTS=62169 CHECKS=2205400	SAT TT=1.085 ASSIGNMENTS=62169 CHECKS=2205400	No data	No data	No data	SAT TT=1.017 ASSIGNMENTS=62594 CHECKS=2345940	? (TO) TT=1800.02	SAT TT=1.055	SAT TT=0.2 ASSIGNMENTS=3968 CHECKS=305085	SAT TT=0.048 ASSIGNMENTS=98 CHECKS=2972	? TT=2.349	No data	SAT TT=2.28	SAT TT=2.216
csp/bibd7/ normalized-bibd-7-35-15-3-5_glb.xml	SAT TT=0.062	SAT TT=311.658 CHECKS=77787000 NODES=1115990	SAT TT=11.648 CHECKS=2419940 NODES=30363	SAT TT=424.115	SAT TT=1.435 CHECKS=237386	SAT TT=2.4 CHECKS=624761	SAT TT=1.817 ASSIGNMENTS=1173	SAT TT=1.727 ASSIGNMENTS=1173	No data	No data	No data	SAT TT=7.116 ASSIGNMENTS=294 CHECKS=17010	SAT TT=7.94 ASSIGNMENTS=294 CHECKS=17010	No data	No data	No data	SAT TT=15.976 ASSIGNMENTS=877418 CHECKS=37314900	? (TO) TT=1800	SAT TT=1.179	SAT TT=0.304 ASSIGNMENTS=5621 CHECKS=388512	SAT TT=0.062 ASSIGNMENTS=294 CHECKS=17010	? TT=2.499	No data	SAT TT=2.196	SAT TT=2.419
csp/bibd7/ normalized-bibd-7-42-18-3-6_glb.xml	SAT TT=1.002	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.06	SAT TT=9.224 CHECKS=2070440	SAT TT=1.186 CHECKS=212203	SAT TT=2.04 ASSIGNMENTS=1228	SAT TT=1.944 ASSIGNMENTS=1228	No data	No data	No data	SAT TT=11.361 ASSIGNMENTS=103369 CHECKS=7276900	SAT TT=10.469 ASSIGNMENTS=103369 CHECKS=7276900	No data	No data	No data	SAT TT=72.958 ASSIGNMENTS=3188800 CHECKS=162715000	? (TO) TT=1800.07	SAT TT=1.002	SAT TT=1.65 ASSIGNMENTS=28568 CHECKS=1917350	SAT TT=3.396 ASSIGNMENTS=103369 CHECKS=7276900	? TT=2.97	No data	SAT TT=2.896	SAT TT=3.034
csp/bibd7/ normalized-bibd-7-49-21-3-7_glb.xml	SAT TT=0.393	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.03	SAT TT=26.21 CHECKS=4502970	SAT TT=1.724 CHECKS=313068	SAT TT=2.185 ASSIGNMENTS=1274	SAT TT=2.532 ASSIGNMENTS=1274	No data	No data	No data	SAT TT=8.109 ASSIGNMENTS=7900 CHECKS=675074	SAT TT=12.403 ASSIGNMENTS=1778 CHECKS=9354	No data	No data	No data	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=1.313	SAT TT=0.548 ASSIGNMENTS=6979 CHECKS=515398	SAT TT=0.393 ASSIGNMENTS=7900 CHECKS=675074	? TT=3.182	No data	SAT TT=3.794	SAT TT=3.425
csp/bibd7/ normalized-bibd-7-56-24-3-8_glb.xml	SAT TT=0.152	SAT TT=22.952 CHECKS=3998430 NODES=55162	? (TO) TT=1800.15	? (TO) TT=1800.11	SAT TT=27.427 CHECKS=3470550	SAT TT=2.265 CHECKS=330601	SAT TT=3.08 ASSIGNMENTS=1318	SAT TT=2.833 ASSIGNMENTS=1318	No data	No data	No data	SAT TT=7.647 ASSIGNMENTS=1592 CHECKS=106704	SAT TT=8.854 ASSIGNMENTS=2022 CHECKS=10479	No data	No data	No data	? (TO) TT=1800.01	SAT TT=1.385 ASSIGNMENTS=85591 CHECKS=2681420	SAT TT=1.4	SAT TT=52.764 ASSIGNMENTS=799256 CHECKS=56559600	SAT TT=0.152 ASSIGNMENTS=1592 CHECKS=106704	? TT=2.987	No data	SAT TT=3.344	SAT TT=3.754
csp/bibd7/ normalized-bibd-7-63-27-3-9_glb.xml	SAT TT=0.13	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=18.197 CHECKS=2478930	SAT TT=3.259 CHECKS=450309	SAT TT=3.128 ASSIGNMENTS=1364	SAT TT=3.367 ASSIGNMENTS=1364	No data	No data	No data	SAT TT=7.122 ASSIGNMENTS=740 CHECKS=53457	SAT TT=8.937 ASSIGNMENTS=2229 CHECKS=11599	No data	No data	No data	SAT TT=322.356 ASSIGNMENTS=7978280 CHECKS=654406000	SAT TT=1210.53 ASSIGNMENTS=28155400 CHECKS=2866900000	SAT TT=1.255	SAT TT=2.465 ASSIGNMENTS=27536 CHECKS=2020620	SAT TT=0.13 ASSIGNMENTS=740 CHECKS=53457	? TT=3.586	No data	SAT TT=4.527	SAT TT=4.409
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd7/ normalized-bibd-7-70-30-3-10_glb.xml	SAT TT=1.243	? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.1	SAT TT=30.246 CHECKS=3472150	SAT TT=3.489 CHECKS=463738	SAT TT=3.112 ASSIGNMENTS=1408	SAT TT=3.363 ASSIGNMENTS=1408	No data	No data	No data	SAT TT=9.083 ASSIGNMENTS=2469 CHECKS=12814	SAT TT=10.085 ASSIGNMENTS=2469 CHECKS=12814	No data	No data	No data	SAT TT=10.877 ASSIGNMENTS=297389 CHECKS=21473500	SAT TT=40.549 ASSIGNMENTS=1098250 CHECKS=84972500	SAT TT=1.243	SAT TT=29.125 ASSIGNMENTS=302858 CHECKS=26035900	SAT TT=8.348 ASSIGNMENTS=171688 CHECKS=15588600	? TT=3.512	No data	SAT TT=953.226	SAT TT=5.469
csp/bibd7/ normalized-bibd-7-77-33-3-11_glb.xml	SAT TT=0.913	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=32.223 CHECKS=3143010	SAT TT=40.138 CHECKS=4402440	SAT TT=4.188 ASSIGNMENTS=1454	SAT TT=3.623 ASSIGNMENTS=1454	No data	No data	No data	SAT TT=9.446 ASSIGNMENTS=2709 CHECKS=14006	SAT TT=10.065 ASSIGNMENTS=2709 CHECKS=14006	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=1.624	? (TO) TT=1800.07	SAT TT=0.913 ASSIGNMENTS=15815 CHECKS=1208930	? TT=3.729	No data	SAT TT=6.041	SAT TT=5.425
csp/bibd7/ normalized-bibd-7-84-36-3-12_glb.xml	SAT TT=0.227	? (TO) TT=1800.15	SAT TT=1499.78 CHECKS=199945000 NODES=2220580	? (TO) TT=1800.06	SAT TT=16.726 CHECKS=1428580	SAT TT=39.286 CHECKS=5013330	SAT TT=4.002 ASSIGNMENTS=1496	SAT TT=3.994 ASSIGNMENTS=1496	No data	No data	No data	SAT TT=9.748 ASSIGNMENTS=2949 CHECKS=15196	SAT TT=9.507 ASSIGNMENTS=2949 CHECKS=15196	No data	No data	No data	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=1.704	SAT TT=1163.06 ASSIGNMENTS=10205300 CHECKS=910157000	SAT TT=0.227 ASSIGNMENTS=1643 CHECKS=117182	? TT=3.843	No data	SAT TT=10.634	SAT TT=8.065
csp/bibd7/ normalized-bibd-7-91-39-3-13_glb.xml	SAT TT=0.213	? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.05	SAT TT=33.643 CHECKS=3294560	SAT TT=40.129 CHECKS=3631280	SAT TT=3.973 ASSIGNMENTS=1542	SAT TT=4.227 ASSIGNMENTS=1542	No data	No data	No data	SAT TT=9.362 ASSIGNMENTS=3188 CHECKS=16384	SAT TT=10.12 ASSIGNMENTS=3188 CHECKS=16384	No data	No data	No data	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=1.523	? (TO) TT=1800.08	SAT TT=0.213 ASSIGNMENTS=1294 CHECKS=106767	? TT=4.027	No data	SAT TT=10.716	SAT TT=7.125
csp/bibd7/ normalized-bibd-7-98-42-3-14_glb.xml	SAT TT=0.272	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=43.78 CHECKS=4800760	SAT TT=5.056 ASSIGNMENTS=1588	SAT TT=4.674 ASSIGNMENTS=1588	No data	No data	No data	SAT TT=10.294 ASSIGNMENTS=3370 CHECKS=17483	SAT TT=10.14 ASSIGNMENTS=3370 CHECKS=17483	No data	No data	No data	? (TO) TT=1800.02	SAT TT=174.78 ASSIGNMENTS=3104970 CHECKS=324341000	SAT TT=1.814	SAT TT=9.232 ASSIGNMENTS=76148 CHECKS=7817730	SAT TT=0.272 ASSIGNMENTS=2664 CHECKS=139611	? TT=4.091	No data	SAT TT=6.654	SAT TT=8.16
csp/bibd8/ normalized-bibd-8-14-7-4-3_glb.xml	SAT TT=0.046	SAT TT=1.578 CHECKS=29418 NODES=1633	SAT TT=2.957 CHECKS=10438 NODES=761	SAT TT=0.165	SAT TT=0.635 CHECKS=156588	SAT TT=0.454 CHECKS=151413	SAT TT=1.476 ASSIGNMENTS=665	SAT TT=1.199 ASSIGNMENTS=665	No data	No data	No data	SAT TT=0.06 ASSIGNMENTS=336 CHECKS=41465	SAT TT=0.061 ASSIGNMENTS=336 CHECKS=41465	No data	No data	No data	SAT TT=0.046 ASSIGNMENTS=331 CHECKS=35214	SAT TT=21.917 ASSIGNMENTS=761594 CHECKS=74014000	SAT TT=0.747	SAT TT=0.073 ASSIGNMENTS=1017 CHECKS=85432	SAT TT=0.051 ASSIGNMENTS=626 CHECKS=63104	? TT=1.763	No data	SAT TT=1.604	SAT TT=1.946
csp/bibd8/ normalized-bibd-8-28-14-4-6_glb.xml	SAT TT=0.071	SAT TT=3.546 CHECKS=105912 NODES=4399	? (TO) TT=1800.09	SAT TT=29.635	? (TO) TT=1800.09	SAT TT=55.44 CHECKS=14017800	SAT TT=5.863 ASSIGNMENTS=16673	SAT TT=5.759 ASSIGNMENTS=16673	No data	No data	No data	SAT TT=1.471 ASSIGNMENTS=41974 CHECKS=3519580	SAT TT=1.466 ASSIGNMENTS=41974 CHECKS=3519580	No data	No data	No data	SAT TT=2.152 ASSIGNMENTS=56543 CHECKS=5610440	? (TO) TT=1800.04	SAT TT=1.36	SAT TT=0.155 ASSIGNMENTS=2045 CHECKS=145907	SAT TT=0.071 ASSIGNMENTS=227 CHECKS=20992	? TT=2.509	No data	SAT TT=2.514	SAT TT=2.917
csp/bibd8/ normalized-bibd-8-42-21-4-9_glb.xml	SAT TT=0.156	SAT TT=114.529 CHECKS=21583500 NODES=321610	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.11	No data	No data	No data	SAT TT=7.754 ASSIGNMENTS=1654 CHECKS=144137	SAT TT=7.749 ASSIGNMENTS=1654 CHECKS=144137	No data	No data	No data	SAT TT=334.851 ASSIGNMENTS=8429860 CHECKS=762093000	? (TO) TT=1800.03	SAT TT=105.003	SAT TT=9.872 ASSIGNMENTS=127888 CHECKS=10155000	SAT TT=0.156 ASSIGNMENTS=1654 CHECKS=144137	? TT=2.955	No data	SAT TT=3.763	SAT TT=5.361
csp/bibd8/ normalized-bibd-8-56-28-4-12_glb.xml	SAT TT=3.384	SAT TT=8.316 CHECKS=318842 NODES=18791	? (TO) TT=1800.17	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.11	No data	No data	No data	SAT TT=11.106 ASSIGNMENTS=59651 CHECKS=7118020	SAT TT=677.581 ASSIGNMENTS=59651 CHECKS=7118020	No data	No data	No data	? (TO) TT=1800.06	SAT TT=99.462 ASSIGNMENTS=2520650 CHECKS=221254000	? (TO) TT=1800.11	SAT TT=47.54 ASSIGNMENTS=279777 CHECKS=25351600	SAT TT=3.384 ASSIGNMENTS=59651 CHECKS=7118020	? TT=3.946	No data	SAT TT=10.36	SAT TT=6.124
csp/bibd8/ normalized-bibd-8-70-35-4-15_glb.xml	SAT TT=0.334	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07	No data	No data	No data	SAT TT=295.907 ASSIGNMENTS=3522 CHECKS=367591	SAT TT=674.364 ASSIGNMENTS=3522 CHECKS=367591	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=1302.61 ASSIGNMENTS=9685250 CHECKS=985236000	SAT TT=0.334 ASSIGNMENTS=3522 CHECKS=367591	? TT=4.399	No data	SAT TT=232.861	SAT TT=17.66
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd8/ normalized-bibd-8-84-42-4-18_glb.xml	SAT TT=14.725	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.14	No data	No data	No data	SAT TT=500.797 ASSIGNMENTS=1303030 CHECKS=222039000	SAT TT=792.696 ASSIGNMENTS=1303030 CHECKS=222039000	No data	No data	No data	? (TO) TT=1800.01	SAT TT=806.14 ASSIGNMENTS=13590100 CHECKS=1386400000	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=118.781 ASSIGNMENTS=1303030 CHECKS=222039000	? TT=4.411	No data	SAT TT=520.019	SAT TT=14.725
csp/bibd8/ normalized-bibd-8-98-49-4-21_glb.xml	SAT TT=34.245	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.09	No data	No data	No data	? (TO) TT=1800.02	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=4.841	No data	? (TO) TT=1800.06	SAT TT=34.245
csp/bibd9/ normalized-bibd-9-108-36-3-9_glb.xml	SAT TT=14.398	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=291.811 CHECKS=22342100	? (TO) TT=1800.11	SAT TT=22.891 ASSIGNMENTS=13222	SAT TT=23.559 ASSIGNMENTS=13222	No data	No data	No data	? (TO) TT=1800.13	? (TO) TT=1800.03	No data	No data	No data	? (TO) TT=1800.02	SAT TT=14.398 ASSIGNMENTS=334519 CHECKS=27771600	? (TO) TT=1800.09	SAT TT=1588.93 ASSIGNMENTS=7647320 CHECKS=700686000	? (TO) TT=1800.04	? TT=5.483	No data	SAT TT=167.193	SAT TT=30.128
csp/bibd9/ normalized-bibd-9-120-40-3-10_glb.xml	SAT TT=0.871	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.14	No data	No data	No data	SAT TT=368.595 ASSIGNMENTS=7085 CHECKS=530573	SAT TT=675.34 ASSIGNMENTS=7085 CHECKS=530573	No data	No data	No data	? (TO) TT=1800.07	SAT TT=99.973 ASSIGNMENTS=1586200 CHECKS=158553000	? (TO) TT=1800.12	? (TO) TT=1800.04	SAT TT=0.871 ASSIGNMENTS=7085 CHECKS=530573	? TT=5.349	No data	SAT TT=115.747	SAT TT=45.02
csp/bibd9/ normalized-bibd-9-12-4-3-1_glb.xml	SAT TT=0.037	SAT TT=2.348 CHECKS=11964 NODES=821	SAT TT=2.191 CHECKS=32263 NODES=1906	SAT TT=0.158	SAT TT=0.631 CHECKS=190577	SAT TT=0.477 CHECKS=167456	SAT TT=1.307 ASSIGNMENTS=115	SAT TT=1.456 ASSIGNMENTS=115	No data	No data	No data	SAT TT=0.045 ASSIGNMENTS=58 CHECKS=2378	SAT TT=0.048 ASSIGNMENTS=58 CHECKS=2378	No data	No data	No data	SAT TT=0.037 ASSIGNMENTS=58 CHECKS=2378	SAT TT=0.169 ASSIGNMENTS=14335 CHECKS=423238	SAT TT=0.933	SAT TT=0.037 ASSIGNMENTS=150 CHECKS=8323	SAT TT=0.038 ASSIGNMENTS=69 CHECKS=4002	? TT=1.957	No data	SAT TT=1.715	SAT TT=2.189
csp/bibd9/ normalized-bibd-9-24-8-3-2_glb.xml	SAT TT=0.07	SAT TT=2.712 CHECKS=74694 NODES=2952	SAT TT=2.801 CHECKS=66623 NODES=3702	SAT TT=0.671	SAT TT=6.911 CHECKS=1617110	SAT TT=1.283 CHECKS=341177	SAT TT=2.741 ASSIGNMENTS=4025	SAT TT=2.778 ASSIGNMENTS=4025	No data	No data	No data	SAT TT=0.084 ASSIGNMENTS=308 CHECKS=18117	SAT TT=0.079 ASSIGNMENTS=308 CHECKS=18117	No data	No data	No data	SAT TT=0.07 ASSIGNMENTS=243 CHECKS=13195	SAT TT=214.547 ASSIGNMENTS=6643700 CHECKS=727034000	SAT TT=0.999	SAT TT=0.152 ASSIGNMENTS=2309 CHECKS=133863	SAT TT=0.076 ASSIGNMENTS=262 CHECKS=21306	? TT=2.937	No data	SAT TT=2.489	SAT TT=2.766
csp/bibd9/ normalized-bibd-9-36-12-3-3_glb.xml	SAT TT=0.106	? (TO) TT=1800.16	SAT TT=5.571 CHECKS=339061 NODES=11710	SAT TT=233.001	SAT TT=41.459 CHECKS=6901980	SAT TT=54.671 CHECKS=10793900	SAT TT=130.377 ASSIGNMENTS=356835	SAT TT=115.796 ASSIGNMENTS=356835	No data	No data	No data	SAT TT=0.12 ASSIGNMENTS=420 CHECKS=26450	SAT TT=0.12 ASSIGNMENTS=420 CHECKS=26450	No data	No data	No data	SAT TT=0.106 ASSIGNMENTS=375 CHECKS=19837	? (TO) TT=1800.06	SAT TT=268.519	SAT TT=0.579 ASSIGNMENTS=5796 CHECKS=452272	SAT TT=0.795 ASSIGNMENTS=16527 CHECKS=1751210	? TT=3.375	No data	SAT TT=3.71	SAT TT=3.952
csp/bibd9/ normalized-bibd-9-48-16-3-4_glb.xml	SAT TT=0.15	? (TO) TT=1800.07	SAT TT=565.36 CHECKS=69659400 NODES=1518290	? (TO) TT=1800.07	SAT TT=45.564 CHECKS=5967360	SAT TT=66.57 CHECKS=10584200	SAT TT=60.627 ASSIGNMENTS=134470	SAT TT=56.191 ASSIGNMENTS=134470	No data	No data	No data	SAT TT=22.253 ASSIGNMENTS=294382 CHECKS=26675700	SAT TT=202.702 ASSIGNMENTS=866829 CHECKS=21414100	No data	No data	No data	SAT TT=0.15 ASSIGNMENTS=564 CHECKS=33303	SAT TT=0.394 ASSIGNMENTS=70345 CHECKS=771266	SAT TT=2.522	SAT TT=1.479 ASSIGNMENTS=15704 CHECKS=1252640	SAT TT=14.732 ASSIGNMENTS=294382 CHECKS=26675700	? TT=4.133	No data	SAT TT=3.933	SAT TT=4.986
csp/bibd9/ normalized-bibd-9-60-20-3-5_glb.xml	SAT TT=1.151	SAT TT=7.73 CHECKS=135085 NODES=8870	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=10.653 ASSIGNMENTS=5569	SAT TT=8.909 ASSIGNMENTS=5569	No data	No data	No data	SAT TT=163.225 ASSIGNMENTS=2484140 CHECKS=241989000	SAT TT=127.187 ASSIGNMENTS=437888 CHECKS=11860600	No data	No data	No data	SAT TT=39.873 ASSIGNMENTS=711468 CHECKS=71066000	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=1.151 ASSIGNMENTS=7762 CHECKS=767877	SAT TT=144.648 ASSIGNMENTS=2484140 CHECKS=241989000	? TT=4.198	No data	SAT TT=4.192	SAT TT=6.504
csp/bibd9/ normalized-bibd-9-72-24-3-6_glb.xml	SAT TT=6.305	SAT TT=1302.45 CHECKS=218612000 NODES=1459850	? (TO) TT=1800.16	? (TO) TT=1800.06	SAT TT=52 CHECKS=5525590	? (TO) TT=1800.08	SAT TT=12.21 ASSIGNMENTS=11878	SAT TT=11.478 ASSIGNMENTS=11878	No data	No data	No data	SAT TT=311.361 ASSIGNMENTS=240509 CHECKS=25565200	SAT TT=691.011 ASSIGNMENTS=240509 CHECKS=25565200	No data	No data	No data	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=1077.09	SAT TT=22.735 ASSIGNMENTS=143663 CHECKS=16548800	SAT TT=15.905 ASSIGNMENTS=240509 CHECKS=25565200	? TT=4.444	No data	SAT TT=6.305	SAT TT=8.582
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd9/ normalized-bibd-9-84-28-3-7_glb.xml	SAT TT=1.794	SAT TT=112.244 CHECKS=9809070 NODES=156280	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=13.793 ASSIGNMENTS=6301	SAT TT=13.592 ASSIGNMENTS=6301	No data	No data	No data	SAT TT=382.144 ASSIGNMENTS=208582 CHECKS=19630600	SAT TT=686.701 ASSIGNMENTS=208582 CHECKS=19630600	No data	No data	No data	SAT TT=1.794 ASSIGNMENTS=26304 CHECKS=2289120	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=298.891 ASSIGNMENTS=1870190 CHECKS=175327000	SAT TT=12.92 ASSIGNMENTS=208582 CHECKS=19630600	? TT=4.936	No data	SAT TT=9.769	SAT TT=9.569
csp/bibd9/ normalized-bibd-9-96-32-3-8_glb.xml	SAT TT=0.406	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.09	SAT TT=359.146 CHECKS=20042200	SAT TT=1300.31 CHECKS=133010000	SAT TT=30.167 ASSIGNMENTS=14183	SAT TT=30.303 ASSIGNMENTS=14183	No data	No data	No data	SAT TT=368.575 ASSIGNMENTS=2562 CHECKS=126677	SAT TT=676.529 ASSIGNMENTS=2562 CHECKS=126677	No data	No data	No data	? (TO) TT=1800.11	SAT TT=69.628 ASSIGNMENTS=978404 CHECKS=121245000	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=0.406 ASSIGNMENTS=2562 CHECKS=126677	? TT=5.624	No data	SAT TT=32.364	SAT TT=12.968
csp/bibdVariousK/ normalized-bibd-10-15-6-4-2_glb.xml	SAT TT=0.055	SAT TT=8.371 CHECKS=1071520 NODES=45275	SAT TT=2.44 CHECKS=98265 NODES=2725	SAT TT=0.341	SAT TT=3.696 CHECKS=1060730	SAT TT=0.907 CHECKS=293522	SAT TT=1.905 ASSIGNMENTS=2103	SAT TT=2.143 ASSIGNMENTS=2103	No data	No data	No data	SAT TT=0.065 ASSIGNMENTS=116 CHECKS=8968	SAT TT=0.067 ASSIGNMENTS=116 CHECKS=8968	No data	No data	No data	SAT TT=0.055 ASSIGNMENTS=144 CHECKS=11869	SAT TT=28.382 ASSIGNMENTS=906311 CHECKS=91250100	SAT TT=1.226	SAT TT=0.061 ASSIGNMENTS=294 CHECKS=14109	SAT TT=0.095 ASSIGNMENTS=1078 CHECKS=123262	? TT=2.434	No data	SAT TT=2.215	SAT TT=2.763
csp/bibdVariousK/ normalized-bibd-10-18-9-5-4_glb.xml	SAT TT=0.078	SAT TT=45.947 CHECKS=6929210 NODES=262761	SAT TT=29.861 CHECKS=5683630 NODES=155132	SAT TT=0.525	SAT TT=1.64 CHECKS=302509	SAT TT=152.915 CHECKS=48281600	SAT TT=6.145 ASSIGNMENTS=21703	SAT TT=6.391 ASSIGNMENTS=21703	No data	No data	No data	SAT TT=0.079 ASSIGNMENTS=383 CHECKS=32136	SAT TT=0.085 ASSIGNMENTS=383 CHECKS=32136	No data	No data	No data	SAT TT=0.078 ASSIGNMENTS=511 CHECKS=43639	? (TO) TT=1800.05	SAT TT=0.996	SAT TT=0.268 ASSIGNMENTS=3522 CHECKS=317321	SAT TT=0.219 ASSIGNMENTS=4745 CHECKS=426734	? TT=2.752	No data	SAT TT=2.763	SAT TT=2.93
csp/bibdVariousK/ normalized-bibd-11-11-5-5-2_glb.xml	SAT TT=0.049	SAT TT=1.926 CHECKS=33309 NODES=1311	SAT TT=2.482 CHECKS=47962 NODES=2196	SAT TT=0.2	SAT TT=0.81 CHECKS=186374	SAT TT=0.467 CHECKS=153862	SAT TT=1.377 ASSIGNMENTS=165	SAT TT=1.353 ASSIGNMENTS=165	No data	No data	No data	SAT TT=0.061 ASSIGNMENTS=54 CHECKS=4969	SAT TT=0.06 ASSIGNMENTS=54 CHECKS=4969	No data	No data	No data	SAT TT=0.049 ASSIGNMENTS=61 CHECKS=5277	SAT TT=0.465 ASSIGNMENTS=22610 CHECKS=1355340	SAT TT=1.112	SAT TT=0.078 ASSIGNMENTS=772 CHECKS=46017	SAT TT=0.053 ASSIGNMENTS=129 CHECKS=16455	? TT=2.338	No data	SAT TT=2.047	SAT TT=2.456
csp/bibdVariousK/ normalized-bibd-11-22-10-5-4_glb.xml	SAT TT=0.319	SAT TT=798.467 CHECKS=125798000 NODES=3344730	SAT TT=7.627 CHECKS=1448000 NODES=15589	SAT TT=1.692	? (TO) TT=1800.11	? (TO) TT=1800.06	SAT TT=30.544 ASSIGNMENTS=104280	SAT TT=29.054 ASSIGNMENTS=104280	No data	No data	No data	SAT TT=0.327 ASSIGNMENTS=6037 CHECKS=565287	SAT TT=0.319 ASSIGNMENTS=6037 CHECKS=565287	No data	No data	No data	SAT TT=1.353 ASSIGNMENTS=35789 CHECKS=3429870	? (TO) TT=1800.03	SAT TT=1.261	SAT TT=0.417 ASSIGNMENTS=4561 CHECKS=487995	SAT TT=0.499 ASSIGNMENTS=11252 CHECKS=1055430	? TT=2.988