CSP 2008 Competition: results by benchmark

Results by benchmark for category n-ary constraints in extension (N-ARY-EXT)

This page displays the results of the different solvers for each benchmark for category n-ary constraints in extension (N-ARY-EXT)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
mddc-solv 2008-06-09
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
spider 2008-06-14
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-100/ normalized-aim-100-1-6-sat-1_ext.xml	SAT TT=0.009	SAT TT=0.837 CHECKS=1705 NODES=236	SAT TT=0.854 CHECKS=3280 NODES=357	SAT TT=30.865	SAT TT=0.013 CHECKS=1438	SAT TT=0.017 CHECKS=4422	SAT TT=0.509 ASSIGNMENTS=15	SAT TT=0.467 ASSIGNMENTS=8	SAT TT=0.423 CHECKS=809 NODES=151	? (TO) TT=1800.04	SAT TT=0.443 CHECKS=153439 NODES=1104	SAT TT=0.022 ASSIGNMENTS=81 CHECKS=2550	SAT TT=0.023 ASSIGNMENTS=81 CHECKS=2550	SAT TT=0.971	SAT TT=1.179	SAT TT=0.057 CHECKS=4633	SAT TT=0.009 ASSIGNMENTS=80 CHECKS=2661	SAT TT=0.035 ASSIGNMENTS=5759 CHECKS=89684	SAT TT=0.431	SAT TT=0.013 ASSIGNMENTS=353 CHECKS=12552	SAT TT=0.011 ASSIGNMENTS=81 CHECKS=2550	SAT TT=0.973	SAT TT=0.025 ASSIGNMENTS=105 CHECKS=1900	SAT TT=0.743	SAT TT=0.742
csp/aim-100/ normalized-aim-100-1-6-sat-2_ext.xml	SAT TT=0.013	SAT TT=0.836 CHECKS=6717 NODES=839	SAT TT=0.862 CHECKS=3778 NODES=490	SAT TT=154.458	SAT TT=0.023 CHECKS=7555	SAT TT=0.041 CHECKS=31706	SAT TT=0.501 ASSIGNMENTS=33	SAT TT=0.479 ASSIGNMENTS=17	SAT TT=0.496 CHECKS=2236 NODES=308	? (TO) TT=1800.05	SAT TT=0.419 CHECKS=145002 NODES=943	SAT TT=0.024 ASSIGNMENTS=274 CHECKS=7201	SAT TT=0.025 ASSIGNMENTS=274 CHECKS=7201	SAT TT=1.1	SAT TT=0.909	SAT TT=0.046 CHECKS=9881	SAT TT=0.013 ASSIGNMENTS=407 CHECKS=10178	SAT TT=0.031 ASSIGNMENTS=5908 CHECKS=85589	SAT TT=0.427	SAT TT=0.013 ASSIGNMENTS=357 CHECKS=8522	SAT TT=0.013 ASSIGNMENTS=274 CHECKS=7201	SAT TT=0.873	SAT TT=0.026 ASSIGNMENTS=227 CHECKS=5363	SAT TT=0.661	SAT TT=0.694
csp/aim-100/ normalized-aim-100-1-6-sat-3_ext.xml	SAT TT=0.011	SAT TT=0.837 CHECKS=5946 NODES=929	SAT TT=0.968 CHECKS=7737 NODES=937	SAT TT=110.652	SAT TT=0.014 CHECKS=3166	SAT TT=0.038 CHECKS=30860	SAT TT=0.527 ASSIGNMENTS=273	SAT TT=0.553 ASSIGNMENTS=327	SAT TT=0.449 CHECKS=1065 NODES=174	? (TO) TT=1800.06	SAT TT=2.144 CHECKS=12091200 NODES=73135	SAT TT=0.022 ASSIGNMENTS=203 CHECKS=5090	SAT TT=0.022 ASSIGNMENTS=203 CHECKS=5090	SAT TT=0.906	SAT TT=0.975	SAT TT=0.045 CHECKS=10042	SAT TT=0.012 ASSIGNMENTS=413 CHECKS=10441	SAT TT=0.03 ASSIGNMENTS=6055 CHECKS=77553	SAT TT=0.346	SAT TT=0.012 ASSIGNMENTS=372 CHECKS=6794	SAT TT=0.011 ASSIGNMENTS=203 CHECKS=5090	SAT TT=0.902	SAT TT=0.041 ASSIGNMENTS=540 CHECKS=25724	SAT TT=0.645	SAT TT=0.689
csp/aim-100/ normalized-aim-100-1-6-sat-4_ext.xml	SAT TT=0.011	SAT TT=0.77 CHECKS=1103 NODES=215	SAT TT=0.819 CHECKS=1526 NODES=212	SAT TT=1.302	SAT TT=0.022 CHECKS=7911	SAT TT=0.02 CHECKS=7522	SAT TT=0.528 ASSIGNMENTS=230	SAT TT=0.552 ASSIGNMENTS=79	SAT TT=0.4 CHECKS=1190 NODES=177	? (TO) TT=1800.05	SAT TT=0.501 CHECKS=298671 NODES=1688	SAT TT=0.023 ASSIGNMENTS=168 CHECKS=4432	SAT TT=0.023 ASSIGNMENTS=168 CHECKS=4432	SAT TT=0.929	SAT TT=1.105	SAT TT=0.039 CHECKS=2257	SAT TT=0.012 ASSIGNMENTS=186 CHECKS=4657	SAT TT=0.032 ASSIGNMENTS=5793 CHECKS=86640	SAT TT=0.354	SAT TT=0.011 ASSIGNMENTS=265 CHECKS=4661	SAT TT=0.011 ASSIGNMENTS=168 CHECKS=4432	SAT TT=0.805	SAT TT=0.024 ASSIGNMENTS=317 CHECKS=15269	SAT TT=0.696	SAT TT=0.648
csp/aim-100/ normalized-aim-100-1-6-unsat-1_ext.xml	UNSAT TT=0.023	UNSAT TT=1.061 CHECKS=54585 NODES=5225	UNSAT TT=1.07 CHECKS=50025 NODES=4694	? (TO) TT=1800.04	UNSAT TT=0.102 CHECKS=61774	UNSAT TT=0.089 CHECKS=64928	UNSAT TT=1.032 ASSIGNMENTS=5914	UNSAT TT=0.82 ASSIGNMENTS=1391	UNSAT TT=0.456 CHECKS=7064 NODES=589	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=0.041 ASSIGNMENTS=2886 CHECKS=60434	UNSAT TT=0.04 ASSIGNMENTS=2886 CHECKS=60434	UNSAT TT=0.565	UNSAT TT=0.696	UNSAT TT=0.07 CHECKS=26332	UNSAT TT=0.024 ASSIGNMENTS=2881 CHECKS=63131	UNSAT TT=0.031 ASSIGNMENTS=8029 CHECKS=90757	UNSAT TT=0.445	UNSAT TT=0.023 ASSIGNMENTS=2017 CHECKS=35977	UNSAT TT=0.025 ASSIGNMENTS=2886 CHECKS=60434	UNSAT TT=0.821	UNSAT TT=0.066 ASSIGNMENTS=887 CHECKS=32392	UNSAT TT=0.66	UNSAT TT=0.648
csp/aim-100/ normalized-aim-100-1-6-unsat-2_ext.xml	UNSAT TT=0.015	UNSAT TT=0.962 CHECKS=19505 NODES=1835	UNSAT TT=0.926 CHECKS=19461 NODES=1768	UNSAT TT=201.423	UNSAT TT=0.058 CHECKS=29844	UNSAT TT=0.171 CHECKS=131979	UNSAT TT=0.712 ASSIGNMENTS=1705	UNSAT TT=0.607 ASSIGNMENTS=388	UNSAT TT=0.525 CHECKS=5820 NODES=494	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=0.04 ASSIGNMENTS=2271 CHECKS=56365	UNSAT TT=0.037 ASSIGNMENTS=2271 CHECKS=56365	UNSAT TT=0.572	UNSAT TT=0.57	UNSAT TT=0.069 CHECKS=25720	UNSAT TT=0.028 ASSIGNMENTS=2350 CHECKS=61699	UNSAT TT=0.038 ASSIGNMENTS=7613 CHECKS=107465	UNSAT TT=0.366	UNSAT TT=0.015 ASSIGNMENTS=620 CHECKS=13227	UNSAT TT=0.023 ASSIGNMENTS=2271 CHECKS=56365	UNSAT TT=0.799	UNSAT TT=0.059 ASSIGNMENTS=1466 CHECKS=65779	UNSAT TT=0.65	UNSAT TT=0.678
csp/aim-100/ normalized-aim-100-1-6-unsat-3_ext.xml	UNSAT TT=0.068	UNSAT TT=1.089 CHECKS=71698 NODES=6813	UNSAT TT=1.282 CHECKS=105326 NODES=9372	? (TO) TT=1800.08	UNSAT TT=0.448 CHECKS=317483	UNSAT TT=0.226 CHECKS=192589	UNSAT TT=2.701 ASSIGNMENTS=27877	UNSAT TT=0.713 ASSIGNMENTS=1207	UNSAT TT=0.898 CHECKS=114616 NODES=7084	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.09 ASSIGNMENTS=10409 CHECKS=226716	UNSAT TT=0.094 ASSIGNMENTS=10409 CHECKS=226716	UNSAT TT=0.715	UNSAT TT=0.557	UNSAT TT=0.127 CHECKS=72138	UNSAT TT=0.068 ASSIGNMENTS=9660 CHECKS=213423	UNSAT TT=0.067 ASSIGNMENTS=13197 CHECKS=210238	UNSAT TT=0.618	UNSAT TT=0.084 ASSIGNMENTS=10146 CHECKS=239740	UNSAT TT=0.07 ASSIGNMENTS=10409 CHECKS=226716	UNSAT TT=0.817	UNSAT TT=0.617 ASSIGNMENTS=21358 CHECKS=700509	UNSAT TT=0.668	UNSAT TT=0.689
csp/aim-100/ normalized-aim-100-1-6-unsat-4_ext.xml	UNSAT TT=0.028	UNSAT TT=1.012 CHECKS=28155 NODES=3311	UNSAT TT=1.02 CHECKS=33338 NODES=3713	? (TO) TT=1800.1	UNSAT TT=0.145 CHECKS=87309	UNSAT TT=0.15 CHECKS=118548	UNSAT TT=1.276 ASSIGNMENTS=8856	UNSAT TT=1.814 ASSIGNMENTS=11034	UNSAT TT=0.47 CHECKS=6361 NODES=596	? (TO) TT=1800.09	? (TO) TT=1800	UNSAT TT=0.076 ASSIGNMENTS=8133 CHECKS=178844	UNSAT TT=0.077 ASSIGNMENTS=8133 CHECKS=178844	UNSAT TT=0.705	UNSAT TT=0.564	UNSAT TT=0.071 CHECKS=21643	UNSAT TT=0.037 ASSIGNMENTS=5255 CHECKS=118129	UNSAT TT=0.034 ASSIGNMENTS=8264 CHECKS=82592	UNSAT TT=0.441	UNSAT TT=0.028 ASSIGNMENTS=2732 CHECKS=52884	UNSAT TT=0.052 ASSIGNMENTS=8133 CHECKS=178844	UNSAT TT=0.868	UNSAT TT=0.085 ASSIGNMENTS=2108 CHECKS=68085	UNSAT TT=0.666	UNSAT TT=0.705
csp/aim-100/ normalized-aim-100-2-0-sat-1_ext.xml	SAT TT=0.013	SAT TT=0.868 CHECKS=6443 NODES=838	SAT TT=0.929 CHECKS=8534 NODES=938	SAT TT=193.579	SAT TT=0.066 CHECKS=40312	SAT TT=0.036 CHECKS=23149	SAT TT=0.638 ASSIGNMENTS=707	SAT TT=0.834 ASSIGNMENTS=1272	SAT TT=0.537 CHECKS=3027 NODES=272	SAT TT=18.447 CHECKS=66901000 NODES=3076570	SAT TT=0.59 CHECKS=1001320 NODES=5272	SAT TT=0.024 ASSIGNMENTS=490 CHECKS=12713	SAT TT=0.026 ASSIGNMENTS=490 CHECKS=12713	SAT TT=1.076	SAT TT=0.94	SAT TT=0.049 CHECKS=11863	SAT TT=0.015 ASSIGNMENTS=561 CHECKS=19429	SAT TT=0.043 ASSIGNMENTS=5316 CHECKS=136211	SAT TT=0.392	SAT TT=0.013 ASSIGNMENTS=450 CHECKS=9729	SAT TT=0.013 ASSIGNMENTS=490 CHECKS=12713	SAT TT=0.827	SAT TT=0.065 ASSIGNMENTS=1130 CHECKS=63380	SAT TT=0.735	SAT TT=0.708
csp/aim-100/ normalized-aim-100-2-0-sat-2_ext.xml	SAT TT=0.016	SAT TT=0.96 CHECKS=26691 NODES=2591	SAT TT=1.025 CHECKS=25652 NODES=2414	SAT TT=54.542	SAT TT=0.178 CHECKS=151621	SAT TT=0.136 CHECKS=154655	SAT TT=0.896 ASSIGNMENTS=2354	SAT TT=1.103 ASSIGNMENTS=3374	SAT TT=0.525 CHECKS=19967 NODES=928	SAT TT=604.591 CHECKS=2285100000 NODES=100912000	SAT TT=1532.64 CHECKS=11544600000 NODES=31098400	SAT TT=0.031 ASSIGNMENTS=822 CHECKS=33873	SAT TT=0.03 ASSIGNMENTS=822 CHECKS=33873	SAT TT=1.025	SAT TT=1.244	SAT TT=0.065 CHECKS=32651	SAT TT=0.016 ASSIGNMENTS=800 CHECKS=32848	SAT TT=0.044 ASSIGNMENTS=5354 CHECKS=142545	SAT TT=0.406	SAT TT=0.016 ASSIGNMENTS=585 CHECKS=17249	SAT TT=0.019 ASSIGNMENTS=822 CHECKS=33873	SAT TT=0.876	SAT TT=0.076 ASSIGNMENTS=639 CHECKS=29969	SAT TT=0.673	SAT TT=0.796
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-100/ normalized-aim-100-2-0-sat-3_ext.xml	SAT TT=0.013	SAT TT=0.859 CHECKS=5023 NODES=570	SAT TT=0.822 CHECKS=1673 NODES=233	SAT TT=2.442	SAT TT=0.015 CHECKS=4055	SAT TT=0.118 CHECKS=147710	SAT TT=0.591 ASSIGNMENTS=338	SAT TT=0.485 ASSIGNMENTS=7	SAT TT=0.524 CHECKS=2766 NODES=256	SAT TT=439.907 CHECKS=1594820000 NODES=77786100	? (TO) TT=1800.04	SAT TT=0.034 ASSIGNMENTS=968 CHECKS=42795	SAT TT=0.033 ASSIGNMENTS=968 CHECKS=42795	SAT TT=1.124	SAT TT=1.032	SAT TT=0.077 CHECKS=12697	SAT TT=0.023 ASSIGNMENTS=1443 CHECKS=55357	SAT TT=0.046 ASSIGNMENTS=5382 CHECKS=136304	SAT TT=0.441	SAT TT=0.013 ASSIGNMENTS=563 CHECKS=15966	SAT TT=0.02 ASSIGNMENTS=968 CHECKS=42795	SAT TT=1.007	SAT TT=0.055 ASSIGNMENTS=724 CHECKS=31913	SAT TT=0.748	SAT TT=0.719
csp/aim-100/ normalized-aim-100-2-0-sat-4_ext.xml	SAT TT=0.015	SAT TT=0.923 CHECKS=8479 NODES=977	SAT TT=0.891 CHECKS=10400 NODES=1197	SAT TT=332.479	SAT TT=0.089 CHECKS=63789	SAT TT=0.058 CHECKS=65978	SAT TT=0.574 ASSIGNMENTS=279	SAT TT=0.682 ASSIGNMENTS=768	SAT TT=0.424 CHECKS=2819 NODES=255	SAT TT=796.756 CHECKS=3027680000 NODES=143701000	SAT TT=0.515 CHECKS=173781 NODES=1221	SAT TT=0.026 ASSIGNMENTS=271 CHECKS=12723	SAT TT=0.019 ASSIGNMENTS=271 CHECKS=12723	SAT TT=1.04	SAT TT=1.096	SAT TT=0.065 CHECKS=19179	SAT TT=0.015 ASSIGNMENTS=445 CHECKS=23246	SAT TT=0.045 ASSIGNMENTS=5460 CHECKS=141277	SAT TT=0.417	SAT TT=0.025 ASSIGNMENTS=1439 CHECKS=58079	SAT TT=0.015 ASSIGNMENTS=271 CHECKS=12723	SAT TT=0.891	SAT TT=0.033 ASSIGNMENTS=247 CHECKS=7456	SAT TT=0.676	SAT TT=0.713
csp/aim-100/ normalized-aim-100-2-0-unsat-1_ext.xml	UNSAT TT=0.011	UNSAT TT=0.812 CHECKS=1576 NODES=238	UNSAT TT=0.803 CHECKS=1036 NODES=147	UNSAT TT=388.858	UNSAT TT=0.024 CHECKS=6978	UNSAT TT=0.025 CHECKS=10526	UNSAT TT=0.533 ASSIGNMENTS=203	UNSAT TT=0.664 ASSIGNMENTS=120	UNSAT TT=0.435 CHECKS=1422 NODES=89	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.025 ASSIGNMENTS=181 CHECKS=6009	UNSAT TT=0.025 ASSIGNMENTS=181 CHECKS=6009	UNSAT TT=0.804	UNSAT TT=0.601	UNSAT TT=0.04 CHECKS=2754	UNSAT TT=0.013 ASSIGNMENTS=173 CHECKS=5951	UNSAT TT=0.041 ASSIGNMENTS=5820 CHECKS=122320	UNSAT TT=0.397	UNSAT TT=0.012 ASSIGNMENTS=228 CHECKS=3612	UNSAT TT=0.011 ASSIGNMENTS=181 CHECKS=6009	UNSAT TT=0.876	UNSAT TT=0.023 ASSIGNMENTS=74 CHECKS=3047	UNSAT TT=0.74	UNSAT TT=0.741
csp/aim-100/ normalized-aim-100-2-0-unsat-2_ext.xml	UNSAT TT=0.013	UNSAT TT=0.99 CHECKS=8547 NODES=869	UNSAT TT=0.945 CHECKS=15082 NODES=1327	? (TO) TT=1800.07	UNSAT TT=0.079 CHECKS=49886	UNSAT TT=0.135 CHECKS=119309	UNSAT TT=0.671 ASSIGNMENTS=957	UNSAT TT=0.602 ASSIGNMENTS=371	UNSAT TT=0.481 CHECKS=7666 NODES=439	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.027 ASSIGNMENTS=872 CHECKS=26851	UNSAT TT=0.029 ASSIGNMENTS=872 CHECKS=26851	UNSAT TT=0.615	UNSAT TT=0.739	UNSAT TT=0.059 CHECKS=15480	UNSAT TT=0.017 ASSIGNMENTS=875 CHECKS=27836	UNSAT TT=0.043 ASSIGNMENTS=5835 CHECKS=130309	UNSAT TT=0.393	UNSAT TT=0.013 ASSIGNMENTS=427 CHECKS=8833	UNSAT TT=0.018 ASSIGNMENTS=872 CHECKS=26851	UNSAT TT=0.872	UNSAT TT=0.032 ASSIGNMENTS=263 CHECKS=13063	UNSAT TT=0.74	UNSAT TT=0.711
csp/aim-100/ normalized-aim-100-2-0-unsat-3_ext.xml	UNSAT TT=0.014	UNSAT TT=0.875 CHECKS=5497 NODES=672	UNSAT TT=0.88 CHECKS=4609 NODES=485	? (TO) TT=1800.05	UNSAT TT=0.098 CHECKS=61315	UNSAT TT=0.075 CHECKS=60036	UNSAT TT=0.765 ASSIGNMENTS=1532	UNSAT TT=1.178 ASSIGNMENTS=3895	UNSAT TT=0.439 CHECKS=1450 NODES=118	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.027 ASSIGNMENTS=718 CHECKS=17966	UNSAT TT=0.027 ASSIGNMENTS=718 CHECKS=17966	UNSAT TT=0.607	UNSAT TT=0.716	UNSAT TT=0.055 CHECKS=14314	UNSAT TT=0.016 ASSIGNMENTS=781 CHECKS=21279	UNSAT TT=0.043 ASSIGNMENTS=5849 CHECKS=128601	UNSAT TT=0.426	UNSAT TT=0.014 ASSIGNMENTS=311 CHECKS=5465	UNSAT TT=0.014 ASSIGNMENTS=718 CHECKS=17966	UNSAT TT=0.813	UNSAT TT=0.033 ASSIGNMENTS=428 CHECKS=20560	UNSAT TT=0.71	UNSAT TT=0.708
csp/aim-100/ normalized-aim-100-2-0-unsat-4_ext.xml	UNSAT TT=0.013	UNSAT TT=0.87 CHECKS=4386 NODES=605	UNSAT TT=0.871 CHECKS=4646 NODES=533	? (TO) TT=1800.07	UNSAT TT=0.057 CHECKS=28397	UNSAT TT=0.048 CHECKS=33238	UNSAT TT=0.678 ASSIGNMENTS=1228	UNSAT TT=0.748 ASSIGNMENTS=860	UNSAT TT=0.438 CHECKS=1931 NODES=160	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=0.027 ASSIGNMENTS=1286 CHECKS=26574	UNSAT TT=0.03 ASSIGNMENTS=1286 CHECKS=26574	UNSAT TT=0.595	UNSAT TT=0.592	UNSAT TT=0.061 CHECKS=12185	UNSAT TT=0.015 ASSIGNMENTS=693 CHECKS=17969	UNSAT TT=0.047 ASSIGNMENTS=6023 CHECKS=128980	UNSAT TT=0.394	UNSAT TT=0.013 ASSIGNMENTS=392 CHECKS=8781	UNSAT TT=0.017 ASSIGNMENTS=1286 CHECKS=26574	UNSAT TT=0.868	UNSAT TT=0.029 ASSIGNMENTS=316 CHECKS=20565	UNSAT TT=0.728	UNSAT TT=0.734
csp/aim-100/ normalized-aim-100-3-4-sat-1_ext.xml	SAT TT=0.017	SAT TT=0.943 CHECKS=6661 NODES=482	SAT TT=0.983 CHECKS=4564 NODES=260	SAT TT=0.096	SAT TT=0.04 CHECKS=20518	SAT TT=0.059 CHECKS=47645	SAT TT=0.588 ASSIGNMENTS=72	SAT TT=0.65 ASSIGNMENTS=43	SAT TT=0.49 CHECKS=6534 NODES=225	SAT TT=0.598 CHECKS=513932 NODES=13417	SAT TT=0.752 CHECKS=1443200 NODES=6733	SAT TT=0.031 ASSIGNMENTS=294 CHECKS=39044	SAT TT=0.034 ASSIGNMENTS=294 CHECKS=39044	SAT TT=1.109	SAT TT=1.333	SAT TT=0.073 CHECKS=26182	SAT TT=0.017 ASSIGNMENTS=146 CHECKS=12809	SAT TT=0.023 ASSIGNMENTS=502 CHECKS=47403	SAT TT=0.522	SAT TT=0.018 ASSIGNMENTS=288 CHECKS=24805	SAT TT=0.022 ASSIGNMENTS=294 CHECKS=39044	SAT TT=1.08	SAT TT=0.036 ASSIGNMENTS=356 CHECKS=32039	SAT TT=0.804	SAT TT=0.932
csp/aim-100/ normalized-aim-100-3-4-sat-2_ext.xml	SAT TT=0.016	SAT TT=0.941 CHECKS=15528 NODES=937	SAT TT=0.981 CHECKS=6237 NODES=487	SAT TT=0.138	SAT TT=0.045 CHECKS=25461	SAT TT=0.18 CHECKS=214568	SAT TT=0.757 ASSIGNMENTS=456	SAT TT=0.762 ASSIGNMENTS=225	SAT TT=0.5 CHECKS=5724 NODES=223	SAT TT=0.519 CHECKS=66552 NODES=1641	SAT TT=0.507 CHECKS=67361 NODES=597	SAT TT=0.027 ASSIGNMENTS=76 CHECKS=6737	SAT TT=0.027 ASSIGNMENTS=76 CHECKS=6737	SAT TT=1.25	SAT TT=1.214	SAT TT=0.078 CHECKS=22749	SAT TT=0.016 ASSIGNMENTS=112 CHECKS=11424	SAT TT=0.107 ASSIGNMENTS=4400 CHECKS=410169	SAT TT=0.528	SAT TT=0.018 ASSIGNMENTS=238 CHECKS=13364	SAT TT=0.016 ASSIGNMENTS=76 CHECKS=6737	SAT TT=1.007	SAT TT=0.037 ASSIGNMENTS=127 CHECKS=10643	SAT TT=0.879	SAT TT=0.921
csp/aim-100/ normalized-aim-100-3-4-sat-3_ext.xml	SAT TT=0.017	SAT TT=0.946 CHECKS=8184 NODES=554	SAT TT=1.105 CHECKS=6108 NODES=383	SAT TT=0.404	SAT TT=0.049 CHECKS=27040	SAT TT=0.079 CHECKS=81656	SAT TT=0.668 ASSIGNMENTS=237	SAT TT=0.854 ASSIGNMENTS=407	SAT TT=0.498 CHECKS=12536 NODES=319	SAT TT=1.883 CHECKS=5109430 NODES=135596	SAT TT=0.605 CHECKS=884700 NODES=4991	SAT TT=0.029 ASSIGNMENTS=213 CHECKS=24325	SAT TT=0.03 ASSIGNMENTS=213 CHECKS=24325	SAT TT=1.368	SAT TT=1.116	SAT TT=0.073 CHECKS=18507	SAT TT=0.017 ASSIGNMENTS=179 CHECKS=19251	SAT TT=0.101 ASSIGNMENTS=4148 CHECKS=370323	SAT TT=0.513	SAT TT=0.017 ASSIGNMENTS=195 CHECKS=12246	SAT TT=0.018 ASSIGNMENTS=213 CHECKS=24325	SAT TT=1.064	SAT TT=0.045 ASSIGNMENTS=306 CHECKS=35529	SAT TT=0.82	SAT TT=0.8
csp/aim-100/ normalized-aim-100-3-4-sat-4_ext.xml	SAT TT=0.015	SAT TT=1.043 CHECKS=12276 NODES=818	SAT TT=0.999 CHECKS=14267 NODES=951	SAT TT=0.122	SAT TT=0.038 CHECKS=16731	SAT TT=0.085 CHECKS=97262	SAT TT=0.753 ASSIGNMENTS=223	SAT TT=0.623 ASSIGNMENTS=78	SAT TT=0.501 CHECKS=3037 NODES=152	SAT TT=0.591 CHECKS=462611 NODES=12097	SAT TT=0.5 CHECKS=42780 NODES=370	SAT TT=0.027 ASSIGNMENTS=85 CHECKS=8617	SAT TT=0.028 ASSIGNMENTS=85 CHECKS=8617	SAT TT=1.115	SAT TT=1.184	SAT TT=0.062 CHECKS=7732	SAT TT=0.016 ASSIGNMENTS=102 CHECKS=11081	SAT TT=0.087 ASSIGNMENTS=4132 CHECKS=349463	SAT TT=0.442	SAT TT=0.023 ASSIGNMENTS=432 CHECKS=38569	SAT TT=0.015 ASSIGNMENTS=85 CHECKS=8617	SAT TT=0.961	SAT TT=0.057 ASSIGNMENTS=347 CHECKS=41517	SAT TT=0.831	SAT TT=0.872
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-100/ normalized-aim-100-6-0-sat-1_ext.xml	SAT TT=0.016	SAT TT=0.965 CHECKS=2044 NODES=127	SAT TT=0.982 CHECKS=2530 NODES=0	SAT TT=0.111	SAT TT=0.028 CHECKS=6997	SAT TT=0.033 CHECKS=12271	SAT TT=0.605 ASSIGNMENTS=1	SAT TT=0.622 ASSIGNMENTS=1	SAT TT=0.548 CHECKS=3151 NODES=123	SAT TT=3.935 CHECKS=10146500 NODES=150955	SAT TT=0.588 CHECKS=46368 NODES=200	SAT TT=0.032 ASSIGNMENTS=23 CHECKS=7338	SAT TT=0.033 ASSIGNMENTS=23 CHECKS=7338	SAT TT=1.338	SAT TT=1.222	SAT TT=0.067 CHECKS=4888	SAT TT=0.016 ASSIGNMENTS=17 CHECKS=3926	SAT TT=0.02 ASSIGNMENTS=32 CHECKS=9463	SAT TT=0.523	SAT TT=0.02 ASSIGNMENTS=66 CHECKS=5961	SAT TT=0.018 ASSIGNMENTS=23 CHECKS=7338	SAT TT=1.076	SAT TT=0.043 ASSIGNMENTS=146 CHECKS=24760	SAT TT=0.969	SAT TT=1.051
csp/aim-100/ normalized-aim-100-6-0-sat-2_ext.xml	SAT TT=0.018	SAT TT=1.039 CHECKS=4821 NODES=226	SAT TT=1.02 CHECKS=5772 NODES=210	SAT TT=0.118	SAT TT=0.041 CHECKS=15112	SAT TT=0.032 CHECKS=10693	SAT TT=0.792 ASSIGNMENTS=1	SAT TT=0.624 ASSIGNMENTS=1	SAT TT=0.694 CHECKS=2725 NODES=115	SAT TT=0.808 CHECKS=23695 NODES=236	SAT TT=0.598 CHECKS=63307 NODES=347	SAT TT=0.032 ASSIGNMENTS=27 CHECKS=6514	SAT TT=0.032 ASSIGNMENTS=27 CHECKS=6514	SAT TT=1.435	SAT TT=1.296	SAT TT=0.073 CHECKS=4909	SAT TT=0.02 ASSIGNMENTS=18 CHECKS=5475	SAT TT=0.024 ASSIGNMENTS=128 CHECKS=26139	SAT TT=0.56	SAT TT=0.018 ASSIGNMENTS=31 CHECKS=4629	SAT TT=0.021 ASSIGNMENTS=27 CHECKS=6514	SAT TT=1.14	SAT TT=0.043 ASSIGNMENTS=154 CHECKS=23821	SAT TT=0.904	SAT TT=1.104
csp/aim-100/ normalized-aim-100-6-0-sat-3_ext.xml	SAT TT=0.019	SAT TT=0.92 CHECKS=1876 NODES=116	SAT TT=0.938 CHECKS=3048 NODES=0	SAT TT=0.089	SAT TT=0.029 CHECKS=6762	SAT TT=0.031 CHECKS=11254	SAT TT=0.782 ASSIGNMENTS=1	SAT TT=0.633 ASSIGNMENTS=1	SAT TT=0.598 CHECKS=4664 NODES=146	SAT TT=3.681 CHECKS=10094400 NODES=150168	SAT TT=0.593 CHECKS=46215 NODES=171	SAT TT=0.032 ASSIGNMENTS=30 CHECKS=7329	SAT TT=0.033 ASSIGNMENTS=30 CHECKS=7329	SAT TT=1.445	SAT TT=1.222	SAT TT=0.068 CHECKS=5839	SAT TT=0.019 ASSIGNMENTS=22 CHECKS=6290	SAT TT=0.021 ASSIGNMENTS=72 CHECKS=13300	SAT TT=0.631	SAT TT=0.02 ASSIGNMENTS=65 CHECKS=5689	SAT TT=0.019 ASSIGNMENTS=30 CHECKS=7329	SAT TT=1.114	SAT TT=0.044 ASSIGNMENTS=172 CHECKS=29147	SAT TT=0.898	SAT TT=0.864
csp/aim-100/ normalized-aim-100-6-0-sat-4_ext.xml	SAT TT=0.017	SAT TT=1.004 CHECKS=3682 NODES=177	SAT TT=1.05 CHECKS=7157 NODES=289	SAT TT=0.121	SAT TT=0.034 CHECKS=11086	SAT TT=0.026 CHECKS=4382	SAT TT=0.78 ASSIGNMENTS=1	SAT TT=0.719 ASSIGNMENTS=1	SAT TT=0.632 CHECKS=7841 NODES=182	SAT TT=6.771 CHECKS=20423200 NODES=300527	SAT TT=0.593 CHECKS=34954 NODES=70	SAT TT=0.03 ASSIGNMENTS=4 CHECKS=1706	SAT TT=0.031 ASSIGNMENTS=4 CHECKS=1706	SAT TT=1.352	SAT TT=1.318	SAT TT=0.072 CHECKS=1088	SAT TT=0.019 ASSIGNMENTS=4 CHECKS=1706	SAT TT=0.021 ASSIGNMENTS=57 CHECKS=12723	SAT TT=0.525	SAT TT=0.017 ASSIGNMENTS=19 CHECKS=2722	SAT TT=0.018 ASSIGNMENTS=4 CHECKS=1706	SAT TT=1.131	SAT TT=0.054 ASSIGNMENTS=200 CHECKS=39342	SAT TT=0.911	SAT TT=0.927
csp/aim-200/ normalized-aim-200-1-6-sat-1_ext.xml	SAT TT=0.021	SAT TT=1.023 CHECKS=11029 NODES=1166	SAT TT=1.009 CHECKS=11207 NODES=1361	? (TO) TT=1800.1	SAT TT=0.025 CHECKS=5722	SAT TT=0.204 CHECKS=165656	SAT TT=0.641 ASSIGNMENTS=109	SAT TT=0.743 ASSIGNMENTS=19	SAT TT=0.603 CHECKS=8905 NODES=650	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=0.037 ASSIGNMENTS=1258 CHECKS=41486	SAT TT=0.039 ASSIGNMENTS=1258 CHECKS=41486	SAT TT=1.269	SAT TT=1.478	SAT TT=0.071 CHECKS=11265	SAT TT=0.021 ASSIGNMENTS=609 CHECKS=20957	SAT TT=0.05 ASSIGNMENTS=9439 CHECKS=133351	SAT TT=0.498	SAT TT=0.036 ASSIGNMENTS=1849 CHECKS=77436	SAT TT=0.024 ASSIGNMENTS=1258 CHECKS=41486	SAT TT=1.097	SAT TT=0.097 ASSIGNMENTS=1397 CHECKS=86627	SAT TT=0.945	SAT TT=1.021
csp/aim-200/ normalized-aim-200-1-6-sat-2_ext.xml	SAT TT=0.026	SAT TT=1.038 CHECKS=21578 NODES=2333	SAT TT=1.121 CHECKS=27461 NODES=2783	? (TO) TT=1800.1	SAT TT=0.026 CHECKS=7575	SAT TT=0.128 CHECKS=90276	SAT TT=0.853 ASSIGNMENTS=1705	SAT TT=1.215 ASSIGNMENTS=2429	SAT TT=0.661 CHECKS=19083 NODES=1445	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.044 ASSIGNMENTS=1785 CHECKS=71585	SAT TT=0.047 ASSIGNMENTS=1785 CHECKS=71585	SAT TT=1.26	SAT TT=1.469	SAT TT=0.112 CHECKS=63908	SAT TT=0.027 ASSIGNMENTS=1700 CHECKS=57651	SAT TT=0.047 ASSIGNMENTS=8708 CHECKS=122936	SAT TT=0.512	SAT TT=0.04 ASSIGNMENTS=2623 CHECKS=85927	SAT TT=0.03 ASSIGNMENTS=1785 CHECKS=71585	SAT TT=1.222	SAT TT=0.102 ASSIGNMENTS=530 CHECKS=35411	SAT TT=0.819	SAT TT=0.82
csp/aim-200/ normalized-aim-200-1-6-sat-3_ext.xml	SAT TT=0.023	SAT TT=1.179 CHECKS=32189 NODES=2509	SAT TT=1.069 CHECKS=15908 NODES=1648	? (TO) TT=1800.03	SAT TT=0.025 CHECKS=8897	SAT TT=0.146 CHECKS=106726	SAT TT=0.849 ASSIGNMENTS=1238	SAT TT=1.042 ASSIGNMENTS=1571	SAT TT=0.623 CHECKS=15885 NODES=959	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=0.045 ASSIGNMENTS=1565 CHECKS=70607	SAT TT=0.044 ASSIGNMENTS=1565 CHECKS=70607	SAT TT=1.481	SAT TT=1.238	SAT TT=0.116 CHECKS=76676	SAT TT=0.031 ASSIGNMENTS=1334 CHECKS=71623	SAT TT=0.042 ASSIGNMENTS=8616 CHECKS=102589	SAT TT=0.503	SAT TT=0.023 ASSIGNMENTS=986 CHECKS=25428	SAT TT=0.033 ASSIGNMENTS=1565 CHECKS=70607	SAT TT=1.179	SAT TT=0.132 ASSIGNMENTS=527 CHECKS=25946	SAT TT=0.954	SAT TT=1.016
csp/aim-200/ normalized-aim-200-1-6-sat-4_ext.xml	SAT TT=0.018	SAT TT=0.964 CHECKS=7397 NODES=1227	SAT TT=0.992 CHECKS=8749 NODES=1302	? (TO) TT=1800.08	SAT TT=0.832 CHECKS=539750	SAT TT=0.222 CHECKS=158736	SAT TT=0.809 ASSIGNMENTS=1357	SAT TT=1.338 ASSIGNMENTS=3798	SAT TT=0.632 CHECKS=7270 NODES=805	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=0.357 ASSIGNMENTS=41221 CHECKS=1176040	SAT TT=0.358 ASSIGNMENTS=41221 CHECKS=1176040	SAT TT=1.212	SAT TT=1.349	SAT TT=0.137 CHECKS=59179	SAT TT=0.05 ASSIGNMENTS=3998 CHECKS=144523	SAT TT=0.053 ASSIGNMENTS=9562 CHECKS=142737	SAT TT=0.512	SAT TT=0.018 ASSIGNMENTS=754 CHECKS=15506	SAT TT=0.303 ASSIGNMENTS=41221 CHECKS=1176040	SAT TT=1.168	SAT TT=0.174 ASSIGNMENTS=615 CHECKS=26419	SAT TT=0.896	SAT TT=1.013
csp/aim-200/ normalized-aim-200-1-6-unsat-1_ext.xml	UNSAT TT=0.1	UNSAT TT=1.264 CHECKS=67766 NODES=6260	UNSAT TT=1.451 CHECKS=110235 NODES=9963	? (TO) TT=1800.04	UNSAT TT=0.256 CHECKS=120605	UNSAT TT=0.205 CHECKS=104252	UNSAT TT=4.365 ASSIGNMENTS=39464	UNSAT TT=0.72 ASSIGNMENTS=388	UNSAT TT=1.024 CHECKS=37586 NODES=2541	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=0.312 ASSIGNMENTS=27682 CHECKS=850312	UNSAT TT=0.31 ASSIGNMENTS=27682 CHECKS=850312	UNSAT TT=0.861	UNSAT TT=0.726	UNSAT TT=0.15 CHECKS=62782	UNSAT TT=0.1 ASSIGNMENTS=11794 CHECKS=290551	UNSAT TT=0.075 ASSIGNMENTS=14419 CHECKS=218094	UNSAT TT=0.664	UNSAT TT=0.102 ASSIGNMENTS=8725 CHECKS=213659	UNSAT TT=0.263 ASSIGNMENTS=27682 CHECKS=850312	UNSAT TT=1.03	UNSAT TT=0.916 ASSIGNMENTS=14738 CHECKS=706070	UNSAT TT=0.918	UNSAT TT=0.819
csp/aim-200/ normalized-aim-200-1-6-unsat-2_ext.xml	UNSAT TT=0.093	UNSAT TT=3.051 CHECKS=677790 NODES=48377	UNSAT TT=2.433 CHECKS=421570 NODES=31169	? (TO) TT=1800.03	UNSAT TT=3.092 CHECKS=1519030	UNSAT TT=1.667 CHECKS=770360	UNSAT TT=37.926 ASSIGNMENTS=461040	UNSAT TT=0.801 ASSIGNMENTS=874	UNSAT TT=1.841 CHECKS=144456 NODES=8846	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.978 ASSIGNMENTS=108309 CHECKS=2758150	UNSAT TT=1.067 ASSIGNMENTS=108309 CHECKS=2758150	UNSAT TT=0.828	UNSAT TT=0.813	UNSAT TT=0.143 CHECKS=67087	UNSAT TT=1.139 ASSIGNMENTS=149653 CHECKS=3776660	UNSAT TT=0.073 ASSIGNMENTS=14253 CHECKS=194678	UNSAT TT=1.602	UNSAT TT=0.093 ASSIGNMENTS=7273 CHECKS=175856	UNSAT TT=0.908 ASSIGNMENTS=108309 CHECKS=2758150	UNSAT TT=1.058	UNSAT TT=1.673 ASSIGNMENTS=35817 CHECKS=1422050	UNSAT TT=0.83	UNSAT TT=0.863
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-200/ normalized-aim-200-1-6-unsat-3_ext.xml	UNSAT TT=0.276	UNSAT TT=1.389 CHECKS=104910 NODES=9817	UNSAT TT=1.507 CHECKS=130883 NODES=11569	? (TO) TT=1800.09	UNSAT TT=0.422 CHECKS=170407	UNSAT TT=78.245 CHECKS=35596400	UNSAT TT=7.519 ASSIGNMENTS=84406	UNSAT TT=2.227 ASSIGNMENTS=10764	UNSAT TT=2.588 CHECKS=216789 NODES=16453	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=0.703 ASSIGNMENTS=73965 CHECKS=1857130	UNSAT TT=0.698 ASSIGNMENTS=73965 CHECKS=1857130	UNSAT TT=0.865	UNSAT TT=0.87	UNSAT TT=0.276 CHECKS=139662	UNSAT TT=0.507 ASSIGNMENTS=66263 CHECKS=1642260	UNSAT TT=0.109 ASSIGNMENTS=19351 CHECKS=326320	UNSAT TT=1.324	UNSAT TT=0.294 ASSIGNMENTS=27068 CHECKS=612829	UNSAT TT=0.593 ASSIGNMENTS=73965 CHECKS=1857130	UNSAT TT=1.103	UNSAT TT=3.412 ASSIGNMENTS=62281 CHECKS=2719140	UNSAT TT=0.912	UNSAT TT=0.896
csp/aim-200/ normalized-aim-200-1-6-unsat-4_ext.xml	UNSAT TT=0.05	UNSAT TT=1.056 CHECKS=15911 NODES=1987	UNSAT TT=1.538 CHECKS=11586 NODES=1400	? (TO) TT=1800.05	UNSAT TT=0.178 CHECKS=77417	UNSAT TT=0.318 CHECKS=180038	UNSAT TT=1.119 ASSIGNMENTS=5150	UNSAT TT=1.109 ASSIGNMENTS=2687	UNSAT TT=0.681 CHECKS=16675 NODES=1360	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=0.086 ASSIGNMENTS=7381 CHECKS=203222	UNSAT TT=0.091 ASSIGNMENTS=7381 CHECKS=203222	UNSAT TT=0.674	UNSAT TT=0.683	UNSAT TT=0.087 CHECKS=31357	UNSAT TT=0.083 ASSIGNMENTS=10013 CHECKS=256527	UNSAT TT=0.05 ASSIGNMENTS=12665 CHECKS=137656	UNSAT TT=0.56	UNSAT TT=0.05 ASSIGNMENTS=4130 CHECKS=90804	UNSAT TT=0.071 ASSIGNMENTS=7381 CHECKS=203222	UNSAT TT=0.959	UNSAT TT=0.24 ASSIGNMENTS=4722 CHECKS=221193	UNSAT TT=0.825	UNSAT TT=0.821
csp/aim-200/ normalized-aim-200-2-0-sat-1_ext.xml	SAT TT=0.046	SAT TT=2.502 CHECKS=509422 NODES=31016	SAT TT=1.179 CHECKS=33816 NODES=3318	? (TO) TT=1800.09	SAT TT=0.046 CHECKS=28612	SAT TT=18.735 CHECKS=16294500	SAT TT=7.138 ASSIGNMENTS=47554	SAT TT=29.794 ASSIGNMENTS=202059	SAT TT=0.812 CHECKS=37256 NODES=2001	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=0.709 ASSIGNMENTS=58735 CHECKS=2402750	SAT TT=0.653 ASSIGNMENTS=58735 CHECKS=2402750	SAT TT=1.503	SAT TT=1.287	SAT TT=0.37 CHECKS=292603	SAT TT=0.603 ASSIGNMENTS=54680 CHECKS=2571650	SAT TT=0.102 ASSIGNMENTS=12374 CHECKS=350327	SAT TT=0.531	SAT TT=0.091 ASSIGNMENTS=6849 CHECKS=246887	SAT TT=0.591 ASSIGNMENTS=58735 CHECKS=2402750	SAT TT=1.268	SAT TT=0.475 ASSIGNMENTS=8167 CHECKS=384294	SAT TT=0.935	SAT TT=0.936
csp/aim-200/ normalized-aim-200-2-0-sat-2_ext.xml	SAT TT=0.032	SAT TT=1.385 CHECKS=90938 NODES=7751	SAT TT=1.349 CHECKS=33199 NODES=3333	? (TO) TT=1800.07	SAT TT=0.032 CHECKS=17918	SAT TT=6.167 CHECKS=5789110	SAT TT=0.892 ASSIGNMENTS=1436	SAT TT=3.513 ASSIGNMENTS=19117	SAT TT=0.781 CHECKS=8773 NODES=742	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=0.307 ASSIGNMENTS=23234 CHECKS=1092160	SAT TT=0.31 ASSIGNMENTS=23234 CHECKS=1092160	SAT TT=1.207	SAT TT=1.204	SAT TT=0.251 CHECKS=190932	SAT TT=0.521 ASSIGNMENTS=41838 CHECKS=2010540	SAT TT=0.097 ASSIGNMENTS=9997 CHECKS=325862	SAT TT=0.533	SAT TT=0.069 ASSIGNMENTS=4727 CHECKS=180051	SAT TT=0.271 ASSIGNMENTS=23234 CHECKS=1092160	SAT TT=1.112	SAT TT=0.968 ASSIGNMENTS=14745 CHECKS=862607	SAT TT=0.894	SAT TT=0.895
csp/aim-200/ normalized-aim-200-2-0-sat-3_ext.xml	SAT TT=0.032	SAT TT=1.125 CHECKS=14497 NODES=1701	SAT TT=1.042 CHECKS=7096 NODES=925	? (TO) TT=1800.05	SAT TT=0.255 CHECKS=168239	SAT TT=0.316 CHECKS=226718	SAT TT=1.743 ASSIGNMENTS=6899	SAT TT=1.063 ASSIGNMENTS=1944	SAT TT=0.606 CHECKS=9252 NODES=730	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.091 ASSIGNMENTS=5275 CHECKS=225910	SAT TT=0.089 ASSIGNMENTS=5275 CHECKS=225910	SAT TT=1.203	SAT TT=1.613	SAT TT=0.171 CHECKS=142569	SAT TT=0.085 ASSIGNMENTS=6760 CHECKS=300611	SAT TT=0.061 ASSIGNMENTS=7833 CHECKS=194761	SAT TT=0.665	SAT TT=0.032 ASSIGNMENTS=1322 CHECKS=42443	SAT TT=0.071 ASSIGNMENTS=5275 CHECKS=225910	SAT TT=1.115	SAT TT=0.151 ASSIGNMENTS=2780 CHECKS=157815	SAT TT=0.942	SAT TT=0.875
csp/aim-200/ normalized-aim-200-2-0-sat-4_ext.xml	SAT TT=0.175	SAT TT=2.376 CHECKS=376081 NODES=28342	SAT TT=1.705 CHECKS=196506 NODES=16455	? (TO) TT=1800.04	SAT TT=4.083 CHECKS=2413160	SAT TT=2.077 CHECKS=1719160	SAT TT=46.733 ASSIGNMENTS=353502	? (TO) TT=1800.06	SAT TT=1.91 CHECKS=196169 NODES=8579	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=0.206 ASSIGNMENTS=14504 CHECKS=662745	SAT TT=0.206 ASSIGNMENTS=14504 CHECKS=662745	SAT TT=1.448	SAT TT=1.523	SAT TT=0.711 CHECKS=712031	SAT TT=0.285 ASSIGNMENTS=26656 CHECKS=1104880	SAT TT=0.094 ASSIGNMENTS=11292 CHECKS=324048	SAT TT=0.499	SAT TT=0.262 ASSIGNMENTS=15794 CHECKS=829886	SAT TT=0.175 ASSIGNMENTS=14504 CHECKS=662745	SAT TT=1.414	SAT TT=0.793 ASSIGNMENTS=9140 CHECKS=390879	SAT TT=0.873	SAT TT=0.969
csp/aim-200/ normalized-aim-200-2-0-unsat-1_ext.xml	UNSAT TT=0.124	UNSAT TT=1.496 CHECKS=100732 NODES=8897	UNSAT TT=1.127 CHECKS=30931 NODES=3274	? (TO) TT=1800.09	UNSAT TT=0.492 CHECKS=220768	UNSAT TT=0.183 CHECKS=107427	UNSAT TT=3.701 ASSIGNMENTS=30063	UNSAT TT=11.176 ASSIGNMENTS=66909	UNSAT TT=0.664 CHECKS=8545 NODES=667	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.194 ASSIGNMENTS=18507 CHECKS=542051	UNSAT TT=0.192 ASSIGNMENTS=18507 CHECKS=542051	UNSAT TT=0.76	UNSAT TT=0.76	UNSAT TT=0.146 CHECKS=69081	UNSAT TT=0.175 ASSIGNMENTS=19989 CHECKS=615076	UNSAT TT=0.084 ASSIGNMENTS=11603 CHECKS=254715	UNSAT TT=0.95	UNSAT TT=0.124 ASSIGNMENTS=10621 CHECKS=276575	UNSAT TT=0.155 ASSIGNMENTS=18507 CHECKS=542051	UNSAT TT=1.129	UNSAT TT=0.136 ASSIGNMENTS=1919 CHECKS=101622	UNSAT TT=0.94	UNSAT TT=1.054
csp/aim-200/ normalized-aim-200-2-0-unsat-2_ext.xml	UNSAT TT=0.046	UNSAT TT=1.146 CHECKS=26963 NODES=2887	UNSAT TT=1.199 CHECKS=34097 NODES=3269	? (TO) TT=1800.11	UNSAT TT=0.224 CHECKS=87525	UNSAT TT=0.357 CHECKS=181892	UNSAT TT=1.433 ASSIGNMENTS=4914	UNSAT TT=4.173 ASSIGNMENTS=19399	UNSAT TT=0.93 CHECKS=31031 NODES=2304	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.062 ASSIGNMENTS=3620 CHECKS=111557	UNSAT TT=0.061 ASSIGNMENTS=3620 CHECKS=111557	UNSAT TT=0.979	UNSAT TT=0.776	UNSAT TT=0.13 CHECKS=49335	UNSAT TT=0.073 ASSIGNMENTS=6305 CHECKS=214256	UNSAT TT=0.075 ASSIGNMENTS=10094 CHECKS=221725	UNSAT TT=0.584	UNSAT TT=0.046 ASSIGNMENTS=2686 CHECKS=74315	UNSAT TT=0.046 ASSIGNMENTS=3620 CHECKS=111557	UNSAT TT=1.125	UNSAT TT=0.157 ASSIGNMENTS=2646 CHECKS=145444	UNSAT TT=0.952	UNSAT TT=0.957
csp/aim-200/ normalized-aim-200-2-0-unsat-3_ext.xml	UNSAT TT=0.023	UNSAT TT=0.964 CHECKS=3008 NODES=498	UNSAT TT=1.008 CHECKS=2641 NODES=396	? (TO) TT=1800.06	UNSAT TT=0.176 CHECKS=79911	UNSAT TT=0.189 CHECKS=110388	UNSAT TT=1.082 ASSIGNMENTS=2556	UNSAT TT=2.867 ASSIGNMENTS=11250	UNSAT TT=0.742 CHECKS=16718 NODES=1263	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.057 ASSIGNMENTS=3802 CHECKS=120210	UNSAT TT=0.061 ASSIGNMENTS=3802 CHECKS=120210	UNSAT TT=0.747	UNSAT TT=0.751	UNSAT TT=0.095 CHECKS=30919	UNSAT TT=0.03 ASSIGNMENTS=1966 CHECKS=68850	UNSAT TT=0.068 ASSIGNMENTS=8470 CHECKS=193920	UNSAT TT=0.576	UNSAT TT=0.023 ASSIGNMENTS=862 CHECKS=17811	UNSAT TT=0.046 ASSIGNMENTS=3802 CHECKS=120210	UNSAT TT=1.065	UNSAT TT=0.059 ASSIGNMENTS=566 CHECKS=29479	UNSAT TT=0.951	UNSAT TT=0.898
csp/aim-200/ normalized-aim-200-2-0-unsat-4_ext.xml	UNSAT TT=0.027	UNSAT TT=1.121 CHECKS=17162 NODES=1811	UNSAT TT=1.147 CHECKS=17871 NODES=1904	? (TO) TT=1800.02	UNSAT TT=0.173 CHECKS=84008	UNSAT TT=0.153 CHECKS=81889	UNSAT TT=1.032 ASSIGNMENTS=3557	UNSAT TT=3.432 ASSIGNMENTS=17814	UNSAT TT=0.603 CHECKS=3927 NODES=321	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=0.055 ASSIGNMENTS=3197 CHECKS=87383	UNSAT TT=0.05 ASSIGNMENTS=3197 CHECKS=87383	UNSAT TT=0.771	UNSAT TT=0.764	UNSAT TT=0.1 CHECKS=35971	UNSAT TT=0.041 ASSIGNMENTS=3174 CHECKS=90460	UNSAT TT=0.061 ASSIGNMENTS=8835 CHECKS=190029	UNSAT TT=0.711	UNSAT TT=0.027 ASSIGNMENTS=1056 CHECKS=25418	UNSAT TT=0.039 ASSIGNMENTS=3197 CHECKS=87383	UNSAT TT=1.055	UNSAT TT=0.072 ASSIGNMENTS=438 CHECKS=23736	UNSAT TT=0.921	UNSAT TT=0.897
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-200/ normalized-aim-200-3-4-sat-1_ext.xml	SAT TT=0.116	SAT TT=1.438 CHECKS=93593 NODES=5310	SAT TT=1.421 CHECKS=73136 NODES=4319	SAT TT=413.578	SAT TT=0.518 CHECKS=369488	SAT TT=0.492 CHECKS=467978	SAT TT=1.556 ASSIGNMENTS=1852	SAT TT=10.808 ASSIGNMENTS=31820	SAT TT=0.715 CHECKS=10639 NODES=442	SAT TT=352.153 CHECKS=1088850000 NODES=28182200	SAT TT=1.366 CHECKS=4638590 NODES=16290	SAT TT=0.14 ASSIGNMENTS=3560 CHECKS=486082	SAT TT=0.139 ASSIGNMENTS=3560 CHECKS=486082	SAT TT=1.529	SAT TT=1.409	SAT TT=0.462 CHECKS=418968	SAT TT=0.233 ASSIGNMENTS=7498 CHECKS=1105960	SAT TT=0.176 ASSIGNMENTS=7192 CHECKS=692968	SAT TT=0.769	SAT TT=0.183 ASSIGNMENTS=4164 CHECKS=691528	SAT TT=0.116 ASSIGNMENTS=3560 CHECKS=486082	SAT TT=1.397	SAT TT=1.176 ASSIGNMENTS=8014 CHECKS=1132020	SAT TT=1.049	SAT TT=1.157
csp/aim-200/ normalized-aim-200-3-4-sat-2_ext.xml	SAT TT=0.034	SAT TT=1.338 CHECKS=40974 NODES=2306	SAT TT=1.666 CHECKS=112624 NODES=5354	SAT TT=107.806	SAT TT=1.966 CHECKS=1477930	SAT TT=13.628 CHECKS=12124700	SAT TT=1.235 ASSIGNMENTS=1220	SAT TT=6.407 ASSIGNMENTS=16146	SAT TT=2.126 CHECKS=253720 NODES=4472	SAT TT=166.171 CHECKS=502942000 NODES=13125200	SAT TT=0.649 CHECKS=195193 NODES=1584	SAT TT=0.044 ASSIGNMENTS=437 CHECKS=56321	SAT TT=0.047 ASSIGNMENTS=437 CHECKS=56321	SAT TT=1.463	SAT TT=1.35	SAT TT=0.165 CHECKS=117131	SAT TT=0.051 ASSIGNMENTS=943 CHECKS=135046	SAT TT=0.197 ASSIGNMENTS=7621 CHECKS=864733	SAT TT=0.71	SAT TT=0.034 ASSIGNMENTS=514 CHECKS=51939	SAT TT=0.034 ASSIGNMENTS=437 CHECKS=56321	SAT TT=1.515	SAT TT=0.262 ASSIGNMENTS=557 CHECKS=73910	SAT TT=1.182	SAT TT=1.196
csp/aim-200/ normalized-aim-200-3-4-sat-3_ext.xml	SAT TT=0.045	SAT TT=3.706 CHECKS=798771 NODES=33688	SAT TT=1.442 CHECKS=91923 NODES=5269	SAT TT=60.547	SAT TT=0.523 CHECKS=387775	SAT TT=19.96 CHECKS=20156900	SAT TT=1.18 ASSIGNMENTS=810	SAT TT=1.378 ASSIGNMENTS=1644	SAT TT=0.751 CHECKS=24165 NODES=722	SAT TT=216.284 CHECKS=622232000 NODES=16217800	SAT TT=0.666 CHECKS=395939 NODES=2427	SAT TT=0.081 ASSIGNMENTS=1137 CHECKS=202171	SAT TT=0.073 ASSIGNMENTS=1137 CHECKS=202171	SAT TT=1.317	SAT TT=1.322	SAT TT=0.217 CHECKS=183005	SAT TT=0.055 ASSIGNMENTS=883 CHECKS=168949	SAT TT=0.279 ASSIGNMENTS=9229 CHECKS=1203210	SAT TT=0.619	SAT TT=0.045 ASSIGNMENTS=1158 CHECKS=115570	SAT TT=0.062 ASSIGNMENTS=1137 CHECKS=202171	SAT TT=1.416	SAT TT=0.965 ASSIGNMENTS=3868 CHECKS=631658	SAT TT=0.922	SAT TT=1.094
csp/aim-200/ normalized-aim-200-3-4-sat-4_ext.xml	SAT TT=0.055	SAT TT=1.184 CHECKS=10487 NODES=924	SAT TT=1.327 CHECKS=24349 NODES=1947	SAT TT=311.112	SAT TT=0.335 CHECKS=230256	SAT TT=0.551 CHECKS=559767	SAT TT=15.809 ASSIGNMENTS=42294	SAT TT=6.634 ASSIGNMENTS=18009	SAT TT=0.758 CHECKS=25332 NODES=607	SAT TT=281.764 CHECKS=874114000 NODES=22651800	? (TO) TT=1800.03	SAT TT=0.084 ASSIGNMENTS=1574 CHECKS=247251	SAT TT=0.087 ASSIGNMENTS=1574 CHECKS=247251	SAT TT=1.63	SAT TT=1.492	SAT TT=0.416 CHECKS=419268	SAT TT=0.223 ASSIGNMENTS=6134 CHECKS=985469	SAT TT=0.135 ASSIGNMENTS=5594 CHECKS=561550	SAT TT=0.665	SAT TT=0.055 ASSIGNMENTS=1203 CHECKS=140078	SAT TT=0.072 ASSIGNMENTS=1574 CHECKS=247251	SAT TT=1.281	SAT TT=0.212 ASSIGNMENTS=742 CHECKS=106897	SAT TT=1.065	SAT TT=1.054
csp/aim-200/ normalized-aim-200-6-0-sat-1_ext.xml	SAT TT=0.036	SAT TT=1.345 CHECKS=9742 NODES=442	SAT TT=1.097 CHECKS=4705 NODES=0	SAT TT=0.523	SAT TT=0.111 CHECKS=45356	SAT TT=0.196 CHECKS=159928	SAT TT=0.935 ASSIGNMENTS=8	SAT TT=0.788 ASSIGNMENTS=2	SAT TT=0.803 CHECKS=3850 NODES=223	SAT TT=5.497 CHECKS=10526400 NODES=152155	SAT TT=0.823 CHECKS=149257 NODES=667	SAT TT=0.057 ASSIGNMENTS=158 CHECKS=62878	SAT TT=0.058 ASSIGNMENTS=158 CHECKS=62878	SAT TT=1.688	SAT TT=1.588	SAT TT=0.22 CHECKS=147498	SAT TT=0.04 ASSIGNMENTS=124 CHECKS=39264	SAT TT=0.15 ASSIGNMENTS=2367 CHECKS=624995	SAT TT=0.672	SAT TT=0.036 ASSIGNMENTS=26 CHECKS=5553	SAT TT=0.044 ASSIGNMENTS=158 CHECKS=62878	SAT TT=1.758	SAT TT=0.105 ASSIGNMENTS=385 CHECKS=60565	SAT TT=0.995	SAT TT=1.02
csp/aim-200/ normalized-aim-200-6-0-sat-2_ext.xml	SAT TT=0.052	SAT TT=1.216 CHECKS=11440 NODES=519	SAT TT=1.158 CHECKS=8092 NODES=383	SAT TT=31.235	SAT TT=0.533 CHECKS=356619	SAT TT=0.197 CHECKS=155651	SAT TT=1.283 ASSIGNMENTS=411	SAT TT=0.783 ASSIGNMENTS=39	SAT TT=0.926 CHECKS=29892 NODES=447	SAT TT=4.999 CHECKS=10526500 NODES=150831	SAT TT=0.769 CHECKS=119405 NODES=156	SAT TT=0.092 ASSIGNMENTS=721 CHECKS=279403	SAT TT=0.096 ASSIGNMENTS=721 CHECKS=279403	SAT TT=1.499	SAT TT=1.737	SAT TT=0.105 CHECKS=26070	SAT TT=0.073 ASSIGNMENTS=614 CHECKS=250029	SAT TT=0.208 ASSIGNMENTS=4241 CHECKS=1039110	SAT TT=0.729	SAT TT=0.052 ASSIGNMENTS=566 CHECKS=121971	SAT TT=0.085 ASSIGNMENTS=721 CHECKS=279403	SAT TT=1.866	SAT TT=0.189 ASSIGNMENTS=748 CHECKS=223057	SAT TT=0.973	SAT TT=1.068
csp/aim-200/ normalized-aim-200-6-0-sat-3_ext.xml	SAT TT=0.034	SAT TT=1.231 CHECKS=15252 NODES=617	SAT TT=1.189 CHECKS=6741 NODES=321	SAT TT=59.204	SAT TT=0.08 CHECKS=35355	SAT TT=0.548 CHECKS=483646	SAT TT=0.806 ASSIGNMENTS=14	SAT TT=0.853 ASSIGNMENTS=4	SAT TT=0.785 CHECKS=9732 NODES=253	SAT TT=9.23 CHECKS=20811000 NODES=300337	SAT TT=0.827 CHECKS=130517 NODES=310	SAT TT=0.049 ASSIGNMENTS=74 CHECKS=24294	SAT TT=0.05 ASSIGNMENTS=74 CHECKS=24294	SAT TT=1.755	SAT TT=1.581	SAT TT=0.125 CHECKS=48290	SAT TT=0.045 ASSIGNMENTS=235 CHECKS=83036	SAT TT=0.047 ASSIGNMENTS=256 CHECKS=70039	SAT TT=0.67	SAT TT=0.04 ASSIGNMENTS=272 CHECKS=27161	SAT TT=0.034 ASSIGNMENTS=74 CHECKS=24294	SAT TT=1.914	SAT TT=0.129 ASSIGNMENTS=266 CHECKS=31352	SAT TT=1.07	SAT TT=1.234
csp/aim-200/ normalized-aim-200-6-0-sat-4_ext.xml	SAT TT=0.04	SAT TT=1.452 CHECKS=63138 NODES=2466	SAT TT=1.201 CHECKS=5346 NODES=0	SAT TT=11.757	SAT TT=0.209 CHECKS=106012	SAT TT=0.363 CHECKS=295753	SAT TT=0.996 ASSIGNMENTS=306	SAT TT=0.744 ASSIGNMENTS=28	SAT TT=0.976 CHECKS=28293 NODES=456	SAT TT=23.469 CHECKS=51751700 NODES=750589	SAT TT=0.818 CHECKS=120736 NODES=229	SAT TT=0.068 ASSIGNMENTS=420 CHECKS=151332	SAT TT=0.067 ASSIGNMENTS=420 CHECKS=151332	SAT TT=1.589	SAT TT=1.49	SAT TT=0.427 CHECKS=357619	SAT TT=0.129 ASSIGNMENTS=1323 CHECKS=533288	SAT TT=0.237 ASSIGNMENTS=4339 CHECKS=1104890	SAT TT=0.662	SAT TT=0.04 ASSIGNMENTS=300 CHECKS=37101	SAT TT=0.061 ASSIGNMENTS=420 CHECKS=151332	SAT TT=1.91	SAT TT=0.257 ASSIGNMENTS=341 CHECKS=76300	SAT TT=1.226	SAT TT=1.019
csp/aim-50/ normalized-aim-50-1-6-sat-1_ext.xml	SAT TT=0.007	SAT TT=0.745 CHECKS=2808 NODES=322	SAT TT=0.771 CHECKS=1463 NODES=207	SAT TT=0.086	SAT TT=0.009 CHECKS=1187	SAT TT=0.021 CHECKS=17728	SAT TT=0.434 ASSIGNMENTS=7	SAT TT=0.405 ASSIGNMENTS=3	SAT TT=0.392 CHECKS=1226 NODES=130	SAT TT=127.314 CHECKS=468919000 NODES=81600600	SAT TT=0.373 CHECKS=127074 NODES=1243	SAT TT=0.023 ASSIGNMENTS=309 CHECKS=9070	SAT TT=0.023 ASSIGNMENTS=309 CHECKS=9070	SAT TT=0.782	SAT TT=0.861	SAT TT=0.034 CHECKS=2062	SAT TT=0.009 ASSIGNMENTS=312 CHECKS=7820	SAT TT=0.021 ASSIGNMENTS=4316 CHECKS=62439	SAT TT=0.322	SAT TT=0.007 ASSIGNMENTS=77 CHECKS=964	SAT TT=0.011 ASSIGNMENTS=309 CHECKS=9070	SAT TT=0.737	SAT TT=0.015 ASSIGNMENTS=124 CHECKS=2506	SAT TT=0.59	SAT TT=0.607
csp/aim-50/ normalized-aim-50-1-6-sat-2_ext.xml	SAT TT=0.006	SAT TT=0.766 CHECKS=792 NODES=132	SAT TT=0.68 CHECKS=325 NODES=0	SAT TT=0.136	SAT TT=0.012 CHECKS=958	SAT TT=0.011 CHECKS=2502	SAT TT=0.427 ASSIGNMENTS=1	SAT TT=0.436 ASSIGNMENTS=1	SAT TT=0.366 CHECKS=1717 NODES=118	SAT TT=2.881 CHECKS=8895340 NODES=1800060	SAT TT=0.347 CHECKS=25091 NODES=284	SAT TT=0.02 ASSIGNMENTS=51 CHECKS=1416	SAT TT=0.02 ASSIGNMENTS=51 CHECKS=1416	SAT TT=0.974	SAT TT=0.796	SAT TT=0.034 CHECKS=1167	SAT TT=0.008 ASSIGNMENTS=57 CHECKS=2605	SAT TT=0.01 ASSIGNMENTS=769 CHECKS=11858	SAT TT=0.318	SAT TT=0.006 ASSIGNMENTS=80 CHECKS=973	SAT TT=0.008 ASSIGNMENTS=51 CHECKS=1416	SAT TT=0.794	SAT TT=0.013 ASSIGNMENTS=103 CHECKS=1825	SAT TT=0.555	SAT TT=0.582
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-50/ normalized-aim-50-1-6-sat-3_ext.xml	SAT TT=0.007	SAT TT=0.755 CHECKS=801 NODES=130	SAT TT=0.736 CHECKS=259 NODES=0	SAT TT=0.063	SAT TT=0.013 CHECKS=2004	SAT TT=0.014 CHECKS=4294	SAT TT=0.398 ASSIGNMENTS=2	SAT TT=0.418 ASSIGNMENTS=4	SAT TT=0.344 CHECKS=211 NODES=51	SAT TT=3.811 CHECKS=13156100 NODES=972600	SAT TT=0.378 CHECKS=55885 NODES=579	SAT TT=0.02 ASSIGNMENTS=48 CHECKS=1390	SAT TT=0.021 ASSIGNMENTS=48 CHECKS=1390	SAT TT=0.868	SAT TT=0.978	SAT TT=0.054 CHECKS=914	SAT TT=0.007 ASSIGNMENTS=58 CHECKS=1462	SAT TT=0.011 ASSIGNMENTS=959 CHECKS=14978	SAT TT=0.343	SAT TT=0.009 ASSIGNMENTS=96 CHECKS=1636	SAT TT=0.008 ASSIGNMENTS=48 CHECKS=1390	SAT TT=0.78	SAT TT=0.016 ASSIGNMENTS=62 CHECKS=1662	SAT TT=0.595	SAT TT=0.564
csp/aim-50/ normalized-aim-50-1-6-sat-4_ext.xml	SAT TT=0.007	SAT TT=0.765 CHECKS=2457 NODES=286	SAT TT=0.722 CHECKS=282 NODES=0	SAT TT=0.057	SAT TT=0.009 CHECKS=415	SAT TT=0.012 CHECKS=2887	SAT TT=0.416 ASSIGNMENTS=1	SAT TT=0.412 ASSIGNMENTS=1	SAT TT=0.342 CHECKS=572 NODES=77	SAT TT=0.462 CHECKS=341987 NODES=48334	SAT TT=0.38 CHECKS=72731 NODES=813	SAT TT=0.021 ASSIGNMENTS=68 CHECKS=2555	SAT TT=0.02 ASSIGNMENTS=68 CHECKS=2555	SAT TT=0.775	SAT TT=1.055	SAT TT=0.039 CHECKS=3290	SAT TT=0.007 ASSIGNMENTS=71 CHECKS=2622	SAT TT=0.016 ASSIGNMENTS=1334 CHECKS=23081	SAT TT=0.323	SAT TT=0.008 ASSIGNMENTS=35 CHECKS=518	SAT TT=0.009 ASSIGNMENTS=68 CHECKS=2555	SAT TT=0.726	SAT TT=0.015 ASSIGNMENTS=52 CHECKS=1636	SAT TT=0.579	SAT TT=0.582
csp/aim-50/ normalized-aim-50-1-6-unsat-1_ext.xml	UNSAT TT=0.006	UNSAT TT=0.737 CHECKS=941 NODES=95	UNSAT TT=0.732 CHECKS=240 NODES=0	UNSAT TT=0.039	UNSAT TT=0.01 CHECKS=239	UNSAT TT=0.018 CHECKS=8453	UNSAT TT=0.38 ASSIGNMENTS=0	UNSAT TT=0.424 ASSIGNMENTS=0	UNSAT TT=0.393 CHECKS=952 NODES=47	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.019 ASSIGNMENTS=44 CHECKS=1225	UNSAT TT=0.019 ASSIGNMENTS=44 CHECKS=1225	UNSAT TT=0.608	UNSAT TT=0.475	UNSAT TT=0.04 CHECKS=1257	UNSAT TT=0.009 ASSIGNMENTS=37 CHECKS=1141	UNSAT TT=0.012 ASSIGNMENTS=829 CHECKS=12395	UNSAT TT=0.32	UNSAT TT=0.006 ASSIGNMENTS=22 CHECKS=311	UNSAT TT=0.007 ASSIGNMENTS=44 CHECKS=1225	UNSAT TT=0.767	UNSAT TT=0.012 ASSIGNMENTS=101 CHECKS=5836	UNSAT TT=0.582	UNSAT TT=0.568
csp/aim-50/ normalized-aim-50-1-6-unsat-2_ext.xml	UNSAT TT=0.009	UNSAT TT=0.807 CHECKS=6668 NODES=749	UNSAT TT=0.81 CHECKS=4868 NODES=561	UNSAT TT=0.218	UNSAT TT=0.024 CHECKS=13259	UNSAT TT=0.031 CHECKS=25479	UNSAT TT=0.51 ASSIGNMENTS=449	UNSAT TT=0.458 ASSIGNMENTS=144	UNSAT TT=0.387 CHECKS=2178 NODES=183	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.022 ASSIGNMENTS=425 CHECKS=10996	UNSAT TT=0.023 ASSIGNMENTS=425 CHECKS=10996	UNSAT TT=0.623	UNSAT TT=0.673	UNSAT TT=0.043 CHECKS=8096	UNSAT TT=0.01 ASSIGNMENTS=548 CHECKS=11986	UNSAT TT=0.025 ASSIGNMENTS=4874 CHECKS=58579	UNSAT TT=0.329	UNSAT TT=0.01 ASSIGNMENTS=329 CHECKS=7318	UNSAT TT=0.009 ASSIGNMENTS=425 CHECKS=10996	UNSAT TT=0.772	UNSAT TT=0.019 ASSIGNMENTS=272 CHECKS=9590	UNSAT TT=0.591	UNSAT TT=0.594
csp/aim-50/ normalized-aim-50-1-6-unsat-3_ext.xml	UNSAT TT=0.007	UNSAT TT=0.733 CHECKS=764 NODES=63	UNSAT TT=0.741 CHECKS=704 NODES=34	UNSAT TT=0.873	UNSAT TT=0.011 CHECKS=202	UNSAT TT=0.041 CHECKS=31111	UNSAT TT=0.4 ASSIGNMENTS=0	UNSAT TT=0.439 ASSIGNMENTS=0	UNSAT TT=0.374 CHECKS=737 NODES=28	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.021 ASSIGNMENTS=72 CHECKS=2689	UNSAT TT=0.021 ASSIGNMENTS=72 CHECKS=2689	UNSAT TT=0.464	UNSAT TT=0.499	UNSAT TT=0.065 CHECKS=2453	UNSAT TT=0.008 ASSIGNMENTS=82 CHECKS=2919	UNSAT TT=0.011 ASSIGNMENTS=355 CHECKS=4198	UNSAT TT=0.32	UNSAT TT=0.008 ASSIGNMENTS=104 CHECKS=1216	UNSAT TT=0.007 ASSIGNMENTS=72 CHECKS=2689	UNSAT TT=0.723	UNSAT TT=0.014 ASSIGNMENTS=23 CHECKS=1135	UNSAT TT=0.588	UNSAT TT=0.589
csp/aim-50/ normalized-aim-50-1-6-unsat-4_ext.xml	UNSAT TT=0.007	UNSAT TT=0.737 CHECKS=755 NODES=100	UNSAT TT=0.816 CHECKS=564 NODES=64	UNSAT TT=0.047	UNSAT TT=0.01 CHECKS=718	UNSAT TT=0.012 CHECKS=3711	UNSAT TT=0.427 ASSIGNMENTS=0	UNSAT TT=0.406 ASSIGNMENTS=0	UNSAT TT=0.376 CHECKS=580 NODES=41	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.018 ASSIGNMENTS=46 CHECKS=1148	UNSAT TT=0.021 ASSIGNMENTS=46 CHECKS=1148	UNSAT TT=0.498	UNSAT TT=0.523	UNSAT TT=0.057 CHECKS=803	UNSAT TT=0.008 ASSIGNMENTS=36 CHECKS=928	UNSAT TT=0.023 ASSIGNMENTS=4581 CHECKS=55443	UNSAT TT=0.341	UNSAT TT=0.007 ASSIGNMENTS=107 CHECKS=1264	UNSAT TT=0.009 ASSIGNMENTS=46 CHECKS=1148	UNSAT TT=0.752	UNSAT TT=0.012 ASSIGNMENTS=8 CHECKS=544	UNSAT TT=0.604	UNSAT TT=0.588
csp/aim-50/ normalized-aim-50-2-0-sat-1_ext.xml	SAT TT=0.008	SAT TT=0.872 CHECKS=975 NODES=138	SAT TT=0.789 CHECKS=1173 NODES=116	SAT TT=0.208	SAT TT=0.012 CHECKS=1194	SAT TT=0.014 CHECKS=5931	SAT TT=0.393 ASSIGNMENTS=1	SAT TT=0.455 ASSIGNMENTS=1	SAT TT=0.394 CHECKS=1432 NODES=141	SAT TT=0.523 CHECKS=675763 NODES=58813	SAT TT=0.386 CHECKS=25855 NODES=240	SAT TT=0.021 ASSIGNMENTS=146 CHECKS=3780	SAT TT=0.021 ASSIGNMENTS=146 CHECKS=3780	SAT TT=0.82	SAT TT=0.855	SAT TT=0.041 CHECKS=3253	SAT TT=0.009 ASSIGNMENTS=112 CHECKS=3026	SAT TT=0.023 ASSIGNMENTS=2792 CHECKS=62123	SAT TT=0.332	SAT TT=0.008 ASSIGNMENTS=134 CHECKS=2470	SAT TT=0.01 ASSIGNMENTS=146 CHECKS=3780	SAT TT=0.759	SAT TT=0.017 ASSIGNMENTS=111 CHECKS=4357	SAT TT=0.609	SAT TT=0.604
csp/aim-50/ normalized-aim-50-2-0-sat-2_ext.xml	SAT TT=0.007	SAT TT=0.852 CHECKS=3854 NODES=447	SAT TT=0.774 CHECKS=2871 NODES=322	SAT TT=0.081	SAT TT=0.012 CHECKS=2288	SAT TT=0.013 CHECKS=5550	SAT TT=0.464 ASSIGNMENTS=53	SAT TT=0.436 ASSIGNMENTS=34	SAT TT=0.352 CHECKS=544 NODES=78	SAT TT=0.481 CHECKS=367759 NODES=17603	SAT TT=0.4 CHECKS=56849 NODES=543	SAT TT=0.02 ASSIGNMENTS=94 CHECKS=3025	SAT TT=0.041 ASSIGNMENTS=94 CHECKS=3025	SAT TT=0.867	SAT TT=1.051	SAT TT=0.042 CHECKS=1464	SAT TT=0.009 ASSIGNMENTS=79 CHECKS=2594	SAT TT=0.017 ASSIGNMENTS=1683 CHECKS=39770	SAT TT=0.33	SAT TT=0.007 ASSIGNMENTS=116 CHECKS=2247	SAT TT=0.009 ASSIGNMENTS=94 CHECKS=3025	SAT TT=0.818	SAT TT=0.016 ASSIGNMENTS=184 CHECKS=5885	SAT TT=0.597	SAT TT=0.584
csp/aim-50/ normalized-aim-50-2-0-sat-3_ext.xml	SAT TT=0.009	SAT TT=0.872 CHECKS=881 NODES=142	SAT TT=0.763 CHECKS=1040 NODES=148	SAT TT=0.071	SAT TT=0.013 CHECKS=4067	SAT TT=0.015 CHECKS=6206	SAT TT=0.443 ASSIGNMENTS=100	SAT TT=0.473 ASSIGNMENTS=65	SAT TT=0.356 CHECKS=716 NODES=78	SAT TT=0.554 CHECKS=602614 NODES=31975	SAT TT=0.42 CHECKS=158615 NODES=1353	SAT TT=0.021 ASSIGNMENTS=75 CHECKS=2280	SAT TT=0.02 ASSIGNMENTS=75 CHECKS=2280	SAT TT=0.854	SAT TT=0.843	SAT TT=0.052 CHECKS=2288	SAT TT=0.009 ASSIGNMENTS=73 CHECKS=2204	SAT TT=0.012 ASSIGNMENTS=312 CHECKS=8475	SAT TT=0.323	SAT TT=0.009 ASSIGNMENTS=102 CHECKS=2205	SAT TT=0.01 ASSIGNMENTS=75 CHECKS=2280	SAT TT=0.748	SAT TT=0.02 ASSIGNMENTS=249 CHECKS=8598	SAT TT=0.599	SAT TT=0.61
csp/aim-50/ normalized-aim-50-2-0-sat-4_ext.xml	SAT TT=0.006	SAT TT=0.724 CHECKS=1267 NODES=155	SAT TT=0.773 CHECKS=1476 NODES=119	SAT TT=0.053	SAT TT=0.011 CHECKS=1430	SAT TT=0.013 CHECKS=5796	SAT TT=0.437 ASSIGNMENTS=5	SAT TT=0.425 ASSIGNMENTS=7	SAT TT=0.39 CHECKS=447 NODES=68	SAT TT=0.42 CHECKS=80401 NODES=3778	SAT TT=0.378 CHECKS=10336 NODES=126	SAT TT=0.019 ASSIGNMENTS=24 CHECKS=895	SAT TT=0.02 ASSIGNMENTS=24 CHECKS=895	SAT TT=1.001	SAT TT=0.797	SAT TT=0.045 CHECKS=1258	SAT TT=0.008 ASSIGNMENTS=44 CHECKS=1272	SAT TT=0.013 ASSIGNMENTS=381 CHECKS=10817	SAT TT=0.33	SAT TT=0.008 ASSIGNMENTS=27 CHECKS=629	SAT TT=0.006 ASSIGNMENTS=24 CHECKS=895	SAT TT=0.742	SAT TT=0.013 ASSIGNMENTS=89 CHECKS=2794	SAT TT=0.609	SAT TT=0.606
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-50/ normalized-aim-50-2-0-unsat-1_ext.xml	UNSAT TT=0.01	UNSAT TT=0.85 CHECKS=1930 NODES=195	UNSAT TT=0.804 CHECKS=1863 NODES=158	UNSAT TT=0.174	UNSAT TT=0.021 CHECKS=8972	UNSAT TT=0.024 CHECKS=20978	UNSAT TT=0.586 ASSIGNMENTS=418	UNSAT TT=0.545 ASSIGNMENTS=233	UNSAT TT=0.412 CHECKS=1335 NODES=84	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.022 ASSIGNMENTS=220 CHECKS=6449	UNSAT TT=0.02 ASSIGNMENTS=220 CHECKS=6449	UNSAT TT=0.512	UNSAT TT=0.509	UNSAT TT=0.051 CHECKS=2903	UNSAT TT=0.012 ASSIGNMENTS=230 CHECKS=6566	UNSAT TT=0.033 ASSIGNMENTS=4355 CHECKS=93427	UNSAT TT=0.324	UNSAT TT=0.01 ASSIGNMENTS=129 CHECKS=2483	UNSAT TT=0.01 ASSIGNMENTS=220 CHECKS=6449	UNSAT TT=0.74	UNSAT TT=0.018 ASSIGNMENTS=193 CHECKS=10384	UNSAT TT=0.634	UNSAT TT=0.62
csp/aim-50/ normalized-aim-50-2-0-unsat-2_ext.xml	UNSAT TT=0.008	UNSAT TT=0.743 CHECKS=1886 NODES=282	UNSAT TT=0.954 CHECKS=2284 NODES=265	UNSAT TT=0.192	UNSAT TT=0.016 CHECKS=4599	UNSAT TT=0.015 CHECKS=6469	UNSAT TT=0.427 ASSIGNMENTS=95	UNSAT TT=0.454 ASSIGNMENTS=16	UNSAT TT=0.361 CHECKS=1060 NODES=71	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.022 ASSIGNMENTS=111 CHECKS=2894	UNSAT TT=0.02 ASSIGNMENTS=111 CHECKS=2894	UNSAT TT=0.471	UNSAT TT=0.65	UNSAT TT=0.061 CHECKS=2530	UNSAT TT=0.01 ASSIGNMENTS=83 CHECKS=2249	UNSAT TT=0.032 ASSIGNMENTS=4064 CHECKS=96877	UNSAT TT=0.322	UNSAT TT=0.011 ASSIGNMENTS=122 CHECKS=2645	UNSAT TT=0.008 ASSIGNMENTS=111 CHECKS=2894	UNSAT TT=0.734	UNSAT TT=0.014 ASSIGNMENTS=120 CHECKS=4430	UNSAT TT=0.593	UNSAT TT=0.605
csp/aim-50/ normalized-aim-50-2-0-unsat-3_ext.xml	UNSAT TT=0.008	UNSAT TT=0.777 CHECKS=2217 NODES=251	UNSAT TT=0.82 CHECKS=2163 NODES=253	UNSAT TT=0.146	UNSAT TT=0.015 CHECKS=3622	UNSAT TT=0.02 CHECKS=13042	UNSAT TT=0.435 ASSIGNMENTS=82	UNSAT TT=0.468 ASSIGNMENTS=131	UNSAT TT=0.386 CHECKS=954 NODES=51	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.022 ASSIGNMENTS=157 CHECKS=4921	UNSAT TT=0.021 ASSIGNMENTS=157 CHECKS=4921	UNSAT TT=0.509	UNSAT TT=0.517	UNSAT TT=0.064 CHECKS=3056	UNSAT TT=0.01 ASSIGNMENTS=174 CHECKS=5493	UNSAT TT=0.032 ASSIGNMENTS=4133 CHECKS=84382	UNSAT TT=0.318	UNSAT TT=0.009 ASSIGNMENTS=125 CHECKS=2453	UNSAT TT=0.008 ASSIGNMENTS=157 CHECKS=4921	UNSAT TT=0.789	UNSAT TT=0.015 ASSIGNMENTS=56 CHECKS=2720	UNSAT TT=0.62	UNSAT TT=0.603
csp/aim-50/ normalized-aim-50-2-0-unsat-4_ext.xml	UNSAT TT=0.008	UNSAT TT=0.795 CHECKS=1880 NODES=238	UNSAT TT=0.825 CHECKS=1227 NODES=130	UNSAT TT=0.199	UNSAT TT=0.017 CHECKS=4459	UNSAT TT=0.016 CHECKS=6916	UNSAT TT=0.449 ASSIGNMENTS=132	UNSAT TT=0.503 ASSIGNMENTS=147	UNSAT TT=0.389 CHECKS=872 NODES=55	? (TO) TT=1800.12	? (TO) TT=1800.02	UNSAT TT=0.024 ASSIGNMENTS=114 CHECKS=3134	UNSAT TT=0.021 ASSIGNMENTS=114 CHECKS=3134	UNSAT TT=0.637	UNSAT TT=0.482	UNSAT TT=0.05 CHECKS=1757	UNSAT TT=0.008 ASSIGNMENTS=121 CHECKS=3225	UNSAT TT=0.028 ASSIGNMENTS=4382 CHECKS=81259	UNSAT TT=0.35	UNSAT TT=0.011 ASSIGNMENTS=196 CHECKS=3789	UNSAT TT=0.01 ASSIGNMENTS=114 CHECKS=3134	UNSAT TT=0.739	UNSAT TT=0.013 ASSIGNMENTS=77 CHECKS=3050	UNSAT TT=0.603	UNSAT TT=0.601
csp/aim-50/ normalized-aim-50-3-4-sat-1_ext.xml	SAT TT=0.008	SAT TT=0.803 CHECKS=702 NODES=73	SAT TT=0.782 CHECKS=870 NODES=58	SAT TT=0.054	SAT TT=0.013 CHECKS=1312	SAT TT=0.013 CHECKS=1102	SAT TT=0.469 ASSIGNMENTS=6	SAT TT=0.518 ASSIGNMENTS=18	SAT TT=0.419 CHECKS=1913 NODES=90	SAT TT=0.407 CHECKS=89249 NODES=2318	SAT TT=0.48 CHECKS=9018 NODES=54	SAT TT=0.022 ASSIGNMENTS=5 CHECKS=468	SAT TT=0.023 ASSIGNMENTS=5 CHECKS=468	SAT TT=1.105	SAT TT=1.088	SAT TT=0.066 CHECKS=1814	SAT TT=0.009 ASSIGNMENTS=5 CHECKS=468	SAT TT=0.011 ASSIGNMENTS=68 CHECKS=4270	SAT TT=0.409	SAT TT=0.011 ASSIGNMENTS=89 CHECKS=3931	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=468	SAT TT=0.863	SAT TT=0.019 ASSIGNMENTS=136 CHECKS=11187	SAT TT=0.628	SAT TT=0.665
csp/aim-50/ normalized-aim-50-3-4-sat-2_ext.xml	SAT TT=0.01	SAT TT=0.919 CHECKS=3802 NODES=274	SAT TT=0.828 CHECKS=4071 NODES=241	SAT TT=0.053	SAT TT=0.019 CHECKS=7001	SAT TT=0.021 CHECKS=13117	SAT TT=0.513 ASSIGNMENTS=70	SAT TT=0.461 ASSIGNMENTS=21	SAT TT=0.373 CHECKS=530 NODES=52	SAT TT=0.437 CHECKS=91486 NODES=2315	SAT TT=0.442 CHECKS=137244 NODES=1014	SAT TT=0.022 ASSIGNMENTS=51 CHECKS=3704	SAT TT=0.022 ASSIGNMENTS=51 CHECKS=3704	SAT TT=0.906	SAT TT=1.167	SAT TT=0.055 CHECKS=7101	SAT TT=0.011 ASSIGNMENTS=63 CHECKS=5922	SAT TT=0.015 ASSIGNMENTS=333 CHECKS=25840	SAT TT=0.41	SAT TT=0.011 ASSIGNMENTS=21 CHECKS=931	SAT TT=0.01 ASSIGNMENTS=51 CHECKS=3704	SAT TT=0.871	SAT TT=0.03 ASSIGNMENTS=132 CHECKS=12635	SAT TT=0.662	SAT TT=0.651
csp/aim-50/ normalized-aim-50-3-4-sat-3_ext.xml	SAT TT=0.009	SAT TT=0.826 CHECKS=1107 NODES=80	SAT TT=0.824 CHECKS=1336 NODES=79	SAT TT=0.053	SAT TT=0.018 CHECKS=4045	SAT TT=0.02 CHECKS=11825	SAT TT=0.52 ASSIGNMENTS=54	SAT TT=0.471 ASSIGNMENTS=24	SAT TT=0.434 CHECKS=2493 NODES=102	SAT TT=0.478 CHECKS=39482 NODES=976	SAT TT=0.43 CHECKS=56821 NODES=506	SAT TT=0.023 ASSIGNMENTS=123 CHECKS=11368	SAT TT=0.024 ASSIGNMENTS=123 CHECKS=11368	SAT TT=1.102	SAT TT=0.958	SAT TT=0.069 CHECKS=3510	SAT TT=0.011 ASSIGNMENTS=73 CHECKS=6572	SAT TT=0.01 ASSIGNMENTS=51 CHECKS=3887	SAT TT=0.371	SAT TT=0.009 ASSIGNMENTS=14 CHECKS=691	SAT TT=0.013 ASSIGNMENTS=123 CHECKS=11368	SAT TT=0.787	SAT TT=0.03 ASSIGNMENTS=139 CHECKS=13576	SAT TT=0.692	SAT TT=0.676
csp/aim-50/ normalized-aim-50-3-4-sat-4_ext.xml	SAT TT=0.01	SAT TT=0.783 CHECKS=1943 NODES=128	SAT TT=0.78 CHECKS=974 NODES=53	SAT TT=0.047	SAT TT=0.016 CHECKS=2349	SAT TT=0.016 CHECKS=4471	SAT TT=0.486 ASSIGNMENTS=27	SAT TT=0.531 ASSIGNMENTS=23	SAT TT=0.406 CHECKS=829 NODES=68	SAT TT=0.396 CHECKS=29535 NODES=722	SAT TT=0.43 CHECKS=34591 NODES=336	SAT TT=0.022 ASSIGNMENTS=16 CHECKS=1416	SAT TT=0.02 ASSIGNMENTS=16 CHECKS=1416	SAT TT=0.886	SAT TT=1.144	SAT TT=0.059 CHECKS=4843	SAT TT=0.011 ASSIGNMENTS=12 CHECKS=1441	SAT TT=0.01 ASSIGNMENTS=84 CHECKS=6231	SAT TT=0.364	SAT TT=0.012 ASSIGNMENTS=79 CHECKS=3690	SAT TT=0.01 ASSIGNMENTS=16 CHECKS=1416	SAT TT=0.832	SAT TT=0.019 ASSIGNMENTS=89 CHECKS=6215	SAT TT=0.642	SAT TT=0.668
csp/aim-50/ normalized-aim-50-6-0-sat-1_ext.xml	SAT TT=0.013	SAT TT=0.837 CHECKS=1164 NODES=72	SAT TT=0.854 CHECKS=2424 NODES=57	SAT TT=0.06	SAT TT=0.016 CHECKS=1797	SAT TT=0.016 CHECKS=2552	SAT TT=0.566 ASSIGNMENTS=1	SAT TT=0.542 ASSIGNMENTS=1	SAT TT=0.459 CHECKS=2475 NODES=73	SAT TT=0.653 CHECKS=203734 NODES=2882	SAT TT=0.443 CHECKS=10561 NODES=23	SAT TT=0.026 ASSIGNMENTS=15 CHECKS=1722	SAT TT=0.025 ASSIGNMENTS=15 CHECKS=1722	SAT TT=1.211	SAT TT=1.374	SAT TT=0.057 CHECKS=1288	SAT TT=0.013 ASSIGNMENTS=11 CHECKS=1547	SAT TT=0.013 ASSIGNMENTS=4 CHECKS=1044	SAT TT=0.488	SAT TT=0.013 ASSIGNMENTS=25 CHECKS=2130	SAT TT=0.013 ASSIGNMENTS=15 CHECKS=1722	SAT TT=0.86	SAT TT=0.023 ASSIGNMENTS=84 CHECKS=12073	SAT TT=0.767	SAT TT=0.767
csp/aim-50/ normalized-aim-50-6-0-sat-2_ext.xml	SAT TT=0.013	SAT TT=0.855 CHECKS=2005 NODES=100	SAT TT=0.807 CHECKS=1471 NODES=0	SAT TT=0.062	SAT TT=37.557 CHECKS=3611	SAT TT=0.019 CHECKS=2469	SAT TT=0.528 ASSIGNMENTS=1	SAT TT=0.55 ASSIGNMENTS=1	SAT TT=0.447 CHECKS=595 NODES=51	SAT TT=0.47 CHECKS=7082 NODES=47	SAT TT=0.47 CHECKS=19811 NODES=112	SAT TT=0.024 ASSIGNMENTS=4 CHECKS=1112	SAT TT=0.023 ASSIGNMENTS=4 CHECKS=1112	SAT TT=1.095	SAT TT=1.221	SAT TT=0.083 CHECKS=794	SAT TT=0.013 ASSIGNMENTS=5 CHECKS=1073	SAT TT=0.011 ASSIGNMENTS=6 CHECKS=1646	SAT TT=0.419	SAT TT=0.015 ASSIGNMENTS=22 CHECKS=1876	SAT TT=0.013 ASSIGNMENTS=4 CHECKS=1112	SAT TT=0.928	SAT TT=0.024 ASSIGNMENTS=58 CHECKS=5545	SAT TT=0.81	SAT TT=0.776
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-50/ normalized-aim-50-6-0-sat-3_ext.xml	SAT TT=0.011	SAT TT=0.857 CHECKS=1587 NODES=78	SAT TT=0.779 CHECKS=626 NODES=0	SAT TT=0.061	SAT TT=0.017 CHECKS=3978	SAT TT=0.016 CHECKS=3352	SAT TT=0.575 ASSIGNMENTS=1	SAT TT=0.575 ASSIGNMENTS=1	SAT TT=0.448 CHECKS=513 NODES=50	SAT TT=0.623 CHECKS=16066 NODES=190	SAT TT=0.461 CHECKS=17584 NODES=103	SAT TT=0.025 ASSIGNMENTS=18 CHECKS=2370	SAT TT=0.024 ASSIGNMENTS=18 CHECKS=2370	SAT TT=1.028	SAT TT=1.206	SAT TT=0.089 CHECKS=3722	SAT TT=0.012 ASSIGNMENTS=16 CHECKS=2268	SAT TT=0.012 ASSIGNMENTS=2 CHECKS=860	SAT TT=0.478	SAT TT=0.012 ASSIGNMENTS=6 CHECKS=1200	SAT TT=0.011 ASSIGNMENTS=18 CHECKS=2370	SAT TT=0.9	SAT TT=0.023 ASSIGNMENTS=59 CHECKS=5750	SAT TT=0.76	SAT TT=0.862
csp/aim-50/ normalized-aim-50-6-0-sat-4_ext.xml	SAT TT=0.011	SAT TT=0.849 CHECKS=1771 NODES=88	SAT TT=0.872 CHECKS=1681 NODES=0	SAT TT=0.062	SAT TT=0.017 CHECKS=2589	SAT TT=0.018 CHECKS=5098	SAT TT=0.536 ASSIGNMENTS=1	SAT TT=0.506 ASSIGNMENTS=1	SAT TT=0.439 CHECKS=596 NODES=51	SAT TT=2.912 CHECKS=9820330 NODES=150048	SAT TT=0.439 CHECKS=22347 NODES=150	SAT TT=0.024 ASSIGNMENTS=14 CHECKS=2724	SAT TT=0.022 ASSIGNMENTS=14 CHECKS=2724	SAT TT=1.202	SAT TT=0.998	SAT TT=0.07 CHECKS=4370	SAT TT=0.012 ASSIGNMENTS=21 CHECKS=3527	SAT TT=0.012 ASSIGNMENTS=15 CHECKS=2665	SAT TT=0.417	SAT TT=0.013 ASSIGNMENTS=8 CHECKS=1200	SAT TT=0.011 ASSIGNMENTS=14 CHECKS=2724	SAT TT=0.855	SAT TT=0.025 ASSIGNMENTS=64 CHECKS=7161	SAT TT=0.749	SAT TT=0.903
csp/bddLarge/ normalized-bdd-21-2713-15-79-10_ext.xml	UNSAT TT=20.161	UNSAT TT=75.449 CHECKS=3377 NODES=1579	? (MO) TT=1.737	? (problem) TT=540.272	? (TO) TT=1800.14	? (TO) TT=1800.18	UNSAT TT=502.74 ASSIGNMENTS=1017	UNSAT TT=932.526 ASSIGNMENTS=1413	UNSAT TT=104.103 CHECKS=96745200 NODES=2174	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=43.467 ASSIGNMENTS=1080 CHECKS=2744120	UNSAT TT=43.568 ASSIGNMENTS=1080 CHECKS=2744120	? (MO) TT=1764.19	? (MO) TT=1775.55	UNSAT TT=20.161 CHECKS=1905990	UNSAT TT=29.044 ASSIGNMENTS=953 CHECKS=2516650	UNSAT TT=138.93 ASSIGNMENTS=5088 CHECKS=11761200	? (MO) TT=9.6	UNSAT TT=31.676 ASSIGNMENTS=990 CHECKS=2587020	UNSAT TT=34.385 ASSIGNMENTS=1080 CHECKS=2744120	? TT=92.272	UNSAT TT=1.681 ASSIGNMENTS=2103 CHECKS=195944	? TT=82.751	? TT=77.592
csp/bddLarge/ normalized-bdd-21-2713-15-79-11_ext.xml	UNSAT TT=17.451	UNSAT TT=73.451 CHECKS=4068 NODES=1788	UNSAT TT=80.089 CHECKS=3913 NODES=1688	? (problem) TT=562.562	? (TO) TT=1800.22	? (TO) TT=1800.22	UNSAT TT=911.868 ASSIGNMENTS=1049	UNSAT TT=948.987 ASSIGNMENTS=1358	UNSAT TT=97.693 CHECKS=95507400 NODES=2241	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=49.223 ASSIGNMENTS=1051 CHECKS=3479530	UNSAT TT=46.629 ASSIGNMENTS=1051 CHECKS=3479530	? (MO) TT=1737.24	? (TO) TT=1800	UNSAT TT=17.451 CHECKS=2083980	UNSAT TT=38.9 ASSIGNMENTS=1045 CHECKS=3517360	UNSAT TT=130.019 ASSIGNMENTS=5016 CHECKS=11739500	? (MO) TT=7.4	UNSAT TT=39.778 ASSIGNMENTS=1092 CHECKS=3604380	UNSAT TT=37.212 ASSIGNMENTS=1051 CHECKS=3479530	? TT=98.06	UNSAT TT=1.684 ASSIGNMENTS=2174 CHECKS=182016	? TT=278.531	? TT=175.473
csp/bddLarge/ normalized-bdd-21-2713-15-79-12_ext.xml	UNSAT TT=23.58	UNSAT TT=76.401 CHECKS=4420 NODES=1946	UNSAT TT=76.343 CHECKS=3818 NODES=1663	? (problem) TT=530.24	? (TO) TT=1800.19	? (TO) TT=1800.18	UNSAT TT=597.324 ASSIGNMENTS=1096	UNSAT TT=918.954 ASSIGNMENTS=1376	UNSAT TT=99.969 CHECKS=101402000 NODES=2194	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=47.555 ASSIGNMENTS=1020 CHECKS=3227590	UNSAT TT=44.215 ASSIGNMENTS=1020 CHECKS=3227590	? (MO) TT=1792.49	? (MO) TT=1749.75	UNSAT TT=23.58 CHECKS=2283190	UNSAT TT=41.345 ASSIGNMENTS=1099 CHECKS=3385670	UNSAT TT=133.813 ASSIGNMENTS=5056 CHECKS=11798900	? (MO) TT=7.58	UNSAT TT=40.519 ASSIGNMENTS=1044 CHECKS=3212260	UNSAT TT=38.918 ASSIGNMENTS=1020 CHECKS=3227590	? TT=87.828	UNSAT TT=2.379 ASSIGNMENTS=2380 CHECKS=388061	? TT=173.51	? TT=171.019
csp/bddLarge/ normalized-bdd-21-2713-15-79-13_ext.xml	SAT TT=1.829	SAT TT=10.945 CHECKS=2800 NODES=84	SAT TT=13.537 CHECKS=2784 NODES=63	? (problem) TT=528.163	SAT TT=1429.09 CHECKS=3023260	SAT TT=154.394 CHECKS=223124	SAT TT=378.668 ASSIGNMENTS=1008	SAT TT=112.528 ASSIGNMENTS=264	SAT TT=129.181 CHECKS=127266000 NODES=3166	SAT TT=173.695 CHECKS=252842000 NODES=4656	SAT TT=4.292 CHECKS=865242 NODES=11	SAT TT=33.92 ASSIGNMENTS=996 CHECKS=2326930	SAT TT=36.259 ASSIGNMENTS=996 CHECKS=2326930	? (TO) TT=1800.09	? (MO) TT=1740.44	SAT TT=4.989 CHECKS=560173	SAT TT=25.485 ASSIGNMENTS=1011 CHECKS=2348490	SAT TT=126.027 ASSIGNMENTS=4913 CHECKS=11824300	? (MO) TT=7.67	SAT TT=1.829 ASSIGNMENTS=23 CHECKS=64014	SAT TT=25.527 ASSIGNMENTS=996 CHECKS=2326930	? TT=88.127	SAT TT=1.812 ASSIGNMENTS=2137 CHECKS=156346	? TT=118.121	? TT=108.251
csp/bddLarge/ normalized-bdd-21-2713-15-79-14_ext.xml	UNSAT TT=20.182	UNSAT TT=76.442 CHECKS=4337 NODES=1797	UNSAT TT=78.339 CHECKS=4293 NODES=1797	? (problem) TT=544.606	? (TO) TT=1800.18	? (TO) TT=1800.22	UNSAT TT=553.099 ASSIGNMENTS=1063	UNSAT TT=1088.96 ASSIGNMENTS=1378	UNSAT TT=96.332 CHECKS=94786000 NODES=2179	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=40.446 ASSIGNMENTS=1064 CHECKS=2658980	UNSAT TT=40.31 ASSIGNMENTS=1064 CHECKS=2658980	? (MO) TT=1730.2	? (TO) TT=1800.07	UNSAT TT=20.182 CHECKS=2077040	UNSAT TT=29.608 ASSIGNMENTS=1045 CHECKS=2543630	UNSAT TT=118.182 ASSIGNMENTS=4753 CHECKS=11415200	? (MO) TT=7.41	UNSAT TT=28.473 ASSIGNMENTS=1036 CHECKS=2370010	UNSAT TT=29.492 ASSIGNMENTS=1064 CHECKS=2658980	? TT=93.322	UNSAT TT=1.807 ASSIGNMENTS=2180 CHECKS=231236	? TT=156.024	? TT=149.998
csp/bddLarge/ normalized-bdd-21-2713-15-79-15_ext.xml	UNSAT TT=18.489	UNSAT TT=75.053 CHECKS=3364 NODES=1552	UNSAT TT=89.695 CHECKS=3657 NODES=1544	? (problem) TT=526.969	? (TO) TT=1800.16	? (TO) TT=1800.16	UNSAT TT=418.5 ASSIGNMENTS=949	UNSAT TT=1090.46 ASSIGNMENTS=1408	UNSAT TT=95.81 CHECKS=90291000 NODES=2275	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=32.96 ASSIGNMENTS=972 CHECKS=2279050	UNSAT TT=34.558 ASSIGNMENTS=972 CHECKS=2279050	? (MO) TT=1795.53	? (MO) TT=1699.29	UNSAT TT=18.489 CHECKS=1939770	UNSAT TT=27.632 ASSIGNMENTS=950 CHECKS=2297690	UNSAT TT=129.538 ASSIGNMENTS=4968 CHECKS=11733700	? (MO) TT=7.59	UNSAT TT=28.547 ASSIGNMENTS=988 CHECKS=2377590	UNSAT TT=26.737 ASSIGNMENTS=972 CHECKS=2279050	? TT=95.974	UNSAT TT=1.578 ASSIGNMENTS=2075 CHECKS=144580	? TT=151.406	? TT=135.077
csp/bddLarge/ normalized-bdd-21-2713-15-79-16_ext.xml	UNSAT TT=20.834	UNSAT TT=75.513 CHECKS=2848 NODES=1647	UNSAT TT=87.346 CHECKS=2839 NODES=1666	? (problem) TT=551.773	? (TO) TT=1800.22	? (TO) TT=1800.14	UNSAT TT=517.709 ASSIGNMENTS=976	UNSAT TT=987.725 ASSIGNMENTS=1403	UNSAT TT=103.609 CHECKS=95101700 NODES=2251	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=39.029 ASSIGNMENTS=993 CHECKS=2558580	UNSAT TT=40.195 ASSIGNMENTS=993 CHECKS=2558580	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=20.834 CHECKS=1878100	UNSAT TT=30.634 ASSIGNMENTS=996 CHECKS=2564460	UNSAT TT=133.136 ASSIGNMENTS=5002 CHECKS=11662400	? (MO) TT=7.6	UNSAT TT=29.869 ASSIGNMENTS=1044 CHECKS=2653780	UNSAT TT=30.352 ASSIGNMENTS=993 CHECKS=2558580	? TT=87.929	UNSAT TT=2.027 ASSIGNMENTS=2094 CHECKS=258122	? TT=134.739	? TT=140.713
csp/bddLarge/ normalized-bdd-21-2713-15-79-17_ext.xml	UNSAT TT=17.901	UNSAT TT=77.791 CHECKS=2796 NODES=1534	UNSAT TT=78.278 CHECKS=2833 NODES=1546	? (problem) TT=535.58	? (TO) TT=1800.16	? (TO) TT=1800.15	UNSAT TT=665.002 ASSIGNMENTS=930	UNSAT TT=1087.51 ASSIGNMENTS=1353	UNSAT TT=126.499 CHECKS=121332000 NODES=3085	? (TO) TT=1800.01	? (TO) TT=1800.09	UNSAT TT=42.007 ASSIGNMENTS=918 CHECKS=2666600	UNSAT TT=38.352 ASSIGNMENTS=918 CHECKS=2666600	? (MO) TT=1774.34	? (MO) TT=1743.5	UNSAT TT=17.901 CHECKS=1868550	UNSAT TT=29.664 ASSIGNMENTS=936 CHECKS=2712710	UNSAT TT=134.993 ASSIGNMENTS=4888 CHECKS=11483900	? (MO) TT=7.01	UNSAT TT=33.097 ASSIGNMENTS=972 CHECKS=2785700	UNSAT TT=30.193 ASSIGNMENTS=918 CHECKS=2666600	? TT=92.833	UNSAT TT=1.544 ASSIGNMENTS=2103 CHECKS=147952	? TT=147.356	? TT=141.49
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddLarge/ normalized-bdd-21-2713-15-79-18_ext.xml	UNSAT TT=17.426	UNSAT TT=73.469 CHECKS=3539 NODES=1698	UNSAT TT=80.459 CHECKS=4097 NODES=1805	? (problem) TT=363.737	? (TO) TT=1800.18	? (TO) TT=1800.17	UNSAT TT=501.132 ASSIGNMENTS=1001	UNSAT TT=911.154 ASSIGNMENTS=1349	UNSAT TT=100.868 CHECKS=90786100 NODES=2209	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=35.383 ASSIGNMENTS=931 CHECKS=2229850	UNSAT TT=36.148 ASSIGNMENTS=931 CHECKS=2229850	? (MO) TT=1786.03	? (TO) TT=1800	UNSAT TT=17.426 CHECKS=1998940	UNSAT TT=28.616 ASSIGNMENTS=997 CHECKS=2507850	UNSAT TT=143.498 ASSIGNMENTS=5280 CHECKS=12357500	? (MO) TT=7.4	UNSAT TT=29.391 ASSIGNMENTS=1048 CHECKS=2608780	UNSAT TT=25.151 ASSIGNMENTS=931 CHECKS=2229850	? TT=91.204	UNSAT TT=1.715 ASSIGNMENTS=2107 CHECKS=146214	? TT=112.317	? TT=107.073
csp/bddLarge/ normalized-bdd-21-2713-15-79-19_ext.xml	SAT TT=12.706	SAT TT=24.235 CHECKS=3185 NODES=321	SAT TT=28.389 CHECKS=3237 NODES=317	? (problem) TT=521.08	SAT TT=562.963 CHECKS=1050710	SAT TT=941.565 CHECKS=1870630	SAT TT=393.514 ASSIGNMENTS=876	SAT TT=1001.32 ASSIGNMENTS=1236	SAT TT=119.394 CHECKS=120110000 NODES=2190	SAT TT=13.143 CHECKS=17534700 NODES=318	SAT TT=39.935 CHECKS=66394700 NODES=1169	SAT TT=36.854 ASSIGNMENTS=884 CHECKS=2219740	SAT TT=36.295 ASSIGNMENTS=884 CHECKS=2219740	? (TO) TT=1800.01	? (MO) TT=1766.44	SAT TT=12.706 CHECKS=1298280	SAT TT=26.447 ASSIGNMENTS=905 CHECKS=2287370	SAT TT=143.58 ASSIGNMENTS=5223 CHECKS=12342200	? (MO) TT=6.89	SAT TT=31.06 ASSIGNMENTS=972 CHECKS=2451620	SAT TT=27.76 ASSIGNMENTS=884 CHECKS=2219740	? TT=95.267	SAT TT=1.799 ASSIGNMENTS=2053 CHECKS=183799	? TT=143.301	? TT=151.378
csp/bddLarge/ normalized-bdd-21-2713-15-79-1_ext.xml	UNSAT TT=21.264	UNSAT TT=79.051 CHECKS=3188 NODES=1542	UNSAT TT=91.595 CHECKS=3075 NODES=1592	? (problem) TT=554.699	? (TO) TT=1800.13	? (TO) TT=1800.15	UNSAT TT=681.082 ASSIGNMENTS=988	UNSAT TT=986.172 ASSIGNMENTS=1474	UNSAT TT=107.558 CHECKS=98932400 NODES=2240	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=40.515 ASSIGNMENTS=975 CHECKS=2814450	UNSAT TT=42.407 ASSIGNMENTS=975 CHECKS=2814450	? (MO) TT=1708.4	? (TO) TT=1800.02	UNSAT TT=21.264 CHECKS=1971060	UNSAT TT=33.669 ASSIGNMENTS=985 CHECKS=2835870	UNSAT TT=140.165 ASSIGNMENTS=4787 CHECKS=11448900	? (MO) TT=7.18	UNSAT TT=34.457 ASSIGNMENTS=1095 CHECKS=3045100	UNSAT TT=33.91 ASSIGNMENTS=975 CHECKS=2814450	? TT=97.517	UNSAT TT=1.606 ASSIGNMENTS=2120 CHECKS=162036	? TT=151.893	? TT=162.59
csp/bddLarge/ normalized-bdd-21-2713-15-79-20_ext.xml	UNSAT TT=20.718	UNSAT TT=88.17 CHECKS=3545 NODES=1668	UNSAT TT=85.059 CHECKS=3548 NODES=1651	? (problem) TT=557.04	? (TO) TT=1800.18	? (TO) TT=1800.15	UNSAT TT=541.651 ASSIGNMENTS=1033	UNSAT TT=1151.26 ASSIGNMENTS=1430	UNSAT TT=105.423 CHECKS=102038000 NODES=2222	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=35.547 ASSIGNMENTS=1042 CHECKS=2604580	UNSAT TT=37.139 ASSIGNMENTS=1042 CHECKS=2604580	? (MO) TT=1753.71	? (MO) TT=1773.83	UNSAT TT=20.718 CHECKS=2070290	UNSAT TT=27.151 ASSIGNMENTS=1041 CHECKS=2600350	UNSAT TT=120.811 ASSIGNMENTS=4747 CHECKS=11343200	? (MO) TT=8.2	UNSAT TT=27.744 ASSIGNMENTS=1078 CHECKS=2664880	UNSAT TT=29.358 ASSIGNMENTS=1042 CHECKS=2604580	? TT=85.767	UNSAT TT=1.738 ASSIGNMENTS=2165 CHECKS=182874	? TT=199.88	? TT=194.024
csp/bddLarge/ normalized-bdd-21-2713-15-79-21_ext.xml	UNSAT TT=18.996	UNSAT TT=70.61 CHECKS=3717 NODES=1633	UNSAT TT=72.345 CHECKS=3676 NODES=1644	? (problem) TT=523.827	? (TO) TT=1800.2	? (TO) TT=1800.15	UNSAT TT=629.111 ASSIGNMENTS=998	UNSAT TT=1171.35 ASSIGNMENTS=1513	UNSAT TT=127.925 CHECKS=132136000 NODES=3066	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=38.647 ASSIGNMENTS=991 CHECKS=2586350	UNSAT TT=36.693 ASSIGNMENTS=991 CHECKS=2586350	? (MO) TT=1707.37	? (TO) TT=1800.05	UNSAT TT=18.996 CHECKS=2045950	UNSAT TT=32.226 ASSIGNMENTS=1026 CHECKS=2612970	UNSAT TT=128.656 ASSIGNMENTS=4740 CHECKS=11184900	? (MO) TT=7.41	UNSAT TT=26.622 ASSIGNMENTS=997 CHECKS=2244880	UNSAT TT=30.417 ASSIGNMENTS=991 CHECKS=2586350	? TT=107.501	UNSAT TT=1.98 ASSIGNMENTS=2248 CHECKS=238372	? TT=169.887	? TT=160.315
csp/bddLarge/ normalized-bdd-21-2713-15-79-22_ext.xml	SAT TT=1.674	SAT TT=20.597 CHECKS=2847 NODES=176	SAT TT=8.439 CHECKS=2713 NODES=0	? (problem) TT=523.495	SAT TT=1014.21 CHECKS=2266570	SAT TT=187.636 CHECKS=359718	SAT TT=12.879 ASSIGNMENTS=12	SAT TT=12.889 ASSIGNMENTS=16	SAT TT=29.545 CHECKS=141102 NODES=21	SAT TT=52.193 CHECKS=70578300 NODES=1297	SAT TT=176.532 CHECKS=84183200 NODES=1476	SAT TT=1.674 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.674 ASSIGNMENTS=11 CHECKS=40695	? (TO) TT=1800.01	? (MO) TT=1758.46	SAT TT=7.559 CHECKS=777147	SAT TT=1.676 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.785 ASSIGNMENTS=12 CHECKS=40695	? (MO) TT=6.81	SAT TT=1.706 ASSIGNMENTS=15 CHECKS=40695	SAT TT=1.675 ASSIGNMENTS=11 CHECKS=40695	? TT=104.144	SAT TT=0.38 ASSIGNMENTS=21 CHECKS=6883	? TT=168.226	? TT=170.135
csp/bddLarge/ normalized-bdd-21-2713-15-79-23_ext.xml	UNSAT TT=22.809	UNSAT TT=74.582 CHECKS=4326 NODES=1854	UNSAT TT=76.905 CHECKS=4041 NODES=1801	? (problem) TT=572.871	? (TO) TT=1800.17	? (TO) TT=1800.15	UNSAT TT=1093.63 ASSIGNMENTS=1162	UNSAT TT=1028.95 ASSIGNMENTS=1505	UNSAT TT=97.584 CHECKS=95862300 NODES=2202	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=44.808 ASSIGNMENTS=1124 CHECKS=3237550	UNSAT TT=48.073 ASSIGNMENTS=1124 CHECKS=3237550	? (MO) TT=1751.48	? (TO) TT=1800.02	UNSAT TT=22.809 CHECKS=2331460	UNSAT TT=44.149 ASSIGNMENTS=1235 CHECKS=3864730	UNSAT TT=138.79 ASSIGNMENTS=5229 CHECKS=12165000	? (MO) TT=7.2	UNSAT TT=34.917 ASSIGNMENTS=1113 CHECKS=3053670	UNSAT TT=39.371 ASSIGNMENTS=1124 CHECKS=3237550	? TT=94.747	UNSAT TT=2.113 ASSIGNMENTS=2360 CHECKS=280553	? TT=141.156	? TT=129.483
csp/bddLarge/ normalized-bdd-21-2713-15-79-24_ext.xml	SAT TT=1.521	SAT TT=63.096 CHECKS=4879 NODES=1171	SAT TT=7.305 CHECKS=2713 NODES=0	? (problem) TT=560.595	SAT TT=184.045 CHECKS=340856	? (TO) TT=1800.15	SAT TT=14.671 ASSIGNMENTS=11	SAT TT=13.35 ASSIGNMENTS=12	SAT TT=29.266 CHECKS=260494 NODES=21	SAT TT=207.989 CHECKS=367836000 NODES=6774	SAT TT=330.506 CHECKS=71950900 NODES=1247	SAT TT=1.64 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.654 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=1794.2	? (MO) TT=1765.67	SAT TT=7.031 CHECKS=700049	SAT TT=1.644 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.661 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=7.88	SAT TT=1.567 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.521 ASSIGNMENTS=10 CHECKS=40695	? TT=93.055	SAT TT=0.386 ASSIGNMENTS=21 CHECKS=5545	? TT=132.094	? TT=124.069
csp/bddLarge/ normalized-bdd-21-2713-15-79-25_ext.xml	UNSAT TT=21.108	UNSAT TT=81.523 CHECKS=1797 NODES=1652	UNSAT TT=96.102 CHECKS=1492 NODES=1642	? (problem) TT=571.979	? (TO) TT=1800.19	? (TO) TT=1800.2	UNSAT TT=421.713 ASSIGNMENTS=1085	UNSAT TT=931.27 ASSIGNMENTS=1341	UNSAT TT=97.406 CHECKS=93518300 NODES=2214	? (TO) TT=1800	? (TO) TT=1800.01	UNSAT TT=40.802 ASSIGNMENTS=1057 CHECKS=2495840	UNSAT TT=38.952 ASSIGNMENTS=1057 CHECKS=2495840	? (MO) TT=1797.16	? (TO) TT=1800.09	UNSAT TT=21.108 CHECKS=1966000	UNSAT TT=31.174 ASSIGNMENTS=1057 CHECKS=2539990	UNSAT TT=138.226 ASSIGNMENTS=4779 CHECKS=11388300	? (MO) TT=7.4	UNSAT TT=32.27 ASSIGNMENTS=1140 CHECKS=2708360	UNSAT TT=29.836 ASSIGNMENTS=1057 CHECKS=2495840	? TT=88.911	UNSAT TT=2.156 ASSIGNMENTS=2213 CHECKS=297305	? TT=160.342	? TT=156.877
csp/bddLarge/ normalized-bdd-21-2713-15-79-26_ext.xml	UNSAT TT=23.759	UNSAT TT=98.128 CHECKS=1368 NODES=1693	UNSAT TT=104.274 CHECKS=1370 NODES=1683	? (problem) TT=533.471	? (TO) TT=1800.22	? (TO) TT=1800.18	UNSAT TT=602.975 ASSIGNMENTS=956	UNSAT TT=1202.17 ASSIGNMENTS=1409	UNSAT TT=107.385 CHECKS=101914000 NODES=2214	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=42.613 ASSIGNMENTS=979 CHECKS=2764020	UNSAT TT=42.652 ASSIGNMENTS=979 CHECKS=2764020	? (MO) TT=1769.31	? (MO) TT=1771.59	UNSAT TT=23.759 CHECKS=2038140	UNSAT TT=31.94 ASSIGNMENTS=939 CHECKS=2658320	UNSAT TT=131.122 ASSIGNMENTS=4930 CHECKS=11677200	? (MO) TT=7.39	UNSAT TT=33.012 ASSIGNMENTS=999 CHECKS=2767690	UNSAT TT=33.678 ASSIGNMENTS=979 CHECKS=2764020	? TT=93.217	UNSAT TT=1.691 ASSIGNMENTS=2097 CHECKS=177503	? TT=167.076	? TT=166.835
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddLarge/ normalized-bdd-21-2713-15-79-27_ext.xml	UNSAT TT=21.921	UNSAT TT=82.754 CHECKS=2387 NODES=1534	UNSAT TT=87.021 CHECKS=2342 NODES=1537	? (problem) TT=531.873	? (TO) TT=1800.24	? (TO) TT=1800.15	UNSAT TT=330.266 ASSIGNMENTS=973	UNSAT TT=1257.88 ASSIGNMENTS=1490	UNSAT TT=130.771 CHECKS=127027000 NODES=3086	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=35.764 ASSIGNMENTS=944 CHECKS=2194040	UNSAT TT=36.166 ASSIGNMENTS=944 CHECKS=2194040	? (TO) TT=1800.05	? (MO) TT=1672.59	UNSAT TT=21.921 CHECKS=1926410	UNSAT TT=27.884 ASSIGNMENTS=976 CHECKS=2287120	UNSAT TT=144.546 ASSIGNMENTS=5284 CHECKS=12327000	? (MO) TT=7.38	UNSAT TT=30.34 ASSIGNMENTS=1012 CHECKS=2360410	UNSAT TT=27.207 ASSIGNMENTS=944 CHECKS=2194040	? TT=90.256	UNSAT TT=1.77 ASSIGNMENTS=2113 CHECKS=227342	? TT=126.605	? TT=134.017
csp/bddLarge/ normalized-bdd-21-2713-15-79-28_ext.xml	UNSAT TT=20.517	UNSAT TT=77.034 CHECKS=4120 NODES=1576	UNSAT TT=82.767 CHECKS=4052 NODES=1582	? (problem) TT=531.038	? (TO) TT=1800.16	? (TO) TT=1800.22	UNSAT TT=413.635 ASSIGNMENTS=1004	UNSAT TT=1060.19 ASSIGNMENTS=1306	UNSAT TT=126.338 CHECKS=135596000 NODES=3184	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=35.451 ASSIGNMENTS=953 CHECKS=2253460	UNSAT TT=34.492 ASSIGNMENTS=953 CHECKS=2253460	? (TO) TT=1800	? (MO) TT=1787.75	UNSAT TT=20.517 CHECKS=2042390	UNSAT TT=26.304 ASSIGNMENTS=959 CHECKS=2307450	UNSAT TT=118.932 ASSIGNMENTS=4754 CHECKS=11379900	? (MO) TT=8.94	UNSAT TT=29.614 ASSIGNMENTS=1037 CHECKS=2460350	UNSAT TT=28.019 ASSIGNMENTS=953 CHECKS=2253460	? TT=97.051	UNSAT TT=1.818 ASSIGNMENTS=2236 CHECKS=223828	? TT=149.407	? TT=149.912
csp/bddLarge/ normalized-bdd-21-2713-15-79-29_ext.xml	UNSAT TT=19.765	UNSAT TT=80.187 CHECKS=2747 NODES=1642	UNSAT TT=84.888 CHECKS=2547 NODES=1654	? (problem) TT=564.747	? (TO) TT=1800.22	? (TO) TT=1800.13	UNSAT TT=820.25 ASSIGNMENTS=1031	UNSAT TT=1099.31 ASSIGNMENTS=1459	UNSAT TT=119.048 CHECKS=124596000 NODES=3110	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=49.585 ASSIGNMENTS=1137 CHECKS=3521360	UNSAT TT=49.579 ASSIGNMENTS=1137 CHECKS=3521360	? (TO) TT=1800.02	? (MO) TT=1677	UNSAT TT=19.765 CHECKS=2134890	UNSAT TT=39.881 ASSIGNMENTS=1137 CHECKS=3490600	UNSAT TT=133.568 ASSIGNMENTS=4952 CHECKS=11626300	? (MO) TT=7.4	UNSAT TT=39.112 ASSIGNMENTS=1140 CHECKS=3542300	UNSAT TT=40.714 ASSIGNMENTS=1137 CHECKS=3521360	? TT=91.676	UNSAT TT=1.833 ASSIGNMENTS=2178 CHECKS=178302	? TT=84.678	? TT=85.312
csp/bddLarge/ normalized-bdd-21-2713-15-79-2_ext.xml	UNSAT TT=21.554	UNSAT TT=89.376 CHECKS=1339 NODES=1571	UNSAT TT=104.163 CHECKS=1345 NODES=1666	? (problem) TT=570.639	? (TO) TT=1800.18	? (TO) TT=1800.17	UNSAT TT=442.809 ASSIGNMENTS=962	UNSAT TT=1194.14 ASSIGNMENTS=1509	UNSAT TT=125.819 CHECKS=133972000 NODES=3131	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=37.628 ASSIGNMENTS=963 CHECKS=2328100	UNSAT TT=37.107 ASSIGNMENTS=963 CHECKS=2328100	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=21.554 CHECKS=1938450	UNSAT TT=29.372 ASSIGNMENTS=962 CHECKS=2328390	UNSAT TT=138.306 ASSIGNMENTS=4973 CHECKS=11741900	? (MO) TT=7.29	UNSAT TT=29.98 ASSIGNMENTS=1034 CHECKS=2295360	UNSAT TT=29.067 ASSIGNMENTS=963 CHECKS=2328100	? TT=90.104	UNSAT TT=1.831 ASSIGNMENTS=2103 CHECKS=202244	? TT=147.454	? TT=148.083
csp/bddLarge/ normalized-bdd-21-2713-15-79-30_ext.xml	UNSAT TT=21.331	UNSAT TT=83.927 CHECKS=2535 NODES=1457	UNSAT TT=96.291 CHECKS=3024 NODES=1471	? (problem) TT=560.038	? (TO) TT=1800.15	? (TO) TT=1800.2	UNSAT TT=225.84 ASSIGNMENTS=914	UNSAT TT=903.81 ASSIGNMENTS=1439	UNSAT TT=100.898 CHECKS=94215000 NODES=2171	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=34.278 ASSIGNMENTS=962 CHECKS=2120180	UNSAT TT=34.163 ASSIGNMENTS=962 CHECKS=2120180	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=21.331 CHECKS=1854620	UNSAT TT=26.104 ASSIGNMENTS=937 CHECKS=2167260	UNSAT TT=120.832 ASSIGNMENTS=4961 CHECKS=11627100	? (MO) TT=6.75	UNSAT TT=26.655 ASSIGNMENTS=992 CHECKS=2235430	UNSAT TT=27.932 ASSIGNMENTS=962 CHECKS=2120180	? TT=91.612	UNSAT TT=1.564 ASSIGNMENTS=2076 CHECKS=141327	? TT=144.477	? TT=149.962
csp/bddLarge/ normalized-bdd-21-2713-15-79-31_ext.xml	SAT TT=1.416	SAT TT=25.094 CHECKS=2948 NODES=295	SAT TT=7.568 CHECKS=2713 NODES=0	? (problem) TT=550.534	SAT TT=835.331 CHECKS=1404870	SAT TT=78.225 CHECKS=96014	SAT TT=14.484 ASSIGNMENTS=12	SAT TT=14.192 ASSIGNMENTS=13	SAT TT=29.282 CHECKS=219837 NODES=21	SAT TT=47.308 CHECKS=62951700 NODES=1156	SAT TT=171.452 CHECKS=266278000 NODES=4392	SAT TT=1.518 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.552 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=1775.42	? (TO) TT=1800.04	SAT TT=10.77 CHECKS=960413	SAT TT=1.416 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.521 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=7.6	SAT TT=1.512 ASSIGNMENTS=12 CHECKS=40695	SAT TT=1.519 ASSIGNMENTS=11 CHECKS=40695	? TT=95.87	SAT TT=0.378 ASSIGNMENTS=21 CHECKS=9428	? TT=139.997	? TT=151.922
csp/bddLarge/ normalized-bdd-21-2713-15-79-32_ext.xml	SAT TT=3.027	SAT TT=11.171 CHECKS=2856 NODES=71	SAT TT=17.687 CHECKS=2931 NODES=136	? (problem) TT=557.038	SAT TT=730.293 CHECKS=1490360	SAT TT=82.244 CHECKS=73361	SAT TT=626.32 ASSIGNMENTS=924	SAT TT=402.452 ASSIGNMENTS=636	SAT TT=116.036 CHECKS=118115000 NODES=2203	SAT TT=156.758 CHECKS=229957000 NODES=4233	SAT TT=5.284 CHECKS=954016 NODES=12	SAT TT=36.966 ASSIGNMENTS=836 CHECKS=2338640	SAT TT=34.601 ASSIGNMENTS=836 CHECKS=2338640	? (MO) TT=1684.51	? (MO) TT=1764.72	SAT TT=3.027 CHECKS=270372	SAT TT=27.435 ASSIGNMENTS=841 CHECKS=2364290	SAT TT=128.792 ASSIGNMENTS=4840 CHECKS=11519000	? (MO) TT=7.2	SAT TT=25.547 ASSIGNMENTS=813 CHECKS=2211900	SAT TT=27.928 ASSIGNMENTS=836 CHECKS=2338640	? TT=90.115	SAT TT=1.888 ASSIGNMENTS=2046 CHECKS=250096	? TT=151.479	? TT=136.284
csp/bddLarge/ normalized-bdd-21-2713-15-79-33_ext.xml	UNSAT TT=22.624	UNSAT TT=81.111 CHECKS=3946 NODES=1895	UNSAT TT=86.823 CHECKS=4783 NODES=2058	? (problem) TT=524.143	? (TO) TT=1800.17	? (TO) TT=1800.13	UNSAT TT=340.465 ASSIGNMENTS=1126	UNSAT TT=1023.77 ASSIGNMENTS=1344	UNSAT TT=97.739 CHECKS=95900300 NODES=2183	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=33.247 ASSIGNMENTS=970 CHECKS=2060490	UNSAT TT=34.564 ASSIGNMENTS=970 CHECKS=2060490	? (MO) TT=1761.8	? (MO) TT=1704.85	UNSAT TT=22.624 CHECKS=2236630	UNSAT TT=28.275 ASSIGNMENTS=1096 CHECKS=2374740	UNSAT TT=134.257 ASSIGNMENTS=4760 CHECKS=11402500	? (MO) TT=7.1	UNSAT TT=30.053 ASSIGNMENTS=1150 CHECKS=2472890	UNSAT TT=25.261 ASSIGNMENTS=970 CHECKS=2060490	? TT=90.335	UNSAT TT=2.036 ASSIGNMENTS=2238 CHECKS=299933	? TT=181.85	? TT=173.487
csp/bddLarge/ normalized-bdd-21-2713-15-79-34_ext.xml	SAT TT=2.241	SAT TT=67.185 CHECKS=4695 NODES=1123	SAT TT=68.939 CHECKS=4700 NODES=1124	? (problem) TT=517.224	? (TO) TT=1800.18	SAT TT=265.753 CHECKS=474798	SAT TT=609.566 ASSIGNMENTS=1066	SAT TT=946.836 ASSIGNMENTS=1070	SAT TT=95.502 CHECKS=92391700 NODES=2211	SAT TT=64.401 CHECKS=93727100 NODES=1722	SAT TT=783.315 CHECKS=1057450000 NODES=17108	SAT TT=48.646 ASSIGNMENTS=1105 CHECKS=3179260	SAT TT=48.076 ASSIGNMENTS=1105 CHECKS=3179260	? (MO) TT=1705.64	? (TO) TT=1800	SAT TT=13.906 CHECKS=1340990	SAT TT=36.212 ASSIGNMENTS=1069 CHECKS=3029320	SAT TT=137.616 ASSIGNMENTS=4952 CHECKS=11539100	? (MO) TT=6.91	SAT TT=2.241 ASSIGNMENTS=23 CHECKS=62038	SAT TT=38.703 ASSIGNMENTS=1105 CHECKS=3179260	? TT=90.337	SAT TT=1.93 ASSIGNMENTS=2218 CHECKS=198321	? TT=185.216	? TT=175.483
csp/bddLarge/ normalized-bdd-21-2713-15-79-35_ext.xml	SAT TT=1.302	SAT TT=69.451 CHECKS=5172 NODES=1378	SAT TT=74.186 CHECKS=4964 NODES=1347	? (problem) TT=527.731	SAT TT=631.137 CHECKS=1280510	SAT TT=675.649 CHECKS=1275640	SAT TT=553.814 ASSIGNMENTS=954	SAT TT=556.58 ASSIGNMENTS=868	SAT TT=96.699 CHECKS=94045200 NODES=2201	SAT TT=147.74 CHECKS=260319000 NODES=4793	? (TO) TT=1800.09	SAT TT=42.673 ASSIGNMENTS=996 CHECKS=2734450	SAT TT=44.302 ASSIGNMENTS=996 CHECKS=2734450	? (TO) TT=1800.02	? (MO) TT=1796.56	SAT TT=1.302 CHECKS=87052	SAT TT=33.955 ASSIGNMENTS=964 CHECKS=2680310	SAT TT=133.788 ASSIGNMENTS=5065 CHECKS=11840400	? (MO) TT=7.5	SAT TT=33.097 ASSIGNMENTS=997 CHECKS=2740220	SAT TT=34.676 ASSIGNMENTS=996 CHECKS=2734450	? TT=87.471	SAT TT=1.681 ASSIGNMENTS=2096 CHECKS=205316	? TT=141.829	? TT=141.975
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddLarge/ normalized-bdd-21-2713-15-79-3_ext.xml	UNSAT TT=20.884	UNSAT TT=71.732 CHECKS=3499 NODES=1584	UNSAT TT=87.981 CHECKS=3032 NODES=1500	? (problem) TT=515.502	? (TO) TT=1800.21	? (TO) TT=1800.16	UNSAT TT=373.027 ASSIGNMENTS=945	UNSAT TT=1136.28 ASSIGNMENTS=1415	UNSAT TT=99.899 CHECKS=99449700 NODES=2183	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=35.265 ASSIGNMENTS=923 CHECKS=2101300	UNSAT TT=32.607 ASSIGNMENTS=923 CHECKS=2101300	? (TO) TT=1800	? (MO) TT=1757.63	UNSAT TT=20.884 CHECKS=1912900	UNSAT TT=27.83 ASSIGNMENTS=955 CHECKS=2188010	UNSAT TT=137.473 ASSIGNMENTS=5229 CHECKS=12318400	? (MO) TT=7.6	UNSAT TT=28.369 ASSIGNMENTS=1016 CHECKS=2276350	UNSAT TT=24.649 ASSIGNMENTS=923 CHECKS=2101300	? TT=89.025	UNSAT TT=1.856 ASSIGNMENTS=2093 CHECKS=192376	? TT=238.94	? TT=232.528
csp/bddLarge/ normalized-bdd-21-2713-15-79-4_ext.xml	SAT TT=1.586	SAT TT=21.646 CHECKS=2932 NODES=226	SAT TT=7.677 CHECKS=2713 NODES=0	? (problem) TT=525.085	SAT TT=772.201 CHECKS=1426610	SAT TT=1181.53 CHECKS=2432610	SAT TT=14.224 ASSIGNMENTS=13	SAT TT=13.406 ASSIGNMENTS=22	SAT TT=31.338 CHECKS=192623 NODES=21	SAT TT=16.492 CHECKS=14935400 NODES=271	SAT TT=123.605 CHECKS=79153300 NODES=1412	SAT TT=1.614 ASSIGNMENTS=12 CHECKS=40695	SAT TT=1.723 ASSIGNMENTS=12 CHECKS=40695	? (MO) TT=1745.33	? (MO) TT=1790.98	SAT TT=5.711 CHECKS=556387	SAT TT=1.706 ASSIGNMENTS=12 CHECKS=40695	SAT TT=1.721 ASSIGNMENTS=12 CHECKS=40695	? (MO) TT=7.07	SAT TT=1.613 ASSIGNMENTS=21 CHECKS=40695	SAT TT=1.586 ASSIGNMENTS=12 CHECKS=40695	? TT=97.744	SAT TT=0.384 ASSIGNMENTS=21 CHECKS=9939	? TT=150.631	? TT=142.071
csp/bddLarge/ normalized-bdd-21-2713-15-79-5_ext.xml	SAT TT=1.335	SAT TT=56.391 CHECKS=3713 NODES=893	SAT TT=7.571 CHECKS=2713 NODES=0	? (problem) TT=523.602	SAT TT=666.73 CHECKS=1414240	SAT TT=881.401 CHECKS=1754550	SAT TT=13.055 ASSIGNMENTS=12	SAT TT=14.067 ASSIGNMENTS=12	SAT TT=29.538 CHECKS=255057 NODES=21	SAT TT=39.547 CHECKS=59021300 NODES=1082	SAT TT=1181.2 CHECKS=1191160000 NODES=18178	SAT TT=1.514 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.521 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=1750.97	? (MO) TT=1743.03	SAT TT=1.335 CHECKS=105438	SAT TT=1.524 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.497 ASSIGNMENTS=11 CHECKS=40695	? (MO) TT=7.1	SAT TT=1.465 ASSIGNMENTS=11 CHECKS=40695	SAT TT=1.47 ASSIGNMENTS=11 CHECKS=40695	? TT=98.243	SAT TT=0.372 ASSIGNMENTS=21 CHECKS=9361	? TT=217.428	? TT=198.989
csp/bddLarge/ normalized-bdd-21-2713-15-79-6_ext.xml	UNSAT TT=22.888	UNSAT TT=76.181 CHECKS=5316 NODES=2097	UNSAT TT=76.052 CHECKS=4113 NODES=1850	? (problem) TT=571.072	? (TO) TT=1800.12	? (TO) TT=1800.21	UNSAT TT=972.952 ASSIGNMENTS=1218	UNSAT TT=965.503 ASSIGNMENTS=1466	UNSAT TT=97.879 CHECKS=100176000 NODES=2195	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=38.699 ASSIGNMENTS=975 CHECKS=2554150	UNSAT TT=36.126 ASSIGNMENTS=975 CHECKS=2554150	? (MO) TT=1785.81	? (MO) TT=1695.23	UNSAT TT=22.888 CHECKS=2355680	UNSAT TT=33.071 ASSIGNMENTS=1071 CHECKS=2793970	UNSAT TT=151.94 ASSIGNMENTS=5177 CHECKS=12005300	? (MO) TT=7	UNSAT TT=32.418 ASSIGNMENTS=1089 CHECKS=2868430	UNSAT TT=29.988 ASSIGNMENTS=975 CHECKS=2554150	? TT=104.317	UNSAT TT=2.39 ASSIGNMENTS=2339 CHECKS=411939	? TT=150.56	? TT=152.108
csp/bddLarge/ normalized-bdd-21-2713-15-79-7_ext.xml	UNSAT TT=20.045	UNSAT TT=73.817 CHECKS=3979 NODES=1823	UNSAT TT=80.599 CHECKS=3864 NODES=1828	? (problem) TT=571.431	? (TO) TT=1800.21	? (TO) TT=1800.16	UNSAT TT=880.847 ASSIGNMENTS=1112	UNSAT TT=1022.82 ASSIGNMENTS=1421	UNSAT TT=101.629 CHECKS=92677300 NODES=2239	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=47.983 ASSIGNMENTS=1083 CHECKS=3176710	UNSAT TT=48.465 ASSIGNMENTS=1083 CHECKS=3176710	? (TO) TT=1800	? (MO) TT=1688.72	UNSAT TT=20.045 CHECKS=2500500	UNSAT TT=37.42 ASSIGNMENTS=1037 CHECKS=3267150	UNSAT TT=131.437 ASSIGNMENTS=4955 CHECKS=11741300	? (MO) TT=7.6	UNSAT TT=36.206 ASSIGNMENTS=1075 CHECKS=3342090	UNSAT TT=36.466 ASSIGNMENTS=1083 CHECKS=3176710	? TT=93.456	UNSAT TT=1.861 ASSIGNMENTS=2138 CHECKS=206666	? TT=80.34	? TT=80.275
csp/bddLarge/ normalized-bdd-21-2713-15-79-8_ext.xml	SAT TT=1.479	SAT TT=39.424 CHECKS=4801 NODES=526	SAT TT=7.722 CHECKS=2713 NODES=0	? (problem) TT=528.732	SAT TT=646.048 CHECKS=1134900	SAT TT=454.389 CHECKS=715287	SAT TT=12.961 ASSIGNMENTS=11	SAT TT=12.866 ASSIGNMENTS=14	SAT TT=31.814 CHECKS=210120 NODES=21	SAT TT=42.29 CHECKS=74186000 NODES=1363	SAT TT=619.153 CHECKS=821644000 NODES=12224	SAT TT=1.809 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.793 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=1769.14	? (MO) TT=1794.91	SAT TT=15.893 CHECKS=1356620	SAT TT=1.786 ASSIGNMENTS=10 CHECKS=40695	SAT TT=1.747 ASSIGNMENTS=10 CHECKS=40695	? (MO) TT=7.4	SAT TT=1.479 ASSIGNMENTS=13 CHECKS=40695	SAT TT=1.783 ASSIGNMENTS=10 CHECKS=40695	? TT=100.806	SAT TT=0.376 ASSIGNMENTS=21 CHECKS=6325	? TT=134.363	? TT=142.448
csp/bddLarge/ normalized-bdd-21-2713-15-79-9_ext.xml	UNSAT TT=19.999	UNSAT TT=83.219 CHECKS=3030 NODES=1531	UNSAT TT=91.779 CHECKS=3319 NODES=1552	? (problem) TT=571.444	? (TO) TT=1800.19	? (TO) TT=1800.13	UNSAT TT=556.598 ASSIGNMENTS=978	UNSAT TT=1237.96 ASSIGNMENTS=1447	UNSAT TT=117.461 CHECKS=125061000 NODES=2181	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=36.518 ASSIGNMENTS=1034 CHECKS=2599890	UNSAT TT=39.232 ASSIGNMENTS=1034 CHECKS=2599890	? (MO) TT=1779.2	? (MO) TT=1717.1	UNSAT TT=19.999 CHECKS=1966230	UNSAT TT=30.788 ASSIGNMENTS=997 CHECKS=2518740	UNSAT TT=141.407 ASSIGNMENTS=4864 CHECKS=11536200	? (MO) TT=7.4	UNSAT TT=31.853 ASSIGNMENTS=1044 CHECKS=2608730	UNSAT TT=30.368 ASSIGNMENTS=1034 CHECKS=2599890	? TT=86	UNSAT TT=1.665 ASSIGNMENTS=2129 CHECKS=177514	? TT=135.336	? TT=135.77
csp/bddSmall/ normalized-bdd-21-133-18-78-10_ext.xml	SAT TT=0.714	SAT TT=31.417 CHECKS=11568 NODES=4444	SAT TT=4.436 CHECKS=133 NODES=0	SAT TT=143.153	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=6.573 ASSIGNMENTS=17	SAT TT=6.797 ASSIGNMENTS=22	SAT TT=12.562 CHECKS=10640 NODES=21	SAT TT=9.581 CHECKS=17916700 NODES=4623	SAT TT=2 CHECKS=1295600 NODES=299	SAT TT=0.786 ASSIGNMENTS=16 CHECKS=2394	SAT TT=0.714 ASSIGNMENTS=16 CHECKS=2394	? (MO) TT=597.44	? (MO) TT=557.11	SAT TT=8.114 CHECKS=1016120	SAT TT=0.77 ASSIGNMENTS=16 CHECKS=2394	SAT TT=0.704 ASSIGNMENTS=16 CHECKS=2394	? (MO) TT=6.9	SAT TT=0.793 ASSIGNMENTS=21 CHECKS=2394	SAT TT=0.787 ASSIGNMENTS=16 CHECKS=2394	? TT=100.094	SAT TT=0.999 ASSIGNMENTS=21 CHECKS=775	? TT=95.111	? TT=108.712
csp/bddSmall/ normalized-bdd-21-133-18-78-11_ext.xml	SAT TT=0.801	SAT TT=39.633 CHECKS=26849 NODES=8913	SAT TT=51.35 CHECKS=28653 NODES=9183	SAT TT=227.687	SAT TT=910.008 CHECKS=181944	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.13	SAT TT=74.59 CHECKS=66037600 NODES=24505	SAT TT=2.407 CHECKS=1448240 NODES=370	SAT TT=84.083 CHECKS=122010000 NODES=19217	SAT TT=24.1 ASSIGNMENTS=10143 CHECKS=1645510	SAT TT=22.712 ASSIGNMENTS=10143 CHECKS=1645510	? (MO) TT=581.37	? (MO) TT=541.75	SAT TT=3.245 CHECKS=268178	SAT TT=15.351 ASSIGNMENTS=9960 CHECKS=1647540	SAT TT=23.924 ASSIGNMENTS=16692 CHECKS=2346960	? (MO) TT=7.29	SAT TT=0.801 ASSIGNMENTS=29 CHECKS=4050	SAT TT=15.959 ASSIGNMENTS=10143 CHECKS=1645510	? TT=105.684	SAT TT=7.553 ASSIGNMENTS=18609 CHECKS=1471740	? TT=223.17	? TT=227.275
csp/bddSmall/ normalized-bdd-21-133-18-78-12_ext.xml	UNSAT TT=12.089	UNSAT TT=49.652 CHECKS=80918 NODES=21031	UNSAT TT=61.526 CHECKS=62322 NODES=16438	UNSAT TT=251.288	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.09	UNSAT TT=61.7 CHECKS=62633200 NODES=24042	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=25.876 ASSIGNMENTS=11516 CHECKS=1773070	UNSAT TT=27.005 ASSIGNMENTS=11516 CHECKS=1773070	? (MO) TT=592.97	? (MO) TT=557.54	UNSAT TT=12.089 CHECKS=1464290	UNSAT TT=18.785 ASSIGNMENTS=11986 CHECKS=1778540	UNSAT TT=21.749 ASSIGNMENTS=16635 CHECKS=2347980	? (MO) TT=7.1	UNSAT TT=16.496 ASSIGNMENTS=10496 CHECKS=1486790	UNSAT TT=18.511 ASSIGNMENTS=11516 CHECKS=1773070	? TT=106.065	UNSAT TT=5.743 ASSIGNMENTS=19103 CHECKS=976016	? TT=221.837	? TT=221.075
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-13_ext.xml	UNSAT TT=15.11	UNSAT TT=86.699 CHECKS=62729 NODES=17802	UNSAT TT=93.276 CHECKS=54869 NODES=16026	UNSAT TT=271.282	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.12	UNSAT TT=70.573 CHECKS=63872600 NODES=23912	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=23.505 ASSIGNMENTS=10062 CHECKS=1513130	UNSAT TT=23.537 ASSIGNMENTS=10062 CHECKS=1513130	? (MO) TT=543.38	? (MO) TT=552.42	UNSAT TT=19.475 CHECKS=1320750	UNSAT TT=16.015 ASSIGNMENTS=10652 CHECKS=1582110	UNSAT TT=21.701 ASSIGNMENTS=14811 CHECKS=2110990	? (MO) TT=7.3	UNSAT TT=16.736 ASSIGNMENTS=10564 CHECKS=1543190	UNSAT TT=15.11 ASSIGNMENTS=10062 CHECKS=1513130	? TT=90.725	UNSAT TT=9.541 ASSIGNMENTS=18943 CHECKS=1798090	? TT=125.03	? TT=126.479
csp/bddSmall/ normalized-bdd-21-133-18-78-14_ext.xml	UNSAT TT=12.937	UNSAT TT=55.155 CHECKS=71926 NODES=19555	UNSAT TT=70.867 CHECKS=71691 NODES=19487	UNSAT TT=242.868	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	UNSAT TT=89.287 CHECKS=82401600 NODES=34610	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=23.022 ASSIGNMENTS=10037 CHECKS=1516500	UNSAT TT=25.235 ASSIGNMENTS=10037 CHECKS=1516500	? (MO) TT=595.56	? (MO) TT=568.02	UNSAT TT=12.937 CHECKS=1282110	UNSAT TT=16.472 ASSIGNMENTS=10610 CHECKS=1474700	UNSAT TT=24.076 ASSIGNMENTS=15503 CHECKS=2217940	? (MO) TT=7.01	UNSAT TT=16.64 ASSIGNMENTS=11579 CHECKS=1536460	UNSAT TT=16.798 ASSIGNMENTS=10037 CHECKS=1516500	? TT=79.517	UNSAT TT=7.554 ASSIGNMENTS=19169 CHECKS=1444690	? TT=239.534	? TT=234.845
csp/bddSmall/ normalized-bdd-21-133-18-78-15_ext.xml	UNSAT TT=13.111	UNSAT TT=60.022 CHECKS=56615 NODES=17053	UNSAT TT=68.782 CHECKS=63200 NODES=18124	UNSAT TT=248.323	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.1	UNSAT TT=66.274 CHECKS=65794900 NODES=24053	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=24.985 ASSIGNMENTS=10147 CHECKS=1682160	UNSAT TT=23.332 ASSIGNMENTS=10147 CHECKS=1682160	? (MO) TT=555.51	? (MO) TT=558.69	UNSAT TT=13.111 CHECKS=1322890	UNSAT TT=17.438 ASSIGNMENTS=11469 CHECKS=1762530	UNSAT TT=21.585 ASSIGNMENTS=15567 CHECKS=2236000	? (MO) TT=7.78	UNSAT TT=17.222 ASSIGNMENTS=11661 CHECKS=1765920	UNSAT TT=16.425 ASSIGNMENTS=10147 CHECKS=1682160	? TT=95.284	UNSAT TT=7.372 ASSIGNMENTS=19762 CHECKS=1466590	? TT=122.463	? TT=122.985
csp/bddSmall/ normalized-bdd-21-133-18-78-16_ext.xml	UNSAT TT=15.544	UNSAT TT=58.602 CHECKS=67531 NODES=18434	UNSAT TT=66.19 CHECKS=70573 NODES=18531	UNSAT TT=275.808	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.13	UNSAT TT=64.081 CHECKS=60196900 NODES=24854	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=24.869 ASSIGNMENTS=11172 CHECKS=1573320	UNSAT TT=25.689 ASSIGNMENTS=11172 CHECKS=1573320	? (MO) TT=555.69	? (MO) TT=547.18	UNSAT TT=15.591 CHECKS=1373920	UNSAT TT=17.417 ASSIGNMENTS=10548 CHECKS=1663600	UNSAT TT=23.438 ASSIGNMENTS=15901 CHECKS=2259680	? (MO) TT=7.32	UNSAT TT=15.83 ASSIGNMENTS=10231 CHECKS=1571370	UNSAT TT=15.544 ASSIGNMENTS=11172 CHECKS=1573320	? TT=95.583	UNSAT TT=9.907 ASSIGNMENTS=20868 CHECKS=2298450	? TT=147.18	? TT=142.222
csp/bddSmall/ normalized-bdd-21-133-18-78-17_ext.xml	SAT TT=0.725	SAT TT=33.241 CHECKS=10260 NODES=4826	SAT TT=4.408 CHECKS=133 NODES=0	SAT TT=153.943	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=6.975 ASSIGNMENTS=14	SAT TT=6.953 ASSIGNMENTS=15	SAT TT=12.487 CHECKS=15673 NODES=21	SAT TT=3.259 CHECKS=4355540 NODES=1120	SAT TT=70.471 CHECKS=105941000 NODES=17944	SAT TT=0.796 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.793 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=549.44	? (MO) TT=597.14	SAT TT=5.053 CHECKS=485363	SAT TT=0.79 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.779 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.43	SAT TT=0.725 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.772 ASSIGNMENTS=13 CHECKS=2394	? TT=99.236	SAT TT=0.993 ASSIGNMENTS=21 CHECKS=417	? TT=122.009	? TT=126.753
csp/bddSmall/ normalized-bdd-21-133-18-78-18_ext.xml	SAT TT=0.768	SAT TT=29.54 CHECKS=9000 NODES=4153	SAT TT=4.221 CHECKS=133 NODES=0	SAT TT=133.505	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=7.502 ASSIGNMENTS=15	SAT TT=6.72 ASSIGNMENTS=14	SAT TT=13.25 CHECKS=16276 NODES=21	SAT TT=32.463 CHECKS=77831800 NODES=20092	SAT TT=33.902 CHECKS=48272100 NODES=7918	SAT TT=0.774 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.769 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=594.57	? (MO) TT=588.16	SAT TT=2.428 CHECKS=174515	SAT TT=0.768 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.759 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.4	SAT TT=0.792 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.786 ASSIGNMENTS=15 CHECKS=2394	? TT=91.612	SAT TT=0.967 ASSIGNMENTS=21 CHECKS=717	? TT=217.324	? TT=227.368
csp/bddSmall/ normalized-bdd-21-133-18-78-19_ext.xml	UNSAT TT=11.976	UNSAT TT=55.298 CHECKS=85411 NODES=22034	UNSAT TT=62.258 CHECKS=70291 NODES=19050	UNSAT TT=242.671	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.12	UNSAT TT=62.824 CHECKS=62000600 NODES=24023	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=24.023 ASSIGNMENTS=11246 CHECKS=1675490	UNSAT TT=23.837 ASSIGNMENTS=11246 CHECKS=1675490	? (MO) TT=587.62	? (MO) TT=602.08	UNSAT TT=11.976 CHECKS=1313320	UNSAT TT=12.724 ASSIGNMENTS=10054 CHECKS=1471910	UNSAT TT=22.387 ASSIGNMENTS=15374 CHECKS=2235730	? (MO) TT=7.18	UNSAT TT=14.695 ASSIGNMENTS=10442 CHECKS=1606760	UNSAT TT=16.127 ASSIGNMENTS=11246 CHECKS=1675490	? TT=85.245	UNSAT TT=6.562 ASSIGNMENTS=20063 CHECKS=1244730	? TT=231.844	? TT=254.803
csp/bddSmall/ normalized-bdd-21-133-18-78-1_ext.xml	SAT TT=0.719	SAT TT=33.089 CHECKS=18106 NODES=6241	SAT TT=4.345 CHECKS=133 NODES=0	SAT TT=146.005	? (TO) TT=1800.07	SAT TT=569.106 CHECKS=114108	SAT TT=7.389 ASSIGNMENTS=14	SAT TT=7.363 ASSIGNMENTS=16	SAT TT=13.338 CHECKS=16817 NODES=21	SAT TT=1.695 CHECKS=544442 NODES=136	SAT TT=229.192 CHECKS=257826000 NODES=19620	SAT TT=0.77 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.779 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=600.22	? (MO) TT=553.03	SAT TT=13.331 CHECKS=1161870	SAT TT=0.733 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.73 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=7.89	SAT TT=0.719 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.797 ASSIGNMENTS=13 CHECKS=2394	? TT=81.62	SAT TT=0.955 ASSIGNMENTS=21 CHECKS=590	? TT=98.121	? TT=100.159
csp/bddSmall/ normalized-bdd-21-133-18-78-20_ext.xml	SAT TT=0.731	SAT TT=41.671 CHECKS=38439 NODES=11735	SAT TT=3.951 CHECKS=133 NODES=0	SAT TT=144.413	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT TT=6.598 ASSIGNMENTS=15	SAT TT=7.258 ASSIGNMENTS=16	SAT TT=12.38 CHECKS=10119 NODES=21	SAT TT=5.196 CHECKS=9473980 NODES=2442	SAT TT=103.362 CHECKS=131512000 NODES=14884	SAT TT=0.789 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.794 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=596.18	? (MO) TT=557.43	SAT TT=3.753 CHECKS=381201	SAT TT=0.785 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.724 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=7.54	SAT TT=0.802 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.731 ASSIGNMENTS=14 CHECKS=2394	? TT=84.077	SAT TT=1.051 ASSIGNMENTS=21 CHECKS=467	? TT=238.746	? TT=238.797
csp/bddSmall/ normalized-bdd-21-133-18-78-21_ext.xml	UNSAT TT=14.384	UNSAT TT=58.504 CHECKS=63268 NODES=18664	UNSAT TT=65.704 CHECKS=59131 NODES=17021	UNSAT TT=254.492	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.15	UNSAT TT=69.807 CHECKS=61116800 NODES=24456	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=24.71 ASSIGNMENTS=10706 CHECKS=1579960	UNSAT TT=22.846 ASSIGNMENTS=10706 CHECKS=1579960	? (MO) TT=557.11	? (MO) TT=574.39	UNSAT TT=14.384 CHECKS=1300580	UNSAT TT=15.93 ASSIGNMENTS=10747 CHECKS=1588220	UNSAT TT=22.185 ASSIGNMENTS=15139 CHECKS=2149850	? (MO) TT=6.91	UNSAT TT=16.467 ASSIGNMENTS=10738 CHECKS=1561600	UNSAT TT=14.944 ASSIGNMENTS=10706 CHECKS=1579960	? TT=105.625	UNSAT TT=7.115 ASSIGNMENTS=19450 CHECKS=1444360	? TT=229.884	? TT=227.686
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-22_ext.xml	UNSAT TT=12.404	UNSAT TT=60.515 CHECKS=69110 NODES=18827	UNSAT TT=67.062 CHECKS=62628 NODES=17039	UNSAT TT=235.217	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.14	UNSAT TT=66.403 CHECKS=60842600 NODES=24631	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=23.446 ASSIGNMENTS=10793 CHECKS=1600220	UNSAT TT=23.872 ASSIGNMENTS=10793 CHECKS=1600220	? (MO) TT=548.73	? (MO) TT=549.57	UNSAT TT=12.404 CHECKS=1220260	UNSAT TT=15.949 ASSIGNMENTS=10733 CHECKS=1618230	UNSAT TT=25.586 ASSIGNMENTS=17896 CHECKS=2503990	? (MO) TT=7.99	UNSAT TT=18.216 ASSIGNMENTS=10580 CHECKS=1784720	UNSAT TT=14.781 ASSIGNMENTS=10793 CHECKS=1600220	? TT=97.181	UNSAT TT=6.423 ASSIGNMENTS=18262 CHECKS=1358800	? TT=99.573	? TT=93.276
csp/bddSmall/ normalized-bdd-21-133-18-78-23_ext.xml	SAT TT=0.754	SAT TT=32.66 CHECKS=12478 NODES=4701	SAT TT=4.176 CHECKS=133 NODES=0	SAT TT=149.269	SAT TT=69.429 CHECKS=8047	? (TO) TT=1800.04	SAT TT=6.864 ASSIGNMENTS=15	SAT TT=7.328 ASSIGNMENTS=14	SAT TT=12.74 CHECKS=12991 NODES=21	SAT TT=20.616 CHECKS=43141400 NODES=11130	SAT TT=13.393 CHECKS=20080300 NODES=4961	SAT TT=0.773 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.789 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=548.53	? (MO) TT=588.33	SAT TT=2.171 CHECKS=127107	SAT TT=0.772 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.778 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=7.3	SAT TT=0.754 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.756 ASSIGNMENTS=14 CHECKS=2394	? TT=86.479	SAT TT=1.072 ASSIGNMENTS=21 CHECKS=360	? TT=292.122	? TT=296.447
csp/bddSmall/ normalized-bdd-21-133-18-78-24_ext.xml	UNSAT TT=13.798	UNSAT TT=54.411 CHECKS=68899 NODES=18430	UNSAT TT=67.062 CHECKS=57164 NODES=16641	UNSAT TT=272.993	? (TO) TT=1800.01	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=64.678 CHECKS=56626400 NODES=24515	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=25.874 ASSIGNMENTS=10291 CHECKS=1883190	UNSAT TT=25.933 ASSIGNMENTS=10291 CHECKS=1883190	? (MO) TT=560.1	? (MO) TT=561.91	UNSAT TT=14.311 CHECKS=1442150	UNSAT TT=15.214 ASSIGNMENTS=9579 CHECKS=1579640	UNSAT TT=21.111 ASSIGNMENTS=14879 CHECKS=2140840	? (MO) TT=7.79	UNSAT TT=13.798 ASSIGNMENTS=9266 CHECKS=1466150	UNSAT TT=16.499 ASSIGNMENTS=10291 CHECKS=1883190	? TT=88.236	UNSAT TT=7.636 ASSIGNMENTS=18876 CHECKS=1555390	? TT=262.944	? TT=259.693
csp/bddSmall/ normalized-bdd-21-133-18-78-25_ext.xml	SAT TT=0.717	SAT TT=44.395 CHECKS=17754 NODES=6507	SAT TT=4.215 CHECKS=133 NODES=0	SAT TT=142.159	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=7.31 ASSIGNMENTS=15	SAT TT=7.26 ASSIGNMENTS=18	SAT TT=13.383 CHECKS=11014 NODES=21	SAT TT=12.931 CHECKS=25220700 NODES=6506	SAT TT=1451.47 CHECKS=1415560000 NODES=35730	SAT TT=0.793 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.807 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=561.47	? (MO) TT=556.14	SAT TT=16.122 CHECKS=1247380	SAT TT=0.717 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.778 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=7.93	SAT TT=0.77 ASSIGNMENTS=17 CHECKS=2394	SAT TT=0.727 ASSIGNMENTS=14 CHECKS=2394	? TT=87.429	SAT TT=0.952 ASSIGNMENTS=21 CHECKS=917	? TT=274.729	? TT=296.427
csp/bddSmall/ normalized-bdd-21-133-18-78-26_ext.xml	SAT TT=0.723	SAT TT=24.775 CHECKS=8361 NODES=3300	SAT TT=3.975 CHECKS=133 NODES=0	SAT TT=145.535	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=6.415 ASSIGNMENTS=15	SAT TT=7.21 ASSIGNMENTS=15	SAT TT=12.383 CHECKS=17186 NODES=21	SAT TT=7.71 CHECKS=15585400 NODES=4019	SAT TT=98.444 CHECKS=128900000 NODES=16365	SAT TT=0.737 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.768 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=590.36	? (MO) TT=574.77	SAT TT=5.341 CHECKS=502716	SAT TT=0.792 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.759 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=7.1	SAT TT=0.723 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.758 ASSIGNMENTS=14 CHECKS=2394	? TT=87.596	SAT TT=0.965 ASSIGNMENTS=21 CHECKS=607	? TT=264.571	? TT=239.915
csp/bddSmall/ normalized-bdd-21-133-18-78-27_ext.xml	SAT TT=0.713	SAT TT=26.707 CHECKS=7401 NODES=2951	SAT TT=4.369 CHECKS=133 NODES=0	SAT TT=134.465	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=7.487 ASSIGNMENTS=15	SAT TT=7.358 ASSIGNMENTS=16	SAT TT=12.62 CHECKS=8393 NODES=21	SAT TT=4.743 CHECKS=7221190 NODES=1861	SAT TT=249.066 CHECKS=263496000 NODES=17084	SAT TT=0.713 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.794 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=596.49	? (MO) TT=549.89	SAT TT=0.775 CHECKS=27164	SAT TT=0.783 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.777 ASSIGNMENTS=15 CHECKS=2394	? (MO) TT=6.78	SAT TT=0.798 ASSIGNMENTS=15 CHECKS=2394	SAT TT=0.787 ASSIGNMENTS=14 CHECKS=2394	? TT=91.623	SAT TT=1.051 ASSIGNMENTS=21 CHECKS=501	? TT=292.533	? TT=277.87
csp/bddSmall/ normalized-bdd-21-133-18-78-28_ext.xml	UNSAT TT=12.778	UNSAT TT=49.741 CHECKS=72626 NODES=20985	UNSAT TT=62.727 CHECKS=68387 NODES=20089	UNSAT TT=252.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.18	UNSAT TT=61.839 CHECKS=60510700 NODES=23937	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=24.121 ASSIGNMENTS=10326 CHECKS=1530210	UNSAT TT=24.674 ASSIGNMENTS=10326 CHECKS=1530210	? (MO) TT=574.22	? (MO) TT=540.41	UNSAT TT=12.778 CHECKS=1366560	UNSAT TT=17.569 ASSIGNMENTS=11822 CHECKS=1778470	UNSAT TT=20.043 ASSIGNMENTS=14997 CHECKS=2178820	? (MO) TT=6.81	UNSAT TT=14.987 ASSIGNMENTS=10020 CHECKS=1443980	UNSAT TT=16.394 ASSIGNMENTS=10326 CHECKS=1530210	? TT=89.438	UNSAT TT=6.846 ASSIGNMENTS=19022 CHECKS=1332520	? TT=93.414	? TT=105.629
csp/bddSmall/ normalized-bdd-21-133-18-78-29_ext.xml	UNSAT TT=12.13	UNSAT TT=63.654 CHECKS=65648 NODES=17331	UNSAT TT=73.221 CHECKS=65288 NODES=16953	UNSAT TT=223.995	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.12	UNSAT TT=68.696 CHECKS=61114500 NODES=24648	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=25.944 ASSIGNMENTS=11498 CHECKS=1641480	UNSAT TT=25.348 ASSIGNMENTS=11498 CHECKS=1641480	? (MO) TT=553.35	? (MO) TT=590.91	UNSAT TT=12.13 CHECKS=1386000	UNSAT TT=16.527 ASSIGNMENTS=11769 CHECKS=1721300	UNSAT TT=19.961 ASSIGNMENTS=14800 CHECKS=2093360	? (MO) TT=7.29	UNSAT TT=15.019 ASSIGNMENTS=10851 CHECKS=1499380	UNSAT TT=17.372 ASSIGNMENTS=11498 CHECKS=1641480	? TT=97.33	UNSAT TT=7.028 ASSIGNMENTS=18668 CHECKS=1419660	? TT=135.204	? TT=131.137
csp/bddSmall/ normalized-bdd-21-133-18-78-2_ext.xml	SAT TT=1.264	SAT TT=32.214 CHECKS=22972 NODES=7545	SAT TT=40.965 CHECKS=26351 NODES=8437	SAT TT=158.923	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=72.653 CHECKS=64942100 NODES=26049	SAT TT=1.774 CHECKS=663297 NODES=166	SAT TT=203.114 CHECKS=223101000 NODES=16656	SAT TT=20.768 ASSIGNMENTS=8312 CHECKS=1292560	SAT TT=22.05 ASSIGNMENTS=8312 CHECKS=1292560	? (MO) TT=555.84	? (MO) TT=572.55	SAT TT=1.264 CHECKS=89502	SAT TT=12.254 ASSIGNMENTS=8245 CHECKS=1242660	SAT TT=0.883 ASSIGNMENTS=94 CHECKS=14021	? (MO) TT=7.05	SAT TT=9.321 ASSIGNMENTS=5863 CHECKS=1049050	SAT TT=13.859 ASSIGNMENTS=8312 CHECKS=1292560	? TT=85.614	SAT TT=1.786 ASSIGNMENTS=1902 CHECKS=171788	? TT=98.403	? TT=98.761
csp/bddSmall/ normalized-bdd-21-133-18-78-30_ext.xml	UNSAT TT=16.415	UNSAT TT=61.912 CHECKS=54050 NODES=16986	UNSAT TT=71.147 CHECKS=58082 NODES=17559	UNSAT TT=250.307	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.11	UNSAT TT=71.227 CHECKS=59540100 NODES=24841	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=25.377 ASSIGNMENTS=11079 CHECKS=1742230	UNSAT TT=25.54 ASSIGNMENTS=11079 CHECKS=1742230	? (MO) TT=559.07	? (MO) TT=583.01	UNSAT TT=18.758 CHECKS=1431650	UNSAT TT=16.415 ASSIGNMENTS=11699 CHECKS=1598120	UNSAT TT=21.7 ASSIGNMENTS=16896 CHECKS=2347340	? (MO) TT=7.46	UNSAT TT=16.997 ASSIGNMENTS=12139 CHECKS=1662080	UNSAT TT=16.925 ASSIGNMENTS=11079 CHECKS=1742230	? TT=80.288	UNSAT TT=10.509 ASSIGNMENTS=22003 CHECKS=1576020	? TT=224.487	? TT=247.41
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-31_ext.xml	UNSAT TT=14.791	UNSAT TT=95.062 CHECKS=59416 NODES=17473	UNSAT TT=106.809 CHECKS=55033 NODES=18090	UNSAT TT=242.139	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=1554.51 ASSIGNMENTS=10289	? (TO) TT=1800.05	UNSAT TT=68.224 CHECKS=58346500 NODES=24228	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=22.982 ASSIGNMENTS=10508 CHECKS=1470000	UNSAT TT=21.747 ASSIGNMENTS=10508 CHECKS=1470000	? (MO) TT=558.83	? (MO) TT=591.98	UNSAT TT=18.057 CHECKS=1374040	UNSAT TT=15.381 ASSIGNMENTS=10624 CHECKS=1470240	UNSAT TT=20.571 ASSIGNMENTS=14711 CHECKS=2073900	? (MO) TT=6.84	UNSAT TT=16.03 ASSIGNMENTS=10964 CHECKS=1515920	UNSAT TT=14.791 ASSIGNMENTS=10508 CHECKS=1470000	? TT=90.919	UNSAT TT=7.92 ASSIGNMENTS=17936 CHECKS=1426550	? TT=262.218	? TT=256.199
csp/bddSmall/ normalized-bdd-21-133-18-78-32_ext.xml	SAT TT=0.72	SAT TT=9.431 CHECKS=551 NODES=316	SAT TT=4.181 CHECKS=133 NODES=0	SAT TT=144.006	? (TO) TT=1800.08	SAT TT=137.203 CHECKS=24194	SAT TT=7.106 ASSIGNMENTS=15	SAT TT=7.295 ASSIGNMENTS=17	SAT TT=13.23 CHECKS=10919 NODES=21	SAT TT=12.541 CHECKS=25508400 NODES=6582	SAT TT=22.129 CHECKS=35857900 NODES=6831	SAT TT=0.779 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.785 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=593.4	? (MO) TT=589.35	SAT TT=3.804 CHECKS=396554	SAT TT=0.72 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.781 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=6.91	SAT TT=0.781 ASSIGNMENTS=16 CHECKS=2394	SAT TT=0.758 ASSIGNMENTS=14 CHECKS=2394	? TT=95.526	SAT TT=1.03 ASSIGNMENTS=21 CHECKS=579	? TT=100.247	? TT=99.489
csp/bddSmall/ normalized-bdd-21-133-18-78-33_ext.xml	UNSAT TT=16.157	UNSAT TT=58.092 CHECKS=58833 NODES=19701	UNSAT TT=62.823 CHECKS=65779 NODES=19303	UNSAT TT=251.674	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.08	UNSAT TT=69.614 CHECKS=65493200 NODES=24400	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=26.887 ASSIGNMENTS=12381 CHECKS=1850770	UNSAT TT=26.966 ASSIGNMENTS=12381 CHECKS=1850770	? (MO) TT=577.3	? (MO) TT=578.12	UNSAT TT=21.246 CHECKS=1332060	UNSAT TT=16.157 ASSIGNMENTS=11345 CHECKS=1605130	UNSAT TT=25.087 ASSIGNMENTS=16918 CHECKS=2396730	? (MO) TT=7.11	UNSAT TT=16.478 ASSIGNMENTS=11335 CHECKS=1520940	UNSAT TT=17.331 ASSIGNMENTS=12381 CHECKS=1850770	? TT=80.257	UNSAT TT=8.136 ASSIGNMENTS=20011 CHECKS=2016650	? TT=163.377	? TT=164.594
csp/bddSmall/ normalized-bdd-21-133-18-78-34_ext.xml	SAT TT=4.658	SAT TT=33.215 CHECKS=22442 NODES=7265	SAT TT=35.779 CHECKS=16011 NODES=5864	SAT TT=153.264	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=900.01 ASSIGNMENTS=6026	? (TO) TT=1800.08	SAT TT=55.574 CHECKS=53835200 NODES=22016	SAT TT=9.887 CHECKS=19526500 NODES=5036	SAT TT=180.709 CHECKS=226250000 NODES=22308	SAT TT=18.784 ASSIGNMENTS=7106 CHECKS=982989	SAT TT=18.697 ASSIGNMENTS=7106 CHECKS=982989	? (MO) TT=607.36	? (MO) TT=597.19	SAT TT=11.356 CHECKS=1107490	SAT TT=8.536 ASSIGNMENTS=6107 CHECKS=855725	SAT TT=9.679 ASSIGNMENTS=7298 CHECKS=1046620	? (MO) TT=7.31	SAT TT=4.658 ASSIGNMENTS=3425 CHECKS=483507	SAT TT=9.61 ASSIGNMENTS=7106 CHECKS=982989	? TT=93.958	SAT TT=7.008 ASSIGNMENTS=18307 CHECKS=1522910	? TT=119.179	? TT=109.337
csp/bddSmall/ normalized-bdd-21-133-18-78-35_ext.xml	UNSAT TT=13.553	UNSAT TT=71.316 CHECKS=59807 NODES=16866	UNSAT TT=75.633 CHECKS=56666 NODES=18545	UNSAT TT=196.748	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=67.369 CHECKS=57562200 NODES=24814	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=22.404 ASSIGNMENTS=11159 CHECKS=1524050	UNSAT TT=23.573 ASSIGNMENTS=11159 CHECKS=1524050	? (MO) TT=548.18	? (MO) TT=564.11	UNSAT TT=13.553 CHECKS=1256280	UNSAT TT=15.873 ASSIGNMENTS=10981 CHECKS=1506470	UNSAT TT=19.84 ASSIGNMENTS=14907 CHECKS=2150450	? (MO) TT=8.09	UNSAT TT=14.543 ASSIGNMENTS=10842 CHECKS=1486900	UNSAT TT=15.578 ASSIGNMENTS=11159 CHECKS=1524050	? TT=90.875	UNSAT TT=5.961 ASSIGNMENTS=19155 CHECKS=1123370	? TT=216.29	? TT=216.235
csp/bddSmall/ normalized-bdd-21-133-18-78-3_ext.xml	SAT TT=0.709	SAT TT=25.143 CHECKS=18934 NODES=5967	SAT TT=4.178 CHECKS=133 NODES=0	SAT TT=148.908	SAT TT=1056.7 CHECKS=223126	SAT TT=367.975 CHECKS=80899	SAT TT=6.593 ASSIGNMENTS=15	SAT TT=7.377 ASSIGNMENTS=15	SAT TT=13.35 CHECKS=11371 NODES=21	SAT TT=35.732 CHECKS=78450700 NODES=20255	SAT TT=186.843 CHECKS=230954000 NODES=22708	SAT TT=0.782 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.797 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=586.49	? (MO) TT=567.8	SAT TT=2.902 CHECKS=296067	SAT TT=0.78 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.762 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.6	SAT TT=0.778 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.709 ASSIGNMENTS=14 CHECKS=2394	? TT=87.334	SAT TT=1.06 ASSIGNMENTS=21 CHECKS=965	? TT=313.581	? TT=311.655
csp/bddSmall/ normalized-bdd-21-133-18-78-4_ext.xml	SAT TT=0.815	SAT TT=28.103 CHECKS=8638 NODES=3826	SAT TT=32.354 CHECKS=13615 NODES=4494	SAT TT=259.118	? (TO) TT=1800.03	SAT TT=458.504 CHECKS=120760	? (TO) TT=1800.1	SAT TT=1640.61 ASSIGNMENTS=5576	SAT TT=66.172 CHECKS=65313800 NODES=24481	SAT TT=12.115 CHECKS=24136800 NODES=6228	SAT TT=113.595 CHECKS=141529000 NODES=18435	SAT TT=23.907 ASSIGNMENTS=10886 CHECKS=1704260	SAT TT=25.224 ASSIGNMENTS=10886 CHECKS=1704260	? (MO) TT=557.78	? (MO) TT=575.58	SAT TT=4.393 CHECKS=385744	SAT TT=11.574 ASSIGNMENTS=7985 CHECKS=1296240	SAT TT=22.367 ASSIGNMENTS=15321 CHECKS=2252060	? (MO) TT=7.6	SAT TT=0.815 ASSIGNMENTS=29 CHECKS=4102	SAT TT=15.737 ASSIGNMENTS=10886 CHECKS=1704260	? TT=88.466	SAT TT=5.102 ASSIGNMENTS=10422 CHECKS=1187820	? TT=239.902	? TT=240.824
csp/bddSmall/ normalized-bdd-21-133-18-78-5_ext.xml	SAT TT=0.723	SAT TT=31.826 CHECKS=23174 NODES=7261	SAT TT=4.335 CHECKS=133 NODES=0	SAT TT=146.667	? (TO) TT=1800.11	SAT TT=1210.76 CHECKS=264689	SAT TT=6.373 ASSIGNMENTS=14	SAT TT=6.91 ASSIGNMENTS=15	SAT TT=12.62 CHECKS=13070 NODES=21	SAT TT=5.479 CHECKS=8566250 NODES=2210	SAT TT=204.982 CHECKS=228402000 NODES=20969	SAT TT=0.742 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.723 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=558.1	? (MO) TT=581.74	SAT TT=4.416 CHECKS=376924	SAT TT=0.776 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.763 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=6.8	SAT TT=0.808 ASSIGNMENTS=14 CHECKS=2394	SAT TT=0.777 ASSIGNMENTS=13 CHECKS=2394	? TT=93.341	SAT TT=1.033 ASSIGNMENTS=21 CHECKS=411	? TT=238.441	? TT=246.13
csp/bddSmall/ normalized-bdd-21-133-18-78-6_ext.xml	UNSAT TT=14.88	UNSAT TT=58.165 CHECKS=39854 NODES=15245	UNSAT TT=75.614 CHECKS=36826 NODES=14492	UNSAT TT=284.58	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.06	UNSAT TT=70.985 CHECKS=61066800 NODES=24384	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=24.373 ASSIGNMENTS=11325 CHECKS=1587550	UNSAT TT=24.91 ASSIGNMENTS=11325 CHECKS=1587550	? (MO) TT=548.39	? (MO) TT=578.82	UNSAT TT=18.274 CHECKS=1373470	UNSAT TT=15.86 ASSIGNMENTS=10771 CHECKS=1560070	UNSAT TT=21.542 ASSIGNMENTS=15723 CHECKS=2247850	? (MO) TT=6.8	UNSAT TT=14.88 ASSIGNMENTS=10514 CHECKS=1467170	UNSAT TT=15.696 ASSIGNMENTS=11325 CHECKS=1587550	? TT=81.781	UNSAT TT=7.522 ASSIGNMENTS=18438 CHECKS=1510260	? TT=212.353	? TT=221.729
csp/bddSmall/ normalized-bdd-21-133-18-78-7_ext.xml	SAT TT=0.813	SAT TT=24.206 CHECKS=18492 NODES=6060	SAT TT=30.109 CHECKS=16344 NODES=5691	SAT TT=215.53	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=71.042 CHECKS=64632500 NODES=24477	SAT TT=7.2 CHECKS=12071900 NODES=3113	SAT TT=58.298 CHECKS=81116600 NODES=13809	SAT TT=23.952 ASSIGNMENTS=11935 CHECKS=1731840	SAT TT=23.728 ASSIGNMENTS=11935 CHECKS=1731840	? (MO) TT=587.91	? (MO) TT=589.29	SAT TT=10.423 CHECKS=1170080	SAT TT=14.717 ASSIGNMENTS=10260 CHECKS=1590280	SAT TT=20.27 ASSIGNMENTS=14689 CHECKS=2231340	? (MO) TT=7.11	SAT TT=0.813 ASSIGNMENTS=31 CHECKS=4119	SAT TT=16.372 ASSIGNMENTS=11935 CHECKS=1731840	? TT=85.604	SAT TT=6.664 ASSIGNMENTS=19737 CHECKS=1193090	? TT=109.834	? TT=117.544
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bddSmall/ normalized-bdd-21-133-18-78-8_ext.xml	SAT TT=0.716	SAT TT=19.655 CHECKS=4897 NODES=1923	SAT TT=4.354 CHECKS=133 NODES=0	SAT TT=135.041	SAT TT=502.312 CHECKS=108116	? (TO) TT=1800.1	SAT TT=7.098 ASSIGNMENTS=14	SAT TT=6.61 ASSIGNMENTS=19	SAT TT=13.442 CHECKS=10029 NODES=21	SAT TT=50.773 CHECKS=115221000 NODES=29765	SAT TT=323.324 CHECKS=346201000 NODES=22271	SAT TT=0.729 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.771 ASSIGNMENTS=13 CHECKS=2394	? (MO) TT=587.22	? (MO) TT=546.07	SAT TT=9.759 CHECKS=922513	SAT TT=0.716 ASSIGNMENTS=13 CHECKS=2394	SAT TT=0.72 ASSIGNMENTS=14 CHECKS=2394	? (MO) TT=7.12	SAT TT=0.772 ASSIGNMENTS=18 CHECKS=2394	SAT TT=0.766 ASSIGNMENTS=13 CHECKS=2394	? TT=81.822	SAT TT=1.031 ASSIGNMENTS=21 CHECKS=342	? TT=93.153	? TT=102.929
csp/bddSmall/ normalized-bdd-21-133-18-78-9_ext.xml	SAT TT=0.744	SAT TT=18.886 CHECKS=5197 NODES=2236	SAT TT=4.171 CHECKS=133 NODES=0	SAT TT=221.13	SAT TT=406.132 CHECKS=99353	? (TO) TT=1800.06	? (TO) TT=1800.14	SAT TT=6.751 ASSIGNMENTS=17	SAT TT=12.602 CHECKS=13421 NODES=21	SAT TT=3.132 CHECKS=4255100 NODES=1094	SAT TT=115.992 CHECKS=148509000 NODES=16458	SAT TT=20.033 ASSIGNMENTS=7765 CHECKS=1113110	SAT TT=19.065 ASSIGNMENTS=7765 CHECKS=1113110	? (MO) TT=598.82	? (MO) TT=576.94	SAT TT=3.339 CHECKS=376742	SAT TT=13.69 ASSIGNMENTS=9668 CHECKS=1345280	SAT TT=0.967 ASSIGNMENTS=215 CHECKS=33232	? (MO) TT=7.39	SAT TT=0.744 ASSIGNMENTS=16 CHECKS=2394	SAT TT=11.142 ASSIGNMENTS=7765 CHECKS=1113110	? TT=95.04	SAT TT=1.187 ASSIGNMENTS=222 CHECKS=27801	? TT=104.127	? TT=105.206
csp/dag-half/ normalized-half-n25-d5-e56-r7-11.xml	SAT TT=308.316	? (TO) TT=1800.09	? (TO) TT=1800.08	? (problem) TT=162.158	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.21	? (TO) TT=1800.18	SAT TT=1582.53 CHECKS=2785180000 NODES=3281760	SAT TT=676.028 CHECKS=3008380000 NODES=6609950	? (TO) TT=1800.06	SAT TT=513.531 ASSIGNMENTS=1487580 CHECKS=186631000	SAT TT=781.989 ASSIGNMENTS=1487580 CHECKS=186631000	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=308.316 CHECKS=81926400	SAT TT=509.482 ASSIGNMENTS=1493520 CHECKS=187453000	SAT TT=484.025 ASSIGNMENTS=1486420 CHECKS=186770000	? (MO) TT=42.83	SAT TT=520.44 ASSIGNMENTS=1493730 CHECKS=187439000	SAT TT=505.038 ASSIGNMENTS=1487580 CHECKS=186631000	? (TO) TT=1800.24	? (TO) TT=1800.07	? (MO) TT=12.94	? (MO) TT=13.901
csp/dag-half/ normalized-half-n25-d5-e56-r7-12.xml	SAT TT=75.674	? (TO) TT=1800.1	? (TO) TT=1800.17	? (problem) TT=167.205	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.49	? (TO) TT=1800.02	SAT TT=371.047 CHECKS=1538590000 NODES=3347100	? (TO) TT=1800.01	SAT TT=91.848 ASSIGNMENTS=245954 CHECKS=30807900	SAT TT=378.19 ASSIGNMENTS=245954 CHECKS=30807900	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=124.697 CHECKS=34281000	SAT TT=83.672 ASSIGNMENTS=248086 CHECKS=31128400	SAT TT=107.342 ASSIGNMENTS=337027 CHECKS=42427400	? (MO) TT=45.71	SAT TT=239.786 ASSIGNMENTS=774673 CHECKS=97773500	SAT TT=75.674 ASSIGNMENTS=245954 CHECKS=30807900	? (TO) TT=1800.22	? (TO) TT=1800.11	? (MO) TT=13.861	? (MO) TT=13.659
csp/dag-half/ normalized-half-n25-d5-e56-r7-13.xml	SAT TT=728.091	? (TO) TT=1800.16	? (TO) TT=1800.18	? (problem) TT=153.185	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.21	? (TO) TT=1800.01	SAT TT=728.091 CHECKS=3214990000 NODES=7037520	? (TO) TT=1800.04	SAT TT=929.588 ASSIGNMENTS=2585780 CHECKS=324727000	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=729.686 CHECKS=207623000	SAT TT=837.047 ASSIGNMENTS=2595970 CHECKS=326054000	SAT TT=845.154 ASSIGNMENTS=2487240 CHECKS=312766000	? (MO) TT=48.69	SAT TT=848.883 ASSIGNMENTS=2490630 CHECKS=313309000	SAT TT=858.97 ASSIGNMENTS=2585780 CHECKS=324727000	? (TO) TT=1800.11	? (TO) TT=1800.03	? (MO) TT=14.54	? (MO) TT=13.679
csp/dag-half/ normalized-half-n25-d5-e56-r7-16.xml	SAT TT=98.032	SAT TT=1125.88 CHECKS=2742230 NODES=213114	SAT TT=1595.18 CHECKS=3878370 NODES=294866	? (problem) TT=150.389	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=480.028 ASSIGNMENTS=1365190 CHECKS=165398000	SAT TT=740.208 ASSIGNMENTS=1365190 CHECKS=165398000	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=98.032 CHECKS=25152800	SAT TT=438.337 ASSIGNMENTS=1400520 CHECKS=169671000	SAT TT=336.319 ASSIGNMENTS=1032600 CHECKS=123553000	? (MO) TT=49.26	SAT TT=316.721 ASSIGNMENTS=939626 CHECKS=113901000	SAT TT=443.519 ASSIGNMENTS=1365190 CHECKS=165398000	? (TO) TT=1800.18	SAT TT=1043.04 ASSIGNMENTS=334688 CHECKS=170989000	? (MO) TT=12.979	? (MO) TT=14.83
csp/dag-half/ normalized-half-n25-d5-e56-r7-17.xml	SAT TT=40.662	? (TO) TT=1800.13	? (TO) TT=1800.16	? (problem) TT=164.588	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.21	? (TO) TT=1800.12	SAT TT=806.289 CHECKS=1220860000 NODES=1572910	SAT TT=965.371 CHECKS=4392430000 NODES=9746820	? (TO) TT=1800.04	SAT TT=210.071 ASSIGNMENTS=668650 CHECKS=81029900	SAT TT=503.902 ASSIGNMENTS=668650 CHECKS=81029900	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=495.351 CHECKS=148480000	SAT TT=214.568 ASSIGNMENTS=674529 CHECKS=81883600	SAT TT=35.315 ASSIGNMENTS=95803 CHECKS=11482000	? (MO) TT=45.87	SAT TT=40.662 ASSIGNMENTS=111780 CHECKS=13725100	SAT TT=211.764 ASSIGNMENTS=668650 CHECKS=81029900	? (TO) TT=1800.16	SAT TT=539.288 ASSIGNMENTS=178568 CHECKS=94965000	? (MO) TT=13.88	? (MO) TT=12.87
csp/dag-half/ normalized-half-n25-d5-e56-r7-1.xml	SAT TT=40.572	? (TO) TT=1800.14	? (TO) TT=1800.16	? (problem) TT=167.782	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.16	SAT TT=338.648 CHECKS=498633000 NODES=608460	SAT TT=126.456 CHECKS=447761000 NODES=988037	? (TO) TT=1800.01	SAT TT=55.235 ASSIGNMENTS=117290 CHECKS=14562500	SAT TT=346.12 ASSIGNMENTS=117290 CHECKS=14562500	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=91.178 CHECKS=24388400	SAT TT=40.572 ASSIGNMENTS=119570 CHECKS=14862700	SAT TT=110.799 ASSIGNMENTS=324908 CHECKS=39793400	? (MO) TT=46.59	SAT TT=215.803 ASSIGNMENTS=649684 CHECKS=78876200	SAT TT=42.893 ASSIGNMENTS=117290 CHECKS=14562500	? (TO) TT=1800.2	? (TO) TT=1800.07	? (MO) TT=13.73	? (MO) TT=14.86
csp/dag-half/ normalized-half-n25-d5-e56-r7-21.xml	SAT TT=532.791	? (TO) TT=1800.17	? (TO) TT=1800.14	? (problem) TT=164.338	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=532.791 CHECKS=153461000	? (TO) TT=1800.05	? (TO) TT=1800.05	? (MO) TT=48.32	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.22	? (TO) TT=1800.08	? (MO) TT=12.86	? (MO) TT=13.893
csp/dag-half/ normalized-half-n25-d5-e56-r7-24.xml	SAT TT=149.569	SAT TT=864.025 CHECKS=6857370 NODES=479120	SAT TT=870.579 CHECKS=6642060 NODES=463249	? (problem) TT=164.349	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.2	? (TO) TT=1800.19	? (TO) TT=1800.02	SAT TT=173.449 CHECKS=668821000 NODES=1465980	? (TO) TT=1800.01	SAT TT=310.33 ASSIGNMENTS=995888 CHECKS=123714000	SAT TT=624.338 ASSIGNMENTS=995888 CHECKS=123714000	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=398.592 CHECKS=128278000	SAT TT=301.341 ASSIGNMENTS=940269 CHECKS=116803000	SAT TT=118.905 ASSIGNMENTS=362312 CHECKS=44125800	? (MO) TT=48.92	SAT TT=149.569 ASSIGNMENTS=454518 CHECKS=56459400	SAT TT=319.349 ASSIGNMENTS=995888 CHECKS=123714000	? (TO) TT=1800.16	? (TO) TT=1800.06	? (MO) TT=13.87	? (MO) TT=14.74
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/dag-half/ normalized-half-n25-d5-e56-r7-25.xml	SAT TT=91.25	? (TO) TT=1800.14	? (TO) TT=1800.12	? (problem) TT=168.468	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.18	? (TO) TT=1800.09	SAT TT=324.933 CHECKS=1313900000 NODES=2897410	? (TO) TT=1800.01	SAT TT=391.368 ASSIGNMENTS=1258110 CHECKS=150317000	SAT TT=703.673 ASSIGNMENTS=1258110 CHECKS=150317000	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=91.25 CHECKS=24102800	SAT TT=391.885 ASSIGNMENTS=1263600 CHECKS=150946000	SAT TT=67.162 ASSIGNMENTS=208507 CHECKS=24540600	? (MO) TT=46.7	SAT TT=386.507 ASSIGNMENTS=1181160 CHECKS=144400000	SAT TT=395.637 ASSIGNMENTS=1258110 CHECKS=150317000	SAT TT=480.212	? (TO) TT=1800.05	? (MO) TT=13.685	? (MO) TT=14.66
csp/dag-half/ normalized-half-n25-d5-e56-r7-2.xml	SAT TT=13.322	? (TO) TT=1800.13	? (TO) TT=1800.16	? (problem) TT=166.396	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.12	SAT TT=1700.02 CHECKS=2699870000 NODES=3259260	SAT TT=243.163 CHECKS=942138000 NODES=2071290	? (TO) TT=1800.02	SAT TT=36.611 ASSIGNMENTS=60234 CHECKS=7283950	SAT TT=323.933 ASSIGNMENTS=60234 CHECKS=7283950	SAT TT=868.906	? (TO) TT=1800.05	SAT TT=133.317 CHECKS=37314000	SAT TT=24.809 ASSIGNMENTS=59760 CHECKS=7246990	SAT TT=23.793 ASSIGNMENTS=63491 CHECKS=7515460	? (MO) TT=43.51	SAT TT=13.322 ASSIGNMENTS=25618 CHECKS=3190790	SAT TT=25.007 ASSIGNMENTS=60234 CHECKS=7283950	? (TO) TT=1800.14	? (TO) TT=1800.09	? (MO) TT=13.84	? (MO) TT=13.884
csp/dag-half/ normalized-half-n25-d5-e56-r7-3.xml	SAT TT=21.553	? (TO) TT=1800.12	? (TO) TT=1800.13	? (problem) TT=155.583	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.43	? (TO) TT=1800.17	SAT TT=851.618 CHECKS=1344230000 NODES=1582130	SAT TT=21.553 CHECKS=20907000 NODES=45278	? (TO) TT=1800.09	SAT TT=125.836 ASSIGNMENTS=311651 CHECKS=38911900	SAT TT=414.325 ASSIGNMENTS=311651 CHECKS=38911900	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=308.051 CHECKS=83887100	SAT TT=113.148 ASSIGNMENTS=317479 CHECKS=39682400	SAT TT=37.646 ASSIGNMENTS=96354 CHECKS=11823700	? (MO) TT=46.16	SAT TT=111.296 ASSIGNMENTS=312882 CHECKS=39097100	SAT TT=112.675 ASSIGNMENTS=311651 CHECKS=38911900	? (TO) TT=1800.22	? (TO) TT=1800.05	? (MO) TT=13.78	? (MO) TT=13.898
csp/dag-half/ normalized-half-n25-d5-e56-r7-4.xml	SAT TT=32.435	? (TO) TT=1800.18	? (TO) TT=1800.16	? (problem) TT=165.867	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.19	? (TO) TT=1800	SAT TT=32.435 CHECKS=68955400 NODES=150490	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=671.545 CHECKS=200360000	? (TO) TT=1800.08	? (TO) TT=1800.05	? (MO) TT=45.15	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.18	? (TO) TT=1800.1	? (MO) TT=14.74	? (MO) TT=14.145
csp/dag-half/ normalized-half-n25-d5-e56-r7-5.xml	SAT TT=20.642	? (TO) TT=1800.16	? (TO) TT=1800.17	? (problem) TT=154.276	? (TO) TT=1800.12	? (TO) TT=1800.2	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.03	SAT TT=702.247 CHECKS=2894530000 NODES=6277310	? (TO) TT=1800.06	SAT TT=1607.25 ASSIGNMENTS=4647660 CHECKS=566484000	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=202.792 CHECKS=59796600	SAT TT=1604.78 ASSIGNMENTS=4764390 CHECKS=581201000	SAT TT=1520.69 ASSIGNMENTS=4804690 CHECKS=586695000	? (MO) TT=48.7	SAT TT=20.642 ASSIGNMENTS=47615 CHECKS=5848230	SAT TT=1534.42 ASSIGNMENTS=4647660 CHECKS=566484000	? (TO) TT=1800.18	? (TO) TT=1800.08	? (MO) TT=13.79	? (MO) TT=13.34
csp/dag-half/ normalized-half-n25-d5-e56-r7-7.xml	SAT TT=38.111	? (TO) TT=1800.17	? (TO) TT=1800.15	? (problem) TT=165.277	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.21	SAT TT=1220.55 CHECKS=1913640000 NODES=2239300	SAT TT=91.084 CHECKS=298906000 NODES=653865	? (TO) TT=1800.06	SAT TT=52.797 ASSIGNMENTS=105448 CHECKS=13239700	SAT TT=342.595 ASSIGNMENTS=105448 CHECKS=13239700	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=370.15 CHECKS=100969000	SAT TT=38.111 ASSIGNMENTS=105880 CHECKS=13341200	SAT TT=142.834 ASSIGNMENTS=402193 CHECKS=50033200	? (MO) TT=49.51	SAT TT=653.118 ASSIGNMENTS=2027500 CHECKS=253531000	SAT TT=40.529 ASSIGNMENTS=105448 CHECKS=13239700	? (TO) TT=1800.22	? (TO) TT=1800.1	? (MO) TT=12.91	? (MO) TT=14.74
csp/dag-half/ normalized-half-n25-d5-e56-r7-8.xml	SAT TT=22.895	? (TO) TT=1800.2	? (TO) TT=1800.14	? (problem) TT=158.144	? (TO) TT=1800.21	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.19	SAT TT=1119.14 CHECKS=1825350000 NODES=2213770	SAT TT=22.895 CHECKS=25425600 NODES=55535	? (TO) TT=1800.06	SAT TT=60.514 ASSIGNMENTS=136187 CHECKS=16975900	SAT TT=346.682 ASSIGNMENTS=136187 CHECKS=16975900	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=94.212 CHECKS=25235400	SAT TT=45.256 ASSIGNMENTS=137424 CHECKS=17186200	SAT TT=208.007 ASSIGNMENTS=667386 CHECKS=84586800	? (MO) TT=46.41	SAT TT=58.478 ASSIGNMENTS=166061 CHECKS=20684500	SAT TT=47.651 ASSIGNMENTS=136187 CHECKS=16975900	? (TO) TT=1800.15	SAT TT=1131.7 ASSIGNMENTS=373697 CHECKS=187595000	? (MO) TT=13.876	? (MO) TT=13.911
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-11.xml	UNSAT TT=26.248	UNSAT TT=84.097 CHECKS=43072 NODES=35306	UNSAT TT=99.048 CHECKS=91831 NODES=44218	? (problem) TT=291.472	? (TO) TT=1800.21	? (TO) TT=1800.14	? (TO) TT=1800.21	? (TO) TT=1800.18	UNSAT TT=372.16 CHECKS=1090440000 NODES=64596	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=99.476 ASSIGNMENTS=35306 CHECKS=43072	UNSAT TT=104.444 ASSIGNMENTS=35306 CHECKS=43072	? (problem) TT=116.444	? (problem) TT=100.596	UNSAT TT=26.248 CHECKS=440322	? (TO) TT=1800.12	? (TO) TT=1800.16	? (exit code) TT=39.201	? (TO) TT=1800.08	? (TO) TT=1800.13	? TT=150.002	UNSAT TT=80.913 ASSIGNMENTS=113957 CHECKS=9644100	? (MO) TT=24.31	? (MO) TT=25.83
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-12.xml	UNSAT TT=40.991	UNSAT TT=168.954 CHECKS=1939 NODES=44725	UNSAT TT=150.607 CHECKS=7248 NODES=51402	? (problem) TT=314.009	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.28	? (TO) TT=1800.21	UNSAT TT=342.23 CHECKS=1068820000 NODES=67455	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=193.372 ASSIGNMENTS=44725 CHECKS=1939	UNSAT TT=196.009 ASSIGNMENTS=44725 CHECKS=1939	? (problem) TT=114.985	? (problem) TT=108.174	UNSAT TT=40.991 CHECKS=595917	? (TO) TT=1800.16	? (TO) TT=1800.08	? (exit code) TT=43.495	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=140.419	UNSAT TT=72.772 ASSIGNMENTS=141156 CHECKS=9895740	? (MO) TT=24.861	? (MO) TT=23.828
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-13.xml	UNSAT TT=42.289	UNSAT TT=98.188 CHECKS=3035 NODES=52121	UNSAT TT=97.817 CHECKS=3092 NODES=51952	? (problem) TT=314.873	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.23	UNSAT TT=329.211 CHECKS=943073000 NODES=61799	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=111.386 ASSIGNMENTS=52121 CHECKS=3035	UNSAT TT=105.743 ASSIGNMENTS=52121 CHECKS=3035	? (problem) TT=113.4	? (problem) TT=115.568	UNSAT TT=42.289 CHECKS=595170	? (TO) TT=1800.13	? (TO) TT=1800.08	? (exit code) TT=41.299	? (TO) TT=1800.09	? (TO) TT=1800.13	? TT=84.314	UNSAT TT=80.471 ASSIGNMENTS=106634 CHECKS=7878100	? (MO) TT=21.92	? (MO) TT=23.736
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-14.xml	UNSAT TT=40.138	UNSAT TT=142.676 CHECKS=24466 NODES=39065	UNSAT TT=133.081 CHECKS=23902 NODES=39173	? (problem) TT=292.923	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.24	UNSAT TT=377.463 CHECKS=1295460000 NODES=98824	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=140.811 ASSIGNMENTS=39065 CHECKS=24466	UNSAT TT=155.302 ASSIGNMENTS=39065 CHECKS=24466	? (problem) TT=110.735	? (problem) TT=116.889	UNSAT TT=40.138 CHECKS=602486	? (TO) TT=1800.12	? (TO) TT=1800.16	? (exit code) TT=45.386	? (TO) TT=1800.16	? (TO) TT=1800.11	? TT=164.268	UNSAT TT=55.471 ASSIGNMENTS=136554 CHECKS=5550630	? (MO) TT=23.392	? (MO) TT=23.49
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-15.xml	UNSAT TT=32.026	UNSAT TT=187.075 CHECKS=14847 NODES=37943	UNSAT TT=189.538 CHECKS=14853 NODES=38039	? (problem) TT=314.616	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.17	UNSAT TT=271.456 CHECKS=755958000 NODES=48617	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=214.958 ASSIGNMENTS=37943 CHECKS=14847	UNSAT TT=220.46 ASSIGNMENTS=37943 CHECKS=14847	? (problem) TT=105.065	? (problem) TT=114.16	UNSAT TT=32.026 CHECKS=458932	? (TO) TT=1800.08	? (TO) TT=1800.09	? (exit code) TT=43.744	? (TO) TT=1800.08	? (TO) TT=1800.13	? TT=141.129	UNSAT TT=73.836 ASSIGNMENTS=96898 CHECKS=7291470	? (MO) TT=24.746	? (MO) TT=23.77
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-17.xml	UNSAT TT=36.904	UNSAT TT=159.117 CHECKS=525 NODES=65819	UNSAT TT=134.654 CHECKS=464 NODES=65328	? (problem) TT=315.635	? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.2	UNSAT TT=276.685 CHECKS=752824000 NODES=61313	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=157.531 ASSIGNMENTS=65819 CHECKS=525	UNSAT TT=170.128 ASSIGNMENTS=65819 CHECKS=525	? (problem) TT=119.791	? (problem) TT=120.89	UNSAT TT=36.904 CHECKS=447780	? (TO) TT=1800.15	? (TO) TT=1800.07	? (exit code) TT=46.763	? (TO) TT=1800.07	? (TO) TT=1800.11	? TT=146.021	UNSAT TT=87.69 ASSIGNMENTS=96119 CHECKS=11052700	? (MO) TT=25.939	? (MO) TT=27.014
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-19.xml	UNSAT TT=36.565	UNSAT TT=105.387 CHECKS=524 NODES=35244	UNSAT TT=108.507 CHECKS=547 NODES=35109	? (problem) TT=295.752	? (TO) TT=1800.18	? (TO) TT=1800.19	? (TO) TT=1800.22	? (TO) TT=1800.22	UNSAT TT=326.445 CHECKS=1034200000 NODES=61385	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=122.198 ASSIGNMENTS=35244 CHECKS=524	UNSAT TT=110.163 ASSIGNMENTS=35244 CHECKS=524	? (problem) TT=123.65	? (problem) TT=124.006	UNSAT TT=36.565 CHECKS=572657	? (TO) TT=1800.1	? (TO) TT=1800.13	? (exit code) TT=47.85	? (TO) TT=1800.09	? (TO) TT=1800.06	? TT=154.334	UNSAT TT=71.357 ASSIGNMENTS=92625 CHECKS=8583460	? (MO) TT=26.931	? (MO) TT=22.703
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-21.xml	UNSAT TT=43.103	UNSAT TT=164.095 CHECKS=334 NODES=82832	UNSAT TT=154.458 CHECKS=15291 NODES=50521	? (problem) TT=313.317	? (TO) TT=1800.17	? (TO) TT=1800.21	? (TO) TT=1800.24	? (TO) TT=1800.18	UNSAT TT=340.667 CHECKS=938490000 NODES=71885	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=175.041 ASSIGNMENTS=82832 CHECKS=334	UNSAT TT=171.401 ASSIGNMENTS=82832 CHECKS=334	? (problem) TT=116.192	? (problem) TT=100.488	UNSAT TT=43.103 CHECKS=412254	? (TO) TT=1800.08	? (TO) TT=1800.07	? (exit code) TT=38.878	? (TO) TT=1800.14	? (TO) TT=1800.15	? TT=71.575	UNSAT TT=83.86 ASSIGNMENTS=98877 CHECKS=10610800	? (MO) TT=23.33	? (MO) TT=25.782
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-22.xml	UNSAT TT=33.142	UNSAT TT=99.585 CHECKS=21188 NODES=54102	UNSAT TT=111.883 CHECKS=21318 NODES=54089	? (problem) TT=296.923	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.25	? (TO) TT=1800.21	UNSAT TT=257.175 CHECKS=661532000 NODES=48494	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=110.938 ASSIGNMENTS=54102 CHECKS=21188	UNSAT TT=114.369 ASSIGNMENTS=54102 CHECKS=21188	? (problem) TT=112.427	? (problem) TT=110.798	UNSAT TT=33.142 CHECKS=396876	? (TO) TT=1800.13	? (TO) TT=1800.09	? (exit code) TT=46.648	? (TO) TT=1800.11	? (TO) TT=1800.11	? TT=151.591	UNSAT TT=63.67 ASSIGNMENTS=93084 CHECKS=8020060	? (MO) TT=27.71	? (MO) TT=21.808
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-25.xml	UNSAT TT=30.962	UNSAT TT=174.968 CHECKS=743 NODES=51744	UNSAT TT=170.964 CHECKS=2752 NODES=38066	? (problem) TT=295.8	? (TO) TT=1800.21	? (TO) TT=1800.18	? (TO) TT=1800.26	? (TO) TT=1800.17	UNSAT TT=258.619 CHECKS=680658000 NODES=42210	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=186.189 ASSIGNMENTS=51744 CHECKS=743	UNSAT TT=191.05 ASSIGNMENTS=51744 CHECKS=743	? (problem) TT=122.852	? (problem) TT=123.578	UNSAT TT=30.962 CHECKS=375539	? (TO) TT=1800.12	? (TO) TT=1800.1	? (exit code) TT=40.223	? (TO) TT=1800.08	? (TO) TT=1800.15	? TT=143.664	UNSAT TT=68.329 ASSIGNMENTS=88677 CHECKS=9643050	? (MO) TT=25.855	? (MO) TT=26.938
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-3.xml	UNSAT TT=34.77	UNSAT TT=145.116 CHECKS=7730 NODES=42442	UNSAT TT=243.391 CHECKS=1771 NODES=64539	? (problem) TT=309.471	? (TO) TT=1800.17	? (TO) TT=1800.02	? (TO) TT=1800.25	? (TO) TT=1801.01	UNSAT TT=447.26 CHECKS=1453470000 NODES=91478	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=161.713 ASSIGNMENTS=42442 CHECKS=7730	UNSAT TT=159.339 ASSIGNMENTS=42442 CHECKS=7730	? (problem) TT=113.395	? (problem) TT=107.255	UNSAT TT=34.77 CHECKS=491762	? (TO) TT=1800.1	? (TO) TT=1800.06	? (exit code) TT=45.697	? (TO) TT=1800.12	? (TO) TT=1800.16	? TT=148.956	UNSAT TT=104.672 ASSIGNMENTS=146016 CHECKS=19048600	? (MO) TT=26.71	? (MO) TT=26.69
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-5.xml	UNSAT TT=41.771	UNSAT TT=140.941 CHECKS=7386 NODES=42965	UNSAT TT=124.656 CHECKS=9076 NODES=49567	? (problem) TT=318.34	? (TO) TT=1800.21	? (TO) TT=1800.17	? (TO) TT=1800.27	? (TO) TT=1800.19	UNSAT TT=346.724 CHECKS=1039470000 NODES=65873	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=148.858 ASSIGNMENTS=42965 CHECKS=7386	UNSAT TT=152.611 ASSIGNMENTS=42965 CHECKS=7386	? (problem) TT=105.114	? (problem) TT=117.179	UNSAT TT=41.771 CHECKS=440207	? (TO) TT=1800.11	? (TO) TT=1800.07	? (exit code) TT=48.074	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=113.475	UNSAT TT=101.267 ASSIGNMENTS=99292 CHECKS=15823800	? (MO) TT=21.654	? (MO) TT=25.825
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-6.xml	UNSAT TT=43.342	UNSAT TT=163.938 CHECKS=4563 NODES=44412	UNSAT TT=139.875 CHECKS=1811 NODES=44103	? (problem) TT=293.97	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.26	UNSAT TT=381.615 CHECKS=1148620000 NODES=64665	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=173.683 ASSIGNMENTS=44412 CHECKS=4563	UNSAT TT=178.124 ASSIGNMENTS=44412 CHECKS=4563	? (problem) TT=107.012	? (problem) TT=116.452	UNSAT TT=43.342 CHECKS=571807	? (TO) TT=1800.07	? (TO) TT=1800.15	? (exit code) TT=45.312	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=142.929	UNSAT TT=87.611 ASSIGNMENTS=124538 CHECKS=11166200	? (MO) TT=21.96	? (MO) TT=25.43
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-7.xml	UNSAT TT=36.219	UNSAT TT=75.778 CHECKS=1638 NODES=42749	UNSAT TT=82.4 CHECKS=1072 NODES=42741	? (problem) TT=298.247	? (TO) TT=1800.18	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.2	UNSAT TT=242.082 CHECKS=681372000 NODES=48488	? (TO) TT=1800	? (TO) TT=1800	UNSAT TT=89.998 ASSIGNMENTS=42749 CHECKS=1638	UNSAT TT=90.669 ASSIGNMENTS=42749 CHECKS=1638	? (problem) TT=110.354	? (problem) TT=116.81	UNSAT TT=36.219 CHECKS=446156	? (TO) TT=1800.1	? (TO) TT=1800.12	? (exit code) TT=47.56	? (TO) TT=1800.09	? (TO) TT=1800.12	? TT=153.632	UNSAT TT=102.179 ASSIGNMENTS=95555 CHECKS=14460300	? (MO) TT=27.05	? (MO) TT=21.784
csp/dag-rand/ normalized-rand-n23-d3-e16-r15-t150000-9.xml	UNSAT TT=33.623	UNSAT TT=182.033 CHECKS=19851 NODES=54803	UNSAT TT=180.858 CHECKS=4973 NODES=66193	? (problem) TT=292.156	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.19	UNSAT TT=297.49 CHECKS=794206000 NODES=48260	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=181.054 ASSIGNMENTS=54803 CHECKS=19851	UNSAT TT=195.753 ASSIGNMENTS=54803 CHECKS=19851	? (problem) TT=102.21	? (problem) TT=98.322	UNSAT TT=33.623 CHECKS=463124	? (TO) TT=1800.06	? (TO) TT=1800.05	? (exit code) TT=45.493	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=125.187	UNSAT TT=115.401 ASSIGNMENTS=124609 CHECKS=18470600	? (MO) TT=23.675	? (MO) TT=23.31
csp/dubois/ normalized-dubois-100_ext.xml	UNSAT TT=0.817	? (TO) TT=1800.25	? (TO) TT=1800.26	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.894	UNSAT TT=1.244	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=3.038	? (TO) TT=1800.04	UNSAT TT=0.835	UNSAT TT=0.817
csp/dubois/ normalized-dubois-20_ext.xml	UNSAT TT=0.537	UNSAT TT=1.492 CHECKS=79754 NODES=14777	UNSAT TT=2.53 CHECKS=223066 NODES=41135	UNSAT TT=8.116	UNSAT TT=111.592 CHECKS=82774500	UNSAT TT=123.134 CHECKS=77412600	UNSAT TT=119.071 ASSIGNMENTS=2060720	UNSAT TT=118.771 ASSIGNMENTS=2097150	UNSAT TT=126.312 CHECKS=82378100 NODES=4810800	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=13.504 ASSIGNMENTS=162181 CHECKS=910479	UNSAT TT=14.149 ASSIGNMENTS=162181 CHECKS=910479	UNSAT TT=0.769	UNSAT TT=0.628	UNSAT TT=6.55 CHECKS=6479290	UNSAT TT=9.845 ASSIGNMENTS=1687500 CHECKS=18413100	UNSAT TT=13.741 ASSIGNMENTS=2366460 CHECKS=25865200	UNSAT TT=19.749	UNSAT TT=14.551 ASSIGNMENTS=2371060 CHECKS=26616600	UNSAT TT=8.887 ASSIGNMENTS=1522830 CHECKS=16528500	UNSAT TT=1.212	UNSAT TT=79.105 ASSIGNMENTS=10581800 CHECKS=31649500	UNSAT TT=0.543	UNSAT TT=0.537
csp/dubois/ normalized-dubois-21_ext.xml	UNSAT TT=0.531	UNSAT TT=1.316 CHECKS=60451 NODES=13835	UNSAT TT=1.874 CHECKS=117352 NODES=27428	UNSAT TT=19.589	UNSAT TT=156.875 CHECKS=93120100	UNSAT TT=177.694 CHECKS=111909000	UNSAT TT=222.003 ASSIGNMENTS=3559610	UNSAT TT=235.596 ASSIGNMENTS=4194300	UNSAT TT=268.599 CHECKS=188953000 NODES=10522000	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=17.976 ASSIGNMENTS=277132 CHECKS=2038860	UNSAT TT=19.524 ASSIGNMENTS=277132 CHECKS=2038860	UNSAT TT=0.645	UNSAT TT=0.6	UNSAT TT=22.512 CHECKS=19603400	UNSAT TT=19.897 ASSIGNMENTS=3678290 CHECKS=40001600	UNSAT TT=28.389 ASSIGNMENTS=4843760 CHECKS=53416300	UNSAT TT=39.743	UNSAT TT=26.107 ASSIGNMENTS=4293310 CHECKS=47921300	UNSAT TT=17.496 ASSIGNMENTS=3069620 CHECKS=32785900	UNSAT TT=1.124	UNSAT TT=162.893 ASSIGNMENTS=21207200 CHECKS=63164400	UNSAT TT=0.534	UNSAT TT=0.531
csp/dubois/ normalized-dubois-22_ext.xml	UNSAT TT=0.582	UNSAT TT=14.903 CHECKS=2783970 NODES=330521	UNSAT TT=0.925 CHECKS=8758 NODES=3461	UNSAT TT=34.553	UNSAT TT=288.754 CHECKS=162424000	UNSAT TT=282.141 CHECKS=152813000	UNSAT TT=414.813 ASSIGNMENTS=7209780	UNSAT TT=473.178 ASSIGNMENTS=8388610	UNSAT TT=601.854 CHECKS=415573000 NODES=23024300	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=62.481 ASSIGNMENTS=1317360 CHECKS=10745900	UNSAT TT=62.717 ASSIGNMENTS=1317360 CHECKS=10745900	UNSAT TT=0.891	UNSAT TT=0.885	UNSAT TT=28.039 CHECKS=25835400	UNSAT TT=38.934 ASSIGNMENTS=7188430 CHECKS=78642900	UNSAT TT=50.238 ASSIGNMENTS=9240150 CHECKS=102130000	UNSAT TT=77.315	UNSAT TT=61.601 ASSIGNMENTS=9346540 CHECKS=105158000	UNSAT TT=33.821 ASSIGNMENTS=6198340 CHECKS=67915800	UNSAT TT=1.259	UNSAT TT=340.086 ASSIGNMENTS=42675800 CHECKS=127191000	UNSAT TT=0.583	UNSAT TT=0.582
csp/dubois/ normalized-dubois-23_ext.xml	UNSAT TT=0.54	UNSAT TT=1.417 CHECKS=76323 NODES=14859	UNSAT TT=1.284 CHECKS=30171 NODES=9037	UNSAT TT=82.833	UNSAT TT=447.724 CHECKS=361665000	UNSAT TT=704.039 CHECKS=367553000	UNSAT TT=863.056 ASSIGNMENTS=14091600	UNSAT TT=893.06 ASSIGNMENTS=16777200	UNSAT TT=1043.03 CHECKS=654953000 NODES=36701800	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=8.708 ASSIGNMENTS=10880 CHECKS=48338	UNSAT TT=8.527 ASSIGNMENTS=10880 CHECKS=48338	UNSAT TT=0.647	UNSAT TT=0.89	UNSAT TT=62.045 CHECKS=52501500	UNSAT TT=77.676 ASSIGNMENTS=14166800 CHECKS=156837000	UNSAT TT=104.352 ASSIGNMENTS=18958200 CHECKS=212296000	UNSAT TT=156.465	UNSAT TT=110.773 ASSIGNMENTS=16352100 CHECKS=188083000	UNSAT TT=65.181 ASSIGNMENTS=12012200 CHECKS=131400000	UNSAT TT=1.242	UNSAT TT=681.621 ASSIGNMENTS=78797800 CHECKS=232927000	UNSAT TT=0.581	UNSAT TT=0.54
csp/dubois/ normalized-dubois-24_ext.xml	UNSAT TT=0.573	UNSAT TT=1.332 CHECKS=58473 NODES=13714	UNSAT TT=3.055 CHECKS=291176 NODES=53290	UNSAT TT=140.76	UNSAT TT=694.658 CHECKS=586994000	UNSAT TT=858.316 CHECKS=429022000	UNSAT TT=1681.43 ASSIGNMENTS=27119900	UNSAT TT=1776.78 ASSIGNMENTS=33554400	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=63.628 ASSIGNMENTS=1057570 CHECKS=9215080	UNSAT TT=64.343 ASSIGNMENTS=1057570 CHECKS=9215080	UNSAT TT=0.652	UNSAT TT=0.784	UNSAT TT=137.664 CHECKS=112819000	UNSAT TT=155.1 ASSIGNMENTS=28205200 CHECKS=312721000	UNSAT TT=215.589 ASSIGNMENTS=37314900 CHECKS=416630000	UNSAT TT=285.283	UNSAT TT=235.43 ASSIGNMENTS=35960500 CHECKS=402743000	UNSAT TT=128.299 ASSIGNMENTS=23587500 CHECKS=259851000	UNSAT TT=1.194	UNSAT TT=1486.23 ASSIGNMENTS=156501000 CHECKS=465824000	UNSAT TT=0.573	UNSAT TT=0.584
csp/dubois/ normalized-dubois-25_ext.xml	UNSAT TT=0.623	UNSAT TT=1.438 CHECKS=73345 NODES=14550	UNSAT TT=1.963 CHECKS=122661 NODES=26950	UNSAT TT=378.723	UNSAT TT=1347.38 CHECKS=1139950000	UNSAT TT=1321.7 CHECKS=1158650000	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=8.828 ASSIGNMENTS=13512 CHECKS=57824	UNSAT TT=8.418 ASSIGNMENTS=13512 CHECKS=57824	UNSAT TT=0.687	UNSAT TT=0.819	UNSAT TT=275.316 CHECKS=225616000	UNSAT TT=335.506 ASSIGNMENTS=56490800 CHECKS=624941000	UNSAT TT=452.698 ASSIGNMENTS=73362700 CHECKS=837196000	UNSAT TT=607.968	UNSAT TT=498.144 ASSIGNMENTS=70776900 CHECKS=826140000	UNSAT TT=280.304 ASSIGNMENTS=48274100 CHECKS=522890000	UNSAT TT=1.218	? (TO) TT=1800.06	UNSAT TT=0.632	UNSAT TT=0.623
csp/dubois/ normalized-dubois-26_ext.xml	UNSAT TT=0.557	UNSAT TT=1.7 CHECKS=92009 NODES=18382	UNSAT TT=5.276 CHECKS=581958 NODES=101262	UNSAT TT=547.605	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=8.772 ASSIGNMENTS=15141 CHECKS=62500	UNSAT TT=8.941 ASSIGNMENTS=15141 CHECKS=62500	UNSAT TT=0.653	UNSAT TT=0.784	UNSAT TT=295.968 CHECKS=251515000	UNSAT TT=604.083 ASSIGNMENTS=109553000 CHECKS=1224880000	UNSAT TT=830.156 ASSIGNMENTS=147259000 CHECKS=1681680000	UNSAT TT=1112.45	UNSAT TT=890.055 ASSIGNMENTS=143617000 CHECKS=1624040000	UNSAT TT=427.332 ASSIGNMENTS=77631500 CHECKS=859176000	UNSAT TT=1.236	? (TO) TT=1800.11	UNSAT TT=0.557	UNSAT TT=0.56
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/dubois/ normalized-dubois-27_ext.xml	UNSAT TT=0.606	UNSAT TT=1.495 CHECKS=76632 NODES=15235	UNSAT TT=252.345 CHECKS=51084500 NODES=4863130	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=64.921 ASSIGNMENTS=1136300 CHECKS=9738060	UNSAT TT=64.296 ASSIGNMENTS=1136300 CHECKS=9738060	UNSAT TT=0.654	UNSAT TT=0.801	UNSAT TT=535.22 CHECKS=414338000	UNSAT TT=1166.52 ASSIGNMENTS=194651000 CHECKS=2198930000	UNSAT TT=1678.28 ASSIGNMENTS=292557000 CHECKS=3379750000	? (TO) TT=1800.1	UNSAT TT=1665.2 ASSIGNMENTS=268163000 CHECKS=3064200000	UNSAT TT=1054.53 ASSIGNMENTS=179924000 CHECKS=1990070000	UNSAT TT=1.217	? (TO) TT=1800.03	UNSAT TT=0.606	UNSAT TT=0.609
csp/dubois/ normalized-dubois-28_ext.xml	UNSAT TT=0.601	UNSAT TT=1.863 CHECKS=98777 NODES=18994	UNSAT TT=5.022 CHECKS=376282 NODES=78755	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=16.25 ASSIGNMENTS=148908 CHECKS=1035260	UNSAT TT=16.321 ASSIGNMENTS=148908 CHECKS=1035260	UNSAT TT=0.658	UNSAT TT=0.659	UNSAT TT=822.714 CHECKS=620715000	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=1.274	? (TO) TT=1800.04	UNSAT TT=0.601	UNSAT TT=0.613
csp/dubois/ normalized-dubois-29_ext.xml	UNSAT TT=0.611	UNSAT TT=72.794 CHECKS=12118900 NODES=1532710	UNSAT TT=1.407 CHECKS=31895 NODES=10170	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=9.07 ASSIGNMENTS=14831 CHECKS=78980	UNSAT TT=9.268 ASSIGNMENTS=14831 CHECKS=78980	UNSAT TT=0.647	UNSAT TT=0.783	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=1.313	? (TO) TT=1800.02	UNSAT TT=0.615	UNSAT TT=0.611
csp/dubois/ normalized-dubois-30_ext.xml	UNSAT TT=0.574	UNSAT TT=11.585 CHECKS=1495870 NODES=229362	UNSAT TT=2.891 CHECKS=215719 NODES=43233	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=12.425 ASSIGNMENTS=85364 CHECKS=495018	UNSAT TT=12.565 ASSIGNMENTS=85364 CHECKS=495018	UNSAT TT=0.779	UNSAT TT=0.812	UNSAT TT=1423.07 CHECKS=1136600000	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=1.272	? (TO) TT=1800.07	UNSAT TT=0.574	UNSAT TT=0.58
csp/dubois/ normalized-dubois-50_ext.xml	UNSAT TT=0.699	? (TO) TT=1800.22	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=0.903	UNSAT TT=0.908	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=1.646	? (TO) TT=1800.03	UNSAT TT=0.758	UNSAT TT=0.699
csp/jnhSat/ normalized-jnh01_ext.xml	SAT TT=0.036	SAT TT=1.322 CHECKS=31091 NODES=1179	SAT TT=1.378 CHECKS=29690 NODES=982	SAT TT=0.193	SAT TT=0.196 CHECKS=102543	SAT TT=0.097 CHECKS=106043	SAT TT=1.118 ASSIGNMENTS=65	SAT TT=1.171 ASSIGNMENTS=105	SAT TT=0.734 CHECKS=21599 NODES=124	SAT TT=1.048 CHECKS=823868 NODES=1873	SAT TT=0.795 CHECKS=363159 NODES=371	SAT TT=0.048 ASSIGNMENTS=81 CHECKS=46280	SAT TT=0.052 ASSIGNMENTS=81 CHECKS=46280	SAT TT=6.039	SAT TT=5.53	SAT TT=0.654 CHECKS=11779	SAT TT=0.04 ASSIGNMENTS=83 CHECKS=49293	SAT TT=0.067 ASSIGNMENTS=507 CHECKS=226031	SAT TT=0.858	SAT TT=0.036 ASSIGNMENTS=117 CHECKS=32014	SAT TT=0.04 ASSIGNMENTS=81 CHECKS=46280	SAT TT=1.813	SAT TT=0.165 ASSIGNMENTS=281 CHECKS=157118	SAT TT=0.988	SAT TT=1.026
csp/jnhSat/ normalized-jnh07_ext.xml	SAT TT=0.035	SAT TT=1.204 CHECKS=6201 NODES=242	SAT TT=1.287 CHECKS=7581 NODES=243	SAT TT=0.221	SAT TT=0.166 CHECKS=98971	SAT TT=0.078 CHECKS=97954	SAT TT=0.957 ASSIGNMENTS=38	SAT TT=0.887 ASSIGNMENTS=13	SAT TT=0.697 CHECKS=11819 NODES=104	SAT TT=0.796 CHECKS=322174 NODES=820	SAT TT=0.692 CHECKS=154124 NODES=186	SAT TT=0.048 ASSIGNMENTS=53 CHECKS=31765	SAT TT=0.047 ASSIGNMENTS=53 CHECKS=31765	SAT TT=4.704	SAT TT=4.941	SAT TT=0.568 CHECKS=20219	SAT TT=0.035 ASSIGNMENTS=55 CHECKS=35403	SAT TT=0.036 ASSIGNMENTS=66 CHECKS=33652	SAT TT=0.81	SAT TT=0.036 ASSIGNMENTS=94 CHECKS=30366	SAT TT=0.036 ASSIGNMENTS=53 CHECKS=31765	SAT TT=1.64	SAT TT=0.255 ASSIGNMENTS=283 CHECKS=154999	SAT TT=0.999	SAT TT=1.006
csp/jnhSat/ normalized-jnh12_ext.xml	SAT TT=0.037	SAT TT=1.071 CHECKS=3023 NODES=128	SAT TT=1.082 CHECKS=4078 NODES=0	SAT TT=0.182	SAT TT=0.094 CHECKS=38091	SAT TT=0.05 CHECKS=27447	SAT TT=0.836 ASSIGNMENTS=6	SAT TT=0.966 ASSIGNMENTS=5	SAT TT=0.75 CHECKS=47304 NODES=140	SAT TT=1.943 CHECKS=2772330 NODES=7325	SAT TT=0.883 CHECKS=238976 NODES=306	SAT TT=0.048 ASSIGNMENTS=53 CHECKS=41867	SAT TT=0.047 ASSIGNMENTS=53 CHECKS=41867	SAT TT=5.296	SAT TT=4.77	SAT TT=0.533 CHECKS=11806	SAT TT=0.037 ASSIGNMENTS=41 CHECKS=43630	SAT TT=0.038 ASSIGNMENTS=70 CHECKS=50059	SAT TT=0.856	SAT TT=0.038 ASSIGNMENTS=66 CHECKS=31983	SAT TT=0.039 ASSIGNMENTS=53 CHECKS=41867	SAT TT=1.639	SAT TT=0.148 ASSIGNMENTS=202 CHECKS=104956	SAT TT=0.999	SAT TT=1.052
csp/jnhSat/ normalized-jnh17_ext.xml	SAT TT=0.033	SAT TT=1.058 CHECKS=3404 NODES=127	SAT TT=1.115 CHECKS=5121 NODES=139	SAT TT=0.199	SAT TT=0.184 CHECKS=100448	SAT TT=0.084 CHECKS=94569	SAT TT=1.094 ASSIGNMENTS=53	SAT TT=0.878 ASSIGNMENTS=10	SAT TT=0.862 CHECKS=99110 NODES=188	SAT TT=0.782 CHECKS=276778 NODES=711	SAT TT=0.703 CHECKS=138293 NODES=170	SAT TT=0.047 ASSIGNMENTS=42 CHECKS=30167	SAT TT=0.048 ASSIGNMENTS=42 CHECKS=30167	SAT TT=4.727	SAT TT=4.712	SAT TT=0.493 CHECKS=13047	SAT TT=0.042 ASSIGNMENTS=87 CHECKS=67602	SAT TT=0.084 ASSIGNMENTS=587 CHECKS=332863	SAT TT=0.826	SAT TT=0.033 ASSIGNMENTS=87 CHECKS=24537	SAT TT=0.035 ASSIGNMENTS=42 CHECKS=30167	SAT TT=1.626	SAT TT=0.214 ASSIGNMENTS=168 CHECKS=96858	SAT TT=0.997	SAT TT=1.039
csp/jnhSat/ normalized-jnh201_ext.xml	SAT TT=0.031	SAT TT=1.078 CHECKS=4697 NODES=216	SAT TT=1.123 CHECKS=5804 NODES=213	SAT TT=0.165	SAT TT=0.099 CHECKS=39897	SAT TT=0.054 CHECKS=25808	SAT TT=0.889 ASSIGNMENTS=31	SAT TT=0.884 ASSIGNMENTS=29	SAT TT=0.734 CHECKS=28550 NODES=142	SAT TT=0.685 CHECKS=30142 NODES=36	SAT TT=0.669 CHECKS=73505 NODES=61	SAT TT=0.045 ASSIGNMENTS=33 CHECKS=7600	SAT TT=0.045 ASSIGNMENTS=33 CHECKS=7600	SAT TT=6.197	SAT TT=5.424	SAT TT=0.617 CHECKS=14562	SAT TT=0.031 ASSIGNMENTS=37 CHECKS=8277	SAT TT=0.043 ASSIGNMENTS=228 CHECKS=72565	SAT TT=0.772	SAT TT=0.033 ASSIGNMENTS=64 CHECKS=13681	SAT TT=0.034 ASSIGNMENTS=33 CHECKS=7600	SAT TT=1.652	SAT TT=0.089 ASSIGNMENTS=122 CHECKS=48560	SAT TT=0.999	SAT TT=0.979
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhSat/ normalized-jnh204_ext.xml	SAT TT=0.05	SAT TT=1.215 CHECKS=19669 NODES=615	SAT TT=1.249 CHECKS=31825 NODES=577	SAT TT=1.193	SAT TT=0.268 CHECKS=141464	SAT TT=0.215 CHECKS=293895	SAT TT=2.055 ASSIGNMENTS=393	SAT TT=1.75 ASSIGNMENTS=276	SAT TT=1.55 CHECKS=464657 NODES=531	SAT TT=1.13 CHECKS=1155770 NODES=3180	SAT TT=1.445 CHECKS=3152710 NODES=3251	SAT TT=0.062 ASSIGNMENTS=232 CHECKS=154994	SAT TT=0.061 ASSIGNMENTS=232 CHECKS=154994	SAT TT=7.23	SAT TT=7.135	SAT TT=0.624 CHECKS=149060	SAT TT=0.066 ASSIGNMENTS=404 CHECKS=265618	SAT TT=0.316 ASSIGNMENTS=4210 CHECKS=1979940	SAT TT=1.172	SAT TT=0.099 ASSIGNMENTS=803 CHECKS=510988	SAT TT=0.05 ASSIGNMENTS=232 CHECKS=154994	SAT TT=1.788	SAT TT=0.27 ASSIGNMENTS=479 CHECKS=232358	SAT TT=0.986	SAT TT=1.173
csp/jnhSat/ normalized-jnh205_ext.xml	SAT TT=0.036	SAT TT=1.133 CHECKS=10024 NODES=352	SAT TT=1.2 CHECKS=14050 NODES=453	SAT TT=0.178	SAT TT=0.139 CHECKS=64434	SAT TT=0.069 CHECKS=51963	SAT TT=1.18 ASSIGNMENTS=74	SAT TT=1.251 ASSIGNMENTS=79	SAT TT=0.785 CHECKS=61736 NODES=169	SAT TT=0.772 CHECKS=340175 NODES=907	SAT TT=0.902 CHECKS=835144 NODES=1073	SAT TT=0.05 ASSIGNMENTS=73 CHECKS=61932	SAT TT=0.049 ASSIGNMENTS=73 CHECKS=61932	SAT TT=4.648	SAT TT=4.731	SAT TT=0.496 CHECKS=24433	SAT TT=0.036 ASSIGNMENTS=53 CHECKS=37981	SAT TT=0.117 ASSIGNMENTS=1175 CHECKS=590693	SAT TT=1.006	SAT TT=0.036 ASSIGNMENTS=109 CHECKS=48990	SAT TT=0.037 ASSIGNMENTS=73 CHECKS=61932	SAT TT=1.696	SAT TT=0.255 ASSIGNMENTS=314 CHECKS=192645	SAT TT=1.008	SAT TT=0.989
csp/jnhSat/ normalized-jnh207_ext.xml	SAT TT=0.04	SAT TT=1.336 CHECKS=52756 NODES=1139	SAT TT=1.003 CHECKS=1942 NODES=0	SAT TT=0.598	SAT TT=0.248 CHECKS=134296	SAT TT=0.147 CHECKS=198074	SAT TT=1.341 ASSIGNMENTS=123	SAT TT=1.477 ASSIGNMENTS=160	SAT TT=0.644 CHECKS=8724 NODES=100	SAT TT=1.44 CHECKS=1927310 NODES=5219	SAT TT=0.692 CHECKS=215288 NODES=250	SAT TT=0.051 ASSIGNMENTS=103 CHECKS=81780	SAT TT=0.054 ASSIGNMENTS=103 CHECKS=81780	SAT TT=4.719	SAT TT=4.675	SAT TT=0.515 CHECKS=38303	SAT TT=0.044 ASSIGNMENTS=146 CHECKS=123564	SAT TT=0.033 ASSIGNMENTS=50 CHECKS=21688	SAT TT=0.874	SAT TT=0.043 ASSIGNMENTS=183 CHECKS=85892	SAT TT=0.04 ASSIGNMENTS=103 CHECKS=81780	SAT TT=1.849	SAT TT=0.287 ASSIGNMENTS=519 CHECKS=288426	SAT TT=0.995	SAT TT=0.996
csp/jnhSat/ normalized-jnh209_ext.xml	SAT TT=0.032	SAT TT=1.419 CHECKS=28061 NODES=880	SAT TT=1.235 CHECKS=21828 NODES=620	SAT TT=0.192	SAT TT=0.153 CHECKS=71112	SAT TT=0.093 CHECKS=93233	SAT TT=1.062 ASSIGNMENTS=87	SAT TT=1.281 ASSIGNMENTS=155	SAT TT=0.746 CHECKS=48676 NODES=159	SAT TT=1.951 CHECKS=3149640 NODES=8716	SAT TT=0.772 CHECKS=367844 NODES=536	SAT TT=0.047 ASSIGNMENTS=101 CHECKS=55036	SAT TT=0.053 ASSIGNMENTS=101 CHECKS=55036	SAT TT=4.482	SAT TT=4.543	SAT TT=0.518 CHECKS=40046	SAT TT=0.037 ASSIGNMENTS=97 CHECKS=52339	SAT TT=0.065 ASSIGNMENTS=582 CHECKS=248614	SAT TT=0.757	SAT TT=0.032 ASSIGNMENTS=118 CHECKS=28410	SAT TT=0.038 ASSIGNMENTS=101 CHECKS=55036	SAT TT=1.82	SAT TT=0.478 ASSIGNMENTS=845 CHECKS=508130	SAT TT=0.99	SAT TT=1.026
csp/jnhSat/ normalized-jnh210_ext.xml	SAT TT=0.034	SAT TT=1.862 CHECKS=5052 NODES=219	SAT TT=1.116 CHECKS=7633 NODES=249	SAT TT=0.245	SAT TT=0.163 CHECKS=95758	SAT TT=0.075 CHECKS=60919	SAT TT=1.051 ASSIGNMENTS=69	SAT TT=0.858 ASSIGNMENTS=19	SAT TT=0.647 CHECKS=12234 NODES=105	SAT TT=0.693 CHECKS=73642 NODES=171	SAT TT=0.695 CHECKS=223041 NODES=283	SAT TT=0.046 ASSIGNMENTS=65 CHECKS=44178	SAT TT=0.046 ASSIGNMENTS=65 CHECKS=44178	SAT TT=4.556	SAT TT=4.529	SAT TT=0.554 CHECKS=23691	SAT TT=0.036 ASSIGNMENTS=102 CHECKS=58413	SAT TT=0.072 ASSIGNMENTS=614 CHECKS=285558	SAT TT=0.863	SAT TT=0.039 ASSIGNMENTS=127 CHECKS=63899	SAT TT=0.034 ASSIGNMENTS=65 CHECKS=44178	SAT TT=1.615	SAT TT=0.489 ASSIGNMENTS=718 CHECKS=438284	SAT TT=1.03	SAT TT=0.998
csp/jnhSat/ normalized-jnh212_ext.xml	SAT TT=0.055	SAT TT=1.451 CHECKS=50680 NODES=1618	SAT TT=1.598 CHECKS=64441 NODES=1891	SAT TT=5.13	SAT TT=1.112 CHECKS=652227	SAT TT=0.216 CHECKS=284458	SAT TT=2.493 ASSIGNMENTS=450	SAT TT=1.616 ASSIGNMENTS=213	SAT TT=1.126 CHECKS=256839 NODES=321	SAT TT=38.473 CHECKS=89750300 NODES=245335	SAT TT=13.966 CHECKS=59558500 NODES=39669	SAT TT=0.079 ASSIGNMENTS=355 CHECKS=282433	SAT TT=0.083 ASSIGNMENTS=355 CHECKS=282433	SAT TT=4.646	SAT TT=5.357	SAT TT=0.542 CHECKS=73890	SAT TT=0.069 ASSIGNMENTS=386 CHECKS=306256	SAT TT=0.308 ASSIGNMENTS=4364 CHECKS=1950750	SAT TT=1.421	SAT TT=0.055 ASSIGNMENTS=344 CHECKS=199933	SAT TT=0.068 ASSIGNMENTS=355 CHECKS=282433	SAT TT=1.811	SAT TT=1.058 ASSIGNMENTS=1888 CHECKS=1185840	SAT TT=1.014	SAT TT=1.019
csp/jnhSat/ normalized-jnh213_ext.xml	SAT TT=0.033	SAT TT=1.053 CHECKS=1862 NODES=101	SAT TT=1.06 CHECKS=3593 NODES=101	SAT TT=0.165	SAT TT=0.176 CHECKS=107309	SAT TT=0.082 CHECKS=111940	SAT TT=0.995 ASSIGNMENTS=22	SAT TT=0.999 ASSIGNMENTS=15	SAT TT=0.682 CHECKS=21388 NODES=115	SAT TT=0.75 CHECKS=174201 NODES=475	SAT TT=0.857 CHECKS=688716 NODES=949	SAT TT=0.043 ASSIGNMENTS=42 CHECKS=22009	SAT TT=0.043 ASSIGNMENTS=42 CHECKS=22009	SAT TT=4.703	SAT TT=4.598	SAT TT=0.484 CHECKS=14725	SAT TT=0.034 ASSIGNMENTS=25 CHECKS=18408	SAT TT=0.035 ASSIGNMENTS=104 CHECKS=34754	SAT TT=0.809	SAT TT=0.034 ASSIGNMENTS=59 CHECKS=27530	SAT TT=0.033 ASSIGNMENTS=42 CHECKS=22009	SAT TT=1.621	SAT TT=0.146 ASSIGNMENTS=326 CHECKS=140979	SAT TT=1	SAT TT=1.004
csp/jnhSat/ normalized-jnh217_ext.xml	SAT TT=0.034	SAT TT=1.092 CHECKS=8047 NODES=164	SAT TT=1.102 CHECKS=8276 NODES=158	SAT TT=0.263	SAT TT=0.101 CHECKS=36168	SAT TT=0.06 CHECKS=35572	SAT TT=0.919 ASSIGNMENTS=59	SAT TT=0.948 ASSIGNMENTS=67	SAT TT=1.164 CHECKS=243803 NODES=381	SAT TT=0.742 CHECKS=180335 NODES=435	SAT TT=0.789 CHECKS=327359 NODES=387	SAT TT=0.043 ASSIGNMENTS=58 CHECKS=30004	SAT TT=0.044 ASSIGNMENTS=58 CHECKS=30004	SAT TT=4.576	SAT TT=4.58	SAT TT=0.495 CHECKS=15757	SAT TT=0.044 ASSIGNMENTS=59 CHECKS=27360	SAT TT=0.078 ASSIGNMENTS=750 CHECKS=328477	SAT TT=0.748	SAT TT=0.044 ASSIGNMENTS=234 CHECKS=94066	SAT TT=0.034 ASSIGNMENTS=58 CHECKS=30004	SAT TT=1.624	SAT TT=0.123 ASSIGNMENTS=212 CHECKS=72579	SAT TT=1.01	SAT TT=0.984
csp/jnhSat/ normalized-jnh218_ext.xml	SAT TT=0.035	SAT TT=1.055 CHECKS=3122 NODES=133	SAT TT=1.1 CHECKS=5597 NODES=146	SAT TT=0.206	SAT TT=0.151 CHECKS=82239	SAT TT=0.074 CHECKS=74399	SAT TT=1.071 ASSIGNMENTS=69	SAT TT=0.842 ASSIGNMENTS=18	SAT TT=0.692 CHECKS=27465 NODES=123	SAT TT=0.685 CHECKS=131146 NODES=326	SAT TT=0.752 CHECKS=320978 NODES=369	SAT TT=0.046 ASSIGNMENTS=57 CHECKS=37918	SAT TT=0.045 ASSIGNMENTS=57 CHECKS=37918	SAT TT=4.66	SAT TT=4.753	SAT TT=0.5 CHECKS=19497	SAT TT=0.041 ASSIGNMENTS=101 CHECKS=69174	SAT TT=0.041 ASSIGNMENTS=138 CHECKS=71383	SAT TT=0.789	SAT TT=0.035 ASSIGNMENTS=104 CHECKS=36793	SAT TT=0.036 ASSIGNMENTS=57 CHECKS=37918	SAT TT=1.657	SAT TT=0.138 ASSIGNMENTS=261 CHECKS=124379	SAT TT=1.017	SAT TT=0.991
csp/jnhSat/ normalized-jnh220_ext.xml	SAT TT=0.036	SAT TT=1.272 CHECKS=23795 NODES=692	SAT TT=1.489 CHECKS=35268 NODES=1081	SAT TT=0.182	SAT TT=0.145 CHECKS=63624	SAT TT=0.073 CHECKS=62733	SAT TT=1.029 ASSIGNMENTS=69	SAT TT=1.432 ASSIGNMENTS=159	SAT TT=0.748 CHECKS=53790 NODES=155	SAT TT=0.758 CHECKS=299134 NODES=778	SAT TT=1.021 CHECKS=1346650 NODES=1655	SAT TT=0.05 ASSIGNMENTS=90 CHECKS=61962	SAT TT=0.05 ASSIGNMENTS=90 CHECKS=61962	SAT TT=4.716	SAT TT=4.55	SAT TT=1.094 CHECKS=66435	SAT TT=0.036 ASSIGNMENTS=69 CHECKS=48711	SAT TT=0.149 ASSIGNMENTS=1627 CHECKS=768327	SAT TT=0.721	SAT TT=0.039 ASSIGNMENTS=146 CHECKS=48785	SAT TT=0.038 ASSIGNMENTS=90 CHECKS=61962	SAT TT=1.978	SAT TT=0.184 ASSIGNMENTS=361 CHECKS=253075	SAT TT=0.987	SAT TT=0.994
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhSat/ normalized-jnh301_ext.xml	SAT TT=0.048	SAT TT=1.203 CHECKS=12387 NODES=455	SAT TT=1.228 CHECKS=13477 NODES=434	SAT TT=0.37	SAT TT=0.71 CHECKS=384029	SAT TT=0.17 CHECKS=177926	SAT TT=1.707 ASSIGNMENTS=196	SAT TT=1.68 ASSIGNMENTS=255	SAT TT=1.239 CHECKS=249630 NODES=321	SAT TT=2.103 CHECKS=3074680 NODES=6619	SAT TT=1.272 CHECKS=1950170 NODES=1946	SAT TT=0.059 ASSIGNMENTS=123 CHECKS=103239	SAT TT=0.058 ASSIGNMENTS=123 CHECKS=103239	SAT TT=5.912	SAT TT=5.833	SAT TT=0.699 CHECKS=77263	SAT TT=0.056 ASSIGNMENTS=213 CHECKS=164004	SAT TT=0.319 ASSIGNMENTS=3930 CHECKS=1866930	SAT TT=1.123	SAT TT=0.051 ASSIGNMENTS=254 CHECKS=128179	SAT TT=0.048 ASSIGNMENTS=123 CHECKS=103239	SAT TT=1.879	SAT TT=0.244 ASSIGNMENTS=350 CHECKS=170510	SAT TT=1.026	SAT TT=1.05
csp/jnhUnsat/ normalized-jnh02_ext.xml	UNSAT TT=0.035	UNSAT TT=1.035 CHECKS=1536 NODES=45	UNSAT TT=1.095 CHECKS=3055 NODES=0	UNSAT TT=0.177	UNSAT TT=0.057 CHECKS=7983	UNSAT TT=0.048 CHECKS=9366	UNSAT TT=0.701 ASSIGNMENTS=0	UNSAT TT=0.855 ASSIGNMENTS=0	UNSAT TT=0.853 CHECKS=25626 NODES=17	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=0.047 ASSIGNMENTS=12 CHECKS=12920	UNSAT TT=0.045 ASSIGNMENTS=12 CHECKS=12920	UNSAT TT=5.154	UNSAT TT=5.638	UNSAT TT=0.532 CHECKS=7412	UNSAT TT=0.036 ASSIGNMENTS=10 CHECKS=9732	UNSAT TT=0.033 ASSIGNMENTS=11 CHECKS=10834	UNSAT TT=0.673	UNSAT TT=0.037 ASSIGNMENTS=60 CHECKS=26020	UNSAT TT=0.035 ASSIGNMENTS=12 CHECKS=12920	UNSAT TT=1.681	UNSAT TT=0.154 ASSIGNMENTS=148 CHECKS=129267	UNSAT TT=0.978	UNSAT TT=1.028
csp/jnhUnsat/ normalized-jnh04_ext.xml	UNSAT TT=0.043	UNSAT TT=1.388 CHECKS=24129 NODES=451	UNSAT TT=1.305 CHECKS=32481 NODES=481	UNSAT TT=0.608	UNSAT TT=0.088 CHECKS=33333	UNSAT TT=0.061 CHECKS=39366	UNSAT TT=0.81 ASSIGNMENTS=0	UNSAT TT=0.885 ASSIGNMENTS=0	UNSAT TT=0.971 CHECKS=172754 NODES=137	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.049 ASSIGNMENTS=87 CHECKS=72429	UNSAT TT=0.054 ASSIGNMENTS=87 CHECKS=72429	UNSAT TT=4.18	UNSAT TT=4.294	UNSAT TT=0.555 CHECKS=34749	UNSAT TT=0.043 ASSIGNMENTS=134 CHECKS=107345	UNSAT TT=0.289 ASSIGNMENTS=3584 CHECKS=1835560	UNSAT TT=0.716	UNSAT TT=0.047 ASSIGNMENTS=182 CHECKS=115706	UNSAT TT=0.044 ASSIGNMENTS=87 CHECKS=72429	UNSAT TT=1.641	UNSAT TT=0.283 ASSIGNMENTS=253 CHECKS=244562	UNSAT TT=1.316	UNSAT TT=1.242
csp/jnhUnsat/ normalized-jnh05_ext.xml	UNSAT TT=0.034	UNSAT TT=1.148 CHECKS=5463 NODES=202	UNSAT TT=1.164 CHECKS=6102 NODES=97	UNSAT TT=0.174	UNSAT TT=0.096 CHECKS=31442	UNSAT TT=0.052 CHECKS=21812	UNSAT TT=1.131 ASSIGNMENTS=0	UNSAT TT=0.922 ASSIGNMENTS=0	UNSAT TT=0.773 CHECKS=36922 NODES=33	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.047 ASSIGNMENTS=19 CHECKS=17174	UNSAT TT=0.046 ASSIGNMENTS=19 CHECKS=17174	UNSAT TT=4.437	UNSAT TT=4.329	UNSAT TT=0.527 CHECKS=17896	UNSAT TT=0.034 ASSIGNMENTS=21 CHECKS=20230	UNSAT TT=0.043 ASSIGNMENTS=114 CHECKS=70258	UNSAT TT=0.715	UNSAT TT=0.039 ASSIGNMENTS=78 CHECKS=27717	UNSAT TT=0.036 ASSIGNMENTS=19 CHECKS=17174	UNSAT TT=1.819	UNSAT TT=0.162 ASSIGNMENTS=206 CHECKS=137262	UNSAT TT=1.261	UNSAT TT=1.156
csp/jnhUnsat/ normalized-jnh06_ext.xml	UNSAT TT=0.045	UNSAT TT=1.373 CHECKS=51228 NODES=930	UNSAT TT=1.312 CHECKS=19234 NODES=554	UNSAT TT=0.381	UNSAT TT=0.264 CHECKS=127577	UNSAT TT=0.11 CHECKS=102667	UNSAT TT=1.457 ASSIGNMENTS=132	UNSAT TT=1.375 ASSIGNMENTS=148	UNSAT TT=1.059 CHECKS=199841 NODES=177	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.056 ASSIGNMENTS=127 CHECKS=88654	UNSAT TT=0.056 ASSIGNMENTS=127 CHECKS=88654	UNSAT TT=4.988	UNSAT TT=4.084	UNSAT TT=0.519 CHECKS=37057	UNSAT TT=0.046 ASSIGNMENTS=160 CHECKS=116649	UNSAT TT=0.335 ASSIGNMENTS=3954 CHECKS=2018960	UNSAT TT=0.92	UNSAT TT=0.045 ASSIGNMENTS=194 CHECKS=91316	UNSAT TT=0.045 ASSIGNMENTS=127 CHECKS=88654	UNSAT TT=1.915	UNSAT TT=0.479 ASSIGNMENTS=609 CHECKS=450433	UNSAT TT=0.979	UNSAT TT=1
csp/jnhUnsat/ normalized-jnh08_ext.xml	UNSAT TT=0.033	UNSAT TT=1.155 CHECKS=4712 NODES=151	UNSAT TT=1.221 CHECKS=7718 NODES=170	UNSAT TT=0.178	UNSAT TT=0.078 CHECKS=19911	UNSAT TT=0.047 CHECKS=15449	UNSAT TT=0.811 ASSIGNMENTS=0	UNSAT TT=1.032 ASSIGNMENTS=0	UNSAT TT=0.824 CHECKS=63906 NODES=54	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.047 ASSIGNMENTS=16 CHECKS=16134	UNSAT TT=0.047 ASSIGNMENTS=16 CHECKS=16134	UNSAT TT=4.299	UNSAT TT=4.161	UNSAT TT=0.526 CHECKS=13052	UNSAT TT=0.036 ASSIGNMENTS=22 CHECKS=22439	UNSAT TT=0.104 ASSIGNMENTS=988 CHECKS=567717	UNSAT TT=0.641	UNSAT TT=0.037 ASSIGNMENTS=95 CHECKS=39404	UNSAT TT=0.033 ASSIGNMENTS=16 CHECKS=16134	UNSAT TT=1.768	UNSAT TT=0.094 ASSIGNMENTS=146 CHECKS=104271	UNSAT TT=1.005	UNSAT TT=1.04
csp/jnhUnsat/ normalized-jnh09_ext.xml	UNSAT TT=0.038	UNSAT TT=1.262 CHECKS=16683 NODES=595	UNSAT TT=1.334 CHECKS=18844 NODES=715	UNSAT TT=0.422	UNSAT TT=0.072 CHECKS=17836	UNSAT TT=0.056 CHECKS=32338	UNSAT TT=1.071 ASSIGNMENTS=0	UNSAT TT=0.825 ASSIGNMENTS=0	UNSAT TT=1.019 CHECKS=94974 NODES=94	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.054 ASSIGNMENTS=87 CHECKS=58349	UNSAT TT=0.055 ASSIGNMENTS=87 CHECKS=58349	UNSAT TT=4.021	UNSAT TT=5.653	UNSAT TT=0.513 CHECKS=29895	UNSAT TT=0.038 ASSIGNMENTS=97 CHECKS=66023	UNSAT TT=0.125 ASSIGNMENTS=1292 CHECKS=635751	UNSAT TT=0.78	UNSAT TT=0.039 ASSIGNMENTS=136 CHECKS=64108	UNSAT TT=0.04 ASSIGNMENTS=87 CHECKS=58349	UNSAT TT=1.777	UNSAT TT=0.253 ASSIGNMENTS=263 CHECKS=170659	UNSAT TT=1.012	UNSAT TT=1.149
csp/jnhUnsat/ normalized-jnh10_ext.xml	UNSAT TT=0.035	UNSAT TT=1.173 CHECKS=8141 NODES=208	UNSAT TT=1.144 CHECKS=4565 NODES=0	UNSAT TT=0.181	UNSAT TT=0.068 CHECKS=12039	UNSAT TT=0.049 CHECKS=17028	UNSAT TT=0.985 ASSIGNMENTS=0	UNSAT TT=0.791 ASSIGNMENTS=0	UNSAT TT=0.824 CHECKS=62568 NODES=48	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.047 ASSIGNMENTS=16 CHECKS=15721	UNSAT TT=0.044 ASSIGNMENTS=16 CHECKS=15721	UNSAT TT=4.253	UNSAT TT=4.217	UNSAT TT=0.5 CHECKS=10983	UNSAT TT=0.035 ASSIGNMENTS=17 CHECKS=17019	UNSAT TT=0.04 ASSIGNMENTS=60 CHECKS=49794	UNSAT TT=0.902	UNSAT TT=0.036 ASSIGNMENTS=73 CHECKS=32823	UNSAT TT=0.035 ASSIGNMENTS=16 CHECKS=15721	UNSAT TT=1.796	UNSAT TT=0.152 ASSIGNMENTS=185 CHECKS=132702	UNSAT TT=0.972	UNSAT TT=1.13
csp/jnhUnsat/ normalized-jnh11_ext.xml	UNSAT TT=0.038	UNSAT TT=1.277 CHECKS=15730 NODES=459	UNSAT TT=1.313 CHECKS=12325 NODES=300	UNSAT TT=0.554	UNSAT TT=0.113 CHECKS=49562	UNSAT TT=0.072 CHECKS=73107	UNSAT TT=1.155 ASSIGNMENTS=36	UNSAT TT=1.127 ASSIGNMENTS=6	UNSAT TT=0.991 CHECKS=129717 NODES=119	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=0.054 ASSIGNMENTS=80 CHECKS=72218	UNSAT TT=0.055 ASSIGNMENTS=80 CHECKS=72218	UNSAT TT=4.068	UNSAT TT=4.491	UNSAT TT=0.52 CHECKS=15577	UNSAT TT=0.04 ASSIGNMENTS=79 CHECKS=66981	UNSAT TT=0.317 ASSIGNMENTS=3774 CHECKS=1804830	UNSAT TT=0.753	UNSAT TT=0.038 ASSIGNMENTS=85 CHECKS=48160	UNSAT TT=0.043 ASSIGNMENTS=80 CHECKS=72218	UNSAT TT=1.889	UNSAT TT=0.243 ASSIGNMENTS=307 CHECKS=210023	UNSAT TT=1.245	UNSAT TT=1.044
csp/jnhUnsat/ normalized-jnh13_ext.xml	UNSAT TT=0.033	UNSAT TT=1.134 CHECKS=5469 NODES=131	UNSAT TT=1.28 CHECKS=6460 NODES=127	UNSAT TT=0.175	UNSAT TT=0.078 CHECKS=23769	UNSAT TT=0.052 CHECKS=19967	UNSAT TT=1.015 ASSIGNMENTS=0	UNSAT TT=0.774 ASSIGNMENTS=0	UNSAT TT=0.727 CHECKS=41305 NODES=34	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.045 ASSIGNMENTS=13 CHECKS=12733	UNSAT TT=0.048 ASSIGNMENTS=13 CHECKS=12733	UNSAT TT=5.132	UNSAT TT=4.207	UNSAT TT=0.72 CHECKS=8937	UNSAT TT=0.034 ASSIGNMENTS=11 CHECKS=12953	UNSAT TT=0.178 ASSIGNMENTS=1735 CHECKS=970875	UNSAT TT=0.677	UNSAT TT=0.036 ASSIGNMENTS=81 CHECKS=29540	UNSAT TT=0.033 ASSIGNMENTS=13 CHECKS=12733	UNSAT TT=1.761	UNSAT TT=0.109 ASSIGNMENTS=194 CHECKS=130886	UNSAT TT=1.042	UNSAT TT=1.4
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhUnsat/ normalized-jnh14_ext.xml	UNSAT TT=0.035	UNSAT TT=1.22 CHECKS=12072 NODES=414	UNSAT TT=1.402 CHECKS=14474 NODES=430	UNSAT TT=0.34	UNSAT TT=0.084 CHECKS=25450	UNSAT TT=0.048 CHECKS=23438	UNSAT TT=1.022 ASSIGNMENTS=0	UNSAT TT=1.041 ASSIGNMENTS=0	UNSAT TT=0.767 CHECKS=54779 NODES=47	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.048 ASSIGNMENTS=43 CHECKS=28491	UNSAT TT=0.044 ASSIGNMENTS=43 CHECKS=28491	UNSAT TT=4.157	UNSAT TT=5.216	UNSAT TT=0.734 CHECKS=22138	UNSAT TT=0.039 ASSIGNMENTS=70 CHECKS=56452	UNSAT TT=0.201 ASSIGNMENTS=2589 CHECKS=1226600	UNSAT TT=0.841	UNSAT TT=0.041 ASSIGNMENTS=159 CHECKS=57710	UNSAT TT=0.035 ASSIGNMENTS=43 CHECKS=28491	UNSAT TT=1.73	UNSAT TT=0.181 ASSIGNMENTS=216 CHECKS=191911	UNSAT TT=1.034	UNSAT TT=1.164
csp/jnhUnsat/ normalized-jnh15_ext.xml	UNSAT TT=0.034	UNSAT TT=1.386 CHECKS=13652 NODES=401	UNSAT TT=1.19 CHECKS=10088 NODES=168	UNSAT TT=0.237	UNSAT TT=0.101 CHECKS=42017	UNSAT TT=0.057 CHECKS=41576	UNSAT TT=0.902 ASSIGNMENTS=10	UNSAT TT=1.164 ASSIGNMENTS=1	UNSAT TT=0.933 CHECKS=59275 NODES=41	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=0.047 ASSIGNMENTS=47 CHECKS=42509	UNSAT TT=0.05 ASSIGNMENTS=47 CHECKS=42509	UNSAT TT=5.233	UNSAT TT=4.92	UNSAT TT=0.66 CHECKS=26455	UNSAT TT=0.038 ASSIGNMENTS=67 CHECKS=48676	UNSAT TT=0.124 ASSIGNMENTS=1046 CHECKS=613418	UNSAT TT=0.903	UNSAT TT=0.034 ASSIGNMENTS=103 CHECKS=43635	UNSAT TT=0.036 ASSIGNMENTS=47 CHECKS=42509	UNSAT TT=1.773	UNSAT TT=0.284 ASSIGNMENTS=415 CHECKS=271891	UNSAT TT=1.139	UNSAT TT=1.042
csp/jnhUnsat/ normalized-jnh16_ext.xml	UNSAT TT=0.119	UNSAT TT=2.585 CHECKS=234797 NODES=5167	UNSAT TT=2.556 CHECKS=223072 NODES=5339	UNSAT TT=1.715	UNSAT TT=5.649 CHECKS=2992990	UNSAT TT=2.694 CHECKS=3878880	UNSAT TT=4.187 ASSIGNMENTS=854	UNSAT TT=7.674 ASSIGNMENTS=2131	UNSAT TT=5.015 CHECKS=2327160 NODES=1952	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.131 ASSIGNMENTS=736 CHECKS=567811	UNSAT TT=0.132 ASSIGNMENTS=736 CHECKS=567811	UNSAT TT=4.467	UNSAT TT=4.28	UNSAT TT=0.868 CHECKS=315260	UNSAT TT=0.133 ASSIGNMENTS=848 CHECKS=659886	UNSAT TT=0.411 ASSIGNMENTS=4730 CHECKS=2492440	UNSAT TT=1.85	UNSAT TT=0.136 ASSIGNMENTS=904 CHECKS=655316	UNSAT TT=0.119 ASSIGNMENTS=736 CHECKS=567811	UNSAT TT=2.134	UNSAT TT=2.506 ASSIGNMENTS=5010 CHECKS=3581100	UNSAT TT=1.245	UNSAT TT=1.199
csp/jnhUnsat/ normalized-jnh18_ext.xml	UNSAT TT=0.039	UNSAT TT=1.327 CHECKS=23099 NODES=766	UNSAT TT=1.339 CHECKS=19645 NODES=658	UNSAT TT=0.291	UNSAT TT=0.386 CHECKS=199967	UNSAT TT=0.099 CHECKS=97199	UNSAT TT=1.258 ASSIGNMENTS=87	UNSAT TT=1.212 ASSIGNMENTS=68	UNSAT TT=1.992 CHECKS=577392 NODES=463	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.054 ASSIGNMENTS=98 CHECKS=72438	UNSAT TT=0.062 ASSIGNMENTS=98 CHECKS=72438	UNSAT TT=5.174	UNSAT TT=5.815	UNSAT TT=0.777 CHECKS=67027	UNSAT TT=0.049 ASSIGNMENTS=142 CHECKS=105061	UNSAT TT=0.327 ASSIGNMENTS=4082 CHECKS=2138040	UNSAT TT=0.922	UNSAT TT=0.045 ASSIGNMENTS=198 CHECKS=99945	UNSAT TT=0.039 ASSIGNMENTS=98 CHECKS=72438	UNSAT TT=1.949	UNSAT TT=0.344 ASSIGNMENTS=640 CHECKS=424875	UNSAT TT=1.222	UNSAT TT=1.001
csp/jnhUnsat/ normalized-jnh19_ext.xml	UNSAT TT=0.048	UNSAT TT=1.302 CHECKS=19591 NODES=613	UNSAT TT=1.406 CHECKS=29688 NODES=789	UNSAT TT=0.756	UNSAT TT=0.535 CHECKS=273477	UNSAT TT=0.282 CHECKS=365478	UNSAT TT=1.89 ASSIGNMENTS=212	UNSAT TT=1.002 ASSIGNMENTS=22	UNSAT TT=0.839 CHECKS=64946 NODES=51	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.06 ASSIGNMENTS=125 CHECKS=113006	UNSAT TT=0.056 ASSIGNMENTS=125 CHECKS=113006	UNSAT TT=4.338	UNSAT TT=4.584	UNSAT TT=0.605 CHECKS=51156	UNSAT TT=0.048 ASSIGNMENTS=135 CHECKS=118965	UNSAT TT=0.321 ASSIGNMENTS=3828 CHECKS=1983590	UNSAT TT=0.975	UNSAT TT=0.049 ASSIGNMENTS=205 CHECKS=105866	UNSAT TT=0.048 ASSIGNMENTS=125 CHECKS=113006	UNSAT TT=1.69	UNSAT TT=0.415 ASSIGNMENTS=703 CHECKS=497972	UNSAT TT=1.026	UNSAT TT=1.026
csp/jnhUnsat/ normalized-jnh202_ext.xml	UNSAT TT=0.032	UNSAT TT=1.079 CHECKS=839 NODES=31	UNSAT TT=1.064 CHECKS=1666 NODES=0	UNSAT TT=0.173	UNSAT TT=0.063 CHECKS=13861	UNSAT TT=0.046 CHECKS=9985	UNSAT TT=0.699 ASSIGNMENTS=0	UNSAT TT=0.801 ASSIGNMENTS=0	UNSAT TT=0.746 CHECKS=57384 NODES=43	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=0.046 ASSIGNMENTS=18 CHECKS=16686	UNSAT TT=0.045 ASSIGNMENTS=18 CHECKS=16686	UNSAT TT=4.312	UNSAT TT=4.578	UNSAT TT=0.539 CHECKS=23990	UNSAT TT=0.032 ASSIGNMENTS=18 CHECKS=16967	UNSAT TT=0.047 ASSIGNMENTS=116 CHECKS=77073	UNSAT TT=0.661	UNSAT TT=0.033 ASSIGNMENTS=54 CHECKS=19376	UNSAT TT=0.035 ASSIGNMENTS=18 CHECKS=16686	UNSAT TT=1.724	UNSAT TT=0.197 ASSIGNMENTS=318 CHECKS=275028	UNSAT TT=0.972	UNSAT TT=1.22
csp/jnhUnsat/ normalized-jnh203_ext.xml	UNSAT TT=0.036	UNSAT TT=1.261 CHECKS=17212 NODES=557	UNSAT TT=1.206 CHECKS=15095 NODES=455	UNSAT TT=0.188	UNSAT TT=0.168 CHECKS=72551	UNSAT TT=0.087 CHECKS=72213	UNSAT TT=1.155 ASSIGNMENTS=53	UNSAT TT=0.93 ASSIGNMENTS=15	UNSAT TT=1.005 CHECKS=93319 NODES=85	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.048 ASSIGNMENTS=54 CHECKS=41414	UNSAT TT=0.048 ASSIGNMENTS=54 CHECKS=41414	UNSAT TT=4.019	UNSAT TT=4.116	UNSAT TT=0.562 CHECKS=29862	UNSAT TT=0.039 ASSIGNMENTS=67 CHECKS=51762	UNSAT TT=0.341 ASSIGNMENTS=3764 CHECKS=2083950	UNSAT TT=0.783	UNSAT TT=0.039 ASSIGNMENTS=129 CHECKS=61920	UNSAT TT=0.036 ASSIGNMENTS=54 CHECKS=41414	UNSAT TT=1.873	UNSAT TT=0.154 ASSIGNMENTS=371 CHECKS=210375	UNSAT TT=1.2	UNSAT TT=1.21
csp/jnhUnsat/ normalized-jnh206_ext.xml	UNSAT TT=0.047	UNSAT TT=1.322 CHECKS=32441 NODES=884	UNSAT TT=1.237 CHECKS=24232 NODES=585	UNSAT TT=0.235	UNSAT TT=0.202 CHECKS=111475	UNSAT TT=0.097 CHECKS=110724	UNSAT TT=1.379 ASSIGNMENTS=100	UNSAT TT=1.128 ASSIGNMENTS=61	UNSAT TT=1.187 CHECKS=229877 NODES=208	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=0.063 ASSIGNMENTS=151 CHECKS=130802	UNSAT TT=0.063 ASSIGNMENTS=151 CHECKS=130802	UNSAT TT=4.025	UNSAT TT=4.162	UNSAT TT=0.52 CHECKS=45502	UNSAT TT=0.047 ASSIGNMENTS=134 CHECKS=125594	UNSAT TT=0.338 ASSIGNMENTS=4002 CHECKS=1966060	UNSAT TT=0.873	UNSAT TT=0.055 ASSIGNMENTS=282 CHECKS=175550	UNSAT TT=0.047 ASSIGNMENTS=151 CHECKS=130802	UNSAT TT=1.944	UNSAT TT=0.302 ASSIGNMENTS=629 CHECKS=366050	UNSAT TT=0.977	UNSAT TT=1.325
csp/jnhUnsat/ normalized-jnh208_ext.xml	UNSAT TT=0.035	UNSAT TT=1.241 CHECKS=32632 NODES=491	UNSAT TT=1.31 CHECKS=27544 NODES=376	UNSAT TT=0.203	UNSAT TT=0.235 CHECKS=122953	UNSAT TT=0.101 CHECKS=117711	UNSAT TT=1.249 ASSIGNMENTS=62	UNSAT TT=1.108 ASSIGNMENTS=23	UNSAT TT=0.886 CHECKS=99125 NODES=81	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=0.046 ASSIGNMENTS=42 CHECKS=36283	UNSAT TT=0.05 ASSIGNMENTS=42 CHECKS=36283	UNSAT TT=4.662	UNSAT TT=4.264	UNSAT TT=0.61 CHECKS=32416	UNSAT TT=0.038 ASSIGNMENTS=82 CHECKS=62801	UNSAT TT=0.324 ASSIGNMENTS=3537 CHECKS=1831530	UNSAT TT=1.03	UNSAT TT=0.039 ASSIGNMENTS=90 CHECKS=49649	UNSAT TT=0.035 ASSIGNMENTS=42 CHECKS=36283	UNSAT TT=1.762	UNSAT TT=0.261 ASSIGNMENTS=297 CHECKS=198019	UNSAT TT=1.214	UNSAT TT=1.035
csp/jnhUnsat/ normalized-jnh20_ext.xml	UNSAT TT=0.04	UNSAT TT=1.182 CHECKS=10769 NODES=367	UNSAT TT=1.286 CHECKS=12081 NODES=299	UNSAT TT=0.229	UNSAT TT=0.132 CHECKS=49566	UNSAT TT=0.052 CHECKS=21635	UNSAT TT=0.932 ASSIGNMENTS=0	UNSAT TT=0.876 ASSIGNMENTS=0	UNSAT TT=0.811 CHECKS=75999 NODES=69	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=0.047 ASSIGNMENTS=75 CHECKS=65162	UNSAT TT=0.053 ASSIGNMENTS=75 CHECKS=65162	UNSAT TT=4.405	UNSAT TT=4.201	UNSAT TT=0.651 CHECKS=40634	UNSAT TT=0.041 ASSIGNMENTS=82 CHECKS=66046	UNSAT TT=0.074 ASSIGNMENTS=459 CHECKS=287257	UNSAT TT=0.724	UNSAT TT=0.04 ASSIGNMENTS=116 CHECKS=58932	UNSAT TT=0.041 ASSIGNMENTS=75 CHECKS=65162	UNSAT TT=1.919	UNSAT TT=0.26 ASSIGNMENTS=274 CHECKS=193683	UNSAT TT=1.227	UNSAT TT=1.036
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhUnsat/ normalized-jnh211_ext.xml	UNSAT TT=0.032	UNSAT TT=1.181 CHECKS=7129 NODES=230	UNSAT TT=1.288 CHECKS=8411 NODES=214	UNSAT TT=0.18	UNSAT TT=0.064 CHECKS=15066	UNSAT TT=0.055 CHECKS=38037	UNSAT TT=0.764 ASSIGNMENTS=0	UNSAT TT=0.779 ASSIGNMENTS=0	UNSAT TT=0.951 CHECKS=72090 NODES=60	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.043 ASSIGNMENTS=18 CHECKS=14766	UNSAT TT=0.039 ASSIGNMENTS=18 CHECKS=14766	UNSAT TT=5.358	UNSAT TT=4.086	UNSAT TT=0.503 CHECKS=14345	UNSAT TT=0.034 ASSIGNMENTS=33 CHECKS=27475	UNSAT TT=0.078 ASSIGNMENTS=605 CHECKS=330026	UNSAT TT=0.787	UNSAT TT=0.034 ASSIGNMENTS=77 CHECKS=30431	UNSAT TT=0.032 ASSIGNMENTS=18 CHECKS=14766	UNSAT TT=1.652	UNSAT TT=0.098 ASSIGNMENTS=179 CHECKS=113276	UNSAT TT=0.983	UNSAT TT=1.209
csp/jnhUnsat/ normalized-jnh214_ext.xml	UNSAT TT=0.035	UNSAT TT=1.172 CHECKS=9170 NODES=262	UNSAT TT=1.18 CHECKS=12139 NODES=295	UNSAT TT=0.177	UNSAT TT=0.186 CHECKS=97015	UNSAT TT=0.064 CHECKS=44495	UNSAT TT=1.194 ASSIGNMENTS=19	UNSAT TT=1.019 ASSIGNMENTS=29	UNSAT TT=0.991 CHECKS=89520 NODES=84	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.049 ASSIGNMENTS=38 CHECKS=32226	UNSAT TT=0.046 ASSIGNMENTS=38 CHECKS=32226	UNSAT TT=4.031	UNSAT TT=4.251	UNSAT TT=0.489 CHECKS=15525	UNSAT TT=0.037 ASSIGNMENTS=42 CHECKS=35489	UNSAT TT=0.298 ASSIGNMENTS=3636 CHECKS=1645080	UNSAT TT=0.775	UNSAT TT=0.037 ASSIGNMENTS=127 CHECKS=45334	UNSAT TT=0.035 ASSIGNMENTS=38 CHECKS=32226	UNSAT TT=1.782	UNSAT TT=0.139 ASSIGNMENTS=192 CHECKS=94987	UNSAT TT=1.009	UNSAT TT=1.015
csp/jnhUnsat/ normalized-jnh215_ext.xml	UNSAT TT=0.036	UNSAT TT=1.308 CHECKS=13766 NODES=340	UNSAT TT=1.279 CHECKS=20743 NODES=462	UNSAT TT=0.253	UNSAT TT=0.113 CHECKS=50556	UNSAT TT=0.061 CHECKS=45694	UNSAT TT=1.339 ASSIGNMENTS=57	UNSAT TT=1.126 ASSIGNMENTS=11	UNSAT TT=0.795 CHECKS=54326 NODES=48	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.048 ASSIGNMENTS=44 CHECKS=34940	UNSAT TT=0.046 ASSIGNMENTS=44 CHECKS=34940	UNSAT TT=4.133	UNSAT TT=4.027	UNSAT TT=0.502 CHECKS=23878	UNSAT TT=0.04 ASSIGNMENTS=85 CHECKS=69855	UNSAT TT=0.14 ASSIGNMENTS=1600 CHECKS=725167	UNSAT TT=0.699	UNSAT TT=0.045 ASSIGNMENTS=225 CHECKS=101877	UNSAT TT=0.036 ASSIGNMENTS=44 CHECKS=34940	UNSAT TT=1.667	UNSAT TT=0.155 ASSIGNMENTS=237 CHECKS=187196	UNSAT TT=1.304	UNSAT TT=1.016
csp/jnhUnsat/ normalized-jnh216_ext.xml	UNSAT TT=0.043	UNSAT TT=1.277 CHECKS=24390 NODES=691	UNSAT TT=1.254 CHECKS=25895 NODES=685	UNSAT TT=0.221	UNSAT TT=32.34 CHECKS=25177600	UNSAT TT=0.105 CHECKS=113204	UNSAT TT=1.361 ASSIGNMENTS=110	UNSAT TT=1.243 ASSIGNMENTS=69	UNSAT TT=0.984 CHECKS=137369 NODES=125	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.058 ASSIGNMENTS=102 CHECKS=89073	UNSAT TT=0.057 ASSIGNMENTS=102 CHECKS=89073	UNSAT TT=3.99	UNSAT TT=4.925	UNSAT TT=0.575 CHECKS=63985	UNSAT TT=0.046 ASSIGNMENTS=129 CHECKS=110696	UNSAT TT=0.326 ASSIGNMENTS=3795 CHECKS=1807000	UNSAT TT=0.878	UNSAT TT=0.043 ASSIGNMENTS=153 CHECKS=75599	UNSAT TT=0.043 ASSIGNMENTS=102 CHECKS=89073	UNSAT TT=1.769	UNSAT TT=0.314 ASSIGNMENTS=547 CHECKS=343587	UNSAT TT=1.212	UNSAT TT=1.064
csp/jnhUnsat/ normalized-jnh219_ext.xml	UNSAT TT=0.034	UNSAT TT=1.107 CHECKS=8788 NODES=217	UNSAT TT=1.198 CHECKS=11123 NODES=225	UNSAT TT=0.198	UNSAT TT=0.162 CHECKS=66908	UNSAT TT=0.084 CHECKS=83245	UNSAT TT=1.192 ASSIGNMENTS=44	UNSAT TT=1.266 ASSIGNMENTS=30	UNSAT TT=1.146 CHECKS=266407 NODES=242	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=0.045 ASSIGNMENTS=44 CHECKS=39871	UNSAT TT=0.048 ASSIGNMENTS=44 CHECKS=39871	UNSAT TT=4.047	UNSAT TT=4.728	UNSAT TT=0.638 CHECKS=26698	UNSAT TT=0.039 ASSIGNMENTS=53 CHECKS=46395	UNSAT TT=0.305 ASSIGNMENTS=3980 CHECKS=1922970	UNSAT TT=0.964	UNSAT TT=0.039 ASSIGNMENTS=133 CHECKS=58625	UNSAT TT=0.034 ASSIGNMENTS=44 CHECKS=39871	UNSAT TT=1.837	UNSAT TT=0.295 ASSIGNMENTS=688 CHECKS=396942	UNSAT TT=1.08	UNSAT TT=0.98
csp/jnhUnsat/ normalized-jnh302_ext.xml	UNSAT TT=0.032	UNSAT TT=1.011 CHECKS=162 NODES=0	UNSAT TT=1.023 CHECKS=162 NODES=0	UNSAT TT=0.18	UNSAT TT=0.049 CHECKS=2146	UNSAT TT=0.046 CHECKS=2146	UNSAT TT=0.651 ASSIGNMENTS=0	UNSAT TT=0.705 ASSIGNMENTS=0	UNSAT TT=0.691 CHECKS=6021 NODES=0	UNSAT TT=0.799 CHECKS=7728 NODES=0	UNSAT TT=0.965 CHECKS=7728 NODES=0	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=5.073	UNSAT TT=5.294	UNSAT TT=0.553 CHECKS=7934	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.877	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=1.715	UNSAT TT=0.12 ASSIGNMENTS=141 CHECKS=159031	UNSAT TT=1.039	UNSAT TT=1.261
csp/jnhUnsat/ normalized-jnh303_ext.xml	UNSAT TT=0.042	UNSAT TT=1.209 CHECKS=15300 NODES=437	UNSAT TT=1.271 CHECKS=17359 NODES=406	UNSAT TT=0.239	UNSAT TT=0.195 CHECKS=99729	UNSAT TT=0.108 CHECKS=115750	UNSAT TT=1.506 ASSIGNMENTS=69	UNSAT TT=1.37 ASSIGNMENTS=29	UNSAT TT=0.917 CHECKS=131812 NODES=106	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=0.055 ASSIGNMENTS=97 CHECKS=70423	UNSAT TT=0.056 ASSIGNMENTS=97 CHECKS=70423	UNSAT TT=4.498	UNSAT TT=4.883	UNSAT TT=0.781 CHECKS=21767	UNSAT TT=0.044 ASSIGNMENTS=69 CHECKS=62646	UNSAT TT=0.366 ASSIGNMENTS=3774 CHECKS=2269940	UNSAT TT=0.856	UNSAT TT=0.044 ASSIGNMENTS=146 CHECKS=83588	UNSAT TT=0.042 ASSIGNMENTS=97 CHECKS=70423	UNSAT TT=1.82	UNSAT TT=0.297 ASSIGNMENTS=371 CHECKS=249415	UNSAT TT=0.973	UNSAT TT=1.044
csp/jnhUnsat/ normalized-jnh304_ext.xml	UNSAT TT=0.036	UNSAT TT=1.24 CHECKS=10982 NODES=268	UNSAT TT=1.1 CHECKS=3036 NODES=0	UNSAT TT=0.272	UNSAT TT=0.062 CHECKS=9940	UNSAT TT=0.048 CHECKS=6569	UNSAT TT=0.685 ASSIGNMENTS=0	UNSAT TT=0.701 ASSIGNMENTS=0	UNSAT TT=0.719 CHECKS=21410 NODES=10	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.048 ASSIGNMENTS=17 CHECKS=16169	UNSAT TT=0.048 ASSIGNMENTS=17 CHECKS=16169	UNSAT TT=4.432	UNSAT TT=4.528	UNSAT TT=0.531 CHECKS=12509	UNSAT TT=0.038 ASSIGNMENTS=36 CHECKS=29884	UNSAT TT=0.047 ASSIGNMENTS=180 CHECKS=112593	UNSAT TT=0.682	UNSAT TT=0.036 ASSIGNMENTS=92 CHECKS=25652	UNSAT TT=0.036 ASSIGNMENTS=17 CHECKS=16169	UNSAT TT=1.729	UNSAT TT=0.114 ASSIGNMENTS=173 CHECKS=144889	UNSAT TT=1.249	UNSAT TT=1.048
csp/jnhUnsat/ normalized-jnh305_ext.xml	UNSAT TT=0.035	UNSAT TT=1.068 CHECKS=3676 NODES=83	UNSAT TT=1.157 CHECKS=5483 NODES=84	UNSAT TT=0.186	UNSAT TT=0.101 CHECKS=34303	UNSAT TT=0.065 CHECKS=45175	UNSAT TT=0.894 ASSIGNMENTS=0	UNSAT TT=1.024 ASSIGNMENTS=0	UNSAT TT=0.758 CHECKS=27202 NODES=25	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.045 ASSIGNMENTS=12 CHECKS=15011	UNSAT TT=0.046 ASSIGNMENTS=12 CHECKS=15011	UNSAT TT=5.03	UNSAT TT=5.058	UNSAT TT=0.708 CHECKS=12489	UNSAT TT=0.035 ASSIGNMENTS=10 CHECKS=14371	UNSAT TT=0.071 ASSIGNMENTS=376 CHECKS=259006	UNSAT TT=0.936	UNSAT TT=0.037 ASSIGNMENTS=67 CHECKS=37051	UNSAT TT=0.035 ASSIGNMENTS=12 CHECKS=15011	UNSAT TT=1.807	UNSAT TT=0.121 ASSIGNMENTS=184 CHECKS=155306	UNSAT TT=1.028	UNSAT TT=1.194
csp/jnhUnsat/ normalized-jnh306_ext.xml	UNSAT TT=0.068	UNSAT TT=2 CHECKS=148016 NODES=2759	UNSAT TT=2.026 CHECKS=134157 NODES=2445	UNSAT TT=1.244	UNSAT TT=1.857 CHECKS=899573	UNSAT TT=0.813 CHECKS=1196730	UNSAT TT=2.991 ASSIGNMENTS=472	UNSAT TT=2.076 ASSIGNMENTS=260	UNSAT TT=3.178 CHECKS=1212120 NODES=952	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=0.075 ASSIGNMENTS=282 CHECKS=252095	UNSAT TT=0.076 ASSIGNMENTS=282 CHECKS=252095	UNSAT TT=4.615	UNSAT TT=4.235	UNSAT TT=1.11 CHECKS=132359	UNSAT TT=0.09 ASSIGNMENTS=435 CHECKS=403019	UNSAT TT=0.35 ASSIGNMENTS=4074 CHECKS=2275400	UNSAT TT=1.306	UNSAT TT=0.068 ASSIGNMENTS=307 CHECKS=217589	UNSAT TT=0.07 ASSIGNMENTS=282 CHECKS=252095	UNSAT TT=2.138	UNSAT TT=1.172 ASSIGNMENTS=1746 CHECKS=1354690	UNSAT TT=1.146	UNSAT TT=1.002
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhUnsat/ normalized-jnh307_ext.xml	UNSAT TT=0.033	UNSAT TT=1.024 CHECKS=890 NODES=36	UNSAT TT=1.091 CHECKS=529 NODES=0	UNSAT TT=0.17	UNSAT TT=0.053 CHECKS=2811	UNSAT TT=0.047 CHECKS=2811	UNSAT TT=0.822 ASSIGNMENTS=0	UNSAT TT=0.78 ASSIGNMENTS=0	UNSAT TT=0.718 CHECKS=8404 NODES=1	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.047 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=0.044 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=4.242	UNSAT TT=4.336	UNSAT TT=0.623 CHECKS=10100	UNSAT TT=0.033 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=0.035 ASSIGNMENTS=1 CHECKS=3843	UNSAT TT=0.662	UNSAT TT=0.035 ASSIGNMENTS=4 CHECKS=4618	UNSAT TT=0.033 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=1.738	UNSAT TT=0.137 ASSIGNMENTS=129 CHECKS=77539	UNSAT TT=1.031	UNSAT TT=1.555
csp/jnhUnsat/ normalized-jnh309_ext.xml	UNSAT TT=0.035	UNSAT TT=1.198 CHECKS=8979 NODES=193	UNSAT TT=1.117 CHECKS=2007 NODES=0	UNSAT TT=0.21	UNSAT TT=0.071 CHECKS=12234	UNSAT TT=0.052 CHECKS=14749	UNSAT TT=0.968 ASSIGNMENTS=0	UNSAT TT=0.823 ASSIGNMENTS=0	UNSAT TT=0.885 CHECKS=36625 NODES=26	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=0.05 ASSIGNMENTS=16 CHECKS=16323	UNSAT TT=0.049 ASSIGNMENTS=16 CHECKS=16323	UNSAT TT=4.966	UNSAT TT=4.268	UNSAT TT=0.55 CHECKS=25571	UNSAT TT=0.035 ASSIGNMENTS=21 CHECKS=23048	UNSAT TT=0.079 ASSIGNMENTS=460 CHECKS=286282	UNSAT TT=0.747	UNSAT TT=0.039 ASSIGNMENTS=33 CHECKS=21557	UNSAT TT=0.035 ASSIGNMENTS=16 CHECKS=16323	UNSAT TT=1.687	UNSAT TT=0.155 ASSIGNMENTS=129 CHECKS=88276	UNSAT TT=1.195	UNSAT TT=1.055
csp/jnhUnsat/ normalized-jnh310_ext.xml	UNSAT TT=0.034	UNSAT TT=1.058 CHECKS=301 NODES=15	UNSAT TT=1.015 CHECKS=183 NODES=0	UNSAT TT=0.184	UNSAT TT=0.056 CHECKS=4182	UNSAT TT=0.043 CHECKS=3728	UNSAT TT=0.885 ASSIGNMENTS=0	UNSAT TT=0.761 ASSIGNMENTS=0	UNSAT TT=0.727 CHECKS=14626 NODES=13	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.044 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=0.047 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=4.555	UNSAT TT=5.223	UNSAT TT=0.54 CHECKS=2313	UNSAT TT=0.034 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=0.059 ASSIGNMENTS=340 CHECKS=188119	UNSAT TT=0.655	UNSAT TT=0.035 ASSIGNMENTS=38 CHECKS=11240	UNSAT TT=0.036 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=1.748	UNSAT TT=0.08 ASSIGNMENTS=36 CHECKS=30532	UNSAT TT=1.039	UNSAT TT=1.276
csp/lexVg/ normalized-crossword-m1c-lex-vg10-11_ext.xml	UNSAT TT=1.55	UNSAT TT=1.701 CHECKS=0 NODES=221	UNSAT TT=3.236 CHECKS=0 NODES=209	? (TO) TT=1800.09	UNSAT TT=41.101 CHECKS=112511	UNSAT TT=17.807 CHECKS=43417	UNSAT TT=20.787 ASSIGNMENTS=0	UNSAT TT=22.258 ASSIGNMENTS=0	UNSAT TT=2.762 CHECKS=0 NODES=368	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=9.329 ASSIGNMENTS=221 CHECKS=0	UNSAT TT=9.026 ASSIGNMENTS=221 CHECKS=0	UNSAT TT=64.248	UNSAT TT=51.21	UNSAT TT=4.342 CHECKS=36205	UNSAT TT=1.55 ASSIGNMENTS=206 CHECKS=41245	UNSAT TT=18.017 ASSIGNMENTS=3472 CHECKS=462122	UNSAT TT=14.413	UNSAT TT=7.462 ASSIGNMENTS=1645 CHECKS=197688	UNSAT TT=1.631 ASSIGNMENTS=238 CHECKS=43669	? TT=31.591	? (TO) TT=1800.08	UNSAT TT=181.014	? (TO) TT=1800
csp/lexVg/ normalized-crossword-m1c-lex-vg10-12_ext.xml	UNSAT TT=0.371	UNSAT TT=0.943 CHECKS=0 NODES=58	UNSAT TT=1.906 CHECKS=0 NODES=0	? (TO) TT=1800.08	UNSAT TT=9.712 CHECKS=26649	UNSAT TT=8.838 CHECKS=24132	UNSAT TT=4.181 ASSIGNMENTS=0	UNSAT TT=4.548 ASSIGNMENTS=0	UNSAT TT=1.055 CHECKS=0 NODES=74	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=0.421 ASSIGNMENTS=60 CHECKS=9481	UNSAT TT=0.422 ASSIGNMENTS=60 CHECKS=9481	UNSAT TT=34.658	UNSAT TT=27.653	UNSAT TT=0.957 CHECKS=6723	UNSAT TT=0.4 ASSIGNMENTS=60 CHECKS=9433	UNSAT TT=15.501 ASSIGNMENTS=3172 CHECKS=436031	UNSAT TT=7.774	UNSAT TT=1.35 ASSIGNMENTS=279 CHECKS=37352	UNSAT TT=0.371 ASSIGNMENTS=60 CHECKS=9481	? TT=32.877	? (TO) TT=1800.11	UNSAT TT=88.589	UNSAT TT=149.832
csp/lexVg/ normalized-crossword-m1c-lex-vg11-12_ext.xml	UNSAT TT=0.214	UNSAT TT=0.836 CHECKS=0 NODES=23	UNSAT TT=0.877 CHECKS=0 NODES=0	? (TO) TT=1800.14	UNSAT TT=3.369 CHECKS=9260	UNSAT TT=3.622 CHECKS=9134	UNSAT TT=1.993 ASSIGNMENTS=0	UNSAT TT=2.337 ASSIGNMENTS=0	UNSAT TT=0.81 CHECKS=0 NODES=27	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.36 ASSIGNMENTS=40 CHECKS=8217	UNSAT TT=0.338 ASSIGNMENTS=40 CHECKS=8217	UNSAT TT=19.154	UNSAT TT=14.674	UNSAT TT=0.378 CHECKS=2811	UNSAT TT=0.214 ASSIGNMENTS=29 CHECKS=5256	UNSAT TT=1.682 ASSIGNMENTS=343 CHECKS=45212	UNSAT TT=2.263	UNSAT TT=0.422 ASSIGNMENTS=72 CHECKS=10791	UNSAT TT=0.32 ASSIGNMENTS=40 CHECKS=8217	? TT=32.237	? (TO) TT=1800.02	UNSAT TT=51.717	UNSAT TT=60.992
csp/lexVg/ normalized-crossword-m1c-lex-vg11-13_ext.xml	UNSAT TT=0.09	UNSAT TT=0.776 CHECKS=0 NODES=7	UNSAT TT=0.829 CHECKS=0 NODES=0	UNSAT TT=223.836	UNSAT TT=0.656 CHECKS=1168	UNSAT TT=0.883 CHECKS=1644	UNSAT TT=0.792 ASSIGNMENTS=0	UNSAT TT=0.698 ASSIGNMENTS=0	UNSAT TT=0.542 CHECKS=0 NODES=7	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.096 ASSIGNMENTS=6 CHECKS=1652	UNSAT TT=0.1 ASSIGNMENTS=6 CHECKS=1652	UNSAT TT=14.086	UNSAT TT=10.75	UNSAT TT=0.175 CHECKS=967	UNSAT TT=0.09 ASSIGNMENTS=6 CHECKS=1652	UNSAT TT=0.118 ASSIGNMENTS=15 CHECKS=2242	UNSAT TT=1.197	UNSAT TT=0.114 ASSIGNMENTS=15 CHECKS=2098	UNSAT TT=0.09 ASSIGNMENTS=6 CHECKS=1652	? TT=33.724	? (TO) TT=1800.01	UNSAT TT=35.674	UNSAT TT=575.879
csp/lexVg/ normalized-crossword-m1c-lex-vg11-15_ext.xml	UNSAT TT=0.019	UNSAT TT=0.741 CHECKS=0 NODES=0	UNSAT TT=0.795 CHECKS=0 NODES=0	UNSAT TT=20.418	UNSAT TT=0.248 CHECKS=41	UNSAT TT=0.243 CHECKS=41	UNSAT TT=0.481 ASSIGNMENTS=0	UNSAT TT=0.456 ASSIGNMENTS=0	UNSAT TT=0.467 CHECKS=0 NODES=0	UNSAT TT=0.453 CHECKS=0 NODES=0	UNSAT TT=0.431 CHECKS=0 NODES=0	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=11.872	UNSAT TT=9.553	UNSAT TT=0.06 CHECKS=151	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=1.053	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=12	? TT=34.5	? (TO) TT=1800.08	UNSAT TT=34.783	UNSAT TT=47.764
csp/lexVg/ normalized-crossword-m1c-lex-vg12-12_ext.xml	UNSAT TT=0.085	UNSAT TT=0.835 CHECKS=0 NODES=8	UNSAT TT=0.786 CHECKS=0 NODES=0	UNSAT TT=279.771	UNSAT TT=1.212 CHECKS=3480	UNSAT TT=1.121 CHECKS=3878	UNSAT TT=0.88 ASSIGNMENTS=0	UNSAT TT=0.967 ASSIGNMENTS=0	UNSAT TT=0.499 CHECKS=0 NODES=11	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.104 ASSIGNMENTS=11 CHECKS=1916	UNSAT TT=0.103 ASSIGNMENTS=11 CHECKS=1916	UNSAT TT=12.92	UNSAT TT=10.64	UNSAT TT=0.121 CHECKS=1037	UNSAT TT=0.085 ASSIGNMENTS=8 CHECKS=1469	UNSAT TT=0.221 ASSIGNMENTS=38 CHECKS=4969	UNSAT TT=1.154	UNSAT TT=0.153 ASSIGNMENTS=20 CHECKS=3565	UNSAT TT=0.094 ASSIGNMENTS=11 CHECKS=1916	? TT=57.464	? (TO) TT=1800.05	UNSAT TT=38.436	? (TO) TT=1800.04
csp/lexVg/ normalized-crossword-m1c-lex-vg12-13_ext.xml	UNSAT TT=0.031	UNSAT TT=0.754 CHECKS=0 NODES=0	UNSAT TT=0.788 CHECKS=0 NODES=0	UNSAT TT=122.654	UNSAT TT=0.192 CHECKS=66	UNSAT TT=0.187 CHECKS=66	UNSAT TT=0.613 ASSIGNMENTS=0	UNSAT TT=0.575 ASSIGNMENTS=0	UNSAT TT=0.605 CHECKS=0 NODES=0	UNSAT TT=0.453 CHECKS=0 NODES=0	UNSAT TT=0.629 CHECKS=0 NODES=0	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=10.486	UNSAT TT=8.251	UNSAT TT=0.054 CHECKS=223	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=1.028	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=104	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=104	? TT=54.929	? (TO) TT=1800.05	UNSAT TT=21.316	UNSAT TT=287.535
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg12-14_ext.xml	UNSAT TT=0.027	UNSAT TT=0.793 CHECKS=0 NODES=0	UNSAT TT=0.91 CHECKS=0 NODES=0	UNSAT TT=52.102	UNSAT TT=0.172 CHECKS=51	UNSAT TT=0.173 CHECKS=51	UNSAT TT=0.48 ASSIGNMENTS=0	UNSAT TT=0.549 ASSIGNMENTS=0	UNSAT TT=0.517 CHECKS=0 NODES=0	UNSAT TT=0.447 CHECKS=0 NODES=0	UNSAT TT=0.437 CHECKS=0 NODES=0	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=8.512	UNSAT TT=7.711	UNSAT TT=0.044 CHECKS=159	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.846	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=55	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=55	? TT=53.509	? (TO) TT=1800.04	UNSAT TT=18.139	UNSAT TT=39.923
csp/lexVg/ normalized-crossword-m1c-lex-vg13-13_ext.xml	UNSAT TT=0.026	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=0.762 CHECKS=0 NODES=0	UNSAT TT=66.948	UNSAT TT=0.168 CHECKS=82	UNSAT TT=0.168 CHECKS=82	UNSAT TT=0.442 ASSIGNMENTS=0	UNSAT TT=0.47 ASSIGNMENTS=0	UNSAT TT=0.386 CHECKS=0 NODES=0	UNSAT TT=0.393 CHECKS=0 NODES=0	UNSAT TT=0.439 CHECKS=0 NODES=0	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=7.706	UNSAT TT=6.444	UNSAT TT=0.034 CHECKS=218	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.719	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=53	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=53	? TT=53.693	? (TO) TT=1800.08	UNSAT TT=13.599	UNSAT TT=42.119
csp/lexVg/ normalized-crossword-m1c-lex-vg13-15_ext.xml	UNSAT TT=0.019	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=0.743 CHECKS=0 NODES=0	UNSAT TT=8.3	UNSAT TT=0.085 CHECKS=29	UNSAT TT=0.085 CHECKS=29	UNSAT TT=0.53 ASSIGNMENTS=0	UNSAT TT=0.53 ASSIGNMENTS=0	UNSAT TT=0.423 CHECKS=0 NODES=0	UNSAT TT=0.422 CHECKS=0 NODES=0	UNSAT TT=0.419 CHECKS=0 NODES=0	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=6.26	UNSAT TT=5.443	UNSAT TT=0.032 CHECKS=65	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.623	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=14	? TT=51.591	? (TO) TT=1800.07	UNSAT TT=7.693	UNSAT TT=12.517
csp/lexVg/ normalized-crossword-m1c-lex-vg13-16_ext.xml	UNSAT TT=0.017	UNSAT TT=0.723 CHECKS=0 NODES=0	UNSAT TT=0.8 CHECKS=0 NODES=0	UNSAT TT=8.962	UNSAT TT=0.087 CHECKS=29	UNSAT TT=0.085 CHECKS=29	UNSAT TT=0.48 ASSIGNMENTS=0	UNSAT TT=0.433 ASSIGNMENTS=0	UNSAT TT=0.378 CHECKS=0 NODES=0	UNSAT TT=0.377 CHECKS=0 NODES=0	UNSAT TT=0.376 CHECKS=0 NODES=0	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=5.637	UNSAT TT=5.237	UNSAT TT=0.026 CHECKS=82	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.629	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=14	? TT=62.107	? (TO) TT=1800.04	UNSAT TT=7.926	UNSAT TT=12.638
csp/lexVg/ normalized-crossword-m1c-lex-vg13-17_ext.xml	UNSAT TT=0.016	UNSAT TT=0.771 CHECKS=0 NODES=0	UNSAT TT=0.765 CHECKS=0 NODES=0	UNSAT TT=6.71	UNSAT TT=0.09 CHECKS=30	UNSAT TT=0.084 CHECKS=30	UNSAT TT=0.455 ASSIGNMENTS=0	UNSAT TT=0.427 ASSIGNMENTS=0	UNSAT TT=0.402 CHECKS=0 NODES=0	UNSAT TT=0.374 CHECKS=0 NODES=0	UNSAT TT=0.492 CHECKS=0 NODES=0	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=5.989	UNSAT TT=5.188	UNSAT TT=0.025 CHECKS=55	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.599	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=14	? TT=57.387	? (TO) TT=1800.03	UNSAT TT=8.143	UNSAT TT=11.668
csp/lexVg/ normalized-crossword-m1c-lex-vg14-15_ext.xml	UNSAT TT=0.019	UNSAT TT=0.75 CHECKS=0 NODES=0	UNSAT TT=0.793 CHECKS=0 NODES=0	UNSAT TT=4.283	UNSAT TT=0.056 CHECKS=29	UNSAT TT=0.056 CHECKS=29	UNSAT TT=0.471 ASSIGNMENTS=0	UNSAT TT=0.566 ASSIGNMENTS=0	UNSAT TT=0.455 CHECKS=0 NODES=0	UNSAT TT=0.376 CHECKS=0 NODES=0	UNSAT TT=0.392 CHECKS=0 NODES=0	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=4.316	UNSAT TT=4.034	UNSAT TT=0.025 CHECKS=98	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.547	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=15	? (exit code) TT=88.171	? (TO) TT=1800.11	UNSAT TT=5.422	UNSAT TT=6.838
csp/lexVg/ normalized-crossword-m1c-lex-vg14-18_ext.xml	UNSAT TT=0.015	UNSAT TT=0.973 CHECKS=0 NODES=0	UNSAT TT=0.846 CHECKS=0 NODES=0	UNSAT TT=4.796	UNSAT TT=0.061 CHECKS=19	UNSAT TT=0.06 CHECKS=19	UNSAT TT=0.428 ASSIGNMENTS=0	UNSAT TT=0.464 ASSIGNMENTS=0	UNSAT TT=0.421 CHECKS=0 NODES=0	UNSAT TT=0.471 CHECKS=0 NODES=0	UNSAT TT=0.386 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=4.282	UNSAT TT=4.096	UNSAT TT=0.025 CHECKS=30	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.513	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=15	? TT=101.027	? (TO) TT=1800.08	UNSAT TT=4.127	UNSAT TT=6.515
csp/lexVg/ normalized-crossword-m1c-lex-vg15-16_ext.xml	UNSAT TT=0.019	UNSAT TT=0.792 CHECKS=0 NODES=0	UNSAT TT=0.797 CHECKS=0 NODES=0	UNSAT TT=1.342	UNSAT TT=0.034 CHECKS=17	UNSAT TT=0.034 CHECKS=17	UNSAT TT=0.422 ASSIGNMENTS=0	UNSAT TT=0.46 ASSIGNMENTS=0	UNSAT TT=0.371 CHECKS=0 NODES=0	UNSAT TT=0.366 CHECKS=0 NODES=0	UNSAT TT=0.381 CHECKS=0 NODES=0	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=3.638	UNSAT TT=3.334	UNSAT TT=0.023 CHECKS=50	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.476	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=16	? (exit code) TT=82.514	? (TO) TT=1800.02	UNSAT TT=2.36	UNSAT TT=3.774
csp/lexVg/ normalized-crossword-m1c-lex-vg15-17_ext.xml	UNSAT TT=0.016	UNSAT TT=0.748 CHECKS=0 NODES=0	UNSAT TT=0.731 CHECKS=0 NODES=0	UNSAT TT=1.411	UNSAT TT=0.031 CHECKS=18	UNSAT TT=0.029 CHECKS=18	UNSAT TT=0.481 ASSIGNMENTS=0	UNSAT TT=0.443 ASSIGNMENTS=0	UNSAT TT=0.375 CHECKS=0 NODES=0	UNSAT TT=0.359 CHECKS=0 NODES=0	UNSAT TT=0.371 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=3.47	UNSAT TT=2.961	UNSAT TT=0.021 CHECKS=24	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.423	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	? TT=81.753	? (TO) TT=1800.02	UNSAT TT=2.196	UNSAT TT=3.076
csp/lexVg/ normalized-crossword-m1c-lex-vg15-18_ext.xml	UNSAT TT=0.014	UNSAT TT=0.727 CHECKS=0 NODES=0	UNSAT TT=0.832 CHECKS=0 NODES=0	UNSAT TT=1.397	UNSAT TT=0.034 CHECKS=19	UNSAT TT=0.032 CHECKS=19	UNSAT TT=0.43 ASSIGNMENTS=0	UNSAT TT=0.467 ASSIGNMENTS=0	UNSAT TT=0.401 CHECKS=0 NODES=0	UNSAT TT=0.363 CHECKS=0 NODES=0	UNSAT TT=0.347 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=3.505	UNSAT TT=3.147	UNSAT TT=0.024 CHECKS=18	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.428	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=16	? TT=85.732	? (TO) TT=1800.04	UNSAT TT=2.01	UNSAT TT=3.077
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg16-18_ext.xml	UNSAT TT=0.016	UNSAT TT=0.79 CHECKS=0 NODES=0	UNSAT TT=0.766 CHECKS=0 NODES=0	UNSAT TT=0.605	UNSAT TT=0.025 CHECKS=19	UNSAT TT=0.025 CHECKS=19	UNSAT TT=0.454 ASSIGNMENTS=0	UNSAT TT=0.444 ASSIGNMENTS=0	UNSAT TT=0.415 CHECKS=0 NODES=0	UNSAT TT=0.375 CHECKS=0 NODES=0	UNSAT TT=0.375 CHECKS=0 NODES=0	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=3.32	UNSAT TT=2.936	UNSAT TT=0.021 CHECKS=5	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.427	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=17	? (exit code) TT=78.15	? (TO) TT=1800.05	UNSAT TT=1.696	UNSAT TT=2.085
csp/lexVg/ normalized-crossword-m1c-lex-vg16-20_ext.xml	UNSAT TT=0.014	UNSAT TT=0.804 CHECKS=0 NODES=0	UNSAT TT=0.768 CHECKS=0 NODES=0	UNSAT TT=0.713	UNSAT TT=0.038 CHECKS=45	UNSAT TT=0.035 CHECKS=45	UNSAT TT=0.496 ASSIGNMENTS=0	UNSAT TT=0.479 ASSIGNMENTS=0	UNSAT TT=0.449 CHECKS=0 NODES=0	UNSAT TT=0.388 CHECKS=0 NODES=0	UNSAT TT=0.383 CHECKS=0 NODES=0	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=3.297	UNSAT TT=3.091	UNSAT TT=0.024 CHECKS=6	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.432	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=17	? TT=99.572	? (TO) TT=1800.05	UNSAT TT=1.466	UNSAT TT=2.051
csp/lexVg/ normalized-crossword-m1c-lex-vg4-5_ext.xml	SAT TT=0.017	SAT TT=0.731 CHECKS=34 NODES=28	SAT TT=0.743 CHECKS=9 NODES=21	SAT TT=2.39	SAT TT=0.247 CHECKS=601	SAT TT=0.191 CHECKS=446	SAT TT=0.906 ASSIGNMENTS=11	SAT TT=0.952 ASSIGNMENTS=10	SAT TT=16.223 CHECKS=11747400 NODES=22	SAT TT=1386.18 CHECKS=8572600000 NODES=-33934500	? (TO) TT=1800.1	SAT TT=0.03 ASSIGNMENTS=7 CHECKS=192	SAT TT=0.03 ASSIGNMENTS=7 CHECKS=192	SAT TT=12.305	SAT TT=15.472	SAT TT=0.036 CHECKS=101	SAT TT=0.018 ASSIGNMENTS=7 CHECKS=192	SAT TT=0.021 ASSIGNMENTS=13 CHECKS=466	SAT TT=0.59	SAT TT=0.032 ASSIGNMENTS=55 CHECKS=1527	SAT TT=0.017 ASSIGNMENTS=7 CHECKS=192	? (MO) TT=33.132	SAT TT=0.489 ASSIGNMENTS=28 CHECKS=2552530	SAT TT=4.352	SAT TT=4.706
csp/lexVg/ normalized-crossword-m1c-lex-vg4-6_ext.xml	SAT TT=0.048	SAT TT=0.899 CHECKS=101 NODES=156	SAT TT=0.862 CHECKS=126 NODES=148	SAT TT=2.814	SAT TT=4.063 CHECKS=28721	SAT TT=0.533 CHECKS=2652	SAT TT=1.382 ASSIGNMENTS=28	SAT TT=1.266 ASSIGNMENTS=11	SAT TT=143.507 CHECKS=395229000 NODES=31	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=0.283 ASSIGNMENTS=359 CHECKS=17565	SAT TT=0.302 ASSIGNMENTS=359 CHECKS=17565	SAT TT=11.639	SAT TT=117.246	SAT TT=0.048 CHECKS=218	SAT TT=0.215 ASSIGNMENTS=233 CHECKS=12157	SAT TT=0.077 ASSIGNMENTS=85 CHECKS=3461	SAT TT=0.749	SAT TT=0.395 ASSIGNMENTS=568 CHECKS=22976	SAT TT=0.288 ASSIGNMENTS=359 CHECKS=17565	? TT=89.73	SAT TT=0.511 ASSIGNMENTS=43 CHECKS=767573	SAT TT=10.841	SAT TT=18.813
csp/lexVg/ normalized-crossword-m1c-lex-vg4-8_ext.xml	SAT TT=6	SAT TT=7.02 CHECKS=17728 NODES=12539	SAT TT=8.65 CHECKS=21002 NODES=14447	? (TO) TT=1800.09	SAT TT=103.668 CHECKS=435754	SAT TT=442.774 CHECKS=2678410	SAT TT=156.672 ASSIGNMENTS=18790	SAT TT=43.101 ASSIGNMENTS=3021	SAT TT=6 CHECKS=62294500 NODES=2113	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=13.961 ASSIGNMENTS=12539 CHECKS=17728	SAT TT=14.033 ASSIGNMENTS=12539 CHECKS=17728	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=27.041 CHECKS=1314950	SAT TT=13.482 ASSIGNMENTS=8925 CHECKS=712766	SAT TT=10.905 ASSIGNMENTS=7987 CHECKS=576957	SAT TT=31.701	SAT TT=52.702 ASSIGNMENTS=33893 CHECKS=2879500	SAT TT=15.466 ASSIGNMENTS=10304 CHECKS=850296	? TT=89.115	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.14
csp/lexVg/ normalized-crossword-m1c-lex-vg5-5_ext.xml	SAT TT=0.02	SAT TT=0.9 CHECKS=41 NODES=40	SAT TT=0.894 CHECKS=11 NODES=0	SAT TT=3.518	SAT TT=0.396 CHECKS=1194	SAT TT=0.397 CHECKS=1131	SAT TT=1.257 ASSIGNMENTS=13	SAT TT=1.385 ASSIGNMENTS=32	SAT TT=39.172 CHECKS=28272600 NODES=25	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=0.03 ASSIGNMENTS=16 CHECKS=616	SAT TT=0.032 ASSIGNMENTS=16 CHECKS=616	SAT TT=16.753	SAT TT=7.432	SAT TT=0.044 CHECKS=1636	SAT TT=0.02 ASSIGNMENTS=16 CHECKS=572	SAT TT=0.015 ASSIGNMENTS=7 CHECKS=202	SAT TT=0.808	SAT TT=0.036 ASSIGNMENTS=41 CHECKS=1426	SAT TT=0.021 ASSIGNMENTS=16 CHECKS=616	? (MO) TT=33.176	SAT TT=0.965 ASSIGNMENTS=50 CHECKS=5442460	SAT TT=7.881	SAT TT=10.453
csp/lexVg/ normalized-crossword-m1c-lex-vg5-6_ext.xml	SAT TT=5.481	SAT TT=14.966 CHECKS=67154 NODES=34824	SAT TT=7.608 CHECKS=27230 NODES=18004	SAT TT=1434.67	SAT TT=288.28 CHECKS=1413740	SAT TT=511.806 CHECKS=2788560	SAT TT=60.654 ASSIGNMENTS=6073	SAT TT=38.659 ASSIGNMENTS=2881	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=21.738 ASSIGNMENTS=34824 CHECKS=67154	SAT TT=20.968 ASSIGNMENTS=34824 CHECKS=67154	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=5.481 CHECKS=300900	SAT TT=39.486 ASSIGNMENTS=31273 CHECKS=2360280	SAT TT=10.026 ASSIGNMENTS=8886 CHECKS=578393	SAT TT=131.506	SAT TT=24.026 ASSIGNMENTS=18289 CHECKS=1333380	SAT TT=31.575 ASSIGNMENTS=23984 CHECKS=1805910	? (MO) TT=33.896	SAT TT=1169.48 ASSIGNMENTS=919 CHECKS=25025400	SAT TT=388.49	SAT TT=100.415
csp/lexVg/ normalized-crossword-m1c-lex-vg5-7_ext.xml	UNSAT TT=113.01	UNSAT TT=113.01 CHECKS=553586 NODES=217904	UNSAT TT=121.249 CHECKS=555619 NODES=222056	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=1042.07 ASSIGNMENTS=86032	UNSAT TT=1353.24 ASSIGNMENTS=73497	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=116.863 ASSIGNMENTS=217904 CHECKS=553586	UNSAT TT=116.706 ASSIGNMENTS=217904 CHECKS=553586	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=248.753 CHECKS=10004200	UNSAT TT=230.921 ASSIGNMENTS=134726 CHECKS=11781500	UNSAT TT=273.408 ASSIGNMENTS=155190 CHECKS=13480400	UNSAT TT=1468.67	UNSAT TT=294.211 ASSIGNMENTS=162921 CHECKS=14358100	UNSAT TT=275.054 ASSIGNMENTS=149956 CHECKS=13027900	? (MO) TT=36.928	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.13
csp/lexVg/ normalized-crossword-m1c-lex-vg5-8_ext.xml	UNSAT TT=54.047	UNSAT TT=54.047 CHECKS=177197 NODES=79365	UNSAT TT=73.236 CHECKS=192182 NODES=96226	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=463.75 ASSIGNMENTS=37211	UNSAT TT=525.961 ASSIGNMENTS=27337	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=61.254 ASSIGNMENTS=79365 CHECKS=177197	UNSAT TT=61.763 ASSIGNMENTS=79365 CHECKS=177197	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=111.967 CHECKS=4011410	UNSAT TT=149.995 ASSIGNMENTS=66894 CHECKS=6523850	UNSAT TT=128.855 ASSIGNMENTS=59690 CHECKS=5669970	UNSAT TT=785.589	UNSAT TT=132.879 ASSIGNMENTS=59941 CHECKS=5923160	UNSAT TT=141.269 ASSIGNMENTS=68671 CHECKS=6687120	? (MO) TT=31.666	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.11
csp/lexVg/ normalized-crossword-m1c-lex-vg5-9_ext.xml	UNSAT TT=24.422	UNSAT TT=26.015 CHECKS=39642 NODES=26821	UNSAT TT=24.422 CHECKS=45677 NODES=26632	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=681.814 CHECKS=2370920	UNSAT TT=99.853 ASSIGNMENTS=6430	UNSAT TT=227.732 ASSIGNMENTS=9209	UNSAT TT=1471.33 CHECKS=19400100000 NODES=32922	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=31.488 ASSIGNMENTS=26821 CHECKS=39642	UNSAT TT=31.45 ASSIGNMENTS=26821 CHECKS=39642	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=73.371 CHECKS=2175040	UNSAT TT=39.676 ASSIGNMENTS=16104 CHECKS=1751530	UNSAT TT=41.817 ASSIGNMENTS=17833 CHECKS=1817980	UNSAT TT=425.674	UNSAT TT=55.295 ASSIGNMENTS=21432 CHECKS=2264480	UNSAT TT=42.57 ASSIGNMENTS=16042 CHECKS=1744540	? (MO) TT=32.274	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg6-10_ext.xml	UNSAT TT=9.73	UNSAT TT=11.104 CHECKS=8326 NODES=6470	UNSAT TT=9.73 CHECKS=7068 NODES=5945	? (TO) TT=1800.11	UNSAT TT=253.363 CHECKS=685443	UNSAT TT=189.733 CHECKS=560726	UNSAT TT=44.96 ASSIGNMENTS=1818	UNSAT TT=170.455 ASSIGNMENTS=4764	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=18.029 ASSIGNMENTS=6470 CHECKS=8326	UNSAT TT=18.838 ASSIGNMENTS=6470 CHECKS=8326	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=28.994 CHECKS=407705	UNSAT TT=16.8 ASSIGNMENTS=4326 CHECKS=580228	UNSAT TT=25.002 ASSIGNMENTS=7420 CHECKS=832156	UNSAT TT=137.664	UNSAT TT=16.611 ASSIGNMENTS=4523 CHECKS=562966	UNSAT TT=17.585 ASSIGNMENTS=4497 CHECKS=604233	? TT=70.152	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.02
csp/lexVg/ normalized-crossword-m1c-lex-vg6-6_ext.xml	SAT TT=0.038	SAT TT=1.792 CHECKS=1191 NODES=1338	SAT TT=2.302 CHECKS=1818 NODES=1929	? (TO) TT=1800.05	SAT TT=5.758 CHECKS=29328	SAT TT=9.541 CHECKS=51071	SAT TT=13.062 ASSIGNMENTS=741	SAT TT=16.543 ASSIGNMENTS=644	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1.115 ASSIGNMENTS=580 CHECKS=52453	SAT TT=1.13 ASSIGNMENTS=580 CHECKS=52453	SAT TT=468.03	SAT TT=84.71	SAT TT=0.618 CHECKS=24183	SAT TT=9.907 ASSIGNMENTS=5182 CHECKS=487622	SAT TT=5.45 ASSIGNMENTS=3669 CHECKS=220267	SAT TT=25.22	SAT TT=0.038 ASSIGNMENTS=18 CHECKS=1051	SAT TT=1.119 ASSIGNMENTS=580 CHECKS=52453	? TT=81.992	SAT TT=344.255 ASSIGNMENTS=861 CHECKS=692529000	SAT TT=168.793	SAT TT=265.099
csp/lexVg/ normalized-crossword-m1c-lex-vg6-8_ext.xml	UNSAT TT=81.531	UNSAT TT=81.531 CHECKS=184004 NODES=86556	UNSAT TT=85.263 CHECKS=165544 NODES=82937	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=382.009 ASSIGNMENTS=21381	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.1	UNSAT TT=94.433 ASSIGNMENTS=86556 CHECKS=184004	UNSAT TT=88.698 ASSIGNMENTS=86556 CHECKS=184004	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=200.206 CHECKS=4343720	UNSAT TT=139.865 ASSIGNMENTS=48746 CHECKS=5602740	UNSAT TT=144.642 ASSIGNMENTS=50798 CHECKS=5777040	UNSAT TT=1588.24	UNSAT TT=155.979 ASSIGNMENTS=50043 CHECKS=5808880	UNSAT TT=147.117 ASSIGNMENTS=50737 CHECKS=5833450	? TT=76.066	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09
csp/lexVg/ normalized-crossword-m1c-lex-vg6-9_ext.xml	UNSAT TT=28.952	UNSAT TT=39.342 CHECKS=56094 NODES=28413	UNSAT TT=28.952 CHECKS=39520 NODES=20961	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=803.118 CHECKS=2408340	UNSAT TT=166.768 ASSIGNMENTS=8020	UNSAT TT=851.778 ASSIGNMENTS=25462	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=43.435 ASSIGNMENTS=28413 CHECKS=56094	UNSAT TT=43.196 ASSIGNMENTS=28413 CHECKS=56094	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=93.842 CHECKS=1681860	UNSAT TT=64.502 ASSIGNMENTS=17705 CHECKS=2225640	UNSAT TT=55.206 ASSIGNMENTS=16800 CHECKS=2007220	UNSAT TT=620.48	UNSAT TT=46.203 ASSIGNMENTS=12884 CHECKS=1590250	UNSAT TT=58.808 ASSIGNMENTS=15940 CHECKS=2046330	? TT=77.226	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04
csp/lexVg/ normalized-crossword-m1c-lex-vg7-10_ext.xml	UNSAT TT=10.191	UNSAT TT=10.191 CHECKS=2573 NODES=5081	UNSAT TT=10.815 CHECKS=4929 NODES=5427	? (TO) TT=1800.03	UNSAT TT=321.609 CHECKS=778394	UNSAT TT=204.588 CHECKS=469694	UNSAT TT=34.439 ASSIGNMENTS=885	UNSAT TT=135.204 ASSIGNMENTS=3112	UNSAT TT=20.883 CHECKS=0 NODES=5397	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=16.559 ASSIGNMENTS=5081 CHECKS=2573	UNSAT TT=17.843 ASSIGNMENTS=5081 CHECKS=2573	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=66.523 CHECKS=802216	UNSAT TT=19.345 ASSIGNMENTS=3904 CHECKS=593591	UNSAT TT=27.061 ASSIGNMENTS=6624 CHECKS=797786	UNSAT TT=171.092	UNSAT TT=13.506 ASSIGNMENTS=3128 CHECKS=416562	UNSAT TT=18.522 ASSIGNMENTS=3720 CHECKS=568056	? TT=76.499	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.02
csp/lexVg/ normalized-crossword-m1c-lex-vg7-8_ext.xml	UNSAT TT=81.69	UNSAT TT=87.174 CHECKS=201289 NODES=72247	UNSAT TT=81.69 CHECKS=201777 NODES=66473	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=1397.94 CHECKS=3717400	UNSAT TT=350.519 ASSIGNMENTS=15347	UNSAT TT=1296.04 ASSIGNMENTS=35283	UNSAT TT=257.786 CHECKS=0 NODES=105887	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=88.609 ASSIGNMENTS=72247 CHECKS=201289	UNSAT TT=88.827 ASSIGNMENTS=72247 CHECKS=201289	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=254.472 CHECKS=4424240	UNSAT TT=250.017 ASSIGNMENTS=61554 CHECKS=8324050	UNSAT TT=142.02 ASSIGNMENTS=35950 CHECKS=4527790	UNSAT TT=1367.69	UNSAT TT=223.413 ASSIGNMENTS=55319 CHECKS=7251720	UNSAT TT=190.978 ASSIGNMENTS=46456 CHECKS=6124340	? TT=91.849	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09
csp/lexVg/ normalized-crossword-m1c-lex-vg7-9_ext.xml	UNSAT TT=30.657	UNSAT TT=30.657 CHECKS=41191 NODES=21224	UNSAT TT=33.966 CHECKS=56096 NODES=21473	? (TO) TT=1800.13	UNSAT TT=914.653 CHECKS=2276300	UNSAT TT=721.99 CHECKS=1838910	UNSAT TT=586.789 ASSIGNMENTS=19560	UNSAT TT=335.795 ASSIGNMENTS=8491	UNSAT TT=93.068 CHECKS=0 NODES=31989	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=37.412 ASSIGNMENTS=21224 CHECKS=41191	UNSAT TT=37.23 ASSIGNMENTS=21224 CHECKS=41191	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=135.989 CHECKS=2042900	UNSAT TT=70.163 ASSIGNMENTS=15252 CHECKS=2164980	UNSAT TT=58.358 ASSIGNMENTS=13817 CHECKS=1746510	UNSAT TT=466.618	UNSAT TT=51.589 ASSIGNMENTS=11677 CHECKS=1591190	UNSAT TT=49.639 ASSIGNMENTS=11558 CHECKS=1636660	? TT=89.817	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.02
csp/lexVg/ normalized-crossword-m1c-lex-vg8-12_ext.xml	UNSAT TT=1.051	UNSAT TT=1.642 CHECKS=33 NODES=220	UNSAT TT=3.16 CHECKS=28 NODES=191	? (TO) TT=1800.05	UNSAT TT=51.803 CHECKS=123458	UNSAT TT=16.962 CHECKS=35104	UNSAT TT=15.986 ASSIGNMENTS=20	UNSAT TT=16.241 ASSIGNMENTS=16	UNSAT TT=2.011 CHECKS=0 NODES=264	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=1.222 ASSIGNMENTS=209 CHECKS=33829	UNSAT TT=1.221 ASSIGNMENTS=209 CHECKS=33829	UNSAT TT=94.475	UNSAT TT=43.092	UNSAT TT=1.968 CHECKS=17670	UNSAT TT=1.051 ASSIGNMENTS=183 CHECKS=29040	UNSAT TT=14.854 ASSIGNMENTS=3437 CHECKS=401250	UNSAT TT=10.053	UNSAT TT=4.622 ASSIGNMENTS=1230 CHECKS=126819	UNSAT TT=1.194 ASSIGNMENTS=209 CHECKS=33829	? TT=33.488	? (TO) TT=1800.07	UNSAT TT=165.665	? (TO) TT=1800.09
csp/lexVg/ normalized-crossword-m1c-lex-vg8-8_ext.xml	UNSAT TT=41.382	UNSAT TT=44.378 CHECKS=57921 NODES=25529	UNSAT TT=41.382 CHECKS=60510 NODES=26356	? (TO) TT=1800.06	UNSAT TT=665.823 CHECKS=2337270	UNSAT TT=1058.7 CHECKS=3496070	UNSAT TT=624.682 ASSIGNMENTS=20986	? (TO) TT=1800.07	UNSAT TT=117.416 CHECKS=0 NODES=37004	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=49.505 ASSIGNMENTS=25047 CHECKS=57145	UNSAT TT=52.717 ASSIGNMENTS=25047 CHECKS=57145	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=117.481 CHECKS=1866740	UNSAT TT=126.588 ASSIGNMENTS=27845 CHECKS=4042700	UNSAT TT=76.948 ASSIGNMENTS=17353 CHECKS=2324880	UNSAT TT=560.966	UNSAT TT=123.224 ASSIGNMENTS=26884 CHECKS=3848170	UNSAT TT=81.442 ASSIGNMENTS=17445 CHECKS=2518560	? TT=32.642	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07
csp/lexVg/ normalized-crossword-m1c-lex-vg8-9_ext.xml	UNSAT TT=16.812	UNSAT TT=16.812 CHECKS=11528 NODES=7482	UNSAT TT=19.493 CHECKS=18281 NODES=8704	? (TO) TT=1800.06	UNSAT TT=497.331 CHECKS=1061760	UNSAT TT=315.34 CHECKS=676415	UNSAT TT=95.673 ASSIGNMENTS=2788	UNSAT TT=654.701 ASSIGNMENTS=12117	UNSAT TT=40.437 CHECKS=0 NODES=9731	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=23.768 ASSIGNMENTS=7482 CHECKS=11528	UNSAT TT=24.03 ASSIGNMENTS=7482 CHECKS=11528	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=68.586 CHECKS=737436	UNSAT TT=30.558 ASSIGNMENTS=5550 CHECKS=869739	UNSAT TT=39.64 ASSIGNMENTS=8434 CHECKS=1100810	UNSAT TT=539.045	UNSAT TT=21.744 ASSIGNMENTS=4366 CHECKS=628606	UNSAT TT=39.919 ASSIGNMENTS=7439 CHECKS=1135480	? TT=24.921	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexVg/ normalized-crossword-m1c-lex-vg9-10_ext.xml	UNSAT TT=5.347	UNSAT TT=5.347 CHECKS=149 NODES=1309	UNSAT TT=5.434 CHECKS=129 NODES=1252	? (TO) TT=1800.09	UNSAT TT=116.417 CHECKS=235006	UNSAT TT=97.733 CHECKS=171745	UNSAT TT=25.666 ASSIGNMENTS=290	UNSAT TT=143.003 ASSIGNMENTS=2171	UNSAT TT=10.453 CHECKS=0 NODES=1606	? (TO) TT=1800	? (TO) TT=1800.1	UNSAT TT=12.375 ASSIGNMENTS=1309 CHECKS=149	UNSAT TT=12.945 ASSIGNMENTS=1309 CHECKS=149	UNSAT TT=535.569	UNSAT TT=464.654	UNSAT TT=18.442 CHECKS=140229	UNSAT TT=6.353 ASSIGNMENTS=969 CHECKS=188303	UNSAT TT=21.078 ASSIGNMENTS=4384 CHECKS=545587	UNSAT TT=59.797	UNSAT TT=11.228 ASSIGNMENTS=2238 CHECKS=305118	UNSAT TT=7.269 ASSIGNMENTS=1047 CHECKS=203531	? TT=31.714	? (TO) TT=1800.04	UNSAT TT=1389.91	? (TO) TT=1800.03
csp/lexVg/ normalized-crossword-m1c-lex-vg9-12_ext.xml	UNSAT TT=0.747	UNSAT TT=1.275 CHECKS=0 NODES=103	UNSAT TT=3.472 CHECKS=0 NODES=109	? (TO) TT=1800.08	UNSAT TT=30.283 CHECKS=75131	UNSAT TT=11.949 CHECKS=25367	UNSAT TT=19.074 ASSIGNMENTS=0	UNSAT TT=18.929 ASSIGNMENTS=0	UNSAT TT=1.757 CHECKS=0 NODES=152	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.942 ASSIGNMENTS=156 CHECKS=25448	UNSAT TT=0.937 ASSIGNMENTS=156 CHECKS=25448	UNSAT TT=57.316	UNSAT TT=44.296	UNSAT TT=2.892 CHECKS=19941	UNSAT TT=0.747 ASSIGNMENTS=118 CHECKS=19036	UNSAT TT=16.836 ASSIGNMENTS=3356 CHECKS=430306	UNSAT TT=10.644	UNSAT TT=5.721 ASSIGNMENTS=1389 CHECKS=146535	UNSAT TT=0.998 ASSIGNMENTS=156 CHECKS=25448	? TT=39.105	? (TO) TT=1800.1	UNSAT TT=155.094	? (TO) TT=1800.07
csp/lexVg/ normalized-crossword-m1c-lex-vg9-9_ext.xml	UNSAT TT=10.384	UNSAT TT=10.384 CHECKS=1840 NODES=3110	UNSAT TT=12.865 CHECKS=2142 NODES=3871	? (TO) TT=1800.09	UNSAT TT=206.949 CHECKS=545607	UNSAT TT=200.06 CHECKS=595263	UNSAT TT=44.966 ASSIGNMENTS=859	UNSAT TT=223.399 ASSIGNMENTS=4120	UNSAT TT=32.394 CHECKS=0 NODES=5241	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=17.56 ASSIGNMENTS=3450 CHECKS=2792	UNSAT TT=17.928 ASSIGNMENTS=3450 CHECKS=2792	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=26.255 CHECKS=274715	UNSAT TT=20.787 ASSIGNMENTS=3398 CHECKS=577238	UNSAT TT=28.083 ASSIGNMENTS=5806 CHECKS=732491	UNSAT TT=155.491	UNSAT TT=16.293 ASSIGNMENTS=3385 CHECKS=478366	UNSAT TT=16.977 ASSIGNMENTS=2892 CHECKS=461466	? TT=38.363	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09
csp/modifiedRenault/ normalized-renault-mod-0_ext.xml	SAT TT=0.586	SAT TT=1.958 CHECKS=3626 NODES=523	SAT TT=1.766 CHECKS=1487 NODES=0	SAT TT=917.438	SAT TT=37.664 CHECKS=101021	SAT TT=6.888 CHECKS=14856	SAT TT=5.155 ASSIGNMENTS=19	SAT TT=5.03 ASSIGNMENTS=35	SAT TT=84.176 CHECKS=101284000 NODES=156	SAT TT=1399 CHECKS=557903000 NODES=-1590470000	? (TO) TT=1800.05	SAT TT=0.598 ASSIGNMENTS=40 CHECKS=1423	SAT TT=0.617 ASSIGNMENTS=40 CHECKS=1423	SAT TT=13.541	SAT TT=10.973	SAT TT=1.053 CHECKS=903	SAT TT=0.615 ASSIGNMENTS=40 CHECKS=1423	SAT TT=0.662 ASSIGNMENTS=134 CHECKS=4246	SAT TT=5.722	SAT TT=1.158 ASSIGNMENTS=501 CHECKS=45371	SAT TT=0.586 ASSIGNMENTS=40 CHECKS=1423	? TT=46.175	SAT TT=1.4 ASSIGNMENTS=202 CHECKS=25542	SAT TT=7.595	SAT TT=8.073
csp/modifiedRenault/ normalized-renault-mod-10_ext.xml	UNSAT TT=0.749	UNSAT TT=1.886 CHECKS=1969 NODES=466	UNSAT TT=2.212 CHECKS=3217 NODES=440	? (TO) TT=1800.07	UNSAT TT=6.491 CHECKS=30544	UNSAT TT=7.508 CHECKS=38433	UNSAT TT=5.156 ASSIGNMENTS=224	UNSAT TT=166.284 ASSIGNMENTS=32934	UNSAT TT=68.165 CHECKS=40090600 NODES=154	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=0.749 ASSIGNMENTS=910 CHECKS=29032	UNSAT TT=0.751 ASSIGNMENTS=910 CHECKS=29032	UNSAT TT=10.281	UNSAT TT=9.332	UNSAT TT=1.313 CHECKS=10769	UNSAT TT=0.774 ASSIGNMENTS=901 CHECKS=28428	UNSAT TT=2.664 ASSIGNMENTS=5421 CHECKS=137844	UNSAT TT=5.138	UNSAT TT=1.162 ASSIGNMENTS=1518 CHECKS=65435	UNSAT TT=0.808 ASSIGNMENTS=910 CHECKS=29032	? TT=129.243	UNSAT TT=1.719 ASSIGNMENTS=88 CHECKS=50227	UNSAT TT=7.577	UNSAT TT=8.504
csp/modifiedRenault/ normalized-renault-mod-11_ext.xml	SAT TT=0.537	SAT TT=1.638 CHECKS=673 NODES=116	SAT TT=1.81 CHECKS=1360 NODES=115	SAT TT=911.968	SAT TT=8.224 CHECKS=22812	SAT TT=6.057 CHECKS=13873	SAT TT=4.188 ASSIGNMENTS=26	SAT TT=4.62 ASSIGNMENTS=91	SAT TT=70.806 CHECKS=39912500 NODES=111	SAT TT=684.737 CHECKS=630211000 NODES=980250000	? (TO) TT=1800.08	SAT TT=0.558 ASSIGNMENTS=22 CHECKS=924	SAT TT=0.553 ASSIGNMENTS=22 CHECKS=924	SAT TT=12.169	SAT TT=11.445	SAT TT=1.059 CHECKS=1630	SAT TT=0.582 ASSIGNMENTS=22 CHECKS=924	SAT TT=0.6 ASSIGNMENTS=148 CHECKS=4412	SAT TT=5.276	SAT TT=0.584 ASSIGNMENTS=53 CHECKS=1669	SAT TT=0.537 ASSIGNMENTS=22 CHECKS=924	? TT=45.094	SAT TT=1.428 ASSIGNMENTS=152 CHECKS=48746	SAT TT=7.434	SAT TT=8.231
csp/modifiedRenault/ normalized-renault-mod-12_ext.xml	UNSAT TT=0.689	UNSAT TT=2.284 CHECKS=5192 NODES=378	UNSAT TT=1.795 CHECKS=1383 NODES=0	? (TO) TT=1800.07	UNSAT TT=22.409 CHECKS=63692	UNSAT TT=8.276 CHECKS=36129	UNSAT TT=4.338 ASSIGNMENTS=0	UNSAT TT=4.366 ASSIGNMENTS=0	UNSAT TT=68.559 CHECKS=39967600 NODES=32	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=0.706 ASSIGNMENTS=148 CHECKS=9814	UNSAT TT=0.719 ASSIGNMENTS=148 CHECKS=9814	UNSAT TT=9.044	UNSAT TT=8.545	UNSAT TT=1.112 CHECKS=16907	UNSAT TT=0.769 ASSIGNMENTS=298 CHECKS=18751	UNSAT TT=3.217 ASSIGNMENTS=4792 CHECKS=178896	UNSAT TT=4.993	UNSAT TT=1.409 ASSIGNMENTS=475 CHECKS=50686	UNSAT TT=0.689 ASSIGNMENTS=148 CHECKS=9814	? TT=61.249	UNSAT TT=1.498 ASSIGNMENTS=294 CHECKS=287261	UNSAT TT=7.535	UNSAT TT=8.295
csp/modifiedRenault/ normalized-renault-mod-13_ext.xml	SAT TT=0.545	SAT TT=1.584 CHECKS=669 NODES=117	SAT TT=1.741 CHECKS=1200 NODES=125	SAT TT=16.185	SAT TT=5.812 CHECKS=14726	SAT TT=5.143 CHECKS=14131	SAT TT=4.148 ASSIGNMENTS=27	SAT TT=4.736 ASSIGNMENTS=60	SAT TT=125.437 CHECKS=243215000 NODES=239	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=0.599 ASSIGNMENTS=42 CHECKS=1620	SAT TT=0.555 ASSIGNMENTS=42 CHECKS=1620	SAT TT=12.962	SAT TT=11.901	SAT TT=1.06 CHECKS=2230	SAT TT=0.587 ASSIGNMENTS=42 CHECKS=1620	SAT TT=1.005 ASSIGNMENTS=1029 CHECKS=32077	SAT TT=5.019	SAT TT=1.049 ASSIGNMENTS=679 CHECKS=43700	SAT TT=0.545 ASSIGNMENTS=42 CHECKS=1620	? TT=56.712	SAT TT=1.484 ASSIGNMENTS=165 CHECKS=26701	SAT TT=8.03	SAT TT=8.516
csp/modifiedRenault/ normalized-renault-mod-14_ext.xml	UNSAT TT=0.661	UNSAT TT=2.037 CHECKS=2983 NODES=243	UNSAT TT=2.349 CHECKS=5227 NODES=302	? (TO) TT=1800.06	UNSAT TT=23.798 CHECKS=62150	UNSAT TT=7.787 CHECKS=29979	UNSAT TT=5.495 ASSIGNMENTS=72	UNSAT TT=8.924 ASSIGNMENTS=574	UNSAT TT=72.756 CHECKS=39978200 NODES=64	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.665 ASSIGNMENTS=278 CHECKS=12018	UNSAT TT=0.663 ASSIGNMENTS=278 CHECKS=12018	UNSAT TT=9.645	UNSAT TT=8.761	UNSAT TT=1.107 CHECKS=11572	UNSAT TT=0.758 ASSIGNMENTS=541 CHECKS=23880	UNSAT TT=2.971 ASSIGNMENTS=5276 CHECKS=160311	UNSAT TT=5.921	UNSAT TT=0.88 ASSIGNMENTS=407 CHECKS=34354	UNSAT TT=0.661 ASSIGNMENTS=278 CHECKS=12018	? TT=74.054	UNSAT TT=1.664 ASSIGNMENTS=402 CHECKS=429170	UNSAT TT=7.707	UNSAT TT=8.421
csp/modifiedRenault/ normalized-renault-mod-16_ext.xml	UNSAT TT=0.728	UNSAT TT=2.308 CHECKS=2463 NODES=805	UNSAT TT=2.328 CHECKS=3123 NODES=798	? (TO) TT=1800.09	UNSAT TT=7.494 CHECKS=38231	UNSAT TT=6.68 CHECKS=43301	UNSAT TT=5.987 ASSIGNMENTS=777	UNSAT TT=95.609 ASSIGNMENTS=54837	UNSAT TT=72.823 CHECKS=40088800 NODES=211	? (TO) TT=1800.1	? (TO) TT=1800	UNSAT TT=0.728 ASSIGNMENTS=1303 CHECKS=48533	UNSAT TT=0.81 ASSIGNMENTS=1303 CHECKS=48533	UNSAT TT=10.047	UNSAT TT=8.767	UNSAT TT=1.142 CHECKS=20062	UNSAT TT=0.787 ASSIGNMENTS=1343 CHECKS=49320	UNSAT TT=2.603 ASSIGNMENTS=5486 CHECKS=158224	UNSAT TT=5.672	UNSAT TT=1.216 ASSIGNMENTS=1537 CHECKS=74974	UNSAT TT=0.761 ASSIGNMENTS=1303 CHECKS=48533	? TT=47.966	UNSAT TT=1.789 ASSIGNMENTS=738 CHECKS=386796	UNSAT TT=7.661	UNSAT TT=8.553
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/modifiedRenault/ normalized-renault-mod-17_ext.xml	UNSAT TT=0.669	UNSAT TT=2.371 CHECKS=6031 NODES=495	UNSAT TT=1.789 CHECKS=797 NODES=0	? (TO) TT=1800.1	UNSAT TT=13.595 CHECKS=37874	UNSAT TT=13.728 CHECKS=48337	UNSAT TT=5.616 ASSIGNMENTS=0	UNSAT TT=5.636 ASSIGNMENTS=0	UNSAT TT=72.26 CHECKS=46176000 NODES=43	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=0.685 ASSIGNMENTS=104 CHECKS=6206	UNSAT TT=0.682 ASSIGNMENTS=104 CHECKS=6206	UNSAT TT=10.219	UNSAT TT=8.764	UNSAT TT=1.291 CHECKS=7008	UNSAT TT=0.745 ASSIGNMENTS=219 CHECKS=11739	UNSAT TT=2.935 ASSIGNMENTS=5053 CHECKS=161976	UNSAT TT=5.202	UNSAT TT=1.287 ASSIGNMENTS=541 CHECKS=56023	UNSAT TT=0.669 ASSIGNMENTS=104 CHECKS=6206	? TT=53.293	UNSAT TT=1.567 ASSIGNMENTS=103 CHECKS=160279	UNSAT TT=7.883	UNSAT TT=8.847
csp/modifiedRenault/ normalized-renault-mod-18_ext.xml	UNSAT TT=0.667	UNSAT TT=2.002 CHECKS=3110 NODES=540	UNSAT TT=2.258 CHECKS=2523 NODES=512	? (TO) TT=1800.12	UNSAT TT=6.563 CHECKS=29093	UNSAT TT=6.656 CHECKS=27980	UNSAT TT=5.227 ASSIGNMENTS=169	UNSAT TT=59.376 ASSIGNMENTS=28546	UNSAT TT=72.67 CHECKS=39992900 NODES=89	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.685 ASSIGNMENTS=565 CHECKS=18446	UNSAT TT=0.685 ASSIGNMENTS=565 CHECKS=18446	UNSAT TT=10.407	UNSAT TT=8.647	UNSAT TT=1.329 CHECKS=8632	UNSAT TT=0.695 ASSIGNMENTS=607 CHECKS=19705	UNSAT TT=2.646 ASSIGNMENTS=5351 CHECKS=145590	UNSAT TT=5.25	UNSAT TT=0.909 ASSIGNMENTS=464 CHECKS=35515	UNSAT TT=0.667 ASSIGNMENTS=565 CHECKS=18446	? TT=56.946	UNSAT TT=1.578 ASSIGNMENTS=262 CHECKS=115516	UNSAT TT=7.676	UNSAT TT=8.01
csp/modifiedRenault/ normalized-renault-mod-19_ext.xml	UNSAT TT=0.626	UNSAT TT=1.856 CHECKS=1700 NODES=532	UNSAT TT=2.546 CHECKS=3886 NODES=487	? (TO) TT=1800.12	UNSAT TT=21.086 CHECKS=61613	UNSAT TT=6.182 CHECKS=21886	UNSAT TT=3.765 ASSIGNMENTS=0	UNSAT TT=3.844 ASSIGNMENTS=0	UNSAT TT=73.141 CHECKS=39994500 NODES=59	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.626 ASSIGNMENTS=169 CHECKS=8262	UNSAT TT=0.667 ASSIGNMENTS=169 CHECKS=8262	UNSAT TT=8.918	UNSAT TT=10.172	UNSAT TT=1.094 CHECKS=9927	UNSAT TT=0.72 ASSIGNMENTS=357 CHECKS=18774	UNSAT TT=2.457 ASSIGNMENTS=5324 CHECKS=137622	UNSAT TT=5.467	UNSAT TT=0.908 ASSIGNMENTS=482 CHECKS=37874	UNSAT TT=0.661 ASSIGNMENTS=169 CHECKS=8262	? TT=51.966	UNSAT TT=1.551 ASSIGNMENTS=169 CHECKS=144994	UNSAT TT=7.676	UNSAT TT=7.957
csp/modifiedRenault/ normalized-renault-mod-1_ext.xml	UNSAT TT=0.649	UNSAT TT=1.85 CHECKS=1408 NODES=63	UNSAT TT=1.789 CHECKS=787 NODES=0	? (TO) TT=1800.09	UNSAT TT=16.162 CHECKS=59393	UNSAT TT=7.117 CHECKS=30527	UNSAT TT=3.813 ASSIGNMENTS=0	UNSAT TT=3.59 ASSIGNMENTS=0	UNSAT TT=84.224 CHECKS=91225600 NODES=42	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.665 ASSIGNMENTS=101 CHECKS=5324	UNSAT TT=0.676 ASSIGNMENTS=101 CHECKS=5324	UNSAT TT=10.231	UNSAT TT=9.49	UNSAT TT=1.239 CHECKS=11261	UNSAT TT=0.766 ASSIGNMENTS=286 CHECKS=13200	UNSAT TT=2.357 ASSIGNMENTS=5127 CHECKS=165726	UNSAT TT=5.293	UNSAT TT=0.888 ASSIGNMENTS=339 CHECKS=29363	UNSAT TT=0.649 ASSIGNMENTS=101 CHECKS=5324	? TT=50.207	UNSAT TT=1.476 ASSIGNMENTS=268 CHECKS=198173	UNSAT TT=7.902	UNSAT TT=8.127
csp/modifiedRenault/ normalized-renault-mod-20_ext.xml	UNSAT TT=0.66	UNSAT TT=2.5 CHECKS=5667 NODES=504	UNSAT TT=2.667 CHECKS=5542 NODES=460	? (TO) TT=1800.13	UNSAT TT=28.31 CHECKS=124829	UNSAT TT=8.153 CHECKS=46720	UNSAT TT=4.066 ASSIGNMENTS=0	UNSAT TT=4.129 ASSIGNMENTS=0	UNSAT TT=119.764 CHECKS=243225000 NODES=57	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.721 ASSIGNMENTS=129 CHECKS=15234	UNSAT TT=0.727 ASSIGNMENTS=129 CHECKS=15234	UNSAT TT=10.551	UNSAT TT=9.609	UNSAT TT=1.125 CHECKS=15273	UNSAT TT=0.725 ASSIGNMENTS=237 CHECKS=23353	UNSAT TT=2.674 ASSIGNMENTS=4933 CHECKS=246583	UNSAT TT=5.546	UNSAT TT=1.017 ASSIGNMENTS=371 CHECKS=48210	UNSAT TT=0.66 ASSIGNMENTS=129 CHECKS=15234	? TT=122.496	UNSAT TT=2.123 ASSIGNMENTS=626 CHECKS=1121500	UNSAT TT=7.603	UNSAT TT=8.355
csp/modifiedRenault/ normalized-renault-mod-21_ext.xml	UNSAT TT=0.648	UNSAT TT=2.037 CHECKS=3583 NODES=248	UNSAT TT=2.326 CHECKS=3930 NODES=235	? (TO) TT=1800.13	UNSAT TT=13.146 CHECKS=67969	UNSAT TT=7.624 CHECKS=42925	UNSAT TT=5.777 ASSIGNMENTS=118	UNSAT TT=12.387 ASSIGNMENTS=1729	UNSAT TT=67.82 CHECKS=40040800 NODES=70	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.648 ASSIGNMENTS=320 CHECKS=19660	UNSAT TT=0.701 ASSIGNMENTS=320 CHECKS=19660	UNSAT TT=10.441	UNSAT TT=10.093	UNSAT TT=1.216 CHECKS=22417	UNSAT TT=0.739 ASSIGNMENTS=585 CHECKS=34379	UNSAT TT=2.959 ASSIGNMENTS=5148 CHECKS=185284	UNSAT TT=5.774	UNSAT TT=1.241 ASSIGNMENTS=479 CHECKS=46920	UNSAT TT=0.684 ASSIGNMENTS=320 CHECKS=19660	? TT=93.144	UNSAT TT=1.529 ASSIGNMENTS=301 CHECKS=240401	UNSAT TT=8.042	UNSAT TT=7.829
csp/modifiedRenault/ normalized-renault-mod-22_ext.xml	UNSAT TT=0.672	UNSAT TT=2.021 CHECKS=1765 NODES=401	UNSAT TT=2.297 CHECKS=2874 NODES=266	? (TO) TT=1800.07	UNSAT TT=20.658 CHECKS=64436	UNSAT TT=8.351 CHECKS=42912	UNSAT TT=8.464 ASSIGNMENTS=0	UNSAT TT=4.721 ASSIGNMENTS=0	UNSAT TT=68.154 CHECKS=39988900 NODES=47	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.672 ASSIGNMENTS=208 CHECKS=16290	UNSAT TT=0.717 ASSIGNMENTS=208 CHECKS=16290	UNSAT TT=11.927	UNSAT TT=8.896	UNSAT TT=1.103 CHECKS=23084	UNSAT TT=0.776 ASSIGNMENTS=364 CHECKS=31816	UNSAT TT=3.25 ASSIGNMENTS=5219 CHECKS=177267	UNSAT TT=5.024	UNSAT TT=1.057 ASSIGNMENTS=571 CHECKS=47708	UNSAT TT=0.712 ASSIGNMENTS=208 CHECKS=16290	? TT=91.479	UNSAT TT=1.48 ASSIGNMENTS=106 CHECKS=107428	UNSAT TT=7.339	UNSAT TT=7.936
csp/modifiedRenault/ normalized-renault-mod-23_ext.xml	UNSAT TT=0.727	UNSAT TT=2.188 CHECKS=6738 NODES=426	UNSAT TT=2.394 CHECKS=6016 NODES=404	? (TO) TT=1800.05	UNSAT TT=19.088 CHECKS=64596	UNSAT TT=12.985 CHECKS=68595	UNSAT TT=3.814 ASSIGNMENTS=0	UNSAT TT=3.847 ASSIGNMENTS=0	UNSAT TT=81.353 CHECKS=94440800 NODES=55	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=0.756 ASSIGNMENTS=213 CHECKS=18567	UNSAT TT=0.727 ASSIGNMENTS=213 CHECKS=18567	UNSAT TT=12.176	UNSAT TT=9.791	UNSAT TT=1.13 CHECKS=27042	UNSAT TT=0.859 ASSIGNMENTS=388 CHECKS=34039	UNSAT TT=2.475 ASSIGNMENTS=5281 CHECKS=192586	UNSAT TT=5.609	UNSAT TT=1.325 ASSIGNMENTS=822 CHECKS=75938	UNSAT TT=0.743 ASSIGNMENTS=213 CHECKS=18567	? TT=93.089	UNSAT TT=1.663 ASSIGNMENTS=367 CHECKS=441179	UNSAT TT=8.334	UNSAT TT=8.49
csp/modifiedRenault/ normalized-renault-mod-24_ext.xml	UNSAT TT=0.692	UNSAT TT=2.429 CHECKS=1356 NODES=140	UNSAT TT=1.901 CHECKS=1182 NODES=0	? (TO) TT=1800.1	UNSAT TT=16.308 CHECKS=58834	UNSAT TT=7.512 CHECKS=31884	UNSAT TT=4.743 ASSIGNMENTS=0	UNSAT TT=4.271 ASSIGNMENTS=0	UNSAT TT=70.045 CHECKS=39963600 NODES=51	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=0.692 ASSIGNMENTS=193 CHECKS=12290	UNSAT TT=0.736 ASSIGNMENTS=193 CHECKS=12290	UNSAT TT=10.855	UNSAT TT=9.894	UNSAT TT=1.196 CHECKS=18642	UNSAT TT=0.764 ASSIGNMENTS=248 CHECKS=17161	UNSAT TT=3.296 ASSIGNMENTS=5094 CHECKS=230564	UNSAT TT=5.303	UNSAT TT=1.052 ASSIGNMENTS=388 CHECKS=35259	UNSAT TT=0.724 ASSIGNMENTS=193 CHECKS=12290	? TT=96.454	UNSAT TT=1.55 ASSIGNMENTS=176 CHECKS=154826	UNSAT TT=7.901	UNSAT TT=8.577
csp/modifiedRenault/ normalized-renault-mod-26_ext.xml	UNSAT TT=0.682	UNSAT TT=2.505 CHECKS=2392 NODES=543	UNSAT TT=2.597 CHECKS=2736 NODES=525	? (TO) TT=1800.09	UNSAT TT=10.824 CHECKS=54195	UNSAT TT=6.777 CHECKS=38132	UNSAT TT=4.278 ASSIGNMENTS=82	UNSAT TT=13.152 ASSIGNMENTS=2319	UNSAT TT=68.897 CHECKS=40044200 NODES=85	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.752 ASSIGNMENTS=411 CHECKS=26129	UNSAT TT=0.7 ASSIGNMENTS=411 CHECKS=26129	UNSAT TT=12.103	UNSAT TT=10.246	UNSAT TT=1.414 CHECKS=15583	UNSAT TT=0.7 ASSIGNMENTS=419 CHECKS=28928	UNSAT TT=2.855 ASSIGNMENTS=5134 CHECKS=191794	UNSAT TT=6.08	UNSAT TT=1.067 ASSIGNMENTS=474 CHECKS=41607	UNSAT TT=0.682 ASSIGNMENTS=411 CHECKS=26129	? TT=101.112	UNSAT TT=1.611 ASSIGNMENTS=209 CHECKS=124708	UNSAT TT=8.778	UNSAT TT=7.986
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/modifiedRenault/ normalized-renault-mod-27_ext.xml	UNSAT TT=0.698	UNSAT TT=1.843 CHECKS=2627 NODES=187	UNSAT TT=1.765 CHECKS=786 NODES=0	? (TO) TT=1800.12	UNSAT TT=11.871 CHECKS=31145	UNSAT TT=14.613 CHECKS=51656	UNSAT TT=4.429 ASSIGNMENTS=0	UNSAT TT=4.492 ASSIGNMENTS=0	UNSAT TT=70.322 CHECKS=39983400 NODES=46	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=0.715 ASSIGNMENTS=109 CHECKS=9336	UNSAT TT=0.722 ASSIGNMENTS=109 CHECKS=9336	UNSAT TT=10.567	UNSAT TT=9.875	UNSAT TT=1.14 CHECKS=10834	UNSAT TT=0.756 ASSIGNMENTS=272 CHECKS=22197	UNSAT TT=1.128 ASSIGNMENTS=1112 CHECKS=43235	UNSAT TT=5.21	UNSAT TT=0.996 ASSIGNMENTS=337 CHECKS=34524	UNSAT TT=0.698 ASSIGNMENTS=109 CHECKS=9336	? TT=94.376	UNSAT TT=1.586 ASSIGNMENTS=75 CHECKS=69916	UNSAT TT=8.424	UNSAT TT=8.327
csp/modifiedRenault/ normalized-renault-mod-28_ext.xml	UNSAT TT=0.659	UNSAT TT=2.112 CHECKS=1712 NODES=224	UNSAT TT=2.071 CHECKS=2589 NODES=215	? (TO) TT=1800.09	UNSAT TT=44.444 CHECKS=119372	UNSAT TT=8.885 CHECKS=41601	UNSAT TT=4.714 ASSIGNMENTS=0	UNSAT TT=4.925 ASSIGNMENTS=0	UNSAT TT=71.084 CHECKS=40034700 NODES=54	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=0.723 ASSIGNMENTS=189 CHECKS=17363	UNSAT TT=0.672 ASSIGNMENTS=189 CHECKS=17363	UNSAT TT=12.031	UNSAT TT=9.828	UNSAT TT=1.212 CHECKS=20421	UNSAT TT=0.821 ASSIGNMENTS=391 CHECKS=34799	UNSAT TT=2.533 ASSIGNMENTS=5158 CHECKS=179476	UNSAT TT=5.591	UNSAT TT=1.99 ASSIGNMENTS=1536 CHECKS=140448	UNSAT TT=0.659 ASSIGNMENTS=189 CHECKS=17363	? (exit code) TT=120.609	UNSAT TT=1.799 ASSIGNMENTS=156 CHECKS=394915	UNSAT TT=8.12	UNSAT TT=9.292
csp/modifiedRenault/ normalized-renault-mod-29_ext.xml	UNSAT TT=0.728	UNSAT TT=1.95 CHECKS=21 NODES=9	UNSAT TT=2.057 CHECKS=1303 NODES=0	? (TO) TT=1800.06	UNSAT TT=8.079 CHECKS=25436	UNSAT TT=7.977 CHECKS=34564	UNSAT TT=3.328 ASSIGNMENTS=0	UNSAT TT=3.15 ASSIGNMENTS=0	UNSAT TT=67.8 CHECKS=39980600 NODES=40	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.728 ASSIGNMENTS=84 CHECKS=10879	UNSAT TT=0.734 ASSIGNMENTS=84 CHECKS=10879	UNSAT TT=10.659	UNSAT TT=9.692	UNSAT TT=1.094 CHECKS=11443	UNSAT TT=0.796 ASSIGNMENTS=124 CHECKS=15453	UNSAT TT=2.82 ASSIGNMENTS=4664 CHECKS=250101	UNSAT TT=5.726	UNSAT TT=0.971 ASSIGNMENTS=204 CHECKS=29409	UNSAT TT=0.728 ASSIGNMENTS=84 CHECKS=10879	? (exit code) TT=105.217	UNSAT TT=1.576 ASSIGNMENTS=126 CHECKS=227519	UNSAT TT=8.199	UNSAT TT=8.569
csp/modifiedRenault/ normalized-renault-mod-30_ext.xml	UNSAT TT=0.844	UNSAT TT=2.769 CHECKS=6588 NODES=609	UNSAT TT=3.453 CHECKS=7982 NODES=568	? (TO) TT=1800.07	UNSAT TT=49.513 CHECKS=174067	UNSAT TT=19.099 CHECKS=86332	UNSAT TT=4.848 ASSIGNMENTS=209	UNSAT TT=5.702 ASSIGNMENTS=397	UNSAT TT=327.083 CHECKS=1089730000 NODES=145	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.904 ASSIGNMENTS=338 CHECKS=33601	UNSAT TT=0.901 ASSIGNMENTS=338 CHECKS=33601	UNSAT TT=10.267	UNSAT TT=9.254	UNSAT TT=1.191 CHECKS=37209	UNSAT TT=0.888 ASSIGNMENTS=572 CHECKS=55353	UNSAT TT=3.736 ASSIGNMENTS=4821 CHECKS=258171	UNSAT TT=5.709	UNSAT TT=1.151 ASSIGNMENTS=502 CHECKS=51791	UNSAT TT=0.844 ASSIGNMENTS=338 CHECKS=33601	? TT=77.893	UNSAT TT=2.4 ASSIGNMENTS=100 CHECKS=918667	UNSAT TT=7.928	UNSAT TT=8.598
csp/modifiedRenault/ normalized-renault-mod-31_ext.xml	SAT TT=0.641	SAT TT=1.889 CHECKS=4320 NODES=503	SAT TT=2.313 CHECKS=5954 NODES=481	SAT TT=1356.4	SAT TT=38.058 CHECKS=151760	SAT TT=9.763 CHECKS=41300	SAT TT=5.458 ASSIGNMENTS=107	SAT TT=8.203 ASSIGNMENTS=1252	SAT TT=153.486 CHECKS=420892000 NODES=246	SAT TT=843.105 CHECKS=2268540000 NODES=888300000	? (TO) TT=1800.03	SAT TT=0.709 ASSIGNMENTS=190 CHECKS=13751	SAT TT=0.661 ASSIGNMENTS=190 CHECKS=13751	SAT TT=12.974	SAT TT=12.138	SAT TT=1.054 CHECKS=10708	SAT TT=0.641 ASSIGNMENTS=178 CHECKS=8365	SAT TT=1.906 ASSIGNMENTS=3611 CHECKS=121754	SAT TT=5.251	SAT TT=1.854 ASSIGNMENTS=496 CHECKS=52086	SAT TT=0.703 ASSIGNMENTS=190 CHECKS=13751	? TT=73.525	SAT TT=1.532 ASSIGNMENTS=180 CHECKS=68523	SAT TT=7.324	SAT TT=8.395
csp/modifiedRenault/ normalized-renault-mod-33_ext.xml	UNSAT TT=0.65	UNSAT TT=2.914 CHECKS=4746 NODES=297	UNSAT TT=3.131 CHECKS=4604 NODES=221	? (TO) TT=1800.12	UNSAT TT=30.581 CHECKS=120695	UNSAT TT=7.187 CHECKS=37114	UNSAT TT=5.214 ASSIGNMENTS=47	UNSAT TT=5.682 ASSIGNMENTS=76	UNSAT TT=85.448 CHECKS=84192500 NODES=144	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.676 ASSIGNMENTS=137 CHECKS=10183	UNSAT TT=0.674 ASSIGNMENTS=137 CHECKS=10183	UNSAT TT=9.851	UNSAT TT=9.03	UNSAT TT=1.171 CHECKS=9681	UNSAT TT=0.693 ASSIGNMENTS=201 CHECKS=14300	UNSAT TT=3.417 ASSIGNMENTS=4752 CHECKS=249865	UNSAT TT=5.333	UNSAT TT=2.077 ASSIGNMENTS=406 CHECKS=42101	UNSAT TT=0.65 ASSIGNMENTS=137 CHECKS=10183	? TT=58.668	UNSAT TT=1.497 ASSIGNMENTS=227 CHECKS=240572	UNSAT TT=7.696	UNSAT TT=7.593
csp/modifiedRenault/ normalized-renault-mod-35_ext.xml	UNSAT TT=0.706	UNSAT TT=2.449 CHECKS=9707 NODES=174	UNSAT TT=1.756 CHECKS=1027 NODES=0	UNSAT TT=15.913	UNSAT TT=2.755 CHECKS=3036	UNSAT TT=2.774 CHECKS=3442	UNSAT TT=2.037 ASSIGNMENTS=0	UNSAT TT=1.949 ASSIGNMENTS=0	UNSAT TT=101.663 CHECKS=158203000 NODES=7	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=0.722 ASSIGNMENTS=37 CHECKS=8271	UNSAT TT=0.715 ASSIGNMENTS=37 CHECKS=8271	UNSAT TT=9.813	UNSAT TT=8.582	UNSAT TT=1.048 CHECKS=14872	UNSAT TT=0.762 ASSIGNMENTS=73 CHECKS=12338	UNSAT TT=0.923 ASSIGNMENTS=277 CHECKS=17921	UNSAT TT=4.874	UNSAT TT=1.448 ASSIGNMENTS=145 CHECKS=25921	UNSAT TT=0.706 ASSIGNMENTS=37 CHECKS=8271	? TT=63.708	UNSAT TT=1.495 ASSIGNMENTS=171 CHECKS=258826	UNSAT TT=8.053	UNSAT TT=8.056
csp/modifiedRenault/ normalized-renault-mod-36_ext.xml	SAT TT=0.674