CSP 2008 Competition: results by benchmark

Results by benchmark for category n-ary constraints in extension (N-ARY-EXT), subcategory boolean problems

This page displays the results of the different solvers for each benchmark for category n-ary constraints in extension (N-ARY-EXT), subcategory boolean problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
mddc-solv 2008-06-09
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
spider 2008-06-14
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-100/ normalized-aim-100-1-6-sat-1_ext.xml	SAT TT=0.009	SAT TT=0.837 CHECKS=1705 NODES=236	SAT TT=0.854 CHECKS=3280 NODES=357	SAT TT=30.865	SAT TT=0.013 CHECKS=1438	SAT TT=0.017 CHECKS=4422	SAT TT=0.509 ASSIGNMENTS=15	SAT TT=0.467 ASSIGNMENTS=8	SAT TT=0.423 CHECKS=809 NODES=151	? (TO) TT=1800.04	SAT TT=0.443 CHECKS=153439 NODES=1104	SAT TT=0.022 ASSIGNMENTS=81 CHECKS=2550	SAT TT=0.023 ASSIGNMENTS=81 CHECKS=2550	SAT TT=0.971	SAT TT=1.179	SAT TT=0.057 CHECKS=4633	SAT TT=0.009 ASSIGNMENTS=80 CHECKS=2661	SAT TT=0.035 ASSIGNMENTS=5759 CHECKS=89684	SAT TT=0.431	SAT TT=0.013 ASSIGNMENTS=353 CHECKS=12552	SAT TT=0.011 ASSIGNMENTS=81 CHECKS=2550	SAT TT=0.973	SAT TT=0.025 ASSIGNMENTS=105 CHECKS=1900	SAT TT=0.743	SAT TT=0.742
csp/aim-100/ normalized-aim-100-1-6-sat-2_ext.xml	SAT TT=0.013	SAT TT=0.836 CHECKS=6717 NODES=839	SAT TT=0.862 CHECKS=3778 NODES=490	SAT TT=154.458	SAT TT=0.023 CHECKS=7555	SAT TT=0.041 CHECKS=31706	SAT TT=0.501 ASSIGNMENTS=33	SAT TT=0.479 ASSIGNMENTS=17	SAT TT=0.496 CHECKS=2236 NODES=308	? (TO) TT=1800.05	SAT TT=0.419 CHECKS=145002 NODES=943	SAT TT=0.024 ASSIGNMENTS=274 CHECKS=7201	SAT TT=0.025 ASSIGNMENTS=274 CHECKS=7201	SAT TT=1.1	SAT TT=0.909	SAT TT=0.046 CHECKS=9881	SAT TT=0.013 ASSIGNMENTS=407 CHECKS=10178	SAT TT=0.031 ASSIGNMENTS=5908 CHECKS=85589	SAT TT=0.427	SAT TT=0.013 ASSIGNMENTS=357 CHECKS=8522	SAT TT=0.013 ASSIGNMENTS=274 CHECKS=7201	SAT TT=0.873	SAT TT=0.026 ASSIGNMENTS=227 CHECKS=5363	SAT TT=0.661	SAT TT=0.694
csp/aim-100/ normalized-aim-100-1-6-sat-3_ext.xml	SAT TT=0.011	SAT TT=0.837 CHECKS=5946 NODES=929	SAT TT=0.968 CHECKS=7737 NODES=937	SAT TT=110.652	SAT TT=0.014 CHECKS=3166	SAT TT=0.038 CHECKS=30860	SAT TT=0.527 ASSIGNMENTS=273	SAT TT=0.553 ASSIGNMENTS=327	SAT TT=0.449 CHECKS=1065 NODES=174	? (TO) TT=1800.06	SAT TT=2.144 CHECKS=12091200 NODES=73135	SAT TT=0.022 ASSIGNMENTS=203 CHECKS=5090	SAT TT=0.022 ASSIGNMENTS=203 CHECKS=5090	SAT TT=0.906	SAT TT=0.975	SAT TT=0.045 CHECKS=10042	SAT TT=0.012 ASSIGNMENTS=413 CHECKS=10441	SAT TT=0.03 ASSIGNMENTS=6055 CHECKS=77553	SAT TT=0.346	SAT TT=0.012 ASSIGNMENTS=372 CHECKS=6794	SAT TT=0.011 ASSIGNMENTS=203 CHECKS=5090	SAT TT=0.902	SAT TT=0.041 ASSIGNMENTS=540 CHECKS=25724	SAT TT=0.645	SAT TT=0.689
csp/aim-100/ normalized-aim-100-1-6-sat-4_ext.xml	SAT TT=0.011	SAT TT=0.77 CHECKS=1103 NODES=215	SAT TT=0.819 CHECKS=1526 NODES=212	SAT TT=1.302	SAT TT=0.022 CHECKS=7911	SAT TT=0.02 CHECKS=7522	SAT TT=0.528 ASSIGNMENTS=230	SAT TT=0.552 ASSIGNMENTS=79	SAT TT=0.4 CHECKS=1190 NODES=177	? (TO) TT=1800.05	SAT TT=0.501 CHECKS=298671 NODES=1688	SAT TT=0.023 ASSIGNMENTS=168 CHECKS=4432	SAT TT=0.023 ASSIGNMENTS=168 CHECKS=4432	SAT TT=0.929	SAT TT=1.105	SAT TT=0.039 CHECKS=2257	SAT TT=0.012 ASSIGNMENTS=186 CHECKS=4657	SAT TT=0.032 ASSIGNMENTS=5793 CHECKS=86640	SAT TT=0.354	SAT TT=0.011 ASSIGNMENTS=265 CHECKS=4661	SAT TT=0.011 ASSIGNMENTS=168 CHECKS=4432	SAT TT=0.805	SAT TT=0.024 ASSIGNMENTS=317 CHECKS=15269	SAT TT=0.696	SAT TT=0.648
csp/aim-100/ normalized-aim-100-1-6-unsat-1_ext.xml	UNSAT TT=0.023	UNSAT TT=1.061 CHECKS=54585 NODES=5225	UNSAT TT=1.07 CHECKS=50025 NODES=4694	? (TO) TT=1800.04	UNSAT TT=0.102 CHECKS=61774	UNSAT TT=0.089 CHECKS=64928	UNSAT TT=1.032 ASSIGNMENTS=5914	UNSAT TT=0.82 ASSIGNMENTS=1391	UNSAT TT=0.456 CHECKS=7064 NODES=589	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=0.041 ASSIGNMENTS=2886 CHECKS=60434	UNSAT TT=0.04 ASSIGNMENTS=2886 CHECKS=60434	UNSAT TT=0.565	UNSAT TT=0.696	UNSAT TT=0.07 CHECKS=26332	UNSAT TT=0.024 ASSIGNMENTS=2881 CHECKS=63131	UNSAT TT=0.031 ASSIGNMENTS=8029 CHECKS=90757	UNSAT TT=0.445	UNSAT TT=0.023 ASSIGNMENTS=2017 CHECKS=35977	UNSAT TT=0.025 ASSIGNMENTS=2886 CHECKS=60434	UNSAT TT=0.821	UNSAT TT=0.066 ASSIGNMENTS=887 CHECKS=32392	UNSAT TT=0.66	UNSAT TT=0.648
csp/aim-100/ normalized-aim-100-1-6-unsat-2_ext.xml	UNSAT TT=0.015	UNSAT TT=0.962 CHECKS=19505 NODES=1835	UNSAT TT=0.926 CHECKS=19461 NODES=1768	UNSAT TT=201.423	UNSAT TT=0.058 CHECKS=29844	UNSAT TT=0.171 CHECKS=131979	UNSAT TT=0.712 ASSIGNMENTS=1705	UNSAT TT=0.607 ASSIGNMENTS=388	UNSAT TT=0.525 CHECKS=5820 NODES=494	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=0.04 ASSIGNMENTS=2271 CHECKS=56365	UNSAT TT=0.037 ASSIGNMENTS=2271 CHECKS=56365	UNSAT TT=0.572	UNSAT TT=0.57	UNSAT TT=0.069 CHECKS=25720	UNSAT TT=0.028 ASSIGNMENTS=2350 CHECKS=61699	UNSAT TT=0.038 ASSIGNMENTS=7613 CHECKS=107465	UNSAT TT=0.366	UNSAT TT=0.015 ASSIGNMENTS=620 CHECKS=13227	UNSAT TT=0.023 ASSIGNMENTS=2271 CHECKS=56365	UNSAT TT=0.799	UNSAT TT=0.059 ASSIGNMENTS=1466 CHECKS=65779	UNSAT TT=0.65	UNSAT TT=0.678
csp/aim-100/ normalized-aim-100-1-6-unsat-3_ext.xml	UNSAT TT=0.068	UNSAT TT=1.089 CHECKS=71698 NODES=6813	UNSAT TT=1.282 CHECKS=105326 NODES=9372	? (TO) TT=1800.08	UNSAT TT=0.448 CHECKS=317483	UNSAT TT=0.226 CHECKS=192589	UNSAT TT=2.701 ASSIGNMENTS=27877	UNSAT TT=0.713 ASSIGNMENTS=1207	UNSAT TT=0.898 CHECKS=114616 NODES=7084	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.09 ASSIGNMENTS=10409 CHECKS=226716	UNSAT TT=0.094 ASSIGNMENTS=10409 CHECKS=226716	UNSAT TT=0.715	UNSAT TT=0.557	UNSAT TT=0.127 CHECKS=72138	UNSAT TT=0.068 ASSIGNMENTS=9660 CHECKS=213423	UNSAT TT=0.067 ASSIGNMENTS=13197 CHECKS=210238	UNSAT TT=0.618	UNSAT TT=0.084 ASSIGNMENTS=10146 CHECKS=239740	UNSAT TT=0.07 ASSIGNMENTS=10409 CHECKS=226716	UNSAT TT=0.817	UNSAT TT=0.617 ASSIGNMENTS=21358 CHECKS=700509	UNSAT TT=0.668	UNSAT TT=0.689
csp/aim-100/ normalized-aim-100-1-6-unsat-4_ext.xml	UNSAT TT=0.028	UNSAT TT=1.012 CHECKS=28155 NODES=3311	UNSAT TT=1.02 CHECKS=33338 NODES=3713	? (TO) TT=1800.1	UNSAT TT=0.145 CHECKS=87309	UNSAT TT=0.15 CHECKS=118548	UNSAT TT=1.276 ASSIGNMENTS=8856	UNSAT TT=1.814 ASSIGNMENTS=11034	UNSAT TT=0.47 CHECKS=6361 NODES=596	? (TO) TT=1800.09	? (TO) TT=1800	UNSAT TT=0.076 ASSIGNMENTS=8133 CHECKS=178844	UNSAT TT=0.077 ASSIGNMENTS=8133 CHECKS=178844	UNSAT TT=0.705	UNSAT TT=0.564	UNSAT TT=0.071 CHECKS=21643	UNSAT TT=0.037 ASSIGNMENTS=5255 CHECKS=118129	UNSAT TT=0.034 ASSIGNMENTS=8264 CHECKS=82592	UNSAT TT=0.441	UNSAT TT=0.028 ASSIGNMENTS=2732 CHECKS=52884	UNSAT TT=0.052 ASSIGNMENTS=8133 CHECKS=178844	UNSAT TT=0.868	UNSAT TT=0.085 ASSIGNMENTS=2108 CHECKS=68085	UNSAT TT=0.666	UNSAT TT=0.705
csp/aim-100/ normalized-aim-100-2-0-sat-1_ext.xml	SAT TT=0.013	SAT TT=0.868 CHECKS=6443 NODES=838	SAT TT=0.929 CHECKS=8534 NODES=938	SAT TT=193.579	SAT TT=0.066 CHECKS=40312	SAT TT=0.036 CHECKS=23149	SAT TT=0.638 ASSIGNMENTS=707	SAT TT=0.834 ASSIGNMENTS=1272	SAT TT=0.537 CHECKS=3027 NODES=272	SAT TT=18.447 CHECKS=66901000 NODES=3076570	SAT TT=0.59 CHECKS=1001320 NODES=5272	SAT TT=0.024 ASSIGNMENTS=490 CHECKS=12713	SAT TT=0.026 ASSIGNMENTS=490 CHECKS=12713	SAT TT=1.076	SAT TT=0.94	SAT TT=0.049 CHECKS=11863	SAT TT=0.015 ASSIGNMENTS=561 CHECKS=19429	SAT TT=0.043 ASSIGNMENTS=5316 CHECKS=136211	SAT TT=0.392	SAT TT=0.013 ASSIGNMENTS=450 CHECKS=9729	SAT TT=0.013 ASSIGNMENTS=490 CHECKS=12713	SAT TT=0.827	SAT TT=0.065 ASSIGNMENTS=1130 CHECKS=63380	SAT TT=0.735	SAT TT=0.708
csp/aim-100/ normalized-aim-100-2-0-sat-2_ext.xml	SAT TT=0.016	SAT TT=0.96 CHECKS=26691 NODES=2591	SAT TT=1.025 CHECKS=25652 NODES=2414	SAT TT=54.542	SAT TT=0.178 CHECKS=151621	SAT TT=0.136 CHECKS=154655	SAT TT=0.896 ASSIGNMENTS=2354	SAT TT=1.103 ASSIGNMENTS=3374	SAT TT=0.525 CHECKS=19967 NODES=928	SAT TT=604.591 CHECKS=2285100000 NODES=100912000	SAT TT=1532.64 CHECKS=11544600000 NODES=31098400	SAT TT=0.031 ASSIGNMENTS=822 CHECKS=33873	SAT TT=0.03 ASSIGNMENTS=822 CHECKS=33873	SAT TT=1.025	SAT TT=1.244	SAT TT=0.065 CHECKS=32651	SAT TT=0.016 ASSIGNMENTS=800 CHECKS=32848	SAT TT=0.044 ASSIGNMENTS=5354 CHECKS=142545	SAT TT=0.406	SAT TT=0.016 ASSIGNMENTS=585 CHECKS=17249	SAT TT=0.019 ASSIGNMENTS=822 CHECKS=33873	SAT TT=0.876	SAT TT=0.076 ASSIGNMENTS=639 CHECKS=29969	SAT TT=0.673	SAT TT=0.796
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-100/ normalized-aim-100-2-0-sat-3_ext.xml	SAT TT=0.013	SAT TT=0.859 CHECKS=5023 NODES=570	SAT TT=0.822 CHECKS=1673 NODES=233	SAT TT=2.442	SAT TT=0.015 CHECKS=4055	SAT TT=0.118 CHECKS=147710	SAT TT=0.591 ASSIGNMENTS=338	SAT TT=0.485 ASSIGNMENTS=7	SAT TT=0.524 CHECKS=2766 NODES=256	SAT TT=439.907 CHECKS=1594820000 NODES=77786100	? (TO) TT=1800.04	SAT TT=0.034 ASSIGNMENTS=968 CHECKS=42795	SAT TT=0.033 ASSIGNMENTS=968 CHECKS=42795	SAT TT=1.124	SAT TT=1.032	SAT TT=0.077 CHECKS=12697	SAT TT=0.023 ASSIGNMENTS=1443 CHECKS=55357	SAT TT=0.046 ASSIGNMENTS=5382 CHECKS=136304	SAT TT=0.441	SAT TT=0.013 ASSIGNMENTS=563 CHECKS=15966	SAT TT=0.02 ASSIGNMENTS=968 CHECKS=42795	SAT TT=1.007	SAT TT=0.055 ASSIGNMENTS=724 CHECKS=31913	SAT TT=0.748	SAT TT=0.719
csp/aim-100/ normalized-aim-100-2-0-sat-4_ext.xml	SAT TT=0.015	SAT TT=0.923 CHECKS=8479 NODES=977	SAT TT=0.891 CHECKS=10400 NODES=1197	SAT TT=332.479	SAT TT=0.089 CHECKS=63789	SAT TT=0.058 CHECKS=65978	SAT TT=0.574 ASSIGNMENTS=279	SAT TT=0.682 ASSIGNMENTS=768	SAT TT=0.424 CHECKS=2819 NODES=255	SAT TT=796.756 CHECKS=3027680000 NODES=143701000	SAT TT=0.515 CHECKS=173781 NODES=1221	SAT TT=0.026 ASSIGNMENTS=271 CHECKS=12723	SAT TT=0.019 ASSIGNMENTS=271 CHECKS=12723	SAT TT=1.04	SAT TT=1.096	SAT TT=0.065 CHECKS=19179	SAT TT=0.015 ASSIGNMENTS=445 CHECKS=23246	SAT TT=0.045 ASSIGNMENTS=5460 CHECKS=141277	SAT TT=0.417	SAT TT=0.025 ASSIGNMENTS=1439 CHECKS=58079	SAT TT=0.015 ASSIGNMENTS=271 CHECKS=12723	SAT TT=0.891	SAT TT=0.033 ASSIGNMENTS=247 CHECKS=7456	SAT TT=0.676	SAT TT=0.713
csp/aim-100/ normalized-aim-100-2-0-unsat-1_ext.xml	UNSAT TT=0.011	UNSAT TT=0.812 CHECKS=1576 NODES=238	UNSAT TT=0.803 CHECKS=1036 NODES=147	UNSAT TT=388.858	UNSAT TT=0.024 CHECKS=6978	UNSAT TT=0.025 CHECKS=10526	UNSAT TT=0.533 ASSIGNMENTS=203	UNSAT TT=0.664 ASSIGNMENTS=120	UNSAT TT=0.435 CHECKS=1422 NODES=89	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.025 ASSIGNMENTS=181 CHECKS=6009	UNSAT TT=0.025 ASSIGNMENTS=181 CHECKS=6009	UNSAT TT=0.804	UNSAT TT=0.601	UNSAT TT=0.04 CHECKS=2754	UNSAT TT=0.013 ASSIGNMENTS=173 CHECKS=5951	UNSAT TT=0.041 ASSIGNMENTS=5820 CHECKS=122320	UNSAT TT=0.397	UNSAT TT=0.012 ASSIGNMENTS=228 CHECKS=3612	UNSAT TT=0.011 ASSIGNMENTS=181 CHECKS=6009	UNSAT TT=0.876	UNSAT TT=0.023 ASSIGNMENTS=74 CHECKS=3047	UNSAT TT=0.74	UNSAT TT=0.741
csp/aim-100/ normalized-aim-100-2-0-unsat-2_ext.xml	UNSAT TT=0.013	UNSAT TT=0.99 CHECKS=8547 NODES=869	UNSAT TT=0.945 CHECKS=15082 NODES=1327	? (TO) TT=1800.07	UNSAT TT=0.079 CHECKS=49886	UNSAT TT=0.135 CHECKS=119309	UNSAT TT=0.671 ASSIGNMENTS=957	UNSAT TT=0.602 ASSIGNMENTS=371	UNSAT TT=0.481 CHECKS=7666 NODES=439	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.027 ASSIGNMENTS=872 CHECKS=26851	UNSAT TT=0.029 ASSIGNMENTS=872 CHECKS=26851	UNSAT TT=0.615	UNSAT TT=0.739	UNSAT TT=0.059 CHECKS=15480	UNSAT TT=0.017 ASSIGNMENTS=875 CHECKS=27836	UNSAT TT=0.043 ASSIGNMENTS=5835 CHECKS=130309	UNSAT TT=0.393	UNSAT TT=0.013 ASSIGNMENTS=427 CHECKS=8833	UNSAT TT=0.018 ASSIGNMENTS=872 CHECKS=26851	UNSAT TT=0.872	UNSAT TT=0.032 ASSIGNMENTS=263 CHECKS=13063	UNSAT TT=0.74	UNSAT TT=0.711
csp/aim-100/ normalized-aim-100-2-0-unsat-3_ext.xml	UNSAT TT=0.014	UNSAT TT=0.875 CHECKS=5497 NODES=672	UNSAT TT=0.88 CHECKS=4609 NODES=485	? (TO) TT=1800.05	UNSAT TT=0.098 CHECKS=61315	UNSAT TT=0.075 CHECKS=60036	UNSAT TT=0.765 ASSIGNMENTS=1532	UNSAT TT=1.178 ASSIGNMENTS=3895	UNSAT TT=0.439 CHECKS=1450 NODES=118	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.027 ASSIGNMENTS=718 CHECKS=17966	UNSAT TT=0.027 ASSIGNMENTS=718 CHECKS=17966	UNSAT TT=0.607	UNSAT TT=0.716	UNSAT TT=0.055 CHECKS=14314	UNSAT TT=0.016 ASSIGNMENTS=781 CHECKS=21279	UNSAT TT=0.043 ASSIGNMENTS=5849 CHECKS=128601	UNSAT TT=0.426	UNSAT TT=0.014 ASSIGNMENTS=311 CHECKS=5465	UNSAT TT=0.014 ASSIGNMENTS=718 CHECKS=17966	UNSAT TT=0.813	UNSAT TT=0.033 ASSIGNMENTS=428 CHECKS=20560	UNSAT TT=0.71	UNSAT TT=0.708
csp/aim-100/ normalized-aim-100-2-0-unsat-4_ext.xml	UNSAT TT=0.013	UNSAT TT=0.87 CHECKS=4386 NODES=605	UNSAT TT=0.871 CHECKS=4646 NODES=533	? (TO) TT=1800.07	UNSAT TT=0.057 CHECKS=28397	UNSAT TT=0.048 CHECKS=33238	UNSAT TT=0.678 ASSIGNMENTS=1228	UNSAT TT=0.748 ASSIGNMENTS=860	UNSAT TT=0.438 CHECKS=1931 NODES=160	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=0.027 ASSIGNMENTS=1286 CHECKS=26574	UNSAT TT=0.03 ASSIGNMENTS=1286 CHECKS=26574	UNSAT TT=0.595	UNSAT TT=0.592	UNSAT TT=0.061 CHECKS=12185	UNSAT TT=0.015 ASSIGNMENTS=693 CHECKS=17969	UNSAT TT=0.047 ASSIGNMENTS=6023 CHECKS=128980	UNSAT TT=0.394	UNSAT TT=0.013 ASSIGNMENTS=392 CHECKS=8781	UNSAT TT=0.017 ASSIGNMENTS=1286 CHECKS=26574	UNSAT TT=0.868	UNSAT TT=0.029 ASSIGNMENTS=316 CHECKS=20565	UNSAT TT=0.728	UNSAT TT=0.734
csp/aim-100/ normalized-aim-100-3-4-sat-1_ext.xml	SAT TT=0.017	SAT TT=0.943 CHECKS=6661 NODES=482	SAT TT=0.983 CHECKS=4564 NODES=260	SAT TT=0.096	SAT TT=0.04 CHECKS=20518	SAT TT=0.059 CHECKS=47645	SAT TT=0.588 ASSIGNMENTS=72	SAT TT=0.65 ASSIGNMENTS=43	SAT TT=0.49 CHECKS=6534 NODES=225	SAT TT=0.598 CHECKS=513932 NODES=13417	SAT TT=0.752 CHECKS=1443200 NODES=6733	SAT TT=0.031 ASSIGNMENTS=294 CHECKS=39044	SAT TT=0.034 ASSIGNMENTS=294 CHECKS=39044	SAT TT=1.109	SAT TT=1.333	SAT TT=0.073 CHECKS=26182	SAT TT=0.017 ASSIGNMENTS=146 CHECKS=12809	SAT TT=0.023 ASSIGNMENTS=502 CHECKS=47403	SAT TT=0.522	SAT TT=0.018 ASSIGNMENTS=288 CHECKS=24805	SAT TT=0.022 ASSIGNMENTS=294 CHECKS=39044	SAT TT=1.08	SAT TT=0.036 ASSIGNMENTS=356 CHECKS=32039	SAT TT=0.804	SAT TT=0.932
csp/aim-100/ normalized-aim-100-3-4-sat-2_ext.xml	SAT TT=0.016	SAT TT=0.941 CHECKS=15528 NODES=937	SAT TT=0.981 CHECKS=6237 NODES=487	SAT TT=0.138	SAT TT=0.045 CHECKS=25461	SAT TT=0.18 CHECKS=214568	SAT TT=0.757 ASSIGNMENTS=456	SAT TT=0.762 ASSIGNMENTS=225	SAT TT=0.5 CHECKS=5724 NODES=223	SAT TT=0.519 CHECKS=66552 NODES=1641	SAT TT=0.507 CHECKS=67361 NODES=597	SAT TT=0.027 ASSIGNMENTS=76 CHECKS=6737	SAT TT=0.027 ASSIGNMENTS=76 CHECKS=6737	SAT TT=1.25	SAT TT=1.214	SAT TT=0.078 CHECKS=22749	SAT TT=0.016 ASSIGNMENTS=112 CHECKS=11424	SAT TT=0.107 ASSIGNMENTS=4400 CHECKS=410169	SAT TT=0.528	SAT TT=0.018 ASSIGNMENTS=238 CHECKS=13364	SAT TT=0.016 ASSIGNMENTS=76 CHECKS=6737	SAT TT=1.007	SAT TT=0.037 ASSIGNMENTS=127 CHECKS=10643	SAT TT=0.879	SAT TT=0.921
csp/aim-100/ normalized-aim-100-3-4-sat-3_ext.xml	SAT TT=0.017	SAT TT=0.946 CHECKS=8184 NODES=554	SAT TT=1.105 CHECKS=6108 NODES=383	SAT TT=0.404	SAT TT=0.049 CHECKS=27040	SAT TT=0.079 CHECKS=81656	SAT TT=0.668 ASSIGNMENTS=237	SAT TT=0.854 ASSIGNMENTS=407	SAT TT=0.498 CHECKS=12536 NODES=319	SAT TT=1.883 CHECKS=5109430 NODES=135596	SAT TT=0.605 CHECKS=884700 NODES=4991	SAT TT=0.029 ASSIGNMENTS=213 CHECKS=24325	SAT TT=0.03 ASSIGNMENTS=213 CHECKS=24325	SAT TT=1.368	SAT TT=1.116	SAT TT=0.073 CHECKS=18507	SAT TT=0.017 ASSIGNMENTS=179 CHECKS=19251	SAT TT=0.101 ASSIGNMENTS=4148 CHECKS=370323	SAT TT=0.513	SAT TT=0.017 ASSIGNMENTS=195 CHECKS=12246	SAT TT=0.018 ASSIGNMENTS=213 CHECKS=24325	SAT TT=1.064	SAT TT=0.045 ASSIGNMENTS=306 CHECKS=35529	SAT TT=0.82	SAT TT=0.8
csp/aim-100/ normalized-aim-100-3-4-sat-4_ext.xml	SAT TT=0.015	SAT TT=1.043 CHECKS=12276 NODES=818	SAT TT=0.999 CHECKS=14267 NODES=951	SAT TT=0.122	SAT TT=0.038 CHECKS=16731	SAT TT=0.085 CHECKS=97262	SAT TT=0.753 ASSIGNMENTS=223	SAT TT=0.623 ASSIGNMENTS=78	SAT TT=0.501 CHECKS=3037 NODES=152	SAT TT=0.591 CHECKS=462611 NODES=12097	SAT TT=0.5 CHECKS=42780 NODES=370	SAT TT=0.027 ASSIGNMENTS=85 CHECKS=8617	SAT TT=0.028 ASSIGNMENTS=85 CHECKS=8617	SAT TT=1.115	SAT TT=1.184	SAT TT=0.062 CHECKS=7732	SAT TT=0.016 ASSIGNMENTS=102 CHECKS=11081	SAT TT=0.087 ASSIGNMENTS=4132 CHECKS=349463	SAT TT=0.442	SAT TT=0.023 ASSIGNMENTS=432 CHECKS=38569	SAT TT=0.015 ASSIGNMENTS=85 CHECKS=8617	SAT TT=0.961	SAT TT=0.057 ASSIGNMENTS=347 CHECKS=41517	SAT TT=0.831	SAT TT=0.872
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-100/ normalized-aim-100-6-0-sat-1_ext.xml	SAT TT=0.016	SAT TT=0.965 CHECKS=2044 NODES=127	SAT TT=0.982 CHECKS=2530 NODES=0	SAT TT=0.111	SAT TT=0.028 CHECKS=6997	SAT TT=0.033 CHECKS=12271	SAT TT=0.605 ASSIGNMENTS=1	SAT TT=0.622 ASSIGNMENTS=1	SAT TT=0.548 CHECKS=3151 NODES=123	SAT TT=3.935 CHECKS=10146500 NODES=150955	SAT TT=0.588 CHECKS=46368 NODES=200	SAT TT=0.032 ASSIGNMENTS=23 CHECKS=7338	SAT TT=0.033 ASSIGNMENTS=23 CHECKS=7338	SAT TT=1.338	SAT TT=1.222	SAT TT=0.067 CHECKS=4888	SAT TT=0.016 ASSIGNMENTS=17 CHECKS=3926	SAT TT=0.02 ASSIGNMENTS=32 CHECKS=9463	SAT TT=0.523	SAT TT=0.02 ASSIGNMENTS=66 CHECKS=5961	SAT TT=0.018 ASSIGNMENTS=23 CHECKS=7338	SAT TT=1.076	SAT TT=0.043 ASSIGNMENTS=146 CHECKS=24760	SAT TT=0.969	SAT TT=1.051
csp/aim-100/ normalized-aim-100-6-0-sat-2_ext.xml	SAT TT=0.018	SAT TT=1.039 CHECKS=4821 NODES=226	SAT TT=1.02 CHECKS=5772 NODES=210	SAT TT=0.118	SAT TT=0.041 CHECKS=15112	SAT TT=0.032 CHECKS=10693	SAT TT=0.792 ASSIGNMENTS=1	SAT TT=0.624 ASSIGNMENTS=1	SAT TT=0.694 CHECKS=2725 NODES=115	SAT TT=0.808 CHECKS=23695 NODES=236	SAT TT=0.598 CHECKS=63307 NODES=347	SAT TT=0.032 ASSIGNMENTS=27 CHECKS=6514	SAT TT=0.032 ASSIGNMENTS=27 CHECKS=6514	SAT TT=1.435	SAT TT=1.296	SAT TT=0.073 CHECKS=4909	SAT TT=0.02 ASSIGNMENTS=18 CHECKS=5475	SAT TT=0.024 ASSIGNMENTS=128 CHECKS=26139	SAT TT=0.56	SAT TT=0.018 ASSIGNMENTS=31 CHECKS=4629	SAT TT=0.021 ASSIGNMENTS=27 CHECKS=6514	SAT TT=1.14	SAT TT=0.043 ASSIGNMENTS=154 CHECKS=23821	SAT TT=0.904	SAT TT=1.104
csp/aim-100/ normalized-aim-100-6-0-sat-3_ext.xml	SAT TT=0.019	SAT TT=0.92 CHECKS=1876 NODES=116	SAT TT=0.938 CHECKS=3048 NODES=0	SAT TT=0.089	SAT TT=0.029 CHECKS=6762	SAT TT=0.031 CHECKS=11254	SAT TT=0.782 ASSIGNMENTS=1	SAT TT=0.633 ASSIGNMENTS=1	SAT TT=0.598 CHECKS=4664 NODES=146	SAT TT=3.681 CHECKS=10094400 NODES=150168	SAT TT=0.593 CHECKS=46215 NODES=171	SAT TT=0.032 ASSIGNMENTS=30 CHECKS=7329	SAT TT=0.033 ASSIGNMENTS=30 CHECKS=7329	SAT TT=1.445	SAT TT=1.222	SAT TT=0.068 CHECKS=5839	SAT TT=0.019 ASSIGNMENTS=22 CHECKS=6290	SAT TT=0.021 ASSIGNMENTS=72 CHECKS=13300	SAT TT=0.631	SAT TT=0.02 ASSIGNMENTS=65 CHECKS=5689	SAT TT=0.019 ASSIGNMENTS=30 CHECKS=7329	SAT TT=1.114	SAT TT=0.044 ASSIGNMENTS=172 CHECKS=29147	SAT TT=0.898	SAT TT=0.864
csp/aim-100/ normalized-aim-100-6-0-sat-4_ext.xml	SAT TT=0.017	SAT TT=1.004 CHECKS=3682 NODES=177	SAT TT=1.05 CHECKS=7157 NODES=289	SAT TT=0.121	SAT TT=0.034 CHECKS=11086	SAT TT=0.026 CHECKS=4382	SAT TT=0.78 ASSIGNMENTS=1	SAT TT=0.719 ASSIGNMENTS=1	SAT TT=0.632 CHECKS=7841 NODES=182	SAT TT=6.771 CHECKS=20423200 NODES=300527	SAT TT=0.593 CHECKS=34954 NODES=70	SAT TT=0.03 ASSIGNMENTS=4 CHECKS=1706	SAT TT=0.031 ASSIGNMENTS=4 CHECKS=1706	SAT TT=1.352	SAT TT=1.318	SAT TT=0.072 CHECKS=1088	SAT TT=0.019 ASSIGNMENTS=4 CHECKS=1706	SAT TT=0.021 ASSIGNMENTS=57 CHECKS=12723	SAT TT=0.525	SAT TT=0.017 ASSIGNMENTS=19 CHECKS=2722	SAT TT=0.018 ASSIGNMENTS=4 CHECKS=1706	SAT TT=1.131	SAT TT=0.054 ASSIGNMENTS=200 CHECKS=39342	SAT TT=0.911	SAT TT=0.927
csp/aim-200/ normalized-aim-200-1-6-sat-1_ext.xml	SAT TT=0.021	SAT TT=1.023 CHECKS=11029 NODES=1166	SAT TT=1.009 CHECKS=11207 NODES=1361	? (TO) TT=1800.1	SAT TT=0.025 CHECKS=5722	SAT TT=0.204 CHECKS=165656	SAT TT=0.641 ASSIGNMENTS=109	SAT TT=0.743 ASSIGNMENTS=19	SAT TT=0.603 CHECKS=8905 NODES=650	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=0.037 ASSIGNMENTS=1258 CHECKS=41486	SAT TT=0.039 ASSIGNMENTS=1258 CHECKS=41486	SAT TT=1.269	SAT TT=1.478	SAT TT=0.071 CHECKS=11265	SAT TT=0.021 ASSIGNMENTS=609 CHECKS=20957	SAT TT=0.05 ASSIGNMENTS=9439 CHECKS=133351	SAT TT=0.498	SAT TT=0.036 ASSIGNMENTS=1849 CHECKS=77436	SAT TT=0.024 ASSIGNMENTS=1258 CHECKS=41486	SAT TT=1.097	SAT TT=0.097 ASSIGNMENTS=1397 CHECKS=86627	SAT TT=0.945	SAT TT=1.021
csp/aim-200/ normalized-aim-200-1-6-sat-2_ext.xml	SAT TT=0.026	SAT TT=1.038 CHECKS=21578 NODES=2333	SAT TT=1.121 CHECKS=27461 NODES=2783	? (TO) TT=1800.1	SAT TT=0.026 CHECKS=7575	SAT TT=0.128 CHECKS=90276	SAT TT=0.853 ASSIGNMENTS=1705	SAT TT=1.215 ASSIGNMENTS=2429	SAT TT=0.661 CHECKS=19083 NODES=1445	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.044 ASSIGNMENTS=1785 CHECKS=71585	SAT TT=0.047 ASSIGNMENTS=1785 CHECKS=71585	SAT TT=1.26	SAT TT=1.469	SAT TT=0.112 CHECKS=63908	SAT TT=0.027 ASSIGNMENTS=1700 CHECKS=57651	SAT TT=0.047 ASSIGNMENTS=8708 CHECKS=122936	SAT TT=0.512	SAT TT=0.04 ASSIGNMENTS=2623 CHECKS=85927	SAT TT=0.03 ASSIGNMENTS=1785 CHECKS=71585	SAT TT=1.222	SAT TT=0.102 ASSIGNMENTS=530 CHECKS=35411	SAT TT=0.819	SAT TT=0.82
csp/aim-200/ normalized-aim-200-1-6-sat-3_ext.xml	SAT TT=0.023	SAT TT=1.179 CHECKS=32189 NODES=2509	SAT TT=1.069 CHECKS=15908 NODES=1648	? (TO) TT=1800.03	SAT TT=0.025 CHECKS=8897	SAT TT=0.146 CHECKS=106726	SAT TT=0.849 ASSIGNMENTS=1238	SAT TT=1.042 ASSIGNMENTS=1571	SAT TT=0.623 CHECKS=15885 NODES=959	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=0.045 ASSIGNMENTS=1565 CHECKS=70607	SAT TT=0.044 ASSIGNMENTS=1565 CHECKS=70607	SAT TT=1.481	SAT TT=1.238	SAT TT=0.116 CHECKS=76676	SAT TT=0.031 ASSIGNMENTS=1334 CHECKS=71623	SAT TT=0.042 ASSIGNMENTS=8616 CHECKS=102589	SAT TT=0.503	SAT TT=0.023 ASSIGNMENTS=986 CHECKS=25428	SAT TT=0.033 ASSIGNMENTS=1565 CHECKS=70607	SAT TT=1.179	SAT TT=0.132 ASSIGNMENTS=527 CHECKS=25946	SAT TT=0.954	SAT TT=1.016
csp/aim-200/ normalized-aim-200-1-6-sat-4_ext.xml	SAT TT=0.018	SAT TT=0.964 CHECKS=7397 NODES=1227	SAT TT=0.992 CHECKS=8749 NODES=1302	? (TO) TT=1800.08	SAT TT=0.832 CHECKS=539750	SAT TT=0.222 CHECKS=158736	SAT TT=0.809 ASSIGNMENTS=1357	SAT TT=1.338 ASSIGNMENTS=3798	SAT TT=0.632 CHECKS=7270 NODES=805	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=0.357 ASSIGNMENTS=41221 CHECKS=1176040	SAT TT=0.358 ASSIGNMENTS=41221 CHECKS=1176040	SAT TT=1.212	SAT TT=1.349	SAT TT=0.137 CHECKS=59179	SAT TT=0.05 ASSIGNMENTS=3998 CHECKS=144523	SAT TT=0.053 ASSIGNMENTS=9562 CHECKS=142737	SAT TT=0.512	SAT TT=0.018 ASSIGNMENTS=754 CHECKS=15506	SAT TT=0.303 ASSIGNMENTS=41221 CHECKS=1176040	SAT TT=1.168	SAT TT=0.174 ASSIGNMENTS=615 CHECKS=26419	SAT TT=0.896	SAT TT=1.013
csp/aim-200/ normalized-aim-200-1-6-unsat-1_ext.xml	UNSAT TT=0.1	UNSAT TT=1.264 CHECKS=67766 NODES=6260	UNSAT TT=1.451 CHECKS=110235 NODES=9963	? (TO) TT=1800.04	UNSAT TT=0.256 CHECKS=120605	UNSAT TT=0.205 CHECKS=104252	UNSAT TT=4.365 ASSIGNMENTS=39464	UNSAT TT=0.72 ASSIGNMENTS=388	UNSAT TT=1.024 CHECKS=37586 NODES=2541	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=0.312 ASSIGNMENTS=27682 CHECKS=850312	UNSAT TT=0.31 ASSIGNMENTS=27682 CHECKS=850312	UNSAT TT=0.861	UNSAT TT=0.726	UNSAT TT=0.15 CHECKS=62782	UNSAT TT=0.1 ASSIGNMENTS=11794 CHECKS=290551	UNSAT TT=0.075 ASSIGNMENTS=14419 CHECKS=218094	UNSAT TT=0.664	UNSAT TT=0.102 ASSIGNMENTS=8725 CHECKS=213659	UNSAT TT=0.263 ASSIGNMENTS=27682 CHECKS=850312	UNSAT TT=1.03	UNSAT TT=0.916 ASSIGNMENTS=14738 CHECKS=706070	UNSAT TT=0.918	UNSAT TT=0.819
csp/aim-200/ normalized-aim-200-1-6-unsat-2_ext.xml	UNSAT TT=0.093	UNSAT TT=3.051 CHECKS=677790 NODES=48377	UNSAT TT=2.433 CHECKS=421570 NODES=31169	? (TO) TT=1800.03	UNSAT TT=3.092 CHECKS=1519030	UNSAT TT=1.667 CHECKS=770360	UNSAT TT=37.926 ASSIGNMENTS=461040	UNSAT TT=0.801 ASSIGNMENTS=874	UNSAT TT=1.841 CHECKS=144456 NODES=8846	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.978 ASSIGNMENTS=108309 CHECKS=2758150	UNSAT TT=1.067 ASSIGNMENTS=108309 CHECKS=2758150	UNSAT TT=0.828	UNSAT TT=0.813	UNSAT TT=0.143 CHECKS=67087	UNSAT TT=1.139 ASSIGNMENTS=149653 CHECKS=3776660	UNSAT TT=0.073 ASSIGNMENTS=14253 CHECKS=194678	UNSAT TT=1.602	UNSAT TT=0.093 ASSIGNMENTS=7273 CHECKS=175856	UNSAT TT=0.908 ASSIGNMENTS=108309 CHECKS=2758150	UNSAT TT=1.058	UNSAT TT=1.673 ASSIGNMENTS=35817 CHECKS=1422050	UNSAT TT=0.83	UNSAT TT=0.863
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-200/ normalized-aim-200-1-6-unsat-3_ext.xml	UNSAT TT=0.276	UNSAT TT=1.389 CHECKS=104910 NODES=9817	UNSAT TT=1.507 CHECKS=130883 NODES=11569	? (TO) TT=1800.09	UNSAT TT=0.422 CHECKS=170407	UNSAT TT=78.245 CHECKS=35596400	UNSAT TT=7.519 ASSIGNMENTS=84406	UNSAT TT=2.227 ASSIGNMENTS=10764	UNSAT TT=2.588 CHECKS=216789 NODES=16453	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=0.703 ASSIGNMENTS=73965 CHECKS=1857130	UNSAT TT=0.698 ASSIGNMENTS=73965 CHECKS=1857130	UNSAT TT=0.865	UNSAT TT=0.87	UNSAT TT=0.276 CHECKS=139662	UNSAT TT=0.507 ASSIGNMENTS=66263 CHECKS=1642260	UNSAT TT=0.109 ASSIGNMENTS=19351 CHECKS=326320	UNSAT TT=1.324	UNSAT TT=0.294 ASSIGNMENTS=27068 CHECKS=612829	UNSAT TT=0.593 ASSIGNMENTS=73965 CHECKS=1857130	UNSAT TT=1.103	UNSAT TT=3.412 ASSIGNMENTS=62281 CHECKS=2719140	UNSAT TT=0.912	UNSAT TT=0.896
csp/aim-200/ normalized-aim-200-1-6-unsat-4_ext.xml	UNSAT TT=0.05	UNSAT TT=1.056 CHECKS=15911 NODES=1987	UNSAT TT=1.538 CHECKS=11586 NODES=1400	? (TO) TT=1800.05	UNSAT TT=0.178 CHECKS=77417	UNSAT TT=0.318 CHECKS=180038	UNSAT TT=1.119 ASSIGNMENTS=5150	UNSAT TT=1.109 ASSIGNMENTS=2687	UNSAT TT=0.681 CHECKS=16675 NODES=1360	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=0.086 ASSIGNMENTS=7381 CHECKS=203222	UNSAT TT=0.091 ASSIGNMENTS=7381 CHECKS=203222	UNSAT TT=0.674	UNSAT TT=0.683	UNSAT TT=0.087 CHECKS=31357	UNSAT TT=0.083 ASSIGNMENTS=10013 CHECKS=256527	UNSAT TT=0.05 ASSIGNMENTS=12665 CHECKS=137656	UNSAT TT=0.56	UNSAT TT=0.05 ASSIGNMENTS=4130 CHECKS=90804	UNSAT TT=0.071 ASSIGNMENTS=7381 CHECKS=203222	UNSAT TT=0.959	UNSAT TT=0.24 ASSIGNMENTS=4722 CHECKS=221193	UNSAT TT=0.825	UNSAT TT=0.821
csp/aim-200/ normalized-aim-200-2-0-sat-1_ext.xml	SAT TT=0.046	SAT TT=2.502 CHECKS=509422 NODES=31016	SAT TT=1.179 CHECKS=33816 NODES=3318	? (TO) TT=1800.09	SAT TT=0.046 CHECKS=28612	SAT TT=18.735 CHECKS=16294500	SAT TT=7.138 ASSIGNMENTS=47554	SAT TT=29.794 ASSIGNMENTS=202059	SAT TT=0.812 CHECKS=37256 NODES=2001	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=0.709 ASSIGNMENTS=58735 CHECKS=2402750	SAT TT=0.653 ASSIGNMENTS=58735 CHECKS=2402750	SAT TT=1.503	SAT TT=1.287	SAT TT=0.37 CHECKS=292603	SAT TT=0.603 ASSIGNMENTS=54680 CHECKS=2571650	SAT TT=0.102 ASSIGNMENTS=12374 CHECKS=350327	SAT TT=0.531	SAT TT=0.091 ASSIGNMENTS=6849 CHECKS=246887	SAT TT=0.591 ASSIGNMENTS=58735 CHECKS=2402750	SAT TT=1.268	SAT TT=0.475 ASSIGNMENTS=8167 CHECKS=384294	SAT TT=0.935	SAT TT=0.936
csp/aim-200/ normalized-aim-200-2-0-sat-2_ext.xml	SAT TT=0.032	SAT TT=1.385 CHECKS=90938 NODES=7751	SAT TT=1.349 CHECKS=33199 NODES=3333	? (TO) TT=1800.07	SAT TT=0.032 CHECKS=17918	SAT TT=6.167 CHECKS=5789110	SAT TT=0.892 ASSIGNMENTS=1436	SAT TT=3.513 ASSIGNMENTS=19117	SAT TT=0.781 CHECKS=8773 NODES=742	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=0.307 ASSIGNMENTS=23234 CHECKS=1092160	SAT TT=0.31 ASSIGNMENTS=23234 CHECKS=1092160	SAT TT=1.207	SAT TT=1.204	SAT TT=0.251 CHECKS=190932	SAT TT=0.521 ASSIGNMENTS=41838 CHECKS=2010540	SAT TT=0.097 ASSIGNMENTS=9997 CHECKS=325862	SAT TT=0.533	SAT TT=0.069 ASSIGNMENTS=4727 CHECKS=180051	SAT TT=0.271 ASSIGNMENTS=23234 CHECKS=1092160	SAT TT=1.112	SAT TT=0.968 ASSIGNMENTS=14745 CHECKS=862607	SAT TT=0.894	SAT TT=0.895
csp/aim-200/ normalized-aim-200-2-0-sat-3_ext.xml	SAT TT=0.032	SAT TT=1.125 CHECKS=14497 NODES=1701	SAT TT=1.042 CHECKS=7096 NODES=925	? (TO) TT=1800.05	SAT TT=0.255 CHECKS=168239	SAT TT=0.316 CHECKS=226718	SAT TT=1.743 ASSIGNMENTS=6899	SAT TT=1.063 ASSIGNMENTS=1944	SAT TT=0.606 CHECKS=9252 NODES=730	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.091 ASSIGNMENTS=5275 CHECKS=225910	SAT TT=0.089 ASSIGNMENTS=5275 CHECKS=225910	SAT TT=1.203	SAT TT=1.613	SAT TT=0.171 CHECKS=142569	SAT TT=0.085 ASSIGNMENTS=6760 CHECKS=300611	SAT TT=0.061 ASSIGNMENTS=7833 CHECKS=194761	SAT TT=0.665	SAT TT=0.032 ASSIGNMENTS=1322 CHECKS=42443	SAT TT=0.071 ASSIGNMENTS=5275 CHECKS=225910	SAT TT=1.115	SAT TT=0.151 ASSIGNMENTS=2780 CHECKS=157815	SAT TT=0.942	SAT TT=0.875
csp/aim-200/ normalized-aim-200-2-0-sat-4_ext.xml	SAT TT=0.175	SAT TT=2.376 CHECKS=376081 NODES=28342	SAT TT=1.705 CHECKS=196506 NODES=16455	? (TO) TT=1800.04	SAT TT=4.083 CHECKS=2413160	SAT TT=2.077 CHECKS=1719160	SAT TT=46.733 ASSIGNMENTS=353502	? (TO) TT=1800.06	SAT TT=1.91 CHECKS=196169 NODES=8579	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=0.206 ASSIGNMENTS=14504 CHECKS=662745	SAT TT=0.206 ASSIGNMENTS=14504 CHECKS=662745	SAT TT=1.448	SAT TT=1.523	SAT TT=0.711 CHECKS=712031	SAT TT=0.285 ASSIGNMENTS=26656 CHECKS=1104880	SAT TT=0.094 ASSIGNMENTS=11292 CHECKS=324048	SAT TT=0.499	SAT TT=0.262 ASSIGNMENTS=15794 CHECKS=829886	SAT TT=0.175 ASSIGNMENTS=14504 CHECKS=662745	SAT TT=1.414	SAT TT=0.793 ASSIGNMENTS=9140 CHECKS=390879	SAT TT=0.873	SAT TT=0.969
csp/aim-200/ normalized-aim-200-2-0-unsat-1_ext.xml	UNSAT TT=0.124	UNSAT TT=1.496 CHECKS=100732 NODES=8897	UNSAT TT=1.127 CHECKS=30931 NODES=3274	? (TO) TT=1800.09	UNSAT TT=0.492 CHECKS=220768	UNSAT TT=0.183 CHECKS=107427	UNSAT TT=3.701 ASSIGNMENTS=30063	UNSAT TT=11.176 ASSIGNMENTS=66909	UNSAT TT=0.664 CHECKS=8545 NODES=667	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.194 ASSIGNMENTS=18507 CHECKS=542051	UNSAT TT=0.192 ASSIGNMENTS=18507 CHECKS=542051	UNSAT TT=0.76	UNSAT TT=0.76	UNSAT TT=0.146 CHECKS=69081	UNSAT TT=0.175 ASSIGNMENTS=19989 CHECKS=615076	UNSAT TT=0.084 ASSIGNMENTS=11603 CHECKS=254715	UNSAT TT=0.95	UNSAT TT=0.124 ASSIGNMENTS=10621 CHECKS=276575	UNSAT TT=0.155 ASSIGNMENTS=18507 CHECKS=542051	UNSAT TT=1.129	UNSAT TT=0.136 ASSIGNMENTS=1919 CHECKS=101622	UNSAT TT=0.94	UNSAT TT=1.054
csp/aim-200/ normalized-aim-200-2-0-unsat-2_ext.xml	UNSAT TT=0.046	UNSAT TT=1.146 CHECKS=26963 NODES=2887	UNSAT TT=1.199 CHECKS=34097 NODES=3269	? (TO) TT=1800.11	UNSAT TT=0.224 CHECKS=87525	UNSAT TT=0.357 CHECKS=181892	UNSAT TT=1.433 ASSIGNMENTS=4914	UNSAT TT=4.173 ASSIGNMENTS=19399	UNSAT TT=0.93 CHECKS=31031 NODES=2304	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.062 ASSIGNMENTS=3620 CHECKS=111557	UNSAT TT=0.061 ASSIGNMENTS=3620 CHECKS=111557	UNSAT TT=0.979	UNSAT TT=0.776	UNSAT TT=0.13 CHECKS=49335	UNSAT TT=0.073 ASSIGNMENTS=6305 CHECKS=214256	UNSAT TT=0.075 ASSIGNMENTS=10094 CHECKS=221725	UNSAT TT=0.584	UNSAT TT=0.046 ASSIGNMENTS=2686 CHECKS=74315	UNSAT TT=0.046 ASSIGNMENTS=3620 CHECKS=111557	UNSAT TT=1.125	UNSAT TT=0.157 ASSIGNMENTS=2646 CHECKS=145444	UNSAT TT=0.952	UNSAT TT=0.957
csp/aim-200/ normalized-aim-200-2-0-unsat-3_ext.xml	UNSAT TT=0.023	UNSAT TT=0.964 CHECKS=3008 NODES=498	UNSAT TT=1.008 CHECKS=2641 NODES=396	? (TO) TT=1800.06	UNSAT TT=0.176 CHECKS=79911	UNSAT TT=0.189 CHECKS=110388	UNSAT TT=1.082 ASSIGNMENTS=2556	UNSAT TT=2.867 ASSIGNMENTS=11250	UNSAT TT=0.742 CHECKS=16718 NODES=1263	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.057 ASSIGNMENTS=3802 CHECKS=120210	UNSAT TT=0.061 ASSIGNMENTS=3802 CHECKS=120210	UNSAT TT=0.747	UNSAT TT=0.751	UNSAT TT=0.095 CHECKS=30919	UNSAT TT=0.03 ASSIGNMENTS=1966 CHECKS=68850	UNSAT TT=0.068 ASSIGNMENTS=8470 CHECKS=193920	UNSAT TT=0.576	UNSAT TT=0.023 ASSIGNMENTS=862 CHECKS=17811	UNSAT TT=0.046 ASSIGNMENTS=3802 CHECKS=120210	UNSAT TT=1.065	UNSAT TT=0.059 ASSIGNMENTS=566 CHECKS=29479	UNSAT TT=0.951	UNSAT TT=0.898
csp/aim-200/ normalized-aim-200-2-0-unsat-4_ext.xml	UNSAT TT=0.027	UNSAT TT=1.121 CHECKS=17162 NODES=1811	UNSAT TT=1.147 CHECKS=17871 NODES=1904	? (TO) TT=1800.02	UNSAT TT=0.173 CHECKS=84008	UNSAT TT=0.153 CHECKS=81889	UNSAT TT=1.032 ASSIGNMENTS=3557	UNSAT TT=3.432 ASSIGNMENTS=17814	UNSAT TT=0.603 CHECKS=3927 NODES=321	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=0.055 ASSIGNMENTS=3197 CHECKS=87383	UNSAT TT=0.05 ASSIGNMENTS=3197 CHECKS=87383	UNSAT TT=0.771	UNSAT TT=0.764	UNSAT TT=0.1 CHECKS=35971	UNSAT TT=0.041 ASSIGNMENTS=3174 CHECKS=90460	UNSAT TT=0.061 ASSIGNMENTS=8835 CHECKS=190029	UNSAT TT=0.711	UNSAT TT=0.027 ASSIGNMENTS=1056 CHECKS=25418	UNSAT TT=0.039 ASSIGNMENTS=3197 CHECKS=87383	UNSAT TT=1.055	UNSAT TT=0.072 ASSIGNMENTS=438 CHECKS=23736	UNSAT TT=0.921	UNSAT TT=0.897
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-200/ normalized-aim-200-3-4-sat-1_ext.xml	SAT TT=0.116	SAT TT=1.438 CHECKS=93593 NODES=5310	SAT TT=1.421 CHECKS=73136 NODES=4319	SAT TT=413.578	SAT TT=0.518 CHECKS=369488	SAT TT=0.492 CHECKS=467978	SAT TT=1.556 ASSIGNMENTS=1852	SAT TT=10.808 ASSIGNMENTS=31820	SAT TT=0.715 CHECKS=10639 NODES=442	SAT TT=352.153 CHECKS=1088850000 NODES=28182200	SAT TT=1.366 CHECKS=4638590 NODES=16290	SAT TT=0.14 ASSIGNMENTS=3560 CHECKS=486082	SAT TT=0.139 ASSIGNMENTS=3560 CHECKS=486082	SAT TT=1.529	SAT TT=1.409	SAT TT=0.462 CHECKS=418968	SAT TT=0.233 ASSIGNMENTS=7498 CHECKS=1105960	SAT TT=0.176 ASSIGNMENTS=7192 CHECKS=692968	SAT TT=0.769	SAT TT=0.183 ASSIGNMENTS=4164 CHECKS=691528	SAT TT=0.116 ASSIGNMENTS=3560 CHECKS=486082	SAT TT=1.397	SAT TT=1.176 ASSIGNMENTS=8014 CHECKS=1132020	SAT TT=1.049	SAT TT=1.157
csp/aim-200/ normalized-aim-200-3-4-sat-2_ext.xml	SAT TT=0.034	SAT TT=1.338 CHECKS=40974 NODES=2306	SAT TT=1.666 CHECKS=112624 NODES=5354	SAT TT=107.806	SAT TT=1.966 CHECKS=1477930	SAT TT=13.628 CHECKS=12124700	SAT TT=1.235 ASSIGNMENTS=1220	SAT TT=6.407 ASSIGNMENTS=16146	SAT TT=2.126 CHECKS=253720 NODES=4472	SAT TT=166.171 CHECKS=502942000 NODES=13125200	SAT TT=0.649 CHECKS=195193 NODES=1584	SAT TT=0.044 ASSIGNMENTS=437 CHECKS=56321	SAT TT=0.047 ASSIGNMENTS=437 CHECKS=56321	SAT TT=1.463	SAT TT=1.35	SAT TT=0.165 CHECKS=117131	SAT TT=0.051 ASSIGNMENTS=943 CHECKS=135046	SAT TT=0.197 ASSIGNMENTS=7621 CHECKS=864733	SAT TT=0.71	SAT TT=0.034 ASSIGNMENTS=514 CHECKS=51939	SAT TT=0.034 ASSIGNMENTS=437 CHECKS=56321	SAT TT=1.515	SAT TT=0.262 ASSIGNMENTS=557 CHECKS=73910	SAT TT=1.182	SAT TT=1.196
csp/aim-200/ normalized-aim-200-3-4-sat-3_ext.xml	SAT TT=0.045	SAT TT=3.706 CHECKS=798771 NODES=33688	SAT TT=1.442 CHECKS=91923 NODES=5269	SAT TT=60.547	SAT TT=0.523 CHECKS=387775	SAT TT=19.96 CHECKS=20156900	SAT TT=1.18 ASSIGNMENTS=810	SAT TT=1.378 ASSIGNMENTS=1644	SAT TT=0.751 CHECKS=24165 NODES=722	SAT TT=216.284 CHECKS=622232000 NODES=16217800	SAT TT=0.666 CHECKS=395939 NODES=2427	SAT TT=0.081 ASSIGNMENTS=1137 CHECKS=202171	SAT TT=0.073 ASSIGNMENTS=1137 CHECKS=202171	SAT TT=1.317	SAT TT=1.322	SAT TT=0.217 CHECKS=183005	SAT TT=0.055 ASSIGNMENTS=883 CHECKS=168949	SAT TT=0.279 ASSIGNMENTS=9229 CHECKS=1203210	SAT TT=0.619	SAT TT=0.045 ASSIGNMENTS=1158 CHECKS=115570	SAT TT=0.062 ASSIGNMENTS=1137 CHECKS=202171	SAT TT=1.416	SAT TT=0.965 ASSIGNMENTS=3868 CHECKS=631658	SAT TT=0.922	SAT TT=1.094
csp/aim-200/ normalized-aim-200-3-4-sat-4_ext.xml	SAT TT=0.055	SAT TT=1.184 CHECKS=10487 NODES=924	SAT TT=1.327 CHECKS=24349 NODES=1947	SAT TT=311.112	SAT TT=0.335 CHECKS=230256	SAT TT=0.551 CHECKS=559767	SAT TT=15.809 ASSIGNMENTS=42294	SAT TT=6.634 ASSIGNMENTS=18009	SAT TT=0.758 CHECKS=25332 NODES=607	SAT TT=281.764 CHECKS=874114000 NODES=22651800	? (TO) TT=1800.03	SAT TT=0.084 ASSIGNMENTS=1574 CHECKS=247251	SAT TT=0.087 ASSIGNMENTS=1574 CHECKS=247251	SAT TT=1.63	SAT TT=1.492	SAT TT=0.416 CHECKS=419268	SAT TT=0.223 ASSIGNMENTS=6134 CHECKS=985469	SAT TT=0.135 ASSIGNMENTS=5594 CHECKS=561550	SAT TT=0.665	SAT TT=0.055 ASSIGNMENTS=1203 CHECKS=140078	SAT TT=0.072 ASSIGNMENTS=1574 CHECKS=247251	SAT TT=1.281	SAT TT=0.212 ASSIGNMENTS=742 CHECKS=106897	SAT TT=1.065	SAT TT=1.054
csp/aim-200/ normalized-aim-200-6-0-sat-1_ext.xml	SAT TT=0.036	SAT TT=1.345 CHECKS=9742 NODES=442	SAT TT=1.097 CHECKS=4705 NODES=0	SAT TT=0.523	SAT TT=0.111 CHECKS=45356	SAT TT=0.196 CHECKS=159928	SAT TT=0.935 ASSIGNMENTS=8	SAT TT=0.788 ASSIGNMENTS=2	SAT TT=0.803 CHECKS=3850 NODES=223	SAT TT=5.497 CHECKS=10526400 NODES=152155	SAT TT=0.823 CHECKS=149257 NODES=667	SAT TT=0.057 ASSIGNMENTS=158 CHECKS=62878	SAT TT=0.058 ASSIGNMENTS=158 CHECKS=62878	SAT TT=1.688	SAT TT=1.588	SAT TT=0.22 CHECKS=147498	SAT TT=0.04 ASSIGNMENTS=124 CHECKS=39264	SAT TT=0.15 ASSIGNMENTS=2367 CHECKS=624995	SAT TT=0.672	SAT TT=0.036 ASSIGNMENTS=26 CHECKS=5553	SAT TT=0.044 ASSIGNMENTS=158 CHECKS=62878	SAT TT=1.758	SAT TT=0.105 ASSIGNMENTS=385 CHECKS=60565	SAT TT=0.995	SAT TT=1.02
csp/aim-200/ normalized-aim-200-6-0-sat-2_ext.xml	SAT TT=0.052	SAT TT=1.216 CHECKS=11440 NODES=519	SAT TT=1.158 CHECKS=8092 NODES=383	SAT TT=31.235	SAT TT=0.533 CHECKS=356619	SAT TT=0.197 CHECKS=155651	SAT TT=1.283 ASSIGNMENTS=411	SAT TT=0.783 ASSIGNMENTS=39	SAT TT=0.926 CHECKS=29892 NODES=447	SAT TT=4.999 CHECKS=10526500 NODES=150831	SAT TT=0.769 CHECKS=119405 NODES=156	SAT TT=0.092 ASSIGNMENTS=721 CHECKS=279403	SAT TT=0.096 ASSIGNMENTS=721 CHECKS=279403	SAT TT=1.499	SAT TT=1.737	SAT TT=0.105 CHECKS=26070	SAT TT=0.073 ASSIGNMENTS=614 CHECKS=250029	SAT TT=0.208 ASSIGNMENTS=4241 CHECKS=1039110	SAT TT=0.729	SAT TT=0.052 ASSIGNMENTS=566 CHECKS=121971	SAT TT=0.085 ASSIGNMENTS=721 CHECKS=279403	SAT TT=1.866	SAT TT=0.189 ASSIGNMENTS=748 CHECKS=223057	SAT TT=0.973	SAT TT=1.068
csp/aim-200/ normalized-aim-200-6-0-sat-3_ext.xml	SAT TT=0.034	SAT TT=1.231 CHECKS=15252 NODES=617	SAT TT=1.189 CHECKS=6741 NODES=321	SAT TT=59.204	SAT TT=0.08 CHECKS=35355	SAT TT=0.548 CHECKS=483646	SAT TT=0.806 ASSIGNMENTS=14	SAT TT=0.853 ASSIGNMENTS=4	SAT TT=0.785 CHECKS=9732 NODES=253	SAT TT=9.23 CHECKS=20811000 NODES=300337	SAT TT=0.827 CHECKS=130517 NODES=310	SAT TT=0.049 ASSIGNMENTS=74 CHECKS=24294	SAT TT=0.05 ASSIGNMENTS=74 CHECKS=24294	SAT TT=1.755	SAT TT=1.581	SAT TT=0.125 CHECKS=48290	SAT TT=0.045 ASSIGNMENTS=235 CHECKS=83036	SAT TT=0.047 ASSIGNMENTS=256 CHECKS=70039	SAT TT=0.67	SAT TT=0.04 ASSIGNMENTS=272 CHECKS=27161	SAT TT=0.034 ASSIGNMENTS=74 CHECKS=24294	SAT TT=1.914	SAT TT=0.129 ASSIGNMENTS=266 CHECKS=31352	SAT TT=1.07	SAT TT=1.234
csp/aim-200/ normalized-aim-200-6-0-sat-4_ext.xml	SAT TT=0.04	SAT TT=1.452 CHECKS=63138 NODES=2466	SAT TT=1.201 CHECKS=5346 NODES=0	SAT TT=11.757	SAT TT=0.209 CHECKS=106012	SAT TT=0.363 CHECKS=295753	SAT TT=0.996 ASSIGNMENTS=306	SAT TT=0.744 ASSIGNMENTS=28	SAT TT=0.976 CHECKS=28293 NODES=456	SAT TT=23.469 CHECKS=51751700 NODES=750589	SAT TT=0.818 CHECKS=120736 NODES=229	SAT TT=0.068 ASSIGNMENTS=420 CHECKS=151332	SAT TT=0.067 ASSIGNMENTS=420 CHECKS=151332	SAT TT=1.589	SAT TT=1.49	SAT TT=0.427 CHECKS=357619	SAT TT=0.129 ASSIGNMENTS=1323 CHECKS=533288	SAT TT=0.237 ASSIGNMENTS=4339 CHECKS=1104890	SAT TT=0.662	SAT TT=0.04 ASSIGNMENTS=300 CHECKS=37101	SAT TT=0.061 ASSIGNMENTS=420 CHECKS=151332	SAT TT=1.91	SAT TT=0.257 ASSIGNMENTS=341 CHECKS=76300	SAT TT=1.226	SAT TT=1.019
csp/aim-50/ normalized-aim-50-1-6-sat-1_ext.xml	SAT TT=0.007	SAT TT=0.745 CHECKS=2808 NODES=322	SAT TT=0.771 CHECKS=1463 NODES=207	SAT TT=0.086	SAT TT=0.009 CHECKS=1187	SAT TT=0.021 CHECKS=17728	SAT TT=0.434 ASSIGNMENTS=7	SAT TT=0.405 ASSIGNMENTS=3	SAT TT=0.392 CHECKS=1226 NODES=130	SAT TT=127.314 CHECKS=468919000 NODES=81600600	SAT TT=0.373 CHECKS=127074 NODES=1243	SAT TT=0.023 ASSIGNMENTS=309 CHECKS=9070	SAT TT=0.023 ASSIGNMENTS=309 CHECKS=9070	SAT TT=0.782	SAT TT=0.861	SAT TT=0.034 CHECKS=2062	SAT TT=0.009 ASSIGNMENTS=312 CHECKS=7820	SAT TT=0.021 ASSIGNMENTS=4316 CHECKS=62439	SAT TT=0.322	SAT TT=0.007 ASSIGNMENTS=77 CHECKS=964	SAT TT=0.011 ASSIGNMENTS=309 CHECKS=9070	SAT TT=0.737	SAT TT=0.015 ASSIGNMENTS=124 CHECKS=2506	SAT TT=0.59	SAT TT=0.607
csp/aim-50/ normalized-aim-50-1-6-sat-2_ext.xml	SAT TT=0.006	SAT TT=0.766 CHECKS=792 NODES=132	SAT TT=0.68 CHECKS=325 NODES=0	SAT TT=0.136	SAT TT=0.012 CHECKS=958	SAT TT=0.011 CHECKS=2502	SAT TT=0.427 ASSIGNMENTS=1	SAT TT=0.436 ASSIGNMENTS=1	SAT TT=0.366 CHECKS=1717 NODES=118	SAT TT=2.881 CHECKS=8895340 NODES=1800060	SAT TT=0.347 CHECKS=25091 NODES=284	SAT TT=0.02 ASSIGNMENTS=51 CHECKS=1416	SAT TT=0.02 ASSIGNMENTS=51 CHECKS=1416	SAT TT=0.974	SAT TT=0.796	SAT TT=0.034 CHECKS=1167	SAT TT=0.008 ASSIGNMENTS=57 CHECKS=2605	SAT TT=0.01 ASSIGNMENTS=769 CHECKS=11858	SAT TT=0.318	SAT TT=0.006 ASSIGNMENTS=80 CHECKS=973	SAT TT=0.008 ASSIGNMENTS=51 CHECKS=1416	SAT TT=0.794	SAT TT=0.013 ASSIGNMENTS=103 CHECKS=1825	SAT TT=0.555	SAT TT=0.582
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-50/ normalized-aim-50-1-6-sat-3_ext.xml	SAT TT=0.007	SAT TT=0.755 CHECKS=801 NODES=130	SAT TT=0.736 CHECKS=259 NODES=0	SAT TT=0.063	SAT TT=0.013 CHECKS=2004	SAT TT=0.014 CHECKS=4294	SAT TT=0.398 ASSIGNMENTS=2	SAT TT=0.418 ASSIGNMENTS=4	SAT TT=0.344 CHECKS=211 NODES=51	SAT TT=3.811 CHECKS=13156100 NODES=972600	SAT TT=0.378 CHECKS=55885 NODES=579	SAT TT=0.02 ASSIGNMENTS=48 CHECKS=1390	SAT TT=0.021 ASSIGNMENTS=48 CHECKS=1390	SAT TT=0.868	SAT TT=0.978	SAT TT=0.054 CHECKS=914	SAT TT=0.007 ASSIGNMENTS=58 CHECKS=1462	SAT TT=0.011 ASSIGNMENTS=959 CHECKS=14978	SAT TT=0.343	SAT TT=0.009 ASSIGNMENTS=96 CHECKS=1636	SAT TT=0.008 ASSIGNMENTS=48 CHECKS=1390	SAT TT=0.78	SAT TT=0.016 ASSIGNMENTS=62 CHECKS=1662	SAT TT=0.595	SAT TT=0.564
csp/aim-50/ normalized-aim-50-1-6-sat-4_ext.xml	SAT TT=0.007	SAT TT=0.765 CHECKS=2457 NODES=286	SAT TT=0.722 CHECKS=282 NODES=0	SAT TT=0.057	SAT TT=0.009 CHECKS=415	SAT TT=0.012 CHECKS=2887	SAT TT=0.416 ASSIGNMENTS=1	SAT TT=0.412 ASSIGNMENTS=1	SAT TT=0.342 CHECKS=572 NODES=77	SAT TT=0.462 CHECKS=341987 NODES=48334	SAT TT=0.38 CHECKS=72731 NODES=813	SAT TT=0.021 ASSIGNMENTS=68 CHECKS=2555	SAT TT=0.02 ASSIGNMENTS=68 CHECKS=2555	SAT TT=0.775	SAT TT=1.055	SAT TT=0.039 CHECKS=3290	SAT TT=0.007 ASSIGNMENTS=71 CHECKS=2622	SAT TT=0.016 ASSIGNMENTS=1334 CHECKS=23081	SAT TT=0.323	SAT TT=0.008 ASSIGNMENTS=35 CHECKS=518	SAT TT=0.009 ASSIGNMENTS=68 CHECKS=2555	SAT TT=0.726	SAT TT=0.015 ASSIGNMENTS=52 CHECKS=1636	SAT TT=0.579	SAT TT=0.582
csp/aim-50/ normalized-aim-50-1-6-unsat-1_ext.xml	UNSAT TT=0.006	UNSAT TT=0.737 CHECKS=941 NODES=95	UNSAT TT=0.732 CHECKS=240 NODES=0	UNSAT TT=0.039	UNSAT TT=0.01 CHECKS=239	UNSAT TT=0.018 CHECKS=8453	UNSAT TT=0.38 ASSIGNMENTS=0	UNSAT TT=0.424 ASSIGNMENTS=0	UNSAT TT=0.393 CHECKS=952 NODES=47	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.019 ASSIGNMENTS=44 CHECKS=1225	UNSAT TT=0.019 ASSIGNMENTS=44 CHECKS=1225	UNSAT TT=0.608	UNSAT TT=0.475	UNSAT TT=0.04 CHECKS=1257	UNSAT TT=0.009 ASSIGNMENTS=37 CHECKS=1141	UNSAT TT=0.012 ASSIGNMENTS=829 CHECKS=12395	UNSAT TT=0.32	UNSAT TT=0.006 ASSIGNMENTS=22 CHECKS=311	UNSAT TT=0.007 ASSIGNMENTS=44 CHECKS=1225	UNSAT TT=0.767	UNSAT TT=0.012 ASSIGNMENTS=101 CHECKS=5836	UNSAT TT=0.582	UNSAT TT=0.568
csp/aim-50/ normalized-aim-50-1-6-unsat-2_ext.xml	UNSAT TT=0.009	UNSAT TT=0.807 CHECKS=6668 NODES=749	UNSAT TT=0.81 CHECKS=4868 NODES=561	UNSAT TT=0.218	UNSAT TT=0.024 CHECKS=13259	UNSAT TT=0.031 CHECKS=25479	UNSAT TT=0.51 ASSIGNMENTS=449	UNSAT TT=0.458 ASSIGNMENTS=144	UNSAT TT=0.387 CHECKS=2178 NODES=183	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.022 ASSIGNMENTS=425 CHECKS=10996	UNSAT TT=0.023 ASSIGNMENTS=425 CHECKS=10996	UNSAT TT=0.623	UNSAT TT=0.673	UNSAT TT=0.043 CHECKS=8096	UNSAT TT=0.01 ASSIGNMENTS=548 CHECKS=11986	UNSAT TT=0.025 ASSIGNMENTS=4874 CHECKS=58579	UNSAT TT=0.329	UNSAT TT=0.01 ASSIGNMENTS=329 CHECKS=7318	UNSAT TT=0.009 ASSIGNMENTS=425 CHECKS=10996	UNSAT TT=0.772	UNSAT TT=0.019 ASSIGNMENTS=272 CHECKS=9590	UNSAT TT=0.591	UNSAT TT=0.594
csp/aim-50/ normalized-aim-50-1-6-unsat-3_ext.xml	UNSAT TT=0.007	UNSAT TT=0.733 CHECKS=764 NODES=63	UNSAT TT=0.741 CHECKS=704 NODES=34	UNSAT TT=0.873	UNSAT TT=0.011 CHECKS=202	UNSAT TT=0.041 CHECKS=31111	UNSAT TT=0.4 ASSIGNMENTS=0	UNSAT TT=0.439 ASSIGNMENTS=0	UNSAT TT=0.374 CHECKS=737 NODES=28	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.021 ASSIGNMENTS=72 CHECKS=2689	UNSAT TT=0.021 ASSIGNMENTS=72 CHECKS=2689	UNSAT TT=0.464	UNSAT TT=0.499	UNSAT TT=0.065 CHECKS=2453	UNSAT TT=0.008 ASSIGNMENTS=82 CHECKS=2919	UNSAT TT=0.011 ASSIGNMENTS=355 CHECKS=4198	UNSAT TT=0.32	UNSAT TT=0.008 ASSIGNMENTS=104 CHECKS=1216	UNSAT TT=0.007 ASSIGNMENTS=72 CHECKS=2689	UNSAT TT=0.723	UNSAT TT=0.014 ASSIGNMENTS=23 CHECKS=1135	UNSAT TT=0.588	UNSAT TT=0.589
csp/aim-50/ normalized-aim-50-1-6-unsat-4_ext.xml	UNSAT TT=0.007	UNSAT TT=0.737 CHECKS=755 NODES=100	UNSAT TT=0.816 CHECKS=564 NODES=64	UNSAT TT=0.047	UNSAT TT=0.01 CHECKS=718	UNSAT TT=0.012 CHECKS=3711	UNSAT TT=0.427 ASSIGNMENTS=0	UNSAT TT=0.406 ASSIGNMENTS=0	UNSAT TT=0.376 CHECKS=580 NODES=41	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.018 ASSIGNMENTS=46 CHECKS=1148	UNSAT TT=0.021 ASSIGNMENTS=46 CHECKS=1148	UNSAT TT=0.498	UNSAT TT=0.523	UNSAT TT=0.057 CHECKS=803	UNSAT TT=0.008 ASSIGNMENTS=36 CHECKS=928	UNSAT TT=0.023 ASSIGNMENTS=4581 CHECKS=55443	UNSAT TT=0.341	UNSAT TT=0.007 ASSIGNMENTS=107 CHECKS=1264	UNSAT TT=0.009 ASSIGNMENTS=46 CHECKS=1148	UNSAT TT=0.752	UNSAT TT=0.012 ASSIGNMENTS=8 CHECKS=544	UNSAT TT=0.604	UNSAT TT=0.588
csp/aim-50/ normalized-aim-50-2-0-sat-1_ext.xml	SAT TT=0.008	SAT TT=0.872 CHECKS=975 NODES=138	SAT TT=0.789 CHECKS=1173 NODES=116	SAT TT=0.208	SAT TT=0.012 CHECKS=1194	SAT TT=0.014 CHECKS=5931	SAT TT=0.393 ASSIGNMENTS=1	SAT TT=0.455 ASSIGNMENTS=1	SAT TT=0.394 CHECKS=1432 NODES=141	SAT TT=0.523 CHECKS=675763 NODES=58813	SAT TT=0.386 CHECKS=25855 NODES=240	SAT TT=0.021 ASSIGNMENTS=146 CHECKS=3780	SAT TT=0.021 ASSIGNMENTS=146 CHECKS=3780	SAT TT=0.82	SAT TT=0.855	SAT TT=0.041 CHECKS=3253	SAT TT=0.009 ASSIGNMENTS=112 CHECKS=3026	SAT TT=0.023 ASSIGNMENTS=2792 CHECKS=62123	SAT TT=0.332	SAT TT=0.008 ASSIGNMENTS=134 CHECKS=2470	SAT TT=0.01 ASSIGNMENTS=146 CHECKS=3780	SAT TT=0.759	SAT TT=0.017 ASSIGNMENTS=111 CHECKS=4357	SAT TT=0.609	SAT TT=0.604
csp/aim-50/ normalized-aim-50-2-0-sat-2_ext.xml	SAT TT=0.007	SAT TT=0.852 CHECKS=3854 NODES=447	SAT TT=0.774 CHECKS=2871 NODES=322	SAT TT=0.081	SAT TT=0.012 CHECKS=2288	SAT TT=0.013 CHECKS=5550	SAT TT=0.464 ASSIGNMENTS=53	SAT TT=0.436 ASSIGNMENTS=34	SAT TT=0.352 CHECKS=544 NODES=78	SAT TT=0.481 CHECKS=367759 NODES=17603	SAT TT=0.4 CHECKS=56849 NODES=543	SAT TT=0.02 ASSIGNMENTS=94 CHECKS=3025	SAT TT=0.041 ASSIGNMENTS=94 CHECKS=3025	SAT TT=0.867	SAT TT=1.051	SAT TT=0.042 CHECKS=1464	SAT TT=0.009 ASSIGNMENTS=79 CHECKS=2594	SAT TT=0.017 ASSIGNMENTS=1683 CHECKS=39770	SAT TT=0.33	SAT TT=0.007 ASSIGNMENTS=116 CHECKS=2247	SAT TT=0.009 ASSIGNMENTS=94 CHECKS=3025	SAT TT=0.818	SAT TT=0.016 ASSIGNMENTS=184 CHECKS=5885	SAT TT=0.597	SAT TT=0.584
csp/aim-50/ normalized-aim-50-2-0-sat-3_ext.xml	SAT TT=0.009	SAT TT=0.872 CHECKS=881 NODES=142	SAT TT=0.763 CHECKS=1040 NODES=148	SAT TT=0.071	SAT TT=0.013 CHECKS=4067	SAT TT=0.015 CHECKS=6206	SAT TT=0.443 ASSIGNMENTS=100	SAT TT=0.473 ASSIGNMENTS=65	SAT TT=0.356 CHECKS=716 NODES=78	SAT TT=0.554 CHECKS=602614 NODES=31975	SAT TT=0.42 CHECKS=158615 NODES=1353	SAT TT=0.021 ASSIGNMENTS=75 CHECKS=2280	SAT TT=0.02 ASSIGNMENTS=75 CHECKS=2280	SAT TT=0.854	SAT TT=0.843	SAT TT=0.052 CHECKS=2288	SAT TT=0.009 ASSIGNMENTS=73 CHECKS=2204	SAT TT=0.012 ASSIGNMENTS=312 CHECKS=8475	SAT TT=0.323	SAT TT=0.009 ASSIGNMENTS=102 CHECKS=2205	SAT TT=0.01 ASSIGNMENTS=75 CHECKS=2280	SAT TT=0.748	SAT TT=0.02 ASSIGNMENTS=249 CHECKS=8598	SAT TT=0.599	SAT TT=0.61
csp/aim-50/ normalized-aim-50-2-0-sat-4_ext.xml	SAT TT=0.006	SAT TT=0.724 CHECKS=1267 NODES=155	SAT TT=0.773 CHECKS=1476 NODES=119	SAT TT=0.053	SAT TT=0.011 CHECKS=1430	SAT TT=0.013 CHECKS=5796	SAT TT=0.437 ASSIGNMENTS=5	SAT TT=0.425 ASSIGNMENTS=7	SAT TT=0.39 CHECKS=447 NODES=68	SAT TT=0.42 CHECKS=80401 NODES=3778	SAT TT=0.378 CHECKS=10336 NODES=126	SAT TT=0.019 ASSIGNMENTS=24 CHECKS=895	SAT TT=0.02 ASSIGNMENTS=24 CHECKS=895	SAT TT=1.001	SAT TT=0.797	SAT TT=0.045 CHECKS=1258	SAT TT=0.008 ASSIGNMENTS=44 CHECKS=1272	SAT TT=0.013 ASSIGNMENTS=381 CHECKS=10817	SAT TT=0.33	SAT TT=0.008 ASSIGNMENTS=27 CHECKS=629	SAT TT=0.006 ASSIGNMENTS=24 CHECKS=895	SAT TT=0.742	SAT TT=0.013 ASSIGNMENTS=89 CHECKS=2794	SAT TT=0.609	SAT TT=0.606
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-50/ normalized-aim-50-2-0-unsat-1_ext.xml	UNSAT TT=0.01	UNSAT TT=0.85 CHECKS=1930 NODES=195	UNSAT TT=0.804 CHECKS=1863 NODES=158	UNSAT TT=0.174	UNSAT TT=0.021 CHECKS=8972	UNSAT TT=0.024 CHECKS=20978	UNSAT TT=0.586 ASSIGNMENTS=418	UNSAT TT=0.545 ASSIGNMENTS=233	UNSAT TT=0.412 CHECKS=1335 NODES=84	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.022 ASSIGNMENTS=220 CHECKS=6449	UNSAT TT=0.02 ASSIGNMENTS=220 CHECKS=6449	UNSAT TT=0.512	UNSAT TT=0.509	UNSAT TT=0.051 CHECKS=2903	UNSAT TT=0.012 ASSIGNMENTS=230 CHECKS=6566	UNSAT TT=0.033 ASSIGNMENTS=4355 CHECKS=93427	UNSAT TT=0.324	UNSAT TT=0.01 ASSIGNMENTS=129 CHECKS=2483	UNSAT TT=0.01 ASSIGNMENTS=220 CHECKS=6449	UNSAT TT=0.74	UNSAT TT=0.018 ASSIGNMENTS=193 CHECKS=10384	UNSAT TT=0.634	UNSAT TT=0.62
csp/aim-50/ normalized-aim-50-2-0-unsat-2_ext.xml	UNSAT TT=0.008	UNSAT TT=0.743 CHECKS=1886 NODES=282	UNSAT TT=0.954 CHECKS=2284 NODES=265	UNSAT TT=0.192	UNSAT TT=0.016 CHECKS=4599	UNSAT TT=0.015 CHECKS=6469	UNSAT TT=0.427 ASSIGNMENTS=95	UNSAT TT=0.454 ASSIGNMENTS=16	UNSAT TT=0.361 CHECKS=1060 NODES=71	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.022 ASSIGNMENTS=111 CHECKS=2894	UNSAT TT=0.02 ASSIGNMENTS=111 CHECKS=2894	UNSAT TT=0.471	UNSAT TT=0.65	UNSAT TT=0.061 CHECKS=2530	UNSAT TT=0.01 ASSIGNMENTS=83 CHECKS=2249	UNSAT TT=0.032 ASSIGNMENTS=4064 CHECKS=96877	UNSAT TT=0.322	UNSAT TT=0.011 ASSIGNMENTS=122 CHECKS=2645	UNSAT TT=0.008 ASSIGNMENTS=111 CHECKS=2894	UNSAT TT=0.734	UNSAT TT=0.014 ASSIGNMENTS=120 CHECKS=4430	UNSAT TT=0.593	UNSAT TT=0.605
csp/aim-50/ normalized-aim-50-2-0-unsat-3_ext.xml	UNSAT TT=0.008	UNSAT TT=0.777 CHECKS=2217 NODES=251	UNSAT TT=0.82 CHECKS=2163 NODES=253	UNSAT TT=0.146	UNSAT TT=0.015 CHECKS=3622	UNSAT TT=0.02 CHECKS=13042	UNSAT TT=0.435 ASSIGNMENTS=82	UNSAT TT=0.468 ASSIGNMENTS=131	UNSAT TT=0.386 CHECKS=954 NODES=51	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.022 ASSIGNMENTS=157 CHECKS=4921	UNSAT TT=0.021 ASSIGNMENTS=157 CHECKS=4921	UNSAT TT=0.509	UNSAT TT=0.517	UNSAT TT=0.064 CHECKS=3056	UNSAT TT=0.01 ASSIGNMENTS=174 CHECKS=5493	UNSAT TT=0.032 ASSIGNMENTS=4133 CHECKS=84382	UNSAT TT=0.318	UNSAT TT=0.009 ASSIGNMENTS=125 CHECKS=2453	UNSAT TT=0.008 ASSIGNMENTS=157 CHECKS=4921	UNSAT TT=0.789	UNSAT TT=0.015 ASSIGNMENTS=56 CHECKS=2720	UNSAT TT=0.62	UNSAT TT=0.603
csp/aim-50/ normalized-aim-50-2-0-unsat-4_ext.xml	UNSAT TT=0.008	UNSAT TT=0.795 CHECKS=1880 NODES=238	UNSAT TT=0.825 CHECKS=1227 NODES=130	UNSAT TT=0.199	UNSAT TT=0.017 CHECKS=4459	UNSAT TT=0.016 CHECKS=6916	UNSAT TT=0.449 ASSIGNMENTS=132	UNSAT TT=0.503 ASSIGNMENTS=147	UNSAT TT=0.389 CHECKS=872 NODES=55	? (TO) TT=1800.12	? (TO) TT=1800.02	UNSAT TT=0.024 ASSIGNMENTS=114 CHECKS=3134	UNSAT TT=0.021 ASSIGNMENTS=114 CHECKS=3134	UNSAT TT=0.637	UNSAT TT=0.482	UNSAT TT=0.05 CHECKS=1757	UNSAT TT=0.008 ASSIGNMENTS=121 CHECKS=3225	UNSAT TT=0.028 ASSIGNMENTS=4382 CHECKS=81259	UNSAT TT=0.35	UNSAT TT=0.011 ASSIGNMENTS=196 CHECKS=3789	UNSAT TT=0.01 ASSIGNMENTS=114 CHECKS=3134	UNSAT TT=0.739	UNSAT TT=0.013 ASSIGNMENTS=77 CHECKS=3050	UNSAT TT=0.603	UNSAT TT=0.601
csp/aim-50/ normalized-aim-50-3-4-sat-1_ext.xml	SAT TT=0.008	SAT TT=0.803 CHECKS=702 NODES=73	SAT TT=0.782 CHECKS=870 NODES=58	SAT TT=0.054	SAT TT=0.013 CHECKS=1312	SAT TT=0.013 CHECKS=1102	SAT TT=0.469 ASSIGNMENTS=6	SAT TT=0.518 ASSIGNMENTS=18	SAT TT=0.419 CHECKS=1913 NODES=90	SAT TT=0.407 CHECKS=89249 NODES=2318	SAT TT=0.48 CHECKS=9018 NODES=54	SAT TT=0.022 ASSIGNMENTS=5 CHECKS=468	SAT TT=0.023 ASSIGNMENTS=5 CHECKS=468	SAT TT=1.105	SAT TT=1.088	SAT TT=0.066 CHECKS=1814	SAT TT=0.009 ASSIGNMENTS=5 CHECKS=468	SAT TT=0.011 ASSIGNMENTS=68 CHECKS=4270	SAT TT=0.409	SAT TT=0.011 ASSIGNMENTS=89 CHECKS=3931	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=468	SAT TT=0.863	SAT TT=0.019 ASSIGNMENTS=136 CHECKS=11187	SAT TT=0.628	SAT TT=0.665
csp/aim-50/ normalized-aim-50-3-4-sat-2_ext.xml	SAT TT=0.01	SAT TT=0.919 CHECKS=3802 NODES=274	SAT TT=0.828 CHECKS=4071 NODES=241	SAT TT=0.053	SAT TT=0.019 CHECKS=7001	SAT TT=0.021 CHECKS=13117	SAT TT=0.513 ASSIGNMENTS=70	SAT TT=0.461 ASSIGNMENTS=21	SAT TT=0.373 CHECKS=530 NODES=52	SAT TT=0.437 CHECKS=91486 NODES=2315	SAT TT=0.442 CHECKS=137244 NODES=1014	SAT TT=0.022 ASSIGNMENTS=51 CHECKS=3704	SAT TT=0.022 ASSIGNMENTS=51 CHECKS=3704	SAT TT=0.906	SAT TT=1.167	SAT TT=0.055 CHECKS=7101	SAT TT=0.011 ASSIGNMENTS=63 CHECKS=5922	SAT TT=0.015 ASSIGNMENTS=333 CHECKS=25840	SAT TT=0.41	SAT TT=0.011 ASSIGNMENTS=21 CHECKS=931	SAT TT=0.01 ASSIGNMENTS=51 CHECKS=3704	SAT TT=0.871	SAT TT=0.03 ASSIGNMENTS=132 CHECKS=12635	SAT TT=0.662	SAT TT=0.651
csp/aim-50/ normalized-aim-50-3-4-sat-3_ext.xml	SAT TT=0.009	SAT TT=0.826 CHECKS=1107 NODES=80	SAT TT=0.824 CHECKS=1336 NODES=79	SAT TT=0.053	SAT TT=0.018 CHECKS=4045	SAT TT=0.02 CHECKS=11825	SAT TT=0.52 ASSIGNMENTS=54	SAT TT=0.471 ASSIGNMENTS=24	SAT TT=0.434 CHECKS=2493 NODES=102	SAT TT=0.478 CHECKS=39482 NODES=976	SAT TT=0.43 CHECKS=56821 NODES=506	SAT TT=0.023 ASSIGNMENTS=123 CHECKS=11368	SAT TT=0.024 ASSIGNMENTS=123 CHECKS=11368	SAT TT=1.102	SAT TT=0.958	SAT TT=0.069 CHECKS=3510	SAT TT=0.011 ASSIGNMENTS=73 CHECKS=6572	SAT TT=0.01 ASSIGNMENTS=51 CHECKS=3887	SAT TT=0.371	SAT TT=0.009 ASSIGNMENTS=14 CHECKS=691	SAT TT=0.013 ASSIGNMENTS=123 CHECKS=11368	SAT TT=0.787	SAT TT=0.03 ASSIGNMENTS=139 CHECKS=13576	SAT TT=0.692	SAT TT=0.676
csp/aim-50/ normalized-aim-50-3-4-sat-4_ext.xml	SAT TT=0.01	SAT TT=0.783 CHECKS=1943 NODES=128	SAT TT=0.78 CHECKS=974 NODES=53	SAT TT=0.047	SAT TT=0.016 CHECKS=2349	SAT TT=0.016 CHECKS=4471	SAT TT=0.486 ASSIGNMENTS=27	SAT TT=0.531 ASSIGNMENTS=23	SAT TT=0.406 CHECKS=829 NODES=68	SAT TT=0.396 CHECKS=29535 NODES=722	SAT TT=0.43 CHECKS=34591 NODES=336	SAT TT=0.022 ASSIGNMENTS=16 CHECKS=1416	SAT TT=0.02 ASSIGNMENTS=16 CHECKS=1416	SAT TT=0.886	SAT TT=1.144	SAT TT=0.059 CHECKS=4843	SAT TT=0.011 ASSIGNMENTS=12 CHECKS=1441	SAT TT=0.01 ASSIGNMENTS=84 CHECKS=6231	SAT TT=0.364	SAT TT=0.012 ASSIGNMENTS=79 CHECKS=3690	SAT TT=0.01 ASSIGNMENTS=16 CHECKS=1416	SAT TT=0.832	SAT TT=0.019 ASSIGNMENTS=89 CHECKS=6215	SAT TT=0.642	SAT TT=0.668
csp/aim-50/ normalized-aim-50-6-0-sat-1_ext.xml	SAT TT=0.013	SAT TT=0.837 CHECKS=1164 NODES=72	SAT TT=0.854 CHECKS=2424 NODES=57	SAT TT=0.06	SAT TT=0.016 CHECKS=1797	SAT TT=0.016 CHECKS=2552	SAT TT=0.566 ASSIGNMENTS=1	SAT TT=0.542 ASSIGNMENTS=1	SAT TT=0.459 CHECKS=2475 NODES=73	SAT TT=0.653 CHECKS=203734 NODES=2882	SAT TT=0.443 CHECKS=10561 NODES=23	SAT TT=0.026 ASSIGNMENTS=15 CHECKS=1722	SAT TT=0.025 ASSIGNMENTS=15 CHECKS=1722	SAT TT=1.211	SAT TT=1.374	SAT TT=0.057 CHECKS=1288	SAT TT=0.013 ASSIGNMENTS=11 CHECKS=1547	SAT TT=0.013 ASSIGNMENTS=4 CHECKS=1044	SAT TT=0.488	SAT TT=0.013 ASSIGNMENTS=25 CHECKS=2130	SAT TT=0.013 ASSIGNMENTS=15 CHECKS=1722	SAT TT=0.86	SAT TT=0.023 ASSIGNMENTS=84 CHECKS=12073	SAT TT=0.767	SAT TT=0.767
csp/aim-50/ normalized-aim-50-6-0-sat-2_ext.xml	SAT TT=0.013	SAT TT=0.855 CHECKS=2005 NODES=100	SAT TT=0.807 CHECKS=1471 NODES=0	SAT TT=0.062	SAT TT=37.557 CHECKS=3611	SAT TT=0.019 CHECKS=2469	SAT TT=0.528 ASSIGNMENTS=1	SAT TT=0.55 ASSIGNMENTS=1	SAT TT=0.447 CHECKS=595 NODES=51	SAT TT=0.47 CHECKS=7082 NODES=47	SAT TT=0.47 CHECKS=19811 NODES=112	SAT TT=0.024 ASSIGNMENTS=4 CHECKS=1112	SAT TT=0.023 ASSIGNMENTS=4 CHECKS=1112	SAT TT=1.095	SAT TT=1.221	SAT TT=0.083 CHECKS=794	SAT TT=0.013 ASSIGNMENTS=5 CHECKS=1073	SAT TT=0.011 ASSIGNMENTS=6 CHECKS=1646	SAT TT=0.419	SAT TT=0.015 ASSIGNMENTS=22 CHECKS=1876	SAT TT=0.013 ASSIGNMENTS=4 CHECKS=1112	SAT TT=0.928	SAT TT=0.024 ASSIGNMENTS=58 CHECKS=5545	SAT TT=0.81	SAT TT=0.776
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/aim-50/ normalized-aim-50-6-0-sat-3_ext.xml	SAT TT=0.011	SAT TT=0.857 CHECKS=1587 NODES=78	SAT TT=0.779 CHECKS=626 NODES=0	SAT TT=0.061	SAT TT=0.017 CHECKS=3978	SAT TT=0.016 CHECKS=3352	SAT TT=0.575 ASSIGNMENTS=1	SAT TT=0.575 ASSIGNMENTS=1	SAT TT=0.448 CHECKS=513 NODES=50	SAT TT=0.623 CHECKS=16066 NODES=190	SAT TT=0.461 CHECKS=17584 NODES=103	SAT TT=0.025 ASSIGNMENTS=18 CHECKS=2370	SAT TT=0.024 ASSIGNMENTS=18 CHECKS=2370	SAT TT=1.028	SAT TT=1.206	SAT TT=0.089 CHECKS=3722	SAT TT=0.012 ASSIGNMENTS=16 CHECKS=2268	SAT TT=0.012 ASSIGNMENTS=2 CHECKS=860	SAT TT=0.478	SAT TT=0.012 ASSIGNMENTS=6 CHECKS=1200	SAT TT=0.011 ASSIGNMENTS=18 CHECKS=2370	SAT TT=0.9	SAT TT=0.023 ASSIGNMENTS=59 CHECKS=5750	SAT TT=0.76	SAT TT=0.862
csp/aim-50/ normalized-aim-50-6-0-sat-4_ext.xml	SAT TT=0.011	SAT TT=0.849 CHECKS=1771 NODES=88	SAT TT=0.872 CHECKS=1681 NODES=0	SAT TT=0.062	SAT TT=0.017 CHECKS=2589	SAT TT=0.018 CHECKS=5098	SAT TT=0.536 ASSIGNMENTS=1	SAT TT=0.506 ASSIGNMENTS=1	SAT TT=0.439 CHECKS=596 NODES=51	SAT TT=2.912 CHECKS=9820330 NODES=150048	SAT TT=0.439 CHECKS=22347 NODES=150	SAT TT=0.024 ASSIGNMENTS=14 CHECKS=2724	SAT TT=0.022 ASSIGNMENTS=14 CHECKS=2724	SAT TT=1.202	SAT TT=0.998	SAT TT=0.07 CHECKS=4370	SAT TT=0.012 ASSIGNMENTS=21 CHECKS=3527	SAT TT=0.012 ASSIGNMENTS=15 CHECKS=2665	SAT TT=0.417	SAT TT=0.013 ASSIGNMENTS=8 CHECKS=1200	SAT TT=0.011 ASSIGNMENTS=14 CHECKS=2724	SAT TT=0.855	SAT TT=0.025 ASSIGNMENTS=64 CHECKS=7161	SAT TT=0.749	SAT TT=0.903
csp/dubois/ normalized-dubois-100_ext.xml	UNSAT TT=0.817	? (TO) TT=1800.25	? (TO) TT=1800.26	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.894	UNSAT TT=1.244	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=3.038	? (TO) TT=1800.04	UNSAT TT=0.835	UNSAT TT=0.817
csp/dubois/ normalized-dubois-20_ext.xml	UNSAT TT=0.537	UNSAT TT=1.492 CHECKS=79754 NODES=14777	UNSAT TT=2.53 CHECKS=223066 NODES=41135	UNSAT TT=8.116	UNSAT TT=111.592 CHECKS=82774500	UNSAT TT=123.134 CHECKS=77412600	UNSAT TT=119.071 ASSIGNMENTS=2060720	UNSAT TT=118.771 ASSIGNMENTS=2097150	UNSAT TT=126.312 CHECKS=82378100 NODES=4810800	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=13.504 ASSIGNMENTS=162181 CHECKS=910479	UNSAT TT=14.149 ASSIGNMENTS=162181 CHECKS=910479	UNSAT TT=0.769	UNSAT TT=0.628	UNSAT TT=6.55 CHECKS=6479290	UNSAT TT=9.845 ASSIGNMENTS=1687500 CHECKS=18413100	UNSAT TT=13.741 ASSIGNMENTS=2366460 CHECKS=25865200	UNSAT TT=19.749	UNSAT TT=14.551 ASSIGNMENTS=2371060 CHECKS=26616600	UNSAT TT=8.887 ASSIGNMENTS=1522830 CHECKS=16528500	UNSAT TT=1.212	UNSAT TT=79.105 ASSIGNMENTS=10581800 CHECKS=31649500	UNSAT TT=0.543	UNSAT TT=0.537
csp/dubois/ normalized-dubois-21_ext.xml	UNSAT TT=0.531	UNSAT TT=1.316 CHECKS=60451 NODES=13835	UNSAT TT=1.874 CHECKS=117352 NODES=27428	UNSAT TT=19.589	UNSAT TT=156.875 CHECKS=93120100	UNSAT TT=177.694 CHECKS=111909000	UNSAT TT=222.003 ASSIGNMENTS=3559610	UNSAT TT=235.596 ASSIGNMENTS=4194300	UNSAT TT=268.599 CHECKS=188953000 NODES=10522000	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=17.976 ASSIGNMENTS=277132 CHECKS=2038860	UNSAT TT=19.524 ASSIGNMENTS=277132 CHECKS=2038860	UNSAT TT=0.645	UNSAT TT=0.6	UNSAT TT=22.512 CHECKS=19603400	UNSAT TT=19.897 ASSIGNMENTS=3678290 CHECKS=40001600	UNSAT TT=28.389 ASSIGNMENTS=4843760 CHECKS=53416300	UNSAT TT=39.743	UNSAT TT=26.107 ASSIGNMENTS=4293310 CHECKS=47921300	UNSAT TT=17.496 ASSIGNMENTS=3069620 CHECKS=32785900	UNSAT TT=1.124	UNSAT TT=162.893 ASSIGNMENTS=21207200 CHECKS=63164400	UNSAT TT=0.534	UNSAT TT=0.531
csp/dubois/ normalized-dubois-22_ext.xml	UNSAT TT=0.582	UNSAT TT=14.903 CHECKS=2783970 NODES=330521	UNSAT TT=0.925 CHECKS=8758 NODES=3461	UNSAT TT=34.553	UNSAT TT=288.754 CHECKS=162424000	UNSAT TT=282.141 CHECKS=152813000	UNSAT TT=414.813 ASSIGNMENTS=7209780	UNSAT TT=473.178 ASSIGNMENTS=8388610	UNSAT TT=601.854 CHECKS=415573000 NODES=23024300	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=62.481 ASSIGNMENTS=1317360 CHECKS=10745900	UNSAT TT=62.717 ASSIGNMENTS=1317360 CHECKS=10745900	UNSAT TT=0.891	UNSAT TT=0.885	UNSAT TT=28.039 CHECKS=25835400	UNSAT TT=38.934 ASSIGNMENTS=7188430 CHECKS=78642900	UNSAT TT=50.238 ASSIGNMENTS=9240150 CHECKS=102130000	UNSAT TT=77.315	UNSAT TT=61.601 ASSIGNMENTS=9346540 CHECKS=105158000	UNSAT TT=33.821 ASSIGNMENTS=6198340 CHECKS=67915800	UNSAT TT=1.259	UNSAT TT=340.086 ASSIGNMENTS=42675800 CHECKS=127191000	UNSAT TT=0.583	UNSAT TT=0.582
csp/dubois/ normalized-dubois-23_ext.xml	UNSAT TT=0.54	UNSAT TT=1.417 CHECKS=76323 NODES=14859	UNSAT TT=1.284 CHECKS=30171 NODES=9037	UNSAT TT=82.833	UNSAT TT=447.724 CHECKS=361665000	UNSAT TT=704.039 CHECKS=367553000	UNSAT TT=863.056 ASSIGNMENTS=14091600	UNSAT TT=893.06 ASSIGNMENTS=16777200	UNSAT TT=1043.03 CHECKS=654953000 NODES=36701800	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=8.708 ASSIGNMENTS=10880 CHECKS=48338	UNSAT TT=8.527 ASSIGNMENTS=10880 CHECKS=48338	UNSAT TT=0.647	UNSAT TT=0.89	UNSAT TT=62.045 CHECKS=52501500	UNSAT TT=77.676 ASSIGNMENTS=14166800 CHECKS=156837000	UNSAT TT=104.352 ASSIGNMENTS=18958200 CHECKS=212296000	UNSAT TT=156.465	UNSAT TT=110.773 ASSIGNMENTS=16352100 CHECKS=188083000	UNSAT TT=65.181 ASSIGNMENTS=12012200 CHECKS=131400000	UNSAT TT=1.242	UNSAT TT=681.621 ASSIGNMENTS=78797800 CHECKS=232927000	UNSAT TT=0.581	UNSAT TT=0.54
csp/dubois/ normalized-dubois-24_ext.xml	UNSAT TT=0.573	UNSAT TT=1.332 CHECKS=58473 NODES=13714	UNSAT TT=3.055 CHECKS=291176 NODES=53290	UNSAT TT=140.76	UNSAT TT=694.658 CHECKS=586994000	UNSAT TT=858.316 CHECKS=429022000	UNSAT TT=1681.43 ASSIGNMENTS=27119900	UNSAT TT=1776.78 ASSIGNMENTS=33554400	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=63.628 ASSIGNMENTS=1057570 CHECKS=9215080	UNSAT TT=64.343 ASSIGNMENTS=1057570 CHECKS=9215080	UNSAT TT=0.652	UNSAT TT=0.784	UNSAT TT=137.664 CHECKS=112819000	UNSAT TT=155.1 ASSIGNMENTS=28205200 CHECKS=312721000	UNSAT TT=215.589 ASSIGNMENTS=37314900 CHECKS=416630000	UNSAT TT=285.283	UNSAT TT=235.43 ASSIGNMENTS=35960500 CHECKS=402743000	UNSAT TT=128.299 ASSIGNMENTS=23587500 CHECKS=259851000	UNSAT TT=1.194	UNSAT TT=1486.23 ASSIGNMENTS=156501000 CHECKS=465824000	UNSAT TT=0.573	UNSAT TT=0.584
csp/dubois/ normalized-dubois-25_ext.xml	UNSAT TT=0.623	UNSAT TT=1.438 CHECKS=73345 NODES=14550	UNSAT TT=1.963 CHECKS=122661 NODES=26950	UNSAT TT=378.723	UNSAT TT=1347.38 CHECKS=1139950000	UNSAT TT=1321.7 CHECKS=1158650000	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=8.828 ASSIGNMENTS=13512 CHECKS=57824	UNSAT TT=8.418 ASSIGNMENTS=13512 CHECKS=57824	UNSAT TT=0.687	UNSAT TT=0.819	UNSAT TT=275.316 CHECKS=225616000	UNSAT TT=335.506 ASSIGNMENTS=56490800 CHECKS=624941000	UNSAT TT=452.698 ASSIGNMENTS=73362700 CHECKS=837196000	UNSAT TT=607.968	UNSAT TT=498.144 ASSIGNMENTS=70776900 CHECKS=826140000	UNSAT TT=280.304 ASSIGNMENTS=48274100 CHECKS=522890000	UNSAT TT=1.218	? (TO) TT=1800.06	UNSAT TT=0.632	UNSAT TT=0.623
csp/dubois/ normalized-dubois-26_ext.xml	UNSAT TT=0.557	UNSAT TT=1.7 CHECKS=92009 NODES=18382	UNSAT TT=5.276 CHECKS=581958 NODES=101262	UNSAT TT=547.605	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=8.772 ASSIGNMENTS=15141 CHECKS=62500	UNSAT TT=8.941 ASSIGNMENTS=15141 CHECKS=62500	UNSAT TT=0.653	UNSAT TT=0.784	UNSAT TT=295.968 CHECKS=251515000	UNSAT TT=604.083 ASSIGNMENTS=109553000 CHECKS=1224880000	UNSAT TT=830.156 ASSIGNMENTS=147259000 CHECKS=1681680000	UNSAT TT=1112.45	UNSAT TT=890.055 ASSIGNMENTS=143617000 CHECKS=1624040000	UNSAT TT=427.332 ASSIGNMENTS=77631500 CHECKS=859176000	UNSAT TT=1.236	? (TO) TT=1800.11	UNSAT TT=0.557	UNSAT TT=0.56
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/dubois/ normalized-dubois-27_ext.xml	UNSAT TT=0.606	UNSAT TT=1.495 CHECKS=76632 NODES=15235	UNSAT TT=252.345 CHECKS=51084500 NODES=4863130	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=64.921 ASSIGNMENTS=1136300 CHECKS=9738060	UNSAT TT=64.296 ASSIGNMENTS=1136300 CHECKS=9738060	UNSAT TT=0.654	UNSAT TT=0.801	UNSAT TT=535.22 CHECKS=414338000	UNSAT TT=1166.52 ASSIGNMENTS=194651000 CHECKS=2198930000	UNSAT TT=1678.28 ASSIGNMENTS=292557000 CHECKS=3379750000	? (TO) TT=1800.1	UNSAT TT=1665.2 ASSIGNMENTS=268163000 CHECKS=3064200000	UNSAT TT=1054.53 ASSIGNMENTS=179924000 CHECKS=1990070000	UNSAT TT=1.217	? (TO) TT=1800.03	UNSAT TT=0.606	UNSAT TT=0.609
csp/dubois/ normalized-dubois-28_ext.xml	UNSAT TT=0.601	UNSAT TT=1.863 CHECKS=98777 NODES=18994	UNSAT TT=5.022 CHECKS=376282 NODES=78755	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=16.25 ASSIGNMENTS=148908 CHECKS=1035260	UNSAT TT=16.321 ASSIGNMENTS=148908 CHECKS=1035260	UNSAT TT=0.658	UNSAT TT=0.659	UNSAT TT=822.714 CHECKS=620715000	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=1.274	? (TO) TT=1800.04	UNSAT TT=0.601	UNSAT TT=0.613
csp/dubois/ normalized-dubois-29_ext.xml	UNSAT TT=0.611	UNSAT TT=72.794 CHECKS=12118900 NODES=1532710	UNSAT TT=1.407 CHECKS=31895 NODES=10170	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=9.07 ASSIGNMENTS=14831 CHECKS=78980	UNSAT TT=9.268 ASSIGNMENTS=14831 CHECKS=78980	UNSAT TT=0.647	UNSAT TT=0.783	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=1.313	? (TO) TT=1800.02	UNSAT TT=0.615	UNSAT TT=0.611
csp/dubois/ normalized-dubois-30_ext.xml	UNSAT TT=0.574	UNSAT TT=11.585 CHECKS=1495870 NODES=229362	UNSAT TT=2.891 CHECKS=215719 NODES=43233	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=12.425 ASSIGNMENTS=85364 CHECKS=495018	UNSAT TT=12.565 ASSIGNMENTS=85364 CHECKS=495018	UNSAT TT=0.779	UNSAT TT=0.812	UNSAT TT=1423.07 CHECKS=1136600000	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=1.272	? (TO) TT=1800.07	UNSAT TT=0.574	UNSAT TT=0.58
csp/dubois/ normalized-dubois-50_ext.xml	UNSAT TT=0.699	? (TO) TT=1800.22	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=0.903	UNSAT TT=0.908	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=1.646	? (TO) TT=1800.03	UNSAT TT=0.758	UNSAT TT=0.699
csp/jnhSat/ normalized-jnh01_ext.xml	SAT TT=0.036	SAT TT=1.322 CHECKS=31091 NODES=1179	SAT TT=1.378 CHECKS=29690 NODES=982	SAT TT=0.193	SAT TT=0.196 CHECKS=102543	SAT TT=0.097 CHECKS=106043	SAT TT=1.118 ASSIGNMENTS=65	SAT TT=1.171 ASSIGNMENTS=105	SAT TT=0.734 CHECKS=21599 NODES=124	SAT TT=1.048 CHECKS=823868 NODES=1873	SAT TT=0.795 CHECKS=363159 NODES=371	SAT TT=0.048 ASSIGNMENTS=81 CHECKS=46280	SAT TT=0.052 ASSIGNMENTS=81 CHECKS=46280	SAT TT=6.039	SAT TT=5.53	SAT TT=0.654 CHECKS=11779	SAT TT=0.04 ASSIGNMENTS=83 CHECKS=49293	SAT TT=0.067 ASSIGNMENTS=507 CHECKS=226031	SAT TT=0.858	SAT TT=0.036 ASSIGNMENTS=117 CHECKS=32014	SAT TT=0.04 ASSIGNMENTS=81 CHECKS=46280	SAT TT=1.813	SAT TT=0.165 ASSIGNMENTS=281 CHECKS=157118	SAT TT=0.988	SAT TT=1.026
csp/jnhSat/ normalized-jnh07_ext.xml	SAT TT=0.035	SAT TT=1.204 CHECKS=6201 NODES=242	SAT TT=1.287 CHECKS=7581 NODES=243	SAT TT=0.221	SAT TT=0.166 CHECKS=98971	SAT TT=0.078 CHECKS=97954	SAT TT=0.957 ASSIGNMENTS=38	SAT TT=0.887 ASSIGNMENTS=13	SAT TT=0.697 CHECKS=11819 NODES=104	SAT TT=0.796 CHECKS=322174 NODES=820	SAT TT=0.692 CHECKS=154124 NODES=186	SAT TT=0.048 ASSIGNMENTS=53 CHECKS=31765	SAT TT=0.047 ASSIGNMENTS=53 CHECKS=31765	SAT TT=4.704	SAT TT=4.941	SAT TT=0.568 CHECKS=20219	SAT TT=0.035 ASSIGNMENTS=55 CHECKS=35403	SAT TT=0.036 ASSIGNMENTS=66 CHECKS=33652	SAT TT=0.81	SAT TT=0.036 ASSIGNMENTS=94 CHECKS=30366	SAT TT=0.036 ASSIGNMENTS=53 CHECKS=31765	SAT TT=1.64	SAT TT=0.255 ASSIGNMENTS=283 CHECKS=154999	SAT TT=0.999	SAT TT=1.006
csp/jnhSat/ normalized-jnh12_ext.xml	SAT TT=0.037	SAT TT=1.071 CHECKS=3023 NODES=128	SAT TT=1.082 CHECKS=4078 NODES=0	SAT TT=0.182	SAT TT=0.094 CHECKS=38091	SAT TT=0.05 CHECKS=27447	SAT TT=0.836 ASSIGNMENTS=6	SAT TT=0.966 ASSIGNMENTS=5	SAT TT=0.75 CHECKS=47304 NODES=140	SAT TT=1.943 CHECKS=2772330 NODES=7325	SAT TT=0.883 CHECKS=238976 NODES=306	SAT TT=0.048 ASSIGNMENTS=53 CHECKS=41867	SAT TT=0.047 ASSIGNMENTS=53 CHECKS=41867	SAT TT=5.296	SAT TT=4.77	SAT TT=0.533 CHECKS=11806	SAT TT=0.037 ASSIGNMENTS=41 CHECKS=43630	SAT TT=0.038 ASSIGNMENTS=70 CHECKS=50059	SAT TT=0.856	SAT TT=0.038 ASSIGNMENTS=66 CHECKS=31983	SAT TT=0.039 ASSIGNMENTS=53 CHECKS=41867	SAT TT=1.639	SAT TT=0.148 ASSIGNMENTS=202 CHECKS=104956	SAT TT=0.999	SAT TT=1.052
csp/jnhSat/ normalized-jnh17_ext.xml	SAT TT=0.033	SAT TT=1.058 CHECKS=3404 NODES=127	SAT TT=1.115 CHECKS=5121 NODES=139	SAT TT=0.199	SAT TT=0.184 CHECKS=100448	SAT TT=0.084 CHECKS=94569	SAT TT=1.094 ASSIGNMENTS=53	SAT TT=0.878 ASSIGNMENTS=10	SAT TT=0.862 CHECKS=99110 NODES=188	SAT TT=0.782 CHECKS=276778 NODES=711	SAT TT=0.703 CHECKS=138293 NODES=170	SAT TT=0.047 ASSIGNMENTS=42 CHECKS=30167	SAT TT=0.048 ASSIGNMENTS=42 CHECKS=30167	SAT TT=4.727	SAT TT=4.712	SAT TT=0.493 CHECKS=13047	SAT TT=0.042 ASSIGNMENTS=87 CHECKS=67602	SAT TT=0.084 ASSIGNMENTS=587 CHECKS=332863	SAT TT=0.826	SAT TT=0.033 ASSIGNMENTS=87 CHECKS=24537	SAT TT=0.035 ASSIGNMENTS=42 CHECKS=30167	SAT TT=1.626	SAT TT=0.214 ASSIGNMENTS=168 CHECKS=96858	SAT TT=0.997	SAT TT=1.039
csp/jnhSat/ normalized-jnh201_ext.xml	SAT TT=0.031	SAT TT=1.078 CHECKS=4697 NODES=216	SAT TT=1.123 CHECKS=5804 NODES=213	SAT TT=0.165	SAT TT=0.099 CHECKS=39897	SAT TT=0.054 CHECKS=25808	SAT TT=0.889 ASSIGNMENTS=31	SAT TT=0.884 ASSIGNMENTS=29	SAT TT=0.734 CHECKS=28550 NODES=142	SAT TT=0.685 CHECKS=30142 NODES=36	SAT TT=0.669 CHECKS=73505 NODES=61	SAT TT=0.045 ASSIGNMENTS=33 CHECKS=7600	SAT TT=0.045 ASSIGNMENTS=33 CHECKS=7600	SAT TT=6.197	SAT TT=5.424	SAT TT=0.617 CHECKS=14562	SAT TT=0.031 ASSIGNMENTS=37 CHECKS=8277	SAT TT=0.043 ASSIGNMENTS=228 CHECKS=72565	SAT TT=0.772	SAT TT=0.033 ASSIGNMENTS=64 CHECKS=13681	SAT TT=0.034 ASSIGNMENTS=33 CHECKS=7600	SAT TT=1.652	SAT TT=0.089 ASSIGNMENTS=122 CHECKS=48560	SAT TT=0.999	SAT TT=0.979
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhSat/ normalized-jnh204_ext.xml	SAT TT=0.05	SAT TT=1.215 CHECKS=19669 NODES=615	SAT TT=1.249 CHECKS=31825 NODES=577	SAT TT=1.193	SAT TT=0.268 CHECKS=141464	SAT TT=0.215 CHECKS=293895	SAT TT=2.055 ASSIGNMENTS=393	SAT TT=1.75 ASSIGNMENTS=276	SAT TT=1.55 CHECKS=464657 NODES=531	SAT TT=1.13 CHECKS=1155770 NODES=3180	SAT TT=1.445 CHECKS=3152710 NODES=3251	SAT TT=0.062 ASSIGNMENTS=232 CHECKS=154994	SAT TT=0.061 ASSIGNMENTS=232 CHECKS=154994	SAT TT=7.23	SAT TT=7.135	SAT TT=0.624 CHECKS=149060	SAT TT=0.066 ASSIGNMENTS=404 CHECKS=265618	SAT TT=0.316 ASSIGNMENTS=4210 CHECKS=1979940	SAT TT=1.172	SAT TT=0.099 ASSIGNMENTS=803 CHECKS=510988	SAT TT=0.05 ASSIGNMENTS=232 CHECKS=154994	SAT TT=1.788	SAT TT=0.27 ASSIGNMENTS=479 CHECKS=232358	SAT TT=0.986	SAT TT=1.173
csp/jnhSat/ normalized-jnh205_ext.xml	SAT TT=0.036	SAT TT=1.133 CHECKS=10024 NODES=352	SAT TT=1.2 CHECKS=14050 NODES=453	SAT TT=0.178	SAT TT=0.139 CHECKS=64434	SAT TT=0.069 CHECKS=51963	SAT TT=1.18 ASSIGNMENTS=74	SAT TT=1.251 ASSIGNMENTS=79	SAT TT=0.785 CHECKS=61736 NODES=169	SAT TT=0.772 CHECKS=340175 NODES=907	SAT TT=0.902 CHECKS=835144 NODES=1073	SAT TT=0.05 ASSIGNMENTS=73 CHECKS=61932	SAT TT=0.049 ASSIGNMENTS=73 CHECKS=61932	SAT TT=4.648	SAT TT=4.731	SAT TT=0.496 CHECKS=24433	SAT TT=0.036 ASSIGNMENTS=53 CHECKS=37981	SAT TT=0.117 ASSIGNMENTS=1175 CHECKS=590693	SAT TT=1.006	SAT TT=0.036 ASSIGNMENTS=109 CHECKS=48990	SAT TT=0.037 ASSIGNMENTS=73 CHECKS=61932	SAT TT=1.696	SAT TT=0.255 ASSIGNMENTS=314 CHECKS=192645	SAT TT=1.008	SAT TT=0.989
csp/jnhSat/ normalized-jnh207_ext.xml	SAT TT=0.04	SAT TT=1.336 CHECKS=52756 NODES=1139	SAT TT=1.003 CHECKS=1942 NODES=0	SAT TT=0.598	SAT TT=0.248 CHECKS=134296	SAT TT=0.147 CHECKS=198074	SAT TT=1.341 ASSIGNMENTS=123	SAT TT=1.477 ASSIGNMENTS=160	SAT TT=0.644 CHECKS=8724 NODES=100	SAT TT=1.44 CHECKS=1927310 NODES=5219	SAT TT=0.692 CHECKS=215288 NODES=250	SAT TT=0.051 ASSIGNMENTS=103 CHECKS=81780	SAT TT=0.054 ASSIGNMENTS=103 CHECKS=81780	SAT TT=4.719	SAT TT=4.675	SAT TT=0.515 CHECKS=38303	SAT TT=0.044 ASSIGNMENTS=146 CHECKS=123564	SAT TT=0.033 ASSIGNMENTS=50 CHECKS=21688	SAT TT=0.874	SAT TT=0.043 ASSIGNMENTS=183 CHECKS=85892	SAT TT=0.04 ASSIGNMENTS=103 CHECKS=81780	SAT TT=1.849	SAT TT=0.287 ASSIGNMENTS=519 CHECKS=288426	SAT TT=0.995	SAT TT=0.996
csp/jnhSat/ normalized-jnh209_ext.xml	SAT TT=0.032	SAT TT=1.419 CHECKS=28061 NODES=880	SAT TT=1.235 CHECKS=21828 NODES=620	SAT TT=0.192	SAT TT=0.153 CHECKS=71112	SAT TT=0.093 CHECKS=93233	SAT TT=1.062 ASSIGNMENTS=87	SAT TT=1.281 ASSIGNMENTS=155	SAT TT=0.746 CHECKS=48676 NODES=159	SAT TT=1.951 CHECKS=3149640 NODES=8716	SAT TT=0.772 CHECKS=367844 NODES=536	SAT TT=0.047 ASSIGNMENTS=101 CHECKS=55036	SAT TT=0.053 ASSIGNMENTS=101 CHECKS=55036	SAT TT=4.482	SAT TT=4.543	SAT TT=0.518 CHECKS=40046	SAT TT=0.037 ASSIGNMENTS=97 CHECKS=52339	SAT TT=0.065 ASSIGNMENTS=582 CHECKS=248614	SAT TT=0.757	SAT TT=0.032 ASSIGNMENTS=118 CHECKS=28410	SAT TT=0.038 ASSIGNMENTS=101 CHECKS=55036	SAT TT=1.82	SAT TT=0.478 ASSIGNMENTS=845 CHECKS=508130	SAT TT=0.99	SAT TT=1.026
csp/jnhSat/ normalized-jnh210_ext.xml	SAT TT=0.034	SAT TT=1.862 CHECKS=5052 NODES=219	SAT TT=1.116 CHECKS=7633 NODES=249	SAT TT=0.245	SAT TT=0.163 CHECKS=95758	SAT TT=0.075 CHECKS=60919	SAT TT=1.051 ASSIGNMENTS=69	SAT TT=0.858 ASSIGNMENTS=19	SAT TT=0.647 CHECKS=12234 NODES=105	SAT TT=0.693 CHECKS=73642 NODES=171	SAT TT=0.695 CHECKS=223041 NODES=283	SAT TT=0.046 ASSIGNMENTS=65 CHECKS=44178	SAT TT=0.046 ASSIGNMENTS=65 CHECKS=44178	SAT TT=4.556	SAT TT=4.529	SAT TT=0.554 CHECKS=23691	SAT TT=0.036 ASSIGNMENTS=102 CHECKS=58413	SAT TT=0.072 ASSIGNMENTS=614 CHECKS=285558	SAT TT=0.863	SAT TT=0.039 ASSIGNMENTS=127 CHECKS=63899	SAT TT=0.034 ASSIGNMENTS=65 CHECKS=44178	SAT TT=1.615	SAT TT=0.489 ASSIGNMENTS=718 CHECKS=438284	SAT TT=1.03	SAT TT=0.998
csp/jnhSat/ normalized-jnh212_ext.xml	SAT TT=0.055	SAT TT=1.451 CHECKS=50680 NODES=1618	SAT TT=1.598 CHECKS=64441 NODES=1891	SAT TT=5.13	SAT TT=1.112 CHECKS=652227	SAT TT=0.216 CHECKS=284458	SAT TT=2.493 ASSIGNMENTS=450	SAT TT=1.616 ASSIGNMENTS=213	SAT TT=1.126 CHECKS=256839 NODES=321	SAT TT=38.473 CHECKS=89750300 NODES=245335	SAT TT=13.966 CHECKS=59558500 NODES=39669	SAT TT=0.079 ASSIGNMENTS=355 CHECKS=282433	SAT TT=0.083 ASSIGNMENTS=355 CHECKS=282433	SAT TT=4.646	SAT TT=5.357	SAT TT=0.542 CHECKS=73890	SAT TT=0.069 ASSIGNMENTS=386 CHECKS=306256	SAT TT=0.308 ASSIGNMENTS=4364 CHECKS=1950750	SAT TT=1.421	SAT TT=0.055 ASSIGNMENTS=344 CHECKS=199933	SAT TT=0.068 ASSIGNMENTS=355 CHECKS=282433	SAT TT=1.811	SAT TT=1.058 ASSIGNMENTS=1888 CHECKS=1185840	SAT TT=1.014	SAT TT=1.019
csp/jnhSat/ normalized-jnh213_ext.xml	SAT TT=0.033	SAT TT=1.053 CHECKS=1862 NODES=101	SAT TT=1.06 CHECKS=3593 NODES=101	SAT TT=0.165	SAT TT=0.176 CHECKS=107309	SAT TT=0.082 CHECKS=111940	SAT TT=0.995 ASSIGNMENTS=22	SAT TT=0.999 ASSIGNMENTS=15	SAT TT=0.682 CHECKS=21388 NODES=115	SAT TT=0.75 CHECKS=174201 NODES=475	SAT TT=0.857 CHECKS=688716 NODES=949	SAT TT=0.043 ASSIGNMENTS=42 CHECKS=22009	SAT TT=0.043 ASSIGNMENTS=42 CHECKS=22009	SAT TT=4.703	SAT TT=4.598	SAT TT=0.484 CHECKS=14725	SAT TT=0.034 ASSIGNMENTS=25 CHECKS=18408	SAT TT=0.035 ASSIGNMENTS=104 CHECKS=34754	SAT TT=0.809	SAT TT=0.034 ASSIGNMENTS=59 CHECKS=27530	SAT TT=0.033 ASSIGNMENTS=42 CHECKS=22009	SAT TT=1.621	SAT TT=0.146 ASSIGNMENTS=326 CHECKS=140979	SAT TT=1	SAT TT=1.004
csp/jnhSat/ normalized-jnh217_ext.xml	SAT TT=0.034	SAT TT=1.092 CHECKS=8047 NODES=164	SAT TT=1.102 CHECKS=8276 NODES=158	SAT TT=0.263	SAT TT=0.101 CHECKS=36168	SAT TT=0.06 CHECKS=35572	SAT TT=0.919 ASSIGNMENTS=59	SAT TT=0.948 ASSIGNMENTS=67	SAT TT=1.164 CHECKS=243803 NODES=381	SAT TT=0.742 CHECKS=180335 NODES=435	SAT TT=0.789 CHECKS=327359 NODES=387	SAT TT=0.043 ASSIGNMENTS=58 CHECKS=30004	SAT TT=0.044 ASSIGNMENTS=58 CHECKS=30004	SAT TT=4.576	SAT TT=4.58	SAT TT=0.495 CHECKS=15757	SAT TT=0.044 ASSIGNMENTS=59 CHECKS=27360	SAT TT=0.078 ASSIGNMENTS=750 CHECKS=328477	SAT TT=0.748	SAT TT=0.044 ASSIGNMENTS=234 CHECKS=94066	SAT TT=0.034 ASSIGNMENTS=58 CHECKS=30004	SAT TT=1.624	SAT TT=0.123 ASSIGNMENTS=212 CHECKS=72579	SAT TT=1.01	SAT TT=0.984
csp/jnhSat/ normalized-jnh218_ext.xml	SAT TT=0.035	SAT TT=1.055 CHECKS=3122 NODES=133	SAT TT=1.1 CHECKS=5597 NODES=146	SAT TT=0.206	SAT TT=0.151 CHECKS=82239	SAT TT=0.074 CHECKS=74399	SAT TT=1.071 ASSIGNMENTS=69	SAT TT=0.842 ASSIGNMENTS=18	SAT TT=0.692 CHECKS=27465 NODES=123	SAT TT=0.685 CHECKS=131146 NODES=326	SAT TT=0.752 CHECKS=320978 NODES=369	SAT TT=0.046 ASSIGNMENTS=57 CHECKS=37918	SAT TT=0.045 ASSIGNMENTS=57 CHECKS=37918	SAT TT=4.66	SAT TT=4.753	SAT TT=0.5 CHECKS=19497	SAT TT=0.041 ASSIGNMENTS=101 CHECKS=69174	SAT TT=0.041 ASSIGNMENTS=138 CHECKS=71383	SAT TT=0.789	SAT TT=0.035 ASSIGNMENTS=104 CHECKS=36793	SAT TT=0.036 ASSIGNMENTS=57 CHECKS=37918	SAT TT=1.657	SAT TT=0.138 ASSIGNMENTS=261 CHECKS=124379	SAT TT=1.017	SAT TT=0.991
csp/jnhSat/ normalized-jnh220_ext.xml	SAT TT=0.036	SAT TT=1.272 CHECKS=23795 NODES=692	SAT TT=1.489 CHECKS=35268 NODES=1081	SAT TT=0.182	SAT TT=0.145 CHECKS=63624	SAT TT=0.073 CHECKS=62733	SAT TT=1.029 ASSIGNMENTS=69	SAT TT=1.432 ASSIGNMENTS=159	SAT TT=0.748 CHECKS=53790 NODES=155	SAT TT=0.758 CHECKS=299134 NODES=778	SAT TT=1.021 CHECKS=1346650 NODES=1655	SAT TT=0.05 ASSIGNMENTS=90 CHECKS=61962	SAT TT=0.05 ASSIGNMENTS=90 CHECKS=61962	SAT TT=4.716	SAT TT=4.55	SAT TT=1.094 CHECKS=66435	SAT TT=0.036 ASSIGNMENTS=69 CHECKS=48711	SAT TT=0.149 ASSIGNMENTS=1627 CHECKS=768327	SAT TT=0.721	SAT TT=0.039 ASSIGNMENTS=146 CHECKS=48785	SAT TT=0.038 ASSIGNMENTS=90 CHECKS=61962	SAT TT=1.978	SAT TT=0.184 ASSIGNMENTS=361 CHECKS=253075	SAT TT=0.987	SAT TT=0.994
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhSat/ normalized-jnh301_ext.xml	SAT TT=0.048	SAT TT=1.203 CHECKS=12387 NODES=455	SAT TT=1.228 CHECKS=13477 NODES=434	SAT TT=0.37	SAT TT=0.71 CHECKS=384029	SAT TT=0.17 CHECKS=177926	SAT TT=1.707 ASSIGNMENTS=196	SAT TT=1.68 ASSIGNMENTS=255	SAT TT=1.239 CHECKS=249630 NODES=321	SAT TT=2.103 CHECKS=3074680 NODES=6619	SAT TT=1.272 CHECKS=1950170 NODES=1946	SAT TT=0.059 ASSIGNMENTS=123 CHECKS=103239	SAT TT=0.058 ASSIGNMENTS=123 CHECKS=103239	SAT TT=5.912	SAT TT=5.833	SAT TT=0.699 CHECKS=77263	SAT TT=0.056 ASSIGNMENTS=213 CHECKS=164004	SAT TT=0.319 ASSIGNMENTS=3930 CHECKS=1866930	SAT TT=1.123	SAT TT=0.051 ASSIGNMENTS=254 CHECKS=128179	SAT TT=0.048 ASSIGNMENTS=123 CHECKS=103239	SAT TT=1.879	SAT TT=0.244 ASSIGNMENTS=350 CHECKS=170510	SAT TT=1.026	SAT TT=1.05
csp/jnhUnsat/ normalized-jnh02_ext.xml	UNSAT TT=0.035	UNSAT TT=1.035 CHECKS=1536 NODES=45	UNSAT TT=1.095 CHECKS=3055 NODES=0	UNSAT TT=0.177	UNSAT TT=0.057 CHECKS=7983	UNSAT TT=0.048 CHECKS=9366	UNSAT TT=0.701 ASSIGNMENTS=0	UNSAT TT=0.855 ASSIGNMENTS=0	UNSAT TT=0.853 CHECKS=25626 NODES=17	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=0.047 ASSIGNMENTS=12 CHECKS=12920	UNSAT TT=0.045 ASSIGNMENTS=12 CHECKS=12920	UNSAT TT=5.154	UNSAT TT=5.638	UNSAT TT=0.532 CHECKS=7412	UNSAT TT=0.036 ASSIGNMENTS=10 CHECKS=9732	UNSAT TT=0.033 ASSIGNMENTS=11 CHECKS=10834	UNSAT TT=0.673	UNSAT TT=0.037 ASSIGNMENTS=60 CHECKS=26020	UNSAT TT=0.035 ASSIGNMENTS=12 CHECKS=12920	UNSAT TT=1.681	UNSAT TT=0.154 ASSIGNMENTS=148 CHECKS=129267	UNSAT TT=0.978	UNSAT TT=1.028
csp/jnhUnsat/ normalized-jnh04_ext.xml	UNSAT TT=0.043	UNSAT TT=1.388 CHECKS=24129 NODES=451	UNSAT TT=1.305 CHECKS=32481 NODES=481	UNSAT TT=0.608	UNSAT TT=0.088 CHECKS=33333	UNSAT TT=0.061 CHECKS=39366	UNSAT TT=0.81 ASSIGNMENTS=0	UNSAT TT=0.885 ASSIGNMENTS=0	UNSAT TT=0.971 CHECKS=172754 NODES=137	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.049 ASSIGNMENTS=87 CHECKS=72429	UNSAT TT=0.054 ASSIGNMENTS=87 CHECKS=72429	UNSAT TT=4.18	UNSAT TT=4.294	UNSAT TT=0.555 CHECKS=34749	UNSAT TT=0.043 ASSIGNMENTS=134 CHECKS=107345	UNSAT TT=0.289 ASSIGNMENTS=3584 CHECKS=1835560	UNSAT TT=0.716	UNSAT TT=0.047 ASSIGNMENTS=182 CHECKS=115706	UNSAT TT=0.044 ASSIGNMENTS=87 CHECKS=72429	UNSAT TT=1.641	UNSAT TT=0.283 ASSIGNMENTS=253 CHECKS=244562	UNSAT TT=1.316	UNSAT TT=1.242
csp/jnhUnsat/ normalized-jnh05_ext.xml	UNSAT TT=0.034	UNSAT TT=1.148 CHECKS=5463 NODES=202	UNSAT TT=1.164 CHECKS=6102 NODES=97	UNSAT TT=0.174	UNSAT TT=0.096 CHECKS=31442	UNSAT TT=0.052 CHECKS=21812	UNSAT TT=1.131 ASSIGNMENTS=0	UNSAT TT=0.922 ASSIGNMENTS=0	UNSAT TT=0.773 CHECKS=36922 NODES=33	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.047 ASSIGNMENTS=19 CHECKS=17174	UNSAT TT=0.046 ASSIGNMENTS=19 CHECKS=17174	UNSAT TT=4.437	UNSAT TT=4.329	UNSAT TT=0.527 CHECKS=17896	UNSAT TT=0.034 ASSIGNMENTS=21 CHECKS=20230	UNSAT TT=0.043 ASSIGNMENTS=114 CHECKS=70258	UNSAT TT=0.715	UNSAT TT=0.039 ASSIGNMENTS=78 CHECKS=27717	UNSAT TT=0.036 ASSIGNMENTS=19 CHECKS=17174	UNSAT TT=1.819	UNSAT TT=0.162 ASSIGNMENTS=206 CHECKS=137262	UNSAT TT=1.261	UNSAT TT=1.156
csp/jnhUnsat/ normalized-jnh06_ext.xml	UNSAT TT=0.045	UNSAT TT=1.373 CHECKS=51228 NODES=930	UNSAT TT=1.312 CHECKS=19234 NODES=554	UNSAT TT=0.381	UNSAT TT=0.264 CHECKS=127577	UNSAT TT=0.11 CHECKS=102667	UNSAT TT=1.457 ASSIGNMENTS=132	UNSAT TT=1.375 ASSIGNMENTS=148	UNSAT TT=1.059 CHECKS=199841 NODES=177	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.056 ASSIGNMENTS=127 CHECKS=88654	UNSAT TT=0.056 ASSIGNMENTS=127 CHECKS=88654	UNSAT TT=4.988	UNSAT TT=4.084	UNSAT TT=0.519 CHECKS=37057	UNSAT TT=0.046 ASSIGNMENTS=160 CHECKS=116649	UNSAT TT=0.335 ASSIGNMENTS=3954 CHECKS=2018960	UNSAT TT=0.92	UNSAT TT=0.045 ASSIGNMENTS=194 CHECKS=91316	UNSAT TT=0.045 ASSIGNMENTS=127 CHECKS=88654	UNSAT TT=1.915	UNSAT TT=0.479 ASSIGNMENTS=609 CHECKS=450433	UNSAT TT=0.979	UNSAT TT=1
csp/jnhUnsat/ normalized-jnh08_ext.xml	UNSAT TT=0.033	UNSAT TT=1.155 CHECKS=4712 NODES=151	UNSAT TT=1.221 CHECKS=7718 NODES=170	UNSAT TT=0.178	UNSAT TT=0.078 CHECKS=19911	UNSAT TT=0.047 CHECKS=15449	UNSAT TT=0.811 ASSIGNMENTS=0	UNSAT TT=1.032 ASSIGNMENTS=0	UNSAT TT=0.824 CHECKS=63906 NODES=54	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.047 ASSIGNMENTS=16 CHECKS=16134	UNSAT TT=0.047 ASSIGNMENTS=16 CHECKS=16134	UNSAT TT=4.299	UNSAT TT=4.161	UNSAT TT=0.526 CHECKS=13052	UNSAT TT=0.036 ASSIGNMENTS=22 CHECKS=22439	UNSAT TT=0.104 ASSIGNMENTS=988 CHECKS=567717	UNSAT TT=0.641	UNSAT TT=0.037 ASSIGNMENTS=95 CHECKS=39404	UNSAT TT=0.033 ASSIGNMENTS=16 CHECKS=16134	UNSAT TT=1.768	UNSAT TT=0.094 ASSIGNMENTS=146 CHECKS=104271	UNSAT TT=1.005	UNSAT TT=1.04
csp/jnhUnsat/ normalized-jnh09_ext.xml	UNSAT TT=0.038	UNSAT TT=1.262 CHECKS=16683 NODES=595	UNSAT TT=1.334 CHECKS=18844 NODES=715	UNSAT TT=0.422	UNSAT TT=0.072 CHECKS=17836	UNSAT TT=0.056 CHECKS=32338	UNSAT TT=1.071 ASSIGNMENTS=0	UNSAT TT=0.825 ASSIGNMENTS=0	UNSAT TT=1.019 CHECKS=94974 NODES=94	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.054 ASSIGNMENTS=87 CHECKS=58349	UNSAT TT=0.055 ASSIGNMENTS=87 CHECKS=58349	UNSAT TT=4.021	UNSAT TT=5.653	UNSAT TT=0.513 CHECKS=29895	UNSAT TT=0.038 ASSIGNMENTS=97 CHECKS=66023	UNSAT TT=0.125 ASSIGNMENTS=1292 CHECKS=635751	UNSAT TT=0.78	UNSAT TT=0.039 ASSIGNMENTS=136 CHECKS=64108	UNSAT TT=0.04 ASSIGNMENTS=87 CHECKS=58349	UNSAT TT=1.777	UNSAT TT=0.253 ASSIGNMENTS=263 CHECKS=170659	UNSAT TT=1.012	UNSAT TT=1.149
csp/jnhUnsat/ normalized-jnh10_ext.xml	UNSAT TT=0.035	UNSAT TT=1.173 CHECKS=8141 NODES=208	UNSAT TT=1.144 CHECKS=4565 NODES=0	UNSAT TT=0.181	UNSAT TT=0.068 CHECKS=12039	UNSAT TT=0.049 CHECKS=17028	UNSAT TT=0.985 ASSIGNMENTS=0	UNSAT TT=0.791 ASSIGNMENTS=0	UNSAT TT=0.824 CHECKS=62568 NODES=48	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.047 ASSIGNMENTS=16 CHECKS=15721	UNSAT TT=0.044 ASSIGNMENTS=16 CHECKS=15721	UNSAT TT=4.253	UNSAT TT=4.217	UNSAT TT=0.5 CHECKS=10983	UNSAT TT=0.035 ASSIGNMENTS=17 CHECKS=17019	UNSAT TT=0.04 ASSIGNMENTS=60 CHECKS=49794	UNSAT TT=0.902	UNSAT TT=0.036 ASSIGNMENTS=73 CHECKS=32823	UNSAT TT=0.035 ASSIGNMENTS=16 CHECKS=15721	UNSAT TT=1.796	UNSAT TT=0.152 ASSIGNMENTS=185 CHECKS=132702	UNSAT TT=0.972	UNSAT TT=1.13
csp/jnhUnsat/ normalized-jnh11_ext.xml	UNSAT TT=0.038	UNSAT TT=1.277 CHECKS=15730 NODES=459	UNSAT TT=1.313 CHECKS=12325 NODES=300	UNSAT TT=0.554	UNSAT TT=0.113 CHECKS=49562	UNSAT TT=0.072 CHECKS=73107	UNSAT TT=1.155 ASSIGNMENTS=36	UNSAT TT=1.127 ASSIGNMENTS=6	UNSAT TT=0.991 CHECKS=129717 NODES=119	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=0.054 ASSIGNMENTS=80 CHECKS=72218	UNSAT TT=0.055 ASSIGNMENTS=80 CHECKS=72218	UNSAT TT=4.068	UNSAT TT=4.491	UNSAT TT=0.52 CHECKS=15577	UNSAT TT=0.04 ASSIGNMENTS=79 CHECKS=66981	UNSAT TT=0.317 ASSIGNMENTS=3774 CHECKS=1804830	UNSAT TT=0.753	UNSAT TT=0.038 ASSIGNMENTS=85 CHECKS=48160	UNSAT TT=0.043 ASSIGNMENTS=80 CHECKS=72218	UNSAT TT=1.889	UNSAT TT=0.243 ASSIGNMENTS=307 CHECKS=210023	UNSAT TT=1.245	UNSAT TT=1.044
csp/jnhUnsat/ normalized-jnh13_ext.xml	UNSAT TT=0.033	UNSAT TT=1.134 CHECKS=5469 NODES=131	UNSAT TT=1.28 CHECKS=6460 NODES=127	UNSAT TT=0.175	UNSAT TT=0.078 CHECKS=23769	UNSAT TT=0.052 CHECKS=19967	UNSAT TT=1.015 ASSIGNMENTS=0	UNSAT TT=0.774 ASSIGNMENTS=0	UNSAT TT=0.727 CHECKS=41305 NODES=34	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.045 ASSIGNMENTS=13 CHECKS=12733	UNSAT TT=0.048 ASSIGNMENTS=13 CHECKS=12733	UNSAT TT=5.132	UNSAT TT=4.207	UNSAT TT=0.72 CHECKS=8937	UNSAT TT=0.034 ASSIGNMENTS=11 CHECKS=12953	UNSAT TT=0.178 ASSIGNMENTS=1735 CHECKS=970875	UNSAT TT=0.677	UNSAT TT=0.036 ASSIGNMENTS=81 CHECKS=29540	UNSAT TT=0.033 ASSIGNMENTS=13 CHECKS=12733	UNSAT TT=1.761	UNSAT TT=0.109 ASSIGNMENTS=194 CHECKS=130886	UNSAT TT=1.042	UNSAT TT=1.4
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhUnsat/ normalized-jnh14_ext.xml	UNSAT TT=0.035	UNSAT TT=1.22 CHECKS=12072 NODES=414	UNSAT TT=1.402 CHECKS=14474 NODES=430	UNSAT TT=0.34	UNSAT TT=0.084 CHECKS=25450	UNSAT TT=0.048 CHECKS=23438	UNSAT TT=1.022 ASSIGNMENTS=0	UNSAT TT=1.041 ASSIGNMENTS=0	UNSAT TT=0.767 CHECKS=54779 NODES=47	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.048 ASSIGNMENTS=43 CHECKS=28491	UNSAT TT=0.044 ASSIGNMENTS=43 CHECKS=28491	UNSAT TT=4.157	UNSAT TT=5.216	UNSAT TT=0.734 CHECKS=22138	UNSAT TT=0.039 ASSIGNMENTS=70 CHECKS=56452	UNSAT TT=0.201 ASSIGNMENTS=2589 CHECKS=1226600	UNSAT TT=0.841	UNSAT TT=0.041 ASSIGNMENTS=159 CHECKS=57710	UNSAT TT=0.035 ASSIGNMENTS=43 CHECKS=28491	UNSAT TT=1.73	UNSAT TT=0.181 ASSIGNMENTS=216 CHECKS=191911	UNSAT TT=1.034	UNSAT TT=1.164
csp/jnhUnsat/ normalized-jnh15_ext.xml	UNSAT TT=0.034	UNSAT TT=1.386 CHECKS=13652 NODES=401	UNSAT TT=1.19 CHECKS=10088 NODES=168	UNSAT TT=0.237	UNSAT TT=0.101 CHECKS=42017	UNSAT TT=0.057 CHECKS=41576	UNSAT TT=0.902 ASSIGNMENTS=10	UNSAT TT=1.164 ASSIGNMENTS=1	UNSAT TT=0.933 CHECKS=59275 NODES=41	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=0.047 ASSIGNMENTS=47 CHECKS=42509	UNSAT TT=0.05 ASSIGNMENTS=47 CHECKS=42509	UNSAT TT=5.233	UNSAT TT=4.92	UNSAT TT=0.66 CHECKS=26455	UNSAT TT=0.038 ASSIGNMENTS=67 CHECKS=48676	UNSAT TT=0.124 ASSIGNMENTS=1046 CHECKS=613418	UNSAT TT=0.903	UNSAT TT=0.034 ASSIGNMENTS=103 CHECKS=43635	UNSAT TT=0.036 ASSIGNMENTS=47 CHECKS=42509	UNSAT TT=1.773	UNSAT TT=0.284 ASSIGNMENTS=415 CHECKS=271891	UNSAT TT=1.139	UNSAT TT=1.042
csp/jnhUnsat/ normalized-jnh16_ext.xml	UNSAT TT=0.119	UNSAT TT=2.585 CHECKS=234797 NODES=5167	UNSAT TT=2.556 CHECKS=223072 NODES=5339	UNSAT TT=1.715	UNSAT TT=5.649 CHECKS=2992990	UNSAT TT=2.694 CHECKS=3878880	UNSAT TT=4.187 ASSIGNMENTS=854	UNSAT TT=7.674 ASSIGNMENTS=2131	UNSAT TT=5.015 CHECKS=2327160 NODES=1952	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.131 ASSIGNMENTS=736 CHECKS=567811	UNSAT TT=0.132 ASSIGNMENTS=736 CHECKS=567811	UNSAT TT=4.467	UNSAT TT=4.28	UNSAT TT=0.868 CHECKS=315260	UNSAT TT=0.133 ASSIGNMENTS=848 CHECKS=659886	UNSAT TT=0.411 ASSIGNMENTS=4730 CHECKS=2492440	UNSAT TT=1.85	UNSAT TT=0.136 ASSIGNMENTS=904 CHECKS=655316	UNSAT TT=0.119 ASSIGNMENTS=736 CHECKS=567811	UNSAT TT=2.134	UNSAT TT=2.506 ASSIGNMENTS=5010 CHECKS=3581100	UNSAT TT=1.245	UNSAT TT=1.199
csp/jnhUnsat/ normalized-jnh18_ext.xml	UNSAT TT=0.039	UNSAT TT=1.327 CHECKS=23099 NODES=766	UNSAT TT=1.339 CHECKS=19645 NODES=658	UNSAT TT=0.291	UNSAT TT=0.386 CHECKS=199967	UNSAT TT=0.099 CHECKS=97199	UNSAT TT=1.258 ASSIGNMENTS=87	UNSAT TT=1.212 ASSIGNMENTS=68	UNSAT TT=1.992 CHECKS=577392 NODES=463	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.054 ASSIGNMENTS=98 CHECKS=72438	UNSAT TT=0.062 ASSIGNMENTS=98 CHECKS=72438	UNSAT TT=5.174	UNSAT TT=5.815	UNSAT TT=0.777 CHECKS=67027	UNSAT TT=0.049 ASSIGNMENTS=142 CHECKS=105061	UNSAT TT=0.327 ASSIGNMENTS=4082 CHECKS=2138040	UNSAT TT=0.922	UNSAT TT=0.045 ASSIGNMENTS=198 CHECKS=99945	UNSAT TT=0.039 ASSIGNMENTS=98 CHECKS=72438	UNSAT TT=1.949	UNSAT TT=0.344 ASSIGNMENTS=640 CHECKS=424875	UNSAT TT=1.222	UNSAT TT=1.001
csp/jnhUnsat/ normalized-jnh19_ext.xml	UNSAT TT=0.048	UNSAT TT=1.302 CHECKS=19591 NODES=613	UNSAT TT=1.406 CHECKS=29688 NODES=789	UNSAT TT=0.756	UNSAT TT=0.535 CHECKS=273477	UNSAT TT=0.282 CHECKS=365478	UNSAT TT=1.89 ASSIGNMENTS=212	UNSAT TT=1.002 ASSIGNMENTS=22	UNSAT TT=0.839 CHECKS=64946 NODES=51	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.06 ASSIGNMENTS=125 CHECKS=113006	UNSAT TT=0.056 ASSIGNMENTS=125 CHECKS=113006	UNSAT TT=4.338	UNSAT TT=4.584	UNSAT TT=0.605 CHECKS=51156	UNSAT TT=0.048 ASSIGNMENTS=135 CHECKS=118965	UNSAT TT=0.321 ASSIGNMENTS=3828 CHECKS=1983590	UNSAT TT=0.975	UNSAT TT=0.049 ASSIGNMENTS=205 CHECKS=105866	UNSAT TT=0.048 ASSIGNMENTS=125 CHECKS=113006	UNSAT TT=1.69	UNSAT TT=0.415 ASSIGNMENTS=703 CHECKS=497972	UNSAT TT=1.026	UNSAT TT=1.026
csp/jnhUnsat/ normalized-jnh202_ext.xml	UNSAT TT=0.032	UNSAT TT=1.079 CHECKS=839 NODES=31	UNSAT TT=1.064 CHECKS=1666 NODES=0	UNSAT TT=0.173	UNSAT TT=0.063 CHECKS=13861	UNSAT TT=0.046 CHECKS=9985	UNSAT TT=0.699 ASSIGNMENTS=0	UNSAT TT=0.801 ASSIGNMENTS=0	UNSAT TT=0.746 CHECKS=57384 NODES=43	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=0.046 ASSIGNMENTS=18 CHECKS=16686	UNSAT TT=0.045 ASSIGNMENTS=18 CHECKS=16686	UNSAT TT=4.312	UNSAT TT=4.578	UNSAT TT=0.539 CHECKS=23990	UNSAT TT=0.032 ASSIGNMENTS=18 CHECKS=16967	UNSAT TT=0.047 ASSIGNMENTS=116 CHECKS=77073	UNSAT TT=0.661	UNSAT TT=0.033 ASSIGNMENTS=54 CHECKS=19376	UNSAT TT=0.035 ASSIGNMENTS=18 CHECKS=16686	UNSAT TT=1.724	UNSAT TT=0.197 ASSIGNMENTS=318 CHECKS=275028	UNSAT TT=0.972	UNSAT TT=1.22
csp/jnhUnsat/ normalized-jnh203_ext.xml	UNSAT TT=0.036	UNSAT TT=1.261 CHECKS=17212 NODES=557	UNSAT TT=1.206 CHECKS=15095 NODES=455	UNSAT TT=0.188	UNSAT TT=0.168 CHECKS=72551	UNSAT TT=0.087 CHECKS=72213	UNSAT TT=1.155 ASSIGNMENTS=53	UNSAT TT=0.93 ASSIGNMENTS=15	UNSAT TT=1.005 CHECKS=93319 NODES=85	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.048 ASSIGNMENTS=54 CHECKS=41414	UNSAT TT=0.048 ASSIGNMENTS=54 CHECKS=41414	UNSAT TT=4.019	UNSAT TT=4.116	UNSAT TT=0.562 CHECKS=29862	UNSAT TT=0.039 ASSIGNMENTS=67 CHECKS=51762	UNSAT TT=0.341 ASSIGNMENTS=3764 CHECKS=2083950	UNSAT TT=0.783	UNSAT TT=0.039 ASSIGNMENTS=129 CHECKS=61920	UNSAT TT=0.036 ASSIGNMENTS=54 CHECKS=41414	UNSAT TT=1.873	UNSAT TT=0.154 ASSIGNMENTS=371 CHECKS=210375	UNSAT TT=1.2	UNSAT TT=1.21
csp/jnhUnsat/ normalized-jnh206_ext.xml	UNSAT TT=0.047	UNSAT TT=1.322 CHECKS=32441 NODES=884	UNSAT TT=1.237 CHECKS=24232 NODES=585	UNSAT TT=0.235	UNSAT TT=0.202 CHECKS=111475	UNSAT TT=0.097 CHECKS=110724	UNSAT TT=1.379 ASSIGNMENTS=100	UNSAT TT=1.128 ASSIGNMENTS=61	UNSAT TT=1.187 CHECKS=229877 NODES=208	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=0.063 ASSIGNMENTS=151 CHECKS=130802	UNSAT TT=0.063 ASSIGNMENTS=151 CHECKS=130802	UNSAT TT=4.025	UNSAT TT=4.162	UNSAT TT=0.52 CHECKS=45502	UNSAT TT=0.047 ASSIGNMENTS=134 CHECKS=125594	UNSAT TT=0.338 ASSIGNMENTS=4002 CHECKS=1966060	UNSAT TT=0.873	UNSAT TT=0.055 ASSIGNMENTS=282 CHECKS=175550	UNSAT TT=0.047 ASSIGNMENTS=151 CHECKS=130802	UNSAT TT=1.944	UNSAT TT=0.302 ASSIGNMENTS=629 CHECKS=366050	UNSAT TT=0.977	UNSAT TT=1.325
csp/jnhUnsat/ normalized-jnh208_ext.xml	UNSAT TT=0.035	UNSAT TT=1.241 CHECKS=32632 NODES=491	UNSAT TT=1.31 CHECKS=27544 NODES=376	UNSAT TT=0.203	UNSAT TT=0.235 CHECKS=122953	UNSAT TT=0.101 CHECKS=117711	UNSAT TT=1.249 ASSIGNMENTS=62	UNSAT TT=1.108 ASSIGNMENTS=23	UNSAT TT=0.886 CHECKS=99125 NODES=81	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=0.046 ASSIGNMENTS=42 CHECKS=36283	UNSAT TT=0.05 ASSIGNMENTS=42 CHECKS=36283	UNSAT TT=4.662	UNSAT TT=4.264	UNSAT TT=0.61 CHECKS=32416	UNSAT TT=0.038 ASSIGNMENTS=82 CHECKS=62801	UNSAT TT=0.324 ASSIGNMENTS=3537 CHECKS=1831530	UNSAT TT=1.03	UNSAT TT=0.039 ASSIGNMENTS=90 CHECKS=49649	UNSAT TT=0.035 ASSIGNMENTS=42 CHECKS=36283	UNSAT TT=1.762	UNSAT TT=0.261 ASSIGNMENTS=297 CHECKS=198019	UNSAT TT=1.214	UNSAT TT=1.035
csp/jnhUnsat/ normalized-jnh20_ext.xml	UNSAT TT=0.04	UNSAT TT=1.182 CHECKS=10769 NODES=367	UNSAT TT=1.286 CHECKS=12081 NODES=299	UNSAT TT=0.229	UNSAT TT=0.132 CHECKS=49566	UNSAT TT=0.052 CHECKS=21635	UNSAT TT=0.932 ASSIGNMENTS=0	UNSAT TT=0.876 ASSIGNMENTS=0	UNSAT TT=0.811 CHECKS=75999 NODES=69	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=0.047 ASSIGNMENTS=75 CHECKS=65162	UNSAT TT=0.053 ASSIGNMENTS=75 CHECKS=65162	UNSAT TT=4.405	UNSAT TT=4.201	UNSAT TT=0.651 CHECKS=40634	UNSAT TT=0.041 ASSIGNMENTS=82 CHECKS=66046	UNSAT TT=0.074 ASSIGNMENTS=459 CHECKS=287257	UNSAT TT=0.724	UNSAT TT=0.04 ASSIGNMENTS=116 CHECKS=58932	UNSAT TT=0.041 ASSIGNMENTS=75 CHECKS=65162	UNSAT TT=1.919	UNSAT TT=0.26 ASSIGNMENTS=274 CHECKS=193683	UNSAT TT=1.227	UNSAT TT=1.036
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhUnsat/ normalized-jnh211_ext.xml	UNSAT TT=0.032	UNSAT TT=1.181 CHECKS=7129 NODES=230	UNSAT TT=1.288 CHECKS=8411 NODES=214	UNSAT TT=0.18	UNSAT TT=0.064 CHECKS=15066	UNSAT TT=0.055 CHECKS=38037	UNSAT TT=0.764 ASSIGNMENTS=0	UNSAT TT=0.779 ASSIGNMENTS=0	UNSAT TT=0.951 CHECKS=72090 NODES=60	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.043 ASSIGNMENTS=18 CHECKS=14766	UNSAT TT=0.039 ASSIGNMENTS=18 CHECKS=14766	UNSAT TT=5.358	UNSAT TT=4.086	UNSAT TT=0.503 CHECKS=14345	UNSAT TT=0.034 ASSIGNMENTS=33 CHECKS=27475	UNSAT TT=0.078 ASSIGNMENTS=605 CHECKS=330026	UNSAT TT=0.787	UNSAT TT=0.034 ASSIGNMENTS=77 CHECKS=30431	UNSAT TT=0.032 ASSIGNMENTS=18 CHECKS=14766	UNSAT TT=1.652	UNSAT TT=0.098 ASSIGNMENTS=179 CHECKS=113276	UNSAT TT=0.983	UNSAT TT=1.209
csp/jnhUnsat/ normalized-jnh214_ext.xml	UNSAT TT=0.035	UNSAT TT=1.172 CHECKS=9170 NODES=262	UNSAT TT=1.18 CHECKS=12139 NODES=295	UNSAT TT=0.177	UNSAT TT=0.186 CHECKS=97015	UNSAT TT=0.064 CHECKS=44495	UNSAT TT=1.194 ASSIGNMENTS=19	UNSAT TT=1.019 ASSIGNMENTS=29	UNSAT TT=0.991 CHECKS=89520 NODES=84	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.049 ASSIGNMENTS=38 CHECKS=32226	UNSAT TT=0.046 ASSIGNMENTS=38 CHECKS=32226	UNSAT TT=4.031	UNSAT TT=4.251	UNSAT TT=0.489 CHECKS=15525	UNSAT TT=0.037 ASSIGNMENTS=42 CHECKS=35489	UNSAT TT=0.298 ASSIGNMENTS=3636 CHECKS=1645080	UNSAT TT=0.775	UNSAT TT=0.037 ASSIGNMENTS=127 CHECKS=45334	UNSAT TT=0.035 ASSIGNMENTS=38 CHECKS=32226	UNSAT TT=1.782	UNSAT TT=0.139 ASSIGNMENTS=192 CHECKS=94987	UNSAT TT=1.009	UNSAT TT=1.015
csp/jnhUnsat/ normalized-jnh215_ext.xml	UNSAT TT=0.036	UNSAT TT=1.308 CHECKS=13766 NODES=340	UNSAT TT=1.279 CHECKS=20743 NODES=462	UNSAT TT=0.253	UNSAT TT=0.113 CHECKS=50556	UNSAT TT=0.061 CHECKS=45694	UNSAT TT=1.339 ASSIGNMENTS=57	UNSAT TT=1.126 ASSIGNMENTS=11	UNSAT TT=0.795 CHECKS=54326 NODES=48	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.048 ASSIGNMENTS=44 CHECKS=34940	UNSAT TT=0.046 ASSIGNMENTS=44 CHECKS=34940	UNSAT TT=4.133	UNSAT TT=4.027	UNSAT TT=0.502 CHECKS=23878	UNSAT TT=0.04 ASSIGNMENTS=85 CHECKS=69855	UNSAT TT=0.14 ASSIGNMENTS=1600 CHECKS=725167	UNSAT TT=0.699	UNSAT TT=0.045 ASSIGNMENTS=225 CHECKS=101877	UNSAT TT=0.036 ASSIGNMENTS=44 CHECKS=34940	UNSAT TT=1.667	UNSAT TT=0.155 ASSIGNMENTS=237 CHECKS=187196	UNSAT TT=1.304	UNSAT TT=1.016
csp/jnhUnsat/ normalized-jnh216_ext.xml	UNSAT TT=0.043	UNSAT TT=1.277 CHECKS=24390 NODES=691	UNSAT TT=1.254 CHECKS=25895 NODES=685	UNSAT TT=0.221	UNSAT TT=32.34 CHECKS=25177600	UNSAT TT=0.105 CHECKS=113204	UNSAT TT=1.361 ASSIGNMENTS=110	UNSAT TT=1.243 ASSIGNMENTS=69	UNSAT TT=0.984 CHECKS=137369 NODES=125	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.058 ASSIGNMENTS=102 CHECKS=89073	UNSAT TT=0.057 ASSIGNMENTS=102 CHECKS=89073	UNSAT TT=3.99	UNSAT TT=4.925	UNSAT TT=0.575 CHECKS=63985	UNSAT TT=0.046 ASSIGNMENTS=129 CHECKS=110696	UNSAT TT=0.326 ASSIGNMENTS=3795 CHECKS=1807000	UNSAT TT=0.878	UNSAT TT=0.043 ASSIGNMENTS=153 CHECKS=75599	UNSAT TT=0.043 ASSIGNMENTS=102 CHECKS=89073	UNSAT TT=1.769	UNSAT TT=0.314 ASSIGNMENTS=547 CHECKS=343587	UNSAT TT=1.212	UNSAT TT=1.064
csp/jnhUnsat/ normalized-jnh219_ext.xml	UNSAT TT=0.034	UNSAT TT=1.107 CHECKS=8788 NODES=217	UNSAT TT=1.198 CHECKS=11123 NODES=225	UNSAT TT=0.198	UNSAT TT=0.162 CHECKS=66908	UNSAT TT=0.084 CHECKS=83245	UNSAT TT=1.192 ASSIGNMENTS=44	UNSAT TT=1.266 ASSIGNMENTS=30	UNSAT TT=1.146 CHECKS=266407 NODES=242	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=0.045 ASSIGNMENTS=44 CHECKS=39871	UNSAT TT=0.048 ASSIGNMENTS=44 CHECKS=39871	UNSAT TT=4.047	UNSAT TT=4.728	UNSAT TT=0.638 CHECKS=26698	UNSAT TT=0.039 ASSIGNMENTS=53 CHECKS=46395	UNSAT TT=0.305 ASSIGNMENTS=3980 CHECKS=1922970	UNSAT TT=0.964	UNSAT TT=0.039 ASSIGNMENTS=133 CHECKS=58625	UNSAT TT=0.034 ASSIGNMENTS=44 CHECKS=39871	UNSAT TT=1.837	UNSAT TT=0.295 ASSIGNMENTS=688 CHECKS=396942	UNSAT TT=1.08	UNSAT TT=0.98
csp/jnhUnsat/ normalized-jnh302_ext.xml	UNSAT TT=0.032	UNSAT TT=1.011 CHECKS=162 NODES=0	UNSAT TT=1.023 CHECKS=162 NODES=0	UNSAT TT=0.18	UNSAT TT=0.049 CHECKS=2146	UNSAT TT=0.046 CHECKS=2146	UNSAT TT=0.651 ASSIGNMENTS=0	UNSAT TT=0.705 ASSIGNMENTS=0	UNSAT TT=0.691 CHECKS=6021 NODES=0	UNSAT TT=0.799 CHECKS=7728 NODES=0	UNSAT TT=0.965 CHECKS=7728 NODES=0	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=5.073	UNSAT TT=5.294	UNSAT TT=0.553 CHECKS=7934	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.877	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=2265	UNSAT TT=1.715	UNSAT TT=0.12 ASSIGNMENTS=141 CHECKS=159031	UNSAT TT=1.039	UNSAT TT=1.261
csp/jnhUnsat/ normalized-jnh303_ext.xml	UNSAT TT=0.042	UNSAT TT=1.209 CHECKS=15300 NODES=437	UNSAT TT=1.271 CHECKS=17359 NODES=406	UNSAT TT=0.239	UNSAT TT=0.195 CHECKS=99729	UNSAT TT=0.108 CHECKS=115750	UNSAT TT=1.506 ASSIGNMENTS=69	UNSAT TT=1.37 ASSIGNMENTS=29	UNSAT TT=0.917 CHECKS=131812 NODES=106	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=0.055 ASSIGNMENTS=97 CHECKS=70423	UNSAT TT=0.056 ASSIGNMENTS=97 CHECKS=70423	UNSAT TT=4.498	UNSAT TT=4.883	UNSAT TT=0.781 CHECKS=21767	UNSAT TT=0.044 ASSIGNMENTS=69 CHECKS=62646	UNSAT TT=0.366 ASSIGNMENTS=3774 CHECKS=2269940	UNSAT TT=0.856	UNSAT TT=0.044 ASSIGNMENTS=146 CHECKS=83588	UNSAT TT=0.042 ASSIGNMENTS=97 CHECKS=70423	UNSAT TT=1.82	UNSAT TT=0.297 ASSIGNMENTS=371 CHECKS=249415	UNSAT TT=0.973	UNSAT TT=1.044
csp/jnhUnsat/ normalized-jnh304_ext.xml	UNSAT TT=0.036	UNSAT TT=1.24 CHECKS=10982 NODES=268	UNSAT TT=1.1 CHECKS=3036 NODES=0	UNSAT TT=0.272	UNSAT TT=0.062 CHECKS=9940	UNSAT TT=0.048 CHECKS=6569	UNSAT TT=0.685 ASSIGNMENTS=0	UNSAT TT=0.701 ASSIGNMENTS=0	UNSAT TT=0.719 CHECKS=21410 NODES=10	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.048 ASSIGNMENTS=17 CHECKS=16169	UNSAT TT=0.048 ASSIGNMENTS=17 CHECKS=16169	UNSAT TT=4.432	UNSAT TT=4.528	UNSAT TT=0.531 CHECKS=12509	UNSAT TT=0.038 ASSIGNMENTS=36 CHECKS=29884	UNSAT TT=0.047 ASSIGNMENTS=180 CHECKS=112593	UNSAT TT=0.682	UNSAT TT=0.036 ASSIGNMENTS=92 CHECKS=25652	UNSAT TT=0.036 ASSIGNMENTS=17 CHECKS=16169	UNSAT TT=1.729	UNSAT TT=0.114 ASSIGNMENTS=173 CHECKS=144889	UNSAT TT=1.249	UNSAT TT=1.048
csp/jnhUnsat/ normalized-jnh305_ext.xml	UNSAT TT=0.035	UNSAT TT=1.068 CHECKS=3676 NODES=83	UNSAT TT=1.157 CHECKS=5483 NODES=84	UNSAT TT=0.186	UNSAT TT=0.101 CHECKS=34303	UNSAT TT=0.065 CHECKS=45175	UNSAT TT=0.894 ASSIGNMENTS=0	UNSAT TT=1.024 ASSIGNMENTS=0	UNSAT TT=0.758 CHECKS=27202 NODES=25	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.045 ASSIGNMENTS=12 CHECKS=15011	UNSAT TT=0.046 ASSIGNMENTS=12 CHECKS=15011	UNSAT TT=5.03	UNSAT TT=5.058	UNSAT TT=0.708 CHECKS=12489	UNSAT TT=0.035 ASSIGNMENTS=10 CHECKS=14371	UNSAT TT=0.071 ASSIGNMENTS=376 CHECKS=259006	UNSAT TT=0.936	UNSAT TT=0.037 ASSIGNMENTS=67 CHECKS=37051	UNSAT TT=0.035 ASSIGNMENTS=12 CHECKS=15011	UNSAT TT=1.807	UNSAT TT=0.121 ASSIGNMENTS=184 CHECKS=155306	UNSAT TT=1.028	UNSAT TT=1.194
csp/jnhUnsat/ normalized-jnh306_ext.xml	UNSAT TT=0.068	UNSAT TT=2 CHECKS=148016 NODES=2759	UNSAT TT=2.026 CHECKS=134157 NODES=2445	UNSAT TT=1.244	UNSAT TT=1.857 CHECKS=899573	UNSAT TT=0.813 CHECKS=1196730	UNSAT TT=2.991 ASSIGNMENTS=472	UNSAT TT=2.076 ASSIGNMENTS=260	UNSAT TT=3.178 CHECKS=1212120 NODES=952	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=0.075 ASSIGNMENTS=282 CHECKS=252095	UNSAT TT=0.076 ASSIGNMENTS=282 CHECKS=252095	UNSAT TT=4.615	UNSAT TT=4.235	UNSAT TT=1.11 CHECKS=132359	UNSAT TT=0.09 ASSIGNMENTS=435 CHECKS=403019	UNSAT TT=0.35 ASSIGNMENTS=4074 CHECKS=2275400	UNSAT TT=1.306	UNSAT TT=0.068 ASSIGNMENTS=307 CHECKS=217589	UNSAT TT=0.07 ASSIGNMENTS=282 CHECKS=252095	UNSAT TT=2.138	UNSAT TT=1.172 ASSIGNMENTS=1746 CHECKS=1354690	UNSAT TT=1.146	UNSAT TT=1.002
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jnhUnsat/ normalized-jnh307_ext.xml	UNSAT TT=0.033	UNSAT TT=1.024 CHECKS=890 NODES=36	UNSAT TT=1.091 CHECKS=529 NODES=0	UNSAT TT=0.17	UNSAT TT=0.053 CHECKS=2811	UNSAT TT=0.047 CHECKS=2811	UNSAT TT=0.822 ASSIGNMENTS=0	UNSAT TT=0.78 ASSIGNMENTS=0	UNSAT TT=0.718 CHECKS=8404 NODES=1	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.047 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=0.044 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=4.242	UNSAT TT=4.336	UNSAT TT=0.623 CHECKS=10100	UNSAT TT=0.033 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=0.035 ASSIGNMENTS=1 CHECKS=3843	UNSAT TT=0.662	UNSAT TT=0.035 ASSIGNMENTS=4 CHECKS=4618	UNSAT TT=0.033 ASSIGNMENTS=3 CHECKS=4522	UNSAT TT=1.738	UNSAT TT=0.137 ASSIGNMENTS=129 CHECKS=77539	UNSAT TT=1.031	UNSAT TT=1.555
csp/jnhUnsat/ normalized-jnh309_ext.xml	UNSAT TT=0.035	UNSAT TT=1.198 CHECKS=8979 NODES=193	UNSAT TT=1.117 CHECKS=2007 NODES=0	UNSAT TT=0.21	UNSAT TT=0.071 CHECKS=12234	UNSAT TT=0.052 CHECKS=14749	UNSAT TT=0.968 ASSIGNMENTS=0	UNSAT TT=0.823 ASSIGNMENTS=0	UNSAT TT=0.885 CHECKS=36625 NODES=26	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=0.05 ASSIGNMENTS=16 CHECKS=16323	UNSAT TT=0.049 ASSIGNMENTS=16 CHECKS=16323	UNSAT TT=4.966	UNSAT TT=4.268	UNSAT TT=0.55 CHECKS=25571	UNSAT TT=0.035 ASSIGNMENTS=21 CHECKS=23048	UNSAT TT=0.079 ASSIGNMENTS=460 CHECKS=286282	UNSAT TT=0.747	UNSAT TT=0.039 ASSIGNMENTS=33 CHECKS=21557	UNSAT TT=0.035 ASSIGNMENTS=16 CHECKS=16323	UNSAT TT=1.687	UNSAT TT=0.155 ASSIGNMENTS=129 CHECKS=88276	UNSAT TT=1.195	UNSAT TT=1.055
csp/jnhUnsat/ normalized-jnh310_ext.xml	UNSAT TT=0.034	UNSAT TT=1.058 CHECKS=301 NODES=15	UNSAT TT=1.015 CHECKS=183 NODES=0	UNSAT TT=0.184	UNSAT TT=0.056 CHECKS=4182	UNSAT TT=0.043 CHECKS=3728	UNSAT TT=0.885 ASSIGNMENTS=0	UNSAT TT=0.761 ASSIGNMENTS=0	UNSAT TT=0.727 CHECKS=14626 NODES=13	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.044 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=0.047 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=4.555	UNSAT TT=5.223	UNSAT TT=0.54 CHECKS=2313	UNSAT TT=0.034 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=0.059 ASSIGNMENTS=340 CHECKS=188119	UNSAT TT=0.655	UNSAT TT=0.035 ASSIGNMENTS=38 CHECKS=11240	UNSAT TT=0.036 ASSIGNMENTS=1 CHECKS=2005	UNSAT TT=1.748	UNSAT TT=0.08 ASSIGNMENTS=36 CHECKS=30532	UNSAT TT=1.039	UNSAT TT=1.276
csp/pret/ normalized-pret-150-25_ext.xml	UNSAT TT=0.655	UNSAT TT=16.476 CHECKS=1957000 NODES=250870	UNSAT TT=75.088 CHECKS=10549000 NODES=1222260	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=24.314 ASSIGNMENTS=250870 CHECKS=1957000	UNSAT TT=23.022 ASSIGNMENTS=250870 CHECKS=1957000	UNSAT TT=0.959	UNSAT TT=0.791	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=1.305	? (TO) TT=1800.08	UNSAT TT=0.655	UNSAT TT=0.698
csp/pret/ normalized-pret-150-40_ext.xml	UNSAT TT=0.657	UNSAT TT=39.513 CHECKS=4869560 NODES=579823	UNSAT TT=135.662 CHECKS=20264500 NODES=2151090	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=43.814 ASSIGNMENTS=579823 CHECKS=4869560	UNSAT TT=46.48 ASSIGNMENTS=579823 CHECKS=4869560	UNSAT TT=0.776	UNSAT TT=1.002	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=1.364	? (TO) TT=1800.09	UNSAT TT=0.657	UNSAT TT=0.68
csp/pret/ normalized-pret-150-60_ext.xml	UNSAT TT=0.648	UNSAT TT=26.542 CHECKS=2650900 NODES=413451	UNSAT TT=17.021 CHECKS=1505670 NODES=248750	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=33.33 ASSIGNMENTS=413451 CHECKS=2650900	UNSAT TT=33.421 ASSIGNMENTS=413451 CHECKS=2650900	UNSAT TT=0.79	UNSAT TT=0.761	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=1.31	? (TO) TT=1800.08	UNSAT TT=0.691	UNSAT TT=0.648
csp/pret/ normalized-pret-150-75_ext.xml	UNSAT TT=0.683	UNSAT TT=56.792 CHECKS=6529300 NODES=917091	? (TO) TT=1800.19	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=63.624 ASSIGNMENTS=917091 CHECKS=6529300	UNSAT TT=63.884 ASSIGNMENTS=917091 CHECKS=6529300	UNSAT TT=0.762	UNSAT TT=0.74	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1788.25	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=1.44	? (TO) TT=1800.06	UNSAT TT=0.708	UNSAT TT=0.683
csp/pret/ normalized-pret-60-25_ext.xml	UNSAT TT=0.532	UNSAT TT=0.994 CHECKS=26773 NODES=5996	UNSAT TT=0.999 CHECKS=9166 NODES=3214	UNSAT TT=14.298	UNSAT TT=148.749 CHECKS=123167000	UNSAT TT=178.469 CHECKS=125587000	UNSAT TT=106.307 ASSIGNMENTS=1759700	UNSAT TT=134.482 ASSIGNMENTS=2097870	UNSAT TT=108.192 CHECKS=75992200 NODES=4473240	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=8.372 ASSIGNMENTS=5996 CHECKS=26773	UNSAT TT=8.491 ASSIGNMENTS=5996 CHECKS=26773	UNSAT TT=0.608	UNSAT TT=0.681	UNSAT TT=32.218 CHECKS=31394700	UNSAT TT=14.902 ASSIGNMENTS=2233420 CHECKS=27921700	UNSAT TT=16.492 ASSIGNMENTS=2328400 CHECKS=30992600	UNSAT TT=27.228	UNSAT TT=14.359 ASSIGNMENTS=2097620 CHECKS=24568900	UNSAT TT=14.086 ASSIGNMENTS=2082170 CHECKS=27862000	UNSAT TT=1.142	UNSAT TT=119.243 ASSIGNMENTS=11902900 CHECKS=46066900	UNSAT TT=0.543	UNSAT TT=0.532
csp/pret/ normalized-pret-60-40_ext.xml	UNSAT TT=0.532	UNSAT TT=6.812 CHECKS=1128880 NODES=145938	UNSAT TT=2.371 CHECKS=202609 NODES=36757	UNSAT TT=13.631	UNSAT TT=154.651 CHECKS=131007000	UNSAT TT=153.79 CHECKS=107612000	UNSAT TT=108.288 ASSIGNMENTS=1786280	UNSAT TT=118.074 ASSIGNMENTS=2097870	UNSAT TT=74.858 CHECKS=53422400 NODES=2913330	? (TO) TT=1800.1	? (TO) TT=1800.01	UNSAT TT=13.049 ASSIGNMENTS=145938 CHECKS=1128880	UNSAT TT=13.348 ASSIGNMENTS=145938 CHECKS=1128880	UNSAT TT=0.604	UNSAT TT=0.602	UNSAT TT=32.318 CHECKS=31394700	UNSAT TT=13.295 ASSIGNMENTS=2021840 CHECKS=26919900	UNSAT TT=17.921 ASSIGNMENTS=2303120 CHECKS=34018600	UNSAT TT=24.84	UNSAT TT=16.021 ASSIGNMENTS=2127050 CHECKS=30136100	UNSAT TT=11.896 ASSIGNMENTS=1924220 CHECKS=22541300	UNSAT TT=1.088	UNSAT TT=107.646 ASSIGNMENTS=11750700 CHECKS=44961000	UNSAT TT=0.535	UNSAT TT=0.532
csp/pret/ normalized-pret-60-60_ext.xml	UNSAT TT=0.524	UNSAT TT=1.269 CHECKS=56760 NODES=14091	UNSAT TT=1.247 CHECKS=54596 NODES=12484	UNSAT TT=13.673	UNSAT TT=83.091 CHECKS=53840200	UNSAT TT=145.452 CHECKS=131118000	UNSAT TT=120.377 ASSIGNMENTS=1971740	UNSAT TT=124.965 ASSIGNMENTS=2066640	UNSAT TT=99.051 CHECKS=66763900 NODES=3902360	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=8.232 ASSIGNMENTS=14091 CHECKS=56760	UNSAT TT=8.973 ASSIGNMENTS=14091 CHECKS=56760	UNSAT TT=0.61	UNSAT TT=0.784	UNSAT TT=31.925 CHECKS=27144700	UNSAT TT=14.238 ASSIGNMENTS=2028550 CHECKS=27031200	UNSAT TT=18.227 ASSIGNMENTS=2286460 CHECKS=34709400	UNSAT TT=23.025	UNSAT TT=14.695 ASSIGNMENTS=2073900 CHECKS=27376900	UNSAT TT=14.166 ASSIGNMENTS=2088260 CHECKS=26854300	UNSAT TT=1.129	UNSAT TT=111.663 ASSIGNMENTS=12040200 CHECKS=49119300	UNSAT TT=0.56	UNSAT TT=0.524
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pret/ normalized-pret-60-75_ext.xml	UNSAT TT=0.509	UNSAT TT=1.609 CHECKS=103001 NODES=22469	UNSAT TT=1.683 CHECKS=114581 NODES=23701	UNSAT TT=13.561	UNSAT TT=155.069 CHECKS=99884800	UNSAT TT=148.731 CHECKS=133991000	UNSAT TT=133.421 ASSIGNMENTS=2160460	UNSAT TT=127.654 ASSIGNMENTS=2090600	UNSAT TT=91.467 CHECKS=62716700 NODES=3617560	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=8.442 ASSIGNMENTS=22469 CHECKS=103001	UNSAT TT=8.622 ASSIGNMENTS=22469 CHECKS=103001	UNSAT TT=0.602	UNSAT TT=0.612	UNSAT TT=32.212 CHECKS=32036800	UNSAT TT=12.038 ASSIGNMENTS=2082980 CHECKS=24288200	UNSAT TT=18.398 ASSIGNMENTS=2260760 CHECKS=37719200	UNSAT TT=25.259	UNSAT TT=11.665 ASSIGNMENTS=1726070 CHECKS=21658700	UNSAT TT=13.579 ASSIGNMENTS=2130430 CHECKS=27539900	UNSAT TT=1.077	UNSAT TT=118.378 ASSIGNMENTS=11868400 CHECKS=48695900	UNSAT TT=0.542	UNSAT TT=0.509
csp/ssa/ normalized-ssa-0432-003_ext.xml	UNSAT TT=0.069	UNSAT TT=14.831 CHECKS=3962210 NODES=47470	UNSAT TT=13.494 CHECKS=3353500 NODES=45882	UNSAT TT=0.479	UNSAT TT=0.069 CHECKS=39061	UNSAT TT=0.083 CHECKS=86528	UNSAT TT=1.578 ASSIGNMENTS=2464	UNSAT TT=0.99 ASSIGNMENTS=241	UNSAT TT=6.449 CHECKS=1505610 NODES=14940	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=9.762 ASSIGNMENTS=69734 CHECKS=7643670	UNSAT TT=20.704 ASSIGNMENTS=47470 CHECKS=3962210	UNSAT TT=1.06	UNSAT TT=1.212	UNSAT TT=0.201 CHECKS=126359	UNSAT TT=2.561 ASSIGNMENTS=78762 CHECKS=8544620	UNSAT TT=1.608 ASSIGNMENTS=41583 CHECKS=5732890	UNSAT TT=0.63	UNSAT TT=3.023 ASSIGNMENTS=86800 CHECKS=9053980	UNSAT TT=2.174 ASSIGNMENTS=69734 CHECKS=7643670	UNSAT TT=1.636	UNSAT TT=11.052 ASSIGNMENTS=77646 CHECKS=3061590	UNSAT TT=1.173	UNSAT TT=1.313
csp/ssa/ normalized-ssa-2670-130_ext.xml	UNSAT TT=1.389	UNSAT TT=41.019 CHECKS=10649900 NODES=168953	UNSAT TT=34.069 CHECKS=9962120 NODES=158051	? (TO) TT=1800.06	UNSAT TT=15.611 CHECKS=10482600	UNSAT TT=14.447 CHECKS=11802000	UNSAT TT=15.861 ASSIGNMENTS=29626	UNSAT TT=1751.31 ASSIGNMENTS=2457260	UNSAT TT=133.999 CHECKS=15995000 NODES=97475	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=9.405 ASSIGNMENTS=21081 CHECKS=4510680	UNSAT TT=1.524 ASSIGNMENTS=21081 CHECKS=4510680	UNSAT TT=1.924	UNSAT TT=1.919	UNSAT TT=2.609 CHECKS=1875930	UNSAT TT=1.965 ASSIGNMENTS=26389 CHECKS=5465440	UNSAT TT=2.3 ASSIGNMENTS=31397 CHECKS=6696580	UNSAT TT=3.291	UNSAT TT=2.498 ASSIGNMENTS=26130 CHECKS=6655050	UNSAT TT=1.491 ASSIGNMENTS=21081 CHECKS=4510680	UNSAT TT=3.366	UNSAT TT=0.534 ASSIGNMENTS=164 CHECKS=24212	UNSAT TT=1.389	UNSAT TT=1.538
csp/ssa/ normalized-ssa-2670-141_ext.xml	SAT TT=0.013	SAT TT=1.079 CHECKS=855 NODES=391	SAT TT=1.047 CHECKS=853 NODES=0	SAT TT=0.067	SAT TT=0.162 CHECKS=19139	SAT TT=0.17 CHECKS=19366	SAT TT=0.652 ASSIGNMENTS=295	SAT TT=0.683 ASSIGNMENTS=296	SAT TT=0.449 CHECKS=372 NODES=391	SAT TT=0.448 CHECKS=2371 NODES=40	SAT TT=0.479 CHECKS=6649 NODES=46	SAT TT=0.025 ASSIGNMENTS=294 CHECKS=483	SAT TT=0.026 ASSIGNMENTS=294 CHECKS=483	SAT TT=1.468	SAT TT=1.351	SAT TT=0.035 CHECKS=407	SAT TT=0.013 ASSIGNMENTS=294 CHECKS=483	SAT TT=0.012 ASSIGNMENTS=291 CHECKS=483	SAT TT=0.485	SAT TT=0.015 ASSIGNMENTS=296 CHECKS=483	SAT TT=0.014 ASSIGNMENTS=294 CHECKS=483	SAT TT=0.976	SAT TT=0.03 ASSIGNMENTS=392 CHECKS=1036	SAT TT=0.888	SAT TT=0.877
csp/ssa/ normalized-ssa-6288-047_ext.xml	SAT TT=0.855	SAT TT=23.677 CHECKS=117930 NODES=14349	SAT TT=64.259 CHECKS=227589 NODES=14367	SAT TT=393	SAT TT=23.197 CHECKS=1018450	SAT TT=26.633 CHECKS=992168	SAT TT=9.293 ASSIGNMENTS=2859	SAT TT=67.677 ASSIGNMENTS=714	SAT TT=221.012 CHECKS=155056 NODES=14463	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=0.954 ASSIGNMENTS=1838 CHECKS=116086	SAT TT=0.97 ASSIGNMENTS=1838 CHECKS=116086	SAT TT=166.181	SAT TT=172.92	SAT TT=2.296 CHECKS=66575	SAT TT=0.855 ASSIGNMENTS=1837 CHECKS=118799	SAT TT=1.997 ASSIGNMENTS=34558 CHECKS=2065300	SAT TT=7.143	SAT TT=3.293 ASSIGNMENTS=6279 CHECKS=357497	SAT TT=0.914 ASSIGNMENTS=1838 CHECKS=116086	SAT TT=7.135	? (MO) TT=5.217	SAT TT=4.665	SAT TT=4.744
csp/ssa/ normalized-ssa-7552-038_ext.xml	SAT TT=0.077	SAT TT=1.929 CHECKS=32181 NODES=2043	SAT TT=2.052 CHECKS=20699 NODES=0	SAT TT=3.85	SAT TT=1.767 CHECKS=1819150	SAT TT=1.284 CHECKS=1807530	SAT TT=1.803 ASSIGNMENTS=158	SAT TT=2.596 ASSIGNMENTS=242	SAT TT=1.886 CHECKS=15271 NODES=1590	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=0.099 ASSIGNMENTS=159 CHECKS=11687	SAT TT=0.098 ASSIGNMENTS=159 CHECKS=11687	SAT TT=3.659	SAT TT=4.006	SAT TT=0.189 CHECKS=23352	SAT TT=0.077 ASSIGNMENTS=177 CHECKS=16608	SAT TT=0.081 ASSIGNMENTS=269 CHECKS=35949	SAT TT=1.361	SAT TT=0.093 ASSIGNMENTS=202 CHECKS=11621	SAT TT=0.092 ASSIGNMENTS=159 CHECKS=11687	SAT TT=3.556	SAT TT=0.594 ASSIGNMENTS=1539 CHECKS=25249	SAT TT=1.761	SAT TT=1.487
csp/ssa/ normalized-ssa-7552-158_ext.xml	SAT TT=0.063	SAT TT=2.878 CHECKS=7005 NODES=1364	SAT TT=1.573 CHECKS=7085 NODES=0	SAT TT=0.329	SAT TT=1.35 CHECKS=1420320	SAT TT=0.943 CHECKS=1423000	SAT TT=1.604 ASSIGNMENTS=123	SAT TT=1.909 ASSIGNMENTS=101	SAT TT=1.246 CHECKS=5417 NODES=1363	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=0.079 ASSIGNMENTS=113 CHECKS=5669	SAT TT=0.079 ASSIGNMENTS=113 CHECKS=5669	SAT TT=2.981	SAT TT=3.061	SAT TT=0.124 CHECKS=4437	SAT TT=0.063 ASSIGNMENTS=113 CHECKS=5673	SAT TT=0.069 ASSIGNMENTS=569 CHECKS=25359	SAT TT=1.164	SAT TT=0.081 ASSIGNMENTS=337 CHECKS=17359	SAT TT=0.065 ASSIGNMENTS=113 CHECKS=5669	SAT TT=2.965	Wrong UNSAT TT=0.425 ASSIGNMENTS=86 CHECKS=10359	SAT TT=1.351	SAT TT=1.369
csp/ssa/ normalized-ssa-7552-159_ext.xml	SAT TT=0.062	SAT TT=2.821 CHECKS=7115 NODES=1366	SAT TT=1.832 CHECKS=11019 NODES=0	SAT TT=0.338	SAT TT=1.22 CHECKS=1219660	SAT TT=0.93 CHECKS=1196450	SAT TT=1.52 ASSIGNMENTS=133	SAT TT=1.987 ASSIGNMENTS=112	SAT TT=1.276 CHECKS=7102 NODES=1369	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=0.082 ASSIGNMENTS=125 CHECKS=6217	SAT TT=0.082 ASSIGNMENTS=125 CHECKS=6217	SAT TT=3.258	SAT TT=3.318	SAT TT=0.125 CHECKS=4429	SAT TT=0.062 ASSIGNMENTS=129 CHECKS=6595	SAT TT=0.063 ASSIGNMENTS=113 CHECKS=4674	SAT TT=1.348	SAT TT=0.084 ASSIGNMENTS=418 CHECKS=19041	SAT TT=0.068 ASSIGNMENTS=125 CHECKS=6217	SAT TT=2.972	SAT TT=0.482 ASSIGNMENTS=1472 CHECKS=28528	SAT TT=1.664	SAT TT=1.681
csp/ssa/ normalized-ssa-7552-160_ext.xml	SAT TT=0.034	SAT TT=2.288 CHECKS=3156 NODES=1303	SAT TT=1.777 CHECKS=2699 NODES=0	SAT TT=0.154	SAT TT=0.557 CHECKS=16428	SAT TT=0.582 CHECKS=16987	SAT TT=0.824 ASSIGNMENTS=475	SAT TT=1.105 ASSIGNMENTS=539	SAT TT=0.793 CHECKS=1910 NODES=757	SAT TT=0.696 CHECKS=10634 NODES=63	SAT TT=0.764 CHECKS=42674 NODES=53	SAT TT=0.046 ASSIGNMENTS=472 CHECKS=2173	SAT TT=0.044 ASSIGNMENTS=472 CHECKS=2173	SAT TT=2.08	SAT TT=2.146	SAT TT=0.079 CHECKS=1976	SAT TT=0.034 ASSIGNMENTS=472 CHECKS=2173	SAT TT=0.031 ASSIGNMENTS=531 CHECKS=2173	SAT TT=0.683	SAT TT=0.039 ASSIGNMENTS=492 CHECKS=2173	SAT TT=0.037 ASSIGNMENTS=472 CHECKS=2173	SAT TT=1.822	SAT TT=0.15 ASSIGNMENTS=757 CHECKS=4681	SAT TT=1.158	SAT TT=1.148
csp/varDimacs/ normalized-bf-0432-007_ext.xml	SAT TT=0.056	SAT TT=1.876 CHECKS=6817 NODES=970	SAT TT=1.541 CHECKS=10254 NODES=0	SAT TT=0.291	SAT TT=0.285 CHECKS=206777	SAT TT=0.209 CHECKS=205195	SAT TT=1.131 ASSIGNMENTS=120	SAT TT=1.294 ASSIGNMENTS=152	SAT TT=1.22 CHECKS=5273 NODES=971	SAT TT=3.403 CHECKS=2297330 NODES=150829	SAT TT=1.372 CHECKS=390545 NODES=431	SAT TT=0.078 ASSIGNMENTS=117 CHECKS=4640	SAT TT=0.068 ASSIGNMENTS=117 CHECKS=4640	SAT TT=2.535	SAT TT=2.849	SAT TT=0.113 CHECKS=3655	SAT TT=0.056 ASSIGNMENTS=117 CHECKS=4640	SAT TT=0.06 ASSIGNMENTS=136 CHECKS=4702	SAT TT=0.92	SAT TT=0.059 ASSIGNMENTS=134 CHECKS=4640	SAT TT=0.056 ASSIGNMENTS=117 CHECKS=4640	SAT TT=2.121	SAT TT=0.332 ASSIGNMENTS=972 CHECKS=13329	SAT TT=1.322	SAT TT=1.835
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/varDimacs/ normalized-bf-1355-075_ext.xml	SAT TT=0.078	SAT TT=2.762 CHECKS=6117 NODES=1818	SAT TT=2.616 CHECKS=6163 NODES=0	SAT TT=0.368	SAT TT=1.381 CHECKS=86913	SAT TT=1.442 CHECKS=89213	SAT TT=1.465 ASSIGNMENTS=1108	SAT TT=2.855 ASSIGNMENTS=1335	SAT TT=1.757 CHECKS=4623 NODES=1818	SAT TT=1.473 CHECKS=27467 NODES=205	SAT TT=1.453 CHECKS=365956 NODES=233	SAT TT=0.1 ASSIGNMENTS=1129 CHECKS=5504	SAT TT=0.099 ASSIGNMENTS=1129 CHECKS=5504	SAT TT=3.395	SAT TT=3.387	SAT TT=0.217 CHECKS=4944	SAT TT=0.078 ASSIGNMENTS=1129 CHECKS=5504	SAT TT=0.074 ASSIGNMENTS=1239 CHECKS=5504	SAT TT=0.966	SAT TT=0.102 ASSIGNMENTS=1146 CHECKS=5504	SAT TT=0.087 ASSIGNMENTS=1129 CHECKS=5504	SAT TT=2.88	SAT TT=0.639 ASSIGNMENTS=1818 CHECKS=11948	SAT TT=1.847	SAT TT=1.45
csp/varDimacs/ normalized-bf-1355-638_ext.xml	SAT TT=0.018	SAT TT=1.231 CHECKS=1678 NODES=532	SAT TT=1.158 CHECKS=1343 NODES=0	SAT TT=0.091	SAT TT=0.225 CHECKS=14973	SAT TT=0.244 CHECKS=14817	SAT TT=0.67 ASSIGNMENTS=288	SAT TT=0.793 ASSIGNMENTS=531	SAT TT=0.542 CHECKS=776 NODES=532	SAT TT=0.496 CHECKS=3878 NODES=4	SAT TT=0.537 CHECKS=4920 NODES=6	SAT TT=0.029 ASSIGNMENTS=288 CHECKS=800	SAT TT=0.032 ASSIGNMENTS=288 CHECKS=800	SAT TT=1.603	SAT TT=1.623	SAT TT=0.046 CHECKS=800	SAT TT=0.018 ASSIGNMENTS=288 CHECKS=800	SAT TT=0.018 ASSIGNMENTS=360 CHECKS=800	SAT TT=0.501	SAT TT=0.02 ASSIGNMENTS=321 CHECKS=800	SAT TT=0.019 ASSIGNMENTS=288 CHECKS=800	SAT TT=1.112	SAT TT=0.053 ASSIGNMENTS=532 CHECKS=1380	SAT TT=1.222	SAT TT=1.088
csp/varDimacs/ normalized-bf-2670-001_ext.xml	SAT TT=0.049	SAT TT=2.659 CHECKS=4470 NODES=1244	SAT TT=1.824 CHECKS=7213 NODES=0	SAT TT=0.236	SAT TT=0.625 CHECKS=184762	SAT TT=0.644 CHECKS=176694	SAT TT=1.198 ASSIGNMENTS=371	SAT TT=1.296 ASSIGNMENTS=381	SAT TT=1.187 CHECKS=3217 NODES=1245	SAT TT=5.974 CHECKS=4512490 NODES=300591	SAT TT=1.181 CHECKS=230659 NODES=270	SAT TT=0.059 ASSIGNMENTS=366 CHECKS=3080	SAT TT=0.064 ASSIGNMENTS=366 CHECKS=3080	SAT TT=2.462	SAT TT=2.837	SAT TT=0.082 CHECKS=2125	SAT TT=0.049 ASSIGNMENTS=366 CHECKS=3080	SAT TT=0.046 ASSIGNMENTS=356 CHECKS=3075	SAT TT=1.095	SAT TT=0.054 ASSIGNMENTS=499 CHECKS=4382	SAT TT=0.051 ASSIGNMENTS=366 CHECKS=3080	SAT TT=2.161	SAT TT=0.311 ASSIGNMENTS=1246 CHECKS=6522	SAT TT=1.421	SAT TT=1.31
csp/varDimacs/ normalized-hole-06_ext.xml	UNSAT TT=0.014	UNSAT TT=0.779 CHECKS=1063 NODES=59	UNSAT TT=0.809 CHECKS=1305 NODES=37	UNSAT TT=0.054	UNSAT TT=0.016 CHECKS=3030	UNSAT TT=0.014 CHECKS=2770	UNSAT TT=0.652 ASSIGNMENTS=961	UNSAT TT=0.742 ASSIGNMENTS=1308	UNSAT TT=0.572 CHECKS=52280 NODES=2581	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.028 ASSIGNMENTS=957 CHECKS=37516	UNSAT TT=0.03 ASSIGNMENTS=957 CHECKS=37516	UNSAT TT=0.586	UNSAT TT=0.792	UNSAT TT=0.069 CHECKS=97166	UNSAT TT=0.017 ASSIGNMENTS=999 CHECKS=39159	UNSAT TT=0.039 ASSIGNMENTS=5904 CHECKS=135253	UNSAT TT=0.354	UNSAT TT=0.018 ASSIGNMENTS=1350 CHECKS=50889	UNSAT TT=0.017 ASSIGNMENTS=957 CHECKS=37516	UNSAT TT=1.111	UNSAT TT=0.101 ASSIGNMENTS=4312 CHECKS=139382	UNSAT TT=0.591	UNSAT TT=0.626
csp/varDimacs/ normalized-hole-07_ext.xml	UNSAT TT=0.021	UNSAT TT=0.905 CHECKS=2028 NODES=99	UNSAT TT=0.864 CHECKS=2591 NODES=80	UNSAT TT=0.243	UNSAT TT=0.021 CHECKS=4506	UNSAT TT=0.021 CHECKS=5418	UNSAT TT=1.648 ASSIGNMENTS=7482	UNSAT TT=2.193 ASSIGNMENTS=10277	UNSAT TT=1.749 CHECKS=405626 NODES=18657	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.119 ASSIGNMENTS=7681 CHECKS=361895	UNSAT TT=0.107 ASSIGNMENTS=7681 CHECKS=361895	UNSAT TT=0.908	UNSAT TT=0.769	UNSAT TT=0.814 CHECKS=1431910	UNSAT TT=0.092 ASSIGNMENTS=7317 CHECKS=345794	UNSAT TT=0.127 ASSIGNMENTS=14802 CHECKS=519119	UNSAT TT=0.579	UNSAT TT=0.122 ASSIGNMENTS=9693 CHECKS=450256	UNSAT TT=0.096 ASSIGNMENTS=7681 CHECKS=361895	UNSAT TT=1.271	UNSAT TT=1.09 ASSIGNMENTS=37832 CHECKS=1340760	UNSAT TT=0.776	UNSAT TT=0.764
csp/varDimacs/ normalized-hole-08_ext.xml	UNSAT TT=0.027	UNSAT TT=0.875 CHECKS=3187 NODES=135	UNSAT TT=0.994 CHECKS=4977 NODES=155	UNSAT TT=2.743	UNSAT TT=0.027 CHECKS=3704	UNSAT TT=0.028 CHECKS=8420	UNSAT TT=12.096 ASSIGNMENTS=70072	UNSAT TT=15.331 ASSIGNMENTS=94447	UNSAT TT=14.751 CHECKS=3410600 NODES=148586	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=1.063 ASSIGNMENTS=71191 CHECKS=3925030	UNSAT TT=1.062 ASSIGNMENTS=71191 CHECKS=3925030	UNSAT TT=4.083	UNSAT TT=0.897	UNSAT TT=11.61 CHECKS=18367500	UNSAT TT=0.913 ASSIGNMENTS=69085 CHECKS=3813590	UNSAT TT=0.976 ASSIGNMENTS=78597 CHECKS=4024450	UNSAT TT=1.989	UNSAT TT=1.156 ASSIGNMENTS=82172 CHECKS=4501850	UNSAT TT=0.954 ASSIGNMENTS=71191 CHECKS=3925030	UNSAT TT=1.733	UNSAT TT=11.924 ASSIGNMENTS=334930 CHECKS=12225300	UNSAT TT=1.352	UNSAT TT=1.892
csp/varDimacs/ normalized-hole-09_ext.xml	UNSAT TT=0.038	UNSAT TT=0.963 CHECKS=6415 NODES=239	UNSAT TT=1.016 CHECKS=19112 NODES=500	UNSAT TT=40.735	UNSAT TT=0.039 CHECKS=11335	UNSAT TT=0.038 CHECKS=15145	UNSAT TT=148.821 ASSIGNMENTS=777211	UNSAT TT=195.656 ASSIGNMENTS=985147	UNSAT TT=177.532 CHECKS=38057000 NODES=1577550	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=18.478 ASSIGNMENTS=715860 CHECKS=44828500	UNSAT TT=18.476 ASSIGNMENTS=715860 CHECKS=44828500	UNSAT TT=189.036	UNSAT TT=1.436	UNSAT TT=149.96 CHECKS=236616000	UNSAT TT=10.79 ASSIGNMENTS=719138 CHECKS=44880400	UNSAT TT=12.863 ASSIGNMENTS=888577 CHECKS=52786200	UNSAT TT=20.23	UNSAT TT=12.174 ASSIGNMENTS=795704 CHECKS=48120400	UNSAT TT=9.983 ASSIGNMENTS=715860 CHECKS=44828500	UNSAT TT=3.222	UNSAT TT=146.409 ASSIGNMENTS=4125000 CHECKS=164531000	UNSAT TT=5.656	UNSAT TT=18.116
csp/varDimacs/ normalized-hole-10_ext.xml	UNSAT TT=0.051	UNSAT TT=1.069 CHECKS=14042 NODES=445	UNSAT TT=1.177 CHECKS=27659 NODES=688	UNSAT TT=629.498	UNSAT TT=0.057 CHECKS=20182	UNSAT TT=0.051 CHECKS=18608	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=148.247 ASSIGNMENTS=8280720 CHECKS=580867000	UNSAT TT=148.522 ASSIGNMENTS=8280720 CHECKS=580867000	? (TO) TT=1800.05	UNSAT TT=2.557	? (TO) TT=1800.1	UNSAT TT=146.981 ASSIGNMENTS=8735530 CHECKS=606514000	UNSAT TT=160.841 ASSIGNMENTS=10378100 CHECKS=704735000	UNSAT TT=230.271	UNSAT TT=186.653 ASSIGNMENTS=10840100 CHECKS=727304000	UNSAT TT=140.25 ASSIGNMENTS=8280720 CHECKS=580867000	UNSAT TT=28.67	UNSAT TT=1791.38 ASSIGNMENTS=50856700 CHECKS=2167480000	UNSAT TT=68.662	UNSAT TT=345.117

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	156	155	125	147	147	145	144	144	59	61	156	156	157	158	150	149	148	149	149	158	158	158
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	156	155	125	147	147	145	144	144	59	61	156	156	157	158	150	149	148	149	149	158	158	158
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	0	0	0	5	4	0	0	0	0	0	0	0	0	0	1	43	0	50	55	0	8	14
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0