CSP 2008 Competition: results by benchmark

Results by benchmark for category n-ary constraints in extension (N-ARY-EXT), subcategory random problems

This page displays the results of the different solvers for each benchmark for category n-ary constraints in extension (N-ARY-EXT), subcategory random problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
mddc-solv 2008-06-09
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
spider 2008-06-14
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-0_ext.xml	UNSAT TT=0.687	UNSAT TT=1.783 CHECKS=0 NODES=1034	UNSAT TT=1.763 CHECKS=0 NODES=1000	? (TO) TT=1800.05	UNSAT TT=97.561 CHECKS=84652	UNSAT TT=81.938 CHECKS=92836	UNSAT TT=6.805 ASSIGNMENTS=111	UNSAT TT=8.255 ASSIGNMENTS=119	UNSAT TT=2.885 CHECKS=0 NODES=1143	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=10.423 ASSIGNMENTS=858 CHECKS=9363	UNSAT TT=9.303 ASSIGNMENTS=1034 CHECKS=0	UNSAT TT=248.424	UNSAT TT=521.031	UNSAT TT=0.687 CHECKS=6634	UNSAT TT=2.961 ASSIGNMENTS=858 CHECKS=9142	UNSAT TT=11.534 ASSIGNMENTS=4186 CHECKS=39944	UNSAT TT=3.874	UNSAT TT=2.587 ASSIGNMENTS=1037 CHECKS=9700	UNSAT TT=2.881 ASSIGNMENTS=858 CHECKS=9363	? TT=41.071	UNSAT TT=1548.51 ASSIGNMENTS=111148 CHECKS=993417000	UNSAT TT=852.803	UNSAT TT=988.571
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-10_ext.xml	UNSAT TT=0.68	UNSAT TT=1.564 CHECKS=0 NODES=955	UNSAT TT=1.576 CHECKS=0 NODES=955	UNSAT TT=409.533	UNSAT TT=62.664 CHECKS=65415	UNSAT TT=87.083 CHECKS=91031	UNSAT TT=5.997 ASSIGNMENTS=111	UNSAT TT=15.38 ASSIGNMENTS=448	UNSAT TT=1.833 CHECKS=0 NODES=1048	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=10.532 ASSIGNMENTS=783 CHECKS=9214	UNSAT TT=9.084 ASSIGNMENTS=955 CHECKS=0	UNSAT TT=354.85	UNSAT TT=388.111	UNSAT TT=0.68 CHECKS=7548	UNSAT TT=3.024 ASSIGNMENTS=783 CHECKS=9214	UNSAT TT=11.217 ASSIGNMENTS=4194 CHECKS=38331	UNSAT TT=3.857	UNSAT TT=3.305 ASSIGNMENTS=996 CHECKS=10589	UNSAT TT=3.083 ASSIGNMENTS=783 CHECKS=9214	? TT=37.275	UNSAT TT=1106.59 ASSIGNMENTS=111306 CHECKS=664299000	UNSAT TT=866.878	? (TO) TT=1800.03
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-11_ext.xml	UNSAT TT=1.697	UNSAT TT=1.718 CHECKS=0 NODES=994	UNSAT TT=2.058 CHECKS=0 NODES=994	UNSAT TT=137.719	UNSAT TT=102.193 CHECKS=75714	UNSAT TT=92.784 CHECKS=76526	UNSAT TT=6.44 ASSIGNMENTS=111	UNSAT TT=28.637 ASSIGNMENTS=827	UNSAT TT=2.071 CHECKS=0 NODES=1267	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=9.62 ASSIGNMENTS=779 CHECKS=8712	UNSAT TT=9.45 ASSIGNMENTS=994 CHECKS=0	UNSAT TT=189.382	UNSAT TT=470.024	UNSAT TT=1.697 CHECKS=7595	UNSAT TT=2.561 ASSIGNMENTS=779 CHECKS=8712	UNSAT TT=11.008 ASSIGNMENTS=4157 CHECKS=36877	UNSAT TT=8.821	UNSAT TT=2.762 ASSIGNMENTS=997 CHECKS=9581	UNSAT TT=2.394 ASSIGNMENTS=779 CHECKS=8712	? TT=29.038	UNSAT TT=988.95 ASSIGNMENTS=111165 CHECKS=623182000	UNSAT TT=878.643	UNSAT TT=1160.01
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-12_ext.xml	UNSAT TT=0.993	UNSAT TT=1.874 CHECKS=0 NODES=1445	UNSAT TT=2.14 CHECKS=0 NODES=1443	UNSAT TT=845.741	UNSAT TT=92.262 CHECKS=84106	UNSAT TT=88.869 CHECKS=92029	UNSAT TT=6.563 ASSIGNMENTS=111	UNSAT TT=32.592 ASSIGNMENTS=1050	UNSAT TT=1.635 CHECKS=0 NODES=1152	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=9.921 ASSIGNMENTS=750 CHECKS=7936	UNSAT TT=9.376 ASSIGNMENTS=1445 CHECKS=0	UNSAT TT=163.919	UNSAT TT=277.045	UNSAT TT=0.993 CHECKS=7378	UNSAT TT=2.289 ASSIGNMENTS=750 CHECKS=7936	UNSAT TT=9.818 ASSIGNMENTS=4129 CHECKS=35123	UNSAT TT=5.66	UNSAT TT=2.588 ASSIGNMENTS=967 CHECKS=9064	UNSAT TT=2.314 ASSIGNMENTS=750 CHECKS=7936	? TT=35.453	UNSAT TT=34.453 ASSIGNMENTS=112034 CHECKS=19182400	UNSAT TT=925.294	UNSAT TT=889.334
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-13_ext.xml	UNSAT TT=0.742	UNSAT TT=2.34 CHECKS=0 NODES=1727	UNSAT TT=2.097 CHECKS=0 NODES=1727	UNSAT TT=98.91	UNSAT TT=96.824 CHECKS=84944	UNSAT TT=79.726 CHECKS=96184	UNSAT TT=6.241 ASSIGNMENTS=111	UNSAT TT=19.029 ASSIGNMENTS=426	UNSAT TT=2.405 CHECKS=0 NODES=1148	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=10.477 ASSIGNMENTS=820 CHECKS=8646	UNSAT TT=9.143 ASSIGNMENTS=872 CHECKS=0	UNSAT TT=330.711	UNSAT TT=532.987	UNSAT TT=0.742 CHECKS=6946	UNSAT TT=2.708 ASSIGNMENTS=819 CHECKS=8622	UNSAT TT=11.449 ASSIGNMENTS=4193 CHECKS=38215	UNSAT TT=4.249	UNSAT TT=2.892 ASSIGNMENTS=1021 CHECKS=9460	UNSAT TT=2.805 ASSIGNMENTS=820 CHECKS=8646	? TT=31.836	UNSAT TT=148.915 ASSIGNMENTS=111408 CHECKS=101838000	UNSAT TT=1062.68	UNSAT TT=1653.33
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-14_ext.xml	UNSAT TT=0.543	UNSAT TT=1.603 CHECKS=0 NODES=999	UNSAT TT=1.582 CHECKS=0 NODES=999	UNSAT TT=690.455	UNSAT TT=112.003 CHECKS=90764	UNSAT TT=93.372 CHECKS=87869	UNSAT TT=7.745 ASSIGNMENTS=111	UNSAT TT=31.029 ASSIGNMENTS=561	UNSAT TT=2.312 CHECKS=0 NODES=1267	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=10.665 ASSIGNMENTS=825 CHECKS=10188	UNSAT TT=9.013 ASSIGNMENTS=999 CHECKS=0	UNSAT TT=181.698	UNSAT TT=582.025	UNSAT TT=0.543 CHECKS=6684	UNSAT TT=2.488 ASSIGNMENTS=825 CHECKS=10188	UNSAT TT=10.851 ASSIGNMENTS=4228 CHECKS=38861	UNSAT TT=5.505	UNSAT TT=3.403 ASSIGNMENTS=1116 CHECKS=11785	UNSAT TT=2.648 ASSIGNMENTS=825 CHECKS=10188	? TT=39.556	UNSAT TT=575.567 ASSIGNMENTS=112961 CHECKS=372329000	UNSAT TT=818.811	UNSAT TT=795.736
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-15_ext.xml	UNSAT TT=0.638	UNSAT TT=2.008 CHECKS=0 NODES=923	UNSAT TT=2.358 CHECKS=0 NODES=939	UNSAT TT=39.812	UNSAT TT=99.945 CHECKS=80798	UNSAT TT=42.644 CHECKS=43232	UNSAT TT=6.97 ASSIGNMENTS=111	UNSAT TT=185.712 ASSIGNMENTS=4477	UNSAT TT=2.52 CHECKS=0 NODES=1262	? (TO) TT=1800.09	? (TO) TT=1800	UNSAT TT=9.865 ASSIGNMENTS=819 CHECKS=9297	UNSAT TT=9.708 ASSIGNMENTS=923 CHECKS=0	UNSAT TT=305.844	UNSAT TT=550.906	UNSAT TT=0.638 CHECKS=6708	UNSAT TT=2.519 ASSIGNMENTS=818 CHECKS=9175	UNSAT TT=11.486 ASSIGNMENTS=4181 CHECKS=40421	UNSAT TT=5.584	UNSAT TT=2.928 ASSIGNMENTS=1030 CHECKS=10319	UNSAT TT=2.596 ASSIGNMENTS=819 CHECKS=9297	? TT=32.34	UNSAT TT=110.566 ASSIGNMENTS=111496 CHECKS=65326100	UNSAT TT=891.12	UNSAT TT=912.119
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-16_ext.xml	UNSAT TT=0.676	UNSAT TT=1.661 CHECKS=0 NODES=959	UNSAT TT=1.653 CHECKS=0 NODES=1197	? (TO) TT=1800.03	UNSAT TT=98.713 CHECKS=90081	UNSAT TT=74.406 CHECKS=81917	UNSAT TT=8.027 ASSIGNMENTS=111	UNSAT TT=19.029 ASSIGNMENTS=617	UNSAT TT=2.379 CHECKS=0 NODES=1282	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=10.987 ASSIGNMENTS=910 CHECKS=11498	UNSAT TT=8.92 ASSIGNMENTS=959 CHECKS=0	UNSAT TT=139.674	UNSAT TT=222.808	UNSAT TT=0.676 CHECKS=8717	UNSAT TT=3.291 ASSIGNMENTS=888 CHECKS=11094	UNSAT TT=11.31 ASSIGNMENTS=4229 CHECKS=39639	UNSAT TT=9.982	UNSAT TT=3.075 ASSIGNMENTS=1091 CHECKS=11621	UNSAT TT=3.383 ASSIGNMENTS=910 CHECKS=11498	? TT=33.919	UNSAT TT=218.527 ASSIGNMENTS=112957 CHECKS=132832000	UNSAT TT=804.402	UNSAT TT=985.492
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-17_ext.xml	UNSAT TT=0.641	UNSAT TT=1.58 CHECKS=0 NODES=930	UNSAT TT=1.622 CHECKS=0 NODES=930	UNSAT TT=107.804	UNSAT TT=82.185 CHECKS=76311	UNSAT TT=85.375 CHECKS=96474	UNSAT TT=6.655 ASSIGNMENTS=111	UNSAT TT=8.898 ASSIGNMENTS=131	UNSAT TT=1.919 CHECKS=0 NODES=1037	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=9.536 ASSIGNMENTS=757 CHECKS=8087	UNSAT TT=9.257 ASSIGNMENTS=930 CHECKS=0	UNSAT TT=225.623	UNSAT TT=506.88	UNSAT TT=0.641 CHECKS=6823	UNSAT TT=2.428 ASSIGNMENTS=756 CHECKS=8103	UNSAT TT=10.076 ASSIGNMENTS=4218 CHECKS=36020	UNSAT TT=3.704	UNSAT TT=2.697 ASSIGNMENTS=970 CHECKS=8959	UNSAT TT=2.378 ASSIGNMENTS=757 CHECKS=8087	? TT=35.801	UNSAT TT=203.298 ASSIGNMENTS=111114 CHECKS=122445000	UNSAT TT=783.204	UNSAT TT=847.535
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-18_ext.xml	UNSAT TT=0.578	UNSAT TT=1.383 CHECKS=0 NODES=835	UNSAT TT=1.528 CHECKS=0 NODES=835	? (TO) TT=1800.1	UNSAT TT=93.704 CHECKS=88306	UNSAT TT=85.669 CHECKS=91813	UNSAT TT=5.457 ASSIGNMENTS=111	UNSAT TT=20.218 ASSIGNMENTS=487	UNSAT TT=1.984 CHECKS=0 NODES=1056	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=10.378 ASSIGNMENTS=793 CHECKS=8575	UNSAT TT=9.166 ASSIGNMENTS=835 CHECKS=0	UNSAT TT=165.26	UNSAT TT=260.676	UNSAT TT=0.578 CHECKS=6643	UNSAT TT=2.611 ASSIGNMENTS=793 CHECKS=8575	UNSAT TT=10.337 ASSIGNMENTS=4217 CHECKS=36020	UNSAT TT=3.086	UNSAT TT=3.014 ASSIGNMENTS=994 CHECKS=9482	UNSAT TT=2.649 ASSIGNMENTS=793 CHECKS=8575	? TT=31.65	? (TO) TT=1800.02	UNSAT TT=809.883	UNSAT TT=1083.6
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-19_ext.xml	UNSAT TT=0.674	UNSAT TT=1.899 CHECKS=0 NODES=1370	UNSAT TT=2.13 CHECKS=0 NODES=1474	UNSAT TT=189.189	UNSAT TT=103.305 CHECKS=80298	UNSAT TT=88.588 CHECKS=82977	UNSAT TT=5.805 ASSIGNMENTS=111	UNSAT TT=24.691 ASSIGNMENTS=843	UNSAT TT=2.058 CHECKS=0 NODES=1036	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=9.513 ASSIGNMENTS=797 CHECKS=8758	UNSAT TT=9.467 ASSIGNMENTS=1370 CHECKS=0	UNSAT TT=158.294	UNSAT TT=235.035	UNSAT TT=0.674 CHECKS=6327	UNSAT TT=2.501 ASSIGNMENTS=780 CHECKS=8716	UNSAT TT=11.184 ASSIGNMENTS=4121 CHECKS=38789	UNSAT TT=8.054	UNSAT TT=2.569 ASSIGNMENTS=997 CHECKS=9712	UNSAT TT=2.5 ASSIGNMENTS=797 CHECKS=8758	? TT=32.628	UNSAT TT=1534.02 ASSIGNMENTS=111289 CHECKS=993647000	UNSAT TT=1093.92	UNSAT TT=1500.6
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-1_ext.xml	UNSAT TT=0.731	UNSAT TT=2.954 CHECKS=0 NODES=2509	UNSAT TT=2.939 CHECKS=0 NODES=2588	UNSAT TT=71.571	UNSAT TT=99.77 CHECKS=83916	UNSAT TT=89.623 CHECKS=90474	UNSAT TT=5.563 ASSIGNMENTS=111	UNSAT TT=15.895 ASSIGNMENTS=255	UNSAT TT=2.088 CHECKS=0 NODES=1060	? (TO) TT=1800	? (TO) TT=1800.08	UNSAT TT=9.653 ASSIGNMENTS=848 CHECKS=8798	UNSAT TT=10.485 ASSIGNMENTS=2509 CHECKS=0	UNSAT TT=282.682	UNSAT TT=446.772	UNSAT TT=0.731 CHECKS=6817	UNSAT TT=2.597 ASSIGNMENTS=858 CHECKS=9252	UNSAT TT=12.05 ASSIGNMENTS=4297 CHECKS=39761	UNSAT TT=6.834	UNSAT TT=3.006 ASSIGNMENTS=1101 CHECKS=11768	UNSAT TT=2.38 ASSIGNMENTS=848 CHECKS=8798	? TT=35.815	UNSAT TT=12.488 ASSIGNMENTS=113026 CHECKS=6262060	UNSAT TT=875.84	UNSAT TT=885.68
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-2_ext.xml	UNSAT TT=1.158	UNSAT TT=1.216 CHECKS=0 NODES=756	UNSAT TT=1.358 CHECKS=0 NODES=752	UNSAT TT=110.626	UNSAT TT=95.068 CHECKS=87092	UNSAT TT=82.026 CHECKS=92245	UNSAT TT=4.37 ASSIGNMENTS=111	UNSAT TT=17.24 ASSIGNMENTS=345	UNSAT TT=1.872 CHECKS=0 NODES=958	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=9.549 ASSIGNMENTS=724 CHECKS=7052	UNSAT TT=9.002 ASSIGNMENTS=756 CHECKS=0	UNSAT TT=91.282	UNSAT TT=125.435	UNSAT TT=1.158 CHECKS=7001	UNSAT TT=1.879 ASSIGNMENTS=724 CHECKS=7052	UNSAT TT=8.898 ASSIGNMENTS=4193 CHECKS=32554	UNSAT TT=5.189	UNSAT TT=2.299 ASSIGNMENTS=951 CHECKS=8586	UNSAT TT=1.682 ASSIGNMENTS=724 CHECKS=7052	? TT=36.543	UNSAT TT=1309.97 ASSIGNMENTS=111110 CHECKS=841934000	UNSAT TT=803.837	UNSAT TT=986.755
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-3_ext.xml	UNSAT TT=0.64	UNSAT TT=1.551 CHECKS=0 NODES=853	UNSAT TT=1.684 CHECKS=0 NODES=874	? (TO) TT=1800.05	UNSAT TT=98.694 CHECKS=92760	UNSAT TT=93.108 CHECKS=112488	UNSAT TT=7.014 ASSIGNMENTS=111	UNSAT TT=19.734 ASSIGNMENTS=679	UNSAT TT=2.562 CHECKS=0 NODES=1274	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=10.625 ASSIGNMENTS=899 CHECKS=10540	UNSAT TT=9.689 ASSIGNMENTS=853 CHECKS=0	UNSAT TT=181.322	UNSAT TT=348.264	UNSAT TT=0.64 CHECKS=7560	UNSAT TT=2.673 ASSIGNMENTS=902 CHECKS=10428	UNSAT TT=10.814 ASSIGNMENTS=4256 CHECKS=38715	UNSAT TT=5.018	UNSAT TT=3.502 ASSIGNMENTS=1136 CHECKS=12562	UNSAT TT=3.159 ASSIGNMENTS=899 CHECKS=10540	? TT=35.834	? (TO) TT=1800.01	UNSAT TT=1121.42	UNSAT TT=1675.11
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-4_ext.xml	UNSAT TT=0.674	UNSAT TT=1.893 CHECKS=0 NODES=1140	UNSAT TT=1.824 CHECKS=0 NODES=1140	UNSAT TT=1487.26	UNSAT TT=92.26 CHECKS=83398	UNSAT TT=88.72 CHECKS=88194	UNSAT TT=5.563 ASSIGNMENTS=111	UNSAT TT=11.67 ASSIGNMENTS=191	UNSAT TT=1.908 CHECKS=0 NODES=1027	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=9.927 ASSIGNMENTS=743 CHECKS=7756	UNSAT TT=9.678 ASSIGNMENTS=1140 CHECKS=0	UNSAT TT=219.859	UNSAT TT=476.404	UNSAT TT=0.674 CHECKS=6691	UNSAT TT=2.762 ASSIGNMENTS=774 CHECKS=8402	UNSAT TT=10.38 ASSIGNMENTS=4118 CHECKS=37012	UNSAT TT=3.847	UNSAT TT=2.481 ASSIGNMENTS=959 CHECKS=8708	UNSAT TT=2.186 ASSIGNMENTS=743 CHECKS=7756	? TT=33.029	UNSAT TT=450.423 ASSIGNMENTS=111110 CHECKS=346052000	UNSAT TT=863.232	UNSAT TT=914.948
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-5_ext.xml	UNSAT TT=1.002	UNSAT TT=3.467 CHECKS=0 NODES=1474	UNSAT TT=3.461 CHECKS=0 NODES=1542	? (TO) TT=1800.1	UNSAT TT=114.41 CHECKS=91305	UNSAT TT=106.646 CHECKS=96506	UNSAT TT=7.268 ASSIGNMENTS=111	UNSAT TT=19.665 ASSIGNMENTS=413	UNSAT TT=2.298 CHECKS=0 NODES=1375	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=10.489 ASSIGNMENTS=895 CHECKS=11369	UNSAT TT=9.947 ASSIGNMENTS=1474 CHECKS=0	UNSAT TT=284.375	UNSAT TT=732.757	UNSAT TT=1.002 CHECKS=6992	UNSAT TT=2.573 ASSIGNMENTS=863 CHECKS=9314	UNSAT TT=11.471 ASSIGNMENTS=4267 CHECKS=42607	UNSAT TT=10.46	UNSAT TT=3.344 ASSIGNMENTS=1108 CHECKS=12607	UNSAT TT=2.985 ASSIGNMENTS=895 CHECKS=11369	? TT=31.555	? (TO) TT=1800.07	UNSAT TT=1002.13	UNSAT TT=1432.77
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-6_ext.xml	UNSAT TT=0.676	UNSAT TT=2.009 CHECKS=0 NODES=882	UNSAT TT=2.03 CHECKS=0 NODES=871	UNSAT TT=121.364	UNSAT TT=101.019 CHECKS=87241	UNSAT TT=92.62 CHECKS=91176	UNSAT TT=6.833 ASSIGNMENTS=111	UNSAT TT=30.432 ASSIGNMENTS=813	UNSAT TT=1.942 CHECKS=0 NODES=1059	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=9.996 ASSIGNMENTS=815 CHECKS=8334	UNSAT TT=9.257 ASSIGNMENTS=882 CHECKS=0	UNSAT TT=139.348	UNSAT TT=489.974	UNSAT TT=0.676 CHECKS=6109	UNSAT TT=2.252 ASSIGNMENTS=815 CHECKS=8330	UNSAT TT=11.083 ASSIGNMENTS=4280 CHECKS=38745	UNSAT TT=4.996	UNSAT TT=2.995 ASSIGNMENTS=1060 CHECKS=10691	UNSAT TT=2.204 ASSIGNMENTS=815 CHECKS=8334	? TT=35.212	UNSAT TT=30.005 ASSIGNMENTS=113031 CHECKS=14766900	UNSAT TT=912.117	UNSAT TT=1060.66
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-7_ext.xml	UNSAT TT=0.73	UNSAT TT=2.041 CHECKS=0 NODES=2580	UNSAT TT=2.135 CHECKS=0 NODES=2633	? (TO) TT=1800.11	UNSAT TT=94.408 CHECKS=85397	UNSAT TT=70.046 CHECKS=72073	UNSAT TT=5.886 ASSIGNMENTS=111	UNSAT TT=38.272 ASSIGNMENTS=1080	UNSAT TT=2.178 CHECKS=0 NODES=1030	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=9.626 ASSIGNMENTS=762 CHECKS=7913	UNSAT TT=9.522 ASSIGNMENTS=2580 CHECKS=0	UNSAT TT=187.704	UNSAT TT=290.574	UNSAT TT=0.73 CHECKS=6735	UNSAT TT=2.23 ASSIGNMENTS=762 CHECKS=7913	UNSAT TT=10.02 ASSIGNMENTS=4125 CHECKS=37673	UNSAT TT=6.665	UNSAT TT=2.313 ASSIGNMENTS=949 CHECKS=8791	UNSAT TT=2.187 ASSIGNMENTS=762 CHECKS=7913	? TT=32.15	UNSAT TT=1439.49 ASSIGNMENTS=111110 CHECKS=948399000	UNSAT TT=781.079	UNSAT TT=800.169
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-8_ext.xml	UNSAT TT=0.725	UNSAT TT=2.175 CHECKS=0 NODES=1045	UNSAT TT=2.072 CHECKS=0 NODES=1052	? (TO) TT=1800.03	UNSAT TT=116.997 CHECKS=89071	UNSAT TT=111.636 CHECKS=91478	UNSAT TT=8.047 ASSIGNMENTS=112	UNSAT TT=21.348 ASSIGNMENTS=647	UNSAT TT=2.515 CHECKS=0 NODES=1387	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=10.821 ASSIGNMENTS=945 CHECKS=12317	UNSAT TT=9.296 ASSIGNMENTS=1045 CHECKS=0	UNSAT TT=295.363	UNSAT TT=528.905	UNSAT TT=0.725 CHECKS=9155	UNSAT TT=3.826 ASSIGNMENTS=989 CHECKS=12929	UNSAT TT=12.691 ASSIGNMENTS=4309 CHECKS=43520	UNSAT TT=11.509	UNSAT TT=4.142 ASSIGNMENTS=1180 CHECKS=13636	UNSAT TT=3.833 ASSIGNMENTS=945 CHECKS=12317	? TT=32.507	UNSAT TT=417.371 ASSIGNMENTS=113004 CHECKS=268148000	UNSAT TT=952.622	UNSAT TT=941.839
csp/rand-10-20-10/ normalized-rand-10-20-10-5-10000-9_ext.xml	UNSAT TT=1.065	UNSAT TT=1.438 CHECKS=0 NODES=916	UNSAT TT=1.453 CHECKS=0 NODES=916	UNSAT TT=258.533	UNSAT TT=101.754 CHECKS=80625	UNSAT TT=91.802 CHECKS=88350	UNSAT TT=6.276 ASSIGNMENTS=111	UNSAT TT=26.456 ASSIGNMENTS=848	UNSAT TT=2.616 CHECKS=0 NODES=1259	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=9.972 ASSIGNMENTS=871 CHECKS=9291	UNSAT TT=9.272 ASSIGNMENTS=916 CHECKS=0	UNSAT TT=194.989	UNSAT TT=305.505	UNSAT TT=1.065 CHECKS=7536	UNSAT TT=2.963 ASSIGNMENTS=834 CHECKS=10247	UNSAT TT=11.198 ASSIGNMENTS=4217 CHECKS=40681	UNSAT TT=7.393	UNSAT TT=2.896 ASSIGNMENTS=1034 CHECKS=11129	UNSAT TT=2.438 ASSIGNMENTS=871 CHECKS=9291	? TT=33.739	UNSAT TT=1736.23 ASSIGNMENTS=111301 CHECKS=1006860000	UNSAT TT=1688.06	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-13_ext.xml	SAT TT=13.027	SAT TT=338.321 CHECKS=2540030 NODES=233472	SAT TT=395.31 CHECKS=2333930 NODES=224781	SAT TT=394.887	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=509.483 ASSIGNMENTS=48630	SAT TT=1393.54 ASSIGNMENTS=90767	SAT TT=50.452 CHECKS=170902000 NODES=135403	SAT TT=86.063 CHECKS=766397000 NODES=2437300	? (TO) TT=1800.09	SAT TT=37.468 ASSIGNMENTS=110865 CHECKS=16008600	SAT TT=37.936 ASSIGNMENTS=110865 CHECKS=16008600	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=13.027 CHECKS=2346640	SAT TT=29.129 ASSIGNMENTS=110455 CHECKS=15960700	SAT TT=31.072 ASSIGNMENTS=116907 CHECKS=16395400	SAT TT=260.383	SAT TT=30.423 ASSIGNMENTS=111111 CHECKS=16050000	SAT TT=29.989 ASSIGNMENTS=110865 CHECKS=16008600	SAT TT=15.813	SAT TT=188.865 ASSIGNMENTS=152874 CHECKS=127269000	SAT TT=105.389	SAT TT=1585.37
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-14_ext.xml	SAT TT=1.327	SAT TT=37.899 CHECKS=158878 NODES=22624	SAT TT=39.859 CHECKS=162902 NODES=22472	SAT TT=92.398	SAT TT=327.919 CHECKS=3153480	SAT TT=262.4 CHECKS=2438960	SAT TT=100.514 ASSIGNMENTS=9382	SAT TT=125.558 ASSIGNMENTS=9417	SAT TT=15.676 CHECKS=44426500 NODES=37003	SAT TT=50.345 CHECKS=412682000 NODES=1302090	SAT TT=584.933 CHECKS=2208080000 NODES=3538850	SAT TT=9.414 ASSIGNMENTS=6069 CHECKS=871573	SAT TT=9.581 ASSIGNMENTS=6069 CHECKS=871573	SAT TT=695.326	? (TO) TT=1800.02	SAT TT=1.968 CHECKS=266822	SAT TT=1.327 ASSIGNMENTS=3935 CHECKS=557946	SAT TT=7.745 ASSIGNMENTS=32565 CHECKS=4094160	SAT TT=30.057	SAT TT=7.924 ASSIGNMENTS=29589 CHECKS=3951370	SAT TT=1.952 ASSIGNMENTS=6069 CHECKS=871573	SAT TT=142.129	SAT TT=7.518 ASSIGNMENTS=240 CHECKS=232909	SAT TT=21.172	SAT TT=18.504
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-15_ext.xml	SAT TT=4.118	SAT TT=73.233 CHECKS=381873 NODES=48121	SAT TT=73.81 CHECKS=383897 NODES=50774	SAT TT=14.62	SAT TT=275.725 CHECKS=2316530	SAT TT=311.679 CHECKS=2799430	SAT TT=34.952 ASSIGNMENTS=3623	SAT TT=431.502 ASSIGNMENTS=18054	SAT TT=7.865 CHECKS=20993700 NODES=16166	SAT TT=109.594 CHECKS=917219000 NODES=2883790	? (TO) TT=1800.09	SAT TT=17.934 ASSIGNMENTS=37101 CHECKS=4712380	SAT TT=17.793 ASSIGNMENTS=37101 CHECKS=4712380	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=11.467 CHECKS=1987770	SAT TT=10.389 ASSIGNMENTS=36293 CHECKS=5039030	SAT TT=1.882 ASSIGNMENTS=7504 CHECKS=834926	SAT TT=16.642	SAT TT=4.118 ASSIGNMENTS=14025 CHECKS=1812510	SAT TT=9.776 ASSIGNMENTS=37101 CHECKS=4712380	SAT TT=251.866	SAT TT=45.902 ASSIGNMENTS=29369 CHECKS=24544500	SAT TT=330.961	SAT TT=289.297
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-17_ext.xml	SAT TT=1.343	SAT TT=59.502 CHECKS=188752 NODES=38541	SAT TT=61.208 CHECKS=196260 NODES=38881	SAT TT=7.097	SAT TT=458.601 CHECKS=4519620	SAT TT=231.252 CHECKS=2233450	SAT TT=12.467 ASSIGNMENTS=1590	SAT TT=108.681 ASSIGNMENTS=9582	SAT TT=7.976 CHECKS=20240600 NODES=15404	SAT TT=328.455 CHECKS=2832080000 NODES=8851790	? (TO) TT=1800.05	SAT TT=1.462 ASSIGNMENTS=6371 CHECKS=684956	SAT TT=1.354 ASSIGNMENTS=6371 CHECKS=684956	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=3.217 CHECKS=462565	SAT TT=1.343 ASSIGNMENTS=5878 CHECKS=642422	SAT TT=1.471 ASSIGNMENTS=7319 CHECKS=703840	SAT TT=13.544	SAT TT=3.935 ASSIGNMENTS=14534 CHECKS=1899900	SAT TT=1.395 ASSIGNMENTS=6371 CHECKS=684956	SAT TT=346.813	SAT TT=24.61 ASSIGNMENTS=14353 CHECKS=15518400	SAT TT=55.831	SAT TT=44.678
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-19_ext.xml	SAT TT=12.411	SAT TT=175.516 CHECKS=1165570 NODES=112693	SAT TT=176.072 CHECKS=1242600 NODES=110632	SAT TT=94.101	SAT TT=1268.61 CHECKS=13142200	SAT TT=1188.67 CHECKS=12538800	SAT TT=162.712 ASSIGNMENTS=16067	SAT TT=176.19 ASSIGNMENTS=10403	SAT TT=30.103 CHECKS=95704500 NODES=79738	SAT TT=940.041 CHECKS=8485590000 NODES=26583900	? (TO) TT=1800.09	SAT TT=21.223 ASSIGNMENTS=57604 CHECKS=7380710	SAT TT=21.353 ASSIGNMENTS=57604 CHECKS=7380710	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=41.893 CHECKS=8172080	SAT TT=15.324 ASSIGNMENTS=64259 CHECKS=8315150	SAT TT=10.51 ASSIGNMENTS=44767 CHECKS=5642600	SAT TT=244.768	SAT TT=13.989 ASSIGNMENTS=59087 CHECKS=7645730	SAT TT=12.411 ASSIGNMENTS=57604 CHECKS=7380710	SAT TT=1746.5	SAT TT=177.821 ASSIGNMENTS=144690 CHECKS=105042000	SAT TT=1682.34	? (TO) TT=1800.06
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-20_ext.xml	SAT TT=3.151	SAT TT=114.725 CHECKS=416408 NODES=65063	SAT TT=149.336 CHECKS=499649 NODES=74262	SAT TT=133.939	SAT TT=399.303 CHECKS=3165710	SAT TT=175.04 CHECKS=1533850	SAT TT=35.833 ASSIGNMENTS=3504	SAT TT=87.131 ASSIGNMENTS=6070	SAT TT=7.522 CHECKS=23278700 NODES=15886	SAT TT=95.488 CHECKS=809627000 NODES=2681370	? (TO) TT=1800.02	SAT TT=11.417 ASSIGNMENTS=10535 CHECKS=1406420	SAT TT=11.464 ASSIGNMENTS=10535 CHECKS=1406420	SAT TT=1647.68	? (TO) TT=1800.02	SAT TT=3.151 CHECKS=444220	SAT TT=3.518 ASSIGNMENTS=10572 CHECKS=1409230	SAT TT=4.002 ASSIGNMENTS=14056 CHECKS=1736300	SAT TT=21.373	SAT TT=3.623 ASSIGNMENTS=10932 CHECKS=1469040	SAT TT=3.466 ASSIGNMENTS=10535 CHECKS=1406420	SAT TT=10.428	SAT TT=25.078 ASSIGNMENTS=13357 CHECKS=12158800	SAT TT=43.083	SAT TT=47.139
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-21_ext.xml	SAT TT=5.508	SAT TT=243.896 CHECKS=1790730 NODES=143542	SAT TT=234.117 CHECKS=1770730 NODES=142367	SAT TT=88.432	SAT TT=1129.95 CHECKS=9765660	SAT TT=315.284 CHECKS=2958490	SAT TT=253.851 ASSIGNMENTS=19456	? (TO) TT=1800.12	SAT TT=11.836 CHECKS=36907300 NODES=23364	SAT TT=1111.2 CHECKS=9510160000 NODES=30013400	? (TO) TT=1800	SAT TT=12.362 ASSIGNMENTS=18907 CHECKS=2409320	SAT TT=13.79 ASSIGNMENTS=18907 CHECKS=2409320	SAT TT=1117.14	SAT TT=348.738	SAT TT=9.972 CHECKS=1811580	SAT TT=6.428 ASSIGNMENTS=21779 CHECKS=2776360	SAT TT=15.376 ASSIGNMENTS=57362 CHECKS=6899710	SAT TT=73.08	SAT TT=7.869 ASSIGNMENTS=29080 CHECKS=3701810	SAT TT=5.508 ASSIGNMENTS=18907 CHECKS=2409320	SAT TT=48.835	SAT TT=26.27 ASSIGNMENTS=16934 CHECKS=15378400	SAT TT=47.027	SAT TT=87.426
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-26_ext.xml	SAT TT=1.797	SAT TT=6.769 CHECKS=13338 NODES=3482	SAT TT=6.728 CHECKS=13518 NODES=3406	SAT TT=511.234	SAT TT=595.546 CHECKS=5599090	SAT TT=20.404 CHECKS=183560	SAT TT=163.024 ASSIGNMENTS=16286	SAT TT=195.384 ASSIGNMENTS=11344	SAT TT=22.422 CHECKS=71883700 NODES=61198	SAT TT=63.492 CHECKS=529673000 NODES=1645820	? (TO) TT=1800.03	SAT TT=10.417 ASSIGNMENTS=9130 CHECKS=1215750	SAT TT=10.413 ASSIGNMENTS=9130 CHECKS=1215750	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=4.459 CHECKS=638697	SAT TT=1.797 ASSIGNMENTS=6585 CHECKS=792605	SAT TT=12.553 ASSIGNMENTS=43557 CHECKS=5957470	SAT TT=62.931	SAT TT=4.287 ASSIGNMENTS=15795 CHECKS=1997930	SAT TT=2.64 ASSIGNMENTS=9130 CHECKS=1215750	SAT TT=196.879	SAT TT=18.025 ASSIGNMENTS=4527 CHECKS=3865410	SAT TT=93.1	SAT TT=94.061
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-27_ext.xml	SAT TT=2.87	? (TO) TT=1800.17	? (TO) TT=1800.12	SAT TT=775.904	SAT TT=443.527 CHECKS=3909950	SAT TT=1292.17 CHECKS=13307800	SAT TT=653.334 ASSIGNMENTS=57230	? (TO) TT=1800.07	SAT TT=42.919 CHECKS=151995000 NODES=110620	SAT TT=189.285 CHECKS=1679800000 NODES=5133190	? (TO) TT=1800.03	SAT TT=41.224 ASSIGNMENTS=113897 CHECKS=15860000	SAT TT=41.905 ASSIGNMENTS=113897 CHECKS=15860000	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=2.87 CHECKS=481612	SAT TT=34.761 ASSIGNMENTS=117469 CHECKS=16266100	SAT TT=22.288 ASSIGNMENTS=76952 CHECKS=10548100	SAT TT=289.806	SAT TT=19.314 ASSIGNMENTS=70869 CHECKS=9813640	SAT TT=30.995 ASSIGNMENTS=113897 CHECKS=15860000	SAT TT=574.672	SAT TT=90.687 ASSIGNMENTS=59443 CHECKS=51577100	SAT TT=67.3	SAT TT=28.913
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-28_ext.xml	SAT TT=1.097	SAT TT=311.257 CHECKS=1506170 NODES=138140	SAT TT=297.849 CHECKS=1498720 NODES=135538	SAT TT=14.033	SAT TT=241.155 CHECKS=2086830	SAT TT=220.495 CHECKS=2254330	SAT TT=12.188 ASSIGNMENTS=1393	SAT TT=195.6 ASSIGNMENTS=11380	SAT TT=6.245 CHECKS=15299000 NODES=12503	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=9.837 ASSIGNMENTS=9534 CHECKS=1274820	SAT TT=10.745 ASSIGNMENTS=9534 CHECKS=1274820	SAT TT=1695.25	? (TO) TT=1800.03	SAT TT=4.898 CHECKS=901967	SAT TT=1.986 ASSIGNMENTS=6632 CHECKS=892337	SAT TT=1.482 ASSIGNMENTS=6592 CHECKS=680749	SAT TT=23.005	SAT TT=1.097 ASSIGNMENTS=3629 CHECKS=465374	SAT TT=2.773 ASSIGNMENTS=9534 CHECKS=1274820	SAT TT=337.735	SAT TT=34.81 ASSIGNMENTS=8546 CHECKS=8862670	SAT TT=286.294	SAT TT=290.188
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-2_ext.xml	SAT TT=4.59	SAT TT=52.849 CHECKS=190066 NODES=20762	SAT TT=49.474 CHECKS=178512 NODES=20158	SAT TT=238.736	SAT TT=207.268 CHECKS=1697800	SAT TT=1536.58 CHECKS=13460900	SAT TT=250.079 ASSIGNMENTS=25193	SAT TT=361.941 ASSIGNMENTS=28785	SAT TT=24.549 CHECKS=84768900 NODES=65478	SAT TT=73.447 CHECKS=659474000 NODES=1992310	? (TO) TT=1800.06	SAT TT=21.382 ASSIGNMENTS=49719 CHECKS=6516470	SAT TT=23.614 ASSIGNMENTS=49719 CHECKS=6516470	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=8.252 CHECKS=1214970	SAT TT=12.983 ASSIGNMENTS=42035 CHECKS=5456490	SAT TT=16.354 ASSIGNMENTS=55963 CHECKS=7273070	SAT TT=101.22	SAT TT=13.295 ASSIGNMENTS=44903 CHECKS=5701570	SAT TT=13.88 ASSIGNMENTS=49719 CHECKS=6516470	SAT TT=4.59	SAT TT=96.911 ASSIGNMENTS=47701 CHECKS=49983400	SAT TT=16.47	SAT TT=162.007
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-31_ext.xml	SAT TT=15.023	SAT TT=150.759 CHECKS=1027420 NODES=103010	SAT TT=195.938 CHECKS=1108280 NODES=113140	SAT TT=409.848	SAT TT=434.638 CHECKS=3859660	? (TO) TT=1800.07	SAT TT=876.302 ASSIGNMENTS=80930	? (TO) TT=1800.11	SAT TT=82.976 CHECKS=281722000 NODES=243977	SAT TT=256.407 CHECKS=2269520000 NODES=6896400	? (TO) TT=1800.08	SAT TT=50.235 ASSIGNMENTS=173354 CHECKS=21757800	SAT TT=160.578 ASSIGNMENTS=103010 CHECKS=1027420	? (TO) TT=1800	? (TO) TT=1800.01	SAT TT=60.07 CHECKS=10121500	SAT TT=46.783 ASSIGNMENTS=186061 CHECKS=23490000	SAT TT=42.489 ASSIGNMENTS=187404 CHECKS=23447200	SAT TT=339.912	SAT TT=20.079 ASSIGNMENTS=84062 CHECKS=10543600	SAT TT=42.816 ASSIGNMENTS=173354 CHECKS=21757800	SAT TT=15.023	SAT TT=353.968 ASSIGNMENTS=246780 CHECKS=198669000	SAT TT=21.239	SAT TT=178.421
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-33_ext.xml	SAT TT=34.143	SAT TT=173.984 CHECKS=1080290 NODES=131116	SAT TT=160.172 CHECKS=1109260 NODES=131445	SAT TT=387.503	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=448.093 ASSIGNMENTS=42118	? (TO) TT=1800.15	SAT TT=65.946 CHECKS=198973000 NODES=168915	SAT TT=225.158 CHECKS=1864390000 NODES=5701400	? (TO) TT=1800.06	SAT TT=42.981 ASSIGNMENTS=140268 CHECKS=20216600	SAT TT=42.448 ASSIGNMENTS=140268 CHECKS=20216600	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=51.176 CHECKS=9902410	SAT TT=87.466 ASSIGNMENTS=343394 CHECKS=49215800	SAT TT=86.569 ASSIGNMENTS=347065 CHECKS=49419400	SAT TT=488.596	SAT TT=89.704 ASSIGNMENTS=360508 CHECKS=51206700	SAT TT=34.143 ASSIGNMENTS=140268 CHECKS=20216600	SAT TT=1286.1	SAT TT=357.134 ASSIGNMENTS=301362 CHECKS=234001000	SAT TT=311.928	SAT TT=365.502
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-34_ext.xml	SAT TT=21.093	SAT TT=81.207 CHECKS=373230 NODES=41825	SAT TT=85.635 CHECKS=408879 NODES=45163	SAT TT=319.613	? (TO) TT=1800.09	SAT TT=1670.62 CHECKS=16282300	SAT TT=272.532 ASSIGNMENTS=25794	SAT TT=1455.13 ASSIGNMENTS=83357	SAT TT=49.678 CHECKS=171786000 NODES=127640	SAT TT=143.912 CHECKS=1180450000 NODES=3540980	? (TO) TT=1800.01	SAT TT=31.336 ASSIGNMENTS=85730 CHECKS=11049100	SAT TT=84.741 ASSIGNMENTS=41825 CHECKS=373230	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=60.285 CHECKS=11458000	SAT TT=23.149 ASSIGNMENTS=85953 CHECKS=11043000	SAT TT=24.673 ASSIGNMENTS=89968 CHECKS=11727200	SAT TT=132.914	SAT TT=21.093 ASSIGNMENTS=79996 CHECKS=10221500	SAT TT=24.157 ASSIGNMENTS=85730 CHECKS=11049100	SAT TT=1101.27	SAT TT=9.239 ASSIGNMENTS=3502 CHECKS=2728200	SAT TT=811.65	SAT TT=1730.92
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-36_ext.xml	SAT TT=6.402	SAT TT=392.18 CHECKS=2306000 NODES=221118	SAT TT=395.206 CHECKS=2342320 NODES=219150	SAT TT=444.524	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=223.982 ASSIGNMENTS=18172	SAT TT=1172.81 ASSIGNMENTS=84329	SAT TT=80.285 CHECKS=245092000 NODES=206472	SAT TT=88.961 CHECKS=741269000 NODES=2201450	? (TO) TT=1800.03	SAT TT=46.291 ASSIGNMENTS=152114 CHECKS=21911800	SAT TT=48.013 ASSIGNMENTS=152114 CHECKS=21911800	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=6.402 CHECKS=1005880	SAT TT=43.176 ASSIGNMENTS=160617 CHECKS=22315100	SAT TT=41.467 ASSIGNMENTS=167802 CHECKS=23095600	SAT TT=318.642	SAT TT=43.171 ASSIGNMENTS=162442 CHECKS=22492600	SAT TT=38.853 ASSIGNMENTS=152114 CHECKS=21911800	SAT TT=938.242	SAT TT=341.378 ASSIGNMENTS=235086 CHECKS=187739000	SAT TT=467.969	SAT TT=1674.19
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-37_ext.xml	SAT TT=38.277	SAT TT=702.939 CHECKS=4637970 NODES=478836	SAT TT=664.704 CHECKS=4602100 NODES=479606	SAT TT=158.048	? (TO) TT=1800.05	SAT TT=1509.57 CHECKS=15366700	SAT TT=564.314 ASSIGNMENTS=44618	SAT TT=109.449 ASSIGNMENTS=8259	SAT TT=55.323 CHECKS=185548000 NODES=145561	SAT TT=1294.99 CHECKS=10726400000 NODES=33350100	? (TO) TT=1800.08	SAT TT=54.775 ASSIGNMENTS=172327 CHECKS=26090600	SAT TT=55.141 ASSIGNMENTS=172327 CHECKS=26090600	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=182.808 CHECKS=34245800	SAT TT=47.342 ASSIGNMENTS=187150 CHECKS=28697900	SAT TT=22.346 ASSIGNMENTS=82724 CHECKS=12836400	SAT TT=182.98	SAT TT=38.277 ASSIGNMENTS=152115 CHECKS=22861200	SAT TT=46.333 ASSIGNMENTS=172327 CHECKS=26090600	SAT TT=1500.73	SAT TT=195.932 ASSIGNMENTS=125474 CHECKS=107171000	? (TO) TT=1800.08	SAT TT=555.301
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-38_ext.xml	SAT TT=3.277	SAT TT=49.606 CHECKS=190689 NODES=22262	SAT TT=49.289 CHECKS=193293 NODES=22504	SAT TT=10.228	SAT TT=321.258 CHECKS=2698360	SAT TT=735.427 CHECKS=6517260	SAT TT=33.426 ASSIGNMENTS=3474	SAT TT=64.345 ASSIGNMENTS=4962	SAT TT=6.978 CHECKS=19649100 NODES=14162	SAT TT=748.375 CHECKS=6623690000 NODES=21954200	SAT TT=429.378 CHECKS=1549790000 NODES=2601880	SAT TT=11.1 ASSIGNMENTS=12195 CHECKS=1405490	SAT TT=11.079 ASSIGNMENTS=12195 CHECKS=1405490	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=7.672 CHECKS=1128800	SAT TT=3.337 ASSIGNMENTS=12073 CHECKS=1391010	SAT TT=2.483 ASSIGNMENTS=10946 CHECKS=1134000	SAT TT=6.837	SAT TT=3.277 ASSIGNMENTS=11509 CHECKS=1328420	SAT TT=3.351 ASSIGNMENTS=12195 CHECKS=1405490	SAT TT=77.014	SAT TT=4.009 ASSIGNMENTS=453 CHECKS=278562	SAT TT=43.198	SAT TT=18.078
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-39_ext.xml	SAT TT=14.545	SAT TT=133.489 CHECKS=925198 NODES=108502	SAT TT=141.17 CHECKS=905563 NODES=106170	SAT TT=217.494	SAT TT=1338.53 CHECKS=14058600	SAT TT=1713.42 CHECKS=16687000	SAT TT=396.162 ASSIGNMENTS=26513	? (TO) TT=1800.11	SAT TT=78.77 CHECKS=277465000 NODES=216295	SAT TT=30.105 CHECKS=252692000 NODES=792872	? (TO) TT=1800.05	SAT TT=22.519 ASSIGNMENTS=53378 CHECKS=7482470	SAT TT=22.204 ASSIGNMENTS=53378 CHECKS=7482470	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=17.437 CHECKS=3894460	SAT TT=29.216 ASSIGNMENTS=110281 CHECKS=15738900	SAT TT=59.06 ASSIGNMENTS=219658 CHECKS=29966800	SAT TT=185.349	SAT TT=52.29 ASSIGNMENTS=190794 CHECKS=26743900	SAT TT=14.545 ASSIGNMENTS=53378 CHECKS=7482470	SAT TT=850.253	SAT TT=395.306 ASSIGNMENTS=264086 CHECKS=210857000	SAT TT=162.705	SAT TT=857.284
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-40_ext.xml	SAT TT=20.071	SAT TT=185.889 CHECKS=1355040 NODES=134302	SAT TT=193.929 CHECKS=1282610 NODES=129809	SAT TT=187.25	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=977.977 ASSIGNMENTS=78667	SAT TT=460.905 ASSIGNMENTS=27862	SAT TT=34.977 CHECKS=112828000 NODES=101211	SAT TT=1001.21 CHECKS=9193410000 NODES=28325800	? (TO) TT=1800.01	SAT TT=32.082 ASSIGNMENTS=98233 CHECKS=13801100	SAT TT=31.629 ASSIGNMENTS=98233 CHECKS=13801100	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=36.177 CHECKS=6834110	SAT TT=28.791 ASSIGNMENTS=107470 CHECKS=15458000	SAT TT=26.717 ASSIGNMENTS=102464 CHECKS=14475100	SAT TT=287.561	SAT TT=20.071 ASSIGNMENTS=80856 CHECKS=11146700	SAT TT=22.887 ASSIGNMENTS=98233 CHECKS=13801100	SAT TT=164.376	SAT TT=10.035 ASSIGNMENTS=3285 CHECKS=2779970	SAT TT=305.493	? (TO) TT=1800.13
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-41_ext.xml	SAT TT=23.512	SAT TT=190.327 CHECKS=1095980 NODES=118898	SAT TT=185.835 CHECKS=1109130 NODES=116988	SAT TT=271.511	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=154.814 ASSIGNMENTS=12938	SAT TT=162.92 ASSIGNMENTS=10451	SAT TT=24.481 CHECKS=77610600 NODES=59808	SAT TT=279.985 CHECKS=2349460000 NODES=7285270	? (TO) TT=1800.08	SAT TT=37.077 ASSIGNMENTS=111895 CHECKS=15843700	SAT TT=36.901 ASSIGNMENTS=111895 CHECKS=15843700	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=25.462 CHECKS=4767140	SAT TT=27.346 ASSIGNMENTS=103447 CHECKS=14593900	SAT TT=47.148 ASSIGNMENTS=182432 CHECKS=26042400	SAT TT=247.997	SAT TT=23.512 ASSIGNMENTS=92002 CHECKS=12517500	SAT TT=28.709 ASSIGNMENTS=111895 CHECKS=15843700	SAT TT=975.366	SAT TT=549.133 ASSIGNMENTS=263432 CHECKS=204678000	? (TO) TT=1800.02	SAT TT=481.837
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-46_ext.xml	SAT TT=0.679	SAT TT=20.264 CHECKS=67825 NODES=8430	SAT TT=20.213 CHECKS=65256 NODES=8349	SAT TT=269.958	SAT TT=201.728 CHECKS=1602850	SAT TT=131.816 CHECKS=1212420	SAT TT=59.107 ASSIGNMENTS=5388	SAT TT=38.236 ASSIGNMENTS=3067	SAT TT=8.584 CHECKS=24652900 NODES=22011	SAT TT=6.087 CHECKS=38412900 NODES=127636	? (TO) TT=1800.02	SAT TT=9.741 ASSIGNMENTS=7345 CHECKS=881946	SAT TT=28.212 ASSIGNMENTS=8430 CHECKS=67825	? (TO) TT=1800.08	SAT TT=992.664	SAT TT=0.679 CHECKS=34167	SAT TT=1.639 ASSIGNMENTS=6179 CHECKS=740064	SAT TT=1.382 ASSIGNMENTS=6151 CHECKS=624916	SAT TT=12.721	SAT TT=1.724 ASSIGNMENTS=5430 CHECKS=712204	SAT TT=2.015 ASSIGNMENTS=7345 CHECKS=881946	SAT TT=15.057	SAT TT=2.182 ASSIGNMENTS=1083 CHECKS=899847	SAT TT=30.22	SAT TT=6.658
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-48_ext.xml	SAT TT=10.979	SAT TT=471.778 CHECKS=4127500 NODES=318012	SAT TT=492.63 CHECKS=3702180 NODES=306238	SAT TT=95.463	SAT TT=853.118 CHECKS=8649900	SAT TT=561.014 CHECKS=5000560	SAT TT=601.828 ASSIGNMENTS=53666	SAT TT=1191.85 ASSIGNMENTS=49473	SAT TT=48.595 CHECKS=154479000 NODES=122448	SAT TT=380.15 CHECKS=3137640000 NODES=9818550	? (TO) TT=1800.03	SAT TT=24.812 ASSIGNMENTS=69455 CHECKS=9260920	SAT TT=25.046 ASSIGNMENTS=69455 CHECKS=9260920	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=34.471 CHECKS=6567990	SAT TT=21.563 ASSIGNMENTS=81928 CHECKS=11445100	SAT TT=21.551 ASSIGNMENTS=83190 CHECKS=11512500	SAT TT=132.092	SAT TT=10.979 ASSIGNMENTS=42590 CHECKS=5794630	SAT TT=17.112 ASSIGNMENTS=69455 CHECKS=9260920	SAT TT=1171.49	SAT TT=195.094 ASSIGNMENTS=137425 CHECKS=110294000	SAT TT=1432.13	SAT TT=1045.34
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-49_ext.xml	SAT TT=5.895	SAT TT=448.021 CHECKS=3116910 NODES=326760	SAT TT=455.275 CHECKS=3098100 NODES=335559	SAT TT=29.637	SAT TT=884.061 CHECKS=8517080	SAT TT=386.163 CHECKS=3788770	SAT TT=90.575 ASSIGNMENTS=8245	SAT TT=937.565 ASSIGNMENTS=55025	SAT TT=64.359 CHECKS=207302000 NODES=170893	SAT TT=60.385 CHECKS=488463000 NODES=1575330	? (TO) TT=1800.08	SAT TT=14.663 ASSIGNMENTS=26332 CHECKS=3495680	SAT TT=15.061 ASSIGNMENTS=26332 CHECKS=3495680	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=5.895 CHECKS=968994	SAT TT=7.088 ASSIGNMENTS=26816 CHECKS=3559290	SAT TT=29.207 ASSIGNMENTS=121957 CHECKS=15537500	SAT TT=50.394	SAT TT=9.311 ASSIGNMENTS=36511 CHECKS=4809550	SAT TT=6.864 ASSIGNMENTS=26332 CHECKS=3495680	SAT TT=26.999	SAT TT=87.051 ASSIGNMENTS=74199 CHECKS=54207000	SAT TT=222.841	SAT TT=134.343
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-50_ext.xml	SAT TT=28.358	SAT TT=38.805 CHECKS=192299 NODES=32940	SAT TT=62.115 CHECKS=347673 NODES=47675	SAT TT=1329.39	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=144.487 ASSIGNMENTS=7348	SAT TT=28.392 CHECKS=94487100 NODES=80806	SAT TT=728.379 CHECKS=6619350000 NODES=20021400	? (TO) TT=1800.03	SAT TT=44.151 ASSIGNMENTS=144771 CHECKS=19605500	SAT TT=44.733 ASSIGNMENTS=144771 CHECKS=19605500	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=144.983 CHECKS=29123300	SAT TT=28.358 ASSIGNMENTS=107865 CHECKS=14992700	SAT TT=111.813 ASSIGNMENTS=449009 CHECKS=59964400	SAT TT=109.036	SAT TT=32.607 ASSIGNMENTS=129417 CHECKS=18398600	SAT TT=36.164 ASSIGNMENTS=144771 CHECKS=19605500	SAT TT=81.021	SAT TT=363.339 ASSIGNMENTS=7266 CHECKS=5159950	SAT TT=206.129	? (TO) TT=1800.06
csp/rand-3-20-20-fcd/ normalized-rand-3-20-20-60-632-fcd-9_ext.xml	SAT TT=10.731	SAT TT=200.679 CHECKS=782784 NODES=97925	SAT TT=222.289 CHECKS=778299 NODES=97271	SAT TT=134.202	SAT TT=934.072 CHECKS=7961230	SAT TT=688.504 CHECKS=6569870	SAT TT=128.551 ASSIGNMENTS=13412	SAT TT=159.582 ASSIGNMENTS=12571	SAT TT=11.417 CHECKS=33821500 NODES=23921	SAT TT=84.29 CHECKS=692231000 NODES=2097440	? (TO) TT=1800.07	SAT TT=22.918 ASSIGNMENTS=54106 CHECKS=7356090	SAT TT=23.043 ASSIGNMENTS=54106 CHECKS=7356090	? (TO) TT=1800	? (TO) TT=1800	SAT TT=14.815 CHECKS=2290860	SAT TT=10.731 ASSIGNMENTS=35573 CHECKS=4921910	SAT TT=8.334 ASSIGNMENTS=30462 CHECKS=3979100	SAT TT=88.146	SAT TT=13.595 ASSIGNMENTS=49528 CHECKS=6994460	SAT TT=15.171 ASSIGNMENTS=54106 CHECKS=7356090	SAT TT=175.692	SAT TT=81.603 ASSIGNMENTS=31403 CHECKS=30565200	SAT TT=29.825	SAT TT=186.967
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-12_ext.xml	SAT TT=6.622	SAT TT=363.183 CHECKS=2189160 NODES=214124	SAT TT=298.847 CHECKS=1694470 NODES=179502	SAT TT=76.157	SAT TT=456.976 CHECKS=4287760	SAT TT=337.304 CHECKS=3321120	SAT TT=75.829 ASSIGNMENTS=7816	SAT TT=218.058 ASSIGNMENTS=14273	SAT TT=33.434 CHECKS=100050000 NODES=85254	SAT TT=222.827 CHECKS=1837480000 NODES=5693880	? (TO) TT=1800.06	SAT TT=21.316 ASSIGNMENTS=53610 CHECKS=6598100	SAT TT=21.2 ASSIGNMENTS=53610 CHECKS=6598100	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT TT=34.439 CHECKS=6958890	SAT TT=16.272 ASSIGNMENTS=55736 CHECKS=7679470	SAT TT=7.378 ASSIGNMENTS=30082 CHECKS=3924270	SAT TT=116.756	SAT TT=14.211 ASSIGNMENTS=54911 CHECKS=7203760	SAT TT=12.266 ASSIGNMENTS=53610 CHECKS=6598100	SAT TT=155.297	SAT TT=166.399 ASSIGNMENTS=116470 CHECKS=88599800	SAT TT=116.848	SAT TT=6.622
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-13_ext.xml	SAT TT=1.904	SAT TT=185.541 CHECKS=1114090 NODES=124481	SAT TT=173.314 CHECKS=1138070 NODES=126729	SAT TT=285.955	SAT TT=222.028 CHECKS=2027170	? (TO) TT=1800.07	SAT TT=327.027 ASSIGNMENTS=30834	? (TO) TT=1800.14	SAT TT=43.029 CHECKS=135676000 NODES=106668	SAT TT=21.852 CHECKS=186889000 NODES=594208	? (TO) TT=1800.06	SAT TT=26.416 ASSIGNMENTS=68349 CHECKS=9806860	SAT TT=26.485 ASSIGNMENTS=68349 CHECKS=9806860	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=1.904 CHECKS=291720	SAT TT=18.577 ASSIGNMENTS=68664 CHECKS=9850570	SAT TT=19.117 ASSIGNMENTS=71782 CHECKS=10071800	SAT TT=157.261	SAT TT=18.778 ASSIGNMENTS=69020 CHECKS=9849450	SAT TT=16.881 ASSIGNMENTS=68349 CHECKS=9806860	SAT TT=51.643	SAT TT=113.427 ASSIGNMENTS=13411 CHECKS=12943300	SAT TT=422.251	SAT TT=572.688
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-16_ext.xml	UNSAT TT=117.418	UNSAT TT=833.171 CHECKS=7437860 NODES=703761	UNSAT TT=844.929 CHECKS=7479160 NODES=702520	UNSAT TT=604.865	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.08	UNSAT TT=200.354 CHECKS=647115000 NODES=520823	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=136.556 ASSIGNMENTS=486579 CHECKS=69166500	UNSAT TT=794.356 ASSIGNMENTS=703761 CHECKS=7437860	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=153.184 CHECKS=30638700	UNSAT TT=123.266 ASSIGNMENTS=457428 CHECKS=65977000	UNSAT TT=112.038 ASSIGNMENTS=458369 CHECKS=66019600	UNSAT TT=895.256	UNSAT TT=117.418 ASSIGNMENTS=460547 CHECKS=63758000	UNSAT TT=125.393 ASSIGNMENTS=486579 CHECKS=69166500	? (TO) TT=1800.11	UNSAT TT=1134.1 ASSIGNMENTS=501909 CHECKS=475402000	? (TO) TT=1800.06	? (TO) TT=1800.12
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-17_ext.xml	SAT TT=18.208	SAT TT=118.382 CHECKS=352976 NODES=65358	SAT TT=118.227 CHECKS=353139 NODES=65167	SAT TT=61.389	SAT TT=1523.43 CHECKS=16051900	SAT TT=449.878 CHECKS=4623320	SAT TT=275.094 ASSIGNMENTS=25842	SAT TT=585.198 ASSIGNMENTS=24181	SAT TT=45.612 CHECKS=161373000 NODES=127939	SAT TT=95.187 CHECKS=784265000 NODES=2449630	? (TO) TT=1800.02	SAT TT=34.958 ASSIGNMENTS=111825 CHECKS=14319000	SAT TT=112.099 ASSIGNMENTS=65358 CHECKS=352976	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=18.208 CHECKS=2936220	SAT TT=26.697 ASSIGNMENTS=104520 CHECKS=13633700	SAT TT=26.273 ASSIGNMENTS=103355 CHECKS=13611300	SAT TT=250.094	SAT TT=26.443 ASSIGNMENTS=104685 CHECKS=14659100	SAT TT=27.534 ASSIGNMENTS=111825 CHECKS=14319000	SAT TT=123.399	SAT TT=196.316 ASSIGNMENTS=120796 CHECKS=108548000	SAT TT=84.496	SAT TT=58.922
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-18_ext.xml	UNSAT TT=13.627	UNSAT TT=130.9 CHECKS=556332 NODES=59184	UNSAT TT=124.203 CHECKS=545409 NODES=59418	UNSAT TT=1088.89	UNSAT TT=999.336 CHECKS=8728910	UNSAT TT=991.169 CHECKS=8565950	UNSAT TT=229.782 ASSIGNMENTS=15453	UNSAT TT=170.99 ASSIGNMENTS=9256	UNSAT TT=25.694 CHECKS=92755300 NODES=54138	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=21.544 ASSIGNMENTS=42014 CHECKS=5896870	UNSAT TT=21.684 ASSIGNMENTS=42014 CHECKS=5896870	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=17.054 CHECKS=2646230	UNSAT TT=15.786 ASSIGNMENTS=47859 CHECKS=6655450	UNSAT TT=10.92 ASSIGNMENTS=40564 CHECKS=5350570	UNSAT TT=68.475	UNSAT TT=14.007 ASSIGNMENTS=46085 CHECKS=6400270	UNSAT TT=13.627 ASSIGNMENTS=42014 CHECKS=5896870	UNSAT TT=202.555	UNSAT TT=55.821 ASSIGNMENTS=35825 CHECKS=35850700	UNSAT TT=179.937	UNSAT TT=173.951
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-1_ext.xml	SAT TT=5.721	SAT TT=160.426 CHECKS=621835 NODES=88969	SAT TT=143.131 CHECKS=652393 NODES=84700	SAT TT=217.933	SAT TT=924.052 CHECKS=8284210	SAT TT=1798.63 CHECKS=17631000	SAT TT=242.409 ASSIGNMENTS=18827	? (TO) TT=1800.05	SAT TT=36.925 CHECKS=110050000 NODES=92671	SAT TT=5.721 CHECKS=34976200 NODES=108423	? (TO) TT=1800.07	SAT TT=21.606 ASSIGNMENTS=55298 CHECKS=7704520	SAT TT=22.068 ASSIGNMENTS=55298 CHECKS=7704520	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=21.173 CHECKS=3427340	SAT TT=14.286 ASSIGNMENTS=56562 CHECKS=7895890	SAT TT=13.108 ASSIGNMENTS=53615 CHECKS=7133020	SAT TT=99.427	SAT TT=14.78 ASSIGNMENTS=58233 CHECKS=7972290	SAT TT=13.83 ASSIGNMENTS=55298 CHECKS=7704520	SAT TT=182.127	SAT TT=49.107 ASSIGNMENTS=29996 CHECKS=25263700	SAT TT=416.27	SAT TT=1320.7
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-20_ext.xml	SAT TT=0.479	SAT TT=363.31 CHECKS=1479710 NODES=174684	SAT TT=324.064 CHECKS=1307280 NODES=158599	SAT TT=259.939	SAT TT=660.01 CHECKS=5407230	SAT TT=18.559 CHECKS=136418	SAT TT=82.821 ASSIGNMENTS=6868	SAT TT=123.019 ASSIGNMENTS=7751	SAT TT=11.311 CHECKS=38860700 NODES=26226	SAT TT=49.202 CHECKS=421078000 NODES=1395660	? (TO) TT=1800	SAT TT=9.751 ASSIGNMENTS=6190 CHECKS=830662	SAT TT=9.682 ASSIGNMENTS=6190 CHECKS=830662	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=0.479 CHECKS=10921	SAT TT=5.201 ASSIGNMENTS=16201 CHECKS=2150130	SAT TT=5.343 ASSIGNMENTS=21271 CHECKS=2421430	SAT TT=38.466	SAT TT=5.278 ASSIGNMENTS=15674 CHECKS=2180110	SAT TT=2.061 ASSIGNMENTS=6190 CHECKS=830662	SAT TT=124.163	SAT TT=4.202 ASSIGNMENTS=2508 CHECKS=2458310	SAT TT=105.547	SAT TT=5.906
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-24_ext.xml	SAT TT=23.739	SAT TT=351.127 CHECKS=2037280 NODES=199257	SAT TT=347.809 CHECKS=2027320 NODES=201359	SAT TT=92.721	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT TT=122.106 ASSIGNMENTS=10812	SAT TT=1394.9 ASSIGNMENTS=86742	SAT TT=85.771 CHECKS=277209000 NODES=228591	SAT TT=512.32 CHECKS=4709690000 NODES=14160800	? (TO) TT=1800.02	SAT TT=38.934 ASSIGNMENTS=111102 CHECKS=15736600	SAT TT=39.156 ASSIGNMENTS=111102 CHECKS=15736600	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=45.303 CHECKS=7728420	SAT TT=23.739 ASSIGNMENTS=85907 CHECKS=11807200	SAT TT=24.27 ASSIGNMENTS=90260 CHECKS=12154300	SAT TT=48.375	SAT TT=49.905 ASSIGNMENTS=183718 CHECKS=24853400	SAT TT=31.354 ASSIGNMENTS=111102 CHECKS=15736600	SAT TT=426.393	SAT TT=157.472 ASSIGNMENTS=54067 CHECKS=48743500	SAT TT=1054.61	SAT TT=751.372
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-29_ext.xml	SAT TT=8.074	SAT TT=115.246 CHECKS=471852 NODES=65088	SAT TT=109.938 CHECKS=472954 NODES=63621	SAT TT=418.957	SAT TT=970.919 CHECKS=9477920	SAT TT=1523.12 CHECKS=15327900	SAT TT=246.059 ASSIGNMENTS=20214	SAT TT=632.763 ASSIGNMENTS=26091	SAT TT=8.074 CHECKS=24624200 NODES=17139	SAT TT=17.173 CHECKS=132305000 NODES=428279	? (TO) TT=1800.04	SAT TT=24.442 ASSIGNMENTS=56512 CHECKS=8323060	SAT TT=24.743 ASSIGNMENTS=56512 CHECKS=8323060	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=8.743 CHECKS=1391130	SAT TT=18.546 ASSIGNMENTS=62480 CHECKS=9228670	SAT TT=16.403 ASSIGNMENTS=55475 CHECKS=8048100	SAT TT=73.224	SAT TT=18.761 ASSIGNMENTS=64524 CHECKS=9448730	SAT TT=16.636 ASSIGNMENTS=56512 CHECKS=8323060	SAT TT=160.148	SAT TT=46.384 ASSIGNMENTS=22115 CHECKS=21010900	SAT TT=92.7	SAT TT=321.189
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-2_ext.xml	UNSAT TT=20.353	UNSAT TT=191.594 CHECKS=813583 NODES=73055	UNSAT TT=188.198 CHECKS=803442 NODES=72060	UNSAT TT=245.796	UNSAT TT=1425.09 CHECKS=10886200	UNSAT TT=1354.4 CHECKS=10128100	UNSAT TT=252.684 ASSIGNMENTS=26692	? (TO) TT=1800.37	UNSAT TT=32.094 CHECKS=101536000 NODES=78269	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=28.435 ASSIGNMENTS=70786 CHECKS=9233930	UNSAT TT=29.41 ASSIGNMENTS=70786 CHECKS=9233930	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=27.057 CHECKS=3704390	UNSAT TT=21.258 ASSIGNMENTS=71247 CHECKS=9402740	UNSAT TT=22 ASSIGNMENTS=75954 CHECKS=9717350	UNSAT TT=138.9	UNSAT TT=20.353 ASSIGNMENTS=67488 CHECKS=8752720	UNSAT TT=20.799 ASSIGNMENTS=70786 CHECKS=9233930	UNSAT TT=326.885	UNSAT TT=122.99 ASSIGNMENTS=81118 CHECKS=82925500	UNSAT TT=233.088	UNSAT TT=268.405
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-30_ext.xml	UNSAT TT=29.726	? (TO) TT=1800.12	? (TO) TT=1800.06	UNSAT TT=638.201	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=457.654 ASSIGNMENTS=36609	? (TO) TT=1800.08	UNSAT TT=52.626 CHECKS=178271000 NODES=113838	? (TO) TT=1800.09	? (TO) TT=1800	UNSAT TT=40.118 ASSIGNMENTS=105662 CHECKS=15513100	UNSAT TT=40.49 ASSIGNMENTS=105662 CHECKS=15513100	? (TO) TT=1800	? (TO) TT=1800.01	UNSAT TT=41.254 CHECKS=6755490	UNSAT TT=29.726 ASSIGNMENTS=98415 CHECKS=14037300	UNSAT TT=32.413 ASSIGNMENTS=103807 CHECKS=15234400	UNSAT TT=294.099	UNSAT TT=30.541 ASSIGNMENTS=101583 CHECKS=14396300	UNSAT TT=31.768 ASSIGNMENTS=105662 CHECKS=15513100	UNSAT TT=879.929	UNSAT TT=195.641 ASSIGNMENTS=108641 CHECKS=111872000	UNSAT TT=742.052	UNSAT TT=866.057
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-32_ext.xml	SAT TT=2.057	SAT TT=41.669 CHECKS=197377 NODES=30327	SAT TT=46.488 CHECKS=201368 NODES=30927	SAT TT=7.698	SAT TT=183.894 CHECKS=1531800	SAT TT=266.207 CHECKS=2624720	SAT TT=22.064 ASSIGNMENTS=2177	SAT TT=296.425 ASSIGNMENTS=16727	SAT TT=5.42 CHECKS=12565700 NODES=10889	SAT TT=319.145 CHECKS=2878600000 NODES=9453320	? (TO) TT=1800.06	SAT TT=10.849 ASSIGNMENTS=13570 CHECKS=1770420	SAT TT=48.987 ASSIGNMENTS=30327 CHECKS=197377	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=5.247 CHECKS=788113	SAT TT=2.057 ASSIGNMENTS=7944 CHECKS=1018320	SAT TT=1.062 ASSIGNMENTS=5174 CHECKS=461528	SAT TT=25.587	SAT TT=2.217 ASSIGNMENTS=8731 CHECKS=1098760	SAT TT=3.718 ASSIGNMENTS=13570 CHECKS=1770420	SAT TT=84.41	SAT TT=1.614 ASSIGNMENTS=246 CHECKS=189489	SAT TT=18.553	SAT TT=6.945
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-35_ext.xml	UNSAT TT=14.923	UNSAT TT=177.933 CHECKS=1229840 NODES=95282	UNSAT TT=180.691 CHECKS=1239280 NODES=99435	UNSAT TT=145.585	UNSAT TT=1594.31 CHECKS=15486700	UNSAT TT=1466.12 CHECKS=12984200	UNSAT TT=280.378 ASSIGNMENTS=28467	UNSAT TT=660.541 ASSIGNMENTS=27366	UNSAT TT=38.371 CHECKS=134376000 NODES=94189	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=24.043 ASSIGNMENTS=62576 CHECKS=7695370	UNSAT TT=170.135 ASSIGNMENTS=95282 CHECKS=1229840	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=29.718 CHECKS=4814120	UNSAT TT=16.999 ASSIGNMENTS=64431 CHECKS=8009630	UNSAT TT=16.182 ASSIGNMENTS=68546 CHECKS=8131340	UNSAT TT=225.412	UNSAT TT=16.168 ASSIGNMENTS=66161 CHECKS=8040780	UNSAT TT=14.923 ASSIGNMENTS=62576 CHECKS=7695370	UNSAT TT=866.154	UNSAT TT=142.079 ASSIGNMENTS=75920 CHECKS=62549100	UNSAT TT=401.376	UNSAT TT=567.157
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-38_ext.xml	UNSAT TT=5.807	UNSAT TT=53.413 CHECKS=215499 NODES=25908	UNSAT TT=60.237 CHECKS=212357 NODES=25941	UNSAT TT=123.316	UNSAT TT=485.288 CHECKS=4543830	UNSAT TT=384.991 CHECKS=3245650	UNSAT TT=81.624 ASSIGNMENTS=8210	UNSAT TT=65.005 ASSIGNMENTS=5235	UNSAT TT=11.811 CHECKS=40126300 NODES=28501	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=14.409 ASSIGNMENTS=24247 CHECKS=2910300	UNSAT TT=14.359 ASSIGNMENTS=24247 CHECKS=2910300	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=8.877 CHECKS=1317180	UNSAT TT=5.807 ASSIGNMENTS=22552 CHECKS=2586670	UNSAT TT=5.394 ASSIGNMENTS=22856 CHECKS=2503030	UNSAT TT=41.103	UNSAT TT=7.227 ASSIGNMENTS=26108 CHECKS=3026200	UNSAT TT=6.707 ASSIGNMENTS=24247 CHECKS=2910300	UNSAT TT=78.01	UNSAT TT=43.614 ASSIGNMENTS=21566 CHECKS=19933100	UNSAT TT=56.431	UNSAT TT=63.612
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-39_ext.xml	UNSAT TT=67.973	UNSAT TT=1363.79 CHECKS=13209800 NODES=1051130	UNSAT TT=1536.39 CHECKS=13788500 NODES=1053120	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=1688.88 ASSIGNMENTS=109966	? (TO) TT=1800.13	UNSAT TT=111.655 CHECKS=398504000 NODES=315598	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=72.782 ASSIGNMENTS=255175 CHECKS=36260000	UNSAT TT=78.592 ASSIGNMENTS=255175 CHECKS=36260000	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=97.215 CHECKS=20283200	UNSAT TT=67.973 ASSIGNMENTS=259399 CHECKS=37254100	UNSAT TT=70.33 ASSIGNMENTS=257884 CHECKS=36468200	UNSAT TT=574.627	UNSAT TT=72.67 ASSIGNMENTS=258653 CHECKS=37191000	UNSAT TT=70.86 ASSIGNMENTS=255175 CHECKS=36260000	? (TO) TT=1800.11	UNSAT TT=650.736 ASSIGNMENTS=391673 CHECKS=300469000	? (TO) TT=1800.03	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-3_ext.xml	UNSAT TT=53.99	UNSAT TT=451.068 CHECKS=2603780 NODES=257898	UNSAT TT=462.118 CHECKS=2638640 NODES=256866	UNSAT TT=429.481	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=1038.48 ASSIGNMENTS=101388	UNSAT TT=689.809 ASSIGNMENTS=48468	UNSAT TT=117.943 CHECKS=408418000 NODES=348597	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=69.115 ASSIGNMENTS=260176 CHECKS=35732800	UNSAT TT=73.657 ASSIGNMENTS=260176 CHECKS=35732800	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=97.953 CHECKS=18327100	UNSAT TT=55.71 ASSIGNMENTS=236597 CHECKS=27828000	UNSAT TT=54.023 ASSIGNMENTS=240937 CHECKS=28254000	UNSAT TT=432.879	UNSAT TT=53.99 ASSIGNMENTS=231953 CHECKS=26592600	UNSAT TT=64.902 ASSIGNMENTS=260176 CHECKS=35732800	? (TO) TT=1800.68	UNSAT TT=330.757 ASSIGNMENTS=289055 CHECKS=211540000	? (TO) TT=1800.06	? (TO) TT=1800.13
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-41_ext.xml	SAT TT=4.577	SAT TT=344.527 CHECKS=2384140 NODES=216906	SAT TT=369.092 CHECKS=2472970 NODES=233846	SAT TT=823.406	SAT TT=163.579 CHECKS=1330060	? (TO) TT=1800.04	SAT TT=76.577 ASSIGNMENTS=5804	SAT TT=395.322 ASSIGNMENTS=16596	SAT TT=15.853 CHECKS=48097500 NODES=38713	SAT TT=521.448 CHECKS=4718830000 NODES=14643800	? (TO) TT=1800.08	SAT TT=12.484 ASSIGNMENTS=15952 CHECKS=2435100	SAT TT=12.642 ASSIGNMENTS=15952 CHECKS=2435100	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=37.779 CHECKS=7127880	SAT TT=4.626 ASSIGNMENTS=16195 CHECKS=2450860	SAT TT=17.184 ASSIGNMENTS=63350 CHECKS=9216630	SAT TT=26.018	SAT TT=29.65 ASSIGNMENTS=104093 CHECKS=15987000	SAT TT=4.577 ASSIGNMENTS=15952 CHECKS=2435100	SAT TT=1438.76	SAT TT=31.257 ASSIGNMENTS=5715 CHECKS=4154870	? (TO) TT=1800.05	SAT TT=1209.76
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-43_ext.xml	UNSAT TT=4.81	UNSAT TT=563.699 CHECKS=4068710 NODES=305123	UNSAT TT=549.332 CHECKS=4034440 NODES=304687	UNSAT TT=76.9	UNSAT TT=474.619 CHECKS=4620100	UNSAT TT=417.128 CHECKS=4188780	UNSAT TT=81.677 ASSIGNMENTS=9308	UNSAT TT=146.347 ASSIGNMENTS=9163	UNSAT TT=11.905 CHECKS=37927500 NODES=25739	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=12.28 ASSIGNMENTS=17885 CHECKS=2151410	UNSAT TT=558.824 ASSIGNMENTS=305123 CHECKS=4068710	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=6.338 CHECKS=1203520	UNSAT TT=4.81 ASSIGNMENTS=18446 CHECKS=2201190	UNSAT TT=6.289 ASSIGNMENTS=24706 CHECKS=2847740	UNSAT TT=30.351	UNSAT TT=5.272 ASSIGNMENTS=18908 CHECKS=2284210	UNSAT TT=4.823 ASSIGNMENTS=17885 CHECKS=2151410	UNSAT TT=131.312	UNSAT TT=44.315 ASSIGNMENTS=37251 CHECKS=29528600	UNSAT TT=115.974	UNSAT TT=93.167
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-44_ext.xml	UNSAT TT=16.422	UNSAT TT=496.627 CHECKS=3173140 NODES=300530	UNSAT TT=500.128 CHECKS=3122440 NODES=298726	UNSAT TT=166.139	UNSAT TT=1379.74 CHECKS=12707800	UNSAT TT=1520.16 CHECKS=14071700	UNSAT TT=314.88 ASSIGNMENTS=25135	UNSAT TT=963.24 ASSIGNMENTS=65938	UNSAT TT=30.902 CHECKS=109830000 NODES=83156	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=25.266 ASSIGNMENTS=62513 CHECKS=8026530	UNSAT TT=467.693 ASSIGNMENTS=300530 CHECKS=3173140	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=24.318 CHECKS=4020290	UNSAT TT=17.41 ASSIGNMENTS=61667 CHECKS=8073300	UNSAT TT=17.819 ASSIGNMENTS=61149 CHECKS=8198580	UNSAT TT=119.128	UNSAT TT=16.422 ASSIGNMENTS=63842 CHECKS=8229290	UNSAT TT=16.984 ASSIGNMENTS=62513 CHECKS=8026530	UNSAT TT=393.673	UNSAT TT=112.784 ASSIGNMENTS=79627 CHECKS=69152900	UNSAT TT=306.755	UNSAT TT=377.648
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-45_ext.xml	UNSAT TT=16.229	UNSAT TT=247.54 CHECKS=1203630 NODES=126228	UNSAT TT=260.811 CHECKS=1300780 NODES=135178	UNSAT TT=208.585	UNSAT TT=1278.74 CHECKS=11384500	UNSAT TT=1415.92 CHECKS=12175900	UNSAT TT=224.903 ASSIGNMENTS=12873	UNSAT TT=208.278 ASSIGNMENTS=10229	UNSAT TT=26.997 CHECKS=85455800 NODES=58529	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=24.242 ASSIGNMENTS=51288 CHECKS=7521620	UNSAT TT=24.467 ASSIGNMENTS=51288 CHECKS=7521620	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=23.05 CHECKS=3745910	UNSAT TT=16.487 ASSIGNMENTS=52753 CHECKS=7656360	UNSAT TT=14.49 ASSIGNMENTS=53506 CHECKS=7017530	UNSAT TT=101.656	UNSAT TT=16.901 ASSIGNMENTS=53017 CHECKS=7680850	UNSAT TT=16.229 ASSIGNMENTS=51288 CHECKS=7521620	UNSAT TT=296.435	UNSAT TT=105.239 ASSIGNMENTS=72248 CHECKS=60444300	UNSAT TT=196.769	UNSAT TT=219.067
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-47_ext.xml	SAT TT=15.225	SAT TT=21.088 CHECKS=86550 NODES=13119	SAT TT=23.519 CHECKS=88283 NODES=13705	SAT TT=29.179	SAT TT=668.727 CHECKS=6120980	SAT TT=1169.92 CHECKS=11141000	SAT TT=91.076 ASSIGNMENTS=9896	SAT TT=182.52 ASSIGNMENTS=12086	SAT TT=15.225 CHECKS=50678000 NODES=40996	SAT TT=518.695 CHECKS=4670210000 NODES=14393100	? (TO) TT=1800.08	SAT TT=29.998 ASSIGNMENTS=83717 CHECKS=10993600	SAT TT=30.353 ASSIGNMENTS=83717 CHECKS=10993600	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=64.386 CHECKS=12030400	SAT TT=23.237 ASSIGNMENTS=90068 CHECKS=11569100	SAT TT=24.216 ASSIGNMENTS=97474 CHECKS=12911500	SAT TT=105.138	SAT TT=24.27 ASSIGNMENTS=95611 CHECKS=13047000	SAT TT=22.047 ASSIGNMENTS=83717 CHECKS=10993600	SAT TT=238.232	SAT TT=3.599 ASSIGNMENTS=264 CHECKS=179878	SAT TT=207.208	SAT TT=196.701
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-49_ext.xml	SAT TT=23.162	SAT TT=461.365 CHECKS=3419990 NODES=350432	SAT TT=424.376 CHECKS=2972600 NODES=312744	SAT TT=151.627	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=799.517 ASSIGNMENTS=69861	SAT TT=445.183 ASSIGNMENTS=28400	SAT TT=94.903 CHECKS=309977000 NODES=249275	SAT TT=1433.8 CHECKS=12876300000 NODES=41573100	? (TO) TT=1800.03	SAT TT=60.577 ASSIGNMENTS=204211 CHECKS=27863600	SAT TT=60.707 ASSIGNMENTS=204211 CHECKS=27863600	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=118.974 CHECKS=21136400	SAT TT=23.162 ASSIGNMENTS=92390 CHECKS=11832200	SAT TT=44.007 ASSIGNMENTS=178729 CHECKS=22781400	SAT TT=344	SAT TT=24.014 ASSIGNMENTS=96212 CHECKS=12296800	SAT TT=51.604 ASSIGNMENTS=204211 CHECKS=27863600	? (TO) TT=1800.12	SAT TT=145.811 ASSIGNMENTS=76976 CHECKS=60853400	SAT TT=1147.78	SAT TT=1150.55
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-4_ext.xml	SAT TT=2.879	SAT TT=839.47 CHECKS=3610250 NODES=435071	SAT TT=865.074 CHECKS=3591940 NODES=436382	SAT TT=108.257	SAT TT=930.371 CHECKS=9331280	SAT TT=775.946 CHECKS=7718260	SAT TT=264.217 ASSIGNMENTS=22824	SAT TT=766.715 ASSIGNMENTS=31568	SAT TT=3.879 CHECKS=6355050 NODES=5336	SAT TT=128.386 CHECKS=1087490000 NODES=3392360	? (TO) TT=1800.07	SAT TT=13.456 ASSIGNMENTS=20999 CHECKS=3058230	SAT TT=13.225 ASSIGNMENTS=20999 CHECKS=3058230	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=31.182 CHECKS=6406330	SAT TT=5.044 ASSIGNMENTS=19267 CHECKS=2802990	SAT TT=5.876 ASSIGNMENTS=24014 CHECKS=3264310	SAT TT=29.4	SAT TT=2.879 ASSIGNMENTS=10731 CHECKS=1541390	SAT TT=5.51 ASSIGNMENTS=20999 CHECKS=3058230	SAT TT=468.712	SAT TT=86.524 ASSIGNMENTS=53876 CHECKS=44026600	SAT TT=561.944	SAT TT=133.791
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-6_ext.xml	UNSAT TT=9.703	UNSAT TT=716.651 CHECKS=3662910 NODES=372345	UNSAT TT=764.905 CHECKS=3714460 NODES=392500	UNSAT TT=96.513	UNSAT TT=869.304 CHECKS=7536960	UNSAT TT=936.193 CHECKS=8117110	UNSAT TT=193.382 ASSIGNMENTS=14512	UNSAT TT=474.067 ASSIGNMENTS=26431	UNSAT TT=20.797 CHECKS=68839700 NODES=42529	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=17.897 ASSIGNMENTS=31503 CHECKS=4330880	UNSAT TT=18.153 ASSIGNMENTS=31503 CHECKS=4330880	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=12.515 CHECKS=2009250	UNSAT TT=9.703 ASSIGNMENTS=29893 CHECKS=4158980	UNSAT TT=9.884 ASSIGNMENTS=33097 CHECKS=4385950	UNSAT TT=76.048	UNSAT TT=10.167 ASSIGNMENTS=30675 CHECKS=4349160	UNSAT TT=10.03 ASSIGNMENTS=31503 CHECKS=4330880	UNSAT TT=218.769	UNSAT TT=90.967 ASSIGNMENTS=53223 CHECKS=44188000	UNSAT TT=120.959	UNSAT TT=175.442
csp/rand-3-20-20/ normalized-rand-3-20-20-60-632-7_ext.xml	SAT TT=1.83	SAT TT=497.083 CHECKS=3207590 NODES=254309	SAT TT=495.171 CHECKS=3055150 NODES=239741	SAT TT=1240.29	? (TO) TT=1800.01	SAT TT=1352.75 CHECKS=13292100	SAT TT=249.967 ASSIGNMENTS=24938	SAT TT=276.603 ASSIGNMENTS=16647	SAT TT=30.019 CHECKS=106011000 NODES=77061	SAT TT=105.573 CHECKS=873610000 NODES=2800650	? (TO) TT=1800.1	SAT TT=22.069 ASSIGNMENTS=49062 CHECKS=7196390	SAT TT=22.075 ASSIGNMENTS=49062 CHECKS=7196390	? (TO) TT=1800.07	SAT TT=1582.62	SAT TT=1.83 CHECKS=316131	SAT TT=14.241 ASSIGNMENTS=48723 CHECKS=7143290	SAT TT=25.482 ASSIGNMENTS=86414 CHECKS=13464600	SAT TT=131.388	SAT TT=14.699 ASSIGNMENTS=50830 CHECKS=7188610	SAT TT=14.604 ASSIGNMENTS=49062 CHECKS=7196390	SAT TT=851.241	SAT TT=68.13 ASSIGNMENTS=26506 CHECKS=23103900	SAT TT=47.32	SAT TT=123.466
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-10_ext.xml	SAT TT=1175.69	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT TT=1663 CHECKS=5779840000 NODES=3811780	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=1392.03 ASSIGNMENTS=3594500 CHECKS=595561000	SAT TT=1437.01 ASSIGNMENTS=3594500 CHECKS=595561000	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=1258.89 CHECKS=198157000	SAT TT=1200.24 ASSIGNMENTS=3551390 CHECKS=589466000	SAT TT=1060.79 ASSIGNMENTS=3308160 CHECKS=555674000	? (TO) TT=1800.08	SAT TT=1175.69 ASSIGNMENTS=3658490 CHECKS=609397000	SAT TT=1216.69 ASSIGNMENTS=3594500 CHECKS=595561000	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-11_ext.xml	SAT TT=49.784	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=459.482 CHECKS=1579280000 NODES=861058	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=174.862 ASSIGNMENTS=342393 CHECKS=55194200	SAT TT=363.208 ASSIGNMENTS=342393 CHECKS=55194200	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=49.784 CHECKS=6376950	SAT TT=84.156 ASSIGNMENTS=244398 CHECKS=39832700	SAT TT=459.896 ASSIGNMENTS=1239750 CHECKS=198103000	? (TO) TT=1800.04	SAT TT=434.274 ASSIGNMENTS=1081330 CHECKS=184858000	SAT TT=126.25 ASSIGNMENTS=342393 CHECKS=55194200	? (TO) TT=1800.17	SAT TT=336.38 ASSIGNMENTS=104569 CHECKS=124461000	? (TO) TT=1800	? (TO) TT=1800.08
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-13_ext.xml	SAT TT=438.384	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.14	SAT TT=790.624 CHECKS=2744030000 NODES=1993470	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=555.579 ASSIGNMENTS=1607010 CHECKS=251029000	SAT TT=588.333 ASSIGNMENTS=1607010 CHECKS=251029000	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=994.102 CHECKS=129947000	SAT TT=530.893 ASSIGNMENTS=1628140 CHECKS=251808000	SAT TT=521.688 ASSIGNMENTS=1737890 CHECKS=263692000	? (TO) TT=1800.03	SAT TT=438.384 ASSIGNMENTS=1277280 CHECKS=206297000	SAT TT=535.56 ASSIGNMENTS=1607010 CHECKS=251029000	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-1_ext.xml	SAT TT=315.984	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.17	SAT TT=1334.14 CHECKS=4597960000 NODES=3070580	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=379.195 ASSIGNMENTS=1118160 CHECKS=195820000	SAT TT=422.148 ASSIGNMENTS=1118160 CHECKS=195820000	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=315.984 ASSIGNMENTS=1008780 CHECKS=179527000	SAT TT=347.359 ASSIGNMENTS=1038290 CHECKS=183563000	? (TO) TT=1800.07	SAT TT=337.36 ASSIGNMENTS=1013180 CHECKS=180278000	SAT TT=372.976 ASSIGNMENTS=1118160 CHECKS=195820000	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.12
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-20_ext.xml	SAT TT=104.09	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=1240.26 ASSIGNMENTS=69864	? (TO) TT=1800.13	SAT TT=255.613 CHECKS=853529000 NODES=478705	SAT TT=1512.46 CHECKS=14457000000 NODES=34063100	? (TO) TT=1800.08	SAT TT=187.547 ASSIGNMENTS=373262 CHECKS=63173500	SAT TT=178.339 ASSIGNMENTS=373262 CHECKS=63173500	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=104.09 CHECKS=17040900	SAT TT=150.946 ASSIGNMENTS=401635 CHECKS=66231000	SAT TT=162.26 ASSIGNMENTS=429689 CHECKS=70467800	SAT TT=1432.45	SAT TT=161.034 ASSIGNMENTS=429838 CHECKS=70602800	SAT TT=130.92 ASSIGNMENTS=373262 CHECKS=63173500	? (TO) TT=1800.17	SAT TT=800.219 ASSIGNMENTS=314840 CHECKS=360018000	? (TO) TT=1800	? (TO) TT=1800.07
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-21_ext.xml	SAT TT=43.043	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=639.023 ASSIGNMENTS=33084	SAT TT=881.896 ASSIGNMENTS=31176	SAT TT=304.446 CHECKS=1147240000 NODES=614931	SAT TT=255.211 CHECKS=2215460000 NODES=5537430	? (TO) TT=1800.08	SAT TT=85.124 ASSIGNMENTS=178497 CHECKS=26841900	SAT TT=144.151 ASSIGNMENTS=178497 CHECKS=26841900	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=43.043 CHECKS=6061610	SAT TT=62.03 ASSIGNMENTS=185535 CHECKS=27644400	SAT TT=210.066 ASSIGNMENTS=559854 CHECKS=88333400	SAT TT=667.448	SAT TT=193.689 ASSIGNMENTS=540033 CHECKS=83963200	SAT TT=58.99 ASSIGNMENTS=178497 CHECKS=26841900	SAT TT=295.224	SAT TT=621.029 ASSIGNMENTS=159811 CHECKS=194078000	? (TO) TT=1800.03	SAT TT=895.104
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-23_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.19	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-28_ext.xml	SAT TT=5.386	SAT TT=30.577 CHECKS=48404 NODES=8486	SAT TT=41.704 CHECKS=67071 NODES=10147	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=878.487 CHECKS=5282720	SAT TT=86.146 ASSIGNMENTS=5521	SAT TT=592.377 ASSIGNMENTS=29010	SAT TT=31.32 CHECKS=109525000 NODES=63890	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=39.996 ASSIGNMENTS=8486 CHECKS=48404	SAT TT=37.597 ASSIGNMENTS=8486 CHECKS=48404	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=37.281 CHECKS=4635370	SAT TT=5.696 ASSIGNMENTS=15048 CHECKS=2297700	SAT TT=27.917 ASSIGNMENTS=82956 CHECKS=11893200	SAT TT=57.089	SAT TT=13.708 ASSIGNMENTS=38096 CHECKS=5773710	SAT TT=5.386 ASSIGNMENTS=14563 CHECKS=2207210	SAT TT=221.7	SAT TT=1527.46 ASSIGNMENTS=553897 CHECKS=737512000	SAT TT=1274.65	? (TO) TT=1800.12
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-30_ext.xml	SAT TT=520.741	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=1340.13 ASSIGNMENTS=3618260 CHECKS=606083000	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=520.741 CHECKS=76471700	SAT TT=1194.61 ASSIGNMENTS=3378650 CHECKS=577106000	SAT TT=1164.94 ASSIGNMENTS=3420700 CHECKS=582879000	? (TO) TT=1800.03	SAT TT=1226.86 ASSIGNMENTS=3407870 CHECKS=583347000	SAT TT=1182.6 ASSIGNMENTS=3618260 CHECKS=606083000	? (TO) TT=1800.18	SAT TT=610.951 ASSIGNMENTS=261864 CHECKS=264345000	? (TO) TT=1800.01	? (TO) TT=1800.05
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-31_ext.xml	SAT TT=41.487	? (TO) TT=1800.08	? (TO) TT=1800.15	SAT TT=1764.24	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=80.016 ASSIGNMENTS=5712	? (TO) TT=1800.06	SAT TT=618.56 CHECKS=2313590000 NODES=1335260	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=66.511 ASSIGNMENTS=120660 CHECKS=20011500	SAT TT=124.138 ASSIGNMENTS=120660 CHECKS=20011500	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=72.069 CHECKS=11269500	SAT TT=41.487 ASSIGNMENTS=113087 CHECKS=18671800	SAT TT=259.71 ASSIGNMENTS=742152 CHECKS=117390000	SAT TT=297.565	SAT TT=249.123 ASSIGNMENTS=749100 CHECKS=119042000	SAT TT=43.551 ASSIGNMENTS=120660 CHECKS=20011500	SAT TT=1011.34	SAT TT=379.814 ASSIGNMENTS=193316 CHECKS=186480000	? (TO) TT=1800.02	? (TO) TT=1800.11
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-32_ext.xml	SAT TT=28.434	SAT TT=753.537 CHECKS=4163700 NODES=353411	SAT TT=877.236 CHECKS=4524170 NODES=368064	? (TO) TT=1800.12	SAT TT=239.951 CHECKS=1180250	? (TO) TT=1800.03	SAT TT=441.255 ASSIGNMENTS=31533	? (TO) TT=1800.18	SAT TT=188.59 CHECKS=621256000 NODES=407417	? (TO) TT=1800	? (TO) TT=1800	SAT TT=36.03 ASSIGNMENTS=87234 CHECKS=15754200	SAT TT=72.442 ASSIGNMENTS=87234 CHECKS=15754200	? (TO) TT=1800.01	? (TO) TT=1800	SAT TT=400.078 CHECKS=67135700	SAT TT=30.796 ASSIGNMENTS=87874 CHECKS=15500800	SAT TT=23.167 ASSIGNMENTS=68005 CHECKS=11943000	SAT TT=613.591	SAT TT=937.348 ASSIGNMENTS=2880300 CHECKS=510628000	SAT TT=28.434 ASSIGNMENTS=87234 CHECKS=15754200	? (TO) TT=1800.15	SAT TT=450.024 ASSIGNMENTS=108999 CHECKS=106957000	? (TO) TT=1800.1	? (TO) TT=1800.15
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-34_ext.xml	SAT TT=195.03	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=1780.51 ASSIGNMENTS=130071	? (TO) TT=1800.13	SAT TT=762.384 CHECKS=2720890000 NODES=1689170	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=486.768 ASSIGNMENTS=1380260 CHECKS=228372000	SAT TT=548.507 ASSIGNMENTS=1380260 CHECKS=228372000	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=725.684 CHECKS=98500400	SAT TT=195.03 ASSIGNMENTS=493929 CHECKS=85066300	SAT TT=304.859 ASSIGNMENTS=838806 CHECKS=144092000	? (TO) TT=1800.06	SAT TT=229.444 ASSIGNMENTS=628886 CHECKS=103720000	SAT TT=467.405 ASSIGNMENTS=1380260 CHECKS=228372000	SAT TT=933.528	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-35_ext.xml	SAT TT=3.588	SAT TT=38.759 CHECKS=63974 NODES=12597	SAT TT=37.939 CHECKS=60518 NODES=12009	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.13	SAT TT=271.405 CHECKS=957750000 NODES=493397	SAT TT=688.812 CHECKS=6385440000 NODES=15610900	? (TO) TT=1800.01	SAT TT=45.411 ASSIGNMENTS=12597 CHECKS=63974	SAT TT=47.16 ASSIGNMENTS=12597 CHECKS=63974	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=85.445 CHECKS=11709600	SAT TT=28.86 ASSIGNMENTS=75890 CHECKS=12291700	SAT TT=26.182 ASSIGNMENTS=71481 CHECKS=11721800	SAT TT=357.767	SAT TT=3.588 ASSIGNMENTS=9954 CHECKS=1497860	SAT TT=26.218 ASSIGNMENTS=75687 CHECKS=12214700	SAT TT=115.57	SAT TT=83.37 ASSIGNMENTS=26532 CHECKS=29364800	? (TO) TT=1800.07	? (TO) TT=1800.07
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-39_ext.xml	SAT TT=877.917	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=1353.97 ASSIGNMENTS=3116320 CHECKS=515620000	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=877.917 ASSIGNMENTS=2681600 CHECKS=448175000	SAT TT=312.346 ASSIGNMENTS=993825 CHECKS=159059000	? (TO) TT=1800.1	SAT TT=1113.92 ASSIGNMENTS=3208300 CHECKS=530132000	SAT TT=1036.67 ASSIGNMENTS=3116320 CHECKS=515620000	? (TO) TT=1800.19	SAT TT=697.934 ASSIGNMENTS=331448 CHECKS=327548000	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-3_ext.xml	SAT TT=333.966	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.09	SAT TT=651.981 CHECKS=2104920000 NODES=1412540	SAT TT=691.466 CHECKS=6515270000 NODES=16190400	? (TO) TT=1800.08	SAT TT=695.224 ASSIGNMENTS=1862400 CHECKS=291695000	SAT TT=753.7 ASSIGNMENTS=1862400 CHECKS=291695000	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=457.031 CHECKS=64749100	SAT TT=688.729 ASSIGNMENTS=1935400 CHECKS=304166000	SAT TT=697.053 ASSIGNMENTS=1940180 CHECKS=303002000	? (TO) TT=1800.05	SAT TT=670.374 ASSIGNMENTS=1890630 CHECKS=296777000	SAT TT=611.297 ASSIGNMENTS=1862400 CHECKS=291695000	SAT TT=333.966	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.14
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-40_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-42_ext.xml	SAT TT=94.539	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=976.551 ASSIGNMENTS=65257	? (TO) TT=1800.09	SAT TT=164.08 CHECKS=549363000 NODES=301050	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=336.601 ASSIGNMENTS=644331 CHECKS=113958000	SAT TT=338.839 ASSIGNMENTS=644331 CHECKS=113958000	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=94.539 CHECKS=13923000	SAT TT=261.868 ASSIGNMENTS=650221 CHECKS=115021000	SAT TT=260.436 ASSIGNMENTS=651434 CHECKS=114754000	? (TO) TT=1800.04	SAT TT=258.795 ASSIGNMENTS=646850 CHECKS=114359000	SAT TT=255.456 ASSIGNMENTS=644331 CHECKS=113958000	SAT TT=510.255	SAT TT=1198.72 ASSIGNMENTS=434179 CHECKS=454732000	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-43_ext.xml	SAT TT=533.821	SAT TT=1016.46 CHECKS=3170160 NODES=321504	SAT TT=1013.21 CHECKS=3237580 NODES=331577	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=1017.02 ASSIGNMENTS=3116420 CHECKS=493669000	SAT TT=1067.02 ASSIGNMENTS=3116420 CHECKS=493669000	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=533.821 CHECKS=73773000	SAT TT=992.684 ASSIGNMENTS=2958140 CHECKS=469462000	SAT TT=40.362 ASSIGNMENTS=122834 CHECKS=19446100	SAT TT=1221.71	SAT TT=1092.96 ASSIGNMENTS=3326820 CHECKS=523937000	SAT TT=996.186 ASSIGNMENTS=3116420 CHECKS=493669000	SAT TT=1519.74	SAT TT=311.455 ASSIGNMENTS=115732 CHECKS=107620000	? (TO) TT=1800.09	? (TO) TT=1800.14
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-45_ext.xml	SAT TT=85.557	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=750.965	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=1491.19 ASSIGNMENTS=83761	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=123.765 ASSIGNMENTS=240069 CHECKS=42010600	SAT TT=125.293 ASSIGNMENTS=240069 CHECKS=42010600	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=194.473 CHECKS=24216200	SAT TT=86.11 ASSIGNMENTS=234164 CHECKS=40939900	SAT TT=89.883 ASSIGNMENTS=247287 CHECKS=43028900	SAT TT=900.844	SAT TT=274.461 ASSIGNMENTS=742410 CHECKS=130222000	SAT TT=85.557 ASSIGNMENTS=240069 CHECKS=42010600	? (TO) TT=1800.21	SAT TT=178.466 ASSIGNMENTS=61759 CHECKS=73087500	? (TO) TT=1800.06	? (TO) TT=1800.11
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-47_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-50_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.14
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-5_ext.xml	SAT TT=177.164	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.13	SAT TT=212.602 CHECKS=774504000 NODES=467066	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=207.029 ASSIGNMENTS=505351 CHECKS=85203100	SAT TT=223.513 ASSIGNMENTS=505351 CHECKS=85203100	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=219.722 CHECKS=31374900	SAT TT=292.553 ASSIGNMENTS=867409 CHECKS=146853000	SAT TT=319.046 ASSIGNMENTS=866525 CHECKS=147383000	? (TO) TT=1800.05	SAT TT=200.336 ASSIGNMENTS=554002 CHECKS=94919600	SAT TT=177.164 ASSIGNMENTS=505351 CHECKS=85203100	? (TO) TT=1800.19	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-7_ext.xml	SAT TT=24.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.16	SAT TT=509.956 CHECKS=1895100000 NODES=1035350	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=105.515 ASSIGNMENTS=249609 CHECKS=42580200	SAT TT=140.667 ASSIGNMENTS=249609 CHECKS=42580200	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=293.849 CHECKS=43375600	SAT TT=92.739 ASSIGNMENTS=252230 CHECKS=42969700	SAT TT=28.449 ASSIGNMENTS=75386 CHECKS=12609200	? (TO) TT=1800.02	SAT TT=24.05 ASSIGNMENTS=65297 CHECKS=11074200	SAT TT=96.377 ASSIGNMENTS=249609 CHECKS=42580200	? (TO) TT=1800.14	SAT TT=1367.67 ASSIGNMENTS=422765 CHECKS=502169000	? (TO) TT=1800.04	? (TO) TT=1800.1
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-8_ext.xml	SAT TT=116.382	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=716.398 ASSIGNMENTS=43074	? (TO) TT=1800.07	SAT TT=211.953 CHECKS=723271000 NODES=470591	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=143.309 ASSIGNMENTS=387874 CHECKS=63962400	SAT TT=178.96 ASSIGNMENTS=387874 CHECKS=63962400	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=498.845 CHECKS=76018700	SAT TT=144.763 ASSIGNMENTS=405251 CHECKS=69066400	SAT TT=114.012 ASSIGNMENTS=329939 CHECKS=54726400	SAT TT=364.737	SAT TT=116.382 ASSIGNMENTS=320758 CHECKS=55187000	SAT TT=133.624 ASSIGNMENTS=387874 CHECKS=63962400	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.1
csp/rand-3-24-24-fcd/ normalized-rand-3-24-24-76-632-fcd-9_ext.xml	SAT TT=63.86	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.11	SAT TT=401.95 CHECKS=1425760000 NODES=910089	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=66.191 ASSIGNMENTS=195241 CHECKS=31680000	SAT TT=336.823 ASSIGNMENTS=195241 CHECKS=31680000	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=242.707 CHECKS=42648300	SAT TT=180.333 ASSIGNMENTS=574365 CHECKS=87947600	SAT TT=182.952 ASSIGNMENTS=581346 CHECKS=88805100	SAT TT=647.586	SAT TT=195.215 ASSIGNMENTS=601097 CHECKS=93827000	SAT TT=63.86 ASSIGNMENTS=195241 CHECKS=31680000	? (TO) TT=1800.18	SAT TT=530.011 ASSIGNMENTS=143816 CHECKS=175217000	? (TO) TT=1800.05	SAT TT=104.732
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-10_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-14_ext.xml	UNSAT TT=1189.87	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.12	UNSAT TT=1765.64 CHECKS=6136160000 NODES=3646260	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=1525.82 ASSIGNMENTS=3915160 CHECKS=656935000	UNSAT TT=1406.64 ASSIGNMENTS=3915160 CHECKS=656935000	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=1189.87 ASSIGNMENTS=3049140 CHECKS=516583000	UNSAT TT=1125.2 ASSIGNMENTS=3184090 CHECKS=526693000	? (TO) TT=1800.02	UNSAT TT=1486.2 ASSIGNMENTS=4180400 CHECKS=695794000	UNSAT TT=1381.81 ASSIGNMENTS=3915160 CHECKS=656935000	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.05
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-15_ext.xml	SAT TT=289.926	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.12	SAT TT=788.218 CHECKS=2546840000 NODES=1635000	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=380.516 ASSIGNMENTS=1151690 CHECKS=190838000	SAT TT=415.522 ASSIGNMENTS=1151690 CHECKS=190838000	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=413.906 CHECKS=62954300	SAT TT=938.068 ASSIGNMENTS=2995670 CHECKS=504376000	SAT TT=389.745 ASSIGNMENTS=1185320 CHECKS=197072000	? (TO) TT=1800.07	SAT TT=289.926 ASSIGNMENTS=899664 CHECKS=150957000	SAT TT=365.27 ASSIGNMENTS=1151690 CHECKS=190838000	? (TO) TT=1800.2	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-16_ext.xml	SAT TT=66.915	SAT TT=972.124 CHECKS=2902020 NODES=236999	SAT TT=1067.22 CHECKS=2887300 NODES=236735	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=1082.52 ASSIGNMENTS=73395	? (TO) TT=1800.09	SAT TT=133.604 CHECKS=487121000 NODES=270124	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=174.029 ASSIGNMENTS=187751 CHECKS=30917200	SAT TT=156.77 ASSIGNMENTS=187751 CHECKS=30917200	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=173.001 CHECKS=20553600	SAT TT=66.915 ASSIGNMENTS=176358 CHECKS=29362400	SAT TT=89.452 ASSIGNMENTS=225328 CHECKS=35702800	SAT TT=471.946	SAT TT=203.786 ASSIGNMENTS=504525 CHECKS=81862900	SAT TT=75.633 ASSIGNMENTS=187751 CHECKS=30917200	? (TO) TT=1800.19	SAT TT=810.717 ASSIGNMENTS=273813 CHECKS=337352000	? (TO) TT=1800.07	SAT TT=189.566
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-17_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-18_ext.xml	SAT TT=14.714	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.14	SAT TT=424.938 ASSIGNMENTS=18895	SAT TT=399.236 CHECKS=1489680000 NODES=848448	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=58.412 ASSIGNMENTS=94297 CHECKS=14487400	SAT TT=76.097 ASSIGNMENTS=94297 CHECKS=14487400	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=184.299 CHECKS=28440000	SAT TT=127.146 ASSIGNMENTS=408926 CHECKS=61332100	SAT TT=31.551 ASSIGNMENTS=96046 CHECKS=14440600	SAT TT=1447.27	SAT TT=14.714 ASSIGNMENTS=48479 CHECKS=7507920	SAT TT=31.357 ASSIGNMENTS=94297 CHECKS=14487400	? (TO) TT=1800.14	SAT TT=78.22 ASSIGNMENTS=32743 CHECKS=31455200	? (TO) TT=1800.03	? (TO) TT=1800.09
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-19_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.15
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-1_ext.xml	SAT TT=332.942	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	SAT TT=1330.41 CHECKS=4598550000 NODES=3128980	SAT TT=332.942 CHECKS=2985180000 NODES=7072490	? (TO) TT=1800.09	SAT TT=1100.08 ASSIGNMENTS=2092760 CHECKS=344888000	SAT TT=662.567 ASSIGNMENTS=2092760 CHECKS=344888000	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=525.14 ASSIGNMENTS=1727640 CHECKS=297323000	SAT TT=688.96 ASSIGNMENTS=2306620 CHECKS=386398000	? (TO) TT=1800.06	SAT TT=649.594 ASSIGNMENTS=2194430 CHECKS=367924000	SAT TT=615.048 ASSIGNMENTS=2092760 CHECKS=344888000	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.15
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-22_ext.xml	UNSAT TT=187.488	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=369.447 CHECKS=1381200000 NODES=733306	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=216.8 ASSIGNMENTS=530504 CHECKS=84727100	UNSAT TT=251.973 ASSIGNMENTS=530504 CHECKS=84727100	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=297.299 CHECKS=40688100	UNSAT TT=195.117 ASSIGNMENTS=529432 CHECKS=85026100	UNSAT TT=206.876 ASSIGNMENTS=532257 CHECKS=85159800	? (TO) TT=1800.05	UNSAT TT=194.776 ASSIGNMENTS=529864 CHECKS=85010000	UNSAT TT=187.488 ASSIGNMENTS=530504 CHECKS=84727100	? (TO) TT=1800.18	UNSAT TT=1653.39 ASSIGNMENTS=726126 CHECKS=799419000	? (TO) TT=1800.09	? (TO) TT=1800.14
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-32_ext.xml	UNSAT TT=1261.2	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.12	UNSAT TT=1759.56 CHECKS=5843610000 NODES=4007370	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=1368.95 ASSIGNMENTS=4144990 CHECKS=733601000	UNSAT TT=1376.95 ASSIGNMENTS=4144990 CHECKS=733601000	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=1240.94 ASSIGNMENTS=3789800 CHECKS=670223000	? (TO) TT=1800.02	UNSAT TT=1261.2 ASSIGNMENTS=3830900 CHECKS=674816000	UNSAT TT=1356.29 ASSIGNMENTS=4144990 CHECKS=733601000	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-35_ext.xml	SAT TT=256.786	? (TO) TT=1800.15	? (TO) TT=1800.14	SAT TT=449.17	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=779.044 ASSIGNMENTS=47434	? (TO) TT=1800.12	SAT TT=315.929 CHECKS=1113100000 NODES=583763	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=526.616 ASSIGNMENTS=1183130 CHECKS=195661000	SAT TT=528.667 ASSIGNMENTS=1183130 CHECKS=195661000	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=256.786 CHECKS=37686700	SAT TT=434.302 ASSIGNMENTS=1185350 CHECKS=196537000	SAT TT=435.145 ASSIGNMENTS=1168950 CHECKS=196607000	? (TO) TT=1800.05	SAT TT=452.858 ASSIGNMENTS=1198910 CHECKS=204562000	SAT TT=427.237 ASSIGNMENTS=1183130 CHECKS=195661000	? (TO) TT=1800.19	? (TO) TT=1800.1	SAT TT=289.492	? (TO) TT=1800.06
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-36_ext.xml	UNSAT TT=1121.56	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.04	UNSAT TT=1691.62 ASSIGNMENTS=4159170 CHECKS=787159000	UNSAT TT=1634.31 ASSIGNMENTS=4159170 CHECKS=787159000	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=1461.17 ASSIGNMENTS=3792260 CHECKS=714179000	UNSAT TT=1592.97 ASSIGNMENTS=4247310 CHECKS=797716000	? (TO) TT=1800.08	UNSAT TT=1121.56 ASSIGNMENTS=3201970 CHECKS=576994000	UNSAT TT=1597.75 ASSIGNMENTS=4159170 CHECKS=787159000	? (TO) TT=1800.19	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.09
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-37_ext.xml	UNSAT TT=1782.01	? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=1782.01 ASSIGNMENTS=5480910 CHECKS=891859000	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.09
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-38_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.12
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-39_ext.xml		? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-42_ext.xml	UNSAT TT=315.777	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.15	UNSAT TT=528.133 CHECKS=1954180000 NODES=1059700	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=347.313 ASSIGNMENTS=847601 CHECKS=149271000	UNSAT TT=376.032 ASSIGNMENTS=847601 CHECKS=149271000	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=424.838 CHECKS=67321200	UNSAT TT=318.094 ASSIGNMENTS=850407 CHECKS=150091000	UNSAT TT=340.508 ASSIGNMENTS=848415 CHECKS=149978000	? (TO) TT=1800.09	UNSAT TT=315.777 ASSIGNMENTS=852188 CHECKS=150195000	UNSAT TT=330.71 ASSIGNMENTS=847601 CHECKS=149271000	? (TO) TT=1800.18	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-43_ext.xml	UNSAT TT=1403.18	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=1767.77 ASSIGNMENTS=4377020 CHECKS=694205000	UNSAT TT=1760.92 ASSIGNMENTS=4377020 CHECKS=694205000	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=1583.26 ASSIGNMENTS=4585220 CHECKS=724624000	UNSAT TT=1523.95 ASSIGNMENTS=4556530 CHECKS=722177000	? (TO) TT=1800	UNSAT TT=1496.99 ASSIGNMENTS=4593320 CHECKS=724089000	UNSAT TT=1403.18 ASSIGNMENTS=4377020 CHECKS=694205000	? (TO) TT=1800.21	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.11
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-45_ext.xml		? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-47_ext.xml	SAT TT=52.958	SAT TT=52.958 CHECKS=147886 NODES=24765	SAT TT=529.503 CHECKS=2368040 NODES=256801	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.14
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-4_ext.xml	UNSAT TT=147.772	? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.13	UNSAT TT=299.819 CHECKS=991049000 NODES=544085	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=206.123 ASSIGNMENTS=406014 CHECKS=72071500	UNSAT TT=209.829 ASSIGNMENTS=406014 CHECKS=72071500	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=254.99 CHECKS=31567800	UNSAT TT=160.03 ASSIGNMENTS=395435 CHECKS=69895200	UNSAT TT=155.521 ASSIGNMENTS=412359 CHECKS=71974700	UNSAT TT=1177.36	UNSAT TT=147.772 ASSIGNMENTS=361794 CHECKS=67325200	UNSAT TT=152.936 ASSIGNMENTS=406014 CHECKS=72071500	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.15
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-50_ext.xml	SAT TT=1089.38	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=1625.55 ASSIGNMENTS=4903370 CHECKS=869579000	SAT TT=1654.44 ASSIGNMENTS=4903370 CHECKS=869579000	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1089.38 ASSIGNMENTS=3285180 CHECKS=577832000	SAT TT=1104.62 ASSIGNMENTS=3385860 CHECKS=596940000	? (TO) TT=1800.01	SAT TT=1540.77 ASSIGNMENTS=4785960 CHECKS=844026000	SAT TT=1630.13 ASSIGNMENTS=4903370 CHECKS=869579000	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-6_ext.xml	SAT TT=828.509	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800	SAT TT=1117.58 ASSIGNMENTS=3766050 CHECKS=566313000	SAT TT=1379 ASSIGNMENTS=3766050 CHECKS=566313000	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=1612.42 CHECKS=233360000	SAT TT=828.509 ASSIGNMENTS=2731230 CHECKS=415852000	SAT TT=1126.11 ASSIGNMENTS=3752140 CHECKS=569880000	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=1106.22 ASSIGNMENTS=3766050 CHECKS=566313000	? (TO) TT=1800.22	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-7_ext.xml	SAT TT=100.636	? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT TT=367.809 CHECKS=1375380000 NODES=745600	SAT TT=878.014 CHECKS=8213690000 NODES=20393600	? (TO) TT=1800.01	SAT TT=369.099 ASSIGNMENTS=885299 CHECKS=147139000	SAT TT=372.209 ASSIGNMENTS=885299 CHECKS=147139000	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=100.636 CHECKS=16745600	SAT TT=378.166 ASSIGNMENTS=1037930 CHECKS=175382000	SAT TT=341.346 ASSIGNMENTS=907454 CHECKS=151378000	? (TO) TT=1800.03	SAT TT=131.922 ASSIGNMENTS=377309 CHECKS=64405800	SAT TT=304.083 ASSIGNMENTS=885299 CHECKS=147139000	SAT TT=1764.21	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.14
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-8_ext.xml	UNSAT TT=942.283	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.11	UNSAT TT=1374.35 CHECKS=4481680000 NODES=2870580	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=1050.26 ASSIGNMENTS=2911150 CHECKS=497891000	UNSAT TT=1087.82 ASSIGNMENTS=2911150 CHECKS=497891000	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=1349.61 CHECKS=201136000	UNSAT TT=942.283 ASSIGNMENTS=2656040 CHECKS=453383000	UNSAT TT=878.716 ASSIGNMENTS=2694510 CHECKS=458665000	? (TO) TT=1800	UNSAT TT=1010.75 ASSIGNMENTS=2871650 CHECKS=490675000	UNSAT TT=1021.54 ASSIGNMENTS=2911150 CHECKS=497891000	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08
csp/rand-3-24-24/ normalized-rand-3-24-24-76-632-9_ext.xml	UNSAT TT=877.378	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=1530.55 CHECKS=5116150000 NODES=3293440	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=877.378 ASSIGNMENTS=2843290 CHECKS=428631000	UNSAT TT=1123.14 ASSIGNMENTS=2843290 CHECKS=428631000	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=1358.89 CHECKS=222572000	UNSAT TT=990.703 ASSIGNMENTS=3017250 CHECKS=491382000	UNSAT TT=856.491 ASSIGNMENTS=2829260 CHECKS=434348000	? (TO) TT=1800.01	UNSAT TT=902.623 ASSIGNMENTS=2766420 CHECKS=420676000	UNSAT TT=901.235 ASSIGNMENTS=2843290 CHECKS=428631000	? (TO) TT=1800.2	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.13
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-10_ext.xml	SAT TT=1604.78	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=1604.78 CHECKS=158321000	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.22	? (TO) TT=1800.11	? (MO) TT=8.38	? (MO) TT=8.38
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-13_ext.xml	SAT TT=1037.51	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=1037.51 CHECKS=115463000	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.05	? (MO) TT=8.44	? (MO) TT=8.432
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-14_ext.xml	SAT TT=235.303	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=235.303 CHECKS=26220500	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.08	? (MO) TT=8.457	? (MO) TT=8.447
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-16_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.16	? (TO) TT=1800.04	? (MO) TT=7.434	? (MO) TT=7.89
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-1_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.11	? (MO) TT=8.07	? (MO) TT=8.24
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-20_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.09	? (MO) TT=8.289	? (MO) TT=7.432
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-21_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.03	? (MO) TT=7.96	? (MO) TT=8.22
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-22_ext.xml	SAT TT=54.867	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=963.567 ASSIGNMENTS=39216	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=977.917 ASSIGNMENTS=124179 CHECKS=22991600	SAT TT=550.681 ASSIGNMENTS=124179 CHECKS=22991600	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=57.027 ASSIGNMENTS=124404 CHECKS=22921900	SAT TT=56.335 ASSIGNMENTS=127682 CHECKS=23355900	SAT TT=201.613	SAT TT=55.388 ASSIGNMENTS=124881 CHECKS=22962600	SAT TT=54.867 ASSIGNMENTS=124179 CHECKS=22991600	? (TO) TT=1800.17	? (TO) TT=1800.1	? (MO) TT=8.54	? (MO) TT=8.23
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-23_ext.xml	SAT TT=57.859	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.07	SAT TT=601.857 CHECKS=1878940000 NODES=1201950	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=67.571 ASSIGNMENTS=150099 CHECKS=29024200	SAT TT=99.54 ASSIGNMENTS=150099 CHECKS=29024200	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=60.118 ASSIGNMENTS=153202 CHECKS=29644700	SAT TT=844.183 ASSIGNMENTS=2263920 CHECKS=426756000	SAT TT=1094.27	SAT TT=993.49 ASSIGNMENTS=2924690 CHECKS=543912000	SAT TT=57.859 ASSIGNMENTS=150099 CHECKS=29024200	? (TO) TT=1800.18	? (TO) TT=1800.09	? (MO) TT=8.22	? (MO) TT=8.42
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-24_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.22	? (TO) TT=1800.03	? (MO) TT=8.36	? (MO) TT=8.41
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-25_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.04	? (MO) TT=8.45	? (MO) TT=8.43
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-27_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.03	? (MO) TT=8.16	? (MO) TT=8.31
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-28_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.04	? (MO) TT=8.438	? (MO) TT=8.44
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-30_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.09	? (MO) TT=8.17	? (MO) TT=8.35
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-31_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.1	? (MO) TT=7.99	? (MO) TT=8.31
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-32_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.19	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.17	? (TO) TT=1800.1	? (MO) TT=8.42	? (MO) TT=8.25
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-34_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.07	? (MO) TT=7.429	? (MO) TT=8.33
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-35_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.33	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.11	? (MO) TT=7.419	? (MO) TT=8.33
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-37_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.1	? (MO) TT=8.05	? (MO) TT=7.405
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-38_ext.xml		? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.02	? (MO) TT=8.26	? (MO) TT=8.06
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-3_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.03	? (MO) TT=8.451	? (MO) TT=8.41
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-40_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.23	? (TO) TT=1800.03	? (MO) TT=8.497	? (MO) TT=8.472
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-42_ext.xml		? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.01	? (MO) TT=8.23	? (MO) TT=8.468
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-43_ext.xml	SAT TT=318.281	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1639.41 CHECKS=5601330000 NODES=2578980	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=963.11 ASSIGNMENTS=1936310 CHECKS=359969000	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=318.281 CHECKS=32849000	SAT TT=863.978 ASSIGNMENTS=1801230 CHECKS=337345000	SAT TT=788.75 ASSIGNMENTS=1838630 CHECKS=330111000	? (TO) TT=1800.09	SAT TT=770.022 ASSIGNMENTS=1775630 CHECKS=321548000	SAT TT=890.767 ASSIGNMENTS=1936310 CHECKS=359969000	? (TO) TT=1800.23	? (TO) TT=1800.09	? (MO) TT=8.43	? (MO) TT=7.439
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-44_ext.xml		? (TO) TT=1800.11	? (MO) TT=2.327	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.18	? (TO) TT=1800.03	? (MO) TT=8.12	? (MO) TT=8.15
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-46_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.21	? (TO) TT=1800.03	? (MO) TT=8.316	? (MO) TT=8.43
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-48_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.02	? (MO) TT=7.605	? (MO) TT=7.572
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-50_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.2	? (TO) TT=1800.1	? (MO) TT=8.33	? (MO) TT=8.03
csp/rand-3-28-28-fcd/ normalized-rand-3-28-28-93-632-fcd-7_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.09	? (MO) TT=8.576	? (MO) TT=8.41
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-10_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.07	? (MO) TT=8.21	? (MO) TT=8.45
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-14_ext.xml	SAT TT=925.489	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800	SAT TT=1194.54 CHECKS=135863000	SAT TT=925.489 ASSIGNMENTS=2449140 CHECKS=443719000	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=929.382 ASSIGNMENTS=2354090 CHECKS=427465000	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.09	? (MO) TT=8.472	? (MO) TT=8.35
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-16_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.1	? (MO) TT=8.406	? (MO) TT=7.88
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-17_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.19	? (TO) TT=1800.08	? (MO) TT=7.153	? (MO) TT=8.453
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-18_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.07	? (MO) TT=8.45	? (MO) TT=8.434
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-1_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.11	? (MO) TT=8.3	? (MO) TT=8.18
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-20_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.05	? (MO) TT=8.36	? (MO) TT=8.444
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-23_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.02	? (MO) TT=7.414	? (MO) TT=8.32
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-24_ext.xml		? (TO) TT=1800.18	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.09	? (MO) TT=8.44	? (MO) TT=8.41
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-25_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.03	? (MO) TT=7.397	? (MO) TT=8.02
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-27_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.03	? (MO) TT=8.33	? (MO) TT=8.11
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-29_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.09	? (MO) TT=8.31	? (MO) TT=8.33
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-30_ext.xml		? (TO) TT=1800.16	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.04	? (MO) TT=8.28	? (MO) TT=8.465
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-31_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.21	? (TO) TT=1800.03	? (MO) TT=8.34	? (MO) TT=8.04
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-32_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (MO) TT=8.25	? (MO) TT=7.506
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-35_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.18	? (TO) TT=1800.02	? (MO) TT=7.432	? (MO) TT=7.407
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-36_ext.xml		? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.2	? (TO) TT=1800.02	? (MO) TT=8.43	? (MO) TT=8.22
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-37_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.03	? (MO) TT=8.33	? (MO) TT=8.43
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-38_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.15	? (TO) TT=1800.09	? (MO) TT=7.433	? (MO) TT=7.13
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-39_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.06	? (MO) TT=8.06	? (MO) TT=8.429
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-3_ext.xml		? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (MO) TT=8.22	? (MO) TT=8.75
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-40_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (MO) TT=8.43	? (MO) TT=8.472
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-41_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.07	? (MO) TT=8.45	? (MO) TT=8.467
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-42_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.06	? (MO) TT=8.39	? (MO) TT=8.31
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-44_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.21	? (TO) TT=1800.05	? (MO) TT=8.31	? (MO) TT=8.24
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-46_ext.xml	SAT TT=61.869	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=1403.9 ASSIGNMENTS=55223	? (TO) TT=1800.07	SAT TT=1343.81 CHECKS=4751880000 NODES=2689730	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=399.069 ASSIGNMENTS=165494 CHECKS=27374700	SAT TT=107.731 ASSIGNMENTS=165494 CHECKS=27374700	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=1340.23 CHECKS=177438000	SAT TT=62.344 ASSIGNMENTS=165592 CHECKS=27349400	SAT TT=97.071 ASSIGNMENTS=268923 CHECKS=41704800	SAT TT=1119.37	? (TO) TT=1800.08	SAT TT=61.869 ASSIGNMENTS=165494 CHECKS=27374700	? (TO) TT=1800.19	? (TO) TT=1800.07	? (MO) TT=8.36	? (MO) TT=8.34
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-5_ext.xml	SAT TT=1363.81	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.12	SAT TT=1402.77 ASSIGNMENTS=3053280 CHECKS=587551000	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=1439.78 ASSIGNMENTS=3401940 CHECKS=658018000	? (TO) TT=1800.03	SAT TT=1641.72 ASSIGNMENTS=3757630 CHECKS=719308000	SAT TT=1363.81 ASSIGNMENTS=3053280 CHECKS=587551000	? (TO) TT=1800.22	? (TO) TT=1800.07	? (MO) TT=8.33	? (MO) TT=8.504
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-6_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.54	? (TO) TT=1800.02	? (MO) TT=8.25	? (MO) TT=8.32
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-8_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.11	? (MO) TT=8.34	? (MO) TT=8.464
csp/rand-3-28-28/ normalized-rand-3-28-28-93-632-9_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.07	? (MO) TT=7.416	? (MO) TT=7.431
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-0_ext.xml	SAT TT=3.394	SAT TT=329.207 CHECKS=1176560 NODES=224141	SAT TT=318.215 CHECKS=1120340 NODES=224438	? (problem) TT=114.274	? (TO) TT=1800.15	? (TO) TT=1800.16	SAT TT=327.407 ASSIGNMENTS=2597	? (TO) TT=1800.09	SAT TT=23.651 CHECKS=23160500 NODES=28171	SAT TT=100.97 CHECKS=350475000 NODES=1472490	? (TO) TT=1800.04	SAT TT=4.313 ASSIGNMENTS=5921 CHECKS=286125	SAT TT=4.03 ASSIGNMENTS=5921 CHECKS=286125	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=13.419 CHECKS=1242050	SAT TT=3.945 ASSIGNMENTS=5993 CHECKS=290030	SAT TT=4.485 ASSIGNMENTS=8139 CHECKS=315015	SAT TT=52.719	SAT TT=3.394 ASSIGNMENTS=1984 CHECKS=89869	SAT TT=4.288 ASSIGNMENTS=5921 CHECKS=286125	? TT=111.227	SAT TT=583.169 ASSIGNMENTS=528049 CHECKS=145131000	? (MO) TT=12.65	? (MO) TT=12.58
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-10_ext.xml	SAT TT=5.034	SAT TT=56.319 CHECKS=146630 NODES=29957	SAT TT=63.596 CHECKS=148681 NODES=30781	? (problem) TT=115.866	? (TO) TT=1800.12	? (TO) TT=1800.18	SAT TT=731.316 ASSIGNMENTS=3866	SAT TT=1716.44 ASSIGNMENTS=13267	SAT TT=57.101 CHECKS=103722000 NODES=127459	SAT TT=72.474 CHECKS=259651000 NODES=1115260	? (TO) TT=1800	SAT TT=14.45 ASSIGNMENTS=9486 CHECKS=470011	SAT TT=65.831 ASSIGNMENTS=29957 CHECKS=146630	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=9.849 CHECKS=608585	SAT TT=5.194 ASSIGNMENTS=9802 CHECKS=508678	SAT TT=10.639 ASSIGNMENTS=40177 CHECKS=1927700	SAT TT=51.516	SAT TT=5.209 ASSIGNMENTS=10508 CHECKS=538070	SAT TT=5.034 ASSIGNMENTS=9486 CHECKS=470011	? TT=81.852	SAT TT=109.859 ASSIGNMENTS=71126 CHECKS=24464800	? (MO) TT=12.759	? (MO) TT=13.891
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-11_ext.xml	SAT TT=11.876	SAT TT=548.54 CHECKS=3066570 NODES=570182	SAT TT=423.776 CHECKS=1912130 NODES=329400	? (problem) TT=122.757	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=23.426 CHECKS=24004600 NODES=27935	SAT TT=214.91 CHECKS=876959000 NODES=3706290	? (TO) TT=1800.04	SAT TT=22.11 ASSIGNMENTS=40960 CHECKS=1974070	SAT TT=313.453 ASSIGNMENTS=40960 CHECKS=1974070	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=24.877 CHECKS=2427610	SAT TT=11.876 ASSIGNMENTS=41262 CHECKS=1994870	SAT TT=4.59 ASSIGNMENTS=10202 CHECKS=421211	SAT TT=56.762	SAT TT=38.376 ASSIGNMENTS=178307 CHECKS=8584150	SAT TT=11.958 ASSIGNMENTS=40960 CHECKS=1974070	? TT=111.585	SAT TT=411.363 ASSIGNMENTS=268983 CHECKS=84676900	? (MO) TT=13.903	? (MO) TT=12.71
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-12_ext.xml	SAT TT=8.698	SAT TT=26.432 CHECKS=165677 NODES=36903	SAT TT=44.992 CHECKS=317404 NODES=65121	? (problem) TT=112.301	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.18	SAT TT=54.383 CHECKS=103145000 NODES=136930	SAT TT=151.69 CHECKS=581015000 NODES=2459340	? (TO) TT=1800.06	SAT TT=25.249 ASSIGNMENTS=65514 CHECKS=3028190	SAT TT=34.693 ASSIGNMENTS=36903 CHECKS=165677	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=8.698 CHECKS=692658	SAT TT=15.007 ASSIGNMENTS=65960 CHECKS=3061760	SAT TT=15.349 ASSIGNMENTS=69350 CHECKS=3148200	SAT TT=95.568	SAT TT=11.951 ASSIGNMENTS=46176 CHECKS=2202850	SAT TT=14.107 ASSIGNMENTS=65514 CHECKS=3028190	? TT=84.399	SAT TT=54.305 ASSIGNMENTS=37555 CHECKS=8801440	? (MO) TT=12.781	? (MO) TT=11.818
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-13_ext.xml	SAT TT=15.754	SAT TT=505.438 CHECKS=8788570 NODES=1607820	SAT TT=500.622 CHECKS=8820780 NODES=1609430	? (problem) TT=117.811	? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=197.834 CHECKS=460367000 NODES=695733	SAT TT=100.211 CHECKS=372395000 NODES=1579560	? (TO) TT=1800.01	SAT TT=58.929 ASSIGNMENTS=288049 CHECKS=14110400	SAT TT=348.817 ASSIGNMENTS=288049 CHECKS=14110400	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=15.754 CHECKS=1725270	SAT TT=52.575 ASSIGNMENTS=287249 CHECKS=14058800	SAT TT=49.942 ASSIGNMENTS=291110 CHECKS=14182200	SAT TT=292.344	SAT TT=66.422 ASSIGNMENTS=372378 CHECKS=18208600	SAT TT=48.19 ASSIGNMENTS=288049 CHECKS=14110400	? TT=85.565	SAT TT=612.156 ASSIGNMENTS=460640 CHECKS=134843000	? (MO) TT=11.784	? (MO) TT=11.798
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-14_ext.xml	SAT TT=5.4	SAT TT=257.357 CHECKS=997437 NODES=200497	SAT TT=257.416 CHECKS=1019320 NODES=200720	? (problem) TT=119.971	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=374.168 CHECKS=942542000 NODES=1331260	SAT TT=320.772 CHECKS=1339510000 NODES=5793260	SAT TT=464.454 CHECKS=954174000 NODES=2272000	SAT TT=25.218 ASSIGNMENTS=54484 CHECKS=2748170	SAT TT=270.513 ASSIGNMENTS=200497 CHECKS=997437	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=22.173 CHECKS=1733690	SAT TT=15.024 ASSIGNMENTS=54281 CHECKS=2746570	SAT TT=30.125 ASSIGNMENTS=122689 CHECKS=6101690	SAT TT=138.071	SAT TT=5.4 ASSIGNMENTS=11274 CHECKS=554440	SAT TT=14.953 ASSIGNMENTS=54484 CHECKS=2748170	? TT=86.8	SAT TT=598.884 ASSIGNMENTS=226299 CHECKS=115480000	? (MO) TT=12.79	? (MO) TT=12.964
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-15_ext.xml	SAT TT=9.328	SAT TT=66.125 CHECKS=449037 NODES=96317	SAT TT=64.762 CHECKS=446555 NODES=96584	? (problem) TT=112.271	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.13	SAT TT=52.026 CHECKS=102174000 NODES=133837	SAT TT=63.827 CHECKS=220687000 NODES=940492	? (TO) TT=1800.06	SAT TT=22.827 ASSIGNMENTS=49412 CHECKS=2401560	SAT TT=75.905 ASSIGNMENTS=96317 CHECKS=449037	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=24.187 CHECKS=2547350	SAT TT=12.351 ASSIGNMENTS=49303 CHECKS=2396350	SAT TT=12.956 ASSIGNMENTS=53243 CHECKS=2500560	SAT TT=83.703	SAT TT=9.328 ASSIGNMENTS=34126 CHECKS=1654520	SAT TT=12.41 ASSIGNMENTS=49412 CHECKS=2401560	? TT=78.82	SAT TT=154.465 ASSIGNMENTS=82716 CHECKS=24890000	? (MO) TT=13.914	? (MO) TT=12.8
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-16_ext.xml	SAT TT=4.346	SAT TT=160.44 CHECKS=180038 NODES=42903	SAT TT=149.123 CHECKS=157543 NODES=37947	? (problem) TT=123.401	? (TO) TT=1800.14	? (TO) TT=1800.17	SAT TT=745.167 ASSIGNMENTS=6069	? (TO) TT=1800.1	SAT TT=26.084 CHECKS=30589600 NODES=44210	SAT TT=141.438 CHECKS=511162000 NODES=2127360	? (TO) TT=1800.05	SAT TT=14.966 ASSIGNMENTS=8097 CHECKS=357165	SAT TT=4.346 ASSIGNMENTS=8097 CHECKS=357165	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=16.834 CHECKS=1842190	SAT TT=6.153 ASSIGNMENTS=15937 CHECKS=741951	SAT TT=12.747 ASSIGNMENTS=52996 CHECKS=2509000	SAT TT=54.423	SAT TT=9.004 ASSIGNMENTS=31597 CHECKS=1424710	SAT TT=4.607 ASSIGNMENTS=8097 CHECKS=357165	? TT=82.194	SAT TT=371.055 ASSIGNMENTS=318762 CHECKS=115626000	? (MO) TT=12.737	? (MO) TT=12.95
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-17_ext.xml	SAT TT=8.735	SAT TT=105.104 CHECKS=761395 NODES=165804	SAT TT=104.925 CHECKS=766781 NODES=165613	? (problem) TT=119.944	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.19	? (TO) TT=1800.11	SAT TT=52.39 CHECKS=93619300 NODES=133926	SAT TT=311.564 CHECKS=1185440000 NODES=5030160	SAT TT=1151.77 CHECKS=2422860000 NODES=5078820	SAT TT=21.221 ASSIGNMENTS=39188 CHECKS=1849360	SAT TT=112.771 ASSIGNMENTS=165804 CHECKS=761395	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=8.735 CHECKS=480448	SAT TT=9.894 ASSIGNMENTS=38668 CHECKS=1837660	SAT TT=11.143 ASSIGNMENTS=42127 CHECKS=1939410	SAT TT=110.108	SAT TT=18.058 ASSIGNMENTS=76803 CHECKS=3645540	SAT TT=10.648 ASSIGNMENTS=39188 CHECKS=1849360	? TT=108.509	SAT TT=108.204 ASSIGNMENTS=64898 CHECKS=20507700	? (MO) TT=12.84	? (MO) TT=12.776
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-18_ext.xml	SAT TT=6.293	SAT TT=82.493 CHECKS=691926 NODES=133766	SAT TT=92.281 CHECKS=692036 NODES=134027	? (problem) TT=121.941	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.16	SAT TT=65.417 CHECKS=128393000 NODES=190591	SAT TT=54.408 CHECKS=166013000 NODES=727316	SAT TT=1404.77 CHECKS=3048910000 NODES=6985040	SAT TT=21.293 ASSIGNMENTS=44644 CHECKS=1988000	SAT TT=93.505 ASSIGNMENTS=133766 CHECKS=691926	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=25.42 CHECKS=2731650	SAT TT=10.96 ASSIGNMENTS=44893 CHECKS=2002810	SAT TT=11.558 ASSIGNMENTS=49383 CHECKS=2106090	SAT TT=101.07	SAT TT=6.293 ASSIGNMENTS=16705 CHECKS=810528	SAT TT=9.866 ASSIGNMENTS=44644 CHECKS=1988000	? TT=71.764	SAT TT=43.507 ASSIGNMENTS=27905 CHECKS=7722190	? (MO) TT=12.72	? (MO) TT=12.72
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-19_ext.xml	SAT TT=8.578	SAT TT=1041.03 CHECKS=2451140 NODES=524717	SAT TT=1058.93 CHECKS=2459380 NODES=525599	? (problem) TT=121.506	SAT TT=1181.78 CHECKS=252601	SAT TT=1543.81 CHECKS=323727	SAT TT=1519.1 ASSIGNMENTS=14577	? (TO) TT=1800.18	SAT TT=24.25 CHECKS=23441300 NODES=36996	SAT TT=68.823 CHECKS=211493000 NODES=877728	SAT TT=1186.78 CHECKS=2754630000 NODES=5628070	SAT TT=20.469 ASSIGNMENTS=35493 CHECKS=1682940	SAT TT=310.095 ASSIGNMENTS=35493 CHECKS=1682940	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=18.667 CHECKS=1865690	SAT TT=10.033 ASSIGNMENTS=35956 CHECKS=1684140	SAT TT=6.285 ASSIGNMENTS=17458 CHECKS=747152	SAT TT=110.319	SAT TT=8.578 ASSIGNMENTS=25758 CHECKS=1209070	SAT TT=9.258 ASSIGNMENTS=35493 CHECKS=1682940	? TT=79.903	SAT TT=201.213 ASSIGNMENTS=130041 CHECKS=39248800	? (MO) TT=11.794	? (MO) TT=12.81
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-1_ext.xml	SAT TT=3.316	SAT TT=230.553 CHECKS=196173 NODES=63661	SAT TT=247.921 CHECKS=195661 NODES=63576	? (problem) TT=115.042	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.12	SAT TT=146.131 CHECKS=324158000 NODES=434447	SAT TT=92.901 CHECKS=350267000 NODES=1480150	SAT TT=1138.02 CHECKS=2502400000 NODES=5001700	SAT TT=29.303 ASSIGNMENTS=73833 CHECKS=3623290	SAT TT=246.826 ASSIGNMENTS=63661 CHECKS=196173	? (TO) TT=1800	? (TO) TT=1800.04	SAT TT=37.657 CHECKS=3385550	SAT TT=19.048 ASSIGNMENTS=74582 CHECKS=3649620	SAT TT=11.179 ASSIGNMENTS=38980 CHECKS=1842210	SAT TT=154.409	SAT TT=3.316 ASSIGNMENTS=1924 CHECKS=95164	SAT TT=18.69 ASSIGNMENTS=73833 CHECKS=3623290	? TT=79.186	SAT TT=110.977 ASSIGNMENTS=43053 CHECKS=14885800	? (MO) TT=12.71	? (MO) TT=12.777
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-2_ext.xml	SAT TT=6.574	SAT TT=28.141 CHECKS=11529 NODES=3898	SAT TT=23.24 CHECKS=11473 NODES=3942	? (problem) TT=112.546	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=1502.07 ASSIGNMENTS=14551	? (TO) TT=1800.2	SAT TT=41.297 CHECKS=70752900 NODES=94783	SAT TT=41.223 CHECKS=110759000 NODES=474708	? (TO) TT=1800.03	SAT TT=20.72 ASSIGNMENTS=30994 CHECKS=1540440	SAT TT=35.495 ASSIGNMENTS=3898 CHECKS=11529	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=6.574 CHECKS=158891	SAT TT=10.316 ASSIGNMENTS=31196 CHECKS=1545070	SAT TT=9.173 ASSIGNMENTS=27978 CHECKS=1313110	SAT TT=96.447	SAT TT=7.876 ASSIGNMENTS=20426 CHECKS=1005180	SAT TT=10.261 ASSIGNMENTS=30994 CHECKS=1540440	? TT=100.393	SAT TT=22.467 ASSIGNMENTS=5513 CHECKS=2460270	? (MO) TT=12.75	? (MO) TT=13.76
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-3_ext.xml	SAT TT=12.97	SAT TT=143.99 CHECKS=502155 NODES=92389	SAT TT=148.571 CHECKS=484287 NODES=91195	? (problem) TT=123.09	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.13	SAT TT=71.149 CHECKS=145087000 NODES=200298	SAT TT=147.262 CHECKS=552697000 NODES=2354870	? (TO) TT=1800.04	SAT TT=27.753 ASSIGNMENTS=64016 CHECKS=3043790	SAT TT=153.346 ASSIGNMENTS=92389 CHECKS=502155	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=19.762 CHECKS=1267880	SAT TT=15.378 ASSIGNMENTS=64108 CHECKS=3045130	SAT TT=17.215 ASSIGNMENTS=69253 CHECKS=3194410	SAT TT=110.908	SAT TT=12.97 ASSIGNMENTS=50533 CHECKS=2433820	SAT TT=16.546 ASSIGNMENTS=64016 CHECKS=3043790	? TT=89.095	SAT TT=26.127 ASSIGNMENTS=5523 CHECKS=2416860	? (MO) TT=12.787	? (MO) TT=13.873
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-4_ext.xml	SAT TT=5.604	SAT TT=87.089 CHECKS=1252240 NODES=225823	SAT TT=85.707 CHECKS=1265050 NODES=225935	? (problem) TT=119.879	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=927.969 ASSIGNMENTS=7283	? (TO) TT=1800.17	SAT TT=68.625 CHECKS=124007000 NODES=201754	SAT TT=63.609 CHECKS=193629000 NODES=833849	? (TO) TT=1800.07	SAT TT=16.034 ASSIGNMENTS=15491 CHECKS=711874	SAT TT=88.32 ASSIGNMENTS=225823 CHECKS=1252240	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=20.29 CHECKS=2803380	SAT TT=5.604 ASSIGNMENTS=15407 CHECKS=710287	SAT TT=6.063 ASSIGNMENTS=20500 CHECKS=875391	SAT TT=62.85	SAT TT=8.643 ASSIGNMENTS=32576 CHECKS=1504750	SAT TT=5.77 ASSIGNMENTS=15491 CHECKS=711874	? TT=81.819	SAT TT=196.058 ASSIGNMENTS=149966 CHECKS=39098800	? (MO) TT=13.66	? (MO) TT=12.79
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-5_ext.xml	SAT TT=11.298	SAT TT=37.461 CHECKS=183071 NODES=40698	SAT TT=40.749 CHECKS=245501 NODES=53242	? (problem) TT=122.366	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.17	SAT TT=205.497 CHECKS=448398000 NODES=680792	SAT TT=326.022 CHECKS=1350070000 NODES=5624540	SAT TT=1694.16 CHECKS=3876760000 NODES=8097100	SAT TT=22.394 ASSIGNMENTS=51520 CHECKS=2307780	SAT TT=45.475 ASSIGNMENTS=40698 CHECKS=183071	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=12.972 CHECKS=1059420	SAT TT=11.298 ASSIGNMENTS=52077 CHECKS=2348660	SAT TT=12.185 ASSIGNMENTS=57737 CHECKS=2535210	SAT TT=100.967	SAT TT=33.116 ASSIGNMENTS=178323 CHECKS=7842940	SAT TT=11.779 ASSIGNMENTS=51520 CHECKS=2307780	? TT=81.948	SAT TT=230.125 ASSIGNMENTS=77967 CHECKS=24695200	? (MO) TT=12.809	? (MO) TT=12.653
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-6_ext.xml	SAT TT=5.206	SAT TT=172.82 CHECKS=256472 NODES=60001	SAT TT=144.273 CHECKS=242310 NODES=61410	? (problem) TT=122.392	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.13	SAT TT=56.497 CHECKS=101255000 NODES=135630	SAT TT=111.337 CHECKS=431250000 NODES=1882880	SAT TT=1005.2 CHECKS=2076880000 NODES=4913730	SAT TT=24.548 ASSIGNMENTS=49602 CHECKS=2508420	SAT TT=182.17 ASSIGNMENTS=60001 CHECKS=256472	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=5.206 CHECKS=5336	SAT TT=12.925 ASSIGNMENTS=49233 CHECKS=2481750	SAT TT=12.819 ASSIGNMENTS=43585 CHECKS=2164070	SAT TT=138.349	SAT TT=12.434 ASSIGNMENTS=40037 CHECKS=2077240	SAT TT=12.961 ASSIGNMENTS=49602 CHECKS=2508420	? TT=78.673	SAT TT=83.508 ASSIGNMENTS=32734 CHECKS=14180300	? (MO) TT=12.818	? (MO) TT=12.58
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-7_ext.xml	SAT TT=3.51	SAT TT=56.042 CHECKS=122359 NODES=37700	SAT TT=120.582 CHECKS=138349 NODES=40144	? (problem) TT=121.934	SAT TT=1218.38 CHECKS=268210	SAT TT=1025.76 CHECKS=206142	SAT TT=679.513 ASSIGNMENTS=4812	? (TO) TT=1800.14	SAT TT=16.918 CHECKS=5973940 NODES=8241	SAT TT=22.096 CHECKS=31561200 NODES=138449	? (TO) TT=1800.08	SAT TT=4.443 ASSIGNMENTS=6050 CHECKS=285357	SAT TT=4.056 ASSIGNMENTS=6050 CHECKS=285357	? (TO) TT=1800.06	SAT TT=1039.06	SAT TT=5.842 CHECKS=81470	SAT TT=3.966 ASSIGNMENTS=5925 CHECKS=272414	SAT TT=4.061 ASSIGNMENTS=5943 CHECKS=209583	SAT TT=50.928	SAT TT=3.51 ASSIGNMENTS=2838 CHECKS=129629	SAT TT=4.428 ASSIGNMENTS=6050 CHECKS=285357	? TT=110.985	SAT TT=28.342 ASSIGNMENTS=12166 CHECKS=2785460	? (MO) TT=13.874	? (MO) TT=12.67
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-8_ext.xml	SAT TT=11.096	SAT TT=250.023 CHECKS=290272 NODES=57650	SAT TT=395.242 CHECKS=417594 NODES=86349	? (problem) TT=120.33	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.21	SAT TT=153.228 CHECKS=339131000 NODES=444915	SAT TT=32.033 CHECKS=80371800 NODES=335665	? (TO) TT=1800.07	SAT TT=44.137 ASSIGNMENTS=165752 CHECKS=7924260	SAT TT=259.488 ASSIGNMENTS=57650 CHECKS=290272	? (TO) TT=1800.01	SAT TT=1496.79	SAT TT=45.187 CHECKS=5752510	SAT TT=36.892 ASSIGNMENTS=166684 CHECKS=7980180	SAT TT=32.281 ASSIGNMENTS=138879 CHECKS=6646260	SAT TT=299.118	SAT TT=11.096 ASSIGNMENTS=38513 CHECKS=1854140	SAT TT=34.081 ASSIGNMENTS=165752 CHECKS=7924260	? TT=111.674	SAT TT=99.361 ASSIGNMENTS=53656 CHECKS=21419700	? (MO) TT=11.79	? (MO) TT=13.67
csp/rand-8-20-5/ normalized-rand-8-20-5-18-800-9_ext.xml	SAT TT=13.206	SAT TT=79.359 CHECKS=130471 NODES=33526	SAT TT=77.03 CHECKS=134487 NODES=33804	? (problem) TT=121.737	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.16	SAT TT=53.474 CHECKS=100819000 NODES=133816	SAT TT=45.215 CHECKS=123964000 NODES=516915	SAT TT=1614.83 CHECKS=3735890000 NODES=7775790	SAT TT=25.783 ASSIGNMENTS=53924 CHECKS=2724760	SAT TT=87.43 ASSIGNMENTS=33526 CHECKS=130471	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=25.251 CHECKS=2267320	SAT TT=15.791 ASSIGNMENTS=55162 CHECKS=2813780	SAT TT=13.314 ASSIGNMENTS=47196 CHECKS=2290590	SAT TT=158.508	SAT TT=13.206 ASSIGNMENTS=45695 CHECKS=2299620	SAT TT=15.058 ASSIGNMENTS=53924 CHECKS=2724760	? TT=101.009	SAT TT=33.504 ASSIGNMENTS=8009 CHECKS=2868490	? (MO) TT=12.77	? (MO) TT=11.883

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	mddc-solv 2008-06-09	MDG-noprobe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	94	94	65	58	58	88	63	123	63	10	129	133	24	25	126	133	106	132	133	55	66	65
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	94	94	65	58	58	88	63	123	63	10	129	133	24	25	126	133	106	132	133	55	66	65
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	1	0	0	0	0	0	0	2	2	0	1	1	0	0	47	27	0	34	20	3	0	1
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0