CSP 2008 Competition: results by benchmark

Results by benchmark for category binary constraints in extension (2-ARY-EXT), subcategory quasi random

This page displays the results of the different solvers for each benchmark for category binary constraints in extension (2-ARY-EXT), subcategory quasi random

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
spider 2008-06-14
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-25-10-20/ normalized-composed-25-10-20-2_ext.xml	SAT TT=0.052	SAT TT=1.044 CHECKS=94780 NODES=527	SAT TT=1.108 CHECKS=243885 NODES=110	SAT TT=0.637	SAT TT=1.486 CHECKS=568907	SAT TT=0.614 CHECKS=131936	SAT TT=1.062 ASSIGNMENTS=48	SAT TT=0.844 ASSIGNMENTS=48	SAT TT=0.724 CHECKS=9029 NODES=150	SAT TT=0.788 CHECKS=125432 NODES=831	SAT TT=0.758 CHECKS=201238 NODES=446	SAT TT=0.068 ASSIGNMENTS=468 CHECKS=30191	SAT TT=0.065 ASSIGNMENTS=468 CHECKS=30191	SAT TT=2.419	SAT TT=2.33	SAT TT=0.058 ASSIGNMENTS=489 CHECKS=31777	SAT TT=0.084 ASSIGNMENTS=1669 CHECKS=175712	SAT TT=0.786	SAT TT=0.062 ASSIGNMENTS=822 CHECKS=105285	SAT TT=0.052 ASSIGNMENTS=468 CHECKS=30191	SAT TT=2.774	SAT TT=0.121 ASSIGNMENTS=135 CHECKS=31404	SAT TT=1.186	SAT TT=1.338
csp/composed-25-10-20/ normalized-composed-25-10-20-3_ext.xml	SAT TT=0.053	SAT TT=1.096 CHECKS=32520 NODES=262	SAT TT=1.228 CHECKS=385480 NODES=165	? (TO) TT=1800.1	SAT TT=1.825 CHECKS=728350	SAT TT=0.617 CHECKS=153413	SAT TT=1.048 ASSIGNMENTS=43	SAT TT=0.843 ASSIGNMENTS=43	SAT TT=0.781 CHECKS=15485 NODES=277	SAT TT=0.906 CHECKS=179215 NODES=1644	SAT TT=0.838 CHECKS=420946 NODES=897	SAT TT=0.066 ASSIGNMENTS=412 CHECKS=28502	SAT TT=0.065 ASSIGNMENTS=412 CHECKS=28502	SAT TT=2.663	SAT TT=2.394	SAT TT=0.054 ASSIGNMENTS=543 CHECKS=40277	SAT TT=0.07 ASSIGNMENTS=1074 CHECKS=127336	SAT TT=0.73	SAT TT=0.069 ASSIGNMENTS=815 CHECKS=103798	SAT TT=0.053 ASSIGNMENTS=412 CHECKS=28502	SAT TT=2.911	SAT TT=0.148 ASSIGNMENTS=143 CHECKS=33084	SAT TT=1.451	SAT TT=1.365
csp/composed-25-10-20/ normalized-composed-25-10-20-4_ext.xml	SAT TT=0.045	SAT TT=1.047 CHECKS=65176 NODES=364	SAT TT=1.208 CHECKS=351310 NODES=464	SAT TT=79.985	SAT TT=0.508 CHECKS=145094	SAT TT=0.791 CHECKS=174398	SAT TT=0.862 ASSIGNMENTS=37	SAT TT=0.905 ASSIGNMENTS=37	SAT TT=0.789 CHECKS=17839 NODES=350	SAT TT=0.92 CHECKS=215186 NODES=2245	SAT TT=0.77 CHECKS=538053 NODES=795	SAT TT=0.055 ASSIGNMENTS=64 CHECKS=5497	SAT TT=0.059 ASSIGNMENTS=64 CHECKS=5497	SAT TT=2.28	SAT TT=2.24	SAT TT=0.045 ASSIGNMENTS=66 CHECKS=5656	SAT TT=0.163 ASSIGNMENTS=4954 CHECKS=614678	SAT TT=0.779	SAT TT=0.069 ASSIGNMENTS=801 CHECKS=103671	SAT TT=0.048 ASSIGNMENTS=64 CHECKS=5497	SAT TT=2.945	SAT TT=0.105 ASSIGNMENTS=138 CHECKS=31096	SAT TT=1.285	SAT TT=1.729
csp/composed-25-10-20/ normalized-composed-25-10-20-5_ext.xml	SAT TT=0.048	SAT TT=0.983 CHECKS=11695 NODES=115	SAT TT=1.131 CHECKS=224939 NODES=195	SAT TT=1.59	SAT TT=1.936 CHECKS=755036	SAT TT=0.641 CHECKS=144125	SAT TT=0.896 ASSIGNMENTS=51	SAT TT=0.853 ASSIGNMENTS=51	SAT TT=0.744 CHECKS=14762 NODES=258	SAT TT=0.794 CHECKS=115440 NODES=1004	SAT TT=0.752 CHECKS=168979 NODES=297	SAT TT=0.063 ASSIGNMENTS=212 CHECKS=14881	SAT TT=0.063 ASSIGNMENTS=212 CHECKS=14881	SAT TT=2.499	SAT TT=2.308	SAT TT=0.051 ASSIGNMENTS=224 CHECKS=15923	SAT TT=0.053 ASSIGNMENTS=262 CHECKS=28343	SAT TT=0.765	SAT TT=0.064 ASSIGNMENTS=822 CHECKS=108352	SAT TT=0.048 ASSIGNMENTS=212 CHECKS=14881	SAT TT=2.992	SAT TT=0.12 ASSIGNMENTS=129 CHECKS=29630	SAT TT=1.567	SAT TT=1.346
csp/composed-25-10-20/ normalized-composed-25-10-20-7_ext.xml	SAT TT=0.048	SAT TT=1.029 CHECKS=11266 NODES=110	SAT TT=1.103 CHECKS=173954 NODES=112	SAT TT=0.55	SAT TT=1.987 CHECKS=726918	SAT TT=0.754 CHECKS=166666	SAT TT=0.846 ASSIGNMENTS=70	SAT TT=1.078 ASSIGNMENTS=70	SAT TT=0.788 CHECKS=14580 NODES=256	SAT TT=0.771 CHECKS=50804 NODES=248	SAT TT=0.798 CHECKS=128888 NODES=192	SAT TT=0.057 ASSIGNMENTS=96 CHECKS=7209	SAT TT=0.061 ASSIGNMENTS=96 CHECKS=7209	SAT TT=2.279	SAT TT=2.449	SAT TT=0.052 ASSIGNMENTS=84 CHECKS=6524	SAT TT=0.135 ASSIGNMENTS=3846 CHECKS=440807	SAT TT=0.755	SAT TT=0.067 ASSIGNMENTS=812 CHECKS=105662	SAT TT=0.048 ASSIGNMENTS=96 CHECKS=7209	SAT TT=2.997	SAT TT=0.108 ASSIGNMENTS=128 CHECKS=30298	SAT TT=1.275	SAT TT=1.733
csp/composed-25-1-25/ normalized-composed-25-1-25-1_ext.xml	UNSAT TT=0.02	UNSAT TT=0.809 CHECKS=1788 NODES=3	UNSAT TT=0.839 CHECKS=1745 NODES=0	UNSAT TT=0.168	UNSAT TT=0.046 CHECKS=6637	UNSAT TT=0.033 CHECKS=1217	UNSAT TT=0.693 ASSIGNMENTS=0	UNSAT TT=0.624 ASSIGNMENTS=0	UNSAT TT=0.572 CHECKS=3036 NODES=32	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.033 ASSIGNMENTS=54 CHECKS=6935	UNSAT TT=0.034 ASSIGNMENTS=54 CHECKS=6935	UNSAT TT=0.989	UNSAT TT=1.094	UNSAT TT=0.022 ASSIGNMENTS=99 CHECKS=12791	UNSAT TT=0.033 ASSIGNMENTS=594 CHECKS=63961	UNSAT TT=0.641	UNSAT TT=0.025 ASSIGNMENTS=217 CHECKS=32567	UNSAT TT=0.02 ASSIGNMENTS=54 CHECKS=6935	UNSAT TT=1.769	UNSAT TT=0.038 ASSIGNMENTS=4 CHECKS=2573	UNSAT TT=1.09	UNSAT TT=1.016
csp/composed-25-1-25/ normalized-composed-25-1-25-2_ext.xml	UNSAT TT=0.021	UNSAT TT=0.891 CHECKS=2824 NODES=6	UNSAT TT=0.953 CHECKS=6638 NODES=0	UNSAT TT=0.174	UNSAT TT=0.076 CHECKS=18119	UNSAT TT=0.034 CHECKS=2600	UNSAT TT=0.806 ASSIGNMENTS=0	UNSAT TT=0.687 ASSIGNMENTS=0	UNSAT TT=0.581 CHECKS=3233 NODES=28	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=0.034 ASSIGNMENTS=109 CHECKS=8911	UNSAT TT=0.033 ASSIGNMENTS=109 CHECKS=8911	UNSAT TT=1.229	UNSAT TT=0.996	UNSAT TT=0.023 ASSIGNMENTS=150 CHECKS=12416	UNSAT TT=0.046 ASSIGNMENTS=978 CHECKS=123605	UNSAT TT=0.518	UNSAT TT=0.024 ASSIGNMENTS=196 CHECKS=26831	UNSAT TT=0.021 ASSIGNMENTS=109 CHECKS=8911	UNSAT TT=1.857	UNSAT TT=0.044 ASSIGNMENTS=5 CHECKS=2503	UNSAT TT=0.992	UNSAT TT=1.021
csp/composed-25-1-25/ normalized-composed-25-1-25-3_ext.xml	UNSAT TT=0.023	UNSAT TT=0.861 CHECKS=2121 NODES=5	UNSAT TT=0.846 CHECKS=5064 NODES=0	UNSAT TT=0.173	UNSAT TT=0.072 CHECKS=16749	UNSAT TT=0.032 CHECKS=2282	UNSAT TT=0.669 ASSIGNMENTS=0	UNSAT TT=0.713 ASSIGNMENTS=0	UNSAT TT=0.542 CHECKS=2346 NODES=20	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=0.033 ASSIGNMENTS=69 CHECKS=7780	UNSAT TT=0.033 ASSIGNMENTS=69 CHECKS=7780	UNSAT TT=0.988	UNSAT TT=1.17	UNSAT TT=0.023 ASSIGNMENTS=149 CHECKS=15056	UNSAT TT=0.034 ASSIGNMENTS=531 CHECKS=67496	UNSAT TT=0.508	UNSAT TT=0.024 ASSIGNMENTS=100 CHECKS=18174	UNSAT TT=0.023 ASSIGNMENTS=69 CHECKS=7780	UNSAT TT=1.777	UNSAT TT=0.041 ASSIGNMENTS=3 CHECKS=1736	UNSAT TT=0.96	UNSAT TT=0.99
csp/composed-25-1-25/ normalized-composed-25-1-25-6_ext.xml	UNSAT TT=0.022	UNSAT TT=0.808 CHECKS=2689 NODES=7	UNSAT TT=1.066 CHECKS=6045 NODES=0	UNSAT TT=0.159	UNSAT TT=0.079 CHECKS=19810	UNSAT TT=0.033 CHECKS=2714	UNSAT TT=0.618 ASSIGNMENTS=0	UNSAT TT=0.664 ASSIGNMENTS=0	UNSAT TT=0.539 CHECKS=2921 NODES=31	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=0.034 ASSIGNMENTS=85 CHECKS=7885	UNSAT TT=0.034 ASSIGNMENTS=85 CHECKS=7885	UNSAT TT=1.109	UNSAT TT=0.908	UNSAT TT=0.022 ASSIGNMENTS=147 CHECKS=14236	UNSAT TT=0.049 ASSIGNMENTS=1239 CHECKS=145284	UNSAT TT=0.66	UNSAT TT=0.023 ASSIGNMENTS=198 CHECKS=26473	UNSAT TT=0.022 ASSIGNMENTS=85 CHECKS=7885	UNSAT TT=1.838	UNSAT TT=0.038 ASSIGNMENTS=6 CHECKS=3126	UNSAT TT=1.095	UNSAT TT=0.993
csp/composed-25-1-25/ normalized-composed-25-1-25-8_ext.xml	UNSAT TT=0.021	UNSAT TT=0.873 CHECKS=1996 NODES=4	UNSAT TT=0.868 CHECKS=4024 NODES=0	UNSAT TT=0.169	UNSAT TT=0.042 CHECKS=4883	UNSAT TT=0.034 CHECKS=2711	UNSAT TT=0.621 ASSIGNMENTS=0	UNSAT TT=0.669 ASSIGNMENTS=0	UNSAT TT=0.571 CHECKS=3132 NODES=25	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=0.032 ASSIGNMENTS=61 CHECKS=6411	UNSAT TT=0.034 ASSIGNMENTS=61 CHECKS=6411	UNSAT TT=1.116	UNSAT TT=0.97	UNSAT TT=0.022 ASSIGNMENTS=87 CHECKS=9974	UNSAT TT=0.054 ASSIGNMENTS=1440 CHECKS=175058	UNSAT TT=0.648	UNSAT TT=0.021 ASSIGNMENTS=157 CHECKS=21820	UNSAT TT=0.022 ASSIGNMENTS=61 CHECKS=6411	UNSAT TT=1.662	UNSAT TT=0.039 ASSIGNMENTS=5 CHECKS=2729	UNSAT TT=1.04	UNSAT TT=0.989
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-25-1-2/ normalized-composed-25-1-2-0_ext.xml	UNSAT TT=0.02	UNSAT TT=0.802 CHECKS=1657 NODES=4	UNSAT TT=0.834 CHECKS=4458 NODES=0	UNSAT TT=0.164	UNSAT TT=0.041 CHECKS=5707	UNSAT TT=0.03 CHECKS=1478	UNSAT TT=0.606 ASSIGNMENTS=0	UNSAT TT=0.695 ASSIGNMENTS=0	UNSAT TT=0.568 CHECKS=2741 NODES=31	? (TO) TT=1800	? (TO) TT=1800	UNSAT TT=0.033 ASSIGNMENTS=117 CHECKS=7189	UNSAT TT=0.033 ASSIGNMENTS=117 CHECKS=7189	UNSAT TT=0.965	UNSAT TT=0.918	UNSAT TT=0.021 ASSIGNMENTS=166 CHECKS=9909	UNSAT TT=0.05 ASSIGNMENTS=2015 CHECKS=142789	UNSAT TT=0.507	UNSAT TT=0.022 ASSIGNMENTS=207 CHECKS=23608	UNSAT TT=0.02 ASSIGNMENTS=117 CHECKS=7189	UNSAT TT=1.636	UNSAT TT=0.035 ASSIGNMENTS=6 CHECKS=949	UNSAT TT=0.945	UNSAT TT=1.122
csp/composed-25-1-2/ normalized-composed-25-1-2-6_ext.xml	UNSAT TT=0.022	UNSAT TT=0.81 CHECKS=2153 NODES=7	UNSAT TT=0.82 CHECKS=6829 NODES=0	UNSAT TT=0.155	UNSAT TT=0.058 CHECKS=12965	UNSAT TT=0.031 CHECKS=1806	UNSAT TT=0.638 ASSIGNMENTS=0	UNSAT TT=0.624 ASSIGNMENTS=0	UNSAT TT=0.538 CHECKS=2697 NODES=31	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.033 ASSIGNMENTS=140 CHECKS=9379	UNSAT TT=0.034 ASSIGNMENTS=140 CHECKS=9379	UNSAT TT=0.967	UNSAT TT=0.912	UNSAT TT=0.023 ASSIGNMENTS=185 CHECKS=12365	UNSAT TT=0.035 ASSIGNMENTS=1100 CHECKS=77179	UNSAT TT=0.734	UNSAT TT=0.022 ASSIGNMENTS=193 CHECKS=21883	UNSAT TT=0.022 ASSIGNMENTS=140 CHECKS=9379	UNSAT TT=1.668	UNSAT TT=0.036 ASSIGNMENTS=8 CHECKS=1106	UNSAT TT=1.007	UNSAT TT=0.965
csp/composed-25-1-2/ normalized-composed-25-1-2-7_ext.xml	UNSAT TT=0.02	UNSAT TT=0.785 CHECKS=1807 NODES=5	UNSAT TT=0.94 CHECKS=7699 NODES=0	UNSAT TT=0.152	UNSAT TT=0.067 CHECKS=15940	UNSAT TT=0.031 CHECKS=1763	UNSAT TT=0.602 ASSIGNMENTS=0	UNSAT TT=0.616 ASSIGNMENTS=0	UNSAT TT=0.529 CHECKS=2808 NODES=34	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=0.032 ASSIGNMENTS=140 CHECKS=8252	UNSAT TT=0.034 ASSIGNMENTS=140 CHECKS=8252	UNSAT TT=0.939	UNSAT TT=1.2	UNSAT TT=0.02 ASSIGNMENTS=183 CHECKS=10858	UNSAT TT=0.035 ASSIGNMENTS=1230 CHECKS=86619	UNSAT TT=0.481	UNSAT TT=0.021 ASSIGNMENTS=215 CHECKS=23310	UNSAT TT=0.021 ASSIGNMENTS=140 CHECKS=8252	UNSAT TT=1.667	UNSAT TT=0.037 ASSIGNMENTS=7 CHECKS=977	UNSAT TT=0.934	UNSAT TT=0.949
csp/composed-25-1-2/ normalized-composed-25-1-2-8_ext.xml	UNSAT TT=0.021	UNSAT TT=0.946 CHECKS=1977 NODES=4	UNSAT TT=0.959 CHECKS=6449 NODES=0	UNSAT TT=0.164	UNSAT TT=0.063 CHECKS=11893	UNSAT TT=0.029 CHECKS=1034	UNSAT TT=0.651 ASSIGNMENTS=0	UNSAT TT=0.62 ASSIGNMENTS=0	UNSAT TT=0.6 CHECKS=2665 NODES=30	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.033 ASSIGNMENTS=124 CHECKS=7439	UNSAT TT=0.033 ASSIGNMENTS=124 CHECKS=7439	UNSAT TT=1.168	UNSAT TT=1.11	UNSAT TT=0.021 ASSIGNMENTS=181 CHECKS=11012	UNSAT TT=0.032 ASSIGNMENTS=824 CHECKS=59481	UNSAT TT=0.517	UNSAT TT=0.021 ASSIGNMENTS=204 CHECKS=22768	UNSAT TT=0.023 ASSIGNMENTS=124 CHECKS=7439	UNSAT TT=1.78	UNSAT TT=0.037 ASSIGNMENTS=5 CHECKS=891	UNSAT TT=1.053	UNSAT TT=0.975
csp/composed-25-1-2/ normalized-composed-25-1-2-9_ext.xml	UNSAT TT=0.02	UNSAT TT=0.84 CHECKS=1957 NODES=7	UNSAT TT=0.819 CHECKS=7145 NODES=0	UNSAT TT=0.162	UNSAT TT=0.066 CHECKS=13700	UNSAT TT=0.032 CHECKS=1825	UNSAT TT=0.617 ASSIGNMENTS=0	UNSAT TT=0.617 ASSIGNMENTS=0	UNSAT TT=0.532 CHECKS=2842 NODES=31	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=0.033 ASSIGNMENTS=138 CHECKS=7748	UNSAT TT=0.033 ASSIGNMENTS=138 CHECKS=7748	UNSAT TT=0.936	UNSAT TT=0.953	UNSAT TT=0.021 ASSIGNMENTS=230 CHECKS=12987	UNSAT TT=0.03 ASSIGNMENTS=668 CHECKS=44608	UNSAT TT=0.611	UNSAT TT=0.021 ASSIGNMENTS=220 CHECKS=24330	UNSAT TT=0.02 ASSIGNMENTS=138 CHECKS=7748	UNSAT TT=1.651	UNSAT TT=0.043 ASSIGNMENTS=6 CHECKS=868	UNSAT TT=0.925	UNSAT TT=0.963
csp/composed-25-1-40/ normalized-composed-25-1-40-0_ext.xml	UNSAT TT=0.022	UNSAT TT=0.852 CHECKS=2608 NODES=4	UNSAT TT=0.809 CHECKS=2919 NODES=0	UNSAT TT=0.163	UNSAT TT=0.074 CHECKS=20999	UNSAT TT=0.036 CHECKS=2693	UNSAT TT=0.761 ASSIGNMENTS=0	UNSAT TT=0.633 ASSIGNMENTS=0	UNSAT TT=0.54 CHECKS=3284 NODES=23	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.034 ASSIGNMENTS=69 CHECKS=8300	UNSAT TT=0.034 ASSIGNMENTS=69 CHECKS=8300	UNSAT TT=1.009	UNSAT TT=0.93	UNSAT TT=0.023 ASSIGNMENTS=109 CHECKS=14171	UNSAT TT=0.052 ASSIGNMENTS=1322 CHECKS=186886	UNSAT TT=0.519	UNSAT TT=0.022 ASSIGNMENTS=152 CHECKS=25789	UNSAT TT=0.022 ASSIGNMENTS=69 CHECKS=8300	UNSAT TT=1.665	UNSAT TT=0.038 ASSIGNMENTS=7 CHECKS=5120	UNSAT TT=1.259	UNSAT TT=1.004
csp/composed-25-1-40/ normalized-composed-25-1-40-2_ext.xml	UNSAT TT=0.023	UNSAT TT=0.805 CHECKS=3096 NODES=6	UNSAT TT=0.826 CHECKS=6925 NODES=0	UNSAT TT=0.173	UNSAT TT=0.081 CHECKS=20289	UNSAT TT=0.034 CHECKS=1323	UNSAT TT=0.618 ASSIGNMENTS=0	UNSAT TT=0.629 ASSIGNMENTS=0	UNSAT TT=0.538 CHECKS=3314 NODES=29	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=0.033 ASSIGNMENTS=87 CHECKS=9314	UNSAT TT=0.034 ASSIGNMENTS=87 CHECKS=9314	UNSAT TT=1.183	UNSAT TT=0.919	UNSAT TT=0.025 ASSIGNMENTS=129 CHECKS=15763	UNSAT TT=0.037 ASSIGNMENTS=785 CHECKS=103843	UNSAT TT=0.517	UNSAT TT=0.024 ASSIGNMENTS=150 CHECKS=22448	UNSAT TT=0.023 ASSIGNMENTS=87 CHECKS=9314	UNSAT TT=1.798	UNSAT TT=0.037 ASSIGNMENTS=7 CHECKS=4114	UNSAT TT=0.982	UNSAT TT=1.296
csp/composed-25-1-40/ normalized-composed-25-1-40-3_ext.xml	UNSAT TT=0.022	UNSAT TT=0.811 CHECKS=2561 NODES=5	UNSAT TT=0.816 CHECKS=3829 NODES=0	UNSAT TT=0.176	UNSAT TT=0.044 CHECKS=6256	UNSAT TT=0.033 CHECKS=1609	UNSAT TT=0.809 ASSIGNMENTS=0	UNSAT TT=0.642 ASSIGNMENTS=0	UNSAT TT=0.789 CHECKS=2307 NODES=18	? (TO) TT=1800.1	? (TO) TT=1800	UNSAT TT=0.035 ASSIGNMENTS=60 CHECKS=8959	UNSAT TT=0.033 ASSIGNMENTS=60 CHECKS=8959	UNSAT TT=0.931	UNSAT TT=0.922	UNSAT TT=0.024 ASSIGNMENTS=127 CHECKS=22099	UNSAT TT=0.052 ASSIGNMENTS=1071 CHECKS=170496	UNSAT TT=0.478	UNSAT TT=0.022 ASSIGNMENTS=77 CHECKS=14575	UNSAT TT=0.023 ASSIGNMENTS=60 CHECKS=8959	UNSAT TT=1.69	UNSAT TT=0.048 ASSIGNMENTS=4 CHECKS=3161	UNSAT TT=1.12	UNSAT TT=1.003
csp/composed-25-1-40/ normalized-composed-25-1-40-4_ext.xml	UNSAT TT=0.021	UNSAT TT=0.81 CHECKS=2413 NODES=5	UNSAT TT=0.825 CHECKS=6054 NODES=0	UNSAT TT=0.176	UNSAT TT=0.047 CHECKS=7088	UNSAT TT=0.035 CHECKS=3082	UNSAT TT=0.798 ASSIGNMENTS=0	UNSAT TT=0.633 ASSIGNMENTS=0	UNSAT TT=0.552 CHECKS=3458 NODES=25	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=0.034 ASSIGNMENTS=63 CHECKS=9430	UNSAT TT=0.034 ASSIGNMENTS=63 CHECKS=9430	UNSAT TT=0.999	UNSAT TT=1.06	UNSAT TT=0.021 ASSIGNMENTS=108 CHECKS=14464	UNSAT TT=0.042 ASSIGNMENTS=960 CHECKS=130925	UNSAT TT=0.484	UNSAT TT=0.024 ASSIGNMENTS=136 CHECKS=23277	UNSAT TT=0.021 ASSIGNMENTS=63 CHECKS=9430	UNSAT TT=1.669	UNSAT TT=0.041 ASSIGNMENTS=7 CHECKS=4591	UNSAT TT=1.087	UNSAT TT=0.997
csp/composed-25-1-40/ normalized-composed-25-1-40-5_ext.xml	UNSAT TT=0.02	UNSAT TT=0.805 CHECKS=2585 NODES=6	UNSAT TT=0.859 CHECKS=2758 NODES=0	UNSAT TT=0.164	UNSAT TT=0.047 CHECKS=7304	UNSAT TT=0.031 CHECKS=1056	UNSAT TT=0.625 ASSIGNMENTS=0	UNSAT TT=0.662 ASSIGNMENTS=0	UNSAT TT=0.541 CHECKS=3038 NODES=17	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=0.034 ASSIGNMENTS=39 CHECKS=6423	UNSAT TT=0.032 ASSIGNMENTS=39 CHECKS=6423	UNSAT TT=0.997	UNSAT TT=1.057	UNSAT TT=0.022 ASSIGNMENTS=68 CHECKS=12604	UNSAT TT=0.039 ASSIGNMENTS=637 CHECKS=97538	UNSAT TT=0.626	UNSAT TT=0.024 ASSIGNMENTS=78 CHECKS=14356	UNSAT TT=0.02 ASSIGNMENTS=39 CHECKS=6423	UNSAT TT=1.797	UNSAT TT=0.041 ASSIGNMENTS=6 CHECKS=3717	UNSAT TT=0.974	UNSAT TT=1.222
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-25-1-80/ normalized-composed-25-1-80-0_ext.xml	UNSAT TT=0.023	UNSAT TT=0.813 CHECKS=3403 NODES=4	UNSAT TT=0.827 CHECKS=3737 NODES=0	UNSAT TT=0.189	UNSAT TT=0.05 CHECKS=8570	UNSAT TT=0.037 CHECKS=1865	UNSAT TT=0.823 ASSIGNMENTS=0	UNSAT TT=0.686 ASSIGNMENTS=0	UNSAT TT=0.595 CHECKS=3507 NODES=21	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.036 ASSIGNMENTS=56 CHECKS=11778	UNSAT TT=0.036 ASSIGNMENTS=56 CHECKS=11778	UNSAT TT=1.253	UNSAT TT=0.995	UNSAT TT=0.028 ASSIGNMENTS=92 CHECKS=20520	UNSAT TT=0.043 ASSIGNMENTS=638 CHECKS=119040	UNSAT TT=0.528	UNSAT TT=0.025 ASSIGNMENTS=82 CHECKS=18397	UNSAT TT=0.023 ASSIGNMENTS=56 CHECKS=11778	UNSAT TT=1.728	UNSAT TT=0.048 ASSIGNMENTS=5 CHECKS=5819	UNSAT TT=1.168	UNSAT TT=1.081
csp/composed-25-1-80/ normalized-composed-25-1-80-2_ext.xml	UNSAT TT=0.023	UNSAT TT=0.873 CHECKS=3909 NODES=6	UNSAT TT=0.828 CHECKS=8069 NODES=0	UNSAT TT=0.174	UNSAT TT=0.048 CHECKS=9236	UNSAT TT=0.036 CHECKS=3520	UNSAT TT=0.824 ASSIGNMENTS=0	UNSAT TT=0.644 ASSIGNMENTS=0	UNSAT TT=0.556 CHECKS=4210 NODES=24	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=0.033 ASSIGNMENTS=57 CHECKS=10966	UNSAT TT=0.035 ASSIGNMENTS=57 CHECKS=10966	UNSAT TT=1.019	UNSAT TT=0.989	UNSAT TT=0.025 ASSIGNMENTS=123 CHECKS=23941	UNSAT TT=0.05 ASSIGNMENTS=869 CHECKS=163457	UNSAT TT=0.563	UNSAT TT=0.026 ASSIGNMENTS=131 CHECKS=28954	UNSAT TT=0.023 ASSIGNMENTS=57 CHECKS=10966	UNSAT TT=1.733	UNSAT TT=0.049 ASSIGNMENTS=5 CHECKS=5913	UNSAT TT=1.15	UNSAT TT=1.183
csp/composed-25-1-80/ normalized-composed-25-1-80-7_ext.xml	UNSAT TT=0.026	UNSAT TT=0.834 CHECKS=4073 NODES=6	UNSAT TT=0.806 CHECKS=3584 NODES=0	UNSAT TT=0.183	UNSAT TT=0.091 CHECKS=26444	UNSAT TT=0.04 CHECKS=3681	UNSAT TT=0.821 ASSIGNMENTS=0	UNSAT TT=0.733 ASSIGNMENTS=0	UNSAT TT=0.564 CHECKS=3680 NODES=23	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.038 ASSIGNMENTS=77 CHECKS=12718	UNSAT TT=0.037 ASSIGNMENTS=77 CHECKS=12718	UNSAT TT=0.948	UNSAT TT=1.149	UNSAT TT=0.027 ASSIGNMENTS=151 CHECKS=25908	UNSAT TT=0.056 ASSIGNMENTS=1161 CHECKS=232847	UNSAT TT=0.541	UNSAT TT=0.028 ASSIGNMENTS=135 CHECKS=29871	UNSAT TT=0.026 ASSIGNMENTS=77 CHECKS=12718	UNSAT TT=1.738	UNSAT TT=0.046 ASSIGNMENTS=6 CHECKS=6327	UNSAT TT=1.015	UNSAT TT=0.982
csp/composed-25-1-80/ normalized-composed-25-1-80-8_ext.xml	UNSAT TT=0.022	UNSAT TT=0.848 CHECKS=3064 NODES=4	UNSAT TT=0.834 CHECKS=4175 NODES=0	UNSAT TT=0.177	UNSAT TT=0.099 CHECKS=30903	UNSAT TT=0.033 CHECKS=1358	UNSAT TT=0.645 ASSIGNMENTS=0	UNSAT TT=0.663 ASSIGNMENTS=0	UNSAT TT=0.574 CHECKS=3587 NODES=23	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.034 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=0.035 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=1.009	UNSAT TT=0.967	UNSAT TT=0.022 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=0.064 ASSIGNMENTS=1216 CHECKS=247400	UNSAT TT=0.574	UNSAT TT=0.025 ASSIGNMENTS=52 CHECKS=10486	UNSAT TT=0.024 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=1.886	UNSAT TT=0.048 ASSIGNMENTS=7 CHECKS=7658	UNSAT TT=1.311	UNSAT TT=1.007
csp/composed-25-1-80/ normalized-composed-25-1-80-9_ext.xml	UNSAT TT=0.024	UNSAT TT=0.81 CHECKS=4729 NODES=8	UNSAT TT=0.852 CHECKS=6657 NODES=0	UNSAT TT=0.189	UNSAT TT=0.062 CHECKS=14835	UNSAT TT=0.04 CHECKS=4278	UNSAT TT=0.632 ASSIGNMENTS=0	UNSAT TT=0.701 ASSIGNMENTS=0	UNSAT TT=0.571 CHECKS=3417 NODES=24	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.038 ASSIGNMENTS=75 CHECKS=13828	UNSAT TT=0.037 ASSIGNMENTS=75 CHECKS=13828	UNSAT TT=1.171	UNSAT TT=1.016	UNSAT TT=0.029 ASSIGNMENTS=179 CHECKS=41164	UNSAT TT=0.064 ASSIGNMENTS=1230 CHECKS=252489	UNSAT TT=0.5	UNSAT TT=0.024 ASSIGNMENTS=75 CHECKS=16749	UNSAT TT=0.026 ASSIGNMENTS=75 CHECKS=13828	UNSAT TT=1.738	UNSAT TT=0.046 ASSIGNMENTS=6 CHECKS=5725	UNSAT TT=0.951	UNSAT TT=1.06
csp/composed-75-1-25/ normalized-composed-75-1-25-2_ext.xml	UNSAT TT=0.051	UNSAT TT=0.946 CHECKS=2223 NODES=6	UNSAT TT=0.95 CHECKS=12138 NODES=0	UNSAT TT=0.399	UNSAT TT=0.215 CHECKS=54998	UNSAT TT=0.08 CHECKS=5385	UNSAT TT=0.748 ASSIGNMENTS=0	UNSAT TT=0.812 ASSIGNMENTS=0	UNSAT TT=0.748 CHECKS=6488 NODES=50	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.064 ASSIGNMENTS=248 CHECKS=26215	UNSAT TT=0.063 ASSIGNMENTS=248 CHECKS=26215	UNSAT TT=1.406	UNSAT TT=1.38	UNSAT TT=0.051 ASSIGNMENTS=304 CHECKS=31909	UNSAT TT=0.152 ASSIGNMENTS=4853 CHECKS=586337	UNSAT TT=0.653	UNSAT TT=0.056 ASSIGNMENTS=470 CHECKS=68700	UNSAT TT=0.052 ASSIGNMENTS=248 CHECKS=26215	UNSAT TT=2.512	UNSAT TT=0.099 ASSIGNMENTS=6 CHECKS=3286	UNSAT TT=1.536	UNSAT TT=1.259
csp/composed-75-1-25/ normalized-composed-75-1-25-4_ext.xml	UNSAT TT=0.047	UNSAT TT=0.993 CHECKS=2300 NODES=6	UNSAT TT=1.1 CHECKS=1981 NODES=0	UNSAT TT=0.405	UNSAT TT=0.122 CHECKS=16988	UNSAT TT=0.077 CHECKS=5168	UNSAT TT=0.775 ASSIGNMENTS=0	UNSAT TT=0.788 ASSIGNMENTS=0	UNSAT TT=0.705 CHECKS=6264 NODES=54	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=0.063 ASSIGNMENTS=212 CHECKS=17958	UNSAT TT=0.062 ASSIGNMENTS=212 CHECKS=17958	UNSAT TT=1.435	UNSAT TT=1.378	UNSAT TT=0.051 ASSIGNMENTS=214 CHECKS=19167	UNSAT TT=0.154 ASSIGNMENTS=5113 CHECKS=582357	UNSAT TT=0.655	UNSAT TT=0.06 ASSIGNMENTS=553 CHECKS=79081	UNSAT TT=0.047 ASSIGNMENTS=212 CHECKS=17958	UNSAT TT=2.518	UNSAT TT=0.096 ASSIGNMENTS=6 CHECKS=3075	UNSAT TT=1.319	UNSAT TT=1.466
csp/composed-75-1-25/ normalized-composed-75-1-25-5_ext.xml	UNSAT TT=0.048	UNSAT TT=0.976 CHECKS=2104 NODES=5	UNSAT TT=0.987 CHECKS=20212 NODES=0	UNSAT TT=0.401	UNSAT TT=0.211 CHECKS=53887	UNSAT TT=0.076 CHECKS=2534	UNSAT TT=0.753 ASSIGNMENTS=0	UNSAT TT=0.824 ASSIGNMENTS=0	UNSAT TT=0.867 CHECKS=6594 NODES=48	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.063 ASSIGNMENTS=204 CHECKS=19561	UNSAT TT=0.059 ASSIGNMENTS=204 CHECKS=19561	UNSAT TT=1.641	UNSAT TT=1.403	UNSAT TT=0.054 ASSIGNMENTS=272 CHECKS=24806	UNSAT TT=0.175 ASSIGNMENTS=6252 CHECKS=692225	UNSAT TT=0.659	UNSAT TT=0.056 ASSIGNMENTS=532 CHECKS=80384	UNSAT TT=0.048 ASSIGNMENTS=204 CHECKS=19561	UNSAT TT=2.369	UNSAT TT=0.098 ASSIGNMENTS=7 CHECKS=2357	UNSAT TT=1.388	UNSAT TT=1.442
csp/composed-75-1-25/ normalized-composed-75-1-25-6_ext.xml	UNSAT TT=0.049	UNSAT TT=0.983 CHECKS=1998 NODES=4	UNSAT TT=1 CHECKS=19651 NODES=0	UNSAT TT=0.401	UNSAT TT=0.214 CHECKS=55945	UNSAT TT=0.075 CHECKS=5312	UNSAT TT=0.772 ASSIGNMENTS=0	UNSAT TT=0.776 ASSIGNMENTS=0	UNSAT TT=0.754 CHECKS=6411 NODES=40	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=0.061 ASSIGNMENTS=345 CHECKS=24299	UNSAT TT=0.064 ASSIGNMENTS=345 CHECKS=24299	UNSAT TT=1.433	UNSAT TT=1.394	UNSAT TT=0.049 ASSIGNMENTS=344 CHECKS=24991	UNSAT TT=0.166 ASSIGNMENTS=6230 CHECKS=691261	UNSAT TT=0.66	UNSAT TT=0.053 ASSIGNMENTS=514 CHECKS=68300	UNSAT TT=0.049 ASSIGNMENTS=345 CHECKS=24299	UNSAT TT=2.308	UNSAT TT=0.095 ASSIGNMENTS=8 CHECKS=3043	UNSAT TT=1.382	UNSAT TT=1.394
csp/composed-75-1-25/ normalized-composed-75-1-25-9_ext.xml	UNSAT TT=0.049	UNSAT TT=1.079 CHECKS=2301 NODES=5	UNSAT TT=1.003 CHECKS=13015 NODES=0	UNSAT TT=0.402	UNSAT TT=0.198 CHECKS=51657	UNSAT TT=0.082 CHECKS=11771	UNSAT TT=0.753 ASSIGNMENTS=0	UNSAT TT=0.998 ASSIGNMENTS=0	UNSAT TT=0.743 CHECKS=6760 NODES=63	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.065 ASSIGNMENTS=257 CHECKS=19768	UNSAT TT=0.06 ASSIGNMENTS=257 CHECKS=19768	UNSAT TT=1.413	UNSAT TT=1.409	UNSAT TT=0.051 ASSIGNMENTS=329 CHECKS=25050	UNSAT TT=0.176 ASSIGNMENTS=6351 CHECKS=691833	UNSAT TT=0.825	UNSAT TT=0.055 ASSIGNMENTS=537 CHECKS=82350	UNSAT TT=0.049 ASSIGNMENTS=257 CHECKS=19768	UNSAT TT=2.328	UNSAT TT=0.092 ASSIGNMENTS=7 CHECKS=3052	UNSAT TT=1.174	UNSAT TT=1.347
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-75-1-2/ normalized-composed-75-1-2-0_ext.xml	UNSAT TT=0.047	UNSAT TT=0.942 CHECKS=1852 NODES=5	UNSAT TT=1.127 CHECKS=17117 NODES=0	UNSAT TT=0.399	UNSAT TT=0.199 CHECKS=49100	UNSAT TT=0.075 CHECKS=4898	UNSAT TT=0.802 ASSIGNMENTS=0	UNSAT TT=0.997 ASSIGNMENTS=0	UNSAT TT=0.705 CHECKS=8367 NODES=94	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=0.059 ASSIGNMENTS=258 CHECKS=17659	UNSAT TT=0.061 ASSIGNMENTS=258 CHECKS=17659	UNSAT TT=1.68	UNSAT TT=1.575	UNSAT TT=0.05 ASSIGNMENTS=279 CHECKS=19618	UNSAT TT=0.107 ASSIGNMENTS=3874 CHECKS=355491	UNSAT TT=0.6	UNSAT TT=0.052 ASSIGNMENTS=555 CHECKS=66796	UNSAT TT=0.047 ASSIGNMENTS=258 CHECKS=17659	UNSAT TT=2.457	UNSAT TT=0.098 ASSIGNMENTS=5 CHECKS=957	UNSAT TT=1.182	UNSAT TT=1.472
csp/composed-75-1-2/ normalized-composed-75-1-2-1_ext.xml	UNSAT TT=0.047	UNSAT TT=0.94 CHECKS=1801 NODES=5	UNSAT TT=1.011 CHECKS=17108 NODES=0	UNSAT TT=0.396	UNSAT TT=0.192 CHECKS=45987	UNSAT TT=0.078 CHECKS=4860	UNSAT TT=0.87 ASSIGNMENTS=0	UNSAT TT=0.752 ASSIGNMENTS=0	UNSAT TT=0.947 CHECKS=6473 NODES=56	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=0.062 ASSIGNMENTS=402 CHECKS=23171	UNSAT TT=0.061 ASSIGNMENTS=402 CHECKS=23171	UNSAT TT=1.538	UNSAT TT=1.361	UNSAT TT=0.049 ASSIGNMENTS=413 CHECKS=23658	UNSAT TT=0.151 ASSIGNMENTS=6633 CHECKS=584150	UNSAT TT=0.65	UNSAT TT=0.054 ASSIGNMENTS=527 CHECKS=72323	UNSAT TT=0.047 ASSIGNMENTS=402 CHECKS=23171	UNSAT TT=2.307	UNSAT TT=0.091 ASSIGNMENTS=8 CHECKS=1063	UNSAT TT=1.39	UNSAT TT=1.431
csp/composed-75-1-2/ normalized-composed-75-1-2-2_ext.xml	UNSAT TT=0.047	UNSAT TT=0.974 CHECKS=1888 NODES=6	UNSAT TT=1.147 CHECKS=19142 NODES=0	UNSAT TT=0.393	UNSAT TT=0.198 CHECKS=47297	UNSAT TT=0.079 CHECKS=4813	UNSAT TT=0.824 ASSIGNMENTS=0	UNSAT TT=0.97 ASSIGNMENTS=0	UNSAT TT=0.953 CHECKS=6242 NODES=62	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.061 ASSIGNMENTS=335 CHECKS=21110	UNSAT TT=0.061 ASSIGNMENTS=335 CHECKS=21110	UNSAT TT=1.404	UNSAT TT=1.499	UNSAT TT=0.05 ASSIGNMENTS=364 CHECKS=23340	UNSAT TT=0.109 ASSIGNMENTS=4024 CHECKS=358778	UNSAT TT=0.716	UNSAT TT=0.056 ASSIGNMENTS=579 CHECKS=77807	UNSAT TT=0.047 ASSIGNMENTS=335 CHECKS=21110	UNSAT TT=2.483	UNSAT TT=0.097 ASSIGNMENTS=6 CHECKS=977	UNSAT TT=1.226	UNSAT TT=1.434
csp/composed-75-1-2/ normalized-composed-75-1-2-5_ext.xml	UNSAT TT=0.047	UNSAT TT=0.943 CHECKS=1528 NODES=5	UNSAT TT=0.99 CHECKS=17462 NODES=0	UNSAT TT=0.394	UNSAT TT=0.114 CHECKS=14512	UNSAT TT=0.074 CHECKS=4787	UNSAT TT=0.819 ASSIGNMENTS=0	UNSAT TT=0.812 ASSIGNMENTS=0	UNSAT TT=0.738 CHECKS=6352 NODES=51	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=0.06 ASSIGNMENTS=387 CHECKS=24082	UNSAT TT=0.062 ASSIGNMENTS=387 CHECKS=24082	UNSAT TT=1.402	UNSAT TT=1.483	UNSAT TT=0.047 ASSIGNMENTS=388 CHECKS=23947	UNSAT TT=0.144 ASSIGNMENTS=6082 CHECKS=529241	UNSAT TT=0.639	UNSAT TT=0.055 ASSIGNMENTS=562 CHECKS=73130	UNSAT TT=0.05 ASSIGNMENTS=387 CHECKS=24082	UNSAT TT=2.484	UNSAT TT=0.093 ASSIGNMENTS=7 CHECKS=1019	UNSAT TT=1.361	UNSAT TT=1.43
csp/composed-75-1-2/ normalized-composed-75-1-2-7_ext.xml	UNSAT TT=0.047	UNSAT TT=0.998 CHECKS=1673 NODES=4	UNSAT TT=1.102 CHECKS=17171 NODES=0	UNSAT TT=0.399	UNSAT TT=0.218 CHECKS=57838	UNSAT TT=0.071 CHECKS=2268	UNSAT TT=0.958 ASSIGNMENTS=0	UNSAT TT=0.97 ASSIGNMENTS=0	UNSAT TT=0.904 CHECKS=6066 NODES=68	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.061 ASSIGNMENTS=366 CHECKS=21831	UNSAT TT=0.062 ASSIGNMENTS=366 CHECKS=21831	UNSAT TT=1.321	UNSAT TT=1.381	UNSAT TT=0.047 ASSIGNMENTS=389 CHECKS=22732	UNSAT TT=0.155 ASSIGNMENTS=6524 CHECKS=593423	UNSAT TT=0.641	UNSAT TT=0.054 ASSIGNMENTS=590 CHECKS=79866	UNSAT TT=0.048 ASSIGNMENTS=366 CHECKS=21831	UNSAT TT=2.476	UNSAT TT=0.093 ASSIGNMENTS=7 CHECKS=1051	UNSAT TT=1.201	UNSAT TT=1.353
csp/composed-75-1-40/ normalized-composed-75-1-40-1_ext.xml	UNSAT TT=0.049	UNSAT TT=0.978 CHECKS=2367 NODES=5	UNSAT TT=0.963 CHECKS=18242 NODES=0	UNSAT TT=0.404	UNSAT TT=0.227 CHECKS=59123	UNSAT TT=0.072 CHECKS=2486	UNSAT TT=0.987 ASSIGNMENTS=0	UNSAT TT=0.826 ASSIGNMENTS=0	UNSAT TT=0.758 CHECKS=6854 NODES=39	? (TO) TT=1800	? (TO) TT=1800.08	UNSAT TT=0.065 ASSIGNMENTS=292 CHECKS=24789	UNSAT TT=0.059 ASSIGNMENTS=292 CHECKS=24789	UNSAT TT=1.426	UNSAT TT=1.512	UNSAT TT=0.052 ASSIGNMENTS=307 CHECKS=26165	UNSAT TT=0.184 ASSIGNMENTS=6210 CHECKS=748357	UNSAT TT=0.675	UNSAT TT=0.058 ASSIGNMENTS=500 CHECKS=83243	UNSAT TT=0.049 ASSIGNMENTS=292 CHECKS=24789	UNSAT TT=2.331	UNSAT TT=0.101 ASSIGNMENTS=8 CHECKS=4165	UNSAT TT=1.129	UNSAT TT=1.264
csp/composed-75-1-40/ normalized-composed-75-1-40-2_ext.xml	UNSAT TT=0.05	UNSAT TT=0.938 CHECKS=2453 NODES=6	UNSAT TT=1.029 CHECKS=11787 NODES=0	UNSAT TT=0.407	UNSAT TT=0.129 CHECKS=20089	UNSAT TT=0.081 CHECKS=5532	UNSAT TT=0.804 ASSIGNMENTS=0	UNSAT TT=1.001 ASSIGNMENTS=0	UNSAT TT=0.799 CHECKS=6663 NODES=40	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.062 ASSIGNMENTS=227 CHECKS=23545	UNSAT TT=0.066 ASSIGNMENTS=227 CHECKS=23545	UNSAT TT=1.459	UNSAT TT=1.369	UNSAT TT=0.052 ASSIGNMENTS=259 CHECKS=27119	UNSAT TT=0.205 ASSIGNMENTS=5936 CHECKS=878926	UNSAT TT=0.659	UNSAT TT=0.053 ASSIGNMENTS=359 CHECKS=58059	UNSAT TT=0.05 ASSIGNMENTS=227 CHECKS=23545	UNSAT TT=2.496	UNSAT TT=0.1 ASSIGNMENTS=6 CHECKS=4554	UNSAT TT=1.206	UNSAT TT=1.372
csp/composed-75-1-40/ normalized-composed-75-1-40-5_ext.xml	UNSAT TT=0.049	UNSAT TT=0.946 CHECKS=2565 NODES=5	UNSAT TT=1.111 CHECKS=8496 NODES=0	UNSAT TT=0.379	UNSAT TT=0.129 CHECKS=20493	UNSAT TT=0.079 CHECKS=5540	UNSAT TT=0.78 ASSIGNMENTS=0	UNSAT TT=0.907 ASSIGNMENTS=0	UNSAT TT=0.758 CHECKS=7403 NODES=40	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.06 ASSIGNMENTS=192 CHECKS=20622	UNSAT TT=0.058 ASSIGNMENTS=192 CHECKS=20622	UNSAT TT=1.422	UNSAT TT=1.396	UNSAT TT=0.05 ASSIGNMENTS=206 CHECKS=24405	UNSAT TT=0.204 ASSIGNMENTS=5940 CHECKS=826891	UNSAT TT=0.815	UNSAT TT=0.059 ASSIGNMENTS=564 CHECKS=95606	UNSAT TT=0.049 ASSIGNMENTS=192 CHECKS=20622	UNSAT TT=2.356	UNSAT TT=0.101 ASSIGNMENTS=7 CHECKS=4342	UNSAT TT=1.16	UNSAT TT=1.456
csp/composed-75-1-40/ normalized-composed-75-1-40-6_ext.xml	UNSAT TT=0.048	UNSAT TT=0.945 CHECKS=2961 NODES=6	UNSAT TT=1.027 CHECKS=13797 NODES=0	UNSAT TT=0.402	UNSAT TT=0.223 CHECKS=59180	UNSAT TT=0.076 CHECKS=3007	UNSAT TT=0.754 ASSIGNMENTS=0	UNSAT TT=0.831 ASSIGNMENTS=0	UNSAT TT=0.759 CHECKS=6946 NODES=41	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.061 ASSIGNMENTS=179 CHECKS=19905	UNSAT TT=0.061 ASSIGNMENTS=179 CHECKS=19905	UNSAT TT=1.577	UNSAT TT=1.386	UNSAT TT=0.048 ASSIGNMENTS=238 CHECKS=28730	UNSAT TT=0.133 ASSIGNMENTS=3361 CHECKS=469964	UNSAT TT=0.661	UNSAT TT=0.06 ASSIGNMENTS=590 CHECKS=86812	UNSAT TT=0.05 ASSIGNMENTS=179 CHECKS=19905	UNSAT TT=2.514	UNSAT TT=0.091 ASSIGNMENTS=6 CHECKS=3968	UNSAT TT=1.397	UNSAT TT=1.261
csp/composed-75-1-40/ normalized-composed-75-1-40-9_ext.xml	UNSAT TT=0.05	UNSAT TT=0.963 CHECKS=2778 NODES=5	UNSAT TT=0.968 CHECKS=14100 NODES=0	UNSAT TT=0.409	UNSAT TT=0.135 CHECKS=23434	UNSAT TT=0.082 CHECKS=5660	UNSAT TT=0.76 ASSIGNMENTS=0	UNSAT TT=0.99 ASSIGNMENTS=0	UNSAT TT=0.77 CHECKS=6978 NODES=63	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.064 ASSIGNMENTS=254 CHECKS=23092	UNSAT TT=0.063 ASSIGNMENTS=254 CHECKS=23092	UNSAT TT=1.431	UNSAT TT=1.374	UNSAT TT=0.052 ASSIGNMENTS=272 CHECKS=27389	UNSAT TT=0.194 ASSIGNMENTS=6127 CHECKS=787308	UNSAT TT=0.656	UNSAT TT=0.053 ASSIGNMENTS=353 CHECKS=59456	UNSAT TT=0.05 ASSIGNMENTS=254 CHECKS=23092	UNSAT TT=2.446	UNSAT TT=0.099 ASSIGNMENTS=8 CHECKS=3659	UNSAT TT=1.184	UNSAT TT=1.446
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-75-1-80/ normalized-composed-75-1-80-1_ext.xml	UNSAT TT=0.049	UNSAT TT=1.109 CHECKS=3548 NODES=6	UNSAT TT=1.023 CHECKS=12036 NODES=0	UNSAT TT=0.417	UNSAT TT=0.232 CHECKS=61937	UNSAT TT=0.084 CHECKS=6114	UNSAT TT=0.826 ASSIGNMENTS=0	UNSAT TT=0.791 ASSIGNMENTS=0	UNSAT TT=0.776 CHECKS=5267 NODES=30	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.065 ASSIGNMENTS=181 CHECKS=25346	UNSAT TT=0.06 ASSIGNMENTS=181 CHECKS=25346	UNSAT TT=1.588	UNSAT TT=1.306	UNSAT TT=0.053 ASSIGNMENTS=215 CHECKS=34722	UNSAT TT=0.155 ASSIGNMENTS=3438 CHECKS=598000	UNSAT TT=0.669	UNSAT TT=0.049 ASSIGNMENTS=173 CHECKS=32381	UNSAT TT=0.051 ASSIGNMENTS=181 CHECKS=25346	UNSAT TT=2.672	UNSAT TT=0.104 ASSIGNMENTS=8 CHECKS=7474	UNSAT TT=1.386	UNSAT TT=1.235
csp/composed-75-1-80/ normalized-composed-75-1-80-3_ext.xml	UNSAT TT=0.047	UNSAT TT=0.944 CHECKS=3487 NODES=6	UNSAT TT=1.104 CHECKS=6399 NODES=0	UNSAT TT=0.416	UNSAT TT=0.247 CHECKS=69188	UNSAT TT=0.09 CHECKS=8103	UNSAT TT=0.774 ASSIGNMENTS=0	UNSAT TT=0.816 ASSIGNMENTS=0	UNSAT TT=0.722 CHECKS=4469 NODES=31	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=0.056 ASSIGNMENTS=114 CHECKS=19207	UNSAT TT=0.06 ASSIGNMENTS=114 CHECKS=19207	UNSAT TT=1.363	UNSAT TT=1.524	UNSAT TT=0.047 ASSIGNMENTS=122 CHECKS=25767	UNSAT TT=0.069 ASSIGNMENTS=815 CHECKS=157633	UNSAT TT=0.63	UNSAT TT=0.049 ASSIGNMENTS=158 CHECKS=29975	UNSAT TT=0.048 ASSIGNMENTS=114 CHECKS=19207	UNSAT TT=2.486	UNSAT TT=0.104 ASSIGNMENTS=5 CHECKS=7797	UNSAT TT=1.359	UNSAT TT=1.228
csp/composed-75-1-80/ normalized-composed-75-1-80-6_ext.xml	UNSAT TT=0.05	UNSAT TT=0.981 CHECKS=3918 NODES=6	UNSAT TT=0.962 CHECKS=8245 NODES=0	UNSAT TT=0.39	UNSAT TT=0.216 CHECKS=64176	UNSAT TT=0.078 CHECKS=6342	UNSAT TT=0.776 ASSIGNMENTS=0	UNSAT TT=0.948 ASSIGNMENTS=0	UNSAT TT=0.843 CHECKS=5346 NODES=28	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=0.058 ASSIGNMENTS=137 CHECKS=22217	UNSAT TT=0.057 ASSIGNMENTS=137 CHECKS=22217	UNSAT TT=1.385	UNSAT TT=1.404	UNSAT TT=0.052 ASSIGNMENTS=172 CHECKS=26930	UNSAT TT=0.161 ASSIGNMENTS=3825 CHECKS=727874	UNSAT TT=0.629	UNSAT TT=0.053 ASSIGNMENTS=203 CHECKS=39726	UNSAT TT=0.05 ASSIGNMENTS=137 CHECKS=22217	UNSAT TT=2.702	UNSAT TT=0.105 ASSIGNMENTS=7 CHECKS=7103	UNSAT TT=1.392	UNSAT TT=1.305
csp/composed-75-1-80/ normalized-composed-75-1-80-8_ext.xml	UNSAT TT=0.045	UNSAT TT=0.956 CHECKS=2943 NODES=3	UNSAT TT=1.015 CHECKS=8962 NODES=0	UNSAT TT=0.392	UNSAT TT=0.241 CHECKS=74686	UNSAT TT=0.086 CHECKS=7160	UNSAT TT=0.767 ASSIGNMENTS=0	UNSAT TT=0.813 ASSIGNMENTS=0	UNSAT TT=0.779 CHECKS=5973 NODES=32	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.059 ASSIGNMENTS=80 CHECKS=18864	UNSAT TT=0.06 ASSIGNMENTS=80 CHECKS=18864	UNSAT TT=1.452	UNSAT TT=1.347	UNSAT TT=0.05 ASSIGNMENTS=101 CHECKS=27615	UNSAT TT=0.171 ASSIGNMENTS=3589 CHECKS=710950	UNSAT TT=0.834	UNSAT TT=0.045 ASSIGNMENTS=118 CHECKS=24676	UNSAT TT=0.047 ASSIGNMENTS=80 CHECKS=18864	UNSAT TT=2.691	UNSAT TT=0.115 ASSIGNMENTS=8 CHECKS=8407	UNSAT TT=1.315	UNSAT TT=1.385
csp/composed-75-1-80/ normalized-composed-75-1-80-9_ext.xml	UNSAT TT=0.046	UNSAT TT=0.973 CHECKS=3562 NODES=5	UNSAT TT=0.944 CHECKS=10216 NODES=0	UNSAT TT=0.415	UNSAT TT=0.223 CHECKS=59283	UNSAT TT=0.075 CHECKS=3521	UNSAT TT=0.773 ASSIGNMENTS=0	UNSAT TT=0.78 ASSIGNMENTS=0	UNSAT TT=0.783 CHECKS=4457 NODES=24	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.063 ASSIGNMENTS=150 CHECKS=23040	UNSAT TT=0.061 ASSIGNMENTS=150 CHECKS=23040	UNSAT TT=1.337	UNSAT TT=1.398	UNSAT TT=0.052 ASSIGNMENTS=232 CHECKS=34355	UNSAT TT=0.199 ASSIGNMENTS=5068 CHECKS=949522	UNSAT TT=0.668	UNSAT TT=0.046 ASSIGNMENTS=115 CHECKS=22510	UNSAT TT=0.051 ASSIGNMENTS=150 CHECKS=23040	UNSAT TT=2.685	UNSAT TT=0.096 ASSIGNMENTS=8 CHECKS=7375	UNSAT TT=1.144	UNSAT TT=1.285
csp/ehi-85/ normalized-ehi-85-297-27_ext.xml	UNSAT TT=0.117	UNSAT TT=2.884 CHECKS=3285910 NODES=3193	UNSAT TT=1.264 CHECKS=36905 NODES=0	UNSAT TT=0.476	UNSAT TT=2.05 CHECKS=266353	UNSAT TT=0.565 CHECKS=6912	UNSAT TT=1.141 ASSIGNMENTS=0	UNSAT TT=0.97 ASSIGNMENTS=0	UNSAT TT=3.067 CHECKS=7188 NODES=5	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.139 ASSIGNMENTS=40 CHECKS=53540	UNSAT TT=0.126 ASSIGNMENTS=40 CHECKS=53540	UNSAT TT=4.837	UNSAT TT=4.281	UNSAT TT=0.267 ASSIGNMENTS=275 CHECKS=649240	UNSAT TT=1.299 ASSIGNMENTS=2191 CHECKS=4715440	UNSAT TT=1.645	UNSAT TT=0.117 ASSIGNMENTS=5 CHECKS=9371	UNSAT TT=0.124 ASSIGNMENTS=40 CHECKS=53540	UNSAT TT=4.059	UNSAT TT=2.306 ASSIGNMENTS=3 CHECKS=6698	UNSAT TT=2.043	UNSAT TT=2.695
csp/ehi-85/ normalized-ehi-85-297-30_ext.xml	UNSAT TT=0.117	UNSAT TT=1.694 CHECKS=869721 NODES=638	UNSAT TT=1.386 CHECKS=89206 NODES=0	UNSAT TT=113.315	UNSAT TT=0.641 CHECKS=16582	UNSAT TT=0.568 CHECKS=9590	UNSAT TT=1.164 ASSIGNMENTS=0	UNSAT TT=1.176 ASSIGNMENTS=0	UNSAT TT=3.156 CHECKS=12777 NODES=6	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.159 ASSIGNMENTS=71 CHECKS=185987	UNSAT TT=0.172 ASSIGNMENTS=71 CHECKS=185987	UNSAT TT=4.979	UNSAT TT=3.92	UNSAT TT=0.321 ASSIGNMENTS=413 CHECKS=983353	UNSAT TT=0.984 ASSIGNMENTS=1687 CHECKS=3505690	UNSAT TT=1.519	UNSAT TT=0.117 ASSIGNMENTS=15 CHECKS=17557	UNSAT TT=0.155 ASSIGNMENTS=71 CHECKS=185987	UNSAT TT=4.023	UNSAT TT=1.506 ASSIGNMENTS=4 CHECKS=23638	UNSAT TT=2.236	UNSAT TT=2.24
csp/ehi-85/ normalized-ehi-85-297-55_ext.xml	UNSAT TT=0.113	UNSAT TT=2.441 CHECKS=2418180 NODES=2647	UNSAT TT=1.397 CHECKS=123287 NODES=0	UNSAT TT=174.964	UNSAT TT=1.756 CHECKS=218889	UNSAT TT=0.607 CHECKS=9329	UNSAT TT=1.167 ASSIGNMENTS=0	UNSAT TT=1.165 ASSIGNMENTS=0	UNSAT TT=2.813 CHECKS=6773 NODES=4	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.199 ASSIGNMENTS=149 CHECKS=319842	UNSAT TT=0.202 ASSIGNMENTS=149 CHECKS=319842	UNSAT TT=4.401	UNSAT TT=4.392	UNSAT TT=0.28 ASSIGNMENTS=361 CHECKS=712175	UNSAT TT=1.803 ASSIGNMENTS=3270 CHECKS=6926100	UNSAT TT=1.713	UNSAT TT=0.113 ASSIGNMENTS=8 CHECKS=13223	UNSAT TT=0.189 ASSIGNMENTS=149 CHECKS=319842	UNSAT TT=4.315	UNSAT TT=1.203 ASSIGNMENTS=4 CHECKS=13836	UNSAT TT=2.319	UNSAT TT=2.653
csp/ehi-85/ normalized-ehi-85-297-78_ext.xml	UNSAT TT=0.116	UNSAT TT=1.785 CHECKS=1322880 NODES=951	UNSAT TT=1.278 CHECKS=25156 NODES=0	UNSAT TT=0.481	UNSAT TT=0.684 CHECKS=20921	UNSAT TT=0.532 CHECKS=7925	UNSAT TT=0.916 ASSIGNMENTS=0	UNSAT TT=0.909 ASSIGNMENTS=0	UNSAT TT=2.747 CHECKS=9420 NODES=9	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.169 ASSIGNMENTS=99 CHECKS=168372	UNSAT TT=0.163 ASSIGNMENTS=99 CHECKS=168372	UNSAT TT=4.797	UNSAT TT=4.208	UNSAT TT=0.354 ASSIGNMENTS=357 CHECKS=998078	UNSAT TT=1.799 ASSIGNMENTS=3047 CHECKS=6753030	UNSAT TT=1.596	UNSAT TT=0.116 ASSIGNMENTS=5 CHECKS=10548	UNSAT TT=0.15 ASSIGNMENTS=99 CHECKS=168372	UNSAT TT=3.915	UNSAT TT=0.509 ASSIGNMENTS=4 CHECKS=13540	UNSAT TT=2.081	UNSAT TT=2.476
csp/ehi-85/ normalized-ehi-85-297-96_ext.xml	UNSAT TT=0.114	UNSAT TT=1.774 CHECKS=1016450 NODES=987	UNSAT TT=1.272 CHECKS=13771 NODES=0	UNSAT TT=0.488	UNSAT TT=0.655 CHECKS=15148	UNSAT TT=0.619 CHECKS=10155	UNSAT TT=1.06 ASSIGNMENTS=0	UNSAT TT=0.969 ASSIGNMENTS=0	UNSAT TT=2.785 CHECKS=7433 NODES=4	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=0.13 ASSIGNMENTS=4 CHECKS=8886	UNSAT TT=0.129 ASSIGNMENTS=4 CHECKS=8886	UNSAT TT=4.858	UNSAT TT=3.981	UNSAT TT=0.119 ASSIGNMENTS=4 CHECKS=8925	UNSAT TT=1.935 ASSIGNMENTS=3569 CHECKS=7550430	UNSAT TT=1.628	UNSAT TT=0.115 ASSIGNMENTS=9 CHECKS=14698	UNSAT TT=0.114 ASSIGNMENTS=4 CHECKS=8886	UNSAT TT=3.896	UNSAT TT=0.8 ASSIGNMENTS=3 CHECKS=17099	UNSAT TT=2.054	UNSAT TT=2.501
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ehi-90/ normalized-ehi-90-315-51_ext.xml	UNSAT TT=0.121	UNSAT TT=2.365 CHECKS=2305600 NODES=2598	UNSAT TT=1.267 CHECKS=13957 NODES=0	UNSAT TT=0.477	UNSAT TT=0.657 CHECKS=15653	UNSAT TT=0.606 CHECKS=9327	UNSAT TT=0.904 ASSIGNMENTS=0	UNSAT TT=0.923 ASSIGNMENTS=0	UNSAT TT=3.124 CHECKS=8151 NODES=8	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.204 ASSIGNMENTS=136 CHECKS=288941	UNSAT TT=0.199 ASSIGNMENTS=136 CHECKS=288941	UNSAT TT=4.572	UNSAT TT=4.557	UNSAT TT=0.247 ASSIGNMENTS=298 CHECKS=607334	UNSAT TT=2.26 ASSIGNMENTS=3655 CHECKS=8660490	UNSAT TT=1.638	UNSAT TT=0.121 ASSIGNMENTS=4 CHECKS=10599	UNSAT TT=0.177 ASSIGNMENTS=136 CHECKS=288941	UNSAT TT=4.065	UNSAT TT=1.051 ASSIGNMENTS=5 CHECKS=14051	UNSAT TT=2.456	UNSAT TT=2.286
csp/ehi-90/ normalized-ehi-90-315-54_ext.xml	UNSAT TT=0.12	UNSAT TT=1.718 CHECKS=1007030 NODES=764	UNSAT TT=1.325 CHECKS=8062 NODES=0	UNSAT TT=0.506	UNSAT TT=0.647 CHECKS=15589	UNSAT TT=0.594 CHECKS=11232	UNSAT TT=0.947 ASSIGNMENTS=0	UNSAT TT=0.908 ASSIGNMENTS=0	UNSAT TT=3.004 CHECKS=5566 NODES=6	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=0.192 ASSIGNMENTS=136 CHECKS=317649	UNSAT TT=0.193 ASSIGNMENTS=136 CHECKS=317649	UNSAT TT=4.621	UNSAT TT=4.449	UNSAT TT=0.444 ASSIGNMENTS=534 CHECKS=1286630	UNSAT TT=1.884 ASSIGNMENTS=3315 CHECKS=7238890	UNSAT TT=1.466	UNSAT TT=0.12 ASSIGNMENTS=5 CHECKS=9936	UNSAT TT=0.184 ASSIGNMENTS=136 CHECKS=317649	UNSAT TT=3.824	UNSAT TT=1.363 ASSIGNMENTS=17 CHECKS=40585	UNSAT TT=2.183	UNSAT TT=2.731
csp/ehi-90/ normalized-ehi-90-315-65_ext.xml	UNSAT TT=0.12	UNSAT TT=1.987 CHECKS=1482220 NODES=1255	UNSAT TT=1.306 CHECKS=16111 NODES=0	UNSAT TT=0.505	UNSAT TT=0.643 CHECKS=10958	UNSAT TT=0.564 CHECKS=8441	UNSAT TT=0.953 ASSIGNMENTS=0	UNSAT TT=0.957 ASSIGNMENTS=0	UNSAT TT=3.205 CHECKS=7211 NODES=4	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=0.134 ASSIGNMENTS=4 CHECKS=10425	UNSAT TT=0.136 ASSIGNMENTS=4 CHECKS=10425	UNSAT TT=4.571	UNSAT TT=4.284	UNSAT TT=0.272 ASSIGNMENTS=277 CHECKS=622360	UNSAT TT=0.686 ASSIGNMENTS=1149 CHECKS=2491840	UNSAT TT=1.646	UNSAT TT=0.12 ASSIGNMENTS=5 CHECKS=10432	UNSAT TT=0.122 ASSIGNMENTS=4 CHECKS=10425	UNSAT TT=3.994	UNSAT TT=1.589 ASSIGNMENTS=4 CHECKS=15331	UNSAT TT=2.144	UNSAT TT=2.437
csp/ehi-90/ normalized-ehi-90-315-71_ext.xml	UNSAT TT=0.121	UNSAT TT=2.521 CHECKS=2640420 NODES=2648	UNSAT TT=1.259 CHECKS=11438 NODES=0	UNSAT TT=0.502	UNSAT TT=0.65 CHECKS=18297	UNSAT TT=0.552 CHECKS=8734	UNSAT TT=0.883 ASSIGNMENTS=0	UNSAT TT=0.968 ASSIGNMENTS=0	UNSAT TT=3.071 CHECKS=5925 NODES=5	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.159 ASSIGNMENTS=53 CHECKS=108868	UNSAT TT=0.156 ASSIGNMENTS=53 CHECKS=108868	UNSAT TT=4.592	UNSAT TT=4.417	UNSAT TT=0.325 ASSIGNMENTS=327 CHECKS=913000	UNSAT TT=1.124 ASSIGNMENTS=1792 CHECKS=4009430	UNSAT TT=1.59	UNSAT TT=0.121 ASSIGNMENTS=5 CHECKS=10324	UNSAT TT=0.139 ASSIGNMENTS=53 CHECKS=108868	UNSAT TT=4.203	UNSAT TT=1.619 ASSIGNMENTS=5 CHECKS=16829	UNSAT TT=2.24	UNSAT TT=2.611
csp/ehi-90/ normalized-ehi-90-315-95_ext.xml	UNSAT TT=0.114	UNSAT TT=1.996 CHECKS=877654 NODES=1509	UNSAT TT=1.37 CHECKS=66886 NODES=0	UNSAT TT=34.105	UNSAT TT=0.61 CHECKS=15631	UNSAT TT=0.556 CHECKS=6983	UNSAT TT=0.879 ASSIGNMENTS=0	UNSAT TT=0.953 ASSIGNMENTS=0	UNSAT TT=3.118 CHECKS=6624 NODES=4	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.134 ASSIGNMENTS=23 CHECKS=18243	UNSAT TT=0.13 ASSIGNMENTS=23 CHECKS=18243	UNSAT TT=4.547	UNSAT TT=4.613	UNSAT TT=0.129 ASSIGNMENTS=71 CHECKS=41844	UNSAT TT=1.017 ASSIGNMENTS=1621 CHECKS=3669060	UNSAT TT=1.511	UNSAT TT=0.114 ASSIGNMENTS=4 CHECKS=9430	UNSAT TT=0.125 ASSIGNMENTS=23 CHECKS=18243	UNSAT TT=3.853	UNSAT TT=2.05 ASSIGNMENTS=3 CHECKS=8570	UNSAT TT=2.159	UNSAT TT=2.525
csp/geom/ normalized-geo50-20-d4-75-18_ext.xml	SAT TT=0.081	SAT TT=1.266 CHECKS=68641 NODES=97	SAT TT=0.991 CHECKS=89174 NODES=58	SAT TT=1.231	SAT TT=0.483 CHECKS=48545	SAT TT=0.278 CHECKS=17437	SAT TT=1.107 ASSIGNMENTS=62	SAT TT=1.113 ASSIGNMENTS=62	SAT TT=0.913 CHECKS=36939 NODES=234	SAT TT=0.782 CHECKS=218585 NODES=474	SAT TT=1.368 CHECKS=4832670 NODES=7293	SAT TT=0.094 ASSIGNMENTS=110 CHECKS=53835	SAT TT=0.095 ASSIGNMENTS=110 CHECKS=53835	SAT TT=4.098	SAT TT=3.394	SAT TT=0.081 ASSIGNMENTS=103 CHECKS=48110	SAT TT=0.435 ASSIGNMENTS=4975 CHECKS=1398780	SAT TT=2.128	SAT TT=0.148 ASSIGNMENTS=1125 CHECKS=357505	SAT TT=0.081 ASSIGNMENTS=110 CHECKS=53835	SAT TT=3.515	SAT TT=0.257 ASSIGNMENTS=62 CHECKS=80140	SAT TT=1.734	SAT TT=1.899
csp/geom/ normalized-geo50-20-d4-75-40_ext.xml	SAT TT=0.057	SAT TT=0.963 CHECKS=17947 NODES=54	SAT TT=0.99 CHECKS=53787 NODES=52	SAT TT=1.025	SAT TT=0.274 CHECKS=12365	SAT TT=0.184 CHECKS=2024	SAT TT=0.831 ASSIGNMENTS=31	SAT TT=0.807 ASSIGNMENTS=31	SAT TT=0.746 CHECKS=10454 NODES=69	SAT TT=0.737 CHECKS=65689 NODES=100	SAT TT=0.929 CHECKS=114498 NODES=138	SAT TT=0.073 ASSIGNMENTS=33 CHECKS=4305	SAT TT=0.072 ASSIGNMENTS=33 CHECKS=4305	SAT TT=3.298	SAT TT=3.113	SAT TT=0.057 ASSIGNMENTS=33 CHECKS=4305	SAT TT=0.061 ASSIGNMENTS=21 CHECKS=3718	SAT TT=0.989	SAT TT=0.066 ASSIGNMENTS=104 CHECKS=26390	SAT TT=0.061 ASSIGNMENTS=33 CHECKS=4305	SAT TT=2.387	SAT TT=0.15 ASSIGNMENTS=50 CHECKS=44682	SAT TT=1.542	SAT TT=1.782
csp/geom/ normalized-geo50-20-d4-75-42_ext.xml	SAT TT=0.067	SAT TT=0.937 CHECKS=18396 NODES=50	SAT TT=1.045 CHECKS=63541 NODES=50	SAT TT=1.196	SAT TT=0.313 CHECKS=21426	SAT TT=0.21 CHECKS=5152	SAT TT=1.038 ASSIGNMENTS=31	SAT TT=0.885 ASSIGNMENTS=31	SAT TT=0.964 CHECKS=15810 NODES=99	SAT TT=0.812 CHECKS=95424 NODES=183	SAT TT=0.806 CHECKS=95470 NODES=99	SAT TT=0.079 ASSIGNMENTS=42 CHECKS=9017	SAT TT=0.074 ASSIGNMENTS=42 CHECKS=9017	SAT TT=3.75	SAT TT=2.91	SAT TT=0.069 ASSIGNMENTS=42 CHECKS=9434	SAT TT=0.268 ASSIGNMENTS=4339 CHECKS=874003	SAT TT=0.852	SAT TT=0.126 ASSIGNMENTS=1144 CHECKS=281803	SAT TT=0.067 ASSIGNMENTS=42 CHECKS=9017	SAT TT=2.667	SAT TT=0.16 ASSIGNMENTS=100 CHECKS=72018	SAT TT=1.825	SAT TT=1.819
csp/geom/ normalized-geo50-20-d4-75-45_ext.xml	SAT TT=0.069	SAT TT=1.077 CHECKS=628215 NODES=487	SAT TT=1.173 CHECKS=108918 NODES=81	SAT TT=1.185	SAT TT=1.094 CHECKS=191078	SAT TT=0.331 CHECKS=29852	SAT TT=0.943 ASSIGNMENTS=185	SAT TT=1.024 ASSIGNMENTS=185	SAT TT=1.002 CHECKS=65734 NODES=557	SAT TT=0.788 CHECKS=359377 NODES=822	SAT TT=0.808 CHECKS=185624 NODES=287	SAT TT=0.083 ASSIGNMENTS=106 CHECKS=32570	SAT TT=0.083 ASSIGNMENTS=106 CHECKS=32570	SAT TT=3.53	SAT TT=7.458	SAT TT=0.079 ASSIGNMENTS=222 CHECKS=79863	SAT TT=0.315 ASSIGNMENTS=4708 CHECKS=1024100	SAT TT=1.187	SAT TT=0.16 ASSIGNMENTS=1395 CHECKS=421629	SAT TT=0.069 ASSIGNMENTS=106 CHECKS=32570	SAT TT=4.51	SAT TT=0.233 ASSIGNMENTS=82 CHECKS=126800	SAT TT=1.655	SAT TT=2.206
csp/geom/ normalized-geo50-20-d4-75-49_ext.xml	SAT TT=0.07	SAT TT=0.963 CHECKS=56150 NODES=83	SAT TT=1.049 CHECKS=124721 NODES=91	SAT TT=1.269	SAT TT=0.389 CHECKS=28976	SAT TT=0.225 CHECKS=5981	SAT TT=0.85 ASSIGNMENTS=54	SAT TT=0.85 ASSIGNMENTS=54	SAT TT=0.865 CHECKS=37777 NODES=338	SAT TT=1.193 CHECKS=3438000 NODES=9335	SAT TT=0.802 CHECKS=347199 NODES=553	SAT TT=0.082 ASSIGNMENTS=69 CHECKS=21485	SAT TT=0.086 ASSIGNMENTS=69 CHECKS=21485	SAT TT=3.919	SAT TT=3.486	SAT TT=0.07 ASSIGNMENTS=64 CHECKS=18153	SAT TT=0.325 ASSIGNMENTS=4391 CHECKS=1032260	SAT TT=1.383	SAT TT=0.13 ASSIGNMENTS=1125 CHECKS=308038	SAT TT=0.075 ASSIGNMENTS=69 CHECKS=21485	SAT TT=2.886	SAT TT=0.283 ASSIGNMENTS=55 CHECKS=54416	SAT TT=1.879	SAT TT=1.897
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/geom/ normalized-geo50-20-d4-75-5_ext.xml	SAT TT=0.065	SAT TT=0.966 CHECKS=21864 NODES=57	SAT TT=0.972 CHECKS=93282 NODES=72	SAT TT=1.096	SAT TT=0.37 CHECKS=37136	SAT TT=0.218 CHECKS=10452	SAT TT=0.883 ASSIGNMENTS=75	SAT TT=1.109 ASSIGNMENTS=75	SAT TT=0.759 CHECKS=13455 NODES=98	SAT TT=0.76 CHECKS=391035 NODES=1032	SAT TT=0.724 CHECKS=92963 NODES=114	SAT TT=0.081 ASSIGNMENTS=117 CHECKS=29885	SAT TT=0.079 ASSIGNMENTS=117 CHECKS=29885	SAT TT=3.19	SAT TT=3.185	SAT TT=0.065 ASSIGNMENTS=99 CHECKS=23863	SAT TT=0.181 ASSIGNMENTS=2871 CHECKS=457140	SAT TT=0.996	SAT TT=0.117 ASSIGNMENTS=1133 CHECKS=240310	SAT TT=0.066 ASSIGNMENTS=117 CHECKS=29885	SAT TT=2.937	SAT TT=0.197 ASSIGNMENTS=88 CHECKS=83049	SAT TT=1.821	SAT TT=1.739
csp/geom/ normalized-geo50-20-d4-75-61_ext.xml	SAT TT=0.061	SAT TT=0.954 CHECKS=38010 NODES=91	SAT TT=1.03 CHECKS=97739 NODES=92	SAT TT=1.047	SAT TT=0.324 CHECKS=26359	SAT TT=0.202 CHECKS=5972	SAT TT=1.039 ASSIGNMENTS=44	SAT TT=0.865 ASSIGNMENTS=44	SAT TT=0.789 CHECKS=11221 NODES=76	SAT TT=0.784 CHECKS=176540 NODES=412	SAT TT=0.778 CHECKS=345412 NODES=608	SAT TT=0.075 ASSIGNMENTS=47 CHECKS=11763	SAT TT=0.074 ASSIGNMENTS=47 CHECKS=11763	SAT TT=3.453	SAT TT=2.81	SAT TT=0.066 ASSIGNMENTS=47 CHECKS=12102	SAT TT=0.216 ASSIGNMENTS=3897 CHECKS=652392	SAT TT=1.02	SAT TT=0.075 ASSIGNMENTS=374 CHECKS=97387	SAT TT=0.061 ASSIGNMENTS=47 CHECKS=11763	SAT TT=2.625	SAT TT=0.169 ASSIGNMENTS=87 CHECKS=98809	SAT TT=1.852	SAT TT=2.043
csp/geom/ normalized-geo50-20-d4-75-76_ext.xml	SAT TT=0.055	SAT TT=0.955 CHECKS=15975 NODES=50	SAT TT=0.927 CHECKS=50973 NODES=50	SAT TT=1.057	SAT TT=0.274 CHECKS=13171	SAT TT=0.18 CHECKS=2113	SAT TT=0.831 ASSIGNMENTS=35	SAT TT=0.841 ASSIGNMENTS=35	SAT TT=0.889 CHECKS=10428 NODES=79	SAT TT=0.722 CHECKS=73141 NODES=138	SAT TT=0.773 CHECKS=67642 NODES=73	SAT TT=0.072 ASSIGNMENTS=32 CHECKS=3782	SAT TT=0.071 ASSIGNMENTS=32 CHECKS=3782	SAT TT=3.385	SAT TT=2.817	SAT TT=0.061 ASSIGNMENTS=32 CHECKS=3782	SAT TT=0.061 ASSIGNMENTS=29 CHECKS=4008	SAT TT=0.797	SAT TT=0.062 ASSIGNMENTS=183 CHECKS=29602	SAT TT=0.055 ASSIGNMENTS=32 CHECKS=3782	SAT TT=2.373	SAT TT=0.151 ASSIGNMENTS=53 CHECKS=46198	SAT TT=1.599	SAT TT=1.922
csp/geom/ normalized-geo50-20-d4-75-94_ext.xml	UNSAT TT=33.347	UNSAT TT=117.775 CHECKS=760436000 NODES=317038	UNSAT TT=117.55 CHECKS=758397000 NODES=316376	UNSAT TT=207.383	UNSAT TT=931.035 CHECKS=182508000	UNSAT TT=396.495 CHECKS=77508800	UNSAT TT=125.408 ASSIGNMENTS=100194	UNSAT TT=125.617 ASSIGNMENTS=100194	UNSAT TT=98.615 CHECKS=27324700 NODES=201897	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=118.475 ASSIGNMENTS=317038 CHECKS=760436000	UNSAT TT=116.389 ASSIGNMENTS=317038 CHECKS=760436000	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=33.347 ASSIGNMENTS=196882 CHECKS=133720000	UNSAT TT=33.477 ASSIGNMENTS=198475 CHECKS=134262000	UNSAT TT=1354.74	UNSAT TT=33.612 ASSIGNMENTS=197273 CHECKS=133647000	UNSAT TT=33.943 ASSIGNMENTS=200233 CHECKS=136053000	? (TO) TT=1800.2	UNSAT TT=573.984 ASSIGNMENTS=210104 CHECKS=748427000	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/geom/ normalized-geo50-20-d4-75-9_ext.xml	SAT TT=0.299	SAT TT=1.17 CHECKS=302609 NODES=244	SAT TT=1.26 CHECKS=432669 NODES=267	SAT TT=3.934	SAT TT=13.154 CHECKS=2891450	SAT TT=6.423 CHECKS=1253930	SAT TT=7.53 ASSIGNMENTS=6872	SAT TT=8.305 ASSIGNMENTS=6872	SAT TT=2.806 CHECKS=634910 NODES=4999	SAT TT=1.545 CHECKS=5144880 NODES=13132	? (TO) TT=1800.07	SAT TT=0.773 ASSIGNMENTS=5119 CHECKS=2820590	SAT TT=0.822 ASSIGNMENTS=5119 CHECKS=2820590	SAT TT=10.023	SAT TT=20.472	SAT TT=1.008 ASSIGNMENTS=7007 CHECKS=3885630	SAT TT=1.772 ASSIGNMENTS=14132 CHECKS=6607620	SAT TT=20.917	SAT TT=0.299 ASSIGNMENTS=2109 CHECKS=947107	SAT TT=0.811 ASSIGNMENTS=5119 CHECKS=2820590	SAT TT=3.138	SAT TT=0.672 ASSIGNMENTS=58 CHECKS=82264	SAT TT=1.897	SAT TT=6.247
csp/lard/ normalized-lard-83-83.xml	SAT TT=10.523	SAT TT=15.563 CHECKS=628603 NODES=83	SAT TT=16.663 CHECKS=609336 NODES=0	? (problem) TT=295.569	? TT=25.698	? TT=23.439	SAT TT=16.305 ASSIGNMENTS=84	SAT TT=16.005 ASSIGNMENTS=84	SAT TT=53.668 CHECKS=297801 NODES=83	SAT TT=49.869 CHECKS=598266 NODES=4	SAT TT=52.744 CHECKS=615327 NODES=5	SAT TT=11.635 ASSIGNMENTS=83 CHECKS=13842	SAT TT=11.774 ASSIGNMENTS=83 CHECKS=13842	? (problem) TT=133.439	? (problem) TT=133.725	SAT TT=11.564 ASSIGNMENTS=83 CHECKS=13842	SAT TT=11.227 ASSIGNMENTS=83 CHECKS=14089	? (exit code) TT=29.978	SAT TT=11.446 ASSIGNMENTS=83 CHECKS=20092	SAT TT=10.523 ASSIGNMENTS=83 CHECKS=13842	SAT TT=56.082	SAT TT=32.246 ASSIGNMENTS=83 CHECKS=432750	? (MO) TT=25.38	? (MO) TT=24.65
csp/lard/ normalized-lard-84-84.xml	SAT TT=11.147	SAT TT=16.266 CHECKS=642809 NODES=84	SAT TT=16.113 CHECKS=609986 NODES=0	? (problem) TT=309.616	? TT=24.217	? TT=27.203	SAT TT=15.315 ASSIGNMENTS=85	SAT TT=15.726 ASSIGNMENTS=85	SAT TT=56.9 CHECKS=305592 NODES=84	SAT TT=51.775 CHECKS=599734 NODES=0	SAT TT=51.145 CHECKS=599734 NODES=0	SAT TT=12.337 ASSIGNMENTS=84 CHECKS=14093	SAT TT=12.203 ASSIGNMENTS=84 CHECKS=14093	? (problem) TT=172.57	? (problem) TT=196.036	SAT TT=12.085 ASSIGNMENTS=84 CHECKS=14093	SAT TT=11.985 ASSIGNMENTS=84 CHECKS=14706	? (exit code) TT=27.739	SAT TT=11.147 ASSIGNMENTS=61 CHECKS=14025	SAT TT=12.077 ASSIGNMENTS=84 CHECKS=14093	SAT TT=53.751	SAT TT=34.263 ASSIGNMENTS=84 CHECKS=436939	? (MO) TT=25.881	? (MO) TT=27.097
csp/lard/ normalized-lard-85-85.xml	SAT TT=11.518	SAT TT=16.662 CHECKS=671476 NODES=85	SAT TT=16.891 CHECKS=655479 NODES=0	? (problem) TT=325.392	? TT=26.619	? TT=30.397	SAT TT=16.562 ASSIGNMENTS=86	SAT TT=16.287 ASSIGNMENTS=86	SAT TT=58.273 CHECKS=319416 NODES=85	SAT TT=54.862 CHECKS=641534 NODES=4	SAT TT=58.984 CHECKS=652287 NODES=4	SAT TT=12.516 ASSIGNMENTS=85 CHECKS=14456	SAT TT=12.479 ASSIGNMENTS=85 CHECKS=14456	? (problem) TT=299.59	? (problem) TT=280.807	SAT TT=12.13 ASSIGNMENTS=85 CHECKS=14456	SAT TT=11.725 ASSIGNMENTS=85 CHECKS=14842	? (exit code) TT=30.806	SAT TT=11.518 ASSIGNMENTS=85 CHECKS=21086	SAT TT=12.839 ASSIGNMENTS=85 CHECKS=14456	SAT TT=59.26	SAT TT=33.244 ASSIGNMENTS=85 CHECKS=589557	? (MO) TT=26.741	? (MO) TT=26.135
csp/lard/ normalized-lard-86-86.xml	SAT TT=12.162	SAT TT=18.713 CHECKS=640681 NODES=86	SAT TT=17.579 CHECKS=599048 NODES=0	? (problem) TT=351.267	? TT=28.277	? TT=27.203	SAT TT=17.375 ASSIGNMENTS=87	SAT TT=17.191 ASSIGNMENTS=87	SAT TT=59.538 CHECKS=327592 NODES=86	SAT TT=56.426 CHECKS=643685 NODES=0	SAT TT=60.952 CHECKS=650920 NODES=1	SAT TT=12.25 ASSIGNMENTS=86 CHECKS=14846	SAT TT=13.362 ASSIGNMENTS=86 CHECKS=14846	? (problem) TT=314.993	? (problem) TT=316.768	SAT TT=13.188 ASSIGNMENTS=86 CHECKS=14846	SAT TT=12.3 ASSIGNMENTS=86 CHECKS=15512	? (exit code) TT=30.537	SAT TT=12.785 ASSIGNMENTS=56 CHECKS=14703	SAT TT=12.162 ASSIGNMENTS=86 CHECKS=14846	SAT TT=60.622	SAT TT=34.721 ASSIGNMENTS=86 CHECKS=470679	? (MO) TT=26.17	? (MO) TT=28.9
csp/lard/ normalized-lard-87-87.xml	SAT TT=12.728	SAT TT=18.288 CHECKS=725372 NODES=87	SAT TT=20.009 CHECKS=706304 NODES=0	? (problem) TT=363.089	? (TO) TT=24.566	Signal TT=25.396	SAT TT=22.495 ASSIGNMENTS=88	SAT TT=21.307 ASSIGNMENTS=88	SAT TT=67.48 CHECKS=342220 NODES=87	SAT TT=58.472 CHECKS=672515 NODES=0	SAT TT=59.423 CHECKS=672458 NODES=0	SAT TT=13.384 ASSIGNMENTS=87 CHECKS=15174	SAT TT=13.451 ASSIGNMENTS=87 CHECKS=15174	? (problem) TT=289.819	? (problem) TT=301.382	SAT TT=12.728 ASSIGNMENTS=87 CHECKS=15174	SAT TT=13.484 ASSIGNMENTS=87 CHECKS=15464	? (exit code) TT=31.218	SAT TT=13.774 ASSIGNMENTS=87 CHECKS=22104	SAT TT=13.504 ASSIGNMENTS=87 CHECKS=15174	SAT TT=61.736	SAT TT=36.457 ASSIGNMENTS=87 CHECKS=632744	? (MO) TT=27.135	? (MO) TT=28.132
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lard/ normalized-lard-88-88.xml	SAT TT=13.17	SAT TT=20.038 CHECKS=670262 NODES=88	SAT TT=20.452 CHECKS=627361 NODES=0	? (problem) TT=367.094	Signal TT=23.602	Signal TT=22.94	SAT TT=26.012 ASSIGNMENTS=89	SAT TT=24.133 ASSIGNMENTS=89	SAT TT=66.564 CHECKS=349356 NODES=88	SAT TT=64.168 CHECKS=687981 NODES=0	SAT TT=62.006 CHECKS=687981 NODES=0	SAT TT=13.299 ASSIGNMENTS=88 CHECKS=15562	SAT TT=13.17 ASSIGNMENTS=88 CHECKS=15562	? (problem) TT=571.502	? (problem) TT=633.913	SAT TT=13.184 ASSIGNMENTS=88 CHECKS=15562	SAT TT=14.142 ASSIGNMENTS=88 CHECKS=16235	? (exit code) TT=50.31	SAT TT=14.175 ASSIGNMENTS=50 CHECKS=15397	SAT TT=14.101 ASSIGNMENTS=88 CHECKS=15562	SAT TT=63.815	SAT TT=38.139 ASSIGNMENTS=88 CHECKS=646732	? (MO) TT=31.88	? (MO) TT=30.05
csp/lard/ normalized-lard-89-89.xml	SAT TT=13.695	SAT TT=19.59 CHECKS=775225 NODES=89	SAT TT=21.185 CHECKS=747565 NODES=0	? (problem) TT=388.757	Signal TT=118.981	Signal TT=20.862	SAT TT=40.868 ASSIGNMENTS=90	SAT TT=38.386 ASSIGNMENTS=90	SAT TT=73.607 CHECKS=366451 NODES=89	SAT TT=66.924 CHECKS=720327 NODES=0	SAT TT=65.288 CHECKS=735912 NODES=2	SAT TT=14.679 ASSIGNMENTS=89 CHECKS=15958	SAT TT=13.695 ASSIGNMENTS=89 CHECKS=15958	? (problem) TT=400.038	? (problem) TT=339.473	SAT TT=14.659 ASSIGNMENTS=89 CHECKS=15958	SAT TT=13.753 ASSIGNMENTS=89 CHECKS=16680	? (exit code) TT=48.914	SAT TT=14.864 ASSIGNMENTS=89 CHECKS=23146	SAT TT=14.354 ASSIGNMENTS=89 CHECKS=15958	SAT TT=68.565	SAT TT=44.124 ASSIGNMENTS=89 CHECKS=533554	? (MO) TT=30.274	? (MO) TT=31.06
csp/lard/ normalized-lard-90-90.xml	SAT TT=14.5	SAT TT=21.226 CHECKS=780902 NODES=90	SAT TT=20.989 CHECKS=748192 NODES=0	? (problem) TT=406.213	Signal TT=20.87	Signal TT=21.99	? (problem) TT=43.908	? (problem) TT=44.657	SAT TT=73.008 CHECKS=375270 NODES=90	SAT TT=70.671 CHECKS=737295 NODES=0	SAT TT=71.24 CHECKS=737265 NODES=0	SAT TT=16.186 ASSIGNMENTS=90 CHECKS=16212	SAT TT=16.174 ASSIGNMENTS=90 CHECKS=16212	? (problem) TT=333.485	? (problem) TT=359.541	SAT TT=15.742 ASSIGNMENTS=90 CHECKS=16212	SAT TT=14.983 ASSIGNMENTS=90 CHECKS=16676	? (exit code) TT=76.738	SAT TT=15.814 ASSIGNMENTS=54 CHECKS=16107	SAT TT=14.5 ASSIGNMENTS=90 CHECKS=16212	SAT TT=74.997	SAT TT=42.119 ASSIGNMENTS=90 CHECKS=546118	? TT=125.776	? (MO) TT=29.433
csp/lard/ normalized-lard-91-91.xml	SAT TT=15.352	SAT TT=23.42 CHECKS=829260 NODES=91	SAT TT=21.496 CHECKS=805112 NODES=0	? (problem) TT=425.316	? TT=13.181	? TT=12.196	? (problem) TT=48.88	? (problem) TT=51.644	SAT TT=77.897 CHECKS=391143 NODES=91	SAT TT=69.713 CHECKS=769107 NODES=0	SAT TT=71.294 CHECKS=769107 NODES=0	SAT TT=15.352 ASSIGNMENTS=91 CHECKS=16615	SAT TT=16.702 ASSIGNMENTS=91 CHECKS=16615	? (problem) TT=345.317	? (problem) TT=370.751	SAT TT=15.489 ASSIGNMENTS=91 CHECKS=16615	SAT TT=16.587 ASSIGNMENTS=91 CHECKS=17157	? (exit code) TT=44.852	SAT TT=16.54 ASSIGNMENTS=91 CHECKS=24212	SAT TT=16.6 ASSIGNMENTS=91 CHECKS=16615	? TT=133.401	SAT TT=44.893 ASSIGNMENTS=91 CHECKS=725354	? (MO) TT=30.84	? (MO) TT=32.53
csp/lard/ normalized-lard-92-92.xml	SAT TT=16.101	SAT TT=24.186 CHECKS=752761 NODES=92	SAT TT=22.337 CHECKS=695792 NODES=0	? (problem) TT=438.335	? TT=12.767	? TT=13.947	? (problem) TT=43.914	? (problem) TT=48.391	SAT TT=77.563 CHECKS=400632 NODES=92	SAT TT=78.28 CHECKS=787960 NODES=0	SAT TT=73.802 CHECKS=796293 NODES=1	SAT TT=16.359 ASSIGNMENTS=92 CHECKS=17048	SAT TT=17.107 ASSIGNMENTS=92 CHECKS=17048	? (problem) TT=290.549	? (problem) TT=298.832	SAT TT=17.147 ASSIGNMENTS=92 CHECKS=17048	SAT TT=17.444 ASSIGNMENTS=92 CHECKS=18138	? (exit code) TT=58.912	SAT TT=16.101 ASSIGNMENTS=53 CHECKS=16833	SAT TT=16.936 ASSIGNMENTS=92 CHECKS=17048	? TT=131.126	SAT TT=48.858 ASSIGNMENTS=92 CHECKS=575005	? (MO) TT=34.66	? (MO) TT=33.33

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	75	75	64	65	65	72	72	75	24	75	75	64	64	75	75	65	75	75	72	75	64	64
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	75	75	64	65	65	72	72	75	24	75	75	64	64	75	75	65	75	75	72	75	64	64
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	0	0	0	0	0	0	0	0	0	1	2	0	0	19	0	0	22	35	0	0	0	0
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0