CSP 2008 Competition: results by benchmark

Results by benchmark for category n-ary constraints in intension (N-ARY-INT)

This page displays the results of the different solvers for each benchmark for category n-ary constraints in intension (N-ARY-INT)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allIntervalSeries/ normalized-series-100.xml	SAT TT=0.759	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=1.26	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.03	? (MO) TT=1221.49	? (TO) TT=1800.05	SAT TT=4.225 ASSIGNMENTS=774 CHECKS=646882	? (TO) TT=1800.07	SAT TT=0.759 ASSIGNMENTS=1 CHECKS=54843	? (TO) TT=1800.02	? TT=140.01	? (TO) TT=1800.06	? (TO) TT=1800.06
csp/allIntervalSeries/ normalized-series-10.xml	SAT TT=0.009	SAT TT=0.931 CHECKS=108808 NODES=447	SAT TT=0.902 CHECKS=90998 NODES=255	SAT TT=0.038	SAT TT=0.163 CHECKS=385886	SAT TT=0.249 CHECKS=972583	SAT TT=0.885 ASSIGNMENTS=60	SAT TT=0.783 ASSIGNMENTS=4	SAT TT=0.7 CHECKS=76601 NODES=255	SAT TT=1.075 CHECKS=1842810 NODES=17623	SAT TT=0.697 CHECKS=14838 NODES=58	SAT TT=0.135 ASSIGNMENTS=1577 CHECKS=148870	SAT TT=0.126 ASSIGNMENTS=1577 CHECKS=148870	SAT TT=1.521	SAT TT=1.34	SAT TT=0.116 ASSIGNMENTS=1413 CHECKS=141957	SAT TT=0.01 ASSIGNMENTS=15 CHECKS=1335	SAT TT=0.56	SAT TT=0.009 ASSIGNMENTS=1 CHECKS=528	SAT TT=0.013 ASSIGNMENTS=44 CHECKS=4486	SAT TT=2.591	SAT TT=0.879	SAT TT=0.905
csp/allIntervalSeries/ normalized-series-12.xml	SAT TT=0.011	SAT TT=1.159 CHECKS=503774 NODES=1618	SAT TT=2.304 CHECKS=2364350 NODES=7549	SAT TT=0.044	SAT TT=3.242 CHECKS=14991800	SAT TT=5.181 CHECKS=22998500	SAT TT=1.093 ASSIGNMENTS=532	SAT TT=0.922 ASSIGNMENTS=24	SAT TT=3.425 CHECKS=4641930 NODES=10563	SAT TT=5.435 CHECKS=22957200 NODES=154803	? (TO) TT=1800.02	SAT TT=7.066 ASSIGNMENTS=94 CHECKS=10289	SAT TT=9.438 ASSIGNMENTS=6501 CHECKS=2065960	SAT TT=2.599	SAT TT=1.955	SAT TT=2.29 ASSIGNMENTS=24656 CHECKS=2896690	SAT TT=0.012 ASSIGNMENTS=9 CHECKS=1094	SAT TT=10.128	SAT TT=0.011 ASSIGNMENTS=1 CHECKS=767	SAT TT=0.019 ASSIGNMENTS=94 CHECKS=10289	SAT TT=3.375	SAT TT=2.168	SAT TT=0.824
csp/allIntervalSeries/ normalized-series-15.xml	SAT TT=0.015	SAT TT=69.795 CHECKS=129056000 NODES=342327	SAT TT=64.78 CHECKS=129145000 NODES=342327	SAT TT=0.052	SAT TT=115.591 CHECKS=509513000	SAT TT=22.237 CHECKS=94409100	SAT TT=1.397 ASSIGNMENTS=1106	SAT TT=1.084 ASSIGNMENTS=56	SAT TT=345.999 CHECKS=723681000 NODES=1099340	SAT TT=73.429 CHECKS=437560000 NODES=1911200	? (TO) TT=1800.08	SAT TT=8.942 ASSIGNMENTS=1106	SAT TT=363.23 ASSIGNMENTS=1639580 CHECKS=770219000	SAT TT=32.124	SAT TT=5.566	SAT TT=8.622 ASSIGNMENTS=71133 CHECKS=10765900	SAT TT=0.106 ASSIGNMENTS=928 CHECKS=119954	? (TO) TT=1800.09	SAT TT=0.015 ASSIGNMENTS=1 CHECKS=1208	SAT TT=0.151 ASSIGNMENTS=1220 CHECKS=174310	SAT TT=337.443	SAT TT=65.561	SAT TT=3.613
csp/allIntervalSeries/ normalized-series-16.xml	SAT TT=0.015	SAT TT=192.347 CHECKS=386221000 NODES=775841	SAT TT=193.628 CHECKS=386377000 NODES=775841	SAT TT=0.052	SAT TT=20.218 CHECKS=93087300	SAT TT=564.099 CHECKS=2790740000	SAT TT=1.079 ASSIGNMENTS=42	SAT TT=1.114 ASSIGNMENTS=6	SAT TT=1755.05 CHECKS=3789000000 NODES=4952830	SAT TT=103.969 CHECKS=584581000 NODES=2250530	? (TO) TT=1800.08	SAT TT=8.387 ASSIGNMENTS=42	SAT TT=511.855 ASSIGNMENTS=1323 CHECKS=166289	SAT TT=293.332	SAT TT=4.222	SAT TT=0.863 ASSIGNMENTS=6550 CHECKS=1002750	SAT TT=0.019 ASSIGNMENTS=42 CHECKS=5917	? (TO) TT=1800.05	SAT TT=0.015 ASSIGNMENTS=1 CHECKS=1377	SAT TT=0.151 ASSIGNMENTS=1323 CHECKS=166289	? (TO) TT=1800.19	SAT TT=3.945	SAT TT=30.232
csp/allIntervalSeries/ normalized-series-18.xml	SAT TT=0.016	? (TO) TT=1800.08	? (TO) TT=1800.14	SAT TT=0.065	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=2.631 ASSIGNMENTS=4139	SAT TT=1.316 ASSIGNMENTS=91	? (TO) TT=1800.03	SAT TT=955.655 CHECKS=5617760000 NODES=17170000	? (TO) TT=1800.08	SAT TT=10.211 ASSIGNMENTS=4139	SAT TT=512.382 ASSIGNMENTS=3463 CHECKS=566291	SAT TT=190.383	SAT TT=13.327	SAT TT=457.807 ASSIGNMENTS=2807590 CHECKS=528970000	SAT TT=0.019 ASSIGNMENTS=1 CHECKS=1748	? (TO) TT=1800.1	SAT TT=0.016 ASSIGNMENTS=1 CHECKS=1748	SAT TT=0.454 ASSIGNMENTS=3463 CHECKS=566291	? (TO) TT=1800.16	SAT TT=327.544	SAT TT=115.297
csp/allIntervalSeries/ normalized-series-20.xml	SAT TT=0.022	? (TO) TT=1800.11	SAT TT=338.246 CHECKS=688420000 NODES=942071	SAT TT=0.071	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=1.657 ASSIGNMENTS=1440	SAT TT=1.205 ASSIGNMENTS=19	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=9.206 ASSIGNMENTS=1440	SAT TT=513.083 ASSIGNMENTS=6771 CHECKS=1368540	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=13.884 ASSIGNMENTS=87320 CHECKS=17166300	SAT TT=0.172 ASSIGNMENTS=1067 CHECKS=189121	? (TO) TT=1800.09	SAT TT=0.022 ASSIGNMENTS=1 CHECKS=2163	SAT TT=1.204 ASSIGNMENTS=6771 CHECKS=1368540	? (TO) TT=1800.17	? (TO) TT=1800.13	SAT TT=1024.22
csp/allIntervalSeries/ normalized-series-25.xml	SAT TT=0.031	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=0.103	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1507.95 ASSIGNMENTS=1826070	SAT TT=1.89 ASSIGNMENTS=111	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=1524.27 ASSIGNMENTS=1826070	SAT TT=515.015 ASSIGNMENTS=11798 CHECKS=3002610	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=186.661 ASSIGNMENTS=853357 CHECKS=207638000	SAT TT=0.159 ASSIGNMENTS=525 CHECKS=125961	? (TO) TT=1800.12	SAT TT=0.031 ASSIGNMENTS=1 CHECKS=3393	SAT TT=2.687 ASSIGNMENTS=11798 CHECKS=3002610	? (TO) TT=1800.2	? (TO) TT=1800.05	? (TO) TT=1800.08
csp/allIntervalSeries/ normalized-series-30.xml	SAT TT=0.039	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=0.135	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=2.259 ASSIGNMENTS=459	SAT TT=2.019 ASSIGNMENTS=12	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=9.521 ASSIGNMENTS=459	SAT TT=512.894 ASSIGNMENTS=2578 CHECKS=713222	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=9.658 ASSIGNMENTS=19341 CHECKS=6642560	SAT TT=0.769 ASSIGNMENTS=2170 CHECKS=581724	? (TO) TT=1800.11	SAT TT=0.039 ASSIGNMENTS=1 CHECKS=4898	SAT TT=0.843 ASSIGNMENTS=2578 CHECKS=713222	? (TO) TT=1800.2	? (TO) TT=1800.05	? (TO) TT=1800.06
csp/allIntervalSeries/ normalized-series-35.xml	SAT TT=0.061	? (TO) TT=1800.15	? (TO) TT=1800.04	SAT TT=0.163	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.13	SAT TT=2.067 ASSIGNMENTS=64	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.01	SAT TT=0.233 ASSIGNMENTS=361 CHECKS=115179	? (TO) TT=1800.09	SAT TT=0.061 ASSIGNMENTS=1 CHECKS=6678	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.06	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allIntervalSeries/ normalized-series-70.xml	SAT TT=0.276	? (TO) TT=1800.06	? (TO) TT=1800.16	SAT TT=0.604	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.02	? (MO) TT=1057.9	? (TO) TT=1800.04	SAT TT=6.169 ASSIGNMENTS=2289 CHECKS=1375520	? (TO) TT=1800.12	SAT TT=0.276 ASSIGNMENTS=1 CHECKS=26838	? (TO) TT=1800.07	? TT=63.443	? (TO) TT=1800.01	? (TO) TT=1800.1
csp/allIntervalSeries/ normalized-series-80.xml	SAT TT=0.409	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=0.857	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=19.625 ASSIGNMENTS=2704	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (MO) TT=1151.8	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=0.409 ASSIGNMENTS=1 CHECKS=35073	? (TO) TT=1800.03	? TT=124.445	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/allIntervalSeries/ normalized-series-8.xml	SAT TT=0.008	SAT TT=0.758 CHECKS=3074 NODES=26	SAT TT=0.786 CHECKS=19140 NODES=107	SAT TT=0.03	SAT TT=0.045 CHECKS=45074	SAT TT=0.023 CHECKS=53567	SAT TT=0.706 ASSIGNMENTS=12	SAT TT=0.727 ASSIGNMENTS=4	SAT TT=0.594 CHECKS=15712 NODES=95	SAT TT=0.59 CHECKS=85743 NODES=1229	SAT TT=0.606 CHECKS=7654 NODES=48	SAT TT=0.025 ASSIGNMENTS=96 CHECKS=7794	SAT TT=0.026 ASSIGNMENTS=96 CHECKS=7794	SAT TT=1.282	SAT TT=1.198	SAT TT=0.014 ASSIGNMENTS=91 CHECKS=7519	SAT TT=0.01 ASSIGNMENTS=17 CHECKS=920	SAT TT=0.371	SAT TT=0.009 ASSIGNMENTS=1 CHECKS=333	SAT TT=0.008 ASSIGNMENTS=11 CHECKS=998	SAT TT=2.117	SAT TT=0.575	SAT TT=0.696
csp/allIntervalSeries/ normalized-series-90.xml	SAT TT=0.526	? (TO) TT=1800.06	? (TO) TT=1800.12	SAT TT=1.076	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (MO) TT=1511.74	? (TO) TT=1800.08	SAT TT=7.14 ASSIGNMENTS=2154 CHECKS=1572860	? (TO) TT=1800.05	SAT TT=0.526 ASSIGNMENTS=1 CHECKS=44408	? (TO) TT=1800.08	? TT=123.138	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/allIntervalSeries/ normalized-series-9.xml	SAT TT=0.007	SAT TT=0.852 CHECKS=28486 NODES=197	SAT TT=0.85 CHECKS=59094 NODES=258	SAT TT=0.035	SAT TT=0.127 CHECKS=252484	SAT TT=0.089 CHECKS=305730	SAT TT=0.781 ASSIGNMENTS=35	SAT TT=0.745 ASSIGNMENTS=7	SAT TT=0.769 CHECKS=151825 NODES=741	SAT TT=0.725 CHECKS=343553 NODES=3987	SAT TT=10.878 CHECKS=69966000 NODES=95857	SAT TT=0.047 ASSIGNMENTS=444 CHECKS=37662	SAT TT=0.048 ASSIGNMENTS=444 CHECKS=37662	SAT TT=1.338	SAT TT=1.362	SAT TT=0.03 ASSIGNMENTS=366 CHECKS=31863	SAT TT=0.013 ASSIGNMENTS=50 CHECKS=4023	SAT TT=0.406	SAT TT=0.007 ASSIGNMENTS=1 CHECKS=425	SAT TT=0.01 ASSIGNMENTS=9 CHECKS=1285	SAT TT=1.894	SAT TT=0.654	SAT TT=0.63
csp/bmc/ normalized-bmc-ibm-01-02.xml	SAT TT=4.363	SAT TT=29.73 CHECKS=241772 NODES=9685	SAT TT=94.841 CHECKS=434684 NODES=9685	SAT TT=14.316	SAT TT=34.04 CHECKS=27432000	SAT TT=23.305 CHECKS=4974480	SAT TT=43.209 ASSIGNMENTS=3047	SAT TT=114.175 ASSIGNMENTS=3680	SAT TT=1029.42 CHECKS=269743 NODES=12023	? (TO) TT=1800.08	SAT TT=829.557 CHECKS=42754500 NODES=847	SAT TT=4.363 ASSIGNMENTS=2982 CHECKS=552844	SAT TT=4.591 ASSIGNMENTS=2982 CHECKS=552844	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=4.68 ASSIGNMENTS=2982 CHECKS=552844	SAT TT=6.708 ASSIGNMENTS=7449 CHECKS=2648600	? (exit code) TT=48.71	SAT TT=542.22 ASSIGNMENTS=179610 CHECKS=389595000	SAT TT=5.099 ASSIGNMENTS=2974 CHECKS=550099	? (TO) TT=1800.12	SAT TT=18.558	SAT TT=20.983
csp/bmc/ normalized-bmc-ibm-01-04.xml	SAT TT=4.88	SAT TT=46.524 CHECKS=277843 NODES=9685	SAT TT=109.15 CHECKS=471661 NODES=9685	SAT TT=14.386	SAT TT=33.861 CHECKS=27276700	SAT TT=26.365 CHECKS=5819680	SAT TT=45.716 ASSIGNMENTS=3047	SAT TT=116.267 ASSIGNMENTS=3594	SAT TT=1079.35 CHECKS=460897 NODES=12023	? (TO) TT=1800.09	SAT TT=1531.44 CHECKS=50592700 NODES=1043	SAT TT=5.337 ASSIGNMENTS=2984 CHECKS=831891	SAT TT=5.142 ASSIGNMENTS=2984 CHECKS=831891	? (problem) TT=618.021	? (problem) TT=615.144	SAT TT=4.88 ASSIGNMENTS=2984 CHECKS=831891	SAT TT=9.558 ASSIGNMENTS=12112 CHECKS=4800940	? (exit code) TT=57.1	SAT TT=755.923 ASSIGNMENTS=216803 CHECKS=463569000	SAT TT=5.072 ASSIGNMENTS=2965 CHECKS=829131	? (TO) TT=1800.08	SAT TT=29.75	SAT TT=31.996
csp/bmc/ normalized-bmc-ibm-01-08.xml	SAT TT=5.184	SAT TT=44.953 CHECKS=296181 NODES=9685	SAT TT=111.373 CHECKS=493586 NODES=9685	SAT TT=13.705	SAT TT=39.282 CHECKS=27589300	SAT TT=24.12 CHECKS=5768100	SAT TT=43.929 ASSIGNMENTS=3047	SAT TT=118.807 ASSIGNMENTS=3466	SAT TT=999.342 CHECKS=755074 NODES=12023	? (TO) TT=1800.04	SAT TT=1044.62 CHECKS=47338100 NODES=940	SAT TT=5.184 ASSIGNMENTS=2964 CHECKS=908579	SAT TT=5.315 ASSIGNMENTS=2964 CHECKS=908579	? (problem) TT=275.489	? (problem) TT=265.126	SAT TT=5.25 ASSIGNMENTS=2964 CHECKS=908579	SAT TT=5.438 ASSIGNMENTS=3221 CHECKS=1190170	? (exit code) TT=59.388	SAT TT=660.8 ASSIGNMENTS=197964 CHECKS=460048000	SAT TT=5.38 ASSIGNMENTS=2942 CHECKS=904546	? (TO) TT=1800.16	SAT TT=47.927	SAT TT=34.211
csp/bmc/ normalized-bmc-ibm-02-02.xml	SAT TT=1.061	SAT TT=4.745 CHECKS=36650 NODES=2810	SAT TT=8.058 CHECKS=80150 NODES=2810	SAT TT=2.764	SAT TT=3.107 CHECKS=2923840	SAT TT=2.447 CHECKS=2583460	SAT TT=9.431 ASSIGNMENTS=524	SAT TT=13.655 ASSIGNMENTS=948	SAT TT=35.609 CHECKS=44487 NODES=3231	SAT TT=48.242 CHECKS=20323500 NODES=150399	SAT TT=29.265 CHECKS=3201460 NODES=301	SAT TT=1.076 ASSIGNMENTS=518 CHECKS=113645	SAT TT=1.14 ASSIGNMENTS=518 CHECKS=113645	Wrong UNSAT TT=23.492	Wrong UNSAT TT=14.86	SAT TT=1.061 ASSIGNMENTS=518 CHECKS=113645	SAT TT=1.064 ASSIGNMENTS=623 CHECKS=116517	Wrong Cert. TT=7.664	SAT TT=1.397 ASSIGNMENTS=977 CHECKS=306968	SAT TT=1.119 ASSIGNMENTS=516 CHECKS=113632	SAT TT=22.403	SAT TT=3.75	SAT TT=3.821
csp/bmc/ normalized-bmc-ibm-02-04.xml	SAT TT=0.959	SAT TT=5.754 CHECKS=42126 NODES=2810	SAT TT=9.114 CHECKS=88133 NODES=2810	SAT TT=2.792	SAT TT=3.265 CHECKS=2893460	SAT TT=2.899 CHECKS=2903340	SAT TT=8.706 ASSIGNMENTS=524	SAT TT=12.488 ASSIGNMENTS=948	SAT TT=93.781 CHECKS=125768 NODES=3231	SAT TT=29.959 CHECKS=236362 NODES=505	SAT TT=29.64 CHECKS=3296770 NODES=293	SAT TT=1.086 ASSIGNMENTS=533 CHECKS=124256	SAT TT=0.959 ASSIGNMENTS=533 CHECKS=124256	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=1.038 ASSIGNMENTS=533 CHECKS=124256	SAT TT=1.098 ASSIGNMENTS=637 CHECKS=126390	Wrong Cert. TT=7.908	SAT TT=1.354 ASSIGNMENTS=1161 CHECKS=340866	SAT TT=1.069 ASSIGNMENTS=523 CHECKS=124238	? (TO) TT=1800.16	SAT TT=5.414	SAT TT=5.485
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bmc/ normalized-bmc-ibm-02-08.xml	SAT TT=1.282	SAT TT=5.867 CHECKS=52577 NODES=2810	SAT TT=9.073 CHECKS=101579 NODES=2810	SAT TT=2.557	SAT TT=3.294 CHECKS=2932360	SAT TT=2.659 CHECKS=2907560	SAT TT=8.76 ASSIGNMENTS=524	SAT TT=13.139 ASSIGNMENTS=948	SAT TT=143.797 CHECKS=251544 NODES=3231	SAT TT=126.996 CHECKS=39298300 NODES=300418	SAT TT=86.334 CHECKS=3272800 NODES=280	SAT TT=1.329 ASSIGNMENTS=516 CHECKS=187140	SAT TT=1.371 ASSIGNMENTS=516 CHECKS=187140	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=1.282 ASSIGNMENTS=516 CHECKS=187140	SAT TT=1.304 ASSIGNMENTS=562 CHECKS=188841	Wrong Cert. TT=8.018	SAT TT=1.497 ASSIGNMENTS=777 CHECKS=278312	SAT TT=1.373 ASSIGNMENTS=515 CHECKS=187129	? (TO) TT=1800.15	SAT TT=6.106	SAT TT=5.86
csp/bmc/ normalized-bmc-ibm-03-02.xml	SAT TT=5.86	SAT TT=56.183 CHECKS=436936 NODES=14957	SAT TT=108.559 CHECKS=520289 NODES=14957	SAT TT=18.366	SAT TT=65.854 CHECKS=28934900	SAT TT=35.799 CHECKS=6301210	SAT TT=61.849 ASSIGNMENTS=3635	SAT TT=156.548 ASSIGNMENTS=4517	SAT TT=1577.42 CHECKS=315108 NODES=19685	? TT=1148.04 CHECKS=362170 NODES=0	? TT=1142.38 CHECKS=356782 NODES=0	SAT TT=5.86 ASSIGNMENTS=3795 CHECKS=504719	SAT TT=6.09 ASSIGNMENTS=3795 CHECKS=504719	Wrong UNSAT TT=505.806	Wrong UNSAT TT=325.438	SAT TT=5.904 ASSIGNMENTS=3808 CHECKS=506554	SAT TT=6.462 ASSIGNMENTS=11113 CHECKS=1282160	? (exit code) TT=89.294	SAT TT=537.923 ASSIGNMENTS=239824 CHECKS=281075000	SAT TT=6.06 ASSIGNMENTS=3918 CHECKS=622129	? (TO) TT=1800.15	SAT TT=20.108	SAT TT=21.912
csp/bmc/ normalized-bmc-ibm-03-04.xml	SAT TT=5.803	SAT TT=99.273 CHECKS=462760 NODES=14957	SAT TT=150.182 CHECKS=546529 NODES=14957	SAT TT=18.885	SAT TT=55.328 CHECKS=28679600	SAT TT=78.729 CHECKS=6617540	SAT TT=57.921 ASSIGNMENTS=3635	SAT TT=157.57 ASSIGNMENTS=4513	SAT TT=1670.73 CHECKS=542517 NODES=19685	? TT=1196.46 CHECKS=776607 NODES=0	? TT=1160.09 CHECKS=778964 NODES=0	SAT TT=6.243 ASSIGNMENTS=3808 CHECKS=639451	SAT TT=5.803 ASSIGNMENTS=3808 CHECKS=639451	? (MO) TT=558.09	? (MO) TT=581.01	SAT TT=6.34 ASSIGNMENTS=3794 CHECKS=641318	SAT TT=21.207 ASSIGNMENTS=94022 CHECKS=13293500	? (exit code) TT=92.785	SAT TT=642.025 ASSIGNMENTS=241310 CHECKS=290346000	SAT TT=6.376 ASSIGNMENTS=3936 CHECKS=756906	? (TO) TT=1800.15	SAT TT=28.599	SAT TT=31.118
csp/bmc/ normalized-bmc-ibm-03-08.xml	SAT TT=6.544	SAT TT=106.126 CHECKS=498560 NODES=14957	SAT TT=150.697 CHECKS=584119 NODES=14957	SAT TT=19.367	SAT TT=51.997 CHECKS=28710300	SAT TT=47.166 CHECKS=6581710	SAT TT=59.177 ASSIGNMENTS=3635	SAT TT=163.291 ASSIGNMENTS=4835	SAT TT=1671.12 CHECKS=864394 NODES=19685	? TT=1476.18 CHECKS=1565200 NODES=0	? TT=1560.13 CHECKS=1561190 NODES=0	SAT TT=6.568 ASSIGNMENTS=3819 CHECKS=858711	SAT TT=20.247 ASSIGNMENTS=3965 CHECKS=1201170	? (problem) TT=789.303	? (problem) TT=737.069	SAT TT=6.544 ASSIGNMENTS=3828 CHECKS=897010	SAT TT=40.231 ASSIGNMENTS=142633 CHECKS=28031200	? (exit code) TT=104.685	SAT TT=835.428 ASSIGNMENTS=184947 CHECKS=391541000	SAT TT=7.395 ASSIGNMENTS=3965 CHECKS=1201170	? (TO) TT=1800.13	SAT TT=33.989	SAT TT=36.581
csp/bmc/ normalized-bmc-ibm-03-16.xml	SAT TT=6.98	SAT TT=104.135 CHECKS=360610 NODES=14930	SAT TT=158.387 CHECKS=452966 NODES=14930	SAT TT=19.451	SAT TT=49.237 CHECKS=28654000	SAT TT=50.234 CHECKS=6544100	SAT TT=57.243 ASSIGNMENTS=3635	SAT TT=160.242 ASSIGNMENTS=4474	SAT TT=1692.16 CHECKS=1483520 NODES=19685	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=20.352 ASSIGNMENTS=3955 CHECKS=1265710	SAT TT=21.55 ASSIGNMENTS=3955 CHECKS=1265710	? (problem) TT=424.216	? (problem) TT=395.496	SAT TT=6.98 ASSIGNMENTS=3823 CHECKS=950673	SAT TT=30.546 ASSIGNMENTS=90097 CHECKS=19382900	? (exit code) TT=95.755	SAT TT=1390.51 ASSIGNMENTS=404901 CHECKS=806402000	SAT TT=7.431 ASSIGNMENTS=3955 CHECKS=1265710	? (TO) TT=1800.12	SAT TT=33.914	SAT TT=33.878
csp/bmc/ normalized-bmc-ibm-04-04.xml	SAT TT=12.94	? TT=160.859	? TT=157.898	SAT TT=43.594	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=135.249 ASSIGNMENTS=5470	? (MO) TT=153.949	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=31.672 ASSIGNMENTS=5364 CHECKS=1433340	SAT TT=30.985 ASSIGNMENTS=5364 CHECKS=1433340	? (problem) TT=1097.55	? (problem) TT=1174.09	SAT TT=12.94 ASSIGNMENTS=5384 CHECKS=1419310	SAT TT=46.786 ASSIGNMENTS=74837 CHECKS=31673100	? (exit code) TT=789.348	? (TO) TT=1800.11	SAT TT=13.02 ASSIGNMENTS=5364 CHECKS=1433340	? (TO) TT=1800.14	SAT TT=115.65	SAT TT=87.319
csp/bmc/ normalized-bmc-ibm-04-16.xml	SAT TT=14.673	? TT=157.649	? TT=157.92	SAT TT=44.017	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=123.756 ASSIGNMENTS=5470	SAT TT=252.862 ASSIGNMENTS=5467	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=31.779 ASSIGNMENTS=5243 CHECKS=1897450	SAT TT=32.391 ASSIGNMENTS=5243 CHECKS=1897450	? (problem) TT=1018.97	? (problem) TT=1033.43	SAT TT=14.765 ASSIGNMENTS=5237 CHECKS=1886310	SAT TT=69.62 ASSIGNMENTS=75978 CHECKS=41013900	? (MO) TT=5.78	? (TO) TT=1800.12	SAT TT=14.673 ASSIGNMENTS=5243 CHECKS=1897450	? (TO) TT=1800.17	SAT TT=212.199	SAT TT=92.351
csp/bmc/ normalized-bmc-ibm-05-02.xml	SAT TT=3.129	SAT TT=27.091 CHECKS=147611 NODES=9396	SAT TT=21.288 CHECKS=159500 NODES=0	SAT TT=10.783	SAT TT=26.531 CHECKS=14047600	SAT TT=21.191 CHECKS=6387210	SAT TT=30.562 ASSIGNMENTS=3109	SAT TT=110.528 ASSIGNMENTS=4111	SAT TT=478.908 CHECKS=178374 NODES=9396	SAT TT=390.93 CHECKS=550424 NODES=764	SAT TT=393.976 CHECKS=24153000 NODES=644	SAT TT=3.197 ASSIGNMENTS=3215 CHECKS=260135	SAT TT=3.246 ASSIGNMENTS=3215 CHECKS=260135	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=3.495 ASSIGNMENTS=3215 CHECKS=260135	SAT TT=3.129 ASSIGNMENTS=3205 CHECKS=242080	? (exit code) TT=33.219	SAT TT=58.428 ASSIGNMENTS=58730 CHECKS=26600500	SAT TT=3.152 ASSIGNMENTS=3229 CHECKS=261404	? (TO) TT=1800.12	SAT TT=10.228	SAT TT=10.498
csp/bmc/ normalized-bmc-ibm-07-08.xml	UNSAT TT=2.231	UNSAT TT=13.522 CHECKS=49 NODES=0	UNSAT TT=14.913 CHECKS=49 NODES=0	UNSAT TT=9.367	UNSAT TT=4.583 CHECKS=133933	UNSAT TT=2.231 CHECKS=133933	UNSAT TT=25.012 ASSIGNMENTS=0	UNSAT TT=24.619 ASSIGNMENTS=0	UNSAT TT=448.335 CHECKS=259635 NODES=0	UNSAT TT=531.494 CHECKS=483036 NODES=0	UNSAT TT=617.988 CHECKS=483036 NODES=0	UNSAT TT=3.126 ASSIGNMENTS=0 CHECKS=127236	UNSAT TT=2.979 ASSIGNMENTS=0 CHECKS=127236	? (problem) TT=808.092	? (problem) TT=783.441	UNSAT TT=3.098 ASSIGNMENTS=0 CHECKS=127236	UNSAT TT=3.248 ASSIGNMENTS=0 CHECKS=127236	? (exit code) TT=35.409	UNSAT TT=3.108 ASSIGNMENTS=0 CHECKS=127236	UNSAT TT=3.073 ASSIGNMENTS=0 CHECKS=127236	? (TO) TT=1800.11	UNSAT TT=16.09	UNSAT TT=19.227
csp/bmc/ normalized-bmc-ibm-07-16.xml	UNSAT TT=2.312	UNSAT TT=13.534 CHECKS=49 NODES=0	UNSAT TT=15.139 CHECKS=49 NODES=0	UNSAT TT=10.158	UNSAT TT=4.519 CHECKS=133933	UNSAT TT=2.312 CHECKS=133933	UNSAT TT=25.216 ASSIGNMENTS=0	UNSAT TT=25.549 ASSIGNMENTS=0	UNSAT TT=447.693 CHECKS=585551 NODES=0	UNSAT TT=574.736 CHECKS=986939 NODES=0	UNSAT TT=602.167 CHECKS=986939 NODES=0	UNSAT TT=3.531 ASSIGNMENTS=0 CHECKS=155836	UNSAT TT=3.296 ASSIGNMENTS=0 CHECKS=155836	? (problem) TT=517.363	? (problem) TT=517.87	UNSAT TT=3.229 ASSIGNMENTS=0 CHECKS=155836	UNSAT TT=3.216 ASSIGNMENTS=0 CHECKS=155836	? (exit code) TT=36.753	UNSAT TT=3.373 ASSIGNMENTS=0 CHECKS=155836	UNSAT TT=3.538 ASSIGNMENTS=0 CHECKS=155836	? (TO) TT=1800.13	UNSAT TT=15.974	UNSAT TT=19.774
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/chessboardColoration/ normalized-cc-10-10-3.xml	SAT TT=6.211	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.11	SAT TT=53.314 CHECKS=10347600 NODES=45500	SAT TT=6.211 CHECKS=5068940 NODES=6872	SAT TT=7.255 CHECKS=6273520 NODES=4189	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=6.254	SAT TT=317.459	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=601.332 ASSIGNMENTS=848702 CHECKS=589533000	? (TO) TT=1800.1	SAT TT=27.442	SAT TT=43.644	SAT TT=156.883
csp/chessboardColoration/ normalized-cc-12-12-2.xml	UNSAT TT=2.717	UNSAT TT=4.249 CHECKS=5614 NODES=241	UNSAT TT=4.332 CHECKS=12150 NODES=51	UNSAT TT=44.694	UNSAT TT=2.717 CHECKS=36232	UNSAT TT=4.616 CHECKS=510235	UNSAT TT=18.938 ASSIGNMENTS=9227	UNSAT TT=20.52 ASSIGNMENTS=9227	UNSAT TT=21.663 CHECKS=301067 NODES=6850	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=11.157 ASSIGNMENTS=2587 CHECKS=1865140	UNSAT TT=11.948 ASSIGNMENTS=3385 CHECKS=91917	UNSAT TT=7.321	UNSAT TT=7.034	UNSAT TT=2.989 ASSIGNMENTS=3028 CHECKS=1734300	UNSAT TT=5.904 ASSIGNMENTS=5665 CHECKS=3443600	? (TO) TT=1800.13	UNSAT TT=5.756 ASSIGNMENTS=6617 CHECKS=3162580	UNSAT TT=3.118 ASSIGNMENTS=2587 CHECKS=1865140	UNSAT TT=5.502	UNSAT TT=3.852	UNSAT TT=4.649
csp/chessboardColoration/ normalized-cc-12-12-3.xml		? (TO) TT=1800.19	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/chessboardColoration/ normalized-cc-15-15-2.xml	UNSAT TT=6.48	UNSAT TT=10.489 CHECKS=6910 NODES=262	UNSAT TT=10.507 CHECKS=29782 NODES=63	UNSAT TT=203.091	UNSAT TT=8.145 CHECKS=122259	UNSAT TT=35.263 CHECKS=3460010	UNSAT TT=53.382 ASSIGNMENTS=12745	UNSAT TT=54.227 ASSIGNMENTS=12745	UNSAT TT=77.255 CHECKS=220005 NODES=5056	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=18.027 ASSIGNMENTS=5663 CHECKS=4971690	UNSAT TT=18.157 ASSIGNMENTS=3406 CHECKS=94710	UNSAT TT=18.576	UNSAT TT=16.046	UNSAT TT=6.48 ASSIGNMENTS=3477 CHECKS=3145880	UNSAT TT=12.259 ASSIGNMENTS=6246 CHECKS=5816370	? (TO) TT=1800.07	UNSAT TT=9.982 ASSIGNMENTS=5885 CHECKS=4680700	UNSAT TT=9.509 ASSIGNMENTS=5663 CHECKS=4971690	UNSAT TT=7.761	UNSAT TT=8.643	UNSAT TT=11.217
csp/chessboardColoration/ normalized-cc-15-15-3.xml		? (MO) TT=9.142	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.23	? (TO) TT=1800.04	? (TO) TT=1800.03
csp/chessboardColoration/ normalized-cc-20-20-2.xml	UNSAT TT=12.75	UNSAT TT=33.961 CHECKS=9410 NODES=297	UNSAT TT=36.618 CHECKS=95702 NODES=83	? (TO) TT=1800.07	UNSAT TT=144.111 CHECKS=37764000	UNSAT TT=333.737 CHECKS=140789000	UNSAT TT=36.973 ASSIGNMENTS=2197	UNSAT TT=40.637 ASSIGNMENTS=2197	UNSAT TT=782.591 CHECKS=215760 NODES=4918	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=22.429 ASSIGNMENTS=2290 CHECKS=5212680	UNSAT TT=35.684 ASSIGNMENTS=3441 CHECKS=99485	UNSAT TT=66.316	UNSAT TT=54.483	UNSAT TT=17.508 ASSIGNMENTS=4624 CHECKS=8640020	UNSAT TT=41.518 ASSIGNMENTS=9486 CHECKS=16818000	? (TO) TT=1800.01	UNSAT TT=24.02 ASSIGNMENTS=5560 CHECKS=9550420	UNSAT TT=14.107 ASSIGNMENTS=2290 CHECKS=5212680	UNSAT TT=12.75	UNSAT TT=25.474	UNSAT TT=31.26
csp/chessboardColoration/ normalized-cc-20-20-3.xml		? (TO) TT=1800.26	? (TO) TT=1800.34	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.08
csp/chessboardColoration/ normalized-cc-5-5-2.xml	UNSAT TT=0.027	UNSAT TT=0.92 CHECKS=896 NODES=64	UNSAT TT=1.661 CHECKS=441 NODES=27	UNSAT TT=0.09	UNSAT TT=0.053 CHECKS=3071	UNSAT TT=0.027 CHECKS=5157	UNSAT TT=2.453 ASSIGNMENTS=5615	UNSAT TT=2.384 ASSIGNMENTS=5615	UNSAT TT=1.159 CHECKS=215134 NODES=3021	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=0.137 ASSIGNMENTS=1111 CHECKS=97184	UNSAT TT=0.125 ASSIGNMENTS=1111 CHECKS=97184	UNSAT TT=1.119	UNSAT TT=0.944	UNSAT TT=0.098 ASSIGNMENTS=998 CHECKS=84392	UNSAT TT=0.349 ASSIGNMENTS=4722 CHECKS=319252	UNSAT TT=4.854	UNSAT TT=0.276 ASSIGNMENTS=2955 CHECKS=214303	UNSAT TT=0.282 ASSIGNMENTS=2950 CHECKS=243957	UNSAT TT=1.815	UNSAT TT=0.971	UNSAT TT=1.095
csp/chessboardColoration/ normalized-cc-5-5-3.xml	SAT TT=0.012	SAT TT=0.914 CHECKS=381 NODES=27	SAT TT=0.865 CHECKS=408 NODES=0	SAT TT=0.065	SAT TT=29.989 CHECKS=18779000	SAT TT=0.025 CHECKS=2879	SAT TT=0.685 ASSIGNMENTS=23	SAT TT=0.749 ASSIGNMENTS=23	SAT TT=0.714 CHECKS=435 NODES=31	SAT TT=0.82 CHECKS=3202 NODES=2	SAT TT=0.723 CHECKS=2897 NODES=0	SAT TT=0.025 ASSIGNMENTS=23 CHECKS=865	SAT TT=0.023 ASSIGNMENTS=23 CHECKS=865	SAT TT=1.355	SAT TT=1.342	SAT TT=0.012 ASSIGNMENTS=23 CHECKS=865	SAT TT=0.013 ASSIGNMENTS=20 CHECKS=643	SAT TT=0.548	SAT TT=0.015 ASSIGNMENTS=63 CHECKS=1760	SAT TT=0.014 ASSIGNMENTS=23 CHECKS=586	SAT TT=1.537	SAT TT=0.867	SAT TT=0.878
csp/chessboardColoration/ normalized-cc-6-6-2.xml	UNSAT TT=0.055	UNSAT TT=1.041 CHECKS=887 NODES=59	UNSAT TT=1.045 CHECKS=926 NODES=30	UNSAT TT=0.2	UNSAT TT=0.114 CHECKS=3468	UNSAT TT=0.055 CHECKS=9848	UNSAT TT=2.818 ASSIGNMENTS=4354	UNSAT TT=3.173 ASSIGNMENTS=4354	UNSAT TT=1.572 CHECKS=217766 NODES=3138	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.208 ASSIGNMENTS=1105 CHECKS=148266	UNSAT TT=0.223 ASSIGNMENTS=1105 CHECKS=148266	UNSAT TT=1.205	UNSAT TT=1.169	UNSAT TT=0.216 ASSIGNMENTS=1205 CHECKS=150030	UNSAT TT=0.736 ASSIGNMENTS=4802 CHECKS=591958	UNSAT TT=11.312	UNSAT TT=0.536 ASSIGNMENTS=3074 CHECKS=423175	UNSAT TT=0.549 ASSIGNMENTS=3042 CHECKS=413083	UNSAT TT=2.199	UNSAT TT=1.242	UNSAT TT=1.489
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/chessboardColoration/ normalized-cc-7-7-2.xml	UNSAT TT=0.26	UNSAT TT=1.389 CHECKS=2259 NODES=113	UNSAT TT=1.292 CHECKS=1771 NODES=35	UNSAT TT=0.304	UNSAT TT=0.26 CHECKS=15303	UNSAT TT=3.315 CHECKS=2371980	UNSAT TT=5.211 ASSIGNMENTS=5697	UNSAT TT=5.151 ASSIGNMENTS=5697	UNSAT TT=2.353 CHECKS=217772 NODES=4948	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=0.531 ASSIGNMENTS=2388 CHECKS=347779	UNSAT TT=0.536 ASSIGNMENTS=2388 CHECKS=347779	UNSAT TT=1.624	UNSAT TT=1.723	UNSAT TT=0.62 ASSIGNMENTS=3113 CHECKS=430894	UNSAT TT=1.264 ASSIGNMENTS=5803 CHECKS=944336	UNSAT TT=26.355	UNSAT TT=0.881 ASSIGNMENTS=3112 CHECKS=595197	UNSAT TT=0.902 ASSIGNMENTS=3105 CHECKS=638351	UNSAT TT=2.553	UNSAT TT=1.424	UNSAT TT=1.832
csp/chessboardColoration/ normalized-cc-8-8-2.xml	UNSAT TT=0.216	UNSAT TT=1.702 CHECKS=9546 NODES=450	UNSAT TT=1.694 CHECKS=2511 NODES=35	UNSAT TT=0.92	UNSAT TT=0.468 CHECKS=26715	UNSAT TT=0.216 CHECKS=29811	UNSAT TT=6.412 ASSIGNMENTS=5697	UNSAT TT=6.278 ASSIGNMENTS=5697	UNSAT TT=3.357 CHECKS=212474 NODES=4885	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.663 ASSIGNMENTS=2226 CHECKS=461689	UNSAT TT=0.689 ASSIGNMENTS=2226 CHECKS=461689	UNSAT TT=2.258	UNSAT TT=2.219	UNSAT TT=0.772 ASSIGNMENTS=2400 CHECKS=503872	UNSAT TT=1.571 ASSIGNMENTS=5077 CHECKS=1185400	UNSAT TT=77.142	UNSAT TT=1.315 ASSIGNMENTS=3108 CHECKS=871327	UNSAT TT=1.212 ASSIGNMENTS=2988 CHECKS=865761	UNSAT TT=3.388	UNSAT TT=1.637	UNSAT TT=1.923
csp/chessboardColoration/ normalized-cc-8-8-3.xml	SAT TT=0.068	SAT TT=1.801 CHECKS=35112 NODES=583	SAT TT=2.178 CHECKS=124855 NODES=2024	SAT TT=203.372	SAT TT=23.023 CHECKS=8782280	SAT TT=19.563 CHECKS=12540200	SAT TT=1.644 ASSIGNMENTS=227	SAT TT=1.998 ASSIGNMENTS=227	SAT TT=1.555 CHECKS=11384 NODES=192	SAT TT=1.451 CHECKS=32963 NODES=22	SAT TT=1.467 CHECKS=38629 NODES=14	SAT TT=7.491 ASSIGNMENTS=44 CHECKS=5675	SAT TT=9.256 ASSIGNMENTS=310 CHECKS=19118	SAT TT=3.656	SAT TT=3.462	? (TO) TT=1800.1	SAT TT=0.07 ASSIGNMENTS=105 CHECKS=14763	? (TO) TT=1800.09	SAT TT=0.098 ASSIGNMENTS=229 CHECKS=24018	SAT TT=0.068 ASSIGNMENTS=44 CHECKS=5675	SAT TT=3.448	SAT TT=1.776	SAT TT=1.777
csp/chessboardColoration/ normalized-cc-9-9-2.xml	UNSAT TT=0.385	UNSAT TT=2.005 CHECKS=4471 NODES=220	UNSAT TT=2.164 CHECKS=3929 NODES=39	UNSAT TT=1.303	UNSAT TT=0.74 CHECKS=18085	UNSAT TT=0.385 CHECKS=49236	UNSAT TT=9.303 ASSIGNMENTS=5653	UNSAT TT=8.498 ASSIGNMENTS=5653	UNSAT TT=6.026 CHECKS=291629 NODES=6632	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.938 ASSIGNMENTS=2121 CHECKS=572385	UNSAT TT=0.967 ASSIGNMENTS=2121 CHECKS=572385	UNSAT TT=3.004	UNSAT TT=3.026	UNSAT TT=0.989 ASSIGNMENTS=2450 CHECKS=618519	UNSAT TT=2.353 ASSIGNMENTS=5074 CHECKS=1622540	UNSAT TT=76.23	UNSAT TT=1.752 ASSIGNMENTS=2877 CHECKS=1087410	UNSAT TT=1.514 ASSIGNMENTS=2765 CHECKS=1026030	UNSAT TT=4.093	UNSAT TT=1.959	UNSAT TT=2.567
csp/chessboardColoration/ normalized-cc-9-9-3.xml	SAT TT=0.2	SAT TT=7.436 CHECKS=1268460 NODES=16368	SAT TT=130.294 CHECKS=35584800 NODES=345696	? (TO) TT=1800.06	SAT TT=32.491 CHECKS=10906600	? (TO) TT=1800.09	SAT TT=4.421 ASSIGNMENTS=1480	SAT TT=3.948 ASSIGNMENTS=1480	SAT TT=3.584 CHECKS=488835 NODES=2590	SAT TT=1.975 CHECKS=121936 NODES=146	SAT TT=2.13 CHECKS=74353 NODES=23	SAT TT=7.796 ASSIGNMENTS=391 CHECKS=134218	SAT TT=11.273 ASSIGNMENTS=4763 CHECKS=569419	SAT TT=4.798	SAT TT=4.58	? (TO) TT=1800.09	SAT TT=0.883 ASSIGNMENTS=2758 CHECKS=663122	? (TO) TT=1800.07	SAT TT=0.2 ASSIGNMENTS=333 CHECKS=78196	SAT TT=0.246 ASSIGNMENTS=391 CHECKS=134218	SAT TT=4.908	SAT TT=3.373	SAT TT=3.743
csp/fischer/ normalized-fischer-10-13-fair.xml		? TT=8.573	? TT=8.522	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.18	? TT=186.293	? (TO) TT=184.03	? (TO) TT=181.75	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.09	? TT=4.474	? (MO) TT=1333.45	? (MO) TT=1453.95
csp/fischer/ normalized-fischer-10-3-fair.xml	UNSAT TT=1.303	? TT=8.385	? TT=8.24	UNSAT TT=3.793	UNSAT TT=3.849 CHECKS=595113	UNSAT TT=1.557 CHECKS=750206	? (TO) TT=1800.12	? (TO) TT=1800.14	? TT=14.437	? (TO) TT=14.33	? (TO) TT=15.35	UNSAT TT=10.189 ASSIGNMENTS=5701 CHECKS=2348860	UNSAT TT=9.687 ASSIGNMENTS=5701 CHECKS=2348860	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=1.303 ASSIGNMENTS=3271 CHECKS=1063190	UNSAT TT=7.046 ASSIGNMENTS=7621 CHECKS=23277400	? (TO) TT=1800.09	UNSAT TT=2.801 ASSIGNMENTS=5759 CHECKS=3650820	UNSAT TT=2.002 ASSIGNMENTS=5701 CHECKS=2348860	? TT=2.57	UNSAT TT=160.569	UNSAT TT=269.585
csp/fischer/ normalized-fischer-10-4-fair.xml	UNSAT TT=8.629	? TT=8.551	? TT=11.688	UNSAT TT=37.466	UNSAT TT=9.773 CHECKS=7435810	UNSAT TT=8.629 CHECKS=6218900	? (TO) TT=1800.08	? (TO) TT=1800.13	? TT=22.087	? (TO) TT=22.84	? (TO) TT=21.48	UNSAT TT=82.879 ASSIGNMENTS=162418 CHECKS=100197000	UNSAT TT=77.143 ASSIGNMENTS=162418 CHECKS=100197000	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=12.218 ASSIGNMENTS=25643 CHECKS=16144800	UNSAT TT=14.39 ASSIGNMENTS=25332 CHECKS=30644600	? (TO) TT=1800.07	UNSAT TT=33.095 ASSIGNMENTS=55030 CHECKS=35295200	UNSAT TT=78.077 ASSIGNMENTS=162418 CHECKS=100197000	? TT=3.254	? (MO) TT=195.02	UNSAT TT=362.817
csp/fischer/ normalized-fischer-10-7-fair.xml		? TT=8.868	? TT=9.425	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.16	? TT=60.352	? (TO) TT=60.95	? (TO) TT=60.39	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=3.542	? (MO) TT=445.02	? (MO) TT=560.75
csp/fischer/ normalized-fischer-10-9-fair.xml		? TT=10.062	? TT=10.159	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.08	? TT=93.049	? (TO) TT=94.9	? (TO) TT=93.37	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=3.619	? (MO) TT=706.661	? (MO) TT=814.34
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fischer/ normalized-fischer-11-10-fair.xml		? TT=8.531	? TT=8.632	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.16	? TT=141.302	? (TO) TT=141.57	? (TO) TT=145.12	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=4.094	? (MO) TT=1126.64	? (MO) TT=1160.38
csp/fischer/ normalized-fischer-11-14-fair.xml		? TT=8.846	? TT=9.45	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.22	? (TO) TT=1800.14	? TT=276.799	? (TO) TT=281.1	? (TO) TT=277.61	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.12	? TT=3.508	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/fischer/ normalized-fischer-11-1-fair.xml	SAT TT=0.267	? TT=8.741	? TT=13.012	SAT TT=1.113	SAT TT=5.554 CHECKS=615038	SAT TT=3.805 CHECKS=2605130	? (TO) TT=1800.07	SAT TT=430.434 ASSIGNMENTS=23909	? TT=6.752	? (TO) TT=6.52	? (TO) TT=6.62	SAT TT=0.368 ASSIGNMENTS=72 CHECKS=406552	SAT TT=0.35 ASSIGNMENTS=72 CHECKS=406552	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.338 ASSIGNMENTS=72 CHECKS=406552	SAT TT=0.267 ASSIGNMENTS=59 CHECKS=90667	SAT TT=375.693	SAT TT=9.248 ASSIGNMENTS=30171 CHECKS=529275	SAT TT=0.309 ASSIGNMENTS=64 CHECKS=224645	? TT=2.213	SAT TT=66.714	SAT TT=117.263
csp/fischer/ normalized-fischer-11-8-fair.xml		? TT=11.755	? TT=10.847	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.11	? TT=94.002	? (TO) TT=94.92	? (TO) TT=96.64	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? TT=3.872	? (MO) TT=738.7	? (MO) TT=810.45
csp/fischer/ normalized-fischer-1-3-fair.xml	UNSAT TT=0.047	? TT=18.857	? TT=19.291	UNSAT TT=0.224	UNSAT TT=1.546 CHECKS=6764	UNSAT TT=0.047 CHECKS=5081	UNSAT TT=1544.87 ASSIGNMENTS=2236150	UNSAT TT=18.489 ASSIGNMENTS=11668	? TT=138.808	? (TO) TT=133.61	? (TO) TT=134.97	UNSAT TT=0.065 ASSIGNMENTS=6 CHECKS=4020	UNSAT TT=0.061 ASSIGNMENTS=6 CHECKS=4020	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.051 ASSIGNMENTS=4 CHECKS=3903	UNSAT TT=0.053 ASSIGNMENTS=18 CHECKS=10371	? (TO) TT=1800.11	UNSAT TT=0.056 ASSIGNMENTS=37 CHECKS=9037	UNSAT TT=0.051 ASSIGNMENTS=6 CHECKS=4020	? TT=33.926	UNSAT TT=5.351	UNSAT TT=16.177
csp/fischer/ normalized-fischer-3-7-fair.xml	UNSAT TT=3.771	? TT=8.697	? TT=8.809	UNSAT TT=107.473	UNSAT TT=244.222 CHECKS=97671000	UNSAT TT=28.176 CHECKS=18782900	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=10.863	? (TO) TT=8.7	? (TO) TT=10.38	UNSAT TT=11.599 ASSIGNMENTS=6232 CHECKS=10829900	UNSAT TT=11.673 ASSIGNMENTS=6232 CHECKS=10829900	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=22.516 ASSIGNMENTS=40623 CHECKS=80133700	? (TO) TT=1800.12	UNSAT TT=248.404 ASSIGNMENTS=567020 CHECKS=391439000	UNSAT TT=3.771 ASSIGNMENTS=6232 CHECKS=10829900	? TT=3.032	UNSAT TT=96.688	UNSAT TT=132.693
csp/fischer/ normalized-fischer-3-8-fair.xml	SAT TT=2.434	? TT=8.956	? TT=8.93	SAT TT=393.921	SAT TT=278.73 CHECKS=104795000	SAT TT=33.395 CHECKS=22408600	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=10.047	? (TO) TT=9.85	? (TO) TT=9.34	SAT TT=10.083 ASSIGNMENTS=2875 CHECKS=5245520	SAT TT=10.465 ASSIGNMENTS=2875 CHECKS=5245520	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=3.729 ASSIGNMENTS=6768 CHECKS=12788300	? (TO) TT=1800.13	SAT TT=6.223 ASSIGNMENTS=5488 CHECKS=21236500	SAT TT=2.434 ASSIGNMENTS=2875 CHECKS=5245520	? TT=3.251	SAT TT=144.583	SAT TT=170.417
csp/fischer/ normalized-fischer-4-3-fair.xml	UNSAT TT=0.217	? TT=11.948	? TT=8.89	UNSAT TT=0.811	UNSAT TT=4.881 CHECKS=204944	UNSAT TT=0.514 CHECKS=236277	? (TO) TT=1800.08	? (TO) TT=1800.17	? TT=6.472	? (TO) TT=7.03	? (TO) TT=6.31	UNSAT TT=0.256 ASSIGNMENTS=112 CHECKS=59002	UNSAT TT=0.233 ASSIGNMENTS=112 CHECKS=59002	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=0.231 ASSIGNMENTS=181 CHECKS=56491	UNSAT TT=3.005 ASSIGNMENTS=4296 CHECKS=12293300	? (TO) TT=1800.11	UNSAT TT=0.295 ASSIGNMENTS=163 CHECKS=371817	UNSAT TT=0.217 ASSIGNMENTS=139 CHECKS=62790	? TT=2.297	UNSAT TT=35.012	UNSAT TT=71.104
csp/fischer/ normalized-fischer-4-5-fair.xml	UNSAT TT=0.671	? TT=10.282	? TT=9.118	UNSAT TT=9.143	UNSAT TT=36.97 CHECKS=20987900	UNSAT TT=3.611 CHECKS=5038490	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=8.496	? (TO) TT=8.16	? (TO) TT=8.34	UNSAT TT=0.697 ASSIGNMENTS=1141 CHECKS=735989	UNSAT TT=0.671 ASSIGNMENTS=1141 CHECKS=735989	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=0.714 ASSIGNMENTS=1293 CHECKS=723542	UNSAT TT=3.152 ASSIGNMENTS=5951 CHECKS=12005700	? (TO) TT=1800.1	UNSAT TT=26.045 ASSIGNMENTS=60371 CHECKS=16227800	UNSAT TT=0.809 ASSIGNMENTS=1515 CHECKS=979529	? TT=2.987	UNSAT TT=79.357	UNSAT TT=115.514
csp/fischer/ normalized-fischer-4-7-fair.xml	UNSAT TT=9.967	? TT=11.144	? TT=8.372	UNSAT TT=741.046	UNSAT TT=232.195 CHECKS=97493600	UNSAT TT=73.521 CHECKS=41031000	? (TO) TT=1800.09	? (TO) TT=1800.13	? TT=11.435	? (TO) TT=11.39	? (TO) TT=12.13	UNSAT TT=32.662 ASSIGNMENTS=37687 CHECKS=75980000	UNSAT TT=35.511 ASSIGNMENTS=37687 CHECKS=75980000	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=9.967 ASSIGNMENTS=13801 CHECKS=28876400	UNSAT TT=31.76 ASSIGNMENTS=45463 CHECKS=96490500	? (TO) TT=1800.1	UNSAT TT=24.947 ASSIGNMENTS=35301 CHECKS=63197700	UNSAT TT=26.709 ASSIGNMENTS=37687 CHECKS=75980000	? TT=2.645	UNSAT TT=146.316	UNSAT TT=241.585
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fischer/ normalized-fischer-5-7-fair.xml	UNSAT TT=35.801	? TT=8.737	? TT=9.728	? (TO) TT=1800.07	UNSAT TT=287.455 CHECKS=107568000	UNSAT TT=171.928 CHECKS=83777100	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=16.55	? (TO) TT=18.59	? (TO) TT=16.5	UNSAT TT=168.788 ASSIGNMENTS=216764 CHECKS=381172000	UNSAT TT=157.893 ASSIGNMENTS=216764 CHECKS=381172000	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=35.801 ASSIGNMENTS=48166 CHECKS=85378200	UNSAT TT=40.134 ASSIGNMENTS=57924 CHECKS=121142000	? (TO) TT=1800.11	UNSAT TT=190.743 ASSIGNMENTS=226285 CHECKS=416922000	UNSAT TT=150.655 ASSIGNMENTS=216764 CHECKS=381172000	? TT=2.649	UNSAT TT=198.9	UNSAT TT=298.366
csp/fischer/ normalized-fischer-6-11-fair.xml	SAT TT=57.416	? TT=9.065	? TT=8.95	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.15	? TT=56.905	? (TO) TT=57.48	? (TO) TT=56.71	SAT TT=217.742 ASSIGNMENTS=97133 CHECKS=639333000	SAT TT=213.87 ASSIGNMENTS=97133 CHECKS=639333000	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=837.111 ASSIGNMENTS=435897 CHECKS=1940240000	SAT TT=207.135 ASSIGNMENTS=97133 CHECKS=639333000	? TT=3.736	? (MO) TT=378.22	? (MO) TT=530.755
csp/fischer/ normalized-fischer-6-4-fair.xml	UNSAT TT=0.899	? TT=9.157	? TT=10.562	UNSAT TT=2.012	UNSAT TT=5.776 CHECKS=2966720	UNSAT TT=2.685 CHECKS=2830600	? (TO) TT=1800.11	? (TO) TT=1800.14	? TT=11.69	? (TO) TT=11.04	? (TO) TT=10.5	UNSAT TT=1.011 ASSIGNMENTS=2019 CHECKS=1056780	UNSAT TT=1.023 ASSIGNMENTS=2019 CHECKS=1056780	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.899 ASSIGNMENTS=1440 CHECKS=644124	UNSAT TT=4.748 ASSIGNMENTS=6571 CHECKS=15436700	? (TO) TT=1800.06	UNSAT TT=1.015 ASSIGNMENTS=1425 CHECKS=758630	UNSAT TT=0.945 ASSIGNMENTS=1858 CHECKS=1033880	? TT=3.209	UNSAT TT=102.584	UNSAT TT=171.396
csp/fischer/ normalized-fischer-6-5-fair.xml	UNSAT TT=3.389	? TT=9.063	? TT=9.249	UNSAT TT=154.066	UNSAT TT=15.592 CHECKS=14647100	UNSAT TT=4.637 CHECKS=5646940	? (TO) TT=1800.14	? (TO) TT=1800.1	? TT=14.585	? (TO) TT=12.93	? (TO) TT=13.88	UNSAT TT=19.167 ASSIGNMENTS=26633 CHECKS=18768600	UNSAT TT=20.392 ASSIGNMENTS=26633 CHECKS=18768600	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=3.389 ASSIGNMENTS=7340 CHECKS=4785990	UNSAT TT=6.601 ASSIGNMENTS=11722 CHECKS=19471500	? (TO) TT=1800.06	UNSAT TT=14.018 ASSIGNMENTS=25574 CHECKS=18226400	UNSAT TT=11.44 ASSIGNMENTS=26633 CHECKS=18768600	? TT=2.534	UNSAT TT=184.09	UNSAT TT=224.696
csp/fischer/ normalized-fischer-6-7-fair.xml	UNSAT TT=119.743	? TT=10.142	? TT=12.806	? (TO) TT=1800.05	UNSAT TT=406.253 CHECKS=137578000	UNSAT TT=536.647 CHECKS=221728000	? (TO) TT=1800.15	? (TO) TT=1800.12	? TT=22.073	? (TO) TT=21.68	? (TO) TT=21.59	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=119.743 ASSIGNMENTS=144660 CHECKS=254227000	UNSAT TT=121.475 ASSIGNMENTS=158668 CHECKS=279944000	? (TO) TT=1800.03	UNSAT TT=438.638 ASSIGNMENTS=487363 CHECKS=744092000	? (TO) TT=1800.07	? TT=3.193	UNSAT TT=345.985	UNSAT TT=383.907
csp/fischer/ normalized-fischer-7-12-fair.xml	SAT TT=1403.18	? TT=8.409	? TT=12.273	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.16	? TT=76.597	? (TO) TT=76.55	? (TO) TT=75.38	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=1403.18 ASSIGNMENTS=549108 CHECKS=2282700000	? (TO) TT=1800.08	? TT=3.701	? (MO) TT=587.561	? (MO) TT=667.26
csp/fischer/ normalized-fischer-7-3-fair.xml	UNSAT TT=0.535	? TT=8.428	? TT=10.713	UNSAT TT=1.515	UNSAT TT=3.654 CHECKS=279351	UNSAT TT=1.465 CHECKS=798091	? (TO) TT=1800.16	? (TO) TT=1800.07	? TT=8.713	? (TO) TT=8.27	? (TO) TT=8.39	UNSAT TT=0.546 ASSIGNMENTS=704 CHECKS=259497	UNSAT TT=0.535 ASSIGNMENTS=704 CHECKS=259497	? (TO) TT=1800.01	? (TO) TT=1800.09	UNSAT TT=0.549 ASSIGNMENTS=777 CHECKS=228418	UNSAT TT=4.566 ASSIGNMENTS=5483 CHECKS=17690900	? (TO) TT=1800.12	UNSAT TT=0.992 ASSIGNMENTS=1011 CHECKS=717541	UNSAT TT=0.575 ASSIGNMENTS=907 CHECKS=338071	? TT=3.16	UNSAT TT=84.829	UNSAT TT=156.302
csp/fischer/ normalized-fischer-7-4-fair.xml	UNSAT TT=1.476	? TT=8.604	? TT=8.645	UNSAT TT=2.869	UNSAT TT=6.846 CHECKS=3903290	UNSAT TT=7.716 CHECKS=3155140	? (TO) TT=1800.12	? (TO) TT=1800.32	? TT=13.155	? (TO) TT=13.94	? (TO) TT=14.07	UNSAT TT=9.769 ASSIGNMENTS=3262 CHECKS=1681260	UNSAT TT=1.908 ASSIGNMENTS=4698 CHECKS=2510770	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=1.476 ASSIGNMENTS=2780 CHECKS=1322900	UNSAT TT=5.667 ASSIGNMENTS=9327 CHECKS=18040100	? (TO) TT=1800.04	UNSAT TT=99.116 ASSIGNMENTS=127928 CHECKS=68389800	UNSAT TT=2.597 ASSIGNMENTS=3262 CHECKS=1681260	? TT=2.573	UNSAT TT=157.091	UNSAT TT=218.708
csp/fischer/ normalized-fischer-8-11-fair.xml		? TT=10.287	? TT=8.935	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.18	? TT=95.659	? (TO) TT=90.72	? (TO) TT=89.81	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.11	? TT=4.115	? (MO) TT=639.262	? (MO) TT=822.97
csp/fischer/ normalized-fischer-8-3-fair.xml	UNSAT TT=0.625	? TT=11.882	? TT=9.592	UNSAT TT=1.903	UNSAT TT=3.635 CHECKS=411782	UNSAT TT=1.057 CHECKS=500543	? (TO) TT=1800.13	? (TO) TT=1800.11	? TT=10.043	? (TO) TT=12.29	? (TO) TT=12.17	UNSAT TT=0.92 ASSIGNMENTS=1862 CHECKS=704939	UNSAT TT=0.812 ASSIGNMENTS=1862 CHECKS=704939	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.625 ASSIGNMENTS=1116 CHECKS=368377	UNSAT TT=4.65 ASSIGNMENTS=6196 CHECKS=17507800	? (TO) TT=1800.12	UNSAT TT=1.392 ASSIGNMENTS=2406 CHECKS=1351640	UNSAT TT=1.076 ASSIGNMENTS=2698 CHECKS=1008890	? TT=3.509	UNSAT TT=101.627	UNSAT TT=179.364
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fischer/ normalized-fischer-9-1-fair.xml	SAT TT=0.248	? TT=9.779	? TT=10.426	SAT TT=0.858	SAT TT=50.08 CHECKS=10428800	SAT TT=4.845 CHECKS=3024060	? (TO) TT=1800.1	SAT TT=17.555 ASSIGNMENTS=2254	? TT=6.171	? (TO) TT=5.45	? (TO) TT=5.47	SAT TT=0.274 ASSIGNMENTS=126 CHECKS=297862	SAT TT=0.276 ASSIGNMENTS=126 CHECKS=297862	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=0.267 ASSIGNMENTS=126 CHECKS=297862	SAT TT=0.248 ASSIGNMENTS=117 CHECKS=168746	SAT TT=57.813	SAT TT=2.559 ASSIGNMENTS=10017 CHECKS=188061	SAT TT=0.259 ASSIGNMENTS=126 CHECKS=218936	? TT=2.004	SAT TT=46.24	SAT TT=96.158
csp/fischer/ normalized-fischer-9-2-fair.xml	UNSAT TT=2.713	? TT=8.487	? TT=8.403	UNSAT TT=57.475	UNSAT TT=6.186 CHECKS=1600900	UNSAT TT=2.713 CHECKS=1589810	? (TO) TT=1800.16	? (TO) TT=1800.06	? TT=9.194	? (TO) TT=8.78	? (TO) TT=9.26	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=1291.43 ASSIGNMENTS=7473280 CHECKS=1320930000	UNSAT TT=14.985 ASSIGNMENTS=28689 CHECKS=59924100	? (TO) TT=1800.08	UNSAT TT=5.422 ASSIGNMENTS=7502 CHECKS=10509300	? (TO) TT=1800.02	? TT=2.898	UNSAT TT=76.46	UNSAT TT=164.58
csp/fischer/ normalized-fischer-9-4-fair.xml	UNSAT TT=5.672	? TT=8.883	? TT=10.321	UNSAT TT=15.213	UNSAT TT=8.973 CHECKS=6207910	UNSAT TT=5.672 CHECKS=4780150	? (TO) TT=1800.12	? (TO) TT=1800.09	? TT=17.785	? (TO) TT=17.39	? (TO) TT=18.12	UNSAT TT=25.756 ASSIGNMENTS=40097 CHECKS=23634500	UNSAT TT=24.505 ASSIGNMENTS=40097 CHECKS=23634500	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=8.405 ASSIGNMENTS=17044 CHECKS=11217400	UNSAT TT=10.866 ASSIGNMENTS=21214 CHECKS=25730400	? (TO) TT=1800.04	UNSAT TT=9.05 ASSIGNMENTS=14040 CHECKS=9230950	UNSAT TT=16.866 ASSIGNMENTS=40097 CHECKS=23634500	? TT=2.837	UNSAT TT=212.554	UNSAT TT=305.81
csp/fischer/ normalized-fischer-9-6-fair.xml	UNSAT TT=125.751	? TT=8.488	? TT=8.554	? (TO) TT=1800.09	UNSAT TT=125.751 CHECKS=61394200	UNSAT TT=358.86 CHECKS=111003000	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=38.227	? (TO) TT=38.14	? (TO) TT=37.94	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=334.426 ASSIGNMENTS=415556 CHECKS=518887000	UNSAT TT=382.529 ASSIGNMENTS=404784 CHECKS=511161000	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.01	? TT=3.319	? (MO) TT=293.34	? (MO) TT=425.74
csp/golombRulerArity3/ normalized-ruler-17-6-a3.xml	SAT TT=0.01	SAT TT=0.922 CHECKS=71934 NODES=39	SAT TT=1.141 CHECKS=472694 NODES=193	SAT TT=0.051	SAT TT=32.071 CHECKS=189270000	SAT TT=3.218 CHECKS=18839000	SAT TT=0.889 ASSIGNMENTS=44	SAT TT=0.873 ASSIGNMENTS=6	SAT TT=0.792 CHECKS=68106 NODES=37	SAT TT=4.183 CHECKS=17628100 NODES=78437	SAT TT=0.775 CHECKS=181419 NODES=438	SAT TT=0.022 ASSIGNMENTS=9 CHECKS=1335	SAT TT=0.022 ASSIGNMENTS=9 CHECKS=1335	SAT TT=1.941	SAT TT=2.004	SAT TT=0.011 ASSIGNMENTS=12 CHECKS=1687	SAT TT=0.01 ASSIGNMENTS=54 CHECKS=4956	SAT TT=0.417	SAT TT=0.022 ASSIGNMENTS=248 CHECKS=18720	SAT TT=0.012 ASSIGNMENTS=41 CHECKS=4762	SAT TT=3.63	SAT TT=0.732	SAT TT=0.756
csp/golombRulerArity3/ normalized-ruler-17-7-a3.xml	UNSAT TT=0.013	UNSAT TT=0.871 CHECKS=748 NODES=0	UNSAT TT=0.845 CHECKS=748 NODES=0	UNSAT TT=0.056	UNSAT TT=0.219 CHECKS=1011840	UNSAT TT=0.04 CHECKS=131682	UNSAT TT=0.851 ASSIGNMENTS=0	UNSAT TT=0.939 ASSIGNMENTS=0	UNSAT TT=1.013 CHECKS=206955 NODES=105	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.165	UNSAT TT=2.045	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.507	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.14	UNSAT TT=0.906	UNSAT TT=0.987
csp/golombRulerArity3/ normalized-ruler-25-7-a3.xml	SAT TT=0.016	SAT TT=1.069 CHECKS=561726 NODES=95	SAT TT=2.548 CHECKS=5037270 NODES=1650	SAT TT=0.222	SAT TT=32.001 CHECKS=203766000	SAT TT=3.361 CHECKS=20990600	SAT TT=2.164 ASSIGNMENTS=1036	SAT TT=1.127 ASSIGNMENTS=7	SAT TT=1.636 CHECKS=1255470 NODES=766	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=0.054 ASSIGNMENTS=482 CHECKS=69702	SAT TT=0.053 ASSIGNMENTS=482 CHECKS=69702	SAT TT=5.024	SAT TT=3.657	SAT TT=0.027 ASSIGNMENTS=277 CHECKS=47129	SAT TT=0.026 ASSIGNMENTS=198 CHECKS=24863	SAT TT=0.583	SAT TT=0.029 ASSIGNMENTS=248 CHECKS=27416	SAT TT=0.016 ASSIGNMENTS=51 CHECKS=8195	SAT TT=7.741	SAT TT=0.94	SAT TT=1.093
csp/golombRulerArity3/ normalized-ruler-25-8-a3.xml	UNSAT TT=0.019	UNSAT TT=0.935 CHECKS=9749 NODES=0	UNSAT TT=0.978 CHECKS=9749 NODES=0	UNSAT TT=0.077	UNSAT TT=30.568 CHECKS=222081000	UNSAT TT=4.039 CHECKS=25736200	UNSAT TT=0.959 ASSIGNMENTS=0	UNSAT TT=1.034 ASSIGNMENTS=0	UNSAT TT=2.405 CHECKS=2898580 NODES=1023	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=5.225	UNSAT TT=5.366	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.846	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=21.933	UNSAT TT=1.296	UNSAT TT=1.64
csp/golombRulerArity3/ normalized-ruler-34-8-a3.xml	SAT TT=0.075	SAT TT=10.579 CHECKS=28958300 NODES=10435	SAT TT=20.538 CHECKS=60744900 NODES=19252	SAT TT=4.59	SAT TT=30.507 CHECKS=220464000	SAT TT=0.841 CHECKS=4430220	SAT TT=9.933 ASSIGNMENTS=9698	SAT TT=1.54 ASSIGNMENTS=201	SAT TT=8.995 CHECKS=17106600 NODES=7420	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=0.075 ASSIGNMENTS=434 CHECKS=100669	SAT TT=0.075 ASSIGNMENTS=434 CHECKS=100669	SAT TT=38.122	SAT TT=17.069	SAT TT=0.075 ASSIGNMENTS=593 CHECKS=139770	SAT TT=0.34 ASSIGNMENTS=1923 CHECKS=420336	SAT TT=0.688	SAT TT=0.62 ASSIGNMENTS=5113 CHECKS=853030	SAT TT=2.02 ASSIGNMENTS=18266 CHECKS=3375350	SAT TT=156.138	SAT TT=1.842	SAT TT=6.921
csp/golombRulerArity3/ normalized-ruler-34-9-a3.xml	UNSAT TT=0.027	UNSAT TT=1.058 CHECKS=23204 NODES=0	UNSAT TT=1.052 CHECKS=23204 NODES=0	UNSAT TT=0.11	UNSAT TT=43.426 CHECKS=279038000	UNSAT TT=11.989 CHECKS=68180900	UNSAT TT=1.427 ASSIGNMENTS=0	UNSAT TT=1.357 ASSIGNMENTS=0	UNSAT TT=17.947 CHECKS=40363200 NODES=10627	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=42.179	UNSAT TT=49.095	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.16	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=323.549	UNSAT TT=4.342	UNSAT TT=5.091
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/golombRulerArity3/ normalized-ruler-44-10-a3.xml	UNSAT TT=0.038	UNSAT TT=1.261 CHECKS=48509 NODES=0	UNSAT TT=1.214 CHECKS=48509 NODES=0	UNSAT TT=0.157	UNSAT TT=149.162 CHECKS=880503000	UNSAT TT=234.877 CHECKS=1165490000	UNSAT TT=1.434 ASSIGNMENTS=0	UNSAT TT=1.359 ASSIGNMENTS=0	UNSAT TT=70.374 CHECKS=185049000 NODES=21303	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=369.002	UNSAT TT=679.142	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=5.798	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.18	UNSAT TT=53.285	UNSAT TT=57.955
csp/golombRulerArity3/ normalized-ruler-44-9-a3.xml	SAT TT=2.18	SAT TT=101.28 CHECKS=338387000 NODES=85284	SAT TT=306.261 CHECKS=912202000 NODES=192760	SAT TT=99.291	SAT TT=160.481 CHECKS=877464000	SAT TT=16.79 CHECKS=93274300	SAT TT=18.087 ASSIGNMENTS=10804	SAT TT=8.453 ASSIGNMENTS=6288	SAT TT=68.181 CHECKS=181104000 NODES=40844	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=106.611 ASSIGNMENTS=85284 CHECKS=338387000	SAT TT=107.545 ASSIGNMENTS=85284 CHECKS=338387000	SAT TT=98.214	SAT TT=235.778	SAT TT=2.18 ASSIGNMENTS=15098 CHECKS=3514780	SAT TT=9.054 ASSIGNMENTS=56230 CHECKS=13240100	SAT TT=2.142	SAT TT=4.541 ASSIGNMENTS=27756 CHECKS=5983490	SAT TT=17.005 ASSIGNMENTS=105241 CHECKS=25440700	? (TO) TT=1800.1	SAT TT=3.605	SAT TT=2.544
csp/golombRulerArity3/ normalized-ruler-55-10-a3.xml	SAT TT=2.627	SAT TT=1518.81 CHECKS=5030680000 NODES=852882	SAT TT=1327.63 CHECKS=4471290000 NODES=815642	SAT TT=1344.27	SAT TT=50.615 CHECKS=312405000	SAT TT=632.905 CHECKS=3374480000	SAT TT=54.158 ASSIGNMENTS=26592	SAT TT=2.627 ASSIGNMENTS=224	SAT TT=212.74 CHECKS=512964000 NODES=82676	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=645.054 ASSIGNMENTS=674738 CHECKS=190649000	SAT TT=643.845 ASSIGNMENTS=674738 CHECKS=190649000	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=17.958 ASSIGNMENTS=75790 CHECKS=25578000	SAT TT=61.987 ASSIGNMENTS=308935 CHECKS=91791700	SAT TT=12.364	SAT TT=33.134 ASSIGNMENTS=171486 CHECKS=48062100	SAT TT=141.823 ASSIGNMENTS=674738 CHECKS=190649000	? (TO) TT=1802.19	SAT TT=80.313	SAT TT=321.18
csp/golombRulerArity3/ normalized-ruler-55-11-a3.xml	UNSAT TT=0.059	? (MO) TT=1.03	? (TO) TT=1800.11	UNSAT TT=0.322	UNSAT TT=651.041 CHECKS=3187240000	UNSAT TT=276.773 CHECKS=1419050000	UNSAT TT=1.898 ASSIGNMENTS=0	UNSAT TT=1.743 ASSIGNMENTS=0	UNSAT TT=758.361 CHECKS=1851230000 NODES=180844	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=0.068 ASSIGNMENTS=1 CHECKS=5347	UNSAT TT=0.073 ASSIGNMENTS=1 CHECKS=5347	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.059 ASSIGNMENTS=1 CHECKS=5347	UNSAT TT=0.072 ASSIGNMENTS=34 CHECKS=20215	UNSAT TT=49.138	UNSAT TT=0.18 ASSIGNMENTS=185 CHECKS=83910	UNSAT TT=0.641 ASSIGNMENTS=426 CHECKS=303910	? (exit code) TT=229.978	UNSAT TT=576.074	UNSAT TT=663.534
csp/golombRulerArity3/ normalized-ruler-67-11-a3.xml	UNSAT TT=481.664	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.14	UNSAT TT=739.711 ASSIGNMENTS=344041	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=1173.04 ASSIGNMENTS=3748360 CHECKS=1707990000	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=481.664 ASSIGNMENTS=1419520 CHECKS=701771000	UNSAT TT=663.864 ASSIGNMENTS=1946100 CHECKS=920254000	UNSAT TT=491.775	? (TO) TT=1800.01	UNSAT TT=1196.01 ASSIGNMENTS=3748360 CHECKS=1707990000	? TT=137.905	? (TO) TT=1800.06	? (TO) TT=1800.08
csp/golombRulerArity3/ normalized-ruler-67-12-a3.xml	UNSAT TT=0.216	? (TO) TT=1800.12	? (TO) TT=1800.13	UNSAT TT=310.414	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=2.542 ASSIGNMENTS=0	UNSAT TT=2.649 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.382 ASSIGNMENTS=158 CHECKS=165599	UNSAT TT=0.384 ASSIGNMENTS=158 CHECKS=165599	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.303 ASSIGNMENTS=116 CHECKS=122632	UNSAT TT=1.586 ASSIGNMENTS=1839 CHECKS=1228210	UNSAT TT=454.412	UNSAT TT=1.785 ASSIGNMENTS=1148 CHECKS=644305	UNSAT TT=0.216 ASSIGNMENTS=62 CHECKS=76810	? TT=122.391	? (TO) TT=1800.04	? (TO) TT=1800.12
csp/golombRulerArity3/ normalized-ruler-70-12-a3.xml	UNSAT TT=2.633	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	UNSAT TT=2.614 ASSIGNMENTS=0	UNSAT TT=2.633 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=479.399 ASSIGNMENTS=983931 CHECKS=605767000	UNSAT TT=938.648 ASSIGNMENTS=983931 CHECKS=605767000	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=306.759 ASSIGNMENTS=758155 CHECKS=458500000	UNSAT TT=408.825 ASSIGNMENTS=987631 CHECKS=542072000	UNSAT TT=581.574	? (TO) TT=1800.09	UNSAT TT=432.31 ASSIGNMENTS=983931 CHECKS=605767000	? (MO) TT=81.524	? (TO) TT=1800.05	? (TO) TT=1800.1
csp/golombRulerArity3/ normalized-ruler-70-13-a3.xml	UNSAT TT=0.109	UNSAT TT=1.557 CHECKS=186374 NODES=0	UNSAT TT=1.606 CHECKS=186374 NODES=0	UNSAT TT=0.409	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=2.441 ASSIGNMENTS=0	UNSAT TT=2.214 ASSIGNMENTS=0	UNSAT TT=1730.48 CHECKS=5479830000 NODES=120218	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=0.115 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.126 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.109 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.111 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=702.199	UNSAT TT=0.111 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.114 ASSIGNMENTS=0 CHECKS=1	? TT=121.619	? (TO) TT=1800.03	? (TO) TT=1800.12
csp/golombRulerArity4/ normalized-ruler-17-6-a4.xml	SAT TT=0.015	SAT TT=0.857 CHECKS=6556 NODES=10	SAT TT=0.804 CHECKS=15322 NODES=12	SAT TT=0.041	SAT TT=0.019 CHECKS=21000	SAT TT=0.015 CHECKS=20440	SAT TT=0.876 ASSIGNMENTS=159	SAT TT=0.803 ASSIGNMENTS=33	SAT TT=1.826 CHECKS=30378 NODES=151	SAT TT=1.204 CHECKS=375267 NODES=504	SAT TT=0.815 CHECKS=86307 NODES=93	SAT TT=0.035 ASSIGNMENTS=52 CHECKS=25072	SAT TT=0.036 ASSIGNMENTS=52 CHECKS=25072	SAT TT=7.232	SAT TT=7.27	SAT TT=0.125 ASSIGNMENTS=399 CHECKS=180087	SAT TT=0.304 ASSIGNMENTS=3599 CHECKS=539305	SAT TT=0.445	SAT TT=0.37 ASSIGNMENTS=3182 CHECKS=560361	SAT TT=0.037 ASSIGNMENTS=124 CHECKS=60616	SAT TT=9.911	SAT TT=1.057	SAT TT=2.043
csp/golombRulerArity4/ normalized-ruler-17-7-a4.xml	UNSAT TT=0.064	UNSAT TT=1.088 CHECKS=167936 NODES=285	UNSAT TT=1.126 CHECKS=186965 NODES=290	UNSAT TT=0.064	UNSAT TT=32.135 CHECKS=199230000	UNSAT TT=0.083 CHECKS=271584	UNSAT TT=1.243 ASSIGNMENTS=271	UNSAT TT=1.066 ASSIGNMENTS=150	UNSAT TT=3.706 CHECKS=83261 NODES=200	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.185 ASSIGNMENTS=268 CHECKS=250493	UNSAT TT=0.172 ASSIGNMENTS=268 CHECKS=250493	UNSAT TT=14.574	UNSAT TT=13.128	UNSAT TT=0.247 ASSIGNMENTS=342 CHECKS=313200	UNSAT TT=0.343 ASSIGNMENTS=3245 CHECKS=579763	UNSAT TT=0.643	UNSAT TT=13.25 ASSIGNMENTS=82632 CHECKS=27788100	UNSAT TT=0.15 ASSIGNMENTS=256 CHECKS=243327	UNSAT TT=21.605	UNSAT TT=1.811	UNSAT TT=2.982
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/golombRulerArity4/ normalized-ruler-25-7-a4.xml	SAT TT=0.062	SAT TT=0.962 CHECKS=64052 NODES=55	SAT TT=1.016 CHECKS=121496 NODES=138	SAT TT=0.062	SAT TT=0.874 CHECKS=3446860	SAT TT=0.624 CHECKS=2417890	SAT TT=1.21 ASSIGNMENTS=248	SAT TT=1.072 ASSIGNMENTS=46	SAT TT=12.425 CHECKS=231236 NODES=520	SAT TT=1.589 CHECKS=677417 NODES=326	SAT TT=1.385 CHECKS=105646 NODES=27	SAT TT=0.269 ASSIGNMENTS=441 CHECKS=358265	SAT TT=0.293 ASSIGNMENTS=441 CHECKS=358265	SAT TT=47.807	SAT TT=33.464	SAT TT=2.519 ASSIGNMENTS=3332 CHECKS=2844560	SAT TT=3.159 ASSIGNMENTS=7421 CHECKS=4052060	SAT TT=0.642	SAT TT=36.49 ASSIGNMENTS=193090 CHECKS=69831200	SAT TT=2.806 ASSIGNMENTS=4521 CHECKS=3598020	SAT TT=75.282	SAT TT=3.272	SAT TT=11.247
csp/golombRulerArity4/ normalized-ruler-25-8-a4.xml	UNSAT TT=0.167	UNSAT TT=3.228 CHECKS=2205720 NODES=1924	UNSAT TT=2.941 CHECKS=1732700 NODES=1571	UNSAT TT=0.167	UNSAT TT=5.102 CHECKS=19713900	UNSAT TT=7.647 CHECKS=31201300	UNSAT TT=4.001 ASSIGNMENTS=2675	UNSAT TT=2.341 ASSIGNMENTS=1043	UNSAT TT=22.018 CHECKS=933192 NODES=1235	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=10.752 ASSIGNMENTS=1924 CHECKS=2205720	UNSAT TT=10.883 ASSIGNMENTS=1924 CHECKS=2205720	UNSAT TT=110.984	UNSAT TT=112.156	UNSAT TT=3.891 ASSIGNMENTS=2323 CHECKS=3879680	UNSAT TT=3.469 ASSIGNMENTS=4952 CHECKS=3753680	UNSAT TT=0.739	UNSAT TT=131.548 ASSIGNMENTS=454104 CHECKS=258182000	UNSAT TT=2.784 ASSIGNMENTS=2119 CHECKS=3283420	UNSAT TT=137.678	UNSAT TT=23.456	UNSAT TT=42.059
csp/golombRulerArity4/ normalized-ruler-34-8-a4.xml	SAT TT=0.171	SAT TT=1.302 CHECKS=285828 NODES=221	SAT TT=1.486 CHECKS=429803 NODES=408	SAT TT=0.171	SAT TT=38.665 CHECKS=194940000	SAT TT=6.829 CHECKS=25613600	SAT TT=3.337 ASSIGNMENTS=1714	SAT TT=3.093 ASSIGNMENTS=1714	SAT TT=76.302 CHECKS=12241200 NODES=20022	SAT TT=7.284 CHECKS=9428430 NODES=2152	SAT TT=3.759 CHECKS=2601190 NODES=550	SAT TT=8.397 ASSIGNMENTS=221 CHECKS=285828	SAT TT=8.94 ASSIGNMENTS=221 CHECKS=285828	SAT TT=416.736	SAT TT=100.33	SAT TT=3.914 ASSIGNMENTS=2339 CHECKS=3610100	SAT TT=47.726 ASSIGNMENTS=32077 CHECKS=42293600	SAT TT=0.723	SAT TT=288.439 ASSIGNMENTS=735982 CHECKS=482836000	SAT TT=11.873 ASSIGNMENTS=7804 CHECKS=11220800	SAT TT=502.436	SAT TT=16.031	SAT TT=41.31
csp/golombRulerArity4/ normalized-ruler-34-9-a4.xml	UNSAT TT=1.607	UNSAT TT=30.542 CHECKS=27699300 NODES=16325	UNSAT TT=26.796 CHECKS=25650800 NODES=15770	UNSAT TT=1.607	UNSAT TT=95.692 CHECKS=400410000	UNSAT TT=103.372 CHECKS=374609000	UNSAT TT=32.469 ASSIGNMENTS=21235	UNSAT TT=32.768 ASSIGNMENTS=21235	UNSAT TT=74.057 CHECKS=10035600 NODES=8731	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=35.791 ASSIGNMENTS=16325 CHECKS=27699300	UNSAT TT=38.519 ASSIGNMENTS=16325 CHECKS=27699300	UNSAT TT=922.554	UNSAT TT=1653.62	UNSAT TT=41.325 ASSIGNMENTS=10874 CHECKS=29474600	UNSAT TT=61.034 ASSIGNMENTS=18485 CHECKS=42834300	UNSAT TT=1.148	UNSAT TT=1210.33 ASSIGNMENTS=1765970 CHECKS=1623110000	UNSAT TT=28.926 ASSIGNMENTS=10112 CHECKS=24333200	UNSAT TT=922.127	UNSAT TT=238.561	UNSAT TT=632.384
csp/golombRulerArity4/ normalized-ruler-44-10-a4.xml	UNSAT TT=8.721	UNSAT TT=242.735 CHECKS=235085000 NODES=82017	UNSAT TT=165.991 CHECKS=137337000 NODES=52987	UNSAT TT=8.721	UNSAT TT=240.374 CHECKS=871265000	UNSAT TT=122.873 CHECKS=475470000	UNSAT TT=629.815 ASSIGNMENTS=229488	UNSAT TT=637.048 ASSIGNMENTS=229488	UNSAT TT=161.465 CHECKS=82702700 NODES=39955	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=257.504 ASSIGNMENTS=82017 CHECKS=235085000	UNSAT TT=250.999 ASSIGNMENTS=82017 CHECKS=235085000	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=302.217 ASSIGNMENTS=46039 CHECKS=166675000	UNSAT TT=543.122 ASSIGNMENTS=71448 CHECKS=280312000	UNSAT TT=4.986	? (TO) TT=1800.09	UNSAT TT=440.378 ASSIGNMENTS=62868 CHECKS=225770000	? (TO) TT=1801.9	? (TO) TT=1800.02	? (TO) TT=1800.08
csp/golombRulerArity4/ normalized-ruler-44-9-a4.xml	SAT TT=3.076	SAT TT=7.169 CHECKS=5585320 NODES=3629	SAT TT=5.018 CHECKS=3567980 NODES=2377	SAT TT=3.076	SAT TT=150.526 CHECKS=550404000	SAT TT=84.71 CHECKS=305916000	SAT TT=93.246 ASSIGNMENTS=38459	SAT TT=102.311 ASSIGNMENTS=38459	SAT TT=191.33 CHECKS=107111000 NODES=105570	SAT TT=76.216 CHECKS=124061000 NODES=14410	? (TO) TT=1800.07	SAT TT=13.696 ASSIGNMENTS=3629 CHECKS=5585320	SAT TT=14.446 ASSIGNMENTS=3629 CHECKS=5585320	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=36.506 ASSIGNMENTS=11429 CHECKS=26049900	SAT TT=431.533 ASSIGNMENTS=114754 CHECKS=263194000	SAT TT=2.166	? (TO) TT=1800.03	SAT TT=641.168 ASSIGNMENTS=187356 CHECKS=435448000	? (TO) TT=1802.2	SAT TT=127.626	SAT TT=1716.08
csp/golombRulerArity4/ normalized-ruler-55-10-a4.xml	SAT TT=10.948	SAT TT=22.868 CHECKS=18865400 NODES=8611	SAT TT=10.948 CHECKS=7960140 NODES=3105	SAT TT=53.028	SAT TT=1034.9 CHECKS=3735620000	SAT TT=866.744 CHECKS=2908610000	SAT TT=180.562 ASSIGNMENTS=66901	SAT TT=183.187 ASSIGNMENTS=66901	SAT TT=191.182 CHECKS=105709000 NODES=40275	SAT TT=1034.52 CHECKS=1759330000 NODES=112358	? (TO) TT=1800.09	SAT TT=28.671 ASSIGNMENTS=8611 CHECKS=18865400	SAT TT=29.087 ASSIGNMENTS=8611 CHECKS=18865400	? (MO) TT=764.52	? (MO) TT=726.7	SAT TT=256.806 ASSIGNMENTS=40183 CHECKS=138122000	SAT TT=328.621 ASSIGNMENTS=49815 CHECKS=163775000	SAT TT=11.704	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.88	? (TO) TT=1800.1	? (TO) TT=1800.08
csp/golombRulerArity4/ normalized-ruler-55-11-a4.xml	UNSAT TT=126.19	? (TO) TT=1800.16	UNSAT TT=1568.97 CHECKS=1326640000 NODES=340090	UNSAT TT=126.19	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.14	UNSAT TT=720.487 ASSIGNMENTS=208157	UNSAT TT=957.629 CHECKS=761886000 NODES=260086	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.04	? (MO) TT=1098.55	? (MO) TT=1205.89	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=17.956	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1801.04	? (TO) TT=1800.27	? (TO) TT=1800.11
csp/golombRulerArity4/ normalized-ruler-67-11-a4.xml		? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=427.536	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1801.28	? (MO) TT=62.96	? (MO) TT=258.11
csp/golombRulerArity4/ normalized-ruler-67-12-a4.xml	UNSAT TT=427.269	? (TO) TT=1800.16	? (TO) TT=1800.12	UNSAT TT=427.269	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=156.998	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1801.76	? (MO) TT=87.96	? (MO) TT=258.87
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/golombRulerArity4/ normalized-ruler-70-12-a4.xml		? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=455.772	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.54	? (MO) TT=89.48	? (MO) TT=284.33
csp/golombRulerArity4/ normalized-ruler-70-13-a4.xml	UNSAT TT=860.676	? (TO) TT=1800.09	? (TO) TT=1800.14	UNSAT TT=860.676	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=166.862	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1801.72	? (MO) TT=131.149	? (MO) TT=296.602
csp/graceful/ normalized-graceful--K4-P2.xml	SAT TT=0.022	SAT TT=4.034 CHECKS=8857960 NODES=4514	SAT TT=3.123 CHECKS=6251660 NODES=3627	? (TO) TT=1800.11	SAT TT=0.446 CHECKS=1994830	SAT TT=0.61 CHECKS=2677860	SAT TT=0.906 ASSIGNMENTS=40	SAT TT=0.857 ASSIGNMENTS=17	SAT TT=1.208 CHECKS=753993 NODES=1071	SAT TT=5.363 CHECKS=25780700 NODES=95296	? (TO) TT=1800.09	SAT TT=0.163 ASSIGNMENTS=995 CHECKS=128318	SAT TT=0.163 ASSIGNMENTS=995 CHECKS=128318	SAT TT=5.051	SAT TT=2.235	SAT TT=0.142 ASSIGNMENTS=1048 CHECKS=120877	SAT TT=0.033 ASSIGNMENTS=212 CHECKS=21967	SAT TT=1339.6	SAT TT=0.117 ASSIGNMENTS=806 CHECKS=85848	SAT TT=0.022 ASSIGNMENTS=97 CHECKS=11849	SAT TT=4.143	SAT TT=0.808	SAT TT=1.287
csp/lexHerald/ normalized-crossword-m1-lex-05-01.xml	SAT TT=0.418	SAT TT=1.036 CHECKS=18787 NODES=96	SAT TT=1.414 CHECKS=129622 NODES=401	SAT TT=3.723	SAT TT=0.651 CHECKS=12998	SAT TT=0.568 CHECKS=13433	SAT TT=9.235 ASSIGNMENTS=786	SAT TT=1.73 ASSIGNMENTS=10	SAT TT=66.942 CHECKS=69865000 NODES=87	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=17.073 ASSIGNMENTS=786	SAT TT=8.126 ASSIGNMENTS=627 CHECKS=249532	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=6.474 ASSIGNMENTS=7815 CHECKS=3876700	SAT TT=1.852 ASSIGNMENTS=9359 CHECKS=971161	SAT TT=1.476	SAT TT=0.418 ASSIGNMENTS=600 CHECKS=216831	SAT TT=0.443 ASSIGNMENTS=627 CHECKS=249532	? (MO) TT=30.602	SAT TT=19.376	SAT TT=21.277
csp/lexHerald/ normalized-crossword-m1-lex-05-05.xml	SAT TT=0.031	SAT TT=0.996 CHECKS=6381 NODES=22	SAT TT=0.877 CHECKS=10499 NODES=22	SAT TT=0.778	SAT TT=0.275 CHECKS=3812	SAT TT=0.235 CHECKS=3941	SAT TT=1.303 ASSIGNMENTS=122	SAT TT=1.129 ASSIGNMENTS=11	SAT TT=115.396 CHECKS=6073740 NODES=17	SAT TT=48.049 CHECKS=5385310 NODES=1950020	SAT TT=111.204 CHECKS=119153000 NODES=17153	SAT TT=0.484 ASSIGNMENTS=2319 CHECKS=417902	SAT TT=0.486 ASSIGNMENTS=2319 CHECKS=417902	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=0.402 ASSIGNMENTS=1796 CHECKS=316642	SAT TT=0.081 ASSIGNMENTS=404 CHECKS=35936	SAT TT=0.723	SAT TT=0.031 ASSIGNMENTS=68 CHECKS=6483	SAT TT=0.032 ASSIGNMENTS=110 CHECKS=10499	? (MO) TT=37.787	SAT TT=2.26	SAT TT=2.676
csp/lexHerald/ normalized-crossword-m1-lex-05-06.xml	SAT TT=0.028	SAT TT=0.921 CHECKS=2391 NODES=25	SAT TT=0.903 CHECKS=4114 NODES=25	SAT TT=2.413	SAT TT=0.4 CHECKS=3486	SAT TT=0.353 CHECKS=3500	SAT TT=4.279 ASSIGNMENTS=498	SAT TT=1.355 ASSIGNMENTS=19	SAT TT=99.699 CHECKS=17986800 NODES=27	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=11.731 ASSIGNMENTS=498	SAT TT=11.357 ASSIGNMENTS=498	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=3.444 ASSIGNMENTS=5619 CHECKS=1058470	SAT TT=1.575 ASSIGNMENTS=5644 CHECKS=560596	SAT TT=0.79	SAT TT=0.028 ASSIGNMENTS=38 CHECKS=3438	SAT TT=0.066 ASSIGNMENTS=143 CHECKS=15881	? (MO) TT=33.971	SAT TT=5.236	SAT TT=7.376
csp/lexHerald/ normalized-crossword-m1-lex-05-09.xml	SAT TT=0.019	SAT TT=0.852 CHECKS=2077 NODES=20	SAT TT=0.854 CHECKS=1737 NODES=0	SAT TT=1.037	SAT TT=0.23 CHECKS=1259	SAT TT=0.233 CHECKS=1522	SAT TT=1.38 ASSIGNMENTS=163	SAT TT=0.952 ASSIGNMENTS=10	SAT TT=122.873 CHECKS=6459080 NODES=21	SAT TT=78.469 CHECKS=8258500 NODES=3600140	SAT TT=108.639 CHECKS=22229900 NODES=1807	SAT TT=0.295 ASSIGNMENTS=835 CHECKS=83953	SAT TT=0.292 ASSIGNMENTS=835 CHECKS=83953	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=0.254 ASSIGNMENTS=627 CHECKS=65526	SAT TT=0.019 ASSIGNMENTS=5 CHECKS=489	SAT TT=0.568	SAT TT=0.028 ASSIGNMENTS=46 CHECKS=2728	SAT TT=0.046 ASSIGNMENTS=154 CHECKS=10251	? (MO) TT=40.181	SAT TT=2.619	SAT TT=3.499
csp/lexHerald/ normalized-crossword-m1-lex-05-10.xml	SAT TT=0.018	SAT TT=0.831 CHECKS=3735 NODES=17	SAT TT=0.864 CHECKS=2824 NODES=0	SAT TT=0.788	SAT TT=0.216 CHECKS=2571	SAT TT=0.134 CHECKS=1506	SAT TT=1.283 ASSIGNMENTS=142	SAT TT=0.957 ASSIGNMENTS=10	SAT TT=128.76 CHECKS=5780890 NODES=19	SAT TT=71.398 CHECKS=12264000 NODES=43950000	SAT TT=74.675 CHECKS=15291600 NODES=1808	SAT TT=0.357 ASSIGNMENTS=1540 CHECKS=270899	SAT TT=0.355 ASSIGNMENTS=1540 CHECKS=270899	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.553 ASSIGNMENTS=2330 CHECKS=417960	SAT TT=0.018 ASSIGNMENTS=11 CHECKS=1052	SAT TT=0.632	SAT TT=0.024 ASSIGNMENTS=29 CHECKS=3176	SAT TT=0.027 ASSIGNMENTS=75 CHECKS=6665	? TT=91.799	SAT TT=2.264	SAT TT=2.633
csp/lexHerald/ normalized-crossword-m1-lex-15-03.xml	SAT TT=0.217	SAT TT=3.723 CHECKS=451693 NODES=808	SAT TT=2.782 CHECKS=203731 NODES=200	? (TO) TT=1800.13	SAT TT=8.436 CHECKS=232924	SAT TT=8.774 CHECKS=611707	SAT TT=12.13 ASSIGNMENTS=79	SAT TT=61.674 ASSIGNMENTS=264	SAT TT=437.681 CHECKS=1808380000 NODES=412	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=0.256 ASSIGNMENTS=74 CHECKS=112311	SAT TT=0.259 ASSIGNMENTS=74 CHECKS=112311	? (TO) TT=1800.11	? (TO) TT=1800.09	SAT TT=0.217 ASSIGNMENTS=60 CHECKS=75949	SAT TT=20.205 ASSIGNMENTS=19830 CHECKS=24677700	? (TO) TT=1800.01	SAT TT=49.78 ASSIGNMENTS=30186 CHECKS=27135400	SAT TT=0.601 ASSIGNMENTS=347 CHECKS=433695	? (MO) TT=33.931	SAT TT=583.863	? (TO) TT=1800.1
csp/lexHerald/ normalized-crossword-m1-lex-15-04.xml	UNSAT TT=1.608	UNSAT TT=11.64 CHECKS=1902950 NODES=4951	UNSAT TT=7.381 CHECKS=485064 NODES=2299	? (TO) TT=1800.08	UNSAT TT=29.944 CHECKS=1705940	UNSAT TT=14.108 CHECKS=1097550	UNSAT TT=21.806 ASSIGNMENTS=0	UNSAT TT=28.002 ASSIGNMENTS=0	UNSAT TT=1107.29 CHECKS=6570340000 NODES=1316	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=19.79 ASSIGNMENTS=4951 CHECKS=1902950	UNSAT TT=17.717 ASSIGNMENTS=4951 CHECKS=1902950	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=1.608 ASSIGNMENTS=606 CHECKS=1300030	UNSAT TT=13.909 ASSIGNMENTS=7960 CHECKS=9925820	UNSAT TT=8.32	UNSAT TT=11.008 ASSIGNMENTS=3266 CHECKS=7793880	UNSAT TT=1.814 ASSIGNMENTS=463 CHECKS=1291450	? (MO) TT=37.824	UNSAT TT=735.255	UNSAT TT=503.359
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexHerald/ normalized-crossword-m1-lex-15-05.xml	SAT TT=0.268	SAT TT=2.478 CHECKS=174192 NODES=189	SAT TT=3.228 CHECKS=349278 NODES=334	SAT TT=1161.83	SAT TT=44.178 CHECKS=2649060	SAT TT=6.993 CHECKS=521272	SAT TT=12.297 ASSIGNMENTS=91	SAT TT=62.35 ASSIGNMENTS=57	SAT TT=223.569 CHECKS=667871000 NODES=453	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.297 ASSIGNMENTS=108 CHECKS=144862	SAT TT=0.283 ASSIGNMENTS=108 CHECKS=144862	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=0.327 ASSIGNMENTS=173 CHECKS=229543	SAT TT=17.543 ASSIGNMENTS=12298 CHECKS=22138500	SAT TT=20.109	SAT TT=95.833 ASSIGNMENTS=52996 CHECKS=48824600	SAT TT=0.268 ASSIGNMENTS=107 CHECKS=144633	? (MO) TT=31.4	SAT TT=313.94	? (TO) TT=1800.03
csp/lexHerald/ normalized-crossword-m1-lex-15-07.xml	SAT TT=11.293	SAT TT=17.613 CHECKS=3581190 NODES=7324	SAT TT=60.213 CHECKS=16093000 NODES=26775	? (TO) TT=1800.05	SAT TT=86.262 CHECKS=3896450	SAT TT=107.417 CHECKS=6199500	SAT TT=39.872 ASSIGNMENTS=2012	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=41.897 ASSIGNMENTS=11470 CHECKS=16897400	SAT TT=116.223 ASSIGNMENTS=48839 CHECKS=32646700	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=11.293 ASSIGNMENTS=3123 CHECKS=5013950	SAT TT=511.508 ASSIGNMENTS=198214 CHECKS=254744000	? (TO) TT=1800	SAT TT=116.261 ASSIGNMENTS=40983 CHECKS=45057400	SAT TT=33.732 ASSIGNMENTS=11470 CHECKS=16897400	? (MO) TT=32.115	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/lexHerald/ normalized-crossword-m1-lex-15-09.xml	SAT TT=0.202	SAT TT=2.383 CHECKS=126350 NODES=368	SAT TT=2.878 CHECKS=221545 NODES=362	? (TO) TT=1800.07	SAT TT=8.379 CHECKS=191646	SAT TT=6.265 CHECKS=146823	SAT TT=9.325 ASSIGNMENTS=91	SAT TT=42.989 ASSIGNMENTS=177	SAT TT=283.501 CHECKS=826296000 NODES=414	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT TT=0.213 ASSIGNMENTS=77 CHECKS=72829	SAT TT=0.214 ASSIGNMENTS=77 CHECKS=72829	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=0.202 ASSIGNMENTS=76 CHECKS=74439	SAT TT=15.897 ASSIGNMENTS=18918 CHECKS=19043600	SAT TT=23.655	SAT TT=42.172 ASSIGNMENTS=31691 CHECKS=22246500	SAT TT=0.455 ASSIGNMENTS=340 CHECKS=336082	? (MO) TT=43.413	SAT TT=975.246	? (TO) TT=1800.01
csp/lexHerald/ normalized-crossword-m1-lex-19-03.xml	SAT TT=71.437	SAT TT=147.472 CHECKS=36729500 NODES=85434	SAT TT=71.437 CHECKS=14985600 NODES=41201	? (TO) TT=1800.1	SAT TT=391.963 CHECKS=42224200	SAT TT=1096.19 CHECKS=133928000	? (TO) TT=1800.15	? (TO) TT=1800.09	SAT TT=815.439 CHECKS=449591000 NODES=11872	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=105.106 ASSIGNMENTS=48894 CHECKS=23590800	SAT TT=112.3 ASSIGNMENTS=48894 CHECKS=23590800	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=637.39 ASSIGNMENTS=184969 CHECKS=315635000	SAT TT=432.318 ASSIGNMENTS=127767 CHECKS=300676000	? (MO) TT=36.206	? (TO) TT=1800.07	? (TO) TT=1800.07
csp/lexHerald/ normalized-crossword-m1-lex-19-06.xml	SAT TT=0.466	SAT TT=4.966 CHECKS=772627 NODES=812	SAT TT=6.031 CHECKS=956265 NODES=803	? (TO) TT=1800.12	SAT TT=11.769 CHECKS=755822	SAT TT=8.725 CHECKS=633577	SAT TT=21.718 ASSIGNMENTS=127	SAT TT=74.735 ASSIGNMENTS=550	SAT TT=263.124 CHECKS=682795000 NODES=800	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=0.487 ASSIGNMENTS=162 CHECKS=274165	SAT TT=0.466 ASSIGNMENTS=162 CHECKS=274165	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=0.5 ASSIGNMENTS=161 CHECKS=308193	SAT TT=14.098 ASSIGNMENTS=7494 CHECKS=15675900	SAT TT=1590.83	SAT TT=71.613 ASSIGNMENTS=46714 CHECKS=88412500	SAT TT=0.677 ASSIGNMENTS=385 CHECKS=510826	? (MO) TT=30.686	SAT TT=1536.08	? (TO) TT=1800
csp/lexHerald/ normalized-crossword-m1-lex-19-09.xml	SAT TT=0.438	SAT TT=5.075 CHECKS=518365 NODES=712	SAT TT=5.796 CHECKS=695502 NODES=714	? (TO) TT=1800.12	SAT TT=51.814 CHECKS=5030510	SAT TT=9.664 CHECKS=1043110	SAT TT=29.9 ASSIGNMENTS=99	SAT TT=66.151 ASSIGNMENTS=158	SAT TT=254.075 CHECKS=750639000 NODES=607	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=0.45 ASSIGNMENTS=118 CHECKS=240060	SAT TT=0.452 ASSIGNMENTS=118 CHECKS=240060	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=0.438 ASSIGNMENTS=123 CHECKS=245428	SAT TT=15.655 ASSIGNMENTS=7544 CHECKS=18843300	SAT TT=13.349	SAT TT=203.996 ASSIGNMENTS=97691 CHECKS=255082000	SAT TT=1.113 ASSIGNMENTS=525 CHECKS=1295660	? (MO) TT=37.204	SAT TT=1078.92	? (TO) TT=1800.04
csp/lexHerald/ normalized-crossword-m1-lex-21-02.xml	SAT TT=2.459	SAT TT=14.147 CHECKS=3939890 NODES=2734	SAT TT=12.698 CHECKS=2702910 NODES=3138	? (TO) TT=1800.14	SAT TT=47.277 CHECKS=5779680	SAT TT=26.625 CHECKS=3485260	SAT TT=37.476 ASSIGNMENTS=436	SAT TT=1683.59 ASSIGNMENTS=62008	SAT TT=1085.48 CHECKS=5267680000 NODES=1610	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=10.604 ASSIGNMENTS=937 CHECKS=2921020	SAT TT=21.469 ASSIGNMENTS=2734 CHECKS=3939890	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=3.457 ASSIGNMENTS=1267 CHECKS=4112260	SAT TT=17.63 ASSIGNMENTS=8455 CHECKS=18309100	? (TO) TT=1800.04	SAT TT=59.948 ASSIGNMENTS=33245 CHECKS=67448800	SAT TT=2.459 ASSIGNMENTS=937 CHECKS=2921020	? (MO) TT=33.675	? (TO) TT=1800.02	? (TO) TT=1800.01
csp/lexHerald/ normalized-crossword-m1-lex-21-03.xml	SAT TT=2.199	SAT TT=10.366 CHECKS=2336370 NODES=3048	SAT TT=15.835 CHECKS=3429390 NODES=4487	? (TO) TT=1800.1	SAT TT=22.739 CHECKS=1419380	SAT TT=72.019 CHECKS=8262950	SAT TT=42.259 ASSIGNMENTS=880	SAT TT=88.146 ASSIGNMENTS=678	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=9.703 ASSIGNMENTS=754 CHECKS=1999630	SAT TT=17.206 ASSIGNMENTS=3048 CHECKS=2336370	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=29.923 ASSIGNMENTS=10122 CHECKS=27589700	SAT TT=37.093 ASSIGNMENTS=16981 CHECKS=36958800	? (TO) TT=1800.05	SAT TT=51.753 ASSIGNMENTS=23652 CHECKS=47890800	SAT TT=2.199 ASSIGNMENTS=754 CHECKS=1999630	? (MO) TT=27.138	? (TO) TT=1800.07	? (TO) TT=1800.1
csp/lexHerald/ normalized-crossword-m1-lex-21-10.xml	UNSAT TT=372.809	UNSAT TT=398.458 CHECKS=21511500 NODES=218824	UNSAT TT=372.809 CHECKS=21744400 NODES=218588	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=377.016 ASSIGNMENTS=223441 CHECKS=22517000	UNSAT TT=376.39 ASSIGNMENTS=223441 CHECKS=22517000	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=533.778 ASSIGNMENTS=149152 CHECKS=523911000	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=934.013 ASSIGNMENTS=259349 CHECKS=927253000	? (MO) TT=32.141	? (TO) TT=1800.04	? (TO) TT=1800.05
csp/lexHerald/ normalized-crossword-m1-lex-23-02.xml	SAT TT=1.775	SAT TT=11.881 CHECKS=2654310 NODES=2351	SAT TT=81.809 CHECKS=29273000 NODES=9382	? (TO) TT=1800.07	SAT TT=128.731 CHECKS=17908900	SAT TT=43.04 CHECKS=7745670	SAT TT=59.735 ASSIGNMENTS=972	? (TO) TT=1800.12	SAT TT=602.784 CHECKS=2660000000 NODES=1338	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=1.786 ASSIGNMENTS=647 CHECKS=1754510	SAT TT=1.775 ASSIGNMENTS=647 CHECKS=1754510	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT TT=3.69 ASSIGNMENTS=1608 CHECKS=4340680	SAT TT=20.817 ASSIGNMENTS=9041 CHECKS=25641800	? (TO) TT=1800.07	SAT TT=220.415 ASSIGNMENTS=104223 CHECKS=280985000	SAT TT=2.002 ASSIGNMENTS=786 CHECKS=2178710	? (MO) TT=39.303	? (TO) TT=1800.02	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexHerald/ normalized-crossword-m1-lex-23-04.xml	SAT TT=858.914	SAT TT=917.591 CHECKS=279462000 NODES=99832	SAT TT=1150.59 CHECKS=351873000 NODES=148537	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=858.914 ASSIGNMENTS=99832 CHECKS=279462000	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=91.379	? (TO) TT=1800.06	? (TO) TT=1800
csp/lexHerald/ normalized-crossword-m1-lex-23-05.xml	SAT TT=9.753	SAT TT=12.391 CHECKS=2048810 NODES=2102	SAT TT=34.197 CHECKS=8956970 NODES=6194	? (TO) TT=1800.15	SAT TT=236.834 CHECKS=45479900	SAT TT=143.8 CHECKS=30439800	SAT TT=50.089 ASSIGNMENTS=576	? (TO) TT=1800.08	SAT TT=232.729 CHECKS=576070000 NODES=954	? (TO) TT=1800.06	? (TO) TT=1800	SAT TT=19.948 ASSIGNMENTS=4020 CHECKS=18178300	SAT TT=21.91 ASSIGNMENTS=4020 CHECKS=18178300	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=9.753 ASSIGNMENTS=3993 CHECKS=15566000	SAT TT=29.721 ASSIGNMENTS=10870 CHECKS=34409600	SAT TT=244.698	SAT TT=106.103 ASSIGNMENTS=46161 CHECKS=135373000	SAT TT=13.284 ASSIGNMENTS=4020 CHECKS=18178300	? (MO) TT=31.696	? (TO) TT=1800.06	? (TO) TT=1800.02
csp/lexHerald/ normalized-crossword-m1-lex-23-06.xml	UNSAT TT=1071.41	UNSAT TT=1137.5 CHECKS=68146500 NODES=602394	? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=1071.41 ASSIGNMENTS=602394 CHECKS=68146500	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.02	? (MO) TT=37.641	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle02.xml	SAT TT=0.01	SAT TT=0.82 CHECKS=1533 NODES=8	SAT TT=0.738 CHECKS=1229 NODES=0	SAT TT=0.06	SAT TT=0.043 CHECKS=538	SAT TT=0.04 CHECKS=759	SAT TT=0.672 ASSIGNMENTS=55	SAT TT=0.65 ASSIGNMENTS=7	SAT TT=88.456 CHECKS=23225 NODES=8	SAT TT=36.59 CHECKS=21881 NODES=5	SAT TT=37.881 CHECKS=21666 NODES=3	SAT TT=0.039 ASSIGNMENTS=183 CHECKS=6457	SAT TT=0.033 ASSIGNMENTS=183 CHECKS=6457	SAT TT=75.174	SAT TT=74.445	SAT TT=0.019 ASSIGNMENTS=183 CHECKS=6457	SAT TT=0.017 ASSIGNMENTS=130 CHECKS=4029	SAT TT=0.358	SAT TT=0.01 ASSIGNMENTS=7 CHECKS=204	SAT TT=0.014 ASSIGNMENTS=138 CHECKS=3449	SAT TT=1372.9	SAT TT=0.708	SAT TT=0.766
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle03.xml	SAT TT=0.026	SAT TT=0.798 CHECKS=2828 NODES=14	SAT TT=0.784 CHECKS=1626 NODES=0	SAT TT=0.188	SAT TT=0.135 CHECKS=974	SAT TT=0.113 CHECKS=982	SAT TT=1.142 ASSIGNMENTS=136	SAT TT=0.796 ASSIGNMENTS=10	SAT TT=133.797 CHECKS=366167 NODES=21	SAT TT=70.064 CHECKS=356803 NODES=13	SAT TT=76.061 CHECKS=4801750 NODES=130	SAT TT=0.18 ASSIGNMENTS=1047 CHECKS=71660	SAT TT=0.183 ASSIGNMENTS=1047 CHECKS=71660	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=0.244 ASSIGNMENTS=1427 CHECKS=103989	SAT TT=0.122 ASSIGNMENTS=865 CHECKS=49235	SAT TT=0.495	SAT TT=0.026 ASSIGNMENTS=72 CHECKS=4443	SAT TT=0.027 ASSIGNMENTS=120 CHECKS=7321	? (TO) TT=1800.14	SAT TT=1.162	SAT TT=1.534
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle04.xml	SAT TT=0.033	SAT TT=0.806 CHECKS=1979 NODES=20	SAT TT=0.887 CHECKS=4639 NODES=21	SAT TT=1.147	SAT TT=0.24 CHECKS=1558	SAT TT=0.219 CHECKS=1508	SAT TT=1.347 ASSIGNMENTS=58	SAT TT=1.038 ASSIGNMENTS=11	SAT TT=133.643 CHECKS=11674000 NODES=34	SAT TT=68.511 CHECKS=59750700 NODES=67350000	SAT TT=538.034 CHECKS=889337000 NODES=35485	SAT TT=0.341 ASSIGNMENTS=1114 CHECKS=91661	SAT TT=0.342 ASSIGNMENTS=1114 CHECKS=91661	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=0.343 ASSIGNMENTS=1241 CHECKS=102716	SAT TT=0.325 ASSIGNMENTS=1338 CHECKS=91920	SAT TT=0.596	SAT TT=0.036 ASSIGNMENTS=76 CHECKS=4980	SAT TT=0.033 ASSIGNMENTS=92 CHECKS=5246	? (MO) TT=38.362	SAT TT=2.863	SAT TT=3.47
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle05.xml	SAT TT=0.026	SAT TT=0.822 CHECKS=2257 NODES=21	SAT TT=0.812 CHECKS=1036 NODES=0	SAT TT=0.741	SAT TT=0.259 CHECKS=1528	SAT TT=0.242 CHECKS=1539	SAT TT=2.057 ASSIGNMENTS=348	SAT TT=1.032 ASSIGNMENTS=11	SAT TT=93.233 CHECKS=6638670 NODES=24	SAT TT=69.57 CHECKS=210681000 NODES=234900000	SAT TT=200.703 CHECKS=366129000 NODES=18765	SAT TT=0.519 ASSIGNMENTS=1571 CHECKS=122081	SAT TT=0.491 ASSIGNMENTS=1571 CHECKS=122081	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.399 ASSIGNMENTS=1381 CHECKS=106865	SAT TT=0.051 ASSIGNMENTS=155 CHECKS=8426	SAT TT=0.768	SAT TT=0.026 ASSIGNMENTS=32 CHECKS=1614	SAT TT=0.037 ASSIGNMENTS=123 CHECKS=7525	? (MO) TT=34.862	SAT TT=2.653	SAT TT=3.077
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle06.xml	SAT TT=0.024	SAT TT=1.018 CHECKS=2629 NODES=23	SAT TT=0.884 CHECKS=3109 NODES=0	SAT TT=2.037	SAT TT=0.325 CHECKS=2074	SAT TT=0.257 CHECKS=1589	SAT TT=76.719 ASSIGNMENTS=14855	SAT TT=1.227 ASSIGNMENTS=12	SAT TT=91.445 CHECKS=17782400 NODES=24	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=0.501 ASSIGNMENTS=1307 CHECKS=181427	SAT TT=0.505 ASSIGNMENTS=1307 CHECKS=181427	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=0.405 ASSIGNMENTS=1065 CHECKS=158935	SAT TT=1.53 ASSIGNMENTS=4940 CHECKS=507035	SAT TT=0.669	SAT TT=0.024 ASSIGNMENTS=23 CHECKS=2871	SAT TT=0.029 ASSIGNMENTS=74 CHECKS=6238	? (MO) TT=32.623	SAT TT=4.538	SAT TT=6.234
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle07.xml	SAT TT=0.026	SAT TT=0.929 CHECKS=4359 NODES=32	SAT TT=0.908 CHECKS=6330 NODES=0	SAT TT=2.814	SAT TT=0.288 CHECKS=1736	SAT TT=0.323 CHECKS=2374	SAT TT=6.059 ASSIGNMENTS=1437	SAT TT=1.152 ASSIGNMENTS=23	SAT TT=122.692 CHECKS=12082400 NODES=31	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=0.257 ASSIGNMENTS=1021 CHECKS=97562	SAT TT=0.258 ASSIGNMENTS=1021 CHECKS=97562	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=0.222 ASSIGNMENTS=1046 CHECKS=98434	SAT TT=0.233 ASSIGNMENTS=1015 CHECKS=86635	SAT TT=0.711	SAT TT=0.026 ASSIGNMENTS=24 CHECKS=1849	SAT TT=0.05 ASSIGNMENTS=153 CHECKS=13098	? TT=95.735	SAT TT=3.638	SAT TT=5.237
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle09.xml	SAT TT=0.078	SAT TT=0.984 CHECKS=4673 NODES=35	SAT TT=1.095 CHECKS=4418 NODES=0	SAT TT=4.223	SAT TT=0.407 CHECKS=2492	SAT TT=0.347 CHECKS=2541	SAT TT=6.818 ASSIGNMENTS=613	SAT TT=1.983 ASSIGNMENTS=20	SAT TT=122.752 CHECKS=12872500 NODES=37	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=14.946 ASSIGNMENTS=613	SAT TT=14.911 ASSIGNMENTS=613	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=2.565 ASSIGNMENTS=2848 CHECKS=877711	SAT TT=0.407 ASSIGNMENTS=649 CHECKS=104187	SAT TT=1.05	SAT TT=0.078 ASSIGNMENTS=102 CHECKS=12891	SAT TT=0.12 ASSIGNMENTS=160 CHECKS=34349	? (MO) TT=33.801	SAT TT=16.323	SAT TT=20.502
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle10.xml	SAT TT=0.037	SAT TT=1.064 CHECKS=20650 NODES=42	SAT TT=1.006 CHECKS=14188 NODES=0	SAT TT=2.372	SAT TT=0.724 CHECKS=10703	SAT TT=0.461 CHECKS=7367	SAT TT=1.907 ASSIGNMENTS=22	SAT TT=2.086 ASSIGNMENTS=18	SAT TT=128.797 CHECKS=122086 NODES=45	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.05 ASSIGNMENTS=25 CHECKS=5247	SAT TT=0.049 ASSIGNMENTS=25 CHECKS=5247	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=0.038 ASSIGNMENTS=24 CHECKS=6221	SAT TT=3.193 ASSIGNMENTS=9076 CHECKS=2026060	SAT TT=1.608	SAT TT=0.082 ASSIGNMENTS=123 CHECKS=30648	SAT TT=0.037 ASSIGNMENTS=20 CHECKS=5805	? (TO) TT=1800.1	SAT TT=16.58	SAT TT=21.649
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle11.xml	SAT TT=0.094	SAT TT=0.959 CHECKS=3576 NODES=38	SAT TT=1.026 CHECKS=8716 NODES=39	SAT TT=10.16	SAT TT=0.622 CHECKS=4391	SAT TT=0.48 CHECKS=3724	SAT TT=3.999 ASSIGNMENTS=270	SAT TT=1.876 ASSIGNMENTS=20	SAT TT=154.657 CHECKS=378218000 NODES=40	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=0.879 ASSIGNMENTS=1364 CHECKS=292760	SAT TT=0.885 ASSIGNMENTS=1364 CHECKS=292760	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=1.039 ASSIGNMENTS=1505 CHECKS=321028	SAT TT=3.699 ASSIGNMENTS=5046 CHECKS=823050	SAT TT=1.105	SAT TT=0.238 ASSIGNMENTS=327 CHECKS=47061	SAT TT=0.094 ASSIGNMENTS=113 CHECKS=23475	? TT=79.694	SAT TT=18.385	SAT TT=20.815
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle15.xml	SAT TT=0.075	SAT TT=1.5 CHECKS=54249 NODES=103	SAT TT=1.648 CHECKS=116865 NODES=108	SAT TT=8.52	SAT TT=2.227 CHECKS=31265	SAT TT=1.647 CHECKS=32495	SAT TT=4.038 ASSIGNMENTS=48	SAT TT=6.913 ASSIGNMENTS=58	SAT TT=132.992 CHECKS=675650 NODES=143	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=0.088 ASSIGNMENTS=52 CHECKS=25836	SAT TT=0.091 ASSIGNMENTS=52 CHECKS=25836	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=0.075 ASSIGNMENTS=52 CHECKS=25836	SAT TT=6.808 ASSIGNMENTS=18851 CHECKS=8104390	SAT TT=2.285	SAT TT=1.787 ASSIGNMENTS=2677 CHECKS=1679310	SAT TT=0.077 ASSIGNMENTS=58 CHECKS=27431	? TT=100.623	SAT TT=26.958	SAT TT=26.961
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle16.xml	SAT TT=0.142	SAT TT=2.297 CHECKS=199736 NODES=273	SAT TT=2.278 CHECKS=306346 NODES=274	SAT TT=8.928	SAT TT=2.674 CHECKS=65052	SAT TT=1.943 CHECKS=86643	SAT TT=5.286 ASSIGNMENTS=64	SAT TT=23.286 ASSIGNMENTS=60	SAT TT=328.121 CHECKS=1136900000 NODES=339	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=0.159 ASSIGNMENTS=81 CHECKS=47351	SAT TT=0.157 ASSIGNMENTS=81 CHECKS=47351	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=0.144 ASSIGNMENTS=81 CHECKS=47351	SAT TT=10.175 ASSIGNMENTS=19445 CHECKS=13858700	? (TO) TT=1800.1	SAT TT=3.491 ASSIGNMENTS=3989 CHECKS=2580580	SAT TT=0.142 ASSIGNMENTS=76 CHECKS=40586	? (MO) TT=41.689	SAT TT=54.137	SAT TT=51.276
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle17.xml	SAT TT=0.229	SAT TT=2.337 CHECKS=215531 NODES=185	SAT TT=3.123 CHECKS=411522 NODES=342	SAT TT=14.974	SAT TT=5.421 CHECKS=201448	SAT TT=3.709 CHECKS=246570	SAT TT=8.952 ASSIGNMENTS=80	SAT TT=52.986 ASSIGNMENTS=66	SAT TT=257.972 CHECKS=631407000 NODES=304	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.251 ASSIGNMENTS=85 CHECKS=72551	SAT TT=0.246 ASSIGNMENTS=85 CHECKS=72551	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.229 ASSIGNMENTS=85 CHECKS=72551	SAT TT=20.451 ASSIGNMENTS=22718 CHECKS=27243900	? (TO) TT=1800.1	SAT TT=58.865 ASSIGNMENTS=39497 CHECKS=31136500	SAT TT=0.271 ASSIGNMENTS=122 CHECKS=101036	? TT=100.989	SAT TT=433.106	SAT TT=740.86
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle18.xml	SAT TT=0.203	SAT TT=2.589 CHECKS=225836 NODES=351	SAT TT=2.923 CHECKS=356791 NODES=349	? (TO) TT=1800.11	SAT TT=39.606 CHECKS=2776440	SAT TT=2.56 CHECKS=198283	SAT TT=9.902 ASSIGNMENTS=87	SAT TT=62.262 ASSIGNMENTS=81	SAT TT=134.216 CHECKS=2539450 NODES=342	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=0.214 ASSIGNMENTS=106 CHECKS=82330	SAT TT=0.228 ASSIGNMENTS=106 CHECKS=82330	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=0.214 ASSIGNMENTS=106 CHECKS=82330	SAT TT=17.696 ASSIGNMENTS=19647 CHECKS=25036800	SAT TT=5.997	SAT TT=61.746 ASSIGNMENTS=40259 CHECKS=33673700	SAT TT=0.203 ASSIGNMENTS=94 CHECKS=79210	? (MO) TT=63.926	SAT TT=66.768	SAT TT=264.508
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle19.xml	SAT TT=0.392	SAT TT=2.884 CHECKS=263371 NODES=477	SAT TT=3.073 CHECKS=329057 NODES=456	? (TO) TT=1800.05	SAT TT=7.485 CHECKS=339092	SAT TT=6.216 CHECKS=354095	SAT TT=13.725 ASSIGNMENTS=383	SAT TT=39.523 ASSIGNMENTS=76	SAT TT=269.03 CHECKS=895289000 NODES=385	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=0.412 ASSIGNMENTS=170 CHECKS=162308	SAT TT=0.392 ASSIGNMENTS=170 CHECKS=162308	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=0.795 ASSIGNMENTS=327 CHECKS=371749	SAT TT=18.573 ASSIGNMENTS=16620 CHECKS=20136200	? (TO) TT=1800	SAT TT=53.476 ASSIGNMENTS=39152 CHECKS=29860900	SAT TT=0.489 ASSIGNMENTS=212 CHECKS=235755	? (MO) TT=32.135	SAT TT=332.475	? (TO) TT=1800.02
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle20.xml	SAT TT=0.099	SAT TT=1.187 CHECKS=4919 NODES=53	SAT TT=1.145 CHECKS=21196 NODES=66	SAT TT=4.904	SAT TT=0.987 CHECKS=8936	SAT TT=0.829 CHECKS=8377	SAT TT=118.778 ASSIGNMENTS=9403	SAT TT=2.318 ASSIGNMENTS=20	SAT TT=121.882 CHECKS=14309600 NODES=53	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=116.449 ASSIGNMENTS=9403	SAT TT=126.131 ASSIGNMENTS=9403	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=7.137 ASSIGNMENTS=8734 CHECKS=3582390	SAT TT=4.722 ASSIGNMENTS=6705 CHECKS=1581020	SAT TT=1.645	SAT TT=0.255 ASSIGNMENTS=408 CHECKS=85202	SAT TT=0.099 ASSIGNMENTS=218 CHECKS=44647	? (MO) TT=45.677	SAT TT=21.736	SAT TT=34.944
csp/mknap/ normalized-mknap-1-0.xml	SAT TT=0.007	SAT TT=0.747 CHECKS=71 NODES=6	SAT TT=0.679 CHECKS=71 NODES=0	SAT TT=0.029	SAT TT=0.011 CHECKS=65	SAT TT=0.009 CHECKS=92	SAT TT=0.488 ASSIGNMENTS=1	SAT TT=0.502 ASSIGNMENTS=1	SAT TT=0.547 CHECKS=76 NODES=6	SAT TT=0.573 CHECKS=83 NODES=0	SAT TT=0.531 CHECKS=83 NODES=0	SAT TT=0.018 ASSIGNMENTS=2 CHECKS=635	SAT TT=0.018 ASSIGNMENTS=2 CHECKS=635	SAT TT=1.463	SAT TT=1.687	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=635	SAT TT=0.009 ASSIGNMENTS=2 CHECKS=1044	SAT TT=0.302	SAT TT=0.008 ASSIGNMENTS=4 CHECKS=974	SAT TT=0.008 ASSIGNMENTS=3 CHECKS=621	SAT TT=1.364	SAT TT=0.5	SAT TT=0.469
csp/mknap/ normalized-mknap-1-2.xml	SAT TT=0.013	SAT TT=1.346 CHECKS=41836 NODES=15	SAT TT=1.223 CHECKS=41836 NODES=0	SAT TT=0.037	SAT TT=0.163 CHECKS=886	SAT TT=0.048 CHECKS=1162	SAT TT=0.575 ASSIGNMENTS=9	SAT TT=0.546 ASSIGNMENTS=25	SAT TT=1.05 CHECKS=46513 NODES=15	SAT TT=0.97 CHECKS=46529 NODES=0	SAT TT=1.041 CHECKS=46529 NODES=0	SAT TT=0.024 ASSIGNMENTS=13 CHECKS=8382	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=8382	SAT TT=2.801	SAT TT=2.579	SAT TT=0.013 ASSIGNMENTS=13 CHECKS=8382	SAT TT=0.014 ASSIGNMENTS=25 CHECKS=13007	SAT TT=0.365	SAT TT=3.354 ASSIGNMENTS=6398 CHECKS=1937140	SAT TT=0.013 ASSIGNMENTS=10 CHECKS=7062	SAT TT=12.724	SAT TT=1.394	SAT TT=4.058
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/mknap/ normalized-mknap-1-3.xml	SAT TT=0.03	SAT TT=19.193 CHECKS=1565190 NODES=20	SAT TT=18.805 CHECKS=1565190 NODES=0	SAT TT=0.05	SAT TT=2 CHECKS=36622	SAT TT=2.628 CHECKS=53826	SAT TT=0.545 ASSIGNMENTS=19	SAT TT=0.772 ASSIGNMENTS=254	SAT TT=9.491 CHECKS=1311300 NODES=20	SAT TT=6.645 CHECKS=1311320 NODES=0	SAT TT=6.24 CHECKS=1311320 NODES=0	SAT TT=0.043 ASSIGNMENTS=66 CHECKS=42215	SAT TT=0.043 ASSIGNMENTS=66 CHECKS=42215	? (problem) TT=39.054	? (problem) TT=32.989	SAT TT=0.03 ASSIGNMENTS=66 CHECKS=42215	SAT TT=0.887 ASSIGNMENTS=3677 CHECKS=1960360	SAT TT=0.378	SAT TT=12.861 ASSIGNMENTS=22355 CHECKS=4544830	SAT TT=0.048 ASSIGNMENTS=143 CHECKS=90571	? TT=340.472	SAT TT=3.398	SAT TT=9.877
csp/mknap/ normalized-mknap-1-4.xml	SAT TT=0.065	? (TO) TT=1800.16	? (TO) TT=1800.18	SAT TT=0.065	SAT TT=42.654 CHECKS=508593	SAT TT=45.474 CHECKS=541580	SAT TT=1.416 ASSIGNMENTS=13258	SAT TT=0.854 ASSIGNMENTS=1807	SAT TT=1568.73 CHECKS=386154000 NODES=28	SAT TT=1608.75 CHECKS=386155000 NODES=0	SAT TT=1607.68 CHECKS=386155000 NODES=0	SAT TT=9.4 ASSIGNMENTS=13258	SAT TT=61.474 ASSIGNMENTS=138723 CHECKS=137352000	? (MO) TT=256.58	? (MO) TT=275.82	SAT TT=1.418 ASSIGNMENTS=3596 CHECKS=3279130	SAT TT=7.971 ASSIGNMENTS=20493 CHECKS=18472800	SAT TT=0.791	SAT TT=136.099 ASSIGNMENTS=32294 CHECKS=22099100	SAT TT=55.486 ASSIGNMENTS=138723 CHECKS=137352000	? TT=939.507	SAT TT=11.99	SAT TT=46.099
csp/mknap/ normalized-mknap-1-5.xml	SAT TT=1.204	? (TO) TT=1800.14	? (TO) TT=1800.11	SAT TT=1.204	SAT TT=120.512 CHECKS=863472	SAT TT=89.942 CHECKS=695190	SAT TT=5.477 ASSIGNMENTS=105826	SAT TT=1.925 ASSIGNMENTS=18723	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=412.224 ASSIGNMENTS=1523430 CHECKS=906612000	SAT TT=410.627 ASSIGNMENTS=1523430 CHECKS=906612000	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=79.785 ASSIGNMENTS=286594 CHECKS=180977000	SAT TT=58.954 ASSIGNMENTS=234559 CHECKS=142503000	SAT TT=1.29	SAT TT=239.562 ASSIGNMENTS=168324 CHECKS=97077800	SAT TT=401.278 ASSIGNMENTS=1523430 CHECKS=906612000	? (TO) TT=1800.15	? (MO) TT=139.36	? (MO) TT=347.835
csp/mknap/ normalized-mknap-1-6.xml	SAT TT=12.671	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=302.627	? (TO) TT=1800.02	SAT TT=1589.11 CHECKS=7670940	SAT TT=73.533 ASSIGNMENTS=1489160	SAT TT=12.671 ASSIGNMENTS=200210	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=327.645 ASSIGNMENTS=1489160	SAT TT=1161.51 ASSIGNMENTS=1489160	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=15.122	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=274.199	? TT=256.572
csp/nengfa/ normalized-block.xml	UNSAT TT=3.833	? (TO) TT=1800.08	? (TO) TT=1800.13	UNSAT TT=1576.66	? (TO) TT=1800.05	? (TO) TT=1800.1	? (problem) TT=2.342	? (problem) TT=2.174	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=15.185	UNSAT TT=17.261	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=23.165	UNSAT TT=3.919	UNSAT TT=3.833
csp/nengfa/ normalized-pack.xml	SAT TT=34.225	SAT TT=936.802 CHECKS=1423020000 NODES=27180	SAT TT=925.439 CHECKS=1423020000 NODES=27180	SAT TT=1340.32	SAT TT=771.91 CHECKS=290338000	? (TO) TT=1800.03	? (problem) TT=7.551	? (problem) TT=7.689	SAT TT=735.495 CHECKS=1281730000 NODES=11069	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=538.374 ASSIGNMENTS=114204 CHECKS=280348000	SAT TT=477.911 ASSIGNMENTS=114204 CHECKS=280348000	? (MO) TT=385.89	? (MO) TT=388.27	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=470.74 ASSIGNMENTS=114204 CHECKS=280348000	? TT=122.483	SAT TT=34.225	SAT TT=37.311
csp/nengfa/ normalized-radi.xml	SAT TT=0.036	SAT TT=313.467 CHECKS=465626000 NODES=8948	SAT TT=315.216 CHECKS=459093000 NODES=8905	SAT TT=8.211	SAT TT=0.437 CHECKS=60525	SAT TT=0.364 CHECKS=53261	SAT TT=1.239 ASSIGNMENTS=102	SAT TT=1.13 ASSIGNMENTS=36	SAT TT=172.292 CHECKS=256883000 NODES=200	SAT TT=1556 CHECKS=3501020000 NODES=5558290	? (TO) TT=1800.06	SAT TT=0.046 ASSIGNMENTS=71 CHECKS=18246	SAT TT=0.045 ASSIGNMENTS=71 CHECKS=18246	? (problem) TT=149.148	? (problem) TT=148.095	SAT TT=0.036 ASSIGNMENTS=87 CHECKS=18085	SAT TT=0.846 ASSIGNMENTS=11180 CHECKS=1742310	SAT TT=0.685	SAT TT=0.371 ASSIGNMENTS=2839 CHECKS=437882	SAT TT=0.7 ASSIGNMENTS=7383 CHECKS=1445130	? TT=125.992	SAT TT=1.533	SAT TT=1.907
csp/nengfa/ normalized-schur.xml	SAT TT=0.34	SAT TT=4.623 CHECKS=805771 NODES=2597	SAT TT=8.018 CHECKS=2034400 NODES=6261	SAT TT=17.533	? (TO) TT=1800.06	SAT TT=32.383 CHECKS=33801300	SAT TT=3.504 ASSIGNMENTS=61	SAT TT=3.172 ASSIGNMENTS=61	SAT TT=4.683 CHECKS=12110 NODES=110	SAT TT=8.207 CHECKS=6507370 NODES=7583	SAT TT=5.14 CHECKS=847869 NODES=327	SAT TT=0.353 ASSIGNMENTS=60 CHECKS=29428	SAT TT=0.353 ASSIGNMENTS=60 CHECKS=29428	SAT TT=178.449	SAT TT=181.273	SAT TT=0.34 ASSIGNMENTS=60 CHECKS=29428	SAT TT=25.552 ASSIGNMENTS=19667 CHECKS=25538300	SAT TT=196.688	SAT TT=2.711 ASSIGNMENTS=1800 CHECKS=2317110	SAT TT=9.088 ASSIGNMENTS=4736 CHECKS=8677330	SAT TT=25.208	SAT TT=24.674	SAT TT=9.867
csp/ogdHerald/ normalized-crossword-m1-ogd-05-01.xml	SAT TT=0.069	SAT TT=0.927 CHECKS=3576 NODES=25	SAT TT=1.168 CHECKS=6613 NODES=25	SAT TT=4.815	SAT TT=1.11 CHECKS=4281	SAT TT=1.029 CHECKS=4299	SAT TT=16.792 ASSIGNMENTS=906	SAT TT=1.92 ASSIGNMENTS=15	SAT TT=62.681 CHECKS=20081800 NODES=28	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=22.841 ASSIGNMENTS=906	SAT TT=7.603 ASSIGNMENTS=188 CHECKS=22235	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=9.559 ASSIGNMENTS=7855 CHECKS=3435890	SAT TT=2.047 ASSIGNMENTS=9293 CHECKS=982195	SAT TT=1.744	SAT TT=0.1 ASSIGNMENTS=178 CHECKS=26480	SAT TT=0.069 ASSIGNMENTS=188 CHECKS=22235	? (MO) TT=37.439	SAT TT=14.928	SAT TT=17.969
csp/ogdHerald/ normalized-crossword-m1-ogd-05-04.xml	SAT TT=0.032	SAT TT=1.043 CHECKS=2400 NODES=19	SAT TT=0.872 CHECKS=1602 NODES=0	SAT TT=1.954	SAT TT=0.349 CHECKS=976	SAT TT=0.355 CHECKS=1271	SAT TT=2.936 ASSIGNMENTS=302	SAT TT=1.127 ASSIGNMENTS=13	SAT TT=117.14 CHECKS=4579910 NODES=22	SAT TT=57.856 CHECKS=5420250 NODES=3150030	SAT TT=222.148 CHECKS=333000000 NODES=11118	SAT TT=0.401 ASSIGNMENTS=1155 CHECKS=93290	SAT TT=0.387 ASSIGNMENTS=1155 CHECKS=93290	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.443 ASSIGNMENTS=1830 CHECKS=132036	SAT TT=0.032 ASSIGNMENTS=14 CHECKS=923	SAT TT=0.747	SAT TT=0.042 ASSIGNMENTS=50 CHECKS=2724	SAT TT=0.052 ASSIGNMENTS=147 CHECKS=6599	? (MO) TT=35.953	SAT TT=4.129	SAT TT=5.392
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdHerald/ normalized-crossword-m1-ogd-05-06.xml	SAT TT=0.073	SAT TT=0.952 CHECKS=1698 NODES=23	SAT TT=1.056 CHECKS=1859 NODES=0	SAT TT=2.889	SAT TT=0.768 CHECKS=2152	SAT TT=0.749 CHECKS=2392	SAT TT=3.672 ASSIGNMENTS=226	SAT TT=1.774 ASSIGNMENTS=14	SAT TT=92.684 CHECKS=11673400 NODES=29	SAT TT=1277.58 CHECKS=5293990000 NODES=1231330000	? (TO) TT=1800.08	SAT TT=0.697 ASSIGNMENTS=1207 CHECKS=200133	SAT TT=0.676 ASSIGNMENTS=1207 CHECKS=200133	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=0.643 ASSIGNMENTS=1211 CHECKS=199439	SAT TT=0.189 ASSIGNMENTS=388 CHECKS=40675	SAT TT=1.532	SAT TT=0.073 ASSIGNMENTS=93 CHECKS=10453	SAT TT=0.097 ASSIGNMENTS=164 CHECKS=17465	? (MO) TT=33.032	SAT TT=9.217	SAT TT=12.92
csp/ogdHerald/ normalized-crossword-m1-ogd-05-08.xml	SAT TT=0.052	SAT TT=0.904 CHECKS=3016 NODES=21	SAT TT=0.889 CHECKS=2122 NODES=0	SAT TT=2.888	SAT TT=0.622 CHECKS=2056	SAT TT=0.617 CHECKS=2188	SAT TT=2.343 ASSIGNMENTS=152	SAT TT=1.64 ASSIGNMENTS=15	SAT TT=108.151 CHECKS=10842600 NODES=25	SAT TT=293.004 CHECKS=180117000 NODES=1608000000	? (TO) TT=1800.02	SAT TT=0.705 ASSIGNMENTS=1228 CHECKS=186984	SAT TT=0.724 ASSIGNMENTS=1228 CHECKS=186984	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=0.902 ASSIGNMENTS=1698 CHECKS=268346	SAT TT=0.802 ASSIGNMENTS=2992 CHECKS=236565	SAT TT=1.31	SAT TT=0.097 ASSIGNMENTS=150 CHECKS=15797	SAT TT=0.052 ASSIGNMENTS=94 CHECKS=6447	? (MO) TT=30.944	SAT TT=9.615	SAT TT=11.736
csp/ogdHerald/ normalized-crossword-m1-ogd-05-09.xml	SAT TT=0.043	SAT TT=0.833 CHECKS=2166 NODES=19	SAT TT=0.868 CHECKS=1510 NODES=0	SAT TT=1.496	SAT TT=0.381 CHECKS=1278	SAT TT=0.327 CHECKS=1084	SAT TT=1.281 ASSIGNMENTS=71	SAT TT=1.126 ASSIGNMENTS=13	SAT TT=123.1 CHECKS=3387240 NODES=21	SAT TT=78.446 CHECKS=7038580 NODES=4500020	? (MO) TT=17.78	SAT TT=0.324 ASSIGNMENTS=802 CHECKS=77748	SAT TT=0.314 ASSIGNMENTS=802 CHECKS=77748	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.289 ASSIGNMENTS=695 CHECKS=70796	SAT TT=0.044 ASSIGNMENTS=61 CHECKS=3535	SAT TT=0.784	SAT TT=0.043 ASSIGNMENTS=59 CHECKS=2906	SAT TT=0.049 ASSIGNMENTS=109 CHECKS=6808	? (MO) TT=38.389	SAT TT=4.367	SAT TT=5.516
csp/ogdHerald/ normalized-crossword-m1-ogd-05-10.xml	SAT TT=0.034	SAT TT=0.881 CHECKS=4858 NODES=17	SAT TT=0.847 CHECKS=4129 NODES=0	SAT TT=1.589	SAT TT=0.28 CHECKS=1400	SAT TT=0.253 CHECKS=1609	SAT TT=1.506 ASSIGNMENTS=121	SAT TT=1.007 ASSIGNMENTS=15	SAT TT=129.347 CHECKS=2984550 NODES=19	SAT TT=66.936 CHECKS=3899510 NODES=7800020	SAT TT=94.905 CHECKS=22446700 NODES=4257	SAT TT=0.247 ASSIGNMENTS=1009 CHECKS=178578	SAT TT=0.225 ASSIGNMENTS=1009 CHECKS=178578	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=0.424 ASSIGNMENTS=1362 CHECKS=245977	SAT TT=0.095 ASSIGNMENTS=326 CHECKS=26284	SAT TT=0.722	SAT TT=0.034 ASSIGNMENTS=25 CHECKS=2334	SAT TT=0.093 ASSIGNMENTS=251 CHECKS=24689	? (MO) TT=35.732	SAT TT=3.944	SAT TT=4.515
csp/ogdHerald/ normalized-crossword-m1-ogd-15-02.xml	SAT TT=0.913	SAT TT=3.913 CHECKS=219221 NODES=324	SAT TT=4.49 CHECKS=338547 NODES=321	? (TO) TT=1800.06	SAT TT=30.145 CHECKS=156028	SAT TT=16.889 CHECKS=62487	SAT TT=33.333 ASSIGNMENTS=86	SAT TT=60.567 ASSIGNMENTS=81	SAT TT=229.704 CHECKS=622558000 NODES=371	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=0.952 ASSIGNMENTS=79 CHECKS=69464	SAT TT=0.937 ASSIGNMENTS=79 CHECKS=69464	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=0.913 ASSIGNMENTS=79 CHECKS=69464	SAT TT=74.31 ASSIGNMENTS=15050 CHECKS=19984800	SAT TT=38.231	SAT TT=51.759 ASSIGNMENTS=11278 CHECKS=9593620	SAT TT=0.944 ASSIGNMENTS=97 CHECKS=73114	? TT=98.717	? (MO) TT=6.67	? (TO) TT=1800.07
csp/ogdHerald/ normalized-crossword-m1-ogd-15-03.xml	SAT TT=0.538	SAT TT=2.948 CHECKS=154375 NODES=195	SAT TT=3.916 CHECKS=288911 NODES=195	SAT TT=33.076	SAT TT=30.822 CHECKS=95812	SAT TT=23.169 CHECKS=53313	SAT TT=21.15 ASSIGNMENTS=106	SAT TT=60.539 ASSIGNMENTS=84	SAT TT=207.889 CHECKS=544969000 NODES=265	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=0.552 ASSIGNMENTS=103 CHECKS=63534	SAT TT=0.553 ASSIGNMENTS=103 CHECKS=63534	? (TO) TT=1800.03	? (TO) TT=1800	SAT TT=0.547 ASSIGNMENTS=103 CHECKS=63534	SAT TT=48.748 ASSIGNMENTS=25562 CHECKS=22188600	SAT TT=21.468	SAT TT=22.164 ASSIGNMENTS=6130 CHECKS=4927320	SAT TT=0.538 ASSIGNMENTS=100 CHECKS=63137	? (MO) TT=31.643	? (TO) TT=1800	? (TO) TT=1800.06
csp/ogdHerald/ normalized-crossword-m1-ogd-15-05.xml	SAT TT=0.746	SAT TT=3.321 CHECKS=193399 NODES=185	SAT TT=3.954 CHECKS=351613 NODES=188	? (TO) TT=1800.1	SAT TT=26.24 CHECKS=111013	SAT TT=14.09 CHECKS=103171	SAT TT=19.93 ASSIGNMENTS=104	SAT TT=62.577 ASSIGNMENTS=85	SAT TT=160.785 CHECKS=234090000 NODES=307	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.798 ASSIGNMENTS=98 CHECKS=75903	SAT TT=0.929 ASSIGNMENTS=98 CHECKS=75903	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.904 ASSIGNMENTS=98 CHECKS=75903	SAT TT=54.165 ASSIGNMENTS=21622 CHECKS=23144400	SAT TT=18.597	SAT TT=59.227 ASSIGNMENTS=16202 CHECKS=13764700	SAT TT=0.746 ASSIGNMENTS=90 CHECKS=63126	? TT=87.88	? (TO) TT=1800.05	? (TO) TT=1800.2
csp/ogdHerald/ normalized-crossword-m1-ogd-15-06.xml	SAT TT=0.897	SAT TT=6.153 CHECKS=269791 NODES=930	SAT TT=7.19 CHECKS=147950 NODES=501	? (TO) TT=1800.07	SAT TT=37.424 CHECKS=109965	SAT TT=25.347 CHECKS=40197	SAT TT=31.924 ASSIGNMENTS=70	SAT TT=47.523 ASSIGNMENTS=68	SAT TT=204.321 CHECKS=562974000 NODES=323	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=0.907 ASSIGNMENTS=78 CHECKS=56861	SAT TT=0.966 ASSIGNMENTS=78 CHECKS=56861	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=0.897 ASSIGNMENTS=79 CHECKS=57081	SAT TT=65.317 ASSIGNMENTS=17865 CHECKS=14628300	SAT TT=35.02	SAT TT=45.762 ASSIGNMENTS=7837 CHECKS=5057230	SAT TT=1.072 ASSIGNMENTS=107 CHECKS=61590	? TT=77.503	? (TO) TT=1800.09	? (MO) TT=6.376
csp/ogdHerald/ normalized-crossword-m1-ogd-15-08.xml	SAT TT=0.569	SAT TT=3.127 CHECKS=161512 NODES=188	SAT TT=3.901 CHECKS=289040 NODES=189	? (TO) TT=1800.12	SAT TT=27.059 CHECKS=91234	SAT TT=20.057 CHECKS=66612	SAT TT=17.161 ASSIGNMENTS=106	SAT TT=42.976 ASSIGNMENTS=78	SAT TT=186.8 CHECKS=423219000 NODES=258	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=0.61 ASSIGNMENTS=114 CHECKS=58012	SAT TT=0.569 ASSIGNMENTS=114 CHECKS=58012	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=0.595 ASSIGNMENTS=114 CHECKS=58012	SAT TT=31.899 ASSIGNMENTS=21460 CHECKS=22485200	SAT TT=31.624	SAT TT=35.012 ASSIGNMENTS=13176 CHECKS=8775080	SAT TT=0.619 ASSIGNMENTS=103 CHECKS=61284	? (MO) TT=35.324	? (TO) TT=1800	? (TO) TT=1800.04
csp/ogdHerald/ normalized-crossword-m1-ogd-19-02.xml	SAT TT=1.147	SAT TT=5.918 CHECKS=359025 NODES=531	SAT TT=7.95 CHECKS=513466 NODES=531	? (TO) TT=1800.17	SAT TT=34.443 CHECKS=196117	SAT TT=28.547 CHECKS=237161	SAT TT=43.694 ASSIGNMENTS=114	SAT TT=66.435 ASSIGNMENTS=212	SAT TT=224.064 CHECKS=579765000 NODES=423	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=1.158 ASSIGNMENTS=103 CHECKS=118325	SAT TT=1.163 ASSIGNMENTS=103 CHECKS=118325	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=1.147 ASSIGNMENTS=103 CHECKS=118325	SAT TT=113.024 ASSIGNMENTS=20375 CHECKS=45974700	SAT TT=63.359	SAT TT=75.491 ASSIGNMENTS=12729 CHECKS=14687700	SAT TT=1.243 ASSIGNMENTS=142 CHECKS=135414	? TT=77.559	? (MO) TT=7.392	? (MO) TT=7.481
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdHerald/ normalized-crossword-m1-ogd-19-05.xml	SAT TT=0.591	SAT TT=3.968 CHECKS=389571 NODES=292	SAT TT=6.338 CHECKS=839027 NODES=299	? (TO) TT=1800.06	SAT TT=29.035 CHECKS=258501	SAT TT=13.478 CHECKS=159602	SAT TT=32.706 ASSIGNMENTS=112	SAT TT=66.631 ASSIGNMENTS=360	SAT TT=319.478 CHECKS=962057000 NODES=442	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.592 ASSIGNMENTS=120 CHECKS=164203	SAT TT=0.591 ASSIGNMENTS=120 CHECKS=164203	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.666 ASSIGNMENTS=120 CHECKS=164203	SAT TT=5.159 ASSIGNMENTS=1361 CHECKS=2496820	SAT TT=29.896	SAT TT=39.656 ASSIGNMENTS=10876 CHECKS=22538400	SAT TT=0.658 ASSIGNMENTS=124 CHECKS=169335	? (MO) TT=45.764	? (TO) TT=1800.05	? (TO) TT=1800.04
csp/ogdHerald/ normalized-crossword-m1-ogd-19-06.xml	SAT TT=1.454	SAT TT=5.327 CHECKS=443343 NODES=291	SAT TT=7.206 CHECKS=678067 NODES=291	? (TO) TT=1800.07	SAT TT=55.531 CHECKS=260089	SAT TT=27.71 CHECKS=109972	SAT TT=42.008 ASSIGNMENTS=153	SAT TT=65.947 ASSIGNMENTS=139	SAT TT=216.712 CHECKS=411071000 NODES=504	? (TO) TT=1800.04	? (TO) TT=1800	SAT TT=1.537 ASSIGNMENTS=157 CHECKS=161643	SAT TT=1.48 ASSIGNMENTS=157 CHECKS=161643	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=1.454 ASSIGNMENTS=157 CHECKS=161643	SAT TT=20.576 ASSIGNMENTS=3554 CHECKS=4652140	? (TO) TT=1800.03	SAT TT=203.098 ASSIGNMENTS=31585 CHECKS=47613500	SAT TT=1.491 ASSIGNMENTS=153 CHECKS=163902	? TT=100.411	? (MO) TT=7.29	? (MO) TT=7.88
csp/ogdHerald/ normalized-crossword-m1-ogd-19-08.xml	SAT TT=1.522	SAT TT=6.147 CHECKS=570466 NODES=302	SAT TT=8.602 CHECKS=1242960 NODES=568	? (TO) TT=1800.1	SAT TT=40.694 CHECKS=209968	SAT TT=25.092 CHECKS=133892	SAT TT=43.13 ASSIGNMENTS=150	SAT TT=69.216 ASSIGNMENTS=328	SAT TT=199.618 CHECKS=331564000 NODES=469	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=1.707 ASSIGNMENTS=192 CHECKS=243341	SAT TT=1.604 ASSIGNMENTS=192 CHECKS=243341	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1.734 ASSIGNMENTS=193 CHECKS=244313	SAT TT=55.023 ASSIGNMENTS=10905 CHECKS=18585500	SAT TT=202.706	SAT TT=42.129 ASSIGNMENTS=7809 CHECKS=14590800	SAT TT=1.522 ASSIGNMENTS=200 CHECKS=231462	? TT=81.781	? (MO) TT=8.23	? (MO) TT=8.06
csp/ogdHerald/ normalized-crossword-m1-ogd-21-03.xml	SAT TT=1.495	SAT TT=5.532 CHECKS=272797 NODES=371	SAT TT=7.693 CHECKS=463302 NODES=371	? (TO) TT=1800.12	SAT TT=43.687 CHECKS=219325	SAT TT=45.024 CHECKS=167154	SAT TT=51.517 ASSIGNMENTS=154	SAT TT=66.435 ASSIGNMENTS=140	SAT TT=492.62 CHECKS=1814310000 NODES=676	? (TO) TT=1800	? (TO) TT=1800.05	SAT TT=1.513 ASSIGNMENTS=180 CHECKS=161589	SAT TT=1.511 ASSIGNMENTS=180 CHECKS=161589	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=1.495 ASSIGNMENTS=180 CHECKS=161589	SAT TT=73.105 ASSIGNMENTS=11084 CHECKS=13950500	? (MO) TT=41.58	SAT TT=89.574 ASSIGNMENTS=14041 CHECKS=18222900	SAT TT=1.78 ASSIGNMENTS=191 CHECKS=216462	? TT=96.658	? (TO) TT=1800.2	? (MO) TT=8.45
csp/ogdHerald/ normalized-crossword-m1-ogd-21-05.xml	SAT TT=0.856	SAT TT=4.916 CHECKS=265481 NODES=383	SAT TT=6.868 CHECKS=373260 NODES=378	? (TO) TT=1800.11	SAT TT=51.277 CHECKS=370406	SAT TT=35.486 CHECKS=215167	SAT TT=42.235 ASSIGNMENTS=177	SAT TT=103.782 ASSIGNMENTS=1395	SAT TT=1376.45 CHECKS=6470460000 NODES=1036	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=1.332 ASSIGNMENTS=224 CHECKS=296774	SAT TT=1.259 ASSIGNMENTS=224 CHECKS=296774	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=1.184 ASSIGNMENTS=226 CHECKS=298539	SAT TT=49.589 ASSIGNMENTS=11555 CHECKS=16229300	SAT TT=48.976	SAT TT=107.702 ASSIGNMENTS=25082 CHECKS=38040600	SAT TT=0.856 ASSIGNMENTS=177 CHECKS=200195	? (MO) TT=34.788	? (TO) TT=1800.26	? (TO) TT=1800.29
csp/ogdHerald/ normalized-crossword-m1-ogd-21-08.xml	SAT TT=1.141	SAT TT=7.07 CHECKS=599752 NODES=367	SAT TT=8.68 CHECKS=1065130 NODES=371	? (TO) TT=1800.11	SAT TT=69.655 CHECKS=603265	SAT TT=31.593 CHECKS=358159	SAT TT=45.187 ASSIGNMENTS=198	? (TO) TT=1800.15	SAT TT=478.945 CHECKS=1936670000 NODES=890	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.15 ASSIGNMENTS=202 CHECKS=265265	SAT TT=1.214 ASSIGNMENTS=202 CHECKS=265265	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=1.141 ASSIGNMENTS=202 CHECKS=265265	SAT TT=38.767 ASSIGNMENTS=10651 CHECKS=17630500	? (TO) TT=1800.01	SAT TT=155.23 ASSIGNMENTS=36787 CHECKS=69086700	SAT TT=1.145 ASSIGNMENTS=207 CHECKS=261998	? TT=83.358	? (MO) TT=7.381	? (MO) TT=7.28
csp/ogdHerald/ normalized-crossword-m1-ogd-21-10.xml	SAT TT=3.256	SAT TT=8.983 CHECKS=265498 NODES=1384	SAT TT=11.328 CHECKS=200122 NODES=1029	? (problem) TT=51.237	SAT TT=89.782 CHECKS=1055370	SAT TT=60.949 CHECKS=470543	SAT TT=68.034 ASSIGNMENTS=151	? (TO) TT=1800.14	SAT TT=606.018 CHECKS=2703620000 NODES=997	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=16.73 ASSIGNMENTS=1383 CHECKS=264722	SAT TT=16.209 ASSIGNMENTS=1383 CHECKS=264722	? (TO) TT=1800.06	? (TO) TT=1800	SAT TT=4.932 ASSIGNMENTS=669 CHECKS=964438	SAT TT=94.418 ASSIGNMENTS=9794 CHECKS=16726500	? (MO) TT=45.47	SAT TT=157.801 ASSIGNMENTS=18001 CHECKS=30589900	SAT TT=3.256 ASSIGNMENTS=348 CHECKS=505001	? TT=78.311	? (MO) TT=7.09	? (MO) TT=7.07
csp/ogdHerald/ normalized-crossword-m1-ogd-23-02.xml	SAT TT=2.258	SAT TT=9.265 CHECKS=760880 NODES=608	SAT TT=11.278 CHECKS=1171760 NODES=444	? (problem) TT=65.319	SAT TT=72.649 CHECKS=509655	SAT TT=32.518 CHECKS=269031	SAT TT=70.359 ASSIGNMENTS=205	SAT TT=159.886 ASSIGNMENTS=2706	SAT TT=368.915 CHECKS=1156120000 NODES=874	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=2.392 ASSIGNMENTS=213 CHECKS=306603	SAT TT=2.502 ASSIGNMENTS=213 CHECKS=306603	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=2.387 ASSIGNMENTS=213 CHECKS=306603	SAT TT=85.353 ASSIGNMENTS=13279 CHECKS=24747700	? (MO) TT=44.76	SAT TT=269.006 ASSIGNMENTS=37726 CHECKS=77871200	SAT TT=2.258 ASSIGNMENTS=214 CHECKS=301928	? TT=98.452	? (MO) TT=9.35	? (MO) TT=9.31
csp/ogdHerald/ normalized-crossword-m1-ogd-23-03.xml	SAT TT=2.543	SAT TT=9.84 CHECKS=505816 NODES=1123	SAT TT=13.26 CHECKS=824798 NODES=1123	? (problem) TT=70.915	SAT TT=85.375 CHECKS=766586	SAT TT=39.048 CHECKS=351549	SAT TT=69.474 ASSIGNMENTS=179	SAT TT=600.469 ASSIGNMENTS=16825	SAT TT=531.525 CHECKS=2052790000 NODES=618	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=2.825 ASSIGNMENTS=250 CHECKS=346176	SAT TT=2.842 ASSIGNMENTS=250 CHECKS=346176	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=2.882 ASSIGNMENTS=276 CHECKS=369680	SAT TT=94.283 ASSIGNMENTS=11615 CHECKS=20454700	? (MO) TT=44.75	SAT TT=126.51 ASSIGNMENTS=15103 CHECKS=27159900	SAT TT=2.543 ASSIGNMENTS=201 CHECKS=286927	? TT=109.239	? (MO) TT=9.53	? (MO) TT=9.53
csp/ogdHerald/ normalized-crossword-m1-ogd-23-07.xml	SAT TT=2.426	SAT TT=9.987 CHECKS=632546 NODES=849	SAT TT=12.623 CHECKS=857925 NODES=450	? (problem) TT=64.583	SAT TT=73.616 CHECKS=425359	SAT TT=35.295 CHECKS=286091	SAT TT=71.405 ASSIGNMENTS=203	SAT TT=75.498 ASSIGNMENTS=380	SAT TT=430.468 CHECKS=1645730000 NODES=946	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=2.582 ASSIGNMENTS=189 CHECKS=283028	SAT TT=2.452 ASSIGNMENTS=189 CHECKS=283028	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=2.426 ASSIGNMENTS=189 CHECKS=283028	SAT TT=111.345 ASSIGNMENTS=12587 CHECKS=24669700	? (MO) TT=46	SAT TT=445.216 ASSIGNMENTS=51001 CHECKS=108336000	SAT TT=2.555 ASSIGNMENTS=192 CHECKS=283738	? TT=100.139	? (MO) TT=9.44	? (MO) TT=9.549
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdHerald/ normalized-crossword-m1-ogd-23-08.xml	SAT TT=1.429	SAT TT=8.74 CHECKS=635114 NODES=936	SAT TT=13.575 CHECKS=756952 NODES=1315	? (TO) TT=1800.18	SAT TT=78.405 CHECKS=758967	SAT TT=86.406 CHECKS=1929500	SAT TT=62.719 ASSIGNMENTS=254	? (TO) TT=1800.06	SAT TT=681.81 CHECKS=2860230000 NODES=988	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=1.449 ASSIGNMENTS=210 CHECKS=317852	SAT TT=1.443 ASSIGNMENTS=210 CHECKS=317852	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=1.429 ASSIGNMENTS=210 CHECKS=317852	SAT TT=66.898 ASSIGNMENTS=13076 CHECKS=22436100	? (MO) TT=49.84	SAT TT=236.242 ASSIGNMENTS=50588 CHECKS=89435300	SAT TT=1.619 ASSIGNMENTS=228 CHECKS=375495	? TT=83.992	? (TO) TT=1800.19	? (MO) TT=6.26
csp/ogdHerald/ normalized-crossword-m1-ogd-23-09.xml	SAT TT=2.094	SAT TT=10.762 CHECKS=1245680 NODES=1199	SAT TT=14.848 CHECKS=1005220 NODES=1235	? (TO) TT=1800.15	SAT TT=63.14 CHECKS=1138740	SAT TT=44.932 CHECKS=525345	SAT TT=71.804 ASSIGNMENTS=159	? (TO) TT=1800.07	SAT TT=555.663 CHECKS=2507880000 NODES=813	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=2.183 ASSIGNMENTS=222 CHECKS=546396	SAT TT=2.316 ASSIGNMENTS=222 CHECKS=546396	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=2.177 ASSIGNMENTS=226 CHECKS=551566	SAT TT=70.611 ASSIGNMENTS=10721 CHECKS=31297700	? (MO) TT=44.01	SAT TT=276.167 ASSIGNMENTS=42035 CHECKS=136670000	SAT TT=2.094 ASSIGNMENTS=216 CHECKS=624994	? TT=73.589	? (TO) TT=1800.11	? (MO) TT=7.415
csp/ogdHerald/ normalized-crossword-m1-ogd-23-10.xml	SAT TT=5.559	SAT TT=12.025 CHECKS=395373 NODES=1288	SAT TT=29.92 CHECKS=1389220 NODES=3196	? (problem) TT=60.821	SAT TT=84.148 CHECKS=333817	SAT TT=99.018 CHECKS=555449	SAT TT=69.622 ASSIGNMENTS=135	? (TO) TT=1800.14	SAT TT=216.174 CHECKS=228422000 NODES=1070	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=23.005 ASSIGNMENTS=2114 CHECKS=853311	SAT TT=26.045 ASSIGNMENTS=2114 CHECKS=853311	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=5.559 ASSIGNMENTS=352 CHECKS=585943	SAT TT=147.162 ASSIGNMENTS=11257 CHECKS=17668900	? (MO) TT=7.49	SAT TT=635.023 ASSIGNMENTS=52023 CHECKS=86383100	SAT TT=8.976 ASSIGNMENTS=507 CHECKS=963852	? TT=63.457	? (MO) TT=7.31	? (MO) TT=7.14
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle02.xml	SAT TT=0.009	SAT TT=0.741 CHECKS=1738 NODES=8	SAT TT=0.725 CHECKS=1041 NODES=0	SAT TT=0.065	SAT TT=0.04 CHECKS=436	SAT TT=0.034 CHECKS=488	SAT TT=0.732 ASSIGNMENTS=68	SAT TT=0.673 ASSIGNMENTS=6	SAT TT=88.955 CHECKS=17595 NODES=9	SAT TT=31.147 CHECKS=21926 NODES=8	SAT TT=32.547 CHECKS=19369 NODES=3	SAT TT=0.03 ASSIGNMENTS=143 CHECKS=5947	SAT TT=0.028 ASSIGNMENTS=143 CHECKS=5947	SAT TT=79.999	SAT TT=75.08	SAT TT=0.019 ASSIGNMENTS=145 CHECKS=6112	SAT TT=0.009 ASSIGNMENTS=15 CHECKS=613	SAT TT=0.343	SAT TT=0.01 ASSIGNMENTS=7 CHECKS=231	SAT TT=0.015 ASSIGNMENTS=118 CHECKS=3255	SAT TT=1337.74	SAT TT=0.834	SAT TT=0.896
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle03.xml	SAT TT=0.022	SAT TT=0.778 CHECKS=2393 NODES=14	SAT TT=0.814 CHECKS=1528 NODES=0	SAT TT=0.24	SAT TT=0.154 CHECKS=1032	SAT TT=0.131 CHECKS=997	SAT TT=1.212 ASSIGNMENTS=67	SAT TT=1.012 ASSIGNMENTS=11	SAT TT=136.879 CHECKS=415980 NODES=15	SAT TT=89.731 CHECKS=1966270 NODES=2250010	SAT TT=85.095 CHECKS=428991 NODES=12	SAT TT=0.222 ASSIGNMENTS=914 CHECKS=69613	SAT TT=0.209 ASSIGNMENTS=914 CHECKS=69613	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=0.204 ASSIGNMENTS=812 CHECKS=64590	SAT TT=0.057 ASSIGNMENTS=418 CHECKS=20259	SAT TT=0.497	SAT TT=0.024 ASSIGNMENTS=76 CHECKS=4153	SAT TT=0.022 ASSIGNMENTS=97 CHECKS=4590	? (TO) TT=1800.12	SAT TT=1.414	SAT TT=1.778
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle05.xml	SAT TT=0.036	SAT TT=0.859 CHECKS=2409 NODES=21	SAT TT=0.873 CHECKS=1744 NODES=0	SAT TT=1.543	SAT TT=0.339 CHECKS=1014	SAT TT=0.356 CHECKS=1263	SAT TT=2.752 ASSIGNMENTS=228	SAT TT=1.051 ASSIGNMENTS=15	SAT TT=90.287 CHECKS=3778160 NODES=22	SAT TT=38.4 CHECKS=50809300 NODES=56400000	SAT TT=46.702 CHECKS=29324900 NODES=1384	SAT TT=9.924 ASSIGNMENTS=228	SAT TT=10.565 ASSIGNMENTS=228	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.236 ASSIGNMENTS=2855 CHECKS=236063	SAT TT=0.076 ASSIGNMENTS=155 CHECKS=8744	SAT TT=0.914	SAT TT=0.036 ASSIGNMENTS=23 CHECKS=1155	SAT TT=0.061 ASSIGNMENTS=223 CHECKS=8840	? (MO) TT=40.129	SAT TT=4.423	SAT TT=5.662
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle06.xml	SAT TT=0.037	SAT TT=0.866 CHECKS=3346 NODES=24	SAT TT=0.884 CHECKS=2363 NODES=0	SAT TT=2.962	SAT TT=0.622 CHECKS=1547	SAT TT=0.527 CHECKS=1586	SAT TT=6.057 ASSIGNMENTS=297	SAT TT=1.457 ASSIGNMENTS=12	SAT TT=93.936 CHECKS=10348500 NODES=24	SAT TT=233.416 CHECKS=153308000 NODES=1398300000	? (TO) TT=1800.09	SAT TT=0.971 ASSIGNMENTS=1623 CHECKS=267414	SAT TT=1.055 ASSIGNMENTS=1623 CHECKS=267414	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=3.094 ASSIGNMENTS=4739 CHECKS=921562	SAT TT=0.037 ASSIGNMENTS=20 CHECKS=2672	SAT TT=1.097	SAT TT=0.053 ASSIGNMENTS=66 CHECKS=5705	SAT TT=0.047 ASSIGNMENTS=95 CHECKS=8714	? (MO) TT=37.661	SAT TT=9.449	SAT TT=11.887
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle07.xml	SAT TT=0.038	SAT TT=0.909 CHECKS=4866 NODES=30	SAT TT=0.903 CHECKS=4732 NODES=0	SAT TT=2.034	SAT TT=0.769 CHECKS=3743	SAT TT=0.511 CHECKS=2039	SAT TT=14.943 ASSIGNMENTS=3056	SAT TT=1.585 ASSIGNMENTS=23	SAT TT=132.296 CHECKS=7555750 NODES=31	SAT TT=1392.27 CHECKS=4822550000 NODES=1478230000	SAT TT=1018.32 CHECKS=1648650000 NODES=85045	SAT TT=0.21 ASSIGNMENTS=592 CHECKS=85849	SAT TT=0.208 ASSIGNMENTS=592 CHECKS=85849	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=0.204 ASSIGNMENTS=606 CHECKS=87656	SAT TT=0.054 ASSIGNMENTS=74 CHECKS=5663	SAT TT=1.016	SAT TT=0.038 ASSIGNMENTS=40 CHECKS=2377	SAT TT=0.074 ASSIGNMENTS=154 CHECKS=13498	? TT=100.925	SAT TT=7.027	SAT TT=8.72
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle08.xml	SAT TT=0.16	SAT TT=1.137 CHECKS=15503 NODES=41	SAT TT=1.122 CHECKS=12944 NODES=0	SAT TT=13.089	SAT TT=1.946 CHECKS=6389	SAT TT=2.458 CHECKS=10336	SAT TT=3.286 ASSIGNMENTS=273	SAT TT=3.09 ASSIGNMENTS=25	SAT TT=131.115 CHECKS=315091 NODES=44	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=1.024 ASSIGNMENTS=1526 CHECKS=530618	SAT TT=1.018 ASSIGNMENTS=1526 CHECKS=530618	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=1.014 ASSIGNMENTS=1438 CHECKS=502068	SAT TT=2.214 ASSIGNMENTS=1469 CHECKS=272335	SAT TT=2.805	SAT TT=0.165 ASSIGNMENTS=74 CHECKS=8801	SAT TT=0.16 ASSIGNMENTS=160 CHECKS=30198	? (TO) TT=1800.15	SAT TT=183.298	SAT TT=174.917
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle10.xml	SAT TT=0.118	SAT TT=1.213 CHECKS=22773 NODES=41	SAT TT=1.387 CHECKS=57768 NODES=44	SAT TT=4.219	SAT TT=48.738 CHECKS=247516	SAT TT=3.257 CHECKS=15114	SAT TT=3.581 ASSIGNMENTS=26	SAT TT=3.971 ASSIGNMENTS=28	SAT TT=129.362 CHECKS=134913 NODES=45	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=0.135 ASSIGNMENTS=24 CHECKS=5687	SAT TT=0.135 ASSIGNMENTS=24 CHECKS=5687	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=0.13 ASSIGNMENTS=24 CHECKS=5687	SAT TT=8.544 ASSIGNMENTS=11465 CHECKS=1729850	SAT TT=3.58	SAT TT=0.182 ASSIGNMENTS=71 CHECKS=18703	SAT TT=0.118 ASSIGNMENTS=24 CHECKS=5687	? (TO) TT=1800.18	SAT TT=232.981	SAT TT=237.225
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle11.xml	SAT TT=0.265	SAT TT=1.312 CHECKS=5711 NODES=38	SAT TT=1.182 CHECKS=3201 NODES=0	SAT TT=6.391	SAT TT=2.631 CHECKS=4449	SAT TT=2.664 CHECKS=5252	SAT TT=4.044 ASSIGNMENTS=174	SAT TT=3.643 ASSIGNMENTS=18	SAT TT=112.484 CHECKS=189330000 NODES=38	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=0.889 ASSIGNMENTS=1056 CHECKS=185443	SAT TT=0.901 ASSIGNMENTS=1056 CHECKS=185443	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.633 ASSIGNMENTS=944 CHECKS=170415	SAT TT=0.806 ASSIGNMENTS=322 CHECKS=48295	SAT TT=3.262	SAT TT=0.477 ASSIGNMENTS=208 CHECKS=21188	SAT TT=0.265 ASSIGNMENTS=110 CHECKS=22983	? TT=80.039	SAT TT=151.287	SAT TT=166.573
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle12.xml	SAT TT=0.045	SAT TT=1.079 CHECKS=24190 NODES=52	SAT TT=1.245 CHECKS=18061 NODES=0	SAT TT=2.563	SAT TT=0.88 CHECKS=8278	SAT TT=0.671 CHECKS=8767	SAT TT=1.981 ASSIGNMENTS=39	SAT TT=2.596 ASSIGNMENTS=36	SAT TT=128.682 CHECKS=10179500 NODES=56	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=0.059 ASSIGNMENTS=37 CHECKS=6989	SAT TT=0.06 ASSIGNMENTS=37 CHECKS=6989	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.045 ASSIGNMENTS=37 CHECKS=6989	SAT TT=2.603 ASSIGNMENTS=11178 CHECKS=2503680	? (TO) TT=1800.11	SAT TT=0.274 ASSIGNMENTS=643 CHECKS=155602	SAT TT=0.052 ASSIGNMENTS=44 CHECKS=10653	? (MO) TT=31.768	SAT TT=8.543	SAT TT=11.358
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle13.xml	SAT TT=0.298	SAT TT=1.712 CHECKS=34538 NODES=65	SAT TT=1.696 CHECKS=32395 NODES=0	SAT TT=10.352	SAT TT=8.014 CHECKS=26757	SAT TT=5.478 CHECKS=13912	SAT TT=6.587 ASSIGNMENTS=46	SAT TT=7.216 ASSIGNMENTS=34	SAT TT=137.415 CHECKS=2182740 NODES=70	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=0.324 ASSIGNMENTS=46 CHECKS=12954	SAT TT=0.307 ASSIGNMENTS=46 CHECKS=12954	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=0.298 ASSIGNMENTS=46 CHECKS=12954	SAT TT=18.772 ASSIGNMENTS=15822 CHECKS=4252790	SAT TT=5.715	SAT TT=2.268 ASSIGNMENTS=1121 CHECKS=433612	SAT TT=0.323 ASSIGNMENTS=40 CHECKS=13064	? (MO) TT=43.156	SAT TT=1202.06	SAT TT=1352.68
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle16.xml	SAT TT=0.275	SAT TT=2.326 CHECKS=141580 NODES=137	SAT TT=2.725 CHECKS=305792 NODES=137	SAT TT=1634.91	SAT TT=5.409 CHECKS=44521	SAT TT=3.878 CHECKS=38213	SAT TT=8.192 ASSIGNMENTS=87	SAT TT=19.296 ASSIGNMENTS=82	SAT TT=214.463 CHECKS=526612000 NODES=221	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=0.308 ASSIGNMENTS=88 CHECKS=40120	SAT TT=0.307 ASSIGNMENTS=88 CHECKS=40120	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=0.275 ASSIGNMENTS=88 CHECKS=40120	SAT TT=17.251 ASSIGNMENTS=19910 CHECKS=14155900	SAT TT=6.177	SAT TT=6.419 ASSIGNMENTS=4355 CHECKS=2539200	SAT TT=0.287 ASSIGNMENTS=82 CHECKS=39313	? (MO) TT=54.361	SAT TT=223.944	SAT TT=232.776
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle17.xml	SAT TT=0.418	SAT TT=2.599 CHECKS=245496 NODES=185	SAT TT=3.612 CHECKS=452743 NODES=185	? (TO) TT=1800.06	SAT TT=12.358 CHECKS=69677	SAT TT=10.756 CHECKS=69033	SAT TT=15.711 ASSIGNMENTS=98	SAT TT=51.771 ASSIGNMENTS=102	SAT TT=191.13 CHECKS=305425000 NODES=241	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=0.445 ASSIGNMENTS=108 CHECKS=73192	SAT TT=0.448 ASSIGNMENTS=108 CHECKS=73192	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=0.45 ASSIGNMENTS=108 CHECKS=73192	SAT TT=40.023 ASSIGNMENTS=25361 CHECKS=27031400	? (TO) TT=1800.06	SAT TT=58.84 ASSIGNMENTS=25913 CHECKS=18753700	SAT TT=0.418 ASSIGNMENTS=104 CHECKS=67307	? TT=79.348	SAT TT=1046.23	SAT TT=1059.65
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle19.xml	SAT TT=0.826	SAT TT=3.1 CHECKS=154205 NODES=193	SAT TT=4.187 CHECKS=280376 NODES=193	? (TO) TT=1800.08	SAT TT=34.378 CHECKS=134278	SAT TT=13.675 CHECKS=48994	SAT TT=22.766 ASSIGNMENTS=91	SAT TT=60.356 ASSIGNMENTS=88	SAT TT=168.358 CHECKS=370142000 NODES=266	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=0.929 ASSIGNMENTS=100 CHECKS=59462	SAT TT=0.907 ASSIGNMENTS=100 CHECKS=59462	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.871 ASSIGNMENTS=100 CHECKS=59462	SAT TT=43.948 ASSIGNMENTS=21103 CHECKS=19679500	SAT TT=19.251	SAT TT=21.767 ASSIGNMENTS=5689 CHECKS=4028720	SAT TT=0.826 ASSIGNMENTS=92 CHECKS=53804	? TT=79.599	? (MO) TT=6.337	? (MO) TT=6.87
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle21.xml	SAT TT=0.162	SAT TT=1.752 CHECKS=116587 NODES=131	SAT TT=2.259 CHECKS=213548 NODES=128	SAT TT=11.408	SAT TT=6.849 CHECKS=38625	SAT TT=6.707 CHECKS=89031	SAT TT=6.928 ASSIGNMENTS=71	SAT TT=17.395 ASSIGNMENTS=79	SAT TT=295.425 CHECKS=784086000 NODES=199	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.172 ASSIGNMENTS=79 CHECKS=32801	SAT TT=0.172 ASSIGNMENTS=79 CHECKS=32801	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.162 ASSIGNMENTS=78 CHECKS=32650	SAT TT=9.876 ASSIGNMENTS=19879 CHECKS=9969070	SAT TT=5.674	SAT TT=4.095 ASSIGNMENTS=4094 CHECKS=1997310	SAT TT=0.163 ASSIGNMENTS=96 CHECKS=35630	? (MO) TT=41.805	SAT TT=113.241	SAT TT=122.424
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle22.xml	SAT TT=0.347	SAT TT=2.187 CHECKS=81327 NODES=134	SAT TT=2.833 CHECKS=139203 NODES=134	? (TO) TT=1800.05	SAT TT=15.41 CHECKS=68840	SAT TT=13.484 CHECKS=42701	SAT TT=18.974 ASSIGNMENTS=63	SAT TT=24.086 ASSIGNMENTS=62	SAT TT=133.131 CHECKS=3284820 NODES=138	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=0.367 ASSIGNMENTS=60 CHECKS=34811	SAT TT=0.347 ASSIGNMENTS=60 CHECKS=34811	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=0.364 ASSIGNMENTS=60 CHECKS=34811	SAT TT=55.861 ASSIGNMENTS=14353 CHECKS=11369000	SAT TT=13.183	SAT TT=17.441 ASSIGNMENTS=3790 CHECKS=3330050	SAT TT=0.428 ASSIGNMENTS=87 CHECKS=50191	? (MO) TT=41.999	? (TO) TT=1800.07	? (TO) TT=1800.1
csp/primes-10/ normalized-primes-10-20-2-1.xml	SAT TT=0.01	SAT TT=0.853 CHECKS=158104 NODES=100	SAT TT=0.816 CHECKS=158102 NODES=0	SAT TT=0.033	SAT TT=0.074 CHECKS=8189	SAT TT=0.162 CHECKS=454379	SAT TT=0.915 ASSIGNMENTS=70	SAT TT=0.918 ASSIGNMENTS=70	SAT TT=0.789 CHECKS=123369 NODES=100	SAT TT=1.954 CHECKS=235710 NODES=2550000	SAT TT=0.895 CHECKS=408855 NODES=25	SAT TT=0.024 ASSIGNMENTS=80 CHECKS=426	SAT TT=0.024 ASSIGNMENTS=80 CHECKS=426	SAT TT=2.475	SAT TT=2.41	SAT TT=0.01 ASSIGNMENTS=80 CHECKS=426	SAT TT=0.011 ASSIGNMENTS=188 CHECKS=2153	SAT TT=0.36	SAT TT=0.754 ASSIGNMENTS=12314 CHECKS=205605	SAT TT=0.011 ASSIGNMENTS=80 CHECKS=426	SAT TT=4.472	SAT TT=0.661	SAT TT=0.677
csp/primes-10/ normalized-primes-10-20-2-7.xml	SAT TT=0.017	SAT TT=653.535 CHECKS=951192000 NODES=2248	SAT TT=1364.82 CHECKS=1947110000 NODES=3646	SAT TT=0.041	SAT TT=0.384 CHECKS=2307	SAT TT=0.043 CHECKS=3130	SAT TT=2.162 ASSIGNMENTS=68	SAT TT=2.831 ASSIGNMENTS=133	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.032 ASSIGNMENTS=155 CHECKS=11037	SAT TT=0.031 ASSIGNMENTS=155 CHECKS=11037	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=0.018 ASSIGNMENTS=157 CHECKS=11166	SAT TT=0.319 ASSIGNMENTS=7895 CHECKS=627071	SAT TT=0.408	SAT TT=3.165 ASSIGNMENTS=74177 CHECKS=3854570	SAT TT=0.017 ASSIGNMENTS=188 CHECKS=10088	? TT=96.005	? (MO) TT=75.97	? (MO) TT=286.147
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-10/ normalized-primes-10-20-3-5.xml	SAT TT=0.016	SAT TT=5.501 CHECKS=8073400 NODES=100	SAT TT=15.358 CHECKS=23870500 NODES=136	SAT TT=0.038	SAT TT=0.49 CHECKS=5200	SAT TT=0.039 CHECKS=4452	SAT TT=1.771 ASSIGNMENTS=74	SAT TT=2.393 ASSIGNMENTS=427	SAT TT=408.086 CHECKS=1231760000 NODES=100	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=0.028 ASSIGNMENTS=292 CHECKS=11929	SAT TT=0.031 ASSIGNMENTS=292 CHECKS=11929	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.018 ASSIGNMENTS=287 CHECKS=10416	SAT TT=0.196 ASSIGNMENTS=8217 CHECKS=358629	SAT TT=0.383	SAT TT=1.672 ASSIGNMENTS=42786 CHECKS=1300880	SAT TT=0.016 ASSIGNMENTS=301 CHECKS=9404	? TT=156.347	SAT TT=50.413	SAT TT=262.697
csp/primes-10/ normalized-primes-10-20-3-7.xml	SAT TT=0.019	? (TO) TT=1800.06	? (TO) TT=1800.12	SAT TT=0.046	SAT TT=0.462 CHECKS=4009	SAT TT=0.095 CHECKS=7125	SAT TT=1.985 ASSIGNMENTS=67	SAT TT=4.031 ASSIGNMENTS=1397	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=0.034 ASSIGNMENTS=367 CHECKS=16057	SAT TT=0.031 ASSIGNMENTS=367 CHECKS=16057	? (TO) TT=1800	? (TO) TT=1800.02	SAT TT=0.022 ASSIGNMENTS=416 CHECKS=21267	SAT TT=0.291 ASSIGNMENTS=8978 CHECKS=616039	SAT TT=0.379	SAT TT=5.415 ASSIGNMENTS=79977 CHECKS=4554320	SAT TT=0.019 ASSIGNMENTS=271 CHECKS=13261	? TT=142.343	? (MO) TT=107.42	? (MO) TT=291.89
csp/primes-10/ normalized-primes-10-40-2-1.xml	SAT TT=0.014	SAT TT=0.881 CHECKS=135689 NODES=100	SAT TT=0.869 CHECKS=136052 NODES=0	SAT TT=0.038	SAT TT=0.151 CHECKS=3125	SAT TT=0.112 CHECKS=192747	SAT TT=1.025 ASSIGNMENTS=43	SAT TT=1.131 ASSIGNMENTS=43	SAT TT=1.055 CHECKS=137067 NODES=100	SAT TT=0.978 CHECKS=150258 NODES=150008	SAT TT=1.197 CHECKS=476634 NODES=695	SAT TT=0.023 ASSIGNMENTS=77 CHECKS=1489	SAT TT=0.025 ASSIGNMENTS=77 CHECKS=1489	SAT TT=3.702	SAT TT=3.484	SAT TT=0.014 ASSIGNMENTS=77 CHECKS=1489	SAT TT=0.019 ASSIGNMENTS=607 CHECKS=9911	SAT TT=0.427	SAT TT=0.171 ASSIGNMENTS=14247 CHECKS=153407	SAT TT=0.014 ASSIGNMENTS=81 CHECKS=1668	SAT TT=6.239	SAT TT=0.719	SAT TT=0.821
csp/primes-10/ normalized-primes-10-40-2-3.xml	SAT TT=0.024	SAT TT=1.818 CHECKS=2215470 NODES=100	SAT TT=1.748 CHECKS=2118250 NODES=0	SAT TT=0.042	SAT TT=1.058 CHECKS=143718	SAT TT=0.769 CHECKS=141544	SAT TT=1.447 ASSIGNMENTS=41	SAT TT=1.45 ASSIGNMENTS=41	SAT TT=88.129 CHECKS=36681900 NODES=102	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.036 ASSIGNMENTS=265 CHECKS=16199	SAT TT=0.032 ASSIGNMENTS=265 CHECKS=16199	SAT TT=92.853	SAT TT=87.583	SAT TT=0.024 ASSIGNMENTS=248 CHECKS=15065	SAT TT=0.229 ASSIGNMENTS=6072 CHECKS=373064	SAT TT=0.471	SAT TT=4.728 ASSIGNMENTS=44233 CHECKS=3019640	SAT TT=0.048 ASSIGNMENTS=856 CHECKS=63863	? TT=235.257	SAT TT=1.659	SAT TT=3.6
csp/primes-10/ normalized-primes-10-40-2-5.xml	SAT TT=0.046	SAT TT=3.666 CHECKS=4657610 NODES=114	SAT TT=4.847 CHECKS=6028720 NODES=104	SAT TT=0.046	SAT TT=1.665 CHECKS=110788	SAT TT=1.287 CHECKS=103096	SAT TT=1.751 ASSIGNMENTS=66	SAT TT=3.364 ASSIGNMENTS=819	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=0.104 ASSIGNMENTS=2329 CHECKS=179214	SAT TT=0.104 ASSIGNMENTS=2329 CHECKS=179214	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=0.061 ASSIGNMENTS=1234 CHECKS=98205	SAT TT=0.506 ASSIGNMENTS=10783 CHECKS=972402	SAT TT=0.406	SAT TT=1.657 ASSIGNMENTS=22774 CHECKS=1672320	SAT TT=0.046 ASSIGNMENTS=593 CHECKS=56924	? (TO) TT=1802.16	SAT TT=12.266	SAT TT=54.304
csp/primes-10/ normalized-primes-10-40-2-7.xml	SAT TT=33.443	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=115.815 CHECKS=5173190	SAT TT=763.048 CHECKS=34974900	SAT TT=319.275 ASSIGNMENTS=127110	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=40.446 ASSIGNMENTS=158147 CHECKS=72472100	SAT TT=38.867 ASSIGNMENTS=158147 CHECKS=72472100	? (TO) TT=1800.07	? (TO) TT=1800	SAT TT=842.724 ASSIGNMENTS=3552770 CHECKS=1768760000	SAT TT=563.257 ASSIGNMENTS=2830140 CHECKS=1210090000	SAT TT=72.969	SAT TT=47.41 ASSIGNMENTS=131010 CHECKS=49656500	SAT TT=33.443 ASSIGNMENTS=158147 CHECKS=72472100	? TT=150.763	? (MO) TT=114.562	? (MO) TT=301.34
csp/primes-10/ normalized-primes-10-40-3-1.xml	SAT TT=0.022	SAT TT=1.772 CHECKS=2005960 NODES=100	SAT TT=1.724 CHECKS=2005960 NODES=0	SAT TT=0.042	SAT TT=0.41 CHECKS=74382	SAT TT=0.212 CHECKS=85477	SAT TT=0.946 ASSIGNMENTS=33	SAT TT=0.969 ASSIGNMENTS=33	SAT TT=7.902 CHECKS=1673280 NODES=100	SAT TT=4.618 CHECKS=3454780 NODES=900005	SAT TT=3.523 CHECKS=1860540 NODES=3	SAT TT=0.033 ASSIGNMENTS=111 CHECKS=13839	SAT TT=0.03 ASSIGNMENTS=111 CHECKS=13839	SAT TT=10.82	SAT TT=10.457	SAT TT=0.022 ASSIGNMENTS=115 CHECKS=13960	SAT TT=0.316 ASSIGNMENTS=5463 CHECKS=539215	SAT TT=0.419	SAT TT=1.096 ASSIGNMENTS=16216 CHECKS=1120890	SAT TT=0.022 ASSIGNMENTS=113 CHECKS=13851	? TT=153.017	SAT TT=1.038	SAT TT=1.692
csp/primes-10/ normalized-primes-10-40-3-5.xml		? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=1338.5	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=207.878	? (MO) TT=78.56	? (MO) TT=287.83
csp/primes-10/ normalized-primes-10-60-2-7.xml	SAT TT=0.122	SAT TT=493.417 CHECKS=775250000 NODES=5699	SAT TT=57.725 CHECKS=103653000 NODES=1286	SAT TT=0.122	SAT TT=8.599 CHECKS=334066	SAT TT=5.472 CHECKS=221518	SAT TT=10.268 ASSIGNMENTS=2512	SAT TT=5.397 ASSIGNMENTS=30	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=130.59 ASSIGNMENTS=327787 CHECKS=259520000	SAT TT=128.256 ASSIGNMENTS=327787 CHECKS=259520000	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=15.694 ASSIGNMENTS=40637 CHECKS=33102200	SAT TT=2.589 ASSIGNMENTS=8468 CHECKS=5383740	SAT TT=0.64	SAT TT=50.278 ASSIGNMENTS=74191 CHECKS=62653000	SAT TT=122.707 ASSIGNMENTS=327787 CHECKS=259520000	? TT=153.487	? (MO) TT=88.81	? (MO) TT=296.502
csp/primes-10/ normalized-primes-10-60-3-5.xml	SAT TT=5.114	? (TO) TT=1800.08	? (TO) TT=1800.17	SAT TT=30.747	SAT TT=12.447 CHECKS=585172	SAT TT=5.114 CHECKS=236405	SAT TT=69.104 ASSIGNMENTS=19287	SAT TT=17.185 ASSIGNMENTS=2075	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=30.951 ASSIGNMENTS=60397 CHECKS=48981300	SAT TT=29.686 ASSIGNMENTS=60397 CHECKS=48981300	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=130.737 ASSIGNMENTS=331988 CHECKS=269430000	SAT TT=70.003 ASSIGNMENTS=153078 CHECKS=144142000	SAT TT=1.378	SAT TT=371.266 ASSIGNMENTS=236201 CHECKS=231564000	SAT TT=23.846 ASSIGNMENTS=60397 CHECKS=48981300	? (MO) TT=91.924	? (MO) TT=91.78	? (MO) TT=299.823
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-10/ normalized-primes-10-60-3-7.xml	SAT TT=39.879	? (TO) TT=1800.09	? (TO) TT=1800.18	SAT TT=39.879	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=1251.29	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=159.955	? TT=177.151	? TT=176.403
csp/primes-10/ normalized-primes-10-80-2-3.xml	SAT TT=0.022	SAT TT=1.093 CHECKS=303008 NODES=100	SAT TT=1.076 CHECKS=302110 NODES=0	SAT TT=0.056	SAT TT=0.607 CHECKS=463	SAT TT=0.022 CHECKS=425	SAT TT=1.008 ASSIGNMENTS=4	SAT TT=1.02 ASSIGNMENTS=4	SAT TT=104.127 CHECKS=16003400 NODES=100	SAT TT=43.66 CHECKS=16010400 NODES=0	SAT TT=40.844 CHECKS=16010400 NODES=0	SAT TT=0.033 ASSIGNMENTS=11 CHECKS=3914	SAT TT=0.035 ASSIGNMENTS=11 CHECKS=3914	SAT TT=191.251	SAT TT=187.716	SAT TT=0.023 ASSIGNMENTS=11 CHECKS=3912	SAT TT=0.024 ASSIGNMENTS=8 CHECKS=3784	SAT TT=0.592	SAT TT=0.022 ASSIGNMENTS=10 CHECKS=3892	SAT TT=0.022 ASSIGNMENTS=11 CHECKS=3914	? TT=839.813	SAT TT=1.023	SAT TT=1.052
csp/primes-10/ normalized-primes-10-80-3-7.xml	SAT TT=0.16	SAT TT=86.406 CHECKS=147938000 NODES=1190	SAT TT=72.313 CHECKS=134964000 NODES=1240	SAT TT=0.16	SAT TT=11.46 CHECKS=411761	SAT TT=6.827 CHECKS=269248	SAT TT=6.842 ASSIGNMENTS=48	SAT TT=22.164 ASSIGNMENTS=664	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=32.59 ASSIGNMENTS=42572 CHECKS=58246100	SAT TT=32.78 ASSIGNMENTS=42572 CHECKS=58246100	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=7.263 ASSIGNMENTS=7759 CHECKS=15188400	SAT TT=5.086 ASSIGNMENTS=6721 CHECKS=10624600	SAT TT=7.464	SAT TT=105.574 ASSIGNMENTS=97456 CHECKS=78422600	SAT TT=25.357 ASSIGNMENTS=42572 CHECKS=58246100	? TT=175.723	? TT=179.94	? TT=172.781
csp/primes-15/ normalized-primes-15-20-2-1.xml	SAT TT=0.012	SAT TT=1.044 CHECKS=625877 NODES=100	SAT TT=0.999 CHECKS=625878 NODES=0	SAT TT=0.032	SAT TT=0.085 CHECKS=11512	SAT TT=0.191 CHECKS=727194	SAT TT=0.964 ASSIGNMENTS=70	SAT TT=0.965 ASSIGNMENTS=70	SAT TT=1.133 CHECKS=351005 NODES=100	SAT TT=0.829 CHECKS=359460 NODES=3	SAT TT=0.833 CHECKS=359593 NODES=4	SAT TT=0.024 ASSIGNMENTS=124 CHECKS=1139	SAT TT=0.024 ASSIGNMENTS=124 CHECKS=1139	SAT TT=3.971	SAT TT=3.808	SAT TT=0.012 ASSIGNMENTS=131 CHECKS=1287	SAT TT=0.056 ASSIGNMENTS=9295 CHECKS=68768	SAT TT=0.35	SAT TT=0.122 ASSIGNMENTS=15713 CHECKS=116213	SAT TT=0.014 ASSIGNMENTS=124 CHECKS=1139	SAT TT=9.963	SAT TT=0.664	SAT TT=0.689
csp/primes-15/ normalized-primes-15-20-2-3.xml	SAT TT=0.016	SAT TT=4.054 CHECKS=6875710 NODES=208	SAT TT=3.515 CHECKS=5466530 NODES=0	SAT TT=0.039	SAT TT=0.298 CHECKS=9399	SAT TT=0.405 CHECKS=415121	SAT TT=1.843 ASSIGNMENTS=68	SAT TT=2.076 ASSIGNMENTS=68	SAT TT=254.936 CHECKS=522581000 NODES=109	? (TO) TT=1800.04	? (MO) TT=32.08	SAT TT=0.026 ASSIGNMENTS=457 CHECKS=10020	SAT TT=0.031 ASSIGNMENTS=457 CHECKS=10020	SAT TT=672.909	SAT TT=669.211	SAT TT=0.016 ASSIGNMENTS=484 CHECKS=10922	SAT TT=0.115 ASSIGNMENTS=9210 CHECKS=210742	SAT TT=0.386	SAT TT=0.189 ASSIGNMENTS=10828 CHECKS=292168	SAT TT=0.017 ASSIGNMENTS=459 CHECKS=15670	? TT=149.464	SAT TT=5.382	SAT TT=19.036
csp/primes-15/ normalized-primes-15-20-2-5.xml	SAT TT=0.029	? (TO) TT=1800.08	? (TO) TT=1800.13	SAT TT=0.039	SAT TT=1.315 CHECKS=461347	SAT TT=1.048 CHECKS=455362	SAT TT=2.442 ASSIGNMENTS=68	SAT TT=3.189 ASSIGNMENTS=63	? (TO) TT=1800.1	? (MO) TT=37.01	? (TO) TT=1800.08	SAT TT=0.034 ASSIGNMENTS=395 CHECKS=27209	SAT TT=0.036 ASSIGNMENTS=395 CHECKS=27209	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=0.031 ASSIGNMENTS=215 CHECKS=50660	SAT TT=0.179 ASSIGNMENTS=7414 CHECKS=370628	SAT TT=0.363	SAT TT=0.432 ASSIGNMENTS=17500 CHECKS=785998	SAT TT=0.029 ASSIGNMENTS=628 CHECKS=40274	? TT=484.085	? (MO) TT=64.918	? (MO) TT=256.178
csp/primes-15/ normalized-primes-15-20-2-7.xml	SAT TT=0.016	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=0.045	SAT TT=0.471 CHECKS=2162	SAT TT=0.153 CHECKS=14846	SAT TT=3.504 ASSIGNMENTS=67	SAT TT=4.565 ASSIGNMENTS=403	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=0.026 ASSIGNMENTS=179 CHECKS=11240	SAT TT=0.027 ASSIGNMENTS=179 CHECKS=11240	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=0.017 ASSIGNMENTS=177 CHECKS=11598	SAT TT=0.312 ASSIGNMENTS=8319 CHECKS=734406	SAT TT=0.397	SAT TT=0.396 ASSIGNMENTS=11581 CHECKS=946619	SAT TT=0.016 ASSIGNMENTS=185 CHECKS=9088	? TT=153.795	? TT=172.008	? TT=177.897
csp/primes-15/ normalized-primes-15-20-3-3.xml	SAT TT=0.014	SAT TT=1058.63 CHECKS=2002010000 NODES=19894	SAT TT=1112.38 CHECKS=2082310000 NODES=19952	SAT TT=0.041	SAT TT=0.346 CHECKS=6410	SAT TT=0.052 CHECKS=13140	SAT TT=3.165 ASSIGNMENTS=1400	SAT TT=4.201 ASSIGNMENTS=153	? (MO) TT=40.81	? (MO) TT=39.08	? (TO) TT=1800.07	SAT TT=0.027 ASSIGNMENTS=226 CHECKS=8194	SAT TT=0.026 ASSIGNMENTS=226 CHECKS=8194	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=0.016 ASSIGNMENTS=213 CHECKS=7952	SAT TT=0.19 ASSIGNMENTS=8621 CHECKS=388027	SAT TT=0.387	SAT TT=0.549 ASSIGNMENTS=13837 CHECKS=1105280	SAT TT=0.014 ASSIGNMENTS=226 CHECKS=8194	? (MO) TT=80.643	SAT TT=11.798	SAT TT=50.674
csp/primes-15/ normalized-primes-15-20-3-5.xml	SAT TT=0.012	SAT TT=44.969 CHECKS=84104800 NODES=1029	SAT TT=17.091 CHECKS=29812400 NODES=332	SAT TT=0.039	SAT TT=0.499 CHECKS=5503	SAT TT=0.988 CHECKS=308849	SAT TT=3.076 ASSIGNMENTS=65	SAT TT=4.459 ASSIGNMENTS=418	? (MO) TT=31	? (MO) TT=31.21	? (TO) TT=1800.01	SAT TT=0.024 ASSIGNMENTS=209 CHECKS=5780	SAT TT=0.028 ASSIGNMENTS=209 CHECKS=5780	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=0.014 ASSIGNMENTS=212 CHECKS=5862	SAT TT=0.154 ASSIGNMENTS=8357 CHECKS=346753	SAT TT=0.433	SAT TT=0.222 ASSIGNMENTS=10238 CHECKS=392054	SAT TT=0.012 ASSIGNMENTS=228 CHECKS=6277	? TT=148.497	? TT=171.401	? TT=163.689
csp/primes-15/ normalized-primes-15-40-2-1.xml	SAT TT=0.015	SAT TT=1.016 CHECKS=453007 NODES=100	SAT TT=1.033 CHECKS=453007 NODES=0	SAT TT=0.038	SAT TT=0.201 CHECKS=33733	SAT TT=0.071 CHECKS=183793	SAT TT=0.983 ASSIGNMENTS=40	SAT TT=1.186 ASSIGNMENTS=40	SAT TT=1.843 CHECKS=433837 NODES=100	SAT TT=1.244 CHECKS=438773 NODES=3	SAT TT=1.18 CHECKS=438782 NODES=2	SAT TT=0.026 ASSIGNMENTS=81 CHECKS=1797	SAT TT=0.027 ASSIGNMENTS=81 CHECKS=1797	SAT TT=4.941	SAT TT=5.016	SAT TT=0.015 ASSIGNMENTS=81 CHECKS=1798	SAT TT=0.028 ASSIGNMENTS=1611 CHECKS=20491	SAT TT=0.387	SAT TT=0.042 ASSIGNMENTS=3392 CHECKS=27539	SAT TT=0.016 ASSIGNMENTS=82 CHECKS=1797	SAT TT=17.683	SAT TT=0.722	SAT TT=0.739
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-15/ normalized-primes-15-40-2-7.xml	SAT TT=1443.63	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.01	? (MO) TT=36.87	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=1443.63 ASSIGNMENTS=11022500 CHECKS=3704260000	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=150.714	? TT=168.574	? TT=170.652
csp/primes-15/ normalized-primes-15-40-3-1.xml	SAT TT=0.027	SAT TT=2.708 CHECKS=4512560 NODES=176	SAT TT=1.45 CHECKS=1283470 NODES=0	SAT TT=0.041	SAT TT=0.455 CHECKS=1963	SAT TT=0.126 CHECKS=139933	SAT TT=0.925 ASSIGNMENTS=32	SAT TT=0.928 ASSIGNMENTS=32	SAT TT=50.607 CHECKS=18566900 NODES=100	SAT TT=18.439 CHECKS=19420900 NODES=2250010	SAT TT=15.754 CHECKS=18777000 NODES=3	SAT TT=0.042 ASSIGNMENTS=735 CHECKS=30517	SAT TT=0.042 ASSIGNMENTS=735 CHECKS=30517	SAT TT=45.823	SAT TT=45.152	SAT TT=0.027 ASSIGNMENTS=612 CHECKS=28673	SAT TT=0.171 ASSIGNMENTS=5469 CHECKS=330249	SAT TT=0.426	SAT TT=0.192 ASSIGNMENTS=14231 CHECKS=327165	SAT TT=0.028 ASSIGNMENTS=451 CHECKS=33181	? (MO) TT=70.332	SAT TT=1	SAT TT=1.452
csp/primes-15/ normalized-primes-15-40-3-5.xml		? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.05	? (MO) TT=21.21	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (MO) TT=94.112	? TT=164.007	? TT=160.96
csp/primes-15/ normalized-primes-15-40-3-7.xml		? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.05	? TT=156.947	? TT=171.199	? TT=171.363
csp/primes-15/ normalized-primes-15-60-2-7.xml	SAT TT=0.084	SAT TT=11.562 CHECKS=20201800 NODES=995	SAT TT=14.885 CHECKS=24754700 NODES=975	SAT TT=0.084	SAT TT=2.331 CHECKS=47350	SAT TT=2.153 CHECKS=82703	SAT TT=1.579 ASSIGNMENTS=4	SAT TT=1.602 ASSIGNMENTS=4	? (MO) TT=34.32	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.171 ASSIGNMENTS=2582 CHECKS=2852640	SAT TT=1.165 ASSIGNMENTS=2582 CHECKS=2852640	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=9.156 ASSIGNMENTS=16738 CHECKS=23001700	SAT TT=38.774 ASSIGNMENTS=91439 CHECKS=97877200	SAT TT=0.595	SAT TT=3.579 ASSIGNMENTS=14758 CHECKS=8664370	SAT TT=1.442 ASSIGNMENTS=3648 CHECKS=3569320	? (MO) TT=70.793	? TT=175.619	? TT=176.447
csp/primes-15/ normalized-primes-15-80-2-1.xml	SAT TT=0.02	SAT TT=0.977 CHECKS=153841 NODES=100	SAT TT=0.966 CHECKS=153841 NODES=0	SAT TT=0.047	SAT TT=0.371 CHECKS=584	SAT TT=0.02 CHECKS=541	SAT TT=1.027 ASSIGNMENTS=10	SAT TT=1.034 ASSIGNMENTS=10	SAT TT=2.76 CHECKS=122263 NODES=100	SAT TT=1.619 CHECKS=123343 NODES=0	SAT TT=1.621 CHECKS=123343 NODES=0	SAT TT=0.03 ASSIGNMENTS=42 CHECKS=1496	SAT TT=0.034 ASSIGNMENTS=42 CHECKS=1496	SAT TT=6.815	SAT TT=6.378	SAT TT=0.022 ASSIGNMENTS=42 CHECKS=1496	SAT TT=0.027 ASSIGNMENTS=1052 CHECKS=10340	SAT TT=0.457	SAT TT=0.024 ASSIGNMENTS=970 CHECKS=2723	SAT TT=0.021 ASSIGNMENTS=42 CHECKS=1496	SAT TT=17.438	SAT TT=0.812	SAT TT=0.821
csp/primes-15/ normalized-primes-15-80-2-3.xml	SAT TT=0.022	SAT TT=1.652 CHECKS=720329 NODES=100	SAT TT=1.586 CHECKS=737764 NODES=0	SAT TT=0.057	SAT TT=0.878 CHECKS=435	SAT TT=0.023 CHECKS=396	SAT TT=0.98 ASSIGNMENTS=4	SAT TT=0.975 ASSIGNMENTS=4	? (MO) TT=121.73	? (MO) TT=32.38	? (MO) TT=464.26	SAT TT=0.038 ASSIGNMENTS=4 CHECKS=3864	SAT TT=0.036 ASSIGNMENTS=4 CHECKS=3864	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.026 ASSIGNMENTS=4 CHECKS=3864	SAT TT=0.024 ASSIGNMENTS=4 CHECKS=3863	SAT TT=0.516	SAT TT=0.025 ASSIGNMENTS=4 CHECKS=3864	SAT TT=0.022 ASSIGNMENTS=4 CHECKS=3864	? TT=426.146	SAT TT=1.057	SAT TT=1.079
csp/primes-15/ normalized-primes-15-80-3-1.xml	SAT TT=0.025	SAT TT=1.299 CHECKS=872531 NODES=100	SAT TT=1.303 CHECKS=686150 NODES=0	SAT TT=0.057	SAT TT=0.974 CHECKS=5101	SAT TT=0.027 CHECKS=2726	SAT TT=1.023 ASSIGNMENTS=9	SAT TT=0.894 ASSIGNMENTS=9	SAT TT=84.377 CHECKS=8708400 NODES=100	SAT TT=24.955 CHECKS=9043240 NODES=0	SAT TT=24.737 CHECKS=9043240 NODES=0	SAT TT=0.034 ASSIGNMENTS=61 CHECKS=8807	SAT TT=0.036 ASSIGNMENTS=61 CHECKS=8807	SAT TT=96.082	SAT TT=93.246	SAT TT=0.025 ASSIGNMENTS=58 CHECKS=8774	SAT TT=0.028 ASSIGNMENTS=1028 CHECKS=18497	SAT TT=0.538	SAT TT=0.029 ASSIGNMENTS=1303 CHECKS=10591	SAT TT=0.029 ASSIGNMENTS=61 CHECKS=8807	? (MO) TT=52.823	SAT TT=1.038	SAT TT=1.244
csp/primes-15/ normalized-primes-15-80-3-5.xml	SAT TT=0.686	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=0.686	SAT TT=17.571 CHECKS=752519	SAT TT=11.804 CHECKS=603646	SAT TT=12.083 ASSIGNMENTS=207	SAT TT=21.58 ASSIGNMENTS=701	? (MO) TT=74.55	? (TO) TT=1800.09	? (MO) TT=342.04	SAT TT=92.115 ASSIGNMENTS=119813 CHECKS=227104000	SAT TT=100.176 ASSIGNMENTS=119813 CHECKS=227104000	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=28.595 ASSIGNMENTS=42536 CHECKS=70575200	SAT TT=6.554 ASSIGNMENTS=8435 CHECKS=16202100	SAT TT=1.177	SAT TT=22.438 ASSIGNMENTS=41520 CHECKS=54005800	SAT TT=89.871 ASSIGNMENTS=119813 CHECKS=227104000	? (MO) TT=91.761	? TT=173.009	? TT=167.993
csp/primes-20/ normalized-primes-20-20-2-3.xml	SAT TT=0.011	SAT TT=18.757 CHECKS=34619800 NODES=242	SAT TT=20.774 CHECKS=40845700 NODES=203	SAT TT=0.041	SAT TT=0.383 CHECKS=5637	SAT TT=1.385 CHECKS=705219	SAT TT=4.089 ASSIGNMENTS=71	SAT TT=4.032 ASSIGNMENTS=71	SAT TT=1027.31 CHECKS=4569250000 NODES=102	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.023 ASSIGNMENTS=215 CHECKS=5379	SAT TT=0.024 ASSIGNMENTS=215 CHECKS=5379	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=0.013 ASSIGNMENTS=204 CHECKS=5269	SAT TT=0.141 ASSIGNMENTS=8448 CHECKS=344251	SAT TT=0.407	SAT TT=0.015 ASSIGNMENTS=514 CHECKS=6741	SAT TT=0.011 ASSIGNMENTS=215 CHECKS=5379	? TT=153.189	SAT TT=9.602	SAT TT=44.141
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-20/ normalized-primes-20-20-2-7.xml	SAT TT=0.045	? (TO) TT=1800.18	? (TO) TT=1800.1	SAT TT=0.045	SAT TT=0.754 CHECKS=3566	SAT TT=0.123 CHECKS=6495	SAT TT=8.714 ASSIGNMENTS=1980	SAT TT=14.392 ASSIGNMENTS=2190	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.05 ASSIGNMENTS=378 CHECKS=69901	SAT TT=0.05 ASSIGNMENTS=378 CHECKS=69901	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=0.047 ASSIGNMENTS=794 CHECKS=105620	SAT TT=0.326 ASSIGNMENTS=8992 CHECKS=869312	SAT TT=0.418	SAT TT=0.053 ASSIGNMENTS=1107 CHECKS=113350	SAT TT=0.057 ASSIGNMENTS=550 CHECKS=136267	? (MO) TT=78.201	? TT=197.599	? TT=195.926
csp/primes-20/ normalized-primes-20-20-3-5.xml	SAT TT=0.016	SAT TT=444.546 CHECKS=659615000 NODES=2076	SAT TT=414.36 CHECKS=666945000 NODES=2088	SAT TT=0.047	SAT TT=0.587 CHECKS=3626	SAT TT=0.451 CHECKS=123394	SAT TT=6.927 ASSIGNMENTS=62	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.029 ASSIGNMENTS=322 CHECKS=15105	SAT TT=0.028 ASSIGNMENTS=322 CHECKS=15105	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=0.016 ASSIGNMENTS=323 CHECKS=15398	SAT TT=0.219 ASSIGNMENTS=8387 CHECKS=553031	SAT TT=0.691	SAT TT=0.026 ASSIGNMENTS=730 CHECKS=39851	SAT TT=0.02 ASSIGNMENTS=635 CHECKS=30686	? (MO) TT=78.021	? TT=225.07	? TT=219.979
csp/primes-20/ normalized-primes-20-40-2-3.xml	SAT TT=0.084	SAT TT=5.56 CHECKS=9644510 NODES=267	SAT TT=5.59 CHECKS=10123300 NODES=194	SAT TT=0.084	SAT TT=4.767 CHECKS=426225	SAT TT=1.857 CHECKS=192701	SAT TT=5.355 ASSIGNMENTS=240	SAT TT=5.822 ASSIGNMENTS=240	SAT TT=552.96 CHECKS=1956630000 NODES=102	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.416 ASSIGNMENTS=11794 CHECKS=1084850	SAT TT=0.419 ASSIGNMENTS=11794 CHECKS=1084850	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=1.391 ASSIGNMENTS=32239 CHECKS=3634010	SAT TT=0.288 ASSIGNMENTS=8340 CHECKS=783517	SAT TT=0.419	SAT TT=0.308 ASSIGNMENTS=5407 CHECKS=804030	SAT TT=0.4 ASSIGNMENTS=7466 CHECKS=1035040	? TT=479.395	SAT TT=11.651	SAT TT=40.428
csp/primes-20/ normalized-primes-20-40-3-7.xml		? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (MO) TT=99.079	? TT=180.653	? TT=178.447
csp/primes-20/ normalized-primes-20-60-2-1.xml	SAT TT=0.014	SAT TT=1.179 CHECKS=760011 NODES=100	SAT TT=1.253 CHECKS=760010 NODES=0	SAT TT=0.044	SAT TT=0.474 CHECKS=12045	SAT TT=0.045 CHECKS=76054	SAT TT=1.276 ASSIGNMENTS=22	SAT TT=1.205 ASSIGNMENTS=22	SAT TT=6.557 CHECKS=569187 NODES=100	SAT TT=2.81 CHECKS=574695 NODES=2	SAT TT=3.147 CHECKS=574688 NODES=0	SAT TT=0.028 ASSIGNMENTS=86 CHECKS=4665	SAT TT=0.024 ASSIGNMENTS=86 CHECKS=4665	SAT TT=10.585	SAT TT=11.087	SAT TT=0.017 ASSIGNMENTS=86 CHECKS=4665	SAT TT=0.041 ASSIGNMENTS=2704 CHECKS=64570	SAT TT=0.414	SAT TT=0.017 ASSIGNMENTS=177 CHECKS=4847	SAT TT=0.014 ASSIGNMENTS=85 CHECKS=4594	SAT TT=37.177	SAT TT=0.819	SAT TT=0.85
csp/primes-20/ normalized-primes-20-60-2-3.xml	SAT TT=0.026	SAT TT=2.444 CHECKS=3620830 NODES=100	SAT TT=2.196 CHECKS=3494320 NODES=0	SAT TT=0.046	SAT TT=1.289 CHECKS=21236	SAT TT=0.037 CHECKS=17025	SAT TT=1.265 ASSIGNMENTS=12	SAT TT=1.194 ASSIGNMENTS=12	SAT TT=387.381 CHECKS=1121670000 NODES=100	SAT TT=307.261 CHECKS=1121670000 NODES=0	SAT TT=305.714 CHECKS=1121670000 NODES=2	SAT TT=0.037 ASSIGNMENTS=150 CHECKS=26468	SAT TT=0.035 ASSIGNMENTS=150 CHECKS=26468	? (TO) TT=1800	? (TO) TT=1800.01	SAT TT=0.026 ASSIGNMENTS=143 CHECKS=24672	SAT TT=0.371 ASSIGNMENTS=4099 CHECKS=918767	SAT TT=0.485	SAT TT=0.031 ASSIGNMENTS=191 CHECKS=37531	SAT TT=0.026 ASSIGNMENTS=150 CHECKS=26464	? TT=225.439	SAT TT=1.088	SAT TT=1.133
csp/primes-20/ normalized-primes-20-60-3-3.xml	SAT TT=0.065	SAT TT=49.886 CHECKS=103204000 NODES=509	SAT TT=54.667 CHECKS=114149000 NODES=433	SAT TT=0.065	SAT TT=10.812 CHECKS=661914	SAT TT=3.993 CHECKS=248777	SAT TT=11.817 ASSIGNMENTS=145	SAT TT=40.515 ASSIGNMENTS=15261	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=0.546 ASSIGNMENTS=2670 CHECKS=1358080	SAT TT=0.538 ASSIGNMENTS=2670 CHECKS=1358080	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=94.669 ASSIGNMENTS=332305 CHECKS=269388000	SAT TT=1.683 ASSIGNMENTS=7315 CHECKS=4726500	SAT TT=0.712	SAT TT=1.03 ASSIGNMENTS=2640 CHECKS=2851710	SAT TT=0.841 ASSIGNMENTS=3791 CHECKS=2212590	? (MO) TT=119.9	? (MO) TT=63.141	? (MO) TT=258.92
csp/primes-20/ normalized-primes-20-60-3-5.xml		? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=913.24	? (TO) TT=1800.08	? (TO) TT=1800.04	? (MO) TT=63.267	? TT=178.063	? TT=177.981
csp/primes-20/ normalized-primes-20-60-3-7.xml		? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.22	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (MO) TT=92.647	? TT=197.788	? TT=199.588
csp/primes-20/ normalized-primes-20-80-2-1.xml	SAT TT=0.018	SAT TT=1.296 CHECKS=761651 NODES=100	SAT TT=1.223 CHECKS=761650 NODES=0	SAT TT=0.045	SAT TT=0.596 CHECKS=502	SAT TT=0.02 CHECKS=4832	SAT TT=1.157 ASSIGNMENTS=11	SAT TT=1.245 ASSIGNMENTS=11	SAT TT=7.532 CHECKS=564964 NODES=100	SAT TT=3.45 CHECKS=570531 NODES=1	SAT TT=3.427 CHECKS=570616 NODES=1	SAT TT=0.025 ASSIGNMENTS=17 CHECKS=3945	SAT TT=0.03 ASSIGNMENTS=17 CHECKS=3945	SAT TT=13.099	SAT TT=11.827	SAT TT=0.019 ASSIGNMENTS=17 CHECKS=3945	SAT TT=0.019 ASSIGNMENTS=22 CHECKS=4023	SAT TT=0.447	SAT TT=0.02 ASSIGNMENTS=17 CHECKS=3907	SAT TT=0.018 ASSIGNMENTS=17 CHECKS=3945	SAT TT=38.958	SAT TT=0.903	SAT TT=0.899
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-20/ normalized-primes-20-80-2-7.xml	SAT TT=0.061	SAT TT=2.608 CHECKS=2280940 NODES=102	? (MO) TT=1.094	SAT TT=0.064	SAT TT=2.616 CHECKS=1993	SAT TT=0.061 CHECKS=1974	SAT TT=1.065 ASSIGNMENTS=1	SAT TT=1.059 ASSIGNMENTS=1	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=0.14 ASSIGNMENTS=86 CHECKS=291675	SAT TT=0.132 ASSIGNMENTS=86 CHECKS=291675	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.121 ASSIGNMENTS=87 CHECKS=290766	SAT TT=2.476 ASSIGNMENTS=4052 CHECKS=7132430	SAT TT=0.566	SAT TT=0.091 ASSIGNMENTS=94 CHECKS=203043	SAT TT=0.121 ASSIGNMENTS=86 CHECKS=291675	? TT=338.589	SAT TT=1.233	SAT TT=1.303
csp/primes-20/ normalized-primes-20-80-3-1.xml	SAT TT=0.026	SAT TT=2.083 CHECKS=2648340 NODES=100	SAT TT=1.626 CHECKS=2002620 NODES=0	SAT TT=0.056	SAT TT=1.189 CHECKS=9015	SAT TT=0.035 CHECKS=9128	SAT TT=1.124 ASSIGNMENTS=10	SAT TT=0.967 ASSIGNMENTS=10	SAT TT=139.976 CHECKS=78008800 NODES=100	SAT TT=136.031 CHECKS=90420600 NODES=1	SAT TT=133.582 CHECKS=90420700 NODES=1	SAT TT=0.039 ASSIGNMENTS=41 CHECKS=19826	SAT TT=0.036 ASSIGNMENTS=41 CHECKS=19826	SAT TT=459.678	SAT TT=448.309	SAT TT=0.028 ASSIGNMENTS=41 CHECKS=19821	SAT TT=0.162 ASSIGNMENTS=1055 CHECKS=350031	SAT TT=0.534	SAT TT=0.036 ASSIGNMENTS=109 CHECKS=37635	SAT TT=0.026 ASSIGNMENTS=41 CHECKS=19826	? TT=154.84	SAT TT=1.145	SAT TT=1.267
csp/primes-20/ normalized-primes-20-80-3-5.xml	SAT TT=91.117	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=114.798	SAT TT=1580.7 CHECKS=81040900	SAT TT=1534.1 CHECKS=74172400	SAT TT=330.626 ASSIGNMENTS=15523	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=179.823 ASSIGNMENTS=186794 CHECKS=502918000	SAT TT=189.874 ASSIGNMENTS=186794 CHECKS=502918000	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=91.117 ASSIGNMENTS=104594 CHECKS=272473000	SAT TT=203.622	SAT TT=276.054 ASSIGNMENTS=178349 CHECKS=814585000	SAT TT=183.603 ASSIGNMENTS=186794 CHECKS=502918000	? TT=224.842	? TT=298.295	? TT=298.739
csp/primes-20/ normalized-primes-20-80-3-7.xml	SAT TT=11.866	SAT TT=923.091 CHECKS=1739830000 NODES=11857	SAT TT=911.841 CHECKS=1692960000 NODES=11937	SAT TT=14.554	SAT TT=11.866 CHECKS=332766	SAT TT=13.841 CHECKS=535867	SAT TT=10.107 ASSIGNMENTS=1	SAT TT=16.097 ASSIGNMENTS=1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=82.161 ASSIGNMENTS=93844 CHECKS=212771000	SAT TT=82.772 ASSIGNMENTS=93844 CHECKS=212771000	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=80.136 ASSIGNMENTS=85219 CHECKS=222324000	SAT TT=1.156	? (TO) TT=1800.02	SAT TT=76.13 ASSIGNMENTS=93844 CHECKS=212771000	? (MO) TT=108.635	? TT=195.215	? TT=185.447
csp/primes-25/ normalized-primes-25-20-2-7.xml	SAT TT=0.017	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=0.046	SAT TT=0.705 CHECKS=2746	SAT TT=4.022 CHECKS=412244	SAT TT=12.93 ASSIGNMENTS=65	SAT TT=33.737 ASSIGNMENTS=18751	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=0.028 ASSIGNMENTS=419 CHECKS=16634	SAT TT=0.031 ASSIGNMENTS=419 CHECKS=16634	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=0.017 ASSIGNMENTS=294 CHECKS=14856	SAT TT=0.348 ASSIGNMENTS=9223 CHECKS=1043960	SAT TT=0.4	SAT TT=0.028 ASSIGNMENTS=799 CHECKS=39635	SAT TT=0.018 ASSIGNMENTS=343 CHECKS=15285	? (MO) TT=64.084	? TT=180.352	? TT=172.936
csp/primes-25/ normalized-primes-25-20-3-1.xml	SAT TT=0.028	SAT TT=38.741 CHECKS=90727300 NODES=217	SAT TT=43.712 CHECKS=103087000 NODES=0	SAT TT=0.036	SAT TT=0.471 CHECKS=11533	SAT TT=3.552 CHECKS=1575720	SAT TT=18.081 ASSIGNMENTS=586	SAT TT=15.635 ASSIGNMENTS=586	SAT TT=256.803 CHECKS=977269000 NODES=100	SAT TT=213.361 CHECKS=986536000 NODES=300000	SAT TT=205.985 CHECKS=1013240000 NODES=1333	SAT TT=0.041 ASSIGNMENTS=329 CHECKS=61249	SAT TT=0.042 ASSIGNMENTS=329 CHECKS=61249	SAT TT=425.732	SAT TT=440.835	SAT TT=0.03 ASSIGNMENTS=322 CHECKS=64288	SAT TT=0.204 ASSIGNMENTS=8076 CHECKS=538835	SAT TT=0.394	SAT TT=0.028 ASSIGNMENTS=669 CHECKS=49310	SAT TT=0.028 ASSIGNMENTS=329 CHECKS=61249	? (MO) TT=113.729	SAT TT=5.2	SAT TT=13.14
csp/primes-25/ normalized-primes-25-20-3-3.xml	SAT TT=0.013	SAT TT=10.806 CHECKS=19666500 NODES=106	SAT TT=47.058 CHECKS=93495400 NODES=189	SAT TT=0.04	SAT TT=0.497 CHECKS=6005	SAT TT=0.047 CHECKS=6574	SAT TT=9.245 ASSIGNMENTS=67	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.03 ASSIGNMENTS=876 CHECKS=21278	SAT TT=0.03 ASSIGNMENTS=876 CHECKS=21278	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=0.02 ASSIGNMENTS=846 CHECKS=20959	SAT TT=0.172 ASSIGNMENTS=8617 CHECKS=431837	SAT TT=0.42	SAT TT=0.023 ASSIGNMENTS=838 CHECKS=25826	SAT TT=0.013 ASSIGNMENTS=272 CHECKS=7649	? (MO) TT=88.536	? (MO) TT=72.5	? (MO) TT=271.997
csp/primes-25/ normalized-primes-25-20-3-7.xml	SAT TT=0.031	? (TO) TT=1800.15	? (TO) TT=1800.11	SAT TT=0.051	SAT TT=1.375 CHECKS=25469	SAT TT=2.237 CHECKS=276702	SAT TT=14.599 ASSIGNMENTS=727	SAT TT=21.018 ASSIGNMENTS=407	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=0.043 ASSIGNMENTS=906 CHECKS=54594	SAT TT=0.046 ASSIGNMENTS=906 CHECKS=54594	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=0.031 ASSIGNMENTS=901 CHECKS=55084	SAT TT=0.495 ASSIGNMENTS=12073 CHECKS=1393870	SAT TT=0.427	SAT TT=0.202 ASSIGNMENTS=1931 CHECKS=557057	SAT TT=0.057 ASSIGNMENTS=1018 CHECKS=134418	? TT=481.549	? TT=180.924	? TT=176.414
csp/primes-25/ normalized-primes-25-40-2-7.xml	SAT TT=15.341	? (TO) TT=1800.15	? (TO) TT=1800.13	SAT TT=31.287	? (TO) TT=1800.02	SAT TT=124.228 CHECKS=5432470	SAT TT=733.489 ASSIGNMENTS=78199	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=23.12 ASSIGNMENTS=105150 CHECKS=45655600	SAT TT=22.893 ASSIGNMENTS=105150 CHECKS=45655600	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=21.808 ASSIGNMENTS=161853 CHECKS=64860500	? (TO) TT=1800.07	SAT TT=77.737	SAT TT=279.999 ASSIGNMENTS=1235820 CHECKS=870201000	SAT TT=15.341 ASSIGNMENTS=105150 CHECKS=45655600	? (MO) TT=129.777	? TT=195.327	? TT=200.303
csp/primes-25/ normalized-primes-25-40-3-3.xml	SAT TT=719.109	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=730.806 CHECKS=54069600	? (TO) TT=1800.09	SAT TT=719.109 ASSIGNMENTS=147256	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=576.847	? (TO) TT=1800.09	? (TO) TT=1800.08	? (MO) TT=65.73	? (MO) TT=92.61	? (MO) TT=269.473
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-25/ normalized-primes-25-40-3-5.xml		? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=525.342	? TT=177.195	? TT=186.267
csp/primes-25/ normalized-primes-25-40-3-7.xml		? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	? (MO) TT=93.638	? TT=195.065	? TT=193.933
csp/primes-25/ normalized-primes-25-60-2-3.xml	SAT TT=0.028	SAT TT=4.821 CHECKS=9112160 NODES=100	SAT TT=4.278 CHECKS=8330110 NODES=0	SAT TT=0.051	SAT TT=1.251 CHECKS=21336	SAT TT=0.05 CHECKS=24184	SAT TT=1.542 ASSIGNMENTS=14	SAT TT=1.397 ASSIGNMENTS=14	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.043 ASSIGNMENTS=158 CHECKS=39732	SAT TT=0.044 ASSIGNMENTS=158 CHECKS=39732	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=0.034 ASSIGNMENTS=158 CHECKS=39751	SAT TT=0.555 ASSIGNMENTS=4545 CHECKS=1495110	SAT TT=0.469	SAT TT=0.028 ASSIGNMENTS=161 CHECKS=34862	SAT TT=0.033 ASSIGNMENTS=148 CHECKS=39262	? TT=706.195	SAT TT=1.177	SAT TT=1.966
csp/primes-25/ normalized-primes-25-60-2-7.xml	SAT TT=2.076	SAT TT=254.464 CHECKS=461773000 NODES=1874	SAT TT=267.483 CHECKS=457298000 NODES=1907	? (TO) TT=1800.03	SAT TT=18.173 CHECKS=644936	SAT TT=7.699 CHECKS=328053	SAT TT=26.452 ASSIGNMENTS=196	SAT TT=100.449 ASSIGNMENTS=4955	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=9.799 ASSIGNMENTS=9957 CHECKS=5897070	SAT TT=9.186 ASSIGNMENTS=9957 CHECKS=5897070	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=628.385 ASSIGNMENTS=1947700 CHECKS=1808710000	SAT TT=92.648 ASSIGNMENTS=346297 CHECKS=266206000	SAT TT=0.785	? (TO) TT=1800.11	SAT TT=2.076 ASSIGNMENTS=9957 CHECKS=5897070	? TT=163.571	? TT=225.154	? TT=220.838
csp/primes-25/ normalized-primes-25-60-3-3.xml	SAT TT=0.243	SAT TT=34.036 CHECKS=71149200 NODES=245	SAT TT=181.798 CHECKS=387635000 NODES=1019	SAT TT=0.243	SAT TT=23.351 CHECKS=1428150	SAT TT=52.088 CHECKS=3235850	SAT TT=17.806 ASSIGNMENTS=11	SAT TT=64.297 ASSIGNMENTS=1435	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=828.83 ASSIGNMENTS=1862700 CHECKS=2181150000	SAT TT=781.47 ASSIGNMENTS=1862700 CHECKS=2181150000	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=47.216 ASSIGNMENTS=136977 CHECKS=126786000	SAT TT=43.753 ASSIGNMENTS=84714 CHECKS=117293000	SAT TT=0.628	SAT TT=244.959 ASSIGNMENTS=510823 CHECKS=705319000	SAT TT=756.398 ASSIGNMENTS=1862700 CHECKS=2181150000	? TT=114.406	? (MO) TT=143.56	? (MO) TT=320.08
csp/primes-25/ normalized-primes-25-80-2-5.xml	SAT TT=0.055	SAT TT=3.926 CHECKS=6177420 NODES=108	SAT TT=3.323 CHECKS=5864340 NODES=0	SAT TT=0.064	SAT TT=1.874 CHECKS=1992	SAT TT=0.056 CHECKS=1971	SAT TT=1.166 ASSIGNMENTS=3	SAT TT=1.251 ASSIGNMENTS=3	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.069 ASSIGNMENTS=30 CHECKS=90524	SAT TT=0.071 ASSIGNMENTS=30 CHECKS=90524	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=0.058 ASSIGNMENTS=26 CHECKS=90497	SAT TT=1.351 ASSIGNMENTS=3821 CHECKS=3588220	SAT TT=0.677	SAT TT=0.056 ASSIGNMENTS=45 CHECKS=90257	SAT TT=0.055 ASSIGNMENTS=26 CHECKS=90498	? TT=394.8	SAT TT=1.294	SAT TT=1.155
csp/primes-25/ normalized-primes-25-80-3-1.xml	SAT TT=0.029	SAT TT=3.633 CHECKS=6661920 NODES=100	SAT TT=2.976 CHECKS=5340230 NODES=0	SAT TT=0.057	SAT TT=1.663 CHECKS=14399	SAT TT=0.038 CHECKS=14614	SAT TT=1.541 ASSIGNMENTS=10	SAT TT=1.352 ASSIGNMENTS=10	SAT TT=134.991 CHECKS=342219000 NODES=100	SAT TT=75.785 CHECKS=342220000 NODES=0	SAT TT=81.917 CHECKS=342220000 NODES=0	SAT TT=0.04 ASSIGNMENTS=37 CHECKS=26636	SAT TT=0.044 ASSIGNMENTS=37 CHECKS=26636	SAT TT=1428.05	SAT TT=1470.51	SAT TT=0.032 ASSIGNMENTS=40 CHECKS=27958	SAT TT=0.202 ASSIGNMENTS=673 CHECKS=465261	SAT TT=0.473	SAT TT=0.033 ASSIGNMENTS=72 CHECKS=32763	SAT TT=0.029 ASSIGNMENTS=39 CHECKS=33024	? TT=157.489	SAT TT=1.426	SAT TT=1.637
csp/primes-25/ normalized-primes-25-80-3-3.xml	SAT TT=0.067	SAT TT=7.36 CHECKS=13996200 NODES=154	SAT TT=5.658 CHECKS=10623600 NODES=0	SAT TT=0.067	SAT TT=3.213 CHECKS=70665	SAT TT=5.024 CHECKS=306000	SAT TT=1.338 ASSIGNMENTS=2	SAT TT=1.385 ASSIGNMENTS=2	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1.327 ASSIGNMENTS=1118 CHECKS=3451170	SAT TT=1.339 ASSIGNMENTS=1118 CHECKS=3451170	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=2.186 ASSIGNMENTS=1812 CHECKS=5750010	SAT TT=4.875 ASSIGNMENTS=5756 CHECKS=13654300	SAT TT=0.734	SAT TT=10.66 ASSIGNMENTS=8665 CHECKS=28272700	SAT TT=5.254 ASSIGNMENTS=4382 CHECKS=14034300	? TT=161.145	? (MO) TT=171.286	? (MO) TT=351.191
csp/primes-25/ normalized-primes-25-80-3-7.xml	SAT TT=91.769	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.09	SAT TT=1335.59 CHECKS=51343900	SAT TT=296.364 CHECKS=12402700	SAT TT=1533.37 ASSIGNMENTS=63225	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=98.829 ASSIGNMENTS=113994 CHECKS=260918000	SAT TT=100.388 ASSIGNMENTS=113994 CHECKS=260918000	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=479.61 ASSIGNMENTS=439638 CHECKS=1362960000	SAT TT=59.217	SAT TT=753.497 ASSIGNMENTS=351681 CHECKS=2116260000	SAT TT=91.769 ASSIGNMENTS=113994 CHECKS=260918000	? TT=158.871	? TT=212.879	? TT=203.831
csp/primes-30/ normalized-primes-30-20-3-1.xml	SAT TT=0.025	SAT TT=47.135 CHECKS=113997000 NODES=174	SAT TT=113.839 CHECKS=259686000 NODES=140	SAT TT=0.036	SAT TT=4.256 CHECKS=1660860	SAT TT=3.385 CHECKS=1666710	SAT TT=9.961 ASSIGNMENTS=68	SAT TT=9.715 ASSIGNMENTS=68	? (MO) TT=9.97	? (MO) TT=10.18	? (MO) TT=9.84	SAT TT=0.083 ASSIGNMENTS=1900 CHECKS=153548	SAT TT=0.082 ASSIGNMENTS=1900 CHECKS=153548	SAT TT=787.185	SAT TT=812.25	SAT TT=0.065 ASSIGNMENTS=1811 CHECKS=153177	SAT TT=0.308 ASSIGNMENTS=11023 CHECKS=809734	SAT TT=0.363	SAT TT=0.025 ASSIGNMENTS=911 CHECKS=31326	SAT TT=0.036 ASSIGNMENTS=939 CHECKS=70608	? TT=490.312	SAT TT=11.012	SAT TT=17.049
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-30/ normalized-primes-30-20-3-7.xml	SAT TT=0.022	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=0.039	SAT TT=0.876 CHECKS=4683	SAT TT=0.066 CHECKS=4136	SAT TT=19.635 ASSIGNMENTS=73	? (TO) TT=1800.11	? (MO) TT=9.95	? (MO) TT=10.57	? (MO) TT=9.89	SAT TT=0.033 ASSIGNMENTS=531 CHECKS=28064	SAT TT=0.035 ASSIGNMENTS=531 CHECKS=28064	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=0.022 ASSIGNMENTS=471 CHECKS=28416	SAT TT=0.343 ASSIGNMENTS=8764 CHECKS=944038	SAT TT=0.492	SAT TT=0.032 ASSIGNMENTS=817 CHECKS=52814	SAT TT=0.106 ASSIGNMENTS=1403 CHECKS=267573	? TT=494.361	? TT=597.999	? TT=604.958
csp/primes-30/ normalized-primes-30-40-2-1.xml	SAT TT=0.012	SAT TT=4.397 CHECKS=9115200 NODES=100	SAT TT=4.287 CHECKS=9115200 NODES=0	SAT TT=0.04	SAT TT=0.962 CHECKS=560371	SAT TT=0.573 CHECKS=698240	SAT TT=2.687 ASSIGNMENTS=43	SAT TT=2.408 ASSIGNMENTS=43	SAT TT=15.733 CHECKS=7700660 NODES=100	SAT TT=7.191 CHECKS=9387260 NODES=450006	SAT TT=8.758 CHECKS=15522500 NODES=2134	SAT TT=0.027 ASSIGNMENTS=211 CHECKS=8042	SAT TT=0.03 ASSIGNMENTS=211 CHECKS=8042	SAT TT=21.474	SAT TT=21.674	SAT TT=0.012 ASSIGNMENTS=211 CHECKS=8042	SAT TT=0.203 ASSIGNMENTS=5920 CHECKS=473585	SAT TT=0.415	SAT TT=0.018 ASSIGNMENTS=375 CHECKS=14317	SAT TT=0.016 ASSIGNMENTS=211 CHECKS=8042	? TT=191.76	SAT TT=0.866	SAT TT=0.869
csp/primes-30/ normalized-primes-30-40-2-3.xml	SAT TT=3.577	SAT TT=202.689 CHECKS=414973000 NODES=959	SAT TT=246.418 CHECKS=459683000 NODES=1081	SAT TT=3.577	SAT TT=6.879 CHECKS=734556	SAT TT=5.988 CHECKS=582954	SAT TT=14.467 ASSIGNMENTS=1004	SAT TT=13.722 ASSIGNMENTS=1004	? (MO) TT=11.92	? (MO) TT=11.04	? (MO) TT=11.12	SAT TT=20.566 ASSIGNMENTS=1004	SAT TT=193.103 ASSIGNMENTS=4408550 CHECKS=503231000	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=318.843 ASSIGNMENTS=4247820 CHECKS=887005000	? (TO) TT=1800.03	SAT TT=0.525	SAT TT=150.733 ASSIGNMENTS=1829170 CHECKS=423568000	SAT TT=196.395 ASSIGNMENTS=4408550 CHECKS=503231000	? TT=145.686	SAT TT=79.302	SAT TT=130.539
csp/primes-30/ normalized-primes-30-40-2-7.xml	SAT TT=278.366	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.12	? (MO) TT=11.28	? (MO) TT=12.34	? (MO) TT=10.72	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=826.853 ASSIGNMENTS=3664510 CHECKS=2633670000	SAT TT=278.366 ASSIGNMENTS=1622720 CHECKS=814133000	SAT TT=0.737	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=119.286	? TT=231.169	? TT=227.328
csp/primes-30/ normalized-primes-30-40-3-3.xml	SAT TT=14.829	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=14.829	SAT TT=1320.8 CHECKS=88454600	SAT TT=499.978 CHECKS=35546100	? (TO) TT=1800.05	? (TO) TT=1800.1	? (MO) TT=11.17	? (MO) TT=11.36	? (MO) TT=11.37	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=455.36	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=151.055	? TT=186.026	? TT=184.394
csp/primes-30/ normalized-primes-30-60-2-1.xml	SAT TT=0.017	SAT TT=2.388 CHECKS=3410680 NODES=100	SAT TT=2.18 CHECKS=3410680 NODES=0	SAT TT=0.045	SAT TT=0.96 CHECKS=148016	SAT TT=0.069 CHECKS=149471	SAT TT=1.268 ASSIGNMENTS=23	SAT TT=1.343 ASSIGNMENTS=23	SAT TT=19.504 CHECKS=1160180 NODES=100	SAT TT=7.236 CHECKS=1519750 NODES=2	SAT TT=6.662 CHECKS=1519740 NODES=0	SAT TT=0.029 ASSIGNMENTS=168 CHECKS=7976	SAT TT=0.03 ASSIGNMENTS=168 CHECKS=7976	SAT TT=28.208	SAT TT=26.388	SAT TT=0.017 ASSIGNMENTS=168 CHECKS=7976	SAT TT=0.107 ASSIGNMENTS=5200 CHECKS=237600	SAT TT=0.453	SAT TT=0.021 ASSIGNMENTS=344 CHECKS=12337	SAT TT=0.017 ASSIGNMENTS=168 CHECKS=7976	? TT=223.307	SAT TT=0.796	SAT TT=0.832
csp/primes-30/ normalized-primes-30-60-2-3.xml	SAT TT=0.047	SAT TT=7.174 CHECKS=16707800 NODES=101	SAT TT=7.092 CHECKS=16829200 NODES=0	SAT TT=0.047	SAT TT=1.129 CHECKS=16326	SAT TT=0.068 CHECKS=27833	SAT TT=0.983 ASSIGNMENTS=12	SAT TT=1.018 ASSIGNMENTS=12	? (MO) TT=11.27	? (MO) TT=10.35	? (MO) TT=11.45	SAT TT=0.081 ASSIGNMENTS=392 CHECKS=137203	SAT TT=0.08 ASSIGNMENTS=392 CHECKS=137203	? (TO) TT=1800	? (TO) TT=1800.07	SAT TT=0.066 ASSIGNMENTS=390 CHECKS=134809	SAT TT=0.665 ASSIGNMENTS=5733 CHECKS=1674010	SAT TT=0.468	SAT TT=1.312 ASSIGNMENTS=5821 CHECKS=3368750	SAT TT=0.126 ASSIGNMENTS=795 CHECKS=295726	? TT=149.46	SAT TT=1.184	SAT TT=1.206
csp/primes-30/ normalized-primes-30-60-2-7.xml	SAT TT=12.407	? (MO) TT=1.136	SAT TT=1276.81 CHECKS=2150260000 NODES=4940	SAT TT=28.74	SAT TT=28.121 CHECKS=1014520	SAT TT=18.638 CHECKS=738581	SAT TT=169.177 ASSIGNMENTS=10212	SAT TT=45.688 ASSIGNMENTS=1056	? (MO) TT=10.58	? (MO) TT=12.16	? (MO) TT=10.79	SAT TT=26.014 ASSIGNMENTS=94393 CHECKS=50945200	SAT TT=25.495 ASSIGNMENTS=94393 CHECKS=50945200	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=23.148 ASSIGNMENTS=135976 CHECKS=67530700	SAT TT=79.519 ASSIGNMENTS=193114 CHECKS=245997000	SAT TT=0.851	SAT TT=12.407 ASSIGNMENTS=39059 CHECKS=34725600	SAT TT=16.224 ASSIGNMENTS=94393 CHECKS=50945200	? (MO) TT=81.518	? TT=219.635	? TT=220.967
csp/primes-30/ normalized-primes-30-60-3-3.xml	SAT TT=0.674	SAT TT=60.221 CHECKS=139252000 NODES=296	SAT TT=110.352 CHECKS=231389000 NODES=288	SAT TT=0.674	SAT TT=40.382 CHECKS=2430390	SAT TT=46.218 CHECKS=2862840	SAT TT=41.44 ASSIGNMENTS=691	SAT TT=54.801 ASSIGNMENTS=790	? (MO) TT=12.11	? (MO) TT=10.57	? (MO) TT=9.91	SAT TT=26.018 ASSIGNMENTS=38508 CHECKS=49019600	SAT TT=25.502 ASSIGNMENTS=38508 CHECKS=49019600	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=11.311 ASSIGNMENTS=32961 CHECKS=32940800	SAT TT=23.646 ASSIGNMENTS=78284 CHECKS=69518500	SAT TT=0.891	SAT TT=842.592 ASSIGNMENTS=858654 CHECKS=2393900000	SAT TT=18.597 ASSIGNMENTS=38508 CHECKS=49019600	? (MO) TT=60.57	? TT=171.281	? TT=178.448
csp/primes-30/ normalized-primes-30-60-3-7.xml		? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.15	? (MO) TT=11.12	? (MO) TT=11.46	? (MO) TT=10.09	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (MO) TT=77.472	? TT=683.267	? TT=700.466
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-30/ normalized-primes-30-80-2-1.xml	SAT TT=0.018	SAT TT=2.485 CHECKS=3382230 NODES=100	SAT TT=2.194 CHECKS=3382230 NODES=0	SAT TT=0.047	SAT TT=1.095 CHECKS=737	SAT TT=0.021 CHECKS=956	SAT TT=1.058 ASSIGNMENTS=11	SAT TT=1.052 ASSIGNMENTS=11	SAT TT=22.623 CHECKS=1091400 NODES=100	SAT TT=8.192 CHECKS=1450990 NODES=0	SAT TT=7.922 CHECKS=1451070 NODES=1	SAT TT=0.029 ASSIGNMENTS=85 CHECKS=5309	SAT TT=0.027 ASSIGNMENTS=85 CHECKS=5309	SAT TT=31.822	SAT TT=29.039	SAT TT=0.019 ASSIGNMENTS=85 CHECKS=5320	SAT TT=0.035 ASSIGNMENTS=4062 CHECKS=37548	SAT TT=0.483	SAT TT=0.018 ASSIGNMENTS=105 CHECKS=5116	SAT TT=0.019 ASSIGNMENTS=85 CHECKS=5309	SAT TT=154.866	SAT TT=0.873	SAT TT=0.894
csp/primes-30/ normalized-primes-30-80-2-7.xml	SAT TT=0.063	SAT TT=5.919 CHECKS=9242930 NODES=102	SAT TT=8.021 CHECKS=11608100 NODES=0	SAT TT=0.063	SAT TT=2.361 CHECKS=2143	SAT TT=0.075 CHECKS=2126	SAT TT=0.927 ASSIGNMENTS=1	SAT TT=1.016 ASSIGNMENTS=1	? (MO) TT=10.02	? (MO) TT=9.97	? (MO) TT=11.55	SAT TT=0.077 ASSIGNMENTS=60 CHECKS=110160	SAT TT=0.076 ASSIGNMENTS=60 CHECKS=110160	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=0.066 ASSIGNMENTS=58 CHECKS=112600	SAT TT=1.771 ASSIGNMENTS=4025 CHECKS=4760180	SAT TT=0.606	SAT TT=0.092 ASSIGNMENTS=116 CHECKS=182086	SAT TT=0.07 ASSIGNMENTS=61 CHECKS=111820	? TT=716.435	SAT TT=1.576	SAT TT=1.279
csp/primes-30/ normalized-primes-30-80-3-3.xml	SAT TT=0.292	SAT TT=7.668 CHECKS=17293400 NODES=211	SAT TT=10.088 CHECKS=21120400 NODES=0	SAT TT=1.395	SAT TT=2.897 CHECKS=48424	SAT TT=4.006 CHECKS=265121	SAT TT=1.161 ASSIGNMENTS=2	SAT TT=1.275 ASSIGNMENTS=2	? (MO) TT=11.54	? (MO) TT=10.28	? (MO) TT=10.88	SAT TT=0.292 ASSIGNMENTS=335 CHECKS=697558	SAT TT=0.295 ASSIGNMENTS=335 CHECKS=697558	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=0.759 ASSIGNMENTS=757 CHECKS=1989930	SAT TT=3.189 ASSIGNMENTS=4989 CHECKS=8399560	SAT TT=0.614	SAT TT=1.939 ASSIGNMENTS=869 CHECKS=5304570	SAT TT=0.894 ASSIGNMENTS=820 CHECKS=2492020	? TT=146.898	? TT=182.067	? TT=174.671
csp/primes-30/ normalized-primes-30-80-3-5.xml		? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.08	? (MO) TT=10.46	? (MO) TT=10.76	? (MO) TT=10.62	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.06	? TT=143.925	? TT=284.482	? TT=173.16
csp/pseudo/aim/ normalized-aim-100-1-6-1.xml	SAT TT=0.038	SAT TT=1.201 CHECKS=21846 NODES=1200	SAT TT=1.105 CHECKS=16672 NODES=1093	SAT TT=1132.65	SAT TT=0.185 CHECKS=111710	SAT TT=0.164 CHECKS=103884	SAT TT=1.384 ASSIGNMENTS=3338	SAT TT=1.388 ASSIGNMENTS=3338	SAT TT=1.091 CHECKS=5151 NODES=438	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=0.134 ASSIGNMENTS=1187 CHECKS=138942	SAT TT=0.125 ASSIGNMENTS=1187 CHECKS=138942	SAT TT=1.453	SAT TT=1.44	SAT TT=0.058 ASSIGNMENTS=490 CHECKS=50727	SAT TT=0.211 ASSIGNMENTS=6629 CHECKS=281140	SAT TT=0.722	SAT TT=0.37 ASSIGNMENTS=2944 CHECKS=275974	SAT TT=0.038 ASSIGNMENTS=278 CHECKS=23153	SAT TT=1.983	SAT TT=0.925	SAT TT=1.024
csp/pseudo/aim/ normalized-aim-100-1-6-4.xml	SAT TT=0.097	SAT TT=1.128 CHECKS=17655 NODES=1131	SAT TT=1.062 CHECKS=20123 NODES=1075	? (TO) TT=1800.03	SAT TT=0.318 CHECKS=186055	SAT TT=0.317 CHECKS=193769	SAT TT=1.065 ASSIGNMENTS=828	SAT TT=1.081 ASSIGNMENTS=828	SAT TT=1.042 CHECKS=15977 NODES=821	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=0.181 ASSIGNMENTS=1919 CHECKS=197180	SAT TT=0.178 ASSIGNMENTS=1919 CHECKS=197180	SAT TT=1.437	SAT TT=1.622	SAT TT=0.14 ASSIGNMENTS=1563 CHECKS=167446	SAT TT=0.143 ASSIGNMENTS=5004 CHECKS=199060	SAT TT=0.652	SAT TT=0.097 ASSIGNMENTS=937 CHECKS=61589	SAT TT=0.109 ASSIGNMENTS=1034 CHECKS=126171	SAT TT=1.779	SAT TT=0.814	SAT TT=0.924
csp/pseudo/aim/ normalized-aim-100-2-0-2.xml	SAT TT=0.489	SAT TT=3.198 CHECKS=896852 NODES=36656	SAT TT=4.525 CHECKS=1679380 NODES=65563	SAT TT=407.963	SAT TT=8.321 CHECKS=6348600	SAT TT=6.83 CHECKS=5231120	SAT TT=2.714 ASSIGNMENTS=18602	SAT TT=2.975 ASSIGNMENTS=18602	SAT TT=2.014 CHECKS=260619 NODES=6598	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=10.85 ASSIGNMENTS=36656 CHECKS=896852	SAT TT=11.36 ASSIGNMENTS=31349 CHECKS=5409650	SAT TT=1.557	SAT TT=1.711	SAT TT=2.533 ASSIGNMENTS=21939 CHECKS=3586780	SAT TT=0.489 ASSIGNMENTS=7731 CHECKS=682765	SAT TT=0.827	SAT TT=3.019 ASSIGNMENTS=17937 CHECKS=2852450	SAT TT=3.531 ASSIGNMENTS=31349 CHECKS=5409650	SAT TT=1.904	SAT TT=0.994	SAT TT=0.934
csp/pseudo/aim/ normalized-aim-100-3-4-2.xml	SAT TT=0.172	SAT TT=1.607 CHECKS=168115 NODES=5662	SAT TT=1.631 CHECKS=141600 NODES=5683	SAT TT=0.922	SAT TT=0.409 CHECKS=338498	SAT TT=0.311 CHECKS=273653	SAT TT=2.983 ASSIGNMENTS=11371	SAT TT=2.831 ASSIGNMENTS=11371	SAT TT=2.881 CHECKS=497348 NODES=5486	SAT TT=6.965 CHECKS=11520500 NODES=515730	? (TO) TT=1800.06	SAT TT=0.223 ASSIGNMENTS=996 CHECKS=272827	SAT TT=0.209 ASSIGNMENTS=996 CHECKS=272827	SAT TT=1.865	SAT TT=1.88	SAT TT=0.172 ASSIGNMENTS=727 CHECKS=217532	SAT TT=1.05 ASSIGNMENTS=7639 CHECKS=1617400	SAT TT=0.862	SAT TT=0.731 ASSIGNMENTS=2749 CHECKS=753824	SAT TT=0.599 ASSIGNMENTS=2617 CHECKS=967997	SAT TT=2.094	SAT TT=0.949	SAT TT=1.108
csp/pseudo/aim/ normalized-aim-100-3-4-3.xml	SAT TT=0.055	SAT TT=1.19 CHECKS=24647 NODES=1375	SAT TT=1.304 CHECKS=26200 NODES=1514	SAT TT=0.513	SAT TT=0.519 CHECKS=429416	SAT TT=1.863 CHECKS=1719700	SAT TT=2.525 ASSIGNMENTS=8616	SAT TT=2.354 ASSIGNMENTS=8616	SAT TT=1.967 CHECKS=138679 NODES=2729	SAT TT=11.894 CHECKS=20200200 NODES=895870	? (TO) TT=1800.01	SAT TT=0.513 ASSIGNMENTS=1774 CHECKS=719746	SAT TT=0.506 ASSIGNMENTS=1774 CHECKS=719746	SAT TT=1.695	SAT TT=1.744	SAT TT=0.518 ASSIGNMENTS=1764 CHECKS=769907	SAT TT=0.82 ASSIGNMENTS=7032 CHECKS=1318810	SAT TT=0.809	SAT TT=1.555 ASSIGNMENTS=5720 CHECKS=1566430	SAT TT=0.055 ASSIGNMENTS=116 CHECKS=39128	SAT TT=2.26	SAT TT=0.961	SAT TT=0.969
csp/pseudo/aim/ normalized-aim-100-3-4-4.xml	SAT TT=0.61	SAT TT=1.474 CHECKS=104142 NODES=4184	SAT TT=1.812 CHECKS=208276 NODES=7626	SAT TT=2.179	SAT TT=2.656 CHECKS=2395670	SAT TT=2.02 CHECKS=1849220	SAT TT=3.356 ASSIGNMENTS=13397	SAT TT=2.977 ASSIGNMENTS=13397	SAT TT=6.461 CHECKS=1722550 NODES=17499	SAT TT=7.898 CHECKS=12418100 NODES=553986	? (TO) TT=1800.02	SAT TT=1.33 ASSIGNMENTS=4798 CHECKS=2012540	SAT TT=1.325 ASSIGNMENTS=4798 CHECKS=2012540	SAT TT=1.909	SAT TT=1.718	SAT TT=0.61 ASSIGNMENTS=2256 CHECKS=908128	SAT TT=1.046 ASSIGNMENTS=7468 CHECKS=1637620	SAT TT=0.787	SAT TT=0.622 ASSIGNMENTS=2197 CHECKS=660543	SAT TT=2.282 ASSIGNMENTS=10167 CHECKS=3802740	SAT TT=2.314	SAT TT=1.068	SAT TT=0.932
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/aim/ normalized-aim-100-6-0-3.xml	SAT TT=0.072	SAT TT=1.338 CHECKS=22533 NODES=1124	SAT TT=1.452 CHECKS=23208 NODES=1015	SAT TT=0.904	SAT TT=0.201 CHECKS=134020	SAT TT=0.182 CHECKS=146791	SAT TT=1.54 ASSIGNMENTS=426	SAT TT=1.772 ASSIGNMENTS=426	SAT TT=1.725 CHECKS=99981 NODES=840	SAT TT=1.421 CHECKS=121799 NODES=2977	SAT TT=1.426 CHECKS=171365 NODES=1311	SAT TT=0.171 ASSIGNMENTS=292 CHECKS=184441	SAT TT=0.177 ASSIGNMENTS=292 CHECKS=184441	SAT TT=2.001	SAT TT=1.997	SAT TT=0.101 ASSIGNMENTS=147 CHECKS=85816	SAT TT=0.84 ASSIGNMENTS=5220 CHECKS=1316770	SAT TT=0.818	SAT TT=0.342 ASSIGNMENTS=1272 CHECKS=356842	SAT TT=0.072 ASSIGNMENTS=70 CHECKS=48759	SAT TT=2.434	SAT TT=1.095	SAT TT=1.328
csp/pseudo/aim/ normalized-aim-200-1-6-1.xml	SAT TT=1.167	SAT TT=1.873 CHECKS=193472 NODES=7946	SAT TT=2.102 CHECKS=222317 NODES=9646	? (TO) TT=1800.1	SAT TT=13.37 CHECKS=8478830	SAT TT=5.643 CHECKS=3485080	SAT TT=11.301 ASSIGNMENTS=92753	SAT TT=12.093 ASSIGNMENTS=92753	SAT TT=2.201 CHECKS=127369 NODES=3715	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=9.134 ASSIGNMENTS=7946 CHECKS=193472	SAT TT=9.697 ASSIGNMENTS=17344 CHECKS=3743000	SAT TT=1.904	SAT TT=1.975	SAT TT=1.167 ASSIGNMENTS=7981 CHECKS=1580700	SAT TT=1.55 ASSIGNMENTS=19204 CHECKS=2118470	SAT TT=1.108	SAT TT=11.347 ASSIGNMENTS=43732 CHECKS=8977590	SAT TT=2.675 ASSIGNMENTS=17344 CHECKS=3743000	SAT TT=2.455	SAT TT=1.238	SAT TT=1.2
csp/pseudo/aim/ normalized-aim-200-1-6-2.xml	SAT TT=0.885	SAT TT=3.875 CHECKS=792276 NODES=37887	SAT TT=3.731 CHECKS=753234 NODES=34327	? (TO) TT=1800.11	SAT TT=6.03 CHECKS=3193740	SAT TT=8.23 CHECKS=4269140	SAT TT=4.293 ASSIGNMENTS=37937	SAT TT=4.343 ASSIGNMENTS=37937	SAT TT=5.124 CHECKS=515808 NODES=17253	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=11.145 ASSIGNMENTS=37887 CHECKS=792276	SAT TT=1.496 ASSIGNMENTS=15438 CHECKS=1912100	SAT TT=1.787	SAT TT=1.818	SAT TT=2.87 ASSIGNMENTS=27719 CHECKS=3586480	SAT TT=0.885 ASSIGNMENTS=15727 CHECKS=1141810	SAT TT=1.393	SAT TT=1.673 ASSIGNMENTS=8113 CHECKS=893074	SAT TT=1.369 ASSIGNMENTS=13464 CHECKS=1660980	SAT TT=2.681	SAT TT=1.348	SAT TT=1.049
csp/pseudo/aim/ normalized-aim-200-1-6-4.xml	SAT TT=1.059	SAT TT=3.649 CHECKS=822520 NODES=29579	SAT TT=3.322 CHECKS=672110 NODES=27165	? (TO) TT=1800.05	SAT TT=44.571 CHECKS=23011200	SAT TT=15.367 CHECKS=8411770	SAT TT=14.026 ASSIGNMENTS=149488	SAT TT=14.846 ASSIGNMENTS=149488	SAT TT=22.21 CHECKS=2919140 NODES=103049	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=11.131 ASSIGNMENTS=29579 CHECKS=822520	SAT TT=29.646 ASSIGNMENTS=240841 CHECKS=29674400	SAT TT=2.098	SAT TT=1.891	SAT TT=30.501 ASSIGNMENTS=297005 CHECKS=37328500	SAT TT=261.23 ASSIGNMENTS=1834890 CHECKS=356778000	SAT TT=26.301	SAT TT=5.825 ASSIGNMENTS=29095 CHECKS=3493110	SAT TT=24.099 ASSIGNMENTS=240841 CHECKS=29674400	SAT TT=2.336	SAT TT=1.207	SAT TT=1.059
csp/pseudo/aim/ normalized-aim-200-2-0-3.xml	SAT TT=1.049	SAT TT=1.711 CHECKS=122864 NODES=7037	SAT TT=2.098 CHECKS=198192 NODES=10306	? (TO) TT=1800.07	SAT TT=8.241 CHECKS=4445050	SAT TT=31.368 CHECKS=17618400	SAT TT=30.033 ASSIGNMENTS=302970	SAT TT=28.622 ASSIGNMENTS=302970	SAT TT=20.612 CHECKS=2784570 NODES=73865	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=9.259 ASSIGNMENTS=7037 CHECKS=122864	SAT TT=10.915 ASSIGNMENTS=27190 CHECKS=4337900	SAT TT=2.134	SAT TT=2.283	SAT TT=223.076 ASSIGNMENTS=1478320 CHECKS=296022000	SAT TT=1.72 ASSIGNMENTS=21420 CHECKS=2293980	SAT TT=1.005	SAT TT=16.693 ASSIGNMENTS=62767 CHECKS=9498680	SAT TT=3.482 ASSIGNMENTS=27190 CHECKS=4337900	SAT TT=2.657	SAT TT=1.049	SAT TT=1.069
csp/pseudo/aim/ normalized-aim-200-3-4-4.xml	SAT TT=1.029	SAT TT=2.103 CHECKS=188104 NODES=6840	SAT TT=2.531 CHECKS=299548 NODES=10161	SAT TT=1785.89	SAT TT=6.663 CHECKS=4954940	SAT TT=9.721 CHECKS=7349590	SAT TT=7.977 ASSIGNMENTS=38004	SAT TT=8.888 ASSIGNMENTS=38004	SAT TT=27.206 CHECKS=5180360 NODES=49190	SAT TT=7.911 CHECKS=8404530 NODES=376254	? (TO) TT=1800.05	SAT TT=9.423 ASSIGNMENTS=6840 CHECKS=188104	SAT TT=9.54 ASSIGNMENTS=6840 CHECKS=188104	SAT TT=2.361	SAT TT=2.326	SAT TT=10.483 ASSIGNMENTS=30817 CHECKS=14973000	SAT TT=5.321 ASSIGNMENTS=17393 CHECKS=7865580	SAT TT=1.861	SAT TT=9.741 ASSIGNMENTS=17184 CHECKS=7550590	SAT TT=1.029 ASSIGNMENTS=3467 CHECKS=1385420	SAT TT=3.044	SAT TT=1.281	SAT TT=1.207
csp/pseudo/aim/ normalized-aim-200-6-0-3.xml	SAT TT=0.417	SAT TT=1.797 CHECKS=37739 NODES=2224	SAT TT=2.286 CHECKS=146463 NODES=4784	? (TO) TT=1800.06	SAT TT=1.431 CHECKS=1022330	SAT TT=3.134 CHECKS=2895050	SAT TT=2.181 ASSIGNMENTS=764	SAT TT=2.4 ASSIGNMENTS=764	SAT TT=2.538 CHECKS=83377 NODES=744	SAT TT=1488.82 CHECKS=2147590000 NODES=56854500	SAT TT=2.895 CHECKS=2701400 NODES=10360	SAT TT=0.417 ASSIGNMENTS=421 CHECKS=398974	SAT TT=0.434 ASSIGNMENTS=421 CHECKS=398974	SAT TT=2.787	SAT TT=2.666	SAT TT=0.592 ASSIGNMENTS=632 CHECKS=622537	SAT TT=2.577 ASSIGNMENTS=6603 CHECKS=3270170	SAT TT=1.078	SAT TT=2.801 ASSIGNMENTS=3518 CHECKS=1864890	SAT TT=2.274 ASSIGNMENTS=2156 CHECKS=2641370	SAT TT=3.709	SAT TT=1.234	SAT TT=1.358
csp/pseudo/aim/ normalized-aim-50-1-6-2.xml	SAT TT=0.013	SAT TT=0.989 CHECKS=16430 NODES=909	SAT TT=0.858 CHECKS=757 NODES=0	SAT TT=0.081	SAT TT=0.021 CHECKS=969	SAT TT=0.015 CHECKS=1069	SAT TT=0.733 ASSIGNMENTS=3	SAT TT=0.784 ASSIGNMENTS=3	SAT TT=0.838 CHECKS=6687 NODES=368	SAT TT=110.969 CHECKS=229738000 NODES=21019000	? (TO) TT=1800.05	SAT TT=0.025 ASSIGNMENTS=2 CHECKS=802	SAT TT=0.025 ASSIGNMENTS=2 CHECKS=802	SAT TT=1.28	SAT TT=1.152	SAT TT=0.013 ASSIGNMENTS=2 CHECKS=802	SAT TT=0.048 ASSIGNMENTS=1251 CHECKS=50569	SAT TT=0.466	SAT TT=0.039 ASSIGNMENTS=472 CHECKS=27861	SAT TT=0.027 ASSIGNMENTS=209 CHECKS=22312	SAT TT=1.139	SAT TT=0.708	SAT TT=0.791
csp/pseudo/aim/ normalized-aim-50-2-0-1.xml	SAT TT=0.037	SAT TT=1.017 CHECKS=8669 NODES=713	SAT TT=0.941 CHECKS=4777 NODES=410	SAT TT=6.479	SAT TT=0.203 CHECKS=147342	SAT TT=0.183 CHECKS=128657	SAT TT=0.945 ASSIGNMENTS=1211	SAT TT=1.195 ASSIGNMENTS=1211	SAT TT=0.832 CHECKS=5945 NODES=339	SAT TT=5.322 CHECKS=10376100 NODES=743890	? (TO) TT=1800.09	SAT TT=0.081 ASSIGNMENTS=749 CHECKS=81799	SAT TT=0.073 ASSIGNMENTS=749 CHECKS=81799	SAT TT=1.543	SAT TT=1.436	SAT TT=0.073 ASSIGNMENTS=718 CHECKS=82307	SAT TT=0.198 ASSIGNMENTS=4767 CHECKS=269997	SAT TT=0.501	SAT TT=0.047 ASSIGNMENTS=493 CHECKS=33401	SAT TT=0.037 ASSIGNMENTS=305 CHECKS=33295	SAT TT=1.187	SAT TT=0.746	SAT TT=0.731
csp/pseudo/aim/ normalized-aim-50-3-4-1.xml	SAT TT=0.019	SAT TT=0.993 CHECKS=4713 NODES=377	SAT TT=0.958 CHECKS=2685 NODES=157	SAT TT=0.081	SAT TT=0.047 CHECKS=20574	SAT TT=0.036 CHECKS=20512	SAT TT=0.967 ASSIGNMENTS=79	SAT TT=0.901 ASSIGNMENTS=79	SAT TT=1.004 CHECKS=23759 NODES=479	SAT TT=1.639 CHECKS=1525370 NODES=67916	SAT TT=1.11 CHECKS=119150 NODES=1079	SAT TT=0.043 ASSIGNMENTS=68 CHECKS=20150	SAT TT=0.041 ASSIGNMENTS=68 CHECKS=20150	SAT TT=1.691	SAT TT=1.359	SAT TT=0.026 ASSIGNMENTS=51 CHECKS=13384	SAT TT=0.363 ASSIGNMENTS=4407 CHECKS=559116	SAT TT=0.599	SAT TT=0.064 ASSIGNMENTS=441 CHECKS=59095	SAT TT=0.019 ASSIGNMENTS=6 CHECKS=1812	SAT TT=1.741	SAT TT=0.856	SAT TT=0.843
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/aim/ normalized-aim-50-3-4-4.xml	SAT TT=0.039	SAT TT=1.027 CHECKS=9606 NODES=578	SAT TT=0.994 CHECKS=5887 NODES=356	SAT TT=0.079	SAT TT=0.061 CHECKS=38409	SAT TT=0.056 CHECKS=38389	SAT TT=0.973 ASSIGNMENTS=460	SAT TT=1.044 ASSIGNMENTS=460	SAT TT=0.91 CHECKS=6600 NODES=186	SAT TT=1.161 CHECKS=485601 NODES=21639	SAT TT=1.08 CHECKS=434549 NODES=3331	SAT TT=0.057 ASSIGNMENTS=152 CHECKS=43768	SAT TT=0.057 ASSIGNMENTS=152 CHECKS=43768	SAT TT=1.417	SAT TT=1.385	SAT TT=0.039 ASSIGNMENTS=125 CHECKS=34909	SAT TT=0.35 ASSIGNMENTS=4402 CHECKS=545662	SAT TT=0.609	SAT TT=0.045 ASSIGNMENTS=361 CHECKS=42302	SAT TT=0.045 ASSIGNMENTS=147 CHECKS=41742	SAT TT=1.759	SAT TT=0.785	SAT TT=0.814
csp/pseudo/aim/ normalized-aim-50-6-0-1.xml	SAT TT=0.025	SAT TT=1.093 CHECKS=3257 NODES=192	SAT TT=1.095 CHECKS=8303 NODES=337	SAT TT=0.101	SAT TT=0.046 CHECKS=11108	SAT TT=0.032 CHECKS=11017	SAT TT=1.025 ASSIGNMENTS=36	SAT TT=1.037 ASSIGNMENTS=36	SAT TT=0.993 CHECKS=2873 NODES=116	SAT TT=1.099 CHECKS=77826 NODES=1933	SAT TT=1.081 CHECKS=62076 NODES=596	SAT TT=0.048 ASSIGNMENTS=50 CHECKS=21446	SAT TT=0.049 ASSIGNMENTS=50 CHECKS=21446	SAT TT=1.716	SAT TT=1.545	SAT TT=0.035 ASSIGNMENTS=43 CHECKS=19179	SAT TT=0.081 ASSIGNMENTS=533 CHECKS=103306	SAT TT=0.861	SAT TT=0.038 ASSIGNMENTS=72 CHECKS=17033	SAT TT=0.025 ASSIGNMENTS=7 CHECKS=3218	SAT TT=1.82	SAT TT=0.89	SAT TT=0.901
csp/pseudo/aim/ normalized-aim-50-6-0-3.xml	SAT TT=0.028	SAT TT=1.186 CHECKS=2355 NODES=157	SAT TT=1.106 CHECKS=3434 NODES=166	SAT TT=0.092	SAT TT=0.044 CHECKS=9519	SAT TT=0.028 CHECKS=9275	SAT TT=1.077 ASSIGNMENTS=4	SAT TT=1.016 ASSIGNMENTS=4	SAT TT=0.992 CHECKS=2817 NODES=128	SAT TT=1.114 CHECKS=72436 NODES=1813	SAT TT=1.081 CHECKS=54098 NODES=485	SAT TT=0.047 ASSIGNMENTS=18 CHECKS=9890	SAT TT=0.04 ASSIGNMENTS=18 CHECKS=9890	SAT TT=1.8	SAT TT=1.61	SAT TT=0.028 ASSIGNMENTS=16 CHECKS=7480	SAT TT=0.053 ASSIGNMENTS=297 CHECKS=46804	SAT TT=0.858	SAT TT=0.049 ASSIGNMENTS=203 CHECKS=38747	SAT TT=0.038 ASSIGNMENTS=48 CHECKS=21982	SAT TT=1.723	SAT TT=0.969	SAT TT=1.107
csp/pseudo/aim/ normalized-aim-50-6-0-4.xml	SAT TT=0.028	SAT TT=1.104 CHECKS=3435 NODES=199	SAT TT=1.072 CHECKS=4642 NODES=208	SAT TT=0.105	SAT TT=0.045 CHECKS=11808	SAT TT=0.032 CHECKS=11886	SAT TT=1.223 ASSIGNMENTS=41	SAT TT=1.209 ASSIGNMENTS=41	SAT TT=1.079 CHECKS=9331 NODES=170	SAT TT=1.046 CHECKS=57955 NODES=1410	SAT TT=1.058 CHECKS=191551 NODES=1592	SAT TT=0.039 ASSIGNMENTS=7 CHECKS=5576	SAT TT=0.038 ASSIGNMENTS=7 CHECKS=5576	SAT TT=1.482	SAT TT=1.525	SAT TT=0.028 ASSIGNMENTS=7 CHECKS=5576	SAT TT=0.041 ASSIGNMENTS=140 CHECKS=26608	SAT TT=0.801	SAT TT=0.036 ASSIGNMENTS=90 CHECKS=16234	SAT TT=0.037 ASSIGNMENTS=43 CHECKS=21011	SAT TT=1.893	SAT TT=0.962	SAT TT=0.986
csp/pseudo/chnl/ normalized-chnl-10-11.xml	UNSAT TT=0.058	UNSAT TT=1.467 CHECKS=212572 NODES=2319	UNSAT TT=1.584 CHECKS=254326 NODES=1665	? (TO) TT=1800.07	UNSAT TT=0.076 CHECKS=11881	UNSAT TT=0.058 CHECKS=7538	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=720.789 ASSIGNMENTS=6161630 CHECKS=725834000	UNSAT TT=869.723 ASSIGNMENTS=6161630 CHECKS=725834000	UNSAT TT=16.988	UNSAT TT=4.25	? (TO) TT=1800.1	UNSAT TT=685.082 ASSIGNMENTS=9135120 CHECKS=883770000	UNSAT TT=37.465	? (TO) TT=1800.04	UNSAT TT=531.88 ASSIGNMENTS=6161630 CHECKS=725834000	UNSAT TT=1426.01	UNSAT TT=11.762	UNSAT TT=11.287
csp/pseudo/chnl/ normalized-chnl-10-15.xml	UNSAT TT=0.062	UNSAT TT=6.176 CHECKS=2773630 NODES=2183	UNSAT TT=3.536 CHECKS=1683300 NODES=1354	? (TO) TT=1800.05	UNSAT TT=0.064 CHECKS=5081	UNSAT TT=0.062 CHECKS=5051	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.01	UNSAT TT=1655.7 ASSIGNMENTS=2865710 CHECKS=474578000	UNSAT TT=1655.95 ASSIGNMENTS=2865710 CHECKS=474578000	UNSAT TT=15.581	UNSAT TT=4.353	? (TO) TT=1800.02	UNSAT TT=613.737 ASSIGNMENTS=5287110 CHECKS=852119000	UNSAT TT=50.798	UNSAT TT=1554.08 ASSIGNMENTS=6517850 CHECKS=1113020000	UNSAT TT=347.557 ASSIGNMENTS=2865710 CHECKS=474578000	? (TO) TT=1800.18	UNSAT TT=16.435	UNSAT TT=5.999
csp/pseudo/chnl/ normalized-chnl-15-16.xml	UNSAT TT=0.327	UNSAT TT=73.688 CHECKS=51110700 NODES=29733	UNSAT TT=288.369 CHECKS=204356000 NODES=42154	? (TO) TT=1800.09	UNSAT TT=0.327 CHECKS=46106	UNSAT TT=0.336 CHECKS=47946	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.21	? (TO) TT=1800.09	? (TO) TT=1800.11
csp/pseudo/chnl/ normalized-chnl-15-20.xml	UNSAT TT=0.437	UNSAT TT=1103 CHECKS=716887000 NODES=32764	? (TO) TT=1800.17	? (TO) TT=1800.06	UNSAT TT=0.437 CHECKS=58974	UNSAT TT=0.458 CHECKS=55833	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	? TT=213.121	? (TO) TT=1800.13	? (TO) TT=1800.05
csp/pseudo/chnl/ normalized-chnl-20-21.xml	UNSAT TT=1.032	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.05	UNSAT TT=1.065 CHECKS=131908	UNSAT TT=1.032 CHECKS=125953	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? TT=500.586	? (TO) TT=1800.05	? (TO) TT=1800.11
csp/pseudo/chnl/ normalized-chnl-20-30.xml	UNSAT TT=1.889	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=2.265 CHECKS=206040	UNSAT TT=1.889 CHECKS=165351	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.03	? TT=666.893	? (TO) TT=1800.01	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/chnl/ normalized-chnl-30-31.xml	UNSAT TT=7.287	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=7.287 CHECKS=587577	? (TO) TT=1800.23	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.09
csp/pseudo/chnl/ normalized-chnl-30-35.xml	UNSAT TT=9.795	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=9.795 CHECKS=663367	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800
csp/pseudo/chnl/ normalized-chnl-30-40.xml	UNSAT TT=13.431	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.06	UNSAT TT=13.431 CHECKS=842229	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.05
csp/pseudo/chnl/ normalized-chnl-35-40.xml	UNSAT TT=21.029	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.02	UNSAT TT=21.029 CHECKS=1251830	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08
csp/pseudo/chnl/ normalized-chnl-35-45.xml	UNSAT TT=29.427	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.04	UNSAT TT=29.427 CHECKS=1461720	UNSAT TT=44.48 CHECKS=1923810	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/pseudo/chnl/ normalized-chnl-40-41.xml		? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.07
csp/pseudo/chnl/ normalized-chnl-40-50.xml		? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/pseudo/chnl/ normalized-chnl-50-55.xml		? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/pseudo/chnl/ normalized-chnl-50-60.xml		? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.05
csp/pseudo/ circuits/ normalized-b1.xml	SAT TT=0.007	SAT TT=0.735 CHECKS=144 NODES=24	SAT TT=0.732 CHECKS=150 NODES=0	SAT TT=0.034	SAT TT=0.012 CHECKS=657	SAT TT=0.009 CHECKS=515	SAT TT=0.626 ASSIGNMENTS=11	SAT TT=0.697 ASSIGNMENTS=20	SAT TT=0.681 CHECKS=221 NODES=24	SAT TT=0.687 CHECKS=648 NODES=2	SAT TT=0.723 CHECKS=708 NODES=2	SAT TT=0.021 ASSIGNMENTS=12 CHECKS=609	SAT TT=0.022 ASSIGNMENTS=12 CHECKS=609	SAT TT=1.56	SAT TT=1.287	SAT TT=0.01 ASSIGNMENTS=12 CHECKS=609	SAT TT=0.01 ASSIGNMENTS=17 CHECKS=628	SAT TT=0.351	SAT TT=0.009 ASSIGNMENTS=22 CHECKS=873	SAT TT=0.007 ASSIGNMENTS=12 CHECKS=603	SAT TT=1.503	SAT TT=0.64	SAT TT=0.592
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ circuits/ normalized-C17.xml	SAT TT=0.007	SAT TT=0.676 CHECKS=58 NODES=15	SAT TT=0.679 CHECKS=61 NODES=0	SAT TT=0.028	SAT TT=0.008 CHECKS=118	SAT TT=0.01 CHECKS=172	SAT TT=0.537 ASSIGNMENTS=6	SAT TT=0.511 ASSIGNMENTS=6	SAT TT=0.474 CHECKS=64 NODES=15	SAT TT=0.504 CHECKS=230 NODES=0	SAT TT=0.507 CHECKS=267 NODES=1	SAT TT=0.019 ASSIGNMENTS=5 CHECKS=160	SAT TT=0.016 ASSIGNMENTS=5 CHECKS=160	SAT TT=1.004	SAT TT=1.084	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=160	SAT TT=0.009 ASSIGNMENTS=9 CHECKS=154	SAT TT=0.308	SAT TT=0.007 ASSIGNMENTS=6 CHECKS=156	SAT TT=0.007 ASSIGNMENTS=6 CHECKS=155	SAT TT=0.963	SAT TT=0.481	SAT TT=0.507
csp/pseudo/ circuits/ normalized-C432.xml	SAT TT=0.331	SAT TT=2.652 CHECKS=9896 NODES=771	SAT TT=2.462 CHECKS=5573 NODES=0	SAT TT=0.641	SAT TT=0.398 CHECKS=24106	SAT TT=0.393 CHECKS=55174	SAT TT=2.81 ASSIGNMENTS=324	SAT TT=3.139 ASSIGNMENTS=655	SAT TT=106.913 CHECKS=16911 NODES=779	SAT TT=46.841 CHECKS=39305 NODES=40	SAT TT=49.29 CHECKS=108599 NODES=44	SAT TT=0.411 ASSIGNMENTS=344 CHECKS=70844	SAT TT=0.415 ASSIGNMENTS=344 CHECKS=70844	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.411 ASSIGNMENTS=344 CHECKS=70844	SAT TT=0.331 ASSIGNMENTS=456 CHECKS=119270	SAT TT=1.968	SAT TT=73.603 ASSIGNMENTS=42765 CHECKS=8746720	SAT TT=0.417 ASSIGNMENTS=350 CHECKS=71008	? (TO) TT=1800.15	SAT TT=3.014	SAT TT=3.086
csp/pseudo/ circuits/ normalized-c8.xml	SAT TT=0.063	SAT TT=1.388 CHECKS=2962 NODES=239	SAT TT=1.444 CHECKS=2306 NODES=0	SAT TT=0.192	SAT TT=0.107 CHECKS=13694	SAT TT=0.083 CHECKS=13548	SAT TT=1.368 ASSIGNMENTS=83	SAT TT=1.418 ASSIGNMENTS=199	SAT TT=81.662 CHECKS=3766 NODES=243	SAT TT=25.481 CHECKS=9341 NODES=11	SAT TT=23.438 CHECKS=13615 NODES=11	SAT TT=0.077 ASSIGNMENTS=81 CHECKS=13533	SAT TT=0.075 ASSIGNMENTS=81 CHECKS=13533	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=0.067 ASSIGNMENTS=81 CHECKS=13533	SAT TT=0.063 ASSIGNMENTS=88 CHECKS=14729	SAT TT=0.844	SAT TT=0.984 ASSIGNMENTS=4663 CHECKS=763194	SAT TT=0.064 ASSIGNMENTS=81 CHECKS=13281	? (TO) TT=1800.07	SAT TT=1.34	SAT TT=1.47
csp/pseudo/ circuits/ normalized-cc.xml	SAT TT=0.025	SAT TT=1.044 CHECKS=1597 NODES=133	SAT TT=1.037 CHECKS=791 NODES=0	SAT TT=0.084	SAT TT=0.039 CHECKS=2239	SAT TT=0.029 CHECKS=2287	SAT TT=1.08 ASSIGNMENTS=27	SAT TT=1.868 ASSIGNMENTS=104	SAT TT=76.011 CHECKS=1387 NODES=133	SAT TT=16.785 CHECKS=3388 NODES=4	SAT TT=16.546 CHECKS=4359 NODES=6	SAT TT=0.039 ASSIGNMENTS=28 CHECKS=4754	SAT TT=0.038 ASSIGNMENTS=28 CHECKS=4754	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=0.026 ASSIGNMENTS=28 CHECKS=4754	SAT TT=0.028 ASSIGNMENTS=43 CHECKS=5080	SAT TT=0.68	SAT TT=0.03 ASSIGNMENTS=81 CHECKS=5993	SAT TT=0.025 ASSIGNMENTS=28 CHECKS=4757	? (TO) TT=1800.18	SAT TT=0.944	SAT TT=1.055
csp/pseudo/ circuits/ normalized-cm42a.xml	SAT TT=0.02	SAT TT=1.021 CHECKS=1184 NODES=99	SAT TT=0.998 CHECKS=1442 NODES=0	SAT TT=0.073	SAT TT=0.035 CHECKS=4028	SAT TT=0.027 CHECKS=3507	SAT TT=0.972 ASSIGNMENTS=38	SAT TT=0.918 ASSIGNMENTS=38	SAT TT=2.872 CHECKS=1006 NODES=101	SAT TT=1.531 CHECKS=2909 NODES=9	SAT TT=1.661 CHECKS=4217 NODES=9	SAT TT=0.034 ASSIGNMENTS=52 CHECKS=4021	SAT TT=0.033 ASSIGNMENTS=52 CHECKS=4021	SAT TT=2.539	Wrong Cert. TT=2.667	SAT TT=0.021 ASSIGNMENTS=43 CHECKS=3994	SAT TT=0.021 ASSIGNMENTS=45 CHECKS=3277	SAT TT=0.557	SAT TT=0.034 ASSIGNMENTS=325 CHECKS=16138	SAT TT=0.02 ASSIGNMENTS=50 CHECKS=4024	SAT TT=20.301	SAT TT=0.934	SAT TT=0.907
csp/pseudo/ circuits/ normalized-cmb.xml	SAT TT=0.093	SAT TT=1.607 CHECKS=5563 NODES=304	SAT TT=1.701 CHECKS=2755 NODES=0	SAT TT=0.619	SAT TT=0.122 CHECKS=9069	SAT TT=0.113 CHECKS=18859	SAT TT=1.533 ASSIGNMENTS=153	SAT TT=1.879 ASSIGNMENTS=245	SAT TT=106.891 CHECKS=5575 NODES=308	SAT TT=50.533 CHECKS=13721 NODES=16	SAT TT=43.758 CHECKS=21439 NODES=16	SAT TT=0.114 ASSIGNMENTS=162 CHECKS=29368	SAT TT=0.119 ASSIGNMENTS=162 CHECKS=29368	SAT TT=375.349	Wrong Cert. TT=373.297	SAT TT=0.104 ASSIGNMENTS=162 CHECKS=29368	SAT TT=0.093 ASSIGNMENTS=119 CHECKS=27145	SAT TT=0.93	SAT TT=2.275 ASSIGNMENTS=7506 CHECKS=1539860	SAT TT=0.107 ASSIGNMENTS=160 CHECKS=29474	? (TO) TT=1800.13	SAT TT=1.527	SAT TT=2.256
csp/pseudo/ course/ normalized-ss97-4.xml	SAT TT=2.532	? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=252.285 ASSIGNMENTS=475286	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=1162.83 ASSIGNMENTS=1731 CHECKS=580222	SAT TT=1252.26 ASSIGNMENTS=1731 CHECKS=580222	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=3.011 ASSIGNMENTS=1822 CHECKS=2222770	SAT TT=4.848 ASSIGNMENTS=7039 CHECKS=7819150	? (TO) TT=1800.1	SAT TT=15.986 ASSIGNMENTS=7291 CHECKS=5985600	SAT TT=2.532 ASSIGNMENTS=1731 CHECKS=580222	? (TO) TT=1800.14	SAT TT=3.746	SAT TT=7.42
csp/pseudo/ course/ normalized-ss97-6.xml	SAT TT=0.04	? (TO) TT=1800.13	SAT TT=224 CHECKS=46781300 NODES=23817	? (TO) TT=1800.05	SAT TT=0.873 CHECKS=22994	SAT TT=0.879 CHECKS=23150	? (TO) TT=1800.08	SAT TT=1.25 ASSIGNMENTS=351	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=0.056 ASSIGNMENTS=130 CHECKS=18175	SAT TT=0.056 ASSIGNMENTS=130 CHECKS=18175	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=0.04 ASSIGNMENTS=130 CHECKS=18175	SAT TT=0.06 ASSIGNMENTS=271 CHECKS=66053	SAT TT=141.642	SAT TT=0.151 ASSIGNMENTS=867 CHECKS=156378	SAT TT=0.044 ASSIGNMENTS=153 CHECKS=18742	? (TO) TT=1800.09	SAT TT=1.252	SAT TT=1.385
csp/pseudo/ course/ normalized-ws97-3.xml	SAT TT=1.208	? (TO) TT=1800.19	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=82.455 ASSIGNMENTS=57720	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=1.208 ASSIGNMENTS=2431 CHECKS=958859	? (TO) TT=1800.06	SAT TT=2.301 ASSIGNMENTS=2714 CHECKS=2591590	? (TO) TT=1800.09	? (TO) TT=1800.15	SAT TT=5.497	SAT TT=10.207
csp/pseudo/ course/ normalized-ws97-5.xml	SAT TT=0.17	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.05	SAT TT=37.14 CHECKS=108787	? (TO) TT=1800.04	? (TO) TT=1800.18	SAT TT=2.642 ASSIGNMENTS=2436	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=1160.24 ASSIGNMENTS=606 CHECKS=179057	SAT TT=223.785 ASSIGNMENTS=606 CHECKS=179057	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=0.17 ASSIGNMENTS=156 CHECKS=122762	? (TO) TT=1800.12	SAT TT=0.248 ASSIGNMENTS=537 CHECKS=166124	SAT TT=0.291 ASSIGNMENTS=606 CHECKS=179057	? (TO) TT=1800.11	SAT TT=2.417	SAT TT=3.72
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/fpga/ normalized-fpga-10-10.xml	SAT TT=0.084	SAT TT=1.568 CHECKS=150473 NODES=2926	SAT TT=1.01 CHECKS=1465 NODES=0	SAT TT=888.318	SAT TT=0.084 CHECKS=16539	SAT TT=0.104 CHECKS=25361	SAT TT=9.226 ASSIGNMENTS=127355	SAT TT=0.915 ASSIGNMENTS=66	SAT TT=0.859 CHECKS=2827 NODES=150	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=8.835 ASSIGNMENTS=1966 CHECKS=195642	SAT TT=8.868 ASSIGNMENTS=1966 CHECKS=195642	SAT TT=1.728	SAT TT=1.705	SAT TT=285.619 ASSIGNMENTS=2580350 CHECKS=421864000	? (TO) TT=1800.09	SAT TT=20.086	SAT TT=0.167 ASSIGNMENTS=1088 CHECKS=159381	SAT TT=0.144 ASSIGNMENTS=994 CHECKS=167247	SAT TT=3.856	SAT TT=0.946	SAT TT=0.918
csp/pseudo/fpga/ normalized-fpga-10-8.xml	SAT TT=0.11	SAT TT=1.341 CHECKS=66706 NODES=3257	SAT TT=1.393 CHECKS=72754 NODES=3718	SAT TT=896.532	SAT TT=0.127 CHECKS=35289	SAT TT=0.114 CHECKS=32861	SAT TT=16.672 ASSIGNMENTS=269893	SAT TT=1.055 ASSIGNMENTS=2002	SAT TT=0.911 CHECKS=21518 NODES=608	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=8.775 ASSIGNMENTS=1836 CHECKS=67604	SAT TT=8.929 ASSIGNMENTS=1836 CHECKS=67604	SAT TT=1.613	SAT TT=1.716	SAT TT=456.374 ASSIGNMENTS=2654620 CHECKS=678505000	SAT TT=0.214 ASSIGNMENTS=2536 CHECKS=307420	SAT TT=31.898	SAT TT=0.11 ASSIGNMENTS=735 CHECKS=108930	SAT TT=1.19 ASSIGNMENTS=7694 CHECKS=1786280	SAT TT=3.046	SAT TT=0.833	SAT TT=0.858
csp/pseudo/fpga/ normalized-fpga-10-9.xml	SAT TT=0.099	SAT TT=1.618 CHECKS=204440 NODES=5028	SAT TT=1.017 CHECKS=908 NODES=0	SAT TT=898.535	SAT TT=0.115 CHECKS=29591	SAT TT=0.099 CHECKS=24007	SAT TT=14.857 ASSIGNMENTS=256375	SAT TT=0.812 ASSIGNMENTS=66	SAT TT=0.833 CHECKS=2025 NODES=135	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=75.108 ASSIGNMENTS=552372 CHECKS=52670100	SAT TT=69.54 ASSIGNMENTS=552372 CHECKS=52670100	SAT TT=1.769	SAT TT=1.689	SAT TT=49.719 ASSIGNMENTS=446877 CHECKS=70943500	SAT TT=300.101 ASSIGNMENTS=1657720 CHECKS=421911000	SAT TT=1.976	SAT TT=0.152 ASSIGNMENTS=964 CHECKS=154165	SAT TT=2.522 ASSIGNMENTS=15326 CHECKS=4107750	SAT TT=2.889	SAT TT=1.11	SAT TT=0.952
csp/pseudo/fpga/ normalized-fpga-11-11.xml	SAT TT=0.103	SAT TT=3.418 CHECKS=1539180 NODES=8471	SAT TT=1.122 CHECKS=2593 NODES=0	SAT TT=899.513	SAT TT=0.103 CHECKS=23182	SAT TT=0.149 CHECKS=42717	SAT TT=48.444 ASSIGNMENTS=687776	SAT TT=0.924 ASSIGNMENTS=81	SAT TT=0.986 CHECKS=4349 NODES=182	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=842.377 ASSIGNMENTS=3256280 CHECKS=751090000	SAT TT=849.179 ASSIGNMENTS=3256280 CHECKS=751090000	SAT TT=1.974	SAT TT=1.918	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=217.837	SAT TT=0.572 ASSIGNMENTS=2096 CHECKS=465899	SAT TT=0.238 ASSIGNMENTS=1478 CHECKS=272798	SAT TT=5.238	SAT TT=1.15	SAT TT=1.031
csp/pseudo/fpga/ normalized-fpga-12-10.xml	SAT TT=0.248	SAT TT=2.246 CHECKS=485940 NODES=10241	SAT TT=4.94 CHECKS=1748620 NODES=34316	SAT TT=892.112	SAT TT=0.248 CHECKS=74225	SAT TT=0.263 CHECKS=75337	SAT TT=32.826 ASSIGNMENTS=534094	SAT TT=1.508 ASSIGNMENTS=3170	SAT TT=1.082 CHECKS=22431 NODES=681	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=61.934 ASSIGNMENTS=319181 CHECKS=47496900	SAT TT=61.736 ASSIGNMENTS=319181 CHECKS=47496900	SAT TT=1.834	SAT TT=1.772	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.12	SAT TT=0.6 ASSIGNMENTS=2402 CHECKS=550230	? (TO) TT=1800.01	SAT TT=27.779	SAT TT=238.015	SAT TT=0.936
csp/pseudo/fpga/ normalized-fpga-13-11.xml	SAT TT=0.414	SAT TT=4.556 CHECKS=1959720 NODES=18904	SAT TT=10.727 CHECKS=5540890 NODES=60162	SAT TT=896.141	SAT TT=0.418 CHECKS=116820	SAT TT=0.414 CHECKS=116734	SAT TT=281.34 ASSIGNMENTS=4077740	SAT TT=1.057 ASSIGNMENTS=436	SAT TT=1.335 CHECKS=72886 NODES=1420	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.13	SAT TT=1.94	SAT TT=2.14	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.51 ASSIGNMENTS=1933 CHECKS=508338	? (TO) TT=1800.02	? (TO) TT=1800.17	SAT TT=54.38	SAT TT=1.173
csp/pseudo/fpga/ normalized-fpga-14-12.xml	SAT TT=0.599	SAT TT=6.184 CHECKS=2708710 NODES=26881	SAT TT=10.174 CHECKS=5346440 NODES=35760	SAT TT=892.64	SAT TT=0.599 CHECKS=163920	SAT TT=2.056 CHECKS=570581	SAT TT=257.221 ASSIGNMENTS=3779120	SAT TT=1.367 ASSIGNMENTS=580	SAT TT=2.282 CHECKS=502873 NODES=3937	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=2.058	SAT TT=2.35	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=2.787 ASSIGNMENTS=6271 CHECKS=2729220	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.04	SAT TT=1.242
csp/pseudo/fpga/ normalized-fpga-14-14.xml	SAT TT=0.4	SAT TT=7.391 CHECKS=3720990 NODES=11364	SAT TT=1.228 CHECKS=17739 NODES=0	SAT TT=897.856	SAT TT=0.403 CHECKS=101586	SAT TT=0.4 CHECKS=102879	SAT TT=281.432 ASSIGNMENTS=3266990	SAT TT=1.355 ASSIGNMENTS=134	SAT TT=1.319 CHECKS=20643 NODES=294	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=1646.34 ASSIGNMENTS=1728 CHECKS=500466	SAT TT=2.265	SAT TT=2.362	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=9.226 ASSIGNMENTS=27739 CHECKS=8360460	SAT TT=0.44 ASSIGNMENTS=1728 CHECKS=500466	SAT TT=786.124	SAT TT=18.648	SAT TT=1.677
csp/pseudo/fpga/ normalized-fpga-15-14.xml	SAT TT=0.673	SAT TT=41.549 CHECKS=29154300 NODES=57432	SAT TT=164.826 CHECKS=121277000 NODES=237929	SAT TT=915.463	SAT TT=0.673 CHECKS=166547	SAT TT=0.678 CHECKS=169488	SAT TT=1072.71 ASSIGNMENTS=13542700	SAT TT=1.476 ASSIGNMENTS=779	SAT TT=1.758 CHECKS=99455 NODES=902	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=2.492	SAT TT=2.607	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.12	SAT TT=16.295 ASSIGNMENTS=43526 CHECKS=15120000	? (TO) TT=1800.07	? (TO) TT=1800.14	SAT TT=144.166	SAT TT=1.503
csp/pseudo/fpga/ normalized-fpga-20-18.xml	SAT TT=3.861	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=26.489 CHECKS=6110250	SAT TT=30.563 CHECKS=7127170	? (TO) TT=1800.07	SAT TT=3.861 ASSIGNMENTS=13085	SAT TT=488.436 CHECKS=451410000 NODES=486194	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=4.562	SAT TT=6.476	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=198.63	? (TO) TT=1800.07	SAT TT=4.73
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/fpga/ normalized-fpga-25-23.xml	SAT TT=3.817	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.09	SAT TT=148.618 CHECKS=30253500	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=322.582 ASSIGNMENTS=1223930	SAT TT=115.662 CHECKS=83178000 NODES=4889	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=50.395	SAT TT=87.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? TT=253.506	? (TO) TT=1800	SAT TT=3.817
csp/pseudo/fpga/ normalized-fpga-30-28.xml	SAT TT=5.074	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.14	SAT TT=5.342 ASSIGNMENTS=6892	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=1552.7	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.01	? TT=309.57	? (TO) TT=1800.02	SAT TT=5.074
csp/pseudo/fpga/ normalized-fpga-30-30.xml	SAT TT=3.288	? (TO) TT=1800.17	? (TO) TT=1800.15	SAT TT=1349.2	SAT TT=86.505 CHECKS=13296500	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=3.288 ASSIGNMENTS=646	SAT TT=767.231 CHECKS=1073840000 NODES=1350	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.22	? (TO) TT=1800.02	SAT TT=6.841
csp/pseudo/fpga/ normalized-fpga-35-34.xml	SAT TT=10.837	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.04	SAT TT=262.674 CHECKS=18969900	? (TO) TT=1800.11	SAT TT=77.418 ASSIGNMENTS=135627	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.2	? (TO) TT=1800.1	SAT TT=10.837
csp/pseudo/fpga/ normalized-fpga-35-35.xml	SAT TT=5.027	? (TO) TT=1800.12	? (TO) TT=1800.16	SAT TT=1346.36	SAT TT=184.1 CHECKS=21793500	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=5.027 ASSIGNMENTS=885	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.05	? TT=1402.68	? (TO) TT=1800.03	SAT TT=10.406
csp/pseudo/garden/ normalized-g-100x100.xml	SAT TT=1.391	SAT TT=23.335 CHECKS=20002 NODES=10000	SAT TT=26.992 CHECKS=20001 NODES=0	SAT TT=3.967	SAT TT=43.526 CHECKS=166909	SAT TT=38.154 CHECKS=167626	SAT TT=30.622 ASSIGNMENTS=6226	SAT TT=25.056 ASSIGNMENTS=6226	SAT TT=64.946 CHECKS=129270 NODES=10000	? TT=36.127 CHECKS=60679 NODES=0	SAT TT=36.901 CHECKS=1598420 NODES=203	SAT TT=1.759 ASSIGNMENTS=6715 CHECKS=260632	SAT TT=2.023 ASSIGNMENTS=6715 CHECKS=260632	SAT TT=124.925	SAT TT=118.284	SAT TT=2.02 ASSIGNMENTS=6715 CHECKS=260632	SAT TT=1.391 ASSIGNMENTS=7033 CHECKS=265221	SAT TT=6.713	SAT TT=2.16 ASSIGNMENTS=6666 CHECKS=261790	SAT TT=2.477 ASSIGNMENTS=7022 CHECKS=265144	SAT TT=9.162	SAT TT=3.968	SAT TT=4.056
csp/pseudo/ garden/ normalized-g-15x15.xml	SAT TT=0.029	SAT TT=1.257 CHECKS=452 NODES=225	SAT TT=1.042 CHECKS=452 NODES=0	SAT TT=0.104	SAT TT=0.041 CHECKS=3383	SAT TT=0.031 CHECKS=3317	SAT TT=0.98 ASSIGNMENTS=144	SAT TT=0.995 ASSIGNMENTS=144	SAT TT=0.991 CHECKS=2454 NODES=225	SAT TT=0.953 CHECKS=3903 NODES=1	SAT TT=0.945 CHECKS=4394 NODES=2	SAT TT=0.043 ASSIGNMENTS=154 CHECKS=5461	SAT TT=0.036 ASSIGNMENTS=154 CHECKS=5461	SAT TT=1.893	SAT TT=1.671	SAT TT=0.03 ASSIGNMENTS=154 CHECKS=5461	SAT TT=0.029 ASSIGNMENTS=97 CHECKS=5098	SAT TT=0.651	SAT TT=0.04 ASSIGNMENTS=312 CHECKS=8475	SAT TT=0.031 ASSIGNMENTS=153 CHECKS=5467	SAT TT=2.062	SAT TT=0.923	SAT TT=1.066
csp/pseudo/ garden/ normalized-g-2x2.xml	SAT TT=0.005	SAT TT=0.651 CHECKS=11 NODES=4	SAT TT=0.648 CHECKS=9 NODES=0	SAT TT=0.024	SAT TT=0.008 CHECKS=56	SAT TT=0.005 CHECKS=60	SAT TT=0.455 ASSIGNMENTS=3	SAT TT=0.509 ASSIGNMENTS=3	SAT TT=0.421 CHECKS=6 NODES=4	SAT TT=0.422 CHECKS=58 NODES=0	SAT TT=0.444 CHECKS=58 NODES=0	SAT TT=0.019 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.019 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.785	SAT TT=0.766	SAT TT=0.006 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.005 ASSIGNMENTS=1 CHECKS=30	SAT TT=0.264	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.892	SAT TT=0.481	SAT TT=0.442
csp/pseudo/ garden/ normalized-g-4x4.xml	SAT TT=0.006	SAT TT=0.702 CHECKS=33 NODES=16	SAT TT=0.683 CHECKS=33 NODES=0	SAT TT=0.029	SAT TT=0.008 CHECKS=200	SAT TT=0.007 CHECKS=244	SAT TT=0.592 ASSIGNMENTS=11	SAT TT=0.486 ASSIGNMENTS=11	SAT TT=0.506 CHECKS=86 NODES=16	SAT TT=0.51 CHECKS=264 NODES=0	SAT TT=0.514 CHECKS=264 NODES=0	SAT TT=0.018 ASSIGNMENTS=10 CHECKS=280	SAT TT=0.02 ASSIGNMENTS=10 CHECKS=280	SAT TT=1.008	SAT TT=0.964	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=280	SAT TT=0.008 ASSIGNMENTS=9 CHECKS=254	SAT TT=0.293	SAT TT=0.008 ASSIGNMENTS=11 CHECKS=270	SAT TT=0.006 ASSIGNMENTS=10 CHECKS=280	SAT TT=0.896	SAT TT=0.484	SAT TT=0.514
csp/pseudo/ garden/ normalized-g-7x7.xml	SAT TT=0.009	SAT TT=0.867 CHECKS=100 NODES=49	SAT TT=0.781 CHECKS=99 NODES=0	SAT TT=0.042	SAT TT=0.015 CHECKS=702	SAT TT=0.012 CHECKS=673	SAT TT=0.678 ASSIGNMENTS=31	SAT TT=0.689 ASSIGNMENTS=31	SAT TT=0.633 CHECKS=403 NODES=49	SAT TT=0.689 CHECKS=839 NODES=0	SAT TT=0.698 CHECKS=834 NODES=0	SAT TT=0.021 ASSIGNMENTS=33 CHECKS=1041	SAT TT=0.022 ASSIGNMENTS=33 CHECKS=1041	SAT TT=1.325	SAT TT=1.183	SAT TT=0.01 ASSIGNMENTS=33 CHECKS=1041	SAT TT=0.009 ASSIGNMENTS=21 CHECKS=960	SAT TT=0.391	SAT TT=0.01 ASSIGNMENTS=30 CHECKS=1030	SAT TT=0.01 ASSIGNMENTS=33 CHECKS=1051	SAT TT=1.538	SAT TT=0.635	SAT TT=0.574
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine