CSP 2008 Competition: results by benchmark

Results by benchmark for category n-ary constraints in intension (N-ARY-INT)

This page displays the results of the different solvers for each benchmark for category n-ary constraints in intension (N-ARY-INT)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allIntervalSeries/ normalized-series-100.xml	SAT TT=0.759	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=1.26	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.03	? (MO) TT=1221.49	? (TO) TT=1800.05	SAT TT=4.225 ASSIGNMENTS=774 CHECKS=646882	? (TO) TT=1800.07	SAT TT=0.759 ASSIGNMENTS=1 CHECKS=54843	? (TO) TT=1800.02	? TT=140.01	? (TO) TT=1800.06	? (TO) TT=1800.06
csp/allIntervalSeries/ normalized-series-10.xml	SAT TT=0.009	SAT TT=0.931 CHECKS=108808 NODES=447	SAT TT=0.902 CHECKS=90998 NODES=255	SAT TT=0.038	SAT TT=0.163 CHECKS=385886	SAT TT=0.249 CHECKS=972583	SAT TT=0.885 ASSIGNMENTS=60	SAT TT=0.783 ASSIGNMENTS=4	SAT TT=0.7 CHECKS=76601 NODES=255	SAT TT=1.075 CHECKS=1842810 NODES=17623	SAT TT=0.697 CHECKS=14838 NODES=58	SAT TT=0.135 ASSIGNMENTS=1577 CHECKS=148870	SAT TT=0.126 ASSIGNMENTS=1577 CHECKS=148870	SAT TT=1.521	SAT TT=1.34	SAT TT=0.116 ASSIGNMENTS=1413 CHECKS=141957	SAT TT=0.01 ASSIGNMENTS=15 CHECKS=1335	SAT TT=0.56	SAT TT=0.009 ASSIGNMENTS=1 CHECKS=528	SAT TT=0.013 ASSIGNMENTS=44 CHECKS=4486	SAT TT=2.591	SAT TT=0.879	SAT TT=0.905
csp/allIntervalSeries/ normalized-series-12.xml	SAT TT=0.011	SAT TT=1.159 CHECKS=503774 NODES=1618	SAT TT=2.304 CHECKS=2364350 NODES=7549	SAT TT=0.044	SAT TT=3.242 CHECKS=14991800	SAT TT=5.181 CHECKS=22998500	SAT TT=1.093 ASSIGNMENTS=532	SAT TT=0.922 ASSIGNMENTS=24	SAT TT=3.425 CHECKS=4641930 NODES=10563	SAT TT=5.435 CHECKS=22957200 NODES=154803	? (TO) TT=1800.02	SAT TT=7.066 ASSIGNMENTS=94 CHECKS=10289	SAT TT=9.438 ASSIGNMENTS=6501 CHECKS=2065960	SAT TT=2.599	SAT TT=1.955	SAT TT=2.29 ASSIGNMENTS=24656 CHECKS=2896690	SAT TT=0.012 ASSIGNMENTS=9 CHECKS=1094	SAT TT=10.128	SAT TT=0.011 ASSIGNMENTS=1 CHECKS=767	SAT TT=0.019 ASSIGNMENTS=94 CHECKS=10289	SAT TT=3.375	SAT TT=2.168	SAT TT=0.824
csp/allIntervalSeries/ normalized-series-15.xml	SAT TT=0.015	SAT TT=69.795 CHECKS=129056000 NODES=342327	SAT TT=64.78 CHECKS=129145000 NODES=342327	SAT TT=0.052	SAT TT=115.591 CHECKS=509513000	SAT TT=22.237 CHECKS=94409100	SAT TT=1.397 ASSIGNMENTS=1106	SAT TT=1.084 ASSIGNMENTS=56	SAT TT=345.999 CHECKS=723681000 NODES=1099340	SAT TT=73.429 CHECKS=437560000 NODES=1911200	? (TO) TT=1800.08	SAT TT=8.942 ASSIGNMENTS=1106	SAT TT=363.23 ASSIGNMENTS=1639580 CHECKS=770219000	SAT TT=32.124	SAT TT=5.566	SAT TT=8.622 ASSIGNMENTS=71133 CHECKS=10765900	SAT TT=0.106 ASSIGNMENTS=928 CHECKS=119954	? (TO) TT=1800.09	SAT TT=0.015 ASSIGNMENTS=1 CHECKS=1208	SAT TT=0.151 ASSIGNMENTS=1220 CHECKS=174310	SAT TT=337.443	SAT TT=65.561	SAT TT=3.613
csp/allIntervalSeries/ normalized-series-16.xml	SAT TT=0.015	SAT TT=192.347 CHECKS=386221000 NODES=775841	SAT TT=193.628 CHECKS=386377000 NODES=775841	SAT TT=0.052	SAT TT=20.218 CHECKS=93087300	SAT TT=564.099 CHECKS=2790740000	SAT TT=1.079 ASSIGNMENTS=42	SAT TT=1.114 ASSIGNMENTS=6	SAT TT=1755.05 CHECKS=3789000000 NODES=4952830	SAT TT=103.969 CHECKS=584581000 NODES=2250530	? (TO) TT=1800.08	SAT TT=8.387 ASSIGNMENTS=42	SAT TT=511.855 ASSIGNMENTS=1323 CHECKS=166289	SAT TT=293.332	SAT TT=4.222	SAT TT=0.863 ASSIGNMENTS=6550 CHECKS=1002750	SAT TT=0.019 ASSIGNMENTS=42 CHECKS=5917	? (TO) TT=1800.05	SAT TT=0.015 ASSIGNMENTS=1 CHECKS=1377	SAT TT=0.151 ASSIGNMENTS=1323 CHECKS=166289	? (TO) TT=1800.19	SAT TT=3.945	SAT TT=30.232
csp/allIntervalSeries/ normalized-series-18.xml	SAT TT=0.016	? (TO) TT=1800.08	? (TO) TT=1800.14	SAT TT=0.065	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=2.631 ASSIGNMENTS=4139	SAT TT=1.316 ASSIGNMENTS=91	? (TO) TT=1800.03	SAT TT=955.655 CHECKS=5617760000 NODES=17170000	? (TO) TT=1800.08	SAT TT=10.211 ASSIGNMENTS=4139	SAT TT=512.382 ASSIGNMENTS=3463 CHECKS=566291	SAT TT=190.383	SAT TT=13.327	SAT TT=457.807 ASSIGNMENTS=2807590 CHECKS=528970000	SAT TT=0.019 ASSIGNMENTS=1 CHECKS=1748	? (TO) TT=1800.1	SAT TT=0.016 ASSIGNMENTS=1 CHECKS=1748	SAT TT=0.454 ASSIGNMENTS=3463 CHECKS=566291	? (TO) TT=1800.16	SAT TT=327.544	SAT TT=115.297
csp/allIntervalSeries/ normalized-series-20.xml	SAT TT=0.022	? (TO) TT=1800.11	SAT TT=338.246 CHECKS=688420000 NODES=942071	SAT TT=0.071	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=1.657 ASSIGNMENTS=1440	SAT TT=1.205 ASSIGNMENTS=19	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=9.206 ASSIGNMENTS=1440	SAT TT=513.083 ASSIGNMENTS=6771 CHECKS=1368540	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=13.884 ASSIGNMENTS=87320 CHECKS=17166300	SAT TT=0.172 ASSIGNMENTS=1067 CHECKS=189121	? (TO) TT=1800.09	SAT TT=0.022 ASSIGNMENTS=1 CHECKS=2163	SAT TT=1.204 ASSIGNMENTS=6771 CHECKS=1368540	? (TO) TT=1800.17	? (TO) TT=1800.13	SAT TT=1024.22
csp/allIntervalSeries/ normalized-series-25.xml	SAT TT=0.031	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=0.103	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1507.95 ASSIGNMENTS=1826070	SAT TT=1.89 ASSIGNMENTS=111	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=1524.27 ASSIGNMENTS=1826070	SAT TT=515.015 ASSIGNMENTS=11798 CHECKS=3002610	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=186.661 ASSIGNMENTS=853357 CHECKS=207638000	SAT TT=0.159 ASSIGNMENTS=525 CHECKS=125961	? (TO) TT=1800.12	SAT TT=0.031 ASSIGNMENTS=1 CHECKS=3393	SAT TT=2.687 ASSIGNMENTS=11798 CHECKS=3002610	? (TO) TT=1800.2	? (TO) TT=1800.05	? (TO) TT=1800.08
csp/allIntervalSeries/ normalized-series-30.xml	SAT TT=0.039	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=0.135	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=2.259 ASSIGNMENTS=459	SAT TT=2.019 ASSIGNMENTS=12	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=9.521 ASSIGNMENTS=459	SAT TT=512.894 ASSIGNMENTS=2578 CHECKS=713222	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=9.658 ASSIGNMENTS=19341 CHECKS=6642560	SAT TT=0.769 ASSIGNMENTS=2170 CHECKS=581724	? (TO) TT=1800.11	SAT TT=0.039 ASSIGNMENTS=1 CHECKS=4898	SAT TT=0.843 ASSIGNMENTS=2578 CHECKS=713222	? (TO) TT=1800.2	? (TO) TT=1800.05	? (TO) TT=1800.06
csp/allIntervalSeries/ normalized-series-35.xml	SAT TT=0.061	? (TO) TT=1800.15	? (TO) TT=1800.04	SAT TT=0.163	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.13	SAT TT=2.067 ASSIGNMENTS=64	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.01	SAT TT=0.233 ASSIGNMENTS=361 CHECKS=115179	? (TO) TT=1800.09	SAT TT=0.061 ASSIGNMENTS=1 CHECKS=6678	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.06	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allIntervalSeries/ normalized-series-70.xml	SAT TT=0.276	? (TO) TT=1800.06	? (TO) TT=1800.16	SAT TT=0.604	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.02	? (MO) TT=1057.9	? (TO) TT=1800.04	SAT TT=6.169 ASSIGNMENTS=2289 CHECKS=1375520	? (TO) TT=1800.12	SAT TT=0.276 ASSIGNMENTS=1 CHECKS=26838	? (TO) TT=1800.07	? TT=63.443	? (TO) TT=1800.01	? (TO) TT=1800.1
csp/allIntervalSeries/ normalized-series-80.xml	SAT TT=0.409	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=0.857	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=19.625 ASSIGNMENTS=2704	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (MO) TT=1151.8	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=0.409 ASSIGNMENTS=1 CHECKS=35073	? (TO) TT=1800.03	? TT=124.445	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/allIntervalSeries/ normalized-series-8.xml	SAT TT=0.008	SAT TT=0.758 CHECKS=3074 NODES=26	SAT TT=0.786 CHECKS=19140 NODES=107	SAT TT=0.03	SAT TT=0.045 CHECKS=45074	SAT TT=0.023 CHECKS=53567	SAT TT=0.706 ASSIGNMENTS=12	SAT TT=0.727 ASSIGNMENTS=4	SAT TT=0.594 CHECKS=15712 NODES=95	SAT TT=0.59 CHECKS=85743 NODES=1229	SAT TT=0.606 CHECKS=7654 NODES=48	SAT TT=0.025 ASSIGNMENTS=96 CHECKS=7794	SAT TT=0.026 ASSIGNMENTS=96 CHECKS=7794	SAT TT=1.282	SAT TT=1.198	SAT TT=0.014 ASSIGNMENTS=91 CHECKS=7519	SAT TT=0.01 ASSIGNMENTS=17 CHECKS=920	SAT TT=0.371	SAT TT=0.009 ASSIGNMENTS=1 CHECKS=333	SAT TT=0.008 ASSIGNMENTS=11 CHECKS=998	SAT TT=2.117	SAT TT=0.575	SAT TT=0.696
csp/allIntervalSeries/ normalized-series-90.xml	SAT TT=0.526	? (TO) TT=1800.06	? (TO) TT=1800.12	SAT TT=1.076	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (MO) TT=1511.74	? (TO) TT=1800.08	SAT TT=7.14 ASSIGNMENTS=2154 CHECKS=1572860	? (TO) TT=1800.05	SAT TT=0.526 ASSIGNMENTS=1 CHECKS=44408	? (TO) TT=1800.08	? TT=123.138	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/allIntervalSeries/ normalized-series-9.xml	SAT TT=0.007	SAT TT=0.852 CHECKS=28486 NODES=197	SAT TT=0.85 CHECKS=59094 NODES=258	SAT TT=0.035	SAT TT=0.127 CHECKS=252484	SAT TT=0.089 CHECKS=305730	SAT TT=0.781 ASSIGNMENTS=35	SAT TT=0.745 ASSIGNMENTS=7	SAT TT=0.769 CHECKS=151825 NODES=741	SAT TT=0.725 CHECKS=343553 NODES=3987	SAT TT=10.878 CHECKS=69966000 NODES=95857	SAT TT=0.047 ASSIGNMENTS=444 CHECKS=37662	SAT TT=0.048 ASSIGNMENTS=444 CHECKS=37662	SAT TT=1.338	SAT TT=1.362	SAT TT=0.03 ASSIGNMENTS=366 CHECKS=31863	SAT TT=0.013 ASSIGNMENTS=50 CHECKS=4023	SAT TT=0.406	SAT TT=0.007 ASSIGNMENTS=1 CHECKS=425	SAT TT=0.01 ASSIGNMENTS=9 CHECKS=1285	SAT TT=1.894	SAT TT=0.654	SAT TT=0.63
csp/bmc/ normalized-bmc-ibm-01-02.xml	SAT TT=4.363	SAT TT=29.73 CHECKS=241772 NODES=9685	SAT TT=94.841 CHECKS=434684 NODES=9685	SAT TT=14.316	SAT TT=34.04 CHECKS=27432000	SAT TT=23.305 CHECKS=4974480	SAT TT=43.209 ASSIGNMENTS=3047	SAT TT=114.175 ASSIGNMENTS=3680	SAT TT=1029.42 CHECKS=269743 NODES=12023	? (TO) TT=1800.08	SAT TT=829.557 CHECKS=42754500 NODES=847	SAT TT=4.363 ASSIGNMENTS=2982 CHECKS=552844	SAT TT=4.591 ASSIGNMENTS=2982 CHECKS=552844	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=4.68 ASSIGNMENTS=2982 CHECKS=552844	SAT TT=6.708 ASSIGNMENTS=7449 CHECKS=2648600	? (exit code) TT=48.71	SAT TT=542.22 ASSIGNMENTS=179610 CHECKS=389595000	SAT TT=5.099 ASSIGNMENTS=2974 CHECKS=550099	? (TO) TT=1800.12	SAT TT=18.558	SAT TT=20.983
csp/bmc/ normalized-bmc-ibm-01-04.xml	SAT TT=4.88	SAT TT=46.524 CHECKS=277843 NODES=9685	SAT TT=109.15 CHECKS=471661 NODES=9685	SAT TT=14.386	SAT TT=33.861 CHECKS=27276700	SAT TT=26.365 CHECKS=5819680	SAT TT=45.716 ASSIGNMENTS=3047	SAT TT=116.267 ASSIGNMENTS=3594	SAT TT=1079.35 CHECKS=460897 NODES=12023	? (TO) TT=1800.09	SAT TT=1531.44 CHECKS=50592700 NODES=1043	SAT TT=5.337 ASSIGNMENTS=2984 CHECKS=831891	SAT TT=5.142 ASSIGNMENTS=2984 CHECKS=831891	? (problem) TT=618.021	? (problem) TT=615.144	SAT TT=4.88 ASSIGNMENTS=2984 CHECKS=831891	SAT TT=9.558 ASSIGNMENTS=12112 CHECKS=4800940	? (exit code) TT=57.1	SAT TT=755.923 ASSIGNMENTS=216803 CHECKS=463569000	SAT TT=5.072 ASSIGNMENTS=2965 CHECKS=829131	? (TO) TT=1800.08	SAT TT=29.75	SAT TT=31.996
csp/bmc/ normalized-bmc-ibm-01-08.xml	SAT TT=5.184	SAT TT=44.953 CHECKS=296181 NODES=9685	SAT TT=111.373 CHECKS=493586 NODES=9685	SAT TT=13.705	SAT TT=39.282 CHECKS=27589300	SAT TT=24.12 CHECKS=5768100	SAT TT=43.929 ASSIGNMENTS=3047	SAT TT=118.807 ASSIGNMENTS=3466	SAT TT=999.342 CHECKS=755074 NODES=12023	? (TO) TT=1800.04	SAT TT=1044.62 CHECKS=47338100 NODES=940	SAT TT=5.184 ASSIGNMENTS=2964 CHECKS=908579	SAT TT=5.315 ASSIGNMENTS=2964 CHECKS=908579	? (problem) TT=275.489	? (problem) TT=265.126	SAT TT=5.25 ASSIGNMENTS=2964 CHECKS=908579	SAT TT=5.438 ASSIGNMENTS=3221 CHECKS=1190170	? (exit code) TT=59.388	SAT TT=660.8 ASSIGNMENTS=197964 CHECKS=460048000	SAT TT=5.38 ASSIGNMENTS=2942 CHECKS=904546	? (TO) TT=1800.16	SAT TT=47.927	SAT TT=34.211
csp/bmc/ normalized-bmc-ibm-02-02.xml	SAT TT=1.061	SAT TT=4.745 CHECKS=36650 NODES=2810	SAT TT=8.058 CHECKS=80150 NODES=2810	SAT TT=2.764	SAT TT=3.107 CHECKS=2923840	SAT TT=2.447 CHECKS=2583460	SAT TT=9.431 ASSIGNMENTS=524	SAT TT=13.655 ASSIGNMENTS=948	SAT TT=35.609 CHECKS=44487 NODES=3231	SAT TT=48.242 CHECKS=20323500 NODES=150399	SAT TT=29.265 CHECKS=3201460 NODES=301	SAT TT=1.076 ASSIGNMENTS=518 CHECKS=113645	SAT TT=1.14 ASSIGNMENTS=518 CHECKS=113645	Wrong UNSAT TT=23.492	Wrong UNSAT TT=14.86	SAT TT=1.061 ASSIGNMENTS=518 CHECKS=113645	SAT TT=1.064 ASSIGNMENTS=623 CHECKS=116517	Wrong Cert. TT=7.664	SAT TT=1.397 ASSIGNMENTS=977 CHECKS=306968	SAT TT=1.119 ASSIGNMENTS=516 CHECKS=113632	SAT TT=22.403	SAT TT=3.75	SAT TT=3.821
csp/bmc/ normalized-bmc-ibm-02-04.xml	SAT TT=0.959	SAT TT=5.754 CHECKS=42126 NODES=2810	SAT TT=9.114 CHECKS=88133 NODES=2810	SAT TT=2.792	SAT TT=3.265 CHECKS=2893460	SAT TT=2.899 CHECKS=2903340	SAT TT=8.706 ASSIGNMENTS=524	SAT TT=12.488 ASSIGNMENTS=948	SAT TT=93.781 CHECKS=125768 NODES=3231	SAT TT=29.959 CHECKS=236362 NODES=505	SAT TT=29.64 CHECKS=3296770 NODES=293	SAT TT=1.086 ASSIGNMENTS=533 CHECKS=124256	SAT TT=0.959 ASSIGNMENTS=533 CHECKS=124256	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=1.038 ASSIGNMENTS=533 CHECKS=124256	SAT TT=1.098 ASSIGNMENTS=637 CHECKS=126390	Wrong Cert. TT=7.908	SAT TT=1.354 ASSIGNMENTS=1161 CHECKS=340866	SAT TT=1.069 ASSIGNMENTS=523 CHECKS=124238	? (TO) TT=1800.16	SAT TT=5.414	SAT TT=5.485
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bmc/ normalized-bmc-ibm-02-08.xml	SAT TT=1.282	SAT TT=5.867 CHECKS=52577 NODES=2810	SAT TT=9.073 CHECKS=101579 NODES=2810	SAT TT=2.557	SAT TT=3.294 CHECKS=2932360	SAT TT=2.659 CHECKS=2907560	SAT TT=8.76 ASSIGNMENTS=524	SAT TT=13.139 ASSIGNMENTS=948	SAT TT=143.797 CHECKS=251544 NODES=3231	SAT TT=126.996 CHECKS=39298300 NODES=300418	SAT TT=86.334 CHECKS=3272800 NODES=280	SAT TT=1.329 ASSIGNMENTS=516 CHECKS=187140	SAT TT=1.371 ASSIGNMENTS=516 CHECKS=187140	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=1.282 ASSIGNMENTS=516 CHECKS=187140	SAT TT=1.304 ASSIGNMENTS=562 CHECKS=188841	Wrong Cert. TT=8.018	SAT TT=1.497 ASSIGNMENTS=777 CHECKS=278312	SAT TT=1.373 ASSIGNMENTS=515 CHECKS=187129	? (TO) TT=1800.15	SAT TT=6.106	SAT TT=5.86
csp/bmc/ normalized-bmc-ibm-03-02.xml	SAT TT=5.86	SAT TT=56.183 CHECKS=436936 NODES=14957	SAT TT=108.559 CHECKS=520289 NODES=14957	SAT TT=18.366	SAT TT=65.854 CHECKS=28934900	SAT TT=35.799 CHECKS=6301210	SAT TT=61.849 ASSIGNMENTS=3635	SAT TT=156.548 ASSIGNMENTS=4517	SAT TT=1577.42 CHECKS=315108 NODES=19685	? TT=1148.04 CHECKS=362170 NODES=0	? TT=1142.38 CHECKS=356782 NODES=0	SAT TT=5.86 ASSIGNMENTS=3795 CHECKS=504719	SAT TT=6.09 ASSIGNMENTS=3795 CHECKS=504719	Wrong UNSAT TT=505.806	Wrong UNSAT TT=325.438	SAT TT=5.904 ASSIGNMENTS=3808 CHECKS=506554	SAT TT=6.462 ASSIGNMENTS=11113 CHECKS=1282160	? (exit code) TT=89.294	SAT TT=537.923 ASSIGNMENTS=239824 CHECKS=281075000	SAT TT=6.06 ASSIGNMENTS=3918 CHECKS=622129	? (TO) TT=1800.15	SAT TT=20.108	SAT TT=21.912
csp/bmc/ normalized-bmc-ibm-03-04.xml	SAT TT=5.803	SAT TT=99.273 CHECKS=462760 NODES=14957	SAT TT=150.182 CHECKS=546529 NODES=14957	SAT TT=18.885	SAT TT=55.328 CHECKS=28679600	SAT TT=78.729 CHECKS=6617540	SAT TT=57.921 ASSIGNMENTS=3635	SAT TT=157.57 ASSIGNMENTS=4513	SAT TT=1670.73 CHECKS=542517 NODES=19685	? TT=1196.46 CHECKS=776607 NODES=0	? TT=1160.09 CHECKS=778964 NODES=0	SAT TT=6.243 ASSIGNMENTS=3808 CHECKS=639451	SAT TT=5.803 ASSIGNMENTS=3808 CHECKS=639451	? (MO) TT=558.09	? (MO) TT=581.01	SAT TT=6.34 ASSIGNMENTS=3794 CHECKS=641318	SAT TT=21.207 ASSIGNMENTS=94022 CHECKS=13293500	? (exit code) TT=92.785	SAT TT=642.025 ASSIGNMENTS=241310 CHECKS=290346000	SAT TT=6.376 ASSIGNMENTS=3936 CHECKS=756906	? (TO) TT=1800.15	SAT TT=28.599	SAT TT=31.118
csp/bmc/ normalized-bmc-ibm-03-08.xml	SAT TT=6.544	SAT TT=106.126 CHECKS=498560 NODES=14957	SAT TT=150.697 CHECKS=584119 NODES=14957	SAT TT=19.367	SAT TT=51.997 CHECKS=28710300	SAT TT=47.166 CHECKS=6581710	SAT TT=59.177 ASSIGNMENTS=3635	SAT TT=163.291 ASSIGNMENTS=4835	SAT TT=1671.12 CHECKS=864394 NODES=19685	? TT=1476.18 CHECKS=1565200 NODES=0	? TT=1560.13 CHECKS=1561190 NODES=0	SAT TT=6.568 ASSIGNMENTS=3819 CHECKS=858711	SAT TT=20.247 ASSIGNMENTS=3965 CHECKS=1201170	? (problem) TT=789.303	? (problem) TT=737.069	SAT TT=6.544 ASSIGNMENTS=3828 CHECKS=897010	SAT TT=40.231 ASSIGNMENTS=142633 CHECKS=28031200	? (exit code) TT=104.685	SAT TT=835.428 ASSIGNMENTS=184947 CHECKS=391541000	SAT TT=7.395 ASSIGNMENTS=3965 CHECKS=1201170	? (TO) TT=1800.13	SAT TT=33.989	SAT TT=36.581
csp/bmc/ normalized-bmc-ibm-03-16.xml	SAT TT=6.98	SAT TT=104.135 CHECKS=360610 NODES=14930	SAT TT=158.387 CHECKS=452966 NODES=14930	SAT TT=19.451	SAT TT=49.237 CHECKS=28654000	SAT TT=50.234 CHECKS=6544100	SAT TT=57.243 ASSIGNMENTS=3635	SAT TT=160.242 ASSIGNMENTS=4474	SAT TT=1692.16 CHECKS=1483520 NODES=19685	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=20.352 ASSIGNMENTS=3955 CHECKS=1265710	SAT TT=21.55 ASSIGNMENTS=3955 CHECKS=1265710	? (problem) TT=424.216	? (problem) TT=395.496	SAT TT=6.98 ASSIGNMENTS=3823 CHECKS=950673	SAT TT=30.546 ASSIGNMENTS=90097 CHECKS=19382900	? (exit code) TT=95.755	SAT TT=1390.51 ASSIGNMENTS=404901 CHECKS=806402000	SAT TT=7.431 ASSIGNMENTS=3955 CHECKS=1265710	? (TO) TT=1800.12	SAT TT=33.914	SAT TT=33.878
csp/bmc/ normalized-bmc-ibm-04-04.xml	SAT TT=12.94	? TT=160.859	? TT=157.898	SAT TT=43.594	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=135.249 ASSIGNMENTS=5470	? (MO) TT=153.949	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=31.672 ASSIGNMENTS=5364 CHECKS=1433340	SAT TT=30.985 ASSIGNMENTS=5364 CHECKS=1433340	? (problem) TT=1097.55	? (problem) TT=1174.09	SAT TT=12.94 ASSIGNMENTS=5384 CHECKS=1419310	SAT TT=46.786 ASSIGNMENTS=74837 CHECKS=31673100	? (exit code) TT=789.348	? (TO) TT=1800.11	SAT TT=13.02 ASSIGNMENTS=5364 CHECKS=1433340	? (TO) TT=1800.14	SAT TT=115.65	SAT TT=87.319
csp/bmc/ normalized-bmc-ibm-04-16.xml	SAT TT=14.673	? TT=157.649	? TT=157.92	SAT TT=44.017	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=123.756 ASSIGNMENTS=5470	SAT TT=252.862 ASSIGNMENTS=5467	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=31.779 ASSIGNMENTS=5243 CHECKS=1897450	SAT TT=32.391 ASSIGNMENTS=5243 CHECKS=1897450	? (problem) TT=1018.97	? (problem) TT=1033.43	SAT TT=14.765 ASSIGNMENTS=5237 CHECKS=1886310	SAT TT=69.62 ASSIGNMENTS=75978 CHECKS=41013900	? (MO) TT=5.78	? (TO) TT=1800.12	SAT TT=14.673 ASSIGNMENTS=5243 CHECKS=1897450	? (TO) TT=1800.17	SAT TT=212.199	SAT TT=92.351
csp/bmc/ normalized-bmc-ibm-05-02.xml	SAT TT=3.129	SAT TT=27.091 CHECKS=147611 NODES=9396	SAT TT=21.288 CHECKS=159500 NODES=0	SAT TT=10.783	SAT TT=26.531 CHECKS=14047600	SAT TT=21.191 CHECKS=6387210	SAT TT=30.562 ASSIGNMENTS=3109	SAT TT=110.528 ASSIGNMENTS=4111	SAT TT=478.908 CHECKS=178374 NODES=9396	SAT TT=390.93 CHECKS=550424 NODES=764	SAT TT=393.976 CHECKS=24153000 NODES=644	SAT TT=3.197 ASSIGNMENTS=3215 CHECKS=260135	SAT TT=3.246 ASSIGNMENTS=3215 CHECKS=260135	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=3.495 ASSIGNMENTS=3215 CHECKS=260135	SAT TT=3.129 ASSIGNMENTS=3205 CHECKS=242080	? (exit code) TT=33.219	SAT TT=58.428 ASSIGNMENTS=58730 CHECKS=26600500	SAT TT=3.152 ASSIGNMENTS=3229 CHECKS=261404	? (TO) TT=1800.12	SAT TT=10.228	SAT TT=10.498
csp/bmc/ normalized-bmc-ibm-07-08.xml	UNSAT TT=2.231	UNSAT TT=13.522 CHECKS=49 NODES=0	UNSAT TT=14.913 CHECKS=49 NODES=0	UNSAT TT=9.367	UNSAT TT=4.583 CHECKS=133933	UNSAT TT=2.231 CHECKS=133933	UNSAT TT=25.012 ASSIGNMENTS=0	UNSAT TT=24.619 ASSIGNMENTS=0	UNSAT TT=448.335 CHECKS=259635 NODES=0	UNSAT TT=531.494 CHECKS=483036 NODES=0	UNSAT TT=617.988 CHECKS=483036 NODES=0	UNSAT TT=3.126 ASSIGNMENTS=0 CHECKS=127236	UNSAT TT=2.979 ASSIGNMENTS=0 CHECKS=127236	? (problem) TT=808.092	? (problem) TT=783.441	UNSAT TT=3.098 ASSIGNMENTS=0 CHECKS=127236	UNSAT TT=3.248 ASSIGNMENTS=0 CHECKS=127236	? (exit code) TT=35.409	UNSAT TT=3.108 ASSIGNMENTS=0 CHECKS=127236	UNSAT TT=3.073 ASSIGNMENTS=0 CHECKS=127236	? (TO) TT=1800.11	UNSAT TT=16.09	UNSAT TT=19.227
csp/bmc/ normalized-bmc-ibm-07-16.xml	UNSAT TT=2.312	UNSAT TT=13.534 CHECKS=49 NODES=0	UNSAT TT=15.139 CHECKS=49 NODES=0	UNSAT TT=10.158	UNSAT TT=4.519 CHECKS=133933	UNSAT TT=2.312 CHECKS=133933	UNSAT TT=25.216 ASSIGNMENTS=0	UNSAT TT=25.549 ASSIGNMENTS=0	UNSAT TT=447.693 CHECKS=585551 NODES=0	UNSAT TT=574.736 CHECKS=986939 NODES=0	UNSAT TT=602.167 CHECKS=986939 NODES=0	UNSAT TT=3.531 ASSIGNMENTS=0 CHECKS=155836	UNSAT TT=3.296 ASSIGNMENTS=0 CHECKS=155836	? (problem) TT=517.363	? (problem) TT=517.87	UNSAT TT=3.229 ASSIGNMENTS=0 CHECKS=155836	UNSAT TT=3.216 ASSIGNMENTS=0 CHECKS=155836	? (exit code) TT=36.753	UNSAT TT=3.373 ASSIGNMENTS=0 CHECKS=155836	UNSAT TT=3.538 ASSIGNMENTS=0 CHECKS=155836	? (TO) TT=1800.13	UNSAT TT=15.974	UNSAT TT=19.774
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/chessboardColoration/ normalized-cc-10-10-3.xml	SAT TT=6.211	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.11	SAT TT=53.314 CHECKS=10347600 NODES=45500	SAT TT=6.211 CHECKS=5068940 NODES=6872	SAT TT=7.255 CHECKS=6273520 NODES=4189	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=6.254	SAT TT=317.459	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=601.332 ASSIGNMENTS=848702 CHECKS=589533000	? (TO) TT=1800.1	SAT TT=27.442	SAT TT=43.644	SAT TT=156.883
csp/chessboardColoration/ normalized-cc-12-12-2.xml	UNSAT TT=2.717	UNSAT TT=4.249 CHECKS=5614 NODES=241	UNSAT TT=4.332 CHECKS=12150 NODES=51	UNSAT TT=44.694	UNSAT TT=2.717 CHECKS=36232	UNSAT TT=4.616 CHECKS=510235	UNSAT TT=18.938 ASSIGNMENTS=9227	UNSAT TT=20.52 ASSIGNMENTS=9227	UNSAT TT=21.663 CHECKS=301067 NODES=6850	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=11.157 ASSIGNMENTS=2587 CHECKS=1865140	UNSAT TT=11.948 ASSIGNMENTS=3385 CHECKS=91917	UNSAT TT=7.321	UNSAT TT=7.034	UNSAT TT=2.989 ASSIGNMENTS=3028 CHECKS=1734300	UNSAT TT=5.904 ASSIGNMENTS=5665 CHECKS=3443600	? (TO) TT=1800.13	UNSAT TT=5.756 ASSIGNMENTS=6617 CHECKS=3162580	UNSAT TT=3.118 ASSIGNMENTS=2587 CHECKS=1865140	UNSAT TT=5.502	UNSAT TT=3.852	UNSAT TT=4.649
csp/chessboardColoration/ normalized-cc-12-12-3.xml		? (TO) TT=1800.19	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/chessboardColoration/ normalized-cc-15-15-2.xml	UNSAT TT=6.48	UNSAT TT=10.489 CHECKS=6910 NODES=262	UNSAT TT=10.507 CHECKS=29782 NODES=63	UNSAT TT=203.091	UNSAT TT=8.145 CHECKS=122259	UNSAT TT=35.263 CHECKS=3460010	UNSAT TT=53.382 ASSIGNMENTS=12745	UNSAT TT=54.227 ASSIGNMENTS=12745	UNSAT TT=77.255 CHECKS=220005 NODES=5056	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=18.027 ASSIGNMENTS=5663 CHECKS=4971690	UNSAT TT=18.157 ASSIGNMENTS=3406 CHECKS=94710	UNSAT TT=18.576	UNSAT TT=16.046	UNSAT TT=6.48 ASSIGNMENTS=3477 CHECKS=3145880	UNSAT TT=12.259 ASSIGNMENTS=6246 CHECKS=5816370	? (TO) TT=1800.07	UNSAT TT=9.982 ASSIGNMENTS=5885 CHECKS=4680700	UNSAT TT=9.509 ASSIGNMENTS=5663 CHECKS=4971690	UNSAT TT=7.761	UNSAT TT=8.643	UNSAT TT=11.217
csp/chessboardColoration/ normalized-cc-15-15-3.xml		? (MO) TT=9.142	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.23	? (TO) TT=1800.04	? (TO) TT=1800.03
csp/chessboardColoration/ normalized-cc-20-20-2.xml	UNSAT TT=12.75	UNSAT TT=33.961 CHECKS=9410 NODES=297	UNSAT TT=36.618 CHECKS=95702 NODES=83	? (TO) TT=1800.07	UNSAT TT=144.111 CHECKS=37764000	UNSAT TT=333.737 CHECKS=140789000	UNSAT TT=36.973 ASSIGNMENTS=2197	UNSAT TT=40.637 ASSIGNMENTS=2197	UNSAT TT=782.591 CHECKS=215760 NODES=4918	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=22.429 ASSIGNMENTS=2290 CHECKS=5212680	UNSAT TT=35.684 ASSIGNMENTS=3441 CHECKS=99485	UNSAT TT=66.316	UNSAT TT=54.483	UNSAT TT=17.508 ASSIGNMENTS=4624 CHECKS=8640020	UNSAT TT=41.518 ASSIGNMENTS=9486 CHECKS=16818000	? (TO) TT=1800.01	UNSAT TT=24.02 ASSIGNMENTS=5560 CHECKS=9550420	UNSAT TT=14.107 ASSIGNMENTS=2290 CHECKS=5212680	UNSAT TT=12.75	UNSAT TT=25.474	UNSAT TT=31.26
csp/chessboardColoration/ normalized-cc-20-20-3.xml		? (TO) TT=1800.26	? (TO) TT=1800.34	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.08
csp/chessboardColoration/ normalized-cc-5-5-2.xml	UNSAT TT=0.027	UNSAT TT=0.92 CHECKS=896 NODES=64	UNSAT TT=1.661 CHECKS=441 NODES=27	UNSAT TT=0.09	UNSAT TT=0.053 CHECKS=3071	UNSAT TT=0.027 CHECKS=5157	UNSAT TT=2.453 ASSIGNMENTS=5615	UNSAT TT=2.384 ASSIGNMENTS=5615	UNSAT TT=1.159 CHECKS=215134 NODES=3021	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=0.137 ASSIGNMENTS=1111 CHECKS=97184	UNSAT TT=0.125 ASSIGNMENTS=1111 CHECKS=97184	UNSAT TT=1.119	UNSAT TT=0.944	UNSAT TT=0.098 ASSIGNMENTS=998 CHECKS=84392	UNSAT TT=0.349 ASSIGNMENTS=4722 CHECKS=319252	UNSAT TT=4.854	UNSAT TT=0.276 ASSIGNMENTS=2955 CHECKS=214303	UNSAT TT=0.282 ASSIGNMENTS=2950 CHECKS=243957	UNSAT TT=1.815	UNSAT TT=0.971	UNSAT TT=1.095
csp/chessboardColoration/ normalized-cc-5-5-3.xml	SAT TT=0.012	SAT TT=0.914 CHECKS=381 NODES=27	SAT TT=0.865 CHECKS=408 NODES=0	SAT TT=0.065	SAT TT=29.989 CHECKS=18779000	SAT TT=0.025 CHECKS=2879	SAT TT=0.685 ASSIGNMENTS=23	SAT TT=0.749 ASSIGNMENTS=23	SAT TT=0.714 CHECKS=435 NODES=31	SAT TT=0.82 CHECKS=3202 NODES=2	SAT TT=0.723 CHECKS=2897 NODES=0	SAT TT=0.025 ASSIGNMENTS=23 CHECKS=865	SAT TT=0.023 ASSIGNMENTS=23 CHECKS=865	SAT TT=1.355	SAT TT=1.342	SAT TT=0.012 ASSIGNMENTS=23 CHECKS=865	SAT TT=0.013 ASSIGNMENTS=20 CHECKS=643	SAT TT=0.548	SAT TT=0.015 ASSIGNMENTS=63 CHECKS=1760	SAT TT=0.014 ASSIGNMENTS=23 CHECKS=586	SAT TT=1.537	SAT TT=0.867	SAT TT=0.878
csp/chessboardColoration/ normalized-cc-6-6-2.xml	UNSAT TT=0.055	UNSAT TT=1.041 CHECKS=887 NODES=59	UNSAT TT=1.045 CHECKS=926 NODES=30	UNSAT TT=0.2	UNSAT TT=0.114 CHECKS=3468	UNSAT TT=0.055 CHECKS=9848	UNSAT TT=2.818 ASSIGNMENTS=4354	UNSAT TT=3.173 ASSIGNMENTS=4354	UNSAT TT=1.572 CHECKS=217766 NODES=3138	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.208 ASSIGNMENTS=1105 CHECKS=148266	UNSAT TT=0.223 ASSIGNMENTS=1105 CHECKS=148266	UNSAT TT=1.205	UNSAT TT=1.169	UNSAT TT=0.216 ASSIGNMENTS=1205 CHECKS=150030	UNSAT TT=0.736 ASSIGNMENTS=4802 CHECKS=591958	UNSAT TT=11.312	UNSAT TT=0.536 ASSIGNMENTS=3074 CHECKS=423175	UNSAT TT=0.549 ASSIGNMENTS=3042 CHECKS=413083	UNSAT TT=2.199	UNSAT TT=1.242	UNSAT TT=1.489
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/chessboardColoration/ normalized-cc-7-7-2.xml	UNSAT TT=0.26	UNSAT TT=1.389 CHECKS=2259 NODES=113	UNSAT TT=1.292 CHECKS=1771 NODES=35	UNSAT TT=0.304	UNSAT TT=0.26 CHECKS=15303	UNSAT TT=3.315 CHECKS=2371980	UNSAT TT=5.211 ASSIGNMENTS=5697	UNSAT TT=5.151 ASSIGNMENTS=5697	UNSAT TT=2.353 CHECKS=217772 NODES=4948	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=0.531 ASSIGNMENTS=2388 CHECKS=347779	UNSAT TT=0.536 ASSIGNMENTS=2388 CHECKS=347779	UNSAT TT=1.624	UNSAT TT=1.723	UNSAT TT=0.62 ASSIGNMENTS=3113 CHECKS=430894	UNSAT TT=1.264 ASSIGNMENTS=5803 CHECKS=944336	UNSAT TT=26.355	UNSAT TT=0.881 ASSIGNMENTS=3112 CHECKS=595197	UNSAT TT=0.902 ASSIGNMENTS=3105 CHECKS=638351	UNSAT TT=2.553	UNSAT TT=1.424	UNSAT TT=1.832
csp/chessboardColoration/ normalized-cc-8-8-2.xml	UNSAT TT=0.216	UNSAT TT=1.702 CHECKS=9546 NODES=450	UNSAT TT=1.694 CHECKS=2511 NODES=35	UNSAT TT=0.92	UNSAT TT=0.468 CHECKS=26715	UNSAT TT=0.216 CHECKS=29811	UNSAT TT=6.412 ASSIGNMENTS=5697	UNSAT TT=6.278 ASSIGNMENTS=5697	UNSAT TT=3.357 CHECKS=212474 NODES=4885	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.663 ASSIGNMENTS=2226 CHECKS=461689	UNSAT TT=0.689 ASSIGNMENTS=2226 CHECKS=461689	UNSAT TT=2.258	UNSAT TT=2.219	UNSAT TT=0.772 ASSIGNMENTS=2400 CHECKS=503872	UNSAT TT=1.571 ASSIGNMENTS=5077 CHECKS=1185400	UNSAT TT=77.142	UNSAT TT=1.315 ASSIGNMENTS=3108 CHECKS=871327	UNSAT TT=1.212 ASSIGNMENTS=2988 CHECKS=865761	UNSAT TT=3.388	UNSAT TT=1.637	UNSAT TT=1.923
csp/chessboardColoration/ normalized-cc-8-8-3.xml	SAT TT=0.068	SAT TT=1.801 CHECKS=35112 NODES=583	SAT TT=2.178 CHECKS=124855 NODES=2024	SAT TT=203.372	SAT TT=23.023 CHECKS=8782280	SAT TT=19.563 CHECKS=12540200	SAT TT=1.644 ASSIGNMENTS=227	SAT TT=1.998 ASSIGNMENTS=227	SAT TT=1.555 CHECKS=11384 NODES=192	SAT TT=1.451 CHECKS=32963 NODES=22	SAT TT=1.467 CHECKS=38629 NODES=14	SAT TT=7.491 ASSIGNMENTS=44 CHECKS=5675	SAT TT=9.256 ASSIGNMENTS=310 CHECKS=19118	SAT TT=3.656	SAT TT=3.462	? (TO) TT=1800.1	SAT TT=0.07 ASSIGNMENTS=105 CHECKS=14763	? (TO) TT=1800.09	SAT TT=0.098 ASSIGNMENTS=229 CHECKS=24018	SAT TT=0.068 ASSIGNMENTS=44 CHECKS=5675	SAT TT=3.448	SAT TT=1.776	SAT TT=1.777
csp/chessboardColoration/ normalized-cc-9-9-2.xml	UNSAT TT=0.385	UNSAT TT=2.005 CHECKS=4471 NODES=220	UNSAT TT=2.164 CHECKS=3929 NODES=39	UNSAT TT=1.303	UNSAT TT=0.74 CHECKS=18085	UNSAT TT=0.385 CHECKS=49236	UNSAT TT=9.303 ASSIGNMENTS=5653	UNSAT TT=8.498 ASSIGNMENTS=5653	UNSAT TT=6.026 CHECKS=291629 NODES=6632	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.938 ASSIGNMENTS=2121 CHECKS=572385	UNSAT TT=0.967 ASSIGNMENTS=2121 CHECKS=572385	UNSAT TT=3.004	UNSAT TT=3.026	UNSAT TT=0.989 ASSIGNMENTS=2450 CHECKS=618519	UNSAT TT=2.353 ASSIGNMENTS=5074 CHECKS=1622540	UNSAT TT=76.23	UNSAT TT=1.752 ASSIGNMENTS=2877 CHECKS=1087410	UNSAT TT=1.514 ASSIGNMENTS=2765 CHECKS=1026030	UNSAT TT=4.093	UNSAT TT=1.959	UNSAT TT=2.567
csp/chessboardColoration/ normalized-cc-9-9-3.xml	SAT TT=0.2	SAT TT=7.436 CHECKS=1268460 NODES=16368	SAT TT=130.294 CHECKS=35584800 NODES=345696	? (TO) TT=1800.06	SAT TT=32.491 CHECKS=10906600	? (TO) TT=1800.09	SAT TT=4.421 ASSIGNMENTS=1480	SAT TT=3.948 ASSIGNMENTS=1480	SAT TT=3.584 CHECKS=488835 NODES=2590	SAT TT=1.975 CHECKS=121936 NODES=146	SAT TT=2.13 CHECKS=74353 NODES=23	SAT TT=7.796 ASSIGNMENTS=391 CHECKS=134218	SAT TT=11.273 ASSIGNMENTS=4763 CHECKS=569419	SAT TT=4.798	SAT TT=4.58	? (TO) TT=1800.09	SAT TT=0.883 ASSIGNMENTS=2758 CHECKS=663122	? (TO) TT=1800.07	SAT TT=0.2 ASSIGNMENTS=333 CHECKS=78196	SAT TT=0.246 ASSIGNMENTS=391 CHECKS=134218	SAT TT=4.908	SAT TT=3.373	SAT TT=3.743
csp/fischer/ normalized-fischer-10-13-fair.xml		? TT=8.573	? TT=8.522	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.18	? TT=186.293	? (TO) TT=184.03	? (TO) TT=181.75	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.09	? TT=4.474	? (MO) TT=1333.45	? (MO) TT=1453.95
csp/fischer/ normalized-fischer-10-3-fair.xml	UNSAT TT=1.303	? TT=8.385	? TT=8.24	UNSAT TT=3.793	UNSAT TT=3.849 CHECKS=595113	UNSAT TT=1.557 CHECKS=750206	? (TO) TT=1800.12	? (TO) TT=1800.14	? TT=14.437	? (TO) TT=14.33	? (TO) TT=15.35	UNSAT TT=10.189 ASSIGNMENTS=5701 CHECKS=2348860	UNSAT TT=9.687 ASSIGNMENTS=5701 CHECKS=2348860	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=1.303 ASSIGNMENTS=3271 CHECKS=1063190	UNSAT TT=7.046 ASSIGNMENTS=7621 CHECKS=23277400	? (TO) TT=1800.09	UNSAT TT=2.801 ASSIGNMENTS=5759 CHECKS=3650820	UNSAT TT=2.002 ASSIGNMENTS=5701 CHECKS=2348860	? TT=2.57	UNSAT TT=160.569	UNSAT TT=269.585
csp/fischer/ normalized-fischer-10-4-fair.xml	UNSAT TT=8.629	? TT=8.551	? TT=11.688	UNSAT TT=37.466	UNSAT TT=9.773 CHECKS=7435810	UNSAT TT=8.629 CHECKS=6218900	? (TO) TT=1800.08	? (TO) TT=1800.13	? TT=22.087	? (TO) TT=22.84	? (TO) TT=21.48	UNSAT TT=82.879 ASSIGNMENTS=162418 CHECKS=100197000	UNSAT TT=77.143 ASSIGNMENTS=162418 CHECKS=100197000	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=12.218 ASSIGNMENTS=25643 CHECKS=16144800	UNSAT TT=14.39 ASSIGNMENTS=25332 CHECKS=30644600	? (TO) TT=1800.07	UNSAT TT=33.095 ASSIGNMENTS=55030 CHECKS=35295200	UNSAT TT=78.077 ASSIGNMENTS=162418 CHECKS=100197000	? TT=3.254	? (MO) TT=195.02	UNSAT TT=362.817
csp/fischer/ normalized-fischer-10-7-fair.xml		? TT=8.868	? TT=9.425	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.16	? TT=60.352	? (TO) TT=60.95	? (TO) TT=60.39	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=3.542	? (MO) TT=445.02	? (MO) TT=560.75
csp/fischer/ normalized-fischer-10-9-fair.xml		? TT=10.062	? TT=10.159	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.08	? TT=93.049	? (TO) TT=94.9	? (TO) TT=93.37	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=3.619	? (MO) TT=706.661	? (MO) TT=814.34
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fischer/ normalized-fischer-11-10-fair.xml		? TT=8.531	? TT=8.632	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.16	? TT=141.302	? (TO) TT=141.57	? (TO) TT=145.12	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=4.094	? (MO) TT=1126.64	? (MO) TT=1160.38
csp/fischer/ normalized-fischer-11-14-fair.xml		? TT=8.846	? TT=9.45	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.22	? (TO) TT=1800.14	? TT=276.799	? (TO) TT=281.1	? (TO) TT=277.61	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.12	? TT=3.508	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/fischer/ normalized-fischer-11-1-fair.xml	SAT TT=0.267	? TT=8.741	? TT=13.012	SAT TT=1.113	SAT TT=5.554 CHECKS=615038	SAT TT=3.805 CHECKS=2605130	? (TO) TT=1800.07	SAT TT=430.434 ASSIGNMENTS=23909	? TT=6.752	? (TO) TT=6.52	? (TO) TT=6.62	SAT TT=0.368 ASSIGNMENTS=72 CHECKS=406552	SAT TT=0.35 ASSIGNMENTS=72 CHECKS=406552	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.338 ASSIGNMENTS=72 CHECKS=406552	SAT TT=0.267 ASSIGNMENTS=59 CHECKS=90667	SAT TT=375.693	SAT TT=9.248 ASSIGNMENTS=30171 CHECKS=529275	SAT TT=0.309 ASSIGNMENTS=64 CHECKS=224645	? TT=2.213	SAT TT=66.714	SAT TT=117.263
csp/fischer/ normalized-fischer-11-8-fair.xml		? TT=11.755	? TT=10.847	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.11	? TT=94.002	? (TO) TT=94.92	? (TO) TT=96.64	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? TT=3.872	? (MO) TT=738.7	? (MO) TT=810.45
csp/fischer/ normalized-fischer-1-3-fair.xml	UNSAT TT=0.047	? TT=18.857	? TT=19.291	UNSAT TT=0.224	UNSAT TT=1.546 CHECKS=6764	UNSAT TT=0.047 CHECKS=5081	UNSAT TT=1544.87 ASSIGNMENTS=2236150	UNSAT TT=18.489 ASSIGNMENTS=11668	? TT=138.808	? (TO) TT=133.61	? (TO) TT=134.97	UNSAT TT=0.065 ASSIGNMENTS=6 CHECKS=4020	UNSAT TT=0.061 ASSIGNMENTS=6 CHECKS=4020	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.051 ASSIGNMENTS=4 CHECKS=3903	UNSAT TT=0.053 ASSIGNMENTS=18 CHECKS=10371	? (TO) TT=1800.11	UNSAT TT=0.056 ASSIGNMENTS=37 CHECKS=9037	UNSAT TT=0.051 ASSIGNMENTS=6 CHECKS=4020	? TT=33.926	UNSAT TT=5.351	UNSAT TT=16.177
csp/fischer/ normalized-fischer-3-7-fair.xml	UNSAT TT=3.771	? TT=8.697	? TT=8.809	UNSAT TT=107.473	UNSAT TT=244.222 CHECKS=97671000	UNSAT TT=28.176 CHECKS=18782900	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=10.863	? (TO) TT=8.7	? (TO) TT=10.38	UNSAT TT=11.599 ASSIGNMENTS=6232 CHECKS=10829900	UNSAT TT=11.673 ASSIGNMENTS=6232 CHECKS=10829900	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=22.516 ASSIGNMENTS=40623 CHECKS=80133700	? (TO) TT=1800.12	UNSAT TT=248.404 ASSIGNMENTS=567020 CHECKS=391439000	UNSAT TT=3.771 ASSIGNMENTS=6232 CHECKS=10829900	? TT=3.032	UNSAT TT=96.688	UNSAT TT=132.693
csp/fischer/ normalized-fischer-3-8-fair.xml	SAT TT=2.434	? TT=8.956	? TT=8.93	SAT TT=393.921	SAT TT=278.73 CHECKS=104795000	SAT TT=33.395 CHECKS=22408600	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=10.047	? (TO) TT=9.85	? (TO) TT=9.34	SAT TT=10.083 ASSIGNMENTS=2875 CHECKS=5245520	SAT TT=10.465 ASSIGNMENTS=2875 CHECKS=5245520	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=3.729 ASSIGNMENTS=6768 CHECKS=12788300	? (TO) TT=1800.13	SAT TT=6.223 ASSIGNMENTS=5488 CHECKS=21236500	SAT TT=2.434 ASSIGNMENTS=2875 CHECKS=5245520	? TT=3.251	SAT TT=144.583	SAT TT=170.417
csp/fischer/ normalized-fischer-4-3-fair.xml	UNSAT TT=0.217	? TT=11.948	? TT=8.89	UNSAT TT=0.811	UNSAT TT=4.881 CHECKS=204944	UNSAT TT=0.514 CHECKS=236277	? (TO) TT=1800.08	? (TO) TT=1800.17	? TT=6.472	? (TO) TT=7.03	? (TO) TT=6.31	UNSAT TT=0.256 ASSIGNMENTS=112 CHECKS=59002	UNSAT TT=0.233 ASSIGNMENTS=112 CHECKS=59002	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=0.231 ASSIGNMENTS=181 CHECKS=56491	UNSAT TT=3.005 ASSIGNMENTS=4296 CHECKS=12293300	? (TO) TT=1800.11	UNSAT TT=0.295 ASSIGNMENTS=163 CHECKS=371817	UNSAT TT=0.217 ASSIGNMENTS=139 CHECKS=62790	? TT=2.297	UNSAT TT=35.012	UNSAT TT=71.104
csp/fischer/ normalized-fischer-4-5-fair.xml	UNSAT TT=0.671	? TT=10.282	? TT=9.118	UNSAT TT=9.143	UNSAT TT=36.97 CHECKS=20987900	UNSAT TT=3.611 CHECKS=5038490	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=8.496	? (TO) TT=8.16	? (TO) TT=8.34	UNSAT TT=0.697 ASSIGNMENTS=1141 CHECKS=735989	UNSAT TT=0.671 ASSIGNMENTS=1141 CHECKS=735989	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=0.714 ASSIGNMENTS=1293 CHECKS=723542	UNSAT TT=3.152 ASSIGNMENTS=5951 CHECKS=12005700	? (TO) TT=1800.1	UNSAT TT=26.045 ASSIGNMENTS=60371 CHECKS=16227800	UNSAT TT=0.809 ASSIGNMENTS=1515 CHECKS=979529	? TT=2.987	UNSAT TT=79.357	UNSAT TT=115.514
csp/fischer/ normalized-fischer-4-7-fair.xml	UNSAT TT=9.967	? TT=11.144	? TT=8.372	UNSAT TT=741.046	UNSAT TT=232.195 CHECKS=97493600	UNSAT TT=73.521 CHECKS=41031000	? (TO) TT=1800.09	? (TO) TT=1800.13	? TT=11.435	? (TO) TT=11.39	? (TO) TT=12.13	UNSAT TT=32.662 ASSIGNMENTS=37687 CHECKS=75980000	UNSAT TT=35.511 ASSIGNMENTS=37687 CHECKS=75980000	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=9.967 ASSIGNMENTS=13801 CHECKS=28876400	UNSAT TT=31.76 ASSIGNMENTS=45463 CHECKS=96490500	? (TO) TT=1800.1	UNSAT TT=24.947 ASSIGNMENTS=35301 CHECKS=63197700	UNSAT TT=26.709 ASSIGNMENTS=37687 CHECKS=75980000	? TT=2.645	UNSAT TT=146.316	UNSAT TT=241.585
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fischer/ normalized-fischer-5-7-fair.xml	UNSAT TT=35.801	? TT=8.737	? TT=9.728	? (TO) TT=1800.07	UNSAT TT=287.455 CHECKS=107568000	UNSAT TT=171.928 CHECKS=83777100	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=16.55	? (TO) TT=18.59	? (TO) TT=16.5	UNSAT TT=168.788 ASSIGNMENTS=216764 CHECKS=381172000	UNSAT TT=157.893 ASSIGNMENTS=216764 CHECKS=381172000	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=35.801 ASSIGNMENTS=48166 CHECKS=85378200	UNSAT TT=40.134 ASSIGNMENTS=57924 CHECKS=121142000	? (TO) TT=1800.11	UNSAT TT=190.743 ASSIGNMENTS=226285 CHECKS=416922000	UNSAT TT=150.655 ASSIGNMENTS=216764 CHECKS=381172000	? TT=2.649	UNSAT TT=198.9	UNSAT TT=298.366
csp/fischer/ normalized-fischer-6-11-fair.xml	SAT TT=57.416	? TT=9.065	? TT=8.95	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.15	? TT=56.905	? (TO) TT=57.48	? (TO) TT=56.71	SAT TT=217.742 ASSIGNMENTS=97133 CHECKS=639333000	SAT TT=213.87 ASSIGNMENTS=97133 CHECKS=639333000	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=837.111 ASSIGNMENTS=435897 CHECKS=1940240000	SAT TT=207.135 ASSIGNMENTS=97133 CHECKS=639333000	? TT=3.736	? (MO) TT=378.22	? (MO) TT=530.755
csp/fischer/ normalized-fischer-6-4-fair.xml	UNSAT TT=0.899	? TT=9.157	? TT=10.562	UNSAT TT=2.012	UNSAT TT=5.776 CHECKS=2966720	UNSAT TT=2.685 CHECKS=2830600	? (TO) TT=1800.11	? (TO) TT=1800.14	? TT=11.69	? (TO) TT=11.04	? (TO) TT=10.5	UNSAT TT=1.011 ASSIGNMENTS=2019 CHECKS=1056780	UNSAT TT=1.023 ASSIGNMENTS=2019 CHECKS=1056780	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.899 ASSIGNMENTS=1440 CHECKS=644124	UNSAT TT=4.748 ASSIGNMENTS=6571 CHECKS=15436700	? (TO) TT=1800.06	UNSAT TT=1.015 ASSIGNMENTS=1425 CHECKS=758630	UNSAT TT=0.945 ASSIGNMENTS=1858 CHECKS=1033880	? TT=3.209	UNSAT TT=102.584	UNSAT TT=171.396
csp/fischer/ normalized-fischer-6-5-fair.xml	UNSAT TT=3.389	? TT=9.063	? TT=9.249	UNSAT TT=154.066	UNSAT TT=15.592 CHECKS=14647100	UNSAT TT=4.637 CHECKS=5646940	? (TO) TT=1800.14	? (TO) TT=1800.1	? TT=14.585	? (TO) TT=12.93	? (TO) TT=13.88	UNSAT TT=19.167 ASSIGNMENTS=26633 CHECKS=18768600	UNSAT TT=20.392 ASSIGNMENTS=26633 CHECKS=18768600	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=3.389 ASSIGNMENTS=7340 CHECKS=4785990	UNSAT TT=6.601 ASSIGNMENTS=11722 CHECKS=19471500	? (TO) TT=1800.06	UNSAT TT=14.018 ASSIGNMENTS=25574 CHECKS=18226400	UNSAT TT=11.44 ASSIGNMENTS=26633 CHECKS=18768600	? TT=2.534	UNSAT TT=184.09	UNSAT TT=224.696
csp/fischer/ normalized-fischer-6-7-fair.xml	UNSAT TT=119.743	? TT=10.142	? TT=12.806	? (TO) TT=1800.05	UNSAT TT=406.253 CHECKS=137578000	UNSAT TT=536.647 CHECKS=221728000	? (TO) TT=1800.15	? (TO) TT=1800.12	? TT=22.073	? (TO) TT=21.68	? (TO) TT=21.59	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=119.743 ASSIGNMENTS=144660 CHECKS=254227000	UNSAT TT=121.475 ASSIGNMENTS=158668 CHECKS=279944000	? (TO) TT=1800.03	UNSAT TT=438.638 ASSIGNMENTS=487363 CHECKS=744092000	? (TO) TT=1800.07	? TT=3.193	UNSAT TT=345.985	UNSAT TT=383.907
csp/fischer/ normalized-fischer-7-12-fair.xml	SAT TT=1403.18	? TT=8.409	? TT=12.273	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.16	? TT=76.597	? (TO) TT=76.55	? (TO) TT=75.38	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=1403.18 ASSIGNMENTS=549108 CHECKS=2282700000	? (TO) TT=1800.08	? TT=3.701	? (MO) TT=587.561	? (MO) TT=667.26
csp/fischer/ normalized-fischer-7-3-fair.xml	UNSAT TT=0.535	? TT=8.428	? TT=10.713	UNSAT TT=1.515	UNSAT TT=3.654 CHECKS=279351	UNSAT TT=1.465 CHECKS=798091	? (TO) TT=1800.16	? (TO) TT=1800.07	? TT=8.713	? (TO) TT=8.27	? (TO) TT=8.39	UNSAT TT=0.546 ASSIGNMENTS=704 CHECKS=259497	UNSAT TT=0.535 ASSIGNMENTS=704 CHECKS=259497	? (TO) TT=1800.01	? (TO) TT=1800.09	UNSAT TT=0.549 ASSIGNMENTS=777 CHECKS=228418	UNSAT TT=4.566 ASSIGNMENTS=5483 CHECKS=17690900	? (TO) TT=1800.12	UNSAT TT=0.992 ASSIGNMENTS=1011 CHECKS=717541	UNSAT TT=0.575 ASSIGNMENTS=907 CHECKS=338071	? TT=3.16	UNSAT TT=84.829	UNSAT TT=156.302
csp/fischer/ normalized-fischer-7-4-fair.xml	UNSAT TT=1.476	? TT=8.604	? TT=8.645	UNSAT TT=2.869	UNSAT TT=6.846 CHECKS=3903290	UNSAT TT=7.716 CHECKS=3155140	? (TO) TT=1800.12	? (TO) TT=1800.32	? TT=13.155	? (TO) TT=13.94	? (TO) TT=14.07	UNSAT TT=9.769 ASSIGNMENTS=3262 CHECKS=1681260	UNSAT TT=1.908 ASSIGNMENTS=4698 CHECKS=2510770	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=1.476 ASSIGNMENTS=2780 CHECKS=1322900	UNSAT TT=5.667 ASSIGNMENTS=9327 CHECKS=18040100	? (TO) TT=1800.04	UNSAT TT=99.116 ASSIGNMENTS=127928 CHECKS=68389800	UNSAT TT=2.597 ASSIGNMENTS=3262 CHECKS=1681260	? TT=2.573	UNSAT TT=157.091	UNSAT TT=218.708
csp/fischer/ normalized-fischer-8-11-fair.xml		? TT=10.287	? TT=8.935	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.18	? TT=95.659	? (TO) TT=90.72	? (TO) TT=89.81	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.11	? TT=4.115	? (MO) TT=639.262	? (MO) TT=822.97
csp/fischer/ normalized-fischer-8-3-fair.xml	UNSAT TT=0.625	? TT=11.882	? TT=9.592	UNSAT TT=1.903	UNSAT TT=3.635 CHECKS=411782	UNSAT TT=1.057 CHECKS=500543	? (TO) TT=1800.13	? (TO) TT=1800.11	? TT=10.043	? (TO) TT=12.29	? (TO) TT=12.17	UNSAT TT=0.92 ASSIGNMENTS=1862 CHECKS=704939	UNSAT TT=0.812 ASSIGNMENTS=1862 CHECKS=704939	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.625 ASSIGNMENTS=1116 CHECKS=368377	UNSAT TT=4.65 ASSIGNMENTS=6196 CHECKS=17507800	? (TO) TT=1800.12	UNSAT TT=1.392 ASSIGNMENTS=2406 CHECKS=1351640	UNSAT TT=1.076 ASSIGNMENTS=2698 CHECKS=1008890	? TT=3.509	UNSAT TT=101.627	UNSAT TT=179.364
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fischer/ normalized-fischer-9-1-fair.xml	SAT TT=0.248	? TT=9.779	? TT=10.426	SAT TT=0.858	SAT TT=50.08 CHECKS=10428800	SAT TT=4.845 CHECKS=3024060	? (TO) TT=1800.1	SAT TT=17.555 ASSIGNMENTS=2254	? TT=6.171	? (TO) TT=5.45	? (TO) TT=5.47	SAT TT=0.274 ASSIGNMENTS=126 CHECKS=297862	SAT TT=0.276 ASSIGNMENTS=126 CHECKS=297862	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=0.267 ASSIGNMENTS=126 CHECKS=297862	SAT TT=0.248 ASSIGNMENTS=117 CHECKS=168746	SAT TT=57.813	SAT TT=2.559 ASSIGNMENTS=10017 CHECKS=188061	SAT TT=0.259 ASSIGNMENTS=126 CHECKS=218936	? TT=2.004	SAT TT=46.24	SAT TT=96.158
csp/fischer/ normalized-fischer-9-2-fair.xml	UNSAT TT=2.713	? TT=8.487	? TT=8.403	UNSAT TT=57.475	UNSAT TT=6.186 CHECKS=1600900	UNSAT TT=2.713 CHECKS=1589810	? (TO) TT=1800.16	? (TO) TT=1800.06	? TT=9.194	? (TO) TT=8.78	? (TO) TT=9.26	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=1291.43 ASSIGNMENTS=7473280 CHECKS=1320930000	UNSAT TT=14.985 ASSIGNMENTS=28689 CHECKS=59924100	? (TO) TT=1800.08	UNSAT TT=5.422 ASSIGNMENTS=7502 CHECKS=10509300	? (TO) TT=1800.02	? TT=2.898	UNSAT TT=76.46	UNSAT TT=164.58
csp/fischer/ normalized-fischer-9-4-fair.xml	UNSAT TT=5.672	? TT=8.883	? TT=10.321	UNSAT TT=15.213	UNSAT TT=8.973 CHECKS=6207910	UNSAT TT=5.672 CHECKS=4780150	? (TO) TT=1800.12	? (TO) TT=1800.09	? TT=17.785	? (TO) TT=17.39	? (TO) TT=18.12	UNSAT TT=25.756 ASSIGNMENTS=40097 CHECKS=23634500	UNSAT TT=24.505 ASSIGNMENTS=40097 CHECKS=23634500	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=8.405 ASSIGNMENTS=17044 CHECKS=11217400	UNSAT TT=10.866 ASSIGNMENTS=21214 CHECKS=25730400	? (TO) TT=1800.04	UNSAT TT=9.05 ASSIGNMENTS=14040 CHECKS=9230950	UNSAT TT=16.866 ASSIGNMENTS=40097 CHECKS=23634500	? TT=2.837	UNSAT TT=212.554	UNSAT TT=305.81
csp/fischer/ normalized-fischer-9-6-fair.xml	UNSAT TT=125.751	? TT=8.488	? TT=8.554	? (TO) TT=1800.09	UNSAT TT=125.751 CHECKS=61394200	UNSAT TT=358.86 CHECKS=111003000	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=38.227	? (TO) TT=38.14	? (TO) TT=37.94	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=334.426 ASSIGNMENTS=415556 CHECKS=518887000	UNSAT TT=382.529 ASSIGNMENTS=404784 CHECKS=511161000	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.01	? TT=3.319	? (MO) TT=293.34	? (MO) TT=425.74
csp/golombRulerArity3/ normalized-ruler-17-6-a3.xml	SAT TT=0.01	SAT TT=0.922 CHECKS=71934 NODES=39	SAT TT=1.141 CHECKS=472694 NODES=193	SAT TT=0.051	SAT TT=32.071 CHECKS=189270000	SAT TT=3.218 CHECKS=18839000	SAT TT=0.889 ASSIGNMENTS=44	SAT TT=0.873 ASSIGNMENTS=6	SAT TT=0.792 CHECKS=68106 NODES=37	SAT TT=4.183 CHECKS=17628100 NODES=78437	SAT TT=0.775 CHECKS=181419 NODES=438	SAT TT=0.022 ASSIGNMENTS=9 CHECKS=1335	SAT TT=0.022 ASSIGNMENTS=9 CHECKS=1335	SAT TT=1.941	SAT TT=2.004	SAT TT=0.011 ASSIGNMENTS=12 CHECKS=1687	SAT TT=0.01 ASSIGNMENTS=54 CHECKS=4956	SAT TT=0.417	SAT TT=0.022 ASSIGNMENTS=248 CHECKS=18720	SAT TT=0.012 ASSIGNMENTS=41 CHECKS=4762	SAT TT=3.63	SAT TT=0.732	SAT TT=0.756
csp/golombRulerArity3/ normalized-ruler-17-7-a3.xml	UNSAT TT=0.013	UNSAT TT=0.871 CHECKS=748 NODES=0	UNSAT TT=0.845 CHECKS=748 NODES=0	UNSAT TT=0.056	UNSAT TT=0.219 CHECKS=1011840	UNSAT TT=0.04 CHECKS=131682	UNSAT TT=0.851 ASSIGNMENTS=0	UNSAT TT=0.939 ASSIGNMENTS=0	UNSAT TT=1.013 CHECKS=206955 NODES=105	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.165	UNSAT TT=2.045	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.507	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.14	UNSAT TT=0.906	UNSAT TT=0.987
csp/golombRulerArity3/ normalized-ruler-25-7-a3.xml	SAT TT=0.016	SAT TT=1.069 CHECKS=561726 NODES=95	SAT TT=2.548 CHECKS=5037270 NODES=1650	SAT TT=0.222	SAT TT=32.001 CHECKS=203766000	SAT TT=3.361 CHECKS=20990600	SAT TT=2.164 ASSIGNMENTS=1036	SAT TT=1.127 ASSIGNMENTS=7	SAT TT=1.636 CHECKS=1255470 NODES=766	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=0.054 ASSIGNMENTS=482 CHECKS=69702	SAT TT=0.053 ASSIGNMENTS=482 CHECKS=69702	SAT TT=5.024	SAT TT=3.657	SAT TT=0.027 ASSIGNMENTS=277 CHECKS=47129	SAT TT=0.026 ASSIGNMENTS=198 CHECKS=24863	SAT TT=0.583	SAT TT=0.029 ASSIGNMENTS=248 CHECKS=27416	SAT TT=0.016 ASSIGNMENTS=51 CHECKS=8195	SAT TT=7.741	SAT TT=0.94	SAT TT=1.093
csp/golombRulerArity3/ normalized-ruler-25-8-a3.xml	UNSAT TT=0.019	UNSAT TT=0.935 CHECKS=9749 NODES=0	UNSAT TT=0.978 CHECKS=9749 NODES=0	UNSAT TT=0.077	UNSAT TT=30.568 CHECKS=222081000	UNSAT TT=4.039 CHECKS=25736200	UNSAT TT=0.959 ASSIGNMENTS=0	UNSAT TT=1.034 ASSIGNMENTS=0	UNSAT TT=2.405 CHECKS=2898580 NODES=1023	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=5.225	UNSAT TT=5.366	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.846	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=21.933	UNSAT TT=1.296	UNSAT TT=1.64
csp/golombRulerArity3/ normalized-ruler-34-8-a3.xml	SAT TT=0.075	SAT TT=10.579 CHECKS=28958300 NODES=10435	SAT TT=20.538 CHECKS=60744900 NODES=19252	SAT TT=4.59	SAT TT=30.507 CHECKS=220464000	SAT TT=0.841 CHECKS=4430220	SAT TT=9.933 ASSIGNMENTS=9698	SAT TT=1.54 ASSIGNMENTS=201	SAT TT=8.995 CHECKS=17106600 NODES=7420	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=0.075 ASSIGNMENTS=434 CHECKS=100669	SAT TT=0.075 ASSIGNMENTS=434 CHECKS=100669	SAT TT=38.122	SAT TT=17.069	SAT TT=0.075 ASSIGNMENTS=593 CHECKS=139770	SAT TT=0.34 ASSIGNMENTS=1923 CHECKS=420336	SAT TT=0.688	SAT TT=0.62 ASSIGNMENTS=5113 CHECKS=853030	SAT TT=2.02 ASSIGNMENTS=18266 CHECKS=3375350	SAT TT=156.138	SAT TT=1.842	SAT TT=6.921
csp/golombRulerArity3/ normalized-ruler-34-9-a3.xml	UNSAT TT=0.027	UNSAT TT=1.058 CHECKS=23204 NODES=0	UNSAT TT=1.052 CHECKS=23204 NODES=0	UNSAT TT=0.11	UNSAT TT=43.426 CHECKS=279038000	UNSAT TT=11.989 CHECKS=68180900	UNSAT TT=1.427 ASSIGNMENTS=0	UNSAT TT=1.357 ASSIGNMENTS=0	UNSAT TT=17.947 CHECKS=40363200 NODES=10627	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=42.179	UNSAT TT=49.095	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.16	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=323.549	UNSAT TT=4.342	UNSAT TT=5.091
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/golombRulerArity3/ normalized-ruler-44-10-a3.xml	UNSAT TT=0.038	UNSAT TT=1.261 CHECKS=48509 NODES=0	UNSAT TT=1.214 CHECKS=48509 NODES=0	UNSAT TT=0.157	UNSAT TT=149.162 CHECKS=880503000	UNSAT TT=234.877 CHECKS=1165490000	UNSAT TT=1.434 ASSIGNMENTS=0	UNSAT TT=1.359 ASSIGNMENTS=0	UNSAT TT=70.374 CHECKS=185049000 NODES=21303	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=369.002	UNSAT TT=679.142	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=5.798	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.18	UNSAT TT=53.285	UNSAT TT=57.955
csp/golombRulerArity3/ normalized-ruler-44-9-a3.xml	SAT TT=2.18	SAT TT=101.28 CHECKS=338387000 NODES=85284	SAT TT=306.261 CHECKS=912202000 NODES=192760	SAT TT=99.291	SAT TT=160.481 CHECKS=877464000	SAT TT=16.79 CHECKS=93274300	SAT TT=18.087 ASSIGNMENTS=10804	SAT TT=8.453 ASSIGNMENTS=6288	SAT TT=68.181 CHECKS=181104000 NODES=40844	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=106.611 ASSIGNMENTS=85284 CHECKS=338387000	SAT TT=107.545 ASSIGNMENTS=85284 CHECKS=338387000	SAT TT=98.214	SAT TT=235.778	SAT TT=2.18 ASSIGNMENTS=15098 CHECKS=3514780	SAT TT=9.054 ASSIGNMENTS=56230 CHECKS=13240100	SAT TT=2.142	SAT TT=4.541 ASSIGNMENTS=27756 CHECKS=5983490	SAT TT=17.005 ASSIGNMENTS=105241 CHECKS=25440700	? (TO) TT=1800.1	SAT TT=3.605	SAT TT=2.544
csp/golombRulerArity3/ normalized-ruler-55-10-a3.xml	SAT TT=2.627	SAT TT=1518.81 CHECKS=5030680000 NODES=852882	SAT TT=1327.63 CHECKS=4471290000 NODES=815642	SAT TT=1344.27	SAT TT=50.615 CHECKS=312405000	SAT TT=632.905 CHECKS=3374480000	SAT TT=54.158 ASSIGNMENTS=26592	SAT TT=2.627 ASSIGNMENTS=224	SAT TT=212.74 CHECKS=512964000 NODES=82676	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=645.054 ASSIGNMENTS=674738 CHECKS=190649000	SAT TT=643.845 ASSIGNMENTS=674738 CHECKS=190649000	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=17.958 ASSIGNMENTS=75790 CHECKS=25578000	SAT TT=61.987 ASSIGNMENTS=308935 CHECKS=91791700	SAT TT=12.364	SAT TT=33.134 ASSIGNMENTS=171486 CHECKS=48062100	SAT TT=141.823 ASSIGNMENTS=674738 CHECKS=190649000	? (TO) TT=1802.19	SAT TT=80.313	SAT TT=321.18
csp/golombRulerArity3/ normalized-ruler-55-11-a3.xml	UNSAT TT=0.059	? (MO) TT=1.03	? (TO) TT=1800.11	UNSAT TT=0.322	UNSAT TT=651.041 CHECKS=3187240000	UNSAT TT=276.773 CHECKS=1419050000	UNSAT TT=1.898 ASSIGNMENTS=0	UNSAT TT=1.743 ASSIGNMENTS=0	UNSAT TT=758.361 CHECKS=1851230000 NODES=180844	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=0.068 ASSIGNMENTS=1 CHECKS=5347	UNSAT TT=0.073 ASSIGNMENTS=1 CHECKS=5347	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.059 ASSIGNMENTS=1 CHECKS=5347	UNSAT TT=0.072 ASSIGNMENTS=34 CHECKS=20215	UNSAT TT=49.138	UNSAT TT=0.18 ASSIGNMENTS=185 CHECKS=83910	UNSAT TT=0.641 ASSIGNMENTS=426 CHECKS=303910	? (exit code) TT=229.978	UNSAT TT=576.074	UNSAT TT=663.534
csp/golombRulerArity3/ normalized-ruler-67-11-a3.xml	UNSAT TT=481.664	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.14	UNSAT TT=739.711 ASSIGNMENTS=344041	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=1173.04 ASSIGNMENTS=3748360 CHECKS=1707990000	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=481.664 ASSIGNMENTS=1419520 CHECKS=701771000	UNSAT TT=663.864 ASSIGNMENTS=1946100 CHECKS=920254000	UNSAT TT=491.775	? (TO) TT=1800.01	UNSAT TT=1196.01 ASSIGNMENTS=3748360 CHECKS=1707990000	? TT=137.905	? (TO) TT=1800.06	? (TO) TT=1800.08
csp/golombRulerArity3/ normalized-ruler-67-12-a3.xml	UNSAT TT=0.216	? (TO) TT=1800.12	? (TO) TT=1800.13	UNSAT TT=310.414	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=2.542 ASSIGNMENTS=0	UNSAT TT=2.649 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.382 ASSIGNMENTS=158 CHECKS=165599	UNSAT TT=0.384 ASSIGNMENTS=158 CHECKS=165599	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.303 ASSIGNMENTS=116 CHECKS=122632	UNSAT TT=1.586 ASSIGNMENTS=1839 CHECKS=1228210	UNSAT TT=454.412	UNSAT TT=1.785 ASSIGNMENTS=1148 CHECKS=644305	UNSAT TT=0.216 ASSIGNMENTS=62 CHECKS=76810	? TT=122.391	? (TO) TT=1800.04	? (TO) TT=1800.12
csp/golombRulerArity3/ normalized-ruler-70-12-a3.xml	UNSAT TT=2.633	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	UNSAT TT=2.614 ASSIGNMENTS=0	UNSAT TT=2.633 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=479.399 ASSIGNMENTS=983931 CHECKS=605767000	UNSAT TT=938.648 ASSIGNMENTS=983931 CHECKS=605767000	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=306.759 ASSIGNMENTS=758155 CHECKS=458500000	UNSAT TT=408.825 ASSIGNMENTS=987631 CHECKS=542072000	UNSAT TT=581.574	? (TO) TT=1800.09	UNSAT TT=432.31 ASSIGNMENTS=983931 CHECKS=605767000	? (MO) TT=81.524	? (TO) TT=1800.05	? (TO) TT=1800.1
csp/golombRulerArity3/ normalized-ruler-70-13-a3.xml	UNSAT TT=0.109	UNSAT TT=1.557 CHECKS=186374 NODES=0	UNSAT TT=1.606 CHECKS=186374 NODES=0	UNSAT TT=0.409	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=2.441 ASSIGNMENTS=0	UNSAT TT=2.214 ASSIGNMENTS=0	UNSAT TT=1730.48 CHECKS=5479830000 NODES=120218	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=0.115 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.126 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.109 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.111 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=702.199	UNSAT TT=0.111 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.114 ASSIGNMENTS=0 CHECKS=1	? TT=121.619	? (TO) TT=1800.03	? (TO) TT=1800.12
csp/golombRulerArity4/ normalized-ruler-17-6-a4.xml	SAT TT=0.015	SAT TT=0.857 CHECKS=6556 NODES=10	SAT TT=0.804 CHECKS=15322 NODES=12	SAT TT=0.041	SAT TT=0.019 CHECKS=21000	SAT TT=0.015 CHECKS=20440	SAT TT=0.876 ASSIGNMENTS=159	SAT TT=0.803 ASSIGNMENTS=33	SAT TT=1.826 CHECKS=30378 NODES=151	SAT TT=1.204 CHECKS=375267 NODES=504	SAT TT=0.815 CHECKS=86307 NODES=93	SAT TT=0.035 ASSIGNMENTS=52 CHECKS=25072	SAT TT=0.036 ASSIGNMENTS=52 CHECKS=25072	SAT TT=7.232	SAT TT=7.27	SAT TT=0.125 ASSIGNMENTS=399 CHECKS=180087	SAT TT=0.304 ASSIGNMENTS=3599 CHECKS=539305	SAT TT=0.445	SAT TT=0.37 ASSIGNMENTS=3182 CHECKS=560361	SAT TT=0.037 ASSIGNMENTS=124 CHECKS=60616	SAT TT=9.911	SAT TT=1.057	SAT TT=2.043
csp/golombRulerArity4/ normalized-ruler-17-7-a4.xml	UNSAT TT=0.064	UNSAT TT=1.088 CHECKS=167936 NODES=285	UNSAT TT=1.126 CHECKS=186965 NODES=290	UNSAT TT=0.064	UNSAT TT=32.135 CHECKS=199230000	UNSAT TT=0.083 CHECKS=271584	UNSAT TT=1.243 ASSIGNMENTS=271	UNSAT TT=1.066 ASSIGNMENTS=150	UNSAT TT=3.706 CHECKS=83261 NODES=200	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.185 ASSIGNMENTS=268 CHECKS=250493	UNSAT TT=0.172 ASSIGNMENTS=268 CHECKS=250493	UNSAT TT=14.574	UNSAT TT=13.128	UNSAT TT=0.247 ASSIGNMENTS=342 CHECKS=313200	UNSAT TT=0.343 ASSIGNMENTS=3245 CHECKS=579763	UNSAT TT=0.643	UNSAT TT=13.25 ASSIGNMENTS=82632 CHECKS=27788100	UNSAT TT=0.15 ASSIGNMENTS=256 CHECKS=243327	UNSAT TT=21.605	UNSAT TT=1.811	UNSAT TT=2.982
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/golombRulerArity4/ normalized-ruler-25-7-a4.xml	SAT TT=0.062	SAT TT=0.962 CHECKS=64052 NODES=55	SAT TT=1.016 CHECKS=121496 NODES=138	SAT TT=0.062	SAT TT=0.874 CHECKS=3446860	SAT TT=0.624 CHECKS=2417890	SAT TT=1.21 ASSIGNMENTS=248	SAT TT=1.072 ASSIGNMENTS=46	SAT TT=12.425 CHECKS=231236 NODES=520	SAT TT=1.589 CHECKS=677417 NODES=326	SAT TT=1.385 CHECKS=105646 NODES=27	SAT TT=0.269 ASSIGNMENTS=441 CHECKS=358265	SAT TT=0.293 ASSIGNMENTS=441 CHECKS=358265	SAT TT=47.807	SAT TT=33.464	SAT TT=2.519 ASSIGNMENTS=3332 CHECKS=2844560	SAT TT=3.159 ASSIGNMENTS=7421 CHECKS=4052060	SAT TT=0.642	SAT TT=36.49 ASSIGNMENTS=193090 CHECKS=69831200	SAT TT=2.806 ASSIGNMENTS=4521 CHECKS=3598020	SAT TT=75.282	SAT TT=3.272	SAT TT=11.247
csp/golombRulerArity4/ normalized-ruler-25-8-a4.xml	UNSAT TT=0.167	UNSAT TT=3.228 CHECKS=2205720 NODES=1924	UNSAT TT=2.941 CHECKS=1732700 NODES=1571	UNSAT TT=0.167	UNSAT TT=5.102 CHECKS=19713900	UNSAT TT=7.647 CHECKS=31201300	UNSAT TT=4.001 ASSIGNMENTS=2675	UNSAT TT=2.341 ASSIGNMENTS=1043	UNSAT TT=22.018 CHECKS=933192 NODES=1235	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=10.752 ASSIGNMENTS=1924 CHECKS=2205720	UNSAT TT=10.883 ASSIGNMENTS=1924 CHECKS=2205720	UNSAT TT=110.984	UNSAT TT=112.156	UNSAT TT=3.891 ASSIGNMENTS=2323 CHECKS=3879680	UNSAT TT=3.469 ASSIGNMENTS=4952 CHECKS=3753680	UNSAT TT=0.739	UNSAT TT=131.548 ASSIGNMENTS=454104 CHECKS=258182000	UNSAT TT=2.784 ASSIGNMENTS=2119 CHECKS=3283420	UNSAT TT=137.678	UNSAT TT=23.456	UNSAT TT=42.059
csp/golombRulerArity4/ normalized-ruler-34-8-a4.xml	SAT TT=0.171	SAT TT=1.302 CHECKS=285828 NODES=221	SAT TT=1.486 CHECKS=429803 NODES=408	SAT TT=0.171	SAT TT=38.665 CHECKS=194940000	SAT TT=6.829 CHECKS=25613600	SAT TT=3.337 ASSIGNMENTS=1714	SAT TT=3.093 ASSIGNMENTS=1714	SAT TT=76.302 CHECKS=12241200 NODES=20022	SAT TT=7.284 CHECKS=9428430 NODES=2152	SAT TT=3.759 CHECKS=2601190 NODES=550	SAT TT=8.397 ASSIGNMENTS=221 CHECKS=285828	SAT TT=8.94 ASSIGNMENTS=221 CHECKS=285828	SAT TT=416.736	SAT TT=100.33	SAT TT=3.914 ASSIGNMENTS=2339 CHECKS=3610100	SAT TT=47.726 ASSIGNMENTS=32077 CHECKS=42293600	SAT TT=0.723	SAT TT=288.439 ASSIGNMENTS=735982 CHECKS=482836000	SAT TT=11.873 ASSIGNMENTS=7804 CHECKS=11220800	SAT TT=502.436	SAT TT=16.031	SAT TT=41.31
csp/golombRulerArity4/ normalized-ruler-34-9-a4.xml	UNSAT TT=1.607	UNSAT TT=30.542 CHECKS=27699300 NODES=16325	UNSAT TT=26.796 CHECKS=25650800 NODES=15770	UNSAT TT=1.607	UNSAT TT=95.692 CHECKS=400410000	UNSAT TT=103.372 CHECKS=374609000	UNSAT TT=32.469 ASSIGNMENTS=21235	UNSAT TT=32.768 ASSIGNMENTS=21235	UNSAT TT=74.057 CHECKS=10035600 NODES=8731	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=35.791 ASSIGNMENTS=16325 CHECKS=27699300	UNSAT TT=38.519 ASSIGNMENTS=16325 CHECKS=27699300	UNSAT TT=922.554	UNSAT TT=1653.62	UNSAT TT=41.325 ASSIGNMENTS=10874 CHECKS=29474600	UNSAT TT=61.034 ASSIGNMENTS=18485 CHECKS=42834300	UNSAT TT=1.148	UNSAT TT=1210.33 ASSIGNMENTS=1765970 CHECKS=1623110000	UNSAT TT=28.926 ASSIGNMENTS=10112 CHECKS=24333200	UNSAT TT=922.127	UNSAT TT=238.561	UNSAT TT=632.384
csp/golombRulerArity4/ normalized-ruler-44-10-a4.xml	UNSAT TT=8.721	UNSAT TT=242.735 CHECKS=235085000 NODES=82017	UNSAT TT=165.991 CHECKS=137337000 NODES=52987	UNSAT TT=8.721	UNSAT TT=240.374 CHECKS=871265000	UNSAT TT=122.873 CHECKS=475470000	UNSAT TT=629.815 ASSIGNMENTS=229488	UNSAT TT=637.048 ASSIGNMENTS=229488	UNSAT TT=161.465 CHECKS=82702700 NODES=39955	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=257.504 ASSIGNMENTS=82017 CHECKS=235085000	UNSAT TT=250.999 ASSIGNMENTS=82017 CHECKS=235085000	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=302.217 ASSIGNMENTS=46039 CHECKS=166675000	UNSAT TT=543.122 ASSIGNMENTS=71448 CHECKS=280312000	UNSAT TT=4.986	? (TO) TT=1800.09	UNSAT TT=440.378 ASSIGNMENTS=62868 CHECKS=225770000	? (TO) TT=1801.9	? (TO) TT=1800.02	? (TO) TT=1800.08
csp/golombRulerArity4/ normalized-ruler-44-9-a4.xml	SAT TT=3.076	SAT TT=7.169 CHECKS=5585320 NODES=3629	SAT TT=5.018 CHECKS=3567980 NODES=2377	SAT TT=3.076	SAT TT=150.526 CHECKS=550404000	SAT TT=84.71 CHECKS=305916000	SAT TT=93.246 ASSIGNMENTS=38459	SAT TT=102.311 ASSIGNMENTS=38459	SAT TT=191.33 CHECKS=107111000 NODES=105570	SAT TT=76.216 CHECKS=124061000 NODES=14410	? (TO) TT=1800.07	SAT TT=13.696 ASSIGNMENTS=3629 CHECKS=5585320	SAT TT=14.446 ASSIGNMENTS=3629 CHECKS=5585320	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=36.506 ASSIGNMENTS=11429 CHECKS=26049900	SAT TT=431.533 ASSIGNMENTS=114754 CHECKS=263194000	SAT TT=2.166	? (TO) TT=1800.03	SAT TT=641.168 ASSIGNMENTS=187356 CHECKS=435448000	? (TO) TT=1802.2	SAT TT=127.626	SAT TT=1716.08
csp/golombRulerArity4/ normalized-ruler-55-10-a4.xml	SAT TT=10.948	SAT TT=22.868 CHECKS=18865400 NODES=8611	SAT TT=10.948 CHECKS=7960140 NODES=3105	SAT TT=53.028	SAT TT=1034.9 CHECKS=3735620000	SAT TT=866.744 CHECKS=2908610000	SAT TT=180.562 ASSIGNMENTS=66901	SAT TT=183.187 ASSIGNMENTS=66901	SAT TT=191.182 CHECKS=105709000 NODES=40275	SAT TT=1034.52 CHECKS=1759330000 NODES=112358	? (TO) TT=1800.09	SAT TT=28.671 ASSIGNMENTS=8611 CHECKS=18865400	SAT TT=29.087 ASSIGNMENTS=8611 CHECKS=18865400	? (MO) TT=764.52	? (MO) TT=726.7	SAT TT=256.806 ASSIGNMENTS=40183 CHECKS=138122000	SAT TT=328.621 ASSIGNMENTS=49815 CHECKS=163775000	SAT TT=11.704	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.88	? (TO) TT=1800.1	? (TO) TT=1800.08
csp/golombRulerArity4/ normalized-ruler-55-11-a4.xml	UNSAT TT=126.19	? (TO) TT=1800.16	UNSAT TT=1568.97 CHECKS=1326640000 NODES=340090	UNSAT TT=126.19	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.14	UNSAT TT=720.487 ASSIGNMENTS=208157	UNSAT TT=957.629 CHECKS=761886000 NODES=260086	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.04	? (MO) TT=1098.55	? (MO) TT=1205.89	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=17.956	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1801.04	? (TO) TT=1800.27	? (TO) TT=1800.11
csp/golombRulerArity4/ normalized-ruler-67-11-a4.xml		? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=427.536	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1801.28	? (MO) TT=62.96	? (MO) TT=258.11
csp/golombRulerArity4/ normalized-ruler-67-12-a4.xml	UNSAT TT=427.269	? (TO) TT=1800.16	? (TO) TT=1800.12	UNSAT TT=427.269	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=156.998	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1801.76	? (MO) TT=87.96	? (MO) TT=258.87
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/golombRulerArity4/ normalized-ruler-70-12-a4.xml		? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=455.772	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.54	? (MO) TT=89.48	? (MO) TT=284.33
csp/golombRulerArity4/ normalized-ruler-70-13-a4.xml	UNSAT TT=860.676	? (TO) TT=1800.09	? (TO) TT=1800.14	UNSAT TT=860.676	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=166.862	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1801.72	? (MO) TT=131.149	? (MO) TT=296.602
csp/graceful/ normalized-graceful--K4-P2.xml	SAT TT=0.022	SAT TT=4.034 CHECKS=8857960 NODES=4514	SAT TT=3.123 CHECKS=6251660 NODES=3627	? (TO) TT=1800.11	SAT TT=0.446 CHECKS=1994830	SAT TT=0.61 CHECKS=2677860	SAT TT=0.906 ASSIGNMENTS=40	SAT TT=0.857 ASSIGNMENTS=17	SAT TT=1.208 CHECKS=753993 NODES=1071	SAT TT=5.363 CHECKS=25780700 NODES=95296	? (TO) TT=1800.09	SAT TT=0.163 ASSIGNMENTS=995 CHECKS=128318	SAT TT=0.163 ASSIGNMENTS=995 CHECKS=128318	SAT TT=5.051	SAT TT=2.235	SAT TT=0.142 ASSIGNMENTS=1048 CHECKS=120877	SAT TT=0.033 ASSIGNMENTS=212 CHECKS=21967	SAT TT=1339.6	SAT TT=0.117 ASSIGNMENTS=806 CHECKS=85848	SAT TT=0.022 ASSIGNMENTS=97 CHECKS=11849	SAT TT=4.143	SAT TT=0.808	SAT TT=1.287
csp/lexHerald/ normalized-crossword-m1-lex-05-01.xml	SAT TT=0.418	SAT TT=1.036 CHECKS=18787 NODES=96	SAT TT=1.414 CHECKS=129622 NODES=401	SAT TT=3.723	SAT TT=0.651 CHECKS=12998	SAT TT=0.568 CHECKS=13433	SAT TT=9.235 ASSIGNMENTS=786	SAT TT=1.73 ASSIGNMENTS=10	SAT TT=66.942 CHECKS=69865000 NODES=87	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=17.073 ASSIGNMENTS=786	SAT TT=8.126 ASSIGNMENTS=627 CHECKS=249532	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=6.474 ASSIGNMENTS=7815 CHECKS=3876700	SAT TT=1.852 ASSIGNMENTS=9359 CHECKS=971161	SAT TT=1.476	SAT TT=0.418 ASSIGNMENTS=600 CHECKS=216831	SAT TT=0.443 ASSIGNMENTS=627 CHECKS=249532	? (MO) TT=30.602	SAT TT=19.376	SAT TT=21.277
csp/lexHerald/ normalized-crossword-m1-lex-05-05.xml	SAT TT=0.031	SAT TT=0.996 CHECKS=6381 NODES=22	SAT TT=0.877 CHECKS=10499 NODES=22	SAT TT=0.778	SAT TT=0.275 CHECKS=3812	SAT TT=0.235 CHECKS=3941	SAT TT=1.303 ASSIGNMENTS=122	SAT TT=1.129 ASSIGNMENTS=11	SAT TT=115.396 CHECKS=6073740 NODES=17	SAT TT=48.049 CHECKS=5385310 NODES=1950020	SAT TT=111.204 CHECKS=119153000 NODES=17153	SAT TT=0.484 ASSIGNMENTS=2319 CHECKS=417902	SAT TT=0.486 ASSIGNMENTS=2319 CHECKS=417902	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=0.402 ASSIGNMENTS=1796 CHECKS=316642	SAT TT=0.081 ASSIGNMENTS=404 CHECKS=35936	SAT TT=0.723	SAT TT=0.031 ASSIGNMENTS=68 CHECKS=6483	SAT TT=0.032 ASSIGNMENTS=110 CHECKS=10499	? (MO) TT=37.787	SAT TT=2.26	SAT TT=2.676
csp/lexHerald/ normalized-crossword-m1-lex-05-06.xml	SAT TT=0.028	SAT TT=0.921 CHECKS=2391 NODES=25	SAT TT=0.903 CHECKS=4114 NODES=25	SAT TT=2.413	SAT TT=0.4 CHECKS=3486	SAT TT=0.353 CHECKS=3500	SAT TT=4.279 ASSIGNMENTS=498	SAT TT=1.355 ASSIGNMENTS=19	SAT TT=99.699 CHECKS=17986800 NODES=27	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=11.731 ASSIGNMENTS=498	SAT TT=11.357 ASSIGNMENTS=498	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=3.444 ASSIGNMENTS=5619 CHECKS=1058470	SAT TT=1.575 ASSIGNMENTS=5644 CHECKS=560596	SAT TT=0.79	SAT TT=0.028 ASSIGNMENTS=38 CHECKS=3438	SAT TT=0.066 ASSIGNMENTS=143 CHECKS=15881	? (MO) TT=33.971	SAT TT=5.236	SAT TT=7.376
csp/lexHerald/ normalized-crossword-m1-lex-05-09.xml	SAT TT=0.019	SAT TT=0.852 CHECKS=2077 NODES=20	SAT TT=0.854 CHECKS=1737 NODES=0	SAT TT=1.037	SAT TT=0.23 CHECKS=1259	SAT TT=0.233 CHECKS=1522	SAT TT=1.38 ASSIGNMENTS=163	SAT TT=0.952 ASSIGNMENTS=10	SAT TT=122.873 CHECKS=6459080 NODES=21	SAT TT=78.469 CHECKS=8258500 NODES=3600140	SAT TT=108.639 CHECKS=22229900 NODES=1807	SAT TT=0.295 ASSIGNMENTS=835 CHECKS=83953	SAT TT=0.292 ASSIGNMENTS=835 CHECKS=83953	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=0.254 ASSIGNMENTS=627 CHECKS=65526	SAT TT=0.019 ASSIGNMENTS=5 CHECKS=489	SAT TT=0.568	SAT TT=0.028 ASSIGNMENTS=46 CHECKS=2728	SAT TT=0.046 ASSIGNMENTS=154 CHECKS=10251	? (MO) TT=40.181	SAT TT=2.619	SAT TT=3.499
csp/lexHerald/ normalized-crossword-m1-lex-05-10.xml	SAT TT=0.018	SAT TT=0.831 CHECKS=3735 NODES=17	SAT TT=0.864 CHECKS=2824 NODES=0	SAT TT=0.788	SAT TT=0.216 CHECKS=2571	SAT TT=0.134 CHECKS=1506	SAT TT=1.283 ASSIGNMENTS=142	SAT TT=0.957 ASSIGNMENTS=10	SAT TT=128.76 CHECKS=5780890 NODES=19	SAT TT=71.398 CHECKS=12264000 NODES=43950000	SAT TT=74.675 CHECKS=15291600 NODES=1808	SAT TT=0.357 ASSIGNMENTS=1540 CHECKS=270899	SAT TT=0.355 ASSIGNMENTS=1540 CHECKS=270899	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.553 ASSIGNMENTS=2330 CHECKS=417960	SAT TT=0.018 ASSIGNMENTS=11 CHECKS=1052	SAT TT=0.632	SAT TT=0.024 ASSIGNMENTS=29 CHECKS=3176	SAT TT=0.027 ASSIGNMENTS=75 CHECKS=6665	? TT=91.799	SAT TT=2.264	SAT TT=2.633
csp/lexHerald/ normalized-crossword-m1-lex-15-03.xml	SAT TT=0.217	SAT TT=3.723 CHECKS=451693 NODES=808	SAT TT=2.782 CHECKS=203731 NODES=200	? (TO) TT=1800.13	SAT TT=8.436 CHECKS=232924	SAT TT=8.774 CHECKS=611707	SAT TT=12.13 ASSIGNMENTS=79	SAT TT=61.674 ASSIGNMENTS=264	SAT TT=437.681 CHECKS=1808380000 NODES=412	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=0.256 ASSIGNMENTS=74 CHECKS=112311	SAT TT=0.259 ASSIGNMENTS=74 CHECKS=112311	? (TO) TT=1800.11	? (TO) TT=1800.09	SAT TT=0.217 ASSIGNMENTS=60 CHECKS=75949	SAT TT=20.205 ASSIGNMENTS=19830 CHECKS=24677700	? (TO) TT=1800.01	SAT TT=49.78 ASSIGNMENTS=30186 CHECKS=27135400	SAT TT=0.601 ASSIGNMENTS=347 CHECKS=433695	? (MO) TT=33.931	SAT TT=583.863	? (TO) TT=1800.1
csp/lexHerald/ normalized-crossword-m1-lex-15-04.xml	UNSAT TT=1.608	UNSAT TT=11.64 CHECKS=1902950 NODES=4951	UNSAT TT=7.381 CHECKS=485064 NODES=2299	? (TO) TT=1800.08	UNSAT TT=29.944 CHECKS=1705940	UNSAT TT=14.108 CHECKS=1097550	UNSAT TT=21.806 ASSIGNMENTS=0	UNSAT TT=28.002 ASSIGNMENTS=0	UNSAT TT=1107.29 CHECKS=6570340000 NODES=1316	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=19.79 ASSIGNMENTS=4951 CHECKS=1902950	UNSAT TT=17.717 ASSIGNMENTS=4951 CHECKS=1902950	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=1.608 ASSIGNMENTS=606 CHECKS=1300030	UNSAT TT=13.909 ASSIGNMENTS=7960 CHECKS=9925820	UNSAT TT=8.32	UNSAT TT=11.008 ASSIGNMENTS=3266 CHECKS=7793880	UNSAT TT=1.814 ASSIGNMENTS=463 CHECKS=1291450	? (MO) TT=37.824	UNSAT TT=735.255	UNSAT TT=503.359
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexHerald/ normalized-crossword-m1-lex-15-05.xml	SAT TT=0.268	SAT TT=2.478 CHECKS=174192 NODES=189	SAT TT=3.228 CHECKS=349278 NODES=334	SAT TT=1161.83	SAT TT=44.178 CHECKS=2649060	SAT TT=6.993 CHECKS=521272	SAT TT=12.297 ASSIGNMENTS=91	SAT TT=62.35 ASSIGNMENTS=57	SAT TT=223.569 CHECKS=667871000 NODES=453	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.297 ASSIGNMENTS=108 CHECKS=144862	SAT TT=0.283 ASSIGNMENTS=108 CHECKS=144862	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=0.327 ASSIGNMENTS=173 CHECKS=229543	SAT TT=17.543 ASSIGNMENTS=12298 CHECKS=22138500	SAT TT=20.109	SAT TT=95.833 ASSIGNMENTS=52996 CHECKS=48824600	SAT TT=0.268 ASSIGNMENTS=107 CHECKS=144633	? (MO) TT=31.4	SAT TT=313.94	? (TO) TT=1800.03
csp/lexHerald/ normalized-crossword-m1-lex-15-07.xml	SAT TT=11.293	SAT TT=17.613 CHECKS=3581190 NODES=7324	SAT TT=60.213 CHECKS=16093000 NODES=26775	? (TO) TT=1800.05	SAT TT=86.262 CHECKS=3896450	SAT TT=107.417 CHECKS=6199500	SAT TT=39.872 ASSIGNMENTS=2012	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=41.897 ASSIGNMENTS=11470 CHECKS=16897400	SAT TT=116.223 ASSIGNMENTS=48839 CHECKS=32646700	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=11.293 ASSIGNMENTS=3123 CHECKS=5013950	SAT TT=511.508 ASSIGNMENTS=198214 CHECKS=254744000	? (TO) TT=1800	SAT TT=116.261 ASSIGNMENTS=40983 CHECKS=45057400	SAT TT=33.732 ASSIGNMENTS=11470 CHECKS=16897400	? (MO) TT=32.115	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/lexHerald/ normalized-crossword-m1-lex-15-09.xml	SAT TT=0.202	SAT TT=2.383 CHECKS=126350 NODES=368	SAT TT=2.878 CHECKS=221545 NODES=362	? (TO) TT=1800.07	SAT TT=8.379 CHECKS=191646	SAT TT=6.265 CHECKS=146823	SAT TT=9.325 ASSIGNMENTS=91	SAT TT=42.989 ASSIGNMENTS=177	SAT TT=283.501 CHECKS=826296000 NODES=414	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT TT=0.213 ASSIGNMENTS=77 CHECKS=72829	SAT TT=0.214 ASSIGNMENTS=77 CHECKS=72829	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=0.202 ASSIGNMENTS=76 CHECKS=74439	SAT TT=15.897 ASSIGNMENTS=18918 CHECKS=19043600	SAT TT=23.655	SAT TT=42.172 ASSIGNMENTS=31691 CHECKS=22246500	SAT TT=0.455 ASSIGNMENTS=340 CHECKS=336082	? (MO) TT=43.413	SAT TT=975.246	? (TO) TT=1800.01
csp/lexHerald/ normalized-crossword-m1-lex-19-03.xml	SAT TT=71.437	SAT TT=147.472 CHECKS=36729500 NODES=85434	SAT TT=71.437 CHECKS=14985600 NODES=41201	? (TO) TT=1800.1	SAT TT=391.963 CHECKS=42224200	SAT TT=1096.19 CHECKS=133928000	? (TO) TT=1800.15	? (TO) TT=1800.09	SAT TT=815.439 CHECKS=449591000 NODES=11872	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=105.106 ASSIGNMENTS=48894 CHECKS=23590800	SAT TT=112.3 ASSIGNMENTS=48894 CHECKS=23590800	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=637.39 ASSIGNMENTS=184969 CHECKS=315635000	SAT TT=432.318 ASSIGNMENTS=127767 CHECKS=300676000	? (MO) TT=36.206	? (TO) TT=1800.07	? (TO) TT=1800.07
csp/lexHerald/ normalized-crossword-m1-lex-19-06.xml	SAT TT=0.466	SAT TT=4.966 CHECKS=772627 NODES=812	SAT TT=6.031 CHECKS=956265 NODES=803	? (TO) TT=1800.12	SAT TT=11.769 CHECKS=755822	SAT TT=8.725 CHECKS=633577	SAT TT=21.718 ASSIGNMENTS=127	SAT TT=74.735 ASSIGNMENTS=550	SAT TT=263.124 CHECKS=682795000 NODES=800	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=0.487 ASSIGNMENTS=162 CHECKS=274165	SAT TT=0.466 ASSIGNMENTS=162 CHECKS=274165	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=0.5 ASSIGNMENTS=161 CHECKS=308193	SAT TT=14.098 ASSIGNMENTS=7494 CHECKS=15675900	SAT TT=1590.83	SAT TT=71.613 ASSIGNMENTS=46714 CHECKS=88412500	SAT TT=0.677 ASSIGNMENTS=385 CHECKS=510826	? (MO) TT=30.686	SAT TT=1536.08	? (TO) TT=1800
csp/lexHerald/ normalized-crossword-m1-lex-19-09.xml	SAT TT=0.438	SAT TT=5.075 CHECKS=518365 NODES=712	SAT TT=5.796 CHECKS=695502 NODES=714	? (TO) TT=1800.12	SAT TT=51.814 CHECKS=5030510	SAT TT=9.664 CHECKS=1043110	SAT TT=29.9 ASSIGNMENTS=99	SAT TT=66.151 ASSIGNMENTS=158	SAT TT=254.075 CHECKS=750639000 NODES=607	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=0.45 ASSIGNMENTS=118 CHECKS=240060	SAT TT=0.452 ASSIGNMENTS=118 CHECKS=240060	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=0.438 ASSIGNMENTS=123 CHECKS=245428	SAT TT=15.655 ASSIGNMENTS=7544 CHECKS=18843300	SAT TT=13.349	SAT TT=203.996 ASSIGNMENTS=97691 CHECKS=255082000	SAT TT=1.113 ASSIGNMENTS=525 CHECKS=1295660	? (MO) TT=37.204	SAT TT=1078.92	? (TO) TT=1800.04
csp/lexHerald/ normalized-crossword-m1-lex-21-02.xml	SAT TT=2.459	SAT TT=14.147 CHECKS=3939890 NODES=2734	SAT TT=12.698 CHECKS=2702910 NODES=3138	? (TO) TT=1800.14	SAT TT=47.277 CHECKS=5779680	SAT TT=26.625 CHECKS=3485260	SAT TT=37.476 ASSIGNMENTS=436	SAT TT=1683.59 ASSIGNMENTS=62008	SAT TT=1085.48 CHECKS=5267680000 NODES=1610	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=10.604 ASSIGNMENTS=937 CHECKS=2921020	SAT TT=21.469 ASSIGNMENTS=2734 CHECKS=3939890	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=3.457 ASSIGNMENTS=1267 CHECKS=4112260	SAT TT=17.63 ASSIGNMENTS=8455 CHECKS=18309100	? (TO) TT=1800.04	SAT TT=59.948 ASSIGNMENTS=33245 CHECKS=67448800	SAT TT=2.459 ASSIGNMENTS=937 CHECKS=2921020	? (MO) TT=33.675	? (TO) TT=1800.02	? (TO) TT=1800.01
csp/lexHerald/ normalized-crossword-m1-lex-21-03.xml	SAT TT=2.199	SAT TT=10.366 CHECKS=2336370 NODES=3048	SAT TT=15.835 CHECKS=3429390 NODES=4487	? (TO) TT=1800.1	SAT TT=22.739 CHECKS=1419380	SAT TT=72.019 CHECKS=8262950	SAT TT=42.259 ASSIGNMENTS=880	SAT TT=88.146 ASSIGNMENTS=678	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=9.703 ASSIGNMENTS=754 CHECKS=1999630	SAT TT=17.206 ASSIGNMENTS=3048 CHECKS=2336370	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=29.923 ASSIGNMENTS=10122 CHECKS=27589700	SAT TT=37.093 ASSIGNMENTS=16981 CHECKS=36958800	? (TO) TT=1800.05	SAT TT=51.753 ASSIGNMENTS=23652 CHECKS=47890800	SAT TT=2.199 ASSIGNMENTS=754 CHECKS=1999630	? (MO) TT=27.138	? (TO) TT=1800.07	? (TO) TT=1800.1
csp/lexHerald/ normalized-crossword-m1-lex-21-10.xml	UNSAT TT=372.809	UNSAT TT=398.458 CHECKS=21511500 NODES=218824	UNSAT TT=372.809 CHECKS=21744400 NODES=218588	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=377.016 ASSIGNMENTS=223441 CHECKS=22517000	UNSAT TT=376.39 ASSIGNMENTS=223441 CHECKS=22517000	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=533.778 ASSIGNMENTS=149152 CHECKS=523911000	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=934.013 ASSIGNMENTS=259349 CHECKS=927253000	? (MO) TT=32.141	? (TO) TT=1800.04	? (TO) TT=1800.05
csp/lexHerald/ normalized-crossword-m1-lex-23-02.xml	SAT TT=1.775	SAT TT=11.881 CHECKS=2654310 NODES=2351	SAT TT=81.809 CHECKS=29273000 NODES=9382	? (TO) TT=1800.07	SAT TT=128.731 CHECKS=17908900	SAT TT=43.04 CHECKS=7745670	SAT TT=59.735 ASSIGNMENTS=972	? (TO) TT=1800.12	SAT TT=602.784 CHECKS=2660000000 NODES=1338	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=1.786 ASSIGNMENTS=647 CHECKS=1754510	SAT TT=1.775 ASSIGNMENTS=647 CHECKS=1754510	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT TT=3.69 ASSIGNMENTS=1608 CHECKS=4340680	SAT TT=20.817 ASSIGNMENTS=9041 CHECKS=25641800	? (TO) TT=1800.07	SAT TT=220.415 ASSIGNMENTS=104223 CHECKS=280985000	SAT TT=2.002 ASSIGNMENTS=786 CHECKS=2178710	? (MO) TT=39.303	? (TO) TT=1800.02	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexHerald/ normalized-crossword-m1-lex-23-04.xml	SAT TT=858.914	SAT TT=917.591 CHECKS=279462000 NODES=99832	SAT TT=1150.59 CHECKS=351873000 NODES=148537	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=858.914 ASSIGNMENTS=99832 CHECKS=279462000	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=91.379	? (TO) TT=1800.06	? (TO) TT=1800
csp/lexHerald/ normalized-crossword-m1-lex-23-05.xml	SAT TT=9.753	SAT TT=12.391 CHECKS=2048810 NODES=2102	SAT TT=34.197 CHECKS=8956970 NODES=6194	? (TO) TT=1800.15	SAT TT=236.834 CHECKS=45479900	SAT TT=143.8 CHECKS=30439800	SAT TT=50.089 ASSIGNMENTS=576	? (TO) TT=1800.08	SAT TT=232.729 CHECKS=576070000 NODES=954	? (TO) TT=1800.06	? (TO) TT=1800	SAT TT=19.948 ASSIGNMENTS=4020 CHECKS=18178300	SAT TT=21.91 ASSIGNMENTS=4020 CHECKS=18178300	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=9.753 ASSIGNMENTS=3993 CHECKS=15566000	SAT TT=29.721 ASSIGNMENTS=10870 CHECKS=34409600	SAT TT=244.698	SAT TT=106.103 ASSIGNMENTS=46161 CHECKS=135373000	SAT TT=13.284 ASSIGNMENTS=4020 CHECKS=18178300	? (MO) TT=31.696	? (TO) TT=1800.06	? (TO) TT=1800.02
csp/lexHerald/ normalized-crossword-m1-lex-23-06.xml	UNSAT TT=1071.41	UNSAT TT=1137.5 CHECKS=68146500 NODES=602394	? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=1071.41 ASSIGNMENTS=602394 CHECKS=68146500	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.02	? (MO) TT=37.641	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle02.xml	SAT TT=0.01	SAT TT=0.82 CHECKS=1533 NODES=8	SAT TT=0.738 CHECKS=1229 NODES=0	SAT TT=0.06	SAT TT=0.043 CHECKS=538	SAT TT=0.04 CHECKS=759	SAT TT=0.672 ASSIGNMENTS=55	SAT TT=0.65 ASSIGNMENTS=7	SAT TT=88.456 CHECKS=23225 NODES=8	SAT TT=36.59 CHECKS=21881 NODES=5	SAT TT=37.881 CHECKS=21666 NODES=3	SAT TT=0.039 ASSIGNMENTS=183 CHECKS=6457	SAT TT=0.033 ASSIGNMENTS=183 CHECKS=6457	SAT TT=75.174	SAT TT=74.445	SAT TT=0.019 ASSIGNMENTS=183 CHECKS=6457	SAT TT=0.017 ASSIGNMENTS=130 CHECKS=4029	SAT TT=0.358	SAT TT=0.01 ASSIGNMENTS=7 CHECKS=204	SAT TT=0.014 ASSIGNMENTS=138 CHECKS=3449	SAT TT=1372.9	SAT TT=0.708	SAT TT=0.766
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle03.xml	SAT TT=0.026	SAT TT=0.798 CHECKS=2828 NODES=14	SAT TT=0.784 CHECKS=1626 NODES=0	SAT TT=0.188	SAT TT=0.135 CHECKS=974	SAT TT=0.113 CHECKS=982	SAT TT=1.142 ASSIGNMENTS=136	SAT TT=0.796 ASSIGNMENTS=10	SAT TT=133.797 CHECKS=366167 NODES=21	SAT TT=70.064 CHECKS=356803 NODES=13	SAT TT=76.061 CHECKS=4801750 NODES=130	SAT TT=0.18 ASSIGNMENTS=1047 CHECKS=71660	SAT TT=0.183 ASSIGNMENTS=1047 CHECKS=71660	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=0.244 ASSIGNMENTS=1427 CHECKS=103989	SAT TT=0.122 ASSIGNMENTS=865 CHECKS=49235	SAT TT=0.495	SAT TT=0.026 ASSIGNMENTS=72 CHECKS=4443	SAT TT=0.027 ASSIGNMENTS=120 CHECKS=7321	? (TO) TT=1800.14	SAT TT=1.162	SAT TT=1.534
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle04.xml	SAT TT=0.033	SAT TT=0.806 CHECKS=1979 NODES=20	SAT TT=0.887 CHECKS=4639 NODES=21	SAT TT=1.147	SAT TT=0.24 CHECKS=1558	SAT TT=0.219 CHECKS=1508	SAT TT=1.347 ASSIGNMENTS=58	SAT TT=1.038 ASSIGNMENTS=11	SAT TT=133.643 CHECKS=11674000 NODES=34	SAT TT=68.511 CHECKS=59750700 NODES=67350000	SAT TT=538.034 CHECKS=889337000 NODES=35485	SAT TT=0.341 ASSIGNMENTS=1114 CHECKS=91661	SAT TT=0.342 ASSIGNMENTS=1114 CHECKS=91661	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=0.343 ASSIGNMENTS=1241 CHECKS=102716	SAT TT=0.325 ASSIGNMENTS=1338 CHECKS=91920	SAT TT=0.596	SAT TT=0.036 ASSIGNMENTS=76 CHECKS=4980	SAT TT=0.033 ASSIGNMENTS=92 CHECKS=5246	? (MO) TT=38.362	SAT TT=2.863	SAT TT=3.47
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle05.xml	SAT TT=0.026	SAT TT=0.822 CHECKS=2257 NODES=21	SAT TT=0.812 CHECKS=1036 NODES=0	SAT TT=0.741	SAT TT=0.259 CHECKS=1528	SAT TT=0.242 CHECKS=1539	SAT TT=2.057 ASSIGNMENTS=348	SAT TT=1.032 ASSIGNMENTS=11	SAT TT=93.233 CHECKS=6638670 NODES=24	SAT TT=69.57 CHECKS=210681000 NODES=234900000	SAT TT=200.703 CHECKS=366129000 NODES=18765	SAT TT=0.519 ASSIGNMENTS=1571 CHECKS=122081	SAT TT=0.491 ASSIGNMENTS=1571 CHECKS=122081	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.399 ASSIGNMENTS=1381 CHECKS=106865	SAT TT=0.051 ASSIGNMENTS=155 CHECKS=8426	SAT TT=0.768	SAT TT=0.026 ASSIGNMENTS=32 CHECKS=1614	SAT TT=0.037 ASSIGNMENTS=123 CHECKS=7525	? (MO) TT=34.862	SAT TT=2.653	SAT TT=3.077
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle06.xml	SAT TT=0.024	SAT TT=1.018 CHECKS=2629 NODES=23	SAT TT=0.884 CHECKS=3109 NODES=0	SAT TT=2.037	SAT TT=0.325 CHECKS=2074	SAT TT=0.257 CHECKS=1589	SAT TT=76.719 ASSIGNMENTS=14855	SAT TT=1.227 ASSIGNMENTS=12	SAT TT=91.445 CHECKS=17782400 NODES=24	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=0.501 ASSIGNMENTS=1307 CHECKS=181427	SAT TT=0.505 ASSIGNMENTS=1307 CHECKS=181427	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=0.405 ASSIGNMENTS=1065 CHECKS=158935	SAT TT=1.53 ASSIGNMENTS=4940 CHECKS=507035	SAT TT=0.669	SAT TT=0.024 ASSIGNMENTS=23 CHECKS=2871	SAT TT=0.029 ASSIGNMENTS=74 CHECKS=6238	? (MO) TT=32.623	SAT TT=4.538	SAT TT=6.234
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle07.xml	SAT TT=0.026	SAT TT=0.929 CHECKS=4359 NODES=32	SAT TT=0.908 CHECKS=6330 NODES=0	SAT TT=2.814	SAT TT=0.288 CHECKS=1736	SAT TT=0.323 CHECKS=2374	SAT TT=6.059 ASSIGNMENTS=1437	SAT TT=1.152 ASSIGNMENTS=23	SAT TT=122.692 CHECKS=12082400 NODES=31	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=0.257 ASSIGNMENTS=1021 CHECKS=97562	SAT TT=0.258 ASSIGNMENTS=1021 CHECKS=97562	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=0.222 ASSIGNMENTS=1046 CHECKS=98434	SAT TT=0.233 ASSIGNMENTS=1015 CHECKS=86635	SAT TT=0.711	SAT TT=0.026 ASSIGNMENTS=24 CHECKS=1849	SAT TT=0.05 ASSIGNMENTS=153 CHECKS=13098	? TT=95.735	SAT TT=3.638	SAT TT=5.237
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle09.xml	SAT TT=0.078	SAT TT=0.984 CHECKS=4673 NODES=35	SAT TT=1.095 CHECKS=4418 NODES=0	SAT TT=4.223	SAT TT=0.407 CHECKS=2492	SAT TT=0.347 CHECKS=2541	SAT TT=6.818 ASSIGNMENTS=613	SAT TT=1.983 ASSIGNMENTS=20	SAT TT=122.752 CHECKS=12872500 NODES=37	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=14.946 ASSIGNMENTS=613	SAT TT=14.911 ASSIGNMENTS=613	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=2.565 ASSIGNMENTS=2848 CHECKS=877711	SAT TT=0.407 ASSIGNMENTS=649 CHECKS=104187	SAT TT=1.05	SAT TT=0.078 ASSIGNMENTS=102 CHECKS=12891	SAT TT=0.12 ASSIGNMENTS=160 CHECKS=34349	? (MO) TT=33.801	SAT TT=16.323	SAT TT=20.502
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle10.xml	SAT TT=0.037	SAT TT=1.064 CHECKS=20650 NODES=42	SAT TT=1.006 CHECKS=14188 NODES=0	SAT TT=2.372	SAT TT=0.724 CHECKS=10703	SAT TT=0.461 CHECKS=7367	SAT TT=1.907 ASSIGNMENTS=22	SAT TT=2.086 ASSIGNMENTS=18	SAT TT=128.797 CHECKS=122086 NODES=45	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.05 ASSIGNMENTS=25 CHECKS=5247	SAT TT=0.049 ASSIGNMENTS=25 CHECKS=5247	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=0.038 ASSIGNMENTS=24 CHECKS=6221	SAT TT=3.193 ASSIGNMENTS=9076 CHECKS=2026060	SAT TT=1.608	SAT TT=0.082 ASSIGNMENTS=123 CHECKS=30648	SAT TT=0.037 ASSIGNMENTS=20 CHECKS=5805	? (TO) TT=1800.1	SAT TT=16.58	SAT TT=21.649
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle11.xml	SAT TT=0.094	SAT TT=0.959 CHECKS=3576 NODES=38	SAT TT=1.026 CHECKS=8716 NODES=39	SAT TT=10.16	SAT TT=0.622 CHECKS=4391	SAT TT=0.48 CHECKS=3724	SAT TT=3.999 ASSIGNMENTS=270	SAT TT=1.876 ASSIGNMENTS=20	SAT TT=154.657 CHECKS=378218000 NODES=40	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=0.879 ASSIGNMENTS=1364 CHECKS=292760	SAT TT=0.885 ASSIGNMENTS=1364 CHECKS=292760	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=1.039 ASSIGNMENTS=1505 CHECKS=321028	SAT TT=3.699 ASSIGNMENTS=5046 CHECKS=823050	SAT TT=1.105	SAT TT=0.238 ASSIGNMENTS=327 CHECKS=47061	SAT TT=0.094 ASSIGNMENTS=113 CHECKS=23475	? TT=79.694	SAT TT=18.385	SAT TT=20.815
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle15.xml	SAT TT=0.075	SAT TT=1.5 CHECKS=54249 NODES=103	SAT TT=1.648 CHECKS=116865 NODES=108	SAT TT=8.52	SAT TT=2.227 CHECKS=31265	SAT TT=1.647 CHECKS=32495	SAT TT=4.038 ASSIGNMENTS=48	SAT TT=6.913 ASSIGNMENTS=58	SAT TT=132.992 CHECKS=675650 NODES=143	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=0.088 ASSIGNMENTS=52 CHECKS=25836	SAT TT=0.091 ASSIGNMENTS=52 CHECKS=25836	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=0.075 ASSIGNMENTS=52 CHECKS=25836	SAT TT=6.808 ASSIGNMENTS=18851 CHECKS=8104390	SAT TT=2.285	SAT TT=1.787 ASSIGNMENTS=2677 CHECKS=1679310	SAT TT=0.077 ASSIGNMENTS=58 CHECKS=27431	? TT=100.623	SAT TT=26.958	SAT TT=26.961
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle16.xml	SAT TT=0.142	SAT TT=2.297 CHECKS=199736 NODES=273	SAT TT=2.278 CHECKS=306346 NODES=274	SAT TT=8.928	SAT TT=2.674 CHECKS=65052	SAT TT=1.943 CHECKS=86643	SAT TT=5.286 ASSIGNMENTS=64	SAT TT=23.286 ASSIGNMENTS=60	SAT TT=328.121 CHECKS=1136900000 NODES=339	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=0.159 ASSIGNMENTS=81 CHECKS=47351	SAT TT=0.157 ASSIGNMENTS=81 CHECKS=47351	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=0.144 ASSIGNMENTS=81 CHECKS=47351	SAT TT=10.175 ASSIGNMENTS=19445 CHECKS=13858700	? (TO) TT=1800.1	SAT TT=3.491 ASSIGNMENTS=3989 CHECKS=2580580	SAT TT=0.142 ASSIGNMENTS=76 CHECKS=40586	? (MO) TT=41.689	SAT TT=54.137	SAT TT=51.276
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle17.xml	SAT TT=0.229	SAT TT=2.337 CHECKS=215531 NODES=185	SAT TT=3.123 CHECKS=411522 NODES=342	SAT TT=14.974	SAT TT=5.421 CHECKS=201448	SAT TT=3.709 CHECKS=246570	SAT TT=8.952 ASSIGNMENTS=80	SAT TT=52.986 ASSIGNMENTS=66	SAT TT=257.972 CHECKS=631407000 NODES=304	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.251 ASSIGNMENTS=85 CHECKS=72551	SAT TT=0.246 ASSIGNMENTS=85 CHECKS=72551	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.229 ASSIGNMENTS=85 CHECKS=72551	SAT TT=20.451 ASSIGNMENTS=22718 CHECKS=27243900	? (TO) TT=1800.1	SAT TT=58.865 ASSIGNMENTS=39497 CHECKS=31136500	SAT TT=0.271 ASSIGNMENTS=122 CHECKS=101036	? TT=100.989	SAT TT=433.106	SAT TT=740.86
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle18.xml	SAT TT=0.203	SAT TT=2.589 CHECKS=225836 NODES=351	SAT TT=2.923 CHECKS=356791 NODES=349	? (TO) TT=1800.11	SAT TT=39.606 CHECKS=2776440	SAT TT=2.56 CHECKS=198283	SAT TT=9.902 ASSIGNMENTS=87	SAT TT=62.262 ASSIGNMENTS=81	SAT TT=134.216 CHECKS=2539450 NODES=342	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=0.214 ASSIGNMENTS=106 CHECKS=82330	SAT TT=0.228 ASSIGNMENTS=106 CHECKS=82330	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=0.214 ASSIGNMENTS=106 CHECKS=82330	SAT TT=17.696 ASSIGNMENTS=19647 CHECKS=25036800	SAT TT=5.997	SAT TT=61.746 ASSIGNMENTS=40259 CHECKS=33673700	SAT TT=0.203 ASSIGNMENTS=94 CHECKS=79210	? (MO) TT=63.926	SAT TT=66.768	SAT TT=264.508
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle19.xml	SAT TT=0.392	SAT TT=2.884 CHECKS=263371 NODES=477	SAT TT=3.073 CHECKS=329057 NODES=456	? (TO) TT=1800.05	SAT TT=7.485 CHECKS=339092	SAT TT=6.216 CHECKS=354095	SAT TT=13.725 ASSIGNMENTS=383	SAT TT=39.523 ASSIGNMENTS=76	SAT TT=269.03 CHECKS=895289000 NODES=385	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=0.412 ASSIGNMENTS=170 CHECKS=162308	SAT TT=0.392 ASSIGNMENTS=170 CHECKS=162308	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=0.795 ASSIGNMENTS=327 CHECKS=371749	SAT TT=18.573 ASSIGNMENTS=16620 CHECKS=20136200	? (TO) TT=1800	SAT TT=53.476 ASSIGNMENTS=39152 CHECKS=29860900	SAT TT=0.489 ASSIGNMENTS=212 CHECKS=235755	? (MO) TT=32.135	SAT TT=332.475	? (TO) TT=1800.02
csp/lexPuzzle/ normalized-crossword-m1-lex-puzzle20.xml	SAT TT=0.099	SAT TT=1.187 CHECKS=4919 NODES=53	SAT TT=1.145 CHECKS=21196 NODES=66	SAT TT=4.904	SAT TT=0.987 CHECKS=8936	SAT TT=0.829 CHECKS=8377	SAT TT=118.778 ASSIGNMENTS=9403	SAT TT=2.318 ASSIGNMENTS=20	SAT TT=121.882 CHECKS=14309600 NODES=53	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=116.449 ASSIGNMENTS=9403	SAT TT=126.131 ASSIGNMENTS=9403	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=7.137 ASSIGNMENTS=8734 CHECKS=3582390	SAT TT=4.722 ASSIGNMENTS=6705 CHECKS=1581020	SAT TT=1.645	SAT TT=0.255 ASSIGNMENTS=408 CHECKS=85202	SAT TT=0.099 ASSIGNMENTS=218 CHECKS=44647	? (MO) TT=45.677	SAT TT=21.736	SAT TT=34.944
csp/mknap/ normalized-mknap-1-0.xml	SAT TT=0.007	SAT TT=0.747 CHECKS=71 NODES=6	SAT TT=0.679 CHECKS=71 NODES=0	SAT TT=0.029	SAT TT=0.011 CHECKS=65	SAT TT=0.009 CHECKS=92	SAT TT=0.488 ASSIGNMENTS=1	SAT TT=0.502 ASSIGNMENTS=1	SAT TT=0.547 CHECKS=76 NODES=6	SAT TT=0.573 CHECKS=83 NODES=0	SAT TT=0.531 CHECKS=83 NODES=0	SAT TT=0.018 ASSIGNMENTS=2 CHECKS=635	SAT TT=0.018 ASSIGNMENTS=2 CHECKS=635	SAT TT=1.463	SAT TT=1.687	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=635	SAT TT=0.009 ASSIGNMENTS=2 CHECKS=1044	SAT TT=0.302	SAT TT=0.008 ASSIGNMENTS=4 CHECKS=974	SAT TT=0.008 ASSIGNMENTS=3 CHECKS=621	SAT TT=1.364	SAT TT=0.5	SAT TT=0.469
csp/mknap/ normalized-mknap-1-2.xml	SAT TT=0.013	SAT TT=1.346 CHECKS=41836 NODES=15	SAT TT=1.223 CHECKS=41836 NODES=0	SAT TT=0.037	SAT TT=0.163 CHECKS=886	SAT TT=0.048 CHECKS=1162	SAT TT=0.575 ASSIGNMENTS=9	SAT TT=0.546 ASSIGNMENTS=25	SAT TT=1.05 CHECKS=46513 NODES=15	SAT TT=0.97 CHECKS=46529 NODES=0	SAT TT=1.041 CHECKS=46529 NODES=0	SAT TT=0.024 ASSIGNMENTS=13 CHECKS=8382	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=8382	SAT TT=2.801	SAT TT=2.579	SAT TT=0.013 ASSIGNMENTS=13 CHECKS=8382	SAT TT=0.014 ASSIGNMENTS=25 CHECKS=13007	SAT TT=0.365	SAT TT=3.354 ASSIGNMENTS=6398 CHECKS=1937140	SAT TT=0.013 ASSIGNMENTS=10 CHECKS=7062	SAT TT=12.724	SAT TT=1.394	SAT TT=4.058
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/mknap/ normalized-mknap-1-3.xml	SAT TT=0.03	SAT TT=19.193 CHECKS=1565190 NODES=20	SAT TT=18.805 CHECKS=1565190 NODES=0	SAT TT=0.05	SAT TT=2 CHECKS=36622	SAT TT=2.628 CHECKS=53826	SAT TT=0.545 ASSIGNMENTS=19	SAT TT=0.772 ASSIGNMENTS=254	SAT TT=9.491 CHECKS=1311300 NODES=20	SAT TT=6.645 CHECKS=1311320 NODES=0	SAT TT=6.24 CHECKS=1311320 NODES=0	SAT TT=0.043 ASSIGNMENTS=66 CHECKS=42215	SAT TT=0.043 ASSIGNMENTS=66 CHECKS=42215	? (problem) TT=39.054	? (problem) TT=32.989	SAT TT=0.03 ASSIGNMENTS=66 CHECKS=42215	SAT TT=0.887 ASSIGNMENTS=3677 CHECKS=1960360	SAT TT=0.378	SAT TT=12.861 ASSIGNMENTS=22355 CHECKS=4544830	SAT TT=0.048 ASSIGNMENTS=143 CHECKS=90571	? TT=340.472	SAT TT=3.398	SAT TT=9.877
csp/mknap/ normalized-mknap-1-4.xml	SAT TT=0.065	? (TO) TT=1800.16	? (TO) TT=1800.18	SAT TT=0.065	SAT TT=42.654 CHECKS=508593	SAT TT=45.474 CHECKS=541580	SAT TT=1.416 ASSIGNMENTS=13258	SAT TT=0.854 ASSIGNMENTS=1807	SAT TT=1568.73 CHECKS=386154000 NODES=28	SAT TT=1608.75 CHECKS=386155000 NODES=0	SAT TT=1607.68 CHECKS=386155000 NODES=0	SAT TT=9.4 ASSIGNMENTS=13258	SAT TT=61.474 ASSIGNMENTS=138723 CHECKS=137352000	? (MO) TT=256.58	? (MO) TT=275.82	SAT TT=1.418 ASSIGNMENTS=3596 CHECKS=3279130	SAT TT=7.971 ASSIGNMENTS=20493 CHECKS=18472800	SAT TT=0.791	SAT TT=136.099 ASSIGNMENTS=32294 CHECKS=22099100	SAT TT=55.486 ASSIGNMENTS=138723 CHECKS=137352000	? TT=939.507	SAT TT=11.99	SAT TT=46.099
csp/mknap/ normalized-mknap-1-5.xml	SAT TT=1.204	? (TO) TT=1800.14	? (TO) TT=1800.11	SAT TT=1.204	SAT TT=120.512 CHECKS=863472	SAT TT=89.942 CHECKS=695190	SAT TT=5.477 ASSIGNMENTS=105826	SAT TT=1.925 ASSIGNMENTS=18723	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=412.224 ASSIGNMENTS=1523430 CHECKS=906612000	SAT TT=410.627 ASSIGNMENTS=1523430 CHECKS=906612000	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=79.785 ASSIGNMENTS=286594 CHECKS=180977000	SAT TT=58.954 ASSIGNMENTS=234559 CHECKS=142503000	SAT TT=1.29	SAT TT=239.562 ASSIGNMENTS=168324 CHECKS=97077800	SAT TT=401.278 ASSIGNMENTS=1523430 CHECKS=906612000	? (TO) TT=1800.15	? (MO) TT=139.36	? (MO) TT=347.835
csp/mknap/ normalized-mknap-1-6.xml	SAT TT=12.671	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=302.627	? (TO) TT=1800.02	SAT TT=1589.11 CHECKS=7670940	SAT TT=73.533 ASSIGNMENTS=1489160	SAT TT=12.671 ASSIGNMENTS=200210	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=327.645 ASSIGNMENTS=1489160	SAT TT=1161.51 ASSIGNMENTS=1489160	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=15.122	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=274.199	? TT=256.572
csp/nengfa/ normalized-block.xml	UNSAT TT=3.833	? (TO) TT=1800.08	? (TO) TT=1800.13	UNSAT TT=1576.66	? (TO) TT=1800.05	? (TO) TT=1800.1	? (problem) TT=2.342	? (problem) TT=2.174	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=15.185	UNSAT TT=17.261	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=23.165	UNSAT TT=3.919	UNSAT TT=3.833
csp/nengfa/ normalized-pack.xml	SAT TT=34.225	SAT TT=936.802 CHECKS=1423020000 NODES=27180	SAT TT=925.439 CHECKS=1423020000 NODES=27180	SAT TT=1340.32	SAT TT=771.91 CHECKS=290338000	? (TO) TT=1800.03	? (problem) TT=7.551	? (problem) TT=7.689	SAT TT=735.495 CHECKS=1281730000 NODES=11069	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=538.374 ASSIGNMENTS=114204 CHECKS=280348000	SAT TT=477.911 ASSIGNMENTS=114204 CHECKS=280348000	? (MO) TT=385.89	? (MO) TT=388.27	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=470.74 ASSIGNMENTS=114204 CHECKS=280348000	? TT=122.483	SAT TT=34.225	SAT TT=37.311
csp/nengfa/ normalized-radi.xml	SAT TT=0.036	SAT TT=313.467 CHECKS=465626000 NODES=8948	SAT TT=315.216 CHECKS=459093000 NODES=8905	SAT TT=8.211	SAT TT=0.437 CHECKS=60525	SAT TT=0.364 CHECKS=53261	SAT TT=1.239 ASSIGNMENTS=102	SAT TT=1.13 ASSIGNMENTS=36	SAT TT=172.292 CHECKS=256883000 NODES=200	SAT TT=1556 CHECKS=3501020000 NODES=5558290	? (TO) TT=1800.06	SAT TT=0.046 ASSIGNMENTS=71 CHECKS=18246	SAT TT=0.045 ASSIGNMENTS=71 CHECKS=18246	? (problem) TT=149.148	? (problem) TT=148.095	SAT TT=0.036 ASSIGNMENTS=87 CHECKS=18085	SAT TT=0.846 ASSIGNMENTS=11180 CHECKS=1742310	SAT TT=0.685	SAT TT=0.371 ASSIGNMENTS=2839 CHECKS=437882	SAT TT=0.7 ASSIGNMENTS=7383 CHECKS=1445130	? TT=125.992	SAT TT=1.533	SAT TT=1.907
csp/nengfa/ normalized-schur.xml	SAT TT=0.34	SAT TT=4.623 CHECKS=805771 NODES=2597	SAT TT=8.018 CHECKS=2034400 NODES=6261	SAT TT=17.533	? (TO) TT=1800.06	SAT TT=32.383 CHECKS=33801300	SAT TT=3.504 ASSIGNMENTS=61	SAT TT=3.172 ASSIGNMENTS=61	SAT TT=4.683 CHECKS=12110 NODES=110	SAT TT=8.207 CHECKS=6507370 NODES=7583	SAT TT=5.14 CHECKS=847869 NODES=327	SAT TT=0.353 ASSIGNMENTS=60 CHECKS=29428	SAT TT=0.353 ASSIGNMENTS=60 CHECKS=29428	SAT TT=178.449	SAT TT=181.273	SAT TT=0.34 ASSIGNMENTS=60 CHECKS=29428	SAT TT=25.552 ASSIGNMENTS=19667 CHECKS=25538300	SAT TT=196.688	SAT TT=2.711 ASSIGNMENTS=1800 CHECKS=2317110	SAT TT=9.088 ASSIGNMENTS=4736 CHECKS=8677330	SAT TT=25.208	SAT TT=24.674	SAT TT=9.867
csp/ogdHerald/ normalized-crossword-m1-ogd-05-01.xml	SAT TT=0.069	SAT TT=0.927 CHECKS=3576 NODES=25	SAT TT=1.168 CHECKS=6613 NODES=25	SAT TT=4.815	SAT TT=1.11 CHECKS=4281	SAT TT=1.029 CHECKS=4299	SAT TT=16.792 ASSIGNMENTS=906	SAT TT=1.92 ASSIGNMENTS=15	SAT TT=62.681 CHECKS=20081800 NODES=28	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=22.841 ASSIGNMENTS=906	SAT TT=7.603 ASSIGNMENTS=188 CHECKS=22235	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=9.559 ASSIGNMENTS=7855 CHECKS=3435890	SAT TT=2.047 ASSIGNMENTS=9293 CHECKS=982195	SAT TT=1.744	SAT TT=0.1 ASSIGNMENTS=178 CHECKS=26480	SAT TT=0.069 ASSIGNMENTS=188 CHECKS=22235	? (MO) TT=37.439	SAT TT=14.928	SAT TT=17.969
csp/ogdHerald/ normalized-crossword-m1-ogd-05-04.xml	SAT TT=0.032	SAT TT=1.043 CHECKS=2400 NODES=19	SAT TT=0.872 CHECKS=1602 NODES=0	SAT TT=1.954	SAT TT=0.349 CHECKS=976	SAT TT=0.355 CHECKS=1271	SAT TT=2.936 ASSIGNMENTS=302	SAT TT=1.127 ASSIGNMENTS=13	SAT TT=117.14 CHECKS=4579910 NODES=22	SAT TT=57.856 CHECKS=5420250 NODES=3150030	SAT TT=222.148 CHECKS=333000000 NODES=11118	SAT TT=0.401 ASSIGNMENTS=1155 CHECKS=93290	SAT TT=0.387 ASSIGNMENTS=1155 CHECKS=93290	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.443 ASSIGNMENTS=1830 CHECKS=132036	SAT TT=0.032 ASSIGNMENTS=14 CHECKS=923	SAT TT=0.747	SAT TT=0.042 ASSIGNMENTS=50 CHECKS=2724	SAT TT=0.052 ASSIGNMENTS=147 CHECKS=6599	? (MO) TT=35.953	SAT TT=4.129	SAT TT=5.392
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdHerald/ normalized-crossword-m1-ogd-05-06.xml	SAT TT=0.073	SAT TT=0.952 CHECKS=1698 NODES=23	SAT TT=1.056 CHECKS=1859 NODES=0	SAT TT=2.889	SAT TT=0.768 CHECKS=2152	SAT TT=0.749 CHECKS=2392	SAT TT=3.672 ASSIGNMENTS=226	SAT TT=1.774 ASSIGNMENTS=14	SAT TT=92.684 CHECKS=11673400 NODES=29	SAT TT=1277.58 CHECKS=5293990000 NODES=1231330000	? (TO) TT=1800.08	SAT TT=0.697 ASSIGNMENTS=1207 CHECKS=200133	SAT TT=0.676 ASSIGNMENTS=1207 CHECKS=200133	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=0.643 ASSIGNMENTS=1211 CHECKS=199439	SAT TT=0.189 ASSIGNMENTS=388 CHECKS=40675	SAT TT=1.532	SAT TT=0.073 ASSIGNMENTS=93 CHECKS=10453	SAT TT=0.097 ASSIGNMENTS=164 CHECKS=17465	? (MO) TT=33.032	SAT TT=9.217	SAT TT=12.92
csp/ogdHerald/ normalized-crossword-m1-ogd-05-08.xml	SAT TT=0.052	SAT TT=0.904 CHECKS=3016 NODES=21	SAT TT=0.889 CHECKS=2122 NODES=0	SAT TT=2.888	SAT TT=0.622 CHECKS=2056	SAT TT=0.617 CHECKS=2188	SAT TT=2.343 ASSIGNMENTS=152	SAT TT=1.64 ASSIGNMENTS=15	SAT TT=108.151 CHECKS=10842600 NODES=25	SAT TT=293.004 CHECKS=180117000 NODES=1608000000	? (TO) TT=1800.02	SAT TT=0.705 ASSIGNMENTS=1228 CHECKS=186984	SAT TT=0.724 ASSIGNMENTS=1228 CHECKS=186984	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=0.902 ASSIGNMENTS=1698 CHECKS=268346	SAT TT=0.802 ASSIGNMENTS=2992 CHECKS=236565	SAT TT=1.31	SAT TT=0.097 ASSIGNMENTS=150 CHECKS=15797	SAT TT=0.052 ASSIGNMENTS=94 CHECKS=6447	? (MO) TT=30.944	SAT TT=9.615	SAT TT=11.736
csp/ogdHerald/ normalized-crossword-m1-ogd-05-09.xml	SAT TT=0.043	SAT TT=0.833 CHECKS=2166 NODES=19	SAT TT=0.868 CHECKS=1510 NODES=0	SAT TT=1.496	SAT TT=0.381 CHECKS=1278	SAT TT=0.327 CHECKS=1084	SAT TT=1.281 ASSIGNMENTS=71	SAT TT=1.126 ASSIGNMENTS=13	SAT TT=123.1 CHECKS=3387240 NODES=21	SAT TT=78.446 CHECKS=7038580 NODES=4500020	? (MO) TT=17.78	SAT TT=0.324 ASSIGNMENTS=802 CHECKS=77748	SAT TT=0.314 ASSIGNMENTS=802 CHECKS=77748	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.289 ASSIGNMENTS=695 CHECKS=70796	SAT TT=0.044 ASSIGNMENTS=61 CHECKS=3535	SAT TT=0.784	SAT TT=0.043 ASSIGNMENTS=59 CHECKS=2906	SAT TT=0.049 ASSIGNMENTS=109 CHECKS=6808	? (MO) TT=38.389	SAT TT=4.367	SAT TT=5.516
csp/ogdHerald/ normalized-crossword-m1-ogd-05-10.xml	SAT TT=0.034	SAT TT=0.881 CHECKS=4858 NODES=17	SAT TT=0.847 CHECKS=4129 NODES=0	SAT TT=1.589	SAT TT=0.28 CHECKS=1400	SAT TT=0.253 CHECKS=1609	SAT TT=1.506 ASSIGNMENTS=121	SAT TT=1.007 ASSIGNMENTS=15	SAT TT=129.347 CHECKS=2984550 NODES=19	SAT TT=66.936 CHECKS=3899510 NODES=7800020	SAT TT=94.905 CHECKS=22446700 NODES=4257	SAT TT=0.247 ASSIGNMENTS=1009 CHECKS=178578	SAT TT=0.225 ASSIGNMENTS=1009 CHECKS=178578	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=0.424 ASSIGNMENTS=1362 CHECKS=245977	SAT TT=0.095 ASSIGNMENTS=326 CHECKS=26284	SAT TT=0.722	SAT TT=0.034 ASSIGNMENTS=25 CHECKS=2334	SAT TT=0.093 ASSIGNMENTS=251 CHECKS=24689	? (MO) TT=35.732	SAT TT=3.944	SAT TT=4.515
csp/ogdHerald/ normalized-crossword-m1-ogd-15-02.xml	SAT TT=0.913	SAT TT=3.913 CHECKS=219221 NODES=324	SAT TT=4.49 CHECKS=338547 NODES=321	? (TO) TT=1800.06	SAT TT=30.145 CHECKS=156028	SAT TT=16.889 CHECKS=62487	SAT TT=33.333 ASSIGNMENTS=86	SAT TT=60.567 ASSIGNMENTS=81	SAT TT=229.704 CHECKS=622558000 NODES=371	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=0.952 ASSIGNMENTS=79 CHECKS=69464	SAT TT=0.937 ASSIGNMENTS=79 CHECKS=69464	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=0.913 ASSIGNMENTS=79 CHECKS=69464	SAT TT=74.31 ASSIGNMENTS=15050 CHECKS=19984800	SAT TT=38.231	SAT TT=51.759 ASSIGNMENTS=11278 CHECKS=9593620	SAT TT=0.944 ASSIGNMENTS=97 CHECKS=73114	? TT=98.717	? (MO) TT=6.67	? (TO) TT=1800.07
csp/ogdHerald/ normalized-crossword-m1-ogd-15-03.xml	SAT TT=0.538	SAT TT=2.948 CHECKS=154375 NODES=195	SAT TT=3.916 CHECKS=288911 NODES=195	SAT TT=33.076	SAT TT=30.822 CHECKS=95812	SAT TT=23.169 CHECKS=53313	SAT TT=21.15 ASSIGNMENTS=106	SAT TT=60.539 ASSIGNMENTS=84	SAT TT=207.889 CHECKS=544969000 NODES=265	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=0.552 ASSIGNMENTS=103 CHECKS=63534	SAT TT=0.553 ASSIGNMENTS=103 CHECKS=63534	? (TO) TT=1800.03	? (TO) TT=1800	SAT TT=0.547 ASSIGNMENTS=103 CHECKS=63534	SAT TT=48.748 ASSIGNMENTS=25562 CHECKS=22188600	SAT TT=21.468	SAT TT=22.164 ASSIGNMENTS=6130 CHECKS=4927320	SAT TT=0.538 ASSIGNMENTS=100 CHECKS=63137	? (MO) TT=31.643	? (TO) TT=1800	? (TO) TT=1800.06
csp/ogdHerald/ normalized-crossword-m1-ogd-15-05.xml	SAT TT=0.746	SAT TT=3.321 CHECKS=193399 NODES=185	SAT TT=3.954 CHECKS=351613 NODES=188	? (TO) TT=1800.1	SAT TT=26.24 CHECKS=111013	SAT TT=14.09 CHECKS=103171	SAT TT=19.93 ASSIGNMENTS=104	SAT TT=62.577 ASSIGNMENTS=85	SAT TT=160.785 CHECKS=234090000 NODES=307	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.798 ASSIGNMENTS=98 CHECKS=75903	SAT TT=0.929 ASSIGNMENTS=98 CHECKS=75903	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.904 ASSIGNMENTS=98 CHECKS=75903	SAT TT=54.165 ASSIGNMENTS=21622 CHECKS=23144400	SAT TT=18.597	SAT TT=59.227 ASSIGNMENTS=16202 CHECKS=13764700	SAT TT=0.746 ASSIGNMENTS=90 CHECKS=63126	? TT=87.88	? (TO) TT=1800.05	? (TO) TT=1800.2
csp/ogdHerald/ normalized-crossword-m1-ogd-15-06.xml	SAT TT=0.897	SAT TT=6.153 CHECKS=269791 NODES=930	SAT TT=7.19 CHECKS=147950 NODES=501	? (TO) TT=1800.07	SAT TT=37.424 CHECKS=109965	SAT TT=25.347 CHECKS=40197	SAT TT=31.924 ASSIGNMENTS=70	SAT TT=47.523 ASSIGNMENTS=68	SAT TT=204.321 CHECKS=562974000 NODES=323	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=0.907 ASSIGNMENTS=78 CHECKS=56861	SAT TT=0.966 ASSIGNMENTS=78 CHECKS=56861	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=0.897 ASSIGNMENTS=79 CHECKS=57081	SAT TT=65.317 ASSIGNMENTS=17865 CHECKS=14628300	SAT TT=35.02	SAT TT=45.762 ASSIGNMENTS=7837 CHECKS=5057230	SAT TT=1.072 ASSIGNMENTS=107 CHECKS=61590	? TT=77.503	? (TO) TT=1800.09	? (MO) TT=6.376
csp/ogdHerald/ normalized-crossword-m1-ogd-15-08.xml	SAT TT=0.569	SAT TT=3.127 CHECKS=161512 NODES=188	SAT TT=3.901 CHECKS=289040 NODES=189	? (TO) TT=1800.12	SAT TT=27.059 CHECKS=91234	SAT TT=20.057 CHECKS=66612	SAT TT=17.161 ASSIGNMENTS=106	SAT TT=42.976 ASSIGNMENTS=78	SAT TT=186.8 CHECKS=423219000 NODES=258	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=0.61 ASSIGNMENTS=114 CHECKS=58012	SAT TT=0.569 ASSIGNMENTS=114 CHECKS=58012	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=0.595 ASSIGNMENTS=114 CHECKS=58012	SAT TT=31.899 ASSIGNMENTS=21460 CHECKS=22485200	SAT TT=31.624	SAT TT=35.012 ASSIGNMENTS=13176 CHECKS=8775080	SAT TT=0.619 ASSIGNMENTS=103 CHECKS=61284	? (MO) TT=35.324	? (TO) TT=1800	? (TO) TT=1800.04
csp/ogdHerald/ normalized-crossword-m1-ogd-19-02.xml	SAT TT=1.147	SAT TT=5.918 CHECKS=359025 NODES=531	SAT TT=7.95 CHECKS=513466 NODES=531	? (TO) TT=1800.17	SAT TT=34.443 CHECKS=196117	SAT TT=28.547 CHECKS=237161	SAT TT=43.694 ASSIGNMENTS=114	SAT TT=66.435 ASSIGNMENTS=212	SAT TT=224.064 CHECKS=579765000 NODES=423	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=1.158 ASSIGNMENTS=103 CHECKS=118325	SAT TT=1.163 ASSIGNMENTS=103 CHECKS=118325	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=1.147 ASSIGNMENTS=103 CHECKS=118325	SAT TT=113.024 ASSIGNMENTS=20375 CHECKS=45974700	SAT TT=63.359	SAT TT=75.491 ASSIGNMENTS=12729 CHECKS=14687700	SAT TT=1.243 ASSIGNMENTS=142 CHECKS=135414	? TT=77.559	? (MO) TT=7.392	? (MO) TT=7.481
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdHerald/ normalized-crossword-m1-ogd-19-05.xml	SAT TT=0.591	SAT TT=3.968 CHECKS=389571 NODES=292	SAT TT=6.338 CHECKS=839027 NODES=299	? (TO) TT=1800.06	SAT TT=29.035 CHECKS=258501	SAT TT=13.478 CHECKS=159602	SAT TT=32.706 ASSIGNMENTS=112	SAT TT=66.631 ASSIGNMENTS=360	SAT TT=319.478 CHECKS=962057000 NODES=442	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.592 ASSIGNMENTS=120 CHECKS=164203	SAT TT=0.591 ASSIGNMENTS=120 CHECKS=164203	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.666 ASSIGNMENTS=120 CHECKS=164203	SAT TT=5.159 ASSIGNMENTS=1361 CHECKS=2496820	SAT TT=29.896	SAT TT=39.656 ASSIGNMENTS=10876 CHECKS=22538400	SAT TT=0.658 ASSIGNMENTS=124 CHECKS=169335	? (MO) TT=45.764	? (TO) TT=1800.05	? (TO) TT=1800.04
csp/ogdHerald/ normalized-crossword-m1-ogd-19-06.xml	SAT TT=1.454	SAT TT=5.327 CHECKS=443343 NODES=291	SAT TT=7.206 CHECKS=678067 NODES=291	? (TO) TT=1800.07	SAT TT=55.531 CHECKS=260089	SAT TT=27.71 CHECKS=109972	SAT TT=42.008 ASSIGNMENTS=153	SAT TT=65.947 ASSIGNMENTS=139	SAT TT=216.712 CHECKS=411071000 NODES=504	? (TO) TT=1800.04	? (TO) TT=1800	SAT TT=1.537 ASSIGNMENTS=157 CHECKS=161643	SAT TT=1.48 ASSIGNMENTS=157 CHECKS=161643	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=1.454 ASSIGNMENTS=157 CHECKS=161643	SAT TT=20.576 ASSIGNMENTS=3554 CHECKS=4652140	? (TO) TT=1800.03	SAT TT=203.098 ASSIGNMENTS=31585 CHECKS=47613500	SAT TT=1.491 ASSIGNMENTS=153 CHECKS=163902	? TT=100.411	? (MO) TT=7.29	? (MO) TT=7.88
csp/ogdHerald/ normalized-crossword-m1-ogd-19-08.xml	SAT TT=1.522	SAT TT=6.147 CHECKS=570466 NODES=302	SAT TT=8.602 CHECKS=1242960 NODES=568	? (TO) TT=1800.1	SAT TT=40.694 CHECKS=209968	SAT TT=25.092 CHECKS=133892	SAT TT=43.13 ASSIGNMENTS=150	SAT TT=69.216 ASSIGNMENTS=328	SAT TT=199.618 CHECKS=331564000 NODES=469	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=1.707 ASSIGNMENTS=192 CHECKS=243341	SAT TT=1.604 ASSIGNMENTS=192 CHECKS=243341	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1.734 ASSIGNMENTS=193 CHECKS=244313	SAT TT=55.023 ASSIGNMENTS=10905 CHECKS=18585500	SAT TT=202.706	SAT TT=42.129 ASSIGNMENTS=7809 CHECKS=14590800	SAT TT=1.522 ASSIGNMENTS=200 CHECKS=231462	? TT=81.781	? (MO) TT=8.23	? (MO) TT=8.06
csp/ogdHerald/ normalized-crossword-m1-ogd-21-03.xml	SAT TT=1.495	SAT TT=5.532 CHECKS=272797 NODES=371	SAT TT=7.693 CHECKS=463302 NODES=371	? (TO) TT=1800.12	SAT TT=43.687 CHECKS=219325	SAT TT=45.024 CHECKS=167154	SAT TT=51.517 ASSIGNMENTS=154	SAT TT=66.435 ASSIGNMENTS=140	SAT TT=492.62 CHECKS=1814310000 NODES=676	? (TO) TT=1800	? (TO) TT=1800.05	SAT TT=1.513 ASSIGNMENTS=180 CHECKS=161589	SAT TT=1.511 ASSIGNMENTS=180 CHECKS=161589	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=1.495 ASSIGNMENTS=180 CHECKS=161589	SAT TT=73.105 ASSIGNMENTS=11084 CHECKS=13950500	? (MO) TT=41.58	SAT TT=89.574 ASSIGNMENTS=14041 CHECKS=18222900	SAT TT=1.78 ASSIGNMENTS=191 CHECKS=216462	? TT=96.658	? (TO) TT=1800.2	? (MO) TT=8.45
csp/ogdHerald/ normalized-crossword-m1-ogd-21-05.xml	SAT TT=0.856	SAT TT=4.916 CHECKS=265481 NODES=383	SAT TT=6.868 CHECKS=373260 NODES=378	? (TO) TT=1800.11	SAT TT=51.277 CHECKS=370406	SAT TT=35.486 CHECKS=215167	SAT TT=42.235 ASSIGNMENTS=177	SAT TT=103.782 ASSIGNMENTS=1395	SAT TT=1376.45 CHECKS=6470460000 NODES=1036	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=1.332 ASSIGNMENTS=224 CHECKS=296774	SAT TT=1.259 ASSIGNMENTS=224 CHECKS=296774	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=1.184 ASSIGNMENTS=226 CHECKS=298539	SAT TT=49.589 ASSIGNMENTS=11555 CHECKS=16229300	SAT TT=48.976	SAT TT=107.702 ASSIGNMENTS=25082 CHECKS=38040600	SAT TT=0.856 ASSIGNMENTS=177 CHECKS=200195	? (MO) TT=34.788	? (TO) TT=1800.26	? (TO) TT=1800.29
csp/ogdHerald/ normalized-crossword-m1-ogd-21-08.xml	SAT TT=1.141	SAT TT=7.07 CHECKS=599752 NODES=367	SAT TT=8.68 CHECKS=1065130 NODES=371	? (TO) TT=1800.11	SAT TT=69.655 CHECKS=603265	SAT TT=31.593 CHECKS=358159	SAT TT=45.187 ASSIGNMENTS=198	? (TO) TT=1800.15	SAT TT=478.945 CHECKS=1936670000 NODES=890	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.15 ASSIGNMENTS=202 CHECKS=265265	SAT TT=1.214 ASSIGNMENTS=202 CHECKS=265265	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=1.141 ASSIGNMENTS=202 CHECKS=265265	SAT TT=38.767 ASSIGNMENTS=10651 CHECKS=17630500	? (TO) TT=1800.01	SAT TT=155.23 ASSIGNMENTS=36787 CHECKS=69086700	SAT TT=1.145 ASSIGNMENTS=207 CHECKS=261998	? TT=83.358	? (MO) TT=7.381	? (MO) TT=7.28
csp/ogdHerald/ normalized-crossword-m1-ogd-21-10.xml	SAT TT=3.256	SAT TT=8.983 CHECKS=265498 NODES=1384	SAT TT=11.328 CHECKS=200122 NODES=1029	? (problem) TT=51.237	SAT TT=89.782 CHECKS=1055370	SAT TT=60.949 CHECKS=470543	SAT TT=68.034 ASSIGNMENTS=151	? (TO) TT=1800.14	SAT TT=606.018 CHECKS=2703620000 NODES=997	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=16.73 ASSIGNMENTS=1383 CHECKS=264722	SAT TT=16.209 ASSIGNMENTS=1383 CHECKS=264722	? (TO) TT=1800.06	? (TO) TT=1800	SAT TT=4.932 ASSIGNMENTS=669 CHECKS=964438	SAT TT=94.418 ASSIGNMENTS=9794 CHECKS=16726500	? (MO) TT=45.47	SAT TT=157.801 ASSIGNMENTS=18001 CHECKS=30589900	SAT TT=3.256 ASSIGNMENTS=348 CHECKS=505001	? TT=78.311	? (MO) TT=7.09	? (MO) TT=7.07
csp/ogdHerald/ normalized-crossword-m1-ogd-23-02.xml	SAT TT=2.258	SAT TT=9.265 CHECKS=760880 NODES=608	SAT TT=11.278 CHECKS=1171760 NODES=444	? (problem) TT=65.319	SAT TT=72.649 CHECKS=509655	SAT TT=32.518 CHECKS=269031	SAT TT=70.359 ASSIGNMENTS=205	SAT TT=159.886 ASSIGNMENTS=2706	SAT TT=368.915 CHECKS=1156120000 NODES=874	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=2.392 ASSIGNMENTS=213 CHECKS=306603	SAT TT=2.502 ASSIGNMENTS=213 CHECKS=306603	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=2.387 ASSIGNMENTS=213 CHECKS=306603	SAT TT=85.353 ASSIGNMENTS=13279 CHECKS=24747700	? (MO) TT=44.76	SAT TT=269.006 ASSIGNMENTS=37726 CHECKS=77871200	SAT TT=2.258 ASSIGNMENTS=214 CHECKS=301928	? TT=98.452	? (MO) TT=9.35	? (MO) TT=9.31
csp/ogdHerald/ normalized-crossword-m1-ogd-23-03.xml	SAT TT=2.543	SAT TT=9.84 CHECKS=505816 NODES=1123	SAT TT=13.26 CHECKS=824798 NODES=1123	? (problem) TT=70.915	SAT TT=85.375 CHECKS=766586	SAT TT=39.048 CHECKS=351549	SAT TT=69.474 ASSIGNMENTS=179	SAT TT=600.469 ASSIGNMENTS=16825	SAT TT=531.525 CHECKS=2052790000 NODES=618	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=2.825 ASSIGNMENTS=250 CHECKS=346176	SAT TT=2.842 ASSIGNMENTS=250 CHECKS=346176	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=2.882 ASSIGNMENTS=276 CHECKS=369680	SAT TT=94.283 ASSIGNMENTS=11615 CHECKS=20454700	? (MO) TT=44.75	SAT TT=126.51 ASSIGNMENTS=15103 CHECKS=27159900	SAT TT=2.543 ASSIGNMENTS=201 CHECKS=286927	? TT=109.239	? (MO) TT=9.53	? (MO) TT=9.53
csp/ogdHerald/ normalized-crossword-m1-ogd-23-07.xml	SAT TT=2.426	SAT TT=9.987 CHECKS=632546 NODES=849	SAT TT=12.623 CHECKS=857925 NODES=450	? (problem) TT=64.583	SAT TT=73.616 CHECKS=425359	SAT TT=35.295 CHECKS=286091	SAT TT=71.405 ASSIGNMENTS=203	SAT TT=75.498 ASSIGNMENTS=380	SAT TT=430.468 CHECKS=1645730000 NODES=946	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=2.582 ASSIGNMENTS=189 CHECKS=283028	SAT TT=2.452 ASSIGNMENTS=189 CHECKS=283028	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=2.426 ASSIGNMENTS=189 CHECKS=283028	SAT TT=111.345 ASSIGNMENTS=12587 CHECKS=24669700	? (MO) TT=46	SAT TT=445.216 ASSIGNMENTS=51001 CHECKS=108336000	SAT TT=2.555 ASSIGNMENTS=192 CHECKS=283738	? TT=100.139	? (MO) TT=9.44	? (MO) TT=9.549
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdHerald/ normalized-crossword-m1-ogd-23-08.xml	SAT TT=1.429	SAT TT=8.74 CHECKS=635114 NODES=936	SAT TT=13.575 CHECKS=756952 NODES=1315	? (TO) TT=1800.18	SAT TT=78.405 CHECKS=758967	SAT TT=86.406 CHECKS=1929500	SAT TT=62.719 ASSIGNMENTS=254	? (TO) TT=1800.06	SAT TT=681.81 CHECKS=2860230000 NODES=988	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=1.449 ASSIGNMENTS=210 CHECKS=317852	SAT TT=1.443 ASSIGNMENTS=210 CHECKS=317852	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=1.429 ASSIGNMENTS=210 CHECKS=317852	SAT TT=66.898 ASSIGNMENTS=13076 CHECKS=22436100	? (MO) TT=49.84	SAT TT=236.242 ASSIGNMENTS=50588 CHECKS=89435300	SAT TT=1.619 ASSIGNMENTS=228 CHECKS=375495	? TT=83.992	? (TO) TT=1800.19	? (MO) TT=6.26
csp/ogdHerald/ normalized-crossword-m1-ogd-23-09.xml	SAT TT=2.094	SAT TT=10.762 CHECKS=1245680 NODES=1199	SAT TT=14.848 CHECKS=1005220 NODES=1235	? (TO) TT=1800.15	SAT TT=63.14 CHECKS=1138740	SAT TT=44.932 CHECKS=525345	SAT TT=71.804 ASSIGNMENTS=159	? (TO) TT=1800.07	SAT TT=555.663 CHECKS=2507880000 NODES=813	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=2.183 ASSIGNMENTS=222 CHECKS=546396	SAT TT=2.316 ASSIGNMENTS=222 CHECKS=546396	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=2.177 ASSIGNMENTS=226 CHECKS=551566	SAT TT=70.611 ASSIGNMENTS=10721 CHECKS=31297700	? (MO) TT=44.01	SAT TT=276.167 ASSIGNMENTS=42035 CHECKS=136670000	SAT TT=2.094 ASSIGNMENTS=216 CHECKS=624994	? TT=73.589	? (TO) TT=1800.11	? (MO) TT=7.415
csp/ogdHerald/ normalized-crossword-m1-ogd-23-10.xml	SAT TT=5.559	SAT TT=12.025 CHECKS=395373 NODES=1288	SAT TT=29.92 CHECKS=1389220 NODES=3196	? (problem) TT=60.821	SAT TT=84.148 CHECKS=333817	SAT TT=99.018 CHECKS=555449	SAT TT=69.622 ASSIGNMENTS=135	? (TO) TT=1800.14	SAT TT=216.174 CHECKS=228422000 NODES=1070	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=23.005 ASSIGNMENTS=2114 CHECKS=853311	SAT TT=26.045 ASSIGNMENTS=2114 CHECKS=853311	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=5.559 ASSIGNMENTS=352 CHECKS=585943	SAT TT=147.162 ASSIGNMENTS=11257 CHECKS=17668900	? (MO) TT=7.49	SAT TT=635.023 ASSIGNMENTS=52023 CHECKS=86383100	SAT TT=8.976 ASSIGNMENTS=507 CHECKS=963852	? TT=63.457	? (MO) TT=7.31	? (MO) TT=7.14
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle02.xml	SAT TT=0.009	SAT TT=0.741 CHECKS=1738 NODES=8	SAT TT=0.725 CHECKS=1041 NODES=0	SAT TT=0.065	SAT TT=0.04 CHECKS=436	SAT TT=0.034 CHECKS=488	SAT TT=0.732 ASSIGNMENTS=68	SAT TT=0.673 ASSIGNMENTS=6	SAT TT=88.955 CHECKS=17595 NODES=9	SAT TT=31.147 CHECKS=21926 NODES=8	SAT TT=32.547 CHECKS=19369 NODES=3	SAT TT=0.03 ASSIGNMENTS=143 CHECKS=5947	SAT TT=0.028 ASSIGNMENTS=143 CHECKS=5947	SAT TT=79.999	SAT TT=75.08	SAT TT=0.019 ASSIGNMENTS=145 CHECKS=6112	SAT TT=0.009 ASSIGNMENTS=15 CHECKS=613	SAT TT=0.343	SAT TT=0.01 ASSIGNMENTS=7 CHECKS=231	SAT TT=0.015 ASSIGNMENTS=118 CHECKS=3255	SAT TT=1337.74	SAT TT=0.834	SAT TT=0.896
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle03.xml	SAT TT=0.022	SAT TT=0.778 CHECKS=2393 NODES=14	SAT TT=0.814 CHECKS=1528 NODES=0	SAT TT=0.24	SAT TT=0.154 CHECKS=1032	SAT TT=0.131 CHECKS=997	SAT TT=1.212 ASSIGNMENTS=67	SAT TT=1.012 ASSIGNMENTS=11	SAT TT=136.879 CHECKS=415980 NODES=15	SAT TT=89.731 CHECKS=1966270 NODES=2250010	SAT TT=85.095 CHECKS=428991 NODES=12	SAT TT=0.222 ASSIGNMENTS=914 CHECKS=69613	SAT TT=0.209 ASSIGNMENTS=914 CHECKS=69613	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=0.204 ASSIGNMENTS=812 CHECKS=64590	SAT TT=0.057 ASSIGNMENTS=418 CHECKS=20259	SAT TT=0.497	SAT TT=0.024 ASSIGNMENTS=76 CHECKS=4153	SAT TT=0.022 ASSIGNMENTS=97 CHECKS=4590	? (TO) TT=1800.12	SAT TT=1.414	SAT TT=1.778
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle05.xml	SAT TT=0.036	SAT TT=0.859 CHECKS=2409 NODES=21	SAT TT=0.873 CHECKS=1744 NODES=0	SAT TT=1.543	SAT TT=0.339 CHECKS=1014	SAT TT=0.356 CHECKS=1263	SAT TT=2.752 ASSIGNMENTS=228	SAT TT=1.051 ASSIGNMENTS=15	SAT TT=90.287 CHECKS=3778160 NODES=22	SAT TT=38.4 CHECKS=50809300 NODES=56400000	SAT TT=46.702 CHECKS=29324900 NODES=1384	SAT TT=9.924 ASSIGNMENTS=228	SAT TT=10.565 ASSIGNMENTS=228	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.236 ASSIGNMENTS=2855 CHECKS=236063	SAT TT=0.076 ASSIGNMENTS=155 CHECKS=8744	SAT TT=0.914	SAT TT=0.036 ASSIGNMENTS=23 CHECKS=1155	SAT TT=0.061 ASSIGNMENTS=223 CHECKS=8840	? (MO) TT=40.129	SAT TT=4.423	SAT TT=5.662
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle06.xml	SAT TT=0.037	SAT TT=0.866 CHECKS=3346 NODES=24	SAT TT=0.884 CHECKS=2363 NODES=0	SAT TT=2.962	SAT TT=0.622 CHECKS=1547	SAT TT=0.527 CHECKS=1586	SAT TT=6.057 ASSIGNMENTS=297	SAT TT=1.457 ASSIGNMENTS=12	SAT TT=93.936 CHECKS=10348500 NODES=24	SAT TT=233.416 CHECKS=153308000 NODES=1398300000	? (TO) TT=1800.09	SAT TT=0.971 ASSIGNMENTS=1623 CHECKS=267414	SAT TT=1.055 ASSIGNMENTS=1623 CHECKS=267414	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=3.094 ASSIGNMENTS=4739 CHECKS=921562	SAT TT=0.037 ASSIGNMENTS=20 CHECKS=2672	SAT TT=1.097	SAT TT=0.053 ASSIGNMENTS=66 CHECKS=5705	SAT TT=0.047 ASSIGNMENTS=95 CHECKS=8714	? (MO) TT=37.661	SAT TT=9.449	SAT TT=11.887
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle07.xml	SAT TT=0.038	SAT TT=0.909 CHECKS=4866 NODES=30	SAT TT=0.903 CHECKS=4732 NODES=0	SAT TT=2.034	SAT TT=0.769 CHECKS=3743	SAT TT=0.511 CHECKS=2039	SAT TT=14.943 ASSIGNMENTS=3056	SAT TT=1.585 ASSIGNMENTS=23	SAT TT=132.296 CHECKS=7555750 NODES=31	SAT TT=1392.27 CHECKS=4822550000 NODES=1478230000	SAT TT=1018.32 CHECKS=1648650000 NODES=85045	SAT TT=0.21 ASSIGNMENTS=592 CHECKS=85849	SAT TT=0.208 ASSIGNMENTS=592 CHECKS=85849	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=0.204 ASSIGNMENTS=606 CHECKS=87656	SAT TT=0.054 ASSIGNMENTS=74 CHECKS=5663	SAT TT=1.016	SAT TT=0.038 ASSIGNMENTS=40 CHECKS=2377	SAT TT=0.074 ASSIGNMENTS=154 CHECKS=13498	? TT=100.925	SAT TT=7.027	SAT TT=8.72
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle08.xml	SAT TT=0.16	SAT TT=1.137 CHECKS=15503 NODES=41	SAT TT=1.122 CHECKS=12944 NODES=0	SAT TT=13.089	SAT TT=1.946 CHECKS=6389	SAT TT=2.458 CHECKS=10336	SAT TT=3.286 ASSIGNMENTS=273	SAT TT=3.09 ASSIGNMENTS=25	SAT TT=131.115 CHECKS=315091 NODES=44	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=1.024 ASSIGNMENTS=1526 CHECKS=530618	SAT TT=1.018 ASSIGNMENTS=1526 CHECKS=530618	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=1.014 ASSIGNMENTS=1438 CHECKS=502068	SAT TT=2.214 ASSIGNMENTS=1469 CHECKS=272335	SAT TT=2.805	SAT TT=0.165 ASSIGNMENTS=74 CHECKS=8801	SAT TT=0.16 ASSIGNMENTS=160 CHECKS=30198	? (TO) TT=1800.15	SAT TT=183.298	SAT TT=174.917
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle10.xml	SAT TT=0.118	SAT TT=1.213 CHECKS=22773 NODES=41	SAT TT=1.387 CHECKS=57768 NODES=44	SAT TT=4.219	SAT TT=48.738 CHECKS=247516	SAT TT=3.257 CHECKS=15114	SAT TT=3.581 ASSIGNMENTS=26	SAT TT=3.971 ASSIGNMENTS=28	SAT TT=129.362 CHECKS=134913 NODES=45	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=0.135 ASSIGNMENTS=24 CHECKS=5687	SAT TT=0.135 ASSIGNMENTS=24 CHECKS=5687	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=0.13 ASSIGNMENTS=24 CHECKS=5687	SAT TT=8.544 ASSIGNMENTS=11465 CHECKS=1729850	SAT TT=3.58	SAT TT=0.182 ASSIGNMENTS=71 CHECKS=18703	SAT TT=0.118 ASSIGNMENTS=24 CHECKS=5687	? (TO) TT=1800.18	SAT TT=232.981	SAT TT=237.225
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle11.xml	SAT TT=0.265	SAT TT=1.312 CHECKS=5711 NODES=38	SAT TT=1.182 CHECKS=3201 NODES=0	SAT TT=6.391	SAT TT=2.631 CHECKS=4449	SAT TT=2.664 CHECKS=5252	SAT TT=4.044 ASSIGNMENTS=174	SAT TT=3.643 ASSIGNMENTS=18	SAT TT=112.484 CHECKS=189330000 NODES=38	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=0.889 ASSIGNMENTS=1056 CHECKS=185443	SAT TT=0.901 ASSIGNMENTS=1056 CHECKS=185443	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.633 ASSIGNMENTS=944 CHECKS=170415	SAT TT=0.806 ASSIGNMENTS=322 CHECKS=48295	SAT TT=3.262	SAT TT=0.477 ASSIGNMENTS=208 CHECKS=21188	SAT TT=0.265 ASSIGNMENTS=110 CHECKS=22983	? TT=80.039	SAT TT=151.287	SAT TT=166.573
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle12.xml	SAT TT=0.045	SAT TT=1.079 CHECKS=24190 NODES=52	SAT TT=1.245 CHECKS=18061 NODES=0	SAT TT=2.563	SAT TT=0.88 CHECKS=8278	SAT TT=0.671 CHECKS=8767	SAT TT=1.981 ASSIGNMENTS=39	SAT TT=2.596 ASSIGNMENTS=36	SAT TT=128.682 CHECKS=10179500 NODES=56	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=0.059 ASSIGNMENTS=37 CHECKS=6989	SAT TT=0.06 ASSIGNMENTS=37 CHECKS=6989	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.045 ASSIGNMENTS=37 CHECKS=6989	SAT TT=2.603 ASSIGNMENTS=11178 CHECKS=2503680	? (TO) TT=1800.11	SAT TT=0.274 ASSIGNMENTS=643 CHECKS=155602	SAT TT=0.052 ASSIGNMENTS=44 CHECKS=10653	? (MO) TT=31.768	SAT TT=8.543	SAT TT=11.358
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle13.xml	SAT TT=0.298	SAT TT=1.712 CHECKS=34538 NODES=65	SAT TT=1.696 CHECKS=32395 NODES=0	SAT TT=10.352	SAT TT=8.014 CHECKS=26757	SAT TT=5.478 CHECKS=13912	SAT TT=6.587 ASSIGNMENTS=46	SAT TT=7.216 ASSIGNMENTS=34	SAT TT=137.415 CHECKS=2182740 NODES=70	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=0.324 ASSIGNMENTS=46 CHECKS=12954	SAT TT=0.307 ASSIGNMENTS=46 CHECKS=12954	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=0.298 ASSIGNMENTS=46 CHECKS=12954	SAT TT=18.772 ASSIGNMENTS=15822 CHECKS=4252790	SAT TT=5.715	SAT TT=2.268 ASSIGNMENTS=1121 CHECKS=433612	SAT TT=0.323 ASSIGNMENTS=40 CHECKS=13064	? (MO) TT=43.156	SAT TT=1202.06	SAT TT=1352.68
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle16.xml	SAT TT=0.275	SAT TT=2.326 CHECKS=141580 NODES=137	SAT TT=2.725 CHECKS=305792 NODES=137	SAT TT=1634.91	SAT TT=5.409 CHECKS=44521	SAT TT=3.878 CHECKS=38213	SAT TT=8.192 ASSIGNMENTS=87	SAT TT=19.296 ASSIGNMENTS=82	SAT TT=214.463 CHECKS=526612000 NODES=221	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=0.308 ASSIGNMENTS=88 CHECKS=40120	SAT TT=0.307 ASSIGNMENTS=88 CHECKS=40120	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=0.275 ASSIGNMENTS=88 CHECKS=40120	SAT TT=17.251 ASSIGNMENTS=19910 CHECKS=14155900	SAT TT=6.177	SAT TT=6.419 ASSIGNMENTS=4355 CHECKS=2539200	SAT TT=0.287 ASSIGNMENTS=82 CHECKS=39313	? (MO) TT=54.361	SAT TT=223.944	SAT TT=232.776
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle17.xml	SAT TT=0.418	SAT TT=2.599 CHECKS=245496 NODES=185	SAT TT=3.612 CHECKS=452743 NODES=185	? (TO) TT=1800.06	SAT TT=12.358 CHECKS=69677	SAT TT=10.756 CHECKS=69033	SAT TT=15.711 ASSIGNMENTS=98	SAT TT=51.771 ASSIGNMENTS=102	SAT TT=191.13 CHECKS=305425000 NODES=241	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=0.445 ASSIGNMENTS=108 CHECKS=73192	SAT TT=0.448 ASSIGNMENTS=108 CHECKS=73192	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=0.45 ASSIGNMENTS=108 CHECKS=73192	SAT TT=40.023 ASSIGNMENTS=25361 CHECKS=27031400	? (TO) TT=1800.06	SAT TT=58.84 ASSIGNMENTS=25913 CHECKS=18753700	SAT TT=0.418 ASSIGNMENTS=104 CHECKS=67307	? TT=79.348	SAT TT=1046.23	SAT TT=1059.65
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle19.xml	SAT TT=0.826	SAT TT=3.1 CHECKS=154205 NODES=193	SAT TT=4.187 CHECKS=280376 NODES=193	? (TO) TT=1800.08	SAT TT=34.378 CHECKS=134278	SAT TT=13.675 CHECKS=48994	SAT TT=22.766 ASSIGNMENTS=91	SAT TT=60.356 ASSIGNMENTS=88	SAT TT=168.358 CHECKS=370142000 NODES=266	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=0.929 ASSIGNMENTS=100 CHECKS=59462	SAT TT=0.907 ASSIGNMENTS=100 CHECKS=59462	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.871 ASSIGNMENTS=100 CHECKS=59462	SAT TT=43.948 ASSIGNMENTS=21103 CHECKS=19679500	SAT TT=19.251	SAT TT=21.767 ASSIGNMENTS=5689 CHECKS=4028720	SAT TT=0.826 ASSIGNMENTS=92 CHECKS=53804	? TT=79.599	? (MO) TT=6.337	? (MO) TT=6.87
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle21.xml	SAT TT=0.162	SAT TT=1.752 CHECKS=116587 NODES=131	SAT TT=2.259 CHECKS=213548 NODES=128	SAT TT=11.408	SAT TT=6.849 CHECKS=38625	SAT TT=6.707 CHECKS=89031	SAT TT=6.928 ASSIGNMENTS=71	SAT TT=17.395 ASSIGNMENTS=79	SAT TT=295.425 CHECKS=784086000 NODES=199	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.172 ASSIGNMENTS=79 CHECKS=32801	SAT TT=0.172 ASSIGNMENTS=79 CHECKS=32801	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.162 ASSIGNMENTS=78 CHECKS=32650	SAT TT=9.876 ASSIGNMENTS=19879 CHECKS=9969070	SAT TT=5.674	SAT TT=4.095 ASSIGNMENTS=4094 CHECKS=1997310	SAT TT=0.163 ASSIGNMENTS=96 CHECKS=35630	? (MO) TT=41.805	SAT TT=113.241	SAT TT=122.424
csp/ogdPuzzle/ normalized-crossword-m1-ogd-puzzle22.xml	SAT TT=0.347	SAT TT=2.187 CHECKS=81327 NODES=134	SAT TT=2.833 CHECKS=139203 NODES=134	? (TO) TT=1800.05	SAT TT=15.41 CHECKS=68840	SAT TT=13.484 CHECKS=42701	SAT TT=18.974 ASSIGNMENTS=63	SAT TT=24.086 ASSIGNMENTS=62	SAT TT=133.131 CHECKS=3284820 NODES=138	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=0.367 ASSIGNMENTS=60 CHECKS=34811	SAT TT=0.347 ASSIGNMENTS=60 CHECKS=34811	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=0.364 ASSIGNMENTS=60 CHECKS=34811	SAT TT=55.861 ASSIGNMENTS=14353 CHECKS=11369000	SAT TT=13.183	SAT TT=17.441 ASSIGNMENTS=3790 CHECKS=3330050	SAT TT=0.428 ASSIGNMENTS=87 CHECKS=50191	? (MO) TT=41.999	? (TO) TT=1800.07	? (TO) TT=1800.1
csp/primes-10/ normalized-primes-10-20-2-1.xml	SAT TT=0.01	SAT TT=0.853 CHECKS=158104 NODES=100	SAT TT=0.816 CHECKS=158102 NODES=0	SAT TT=0.033	SAT TT=0.074 CHECKS=8189	SAT TT=0.162 CHECKS=454379	SAT TT=0.915 ASSIGNMENTS=70	SAT TT=0.918 ASSIGNMENTS=70	SAT TT=0.789 CHECKS=123369 NODES=100	SAT TT=1.954 CHECKS=235710 NODES=2550000	SAT TT=0.895 CHECKS=408855 NODES=25	SAT TT=0.024 ASSIGNMENTS=80 CHECKS=426	SAT TT=0.024 ASSIGNMENTS=80 CHECKS=426	SAT TT=2.475	SAT TT=2.41	SAT TT=0.01 ASSIGNMENTS=80 CHECKS=426	SAT TT=0.011 ASSIGNMENTS=188 CHECKS=2153	SAT TT=0.36	SAT TT=0.754 ASSIGNMENTS=12314 CHECKS=205605	SAT TT=0.011 ASSIGNMENTS=80 CHECKS=426	SAT TT=4.472	SAT TT=0.661	SAT TT=0.677
csp/primes-10/ normalized-primes-10-20-2-7.xml	SAT TT=0.017	SAT TT=653.535 CHECKS=951192000 NODES=2248	SAT TT=1364.82 CHECKS=1947110000 NODES=3646	SAT TT=0.041	SAT TT=0.384 CHECKS=2307	SAT TT=0.043 CHECKS=3130	SAT TT=2.162 ASSIGNMENTS=68	SAT TT=2.831 ASSIGNMENTS=133	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.032 ASSIGNMENTS=155 CHECKS=11037	SAT TT=0.031 ASSIGNMENTS=155 CHECKS=11037	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=0.018 ASSIGNMENTS=157 CHECKS=11166	SAT TT=0.319 ASSIGNMENTS=7895 CHECKS=627071	SAT TT=0.408	SAT TT=3.165 ASSIGNMENTS=74177 CHECKS=3854570	SAT TT=0.017 ASSIGNMENTS=188 CHECKS=10088	? TT=96.005	? (MO) TT=75.97	? (MO) TT=286.147
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-10/ normalized-primes-10-20-3-5.xml	SAT TT=0.016	SAT TT=5.501 CHECKS=8073400 NODES=100	SAT TT=15.358 CHECKS=23870500 NODES=136	SAT TT=0.038	SAT TT=0.49 CHECKS=5200	SAT TT=0.039 CHECKS=4452	SAT TT=1.771 ASSIGNMENTS=74	SAT TT=2.393 ASSIGNMENTS=427	SAT TT=408.086 CHECKS=1231760000 NODES=100	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=0.028 ASSIGNMENTS=292 CHECKS=11929	SAT TT=0.031 ASSIGNMENTS=292 CHECKS=11929	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.018 ASSIGNMENTS=287 CHECKS=10416	SAT TT=0.196 ASSIGNMENTS=8217 CHECKS=358629	SAT TT=0.383	SAT TT=1.672 ASSIGNMENTS=42786 CHECKS=1300880	SAT TT=0.016 ASSIGNMENTS=301 CHECKS=9404	? TT=156.347	SAT TT=50.413	SAT TT=262.697
csp/primes-10/ normalized-primes-10-20-3-7.xml	SAT TT=0.019	? (TO) TT=1800.06	? (TO) TT=1800.12	SAT TT=0.046	SAT TT=0.462 CHECKS=4009	SAT TT=0.095 CHECKS=7125	SAT TT=1.985 ASSIGNMENTS=67	SAT TT=4.031 ASSIGNMENTS=1397	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=0.034 ASSIGNMENTS=367 CHECKS=16057	SAT TT=0.031 ASSIGNMENTS=367 CHECKS=16057	? (TO) TT=1800	? (TO) TT=1800.02	SAT TT=0.022 ASSIGNMENTS=416 CHECKS=21267	SAT TT=0.291 ASSIGNMENTS=8978 CHECKS=616039	SAT TT=0.379	SAT TT=5.415 ASSIGNMENTS=79977 CHECKS=4554320	SAT TT=0.019 ASSIGNMENTS=271 CHECKS=13261	? TT=142.343	? (MO) TT=107.42	? (MO) TT=291.89
csp/primes-10/ normalized-primes-10-40-2-1.xml	SAT TT=0.014	SAT TT=0.881 CHECKS=135689 NODES=100	SAT TT=0.869 CHECKS=136052 NODES=0	SAT TT=0.038	SAT TT=0.151 CHECKS=3125	SAT TT=0.112 CHECKS=192747	SAT TT=1.025 ASSIGNMENTS=43	SAT TT=1.131 ASSIGNMENTS=43	SAT TT=1.055 CHECKS=137067 NODES=100	SAT TT=0.978 CHECKS=150258 NODES=150008	SAT TT=1.197 CHECKS=476634 NODES=695	SAT TT=0.023 ASSIGNMENTS=77 CHECKS=1489	SAT TT=0.025 ASSIGNMENTS=77 CHECKS=1489	SAT TT=3.702	SAT TT=3.484	SAT TT=0.014 ASSIGNMENTS=77 CHECKS=1489	SAT TT=0.019 ASSIGNMENTS=607 CHECKS=9911	SAT TT=0.427	SAT TT=0.171 ASSIGNMENTS=14247 CHECKS=153407	SAT TT=0.014 ASSIGNMENTS=81 CHECKS=1668	SAT TT=6.239	SAT TT=0.719	SAT TT=0.821
csp/primes-10/ normalized-primes-10-40-2-3.xml	SAT TT=0.024	SAT TT=1.818 CHECKS=2215470 NODES=100	SAT TT=1.748 CHECKS=2118250 NODES=0	SAT TT=0.042	SAT TT=1.058 CHECKS=143718	SAT TT=0.769 CHECKS=141544	SAT TT=1.447 ASSIGNMENTS=41	SAT TT=1.45 ASSIGNMENTS=41	SAT TT=88.129 CHECKS=36681900 NODES=102	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.036 ASSIGNMENTS=265 CHECKS=16199	SAT TT=0.032 ASSIGNMENTS=265 CHECKS=16199	SAT TT=92.853	SAT TT=87.583	SAT TT=0.024 ASSIGNMENTS=248 CHECKS=15065	SAT TT=0.229 ASSIGNMENTS=6072 CHECKS=373064	SAT TT=0.471	SAT TT=4.728 ASSIGNMENTS=44233 CHECKS=3019640	SAT TT=0.048 ASSIGNMENTS=856 CHECKS=63863	? TT=235.257	SAT TT=1.659	SAT TT=3.6
csp/primes-10/ normalized-primes-10-40-2-5.xml	SAT TT=0.046	SAT TT=3.666 CHECKS=4657610 NODES=114	SAT TT=4.847 CHECKS=6028720 NODES=104	SAT TT=0.046	SAT TT=1.665 CHECKS=110788	SAT TT=1.287 CHECKS=103096	SAT TT=1.751 ASSIGNMENTS=66	SAT TT=3.364 ASSIGNMENTS=819	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=0.104 ASSIGNMENTS=2329 CHECKS=179214	SAT TT=0.104 ASSIGNMENTS=2329 CHECKS=179214	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=0.061 ASSIGNMENTS=1234 CHECKS=98205	SAT TT=0.506 ASSIGNMENTS=10783 CHECKS=972402	SAT TT=0.406	SAT TT=1.657 ASSIGNMENTS=22774 CHECKS=1672320	SAT TT=0.046 ASSIGNMENTS=593 CHECKS=56924	? (TO) TT=1802.16	SAT TT=12.266	SAT TT=54.304
csp/primes-10/ normalized-primes-10-40-2-7.xml	SAT TT=33.443	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=115.815 CHECKS=5173190	SAT TT=763.048 CHECKS=34974900	SAT TT=319.275 ASSIGNMENTS=127110	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=40.446 ASSIGNMENTS=158147 CHECKS=72472100	SAT TT=38.867 ASSIGNMENTS=158147 CHECKS=72472100	? (TO) TT=1800.07	? (TO) TT=1800	SAT TT=842.724 ASSIGNMENTS=3552770 CHECKS=1768760000	SAT TT=563.257 ASSIGNMENTS=2830140 CHECKS=1210090000	SAT TT=72.969	SAT TT=47.41 ASSIGNMENTS=131010 CHECKS=49656500	SAT TT=33.443 ASSIGNMENTS=158147 CHECKS=72472100	? TT=150.763	? (MO) TT=114.562	? (MO) TT=301.34
csp/primes-10/ normalized-primes-10-40-3-1.xml	SAT TT=0.022	SAT TT=1.772 CHECKS=2005960 NODES=100	SAT TT=1.724 CHECKS=2005960 NODES=0	SAT TT=0.042	SAT TT=0.41 CHECKS=74382	SAT TT=0.212 CHECKS=85477	SAT TT=0.946 ASSIGNMENTS=33	SAT TT=0.969 ASSIGNMENTS=33	SAT TT=7.902 CHECKS=1673280 NODES=100	SAT TT=4.618 CHECKS=3454780 NODES=900005	SAT TT=3.523 CHECKS=1860540 NODES=3	SAT TT=0.033 ASSIGNMENTS=111 CHECKS=13839	SAT TT=0.03 ASSIGNMENTS=111 CHECKS=13839	SAT TT=10.82	SAT TT=10.457	SAT TT=0.022 ASSIGNMENTS=115 CHECKS=13960	SAT TT=0.316 ASSIGNMENTS=5463 CHECKS=539215	SAT TT=0.419	SAT TT=1.096 ASSIGNMENTS=16216 CHECKS=1120890	SAT TT=0.022 ASSIGNMENTS=113 CHECKS=13851	? TT=153.017	SAT TT=1.038	SAT TT=1.692
csp/primes-10/ normalized-primes-10-40-3-5.xml		? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=1338.5	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=207.878	? (MO) TT=78.56	? (MO) TT=287.83
csp/primes-10/ normalized-primes-10-60-2-7.xml	SAT TT=0.122	SAT TT=493.417 CHECKS=775250000 NODES=5699	SAT TT=57.725 CHECKS=103653000 NODES=1286	SAT TT=0.122	SAT TT=8.599 CHECKS=334066	SAT TT=5.472 CHECKS=221518	SAT TT=10.268 ASSIGNMENTS=2512	SAT TT=5.397 ASSIGNMENTS=30	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=130.59 ASSIGNMENTS=327787 CHECKS=259520000	SAT TT=128.256 ASSIGNMENTS=327787 CHECKS=259520000	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=15.694 ASSIGNMENTS=40637 CHECKS=33102200	SAT TT=2.589 ASSIGNMENTS=8468 CHECKS=5383740	SAT TT=0.64	SAT TT=50.278 ASSIGNMENTS=74191 CHECKS=62653000	SAT TT=122.707 ASSIGNMENTS=327787 CHECKS=259520000	? TT=153.487	? (MO) TT=88.81	? (MO) TT=296.502
csp/primes-10/ normalized-primes-10-60-3-5.xml	SAT TT=5.114	? (TO) TT=1800.08	? (TO) TT=1800.17	SAT TT=30.747	SAT TT=12.447 CHECKS=585172	SAT TT=5.114 CHECKS=236405	SAT TT=69.104 ASSIGNMENTS=19287	SAT TT=17.185 ASSIGNMENTS=2075	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=30.951 ASSIGNMENTS=60397 CHECKS=48981300	SAT TT=29.686 ASSIGNMENTS=60397 CHECKS=48981300	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=130.737 ASSIGNMENTS=331988 CHECKS=269430000	SAT TT=70.003 ASSIGNMENTS=153078 CHECKS=144142000	SAT TT=1.378	SAT TT=371.266 ASSIGNMENTS=236201 CHECKS=231564000	SAT TT=23.846 ASSIGNMENTS=60397 CHECKS=48981300	? (MO) TT=91.924	? (MO) TT=91.78	? (MO) TT=299.823
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-10/ normalized-primes-10-60-3-7.xml	SAT TT=39.879	? (TO) TT=1800.09	? (TO) TT=1800.18	SAT TT=39.879	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=1251.29	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=159.955	? TT=177.151	? TT=176.403
csp/primes-10/ normalized-primes-10-80-2-3.xml	SAT TT=0.022	SAT TT=1.093 CHECKS=303008 NODES=100	SAT TT=1.076 CHECKS=302110 NODES=0	SAT TT=0.056	SAT TT=0.607 CHECKS=463	SAT TT=0.022 CHECKS=425	SAT TT=1.008 ASSIGNMENTS=4	SAT TT=1.02 ASSIGNMENTS=4	SAT TT=104.127 CHECKS=16003400 NODES=100	SAT TT=43.66 CHECKS=16010400 NODES=0	SAT TT=40.844 CHECKS=16010400 NODES=0	SAT TT=0.033 ASSIGNMENTS=11 CHECKS=3914	SAT TT=0.035 ASSIGNMENTS=11 CHECKS=3914	SAT TT=191.251	SAT TT=187.716	SAT TT=0.023 ASSIGNMENTS=11 CHECKS=3912	SAT TT=0.024 ASSIGNMENTS=8 CHECKS=3784	SAT TT=0.592	SAT TT=0.022 ASSIGNMENTS=10 CHECKS=3892	SAT TT=0.022 ASSIGNMENTS=11 CHECKS=3914	? TT=839.813	SAT TT=1.023	SAT TT=1.052
csp/primes-10/ normalized-primes-10-80-3-7.xml	SAT TT=0.16	SAT TT=86.406 CHECKS=147938000 NODES=1190	SAT TT=72.313 CHECKS=134964000 NODES=1240	SAT TT=0.16	SAT TT=11.46 CHECKS=411761	SAT TT=6.827 CHECKS=269248	SAT TT=6.842 ASSIGNMENTS=48	SAT TT=22.164 ASSIGNMENTS=664	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=32.59 ASSIGNMENTS=42572 CHECKS=58246100	SAT TT=32.78 ASSIGNMENTS=42572 CHECKS=58246100	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=7.263 ASSIGNMENTS=7759 CHECKS=15188400	SAT TT=5.086 ASSIGNMENTS=6721 CHECKS=10624600	SAT TT=7.464	SAT TT=105.574 ASSIGNMENTS=97456 CHECKS=78422600	SAT TT=25.357 ASSIGNMENTS=42572 CHECKS=58246100	? TT=175.723	? TT=179.94	? TT=172.781
csp/primes-15/ normalized-primes-15-20-2-1.xml	SAT TT=0.012	SAT TT=1.044 CHECKS=625877 NODES=100	SAT TT=0.999 CHECKS=625878 NODES=0	SAT TT=0.032	SAT TT=0.085 CHECKS=11512	SAT TT=0.191 CHECKS=727194	SAT TT=0.964 ASSIGNMENTS=70	SAT TT=0.965 ASSIGNMENTS=70	SAT TT=1.133 CHECKS=351005 NODES=100	SAT TT=0.829 CHECKS=359460 NODES=3	SAT TT=0.833 CHECKS=359593 NODES=4	SAT TT=0.024 ASSIGNMENTS=124 CHECKS=1139	SAT TT=0.024 ASSIGNMENTS=124 CHECKS=1139	SAT TT=3.971	SAT TT=3.808	SAT TT=0.012 ASSIGNMENTS=131 CHECKS=1287	SAT TT=0.056 ASSIGNMENTS=9295 CHECKS=68768	SAT TT=0.35	SAT TT=0.122 ASSIGNMENTS=15713 CHECKS=116213	SAT TT=0.014 ASSIGNMENTS=124 CHECKS=1139	SAT TT=9.963	SAT TT=0.664	SAT TT=0.689
csp/primes-15/ normalized-primes-15-20-2-3.xml	SAT TT=0.016	SAT TT=4.054 CHECKS=6875710 NODES=208	SAT TT=3.515 CHECKS=5466530 NODES=0	SAT TT=0.039	SAT TT=0.298 CHECKS=9399	SAT TT=0.405 CHECKS=415121	SAT TT=1.843 ASSIGNMENTS=68	SAT TT=2.076 ASSIGNMENTS=68	SAT TT=254.936 CHECKS=522581000 NODES=109	? (TO) TT=1800.04	? (MO) TT=32.08	SAT TT=0.026 ASSIGNMENTS=457 CHECKS=10020	SAT TT=0.031 ASSIGNMENTS=457 CHECKS=10020	SAT TT=672.909	SAT TT=669.211	SAT TT=0.016 ASSIGNMENTS=484 CHECKS=10922	SAT TT=0.115 ASSIGNMENTS=9210 CHECKS=210742	SAT TT=0.386	SAT TT=0.189 ASSIGNMENTS=10828 CHECKS=292168	SAT TT=0.017 ASSIGNMENTS=459 CHECKS=15670	? TT=149.464	SAT TT=5.382	SAT TT=19.036
csp/primes-15/ normalized-primes-15-20-2-5.xml	SAT TT=0.029	? (TO) TT=1800.08	? (TO) TT=1800.13	SAT TT=0.039	SAT TT=1.315 CHECKS=461347	SAT TT=1.048 CHECKS=455362	SAT TT=2.442 ASSIGNMENTS=68	SAT TT=3.189 ASSIGNMENTS=63	? (TO) TT=1800.1	? (MO) TT=37.01	? (TO) TT=1800.08	SAT TT=0.034 ASSIGNMENTS=395 CHECKS=27209	SAT TT=0.036 ASSIGNMENTS=395 CHECKS=27209	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=0.031 ASSIGNMENTS=215 CHECKS=50660	SAT TT=0.179 ASSIGNMENTS=7414 CHECKS=370628	SAT TT=0.363	SAT TT=0.432 ASSIGNMENTS=17500 CHECKS=785998	SAT TT=0.029 ASSIGNMENTS=628 CHECKS=40274	? TT=484.085	? (MO) TT=64.918	? (MO) TT=256.178
csp/primes-15/ normalized-primes-15-20-2-7.xml	SAT TT=0.016	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=0.045	SAT TT=0.471 CHECKS=2162	SAT TT=0.153 CHECKS=14846	SAT TT=3.504 ASSIGNMENTS=67	SAT TT=4.565 ASSIGNMENTS=403	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=0.026 ASSIGNMENTS=179 CHECKS=11240	SAT TT=0.027 ASSIGNMENTS=179 CHECKS=11240	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=0.017 ASSIGNMENTS=177 CHECKS=11598	SAT TT=0.312 ASSIGNMENTS=8319 CHECKS=734406	SAT TT=0.397	SAT TT=0.396 ASSIGNMENTS=11581 CHECKS=946619	SAT TT=0.016 ASSIGNMENTS=185 CHECKS=9088	? TT=153.795	? TT=172.008	? TT=177.897
csp/primes-15/ normalized-primes-15-20-3-3.xml	SAT TT=0.014	SAT TT=1058.63 CHECKS=2002010000 NODES=19894	SAT TT=1112.38 CHECKS=2082310000 NODES=19952	SAT TT=0.041	SAT TT=0.346 CHECKS=6410	SAT TT=0.052 CHECKS=13140	SAT TT=3.165 ASSIGNMENTS=1400	SAT TT=4.201 ASSIGNMENTS=153	? (MO) TT=40.81	? (MO) TT=39.08	? (TO) TT=1800.07	SAT TT=0.027 ASSIGNMENTS=226 CHECKS=8194	SAT TT=0.026 ASSIGNMENTS=226 CHECKS=8194	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=0.016 ASSIGNMENTS=213 CHECKS=7952	SAT TT=0.19 ASSIGNMENTS=8621 CHECKS=388027	SAT TT=0.387	SAT TT=0.549 ASSIGNMENTS=13837 CHECKS=1105280	SAT TT=0.014 ASSIGNMENTS=226 CHECKS=8194	? (MO) TT=80.643	SAT TT=11.798	SAT TT=50.674
csp/primes-15/ normalized-primes-15-20-3-5.xml	SAT TT=0.012	SAT TT=44.969 CHECKS=84104800 NODES=1029	SAT TT=17.091 CHECKS=29812400 NODES=332	SAT TT=0.039	SAT TT=0.499 CHECKS=5503	SAT TT=0.988 CHECKS=308849	SAT TT=3.076 ASSIGNMENTS=65	SAT TT=4.459 ASSIGNMENTS=418	? (MO) TT=31	? (MO) TT=31.21	? (TO) TT=1800.01	SAT TT=0.024 ASSIGNMENTS=209 CHECKS=5780	SAT TT=0.028 ASSIGNMENTS=209 CHECKS=5780	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=0.014 ASSIGNMENTS=212 CHECKS=5862	SAT TT=0.154 ASSIGNMENTS=8357 CHECKS=346753	SAT TT=0.433	SAT TT=0.222 ASSIGNMENTS=10238 CHECKS=392054	SAT TT=0.012 ASSIGNMENTS=228 CHECKS=6277	? TT=148.497	? TT=171.401	? TT=163.689
csp/primes-15/ normalized-primes-15-40-2-1.xml	SAT TT=0.015	SAT TT=1.016 CHECKS=453007 NODES=100	SAT TT=1.033 CHECKS=453007 NODES=0	SAT TT=0.038	SAT TT=0.201 CHECKS=33733	SAT TT=0.071 CHECKS=183793	SAT TT=0.983 ASSIGNMENTS=40	SAT TT=1.186 ASSIGNMENTS=40	SAT TT=1.843 CHECKS=433837 NODES=100	SAT TT=1.244 CHECKS=438773 NODES=3	SAT TT=1.18 CHECKS=438782 NODES=2	SAT TT=0.026 ASSIGNMENTS=81 CHECKS=1797	SAT TT=0.027 ASSIGNMENTS=81 CHECKS=1797	SAT TT=4.941	SAT TT=5.016	SAT TT=0.015 ASSIGNMENTS=81 CHECKS=1798	SAT TT=0.028 ASSIGNMENTS=1611 CHECKS=20491	SAT TT=0.387	SAT TT=0.042 ASSIGNMENTS=3392 CHECKS=27539	SAT TT=0.016 ASSIGNMENTS=82 CHECKS=1797	SAT TT=17.683	SAT TT=0.722	SAT TT=0.739
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-15/ normalized-primes-15-40-2-7.xml	SAT TT=1443.63	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.01	? (MO) TT=36.87	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=1443.63 ASSIGNMENTS=11022500 CHECKS=3704260000	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=150.714	? TT=168.574	? TT=170.652
csp/primes-15/ normalized-primes-15-40-3-1.xml	SAT TT=0.027	SAT TT=2.708 CHECKS=4512560 NODES=176	SAT TT=1.45 CHECKS=1283470 NODES=0	SAT TT=0.041	SAT TT=0.455 CHECKS=1963	SAT TT=0.126 CHECKS=139933	SAT TT=0.925 ASSIGNMENTS=32	SAT TT=0.928 ASSIGNMENTS=32	SAT TT=50.607 CHECKS=18566900 NODES=100	SAT TT=18.439 CHECKS=19420900 NODES=2250010	SAT TT=15.754 CHECKS=18777000 NODES=3	SAT TT=0.042 ASSIGNMENTS=735 CHECKS=30517	SAT TT=0.042 ASSIGNMENTS=735 CHECKS=30517	SAT TT=45.823	SAT TT=45.152	SAT TT=0.027 ASSIGNMENTS=612 CHECKS=28673	SAT TT=0.171 ASSIGNMENTS=5469 CHECKS=330249	SAT TT=0.426	SAT TT=0.192 ASSIGNMENTS=14231 CHECKS=327165	SAT TT=0.028 ASSIGNMENTS=451 CHECKS=33181	? (MO) TT=70.332	SAT TT=1	SAT TT=1.452
csp/primes-15/ normalized-primes-15-40-3-5.xml		? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.05	? (MO) TT=21.21	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (MO) TT=94.112	? TT=164.007	? TT=160.96
csp/primes-15/ normalized-primes-15-40-3-7.xml		? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.05	? TT=156.947	? TT=171.199	? TT=171.363
csp/primes-15/ normalized-primes-15-60-2-7.xml	SAT TT=0.084	SAT TT=11.562 CHECKS=20201800 NODES=995	SAT TT=14.885 CHECKS=24754700 NODES=975	SAT TT=0.084	SAT TT=2.331 CHECKS=47350	SAT TT=2.153 CHECKS=82703	SAT TT=1.579 ASSIGNMENTS=4	SAT TT=1.602 ASSIGNMENTS=4	? (MO) TT=34.32	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.171 ASSIGNMENTS=2582 CHECKS=2852640	SAT TT=1.165 ASSIGNMENTS=2582 CHECKS=2852640	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=9.156 ASSIGNMENTS=16738 CHECKS=23001700	SAT TT=38.774 ASSIGNMENTS=91439 CHECKS=97877200	SAT TT=0.595	SAT TT=3.579 ASSIGNMENTS=14758 CHECKS=8664370	SAT TT=1.442 ASSIGNMENTS=3648 CHECKS=3569320	? (MO) TT=70.793	? TT=175.619	? TT=176.447
csp/primes-15/ normalized-primes-15-80-2-1.xml	SAT TT=0.02	SAT TT=0.977 CHECKS=153841 NODES=100	SAT TT=0.966 CHECKS=153841 NODES=0	SAT TT=0.047	SAT TT=0.371 CHECKS=584	SAT TT=0.02 CHECKS=541	SAT TT=1.027 ASSIGNMENTS=10	SAT TT=1.034 ASSIGNMENTS=10	SAT TT=2.76 CHECKS=122263 NODES=100	SAT TT=1.619 CHECKS=123343 NODES=0	SAT TT=1.621 CHECKS=123343 NODES=0	SAT TT=0.03 ASSIGNMENTS=42 CHECKS=1496	SAT TT=0.034 ASSIGNMENTS=42 CHECKS=1496	SAT TT=6.815	SAT TT=6.378	SAT TT=0.022 ASSIGNMENTS=42 CHECKS=1496	SAT TT=0.027 ASSIGNMENTS=1052 CHECKS=10340	SAT TT=0.457	SAT TT=0.024 ASSIGNMENTS=970 CHECKS=2723	SAT TT=0.021 ASSIGNMENTS=42 CHECKS=1496	SAT TT=17.438	SAT TT=0.812	SAT TT=0.821
csp/primes-15/ normalized-primes-15-80-2-3.xml	SAT TT=0.022	SAT TT=1.652 CHECKS=720329 NODES=100	SAT TT=1.586 CHECKS=737764 NODES=0	SAT TT=0.057	SAT TT=0.878 CHECKS=435	SAT TT=0.023 CHECKS=396	SAT TT=0.98 ASSIGNMENTS=4	SAT TT=0.975 ASSIGNMENTS=4	? (MO) TT=121.73	? (MO) TT=32.38	? (MO) TT=464.26	SAT TT=0.038 ASSIGNMENTS=4 CHECKS=3864	SAT TT=0.036 ASSIGNMENTS=4 CHECKS=3864	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.026 ASSIGNMENTS=4 CHECKS=3864	SAT TT=0.024 ASSIGNMENTS=4 CHECKS=3863	SAT TT=0.516	SAT TT=0.025 ASSIGNMENTS=4 CHECKS=3864	SAT TT=0.022 ASSIGNMENTS=4 CHECKS=3864	? TT=426.146	SAT TT=1.057	SAT TT=1.079
csp/primes-15/ normalized-primes-15-80-3-1.xml	SAT TT=0.025	SAT TT=1.299 CHECKS=872531 NODES=100	SAT TT=1.303 CHECKS=686150 NODES=0	SAT TT=0.057	SAT TT=0.974 CHECKS=5101	SAT TT=0.027 CHECKS=2726	SAT TT=1.023 ASSIGNMENTS=9	SAT TT=0.894 ASSIGNMENTS=9	SAT TT=84.377 CHECKS=8708400 NODES=100	SAT TT=24.955 CHECKS=9043240 NODES=0	SAT TT=24.737 CHECKS=9043240 NODES=0	SAT TT=0.034 ASSIGNMENTS=61 CHECKS=8807	SAT TT=0.036 ASSIGNMENTS=61 CHECKS=8807	SAT TT=96.082	SAT TT=93.246	SAT TT=0.025 ASSIGNMENTS=58 CHECKS=8774	SAT TT=0.028 ASSIGNMENTS=1028 CHECKS=18497	SAT TT=0.538	SAT TT=0.029 ASSIGNMENTS=1303 CHECKS=10591	SAT TT=0.029 ASSIGNMENTS=61 CHECKS=8807	? (MO) TT=52.823	SAT TT=1.038	SAT TT=1.244
csp/primes-15/ normalized-primes-15-80-3-5.xml	SAT TT=0.686	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=0.686	SAT TT=17.571 CHECKS=752519	SAT TT=11.804 CHECKS=603646	SAT TT=12.083 ASSIGNMENTS=207	SAT TT=21.58 ASSIGNMENTS=701	? (MO) TT=74.55	? (TO) TT=1800.09	? (MO) TT=342.04	SAT TT=92.115 ASSIGNMENTS=119813 CHECKS=227104000	SAT TT=100.176 ASSIGNMENTS=119813 CHECKS=227104000	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=28.595 ASSIGNMENTS=42536 CHECKS=70575200	SAT TT=6.554 ASSIGNMENTS=8435 CHECKS=16202100	SAT TT=1.177	SAT TT=22.438 ASSIGNMENTS=41520 CHECKS=54005800	SAT TT=89.871 ASSIGNMENTS=119813 CHECKS=227104000	? (MO) TT=91.761	? TT=173.009	? TT=167.993
csp/primes-20/ normalized-primes-20-20-2-3.xml	SAT TT=0.011	SAT TT=18.757 CHECKS=34619800 NODES=242	SAT TT=20.774 CHECKS=40845700 NODES=203	SAT TT=0.041	SAT TT=0.383 CHECKS=5637	SAT TT=1.385 CHECKS=705219	SAT TT=4.089 ASSIGNMENTS=71	SAT TT=4.032 ASSIGNMENTS=71	SAT TT=1027.31 CHECKS=4569250000 NODES=102	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.023 ASSIGNMENTS=215 CHECKS=5379	SAT TT=0.024 ASSIGNMENTS=215 CHECKS=5379	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=0.013 ASSIGNMENTS=204 CHECKS=5269	SAT TT=0.141 ASSIGNMENTS=8448 CHECKS=344251	SAT TT=0.407	SAT TT=0.015 ASSIGNMENTS=514 CHECKS=6741	SAT TT=0.011 ASSIGNMENTS=215 CHECKS=5379	? TT=153.189	SAT TT=9.602	SAT TT=44.141
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-20/ normalized-primes-20-20-2-7.xml	SAT TT=0.045	? (TO) TT=1800.18	? (TO) TT=1800.1	SAT TT=0.045	SAT TT=0.754 CHECKS=3566	SAT TT=0.123 CHECKS=6495	SAT TT=8.714 ASSIGNMENTS=1980	SAT TT=14.392 ASSIGNMENTS=2190	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.05 ASSIGNMENTS=378 CHECKS=69901	SAT TT=0.05 ASSIGNMENTS=378 CHECKS=69901	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=0.047 ASSIGNMENTS=794 CHECKS=105620	SAT TT=0.326 ASSIGNMENTS=8992 CHECKS=869312	SAT TT=0.418	SAT TT=0.053 ASSIGNMENTS=1107 CHECKS=113350	SAT TT=0.057 ASSIGNMENTS=550 CHECKS=136267	? (MO) TT=78.201	? TT=197.599	? TT=195.926
csp/primes-20/ normalized-primes-20-20-3-5.xml	SAT TT=0.016	SAT TT=444.546 CHECKS=659615000 NODES=2076	SAT TT=414.36 CHECKS=666945000 NODES=2088	SAT TT=0.047	SAT TT=0.587 CHECKS=3626	SAT TT=0.451 CHECKS=123394	SAT TT=6.927 ASSIGNMENTS=62	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.029 ASSIGNMENTS=322 CHECKS=15105	SAT TT=0.028 ASSIGNMENTS=322 CHECKS=15105	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=0.016 ASSIGNMENTS=323 CHECKS=15398	SAT TT=0.219 ASSIGNMENTS=8387 CHECKS=553031	SAT TT=0.691	SAT TT=0.026 ASSIGNMENTS=730 CHECKS=39851	SAT TT=0.02 ASSIGNMENTS=635 CHECKS=30686	? (MO) TT=78.021	? TT=225.07	? TT=219.979
csp/primes-20/ normalized-primes-20-40-2-3.xml	SAT TT=0.084	SAT TT=5.56 CHECKS=9644510 NODES=267	SAT TT=5.59 CHECKS=10123300 NODES=194	SAT TT=0.084	SAT TT=4.767 CHECKS=426225	SAT TT=1.857 CHECKS=192701	SAT TT=5.355 ASSIGNMENTS=240	SAT TT=5.822 ASSIGNMENTS=240	SAT TT=552.96 CHECKS=1956630000 NODES=102	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.416 ASSIGNMENTS=11794 CHECKS=1084850	SAT TT=0.419 ASSIGNMENTS=11794 CHECKS=1084850	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=1.391 ASSIGNMENTS=32239 CHECKS=3634010	SAT TT=0.288 ASSIGNMENTS=8340 CHECKS=783517	SAT TT=0.419	SAT TT=0.308 ASSIGNMENTS=5407 CHECKS=804030	SAT TT=0.4 ASSIGNMENTS=7466 CHECKS=1035040	? TT=479.395	SAT TT=11.651	SAT TT=40.428
csp/primes-20/ normalized-primes-20-40-3-7.xml		? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (MO) TT=99.079	? TT=180.653	? TT=178.447
csp/primes-20/ normalized-primes-20-60-2-1.xml	SAT TT=0.014	SAT TT=1.179 CHECKS=760011 NODES=100	SAT TT=1.253 CHECKS=760010 NODES=0	SAT TT=0.044	SAT TT=0.474 CHECKS=12045	SAT TT=0.045 CHECKS=76054	SAT TT=1.276 ASSIGNMENTS=22	SAT TT=1.205 ASSIGNMENTS=22	SAT TT=6.557 CHECKS=569187 NODES=100	SAT TT=2.81 CHECKS=574695 NODES=2	SAT TT=3.147 CHECKS=574688 NODES=0	SAT TT=0.028 ASSIGNMENTS=86 CHECKS=4665	SAT TT=0.024 ASSIGNMENTS=86 CHECKS=4665	SAT TT=10.585	SAT TT=11.087	SAT TT=0.017 ASSIGNMENTS=86 CHECKS=4665	SAT TT=0.041 ASSIGNMENTS=2704 CHECKS=64570	SAT TT=0.414	SAT TT=0.017 ASSIGNMENTS=177 CHECKS=4847	SAT TT=0.014 ASSIGNMENTS=85 CHECKS=4594	SAT TT=37.177	SAT TT=0.819	SAT TT=0.85
csp/primes-20/ normalized-primes-20-60-2-3.xml	SAT TT=0.026	SAT TT=2.444 CHECKS=3620830 NODES=100	SAT TT=2.196 CHECKS=3494320 NODES=0	SAT TT=0.046	SAT TT=1.289 CHECKS=21236	SAT TT=0.037 CHECKS=17025	SAT TT=1.265 ASSIGNMENTS=12	SAT TT=1.194 ASSIGNMENTS=12	SAT TT=387.381 CHECKS=1121670000 NODES=100	SAT TT=307.261 CHECKS=1121670000 NODES=0	SAT TT=305.714 CHECKS=1121670000 NODES=2	SAT TT=0.037 ASSIGNMENTS=150 CHECKS=26468	SAT TT=0.035 ASSIGNMENTS=150 CHECKS=26468	? (TO) TT=1800	? (TO) TT=1800.01	SAT TT=0.026 ASSIGNMENTS=143 CHECKS=24672	SAT TT=0.371 ASSIGNMENTS=4099 CHECKS=918767	SAT TT=0.485	SAT TT=0.031 ASSIGNMENTS=191 CHECKS=37531	SAT TT=0.026 ASSIGNMENTS=150 CHECKS=26464	? TT=225.439	SAT TT=1.088	SAT TT=1.133
csp/primes-20/ normalized-primes-20-60-3-3.xml	SAT TT=0.065	SAT TT=49.886 CHECKS=103204000 NODES=509	SAT TT=54.667 CHECKS=114149000 NODES=433	SAT TT=0.065	SAT TT=10.812 CHECKS=661914	SAT TT=3.993 CHECKS=248777	SAT TT=11.817 ASSIGNMENTS=145	SAT TT=40.515 ASSIGNMENTS=15261	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=0.546 ASSIGNMENTS=2670 CHECKS=1358080	SAT TT=0.538 ASSIGNMENTS=2670 CHECKS=1358080	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=94.669 ASSIGNMENTS=332305 CHECKS=269388000	SAT TT=1.683 ASSIGNMENTS=7315 CHECKS=4726500	SAT TT=0.712	SAT TT=1.03 ASSIGNMENTS=2640 CHECKS=2851710	SAT TT=0.841 ASSIGNMENTS=3791 CHECKS=2212590	? (MO) TT=119.9	? (MO) TT=63.141	? (MO) TT=258.92
csp/primes-20/ normalized-primes-20-60-3-5.xml		? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=913.24	? (TO) TT=1800.08	? (TO) TT=1800.04	? (MO) TT=63.267	? TT=178.063	? TT=177.981
csp/primes-20/ normalized-primes-20-60-3-7.xml		? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.22	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (MO) TT=92.647	? TT=197.788	? TT=199.588
csp/primes-20/ normalized-primes-20-80-2-1.xml	SAT TT=0.018	SAT TT=1.296 CHECKS=761651 NODES=100	SAT TT=1.223 CHECKS=761650 NODES=0	SAT TT=0.045	SAT TT=0.596 CHECKS=502	SAT TT=0.02 CHECKS=4832	SAT TT=1.157 ASSIGNMENTS=11	SAT TT=1.245 ASSIGNMENTS=11	SAT TT=7.532 CHECKS=564964 NODES=100	SAT TT=3.45 CHECKS=570531 NODES=1	SAT TT=3.427 CHECKS=570616 NODES=1	SAT TT=0.025 ASSIGNMENTS=17 CHECKS=3945	SAT TT=0.03 ASSIGNMENTS=17 CHECKS=3945	SAT TT=13.099	SAT TT=11.827	SAT TT=0.019 ASSIGNMENTS=17 CHECKS=3945	SAT TT=0.019 ASSIGNMENTS=22 CHECKS=4023	SAT TT=0.447	SAT TT=0.02 ASSIGNMENTS=17 CHECKS=3907	SAT TT=0.018 ASSIGNMENTS=17 CHECKS=3945	SAT TT=38.958	SAT TT=0.903	SAT TT=0.899
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-20/ normalized-primes-20-80-2-7.xml	SAT TT=0.061	SAT TT=2.608 CHECKS=2280940 NODES=102	? (MO) TT=1.094	SAT TT=0.064	SAT TT=2.616 CHECKS=1993	SAT TT=0.061 CHECKS=1974	SAT TT=1.065 ASSIGNMENTS=1	SAT TT=1.059 ASSIGNMENTS=1	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=0.14 ASSIGNMENTS=86 CHECKS=291675	SAT TT=0.132 ASSIGNMENTS=86 CHECKS=291675	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.121 ASSIGNMENTS=87 CHECKS=290766	SAT TT=2.476 ASSIGNMENTS=4052 CHECKS=7132430	SAT TT=0.566	SAT TT=0.091 ASSIGNMENTS=94 CHECKS=203043	SAT TT=0.121 ASSIGNMENTS=86 CHECKS=291675	? TT=338.589	SAT TT=1.233	SAT TT=1.303
csp/primes-20/ normalized-primes-20-80-3-1.xml	SAT TT=0.026	SAT TT=2.083 CHECKS=2648340 NODES=100	SAT TT=1.626 CHECKS=2002620 NODES=0	SAT TT=0.056	SAT TT=1.189 CHECKS=9015	SAT TT=0.035 CHECKS=9128	SAT TT=1.124 ASSIGNMENTS=10	SAT TT=0.967 ASSIGNMENTS=10	SAT TT=139.976 CHECKS=78008800 NODES=100	SAT TT=136.031 CHECKS=90420600 NODES=1	SAT TT=133.582 CHECKS=90420700 NODES=1	SAT TT=0.039 ASSIGNMENTS=41 CHECKS=19826	SAT TT=0.036 ASSIGNMENTS=41 CHECKS=19826	SAT TT=459.678	SAT TT=448.309	SAT TT=0.028 ASSIGNMENTS=41 CHECKS=19821	SAT TT=0.162 ASSIGNMENTS=1055 CHECKS=350031	SAT TT=0.534	SAT TT=0.036 ASSIGNMENTS=109 CHECKS=37635	SAT TT=0.026 ASSIGNMENTS=41 CHECKS=19826	? TT=154.84	SAT TT=1.145	SAT TT=1.267
csp/primes-20/ normalized-primes-20-80-3-5.xml	SAT TT=91.117	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=114.798	SAT TT=1580.7 CHECKS=81040900	SAT TT=1534.1 CHECKS=74172400	SAT TT=330.626 ASSIGNMENTS=15523	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=179.823 ASSIGNMENTS=186794 CHECKS=502918000	SAT TT=189.874 ASSIGNMENTS=186794 CHECKS=502918000	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=91.117 ASSIGNMENTS=104594 CHECKS=272473000	SAT TT=203.622	SAT TT=276.054 ASSIGNMENTS=178349 CHECKS=814585000	SAT TT=183.603 ASSIGNMENTS=186794 CHECKS=502918000	? TT=224.842	? TT=298.295	? TT=298.739
csp/primes-20/ normalized-primes-20-80-3-7.xml	SAT TT=11.866	SAT TT=923.091 CHECKS=1739830000 NODES=11857	SAT TT=911.841 CHECKS=1692960000 NODES=11937	SAT TT=14.554	SAT TT=11.866 CHECKS=332766	SAT TT=13.841 CHECKS=535867	SAT TT=10.107 ASSIGNMENTS=1	SAT TT=16.097 ASSIGNMENTS=1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=82.161 ASSIGNMENTS=93844 CHECKS=212771000	SAT TT=82.772 ASSIGNMENTS=93844 CHECKS=212771000	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=80.136 ASSIGNMENTS=85219 CHECKS=222324000	SAT TT=1.156	? (TO) TT=1800.02	SAT TT=76.13 ASSIGNMENTS=93844 CHECKS=212771000	? (MO) TT=108.635	? TT=195.215	? TT=185.447
csp/primes-25/ normalized-primes-25-20-2-7.xml	SAT TT=0.017	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=0.046	SAT TT=0.705 CHECKS=2746	SAT TT=4.022 CHECKS=412244	SAT TT=12.93 ASSIGNMENTS=65	SAT TT=33.737 ASSIGNMENTS=18751	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=0.028 ASSIGNMENTS=419 CHECKS=16634	SAT TT=0.031 ASSIGNMENTS=419 CHECKS=16634	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=0.017 ASSIGNMENTS=294 CHECKS=14856	SAT TT=0.348 ASSIGNMENTS=9223 CHECKS=1043960	SAT TT=0.4	SAT TT=0.028 ASSIGNMENTS=799 CHECKS=39635	SAT TT=0.018 ASSIGNMENTS=343 CHECKS=15285	? (MO) TT=64.084	? TT=180.352	? TT=172.936
csp/primes-25/ normalized-primes-25-20-3-1.xml	SAT TT=0.028	SAT TT=38.741 CHECKS=90727300 NODES=217	SAT TT=43.712 CHECKS=103087000 NODES=0	SAT TT=0.036	SAT TT=0.471 CHECKS=11533	SAT TT=3.552 CHECKS=1575720	SAT TT=18.081 ASSIGNMENTS=586	SAT TT=15.635 ASSIGNMENTS=586	SAT TT=256.803 CHECKS=977269000 NODES=100	SAT TT=213.361 CHECKS=986536000 NODES=300000	SAT TT=205.985 CHECKS=1013240000 NODES=1333	SAT TT=0.041 ASSIGNMENTS=329 CHECKS=61249	SAT TT=0.042 ASSIGNMENTS=329 CHECKS=61249	SAT TT=425.732	SAT TT=440.835	SAT TT=0.03 ASSIGNMENTS=322 CHECKS=64288	SAT TT=0.204 ASSIGNMENTS=8076 CHECKS=538835	SAT TT=0.394	SAT TT=0.028 ASSIGNMENTS=669 CHECKS=49310	SAT TT=0.028 ASSIGNMENTS=329 CHECKS=61249	? (MO) TT=113.729	SAT TT=5.2	SAT TT=13.14
csp/primes-25/ normalized-primes-25-20-3-3.xml	SAT TT=0.013	SAT TT=10.806 CHECKS=19666500 NODES=106	SAT TT=47.058 CHECKS=93495400 NODES=189	SAT TT=0.04	SAT TT=0.497 CHECKS=6005	SAT TT=0.047 CHECKS=6574	SAT TT=9.245 ASSIGNMENTS=67	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.03 ASSIGNMENTS=876 CHECKS=21278	SAT TT=0.03 ASSIGNMENTS=876 CHECKS=21278	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=0.02 ASSIGNMENTS=846 CHECKS=20959	SAT TT=0.172 ASSIGNMENTS=8617 CHECKS=431837	SAT TT=0.42	SAT TT=0.023 ASSIGNMENTS=838 CHECKS=25826	SAT TT=0.013 ASSIGNMENTS=272 CHECKS=7649	? (MO) TT=88.536	? (MO) TT=72.5	? (MO) TT=271.997
csp/primes-25/ normalized-primes-25-20-3-7.xml	SAT TT=0.031	? (TO) TT=1800.15	? (TO) TT=1800.11	SAT TT=0.051	SAT TT=1.375 CHECKS=25469	SAT TT=2.237 CHECKS=276702	SAT TT=14.599 ASSIGNMENTS=727	SAT TT=21.018 ASSIGNMENTS=407	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=0.043 ASSIGNMENTS=906 CHECKS=54594	SAT TT=0.046 ASSIGNMENTS=906 CHECKS=54594	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=0.031 ASSIGNMENTS=901 CHECKS=55084	SAT TT=0.495 ASSIGNMENTS=12073 CHECKS=1393870	SAT TT=0.427	SAT TT=0.202 ASSIGNMENTS=1931 CHECKS=557057	SAT TT=0.057 ASSIGNMENTS=1018 CHECKS=134418	? TT=481.549	? TT=180.924	? TT=176.414
csp/primes-25/ normalized-primes-25-40-2-7.xml	SAT TT=15.341	? (TO) TT=1800.15	? (TO) TT=1800.13	SAT TT=31.287	? (TO) TT=1800.02	SAT TT=124.228 CHECKS=5432470	SAT TT=733.489 ASSIGNMENTS=78199	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=23.12 ASSIGNMENTS=105150 CHECKS=45655600	SAT TT=22.893 ASSIGNMENTS=105150 CHECKS=45655600	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=21.808 ASSIGNMENTS=161853 CHECKS=64860500	? (TO) TT=1800.07	SAT TT=77.737	SAT TT=279.999 ASSIGNMENTS=1235820 CHECKS=870201000	SAT TT=15.341 ASSIGNMENTS=105150 CHECKS=45655600	? (MO) TT=129.777	? TT=195.327	? TT=200.303
csp/primes-25/ normalized-primes-25-40-3-3.xml	SAT TT=719.109	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=730.806 CHECKS=54069600	? (TO) TT=1800.09	SAT TT=719.109 ASSIGNMENTS=147256	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=576.847	? (TO) TT=1800.09	? (TO) TT=1800.08	? (MO) TT=65.73	? (MO) TT=92.61	? (MO) TT=269.473
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-25/ normalized-primes-25-40-3-5.xml		? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=525.342	? TT=177.195	? TT=186.267
csp/primes-25/ normalized-primes-25-40-3-7.xml		? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	? (MO) TT=93.638	? TT=195.065	? TT=193.933
csp/primes-25/ normalized-primes-25-60-2-3.xml	SAT TT=0.028	SAT TT=4.821 CHECKS=9112160 NODES=100	SAT TT=4.278 CHECKS=8330110 NODES=0	SAT TT=0.051	SAT TT=1.251 CHECKS=21336	SAT TT=0.05 CHECKS=24184	SAT TT=1.542 ASSIGNMENTS=14	SAT TT=1.397 ASSIGNMENTS=14	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.043 ASSIGNMENTS=158 CHECKS=39732	SAT TT=0.044 ASSIGNMENTS=158 CHECKS=39732	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=0.034 ASSIGNMENTS=158 CHECKS=39751	SAT TT=0.555 ASSIGNMENTS=4545 CHECKS=1495110	SAT TT=0.469	SAT TT=0.028 ASSIGNMENTS=161 CHECKS=34862	SAT TT=0.033 ASSIGNMENTS=148 CHECKS=39262	? TT=706.195	SAT TT=1.177	SAT TT=1.966
csp/primes-25/ normalized-primes-25-60-2-7.xml	SAT TT=2.076	SAT TT=254.464 CHECKS=461773000 NODES=1874	SAT TT=267.483 CHECKS=457298000 NODES=1907	? (TO) TT=1800.03	SAT TT=18.173 CHECKS=644936	SAT TT=7.699 CHECKS=328053	SAT TT=26.452 ASSIGNMENTS=196	SAT TT=100.449 ASSIGNMENTS=4955	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=9.799 ASSIGNMENTS=9957 CHECKS=5897070	SAT TT=9.186 ASSIGNMENTS=9957 CHECKS=5897070	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=628.385 ASSIGNMENTS=1947700 CHECKS=1808710000	SAT TT=92.648 ASSIGNMENTS=346297 CHECKS=266206000	SAT TT=0.785	? (TO) TT=1800.11	SAT TT=2.076 ASSIGNMENTS=9957 CHECKS=5897070	? TT=163.571	? TT=225.154	? TT=220.838
csp/primes-25/ normalized-primes-25-60-3-3.xml	SAT TT=0.243	SAT TT=34.036 CHECKS=71149200 NODES=245	SAT TT=181.798 CHECKS=387635000 NODES=1019	SAT TT=0.243	SAT TT=23.351 CHECKS=1428150	SAT TT=52.088 CHECKS=3235850	SAT TT=17.806 ASSIGNMENTS=11	SAT TT=64.297 ASSIGNMENTS=1435	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=828.83 ASSIGNMENTS=1862700 CHECKS=2181150000	SAT TT=781.47 ASSIGNMENTS=1862700 CHECKS=2181150000	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=47.216 ASSIGNMENTS=136977 CHECKS=126786000	SAT TT=43.753 ASSIGNMENTS=84714 CHECKS=117293000	SAT TT=0.628	SAT TT=244.959 ASSIGNMENTS=510823 CHECKS=705319000	SAT TT=756.398 ASSIGNMENTS=1862700 CHECKS=2181150000	? TT=114.406	? (MO) TT=143.56	? (MO) TT=320.08
csp/primes-25/ normalized-primes-25-80-2-5.xml	SAT TT=0.055	SAT TT=3.926 CHECKS=6177420 NODES=108	SAT TT=3.323 CHECKS=5864340 NODES=0	SAT TT=0.064	SAT TT=1.874 CHECKS=1992	SAT TT=0.056 CHECKS=1971	SAT TT=1.166 ASSIGNMENTS=3	SAT TT=1.251 ASSIGNMENTS=3	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.069 ASSIGNMENTS=30 CHECKS=90524	SAT TT=0.071 ASSIGNMENTS=30 CHECKS=90524	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=0.058 ASSIGNMENTS=26 CHECKS=90497	SAT TT=1.351 ASSIGNMENTS=3821 CHECKS=3588220	SAT TT=0.677	SAT TT=0.056 ASSIGNMENTS=45 CHECKS=90257	SAT TT=0.055 ASSIGNMENTS=26 CHECKS=90498	? TT=394.8	SAT TT=1.294	SAT TT=1.155
csp/primes-25/ normalized-primes-25-80-3-1.xml	SAT TT=0.029	SAT TT=3.633 CHECKS=6661920 NODES=100	SAT TT=2.976 CHECKS=5340230 NODES=0	SAT TT=0.057	SAT TT=1.663 CHECKS=14399	SAT TT=0.038 CHECKS=14614	SAT TT=1.541 ASSIGNMENTS=10	SAT TT=1.352 ASSIGNMENTS=10	SAT TT=134.991 CHECKS=342219000 NODES=100	SAT TT=75.785 CHECKS=342220000 NODES=0	SAT TT=81.917 CHECKS=342220000 NODES=0	SAT TT=0.04 ASSIGNMENTS=37 CHECKS=26636	SAT TT=0.044 ASSIGNMENTS=37 CHECKS=26636	SAT TT=1428.05	SAT TT=1470.51	SAT TT=0.032 ASSIGNMENTS=40 CHECKS=27958	SAT TT=0.202 ASSIGNMENTS=673 CHECKS=465261	SAT TT=0.473	SAT TT=0.033 ASSIGNMENTS=72 CHECKS=32763	SAT TT=0.029 ASSIGNMENTS=39 CHECKS=33024	? TT=157.489	SAT TT=1.426	SAT TT=1.637
csp/primes-25/ normalized-primes-25-80-3-3.xml	SAT TT=0.067	SAT TT=7.36 CHECKS=13996200 NODES=154	SAT TT=5.658 CHECKS=10623600 NODES=0	SAT TT=0.067	SAT TT=3.213 CHECKS=70665	SAT TT=5.024 CHECKS=306000	SAT TT=1.338 ASSIGNMENTS=2	SAT TT=1.385 ASSIGNMENTS=2	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1.327 ASSIGNMENTS=1118 CHECKS=3451170	SAT TT=1.339 ASSIGNMENTS=1118 CHECKS=3451170	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=2.186 ASSIGNMENTS=1812 CHECKS=5750010	SAT TT=4.875 ASSIGNMENTS=5756 CHECKS=13654300	SAT TT=0.734	SAT TT=10.66 ASSIGNMENTS=8665 CHECKS=28272700	SAT TT=5.254 ASSIGNMENTS=4382 CHECKS=14034300	? TT=161.145	? (MO) TT=171.286	? (MO) TT=351.191
csp/primes-25/ normalized-primes-25-80-3-7.xml	SAT TT=91.769	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.09	SAT TT=1335.59 CHECKS=51343900	SAT TT=296.364 CHECKS=12402700	SAT TT=1533.37 ASSIGNMENTS=63225	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=98.829 ASSIGNMENTS=113994 CHECKS=260918000	SAT TT=100.388 ASSIGNMENTS=113994 CHECKS=260918000	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=479.61 ASSIGNMENTS=439638 CHECKS=1362960000	SAT TT=59.217	SAT TT=753.497 ASSIGNMENTS=351681 CHECKS=2116260000	SAT TT=91.769 ASSIGNMENTS=113994 CHECKS=260918000	? TT=158.871	? TT=212.879	? TT=203.831
csp/primes-30/ normalized-primes-30-20-3-1.xml	SAT TT=0.025	SAT TT=47.135 CHECKS=113997000 NODES=174	SAT TT=113.839 CHECKS=259686000 NODES=140	SAT TT=0.036	SAT TT=4.256 CHECKS=1660860	SAT TT=3.385 CHECKS=1666710	SAT TT=9.961 ASSIGNMENTS=68	SAT TT=9.715 ASSIGNMENTS=68	? (MO) TT=9.97	? (MO) TT=10.18	? (MO) TT=9.84	SAT TT=0.083 ASSIGNMENTS=1900 CHECKS=153548	SAT TT=0.082 ASSIGNMENTS=1900 CHECKS=153548	SAT TT=787.185	SAT TT=812.25	SAT TT=0.065 ASSIGNMENTS=1811 CHECKS=153177	SAT TT=0.308 ASSIGNMENTS=11023 CHECKS=809734	SAT TT=0.363	SAT TT=0.025 ASSIGNMENTS=911 CHECKS=31326	SAT TT=0.036 ASSIGNMENTS=939 CHECKS=70608	? TT=490.312	SAT TT=11.012	SAT TT=17.049
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-30/ normalized-primes-30-20-3-7.xml	SAT TT=0.022	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=0.039	SAT TT=0.876 CHECKS=4683	SAT TT=0.066 CHECKS=4136	SAT TT=19.635 ASSIGNMENTS=73	? (TO) TT=1800.11	? (MO) TT=9.95	? (MO) TT=10.57	? (MO) TT=9.89	SAT TT=0.033 ASSIGNMENTS=531 CHECKS=28064	SAT TT=0.035 ASSIGNMENTS=531 CHECKS=28064	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=0.022 ASSIGNMENTS=471 CHECKS=28416	SAT TT=0.343 ASSIGNMENTS=8764 CHECKS=944038	SAT TT=0.492	SAT TT=0.032 ASSIGNMENTS=817 CHECKS=52814	SAT TT=0.106 ASSIGNMENTS=1403 CHECKS=267573	? TT=494.361	? TT=597.999	? TT=604.958
csp/primes-30/ normalized-primes-30-40-2-1.xml	SAT TT=0.012	SAT TT=4.397 CHECKS=9115200 NODES=100	SAT TT=4.287 CHECKS=9115200 NODES=0	SAT TT=0.04	SAT TT=0.962 CHECKS=560371	SAT TT=0.573 CHECKS=698240	SAT TT=2.687 ASSIGNMENTS=43	SAT TT=2.408 ASSIGNMENTS=43	SAT TT=15.733 CHECKS=7700660 NODES=100	SAT TT=7.191 CHECKS=9387260 NODES=450006	SAT TT=8.758 CHECKS=15522500 NODES=2134	SAT TT=0.027 ASSIGNMENTS=211 CHECKS=8042	SAT TT=0.03 ASSIGNMENTS=211 CHECKS=8042	SAT TT=21.474	SAT TT=21.674	SAT TT=0.012 ASSIGNMENTS=211 CHECKS=8042	SAT TT=0.203 ASSIGNMENTS=5920 CHECKS=473585	SAT TT=0.415	SAT TT=0.018 ASSIGNMENTS=375 CHECKS=14317	SAT TT=0.016 ASSIGNMENTS=211 CHECKS=8042	? TT=191.76	SAT TT=0.866	SAT TT=0.869
csp/primes-30/ normalized-primes-30-40-2-3.xml	SAT TT=3.577	SAT TT=202.689 CHECKS=414973000 NODES=959	SAT TT=246.418 CHECKS=459683000 NODES=1081	SAT TT=3.577	SAT TT=6.879 CHECKS=734556	SAT TT=5.988 CHECKS=582954	SAT TT=14.467 ASSIGNMENTS=1004	SAT TT=13.722 ASSIGNMENTS=1004	? (MO) TT=11.92	? (MO) TT=11.04	? (MO) TT=11.12	SAT TT=20.566 ASSIGNMENTS=1004	SAT TT=193.103 ASSIGNMENTS=4408550 CHECKS=503231000	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=318.843 ASSIGNMENTS=4247820 CHECKS=887005000	? (TO) TT=1800.03	SAT TT=0.525	SAT TT=150.733 ASSIGNMENTS=1829170 CHECKS=423568000	SAT TT=196.395 ASSIGNMENTS=4408550 CHECKS=503231000	? TT=145.686	SAT TT=79.302	SAT TT=130.539
csp/primes-30/ normalized-primes-30-40-2-7.xml	SAT TT=278.366	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.12	? (MO) TT=11.28	? (MO) TT=12.34	? (MO) TT=10.72	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=826.853 ASSIGNMENTS=3664510 CHECKS=2633670000	SAT TT=278.366 ASSIGNMENTS=1622720 CHECKS=814133000	SAT TT=0.737	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=119.286	? TT=231.169	? TT=227.328
csp/primes-30/ normalized-primes-30-40-3-3.xml	SAT TT=14.829	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=14.829	SAT TT=1320.8 CHECKS=88454600	SAT TT=499.978 CHECKS=35546100	? (TO) TT=1800.05	? (TO) TT=1800.1	? (MO) TT=11.17	? (MO) TT=11.36	? (MO) TT=11.37	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=455.36	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=151.055	? TT=186.026	? TT=184.394
csp/primes-30/ normalized-primes-30-60-2-1.xml	SAT TT=0.017	SAT TT=2.388 CHECKS=3410680 NODES=100	SAT TT=2.18 CHECKS=3410680 NODES=0	SAT TT=0.045	SAT TT=0.96 CHECKS=148016	SAT TT=0.069 CHECKS=149471	SAT TT=1.268 ASSIGNMENTS=23	SAT TT=1.343 ASSIGNMENTS=23	SAT TT=19.504 CHECKS=1160180 NODES=100	SAT TT=7.236 CHECKS=1519750 NODES=2	SAT TT=6.662 CHECKS=1519740 NODES=0	SAT TT=0.029 ASSIGNMENTS=168 CHECKS=7976	SAT TT=0.03 ASSIGNMENTS=168 CHECKS=7976	SAT TT=28.208	SAT TT=26.388	SAT TT=0.017 ASSIGNMENTS=168 CHECKS=7976	SAT TT=0.107 ASSIGNMENTS=5200 CHECKS=237600	SAT TT=0.453	SAT TT=0.021 ASSIGNMENTS=344 CHECKS=12337	SAT TT=0.017 ASSIGNMENTS=168 CHECKS=7976	? TT=223.307	SAT TT=0.796	SAT TT=0.832
csp/primes-30/ normalized-primes-30-60-2-3.xml	SAT TT=0.047	SAT TT=7.174 CHECKS=16707800 NODES=101	SAT TT=7.092 CHECKS=16829200 NODES=0	SAT TT=0.047	SAT TT=1.129 CHECKS=16326	SAT TT=0.068 CHECKS=27833	SAT TT=0.983 ASSIGNMENTS=12	SAT TT=1.018 ASSIGNMENTS=12	? (MO) TT=11.27	? (MO) TT=10.35	? (MO) TT=11.45	SAT TT=0.081 ASSIGNMENTS=392 CHECKS=137203	SAT TT=0.08 ASSIGNMENTS=392 CHECKS=137203	? (TO) TT=1800	? (TO) TT=1800.07	SAT TT=0.066 ASSIGNMENTS=390 CHECKS=134809	SAT TT=0.665 ASSIGNMENTS=5733 CHECKS=1674010	SAT TT=0.468	SAT TT=1.312 ASSIGNMENTS=5821 CHECKS=3368750	SAT TT=0.126 ASSIGNMENTS=795 CHECKS=295726	? TT=149.46	SAT TT=1.184	SAT TT=1.206
csp/primes-30/ normalized-primes-30-60-2-7.xml	SAT TT=12.407	? (MO) TT=1.136	SAT TT=1276.81 CHECKS=2150260000 NODES=4940	SAT TT=28.74	SAT TT=28.121 CHECKS=1014520	SAT TT=18.638 CHECKS=738581	SAT TT=169.177 ASSIGNMENTS=10212	SAT TT=45.688 ASSIGNMENTS=1056	? (MO) TT=10.58	? (MO) TT=12.16	? (MO) TT=10.79	SAT TT=26.014 ASSIGNMENTS=94393 CHECKS=50945200	SAT TT=25.495 ASSIGNMENTS=94393 CHECKS=50945200	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=23.148 ASSIGNMENTS=135976 CHECKS=67530700	SAT TT=79.519 ASSIGNMENTS=193114 CHECKS=245997000	SAT TT=0.851	SAT TT=12.407 ASSIGNMENTS=39059 CHECKS=34725600	SAT TT=16.224 ASSIGNMENTS=94393 CHECKS=50945200	? (MO) TT=81.518	? TT=219.635	? TT=220.967
csp/primes-30/ normalized-primes-30-60-3-3.xml	SAT TT=0.674	SAT TT=60.221 CHECKS=139252000 NODES=296	SAT TT=110.352 CHECKS=231389000 NODES=288	SAT TT=0.674	SAT TT=40.382 CHECKS=2430390	SAT TT=46.218 CHECKS=2862840	SAT TT=41.44 ASSIGNMENTS=691	SAT TT=54.801 ASSIGNMENTS=790	? (MO) TT=12.11	? (MO) TT=10.57	? (MO) TT=9.91	SAT TT=26.018 ASSIGNMENTS=38508 CHECKS=49019600	SAT TT=25.502 ASSIGNMENTS=38508 CHECKS=49019600	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=11.311 ASSIGNMENTS=32961 CHECKS=32940800	SAT TT=23.646 ASSIGNMENTS=78284 CHECKS=69518500	SAT TT=0.891	SAT TT=842.592 ASSIGNMENTS=858654 CHECKS=2393900000	SAT TT=18.597 ASSIGNMENTS=38508 CHECKS=49019600	? (MO) TT=60.57	? TT=171.281	? TT=178.448
csp/primes-30/ normalized-primes-30-60-3-7.xml		? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.15	? (MO) TT=11.12	? (MO) TT=11.46	? (MO) TT=10.09	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (MO) TT=77.472	? TT=683.267	? TT=700.466
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-30/ normalized-primes-30-80-2-1.xml	SAT TT=0.018	SAT TT=2.485 CHECKS=3382230 NODES=100	SAT TT=2.194 CHECKS=3382230 NODES=0	SAT TT=0.047	SAT TT=1.095 CHECKS=737	SAT TT=0.021 CHECKS=956	SAT TT=1.058 ASSIGNMENTS=11	SAT TT=1.052 ASSIGNMENTS=11	SAT TT=22.623 CHECKS=1091400 NODES=100	SAT TT=8.192 CHECKS=1450990 NODES=0	SAT TT=7.922 CHECKS=1451070 NODES=1	SAT TT=0.029 ASSIGNMENTS=85 CHECKS=5309	SAT TT=0.027 ASSIGNMENTS=85 CHECKS=5309	SAT TT=31.822	SAT TT=29.039	SAT TT=0.019 ASSIGNMENTS=85 CHECKS=5320	SAT TT=0.035 ASSIGNMENTS=4062 CHECKS=37548	SAT TT=0.483	SAT TT=0.018 ASSIGNMENTS=105 CHECKS=5116	SAT TT=0.019 ASSIGNMENTS=85 CHECKS=5309	SAT TT=154.866	SAT TT=0.873	SAT TT=0.894
csp/primes-30/ normalized-primes-30-80-2-7.xml	SAT TT=0.063	SAT TT=5.919 CHECKS=9242930 NODES=102	SAT TT=8.021 CHECKS=11608100 NODES=0	SAT TT=0.063	SAT TT=2.361 CHECKS=2143	SAT TT=0.075 CHECKS=2126	SAT TT=0.927 ASSIGNMENTS=1	SAT TT=1.016 ASSIGNMENTS=1	? (MO) TT=10.02	? (MO) TT=9.97	? (MO) TT=11.55	SAT TT=0.077 ASSIGNMENTS=60 CHECKS=110160	SAT TT=0.076 ASSIGNMENTS=60 CHECKS=110160	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=0.066 ASSIGNMENTS=58 CHECKS=112600	SAT TT=1.771 ASSIGNMENTS=4025 CHECKS=4760180	SAT TT=0.606	SAT TT=0.092 ASSIGNMENTS=116 CHECKS=182086	SAT TT=0.07 ASSIGNMENTS=61 CHECKS=111820	? TT=716.435	SAT TT=1.576	SAT TT=1.279
csp/primes-30/ normalized-primes-30-80-3-3.xml	SAT TT=0.292	SAT TT=7.668 CHECKS=17293400 NODES=211	SAT TT=10.088 CHECKS=21120400 NODES=0	SAT TT=1.395	SAT TT=2.897 CHECKS=48424	SAT TT=4.006 CHECKS=265121	SAT TT=1.161 ASSIGNMENTS=2	SAT TT=1.275 ASSIGNMENTS=2	? (MO) TT=11.54	? (MO) TT=10.28	? (MO) TT=10.88	SAT TT=0.292 ASSIGNMENTS=335 CHECKS=697558	SAT TT=0.295 ASSIGNMENTS=335 CHECKS=697558	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=0.759 ASSIGNMENTS=757 CHECKS=1989930	SAT TT=3.189 ASSIGNMENTS=4989 CHECKS=8399560	SAT TT=0.614	SAT TT=1.939 ASSIGNMENTS=869 CHECKS=5304570	SAT TT=0.894 ASSIGNMENTS=820 CHECKS=2492020	? TT=146.898	? TT=182.067	? TT=174.671
csp/primes-30/ normalized-primes-30-80-3-5.xml		? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.08	? (MO) TT=10.46	? (MO) TT=10.76	? (MO) TT=10.62	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.06	? TT=143.925	? TT=284.482	? TT=173.16
csp/pseudo/aim/ normalized-aim-100-1-6-1.xml	SAT TT=0.038	SAT TT=1.201 CHECKS=21846 NODES=1200	SAT TT=1.105 CHECKS=16672 NODES=1093	SAT TT=1132.65	SAT TT=0.185 CHECKS=111710	SAT TT=0.164 CHECKS=103884	SAT TT=1.384 ASSIGNMENTS=3338	SAT TT=1.388 ASSIGNMENTS=3338	SAT TT=1.091 CHECKS=5151 NODES=438	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=0.134 ASSIGNMENTS=1187 CHECKS=138942	SAT TT=0.125 ASSIGNMENTS=1187 CHECKS=138942	SAT TT=1.453	SAT TT=1.44	SAT TT=0.058 ASSIGNMENTS=490 CHECKS=50727	SAT TT=0.211 ASSIGNMENTS=6629 CHECKS=281140	SAT TT=0.722	SAT TT=0.37 ASSIGNMENTS=2944 CHECKS=275974	SAT TT=0.038 ASSIGNMENTS=278 CHECKS=23153	SAT TT=1.983	SAT TT=0.925	SAT TT=1.024
csp/pseudo/aim/ normalized-aim-100-1-6-4.xml	SAT TT=0.097	SAT TT=1.128 CHECKS=17655 NODES=1131	SAT TT=1.062 CHECKS=20123 NODES=1075	? (TO) TT=1800.03	SAT TT=0.318 CHECKS=186055	SAT TT=0.317 CHECKS=193769	SAT TT=1.065 ASSIGNMENTS=828	SAT TT=1.081 ASSIGNMENTS=828	SAT TT=1.042 CHECKS=15977 NODES=821	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=0.181 ASSIGNMENTS=1919 CHECKS=197180	SAT TT=0.178 ASSIGNMENTS=1919 CHECKS=197180	SAT TT=1.437	SAT TT=1.622	SAT TT=0.14 ASSIGNMENTS=1563 CHECKS=167446	SAT TT=0.143 ASSIGNMENTS=5004 CHECKS=199060	SAT TT=0.652	SAT TT=0.097 ASSIGNMENTS=937 CHECKS=61589	SAT TT=0.109 ASSIGNMENTS=1034 CHECKS=126171	SAT TT=1.779	SAT TT=0.814	SAT TT=0.924
csp/pseudo/aim/ normalized-aim-100-2-0-2.xml	SAT TT=0.489	SAT TT=3.198 CHECKS=896852 NODES=36656	SAT TT=4.525 CHECKS=1679380 NODES=65563	SAT TT=407.963	SAT TT=8.321 CHECKS=6348600	SAT TT=6.83 CHECKS=5231120	SAT TT=2.714 ASSIGNMENTS=18602	SAT TT=2.975 ASSIGNMENTS=18602	SAT TT=2.014 CHECKS=260619 NODES=6598	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=10.85 ASSIGNMENTS=36656 CHECKS=896852	SAT TT=11.36 ASSIGNMENTS=31349 CHECKS=5409650	SAT TT=1.557	SAT TT=1.711	SAT TT=2.533 ASSIGNMENTS=21939 CHECKS=3586780	SAT TT=0.489 ASSIGNMENTS=7731 CHECKS=682765	SAT TT=0.827	SAT TT=3.019 ASSIGNMENTS=17937 CHECKS=2852450	SAT TT=3.531 ASSIGNMENTS=31349 CHECKS=5409650	SAT TT=1.904	SAT TT=0.994	SAT TT=0.934
csp/pseudo/aim/ normalized-aim-100-3-4-2.xml	SAT TT=0.172	SAT TT=1.607 CHECKS=168115 NODES=5662	SAT TT=1.631 CHECKS=141600 NODES=5683	SAT TT=0.922	SAT TT=0.409 CHECKS=338498	SAT TT=0.311 CHECKS=273653	SAT TT=2.983 ASSIGNMENTS=11371	SAT TT=2.831 ASSIGNMENTS=11371	SAT TT=2.881 CHECKS=497348 NODES=5486	SAT TT=6.965 CHECKS=11520500 NODES=515730	? (TO) TT=1800.06	SAT TT=0.223 ASSIGNMENTS=996 CHECKS=272827	SAT TT=0.209 ASSIGNMENTS=996 CHECKS=272827	SAT TT=1.865	SAT TT=1.88	SAT TT=0.172 ASSIGNMENTS=727 CHECKS=217532	SAT TT=1.05 ASSIGNMENTS=7639 CHECKS=1617400	SAT TT=0.862	SAT TT=0.731 ASSIGNMENTS=2749 CHECKS=753824	SAT TT=0.599 ASSIGNMENTS=2617 CHECKS=967997	SAT TT=2.094	SAT TT=0.949	SAT TT=1.108
csp/pseudo/aim/ normalized-aim-100-3-4-3.xml	SAT TT=0.055	SAT TT=1.19 CHECKS=24647 NODES=1375	SAT TT=1.304 CHECKS=26200 NODES=1514	SAT TT=0.513	SAT TT=0.519 CHECKS=429416	SAT TT=1.863 CHECKS=1719700	SAT TT=2.525 ASSIGNMENTS=8616	SAT TT=2.354 ASSIGNMENTS=8616	SAT TT=1.967 CHECKS=138679 NODES=2729	SAT TT=11.894 CHECKS=20200200 NODES=895870	? (TO) TT=1800.01	SAT TT=0.513 ASSIGNMENTS=1774 CHECKS=719746	SAT TT=0.506 ASSIGNMENTS=1774 CHECKS=719746	SAT TT=1.695	SAT TT=1.744	SAT TT=0.518 ASSIGNMENTS=1764 CHECKS=769907	SAT TT=0.82 ASSIGNMENTS=7032 CHECKS=1318810	SAT TT=0.809	SAT TT=1.555 ASSIGNMENTS=5720 CHECKS=1566430	SAT TT=0.055 ASSIGNMENTS=116 CHECKS=39128	SAT TT=2.26	SAT TT=0.961	SAT TT=0.969
csp/pseudo/aim/ normalized-aim-100-3-4-4.xml	SAT TT=0.61	SAT TT=1.474 CHECKS=104142 NODES=4184	SAT TT=1.812 CHECKS=208276 NODES=7626	SAT TT=2.179	SAT TT=2.656 CHECKS=2395670	SAT TT=2.02 CHECKS=1849220	SAT TT=3.356 ASSIGNMENTS=13397	SAT TT=2.977 ASSIGNMENTS=13397	SAT TT=6.461 CHECKS=1722550 NODES=17499	SAT TT=7.898 CHECKS=12418100 NODES=553986	? (TO) TT=1800.02	SAT TT=1.33 ASSIGNMENTS=4798 CHECKS=2012540	SAT TT=1.325 ASSIGNMENTS=4798 CHECKS=2012540	SAT TT=1.909	SAT TT=1.718	SAT TT=0.61 ASSIGNMENTS=2256 CHECKS=908128	SAT TT=1.046 ASSIGNMENTS=7468 CHECKS=1637620	SAT TT=0.787	SAT TT=0.622 ASSIGNMENTS=2197 CHECKS=660543	SAT TT=2.282 ASSIGNMENTS=10167 CHECKS=3802740	SAT TT=2.314	SAT TT=1.068	SAT TT=0.932
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/aim/ normalized-aim-100-6-0-3.xml	SAT TT=0.072	SAT TT=1.338 CHECKS=22533 NODES=1124	SAT TT=1.452 CHECKS=23208 NODES=1015	SAT TT=0.904	SAT TT=0.201 CHECKS=134020	SAT TT=0.182 CHECKS=146791	SAT TT=1.54 ASSIGNMENTS=426	SAT TT=1.772 ASSIGNMENTS=426	SAT TT=1.725 CHECKS=99981 NODES=840	SAT TT=1.421 CHECKS=121799 NODES=2977	SAT TT=1.426 CHECKS=171365 NODES=1311	SAT TT=0.171 ASSIGNMENTS=292 CHECKS=184441	SAT TT=0.177 ASSIGNMENTS=292 CHECKS=184441	SAT TT=2.001	SAT TT=1.997	SAT TT=0.101 ASSIGNMENTS=147 CHECKS=85816	SAT TT=0.84 ASSIGNMENTS=5220 CHECKS=1316770	SAT TT=0.818	SAT TT=0.342 ASSIGNMENTS=1272 CHECKS=356842	SAT TT=0.072 ASSIGNMENTS=70 CHECKS=48759	SAT TT=2.434	SAT TT=1.095	SAT TT=1.328
csp/pseudo/aim/ normalized-aim-200-1-6-1.xml	SAT TT=1.167	SAT TT=1.873 CHECKS=193472 NODES=7946	SAT TT=2.102 CHECKS=222317 NODES=9646	? (TO) TT=1800.1	SAT TT=13.37 CHECKS=8478830	SAT TT=5.643 CHECKS=3485080	SAT TT=11.301 ASSIGNMENTS=92753	SAT TT=12.093 ASSIGNMENTS=92753	SAT TT=2.201 CHECKS=127369 NODES=3715	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=9.134 ASSIGNMENTS=7946 CHECKS=193472	SAT TT=9.697 ASSIGNMENTS=17344 CHECKS=3743000	SAT TT=1.904	SAT TT=1.975	SAT TT=1.167 ASSIGNMENTS=7981 CHECKS=1580700	SAT TT=1.55 ASSIGNMENTS=19204 CHECKS=2118470	SAT TT=1.108	SAT TT=11.347 ASSIGNMENTS=43732 CHECKS=8977590	SAT TT=2.675 ASSIGNMENTS=17344 CHECKS=3743000	SAT TT=2.455	SAT TT=1.238	SAT TT=1.2
csp/pseudo/aim/ normalized-aim-200-1-6-2.xml	SAT TT=0.885	SAT TT=3.875 CHECKS=792276 NODES=37887	SAT TT=3.731 CHECKS=753234 NODES=34327	? (TO) TT=1800.11	SAT TT=6.03 CHECKS=3193740	SAT TT=8.23 CHECKS=4269140	SAT TT=4.293 ASSIGNMENTS=37937	SAT TT=4.343 ASSIGNMENTS=37937	SAT TT=5.124 CHECKS=515808 NODES=17253	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=11.145 ASSIGNMENTS=37887 CHECKS=792276	SAT TT=1.496 ASSIGNMENTS=15438 CHECKS=1912100	SAT TT=1.787	SAT TT=1.818	SAT TT=2.87 ASSIGNMENTS=27719 CHECKS=3586480	SAT TT=0.885 ASSIGNMENTS=15727 CHECKS=1141810	SAT TT=1.393	SAT TT=1.673 ASSIGNMENTS=8113 CHECKS=893074	SAT TT=1.369 ASSIGNMENTS=13464 CHECKS=1660980	SAT TT=2.681	SAT TT=1.348	SAT TT=1.049
csp/pseudo/aim/ normalized-aim-200-1-6-4.xml	SAT TT=1.059	SAT TT=3.649 CHECKS=822520 NODES=29579	SAT TT=3.322 CHECKS=672110 NODES=27165	? (TO) TT=1800.05	SAT TT=44.571 CHECKS=23011200	SAT TT=15.367 CHECKS=8411770	SAT TT=14.026 ASSIGNMENTS=149488	SAT TT=14.846 ASSIGNMENTS=149488	SAT TT=22.21 CHECKS=2919140 NODES=103049	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=11.131 ASSIGNMENTS=29579 CHECKS=822520	SAT TT=29.646 ASSIGNMENTS=240841 CHECKS=29674400	SAT TT=2.098	SAT TT=1.891	SAT TT=30.501 ASSIGNMENTS=297005 CHECKS=37328500	SAT TT=261.23 ASSIGNMENTS=1834890 CHECKS=356778000	SAT TT=26.301	SAT TT=5.825 ASSIGNMENTS=29095 CHECKS=3493110	SAT TT=24.099 ASSIGNMENTS=240841 CHECKS=29674400	SAT TT=2.336	SAT TT=1.207	SAT TT=1.059
csp/pseudo/aim/ normalized-aim-200-2-0-3.xml	SAT TT=1.049	SAT TT=1.711 CHECKS=122864 NODES=7037	SAT TT=2.098 CHECKS=198192 NODES=10306	? (TO) TT=1800.07	SAT TT=8.241 CHECKS=4445050	SAT TT=31.368 CHECKS=17618400	SAT TT=30.033 ASSIGNMENTS=302970	SAT TT=28.622 ASSIGNMENTS=302970	SAT TT=20.612 CHECKS=2784570 NODES=73865	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=9.259 ASSIGNMENTS=7037 CHECKS=122864	SAT TT=10.915 ASSIGNMENTS=27190 CHECKS=4337900	SAT TT=2.134	SAT TT=2.283	SAT TT=223.076 ASSIGNMENTS=1478320 CHECKS=296022000	SAT TT=1.72 ASSIGNMENTS=21420 CHECKS=2293980	SAT TT=1.005	SAT TT=16.693 ASSIGNMENTS=62767 CHECKS=9498680	SAT TT=3.482 ASSIGNMENTS=27190 CHECKS=4337900	SAT TT=2.657	SAT TT=1.049	SAT TT=1.069
csp/pseudo/aim/ normalized-aim-200-3-4-4.xml	SAT TT=1.029	SAT TT=2.103 CHECKS=188104 NODES=6840	SAT TT=2.531 CHECKS=299548 NODES=10161	SAT TT=1785.89	SAT TT=6.663 CHECKS=4954940	SAT TT=9.721 CHECKS=7349590	SAT TT=7.977 ASSIGNMENTS=38004	SAT TT=8.888 ASSIGNMENTS=38004	SAT TT=27.206 CHECKS=5180360 NODES=49190	SAT TT=7.911 CHECKS=8404530 NODES=376254	? (TO) TT=1800.05	SAT TT=9.423 ASSIGNMENTS=6840 CHECKS=188104	SAT TT=9.54 ASSIGNMENTS=6840 CHECKS=188104	SAT TT=2.361	SAT TT=2.326	SAT TT=10.483 ASSIGNMENTS=30817 CHECKS=14973000	SAT TT=5.321 ASSIGNMENTS=17393 CHECKS=7865580	SAT TT=1.861	SAT TT=9.741 ASSIGNMENTS=17184 CHECKS=7550590	SAT TT=1.029 ASSIGNMENTS=3467 CHECKS=1385420	SAT TT=3.044	SAT TT=1.281	SAT TT=1.207
csp/pseudo/aim/ normalized-aim-200-6-0-3.xml	SAT TT=0.417	SAT TT=1.797 CHECKS=37739 NODES=2224	SAT TT=2.286 CHECKS=146463 NODES=4784	? (TO) TT=1800.06	SAT TT=1.431 CHECKS=1022330	SAT TT=3.134 CHECKS=2895050	SAT TT=2.181 ASSIGNMENTS=764	SAT TT=2.4 ASSIGNMENTS=764	SAT TT=2.538 CHECKS=83377 NODES=744	SAT TT=1488.82 CHECKS=2147590000 NODES=56854500	SAT TT=2.895 CHECKS=2701400 NODES=10360	SAT TT=0.417 ASSIGNMENTS=421 CHECKS=398974	SAT TT=0.434 ASSIGNMENTS=421 CHECKS=398974	SAT TT=2.787	SAT TT=2.666	SAT TT=0.592 ASSIGNMENTS=632 CHECKS=622537	SAT TT=2.577 ASSIGNMENTS=6603 CHECKS=3270170	SAT TT=1.078	SAT TT=2.801 ASSIGNMENTS=3518 CHECKS=1864890	SAT TT=2.274 ASSIGNMENTS=2156 CHECKS=2641370	SAT TT=3.709	SAT TT=1.234	SAT TT=1.358
csp/pseudo/aim/ normalized-aim-50-1-6-2.xml	SAT TT=0.013	SAT TT=0.989 CHECKS=16430 NODES=909	SAT TT=0.858 CHECKS=757 NODES=0	SAT TT=0.081	SAT TT=0.021 CHECKS=969	SAT TT=0.015 CHECKS=1069	SAT TT=0.733 ASSIGNMENTS=3	SAT TT=0.784 ASSIGNMENTS=3	SAT TT=0.838 CHECKS=6687 NODES=368	SAT TT=110.969 CHECKS=229738000 NODES=21019000	? (TO) TT=1800.05	SAT TT=0.025 ASSIGNMENTS=2 CHECKS=802	SAT TT=0.025 ASSIGNMENTS=2 CHECKS=802	SAT TT=1.28	SAT TT=1.152	SAT TT=0.013 ASSIGNMENTS=2 CHECKS=802	SAT TT=0.048 ASSIGNMENTS=1251 CHECKS=50569	SAT TT=0.466	SAT TT=0.039 ASSIGNMENTS=472 CHECKS=27861	SAT TT=0.027 ASSIGNMENTS=209 CHECKS=22312	SAT TT=1.139	SAT TT=0.708	SAT TT=0.791
csp/pseudo/aim/ normalized-aim-50-2-0-1.xml	SAT TT=0.037	SAT TT=1.017 CHECKS=8669 NODES=713	SAT TT=0.941 CHECKS=4777 NODES=410	SAT TT=6.479	SAT TT=0.203 CHECKS=147342	SAT TT=0.183 CHECKS=128657	SAT TT=0.945 ASSIGNMENTS=1211	SAT TT=1.195 ASSIGNMENTS=1211	SAT TT=0.832 CHECKS=5945 NODES=339	SAT TT=5.322 CHECKS=10376100 NODES=743890	? (TO) TT=1800.09	SAT TT=0.081 ASSIGNMENTS=749 CHECKS=81799	SAT TT=0.073 ASSIGNMENTS=749 CHECKS=81799	SAT TT=1.543	SAT TT=1.436	SAT TT=0.073 ASSIGNMENTS=718 CHECKS=82307	SAT TT=0.198 ASSIGNMENTS=4767 CHECKS=269997	SAT TT=0.501	SAT TT=0.047 ASSIGNMENTS=493 CHECKS=33401	SAT TT=0.037 ASSIGNMENTS=305 CHECKS=33295	SAT TT=1.187	SAT TT=0.746	SAT TT=0.731
csp/pseudo/aim/ normalized-aim-50-3-4-1.xml	SAT TT=0.019	SAT TT=0.993 CHECKS=4713 NODES=377	SAT TT=0.958 CHECKS=2685 NODES=157	SAT TT=0.081	SAT TT=0.047 CHECKS=20574	SAT TT=0.036 CHECKS=20512	SAT TT=0.967 ASSIGNMENTS=79	SAT TT=0.901 ASSIGNMENTS=79	SAT TT=1.004 CHECKS=23759 NODES=479	SAT TT=1.639 CHECKS=1525370 NODES=67916	SAT TT=1.11 CHECKS=119150 NODES=1079	SAT TT=0.043 ASSIGNMENTS=68 CHECKS=20150	SAT TT=0.041 ASSIGNMENTS=68 CHECKS=20150	SAT TT=1.691	SAT TT=1.359	SAT TT=0.026 ASSIGNMENTS=51 CHECKS=13384	SAT TT=0.363 ASSIGNMENTS=4407 CHECKS=559116	SAT TT=0.599	SAT TT=0.064 ASSIGNMENTS=441 CHECKS=59095	SAT TT=0.019 ASSIGNMENTS=6 CHECKS=1812	SAT TT=1.741	SAT TT=0.856	SAT TT=0.843
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/aim/ normalized-aim-50-3-4-4.xml	SAT TT=0.039	SAT TT=1.027 CHECKS=9606 NODES=578	SAT TT=0.994 CHECKS=5887 NODES=356	SAT TT=0.079	SAT TT=0.061 CHECKS=38409	SAT TT=0.056 CHECKS=38389	SAT TT=0.973 ASSIGNMENTS=460	SAT TT=1.044 ASSIGNMENTS=460	SAT TT=0.91 CHECKS=6600 NODES=186	SAT TT=1.161 CHECKS=485601 NODES=21639	SAT TT=1.08 CHECKS=434549 NODES=3331	SAT TT=0.057 ASSIGNMENTS=152 CHECKS=43768	SAT TT=0.057 ASSIGNMENTS=152 CHECKS=43768	SAT TT=1.417	SAT TT=1.385	SAT TT=0.039 ASSIGNMENTS=125 CHECKS=34909	SAT TT=0.35 ASSIGNMENTS=4402 CHECKS=545662	SAT TT=0.609	SAT TT=0.045 ASSIGNMENTS=361 CHECKS=42302	SAT TT=0.045 ASSIGNMENTS=147 CHECKS=41742	SAT TT=1.759	SAT TT=0.785	SAT TT=0.814
csp/pseudo/aim/ normalized-aim-50-6-0-1.xml	SAT TT=0.025	SAT TT=1.093 CHECKS=3257 NODES=192	SAT TT=1.095 CHECKS=8303 NODES=337	SAT TT=0.101	SAT TT=0.046 CHECKS=11108	SAT TT=0.032 CHECKS=11017	SAT TT=1.025 ASSIGNMENTS=36	SAT TT=1.037 ASSIGNMENTS=36	SAT TT=0.993 CHECKS=2873 NODES=116	SAT TT=1.099 CHECKS=77826 NODES=1933	SAT TT=1.081 CHECKS=62076 NODES=596	SAT TT=0.048 ASSIGNMENTS=50 CHECKS=21446	SAT TT=0.049 ASSIGNMENTS=50 CHECKS=21446	SAT TT=1.716	SAT TT=1.545	SAT TT=0.035 ASSIGNMENTS=43 CHECKS=19179	SAT TT=0.081 ASSIGNMENTS=533 CHECKS=103306	SAT TT=0.861	SAT TT=0.038 ASSIGNMENTS=72 CHECKS=17033	SAT TT=0.025 ASSIGNMENTS=7 CHECKS=3218	SAT TT=1.82	SAT TT=0.89	SAT TT=0.901
csp/pseudo/aim/ normalized-aim-50-6-0-3.xml	SAT TT=0.028	SAT TT=1.186 CHECKS=2355 NODES=157	SAT TT=1.106 CHECKS=3434 NODES=166	SAT TT=0.092	SAT TT=0.044 CHECKS=9519	SAT TT=0.028 CHECKS=9275	SAT TT=1.077 ASSIGNMENTS=4	SAT TT=1.016 ASSIGNMENTS=4	SAT TT=0.992 CHECKS=2817 NODES=128	SAT TT=1.114 CHECKS=72436 NODES=1813	SAT TT=1.081 CHECKS=54098 NODES=485	SAT TT=0.047 ASSIGNMENTS=18 CHECKS=9890	SAT TT=0.04 ASSIGNMENTS=18 CHECKS=9890	SAT TT=1.8	SAT TT=1.61	SAT TT=0.028 ASSIGNMENTS=16 CHECKS=7480	SAT TT=0.053 ASSIGNMENTS=297 CHECKS=46804	SAT TT=0.858	SAT TT=0.049 ASSIGNMENTS=203 CHECKS=38747	SAT TT=0.038 ASSIGNMENTS=48 CHECKS=21982	SAT TT=1.723	SAT TT=0.969	SAT TT=1.107
csp/pseudo/aim/ normalized-aim-50-6-0-4.xml	SAT TT=0.028	SAT TT=1.104 CHECKS=3435 NODES=199	SAT TT=1.072 CHECKS=4642 NODES=208	SAT TT=0.105	SAT TT=0.045 CHECKS=11808	SAT TT=0.032 CHECKS=11886	SAT TT=1.223 ASSIGNMENTS=41	SAT TT=1.209 ASSIGNMENTS=41	SAT TT=1.079 CHECKS=9331 NODES=170	SAT TT=1.046 CHECKS=57955 NODES=1410	SAT TT=1.058 CHECKS=191551 NODES=1592	SAT TT=0.039 ASSIGNMENTS=7 CHECKS=5576	SAT TT=0.038 ASSIGNMENTS=7 CHECKS=5576	SAT TT=1.482	SAT TT=1.525	SAT TT=0.028 ASSIGNMENTS=7 CHECKS=5576	SAT TT=0.041 ASSIGNMENTS=140 CHECKS=26608	SAT TT=0.801	SAT TT=0.036 ASSIGNMENTS=90 CHECKS=16234	SAT TT=0.037 ASSIGNMENTS=43 CHECKS=21011	SAT TT=1.893	SAT TT=0.962	SAT TT=0.986
csp/pseudo/chnl/ normalized-chnl-10-11.xml	UNSAT TT=0.058	UNSAT TT=1.467 CHECKS=212572 NODES=2319	UNSAT TT=1.584 CHECKS=254326 NODES=1665	? (TO) TT=1800.07	UNSAT TT=0.076 CHECKS=11881	UNSAT TT=0.058 CHECKS=7538	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=720.789 ASSIGNMENTS=6161630 CHECKS=725834000	UNSAT TT=869.723 ASSIGNMENTS=6161630 CHECKS=725834000	UNSAT TT=16.988	UNSAT TT=4.25	? (TO) TT=1800.1	UNSAT TT=685.082 ASSIGNMENTS=9135120 CHECKS=883770000	UNSAT TT=37.465	? (TO) TT=1800.04	UNSAT TT=531.88 ASSIGNMENTS=6161630 CHECKS=725834000	UNSAT TT=1426.01	UNSAT TT=11.762	UNSAT TT=11.287
csp/pseudo/chnl/ normalized-chnl-10-15.xml	UNSAT TT=0.062	UNSAT TT=6.176 CHECKS=2773630 NODES=2183	UNSAT TT=3.536 CHECKS=1683300 NODES=1354	? (TO) TT=1800.05	UNSAT TT=0.064 CHECKS=5081	UNSAT TT=0.062 CHECKS=5051	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.01	UNSAT TT=1655.7 ASSIGNMENTS=2865710 CHECKS=474578000	UNSAT TT=1655.95 ASSIGNMENTS=2865710 CHECKS=474578000	UNSAT TT=15.581	UNSAT TT=4.353	? (TO) TT=1800.02	UNSAT TT=613.737 ASSIGNMENTS=5287110 CHECKS=852119000	UNSAT TT=50.798	UNSAT TT=1554.08 ASSIGNMENTS=6517850 CHECKS=1113020000	UNSAT TT=347.557 ASSIGNMENTS=2865710 CHECKS=474578000	? (TO) TT=1800.18	UNSAT TT=16.435	UNSAT TT=5.999
csp/pseudo/chnl/ normalized-chnl-15-16.xml	UNSAT TT=0.327	UNSAT TT=73.688 CHECKS=51110700 NODES=29733	UNSAT TT=288.369 CHECKS=204356000 NODES=42154	? (TO) TT=1800.09	UNSAT TT=0.327 CHECKS=46106	UNSAT TT=0.336 CHECKS=47946	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.21	? (TO) TT=1800.09	? (TO) TT=1800.11
csp/pseudo/chnl/ normalized-chnl-15-20.xml	UNSAT TT=0.437	UNSAT TT=1103 CHECKS=716887000 NODES=32764	? (TO) TT=1800.17	? (TO) TT=1800.06	UNSAT TT=0.437 CHECKS=58974	UNSAT TT=0.458 CHECKS=55833	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	? TT=213.121	? (TO) TT=1800.13	? (TO) TT=1800.05
csp/pseudo/chnl/ normalized-chnl-20-21.xml	UNSAT TT=1.032	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.05	UNSAT TT=1.065 CHECKS=131908	UNSAT TT=1.032 CHECKS=125953	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? TT=500.586	? (TO) TT=1800.05	? (TO) TT=1800.11
csp/pseudo/chnl/ normalized-chnl-20-30.xml	UNSAT TT=1.889	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=2.265 CHECKS=206040	UNSAT TT=1.889 CHECKS=165351	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.03	? TT=666.893	? (TO) TT=1800.01	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/chnl/ normalized-chnl-30-31.xml	UNSAT TT=7.287	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=7.287 CHECKS=587577	? (TO) TT=1800.23	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.09
csp/pseudo/chnl/ normalized-chnl-30-35.xml	UNSAT TT=9.795	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=9.795 CHECKS=663367	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800
csp/pseudo/chnl/ normalized-chnl-30-40.xml	UNSAT TT=13.431	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.06	UNSAT TT=13.431 CHECKS=842229	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.05
csp/pseudo/chnl/ normalized-chnl-35-40.xml	UNSAT TT=21.029	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.02	UNSAT TT=21.029 CHECKS=1251830	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08
csp/pseudo/chnl/ normalized-chnl-35-45.xml	UNSAT TT=29.427	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.04	UNSAT TT=29.427 CHECKS=1461720	UNSAT TT=44.48 CHECKS=1923810	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/pseudo/chnl/ normalized-chnl-40-41.xml		? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.07
csp/pseudo/chnl/ normalized-chnl-40-50.xml		? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/pseudo/chnl/ normalized-chnl-50-55.xml		? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/pseudo/chnl/ normalized-chnl-50-60.xml		? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.05
csp/pseudo/ circuits/ normalized-b1.xml	SAT TT=0.007	SAT TT=0.735 CHECKS=144 NODES=24	SAT TT=0.732 CHECKS=150 NODES=0	SAT TT=0.034	SAT TT=0.012 CHECKS=657	SAT TT=0.009 CHECKS=515	SAT TT=0.626 ASSIGNMENTS=11	SAT TT=0.697 ASSIGNMENTS=20	SAT TT=0.681 CHECKS=221 NODES=24	SAT TT=0.687 CHECKS=648 NODES=2	SAT TT=0.723 CHECKS=708 NODES=2	SAT TT=0.021 ASSIGNMENTS=12 CHECKS=609	SAT TT=0.022 ASSIGNMENTS=12 CHECKS=609	SAT TT=1.56	SAT TT=1.287	SAT TT=0.01 ASSIGNMENTS=12 CHECKS=609	SAT TT=0.01 ASSIGNMENTS=17 CHECKS=628	SAT TT=0.351	SAT TT=0.009 ASSIGNMENTS=22 CHECKS=873	SAT TT=0.007 ASSIGNMENTS=12 CHECKS=603	SAT TT=1.503	SAT TT=0.64	SAT TT=0.592
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ circuits/ normalized-C17.xml	SAT TT=0.007	SAT TT=0.676 CHECKS=58 NODES=15	SAT TT=0.679 CHECKS=61 NODES=0	SAT TT=0.028	SAT TT=0.008 CHECKS=118	SAT TT=0.01 CHECKS=172	SAT TT=0.537 ASSIGNMENTS=6	SAT TT=0.511 ASSIGNMENTS=6	SAT TT=0.474 CHECKS=64 NODES=15	SAT TT=0.504 CHECKS=230 NODES=0	SAT TT=0.507 CHECKS=267 NODES=1	SAT TT=0.019 ASSIGNMENTS=5 CHECKS=160	SAT TT=0.016 ASSIGNMENTS=5 CHECKS=160	SAT TT=1.004	SAT TT=1.084	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=160	SAT TT=0.009 ASSIGNMENTS=9 CHECKS=154	SAT TT=0.308	SAT TT=0.007 ASSIGNMENTS=6 CHECKS=156	SAT TT=0.007 ASSIGNMENTS=6 CHECKS=155	SAT TT=0.963	SAT TT=0.481	SAT TT=0.507
csp/pseudo/ circuits/ normalized-C432.xml	SAT TT=0.331	SAT TT=2.652 CHECKS=9896 NODES=771	SAT TT=2.462 CHECKS=5573 NODES=0	SAT TT=0.641	SAT TT=0.398 CHECKS=24106	SAT TT=0.393 CHECKS=55174	SAT TT=2.81 ASSIGNMENTS=324	SAT TT=3.139 ASSIGNMENTS=655	SAT TT=106.913 CHECKS=16911 NODES=779	SAT TT=46.841 CHECKS=39305 NODES=40	SAT TT=49.29 CHECKS=108599 NODES=44	SAT TT=0.411 ASSIGNMENTS=344 CHECKS=70844	SAT TT=0.415 ASSIGNMENTS=344 CHECKS=70844	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.411 ASSIGNMENTS=344 CHECKS=70844	SAT TT=0.331 ASSIGNMENTS=456 CHECKS=119270	SAT TT=1.968	SAT TT=73.603 ASSIGNMENTS=42765 CHECKS=8746720	SAT TT=0.417 ASSIGNMENTS=350 CHECKS=71008	? (TO) TT=1800.15	SAT TT=3.014	SAT TT=3.086
csp/pseudo/ circuits/ normalized-c8.xml	SAT TT=0.063	SAT TT=1.388 CHECKS=2962 NODES=239	SAT TT=1.444 CHECKS=2306 NODES=0	SAT TT=0.192	SAT TT=0.107 CHECKS=13694	SAT TT=0.083 CHECKS=13548	SAT TT=1.368 ASSIGNMENTS=83	SAT TT=1.418 ASSIGNMENTS=199	SAT TT=81.662 CHECKS=3766 NODES=243	SAT TT=25.481 CHECKS=9341 NODES=11	SAT TT=23.438 CHECKS=13615 NODES=11	SAT TT=0.077 ASSIGNMENTS=81 CHECKS=13533	SAT TT=0.075 ASSIGNMENTS=81 CHECKS=13533	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=0.067 ASSIGNMENTS=81 CHECKS=13533	SAT TT=0.063 ASSIGNMENTS=88 CHECKS=14729	SAT TT=0.844	SAT TT=0.984 ASSIGNMENTS=4663 CHECKS=763194	SAT TT=0.064 ASSIGNMENTS=81 CHECKS=13281	? (TO) TT=1800.07	SAT TT=1.34	SAT TT=1.47
csp/pseudo/ circuits/ normalized-cc.xml	SAT TT=0.025	SAT TT=1.044 CHECKS=1597 NODES=133	SAT TT=1.037 CHECKS=791 NODES=0	SAT TT=0.084	SAT TT=0.039 CHECKS=2239	SAT TT=0.029 CHECKS=2287	SAT TT=1.08 ASSIGNMENTS=27	SAT TT=1.868 ASSIGNMENTS=104	SAT TT=76.011 CHECKS=1387 NODES=133	SAT TT=16.785 CHECKS=3388 NODES=4	SAT TT=16.546 CHECKS=4359 NODES=6	SAT TT=0.039 ASSIGNMENTS=28 CHECKS=4754	SAT TT=0.038 ASSIGNMENTS=28 CHECKS=4754	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=0.026 ASSIGNMENTS=28 CHECKS=4754	SAT TT=0.028 ASSIGNMENTS=43 CHECKS=5080	SAT TT=0.68	SAT TT=0.03 ASSIGNMENTS=81 CHECKS=5993	SAT TT=0.025 ASSIGNMENTS=28 CHECKS=4757	? (TO) TT=1800.18	SAT TT=0.944	SAT TT=1.055
csp/pseudo/ circuits/ normalized-cm42a.xml	SAT TT=0.02	SAT TT=1.021 CHECKS=1184 NODES=99	SAT TT=0.998 CHECKS=1442 NODES=0	SAT TT=0.073	SAT TT=0.035 CHECKS=4028	SAT TT=0.027 CHECKS=3507	SAT TT=0.972 ASSIGNMENTS=38	SAT TT=0.918 ASSIGNMENTS=38	SAT TT=2.872 CHECKS=1006 NODES=101	SAT TT=1.531 CHECKS=2909 NODES=9	SAT TT=1.661 CHECKS=4217 NODES=9	SAT TT=0.034 ASSIGNMENTS=52 CHECKS=4021	SAT TT=0.033 ASSIGNMENTS=52 CHECKS=4021	SAT TT=2.539	Wrong Cert. TT=2.667	SAT TT=0.021 ASSIGNMENTS=43 CHECKS=3994	SAT TT=0.021 ASSIGNMENTS=45 CHECKS=3277	SAT TT=0.557	SAT TT=0.034 ASSIGNMENTS=325 CHECKS=16138	SAT TT=0.02 ASSIGNMENTS=50 CHECKS=4024	SAT TT=20.301	SAT TT=0.934	SAT TT=0.907
csp/pseudo/ circuits/ normalized-cmb.xml	SAT TT=0.093	SAT TT=1.607 CHECKS=5563 NODES=304	SAT TT=1.701 CHECKS=2755 NODES=0	SAT TT=0.619	SAT TT=0.122 CHECKS=9069	SAT TT=0.113 CHECKS=18859	SAT TT=1.533 ASSIGNMENTS=153	SAT TT=1.879 ASSIGNMENTS=245	SAT TT=106.891 CHECKS=5575 NODES=308	SAT TT=50.533 CHECKS=13721 NODES=16	SAT TT=43.758 CHECKS=21439 NODES=16	SAT TT=0.114 ASSIGNMENTS=162 CHECKS=29368	SAT TT=0.119 ASSIGNMENTS=162 CHECKS=29368	SAT TT=375.349	Wrong Cert. TT=373.297	SAT TT=0.104 ASSIGNMENTS=162 CHECKS=29368	SAT TT=0.093 ASSIGNMENTS=119 CHECKS=27145	SAT TT=0.93	SAT TT=2.275 ASSIGNMENTS=7506 CHECKS=1539860	SAT TT=0.107 ASSIGNMENTS=160 CHECKS=29474	? (TO) TT=1800.13	SAT TT=1.527	SAT TT=2.256
csp/pseudo/ course/ normalized-ss97-4.xml	SAT TT=2.532	? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=252.285 ASSIGNMENTS=475286	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=1162.83 ASSIGNMENTS=1731 CHECKS=580222	SAT TT=1252.26 ASSIGNMENTS=1731 CHECKS=580222	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=3.011 ASSIGNMENTS=1822 CHECKS=2222770	SAT TT=4.848 ASSIGNMENTS=7039 CHECKS=7819150	? (TO) TT=1800.1	SAT TT=15.986 ASSIGNMENTS=7291 CHECKS=5985600	SAT TT=2.532 ASSIGNMENTS=1731 CHECKS=580222	? (TO) TT=1800.14	SAT TT=3.746	SAT TT=7.42
csp/pseudo/ course/ normalized-ss97-6.xml	SAT TT=0.04	? (TO) TT=1800.13	SAT TT=224 CHECKS=46781300 NODES=23817	? (TO) TT=1800.05	SAT TT=0.873 CHECKS=22994	SAT TT=0.879 CHECKS=23150	? (TO) TT=1800.08	SAT TT=1.25 ASSIGNMENTS=351	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=0.056 ASSIGNMENTS=130 CHECKS=18175	SAT TT=0.056 ASSIGNMENTS=130 CHECKS=18175	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=0.04 ASSIGNMENTS=130 CHECKS=18175	SAT TT=0.06 ASSIGNMENTS=271 CHECKS=66053	SAT TT=141.642	SAT TT=0.151 ASSIGNMENTS=867 CHECKS=156378	SAT TT=0.044 ASSIGNMENTS=153 CHECKS=18742	? (TO) TT=1800.09	SAT TT=1.252	SAT TT=1.385
csp/pseudo/ course/ normalized-ws97-3.xml	SAT TT=1.208	? (TO) TT=1800.19	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=82.455 ASSIGNMENTS=57720	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=1.208 ASSIGNMENTS=2431 CHECKS=958859	? (TO) TT=1800.06	SAT TT=2.301 ASSIGNMENTS=2714 CHECKS=2591590	? (TO) TT=1800.09	? (TO) TT=1800.15	SAT TT=5.497	SAT TT=10.207
csp/pseudo/ course/ normalized-ws97-5.xml	SAT TT=0.17	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.05	SAT TT=37.14 CHECKS=108787	? (TO) TT=1800.04	? (TO) TT=1800.18	SAT TT=2.642 ASSIGNMENTS=2436	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=1160.24 ASSIGNMENTS=606 CHECKS=179057	SAT TT=223.785 ASSIGNMENTS=606 CHECKS=179057	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=0.17 ASSIGNMENTS=156 CHECKS=122762	? (TO) TT=1800.12	SAT TT=0.248 ASSIGNMENTS=537 CHECKS=166124	SAT TT=0.291 ASSIGNMENTS=606 CHECKS=179057	? (TO) TT=1800.11	SAT TT=2.417	SAT TT=3.72
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/fpga/ normalized-fpga-10-10.xml	SAT TT=0.084	SAT TT=1.568 CHECKS=150473 NODES=2926	SAT TT=1.01 CHECKS=1465 NODES=0	SAT TT=888.318	SAT TT=0.084 CHECKS=16539	SAT TT=0.104 CHECKS=25361	SAT TT=9.226 ASSIGNMENTS=127355	SAT TT=0.915 ASSIGNMENTS=66	SAT TT=0.859 CHECKS=2827 NODES=150	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=8.835 ASSIGNMENTS=1966 CHECKS=195642	SAT TT=8.868 ASSIGNMENTS=1966 CHECKS=195642	SAT TT=1.728	SAT TT=1.705	SAT TT=285.619 ASSIGNMENTS=2580350 CHECKS=421864000	? (TO) TT=1800.09	SAT TT=20.086	SAT TT=0.167 ASSIGNMENTS=1088 CHECKS=159381	SAT TT=0.144 ASSIGNMENTS=994 CHECKS=167247	SAT TT=3.856	SAT TT=0.946	SAT TT=0.918
csp/pseudo/fpga/ normalized-fpga-10-8.xml	SAT TT=0.11	SAT TT=1.341 CHECKS=66706 NODES=3257	SAT TT=1.393 CHECKS=72754 NODES=3718	SAT TT=896.532	SAT TT=0.127 CHECKS=35289	SAT TT=0.114 CHECKS=32861	SAT TT=16.672 ASSIGNMENTS=269893	SAT TT=1.055 ASSIGNMENTS=2002	SAT TT=0.911 CHECKS=21518 NODES=608	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=8.775 ASSIGNMENTS=1836 CHECKS=67604	SAT TT=8.929 ASSIGNMENTS=1836 CHECKS=67604	SAT TT=1.613	SAT TT=1.716	SAT TT=456.374 ASSIGNMENTS=2654620 CHECKS=678505000	SAT TT=0.214 ASSIGNMENTS=2536 CHECKS=307420	SAT TT=31.898	SAT TT=0.11 ASSIGNMENTS=735 CHECKS=108930	SAT TT=1.19 ASSIGNMENTS=7694 CHECKS=1786280	SAT TT=3.046	SAT TT=0.833	SAT TT=0.858
csp/pseudo/fpga/ normalized-fpga-10-9.xml	SAT TT=0.099	SAT TT=1.618 CHECKS=204440 NODES=5028	SAT TT=1.017 CHECKS=908 NODES=0	SAT TT=898.535	SAT TT=0.115 CHECKS=29591	SAT TT=0.099 CHECKS=24007	SAT TT=14.857 ASSIGNMENTS=256375	SAT TT=0.812 ASSIGNMENTS=66	SAT TT=0.833 CHECKS=2025 NODES=135	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=75.108 ASSIGNMENTS=552372 CHECKS=52670100	SAT TT=69.54 ASSIGNMENTS=552372 CHECKS=52670100	SAT TT=1.769	SAT TT=1.689	SAT TT=49.719 ASSIGNMENTS=446877 CHECKS=70943500	SAT TT=300.101 ASSIGNMENTS=1657720 CHECKS=421911000	SAT TT=1.976	SAT TT=0.152 ASSIGNMENTS=964 CHECKS=154165	SAT TT=2.522 ASSIGNMENTS=15326 CHECKS=4107750	SAT TT=2.889	SAT TT=1.11	SAT TT=0.952
csp/pseudo/fpga/ normalized-fpga-11-11.xml	SAT TT=0.103	SAT TT=3.418 CHECKS=1539180 NODES=8471	SAT TT=1.122 CHECKS=2593 NODES=0	SAT TT=899.513	SAT TT=0.103 CHECKS=23182	SAT TT=0.149 CHECKS=42717	SAT TT=48.444 ASSIGNMENTS=687776	SAT TT=0.924 ASSIGNMENTS=81	SAT TT=0.986 CHECKS=4349 NODES=182	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=842.377 ASSIGNMENTS=3256280 CHECKS=751090000	SAT TT=849.179 ASSIGNMENTS=3256280 CHECKS=751090000	SAT TT=1.974	SAT TT=1.918	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=217.837	SAT TT=0.572 ASSIGNMENTS=2096 CHECKS=465899	SAT TT=0.238 ASSIGNMENTS=1478 CHECKS=272798	SAT TT=5.238	SAT TT=1.15	SAT TT=1.031
csp/pseudo/fpga/ normalized-fpga-12-10.xml	SAT TT=0.248	SAT TT=2.246 CHECKS=485940 NODES=10241	SAT TT=4.94 CHECKS=1748620 NODES=34316	SAT TT=892.112	SAT TT=0.248 CHECKS=74225	SAT TT=0.263 CHECKS=75337	SAT TT=32.826 ASSIGNMENTS=534094	SAT TT=1.508 ASSIGNMENTS=3170	SAT TT=1.082 CHECKS=22431 NODES=681	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=61.934 ASSIGNMENTS=319181 CHECKS=47496900	SAT TT=61.736 ASSIGNMENTS=319181 CHECKS=47496900	SAT TT=1.834	SAT TT=1.772	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.12	SAT TT=0.6 ASSIGNMENTS=2402 CHECKS=550230	? (TO) TT=1800.01	SAT TT=27.779	SAT TT=238.015	SAT TT=0.936
csp/pseudo/fpga/ normalized-fpga-13-11.xml	SAT TT=0.414	SAT TT=4.556 CHECKS=1959720 NODES=18904	SAT TT=10.727 CHECKS=5540890 NODES=60162	SAT TT=896.141	SAT TT=0.418 CHECKS=116820	SAT TT=0.414 CHECKS=116734	SAT TT=281.34 ASSIGNMENTS=4077740	SAT TT=1.057 ASSIGNMENTS=436	SAT TT=1.335 CHECKS=72886 NODES=1420	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.13	SAT TT=1.94	SAT TT=2.14	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.51 ASSIGNMENTS=1933 CHECKS=508338	? (TO) TT=1800.02	? (TO) TT=1800.17	SAT TT=54.38	SAT TT=1.173
csp/pseudo/fpga/ normalized-fpga-14-12.xml	SAT TT=0.599	SAT TT=6.184 CHECKS=2708710 NODES=26881	SAT TT=10.174 CHECKS=5346440 NODES=35760	SAT TT=892.64	SAT TT=0.599 CHECKS=163920	SAT TT=2.056 CHECKS=570581	SAT TT=257.221 ASSIGNMENTS=3779120	SAT TT=1.367 ASSIGNMENTS=580	SAT TT=2.282 CHECKS=502873 NODES=3937	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=2.058	SAT TT=2.35	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=2.787 ASSIGNMENTS=6271 CHECKS=2729220	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.04	SAT TT=1.242
csp/pseudo/fpga/ normalized-fpga-14-14.xml	SAT TT=0.4	SAT TT=7.391 CHECKS=3720990 NODES=11364	SAT TT=1.228 CHECKS=17739 NODES=0	SAT TT=897.856	SAT TT=0.403 CHECKS=101586	SAT TT=0.4 CHECKS=102879	SAT TT=281.432 ASSIGNMENTS=3266990	SAT TT=1.355 ASSIGNMENTS=134	SAT TT=1.319 CHECKS=20643 NODES=294	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=1646.34 ASSIGNMENTS=1728 CHECKS=500466	SAT TT=2.265	SAT TT=2.362	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=9.226 ASSIGNMENTS=27739 CHECKS=8360460	SAT TT=0.44 ASSIGNMENTS=1728 CHECKS=500466	SAT TT=786.124	SAT TT=18.648	SAT TT=1.677
csp/pseudo/fpga/ normalized-fpga-15-14.xml	SAT TT=0.673	SAT TT=41.549 CHECKS=29154300 NODES=57432	SAT TT=164.826 CHECKS=121277000 NODES=237929	SAT TT=915.463	SAT TT=0.673 CHECKS=166547	SAT TT=0.678 CHECKS=169488	SAT TT=1072.71 ASSIGNMENTS=13542700	SAT TT=1.476 ASSIGNMENTS=779	SAT TT=1.758 CHECKS=99455 NODES=902	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=2.492	SAT TT=2.607	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.12	SAT TT=16.295 ASSIGNMENTS=43526 CHECKS=15120000	? (TO) TT=1800.07	? (TO) TT=1800.14	SAT TT=144.166	SAT TT=1.503
csp/pseudo/fpga/ normalized-fpga-20-18.xml	SAT TT=3.861	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=26.489 CHECKS=6110250	SAT TT=30.563 CHECKS=7127170	? (TO) TT=1800.07	SAT TT=3.861 ASSIGNMENTS=13085	SAT TT=488.436 CHECKS=451410000 NODES=486194	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=4.562	SAT TT=6.476	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=198.63	? (TO) TT=1800.07	SAT TT=4.73
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/fpga/ normalized-fpga-25-23.xml	SAT TT=3.817	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.09	SAT TT=148.618 CHECKS=30253500	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=322.582 ASSIGNMENTS=1223930	SAT TT=115.662 CHECKS=83178000 NODES=4889	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=50.395	SAT TT=87.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? TT=253.506	? (TO) TT=1800	SAT TT=3.817
csp/pseudo/fpga/ normalized-fpga-30-28.xml	SAT TT=5.074	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.14	SAT TT=5.342 ASSIGNMENTS=6892	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=1552.7	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.01	? TT=309.57	? (TO) TT=1800.02	SAT TT=5.074
csp/pseudo/fpga/ normalized-fpga-30-30.xml	SAT TT=3.288	? (TO) TT=1800.17	? (TO) TT=1800.15	SAT TT=1349.2	SAT TT=86.505 CHECKS=13296500	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=3.288 ASSIGNMENTS=646	SAT TT=767.231 CHECKS=1073840000 NODES=1350	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.22	? (TO) TT=1800.02	SAT TT=6.841
csp/pseudo/fpga/ normalized-fpga-35-34.xml	SAT TT=10.837	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.04	SAT TT=262.674 CHECKS=18969900	? (TO) TT=1800.11	SAT TT=77.418 ASSIGNMENTS=135627	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.2	? (TO) TT=1800.1	SAT TT=10.837
csp/pseudo/fpga/ normalized-fpga-35-35.xml	SAT TT=5.027	? (TO) TT=1800.12	? (TO) TT=1800.16	SAT TT=1346.36	SAT TT=184.1 CHECKS=21793500	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=5.027 ASSIGNMENTS=885	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.05	? TT=1402.68	? (TO) TT=1800.03	SAT TT=10.406
csp/pseudo/garden/ normalized-g-100x100.xml	SAT TT=1.391	SAT TT=23.335 CHECKS=20002 NODES=10000	SAT TT=26.992 CHECKS=20001 NODES=0	SAT TT=3.967	SAT TT=43.526 CHECKS=166909	SAT TT=38.154 CHECKS=167626	SAT TT=30.622 ASSIGNMENTS=6226	SAT TT=25.056 ASSIGNMENTS=6226	SAT TT=64.946 CHECKS=129270 NODES=10000	? TT=36.127 CHECKS=60679 NODES=0	SAT TT=36.901 CHECKS=1598420 NODES=203	SAT TT=1.759 ASSIGNMENTS=6715 CHECKS=260632	SAT TT=2.023 ASSIGNMENTS=6715 CHECKS=260632	SAT TT=124.925	SAT TT=118.284	SAT TT=2.02 ASSIGNMENTS=6715 CHECKS=260632	SAT TT=1.391 ASSIGNMENTS=7033 CHECKS=265221	SAT TT=6.713	SAT TT=2.16 ASSIGNMENTS=6666 CHECKS=261790	SAT TT=2.477 ASSIGNMENTS=7022 CHECKS=265144	SAT TT=9.162	SAT TT=3.968	SAT TT=4.056
csp/pseudo/ garden/ normalized-g-15x15.xml	SAT TT=0.029	SAT TT=1.257 CHECKS=452 NODES=225	SAT TT=1.042 CHECKS=452 NODES=0	SAT TT=0.104	SAT TT=0.041 CHECKS=3383	SAT TT=0.031 CHECKS=3317	SAT TT=0.98 ASSIGNMENTS=144	SAT TT=0.995 ASSIGNMENTS=144	SAT TT=0.991 CHECKS=2454 NODES=225	SAT TT=0.953 CHECKS=3903 NODES=1	SAT TT=0.945 CHECKS=4394 NODES=2	SAT TT=0.043 ASSIGNMENTS=154 CHECKS=5461	SAT TT=0.036 ASSIGNMENTS=154 CHECKS=5461	SAT TT=1.893	SAT TT=1.671	SAT TT=0.03 ASSIGNMENTS=154 CHECKS=5461	SAT TT=0.029 ASSIGNMENTS=97 CHECKS=5098	SAT TT=0.651	SAT TT=0.04 ASSIGNMENTS=312 CHECKS=8475	SAT TT=0.031 ASSIGNMENTS=153 CHECKS=5467	SAT TT=2.062	SAT TT=0.923	SAT TT=1.066
csp/pseudo/ garden/ normalized-g-2x2.xml	SAT TT=0.005	SAT TT=0.651 CHECKS=11 NODES=4	SAT TT=0.648 CHECKS=9 NODES=0	SAT TT=0.024	SAT TT=0.008 CHECKS=56	SAT TT=0.005 CHECKS=60	SAT TT=0.455 ASSIGNMENTS=3	SAT TT=0.509 ASSIGNMENTS=3	SAT TT=0.421 CHECKS=6 NODES=4	SAT TT=0.422 CHECKS=58 NODES=0	SAT TT=0.444 CHECKS=58 NODES=0	SAT TT=0.019 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.019 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.785	SAT TT=0.766	SAT TT=0.006 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.005 ASSIGNMENTS=1 CHECKS=30	SAT TT=0.264	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.892	SAT TT=0.481	SAT TT=0.442
csp/pseudo/ garden/ normalized-g-4x4.xml	SAT TT=0.006	SAT TT=0.702 CHECKS=33 NODES=16	SAT TT=0.683 CHECKS=33 NODES=0	SAT TT=0.029	SAT TT=0.008 CHECKS=200	SAT TT=0.007 CHECKS=244	SAT TT=0.592 ASSIGNMENTS=11	SAT TT=0.486 ASSIGNMENTS=11	SAT TT=0.506 CHECKS=86 NODES=16	SAT TT=0.51 CHECKS=264 NODES=0	SAT TT=0.514 CHECKS=264 NODES=0	SAT TT=0.018 ASSIGNMENTS=10 CHECKS=280	SAT TT=0.02 ASSIGNMENTS=10 CHECKS=280	SAT TT=1.008	SAT TT=0.964	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=280	SAT TT=0.008 ASSIGNMENTS=9 CHECKS=254	SAT TT=0.293	SAT TT=0.008 ASSIGNMENTS=11 CHECKS=270	SAT TT=0.006 ASSIGNMENTS=10 CHECKS=280	SAT TT=0.896	SAT TT=0.484	SAT TT=0.514
csp/pseudo/ garden/ normalized-g-7x7.xml	SAT TT=0.009	SAT TT=0.867 CHECKS=100 NODES=49	SAT TT=0.781 CHECKS=99 NODES=0	SAT TT=0.042	SAT TT=0.015 CHECKS=702	SAT TT=0.012 CHECKS=673	SAT TT=0.678 ASSIGNMENTS=31	SAT TT=0.689 ASSIGNMENTS=31	SAT TT=0.633 CHECKS=403 NODES=49	SAT TT=0.689 CHECKS=839 NODES=0	SAT TT=0.698 CHECKS=834 NODES=0	SAT TT=0.021 ASSIGNMENTS=33 CHECKS=1041	SAT TT=0.022 ASSIGNMENTS=33 CHECKS=1041	SAT TT=1.325	SAT TT=1.183	SAT TT=0.01 ASSIGNMENTS=33 CHECKS=1041	SAT TT=0.009 ASSIGNMENTS=21 CHECKS=960	SAT TT=0.391	SAT TT=0.01 ASSIGNMENTS=30 CHECKS=1030	SAT TT=0.01 ASSIGNMENTS=33 CHECKS=1051	SAT TT=1.538	SAT TT=0.635	SAT TT=0.574
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ garden/ normalized-g-9x3.xml	SAT TT=0.006	SAT TT=0.718 CHECKS=56 NODES=27	SAT TT=0.737 CHECKS=56 NODES=0	SAT TT=0.033	SAT TT=0.011 CHECKS=382	SAT TT=0.006 CHECKS=337	SAT TT=0.512 ASSIGNMENTS=19	SAT TT=0.568 ASSIGNMENTS=19	SAT TT=0.562 CHECKS=176 NODES=27	SAT TT=0.624 CHECKS=483 NODES=1	SAT TT=0.535 CHECKS=457 NODES=0	SAT TT=0.019 ASSIGNMENTS=18 CHECKS=497	SAT TT=0.018 ASSIGNMENTS=18 CHECKS=497	SAT TT=1.165	SAT TT=1.041	SAT TT=0.009 ASSIGNMENTS=18 CHECKS=497	SAT TT=0.008 ASSIGNMENTS=13 CHECKS=413	SAT TT=0.329	SAT TT=0.008 ASSIGNMENTS=21 CHECKS=488	SAT TT=0.009 ASSIGNMENTS=18 CHECKS=497	SAT TT=1.024	SAT TT=0.556	SAT TT=0.524
csp/pseudo/ garden/ normalized-g-9x9.xml	SAT TT=0.011	SAT TT=0.867 CHECKS=164 NODES=81	SAT TT=0.828 CHECKS=164 NODES=0	SAT TT=0.052	SAT TT=0.02 CHECKS=1149	SAT TT=0.014 CHECKS=1180	SAT TT=0.713 ASSIGNMENTS=54	SAT TT=0.713 ASSIGNMENTS=54	SAT TT=0.752 CHECKS=766 NODES=81	SAT TT=0.744 CHECKS=1424 NODES=1	SAT TT=0.82 CHECKS=1506 NODES=1	SAT TT=0.025 ASSIGNMENTS=54 CHECKS=1829	SAT TT=0.025 ASSIGNMENTS=54 CHECKS=1829	SAT TT=1.316	SAT TT=1.365	SAT TT=0.011 ASSIGNMENTS=54 CHECKS=1829	SAT TT=0.014 ASSIGNMENTS=33 CHECKS=1680	SAT TT=0.469	SAT TT=0.012 ASSIGNMENTS=58 CHECKS=1805	SAT TT=0.014 ASSIGNMENTS=55 CHECKS=1823	SAT TT=1.567	SAT TT=0.663	SAT TT=0.684
csp/pseudo/ii/ normalized-ii-16a2.xml	SAT TT=1.822	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=3.935	SAT TT=13.619 CHECKS=12729400	SAT TT=8.943 CHECKS=6015530	SAT TT=23.485 ASSIGNMENTS=100	SAT TT=22.436 ASSIGNMENTS=100	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=1.822 ASSIGNMENTS=103 CHECKS=342975	SAT TT=1.979 ASSIGNMENTS=103 CHECKS=342975	SAT TT=31.515	SAT TT=31.775	SAT TT=1.916 ASSIGNMENTS=103 CHECKS=342975	SAT TT=2.223 ASSIGNMENTS=908 CHECKS=647487	SAT TT=48.861	? (TO) TT=1800.1	SAT TT=1.885 ASSIGNMENTS=103 CHECKS=338350	SAT TT=176.958	SAT TT=5.352	SAT TT=6.198
csp/pseudo/ii/ normalized-ii-16b2.xml	SAT TT=5.129	? (TO) TT=1800.11	? (TO) TT=1800.13	SAT TT=1615.96	? (TO) TT=1800.06	SAT TT=205.18 CHECKS=213195000	? (TO) TT=1800.1	? (TO) TT=1800.16	SAT TT=476.737 CHECKS=18314400 NODES=12858	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=21.027	SAT TT=20.798	? (TO) TT=1800.11	SAT TT=5.433 ASSIGNMENTS=596 CHECKS=3650160	SAT TT=11.079	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=257.18	SAT TT=5.129	SAT TT=6.386
csp/pseudo/ii/ normalized-ii-16c2.xml	SAT TT=5.995	? (TO) TT=1800.1	? (TO) TT=1800.12	SAT TT=1611.36	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.28	SAT TT=918.014 CHECKS=41894500 NODES=26932	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=19	SAT TT=18.131	? (TO) TT=1800.03	SAT TT=50.365 ASSIGNMENTS=4687 CHECKS=37051400	SAT TT=12.333	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=336.72	SAT TT=5.995	SAT TT=6.714
csp/pseudo/ii/ normalized-ii-16d1.xml	SAT TT=7.45	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=88.416 CHECKS=39468800	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=822.658 CHECKS=35391100 NODES=39811	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=26.566	SAT TT=26.986	? (TO) TT=1800.08	SAT TT=20.411 ASSIGNMENTS=7762 CHECKS=19490600	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=417.987	SAT TT=7.45	SAT TT=8.138
csp/pseudo/ii/ normalized-ii-16e1.xml	SAT TT=8.592	? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.02	SAT TT=64.493 CHECKS=16959200	SAT TT=73.737 CHECKS=18390400	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=32.051	SAT TT=31.96	? (TO) TT=1800.06	SAT TT=24.881 ASSIGNMENTS=8248 CHECKS=24904900	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=888.211	SAT TT=8.592	SAT TT=13.004
csp/pseudo/ii/ normalized-ii-16e2.xml	SAT TT=5.925	? (TO) TT=1800.09	? (TO) TT=1800.13	SAT TT=923.206	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.14	SAT TT=461.489 CHECKS=31062500 NODES=14989	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=12.388	SAT TT=12.566	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=17.101	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=462.383	SAT TT=5.925	SAT TT=7.817
csp/pseudo/ii/ normalized-ii-32a1.xml	SAT TT=7.118	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.07	SAT TT=1063.84 CHECKS=25046000 NODES=14972	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=7.118 ASSIGNMENTS=238 CHECKS=6054420	SAT TT=9.839	SAT TT=7.648 ASSIGNMENTS=510 CHECKS=6471450	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=7.781	SAT TT=8.448
csp/pseudo/ii/ normalized-ii-32b3.xml	SAT TT=4.083	? (TO) TT=1800.14	? (TO) TT=1800.14	SAT TT=1603.68	SAT TT=47.058 CHECKS=17658200	SAT TT=68.159 CHECKS=26673300	SAT TT=19.494 ASSIGNMENTS=3034	SAT TT=16.806 ASSIGNMENTS=3034	SAT TT=108.32 CHECKS=1137050 NODES=1355	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=254.011 ASSIGNMENTS=26680 CHECKS=95700900	SAT TT=245.502 ASSIGNMENTS=26680 CHECKS=95700900	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=49.876 ASSIGNMENTS=1479 CHECKS=38285300	SAT TT=11.226	SAT TT=4.083 ASSIGNMENTS=224 CHECKS=3126790	? (TO) TT=1800.02	? (TO) TT=1800.17	SAT TT=6.292	SAT TT=10.813
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ii/ normalized-ii-32c3.xml	SAT TT=1.938	? (TO) TT=1800.09	SAT TT=1722.4 CHECKS=566503000 NODES=220969	? (TO) TT=1800.09	SAT TT=7.381 CHECKS=1866220	SAT TT=9.237 CHECKS=2416450	SAT TT=850.913 ASSIGNMENTS=492279	SAT TT=856.302 ASSIGNMENTS=492279	SAT TT=71.232 CHECKS=176945 NODES=768	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=1.938 ASSIGNMENTS=140 CHECKS=1597340	SAT TT=16.435	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=4.25	SAT TT=6.336
csp/pseudo/ii/ normalized-ii-32d2.xml	SAT TT=5.815	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.1	SAT TT=219.158 CHECKS=103325000	SAT TT=419.212 CHECKS=237242000	SAT TT=52.832 ASSIGNMENTS=19079	SAT TT=52.798 ASSIGNMENTS=19079	SAT TT=738.448 CHECKS=20656200 NODES=25782	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=1649.14 ASSIGNMENTS=19079	SAT TT=1646.63 ASSIGNMENTS=19079	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.12	SAT TT=26.645 ASSIGNMENTS=4673 CHECKS=26839100	SAT TT=1290.89	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.12	SAT TT=7.604	SAT TT=5.815
csp/pseudo/ii/ normalized-ii-32e1.xml	SAT TT=0.194	SAT TT=1.869 CHECKS=8106 NODES=444	SAT TT=2.026 CHECKS=19180 NODES=444	SAT TT=0.45	SAT TT=0.927 CHECKS=253165	SAT TT=0.333 CHECKS=72134	SAT TT=2.085 ASSIGNMENTS=30	SAT TT=2.299 ASSIGNMENTS=30	SAT TT=62.302 CHECKS=12069 NODES=511	SAT TT=4.114 CHECKS=1997470 NODES=31587	SAT TT=2.723 CHECKS=1236850 NODES=1029	SAT TT=0.206 ASSIGNMENTS=44 CHECKS=99064	SAT TT=0.219 ASSIGNMENTS=44 CHECKS=99064	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=0.196 ASSIGNMENTS=44 CHECKS=99064	SAT TT=1.451 ASSIGNMENTS=1324 CHECKS=2168180	SAT TT=1.268	SAT TT=0.317 ASSIGNMENTS=153 CHECKS=203557	SAT TT=0.194 ASSIGNMENTS=43 CHECKS=97828	? (TO) TT=1800.08	SAT TT=2.1	SAT TT=3.038
csp/pseudo/ii/ normalized-ii-32e2.xml	SAT TT=3.064	SAT TT=15.922 CHECKS=5268120 NODES=5115	SAT TT=154.685 CHECKS=58904200 NODES=37606	SAT TT=1791.51	SAT TT=14.449 CHECKS=6814430	SAT TT=19.361 CHECKS=9428700	SAT TT=244.352 ASSIGNMENTS=183291	SAT TT=264.796 ASSIGNMENTS=183291	SAT TT=64.686 CHECKS=38104 NODES=612	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=54.034 ASSIGNMENTS=17054 CHECKS=20229200	SAT TT=56.136 ASSIGNMENTS=17054 CHECKS=20229200	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=6.705	SAT TT=3.465 ASSIGNMENTS=729 CHECKS=2552010	SAT TT=800.004 ASSIGNMENTS=68954 CHECKS=677669000	? (TO) TT=1800.14	SAT TT=3.064	SAT TT=4.544
csp/pseudo/ii/ normalized-ii-32e3.xml	SAT TT=1.232	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=38.897 CHECKS=17865500	SAT TT=66.393 CHECKS=24961600	SAT TT=372.349 ASSIGNMENTS=121330	SAT TT=353.778 ASSIGNMENTS=121330	SAT TT=86.052 CHECKS=421584 NODES=1003	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=255.194 ASSIGNMENTS=25304 CHECKS=93659400	SAT TT=254.614 ASSIGNMENTS=25304 CHECKS=93659400	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=1.232 ASSIGNMENTS=60 CHECKS=758327	SAT TT=11.698	SAT TT=1.355 ASSIGNMENTS=172 CHECKS=1009690	? (TO) TT=1800.06	? (TO) TT=1800.14	SAT TT=4.808	SAT TT=8.347
csp/pseudo/ ii/ normalized-ii-8a1.xml	SAT TT=0.02	SAT TT=0.988 CHECKS=1070 NODES=134	SAT TT=0.975 CHECKS=1334 NODES=0	SAT TT=0.08	SAT TT=0.042 CHECKS=9238	SAT TT=0.029 CHECKS=6426	SAT TT=1.099 ASSIGNMENTS=21	SAT TT=1.332 ASSIGNMENTS=21	SAT TT=0.994 CHECKS=1160 NODES=140	SAT TT=1.191 CHECKS=11217 NODES=555	SAT TT=1.022 CHECKS=63712 NODES=324	SAT TT=0.032 ASSIGNMENTS=16 CHECKS=1337	SAT TT=0.033 ASSIGNMENTS=16 CHECKS=1337	SAT TT=1.686	SAT TT=1.787	SAT TT=0.02 ASSIGNMENTS=16 CHECKS=1337	SAT TT=0.021 ASSIGNMENTS=32 CHECKS=1611	SAT TT=0.597	SAT TT=0.021 ASSIGNMENTS=79 CHECKS=4220	SAT TT=0.022 ASSIGNMENTS=19 CHECKS=1371	SAT TT=1.846	SAT TT=0.913	SAT TT=0.92
csp/pseudo/ ii/ normalized-ii-8b1.xml	SAT TT=0.133	SAT TT=8.312 CHECKS=7477 NODES=672	SAT TT=8.275 CHECKS=23179 NODES=672	SAT TT=0.453	SAT TT=0.393 CHECKS=137611	SAT TT=0.411 CHECKS=325535	SAT TT=2.882 ASSIGNMENTS=55	SAT TT=3.085 ASSIGNMENTS=55	SAT TT=3.171 CHECKS=8774 NODES=674	SAT TT=2.758 CHECKS=51132 NODES=826	SAT TT=3.493 CHECKS=717578 NODES=661	SAT TT=0.155 ASSIGNMENTS=54 CHECKS=11621	SAT TT=0.162 ASSIGNMENTS=54 CHECKS=11621	SAT TT=3.48	SAT TT=3.462	SAT TT=0.144 ASSIGNMENTS=54 CHECKS=11621	SAT TT=0.699 ASSIGNMENTS=7187 CHECKS=837611	SAT TT=1.226	SAT TT=0.171 ASSIGNMENTS=260 CHECKS=19702	SAT TT=0.133 ASSIGNMENTS=54 CHECKS=11643	SAT TT=5.215	SAT TT=1.712	SAT TT=1.519
csp/pseudo/ ii/ normalized-ii-8b2.xml	SAT TT=0.294	SAT TT=14.348 CHECKS=551906 NODES=3076	SAT TT=14.326 CHECKS=355945 NODES=2814	SAT TT=0.853	SAT TT=1.327 CHECKS=997002	SAT TT=1.133 CHECKS=1025090	SAT TT=4.59 ASSIGNMENTS=53	SAT TT=4.375 ASSIGNMENTS=53	SAT TT=8.394 CHECKS=94586 NODES=1506	? (TO) TT=1800.09	SAT TT=8.652 CHECKS=9112610 NODES=4396	SAT TT=0.3 ASSIGNMENTS=52 CHECKS=22824	SAT TT=0.314 ASSIGNMENTS=52 CHECKS=22824	SAT TT=5.749	SAT TT=5.508	SAT TT=0.302 ASSIGNMENTS=52 CHECKS=22824	SAT TT=1.469 ASSIGNMENTS=8086 CHECKS=1428680	SAT TT=1.742	SAT TT=0.425 ASSIGNMENTS=414 CHECKS=65912	SAT TT=0.294 ASSIGNMENTS=52 CHECKS=22833	SAT TT=6.58	SAT TT=2.221	SAT TT=2.12
csp/pseudo/ ii/ normalized-ii-8b4.xml	SAT TT=0.582	SAT TT=9.22 CHECKS=1845260 NODES=6271	SAT TT=9.888 CHECKS=1999360 NODES=6549	SAT TT=1.679	SAT TT=3.194 CHECKS=1309160	SAT TT=4.172 CHECKS=3530280	SAT TT=8.754 ASSIGNMENTS=46	SAT TT=8.454 ASSIGNMENTS=46	SAT TT=29.277 CHECKS=170291 NODES=2490	? (TO) TT=1800.09	SAT TT=24.672 CHECKS=16318700 NODES=2875	SAT TT=0.603 ASSIGNMENTS=46 CHECKS=45058	SAT TT=0.62 ASSIGNMENTS=46 CHECKS=45058	SAT TT=11.476	SAT TT=11.266	SAT TT=0.619 ASSIGNMENTS=46 CHECKS=45058	SAT TT=1.582 ASSIGNMENTS=5099 CHECKS=1273690	SAT TT=3.182	SAT TT=3.108 ASSIGNMENTS=1502 CHECKS=214309	SAT TT=0.582 ASSIGNMENTS=46 CHECKS=45058	SAT TT=7.505	SAT TT=2.651	SAT TT=3.094
csp/pseudo/ ii/ normalized-ii-8c2.xml	SAT TT=0.473	SAT TT=13.038 CHECKS=7848340 NODES=16084	SAT TT=8.055 CHECKS=1839020 NODES=5766	SAT TT=1.398	SAT TT=2.647 CHECKS=2032650	SAT TT=1.674 CHECKS=828840	SAT TT=6.736 ASSIGNMENTS=100	SAT TT=6.118 ASSIGNMENTS=100	SAT TT=17.293 CHECKS=60424 NODES=2161	SAT TT=99.082 CHECKS=105619000 NODES=1651790	SAT TT=16.837 CHECKS=10331500 NODES=2675	SAT TT=0.514 ASSIGNMENTS=100 CHECKS=41973	SAT TT=0.521 ASSIGNMENTS=100 CHECKS=41973	SAT TT=10.195	SAT TT=8.639	SAT TT=0.473 ASSIGNMENTS=100 CHECKS=41973	SAT TT=3.785 ASSIGNMENTS=21780 CHECKS=3455760	SAT TT=166.428	SAT TT=5.615 ASSIGNMENTS=3119 CHECKS=558330	SAT TT=0.538 ASSIGNMENTS=100 CHECKS=41973	SAT TT=7.881	SAT TT=3.152	SAT TT=3.371
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/jnh/ normalized-jnh-12.xml	SAT TT=0.092	SAT TT=1.902 CHECKS=11436 NODES=461	SAT TT=1.793 CHECKS=17056 NODES=256	SAT TT=0.33	SAT TT=0.135 CHECKS=30684	SAT TT=0.092 CHECKS=28671	SAT TT=1.546 ASSIGNMENTS=9	SAT TT=1.682 ASSIGNMENTS=9	SAT TT=1.979 CHECKS=107856 NODES=278	SAT TT=151.701 CHECKS=241627000 NODES=1201210	? (TO) TT=1800	SAT TT=0.359 ASSIGNMENTS=54 CHECKS=253825	SAT TT=0.327 ASSIGNMENTS=54 CHECKS=253825	SAT TT=3.356	SAT TT=3.097	SAT TT=0.46 ASSIGNMENTS=102 CHECKS=414681	SAT TT=2.044 ASSIGNMENTS=1095 CHECKS=2016190	SAT TT=0.98	SAT TT=0.281 ASSIGNMENTS=88 CHECKS=163740	SAT TT=0.339 ASSIGNMENTS=72 CHECKS=283895	SAT TT=3.901	SAT TT=1.414	SAT TT=1.748
csp/pseudo/jnh/ normalized-jnh-17.xml	SAT TT=0.207	SAT TT=1.629 CHECKS=14698 NODES=615	SAT TT=1.793 CHECKS=16441 NODES=597	SAT TT=0.317	SAT TT=0.251 CHECKS=131484	SAT TT=0.207 CHECKS=132865	SAT TT=1.636 ASSIGNMENTS=57	SAT TT=1.809 ASSIGNMENTS=57	SAT TT=1.871 CHECKS=31727 NODES=221	SAT TT=20.825 CHECKS=30696500 NODES=154438	SAT TT=5.972 CHECKS=9196790 NODES=12798	SAT TT=0.304 ASSIGNMENTS=53 CHECKS=222386	SAT TT=0.312 ASSIGNMENTS=53 CHECKS=222386	SAT TT=3.283	SAT TT=3.155	SAT TT=0.364 ASSIGNMENTS=74 CHECKS=297358	SAT TT=3.276 ASSIGNMENTS=2016 CHECKS=3616030	SAT TT=0.987	SAT TT=0.35 ASSIGNMENTS=148 CHECKS=244119	SAT TT=0.303 ASSIGNMENTS=47 CHECKS=211728	SAT TT=3.863	SAT TT=1.449	SAT TT=1.632
csp/pseudo/ jnh/ normalized-jnh-1.xml	SAT TT=0.3	SAT TT=1.565 CHECKS=4504 NODES=274	SAT TT=1.689 CHECKS=7021 NODES=259	SAT TT=0.34	SAT TT=0.332 CHECKS=184915	SAT TT=0.3 CHECKS=211900	SAT TT=2.009 ASSIGNMENTS=122	SAT TT=1.98 ASSIGNMENTS=122	SAT TT=2.098 CHECKS=166082 NODES=364	SAT TT=40 CHECKS=59863800 NODES=271081	SAT TT=2.069 CHECKS=540676 NODES=885	SAT TT=1.355 ASSIGNMENTS=254 CHECKS=1146800	SAT TT=1.131 ASSIGNMENTS=254 CHECKS=1146800	SAT TT=3.379	SAT TT=3.567	SAT TT=0.631 ASSIGNMENTS=145 CHECKS=484978	SAT TT=8.151 ASSIGNMENTS=4130 CHECKS=8143300	SAT TT=1.004	SAT TT=2.715 ASSIGNMENTS=1233 CHECKS=2197790	SAT TT=0.344 ASSIGNMENTS=80 CHECKS=264577	SAT TT=4.802	SAT TT=1.707	SAT TT=1.52
csp/pseudo/jnh/ normalized-jnh-201.xml	SAT TT=0.168	SAT TT=1.626 CHECKS=2276 NODES=200	SAT TT=1.647 CHECKS=5461 NODES=200	SAT TT=0.305	SAT TT=0.295 CHECKS=156366	SAT TT=0.187 CHECKS=101791	SAT TT=1.806 ASSIGNMENTS=87	SAT TT=1.697 ASSIGNMENTS=87	SAT TT=1.836 CHECKS=46552 NODES=269	SAT TT=1.793 CHECKS=147916 NODES=622	SAT TT=1.837 CHECKS=372033 NODES=544	SAT TT=0.209 ASSIGNMENTS=54 CHECKS=123137	SAT TT=0.212 ASSIGNMENTS=54 CHECKS=123137	SAT TT=3.339	SAT TT=3.566	SAT TT=0.185 ASSIGNMENTS=43 CHECKS=86177	SAT TT=1.88 ASSIGNMENTS=895 CHECKS=1829800	SAT TT=0.982	SAT TT=0.168 ASSIGNMENTS=60 CHECKS=61658	SAT TT=0.177 ASSIGNMENTS=42 CHECKS=90691	SAT TT=6.542	SAT TT=1.49	SAT TT=1.84
csp/pseudo/jnh/ normalized-jnh-204.xml	SAT TT=0.272	SAT TT=2.173 CHECKS=77565 NODES=3236	SAT TT=2.012 CHECKS=55229 NODES=2052	SAT TT=0.368	SAT TT=0.366 CHECKS=208995	SAT TT=0.396 CHECKS=270045	SAT TT=1.747 ASSIGNMENTS=97	SAT TT=1.888 ASSIGNMENTS=97	SAT TT=3.795 CHECKS=900740 NODES=837	SAT TT=1631.49 CHECKS=2880170000 NODES=15647600	SAT TT=2.42 CHECKS=1580960 NODES=2889	SAT TT=0.272 ASSIGNMENTS=61 CHECKS=192895	SAT TT=0.275 ASSIGNMENTS=61 CHECKS=192895	SAT TT=3.288	SAT TT=3.096	SAT TT=0.455 ASSIGNMENTS=123 CHECKS=403486	SAT TT=2.086 ASSIGNMENTS=1386 CHECKS=2147430	SAT TT=1.251	SAT TT=2.786 ASSIGNMENTS=1852 CHECKS=2565340	SAT TT=0.88 ASSIGNMENTS=200 CHECKS=824075	SAT TT=4.122	SAT TT=1.978	SAT TT=1.64
csp/pseudo/jnh/ normalized-jnh-205.xml	SAT TT=0.318	SAT TT=1.592 CHECKS=6757 NODES=360	SAT TT=1.602 CHECKS=8667 NODES=434	SAT TT=0.318	SAT TT=0.567 CHECKS=394626	SAT TT=0.446 CHECKS=314465	SAT TT=1.642 ASSIGNMENTS=103	SAT TT=1.609 ASSIGNMENTS=103	SAT TT=2.775 CHECKS=465656 NODES=517	SAT TT=8.581 CHECKS=11183700 NODES=58974	SAT TT=1.993 CHECKS=733962 NODES=1320	SAT TT=0.397 ASSIGNMENTS=88 CHECKS=337455	SAT TT=0.389 ASSIGNMENTS=88 CHECKS=337455	SAT TT=3.382	SAT TT=3.245	SAT TT=0.522 ASSIGNMENTS=110 CHECKS=437708	SAT TT=6.541 ASSIGNMENTS=4112 CHECKS=7268580	SAT TT=1.049	SAT TT=2.159 ASSIGNMENTS=1322 CHECKS=2231160	SAT TT=0.65 ASSIGNMENTS=142 CHECKS=631937	SAT TT=3.73	SAT TT=1.649	SAT TT=1.636
csp/pseudo/jnh/ normalized-jnh-207.xml	SAT TT=0.432	SAT TT=1.612 CHECKS=9320 NODES=424	SAT TT=1.762 CHECKS=14618 NODES=542	SAT TT=0.707	SAT TT=0.547 CHECKS=366437	SAT TT=0.468 CHECKS=337755	SAT TT=2.008 ASSIGNMENTS=172	SAT TT=1.78 ASSIGNMENTS=172	SAT TT=1.951 CHECKS=52234 NODES=245	SAT TT=1295.14 CHECKS=2267540000 NODES=12112100	? (TO) TT=1800.07	SAT TT=0.542 ASSIGNMENTS=114 CHECKS=485879	SAT TT=0.582 ASSIGNMENTS=114 CHECKS=485879	SAT TT=2.993	SAT TT=3.467	SAT TT=1.173 ASSIGNMENTS=287 CHECKS=1204540	SAT TT=6.889 ASSIGNMENTS=4339 CHECKS=7195940	SAT TT=0.992	SAT TT=0.55 ASSIGNMENTS=274 CHECKS=432668	SAT TT=0.432 ASSIGNMENTS=95 CHECKS=375519	SAT TT=4.12	SAT TT=1.616	SAT TT=1.412
csp/pseudo/jnh/ normalized-jnh-209.xml	SAT TT=0.359	SAT TT=1.832 CHECKS=16056 NODES=755	SAT TT=1.704 CHECKS=14446 NODES=548	SAT TT=0.359	SAT TT=0.701 CHECKS=483216	SAT TT=0.677 CHECKS=493898	SAT TT=1.986 ASSIGNMENTS=446	SAT TT=1.986 ASSIGNMENTS=446	SAT TT=1.812 CHECKS=70396 NODES=250	SAT TT=292.256 CHECKS=514017000 NODES=2801820	? (TO) TT=1800.03	SAT TT=1.09 ASSIGNMENTS=274 CHECKS=979847	SAT TT=1.079 ASSIGNMENTS=274 CHECKS=979847	SAT TT=3.371	SAT TT=3.183	SAT TT=1.098 ASSIGNMENTS=273 CHECKS=1022760	SAT TT=6.228 ASSIGNMENTS=4548 CHECKS=6666210	SAT TT=0.943	SAT TT=4.132 ASSIGNMENTS=2346 CHECKS=4091210	SAT TT=0.673 ASSIGNMENTS=168 CHECKS=603594	SAT TT=3.852	SAT TT=1.49	SAT TT=1.482
csp/pseudo/jnh/ normalized-jnh-210.xml	SAT TT=0.215	SAT TT=1.686 CHECKS=9707 NODES=540	SAT TT=1.659 CHECKS=11769 NODES=412	SAT TT=0.316	SAT TT=0.294 CHECKS=180968	SAT TT=0.296 CHECKS=218461	SAT TT=1.823 ASSIGNMENTS=66	SAT TT=1.951 ASSIGNMENTS=66	SAT TT=1.664 CHECKS=14071 NODES=204	SAT TT=3.083 CHECKS=2106610 NODES=11123	SAT TT=1.914 CHECKS=332638 NODES=707	SAT TT=0.299 ASSIGNMENTS=62 CHECKS=211328	SAT TT=0.287 ASSIGNMENTS=62 CHECKS=211328	SAT TT=3.168	SAT TT=3.225	SAT TT=0.348 ASSIGNMENTS=71 CHECKS=270578	SAT TT=5.497 ASSIGNMENTS=3393 CHECKS=6000920	SAT TT=0.982	SAT TT=0.266 ASSIGNMENTS=95 CHECKS=163168	SAT TT=0.215 ASSIGNMENTS=48 CHECKS=141060	SAT TT=3.952	SAT TT=1.733	SAT TT=1.802
csp/pseudo/jnh/ normalized-jnh-213.xml	SAT TT=0.19	SAT TT=1.623 CHECKS=8347 NODES=426	SAT TT=1.512 CHECKS=5890 NODES=0	SAT TT=0.386	SAT TT=0.319 CHECKS=200747	SAT TT=0.258 CHECKS=187587	SAT TT=1.672 ASSIGNMENTS=20	SAT TT=1.786 ASSIGNMENTS=20	SAT TT=1.624 CHECKS=32949 NODES=225	SAT TT=9.354 CHECKS=12345900 NODES=66492	SAT TT=2.349 CHECKS=1539550 NODES=2680	SAT TT=0.19 ASSIGNMENTS=54 CHECKS=127369	SAT TT=0.221 ASSIGNMENTS=54 CHECKS=127369	SAT TT=3.245	SAT TT=3.168	SAT TT=0.325 ASSIGNMENTS=81 CHECKS=274473	SAT TT=4.743 ASSIGNMENTS=3123 CHECKS=5254140	SAT TT=0.991	SAT TT=1.884 ASSIGNMENTS=952 CHECKS=1683370	SAT TT=0.201 ASSIGNMENTS=41 CHECKS=120061	SAT TT=4.116	SAT TT=1.606	SAT TT=1.596
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/jnh/ normalized-jnh-217.xml	SAT TT=0.232	SAT TT=1.865 CHECKS=15338 NODES=796	SAT TT=1.754 CHECKS=13338 NODES=619	SAT TT=0.351	SAT TT=0.271 CHECKS=134021	SAT TT=0.232 CHECKS=134257	SAT TT=1.845 ASSIGNMENTS=142	SAT TT=1.732 ASSIGNMENTS=142	SAT TT=1.86 CHECKS=77250 NODES=290	SAT TT=38.223 CHECKS=57262500 NODES=303588	SAT TT=5.978 CHECKS=10169500 NODES=13548	SAT TT=0.646 ASSIGNMENTS=168 CHECKS=598366	SAT TT=0.671 ASSIGNMENTS=168 CHECKS=598366	SAT TT=2.928	SAT TT=3.064	SAT TT=1.033 ASSIGNMENTS=282 CHECKS=1021120	SAT TT=3.953 ASSIGNMENTS=2805 CHECKS=4410500	SAT TT=0.97	SAT TT=14.692 ASSIGNMENTS=9882 CHECKS=14044200	SAT TT=0.537 ASSIGNMENTS=117 CHECKS=442509	SAT TT=4.812	SAT TT=1.42	SAT TT=1.795
csp/pseudo/jnh/ normalized-jnh-218.xml	SAT TT=0.176	SAT TT=1.678 CHECKS=11733 NODES=508	SAT TT=1.658 CHECKS=13636 NODES=443	SAT TT=0.331	SAT TT=0.222 CHECKS=110884	SAT TT=0.176 CHECKS=105033	SAT TT=1.588 ASSIGNMENTS=24	SAT TT=1.699 ASSIGNMENTS=24	SAT TT=1.616 CHECKS=31664 NODES=223	SAT TT=13.108 CHECKS=18478600 NODES=98000	? (TO) TT=1800.07	SAT TT=0.275 ASSIGNMENTS=59 CHECKS=181564	SAT TT=0.262 ASSIGNMENTS=59 CHECKS=181564	SAT TT=3.251	SAT TT=3.369	SAT TT=0.347 ASSIGNMENTS=82 CHECKS=263507	SAT TT=3.948 ASSIGNMENTS=2400 CHECKS=4121460	SAT TT=0.997	SAT TT=0.434 ASSIGNMENTS=286 CHECKS=323000	SAT TT=0.259 ASSIGNMENTS=62 CHECKS=199714	SAT TT=4.101	SAT TT=1.759	SAT TT=1.421
csp/pseudo/jnh/ normalized-jnh-220.xml	SAT TT=0.158	SAT TT=2.152 CHECKS=72228 NODES=2377	SAT TT=2.335 CHECKS=87729 NODES=2877	SAT TT=0.442	SAT TT=0.202 CHECKS=85141	SAT TT=0.158 CHECKS=81582	SAT TT=1.707 ASSIGNMENTS=88	SAT TT=1.708 ASSIGNMENTS=88	SAT TT=1.952 CHECKS=121631 NODES=299	SAT TT=573.648 CHECKS=915979000 NODES=4958410	SAT TT=3.826 CHECKS=4809690 NODES=7371	SAT TT=0.307 ASSIGNMENTS=62 CHECKS=223434	SAT TT=0.312 ASSIGNMENTS=62 CHECKS=223434	SAT TT=3.335	SAT TT=3.2	SAT TT=0.287 ASSIGNMENTS=62 CHECKS=192758	SAT TT=6.802 ASSIGNMENTS=4253 CHECKS=7139510	SAT TT=0.99	SAT TT=2.665 ASSIGNMENTS=1516 CHECKS=2273940	SAT TT=0.397 ASSIGNMENTS=80 CHECKS=335072	SAT TT=4.478	SAT TT=1.615	SAT TT=1.715
csp/pseudo/jnh/ normalized-jnh-301.xml	SAT TT=0.704	SAT TT=1.755 CHECKS=6351 NODES=538	SAT TT=1.816 CHECKS=7910 NODES=258	SAT TT=0.704	SAT TT=0.992 CHECKS=678516	SAT TT=1.252 CHECKS=914823	SAT TT=2.049 ASSIGNMENTS=767	SAT TT=2.018 ASSIGNMENTS=767	SAT TT=2.101 CHECKS=95691 NODES=291	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=9.92 ASSIGNMENTS=767	SAT TT=1.543 ASSIGNMENTS=288 CHECKS=1426390	SAT TT=3.688	SAT TT=3.818	SAT TT=2.124 ASSIGNMENTS=384 CHECKS=1832000	SAT TT=9.472 ASSIGNMENTS=4222 CHECKS=9186690	SAT TT=0.971	SAT TT=4.158 ASSIGNMENTS=1480 CHECKS=3396950	SAT TT=1.889 ASSIGNMENTS=323 CHECKS=1631930	SAT TT=4.889	SAT TT=1.559	SAT TT=1.771
csp/pseudo/ jnh/ normalized-jnh-7.xml	SAT TT=0.26	SAT TT=1.667 CHECKS=8218 NODES=339	SAT TT=1.797 CHECKS=11671 NODES=342	SAT TT=0.35	SAT TT=0.26 CHECKS=142573	SAT TT=0.268 CHECKS=187535	SAT TT=1.591 ASSIGNMENTS=51	SAT TT=1.649 ASSIGNMENTS=51	SAT TT=1.681 CHECKS=12455 NODES=201	SAT TT=1.914 CHECKS=677138 NODES=3322	? (TO) TT=1800.06	SAT TT=0.331 ASSIGNMENTS=67 CHECKS=259351	SAT TT=0.369 ASSIGNMENTS=67 CHECKS=259351	SAT TT=3.127	SAT TT=3.403	SAT TT=0.665 ASSIGNMENTS=145 CHECKS=558267	SAT TT=0.424 ASSIGNMENTS=183 CHECKS=345990	SAT TT=0.98	SAT TT=0.309 ASSIGNMENTS=108 CHECKS=184186	SAT TT=0.483 ASSIGNMENTS=104 CHECKS=434527	SAT TT=4.076	SAT TT=1.73	SAT TT=1.447
csp/pseudo/ logic-synthesis/ normalized-5xp1-b.xml	SAT TT=1.543	SAT TT=4.112 CHECKS=23761 NODES=464	SAT TT=4.031 CHECKS=24239 NODES=0	SAT TT=1.72	SAT TT=7.097 CHECKS=164318	SAT TT=10.966 CHECKS=238309	SAT TT=3.519 ASSIGNMENTS=170	SAT TT=3.664 ASSIGNMENTS=441	SAT TT=128.313 CHECKS=42962 NODES=465	SAT TT=156.54 CHECKS=91826 NODES=0	SAT TT=177.303 CHECKS=91835 NODES=0	SAT TT=1.584 ASSIGNMENTS=169 CHECKS=1216870	SAT TT=1.675 ASSIGNMENTS=169 CHECKS=1216870	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.543 ASSIGNMENTS=169 CHECKS=1216870	SAT TT=2.255 ASSIGNMENTS=442 CHECKS=1514740	SAT TT=2.929	SAT TT=2.094 ASSIGNMENTS=572 CHECKS=1749760	SAT TT=1.631 ASSIGNMENTS=169 CHECKS=1216870	? (TO) TT=1800.12	SAT TT=8.191	SAT TT=14.739
csp/pseudo/ logic-synthesis/ normalized-9sym-b.xml	SAT TT=0.996	SAT TT=3.118 CHECKS=18466 NODES=309	SAT TT=3.916 CHECKS=35697 NODES=309	SAT TT=1.246	SAT TT=2.585 CHECKS=108923	SAT TT=3.638 CHECKS=158449	SAT TT=2.65 ASSIGNMENTS=139	SAT TT=2.866 ASSIGNMENTS=189	SAT TT=88.778 CHECKS=38558 NODES=310	SAT TT=24.585 CHECKS=70388 NODES=0	SAT TT=26.695 CHECKS=75961 NODES=1	SAT TT=1.04 ASSIGNMENTS=141 CHECKS=711307	SAT TT=1.113 ASSIGNMENTS=141 CHECKS=711307	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=1.016 ASSIGNMENTS=141 CHECKS=711307	SAT TT=1.106 ASSIGNMENTS=224 CHECKS=795965	SAT TT=2.132	SAT TT=1.439 ASSIGNMENTS=365 CHECKS=1027400	SAT TT=0.996 ASSIGNMENTS=139 CHECKS=681698	? (TO) TT=1800.13	SAT TT=5.253	SAT TT=9.799
csp/pseudo/ logic-synthesis/ normalized-9symml.xml	SAT TT=0.213	SAT TT=2.304 CHECKS=8504 NODES=651	SAT TT=2.159 CHECKS=8668 NODES=0	SAT TT=0.54	SAT TT=0.376 CHECKS=51114	SAT TT=0.3 CHECKS=49311	SAT TT=2.753 ASSIGNMENTS=334	SAT TT=3.217 ASSIGNMENTS=559	SAT TT=108.996 CHECKS=12354 NODES=657	SAT TT=54.97 CHECKS=29511 NODES=40	SAT TT=64.251 CHECKS=61910 NODES=27	SAT TT=0.269 ASSIGNMENTS=340 CHECKS=46480	SAT TT=0.268 ASSIGNMENTS=340 CHECKS=46480	? (TO) TT=1800	? (TO) TT=1800.08	SAT TT=0.283 ASSIGNMENTS=344 CHECKS=46384	SAT TT=0.213 ASSIGNMENTS=252 CHECKS=40802	SAT TT=1.955	SAT TT=87.176 ASSIGNMENTS=106253 CHECKS=15387600	SAT TT=0.284 ASSIGNMENTS=342 CHECKS=47964	? (TO) TT=1800.14	SAT TT=2.166	SAT TT=2.185
csp/pseudo/ logic-synthesis/ normalized-alu4-b.xml	SAT TT=1.435	SAT TT=5.374 CHECKS=57694 NODES=807	SAT TT=5.715 CHECKS=52487 NODES=0	SAT TT=2.161	SAT TT=5.172 CHECKS=182985	SAT TT=6.772 CHECKS=274766	SAT TT=4.413 ASSIGNMENTS=443	SAT TT=4.305 ASSIGNMENTS=773	SAT TT=139.052 CHECKS=54510 NODES=810	SAT TT=314.744 CHECKS=113288 NODES=0	SAT TT=336.322 CHECKS=113280 NODES=0	SAT TT=1.435 ASSIGNMENTS=442 CHECKS=938023	SAT TT=1.68 ASSIGNMENTS=442 CHECKS=938023	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=1.475 ASSIGNMENTS=442 CHECKS=938023	SAT TT=1.72 ASSIGNMENTS=745 CHECKS=1097510	SAT TT=7.32	SAT TT=2.113 ASSIGNMENTS=1104 CHECKS=1722680	SAT TT=1.764 ASSIGNMENTS=442 CHECKS=937460	? (TO) TT=1800.08	SAT TT=8.79	SAT TT=14.5
csp/pseudo/ logic-synthesis/ normalized-apex4-a.xml	SAT TT=2.072	SAT TT=9.502 CHECKS=50601 NODES=4316	SAT TT=12.755 CHECKS=65043 NODES=4316	SAT TT=4.343	SAT TT=32.517 CHECKS=265348	SAT TT=83.933 CHECKS=931077	SAT TT=16.285 ASSIGNMENTS=2403	SAT TT=101.263 ASSIGNMENTS=3981	SAT TT=171.956 CHECKS=74442 NODES=4323	SAT TT=448.745 CHECKS=203580 NODES=14	SAT TT=574.466 CHECKS=310988 NODES=11	SAT TT=2.072 ASSIGNMENTS=2377 CHECKS=795047	SAT TT=2.17 ASSIGNMENTS=2377 CHECKS=795047	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=2.245 ASSIGNMENTS=2377 CHECKS=795047	SAT TT=2.205 ASSIGNMENTS=3212 CHECKS=806602	SAT TT=93.027	SAT TT=2.888 ASSIGNMENTS=6051 CHECKS=1461360	SAT TT=2.251 ASSIGNMENTS=2384 CHECKS=795454	? (TO) TT=1800.11	SAT TT=9.87	SAT TT=11.987
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ logic-synthesis/ normalized-bench1-pi.xml	SAT TT=0.37	SAT TT=6.556 CHECKS=16806 NODES=4676	SAT TT=6.343 CHECKS=15108 NODES=0	SAT TT=0.97	SAT TT=7.542 CHECKS=88905	SAT TT=7.273 CHECKS=58533	SAT TT=6.211 ASSIGNMENTS=4318	SAT TT=5.332 ASSIGNMENTS=4318	SAT TT=135.18 CHECKS=15774 NODES=4676	SAT TT=770.873 CHECKS=29554 NODES=1	SAT TT=961.015 CHECKS=29499 NODES=0	SAT TT=13.67 ASSIGNMENTS=4318	SAT TT=11.248 ASSIGNMENTS=4676 CHECKS=15686	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=5.717 ASSIGNMENTS=4286 CHECKS=292844	SAT TT=0.37 ASSIGNMENTS=1160 CHECKS=168646	SAT TT=1.95	SAT TT=13.686 ASSIGNMENTS=6658 CHECKS=482534	SAT TT=4.993 ASSIGNMENTS=4428 CHECKS=292751	? (TO) TT=1800.15	SAT TT=3.998	SAT TT=5.074
csp/pseudo/ logic-synthesis/ normalized-clip-b.xml	SAT TT=0.713	SAT TT=2.607 CHECKS=15723 NODES=349	SAT TT=2.737 CHECKS=13381 NODES=0	SAT TT=0.821	SAT TT=2.012 CHECKS=57986	SAT TT=2.419 CHECKS=77633	SAT TT=2.146 ASSIGNMENTS=217	SAT TT=2.18 ASSIGNMENTS=306	SAT TT=123.663 CHECKS=21489 NODES=350	SAT TT=76.775 CHECKS=45530 NODES=1	SAT TT=75.021 CHECKS=46777 NODES=1	SAT TT=0.872 ASSIGNMENTS=218 CHECKS=547935	SAT TT=0.866 ASSIGNMENTS=218 CHECKS=547935	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=0.845 ASSIGNMENTS=218 CHECKS=547935	SAT TT=0.763 ASSIGNMENTS=313 CHECKS=562889	SAT TT=2.006	SAT TT=0.713 ASSIGNMENTS=313 CHECKS=561647	SAT TT=0.737 ASSIGNMENTS=220 CHECKS=546847	? (TO) TT=1800.08	SAT TT=3.816	SAT TT=7.138
csp/pseudo/ logic-synthesis/ normalized-count-b.xml	SAT TT=0.74	SAT TT=3.201 CHECKS=16860 NODES=467	SAT TT=3.189 CHECKS=21823 NODES=0	SAT TT=1.04	SAT TT=2.134 CHECKS=94584	SAT TT=2.742 CHECKS=124431	SAT TT=2.162 ASSIGNMENTS=319	SAT TT=2.509 ASSIGNMENTS=446	SAT TT=128.307 CHECKS=21992 NODES=468	SAT TT=563.925 CHECKS=53996 NODES=0	SAT TT=568.243 CHECKS=57734 NODES=1	SAT TT=0.779 ASSIGNMENTS=313 CHECKS=518929	SAT TT=0.79 ASSIGNMENTS=313 CHECKS=518929	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=0.74 ASSIGNMENTS=313 CHECKS=518929	SAT TT=0.772 ASSIGNMENTS=415 CHECKS=530954	SAT TT=1.782	SAT TT=1.089 ASSIGNMENTS=652 CHECKS=854530	SAT TT=0.787 ASSIGNMENTS=318 CHECKS=564488	? (TO) TT=1800.1	SAT TT=4.492	SAT TT=7.726
csp/pseudo/ logic-synthesis/ normalized-e-am-pi.xml	SAT TT=1.977	SAT TT=7.427 CHECKS=18602 NODES=4676	SAT TT=6.254 CHECKS=18619 NODES=0	SAT TT=1.977	SAT TT=11.633 CHECKS=71293	SAT TT=10.275 CHECKS=71842	SAT TT=8.192 ASSIGNMENTS=4410	SAT TT=8.536 ASSIGNMENTS=4410	SAT TT=151.768 CHECKS=51022 NODES=4676	SAT TT=348.4 CHECKS=128986 NODES=0	SAT TT=295.467 CHECKS=128986 NODES=0	SAT TT=11.526 ASSIGNMENTS=4420 CHECKS=1789690	SAT TT=14.375 ASSIGNMENTS=4676 CHECKS=18409	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=2.402 ASSIGNMENTS=4414 CHECKS=1789700	SAT TT=2.635 ASSIGNMENTS=4554 CHECKS=1790230	SAT TT=3.493	SAT TT=2.171 ASSIGNMENTS=4520 CHECKS=1790110	SAT TT=2.749 ASSIGNMENTS=4420 CHECKS=1789690	? (TO) TT=1800.15	SAT TT=8.314	SAT TT=18.229
csp/pseudo/ logic-synthesis/ normalized-ex5-pi.xml	SAT TT=2.653	SAT TT=7.273 CHECKS=34697 NODES=2459	SAT TT=6.598 CHECKS=26787 NODES=0	SAT TT=2.653	SAT TT=10.591 CHECKS=87846	SAT TT=10.263 CHECKS=86998	SAT TT=5.459 ASSIGNMENTS=2299	SAT TT=5.405 ASSIGNMENTS=2299	SAT TT=148.627 CHECKS=92258 NODES=2459	SAT TT=1008.2 CHECKS=121457 NODES=0	SAT TT=918.267 CHECKS=124842 NODES=1	SAT TT=13.828 ASSIGNMENTS=2306 CHECKS=2594730	SAT TT=15.092 ASSIGNMENTS=2459 CHECKS=34670	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=3.959 ASSIGNMENTS=2302 CHECKS=2594070	SAT TT=3.271 ASSIGNMENTS=2349 CHECKS=2594800	SAT TT=19.119	SAT TT=3.321 ASSIGNMENTS=2364 CHECKS=2591550	SAT TT=3.537 ASSIGNMENTS=2306 CHECKS=2594730	? (TO) TT=1800.13	SAT TT=11.341	SAT TT=26.354
csp/pseudo/ logic-synthesis/ normalized-f51m-b.xml	SAT TT=0.696	SAT TT=2.763 CHECKS=13302 NODES=406	SAT TT=2.842 CHECKS=16722 NODES=0	SAT TT=0.82	SAT TT=1.3 CHECKS=36109	SAT TT=1.499 CHECKS=43272	SAT TT=2.006 ASSIGNMENTS=158	SAT TT=2.437 ASSIGNMENTS=385	SAT TT=128.771 CHECKS=21160 NODES=407	SAT TT=75.179 CHECKS=41348 NODES=0	SAT TT=80.098 CHECKS=41346 NODES=0	SAT TT=0.718 ASSIGNMENTS=155 CHECKS=478880	SAT TT=0.714 ASSIGNMENTS=155 CHECKS=478880	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=0.7 ASSIGNMENTS=155 CHECKS=478880	SAT TT=0.758 ASSIGNMENTS=381 CHECKS=568577	SAT TT=2.14	SAT TT=0.7 ASSIGNMENTS=365 CHECKS=562472	SAT TT=0.696 ASSIGNMENTS=155 CHECKS=479221	? (TO) TT=1800.14	SAT TT=4.245	SAT TT=7.201
csp/pseudo/ logic-synthesis/ normalized-max1024-pi.xml	SAT TT=0.295	SAT TT=3.073 CHECKS=9830 NODES=1278	SAT TT=2.079 CHECKS=4324 NODES=0	SAT TT=0.541	SAT TT=0.387 CHECKS=22526	SAT TT=0.333 CHECKS=17711	SAT TT=2.053 ASSIGNMENTS=912	SAT TT=2.222 ASSIGNMENTS=912	SAT TT=9.631 CHECKS=15156 NODES=1278	SAT TT=5.841 CHECKS=24662 NODES=5	SAT TT=6.181 CHECKS=25119 NODES=1	SAT TT=0.528 ASSIGNMENTS=922 CHECKS=61434	SAT TT=0.505 ASSIGNMENTS=922 CHECKS=61434	SAT TT=6.053	SAT TT=7.062	SAT TT=0.419 ASSIGNMENTS=922 CHECKS=61434	SAT TT=0.295 ASSIGNMENTS=1213 CHECKS=152504	SAT TT=1.553	SAT TT=26.63 ASSIGNMENTS=23180 CHECKS=2911850	SAT TT=0.537 ASSIGNMENTS=918 CHECKS=61401	SAT TT=34.977	SAT TT=2.889	SAT TT=2.646
csp/pseudo/ logic-synthesis/ normalized-prom2-pi.xml	SAT TT=0.485	SAT TT=3.756 CHECKS=34835 NODES=2617	SAT TT=3.643 CHECKS=12253 NODES=0	SAT TT=1.11	SAT TT=2.3 CHECKS=37165	SAT TT=2.13 CHECKS=37018	SAT TT=4.059 ASSIGNMENTS=1978	SAT TT=8.107 ASSIGNMENTS=2207	SAT TT=132.285 CHECKS=35952 NODES=2617	SAT TT=142.015 CHECKS=52404 NODES=11	SAT TT=124.545 CHECKS=68090 NODES=11	SAT TT=0.545 ASSIGNMENTS=1990 CHECKS=166534	SAT TT=0.51 ASSIGNMENTS=1990 CHECKS=166534	SAT TT=1222.31	SAT TT=1269.83	SAT TT=0.566 ASSIGNMENTS=1990 CHECKS=166534	SAT TT=0.527 ASSIGNMENTS=2158 CHECKS=166853	SAT TT=2.507	SAT TT=0.485 ASSIGNMENTS=2148 CHECKS=166856	SAT TT=0.499 ASSIGNMENTS=1986 CHECKS=166402	? (TO) TT=1800.07	SAT TT=4.753	SAT TT=5.8
csp/pseudo/ logic-synthesis/ normalized-rot-b.xml	SAT TT=1.555	SAT TT=6.263 CHECKS=58091 NODES=1451	SAT TT=7.501 CHECKS=80442 NODES=1451	SAT TT=2.387	SAT TT=8.973 CHECKS=291760	SAT TT=10.412 CHECKS=293068	SAT TT=5.204 ASSIGNMENTS=970	SAT TT=6.601 ASSIGNMENTS=1321	SAT TT=130.813 CHECKS=57157 NODES=1454	SAT TT=451.87 CHECKS=129137 NODES=2	SAT TT=455.203 CHECKS=136745 NODES=3	SAT TT=1.633 ASSIGNMENTS=978 CHECKS=910309	SAT TT=1.6 ASSIGNMENTS=978 CHECKS=910309	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=1.633 ASSIGNMENTS=978 CHECKS=910309	SAT TT=1.555 ASSIGNMENTS=1289 CHECKS=925883	SAT TT=8.929	SAT TT=2.898 ASSIGNMENTS=3808 CHECKS=2613260	SAT TT=1.655 ASSIGNMENTS=970 CHECKS=910296	? (TO) TT=1800.11	SAT TT=9.25	SAT TT=15.271
csp/pseudo/ logic-synthesis/ normalized-sao2-b.xml	SAT TT=0.465	SAT TT=2.787 CHECKS=26899 NODES=372	SAT TT=2.933 CHECKS=37190 NODES=372	SAT TT=0.795	SAT TT=0.644 CHECKS=28378	SAT TT=0.743 CHECKS=37262	SAT TT=2.448 ASSIGNMENTS=163	SAT TT=2.13 ASSIGNMENTS=358	SAT TT=128.827 CHECKS=19381 NODES=373	SAT TT=182.168 CHECKS=40254 NODES=0	SAT TT=177.589 CHECKS=40279 NODES=0	SAT TT=0.527 ASSIGNMENTS=162 CHECKS=275577	SAT TT=0.474 ASSIGNMENTS=162 CHECKS=275577	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=0.465 ASSIGNMENTS=162 CHECKS=275577	SAT TT=0.644 ASSIGNMENTS=338 CHECKS=365000	SAT TT=1.807	SAT TT=0.673 ASSIGNMENTS=449 CHECKS=475534	SAT TT=0.509 ASSIGNMENTS=163 CHECKS=276049	? (TO) TT=1800.08	SAT TT=4.289	SAT TT=5.75
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/mps/ normalized-mps-10teams.xml	SAT TT=6.266	? (TO) TT=1800.07	? (TO) TT=1800.15	SAT TT=7.481	SAT TT=1224.27 CHECKS=7024600	? (TO) TT=1800.03	SAT TT=13.293 ASSIGNMENTS=413	SAT TT=13.206 ASSIGNMENTS=403	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=19.813 ASSIGNMENTS=413	SAT TT=1605.46 ASSIGNMENTS=413	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=563.688 ASSIGNMENTS=91810 CHECKS=485503000	? (TO) TT=1800.08	SAT TT=57.405	SAT TT=866.813 ASSIGNMENTS=105160 CHECKS=700807000	SAT TT=528.981 ASSIGNMENTS=69460 CHECKS=398790000	? (TO) TT=1800.13	SAT TT=8.774	SAT TT=6.266
csp/pseudo/mps/ normalized-mps-air01.xml	SAT TT=0.975	SAT TT=4.413 CHECKS=48393 NODES=784	SAT TT=5.047 CHECKS=114850 NODES=1417	SAT TT=0.975	SAT TT=39.604 CHECKS=36496	SAT TT=5.566 CHECKS=4864	SAT TT=5.223 ASSIGNMENTS=374	SAT TT=5.683 ASSIGNMENTS=219	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=9.833 ASSIGNMENTS=724 CHECKS=1286420	SAT TT=12.337 ASSIGNMENTS=784 CHECKS=48393	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=3.234 ASSIGNMENTS=866 CHECKS=4026810	SAT TT=6.25 ASSIGNMENTS=3702 CHECKS=8587800	SAT TT=3.509	SAT TT=4.056 ASSIGNMENTS=1828 CHECKS=6244830	SAT TT=1.711 ASSIGNMENTS=724 CHECKS=1286420	? TT=1680.71	SAT TT=4.926	SAT TT=10.945
csp/pseudo/mps/ normalized-mps-air02.xml	SAT TT=33.176	? TT=78.573	? TT=70.217	SAT TT=33.176	Signal TT=13.116	Signal TT=14.099	? (problem) TT=53.27	? (problem) TT=50.585	? TT=0.652	? TT=0.694	? TT=0.695	? (MO) TT=227.4	? (MO) TT=242.07	? (problem) TT=38.889	? (problem) TT=41.385	Signal TT=109.874	Signal TT=115.808	? (exit code) TT=202.793	SAT TT=174.206 ASSIGNMENTS=2960 CHECKS=143411000	Signal TT=107.316	? (TO) TT=1800.24	? (MO) TT=133.147	? (MO) TT=344.443
csp/pseudo/mps/ normalized-mps-air03.xml	SAT TT=51.237	? TT=102.88	? TT=110.348	SAT TT=51.237	Signal TT=13.606	Signal TT=14.332	? (problem) TT=60.625	? (problem) TT=65.132	? TT=1.259	? TT=1.178	? TT=1.504	? (MO) TT=324.09	? (MO) TT=317.37	? (problem) TT=56.809	? (problem) TT=60.952	Signal TT=133.986	Signal TT=180.765	? (exit code) TT=285.484	SAT TT=211.219 ASSIGNMENTS=2978 CHECKS=161318000	Signal TT=142.895	? (TO) TT=1800.09	? (MO) TT=204.502	? (MO) TT=386.423
csp/pseudo/mps/ normalized-mps-air05.xml	SAT TT=46.035	? (TO) TT=1800.2	? (TO) TT=1800.19	SAT TT=902.087	SAT TT=393.723 CHECKS=314931	SAT TT=169.741 CHECKS=133562	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.04	? TT=190.769 CHECKS=51193 NODES=0	? TT=195.738 CHECKS=51185 NODES=0	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.12	? TT=300.482	SAT TT=46.035	SAT TT=102.116
csp/pseudo/mps/ normalized-mps-air06.xml	SAT TT=912.34	? (TO) TT=1800.21	? (TO) TT=1800.09	SAT TT=912.34	? (TO) TT=1800.19	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=233.923 CHECKS=2166780 NODES=0	? TT=225.272 CHECKS=2166740 NODES=0	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.16	? TT=515.17	? (TO) TT=1800.12	? (TO) TT=1800.06
csp/pseudo/mps/ normalized-mps-bm23.xml	SAT TT=0.053	SAT TT=18.278 CHECKS=7659260 NODES=181	SAT TT=41.982 CHECKS=18496700 NODES=202	SAT TT=0.069	SAT TT=0.128 CHECKS=1524	SAT TT=0.13 CHECKS=1512	SAT TT=0.656 ASSIGNMENTS=29	SAT TT=0.87 ASSIGNMENTS=188	SAT TT=131.906 CHECKS=790925 NODES=93	SAT TT=139.59 CHECKS=120578 NODES=600025	SAT TT=129.564 CHECKS=117528 NODES=7	SAT TT=0.082 ASSIGNMENTS=61 CHECKS=85446	SAT TT=0.08 ASSIGNMENTS=61 CHECKS=85446	? (problem) TT=38.057	? (problem) TT=37.496	SAT TT=0.064 ASSIGNMENTS=50 CHECKS=72707	SAT TT=0.288 ASSIGNMENTS=436 CHECKS=465635	SAT TT=0.501	SAT TT=48.097 ASSIGNMENTS=38426 CHECKS=25142200	SAT TT=0.053 ASSIGNMENTS=29 CHECKS=46196	? TT=480.457	SAT TT=1.602	SAT TT=2.527
csp/pseudo/mps/ normalized-mps-l152lav.xml		? (TO) TT=1800.13	? (TO) TT=1800.19	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.07	? TT=0.413	? TT=0.423	? TT=0.428	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.07	? (exit code) TT=11.019	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=312.093	? (TO) TT=1800.18	? (TO) TT=1800.09
csp/pseudo/mps/ normalized-mps-mitre.xml	SAT TT=1598.68	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=1598.68	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1205.44	? (TO) TT=1800.12	? (TO) TT=1800.04	? TT=235.746	? TT=174.062	? TT=169.608
csp/pseudo/mps/ normalized-mps-mzzv11.xml	SAT TT=7.263	? (TO) TT=1800.24	SAT TT=323.987 CHECKS=108458000 NODES=0	SAT TT=14.596	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=43.82 ASSIGNMENTS=2919	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=19.478 ASSIGNMENTS=3611 CHECKS=1266060	SAT TT=1104.74 ASSIGNMENTS=3611 CHECKS=1266060	? (problem) TT=209.161	? (problem) TT=197.863	SAT TT=7.431 ASSIGNMENTS=3600 CHECKS=1266010	SAT TT=7.975 ASSIGNMENTS=4513 CHECKS=1915370	SAT TT=31.594	SAT TT=66.896 ASSIGNMENTS=25378 CHECKS=25954300	SAT TT=7.263 ASSIGNMENTS=3611 CHECKS=1266060	? TT=219.312	? (MO) TT=80.546	? (MO) TT=269.523
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/mps/ normalized-mps-neos5.xml	SAT TT=0.426	SAT TT=2.459 CHECKS=124363 NODES=163	SAT TT=14.042 CHECKS=2252970 NODES=0	SAT TT=0.426	SAT TT=8.603 CHECKS=12823	SAT TT=8.846 CHECKS=12282	SAT TT=1.442 ASSIGNMENTS=145	SAT TT=1.505 ASSIGNMENTS=145	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.626 ASSIGNMENTS=145 CHECKS=627292	SAT TT=0.627 ASSIGNMENTS=145 CHECKS=627292	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=0.614 ASSIGNMENTS=145 CHECKS=627292	SAT TT=2.422 ASSIGNMENTS=764 CHECKS=3287350	SAT TT=1.452	? (TO) TT=1800.09	SAT TT=0.614 ASSIGNMENTS=144 CHECKS=623010	? (TO) TT=1800.15	? TT=220.732	? TT=218.814
csp/pseudo/mps/ normalized-mps-opt1217.xml	SAT TT=0.137	SAT TT=1.796 CHECKS=3116 NODES=787	SAT TT=1.422 CHECKS=3316 NODES=0	SAT TT=0.277	SAT TT=3.116 CHECKS=12385	SAT TT=4.013 CHECKS=15086	SAT TT=1.574 ASSIGNMENTS=738	SAT TT=1.922 ASSIGNMENTS=721	SAT TT=780.999 CHECKS=806636000 NODES=787	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=0.187 ASSIGNMENTS=738 CHECKS=85373	SAT TT=0.163 ASSIGNMENTS=738 CHECKS=85373	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=0.178 ASSIGNMENTS=738 CHECKS=85373	SAT TT=0.137 ASSIGNMENTS=133 CHECKS=83899	SAT TT=1.224	SAT TT=0.17 ASSIGNMENTS=504 CHECKS=82796	SAT TT=0.178 ASSIGNMENTS=738 CHECKS=85373	? (TO) TT=1800.23	? TT=200.637	? TT=191.939
csp/pseudo/mps/ normalized-mps-p0282.xml	SAT TT=0.07	SAT TT=54.075 CHECKS=22091000 NODES=284	SAT TT=147.706 CHECKS=42640500 NODES=0	SAT TT=0.169	SAT TT=0.613 CHECKS=11903	SAT TT=0.611 CHECKS=12400	SAT TT=1.296 ASSIGNMENTS=221	SAT TT=1.171 ASSIGNMENTS=266	SAT TT=124.648 CHECKS=3573950 NODES=282	SAT TT=250.547 CHECKS=2506190 NODES=13	SAT TT=261.429 CHECKS=3403180 NODES=49	SAT TT=0.082 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.084 ASSIGNMENTS=237 CHECKS=46009	? (problem) TT=79.221	? (problem) TT=72.285	SAT TT=0.074 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.073 ASSIGNMENTS=133 CHECKS=39479	SAT TT=0.837	SAT TT=0.07 ASSIGNMENTS=212 CHECKS=35108	SAT TT=0.071 ASSIGNMENTS=228 CHECKS=45887	? (TO) TT=1801.37	SAT TT=36.761	SAT TT=159.111
csp/pseudo/mps/ normalized-mps-p0291.xml	SAT TT=0.036	SAT TT=14.597 CHECKS=3270560 NODES=291	SAT TT=52.658 CHECKS=12747000 NODES=0	SAT TT=0.106	SAT TT=0.728 CHECKS=18263	SAT TT=0.659 CHECKS=16522	SAT TT=1.038 ASSIGNMENTS=274	SAT TT=1.245 ASSIGNMENTS=115	? (TO) TT=1800	SAT TT=40.551 CHECKS=5933 NODES=11	SAT TT=40.363 CHECKS=9690 NODES=15	SAT TT=0.053 ASSIGNMENTS=274 CHECKS=19556	SAT TT=0.051 ASSIGNMENTS=274 CHECKS=19556	? (MO) TT=1476.11	? (MO) TT=1465.58	SAT TT=0.04 ASSIGNMENTS=274 CHECKS=19556	SAT TT=0.036 ASSIGNMENTS=122 CHECKS=13175	SAT TT=0.829	SAT TT=0.038 ASSIGNMENTS=192 CHECKS=9930	SAT TT=0.041 ASSIGNMENTS=278 CHECKS=19833	? (TO) TT=1800.16	SAT TT=11.746	SAT TT=47.864
csp/pseudo/mps/ normalized-mps-p0548.xml	SAT TT=0.097	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=3.476 CHECKS=16160	SAT TT=3.503 CHECKS=17109	SAT TT=1.311 ASSIGNMENTS=389	SAT TT=2.316 ASSIGNMENTS=2810	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=0.109 ASSIGNMENTS=382 CHECKS=54026	SAT TT=0.11 ASSIGNMENTS=382 CHECKS=54026	? (MO) TT=27.01	? (MO) TT=24.38	SAT TT=0.097 ASSIGNMENTS=384 CHECKS=53525	? (TO) TT=1800.09	SAT TT=1.277	? (TO) TT=1800.04	SAT TT=0.255 ASSIGNMENTS=971 CHECKS=371348	? TT=410.431	? TT=165.183	? TT=172.715
csp/pseudo/mps/ normalized-mps-seymour.xml	SAT TT=0.9	SAT TT=10.219 CHECKS=27824 NODES=1372	SAT TT=5.339 CHECKS=15815 NODES=0	SAT TT=2.125	SAT TT=2.033 CHECKS=181757	SAT TT=1.856 CHECKS=184204	SAT TT=4.816 ASSIGNMENTS=792	SAT TT=5.198 ASSIGNMENTS=792	SAT TT=14.75 CHECKS=86280 NODES=1372	SAT TT=7.577 CHECKS=116673 NODES=3	SAT TT=7.364 CHECKS=132767 NODES=4	SAT TT=0.946 ASSIGNMENTS=801 CHECKS=293943	SAT TT=0.934 ASSIGNMENTS=801 CHECKS=293943	SAT TT=16.69	SAT TT=21.279	SAT TT=0.928 ASSIGNMENTS=801 CHECKS=293943	SAT TT=0.915 ASSIGNMENTS=893 CHECKS=294998	SAT TT=16.128	SAT TT=0.9 ASSIGNMENTS=876 CHECKS=295079	SAT TT=0.922 ASSIGNMENTS=803 CHECKS=293957	SAT TT=56.852	SAT TT=7.394	SAT TT=8.315
csp/pseudo/mps/ normalized-mps-stein27.xml	SAT TT=0.012	SAT TT=0.942 CHECKS=1864 NODES=27	SAT TT=0.883 CHECKS=3714 NODES=0	SAT TT=0.05	SAT TT=0.039 CHECKS=7897	SAT TT=0.026 CHECKS=7133	SAT TT=0.701 ASSIGNMENTS=9	SAT TT=0.666 ASSIGNMENTS=9	SAT TT=74.718 CHECKS=277484 NODES=27	SAT TT=14.306 CHECKS=165499 NODES=0	SAT TT=14.338 CHECKS=165467 NODES=0	SAT TT=0.024 ASSIGNMENTS=8 CHECKS=1620	SAT TT=0.025 ASSIGNMENTS=8 CHECKS=1620	? (MO) TT=38.08	? (MO) TT=38.27	SAT TT=0.012 ASSIGNMENTS=8 CHECKS=1620	SAT TT=0.013 ASSIGNMENTS=6 CHECKS=1590	SAT TT=0.421	SAT TT=0.015 ASSIGNMENTS=8 CHECKS=1631	SAT TT=0.013 ASSIGNMENTS=9 CHECKS=1593	? TT=1091.71	SAT TT=0.649	SAT TT=0.687
csp/pseudo/mps/ normalized-mps-stein9.xml	SAT TT=0.006	SAT TT=0.708 CHECKS=61 NODES=9	SAT TT=0.67 CHECKS=68 NODES=0	SAT TT=0.026	SAT TT=0.007 CHECKS=342	SAT TT=0.012 CHECKS=946	SAT TT=0.498 ASSIGNMENTS=5	SAT TT=0.476 ASSIGNMENTS=5	SAT TT=0.475 CHECKS=186 NODES=9	SAT TT=0.435 CHECKS=277 NODES=0	SAT TT=0.46 CHECKS=275 NODES=0	SAT TT=0.019 ASSIGNMENTS=4 CHECKS=186	SAT TT=0.018 ASSIGNMENTS=4 CHECKS=186	SAT TT=0.958	SAT TT=1.242	SAT TT=0.006 ASSIGNMENTS=4 CHECKS=186	SAT TT=0.007 ASSIGNMENTS=4 CHECKS=183	SAT TT=0.276	SAT TT=0.007 ASSIGNMENTS=4 CHECKS=186	SAT TT=0.007 ASSIGNMENTS=4 CHECKS=186	SAT TT=0.988	SAT TT=0.485	SAT TT=0.51
csp/pseudo/mps/ normalized-mps-vpm2.xml		? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.12	? (MO) TT=1428.96	? (MO) TT=1422.49	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=1732.42	? TT=149.051	? TT=143.138
csp/pseudo/mpsReduced/ normalized-mps-red-afiro.xml	SAT TT=2.419	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=1679.15	SAT TT=1059.91 CHECKS=1127600	SAT TT=72.893 CHECKS=88785	SAT TT=3.26 ASSIGNMENTS=4152	SAT TT=2.419 ASSIGNMENTS=1185	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=12.857 ASSIGNMENTS=7661 CHECKS=11010100	SAT TT=1254.63 ASSIGNMENTS=7661 CHECKS=11010100	? (MO) TT=232.41	? (MO) TT=229.28	SAT TT=2.592 ASSIGNMENTS=9210 CHECKS=4777940	SAT TT=5.396 ASSIGNMENTS=14673 CHECKS=11742200	SAT TT=20.733	? (TO) TT=1800.03	SAT TT=5.35 ASSIGNMENTS=7661 CHECKS=11010100	? (TO) TT=1802.2	SAT TT=42.305	SAT TT=198.856
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/mpsReduced/ normalized-mps-red-agg3.xml	SAT TT=18.197	? (TO) TT=1800.17	? (TO) TT=1800.18	SAT TT=18.197	? (TO) TT=1800.13	? (TO) TT=1800.21	SAT TT=62.033 ASSIGNMENTS=7209	? (TO) TT=1800.14	? TT=0.907	? TT=1.058	? TT=0.898	SAT TT=793.552 ASSIGNMENTS=7209	SAT TT=1729.36 ASSIGNMENTS=7209	? (MO) TT=154.97	? (MO) TT=155.59	? (TO) TT=1800.12	? (TO) TT=1800.09	SAT TT=44.401	? (TO) TT=1800.12	? (TO) TT=1800.14	? TT=234.481	? TT=153.627	? TT=147.522
csp/pseudo/mpsReduced/ normalized-mps-red-agg.xml	SAT TT=1479.2	? (TO) TT=1800.06	? (TO) TT=1800.19	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=141.404 ASSIGNMENTS=102049	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800	SAT TT=1479.2 ASSIGNMENTS=102049	? (MO) TT=117.55	? (MO) TT=117.94	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.13	? TT=237.629	? TT=158.975	? TT=161.948
csp/pseudo/mpsReduced/ normalized-mps-red-air01.xml	SAT TT=0.972	SAT TT=4.383 CHECKS=48393 NODES=784	SAT TT=5.03 CHECKS=114850 NODES=1417	SAT TT=0.972	SAT TT=42.169 CHECKS=37578	SAT TT=6.311 CHECKS=5059	SAT TT=5.245 ASSIGNMENTS=374	SAT TT=5.477 ASSIGNMENTS=219	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=10.278 ASSIGNMENTS=724 CHECKS=1286420	SAT TT=12.309 ASSIGNMENTS=784 CHECKS=48393	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=3.187 ASSIGNMENTS=866 CHECKS=4026810	SAT TT=13.581 ASSIGNMENTS=7867 CHECKS=21503600	SAT TT=3.296	SAT TT=3.676 ASSIGNMENTS=1828 CHECKS=6244830	SAT TT=1.692 ASSIGNMENTS=724 CHECKS=1286420	? TT=1578.44	SAT TT=4.555	SAT TT=10.938
csp/pseudo/mpsReduced/ normalized-mps-red-air03.xml	SAT TT=48.271	? TT=110.398	? TT=110.616	SAT TT=48.271	Signal TT=12.54	Signal TT=13.569	? (problem) TT=65.158	? (problem) TT=60.638	? TT=1.206	? TT=1.143	? TT=1.402	? (MO) TT=302.74	? (MO) TT=307.37	? (problem) TT=56.993	? (problem) TT=62.244	Signal TT=138.532	Signal TT=285.352	? (exit code) TT=295.178	SAT TT=203.283 ASSIGNMENTS=2978 CHECKS=161318000	Signal TT=138.98	? (TO) TT=1800.1	? (MO) TT=194.775	? (MO) TT=408.775
csp/pseudo/mpsReduced/ normalized-mps-red-bandm.xml	UNSAT TT=21.105	? (TO) TT=1800.21	? (TO) TT=1800.22	UNSAT TT=21.105	Signal TT=14.018	Signal TT=14.019	UNSAT TT=114.31 ASSIGNMENTS=0	UNSAT TT=101.17 ASSIGNMENTS=0	? TT=0.87	? TT=0.949	? TT=0.717	UNSAT TT=108.4 ASSIGNMENTS=49 CHECKS=25473600	UNSAT TT=1468.6 ASSIGNMENTS=49 CHECKS=25473600	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=50.685 ASSIGNMENTS=24 CHECKS=24615600	UNSAT TT=632.021 ASSIGNMENTS=226086 CHECKS=725820000	? (exit code) TT=104.874	UNSAT TT=68.545 ASSIGNMENTS=3132 CHECKS=46213100	UNSAT TT=51.693 ASSIGNMENTS=49 CHECKS=25473600	? (TO) TT=1800.08	? TT=449.466	? TT=430.444
csp/pseudo/mpsReduced/ normalized-mps-red-beaconfd.xml	SAT TT=73.052	? TT=2.874	? TT=3.163	SAT TT=73.052	Signal TT=14.504	Signal TT=14.235	? (problem) TT=2.291	? (problem) TT=2.555	? TT=0.672	? TT=0.52	? TT=0.67	? (MO) TT=802.83	? (MO) TT=794.9	? (problem) TT=2.045	? (problem) TT=2.05	Signal TT=272.803	? (MO) TT=819.844	? (exit code) TT=540.097	Signal TT=593.244	Signal TT=652.733	? TT=199.974	? TT=248.779	? TT=301.993
csp/pseudo/mpsReduced/ normalized-mps-red-bell3a.xml	SAT TT=0.485	? (TO) TT=1800.19	? (TO) TT=1800.27	? (TO) TT=1800.02	SAT TT=31.81 CHECKS=131276	SAT TT=22.222 CHECKS=77469	SAT TT=3.443 ASSIGNMENTS=3372	SAT TT=10.285 ASSIGNMENTS=6678	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=8.153 ASSIGNMENTS=1169 CHECKS=289654	SAT TT=1250.44 ASSIGNMENTS=1169 CHECKS=289654	? (MO) TT=537.99	? (MO) TT=494.37	? (TO) TT=1800.11	SAT TT=1.029 ASSIGNMENTS=4512 CHECKS=1626570	? (TO) TT=1800.06	SAT TT=302.715 ASSIGNMENTS=833196 CHECKS=289974000	SAT TT=0.485 ASSIGNMENTS=1169 CHECKS=289654	? (TO) TT=1800.13	? TT=221.264	? TT=239.706
csp/pseudo/mpsReduced/ normalized-mps-red-berlin-5-8_0.xml	SAT TT=5.005	? (TO) TT=1800.18	? (TO) TT=1800.11	SAT TT=900.454	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=17.28 ASSIGNMENTS=4928	SAT TT=95.596 ASSIGNMENTS=4288	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=14.181 ASSIGNMENTS=4599 CHECKS=4325660	SAT TT=1419.32 ASSIGNMENTS=4599 CHECKS=4325660	? (MO) TT=579.96	? (MO) TT=607.66	? (TO) TT=1800.06	SAT TT=5.087 ASSIGNMENTS=5216 CHECKS=4546580	? (TO) TT=1800.02	SAT TT=15.097 ASSIGNMENTS=18701 CHECKS=13020400	SAT TT=5.005 ASSIGNMENTS=4599 CHECKS=4325660	? (TO) TT=1801.57	? TT=143.6	? TT=152.077
csp/pseudo/mpsReduced/ normalized-mps-red-blend.xml	UNSAT TT=2.462	? (TO) TT=1800.07	? (TO) TT=1800.15	UNSAT TT=2.462	UNSAT TT=113.53 CHECKS=11528	UNSAT TT=86.548 CHECKS=8647	UNSAT TT=22.28 ASSIGNMENTS=0	UNSAT TT=23.238 ASSIGNMENTS=0	? TT=0.653	? TT=0.652	? TT=0.62	UNSAT TT=30.582 ASSIGNMENTS=0	UNSAT TT=1062.64 ASSIGNMENTS=3625 CHECKS=51568400	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=7.043 ASSIGNMENTS=707 CHECKS=10691500	UNSAT TT=96.859 ASSIGNMENTS=123863 CHECKS=132840000	UNSAT TT=696.233	UNSAT TT=18.845 ASSIGNMENTS=6079 CHECKS=37485300	UNSAT TT=28.478 ASSIGNMENTS=3625 CHECKS=51568400	? (TO) TT=1800.12	? TT=422.801	? TT=413.084
csp/pseudo/mpsReduced/ normalized-mps-red-egout.xml	UNSAT TT=3.322	UNSAT TT=650.846 CHECKS=51621000 NODES=3119	UNSAT TT=866.605 CHECKS=68554800 NODES=3153	? (TO) TT=1800.03	UNSAT TT=16.145 CHECKS=13989	? (TO) TT=1800.04	UNSAT TT=3.139 ASSIGNMENTS=0	UNSAT TT=3.322 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=11.424 ASSIGNMENTS=3342 CHECKS=3401380	UNSAT TT=621.558 ASSIGNMENTS=3119 CHECKS=51621000	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=8.168 ASSIGNMENTS=10905 CHECKS=6502830	UNSAT TT=7.923 ASSIGNMENTS=9669 CHECKS=10692300	UNSAT TT=88.215	UNSAT TT=270.572 ASSIGNMENTS=262694 CHECKS=154697000	UNSAT TT=4.039 ASSIGNMENTS=3342 CHECKS=3401380	? TT=298.191	UNSAT TT=4.248	UNSAT TT=8.66
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/mpsReduced/ normalized-mps-red-fiber.xml	SAT TT=30.47	SAT TT=175.287 CHECKS=21022700 NODES=5416	SAT TT=191.845 CHECKS=21396700 NODES=3237	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT TT=10.564 ASSIGNMENTS=29319	SAT TT=30.47 ASSIGNMENTS=31271	SAT TT=186.977 CHECKS=59048600 NODES=5701	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=1693.8 ASSIGNMENTS=29319	? (MO) TT=154.4	? (MO) TT=153.41	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=37.359	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1802.12	? (MO) TT=83.658	? (MO) TT=285.83
csp/pseudo/mpsReduced/ normalized-mps-red-flugpl.xml	SAT TT=1.526	SAT TT=20.658 CHECKS=5302800 NODES=265	SAT TT=10.34 CHECKS=2493400 NODES=0	SAT TT=3.916	SAT TT=4.168 CHECKS=78985	SAT TT=5.322 CHECKS=101816	SAT TT=1.213 ASSIGNMENTS=2523	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=9.704 ASSIGNMENTS=12564 CHECKS=4357580	SAT TT=27.363 ASSIGNMENTS=265 CHECKS=5302800	? (MO) TT=126.36	? (MO) TT=126.15	SAT TT=3.201 ASSIGNMENTS=14937 CHECKS=6288580	SAT TT=1.526 ASSIGNMENTS=11249 CHECKS=3010990	SAT TT=0.957	? (TO) TT=1800.06	SAT TT=2.246 ASSIGNMENTS=12564 CHECKS=4357580	? TT=601.587	? (MO) TT=92.19	? (MO) TT=299.048
csp/pseudo/mpsReduced/ normalized-mps-red-gr4x6.xml	UNSAT TT=1562.29	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=1660.67 CHECKS=1732750	UNSAT TT=1562.29 CHECKS=2015800	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.13
csp/pseudo/mpsReduced/ normalized-mps-red-markshare2-1.xml	SAT TT=0.236	SAT TT=153.348 CHECKS=7590860 NODES=330	SAT TT=171.614 CHECKS=8639440 NODES=0	SAT TT=0.236	SAT TT=10.138 CHECKS=6950	SAT TT=9.163 CHECKS=6400	SAT TT=1.462 ASSIGNMENTS=199	SAT TT=2.879 ASSIGNMENTS=3158	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.359 ASSIGNMENTS=193 CHECKS=327075	SAT TT=0.356 ASSIGNMENTS=193 CHECKS=327075	? (MO) TT=120.28	? (MO) TT=119.31	SAT TT=0.336 ASSIGNMENTS=193 CHECKS=327075	SAT TT=12.464 ASSIGNMENTS=8980 CHECKS=24590900	SAT TT=4.395	SAT TT=45.67 ASSIGNMENTS=48949 CHECKS=75524800	SAT TT=0.368 ASSIGNMENTS=203 CHECKS=328221	? TT=338.429	? (MO) TT=91.71	? (MO) TT=298.381
csp/pseudo/mpsReduced/ normalized-mps-red-misc03.xml	SAT TT=1.592	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=38.677	SAT TT=15.145 CHECKS=67630	SAT TT=8.398 CHECKS=41579	SAT TT=1.199 ASSIGNMENTS=374	SAT TT=4.403 ASSIGNMENTS=18864	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=405.419 ASSIGNMENTS=739 CHECKS=1995020	SAT TT=459.475 ASSIGNMENTS=739 CHECKS=1995020	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=10.56 ASSIGNMENTS=4042 CHECKS=14280500	SAT TT=10.009 ASSIGNMENTS=6291 CHECKS=14211700	SAT TT=3.034	SAT TT=3.126 ASSIGNMENTS=1204 CHECKS=4475840	SAT TT=1.592 ASSIGNMENTS=739 CHECKS=1995020	? TT=253.507	? TT=229.072	? TT=203.201
csp/pseudo/mpsReduced/ normalized-mps-red-p0282.xml	SAT TT=0.064	SAT TT=54.257 CHECKS=22091000 NODES=284	SAT TT=139.239 CHECKS=42640500 NODES=0	SAT TT=0.166	SAT TT=0.574 CHECKS=12253	SAT TT=0.59 CHECKS=12859	SAT TT=1.22 ASSIGNMENTS=221	SAT TT=1.368 ASSIGNMENTS=266	SAT TT=131.655 CHECKS=3574300 NODES=282	SAT TT=239.739 CHECKS=2505840 NODES=14	SAT TT=256.452 CHECKS=2956720 NODES=20	SAT TT=0.08 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.078 ASSIGNMENTS=237 CHECKS=46009	? (problem) TT=73.758	? (problem) TT=75.673	SAT TT=0.068 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.064 ASSIGNMENTS=133 CHECKS=40840	SAT TT=0.979	SAT TT=0.067 ASSIGNMENTS=212 CHECKS=35108	SAT TT=0.071 ASSIGNMENTS=228 CHECKS=45887	? (TO) TT=1801.47	SAT TT=36.177	SAT TT=146.682
csp/pseudo/mpsReduced/ normalized-mps-red-pk1.xml	SAT TT=0.484	? (TO) TT=1800.06	? (TO) TT=1800.16	SAT TT=0.521	? (TO) TT=1800.1	SAT TT=122.784 CHECKS=187313	SAT TT=1.981 ASSIGNMENTS=690	SAT TT=6.342 ASSIGNMENTS=19099	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.04	SAT TT=8.737 ASSIGNMENTS=690	SAT TT=8.44 ASSIGNMENTS=246 CHECKS=446702	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=1.654	? (TO) TT=1800.05	SAT TT=0.484 ASSIGNMENTS=246 CHECKS=446702	? (TO) TT=1800.1	? TT=148.2	? TT=148.264
csp/pseudo/mpsReduced/ normalized-mps-red-ran10x10b.xml	SAT TT=1.359	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=1.359	SAT TT=53.791 CHECKS=21423	SAT TT=57.726 CHECKS=24249	SAT TT=43.759 ASSIGNMENTS=3171	SAT TT=45.097 ASSIGNMENTS=833	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=10.122 ASSIGNMENTS=1424 CHECKS=524730	SAT TT=1090.37 ASSIGNMENTS=1424 CHECKS=524730	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=83.576 ASSIGNMENTS=42072 CHECKS=139280000	SAT TT=3.563 ASSIGNMENTS=2012 CHECKS=6083780	SAT TT=691.709	SAT TT=5.719 ASSIGNMENTS=1130 CHECKS=7461970	SAT TT=1.739 ASSIGNMENTS=1424 CHECKS=524730	? (TO) TT=1800.31	SAT TT=4.77	SAT TT=7.749
csp/pseudo/mpsReduced/ normalized-mps-red-ran14x18.xml		? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.06	? TT=37.467 CHECKS=4275050 NODES=0	? TT=40.333 CHECKS=4275050 NODES=0	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1802.14	? (TO) TT=1800.08	? (TO) TT=1800.08
csp/pseudo/mpsReduced/ normalized-mps-red-ran16x16.xml	SAT TT=1.757	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=3.45	SAT TT=60.886 CHECKS=4834	SAT TT=58.629 CHECKS=4556	SAT TT=88.468 ASSIGNMENTS=3739	SAT TT=85.826 ASSIGNMENTS=2088	? (TO) TT=1800.01	? TT=39.466 CHECKS=3254050 NODES=0	? TT=39.897 CHECKS=3254050 NODES=0	SAT TT=1.757 ASSIGNMENTS=3545 CHECKS=2136710	SAT TT=1.862 ASSIGNMENTS=3545 CHECKS=2136710	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1.846 ASSIGNMENTS=3545 CHECKS=2136710	SAT TT=106.889 ASSIGNMENTS=240474 CHECKS=158768000	? (TO) TT=1800.08	SAT TT=1.907 ASSIGNMENTS=3495 CHECKS=2135200	SAT TT=2.38 ASSIGNMENTS=3774 CHECKS=2136030	? TT=431.907	SAT TT=11.169	SAT TT=22.046
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/mpsReduced/ normalized-mps-red-sample2.xml	UNSAT TT=11.859	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=13.829 CHECKS=23622	UNSAT TT=11.859 CHECKS=26584	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=1071.58 ASSIGNMENTS=865701 CHECKS=1034350000	? (TO) TT=1800.12	UNSAT TT=233.564 ASSIGNMENTS=275425 CHECKS=135550000	UNSAT TT=562.817 ASSIGNMENTS=478493 CHECKS=568487000	? (TO) TT=1800.2	? (MO) TT=81.91	? (MO) TT=284.27
csp/pseudo/mpsReduced/ normalized-mps-red-share2b.xml	UNSAT TT=12.69	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.11	UNSAT TT=333.675 CHECKS=88439	UNSAT TT=402.188 CHECKS=121378	UNSAT TT=9.878 ASSIGNMENTS=0	UNSAT TT=13.775 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=37.998 ASSIGNMENTS=6486 CHECKS=54297400	UNSAT TT=1280.38 ASSIGNMENTS=6486 CHECKS=54297400	? (MO) TT=210.33	? (MO) TT=207.82	UNSAT TT=1007.41 ASSIGNMENTS=127421 CHECKS=2700260000	UNSAT TT=148.885 ASSIGNMENTS=113885 CHECKS=178021000	UNSAT TT=747.321	UNSAT TT=12.69 ASSIGNMENTS=16157 CHECKS=23071700	UNSAT TT=27.037 ASSIGNMENTS=6486 CHECKS=54297400	? TT=408.482	? (MO) TT=157.134	? (MO) TT=355.992
csp/pseudo/mpsReduced/ normalized-mps-red-vtp-base.xml		? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=0.82	? TT=0.827	? TT=0.595	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.18	? TT=161.023	? TT=171.371
csp/pseudo/ niklas/ normalized-air04.xml	SAT TT=13.832	SAT TT=25.471 CHECKS=17721 NODES=8904	SAT TT=20.363 CHECKS=17721 NODES=0	SAT TT=13.832	SAT TT=85.646 CHECKS=53965	SAT TT=87.134 CHECKS=54270	SAT TT=70.159 ASSIGNMENTS=8905	SAT TT=150.549 ASSIGNMENTS=8905	SAT TT=383.4 CHECKS=71747 NODES=8904	? TT=224.569 CHECKS=70994 NODES=0	? TT=186.97 CHECKS=70989 NODES=0	SAT TT=29.771 ASSIGNMENTS=8904 CHECKS=10060500	SAT TT=37.209 ASSIGNMENTS=8904 CHECKS=17721	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=17.138 ASSIGNMENTS=8904 CHECKS=10060500	SAT TT=15.86 ASSIGNMENTS=8904 CHECKS=10060500	SAT TT=41.423	SAT TT=16.441 ASSIGNMENTS=8904 CHECKS=10060500	SAT TT=17.45 ASSIGNMENTS=8904 CHECKS=10060500	? TT=1031.2	SAT TT=53.998	SAT TT=93.643
csp/pseudo/ niklas/ normalized-air05.xml	SAT TT=10.708	SAT TT=23.167 CHECKS=9177 NODES=7195	SAT TT=19.064 CHECKS=9177 NODES=0	SAT TT=10.708	SAT TT=119.545 CHECKS=42154	SAT TT=119.909 CHECKS=40515	SAT TT=62.398 ASSIGNMENTS=7196	SAT TT=128.472 ASSIGNMENTS=7196	SAT TT=332.523 CHECKS=51575 NODES=7195	? TT=192.323 CHECKS=51180 NODES=0	? TT=201.31 CHECKS=51180 NODES=0	SAT TT=28.95 ASSIGNMENTS=7195 CHECKS=10019200	SAT TT=34.058 ASSIGNMENTS=7195 CHECKS=9177	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=16.659 ASSIGNMENTS=7195 CHECKS=10019200	SAT TT=17.742 ASSIGNMENTS=7195 CHECKS=10019200	SAT TT=35.808	SAT TT=14.145 ASSIGNMENTS=7195 CHECKS=10019200	SAT TT=17.363 ASSIGNMENTS=7195 CHECKS=10019200	? TT=246.45	SAT TT=43.41	SAT TT=80.006
csp/pseudo/ niklas/ normalized-enigma.xml	SAT TT=0.037	SAT TT=10.369 CHECKS=811227 NODES=100	SAT TT=3.332 CHECKS=262498 NODES=0	SAT TT=0.078	SAT TT=0.402 CHECKS=2936	SAT TT=0.415 CHECKS=3340	SAT TT=0.746 ASSIGNMENTS=94	SAT TT=0.776 ASSIGNMENTS=87	SAT TT=60.927 CHECKS=42396 NODES=100	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT TT=0.048 ASSIGNMENTS=96 CHECKS=17832	SAT TT=0.048 ASSIGNMENTS=96 CHECKS=17832	? (MO) TT=472.53	? (MO) TT=541.95	SAT TT=0.038 ASSIGNMENTS=96 CHECKS=17832	SAT TT=0.037 ASSIGNMENTS=26 CHECKS=18535	SAT TT=0.665	SAT TT=0.087 ASSIGNMENTS=174 CHECKS=126054	SAT TT=0.038 ASSIGNMENTS=98 CHECKS=17941	? TT=1135.93	? TT=804.05	? TT=837.737
csp/pseudo/ niklas/ normalized-l152lav.xml	SAT TT=2.854	SAT TT=12.468 CHECKS=2178 NODES=1989	SAT TT=11.608 CHECKS=2178 NODES=0	SAT TT=2.854	SAT TT=228.981 CHECKS=10027	SAT TT=220.383 CHECKS=10997	SAT TT=16.215 ASSIGNMENTS=1990	SAT TT=18.098 ASSIGNMENTS=1990	? TT=0.604	? TT=0.627	? TT=0.602	SAT TT=16.519 ASSIGNMENTS=1989 CHECKS=4846840	SAT TT=22.242 ASSIGNMENTS=1989 CHECKS=2178	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=6.29 ASSIGNMENTS=1989 CHECKS=4846640	SAT TT=6.666 ASSIGNMENTS=1989 CHECKS=4846530	? (exit code) TT=16.483	SAT TT=6.219 ASSIGNMENTS=1989 CHECKS=4846560	SAT TT=6.387 ASSIGNMENTS=1989 CHECKS=4846840	? TT=1159.1	SAT TT=20.945	SAT TT=83.957
csp/pseudo/ niklas/ normalized-lseu.xml	SAT TT=0.02	SAT TT=1.354 CHECKS=20525 NODES=91	SAT TT=1.485 CHECKS=48696 NODES=0	SAT TT=0.053	SAT TT=0.091 CHECKS=946	SAT TT=0.11 CHECKS=1045	SAT TT=0.681 ASSIGNMENTS=67	SAT TT=0.86 ASSIGNMENTS=306	SAT TT=68.279 CHECKS=199605 NODES=172	? (TO) TT=1800.03	SAT TT=1001.18 CHECKS=985807000 NODES=99979	SAT TT=0.033 ASSIGNMENTS=69 CHECKS=7810	SAT TT=0.031 ASSIGNMENTS=69 CHECKS=7810	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=0.02 ASSIGNMENTS=69 CHECKS=7810	SAT TT=0.033 ASSIGNMENTS=225 CHECKS=36172	SAT TT=0.54	SAT TT=0.028 ASSIGNMENTS=137 CHECKS=26264	SAT TT=0.021 ASSIGNMENTS=69 CHECKS=7948	? (TO) TT=1800.16	SAT TT=36.265	SAT TT=156.611
csp/pseudo/ niklas/ normalized-mitre.xml	SAT TT=995.97	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=995.97 CHECKS=2566540	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=1202.23	? (TO) TT=1800.04	? (TO) TT=1800.08	? TT=953.048	? TT=162.853	? TT=168.942
csp/pseudo/ niklas/ normalized-mod008.xml	SAT TT=0.193	SAT TT=1.524 CHECKS=330 NODES=319	SAT TT=1.43 CHECKS=824 NODES=0	SAT TT=0.193	SAT TT=10.871 CHECKS=3079	SAT TT=10.577 CHECKS=2981	SAT TT=1.41 ASSIGNMENTS=315	SAT TT=1.455 ASSIGNMENTS=319	SAT TT=62.049 CHECKS=1505 NODES=319	SAT TT=1.903 CHECKS=3951 NODES=0	SAT TT=1.868 CHECKS=3951 NODES=0	SAT TT=0.275 ASSIGNMENTS=315 CHECKS=266439	SAT TT=0.273 ASSIGNMENTS=315 CHECKS=266439	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=0.248 ASSIGNMENTS=315 CHECKS=266439	SAT TT=0.245 ASSIGNMENTS=317 CHECKS=266979	SAT TT=0.989	SAT TT=0.265 ASSIGNMENTS=317 CHECKS=266853	SAT TT=0.265 ASSIGNMENTS=315 CHECKS=266155	? (TO) TT=1800.15	? TT=187.553	? TT=175.049
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ niklas/ normalized-mux.xml	SAT TT=0.061	SAT TT=1.312 CHECKS=2210 NODES=232	SAT TT=1.3 CHECKS=1450 NODES=0	SAT TT=0.195	SAT TT=0.086 CHECKS=6690	SAT TT=0.078 CHECKS=13304	SAT TT=1.683 ASSIGNMENTS=95	SAT TT=1.518 ASSIGNMENTS=201	SAT TT=78.258 CHECKS=3939 NODES=234	SAT TT=19.218 CHECKS=10626 NODES=21	SAT TT=19.083 CHECKS=17854 NODES=21	SAT TT=0.074 ASSIGNMENTS=93 CHECKS=14034	SAT TT=0.077 ASSIGNMENTS=93 CHECKS=14034	SAT TT=135.997	Wrong Cert. TT=138.822	SAT TT=0.064 ASSIGNMENTS=93 CHECKS=14034	SAT TT=0.061 ASSIGNMENTS=79 CHECKS=13836	SAT TT=0.883	SAT TT=0.817 ASSIGNMENTS=4173 CHECKS=533507	SAT TT=0.07 ASSIGNMENTS=89 CHECKS=13977	SAT TT=1581.31	SAT TT=1.451	SAT TT=1.603
csp/pseudo/ niklas/ normalized-my-adder.xml	SAT TT=0.172	SAT TT=1.934 CHECKS=3817 NODES=577	SAT TT=1.642 CHECKS=3684 NODES=0	SAT TT=0.407	SAT TT=0.266 CHECKS=34902	SAT TT=0.204 CHECKS=34362	SAT TT=2.097 ASSIGNMENTS=345	SAT TT=2.3 ASSIGNMENTS=482	SAT TT=2.305 CHECKS=7777 NODES=577	SAT TT=2.305 CHECKS=22321 NODES=54	SAT TT=2.316 CHECKS=55715 NODES=34	SAT TT=0.186 ASSIGNMENTS=324 CHECKS=26582	SAT TT=0.193 ASSIGNMENTS=324 CHECKS=26582	SAT TT=4.238	Wrong Cert. TT=4.211	SAT TT=0.172 ASSIGNMENTS=324 CHECKS=26582	SAT TT=0.794 ASSIGNMENTS=8049 CHECKS=747405	SAT TT=1.307	SAT TT=19.489 ASSIGNMENTS=45203 CHECKS=3678420	SAT TT=0.18 ASSIGNMENTS=320 CHECKS=26679	SAT TT=6.799	SAT TT=1.5	SAT TT=1.877
csp/pseudo/ niklas/ normalized-p0282.xml	SAT TT=0.067	SAT TT=50.812 CHECKS=22091000 NODES=284	SAT TT=148.827 CHECKS=42640500 NODES=0	SAT TT=0.153	SAT TT=0.633 CHECKS=13648	SAT TT=0.6 CHECKS=12841	SAT TT=1.113 ASSIGNMENTS=221	SAT TT=1.233 ASSIGNMENTS=266	SAT TT=130.406 CHECKS=3573950 NODES=282	SAT TT=255.19 CHECKS=2505550 NODES=12	SAT TT=254.761 CHECKS=2502250 NODES=7	SAT TT=0.083 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.084 ASSIGNMENTS=237 CHECKS=46009	? (problem) TT=72.591	? (problem) TT=73.466	SAT TT=0.071 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.069 ASSIGNMENTS=148 CHECKS=43002	SAT TT=0.978	SAT TT=0.07 ASSIGNMENTS=212 CHECKS=35108	SAT TT=0.067 ASSIGNMENTS=228 CHECKS=45887	? (TO) TT=1802.07	SAT TT=35.958	SAT TT=156.52
csp/pseudo/ niklas/ normalized-p0548.xml	SAT TT=0.151	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=2.091 CHECKS=10812	SAT TT=3.077 CHECKS=15728	SAT TT=1.208 ASSIGNMENTS=397	SAT TT=1.749 ASSIGNMENTS=2169	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=0.17 ASSIGNMENTS=606 CHECKS=202978	SAT TT=0.169 ASSIGNMENTS=606 CHECKS=202978	? (MO) TT=22.94	? (MO) TT=24.69	SAT TT=0.151 ASSIGNMENTS=565 CHECKS=194339	SAT TT=7.641 ASSIGNMENTS=35883 CHECKS=16389100	SAT TT=0.876	? (TO) TT=1800.09	SAT TT=0.347 ASSIGNMENTS=1043 CHECKS=597264	? TT=385.758	? TT=281.337	? TT=185.946
csp/pseudo/ niklas/ normalized-pk1.xml	SAT TT=0.099	SAT TT=1.079 CHECKS=435 NODES=86	SAT TT=0.989 CHECKS=435 NODES=0	SAT TT=0.153	SAT TT=1.133 CHECKS=3844	SAT TT=1.116 CHECKS=3862	SAT TT=1.061 ASSIGNMENTS=57	SAT TT=0.992 ASSIGNMENTS=86	SAT TT=61.478 CHECKS=1035 NODES=86	SAT TT=1.685 CHECKS=11281 NODES=5	SAT TT=2.295 CHECKS=98371 NODES=4	SAT TT=0.118 ASSIGNMENTS=56 CHECKS=89064	SAT TT=0.121 ASSIGNMENTS=56 CHECKS=89064	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=0.112 ASSIGNMENTS=56 CHECKS=89064	SAT TT=0.099 ASSIGNMENTS=33 CHECKS=77962	SAT TT=0.799	SAT TT=39.2 ASSIGNMENTS=35397 CHECKS=61216900	SAT TT=0.105 ASSIGNMENTS=56 CHECKS=89586	? (TO) TT=1800.13	? (MO) TT=76.804	? (MO) TT=283.747
csp/pseudo/ niklas/ normalized-seymour.xml	SAT TT=0.892	SAT TT=8.927 CHECKS=27702 NODES=1255	SAT TT=4.531 CHECKS=17069 NODES=0	SAT TT=2.095	SAT TT=1.878 CHECKS=239380	SAT TT=1.668 CHECKS=237091	SAT TT=4.794 ASSIGNMENTS=792	SAT TT=5.549 ASSIGNMENTS=792	SAT TT=12.01 CHECKS=93523 NODES=1255	SAT TT=5.509 CHECKS=122763 NODES=8	SAT TT=5.886 CHECKS=134146 NODES=4	SAT TT=0.934 ASSIGNMENTS=801 CHECKS=293685	SAT TT=0.934 ASSIGNMENTS=801 CHECKS=293685	SAT TT=15.52	SAT TT=21.469	SAT TT=0.929 ASSIGNMENTS=801 CHECKS=293685	SAT TT=0.912 ASSIGNMENTS=880 CHECKS=294436	SAT TT=2.677	SAT TT=0.892 ASSIGNMENTS=851 CHECKS=293637	SAT TT=0.904 ASSIGNMENTS=804 CHECKS=293914	SAT TT=62.273	SAT TT=7.627	SAT TT=8.425
csp/pseudo/ niklas/ normalized-stein27.xml	SAT TT=0.013	SAT TT=0.855 CHECKS=1864 NODES=27	SAT TT=0.861 CHECKS=3714 NODES=0	SAT TT=0.048	SAT TT=0.032 CHECKS=8042	SAT TT=0.027 CHECKS=7707	SAT TT=0.65 ASSIGNMENTS=9	SAT TT=0.848 ASSIGNMENTS=9	SAT TT=74.706 CHECKS=277484 NODES=27	SAT TT=14.331 CHECKS=165501 NODES=0	SAT TT=13.888 CHECKS=165499 NODES=0	SAT TT=0.026 ASSIGNMENTS=8 CHECKS=1620	SAT TT=0.027 ASSIGNMENTS=8 CHECKS=1620	? (MO) TT=41.56	? (MO) TT=40.99	SAT TT=0.014 ASSIGNMENTS=8 CHECKS=1620	SAT TT=0.015 ASSIGNMENTS=6 CHECKS=1478	SAT TT=0.398	SAT TT=0.013 ASSIGNMENTS=8 CHECKS=1631	SAT TT=0.013 ASSIGNMENTS=9 CHECKS=1593	? TT=172.37	SAT TT=0.687	SAT TT=0.694
csp/pseudo/ niklas/ normalized-stein45.xml	SAT TT=0.025	SAT TT=1.069 CHECKS=886 NODES=45	SAT TT=1.027 CHECKS=855 NODES=0	SAT TT=0.087	SAT TT=0.037 CHECKS=2220	SAT TT=0.025 CHECKS=2403	SAT TT=1.013 ASSIGNMENTS=13	SAT TT=0.95 ASSIGNMENTS=13	SAT TT=203.43 CHECKS=235859000 NODES=45	SAT TT=85.226 CHECKS=140514000 NODES=0	SAT TT=85.033 CHECKS=140514000 NODES=0	SAT TT=0.046 ASSIGNMENTS=12 CHECKS=4532	SAT TT=0.039 ASSIGNMENTS=12 CHECKS=4532	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=0.026 ASSIGNMENTS=12 CHECKS=4532	SAT TT=0.032 ASSIGNMENTS=59 CHECKS=13639	SAT TT=0.742	SAT TT=0.029 ASSIGNMENTS=26 CHECKS=5771	SAT TT=0.026 ASSIGNMENTS=12 CHECKS=4512	? TT=754.848	SAT TT=0.902	SAT TT=0.856
csp/pseudo/par/ normalized-par-16-2-c.xml	SAT TT=1.788	SAT TT=6.541 CHECKS=1678500 NODES=10893	SAT TT=44.202 CHECKS=15647300 NODES=117004	SAT TT=5.991	SAT TT=260.227 CHECKS=239070000	SAT TT=166.655 CHECKS=177948000	SAT TT=290.106 ASSIGNMENTS=367998	SAT TT=268.478 ASSIGNMENTS=367998	SAT TT=390.549 CHECKS=130430000 NODES=113465	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=13.265 ASSIGNMENTS=10893 CHECKS=1678500	SAT TT=159.531 ASSIGNMENTS=76639 CHECKS=181434000	SAT TT=3.539	SAT TT=3.335	SAT TT=48.122 ASSIGNMENTS=24387 CHECKS=56319300	SAT TT=55.001 ASSIGNMENTS=35415 CHECKS=65498500	SAT TT=3.738	SAT TT=571.787 ASSIGNMENTS=201110 CHECKS=481324000	SAT TT=152.008 ASSIGNMENTS=76639 CHECKS=181434000	SAT TT=5.763	SAT TT=2.075	SAT TT=1.788
csp/pseudo/par/ normalized-par-16-3-c.xml	SAT TT=1.667	SAT TT=201.275 CHECKS=75106700 NODES=574385	SAT TT=108.854 CHECKS=40865200 NODES=323384	SAT TT=2.882	SAT TT=93.108 CHECKS=85804300	SAT TT=145.248 CHECKS=159807000	SAT TT=24.679 ASSIGNMENTS=33908	SAT TT=24.871 ASSIGNMENTS=33908	SAT TT=57.14 CHECKS=19859400 NODES=19231	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=126.902 ASSIGNMENTS=60189 CHECKS=140788000	SAT TT=123.701 ASSIGNMENTS=60189 CHECKS=140788000	SAT TT=3.211	SAT TT=3.111	SAT TT=96.459 ASSIGNMENTS=52652 CHECKS=119688000	SAT TT=118.735 ASSIGNMENTS=66614 CHECKS=138597000	SAT TT=5.96	SAT TT=239.023 ASSIGNMENTS=88562 CHECKS=215346000	SAT TT=115.363 ASSIGNMENTS=60189 CHECKS=140788000	SAT TT=6.617	SAT TT=1.917	SAT TT=1.667
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/par/ normalized-par-16-4.xml	SAT TT=2.042	SAT TT=30.149 CHECKS=10481100 NODES=37310	SAT TT=83.391 CHECKS=29182600 NODES=96747	SAT TT=3.909	SAT TT=152.005 CHECKS=91980900	SAT TT=24.093 CHECKS=19708500	SAT TT=160.062 ASSIGNMENTS=98083	SAT TT=169.629 ASSIGNMENTS=98083	SAT TT=843.765 CHECKS=138728000 NODES=184926	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=44.534 ASSIGNMENTS=12418 CHECKS=34671800	SAT TT=37.88 ASSIGNMENTS=37310 CHECKS=10481100	SAT TT=8.464	SAT TT=8.511	SAT TT=57.43 ASSIGNMENTS=23176 CHECKS=62770600	SAT TT=20.664 ASSIGNMENTS=13789 CHECKS=20549300	SAT TT=37.292	SAT TT=137.578 ASSIGNMENTS=38888 CHECKS=96856500	SAT TT=35.29 ASSIGNMENTS=12418 CHECKS=34671800	SAT TT=7.857	SAT TT=2.042	SAT TT=2.217
csp/pseudo/par/ normalized-par-16-5-c.xml	SAT TT=1.618	SAT TT=194.223 CHECKS=71874700 NODES=613452	SAT TT=221.917 CHECKS=83949300 NODES=732514	SAT TT=10.628	SAT TT=139.07 CHECKS=135220000	SAT TT=463.76 CHECKS=555591000	SAT TT=42.873 ASSIGNMENTS=52888	SAT TT=43.357 ASSIGNMENTS=52888	SAT TT=302.746 CHECKS=99625400 NODES=87998	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=181.184 ASSIGNMENTS=613452 CHECKS=71874700	SAT TT=339.471 ASSIGNMENTS=160068 CHECKS=389951000	SAT TT=3.403	SAT TT=3.077	SAT TT=42.624 ASSIGNMENTS=25876 CHECKS=54410600	SAT TT=24.594 ASSIGNMENTS=19489 CHECKS=29493000	SAT TT=2.47	SAT TT=34.441 ASSIGNMENTS=16364 CHECKS=30878600	SAT TT=328.516 ASSIGNMENTS=160068 CHECKS=389951000	SAT TT=5.772	SAT TT=2.129	SAT TT=1.618
csp/pseudo/par/ normalized-par-16-5.xml	SAT TT=2.63	SAT TT=376.944 CHECKS=131326000 NODES=381898	SAT TT=356.438 CHECKS=131333000 NODES=381864	SAT TT=2.63	SAT TT=43.562 CHECKS=28905500	SAT TT=72.808 CHECKS=49731100	SAT TT=21.875 ASSIGNMENTS=12758	SAT TT=23.543 ASSIGNMENTS=12758	SAT TT=647.241 CHECKS=102235000 NODES=127106	? (TO) TT=1800	? (TO) TT=1800.04	SAT TT=325.33 ASSIGNMENTS=117479 CHECKS=326218000	SAT TT=312.483 ASSIGNMENTS=381898 CHECKS=131326000	SAT TT=8.43	SAT TT=8.281	SAT TT=56.566 ASSIGNMENTS=23238 CHECKS=60958500	SAT TT=177.633 ASSIGNMENTS=69014 CHECKS=178059000	SAT TT=37.025	SAT TT=251.803 ASSIGNMENTS=76474 CHECKS=198151000	SAT TT=323.054 ASSIGNMENTS=117479 CHECKS=326218000	SAT TT=10.849	SAT TT=2.766	SAT TT=2.646
csp/pseudo/par/ normalized-par-32-1-c.xml		? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.11
csp/pseudo/par/ normalized-par-32-1.xml		? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.05
csp/pseudo/par/ normalized-par-32-2-c.xml	SAT TT=180.881	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=180.881	? (TO) TT=1800.14	? (TO) TT=1800.12
csp/pseudo/par/ normalized-par-32-3-c.xml		? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.09
csp/pseudo/par/ normalized-par-32-4.xml		? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/pseudo/par/ normalized-par-32-5-c.xml		? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.06
csp/pseudo/par/ normalized-par-8-1-c.xml	SAT TT=0.031	SAT TT=1.039 CHECKS=1966 NODES=141	SAT TT=1.022 CHECKS=2827 NODES=132	SAT TT=0.086	SAT TT=0.052 CHECKS=18976	SAT TT=0.038 CHECKS=19433	SAT TT=1.039 ASSIGNMENTS=20	SAT TT=1.264 ASSIGNMENTS=20	SAT TT=0.97 CHECKS=1336 NODES=130	SAT TT=2.148 CHECKS=2649100 NODES=81086	SAT TT=1.78 CHECKS=1851390 NODES=10291	SAT TT=0.041 ASSIGNMENTS=15 CHECKS=10408	SAT TT=0.042 ASSIGNMENTS=15 CHECKS=10408	SAT TT=1.709	SAT TT=1.783	SAT TT=0.031 ASSIGNMENTS=19 CHECKS=11997	SAT TT=0.067 ASSIGNMENTS=374 CHECKS=84056	SAT TT=0.739	SAT TT=0.072 ASSIGNMENTS=436 CHECKS=60847	SAT TT=0.035 ASSIGNMENTS=21 CHECKS=14559	SAT TT=1.824	SAT TT=1.007	SAT TT=0.982
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/par/ normalized-par-8-2-c.xml	SAT TT=0.026	SAT TT=1.024 CHECKS=3607 NODES=157	SAT TT=1.144 CHECKS=4729 NODES=155	SAT TT=0.101	SAT TT=0.052 CHECKS=16107	SAT TT=0.035 CHECKS=17193	SAT TT=1.179 ASSIGNMENTS=17	SAT TT=1.277 ASSIGNMENTS=17	SAT TT=1.018 CHECKS=5574 NODES=151	SAT TT=2.43 CHECKS=2718350 NODES=79202	SAT TT=1.702 CHECKS=1149830 NODES=7072	SAT TT=0.037 ASSIGNMENTS=11 CHECKS=4600	SAT TT=0.037 ASSIGNMENTS=11 CHECKS=4600	SAT TT=1.732	SAT TT=1.499	SAT TT=0.026 ASSIGNMENTS=12 CHECKS=5269	SAT TT=0.083 ASSIGNMENTS=477 CHECKS=106508	SAT TT=0.687	SAT TT=0.072 ASSIGNMENTS=456 CHECKS=57713	SAT TT=0.028 ASSIGNMENTS=11 CHECKS=5867	SAT TT=1.787	SAT TT=0.874	SAT TT=1.008
csp/pseudo/par/ normalized-par-8-5-c.xml	SAT TT=0.027	SAT TT=1.045 CHECKS=1934 NODES=158	SAT TT=1.038 CHECKS=3944 NODES=166	SAT TT=0.096	SAT TT=0.054 CHECKS=19592	SAT TT=0.042 CHECKS=20062	SAT TT=1.085 ASSIGNMENTS=12	SAT TT=1.202 ASSIGNMENTS=12	SAT TT=1.101 CHECKS=4353 NODES=167	SAT TT=2.805 CHECKS=4085280 NODES=113948	SAT TT=1.159 CHECKS=67901 NODES=532	SAT TT=0.041 ASSIGNMENTS=8 CHECKS=5958	SAT TT=0.04 ASSIGNMENTS=8 CHECKS=5958	SAT TT=1.638	SAT TT=1.66	SAT TT=0.031 ASSIGNMENTS=7 CHECKS=5947	SAT TT=0.027 ASSIGNMENTS=6 CHECKS=3708	SAT TT=0.751	SAT TT=0.062 ASSIGNMENTS=313 CHECKS=54157	SAT TT=0.03 ASSIGNMENTS=8 CHECKS=5958	SAT TT=2.013	SAT TT=0.989	SAT TT=0.885
csp/pseudo/par/ normalized-par-8-5.xml	SAT TT=0.076	SAT TT=2.022 CHECKS=7922 NODES=718	SAT TT=1.961 CHECKS=12491 NODES=718	SAT TT=0.343	SAT TT=0.222 CHECKS=93738	SAT TT=0.168 CHECKS=90572	SAT TT=1.958 ASSIGNMENTS=10	SAT TT=2.012 ASSIGNMENTS=10	SAT TT=2.305 CHECKS=24002 NODES=768	SAT TT=2.648 CHECKS=1290310 NODES=49773	SAT TT=342.776 CHECKS=1110620000 NODES=1978640	SAT TT=0.095 ASSIGNMENTS=6 CHECKS=4243	SAT TT=0.095 ASSIGNMENTS=6 CHECKS=4243	SAT TT=3.505	SAT TT=3.447	SAT TT=0.076 ASSIGNMENTS=6 CHECKS=4243	SAT TT=0.098 ASSIGNMENTS=94 CHECKS=36877	SAT TT=5.008	SAT TT=0.164 ASSIGNMENTS=623 CHECKS=92497	SAT TT=0.086 ASSIGNMENTS=10 CHECKS=9367	SAT TT=4.076	SAT TT=1.849	SAT TT=1.233
csp/pseudo/ppp/ normalized-ppp-1-11-19-21.xml		? (TO) TT=1800.09	? (MO) TT=7.447	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (MO) TT=18.45	? (TO) TT=1800.03	? (TO) TT=1800.04	? TT=415.35	? (TO) TT=1800.1	? (TO) TT=1800.06
csp/pseudo/ppp/ normalized-ppp-1-12-16.xml	SAT TT=7.417	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=85.287 CHECKS=3104980	? (TO) TT=1800.16	SAT TT=930.838 ASSIGNMENTS=194215	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=392.493 ASSIGNMENTS=174205 CHECKS=306943000	SAT TT=1148.91 ASSIGNMENTS=174205 CHECKS=306943000	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (exit code) TT=15.752	? (TO) TT=1800.02	SAT TT=379.522 ASSIGNMENTS=174205 CHECKS=306943000	? TT=269.88	SAT TT=7.417	SAT TT=8.337
csp/pseudo/ppp/ normalized-ppp-1-13.xml	SAT TT=8.717	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.97	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.07	? (exit code) TT=20.543	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=291.68	SAT TT=94.45	SAT TT=8.717
csp/pseudo/ppp/ normalized-ppp-1-3-13-19.xml	SAT TT=8.516	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (MO) TT=297.57	? (TO) TT=1800.03	? (TO) TT=1800.05	? TT=302.357	SAT TT=108.01	SAT TT=8.516
csp/pseudo/ppp/ normalized-ppp-1-9-16-19.xml		? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (exit code) TT=16.842	? (TO) TT=1800.08	? (TO) TT=1800.12	? TT=299.157	? (TO) TT=1800.08	? (TO) TT=1800.02
csp/pseudo/ppp/ normalized-ppp-3-13-25-26.xml	SAT TT=16.056	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=221.4 ASSIGNMENTS=130071 CHECKS=175138000	SAT TT=981.523 ASSIGNMENTS=130071 CHECKS=175138000	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.1	? (exit code) TT=17.596	? (TO) TT=1800.1	SAT TT=214.613 ASSIGNMENTS=130071 CHECKS=175138000	? TT=268.202	SAT TT=109.857	SAT TT=16.056
csp/pseudo/ primesDimacs/ normalized-bf-0432-007.xml	UNSAT TT=1.94	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.02	UNSAT TT=1256.28 CHECKS=782476000	UNSAT TT=1235.92 CHECKS=816716000	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=7.614	UNSAT TT=7.818	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=72.158	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=7.774	UNSAT TT=1.94	UNSAT TT=2.052
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ primesDimacs/ normalized-bf-1355-075.xml	UNSAT TT=1.021	UNSAT TT=7.156 CHECKS=98296 NODES=5660	UNSAT TT=12.961 CHECKS=137672 NODES=5652	? (TO) TT=1800.09	UNSAT TT=14.877 CHECKS=13263500	UNSAT TT=4.712 CHECKS=3585030	UNSAT TT=11.932 ASSIGNMENTS=326	? (TO) TT=1800.14	UNSAT TT=18.079 CHECKS=27469 NODES=104	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=1.236 ASSIGNMENTS=290 CHECKS=286640	UNSAT TT=1.021 ASSIGNMENTS=290 CHECKS=286640	UNSAT TT=18.743	UNSAT TT=20.224	UNSAT TT=1.122 ASSIGNMENTS=282 CHECKS=318791	UNSAT TT=5.285 ASSIGNMENTS=9653 CHECKS=4080640	UNSAT TT=114.214	UNSAT TT=784.844 ASSIGNMENTS=272907 CHECKS=246666000	UNSAT TT=1.161 ASSIGNMENTS=333 CHECKS=323600	UNSAT TT=8.264	UNSAT TT=2.426	UNSAT TT=3.08
csp/pseudo/ primesDimacs/ normalized-bf-1355-638.xml	UNSAT TT=1.038	UNSAT TT=8.287 CHECKS=163179 NODES=7933	UNSAT TT=11.663 CHECKS=217720 NODES=8047	? (TO) TT=1800.02	UNSAT TT=11.083 CHECKS=8958060	UNSAT TT=5.816 CHECKS=3866100	UNSAT TT=11.173 ASSIGNMENTS=642	? (TO) TT=1800.14	UNSAT TT=18.505 CHECKS=17795 NODES=113	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=1.066 ASSIGNMENTS=332 CHECKS=270840	UNSAT TT=1.038 ASSIGNMENTS=332 CHECKS=270840	UNSAT TT=18.426	UNSAT TT=17.976	UNSAT TT=1.128 ASSIGNMENTS=324 CHECKS=279024	UNSAT TT=5.448 ASSIGNMENTS=9567 CHECKS=4074000	UNSAT TT=94.874	UNSAT TT=319.55 ASSIGNMENTS=107294 CHECKS=72951900	UNSAT TT=1.056 ASSIGNMENTS=292 CHECKS=243472	UNSAT TT=8.556	UNSAT TT=2.371	UNSAT TT=2.62
csp/pseudo/ primesDimacs/ normalized-bf-2670-001.xml	UNSAT TT=0.758	UNSAT TT=4.319 CHECKS=175155 NODES=3944	UNSAT TT=5.957 CHECKS=216075 NODES=4189	? (TO) TT=1800.04	UNSAT TT=2.77 CHECKS=1358240	UNSAT TT=3.374 CHECKS=1504840	UNSAT TT=5.075 ASSIGNMENTS=715	UNSAT TT=5.27 ASSIGNMENTS=715	UNSAT TT=9.879 CHECKS=69756 NODES=833	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.905 ASSIGNMENTS=951 CHECKS=454543	UNSAT TT=0.913 ASSIGNMENTS=951 CHECKS=454543	UNSAT TT=8.008	UNSAT TT=7.867	UNSAT TT=1.013 ASSIGNMENTS=1143 CHECKS=549452	UNSAT TT=2.157 ASSIGNMENTS=11329 CHECKS=2067920	UNSAT TT=22.101	UNSAT TT=63.338 ASSIGNMENTS=97727 CHECKS=20923500	UNSAT TT=0.758 ASSIGNMENTS=656 CHECKS=323854	UNSAT TT=6.212	UNSAT TT=2.373	UNSAT TT=1.888
csp/pseudo/ primesDimacs/ normalized-f1000.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.08
csp/pseudo/ primesDimacs/ normalized-f2000.xml		? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/pseudo/ primesDimacs/ normalized-f600.xml		? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.12
csp/pseudo/ primesDimacs/ normalized-g-125-17.xml		? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.03	? (TO) TT=1800.12
csp/pseudo/ primesDimacs/ normalized-g-125-18.xml		? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/pseudo/ primesDimacs/ normalized-hanoi4.xml	SAT TT=2.365	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=1465.29	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.11	SAT TT=40.033 CHECKS=3044760 NODES=9216	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=9.233	SAT TT=8.603	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=81.875	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=9.202	SAT TT=2.365	SAT TT=2.475
csp/pseudo/ primesDimacs/ normalized-hanoi5.xml	SAT TT=5.43	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=32.439	SAT TT=35.235	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=237.339	SAT TT=14.201	SAT TT=5.43
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/radar/ normalized-radar-10-10-4.5-0.5-100.xml	SAT TT=0.036	SAT TT=1.326 CHECKS=4336 NODES=372	SAT TT=1.176 CHECKS=4570 NODES=0	SAT TT=0.154	SAT TT=0.066 CHECKS=6431	SAT TT=0.047 CHECKS=6596	SAT TT=1.365 ASSIGNMENTS=46	SAT TT=1.395 ASSIGNMENTS=46	SAT TT=2.143 CHECKS=5858 NODES=372	SAT TT=6.102 CHECKS=124518 NODES=2100100	SAT TT=3.427 CHECKS=5919430 NODES=772	SAT TT=0.055 ASSIGNMENTS=58 CHECKS=9106	SAT TT=0.055 ASSIGNMENTS=58 CHECKS=9106	Wrong Cert. TT=3.497	Wrong Cert. TT=3.564	SAT TT=0.041 ASSIGNMENTS=58 CHECKS=9106	SAT TT=0.036 ASSIGNMENTS=81 CHECKS=7956	SAT TT=0.835	SAT TT=0.048 ASSIGNMENTS=236 CHECKS=14489	SAT TT=0.042 ASSIGNMENTS=57 CHECKS=9112	SAT TT=11.039	SAT TT=1.423	SAT TT=1.51
csp/pseudo/radar/ normalized-radar-10-10-4.5-0.95-100.xml	SAT TT=0.047	SAT TT=1.424 CHECKS=4113 NODES=435	SAT TT=1.48 CHECKS=5379 NODES=0	SAT TT=0.176	SAT TT=0.077 CHECKS=8093	SAT TT=0.054 CHECKS=8344	SAT TT=1.588 ASSIGNMENTS=58	SAT TT=1.746 ASSIGNMENTS=58	SAT TT=1.747 CHECKS=7588 NODES=435	SAT TT=34.309 CHECKS=861164 NODES=13350100	SAT TT=50.726 CHECKS=234371000 NODES=27583	SAT TT=0.06 ASSIGNMENTS=55 CHECKS=9946	SAT TT=0.059 ASSIGNMENTS=55 CHECKS=9946	Wrong Cert. TT=3.36	Wrong Cert. TT=3.638	SAT TT=0.047 ASSIGNMENTS=55 CHECKS=9946	SAT TT=0.057 ASSIGNMENTS=347 CHECKS=27212	SAT TT=0.941	SAT TT=0.053 ASSIGNMENTS=131 CHECKS=9914	SAT TT=0.048 ASSIGNMENTS=74 CHECKS=9944	SAT TT=6.516	SAT TT=1.48	SAT TT=1.481
csp/pseudo/radar/ normalized-radar-10-10-4.5-0.95-98.xml	SAT TT=0.044	SAT TT=1.286 CHECKS=3485 NODES=411	SAT TT=1.186 CHECKS=4631 NODES=0	SAT TT=0.167	SAT TT=0.069 CHECKS=7944	SAT TT=0.051 CHECKS=7901	SAT TT=1.592 ASSIGNMENTS=41	SAT TT=1.407 ASSIGNMENTS=41	SAT TT=1.638 CHECKS=7280 NODES=411	SAT TT=32.163 CHECKS=781950 NODES=12750100	SAT TT=25.588 CHECKS=113900000 NODES=13790	SAT TT=0.055 ASSIGNMENTS=45 CHECKS=9120	SAT TT=0.057 ASSIGNMENTS=45 CHECKS=9120	Wrong Cert. TT=3.932	Wrong Cert. TT=4.114	SAT TT=0.047 ASSIGNMENTS=45 CHECKS=9120	SAT TT=0.045 ASSIGNMENTS=98 CHECKS=8213	SAT TT=0.831	SAT TT=0.086 ASSIGNMENTS=661 CHECKS=44723	SAT TT=0.044 ASSIGNMENTS=45 CHECKS=9101	SAT TT=6.061	SAT TT=1.271	SAT TT=1.653
csp/pseudo/radar/ normalized-radar-10-20-4.5-0.5-100.xml	SAT TT=0.086	SAT TT=1.835 CHECKS=10585 NODES=776	SAT TT=1.625 CHECKS=10200 NODES=0	SAT TT=0.261	SAT TT=0.138 CHECKS=14916	SAT TT=0.114 CHECKS=14960	SAT TT=2.021 ASSIGNMENTS=91	SAT TT=2.168 ASSIGNMENTS=91	SAT TT=7.723 CHECKS=12459 NODES=776	SAT TT=7.534 CHECKS=135740 NODES=900207	SAT TT=14.803 CHECKS=50382100 NODES=5509	SAT TT=0.092 ASSIGNMENTS=98 CHECKS=21935	SAT TT=0.106 ASSIGNMENTS=98 CHECKS=21935	Wrong Cert. TT=7.239	Wrong Cert. TT=6.562	SAT TT=0.088 ASSIGNMENTS=98 CHECKS=21935	SAT TT=0.086 ASSIGNMENTS=181 CHECKS=19281	SAT TT=1.053	SAT TT=0.201 ASSIGNMENTS=1128 CHECKS=102982	SAT TT=0.095 ASSIGNMENTS=112 CHECKS=21976	SAT TT=86.241	SAT TT=1.67	SAT TT=1.762
csp/pseudo/radar/ normalized-radar-10-20-4.5-0.95-100.xml	SAT TT=0.103	SAT TT=2.317 CHECKS=12164 NODES=934	SAT TT=1.842 CHECKS=12582 NODES=0	SAT TT=0.374	SAT TT=0.158 CHECKS=18372	SAT TT=0.113 CHECKS=17657	SAT TT=1.966 ASSIGNMENTS=78	SAT TT=2.331 ASSIGNMENTS=78	SAT TT=5.283 CHECKS=16390 NODES=934	SAT TT=548.821 CHECKS=15243600 NODES=96000300	SAT TT=56.226 CHECKS=206660000 NODES=23809	SAT TT=0.129 ASSIGNMENTS=86 CHECKS=26871	SAT TT=0.12 ASSIGNMENTS=86 CHECKS=26871	Wrong Cert. TT=7.303	Wrong Cert. TT=7.772	SAT TT=0.104 ASSIGNMENTS=86 CHECKS=26871	SAT TT=0.113 ASSIGNMENTS=423 CHECKS=45299	SAT TT=1.105	SAT TT=0.12 ASSIGNMENTS=305 CHECKS=26712	SAT TT=0.103 ASSIGNMENTS=98 CHECKS=26865	SAT TT=43.079	SAT TT=1.914	SAT TT=2.257
csp/pseudo/radar/ normalized-radar-10-20-4.5-0.95-98.xml	SAT TT=0.101	SAT TT=2.172 CHECKS=12591 NODES=906	SAT TT=1.645 CHECKS=12927 NODES=0	SAT TT=0.34	SAT TT=0.167 CHECKS=18199	SAT TT=0.119 CHECKS=17838	SAT TT=2.086 ASSIGNMENTS=69	SAT TT=2.32 ASSIGNMENTS=69	SAT TT=3.695 CHECKS=16274 NODES=906	SAT TT=401.955 CHECKS=12171800 NODES=79650300	SAT TT=188.945 CHECKS=746862000 NODES=87924	SAT TT=0.119 ASSIGNMENTS=76 CHECKS=25008	SAT TT=0.114 ASSIGNMENTS=76 CHECKS=25008	Wrong Cert. TT=5.543	Wrong Cert. TT=5.706	SAT TT=0.101 ASSIGNMENTS=76 CHECKS=25008	SAT TT=0.113 ASSIGNMENTS=380 CHECKS=41557	SAT TT=1.067	SAT TT=0.125 ASSIGNMENTS=275 CHECKS=24879	SAT TT=0.11 ASSIGNMENTS=75 CHECKS=25025	SAT TT=30.089	SAT TT=1.785	SAT TT=2.149
csp/pseudo/radar/ normalized-radar-30-30-4.5-0.5-100.xml	SAT TT=0.876	SAT TT=5.754 CHECKS=89373 NODES=4447	SAT TT=5.148 CHECKS=70991 NODES=0	SAT TT=1.695	SAT TT=1.38 CHECKS=89997	SAT TT=1.165 CHECKS=92120	SAT TT=5.357 ASSIGNMENTS=332	SAT TT=5.69 ASSIGNMENTS=332	SAT TT=140.923 CHECKS=77519 NODES=4447	? (TO) TT=1800.08	SAT TT=561.512 CHECKS=670038000 NODES=72999	SAT TT=1.051 ASSIGNMENTS=392 CHECKS=186616	SAT TT=1.052 ASSIGNMENTS=392 CHECKS=186616	Wrong Cert. TT=275.72	Wrong Cert. TT=315.247	SAT TT=0.876 ASSIGNMENTS=392 CHECKS=186616	SAT TT=0.984 ASSIGNMENTS=2960 CHECKS=598849	SAT TT=2.617	SAT TT=249.122 ASSIGNMENTS=70895 CHECKS=13330800	SAT TT=0.902 ASSIGNMENTS=386 CHECKS=186685	? (TO) TT=1800.15	SAT TT=3.85	SAT TT=5.108
csp/pseudo/radar/ normalized-radar-30-30-4.5-0.95-100.xml	SAT TT=0.875	SAT TT=5.716 CHECKS=75346 NODES=4617	SAT TT=4.973 CHECKS=70153 NODES=0	SAT TT=1.735	SAT TT=1.383 CHECKS=97380	SAT TT=1.116 CHECKS=98287	SAT TT=6.649 ASSIGNMENTS=430	SAT TT=6.297 ASSIGNMENTS=430	SAT TT=77.746 CHECKS=93265 NODES=4617	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.976 ASSIGNMENTS=501 CHECKS=157778	SAT TT=0.903 ASSIGNMENTS=501 CHECKS=157778	Wrong Cert. TT=47.9	Wrong Cert. TT=68.55	SAT TT=0.875 ASSIGNMENTS=501 CHECKS=157778	SAT TT=3.284 ASSIGNMENTS=17975 CHECKS=3051980	SAT TT=2.732	SAT TT=231.641 ASSIGNMENTS=73622 CHECKS=10459600	SAT TT=0.902 ASSIGNMENTS=397 CHECKS=157703	SAT TT=1484.3	SAT TT=3.913	SAT TT=5.291
csp/pseudo/radar/ normalized-radar-30-30-4.5-0.95-98.xml	SAT TT=0.814	SAT TT=5.421 CHECKS=74144 NODES=4624	SAT TT=4.859 CHECKS=68809 NODES=0	SAT TT=1.595	SAT TT=1.233 CHECKS=96767	SAT TT=1.115 CHECKS=96027	SAT TT=5.795 ASSIGNMENTS=415	SAT TT=5.929 ASSIGNMENTS=415	SAT TT=73.559 CHECKS=83902 NODES=4624	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=0.814 ASSIGNMENTS=448 CHECKS=154239	SAT TT=0.82 ASSIGNMENTS=448 CHECKS=154239	Wrong Cert. TT=37.708	Wrong Cert. TT=62.883	SAT TT=0.842 ASSIGNMENTS=448 CHECKS=154239	SAT TT=3.276 ASSIGNMENTS=19582 CHECKS=3131600	SAT TT=2.988	SAT TT=452.263 ASSIGNMENTS=104093 CHECKS=14025900	SAT TT=0.891 ASSIGNMENTS=435 CHECKS=154231	SAT TT=730.548	SAT TT=4.545	SAT TT=4.727
csp/pseudo/radar/ normalized-radar-30-70-4.5-0.5-100.xml	SAT TT=1.533	SAT TT=25.505 CHECKS=214996 NODES=10772	SAT TT=22.773 CHECKS=172713 NODES=0	SAT TT=4.184	SAT TT=14.503 CHECKS=231633	SAT TT=15.615 CHECKS=232213	SAT TT=14.939 ASSIGNMENTS=850	SAT TT=16.895 ASSIGNMENTS=850	SAT TT=187.598 CHECKS=191093 NODES=10772	? TT=106.329 CHECKS=164245 NODES=0	? TT=110.41 CHECKS=164069 NODES=0	SAT TT=1.604 ASSIGNMENTS=941 CHECKS=448309	SAT TT=1.605 ASSIGNMENTS=941 CHECKS=448309	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=1.683 ASSIGNMENTS=941 CHECKS=448309	SAT TT=1.533 ASSIGNMENTS=3045 CHECKS=447597	SAT TT=6.118	SAT TT=1.803 ASSIGNMENTS=2422 CHECKS=448511	SAT TT=1.831 ASSIGNMENTS=928 CHECKS=448228	? (TO) TT=1800.12	SAT TT=7.675	SAT TT=10.415
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/radar/ normalized-radar-30-70-4.5-0.95-100.xml	SAT TT=1.501	SAT TT=23.344 CHECKS=177903 NODES=10976	SAT TT=21.69 CHECKS=166790 NODES=0	SAT TT=4.288	SAT TT=14.353 CHECKS=233431	SAT TT=15.63 CHECKS=235580	SAT TT=14.798 ASSIGNMENTS=856	SAT TT=18.018 ASSIGNMENTS=856	SAT TT=135.161 CHECKS=220962 NODES=10976	? TT=53.939 CHECKS=170982 NODES=0	? TT=61.808 CHECKS=171085 NODES=0	SAT TT=1.563 ASSIGNMENTS=981 CHECKS=376839	SAT TT=1.571 ASSIGNMENTS=981 CHECKS=376839	Wrong Cert. TT=171.127	Wrong Cert. TT=375.601	SAT TT=1.613 ASSIGNMENTS=981 CHECKS=376839	SAT TT=1.501 ASSIGNMENTS=2976 CHECKS=376641	SAT TT=5.994	SAT TT=1.802 ASSIGNMENTS=2615 CHECKS=376844	SAT TT=1.566 ASSIGNMENTS=1042 CHECKS=376860	? (TO) TT=1800.1	SAT TT=8.309	SAT TT=10.522
csp/pseudo/radar/ normalized-radar-30-70-4.5-0.95-98.xml	SAT TT=1.48	SAT TT=24.703 CHECKS=182863 NODES=10990	SAT TT=20.81 CHECKS=167199 NODES=0	SAT TT=3.944	SAT TT=13.761 CHECKS=231852	SAT TT=15.845 CHECKS=233448	SAT TT=15.16 ASSIGNMENTS=892	SAT TT=14.342 ASSIGNMENTS=892	SAT TT=165.621 CHECKS=219565 NODES=10990	? TT=73.854 CHECKS=169196 NODES=0	? TT=79.171 CHECKS=169125 NODES=0	SAT TT=1.48 ASSIGNMENTS=965 CHECKS=384815	SAT TT=1.584 ASSIGNMENTS=965 CHECKS=384815	Wrong Cert. TT=205.62	Wrong Cert. TT=384.528	SAT TT=1.495 ASSIGNMENTS=965 CHECKS=384815	SAT TT=1.495 ASSIGNMENTS=3049 CHECKS=384204	SAT TT=5.91	SAT TT=1.89 ASSIGNMENTS=2670 CHECKS=384718	SAT TT=1.673 ASSIGNMENTS=1004 CHECKS=384754	? (TO) TT=1800.12	SAT TT=7.389	SAT TT=9.698
csp/pseudo/routing/ normalized-s3-3-3-1.xml	SAT TT=0.165	SAT TT=14.15 CHECKS=8356460 NODES=3646	SAT TT=10.001 CHECKS=5845300 NODES=2201	SAT TT=898.823	SAT TT=0.259 CHECKS=30227	SAT TT=0.23 CHECKS=30202	SAT TT=1.973 ASSIGNMENTS=1119	SAT TT=30.096 ASSIGNMENTS=180124	SAT TT=23.862 CHECKS=51383700 NODES=891	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=0.573 ASSIGNMENTS=1026 CHECKS=670839	SAT TT=0.548 ASSIGNMENTS=1026 CHECKS=670839	Wrong Cert. TT=2.818	Wrong Cert. TT=2.966	SAT TT=0.623 ASSIGNMENTS=1259 CHECKS=822169	SAT TT=1.661 ASSIGNMENTS=6610 CHECKS=2224080	SAT TT=1.135	SAT TT=1.201 ASSIGNMENTS=3037 CHECKS=966826	SAT TT=0.165 ASSIGNMENTS=369 CHECKS=167073	? TT=434.334	SAT TT=1.534	SAT TT=1.498
csp/pseudo/routing/ normalized-s3-3-3-2.xml	SAT TT=0.259	? (TO) TT=1800.15	SAT TT=376.504 CHECKS=210100000 NODES=17165	SAT TT=893.605	SAT TT=0.285 CHECKS=27068	SAT TT=0.259 CHECKS=26980	SAT TT=1.862 ASSIGNMENTS=698	SAT TT=344.679 ASSIGNMENTS=1759760	SAT TT=219.298 CHECKS=399000000 NODES=944	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=1.213 ASSIGNMENTS=2013 CHECKS=1548150	SAT TT=1.199 ASSIGNMENTS=2013 CHECKS=1548150	Wrong Cert. TT=8.591	Wrong Cert. TT=8.595	SAT TT=1.495 ASSIGNMENTS=2943 CHECKS=1970080	SAT TT=1.815 ASSIGNMENTS=6691 CHECKS=2403800	SAT TT=1.129	SAT TT=0.764 ASSIGNMENTS=2184 CHECKS=606330	SAT TT=0.376 ASSIGNMENTS=731 CHECKS=478232	? TT=233.332	SAT TT=1.215	SAT TT=1.208
csp/pseudo/routing/ normalized-s3-3-3-3.xml	SAT TT=0.177	SAT TT=22.11 CHECKS=13661100 NODES=1915	SAT TT=25.388 CHECKS=13904200 NODES=2489	SAT TT=3.411	SAT TT=0.98 CHECKS=184509	SAT TT=1.657 CHECKS=305361	SAT TT=1.728 ASSIGNMENTS=1095	SAT TT=12.906 ASSIGNMENTS=55946	SAT TT=83.182 CHECKS=187643000 NODES=961	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.208 ASSIGNMENTS=338 CHECKS=198751	SAT TT=0.205 ASSIGNMENTS=338 CHECKS=198751	Wrong Cert. TT=4.217	Wrong Cert. TT=3.997	SAT TT=0.177 ASSIGNMENTS=357 CHECKS=194747	SAT TT=0.956 ASSIGNMENTS=5230 CHECKS=1372310	SAT TT=0.976	SAT TT=1.303 ASSIGNMENTS=2366 CHECKS=733452	SAT TT=0.242 ASSIGNMENTS=597 CHECKS=284057	? TT=863.345	SAT TT=1.388	SAT TT=1.418
csp/pseudo/routing/ normalized-s3-3-3-4.xml	SAT TT=0.129	SAT TT=24.373 CHECKS=14317700 NODES=5497	SAT TT=36.949 CHECKS=22273400 NODES=10519	SAT TT=896.77	SAT TT=1.154 CHECKS=225197	SAT TT=0.581 CHECKS=102051	SAT TT=2.121 ASSIGNMENTS=1135	SAT TT=17.576 ASSIGNMENTS=83525	SAT TT=12.752 CHECKS=19297500 NODES=370	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=0.131 ASSIGNMENTS=216 CHECKS=92278	SAT TT=0.129 ASSIGNMENTS=216 CHECKS=92278	Wrong Cert. TT=3.937	Wrong Cert. TT=3.78	SAT TT=0.13 ASSIGNMENTS=271 CHECKS=129332	SAT TT=1.036 ASSIGNMENTS=5395 CHECKS=1472080	SAT TT=0.93	SAT TT=2.188 ASSIGNMENTS=4109 CHECKS=1605360	SAT TT=0.159 ASSIGNMENTS=311 CHECKS=153881	? TT=866.116	SAT TT=1.307	SAT TT=1.413
csp/pseudo/routing/ normalized-s3-3-3-5.xml	SAT TT=0.143	SAT TT=19.753 CHECKS=12106400 NODES=1401	SAT TT=1.987 CHECKS=481814 NODES=0	SAT TT=893.074	SAT TT=1.589 CHECKS=271924	SAT TT=1.363 CHECKS=234202	SAT TT=2.715 ASSIGNMENTS=3781	SAT TT=350.812 ASSIGNMENTS=1967270	SAT TT=9.807 CHECKS=38244 NODES=243	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.162 ASSIGNMENTS=273 CHECKS=128870	SAT TT=0.154 ASSIGNMENTS=273 CHECKS=128870	Wrong Cert. TT=3.839	Wrong Cert. TT=4.385	SAT TT=0.143 ASSIGNMENTS=268 CHECKS=128019	SAT TT=1.338 ASSIGNMENTS=6222 CHECKS=1946730	SAT TT=0.947	SAT TT=0.637 ASSIGNMENTS=1906 CHECKS=496858	SAT TT=0.161 ASSIGNMENTS=313 CHECKS=146457	? TT=207.688	SAT TT=1.158	SAT TT=1.189
csp/pseudo/routing/ normalized-s4-4-3-10.xml	SAT TT=1.851	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.08	SAT TT=714.126 CHECKS=113037000	SAT TT=346.673 CHECKS=53284700	SAT TT=67.755 ASSIGNMENTS=139606	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=585.333 ASSIGNMENTS=361214 CHECKS=418929000	SAT TT=618.491 ASSIGNMENTS=361214 CHECKS=418929000	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=627.07 ASSIGNMENTS=332522 CHECKS=471651000	SAT TT=116.662 ASSIGNMENTS=75487 CHECKS=87496900	SAT TT=8.992	SAT TT=745.97 ASSIGNMENTS=454432 CHECKS=401492000	SAT TT=569.279 ASSIGNMENTS=361214 CHECKS=418929000	? TT=228.42	SAT TT=1.851	SAT TT=2.103
csp/pseudo/routing/ normalized-s4-4-3-1.xml	SAT TT=2.412	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	SAT TT=348.164 CHECKS=65336600	? (TO) TT=1800.02	SAT TT=49.263 ASSIGNMENTS=104331	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=1143.33 ASSIGNMENTS=946779 CHECKS=901929000	SAT TT=1173.11 ASSIGNMENTS=946779 CHECKS=901929000	Wrong Cert. TT=475.067	Wrong Cert. TT=508.889	? (TO) TT=1800.09	SAT TT=31.884 ASSIGNMENTS=34430 CHECKS=28474600	? (TO) TT=1800.1	SAT TT=754.076 ASSIGNMENTS=583745 CHECKS=500745000	SAT TT=1108.59 ASSIGNMENTS=946779 CHECKS=901929000	? TT=220.063	SAT TT=2.412	SAT TT=3.221
csp/pseudo/routing/ normalized-s4-4-3-2.xml	SAT TT=2.062	? (TO) TT=1800.13	? (TO) TT=1800.11	SAT TT=1349.76	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=55.239 ASSIGNMENTS=127283	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=82.281 ASSIGNMENTS=64781 CHECKS=62146300	SAT TT=124.11 ASSIGNMENTS=64781 CHECKS=62146300	Wrong Cert. TT=236.383	Wrong Cert. TT=235.653	SAT TT=1111.19 ASSIGNMENTS=883703 CHECKS=936309000	SAT TT=1129.71 ASSIGNMENTS=812850 CHECKS=1025900000	SAT TT=93.435	? (TO) TT=1800.1	SAT TT=70.603 ASSIGNMENTS=64781 CHECKS=62146300	? TT=233.646	SAT TT=2.062	SAT TT=2.687
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/routing/ normalized-s4-4-3-3.xml	SAT TT=2.687	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=1252.36 CHECKS=258071000	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	Wrong Cert. TT=227.703	Wrong Cert. TT=230.09	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=292.826	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=1273.83	SAT TT=4.396	SAT TT=2.687
csp/pseudo/routing/ normalized-s4-4-3-4.xml	SAT TT=1.942	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.09	SAT TT=948.805 CHECKS=170461000	? (TO) TT=1800.11	SAT TT=9.58 ASSIGNMENTS=22126	SAT TT=774.258 ASSIGNMENTS=2055640	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=18.043 ASSIGNMENTS=8482 CHECKS=9559560	SAT TT=56.034 ASSIGNMENTS=8482 CHECKS=9559560	Wrong Cert. TT=1017.73	Wrong Cert. TT=973.514	SAT TT=1167.41 ASSIGNMENTS=811360 CHECKS=980026000	SAT TT=827.038 ASSIGNMENTS=558581 CHECKS=713791000	SAT TT=233.012	SAT TT=596.035 ASSIGNMENTS=455410 CHECKS=354587000	SAT TT=11.923 ASSIGNMENTS=8482 CHECKS=9559560	? TT=238.316	SAT TT=2.02	SAT TT=1.942
csp/pseudo/routing/ normalized-s4-4-3-5.xml	SAT TT=2.348	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	SAT TT=451.578 ASSIGNMENTS=1240490	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=1280.73 ASSIGNMENTS=729462 CHECKS=1024890000	SAT TT=466.262 ASSIGNMENTS=293825 CHECKS=369415000	SAT TT=103.319	? (TO) TT=1800.09	? (TO) TT=1800.05	? TT=250.146	SAT TT=2.348	SAT TT=3.079
csp/pseudo/routing/ normalized-s4-4-3-6.xml	SAT TT=1.577	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT TT=898.929	? (TO) TT=1800.08	SAT TT=322.117 CHECKS=66114800	SAT TT=23.156 ASSIGNMENTS=61151	SAT TT=883.436 ASSIGNMENTS=2963120	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=9.913 ASSIGNMENTS=2157 CHECKS=2020660	SAT TT=45.882 ASSIGNMENTS=2157 CHECKS=2020660	Wrong Cert. TT=124.222	Wrong Cert. TT=115.512	SAT TT=189.918 ASSIGNMENTS=182121 CHECKS=156986000	SAT TT=45.711 ASSIGNMENTS=51641 CHECKS=43571700	SAT TT=3.408	SAT TT=1311.72 ASSIGNMENTS=1223880 CHECKS=1011160000	SAT TT=2.415 ASSIGNMENTS=2157 CHECKS=2020660	? TT=224.588	SAT TT=1.577	SAT TT=15.071
csp/pseudo/routing/ normalized-s4-4-3-7.xml	SAT TT=2.849	? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=214.74 CHECKS=40191200	SAT TT=118.69 ASSIGNMENTS=308413	? (TO) TT=1800.18	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=78.628 ASSIGNMENTS=65127 CHECKS=57304100	SAT TT=113.435 ASSIGNMENTS=65127 CHECKS=57304100	Wrong Cert. TT=492.662	Wrong Cert. TT=501.154	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=83.266	SAT TT=936.736 ASSIGNMENTS=704807 CHECKS=497311000	SAT TT=68.592 ASSIGNMENTS=65127 CHECKS=57304100	? TT=230.073	SAT TT=2.849	SAT TT=8.755
csp/pseudo/routing/ normalized-s4-4-3-8.xml	SAT TT=1.898	SAT TT=193.134 CHECKS=127189000 NODES=57137	? (TO) TT=1800.11	SAT TT=1030.57	SAT TT=16.01 CHECKS=3359980	SAT TT=31.782 CHECKS=7173040	SAT TT=3.361 ASSIGNMENTS=6180	SAT TT=253.789 ASSIGNMENTS=828416	SAT TT=1130.57 CHECKS=2814190000 NODES=40957	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=48.233 ASSIGNMENTS=7609 CHECKS=4472960	SAT TT=48.21 ASSIGNMENTS=7609 CHECKS=4472960	Wrong Cert. TT=4.003	Wrong Cert. TT=3.697	SAT TT=16.701 ASSIGNMENTS=23841 CHECKS=18524800	SAT TT=5.035 ASSIGNMENTS=11778 CHECKS=5178070	SAT TT=1.971	SAT TT=97.975 ASSIGNMENTS=116307 CHECKS=51551200	SAT TT=4.393 ASSIGNMENTS=7609 CHECKS=4472960	? TT=866.223	SAT TT=1.898	SAT TT=2.552
csp/pseudo/routing/ normalized-s4-4-3-9.xml	SAT TT=2.248	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=950.913 ASSIGNMENTS=1613820	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=98.015 ASSIGNMENTS=46442 CHECKS=64568800	? (TO) TT=1800.06	SAT TT=1461.19 ASSIGNMENTS=802936 CHECKS=878707000	? (TO) TT=1800.05	? TT=250.912	SAT TT=2.248	SAT TT=2.357
csp/pseudo/ssa/ normalized-ssa-0432-003.xml	UNSAT TT=0.298	UNSAT TT=67.794 CHECKS=17319900 NODES=115972	UNSAT TT=47.533 CHECKS=10329100 NODES=83152	UNSAT TT=0.543	UNSAT TT=0.298 CHECKS=134508	UNSAT TT=0.384 CHECKS=296461	UNSAT TT=5.699 ASSIGNMENTS=7301	UNSAT TT=5.587 ASSIGNMENTS=7301	UNSAT TT=803.196 CHECKS=145049000 NODES=786797	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=43.326 ASSIGNMENTS=90077 CHECKS=45147400	UNSAT TT=76.576 ASSIGNMENTS=115966 CHECKS=17319900	UNSAT TT=4.312	UNSAT TT=4.283	UNSAT TT=25.691 ASSIGNMENTS=83408 CHECKS=36542000	UNSAT TT=33.26 ASSIGNMENTS=79659 CHECKS=47831900	UNSAT TT=3.296	UNSAT TT=82.105 ASSIGNMENTS=192025 CHECKS=88303200	UNSAT TT=31.735 ASSIGNMENTS=90077 CHECKS=45147400	UNSAT TT=4.201	UNSAT TT=1.312	UNSAT TT=1.807
csp/pseudo/ssa/ normalized-ssa-2670-130.xml	UNSAT TT=1.875	UNSAT TT=39.258 CHECKS=10931100 NODES=79830	UNSAT TT=53.557 CHECKS=15120200 NODES=105700	? (TO) TT=1800.03	UNSAT TT=223.818 CHECKS=85111100	UNSAT TT=107.613 CHECKS=48062400	UNSAT TT=179.144 ASSIGNMENTS=166440	UNSAT TT=174.23 ASSIGNMENTS=166440	UNSAT TT=827.407 CHECKS=57666800 NODES=194732	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=77.499 ASSIGNMENTS=62778 CHECKS=58091100	UNSAT TT=68.917 ASSIGNMENTS=142087 CHECKS=20250300	UNSAT TT=7.923	UNSAT TT=7.687	UNSAT TT=19.769 ASSIGNMENTS=20890 CHECKS=16809300	UNSAT TT=21.163 ASSIGNMENTS=26136 CHECKS=17147900	UNSAT TT=10.298	UNSAT TT=120.797 ASSIGNMENTS=149252 CHECKS=45695800	UNSAT TT=71.167 ASSIGNMENTS=62778 CHECKS=58091100	UNSAT TT=7.036	UNSAT TT=1.875	UNSAT TT=1.916
csp/pseudo/ssa/ normalized-ssa-2670-141.xml	UNSAT TT=1.618	UNSAT TT=115.509 CHECKS=39541600 NODES=423668	UNSAT TT=152.2 CHECKS=50122100 NODES=518679	? (TO) TT=1800.03	UNSAT TT=209.122 CHECKS=100853000	UNSAT TT=183.995 CHECKS=103197000	UNSAT TT=497.851 ASSIGNMENTS=481942	UNSAT TT=334.362 ASSIGNMENTS=481942	UNSAT TT=1612.47 CHECKS=168008000 NODES=608122	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=214.234 ASSIGNMENTS=290547 CHECKS=230652000	UNSAT TT=165.477 ASSIGNMENTS=566893 CHECKS=53130300	UNSAT TT=3.704	UNSAT TT=4.182	UNSAT TT=45.511 ASSIGNMENTS=75002 CHECKS=50539200	UNSAT TT=41.691 ASSIGNMENTS=66685 CHECKS=47819500	UNSAT TT=6.635	UNSAT TT=476.424 ASSIGNMENTS=521618 CHECKS=315898000	UNSAT TT=204.684 ASSIGNMENTS=290547 CHECKS=230652000	UNSAT TT=5.882	UNSAT TT=1.618	UNSAT TT=1.657
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ssa/ normalized-ssa-6288-047.xml	UNSAT TT=2.52	UNSAT TT=22.678 CHECKS=791 NODES=0	UNSAT TT=23.555 CHECKS=791 NODES=0	UNSAT TT=10.197	UNSAT TT=17.256 CHECKS=45469	UNSAT TT=14.187 CHECKS=45469	UNSAT TT=30.377 ASSIGNMENTS=0	UNSAT TT=28.175 ASSIGNMENTS=0	UNSAT TT=345.964 CHECKS=2027 NODES=0	UNSAT TT=355.62 CHECKS=3956 NODES=0	UNSAT TT=401.097 CHECKS=3956 NODES=0	UNSAT TT=2.69 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=2.683 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=417.548	UNSAT TT=223.157	UNSAT TT=2.657 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=2.52 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=22.751	UNSAT TT=2.637 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=2.649 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=10.811	UNSAT TT=8.68	UNSAT TT=9.353
csp/pseudo/ssa/ normalized-ssa-7552-038.xml	SAT TT=0.336	SAT TT=3.985 CHECKS=61821 NODES=4149	SAT TT=6.493 CHECKS=97109 NODES=4100	SAT TT=1799.09	SAT TT=8.52 CHECKS=6664050	SAT TT=5.069 CHECKS=3594130	SAT TT=6.876 ASSIGNMENTS=1206	SAT TT=6.374 ASSIGNMENTS=1206	SAT TT=8.048 CHECKS=19334 NODES=3034	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=8.6 ASSIGNMENTS=1224 CHECKS=455939	SAT TT=10.506 ASSIGNMENTS=4145 CHECKS=61584	SAT TT=12.084	SAT TT=12.182	SAT TT=5.369 ASSIGNMENTS=11874 CHECKS=4911170	SAT TT=0.336 ASSIGNMENTS=216 CHECKS=20447	SAT TT=7.661	SAT TT=3.052 ASSIGNMENTS=3051 CHECKS=661481	SAT TT=0.732 ASSIGNMENTS=1224 CHECKS=455939	SAT TT=7.426	SAT TT=2.013	SAT TT=2.348
csp/pseudo/ssa/ normalized-ssa-7552-158.xml	SAT TT=0.26	SAT TT=3.473 CHECKS=15039 NODES=2726	SAT TT=5.482 CHECKS=43370 NODES=2726	SAT TT=0.89	SAT TT=6.006 CHECKS=4600080	SAT TT=4.03 CHECKS=3241330	SAT TT=4.948 ASSIGNMENTS=134	SAT TT=5.047 ASSIGNMENTS=134	SAT TT=6.947 CHECKS=17650 NODES=2757	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=0.291 ASSIGNMENTS=142 CHECKS=15319	SAT TT=0.292 ASSIGNMENTS=142 CHECKS=15319	SAT TT=11.312	SAT TT=11.538	SAT TT=0.26 ASSIGNMENTS=142 CHECKS=15322	SAT TT=0.276 ASSIGNMENTS=210 CHECKS=14574	SAT TT=20.763	SAT TT=2.887 ASSIGNMENTS=7016 CHECKS=652881	SAT TT=0.26 ASSIGNMENTS=135 CHECKS=13865	SAT TT=6.989	SAT TT=1.892	SAT TT=2.185
csp/pseudo/ssa/ normalized-ssa-7552-159.xml	SAT TT=0.271	SAT TT=3.23 CHECKS=15826 NODES=2728	SAT TT=4.947 CHECKS=43322 NODES=2728	SAT TT=0.891	SAT TT=7.027 CHECKS=5525820	SAT TT=3.985 CHECKS=3182480	SAT TT=5.187 ASSIGNMENTS=144	SAT TT=5.112 ASSIGNMENTS=144	SAT TT=6.52 CHECKS=17785 NODES=2757	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=0.299 ASSIGNMENTS=159 CHECKS=19325	SAT TT=0.3 ASSIGNMENTS=159 CHECKS=19325	SAT TT=11.323	SAT TT=11.493	SAT TT=0.29 ASSIGNMENTS=170 CHECKS=24861	SAT TT=0.285 ASSIGNMENTS=182 CHECKS=14459	SAT TT=15.832	SAT TT=2.653 ASSIGNMENTS=5221 CHECKS=490847	SAT TT=0.271 ASSIGNMENTS=153 CHECKS=15403	SAT TT=6.648	SAT TT=1.947	SAT TT=2.055
csp/pseudo/ssa/ normalized-ssa-7552-160.xml	SAT TT=0.292	SAT TT=3.362 CHECKS=18673 NODES=2788	SAT TT=4.447 CHECKS=51359 NODES=0	SAT TT=0.985	SAT TT=6.924 CHECKS=5644880	SAT TT=4.595 CHECKS=3379640	SAT TT=5.385 ASSIGNMENTS=139	SAT TT=5.152 ASSIGNMENTS=139	SAT TT=7.121 CHECKS=18907 NODES=2817	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.785 ASSIGNMENTS=1377 CHECKS=519920	SAT TT=0.783 ASSIGNMENTS=1377 CHECKS=519920	SAT TT=9.867	SAT TT=9.776	SAT TT=0.407 ASSIGNMENTS=451 CHECKS=133595	SAT TT=0.292 ASSIGNMENTS=175 CHECKS=16519	SAT TT=5.194	SAT TT=2.269 ASSIGNMENTS=3735 CHECKS=456520	SAT TT=0.31 ASSIGNMENTS=180 CHECKS=30534	SAT TT=6.648	SAT TT=2.217	SAT TT=2.484
csp/pseudo/ttp/ normalized-circ-4-3.xml	SAT TT=0.08	SAT TT=1.667 CHECKS=17194 NODES=488	SAT TT=1.336 CHECKS=4809 NODES=0	SAT TT=1.123	SAT TT=0.639 CHECKS=100384	SAT TT=0.61 CHECKS=98983	SAT TT=1.929 ASSIGNMENTS=302	SAT TT=1.593 ASSIGNMENTS=78	SAT TT=1.585 CHECKS=4097 NODES=148	SAT TT=2.203 CHECKS=1035660 NODES=7376	SAT TT=1.482 CHECKS=90225 NODES=160	SAT TT=0.123 ASSIGNMENTS=93 CHECKS=62074	SAT TT=0.129 ASSIGNMENTS=93 CHECKS=62074	Wrong UNSAT TT=2.237	Wrong UNSAT TT=2.311	SAT TT=0.122 ASSIGNMENTS=143 CHECKS=86225	SAT TT=0.103 ASSIGNMENTS=113 CHECKS=59010	SAT TT=1.261	SAT TT=0.08 ASSIGNMENTS=34 CHECKS=15972	SAT TT=0.122 ASSIGNMENTS=104 CHECKS=76973	SAT TT=5.125	SAT TT=1.394	SAT TT=1.155
csp/pseudo/ttp/ normalized-circ-8-3.xml	SAT TT=17.092	? (TO) TT=1800.15	SAT TT=810.724 CHECKS=43264900 NODES=198694	? (TO) TT=1800.03	SAT TT=320.371 CHECKS=15876400	SAT TT=349.909 CHECKS=17755200	SAT TT=80.539 ASSIGNMENTS=22310	? (TO) TT=1800.09	SAT TT=118.903 CHECKS=2921390 NODES=1939	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=134.499 ASSIGNMENTS=63426 CHECKS=7925780	SAT TT=133.902 ASSIGNMENTS=63426 CHECKS=7925780	Wrong UNSAT TT=535.641	Wrong UNSAT TT=565.076	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=767.23 ASSIGNMENTS=21464 CHECKS=416750000	? TT=488.945	SAT TT=17.092	SAT TT=27.931
csp/pseudo/ttp/ normalized-data-6-3.xml	SAT TT=3.588	SAT TT=12.839 CHECKS=584163 NODES=8984	SAT TT=13.694 CHECKS=747346 NODES=10248	? (TO) TT=1800.03	SAT TT=26.028 CHECKS=2210310	SAT TT=17.377 CHECKS=1300180	SAT TT=6.925 ASSIGNMENTS=2445	SAT TT=36.113 ASSIGNMENTS=27194	SAT TT=34.832 CHECKS=83261 NODES=677	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=16.787 ASSIGNMENTS=6593 CHECKS=499480	SAT TT=16.742 ASSIGNMENTS=6593 CHECKS=499480	Wrong UNSAT TT=11.489	Wrong UNSAT TT=11.573	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=94.262 ASSIGNMENTS=11862 CHECKS=57986600	SAT TT=11.633 ASSIGNMENTS=1536 CHECKS=7151380	? TT=217.951	SAT TT=3.689	SAT TT=3.588
csp/pseudo/ttp/ normalized-data-8-3.xml	SAT TT=17.557	? (TO) TT=1800.15	SAT TT=826.24 CHECKS=43264900 NODES=198694	? (TO) TT=1800.11	SAT TT=339.49 CHECKS=19143000	SAT TT=710.767 CHECKS=38680600	SAT TT=90.297 ASSIGNMENTS=22310	? (TO) TT=1800.14	SAT TT=120.084 CHECKS=2921390 NODES=1939	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=138.837 ASSIGNMENTS=63426 CHECKS=7925780	SAT TT=137.892 ASSIGNMENTS=63426 CHECKS=7925780	Wrong UNSAT TT=574.925	Wrong UNSAT TT=544.635	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=1006.39 ASSIGNMENTS=21464 CHECKS=416750000	? TT=353.593	SAT TT=17.557	SAT TT=27.876
csp/pseudo/uclid/ normalized-22s-smv.xml	UNSAT TT=25.823	UNSAT TT=718.577 CHECKS=119897000 NODES=508834	UNSAT TT=951.029 CHECKS=143993000 NODES=693595	? (TO) TT=1800.08	UNSAT TT=25.823 CHECKS=11009000	UNSAT TT=325.929 CHECKS=45990200	UNSAT TT=26.194 ASSIGNMENTS=0	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=384.459	UNSAT TT=31.104 ASSIGNMENTS=54207 CHECKS=22373800	? (TO) TT=1800.1	? TT=484.289	? (MO) TT=70.3	? (MO) TT=268.54
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/uclid/ normalized-37s-smv.xml	UNSAT TT=2.663	UNSAT TT=87.937 CHECKS=13267400 NODES=75094	UNSAT TT=98.718 CHECKS=12752900 NODES=77610	UNSAT TT=214.017	UNSAT TT=389.223 CHECKS=83135600	UNSAT TT=673.092 CHECKS=153648000	UNSAT TT=500.187 ASSIGNMENTS=483920	UNSAT TT=60.46 ASSIGNMENTS=46176	UNSAT TT=324.58 CHECKS=73676000 NODES=148518	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=24.976 ASSIGNMENTS=42669 CHECKS=16490000	UNSAT TT=90.854 ASSIGNMENTS=75094 CHECKS=13267400	UNSAT TT=10.086	UNSAT TT=9.285	UNSAT TT=122.844 ASSIGNMENTS=229315 CHECKS=141101000	UNSAT TT=71.94 ASSIGNMENTS=123784 CHECKS=78168300	UNSAT TT=54.053	? (TO) TT=1800.04	UNSAT TT=15.997 ASSIGNMENTS=42669 CHECKS=16490000	UNSAT TT=9.152	UNSAT TT=2.663	UNSAT TT=3.75
csp/pseudo/uclid/ normalized-43s-smv.xml	UNSAT TT=93.958	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.06	Wrong Cert. TT=204.394	Wrong Cert. TT=931.325	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=401.908	UNSAT TT=93.958	UNSAT TT=195.867
csp/pseudo/uclid/ normalized-44s-smv.xml	UNSAT TT=5.33	UNSAT TT=50.445 CHECKS=14484600 NODES=76972	UNSAT TT=45.018 CHECKS=11241800 NODES=77829	? (TO) TT=1800.07	UNSAT TT=103.26 CHECKS=11890700	UNSAT TT=96.554 CHECKS=13044800	UNSAT TT=73.293 ASSIGNMENTS=273394	? (TO) TT=1800.15	UNSAT TT=79.916 CHECKS=18628800 NODES=179941	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=492.506 ASSIGNMENTS=418658 CHECKS=714841000	UNSAT TT=52.668 ASSIGNMENTS=76963 CHECKS=14484600	Wrong Cert. TT=12.231	Wrong Cert. TT=12.65	UNSAT TT=67.703 ASSIGNMENTS=71468 CHECKS=97553200	UNSAT TT=175.009 ASSIGNMENTS=133658 CHECKS=261120000	UNSAT TT=3.955	? (TO) TT=1800.06	UNSAT TT=486.059 ASSIGNMENTS=418658 CHECKS=714841000	UNSAT TT=18.219	UNSAT TT=5.33	UNSAT TT=10.357
csp/pseudo/uclid/ normalized-46s-smv.xml	UNSAT TT=11.623	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	Wrong Cert. TT=39.757	Wrong Cert. TT=50.397	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=48.599	UNSAT TT=11.623	UNSAT TT=28.601
csp/pseudo/uclid/ normalized-blast-floppy1-4.xml	SAT TT=0.046	SAT TT=2.026 CHECKS=146231 NODES=241	SAT TT=1.999 CHECKS=147760 NODES=0	SAT TT=0.143	SAT TT=0.225 CHECKS=10535	SAT TT=0.214 CHECKS=10382	SAT TT=1.13 ASSIGNMENTS=268	SAT TT=1.251 ASSIGNMENTS=75	SAT TT=11.983 CHECKS=949685 NODES=595	SAT TT=4.368 CHECKS=162600 NODES=34	SAT TT=4.431 CHECKS=164786 NODES=24	SAT TT=0.061 ASSIGNMENTS=156 CHECKS=18373	SAT TT=0.06 ASSIGNMENTS=156 CHECKS=18373	Wrong Cert. TT=47.156	Wrong Cert. TT=41.801	SAT TT=0.046 ASSIGNMENTS=156 CHECKS=18373	SAT TT=0.069 ASSIGNMENTS=387 CHECKS=62613	SAT TT=0.704	SAT TT=20.502 ASSIGNMENTS=179234 CHECKS=12037300	SAT TT=0.051 ASSIGNMENTS=153 CHECKS=18196	SAT TT=303.234	SAT TT=26.056	SAT TT=120.061
csp/pseudo/uclid/ normalized-blast-floppy1-7.xml	UNSAT TT=0.666	UNSAT TT=663.041 CHECKS=273666000 NODES=430	UNSAT TT=911.183 CHECKS=382944000 NODES=410	UNSAT TT=2.763	UNSAT TT=1.079 CHECKS=3907	UNSAT TT=1.371 CHECKS=9043	UNSAT TT=4.718 ASSIGNMENTS=0	UNSAT TT=4.582 ASSIGNMENTS=0	UNSAT TT=351.755 CHECKS=434108000 NODES=2	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=0.723 ASSIGNMENTS=1 CHECKS=101483	UNSAT TT=0.722 ASSIGNMENTS=1 CHECKS=101483	? (problem) TT=49.452	? (problem) TT=49.241	UNSAT TT=0.666 ASSIGNMENTS=1 CHECKS=101483	UNSAT TT=39.211 ASSIGNMENTS=49980 CHECKS=46305600	UNSAT TT=84.165	UNSAT TT=0.725 ASSIGNMENTS=2 CHECKS=107550	UNSAT TT=0.849 ASSIGNMENTS=5 CHECKS=192020	? TT=426.602	? TT=167.298	? TT=170.784
csp/pseudo/uclid/ normalized-blast-tlan3.xml	SAT TT=8.804	SAT TT=306.078 CHECKS=12140800 NODES=52024	SAT TT=566.465 CHECKS=12767000 NODES=52040	SAT TT=24.592	SAT TT=101.289 CHECKS=12864400	SAT TT=99.173 CHECKS=1057690	SAT TT=648.564 ASSIGNMENTS=3233	? (TO) TT=1800.18	SAT TT=1643.71 CHECKS=51654100 NODES=25505	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=94.588 ASSIGNMENTS=19952 CHECKS=2651060	SAT TT=94.8 ASSIGNMENTS=19952 CHECKS=2651060	? (problem) TT=267.233	? (problem) TT=275.675	SAT TT=8.804 ASSIGNMENTS=1713 CHECKS=3047720	? (TO) TT=1800.12	SAT TT=48.804	? (TO) TT=1800.12	SAT TT=9.992 ASSIGNMENTS=1718 CHECKS=3027510	? TT=591.112	? TT=173.949	? TT=181.396
csp/pseudo/uclid/ normalized-cache-ibm-q-unbounded-Icl2arity-ucl.xml	UNSAT TT=140.591	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.16	? (TO) TT=1800.05	? TT=1174.03 CHECKS=370173 NODES=0	? TT=1191.08 CHECKS=370173 NODES=0	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=533.29	UNSAT TT=519.142	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=399.397	UNSAT TT=140.591	UNSAT TT=253.6
csp/pseudo/uclid/ normalized-elf-rf6.xml	UNSAT TT=0.014	UNSAT TT=0.862 CHECKS=525 NODES=18	UNSAT TT=0.856 CHECKS=811 NODES=0	UNSAT TT=0.052	UNSAT TT=0.023 CHECKS=1321	UNSAT TT=0.018 CHECKS=1203	UNSAT TT=0.764 ASSIGNMENTS=0	UNSAT TT=0.779 ASSIGNMENTS=0	UNSAT TT=0.857 CHECKS=749 NODES=5	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.028 ASSIGNMENTS=3 CHECKS=772	UNSAT TT=0.025 ASSIGNMENTS=3 CHECKS=772	Wrong Cert. TT=2.016	Wrong Cert. TT=1.906	UNSAT TT=0.016 ASSIGNMENTS=19 CHECKS=3367	UNSAT TT=0.056 ASSIGNMENTS=647 CHECKS=69852	UNSAT TT=0.533	UNSAT TT=0.015 ASSIGNMENTS=10 CHECKS=1206	UNSAT TT=0.014 ASSIGNMENTS=3 CHECKS=772	UNSAT TT=1.649	UNSAT TT=0.708	UNSAT TT=0.682
csp/pseudo/uclid/ normalized-elf-rf8.xml	UNSAT TT=7.811	UNSAT TT=26.774 CHECKS=2650340 NODES=16891	UNSAT TT=62.814 CHECKS=4753880 NODES=15612	? (TO) TT=1800.09	UNSAT TT=71.863 CHECKS=22158200	UNSAT TT=37.627 CHECKS=5729870	UNSAT TT=171.47 ASSIGNMENTS=11133	? (TO) TT=1800.1	UNSAT TT=110.433 CHECKS=1241940 NODES=2103	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=17.4 ASSIGNMENTS=3265 CHECKS=7081820	UNSAT TT=36.659 ASSIGNMENTS=16891 CHECKS=2650340	Wrong Cert. TT=83.67	Wrong Cert. TT=137.229	UNSAT TT=22.484 ASSIGNMENTS=8031 CHECKS=20453600	UNSAT TT=19.389 ASSIGNMENTS=26824 CHECKS=15519500	UNSAT TT=20.641	UNSAT TT=49.978 ASSIGNMENTS=32218 CHECKS=36334900	UNSAT TT=9.493 ASSIGNMENTS=3265 CHECKS=7081820	UNSAT TT=26.823	UNSAT TT=7.811	UNSAT TT=18.498
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/uclid/ normalized-elf-rf9.xml	UNSAT TT=34.642	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.11	UNSAT TT=1607.25 CHECKS=337241000	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1846.07	? TT=861.637 CHECKS=311880 NODES=0	? TT=876.546 CHECKS=309277 NODES=0	UNSAT TT=558.807 ASSIGNMENTS=43991 CHECKS=177041000	UNSAT TT=1012.26 ASSIGNMENTS=43991 CHECKS=177041000	Wrong Cert. TT=798.713	? (TO) TT=1800.08	UNSAT TT=331.337 ASSIGNMENTS=83654 CHECKS=267958000	UNSAT TT=198.187 ASSIGNMENTS=95084 CHECKS=139816000	? (TO) TT=1800.04	? (TO) TT=1800.14	UNSAT TT=220.647 ASSIGNMENTS=43991 CHECKS=177041000	UNSAT TT=135.041	UNSAT TT=34.642	UNSAT TT=109.246
csp/pseudo/uclid/ normalized-ooo-burch-dill-4-accl.xml	UNSAT TT=22.61	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=63.355	UNSAT TT=44.046	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=64.754	UNSAT TT=22.61	UNSAT TT=52.781
csp/pseudo/uclid/ normalized-ooo-burch-dill-8-accl.xml		? (TO) TT=1800.22	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.01	? TT=1020.73 CHECKS=311195 NODES=0	? TT=928.62 CHECKS=311195 NODES=0	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=678.531	UNSAT TT=425.42	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05	? TT=1118.06	? (TO) TT=1800.08	? (TO) TT=1800.09
csp/pseudo/uclid/ normalized-ooo-rf10.xml	UNSAT TT=59.254	? (TO) TT=1800.18	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.07	? TT=1556.28 CHECKS=25012000 NODES=600000	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.03	Wrong Cert. TT=468.035	Wrong Cert. TT=499.765	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=598.623	UNSAT TT=59.254	UNSAT TT=64.058
csp/pseudo/uclid/ normalized-ooo-rf8.xml	UNSAT TT=7.511	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	Wrong Cert. TT=82.715	Wrong Cert. TT=96.651	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=505.96	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=30.381	UNSAT TT=7.511	UNSAT TT=12.707
csp/pseudo/uclid/ normalized-ooo-tag10.xml	UNSAT TT=17.802	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.06	Wrong Cert. TT=146.604	Wrong Cert. TT=191.221	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.12	UNSAT TT=370.497	UNSAT TT=17.802	UNSAT TT=27.609
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-0.xml	SAT TT=0.037	SAT TT=1.99 CHECKS=274420 NODES=359	SAT TT=1.908 CHECKS=375817 NODES=217	SAT TT=1786.74	SAT TT=0.734 CHECKS=17338	SAT TT=0.143 CHECKS=11211	SAT TT=1.577 ASSIGNMENTS=202	SAT TT=2.202 ASSIGNMENTS=93	SAT TT=123.874 CHECKS=214630 NODES=312	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=0.058 ASSIGNMENTS=144 CHECKS=14389	SAT TT=0.056 ASSIGNMENTS=144 CHECKS=14389	? (problem) TT=113.8	? (problem) TT=111.747	SAT TT=0.044 ASSIGNMENTS=134 CHECKS=12242	SAT TT=0.044 ASSIGNMENTS=376 CHECKS=18579	? TT=0.303	SAT TT=0.039 ASSIGNMENTS=102 CHECKS=5235	SAT TT=0.037 ASSIGNMENTS=110 CHECKS=5330	? (TO) TT=1802.39	SAT TT=1.335	SAT TT=1.716
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-18.xml	UNSAT TT=0.034	UNSAT TT=1.709 CHECKS=262672 NODES=0	UNSAT TT=1.817 CHECKS=262672 NODES=0	UNSAT TT=0.081	UNSAT TT=0.641 CHECKS=123	UNSAT TT=0.078 CHECKS=123	UNSAT TT=1.085 ASSIGNMENTS=0	UNSAT TT=0.927 ASSIGNMENTS=0	UNSAT TT=130.956 CHECKS=4936 NODES=0	UNSAT TT=92.215 CHECKS=5476 NODES=0	UNSAT TT=93.858 CHECKS=5476 NODES=0	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=1025	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=1025	? (problem) TT=113.654	? (problem) TT=115.62	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1025	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1025	? TT=0.343	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1025	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1025	? TT=630.553	UNSAT TT=1.311	UNSAT TT=1.633
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-19.xml	UNSAT TT=0.033	UNSAT TT=1.494 CHECKS=21697 NODES=0	UNSAT TT=1.396 CHECKS=21697 NODES=0	UNSAT TT=0.083	UNSAT TT=0.652 CHECKS=133	UNSAT TT=0.07 CHECKS=133	UNSAT TT=0.914 ASSIGNMENTS=0	UNSAT TT=1.137 ASSIGNMENTS=0	UNSAT TT=136.984 CHECKS=16818800 NODES=0	UNSAT TT=97.564 CHECKS=16818800 NODES=0	UNSAT TT=111.113 CHECKS=16818800 NODES=0	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1835	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1835	? (problem) TT=124.348	? (problem) TT=126.262	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1835	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1835	? TT=0.373	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=1835	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1835	? (TO) TT=1802.16	UNSAT TT=1.324	UNSAT TT=1.507
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-1.xml	UNSAT TT=0.032	UNSAT TT=1.333 CHECKS=72974 NODES=0	UNSAT TT=1.344 CHECKS=72974 NODES=0	UNSAT TT=0.085	UNSAT TT=0.64 CHECKS=134	UNSAT TT=0.063 CHECKS=134	UNSAT TT=0.897 ASSIGNMENTS=0	UNSAT TT=0.929 ASSIGNMENTS=0	UNSAT TT=135.277 CHECKS=177618 NODES=0	UNSAT TT=180.016 CHECKS=177618 NODES=0	UNSAT TT=161.983 CHECKS=177618 NODES=0	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=1738	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=1738	? (problem) TT=119.52	? (problem) TT=119.949	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1738	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1738	? TT=0.372	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=1738	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=1738	? TT=265.782	UNSAT TT=1.433	UNSAT TT=1.327
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-21.xml	SAT TT=0.04	SAT TT=5.034 CHECKS=2286150 NODES=238	SAT TT=5.482 CHECKS=2422120 NODES=152	? (TO) TT=1800.03	SAT TT=0.802 CHECKS=3897	SAT TT=0.13 CHECKS=3836	SAT TT=1.603 ASSIGNMENTS=122	SAT TT=2.134 ASSIGNMENTS=100	SAT TT=130.515 CHECKS=5678540 NODES=526	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=0.053 ASSIGNMENTS=102 CHECKS=5317	SAT TT=0.054 ASSIGNMENTS=102 CHECKS=5317	? (problem) TT=131.499	? (problem) TT=125.393	SAT TT=0.04 ASSIGNMENTS=109 CHECKS=5905	SAT TT=0.043 ASSIGNMENTS=179 CHECKS=9126	? TT=0.359	SAT TT=0.112 ASSIGNMENTS=782 CHECKS=58762	SAT TT=0.048 ASSIGNMENTS=173 CHECKS=15422	? TT=1717.13	SAT TT=1.574	SAT TT=1.533
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-22.xml	SAT TT=0.036	SAT TT=3.5 CHECKS=1159850 NODES=151	SAT TT=26.005 CHECKS=13977300 NODES=288	? (TO) TT=1800.08	SAT TT=0.635 CHECKS=6818	SAT TT=0.091 CHECKS=6096	SAT TT=1.512 ASSIGNMENTS=111	SAT TT=1.87 ASSIGNMENTS=101	SAT TT=116.951 CHECKS=16955000 NODES=182	SAT TT=1187.78 CHECKS=110177000 NODES=1633050000	? (TO) TT=1800.05	SAT TT=0.049 ASSIGNMENTS=114 CHECKS=5420	SAT TT=0.048 ASSIGNMENTS=114 CHECKS=5420	? (problem) TT=119.445	? (problem) TT=109.979	SAT TT=0.038 ASSIGNMENTS=110 CHECKS=5394	SAT TT=0.045 ASSIGNMENTS=428 CHECKS=20474	? TT=0.375	SAT TT=0.105 ASSIGNMENTS=884 CHECKS=49855	SAT TT=0.036 ASSIGNMENTS=106 CHECKS=4578	? TT=250.865	SAT TT=1.392	SAT TT=1.413
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-23.xml	SAT TT=0.037	SAT TT=55.014 CHECKS=28898600 NODES=322	SAT TT=4.636 CHECKS=1847930 NODES=144	SAT TT=0.086	SAT TT=0.67 CHECKS=3248	SAT TT=0.085 CHECKS=3266	SAT TT=1.455 ASSIGNMENTS=103	SAT TT=2.043 ASSIGNMENTS=97	SAT TT=138.042 CHECKS=16979700 NODES=255	SAT TT=742.013 CHECKS=63239200 NODES=967800000	? (TO) TT=1800.1	SAT TT=0.046 ASSIGNMENTS=97 CHECKS=4764	SAT TT=0.051 ASSIGNMENTS=97 CHECKS=4764	? (problem) TT=93.396	? (problem) TT=84.924	SAT TT=0.037 ASSIGNMENTS=97 CHECKS=4764	SAT TT=0.04 ASSIGNMENTS=217 CHECKS=8971	? TT=0.368	SAT TT=0.044 ASSIGNMENTS=199 CHECKS=8461	SAT TT=0.043 ASSIGNMENTS=106 CHECKS=7137	? TT=714.92	SAT TT=1.613	SAT TT=1.572
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-27.xml	SAT TT=0.044	SAT TT=3.492 CHECKS=1407370 NODES=146	SAT TT=3.708 CHECKS=1577680 NODES=202	SAT TT=0.09	SAT TT=0.8 CHECKS=3005	SAT TT=0.109 CHECKS=2834	SAT TT=1.551 ASSIGNMENTS=238	SAT TT=2.153 ASSIGNMENTS=105	SAT TT=124.316 CHECKS=4595180 NODES=326	? (TO) TT=1800.04	? (TO) TT=1800	SAT TT=0.057 ASSIGNMENTS=145 CHECKS=10547	SAT TT=0.058 ASSIGNMENTS=145 CHECKS=10547	? (problem) TT=115.985	? (problem) TT=119.797	SAT TT=0.044 ASSIGNMENTS=154 CHECKS=11097	SAT TT=0.044 ASSIGNMENTS=294 CHECKS=14090	? TT=0.374	SAT TT=0.049 ASSIGNMENTS=166 CHECKS=8262	SAT TT=0.044 ASSIGNMENTS=120 CHECKS=8742	? (TO) TT=1802.22	SAT TT=1.447	SAT TT=1.631
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-2.xml	UNSAT TT=0.035	UNSAT TT=1.586 CHECKS=128206 NODES=0	UNSAT TT=1.466 CHECKS=128206 NODES=0	UNSAT TT=0.086	UNSAT TT=0.687 CHECKS=160	UNSAT TT=0.077 CHECKS=160	UNSAT TT=0.896 ASSIGNMENTS=0	UNSAT TT=0.921 ASSIGNMENTS=0	UNSAT TT=133.455 CHECKS=90382 NODES=0	UNSAT TT=97.355 CHECKS=90382 NODES=0	UNSAT TT=89.501 CHECKS=90382 NODES=0	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1786	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1786	? (problem) TT=101.339	? (problem) TT=105.23	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1786	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1786	? TT=0.326	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1786	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1786	? TT=273.915	UNSAT TT=1.425	UNSAT TT=1.475
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-30.xml	SAT TT=0.041	SAT TT=1.648 CHECKS=173726 NODES=145	SAT TT=2.291 CHECKS=487017 NODES=226	SAT TT=1346.68	SAT TT=0.861 CHECKS=12192	SAT TT=0.117 CHECKS=4498	SAT TT=1.367 ASSIGNMENTS=112	SAT TT=2.513 ASSIGNMENTS=141	SAT TT=140.548 CHECKS=197525 NODES=317	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=0.053 ASSIGNMENTS=120 CHECKS=7452	SAT TT=0.054 ASSIGNMENTS=120 CHECKS=7452	? (problem) TT=126.746	? (problem) TT=126.476	SAT TT=0.041 ASSIGNMENTS=154 CHECKS=10237	SAT TT=0.056 ASSIGNMENTS=677 CHECKS=40546	? TT=0.321	SAT TT=0.127 ASSIGNMENTS=909 CHECKS=68874	SAT TT=0.041 ASSIGNMENTS=106 CHECKS=5987	? TT=1450.08	SAT TT=1.385	SAT TT=1.55
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-32.xml	UNSAT TT=0.036	UNSAT TT=1.499 CHECKS=26931 NODES=0	UNSAT TT=1.404 CHECKS=26931 NODES=0	UNSAT TT=0.088	UNSAT TT=0.791 CHECKS=179	UNSAT TT=0.094 CHECKS=179	UNSAT TT=0.926 ASSIGNMENTS=0	UNSAT TT=1.116 ASSIGNMENTS=0	UNSAT TT=143.389 CHECKS=67209300 NODES=0	UNSAT TT=183.406 CHECKS=67209800 NODES=0	UNSAT TT=176.201 CHECKS=67209800 NODES=0	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=1946	UNSAT TT=0.05 ASSIGNMENTS=0 CHECKS=1946	? (problem) TT=99.932	? (problem) TT=107.409	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1946	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1946	? TT=0.361	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1946	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=1946	? (TO) TT=1802.27	UNSAT TT=1.417	UNSAT TT=1.308
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-40.xml	SAT TT=0.037	SAT TT=3.602 CHECKS=1164390 NODES=151	SAT TT=7.64 CHECKS=3591000 NODES=210	SAT TT=1340.93	SAT TT=0.845 CHECKS=5685	SAT TT=0.159 CHECKS=5604	SAT TT=1.404 ASSIGNMENTS=152	SAT TT=2.2 ASSIGNMENTS=101	SAT TT=137.814 CHECKS=16856500 NODES=150	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=0.056 ASSIGNMENTS=116 CHECKS=6784	SAT TT=0.05 ASSIGNMENTS=116 CHECKS=6784	? (problem) TT=122.328	? (problem) TT=137.343	SAT TT=0.041 ASSIGNMENTS=117 CHECKS=6827	SAT TT=0.037 ASSIGNMENTS=96 CHECKS=4930	? TT=0.381	SAT TT=0.081 ASSIGNMENTS=551 CHECKS=37743	SAT TT=0.041 ASSIGNMENTS=109 CHECKS=5838	? TT=256.108	SAT TT=1.287	SAT TT=1.391
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-41.xml	UNSAT TT=0.035	UNSAT TT=1.427 CHECKS=28388 NODES=0	UNSAT TT=1.293 CHECKS=28388 NODES=0	UNSAT TT=0.084	UNSAT TT=0.677 CHECKS=119	UNSAT TT=0.075 CHECKS=119	UNSAT TT=0.955 ASSIGNMENTS=0	UNSAT TT=1.126 ASSIGNMENTS=0	UNSAT TT=122.74 CHECKS=77911 NODES=0	UNSAT TT=86.069 CHECKS=77911 NODES=0	UNSAT TT=96.238 CHECKS=77911 NODES=0	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1032	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1032	? (problem) TT=98.583	? (problem) TT=99.159	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1032	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1032	? TT=0.323	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1032	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1032	? TT=854.754	UNSAT TT=1.516	UNSAT TT=1.388
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-44.xml	UNSAT TT=0.034	UNSAT TT=2.761 CHECKS=1051290 NODES=0	UNSAT TT=2.871 CHECKS=1051290 NODES=0	UNSAT TT=0.083	UNSAT TT=0.687 CHECKS=170	UNSAT TT=0.074 CHECKS=170	UNSAT TT=0.968 ASSIGNMENTS=0	UNSAT TT=0.945 ASSIGNMENTS=0	UNSAT TT=154.94 CHECKS=68214900 NODES=0	UNSAT TT=167.211 CHECKS=68215200 NODES=0	UNSAT TT=154.796 CHECKS=68215200 NODES=0	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1889	UNSAT TT=0.049 ASSIGNMENTS=0 CHECKS=1889	? (problem) TT=125.737	? (problem) TT=130.83	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1889	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1889	? TT=0.369	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1889	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1889	? TT=252.13	UNSAT TT=1.415	UNSAT TT=1.469
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-45.xml	SAT TT=0.039	SAT TT=1.86 CHECKS=420224 NODES=260	SAT TT=3.286 CHECKS=1186700 NODES=347	SAT TT=381.213	SAT TT=0.626 CHECKS=3276	SAT TT=0.084 CHECKS=3379	SAT TT=1.474 ASSIGNMENTS=102	SAT TT=1.915 ASSIGNMENTS=98	SAT TT=124.18 CHECKS=362965 NODES=149	SAT TT=842.005 CHECKS=44855000 NODES=1036200000	? (TO) TT=1800.09	SAT TT=0.053 ASSIGNMENTS=171 CHECKS=12481	SAT TT=0.05 ASSIGNMENTS=171 CHECKS=12481	? (problem) TT=120.836	? (problem) TT=119.601	SAT TT=0.045 ASSIGNMENTS=174 CHECKS=12695	SAT TT=0.039 ASSIGNMENTS=199 CHECKS=8512	? TT=0.358	SAT TT=0.096 ASSIGNMENTS=797 CHECKS=50206	SAT TT=0.042 ASSIGNMENTS=187 CHECKS=12360	? TT=1477.02	SAT TT=1.463	SAT TT=1.622
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-47.xml	UNSAT TT=0.036	UNSAT TT=1.391 CHECKS=74569 NODES=0	UNSAT TT=1.569 CHECKS=74569 NODES=0	UNSAT TT=0.086	UNSAT TT=0.819 CHECKS=123	UNSAT TT=0.102 CHECKS=123	UNSAT TT=0.905 ASSIGNMENTS=0	UNSAT TT=1.005 ASSIGNMENTS=0	UNSAT TT=121.471 CHECKS=83417 NODES=0	UNSAT TT=136.097 CHECKS=83873 NODES=0	UNSAT TT=120.602 CHECKS=83873 NODES=0	UNSAT TT=0.049 ASSIGNMENTS=0 CHECKS=1730	UNSAT TT=0.05 ASSIGNMENTS=0 CHECKS=1730	? (problem) TT=126.269	? (problem) TT=124.47	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=1730	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1730	? TT=0.302	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1730	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1730	? TT=659.271	UNSAT TT=1.388	UNSAT TT=1.515
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-49.xml	SAT TT=0.038	SAT TT=4.903 CHECKS=2201390 NODES=151	SAT TT=7.033 CHECKS=3328940 NODES=151	SAT TT=0.089	SAT TT=0.737 CHECKS=5898	SAT TT=0.1 CHECKS=3165	SAT TT=1.324 ASSIGNMENTS=105	SAT TT=1.847 ASSIGNMENTS=101	SAT TT=133.473 CHECKS=5397320 NODES=223	SAT TT=241.039 CHECKS=15864400 NODES=188400000	? (TO) TT=1800.09	SAT TT=0.053 ASSIGNMENTS=125 CHECKS=7139	SAT TT=0.049 ASSIGNMENTS=125 CHECKS=7139	? (problem) TT=145.905	? (problem) TT=149.863	SAT TT=0.041 ASSIGNMENTS=145 CHECKS=9494	SAT TT=0.038 ASSIGNMENTS=216 CHECKS=7557	? TT=0.36	SAT TT=0.041 ASSIGNMENTS=115 CHECKS=4634	SAT TT=0.039 ASSIGNMENTS=95 CHECKS=4340	? (TO) TT=1802.35	SAT TT=1.199	SAT TT=1.321
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-4.xml	SAT TT=0.04	SAT TT=4.003 CHECKS=1412560 NODES=152	SAT TT=11.501 CHECKS=5347100 NODES=211	? (TO) TT=1800.09	SAT TT=0.733 CHECKS=3914	SAT TT=0.122 CHECKS=3981	SAT TT=1.479 ASSIGNMENTS=125	SAT TT=2.185 ASSIGNMENTS=237	SAT TT=153.341 CHECKS=67456600 NODES=145	? (TO) TT=1800.07	? (MO) TT=62.71	SAT TT=0.053 ASSIGNMENTS=96 CHECKS=4868	SAT TT=0.051 ASSIGNMENTS=96 CHECKS=4868	? (problem) TT=122.832	? (problem) TT=130.522	SAT TT=0.04 ASSIGNMENTS=96 CHECKS=4868	SAT TT=0.04 ASSIGNMENTS=105 CHECKS=5093	? TT=0.308	SAT TT=0.049 ASSIGNMENTS=175 CHECKS=8587	SAT TT=0.046 ASSIGNMENTS=112 CHECKS=8932	? (TO) TT=1802.38	SAT TT=1.35	SAT TT=1.392
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-5.xml	UNSAT TT=0.035	UNSAT TT=1.913 CHECKS=271324 NODES=0	UNSAT TT=1.786 CHECKS=271324 NODES=0	UNSAT TT=0.085	UNSAT TT=0.837 CHECKS=150	UNSAT TT=0.112 CHECKS=150	UNSAT TT=0.991 ASSIGNMENTS=0	UNSAT TT=0.967 ASSIGNMENTS=0	UNSAT TT=146.454 CHECKS=121240 NODES=0	UNSAT TT=141.901 CHECKS=121912 NODES=0	UNSAT TT=170.11 CHECKS=121912 NODES=0	UNSAT TT=0.05 ASSIGNMENTS=0 CHECKS=1996	UNSAT TT=0.05 ASSIGNMENTS=0 CHECKS=1996	? (problem) TT=116.001	? (problem) TT=120.258	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1996	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=1996	? TT=0.338	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1996	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1996	? TT=443.947	UNSAT TT=1.452	UNSAT TT=1.339
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-6.xml	SAT TT=0.041	SAT TT=22.647 CHECKS=10854300 NODES=304	SAT TT=28.387 CHECKS=14856900 NODES=318	SAT TT=0.091	SAT TT=0.763 CHECKS=7323	SAT TT=0.124 CHECKS=7392	SAT TT=1.5 ASSIGNMENTS=104	SAT TT=2.384 ASSIGNMENTS=123	SAT TT=218.82 CHECKS=269355000 NODES=228	SAT TT=841.586 CHECKS=314126000 NODES=891450000	? (TO) TT=1800.05	SAT TT=0.054 ASSIGNMENTS=130 CHECKS=12121	SAT TT=0.056 ASSIGNMENTS=130 CHECKS=12121	? (problem) TT=120.092	? (problem) TT=114.995	SAT TT=0.042 ASSIGNMENTS=141 CHECKS=12146	SAT TT=0.048 ASSIGNMENTS=435 CHECKS=22860	? TT=0.374	SAT TT=0.046 ASSIGNMENTS=131 CHECKS=6305	SAT TT=0.041 ASSIGNMENTS=109 CHECKS=9063	? (TO) TT=1802.25	SAT TT=1.206	SAT TT=1.587
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-10.xml	SAT TT=0.05	SAT TT=1.921 CHECKS=147923 NODES=183	SAT TT=1.857 CHECKS=186477 NODES=0	SAT TT=0.106	SAT TT=1.823 CHECKS=6039	SAT TT=0.397 CHECKS=3810	SAT TT=1.739 ASSIGNMENTS=150	SAT TT=3.518 ASSIGNMENTS=146	SAT TT=159.771 CHECKS=62005200 NODES=442	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=0.071 ASSIGNMENTS=207 CHECKS=19414	SAT TT=0.07 ASSIGNMENTS=207 CHECKS=19414	? (problem) TT=154.874	? (problem) TT=152.763	SAT TT=0.061 ASSIGNMENTS=207 CHECKS=19478	SAT TT=0.056 ASSIGNMENTS=356 CHECKS=19474	? TT=0.335	SAT TT=0.193 ASSIGNMENTS=1352 CHECKS=97848	SAT TT=0.05 ASSIGNMENTS=152 CHECKS=6708	? TT=610.908	SAT TT=1.41	SAT TT=1.738
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-11.xml	SAT TT=0.052	SAT TT=1.91 CHECKS=141370 NODES=183	SAT TT=2.36 CHECKS=359511 NODES=262	SAT TT=0.1	SAT TT=2.092 CHECKS=3631	SAT TT=0.49 CHECKS=3660	SAT TT=1.567 ASSIGNMENTS=139	SAT TT=3.449 ASSIGNMENTS=144	SAT TT=130.806 CHECKS=609569 NODES=283	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=0.069 ASSIGNMENTS=195 CHECKS=13785	SAT TT=0.068 ASSIGNMENTS=195 CHECKS=13785	? (problem) TT=106.983	? (problem) TT=119.757	SAT TT=0.054 ASSIGNMENTS=198 CHECKS=14971	SAT TT=0.058 ASSIGNMENTS=436 CHECKS=23924	? TT=0.336	SAT TT=0.188 ASSIGNMENTS=1249 CHECKS=106931	SAT TT=0.052 ASSIGNMENTS=149 CHECKS=6701	? (TO) TT=1802.3	SAT TT=1.362	SAT TT=2.022
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-13.xml	SAT TT=0.045	SAT TT=1.698 CHECKS=125440 NODES=181	SAT TT=2.214 CHECKS=401711 NODES=185	SAT TT=0.099	SAT TT=1.077 CHECKS=4371	SAT TT=0.193 CHECKS=4115	SAT TT=1.701 ASSIGNMENTS=150	SAT TT=3.917 ASSIGNMENTS=460	SAT TT=129.728 CHECKS=298930 NODES=302	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=0.058 ASSIGNMENTS=158 CHECKS=9281	SAT TT=0.06 ASSIGNMENTS=158 CHECKS=9281	? (problem) TT=115.153	? (problem) TT=115.097	SAT TT=0.05 ASSIGNMENTS=166 CHECKS=10037	SAT TT=0.045 ASSIGNMENTS=124 CHECKS=5890	? TT=0.337	SAT TT=0.107 ASSIGNMENTS=778 CHECKS=58722	SAT TT=0.05 ASSIGNMENTS=193 CHECKS=13658	? (TO) TT=1802.24	SAT TT=1.366	SAT TT=1.585
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-16.xml	SAT TT=0.046	SAT TT=4.503 CHECKS=1234500 NODES=257	SAT TT=2.108 CHECKS=298555 NODES=181	SAT TT=0.097	SAT TT=1.272 CHECKS=5706	SAT TT=0.268 CHECKS=6228	SAT TT=1.623 ASSIGNMENTS=175	SAT TT=3.569 ASSIGNMENTS=170	SAT TT=134.336 CHECKS=93214 NODES=189	? (TO) TT=1800	? (TO) TT=1800	SAT TT=0.063 ASSIGNMENTS=137 CHECKS=6231	SAT TT=0.058 ASSIGNMENTS=137 CHECKS=6231	? (problem) TT=108.67	? (problem) TT=107.46	SAT TT=0.05 ASSIGNMENTS=137 CHECKS=6231	SAT TT=0.046 ASSIGNMENTS=161 CHECKS=6408	? TT=0.332	SAT TT=0.059 ASSIGNMENTS=233 CHECKS=11116	SAT TT=0.048 ASSIGNMENTS=150 CHECKS=8199	? (TO) TT=1802.28	SAT TT=1.431	SAT TT=1.492
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-1.xml	SAT TT=0.044	SAT TT=2.508 CHECKS=477780 NODES=240	SAT TT=2.595 CHECKS=485197 NODES=276	SAT TT=26.505	SAT TT=1.259 CHECKS=13385	SAT TT=0.32 CHECKS=15031	SAT TT=1.53 ASSIGNMENTS=190	SAT TT=3.253 ASSIGNMENTS=141	SAT TT=136.554 CHECKS=89039 NODES=181	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=0.06 ASSIGNMENTS=210 CHECKS=9444	SAT TT=0.066 ASSIGNMENTS=210 CHECKS=9444	? (problem) TT=125.321	? (problem) TT=131.533	SAT TT=0.046 ASSIGNMENTS=170 CHECKS=8232	SAT TT=0.044 ASSIGNMENTS=138 CHECKS=6346	? TT=0.374	SAT TT=0.077 ASSIGNMENTS=444 CHECKS=25669	SAT TT=0.057 ASSIGNMENTS=236 CHECKS=19845	? (TO) TT=1802.14	SAT TT=1.394	SAT TT=1.692
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-23.xml	SAT TT=0.049	SAT TT=1.919 CHECKS=152782 NODES=182	SAT TT=2.71 CHECKS=650827 NODES=262	SAT TT=893.382	SAT TT=0.981 CHECKS=3898	SAT TT=0.16 CHECKS=4190	SAT TT=1.702 ASSIGNMENTS=153	SAT TT=3.323 ASSIGNMENTS=148	SAT TT=132.15 CHECKS=223706 NODES=188	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=0.063 ASSIGNMENTS=157 CHECKS=9657	SAT TT=0.06 ASSIGNMENTS=157 CHECKS=9657	? (problem) TT=117.511	? (problem) TT=113.376	SAT TT=0.053 ASSIGNMENTS=178 CHECKS=14142	SAT TT=0.051 ASSIGNMENTS=232 CHECKS=12829	? TT=0.336	SAT TT=0.076 ASSIGNMENTS=473 CHECKS=28224	SAT TT=0.049 ASSIGNMENTS=141 CHECKS=6639	? (TO) TT=1802.09	SAT TT=1.442	SAT TT=1.817
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-24.xml	SAT TT=0.047	SAT TT=1.896 CHECKS=175331 NODES=300	SAT TT=2.922 CHECKS=677155 NODES=297	SAT TT=894.846	SAT TT=1.265 CHECKS=7226	SAT TT=0.226 CHECKS=4893	SAT TT=1.741 ASSIGNMENTS=148	SAT TT=3.491 ASSIGNMENTS=160	SAT TT=124.531 CHECKS=99565 NODES=184	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=0.076 ASSIGNMENTS=247 CHECKS=30902	SAT TT=0.076 ASSIGNMENTS=247 CHECKS=30902	? (problem) TT=134.849	? (problem) TT=148.91	SAT TT=0.081 ASSIGNMENTS=300 CHECKS=53537	SAT TT=0.049 ASSIGNMENTS=140 CHECKS=6264	? TT=0.311	SAT TT=0.121 ASSIGNMENTS=786 CHECKS=57776	SAT TT=0.047 ASSIGNMENTS=147 CHECKS=6945	? TT=148.77	SAT TT=1.485	SAT TT=1.654
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-26.xml	SAT TT=0.052	SAT TT=2.003 CHECKS=189006 NODES=344	SAT TT=2.695 CHECKS=444279 NODES=0	SAT TT=0.098	SAT TT=2.926 CHECKS=3580	SAT TT=0.745 CHECKS=3775	SAT TT=1.632 ASSIGNMENTS=137	SAT TT=3.672 ASSIGNMENTS=151	SAT TT=134.024 CHECKS=405800 NODES=183	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=0.065 ASSIGNMENTS=146 CHECKS=7420	SAT TT=0.059 ASSIGNMENTS=146 CHECKS=7420	? (problem) TT=147.128	? (problem) TT=150.261	SAT TT=0.052 ASSIGNMENTS=146 CHECKS=7420	SAT TT=0.059 ASSIGNMENTS=328 CHECKS=20261	? TT=0.305	SAT TT=0.176 ASSIGNMENTS=1195 CHECKS=107268	SAT TT=0.054 ASSIGNMENTS=159 CHECKS=9103	? (TO) TT=1802.51	SAT TT=1.361	SAT TT=1.595
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-27.xml	SAT TT=0.046	SAT TT=1.937 CHECKS=159824 NODES=196	SAT TT=2.857 CHECKS=533407 NODES=277	SAT TT=0.113	SAT TT=2.003 CHECKS=5722	SAT TT=0.525 CHECKS=5731	SAT TT=1.651 ASSIGNMENTS=207	SAT TT=3.563 ASSIGNMENTS=167	? (MO) TT=44.99	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=0.061 ASSIGNMENTS=159 CHECKS=8165	SAT TT=0.058 ASSIGNMENTS=159 CHECKS=8165	? (problem) TT=142.943	? (problem) TT=146.399	SAT TT=0.049 ASSIGNMENTS=175 CHECKS=8258	SAT TT=0.046 ASSIGNMENTS=159 CHECKS=6618	? TT=0.336	SAT TT=0.142 ASSIGNMENTS=1034 CHECKS=87899	SAT TT=0.056 ASSIGNMENTS=173 CHECKS=11177	? (TO) TT=1802.31	SAT TT=1.659	SAT TT=1.651
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-28.xml	SAT TT=0.049	SAT TT=1.992 CHECKS=215655 NODES=258	SAT TT=2.482 CHECKS=547087 NODES=181	SAT TT=0.137	SAT TT=1.679 CHECKS=5621	SAT TT=0.374 CHECKS=5361	SAT TT=1.549 ASSIGNMENTS=170	SAT TT=4.23 ASSIGNMENTS=211	SAT TT=132.823 CHECKS=359902 NODES=521	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=0.063 ASSIGNMENTS=145 CHECKS=7974	SAT TT=0.061 ASSIGNMENTS=145 CHECKS=7974	? (problem) TT=146.721	? (problem) TT=133.627	SAT TT=0.053 ASSIGNMENTS=154 CHECKS=7961	SAT TT=0.059 ASSIGNMENTS=457 CHECKS=25418	? TT=0.374	SAT TT=0.127 ASSIGNMENTS=792 CHECKS=70549	SAT TT=0.049 ASSIGNMENTS=129 CHECKS=6192	? (TO) TT=1802.32	SAT TT=1.672	SAT TT=1.691
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-29.xml	SAT TT=0.048	SAT TT=2.617 CHECKS=420152 NODES=284	SAT TT=2.655 CHECKS=577550 NODES=309	SAT TT=0.097	SAT TT=1.994 CHECKS=4021	SAT TT=0.427 CHECKS=4273	SAT TT=1.817 ASSIGNMENTS=161	SAT TT=3.36 ASSIGNMENTS=141	SAT TT=130.549 CHECKS=151089 NODES=184	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=0.063 ASSIGNMENTS=150 CHECKS=8155	SAT TT=0.064 ASSIGNMENTS=150 CHECKS=8155	? (problem) TT=134.43	? (problem) TT=128.659	SAT TT=0.052 ASSIGNMENTS=160 CHECKS=9591	SAT TT=0.048 ASSIGNMENTS=140 CHECKS=7228	? TT=0.373	SAT TT=0.19 ASSIGNMENTS=1278 CHECKS=102509	SAT TT=0.049 ASSIGNMENTS=153 CHECKS=7669	? (TO) TT=1802.4	SAT TT=1.395	SAT TT=1.624
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-2.xml	SAT TT=0.046	SAT TT=3.409 CHECKS=775597 NODES=348	SAT TT=2.938 CHECKS=613729 NODES=237	SAT TT=0.099	SAT TT=1.57 CHECKS=4245	SAT TT=0.32 CHECKS=4179	SAT TT=1.55 ASSIGNMENTS=153	SAT TT=3.562 ASSIGNMENTS=190	SAT TT=129.586 CHECKS=116974 NODES=182	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=0.063 ASSIGNMENTS=141 CHECKS=6429	SAT TT=0.063 ASSIGNMENTS=141 CHECKS=6429	? (problem) TT=115.87	? (problem) TT=110.983	SAT TT=0.046 ASSIGNMENTS=141 CHECKS=6429	SAT TT=0.047 ASSIGNMENTS=257 CHECKS=13313	? TT=0.375	SAT TT=0.08 ASSIGNMENTS=443 CHECKS=24317	SAT TT=0.052 ASSIGNMENTS=141 CHECKS=7424	? (TO) TT=1802.19	SAT TT=1.448	SAT TT=1.51
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-30.xml	SAT TT=0.051	SAT TT=1.849 CHECKS=158592 NODES=182	SAT TT=2.93 CHECKS=717731 NODES=516	SAT TT=896.774	SAT TT=1.189 CHECKS=6868	SAT TT=0.257 CHECKS=7333	SAT TT=1.551 ASSIGNMENTS=205	SAT TT=3.482 ASSIGNMENTS=190	SAT TT=127.44 CHECKS=163678 NODES=181	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.06 ASSIGNMENTS=147 CHECKS=6419	SAT TT=0.058 ASSIGNMENTS=147 CHECKS=6419	? (problem) TT=103.765	? (problem) TT=106.738	SAT TT=0.051 ASSIGNMENTS=147 CHECKS=6419	SAT TT=0.051 ASSIGNMENTS=285 CHECKS=10559	? TT=0.31	SAT TT=0.128 ASSIGNMENTS=919 CHECKS=76868	SAT TT=0.051 ASSIGNMENTS=137 CHECKS=6180	? TT=1043.82	SAT TT=1.346	SAT TT=1.518
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-35.xml	SAT TT=0.041	SAT TT=1.69 CHECKS=149604 NODES=187	SAT TT=3.276 CHECKS=849445 NODES=370	SAT TT=0.101	SAT TT=0.985 CHECKS=4418	SAT TT=0.157 CHECKS=4804	SAT TT=1.659 ASSIGNMENTS=142	SAT TT=2.992 ASSIGNMENTS=155	SAT TT=135.968 CHECKS=85049 NODES=182	? (TO) TT=1800.07	? (TO) TT=1800	SAT TT=0.054 ASSIGNMENTS=142 CHECKS=6455	SAT TT=0.056 ASSIGNMENTS=142 CHECKS=6455	? (problem) TT=109.752	? (problem) TT=111.322	SAT TT=0.046 ASSIGNMENTS=142 CHECKS=6455	SAT TT=0.041 ASSIGNMENTS=127 CHECKS=5849	? TT=0.331	SAT TT=0.143 ASSIGNMENTS=1184 CHECKS=83758	SAT TT=0.048 ASSIGNMENTS=132 CHECKS=5729	? TT=1133.73	SAT TT=1.484	SAT TT=1.869
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-36.xml	SAT TT=0.048	SAT TT=1.881 CHECKS=142330 NODES=185	SAT TT=2.397 CHECKS=441724 NODES=248	SAT TT=868.215	SAT TT=1.798 CHECKS=3915	SAT TT=0.36 CHECKS=4149	SAT TT=1.852 ASSIGNMENTS=152	SAT TT=3.63 ASSIGNMENTS=164	SAT TT=138.968 CHECKS=31488000 NODES=339	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=0.063 ASSIGNMENTS=136 CHECKS=6816	SAT TT=0.063 ASSIGNMENTS=136 CHECKS=6816	? (problem) TT=134.6	? (problem) TT=134.821	SAT TT=0.048 ASSIGNMENTS=136 CHECKS=6816	SAT TT=0.048 ASSIGNMENTS=206 CHECKS=12173	? TT=0.373	SAT TT=0.184 ASSIGNMENTS=1183 CHECKS=105608	SAT TT=0.077 ASSIGNMENTS=323 CHECKS=44000	? TT=545.391	SAT TT=1.62	SAT TT=1.581
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-38.xml	SAT TT=0.049	SAT TT=1.941 CHECKS=134163 NODES=180	SAT TT=1.797 CHECKS=151727 NODES=0	SAT TT=0.108	SAT TT=2.613 CHECKS=3213	SAT TT=0.608 CHECKS=3272	SAT TT=1.575 ASSIGNMENTS=151	SAT TT=4.033 ASSIGNMENTS=143	SAT TT=136.024 CHECKS=8658840 NODES=346	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=0.065 ASSIGNMENTS=162 CHECKS=10027	SAT TT=0.066 ASSIGNMENTS=162 CHECKS=10027	? (problem) TT=133.344	? (problem) TT=133.289	SAT TT=0.053 ASSIGNMENTS=170 CHECKS=9872	SAT TT=0.06 ASSIGNMENTS=496 CHECKS=24645	? TT=0.309	SAT TT=0.066 ASSIGNMENTS=245 CHECKS=13852	SAT TT=0.049 ASSIGNMENTS=143 CHECKS=6674	? (TO) TT=1802.29	SAT TT=1.386	SAT TT=1.631
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-39.xml	SAT TT=0.048	SAT TT=2.168 CHECKS=211389 NODES=263	SAT TT=2.216 CHECKS=292066 NODES=182	SAT TT=0.098	SAT TT=1.412 CHECKS=7565	SAT TT=0.281 CHECKS=3401	SAT TT=1.656 ASSIGNMENTS=218	SAT TT=3.678 ASSIGNMENTS=153	SAT TT=132.369 CHECKS=201732 NODES=409	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=0.059 ASSIGNMENTS=145 CHECKS=7675	SAT TT=0.064 ASSIGNMENTS=145 CHECKS=7675	? (problem) TT=96.721	? (problem) TT=99.219	SAT TT=0.051 ASSIGNMENTS=142 CHECKS=7678	SAT TT=0.048 ASSIGNMENTS=131 CHECKS=6479	? TT=0.37	SAT TT=0.154 ASSIGNMENTS=1061 CHECKS=94027	SAT TT=0.049 ASSIGNMENTS=145 CHECKS=7755	? (TO) TT=1802.17	SAT TT=1.548	SAT TT=1.522
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-42.xml	SAT TT=0.046	SAT TT=2.036 CHECKS=238463 NODES=335	SAT TT=2.77 CHECKS=638293 NODES=427	SAT TT=1343.92	SAT TT=1.281 CHECKS=3737	SAT TT=0.24 CHECKS=3793	SAT TT=1.583 ASSIGNMENTS=146	SAT TT=3.618 ASSIGNMENTS=167	SAT TT=135.156 CHECKS=96886 NODES=185	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=0.059 ASSIGNMENTS=155 CHECKS=9389	SAT TT=0.063 ASSIGNMENTS=155 CHECKS=9389	? (problem) TT=119.84	? (problem) TT=119.887	SAT TT=0.05 ASSIGNMENTS=163 CHECKS=9421	SAT TT=0.046 ASSIGNMENTS=139 CHECKS=6324	? TT=0.335	SAT TT=0.069 ASSIGNMENTS=388 CHECKS=21468	SAT TT=0.049 ASSIGNMENTS=173 CHECKS=10042	? TT=686.018	SAT TT=1.565	SAT TT=1.743
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-47.xml	SAT TT=0.046	SAT TT=1.847 CHECKS=145117 NODES=180	SAT TT=6.144 CHECKS=1799640 NODES=344	SAT TT=0.104	SAT TT=1.569 CHECKS=3669	SAT TT=0.317 CHECKS=3518	SAT TT=1.527 ASSIGNMENTS=144	SAT TT=3.701 ASSIGNMENTS=159	SAT TT=129.155 CHECKS=121193 NODES=307	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=0.062 ASSIGNMENTS=131 CHECKS=6336	SAT TT=0.063 ASSIGNMENTS=131 CHECKS=6336	? (problem) TT=121.021	? (problem) TT=120.082	SAT TT=0.047 ASSIGNMENTS=131 CHECKS=6336	SAT TT=0.046 ASSIGNMENTS=138 CHECKS=6596	? TT=0.371	SAT TT=0.072 ASSIGNMENTS=316 CHECKS=17246	SAT TT=0.055 ASSIGNMENTS=176 CHECKS=12022	? (TO) TT=1802.17	SAT TT=1.618	SAT TT=1.458
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-48.xml	SAT TT=0.044	SAT TT=1.66 CHECKS=115342 NODES=183	SAT TT=2.436 CHECKS=443382 NODES=270	SAT TT=0.101	SAT TT=1.003 CHECKS=4435	SAT TT=0.151 CHECKS=4302	SAT TT=1.461 ASSIGNMENTS=153	SAT TT=3.435 ASSIGNMENTS=244	SAT TT=127.421 CHECKS=3275180 NODES=180	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.059 ASSIGNMENTS=143 CHECKS=5797	SAT TT=0.059 ASSIGNMENTS=143 CHECKS=5797	? (problem) TT=119.687	? (problem) TT=119.189	SAT TT=0.047 ASSIGNMENTS=143 CHECKS=5797	SAT TT=0.044 ASSIGNMENTS=164 CHECKS=6259	? TT=0.337	SAT TT=0.063 ASSIGNMENTS=319 CHECKS=15816	SAT TT=0.045 ASSIGNMENTS=136 CHECKS=5822	? TT=1465.07	SAT TT=1.497	SAT TT=1.776
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-49.xml	SAT TT=0.048	SAT TT=1.716 CHECKS=127994 NODES=182	SAT TT=11.247 CHECKS=3854660 NODES=333	SAT TT=0.103	SAT TT=1.715 CHECKS=4671	SAT TT=0.392 CHECKS=4411	SAT TT=1.62 ASSIGNMENTS=155	SAT TT=4.107 ASSIGNMENTS=404	SAT TT=135.782 CHECKS=13496500 NODES=426	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=0.084 ASSIGNMENTS=309 CHECKS=41066	SAT TT=0.083 ASSIGNMENTS=309 CHECKS=41066	? (problem) TT=107.38	? (problem) TT=111.347	SAT TT=0.069 ASSIGNMENTS=282 CHECKS=37384	SAT TT=0.048 ASSIGNMENTS=136 CHECKS=6331	? TT=0.331	SAT TT=0.062 ASSIGNMENTS=272 CHECKS=14858	SAT TT=0.055 ASSIGNMENTS=239 CHECKS=19381	? TT=578.127	SAT TT=1.623	SAT TT=1.658
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-4.xml	SAT TT=0.052	SAT TT=2.487 CHECKS=331039 NODES=275	SAT TT=2.832 CHECKS=525093 NODES=296	SAT TT=0.389	SAT TT=3.018 CHECKS=4464	SAT TT=0.811 CHECKS=4609	SAT TT=1.718 ASSIGNMENTS=152	SAT TT=3.944 ASSIGNMENTS=182	SAT TT=130.738 CHECKS=111924 NODES=183	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.064 ASSIGNMENTS=143 CHECKS=7558	SAT TT=0.061 ASSIGNMENTS=143 CHECKS=7558	? (problem) TT=183.105	? (problem) TT=183.118	SAT TT=0.052 ASSIGNMENTS=143 CHECKS=7558	SAT TT=0.053 ASSIGNMENTS=266 CHECKS=12524	? TT=0.332	SAT TT=0.181 ASSIGNMENTS=1272 CHECKS=105239	SAT TT=0.054 ASSIGNMENTS=154 CHECKS=8013	? (TO) TT=1802.15	SAT TT=1.55	SAT TT=1.766
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-5.xml	SAT TT=0.05	SAT TT=2.032 CHECKS=152560 NODES=183	SAT TT=2.105 CHECKS=212957 NODES=0	SAT TT=0.108	SAT TT=2.181 CHECKS=4085	SAT TT=0.487 CHECKS=3170	SAT TT=1.684 ASSIGNMENTS=142	SAT TT=4.047 ASSIGNMENTS=229	SAT TT=127.502 CHECKS=113266 NODES=188	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.065 ASSIGNMENTS=142 CHECKS=7390	SAT TT=0.064 ASSIGNMENTS=142 CHECKS=7390	? (problem) TT=101.457	? (problem) TT=102.483	SAT TT=0.05 ASSIGNMENTS=152 CHECKS=7324	SAT TT=0.053 ASSIGNMENTS=245 CHECKS=14701	? TT=0.331	SAT TT=0.194 ASSIGNMENTS=1273 CHECKS=113971	SAT TT=0.05 ASSIGNMENTS=138 CHECKS=6893	? (TO) TT=1802.32	SAT TT=1.601	SAT TT=1.885
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-7.xml	SAT TT=0.053	SAT TT=1.924 CHECKS=142987 NODES=186	SAT TT=2.174 CHECKS=206816 NODES=0	SAT TT=1.856	SAT TT=2.221 CHECKS=4833	SAT TT=0.531 CHECKS=4247	SAT TT=1.723 ASSIGNMENTS=144	SAT TT=3.972 ASSIGNMENTS=222	SAT TT=122.929 CHECKS=110610 NODES=188	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=0.066 ASSIGNMENTS=188 CHECKS=10897	SAT TT=0.066 ASSIGNMENTS=188 CHECKS=10897	? (problem) TT=122.427	? (problem) TT=118.768	SAT TT=0.053 ASSIGNMENTS=168 CHECKS=9309	SAT TT=0.057 ASSIGNMENTS=373 CHECKS=18325	? TT=0.336	SAT TT=0.178 ASSIGNMENTS=1121 CHECKS=100408	SAT TT=0.072 ASSIGNMENTS=368 CHECKS=35521	? TT=393.345	SAT TT=1.49	SAT TT=1.821
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-8.xml	SAT TT=0.05	SAT TT=2.076 CHECKS=243092 NODES=294	SAT TT=2.393 CHECKS=372865 NODES=190	SAT TT=478.84	SAT TT=1.599 CHECKS=4207	SAT TT=0.333 CHECKS=4150	SAT TT=1.611 ASSIGNMENTS=205	SAT TT=3.472 ASSIGNMENTS=141	SAT TT=121.91 CHECKS=1927660 NODES=185	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=0.056 ASSIGNMENTS=147 CHECKS=7011	SAT TT=0.057 ASSIGNMENTS=147 CHECKS=7011	? (problem) TT=137.759	? (problem) TT=129.369	SAT TT=0.051 ASSIGNMENTS=147 CHECKS=7011	SAT TT=0.06 ASSIGNMENTS=707 CHECKS=34826	? TT=0.328	SAT TT=0.166 ASSIGNMENTS=1157 CHECKS=88643	SAT TT=0.05 ASSIGNMENTS=156 CHECKS=8021	? TT=485.756	SAT TT=1.464	SAT TT=1.681
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-11.xml	SAT TT=0.069	SAT TT=126.017 CHECKS=60162000 NODES=1524	SAT TT=116.156 CHECKS=61636300 NODES=1907	? (TO) TT=1800.11	SAT TT=4.438 CHECKS=8349	SAT TT=1.483 CHECKS=16887	SAT TT=2.159 ASSIGNMENTS=168	SAT TT=9.13 ASSIGNMENTS=182	SAT TT=544.347 CHECKS=1370410000 NODES=384	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=0.084 ASSIGNMENTS=125 CHECKS=11757	SAT TT=0.084 ASSIGNMENTS=125 CHECKS=11757	? (problem) TT=62.509	? (problem) TT=58.669	SAT TT=0.069 ASSIGNMENTS=125 CHECKS=11757	SAT TT=0.073 ASSIGNMENTS=235 CHECKS=20369	? TT=0.314	SAT TT=0.309 ASSIGNMENTS=1545 CHECKS=222969	SAT TT=0.095 ASSIGNMENTS=367 CHECKS=44248	? TT=964.328	SAT TT=1.952	SAT TT=1.938
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-12.xml	UNSAT TT=0.069	UNSAT TT=24.343 CHECKS=14446400 NODES=66	UNSAT TT=23.176 CHECKS=14780700 NODES=30	UNSAT TT=0.138	UNSAT TT=10.38 CHECKS=167	UNSAT TT=3.055 CHECKS=167	UNSAT TT=1.127 ASSIGNMENTS=0	UNSAT TT=1.313 ASSIGNMENTS=0	UNSAT TT=125.315 CHECKS=10685500 NODES=0	UNSAT TT=122.887 CHECKS=10685500 NODES=0	UNSAT TT=122.029 CHECKS=10685500 NODES=0	UNSAT TT=0.081 ASSIGNMENTS=0 CHECKS=4108	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=4108	? (problem) TT=73.468	? (problem) TT=76.662	UNSAT TT=0.07 ASSIGNMENTS=0 CHECKS=4108	UNSAT TT=0.069 ASSIGNMENTS=0 CHECKS=4108	? TT=0.339	UNSAT TT=0.069 ASSIGNMENTS=0 CHECKS=4108	UNSAT TT=0.069 ASSIGNMENTS=0 CHECKS=4108	? TT=250.754	UNSAT TT=1.687	UNSAT TT=1.776
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-14.xml	SAT TT=0.067	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=8.113 CHECKS=76619	SAT TT=2.212 CHECKS=20913	SAT TT=2.262 ASSIGNMENTS=303	SAT TT=7.816 ASSIGNMENTS=165	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=0.085 ASSIGNMENTS=112 CHECKS=12593	SAT TT=0.086 ASSIGNMENTS=112 CHECKS=12593	? (problem) TT=60.967	? (problem) TT=64.696	SAT TT=0.067 ASSIGNMENTS=121 CHECKS=12612	SAT TT=0.117 ASSIGNMENTS=987 CHECKS=97505	? TT=0.34	SAT TT=0.243 ASSIGNMENTS=1273 CHECKS=146171	SAT TT=0.081 ASSIGNMENTS=183 CHECKS=28610	? TT=267.762	SAT TT=1.628	SAT TT=1.692
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-26.xml	UNSAT TT=0.062	UNSAT TT=2.153 CHECKS=31225 NODES=0	UNSAT TT=2.051 CHECKS=31225 NODES=0	UNSAT TT=0.131	UNSAT TT=4.844 CHECKS=203	UNSAT TT=1.196 CHECKS=203	UNSAT TT=1.214 ASSIGNMENTS=0	UNSAT TT=1.177 ASSIGNMENTS=0	UNSAT TT=129.084 CHECKS=361888 NODES=0	UNSAT TT=105.093 CHECKS=361889 NODES=0	UNSAT TT=109.861 CHECKS=361889 NODES=0	UNSAT TT=0.077 ASSIGNMENTS=0 CHECKS=4099	UNSAT TT=0.07 ASSIGNMENTS=0 CHECKS=4099	? (problem) TT=73.53	? (problem) TT=73.724	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=4099	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=4099	? TT=0.32	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=4099	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=4099	? TT=1509.66	UNSAT TT=1.849	UNSAT TT=1.981
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-27.xml	SAT TT=0.066	SAT TT=249.548 CHECKS=105847000 NODES=2151	SAT TT=212.923 CHECKS=89020500 NODES=1779	? (TO) TT=1800.04	SAT TT=8.444 CHECKS=161717	SAT TT=3.164 CHECKS=106125	SAT TT=2.137 ASSIGNMENTS=346	SAT TT=8.341 ASSIGNMENTS=176	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=0.091 ASSIGNMENTS=201 CHECKS=19190	SAT TT=0.088 ASSIGNMENTS=201 CHECKS=19190	? (problem) TT=73.635	? (problem) TT=60.61	SAT TT=0.074 ASSIGNMENTS=191 CHECKS=18383	SAT TT=0.314 ASSIGNMENTS=4839 CHECKS=482461	? TT=0.337	SAT TT=0.313 ASSIGNMENTS=1511 CHECKS=187535	SAT TT=0.066 ASSIGNMENTS=138 CHECKS=11619	? TT=248.245	SAT TT=1.725	SAT TT=2.039
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-29.xml	UNSAT TT=0.062	? (TO) TT=1800.13	? (TO) TT=1800.14	UNSAT TT=0.137	UNSAT TT=15.645 CHECKS=210	UNSAT TT=4.719 CHECKS=210	UNSAT TT=1.223 ASSIGNMENTS=0	UNSAT TT=1.201 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.081 ASSIGNMENTS=0 CHECKS=3880	UNSAT TT=0.082 ASSIGNMENTS=0 CHECKS=3880	? (problem) TT=64.712	? (problem) TT=65.442	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=3880	UNSAT TT=0.065 ASSIGNMENTS=0 CHECKS=3880	? TT=0.355	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=3880	UNSAT TT=0.069 ASSIGNMENTS=0 CHECKS=3880	? TT=246.293	UNSAT TT=1.527	UNSAT TT=1.91
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-2.xml	UNSAT TT=0.062	UNSAT TT=38.48 CHECKS=24104200 NODES=98	UNSAT TT=37.099 CHECKS=23165300 NODES=73	UNSAT TT=0.126	UNSAT TT=6.72 CHECKS=181	UNSAT TT=1.916 CHECKS=181	UNSAT TT=1.044 ASSIGNMENTS=0	UNSAT TT=1.159 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=3446	UNSAT TT=0.073 ASSIGNMENTS=0 CHECKS=3446	? (problem) TT=77.174	? (problem) TT=77.047	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=3446	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=3446	? TT=0.363	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=3446	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=3446	? TT=1216.66	UNSAT TT=1.637	UNSAT TT=1.852
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-30.xml	UNSAT TT=0.059	UNSAT TT=107.082 CHECKS=76092100 NODES=414	UNSAT TT=110.092 CHECKS=72669900 NODES=323	UNSAT TT=0.128	UNSAT TT=5.425 CHECKS=189	UNSAT TT=1.457 CHECKS=189	UNSAT TT=1.039 ASSIGNMENTS=0	UNSAT TT=1.095 ASSIGNMENTS=0	UNSAT TT=131.89 CHECKS=50224400 NODES=0	UNSAT TT=73.717 CHECKS=50224400 NODES=0	UNSAT TT=74.967 CHECKS=50224400 NODES=0	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=3445	UNSAT TT=0.075 ASSIGNMENTS=0 CHECKS=3445	? (problem) TT=64.565	? (problem) TT=63.212	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=3445	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=3445	? TT=0.425	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3445	UNSAT TT=0.06 ASSIGNMENTS=0 CHECKS=3445	? TT=289.071	UNSAT TT=1.669	UNSAT TT=1.752
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-31.xml	UNSAT TT=0.057	? (TO) TT=1800.12	? (TO) TT=1800.11	UNSAT TT=0.116	UNSAT TT=2.195 CHECKS=194	UNSAT TT=0.415 CHECKS=194	UNSAT TT=1.097 ASSIGNMENTS=0	UNSAT TT=1.188 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=0.072 ASSIGNMENTS=0 CHECKS=3293	UNSAT TT=0.075 ASSIGNMENTS=0 CHECKS=3293	? (problem) TT=68.523	? (problem) TT=64.63	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3293	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3293	? TT=0.358	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=3293	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3293	? TT=252.306	UNSAT TT=1.618	UNSAT TT=1.926
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-33.xml	SAT TT=0.075	SAT TT=110.28 CHECKS=51272600 NODES=1258	SAT TT=18.882 CHECKS=8406970 NODES=288	? (TO) TT=1800.04	SAT TT=13.889 CHECKS=75960	SAT TT=10.166 CHECKS=322170	SAT TT=3.214 ASSIGNMENTS=580	SAT TT=14.025 ASSIGNMENTS=767	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.03	SAT TT=0.089 ASSIGNMENTS=134 CHECKS=13775	SAT TT=0.087 ASSIGNMENTS=134 CHECKS=13775	? (problem) TT=65.849	? (problem) TT=66.094	SAT TT=0.075 ASSIGNMENTS=133 CHECKS=13806	SAT TT=0.139 ASSIGNMENTS=1119 CHECKS=142236	? TT=0.312	SAT TT=0.341 ASSIGNMENTS=1501 CHECKS=250245	SAT TT=0.085 ASSIGNMENTS=166 CHECKS=23042	? TT=1125.97	SAT TT=1.716	SAT TT=2.124
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-34.xml	UNSAT TT=0.059	UNSAT TT=566.448 CHECKS=326865000 NODES=1584	UNSAT TT=798.389 CHECKS=434644000 NODES=1731	UNSAT TT=0.116	UNSAT TT=2.455 CHECKS=185	UNSAT TT=0.511 CHECKS=185	UNSAT TT=1.318 ASSIGNMENTS=0	UNSAT TT=1.225 ASSIGNMENTS=0	UNSAT TT=198.652 CHECKS=244477000 NODES=0	UNSAT TT=141.152 CHECKS=244477000 NODES=0	UNSAT TT=131.272 CHECKS=244477000 NODES=0	UNSAT TT=0.073 ASSIGNMENTS=0 CHECKS=3384	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=3384	? (problem) TT=61.8	? (problem) TT=66.067	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3384	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=3384	? TT=0.313	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=3384	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=3384	? TT=294.963	UNSAT TT=1.862	UNSAT TT=1.867
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-36.xml	SAT TT=0.1	SAT TT=224.183 CHECKS=96117800 NODES=2474	SAT TT=1147.56 CHECKS=457179000 NODES=7018	? (TO) TT=1800.03	SAT TT=6.056 CHECKS=154885	SAT TT=7.358 CHECKS=423545	SAT TT=2.251 ASSIGNMENTS=406	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=0.208 ASSIGNMENTS=838 CHECKS=229200	SAT TT=0.343 ASSIGNMENTS=838 CHECKS=229200	? (problem) TT=71.694	? (problem) TT=80.264	SAT TT=0.17 ASSIGNMENTS=867 CHECKS=179649	SAT TT=0.58 ASSIGNMENTS=8499 CHECKS=1000790	? TT=0.317	SAT TT=0.395 ASSIGNMENTS=1827 CHECKS=243830	SAT TT=0.1 ASSIGNMENTS=394 CHECKS=60957	? TT=252.785	SAT TT=1.507	SAT TT=1.986
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-39.xml	SAT TT=0.082	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.11	SAT TT=16.45 CHECKS=27933	SAT TT=6.087 CHECKS=50805	SAT TT=3.361 ASSIGNMENTS=581	SAT TT=12.034 ASSIGNMENTS=936	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=0.095 ASSIGNMENTS=172 CHECKS=19756	SAT TT=0.094 ASSIGNMENTS=172 CHECKS=19756	? (problem) TT=66.642	? (problem) TT=70.769	SAT TT=0.082 ASSIGNMENTS=167 CHECKS=18965	SAT TT=0.132 ASSIGNMENTS=1131 CHECKS=120806	? TT=0.334	SAT TT=2.773 ASSIGNMENTS=16574 CHECKS=2429780	SAT TT=0.083 ASSIGNMENTS=198 CHECKS=21290	? TT=243.853	SAT TT=1.521	SAT TT=1.811
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-43.xml	UNSAT TT=0.059	UNSAT TT=2.376 CHECKS=128066 NODES=0	UNSAT TT=2.206 CHECKS=128066 NODES=0	UNSAT TT=0.117	UNSAT TT=5.233 CHECKS=143	UNSAT TT=1.41 CHECKS=143	UNSAT TT=1.146 ASSIGNMENTS=0	UNSAT TT=1.056 ASSIGNMENTS=0	UNSAT TT=143.174 CHECKS=49658000 NODES=0	UNSAT TT=88.966 CHECKS=49960200 NODES=0	UNSAT TT=92.974 CHECKS=49960200 NODES=0	UNSAT TT=0.075 ASSIGNMENTS=0 CHECKS=3399	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=3399	? (problem) TT=72.02	? (problem) TT=87.655	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3399	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=3399	? TT=0.319	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=3399	UNSAT TT=0.065 ASSIGNMENTS=0 CHECKS=3399	? TT=1049.92	UNSAT TT=1.397	UNSAT TT=1.852
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-44.xml	SAT TT=0.075	SAT TT=78.282 CHECKS=39919500 NODES=1020	SAT TT=372.347 CHECKS=198001000 NODES=4352	? (TO) TT=1800.03	SAT TT=8.934 CHECKS=118415	SAT TT=7.26 CHECKS=328464	SAT TT=2.465 ASSIGNMENTS=171	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=0.084 ASSIGNMENTS=127 CHECKS=12077	SAT TT=0.083 ASSIGNMENTS=127 CHECKS=12077	? (problem) TT=61.727	? (problem) TT=62.454	SAT TT=0.075 ASSIGNMENTS=127 CHECKS=12077	SAT TT=0.093 ASSIGNMENTS=458 CHECKS=56009	? TT=0.424	SAT TT=0.498 ASSIGNMENTS=1839 CHECKS=281751	SAT TT=0.082 ASSIGNMENTS=183 CHECKS=24251	? TT=262.854	SAT TT=1.545	SAT TT=1.999
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-47.xml	UNSAT TT=0.06	UNSAT TT=2.489 CHECKS=407665 NODES=0	UNSAT TT=2.673 CHECKS=407665 NODES=0	UNSAT TT=0.129	UNSAT TT=14.231 CHECKS=130	UNSAT TT=4.567 CHECKS=130	UNSAT TT=1.148 ASSIGNMENTS=0	UNSAT TT=1.186 ASSIGNMENTS=0	UNSAT TT=147.593 CHECKS=49766900 NODES=0	UNSAT TT=184.661 CHECKS=49766900 NODES=0	UNSAT TT=190.015 CHECKS=49766900 NODES=0	UNSAT TT=0.072 ASSIGNMENTS=0 CHECKS=2043	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=2043	? (problem) TT=65.417	? (problem) TT=65.512	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=2043	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=2043	? TT=0.321	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=2043	UNSAT TT=0.06 ASSIGNMENTS=0 CHECKS=2043	? TT=219.46	UNSAT TT=1.529	UNSAT TT=1.991
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-48.xml	UNSAT TT=0.06	UNSAT TT=5.145 CHECKS=1343400 NODES=173	UNSAT TT=3.268 CHECKS=655097 NODES=0	UNSAT TT=0.125	UNSAT TT=14.414 CHECKS=240	UNSAT TT=4.315 CHECKS=240	UNSAT TT=1.279 ASSIGNMENTS=0	UNSAT TT=1.196 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.01	UNSAT TT=0.077 ASSIGNMENTS=0 CHECKS=3416	UNSAT TT=0.082 ASSIGNMENTS=0 CHECKS=3416	? (problem) TT=61.718	? (problem) TT=60.77	UNSAT TT=0.065 ASSIGNMENTS=0 CHECKS=3416	UNSAT TT=0.065 ASSIGNMENTS=0 CHECKS=3416	? TT=0.333	UNSAT TT=0.06 ASSIGNMENTS=0 CHECKS=3416	UNSAT TT=0.067 ASSIGNMENTS=0 CHECKS=3416	? TT=1059.62	UNSAT TT=1.561	UNSAT TT=1.893
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-49.xml	UNSAT TT=0.06	UNSAT TT=22.822 CHECKS=14257400 NODES=45	UNSAT TT=6.016 CHECKS=2970320 NODES=0	UNSAT TT=0.115	UNSAT TT=3.958 CHECKS=152	UNSAT TT=1.074 CHECKS=152	UNSAT TT=1.094 ASSIGNMENTS=0	UNSAT TT=1.065 ASSIGNMENTS=0	UNSAT TT=148.19 CHECKS=49612600 NODES=0	UNSAT TT=204.035 CHECKS=49612600 NODES=0	UNSAT TT=198.491 CHECKS=49612600 NODES=0	UNSAT TT=0.071 ASSIGNMENTS=0 CHECKS=3472	UNSAT TT=0.073 ASSIGNMENTS=0 CHECKS=3472	? (problem) TT=70.465	? (problem) TT=66.524	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=3472	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=3472	? TT=0.334	UNSAT TT=0.065 ASSIGNMENTS=0 CHECKS=3472	UNSAT TT=0.06 ASSIGNMENTS=0 CHECKS=3472	? TT=997.317	UNSAT TT=1.509	UNSAT TT=2.09
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-7.xml	UNSAT TT=0.053	UNSAT TT=1111.23 CHECKS=543047000 NODES=3972	UNSAT TT=1058.81 CHECKS=550291000 NODES=3970	UNSAT TT=0.127	UNSAT TT=4.618 CHECKS=170	UNSAT TT=1.134 CHECKS=170	UNSAT TT=1.018 ASSIGNMENTS=0	UNSAT TT=1.057 ASSIGNMENTS=0	UNSAT TT=579.423 CHECKS=1220950000 NODES=0	UNSAT TT=567.536 CHECKS=1220950000 NODES=0	UNSAT TT=611.065 CHECKS=1220950000 NODES=0	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=1944	UNSAT TT=0.073 ASSIGNMENTS=0 CHECKS=1944	? (problem) TT=78.958	? (problem) TT=70.928	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=1944	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=1944	? TT=0.317	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=1944	UNSAT TT=0.055 ASSIGNMENTS=0 CHECKS=1944	? TT=1048.53	UNSAT TT=1.499	UNSAT TT=1.668
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-9.xml	UNSAT TT=0.064	UNSAT TT=2.513 CHECKS=445775 NODES=0	UNSAT TT=2.506 CHECKS=445775 NODES=0	UNSAT TT=0.124	UNSAT TT=3.935 CHECKS=179	UNSAT TT=0.971 CHECKS=179	UNSAT TT=1.148 ASSIGNMENTS=0	UNSAT TT=1.085 ASSIGNMENTS=0	UNSAT TT=123.445 CHECKS=798161 NODES=0	UNSAT TT=201.341 CHECKS=798161 NODES=0	UNSAT TT=202.247 CHECKS=798161 NODES=0	UNSAT TT=0.075 ASSIGNMENTS=0 CHECKS=3536	UNSAT TT=0.072 ASSIGNMENTS=0 CHECKS=3536	? (problem) TT=71.309	? (problem) TT=71.859	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=3536	UNSAT TT=0.067 ASSIGNMENTS=0 CHECKS=3536	? TT=0.358	UNSAT TT=0.066 ASSIGNMENTS=0 CHECKS=3536	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=3536	? TT=269.642	UNSAT TT=1.631	UNSAT TT=1.841
csp/ramsey3/ normalized-ramsey-10-3.xml	SAT TT=0.011	SAT TT=1.044 CHECKS=1038 NODES=85	SAT TT=0.877 CHECKS=835 NODES=46	SAT TT=0.056	SAT TT=0.071 CHECKS=6054	SAT TT=34.704 CHECKS=41831300	SAT TT=0.72 ASSIGNMENTS=40	SAT TT=0.75 ASSIGNMENTS=40	SAT TT=0.814 CHECKS=1232 NODES=102	SAT TT=0.836 CHECKS=3014 NODES=8	SAT TT=0.732 CHECKS=4247 NODES=11	SAT TT=0.024 ASSIGNMENTS=40 CHECKS=664	SAT TT=0.023 ASSIGNMENTS=40 CHECKS=664	SAT TT=1.19	SAT TT=1.187	SAT TT=0.013 ASSIGNMENTS=40 CHECKS=664	SAT TT=0.011 ASSIGNMENTS=35 CHECKS=547	SAT TT=4.809	SAT TT=0.015 ASSIGNMENTS=162 CHECKS=2988	SAT TT=0.013 ASSIGNMENTS=29 CHECKS=578	SAT TT=1.468	SAT TT=0.834	SAT TT=0.883
csp/ramsey3/ normalized-ramsey-13-3.xml	SAT TT=0.021	SAT TT=1.029 CHECKS=1887 NODES=151	SAT TT=1.164 CHECKS=3639 NODES=215	SAT TT=1.431	SAT TT=0.166 CHECKS=16109	? (TO) TT=1800.06	SAT TT=1.126 ASSIGNMENTS=117	SAT TT=1.055 ASSIGNMENTS=117	SAT TT=1.028 CHECKS=2416 NODES=158	SAT TT=0.972 CHECKS=8991 NODES=41	SAT TT=0.953 CHECKS=13235 NODES=28	SAT TT=0.036 ASSIGNMENTS=55 CHECKS=2044	SAT TT=0.035 ASSIGNMENTS=55 CHECKS=2044	SAT TT=1.505	SAT TT=1.732	SAT TT=0.024 ASSIGNMENTS=57 CHECKS=2146	SAT TT=0.05 ASSIGNMENTS=884 CHECKS=30190	? (TO) TT=1800.02	SAT TT=0.03 ASSIGNMENTS=322 CHECKS=9296	SAT TT=0.021 ASSIGNMENTS=46 CHECKS=1614	SAT TT=2.142	SAT TT=1.337	SAT TT=1.355
csp/ramsey3/ normalized-ramsey-15-3.xml	SAT TT=0.161	SAT TT=110.907 CHECKS=36998000 NODES=1274680	SAT TT=49 CHECKS=17802400 NODES=514502	? (TO) TT=1800.11	SAT TT=61.459 CHECKS=51475100	? (TO) TT=1800.12	SAT TT=3.45 ASSIGNMENTS=8136	SAT TT=3.34 ASSIGNMENTS=8136	SAT TT=1.226 CHECKS=18665 NODES=476	SAT TT=1.93 CHECKS=1901810 NODES=24254	SAT TT=2.848 CHECKS=4122970 NODES=10575	SAT TT=9.048 ASSIGNMENTS=4292 CHECKS=156490	SAT TT=9.046 ASSIGNMENTS=4292 CHECKS=156490	SAT TT=1.837	SAT TT=1.911	? (TO) TT=1800.08	SAT TT=1.252 ASSIGNMENTS=15981 CHECKS=1445160	? (TO) TT=1800.08	SAT TT=1.292 ASSIGNMENTS=12472 CHECKS=1544020	SAT TT=0.161 ASSIGNMENTS=1445 CHECKS=148508	SAT TT=2.997	SAT TT=1.831	SAT TT=7.106
csp/ramsey3/ normalized-ramsey-16-3.xml	SAT TT=0.513	SAT TT=94.026 CHECKS=28276500 NODES=918201	? (TO) TT=1800.07	SAT TT=1687.17	SAT TT=29.765 CHECKS=23885700	? (TO) TT=1800.08	SAT TT=2.26 ASSIGNMENTS=2184	SAT TT=1.996 ASSIGNMENTS=2184	SAT TT=1.749 CHECKS=166802 NODES=2250	SAT TT=4.757 CHECKS=7607620 NODES=90420	SAT TT=1.557 CHECKS=739056 NODES=3187	SAT TT=8.727 ASSIGNMENTS=1529 CHECKS=46737	SAT TT=8.939 ASSIGNMENTS=1529 CHECKS=46737	SAT TT=1.903	SAT TT=2.073	? (TO) TT=1800.06	SAT TT=0.828 ASSIGNMENTS=10563 CHECKS=883899	? (TO) TT=1800.12	SAT TT=0.53 ASSIGNMENTS=4651 CHECKS=587430	SAT TT=0.513 ASSIGNMENTS=4538 CHECKS=532646	SAT TT=3.174	SAT TT=2.908	SAT TT=6.545
csp/ramsey3/ normalized-ramsey-17-3.xml	UNSAT TT=11.189	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=11.189 CHECKS=4652950	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.12
csp/ramsey3/ normalized-ramsey-18-3.xml	UNSAT TT=19.169	UNSAT TT=1721.17 CHECKS=525920000 NODES=13620600	? (TO) TT=1800.12	? (TO) TT=1800.04	UNSAT TT=19.169 CHECKS=7258600	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.1
csp/ramsey3/ normalized-ramsey-20-3.xml	UNSAT TT=23.197	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.02	UNSAT TT=23.197 CHECKS=7013200	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.11
csp/ramsey3/ normalized-ramsey-25-3.xml	UNSAT TT=60.424	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.04	UNSAT TT=60.424 CHECKS=25331000	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.1
csp/ramsey4/ normalized-ramsey-25-4.xml	SAT TT=0.142	SAT TT=2.707 CHECKS=89277 NODES=2585	SAT TT=4.286 CHECKS=501470 NODES=9263	SAT TT=73.75	SAT TT=71.407 CHECKS=28132200	? (TO) TT=1800.04	SAT TT=2.764 ASSIGNMENTS=438	SAT TT=2.59 ASSIGNMENTS=438	SAT TT=3.534 CHECKS=43922 NODES=1226	SAT TT=2.852 CHECKS=96862 NODES=153	SAT TT=3.137 CHECKS=232676 NODES=89	SAT TT=0.173 ASSIGNMENTS=260 CHECKS=22573	SAT TT=0.171 ASSIGNMENTS=260 CHECKS=22573	SAT TT=3.755	SAT TT=3.563	SAT TT=0.158 ASSIGNMENTS=271 CHECKS=21056	SAT TT=0.28 ASSIGNMENTS=2130 CHECKS=138690	? (TO) TT=1800.09	SAT TT=0.37 ASSIGNMENTS=1476 CHECKS=155520	SAT TT=0.142 ASSIGNMENTS=227 CHECKS=15725	SAT TT=4.429	SAT TT=11.758	SAT TT=19.299
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ramsey4/ normalized-ramsey-30-4.xml	SAT TT=0.259	SAT TT=1466.23 CHECKS=696818000 NODES=8969030	SAT TT=6.691 CHECKS=832943 NODES=13765	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.08	SAT TT=3.775 ASSIGNMENTS=559	SAT TT=3.311 ASSIGNMENTS=559	SAT TT=10.364 CHECKS=379071 NODES=3762	SAT TT=5.921 CHECKS=252713 NODES=587	SAT TT=6.181 CHECKS=680515 NODES=249	SAT TT=0.278 ASSIGNMENTS=312 CHECKS=37314	SAT TT=0.3 ASSIGNMENTS=312 CHECKS=37314	SAT TT=5.458	SAT TT=4.826	SAT TT=0.276 ASSIGNMENTS=297 CHECKS=34633	SAT TT=3.49 ASSIGNMENTS=25464 CHECKS=2490420	? (TO) TT=1800.09	SAT TT=0.71 ASSIGNMENTS=2276 CHECKS=326371	SAT TT=0.259 ASSIGNMENTS=303 CHECKS=37035	SAT TT=6.116	SAT TT=35.599	SAT TT=272.507
csp/ramsey4/ normalized-ramsey-32-4.xml	SAT TT=0.375	SAT TT=36.921 CHECKS=8377680 NODES=124110	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=4.81 ASSIGNMENTS=1314	SAT TT=4.363 ASSIGNMENTS=1314	SAT TT=25.54 CHECKS=1777520 NODES=9817	SAT TT=7.545 CHECKS=362562 NODES=891	SAT TT=8.656 CHECKS=1010300 NODES=302	SAT TT=11.008 ASSIGNMENTS=2938 CHECKS=174510	SAT TT=11.403 ASSIGNMENTS=2938 CHECKS=174510	SAT TT=6.501	SAT TT=10.501	SAT TT=0.375 ASSIGNMENTS=452 CHECKS=89852	SAT TT=4.481 ASSIGNMENTS=27208 CHECKS=3086230	? (TO) TT=1800.05	SAT TT=1.002 ASSIGNMENTS=2657 CHECKS=462746	SAT TT=1.789 ASSIGNMENTS=4803 CHECKS=1743960	SAT TT=9.289	SAT TT=36.434	SAT TT=607.457
csp/ramsey4/ normalized-ramsey-33-4.xml	SAT TT=1.122	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT TT=7.596 ASSIGNMENTS=3942	SAT TT=7.973 ASSIGNMENTS=3942	SAT TT=26.14 CHECKS=1313650 NODES=8275	SAT TT=134.572 CHECKS=224256000 NODES=900966	SAT TT=10.909 CHECKS=2061530 NODES=725	SAT TT=11.283 ASSIGNMENTS=3903 CHECKS=295199	SAT TT=11.61 ASSIGNMENTS=3903 CHECKS=295199	SAT TT=7.573	SAT TT=36.879	? (TO) TT=1800.05	SAT TT=5.228 ASSIGNMENTS=29122 CHECKS=3884310	? (TO) TT=1800.1	SAT TT=1.122 ASSIGNMENTS=2576 CHECKS=513364	SAT TT=8.688 ASSIGNMENTS=23991 CHECKS=10180100	SAT TT=30.879	SAT TT=63.96	SAT TT=828.092
csp/ramsey4/ normalized-ramsey-34-4.xml	SAT TT=1.575	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.02	SAT TT=105.834 ASSIGNMENTS=67156	SAT TT=101.739 ASSIGNMENTS=67156	SAT TT=40.921 CHECKS=2479700 NODES=12242	SAT TT=35.663 CHECKS=39719100 NODES=153985	SAT TT=11.409 CHECKS=1516230 NODES=544	SAT TT=14.573 ASSIGNMENTS=14202 CHECKS=1418260	SAT TT=14.598 ASSIGNMENTS=14202 CHECKS=1418260	SAT TT=7.852	SAT TT=41.776	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=1.575 ASSIGNMENTS=3935 CHECKS=909558	SAT TT=11.317 ASSIGNMENTS=28457 CHECKS=13399600	SAT TT=167.738	SAT TT=366.2	SAT TT=1039.57
csp/ramsey4/ normalized-ramsey-35-4.xml	SAT TT=12.963	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=928.021 ASSIGNMENTS=669213	SAT TT=991.658 ASSIGNMENTS=669213	SAT TT=106.465 CHECKS=7799680 NODES=37035	SAT TT=1674.56 CHECKS=2662960000 NODES=10053200	SAT TT=12.963 CHECKS=1777030 NODES=559	SAT TT=1771.32 ASSIGNMENTS=669213	SAT TT=1063.55 ASSIGNMENTS=722397 CHECKS=394854000	SAT TT=160.261	SAT TT=173.659	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=311.551 ASSIGNMENTS=722397 CHECKS=394854000	? (TO) TT=1800.29	SAT TT=800.17	? (TO) TT=1800
csp/ramsey4/ normalized-ramsey-38-4.xml	SAT TT=551.135	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.05	SAT TT=564.971 ASSIGNMENTS=1467950 CHECKS=217059000	SAT TT=551.135 ASSIGNMENTS=1467950 CHECKS=217059000	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.02	? (TO) TT=1800.1
csp/ramsey4/ normalized-ramsey-45-4.xml		? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.21	? (TO) TT=1800.19	? (TO) TT=1800.04
csp/schurrLemma/ normalized-lemma-100-9-mod.xml	UNSAT TT=0.528	? (TO) TT=1800.1	? (TO) TT=1800.11	UNSAT TT=0.626	? (TO) TT=1800.05	? (TO) TT=1800.02	? (problem) TT=1.346	? (problem) TT=1.442	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.552 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.554 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1466.44	UNSAT TT=751.587	UNSAT TT=0.535 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.539 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=29.938	UNSAT TT=0.53 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.528 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=351.423	UNSAT TT=6.271	UNSAT TT=19.517
csp/schurrLemma/ normalized-lemma-12-9-mod.xml	UNSAT TT=0.006	UNSAT TT=27.7 CHECKS=25613000 NODES=320391	UNSAT TT=26.889 CHECKS=24722700 NODES=295247	UNSAT TT=0.029	UNSAT TT=85.673 CHECKS=453129000	UNSAT TT=86.576 CHECKS=446227000	UNSAT TT=0.625 ASSIGNMENTS=0	UNSAT TT=0.615 ASSIGNMENTS=0	UNSAT TT=24.763 CHECKS=31248600 NODES=394741	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=409.422	UNSAT TT=43.735	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.881	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=386.472	UNSAT TT=1.03	UNSAT TT=2
csp/schurrLemma/ normalized-lemma-15-9-mod.xml	UNSAT TT=0.007	UNSAT TT=31.263 CHECKS=34497100 NODES=204625	UNSAT TT=32.959 CHECKS=34693600 NODES=202782	UNSAT TT=0.033	UNSAT TT=117.111 CHECKS=583739000	UNSAT TT=116.253 CHECKS=530920000	UNSAT TT=0.676 ASSIGNMENTS=0	UNSAT TT=0.674 ASSIGNMENTS=0	UNSAT TT=37.503 CHECKS=51654000 NODES=259884	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=784.908	UNSAT TT=53.159	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.971	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=295.39	UNSAT TT=1.343	UNSAT TT=4.464
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/schurrLemma/ normalized-lemma-20-9-mod.xml	UNSAT TT=0.01	UNSAT TT=62.918 CHECKS=75283300 NODES=202721	UNSAT TT=62.38 CHECKS=74485600 NODES=203248	UNSAT TT=0.047	UNSAT TT=87.451 CHECKS=393807000	UNSAT TT=180.19 CHECKS=817337000	UNSAT TT=0.947 ASSIGNMENTS=0	UNSAT TT=0.939 ASSIGNMENTS=0	UNSAT TT=64.881 CHECKS=110513000 NODES=257259	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=823.395	UNSAT TT=77.391	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=6.472	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=470.351	UNSAT TT=1.4	UNSAT TT=5.219
csp/schurrLemma/ normalized-lemma-23-3.xml	SAT TT=0.012	SAT TT=0.867 CHECKS=7356 NODES=163	SAT TT=0.846 CHECKS=417 NODES=0	SAT TT=0.058	SAT TT=0.061 CHECKS=2188	SAT TT=0.049 CHECKS=66058	SAT TT=0.789 ASSIGNMENTS=18	SAT TT=0.68 ASSIGNMENTS=18	SAT TT=0.912 CHECKS=70160 NODES=866	SAT TT=0.888 CHECKS=44108 NODES=426	SAT TT=0.799 CHECKS=13276 NODES=57	SAT TT=0.024 ASSIGNMENTS=14 CHECKS=1109	SAT TT=0.024 ASSIGNMENTS=14 CHECKS=1109	SAT TT=1.235	SAT TT=1.15	SAT TT=0.012 ASSIGNMENTS=14 CHECKS=1109	SAT TT=0.053 ASSIGNMENTS=801 CHECKS=49729	SAT TT=0.682	SAT TT=0.03 ASSIGNMENTS=227 CHECKS=19516	SAT TT=0.07 ASSIGNMENTS=624 CHECKS=68552	SAT TT=1.91	SAT TT=0.838	SAT TT=0.875
csp/schurrLemma/ normalized-lemma-24-3.xml	UNSAT TT=0.083	UNSAT TT=1.613 CHECKS=313553 NODES=5074	UNSAT TT=1.58 CHECKS=305904 NODES=5022	UNSAT TT=0.083	UNSAT TT=1.712 CHECKS=1738540	UNSAT TT=70.438 CHECKS=117852000	UNSAT TT=2.909 ASSIGNMENTS=8068	UNSAT TT=2.905 ASSIGNMENTS=8068	UNSAT TT=1.164 CHECKS=249923 NODES=2782	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.186 ASSIGNMENTS=1549 CHECKS=189500	UNSAT TT=0.186 ASSIGNMENTS=1549 CHECKS=189500	UNSAT TT=1.038	UNSAT TT=0.834	UNSAT TT=0.151 ASSIGNMENTS=1488 CHECKS=182084	UNSAT TT=0.345 ASSIGNMENTS=5217 CHECKS=418785	UNSAT TT=28.658	UNSAT TT=0.431 ASSIGNMENTS=4815 CHECKS=523343	UNSAT TT=0.342 ASSIGNMENTS=3179 CHECKS=386617	UNSAT TT=2.267	UNSAT TT=1.003	UNSAT TT=1.235
csp/schurrLemma/ normalized-lemma-30-9-mod.xml	UNSAT TT=0.015	UNSAT TT=142.409 CHECKS=209016000 NODES=203833	UNSAT TT=154.915 CHECKS=208352000 NODES=202754	UNSAT TT=0.076	UNSAT TT=354.139 CHECKS=1610310000	UNSAT TT=307.782 CHECKS=1537440000	UNSAT TT=1.125 ASSIGNMENTS=0	UNSAT TT=1.138 ASSIGNMENTS=0	UNSAT TT=157.677 CHECKS=274822000 NODES=251327	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=614.607	UNSAT TT=193.522	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=9.654	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=379.171	UNSAT TT=2.516	UNSAT TT=4.402
csp/schurrLemma/ normalized-lemma-50-9-mod.xml	UNSAT TT=0.044	UNSAT TT=493.224 CHECKS=706177000 NODES=202186	UNSAT TT=460.925 CHECKS=710946000 NODES=203588	UNSAT TT=0.171	UNSAT TT=869.283 CHECKS=3766130000	UNSAT TT=856.879 CHECKS=3702890000	UNSAT TT=2.123 ASSIGNMENTS=0	UNSAT TT=1.976 ASSIGNMENTS=0	UNSAT TT=448.819 CHECKS=804566000 NODES=256766	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.06 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=808.924	UNSAT TT=608.924	UNSAT TT=0.049 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=15.438	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=534.629	UNSAT TT=3.041	UNSAT TT=6.168
csp/schurrLemma/ normalized-lemma-66-4.xml	SAT TT=0.073	SAT TT=1.38 CHECKS=6355 NODES=79	? (TO) TT=1800.13	SAT TT=1675.52	SAT TT=7.54 CHECKS=6558790	? (TO) TT=1800.04	SAT TT=1.812 ASSIGNMENTS=86	SAT TT=1.547 ASSIGNMENTS=86	? (TO) TT=1800.02	SAT TT=41.464 CHECKS=77632000 NODES=183301	SAT TT=1.71 CHECKS=411248 NODES=387	SAT TT=0.085 ASSIGNMENTS=74 CHECKS=23832	SAT TT=0.089 ASSIGNMENTS=74 CHECKS=23832	SAT TT=444.956	? (TO) TT=1800.12	SAT TT=0.073 ASSIGNMENTS=57 CHECKS=19621	SAT TT=421.705 ASSIGNMENTS=821388 CHECKS=577633000	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.15
csp/schurrLemma/ normalized-lemma-67-4.xml		? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/socialGolfers/ normalized-socialGolfer-6-3-5.xml	SAT TT=8.054	? (TO) TT=1800.12	SAT TT=659.955 CHECKS=135231000 NODES=2529250	? (TO) TT=1800.11	SAT TT=8.054 CHECKS=3369210	SAT TT=16.805 CHECKS=7540830	SAT TT=18.227 ASSIGNMENTS=50236	? (TO) TT=1800.16	SAT TT=241.903 CHECKS=78686900 NODES=154180	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=1661.99 ASSIGNMENTS=48701 CHECKS=42122700	SAT TT=319.841 ASSIGNMENTS=48701 CHECKS=42122700	SAT TT=294.496	SAT TT=24.734	SAT TT=237.562 ASSIGNMENTS=65401 CHECKS=151995000	SAT TT=125.667 ASSIGNMENTS=48774 CHECKS=73355900	? (TO) TT=1800.03	SAT TT=910.112 ASSIGNMENTS=408762 CHECKS=505264000	SAT TT=65.991 ASSIGNMENTS=48701 CHECKS=42122700	? (TO) TT=1800.16	SAT TT=51.289	SAT TT=67.654
csp/socialGolfers/ normalized-socialGolfer-6-3-6.xml	SAT TT=2.664	SAT TT=10.484 CHECKS=929194 NODES=20374	SAT TT=987.752 CHECKS=246549000 NODES=2337870	? (TO) TT=1800.1	SAT TT=15.438 CHECKS=2921480	SAT TT=3.716 CHECKS=839495	SAT TT=5.523 ASSIGNMENTS=3038	SAT TT=8.384 ASSIGNMENTS=3832	SAT TT=36.278 CHECKS=9144040 NODES=6829	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=12.619 ASSIGNMENTS=7230 CHECKS=1003200	SAT TT=12.783 ASSIGNMENTS=7230 CHECKS=1003200	SAT TT=10.405	SAT TT=10.435	? (TO) TT=1800.03	SAT TT=7.298 ASSIGNMENTS=82143 CHECKS=5740400	? (TO) TT=1800.11	SAT TT=7.143 ASSIGNMENTS=6226 CHECKS=4721750	SAT TT=8.532 ASSIGNMENTS=4349 CHECKS=5654250	? TT=160.854	SAT TT=20.385	SAT TT=2.664
csp/socialGolfers/ normalized-socialGolfer-6-3-7.xml	SAT TT=2.969	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=12.344 CHECKS=1841210	SAT TT=10.583 CHECKS=1696730	SAT TT=6.991 ASSIGNMENTS=1636	SAT TT=19.181 ASSIGNMENTS=8377	SAT TT=117.361 CHECKS=46589200 NODES=3983	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=23.583 ASSIGNMENTS=6803 CHECKS=6600970	SAT TT=23.175 ASSIGNMENTS=6803 CHECKS=6600970	SAT TT=17.555	SAT TT=19.308	SAT TT=315.559 ASSIGNMENTS=172044 CHECKS=281587000	SAT TT=11.562 ASSIGNMENTS=120393 CHECKS=8509700	? (TO) TT=1800.05	SAT TT=3.27 ASSIGNMENTS=7423 CHECKS=1615370	SAT TT=2.969 ASSIGNMENTS=1443 CHECKS=1423330	? TT=148.518	SAT TT=3.299	SAT TT=4.012
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/socialGolfers/ normalized-socialGolfer-6-3-8.xml	SAT TT=2.05	SAT TT=52.4 CHECKS=13777800 NODES=31419	? (TO) TT=1800.15	? (TO) TT=1800.02	SAT TT=18.941 CHECKS=2521860	SAT TT=34.389 CHECKS=2977640	SAT TT=10.993 ASSIGNMENTS=3277	SAT TT=38.512 ASSIGNMENTS=12029	SAT TT=359.09 CHECKS=443317000 NODES=4523	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=67.027 ASSIGNMENTS=11581 CHECKS=25089100	SAT TT=67.61 ASSIGNMENTS=11581 CHECKS=25089100	SAT TT=43.288	SAT TT=42.26	SAT TT=2.05 ASSIGNMENTS=1879 CHECKS=893598	SAT TT=18.167 ASSIGNMENTS=168472 CHECKS=12085800	? (TO) TT=1800.07	SAT TT=14.336 ASSIGNMENTS=11581 CHECKS=6563140	SAT TT=2.662 ASSIGNMENTS=2205 CHECKS=1150040	? TT=488.465	SAT TT=4.698	SAT TT=5.079
csp/socialGolfers/ normalized-socialGolfer-6-4-5.xml		? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? TT=158.355	? (TO) TT=1800.01	? (TO) TT=1800.06
csp/socialGolfers/ normalized-socialGolfer-6-4-7.xml	SAT TT=20.854	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=291.183	SAT TT=327.835	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1076.63 ASSIGNMENTS=267207 CHECKS=755303000	? (TO) TT=1800.1	? TT=673.939	SAT TT=213.301	SAT TT=20.854
csp/socialGolfers/ normalized-socialGolfer-6-4-8.xml	SAT TT=7.338	? (MO) TT=5.216	SAT TT=1573.03 CHECKS=540812000 NODES=101849	? (TO) TT=1800.03	SAT TT=82.521 CHECKS=6397680	SAT TT=92.526 CHECKS=5826430	SAT TT=19.257 ASSIGNMENTS=4458	SAT TT=655.464 ASSIGNMENTS=125573	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=512.04 ASSIGNMENTS=33305 CHECKS=159002000	SAT TT=477.739 ASSIGNMENTS=33305 CHECKS=159002000	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=177.184 ASSIGNMENTS=36154 CHECKS=94642500	? (TO) TT=1800.08	? TT=226.396	SAT TT=67.114	SAT TT=7.338
csp/socialGolfers/ normalized-socialGolfer-7-4-8.xml	SAT TT=339.765	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT TT=731.177 ASSIGNMENTS=140446 CHECKS=411969000	? (TO) TT=1800.05	? TT=193.072	? (TO) TT=1800.1	SAT TT=339.765
csp/socialGolfers/ normalized-socialGolfer-8-4-8.xml		? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? TT=180.57	? (TO) TT=1800	? (TO) TT=1800.03
csp/socialGolfers/ normalized-socialGolfer-9-4-8.xml		? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.07	? TT=215.161	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/tdsp/ normalized-C1-1-20.xml	SAT TT=4.784	SAT TT=86.238 CHECKS=57861100 NODES=65274	SAT TT=1235.48 CHECKS=928176000 NODES=852887	SAT TT=1342.54	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.17	SAT TT=77.892 CHECKS=9735920 NODES=14134	SAT TT=47.121 CHECKS=50109200 NODES=58411	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800	? (problem) TT=68.54	? (problem) TT=64.586	? (TO) TT=1800.06	SAT TT=20.575 ASSIGNMENTS=282451 CHECKS=55700500	? TT=0.309	? (TO) TT=1800.02	? (TO) TT=1800.06	? TT=534.728	SAT TT=28.086	SAT TT=4.784
csp/tdsp/ normalized-C1-2-20.xml	SAT TT=5.284	? (TO) TT=1800.13	? (TO) TT=1800.16	SAT TT=1343.62	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.08	? (problem) TT=77.104	? (problem) TT=72.826	? (TO) TT=1800.11	? (TO) TT=1800.09	? TT=0.361	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=763.551	SAT TT=5.284	SAT TT=45.567
csp/tdsp/ normalized-C1-2-21.xml	SAT TT=0.69	SAT TT=22.048 CHECKS=14513200 NODES=9536	SAT TT=2.252 CHECKS=477386 NODES=599	SAT TT=1764.58	SAT TT=51.745 CHECKS=21923800	SAT TT=71.256 CHECKS=31521600	SAT TT=5.266 ASSIGNMENTS=1103	? (TO) TT=1800.16	SAT TT=80.764 CHECKS=11732000 NODES=16517	SAT TT=195.256 CHECKS=389309000 NODES=404081	SAT TT=30.784 CHECKS=1052750 NODES=891	SAT TT=1.011 ASSIGNMENTS=9945 CHECKS=2364700	SAT TT=1.016 ASSIGNMENTS=9945 CHECKS=2364700	? (problem) TT=79.246	? (problem) TT=80.583	SAT TT=2.456 ASSIGNMENTS=27859 CHECKS=6214920	SAT TT=1.473 ASSIGNMENTS=15143 CHECKS=3786700	? TT=0.329	SAT TT=442.012 ASSIGNMENTS=3638160 CHECKS=747705000	SAT TT=0.69 ASSIGNMENTS=5605 CHECKS=1590770	? (TO) TT=1802.21	SAT TT=1.087	SAT TT=1.551
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tdsp/ normalized-C2-1-15.xml	SAT TT=13.833	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.13	? (problem) TT=77.551	? (problem) TT=83.883	? (TO) TT=1800.1	? (TO) TT=1800.01	? TT=0.412	? (TO) TT=1800.06	? (TO) TT=1800.04	? TT=690.107	SAT TT=13.833	SAT TT=160.481
csp/tdsp/ normalized-C2-2-15.xml	SAT TT=5.175	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=54.063 ASSIGNMENTS=203502 CHECKS=94414500	SAT TT=56.208 ASSIGNMENTS=203502 CHECKS=94414500	? (problem) TT=114.428	? (problem) TT=101.036	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=0.453	? (TO) TT=1800.09	SAT TT=48.643 ASSIGNMENTS=203502 CHECKS=94414500	? TT=860.842	SAT TT=5.175	SAT TT=31.941
csp/tdsp/ normalized-C2-3-16.xml	SAT TT=1.024	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=38.132 CHECKS=14261600	SAT TT=94.718 CHECKS=35343600	SAT TT=96.591 ASSIGNMENTS=23864	? (TO) TT=1800.14	? (TO) TT=1800.04	SAT TT=605.575 CHECKS=1122470000 NODES=625967	SAT TT=90.583 CHECKS=946549 NODES=374	SAT TT=8.718 ASSIGNMENTS=1958 CHECKS=1792950	SAT TT=8.52 ASSIGNMENTS=1958 CHECKS=1792950	? (problem) TT=69.913	? (problem) TT=73.722	? (TO) TT=1800.11	? (TO) TT=1800.05	? TT=0.404	? (TO) TT=1800.09	SAT TT=1.024 ASSIGNMENTS=1958 CHECKS=1792950	? (TO) TT=1802.19	SAT TT=1.725	SAT TT=2.9
csp/tdsp/ normalized-C3-1-31.xml	SAT TT=6.587	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	Wrong Cert. TT=1198.58 ASSIGNMENTS=372916	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (problem) TT=87.409	? (problem) TT=86.749	? (TO) TT=1800.02	? (TO) TT=1800.07	? TT=0.55	? (TO) TT=1800.11	? (TO) TT=1800.05	? TT=900.718	SAT TT=6.587	SAT TT=8.783
csp/tdsp/ normalized-C3-2-30.xml		? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.34	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.06	? (problem) TT=74.183	? (problem) TT=80.031	? (TO) TT=1800.03	? (TO) TT=1800.06	? TT=0.417	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=718.15	? (TO) TT=1800.03	? (TO) TT=1800.01
csp/tdsp/ normalized-C4-1-60.xml	SAT TT=96.907	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=96.907 ASSIGNMENTS=468	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? (problem) TT=188.282	? (problem) TT=181.572	? (TO) TT=1800.1	? (TO) TT=1800.06	? TT=0.473	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1801.01	? (TO) TT=1800.03	? (TO) TT=1800.04
csp/tdsp/ normalized-C4-2-60.xml	SAT TT=1353.87	? (TO) TT=1800.1	? (TO) TT=1800.13	SAT TT=1353.87	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? (MO) TT=99.52	? (problem) TT=107.619	? (TO) TT=1800.1	? (TO) TT=1800.08	? TT=0.629	? (TO) TT=1800.07	? (TO) TT=1800.08	? TT=794.093	? (TO) TT=1800.02	? (TO) TT=1800.09
csp/tdsp/ normalized-C4-3-60.xml	SAT TT=104.074	? (TO) TT=1800.11	? (TO) TT=1800.06	SAT TT=1784.59	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=104.074 ASSIGNMENTS=750	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.14	? (problem) TT=159.833	? (problem) TT=170.942	? (TO) TT=1800.04	? (TO) TT=1800.05	? TT=0.465	? (TO) TT=1800.06	? (TO) TT=1800.04	? TT=1707.04	? (TO) TT=1800.1	? (TO) TT=1800.01
csp/tdsp/ normalized-C4-3-61.xml	SAT TT=12.237	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=297.475 ASSIGNMENTS=1202370 CHECKS=972831000	SAT TT=1745.81 ASSIGNMENTS=1202370 CHECKS=972831000	? (problem) TT=189.352	? (problem) TT=160.853	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=0.633	SAT TT=423.799 ASSIGNMENTS=1611260 CHECKS=1481060000	SAT TT=287.246 ASSIGNMENTS=1202370 CHECKS=972831000	? (TO) TT=1800.9	SAT TT=12.237	SAT TT=98.289
csp/tdsp/ normalized-C5-1-90.xml		? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (MO) TT=93.94	? (MO) TT=90.69	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=0.729	? (TO) TT=1800.08	? (TO) TT=1800.05	? TT=1166.35	? (TO) TT=1800.1	? (TO) TT=1800.03
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tdsp/ normalized-C5-1-91.xml	SAT TT=257.173	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (MO) TT=96.51	? (MO) TT=95.37	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=0.529	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=1176.37	SAT TT=257.173	? (TO) TT=1800.01
csp/tdsp/ normalized-C5-2-91.xml	SAT TT=588.036	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.03	? (MO) TT=177.99	? (MO) TT=179.88	? (TO) TT=1800.05	? (TO) TT=1800.04	? TT=0.594	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.29	SAT TT=588.036	SAT TT=796.881
csp/tdsp/ normalized-C5-3-91.xml		? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.09	? (MO) TT=380.42	? (TO) TT=1800.09	? (TO) TT=1800.08	? (MO) TT=95.65	? (MO) TT=98.12	? (TO) TT=1800.06	? (TO) TT=1800.04	? TT=0.73	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=665.229	? (MO) TT=1682.37	? (TO) TT=1800.09
csp/tdsp/ normalized-C6-1-121.xml		? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.22	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (MO) TT=159.33	? (MO) TT=160.83	? (TO) TT=1800.1	? (TO) TT=1800.05	? TT=0.632	? (TO) TT=1800.12	? (TO) TT=1800.07	? TT=1207.08	? (MO) TT=1297.15	? (TO) TT=1800.08
csp/tdsp/ normalized-C6-3-121.xml		? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.06	? (MO) TT=141.94	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.02	? (MO) TT=242.65	? (MO) TT=260.23	? (TO) TT=1800.06	? (TO) TT=1800.12	? TT=0.641	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1801.53	? (MO) TT=1024.04	? (TO) TT=1800
csp/tdsp/ normalized-C7-1-240.xml		? (TO) TT=1800.18	? (TO) TT=1800.27	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.13	? (problem) TT=1620.89	? TT=204.381	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	? (MO) TT=518.58	? (MO) TT=529.92	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=1.365	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.26	? TT=184.402	? TT=177.64
csp/tdsp/ normalized-C7-3-240.xml		? (TO) TT=1800.22	? (TO) TT=1800.24	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.51	? (problem) TT=56.485	? TT=204.269	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	? (MO) TT=785.97	? (MO) TT=784.96	? (TO) TT=1800.14	? (TO) TT=1800.16	? TT=1.226	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.26	? TT=182.376	? TT=180.267
csp/ukHerald/ normalized-crossword-m1-uk-05-02.xml	SAT TT=0.046	SAT TT=0.948 CHECKS=2899 NODES=23	SAT TT=0.915 CHECKS=2305 NODES=0	SAT TT=3.217	SAT TT=1.491 CHECKS=4152	SAT TT=1.11 CHECKS=2268	? (TO) TT=1800.08	SAT TT=1.612 ASSIGNMENTS=15	SAT TT=103.121 CHECKS=8225240 NODES=27	SAT TT=460.797 CHECKS=1447100000 NODES=1648800000	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=4.211 ASSIGNMENTS=6009 CHECKS=942989	SAT TT=0.193 ASSIGNMENTS=477 CHECKS=36087	SAT TT=1.68	SAT TT=0.046 ASSIGNMENTS=9 CHECKS=1290	SAT TT=0.139 ASSIGNMENTS=159 CHECKS=18459	? (MO) TT=32.444	SAT TT=17.515	SAT TT=21.08
csp/ukHerald/ normalized-crossword-m1-uk-05-05.xml	SAT TT=0.038	SAT TT=0.892 CHECKS=5817 NODES=17	SAT TT=0.873 CHECKS=8932 NODES=0	SAT TT=1.492	SAT TT=0.585 CHECKS=3876	SAT TT=0.318 CHECKS=1616	SAT TT=1.425 ASSIGNMENTS=100	SAT TT=1.02 ASSIGNMENTS=13	SAT TT=108.664 CHECKS=2733030 NODES=18	SAT TT=54.492 CHECKS=1990580 NODES=3750010	SAT TT=48.045 CHECKS=2307500 NODES=61	SAT TT=0.956 ASSIGNMENTS=4755 CHECKS=878016	SAT TT=0.897 ASSIGNMENTS=4755 CHECKS=878016	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=1.142 ASSIGNMENTS=6468 CHECKS=1185040	SAT TT=0.459 ASSIGNMENTS=1998 CHECKS=176846	SAT TT=0.955	SAT TT=0.038 ASSIGNMENTS=31 CHECKS=2760	SAT TT=0.115 ASSIGNMENTS=234 CHECKS=27385	? (MO) TT=45.596	SAT TT=6.169	SAT TT=6.93
csp/ukHerald/ normalized-crossword-m1-uk-15-01.xml	SAT TT=0.523	SAT TT=2.44 CHECKS=96913 NODES=193	SAT TT=3.612 CHECKS=197374 NODES=193	? (TO) TT=1800.06	SAT TT=13.571 CHECKS=42875	SAT TT=13.68 CHECKS=45565	SAT TT=16.976 ASSIGNMENTS=108	SAT TT=36.537 ASSIGNMENTS=72	SAT TT=271.525 CHECKS=816286000 NODES=231	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=0.595 ASSIGNMENTS=114 CHECKS=49434	SAT TT=0.681 ASSIGNMENTS=114 CHECKS=49434	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.592 ASSIGNMENTS=107 CHECKS=46263	SAT TT=56.272 ASSIGNMENTS=18777 CHECKS=15974000	SAT TT=38.014	SAT TT=18.061 ASSIGNMENTS=5545 CHECKS=2916720	SAT TT=0.523 ASSIGNMENTS=88 CHECKS=43588	? (MO) TT=34.453	? (TO) TT=1800.06	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukHerald/ normalized-crossword-m1-uk-15-02.xml	SAT TT=0.601	SAT TT=3.29 CHECKS=189251 NODES=341	SAT TT=3.558 CHECKS=264556 NODES=200	? (TO) TT=1800.08	SAT TT=26.614 CHECKS=282581	SAT TT=14.166 CHECKS=105858	SAT TT=20.367 ASSIGNMENTS=84	SAT TT=49.898 ASSIGNMENTS=95	SAT TT=249.371 CHECKS=568097000 NODES=304	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=1.459 ASSIGNMENTS=150 CHECKS=154585	SAT TT=1.495 ASSIGNMENTS=150 CHECKS=154585	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=1.892 ASSIGNMENTS=174 CHECKS=213851	SAT TT=51.806 ASSIGNMENTS=18346 CHECKS=20437400	SAT TT=180.021	SAT TT=84.927 ASSIGNMENTS=25311 CHECKS=18957800	SAT TT=0.601 ASSIGNMENTS=90 CHECKS=56622	? TT=93.953	? (TO) TT=1800.04	? (MO) TT=8.53
csp/ukHerald/ normalized-crossword-m1-uk-15-03.xml	SAT TT=0.435	SAT TT=3.011 CHECKS=164281 NODES=193	SAT TT=3.844 CHECKS=295964 NODES=193	SAT TT=43.554	SAT TT=23.499 CHECKS=64065	SAT TT=21.954 CHECKS=65746	SAT TT=16.759 ASSIGNMENTS=96	SAT TT=62.969 ASSIGNMENTS=85	SAT TT=211.905 CHECKS=569706000 NODES=277	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.477 ASSIGNMENTS=100 CHECKS=57505	SAT TT=0.475 ASSIGNMENTS=100 CHECKS=57505	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=0.435 ASSIGNMENTS=100 CHECKS=57505	SAT TT=48.676 ASSIGNMENTS=32342 CHECKS=25682200	? (TO) TT=1800.01	SAT TT=57.119 ASSIGNMENTS=19822 CHECKS=13527000	SAT TT=0.461 ASSIGNMENTS=97 CHECKS=59762	? (MO) TT=32.129	? (TO) TT=1800.18	? (TO) TT=1800.1
csp/ukHerald/ normalized-crossword-m1-uk-15-07.xml	SAT TT=0.72	SAT TT=3.169 CHECKS=131821 NODES=339	SAT TT=5.196 CHECKS=301246 NODES=563	? (TO) TT=1800.08	SAT TT=28.692 CHECKS=53325	SAT TT=25.231 CHECKS=41955	SAT TT=20.794 ASSIGNMENTS=81	SAT TT=57.916 ASSIGNMENTS=398	SAT TT=155.299 CHECKS=352556000 NODES=282	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=0.72 ASSIGNMENTS=93 CHECKS=52502	SAT TT=0.741 ASSIGNMENTS=93 CHECKS=52502	? (TO) TT=1800	? (TO) TT=1800.08	SAT TT=0.831 ASSIGNMENTS=89 CHECKS=53188	SAT TT=76.223 ASSIGNMENTS=21195 CHECKS=18353600	SAT TT=42.588	SAT TT=60.925 ASSIGNMENTS=15212 CHECKS=8491090	SAT TT=3.478 ASSIGNMENTS=253 CHECKS=259613	? (MO) TT=32.317	? (MO) TT=6.367	? (MO) TT=6.318
csp/ukHerald/ normalized-crossword-m1-uk-15-08.xml	SAT TT=0.489	SAT TT=2.831 CHECKS=175189 NODES=192	SAT TT=3.323 CHECKS=321226 NODES=193	? (TO) TT=1800.06	SAT TT=21.768 CHECKS=57960	SAT TT=20.096 CHECKS=55098	SAT TT=13.178 ASSIGNMENTS=101	SAT TT=54.732 ASSIGNMENTS=92	SAT TT=194.18 CHECKS=355224000 NODES=336	? (TO) TT=1800.03	? (TO) TT=1800	SAT TT=0.508 ASSIGNMENTS=106 CHECKS=53264	SAT TT=0.509 ASSIGNMENTS=106 CHECKS=53264	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT TT=0.497 ASSIGNMENTS=106 CHECKS=53264	SAT TT=34.811 ASSIGNMENTS=27410 CHECKS=21478700	? (TO) TT=1800.07	SAT TT=57.259 ASSIGNMENTS=25215 CHECKS=13960600	SAT TT=0.489 ASSIGNMENTS=113 CHECKS=53723	? TT=83.108	SAT TT=1760.92	? (TO) TT=1800.04
csp/ukHerald/ normalized-crossword-m1-uk-15-09.xml	SAT TT=0.372	SAT TT=2.573 CHECKS=130241 NODES=192	SAT TT=3.334 CHECKS=240541 NODES=190	? (TO) TT=1800.12	SAT TT=21.763 CHECKS=52515	SAT TT=20.271 CHECKS=55401	SAT TT=15.21 ASSIGNMENTS=112	SAT TT=62.966 ASSIGNMENTS=104	SAT TT=196.766 CHECKS=346094000 NODES=252	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=0.414 ASSIGNMENTS=108 CHECKS=54672	SAT TT=0.441 ASSIGNMENTS=108 CHECKS=54672	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=0.408 ASSIGNMENTS=108 CHECKS=54672	SAT TT=33.865 ASSIGNMENTS=29957 CHECKS=18910800	? (TO) TT=1800.07	SAT TT=60.154 ASSIGNMENTS=28153 CHECKS=16552900	SAT TT=0.372 ASSIGNMENTS=102 CHECKS=53487	? (MO) TT=38.593	SAT TT=1323.61	? (TO) TT=1800
csp/ukHerald/ normalized-crossword-m1-uk-15-10.xml	SAT TT=0.912	SAT TT=3.116 CHECKS=154549 NODES=194	SAT TT=4.127 CHECKS=244835 NODES=194	? (TO) TT=1800.08	SAT TT=29.029 CHECKS=226542	SAT TT=13.128 CHECKS=54908	SAT TT=21.926 ASSIGNMENTS=67	SAT TT=144.075 ASSIGNMENTS=580	SAT TT=137.068 CHECKS=213827000 NODES=311	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.944 ASSIGNMENTS=99 CHECKS=107863	SAT TT=0.953 ASSIGNMENTS=99 CHECKS=107863	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=1.12 ASSIGNMENTS=113 CHECKS=125368	SAT TT=75.587 ASSIGNMENTS=23894 CHECKS=25025700	SAT TT=1187.63	SAT TT=57.147 ASSIGNMENTS=12945 CHECKS=10499400	SAT TT=0.912 ASSIGNMENTS=89 CHECKS=95330	? TT=76.313	? (MO) TT=6.336	? (MO) TT=9.609
csp/ukHerald/ normalized-crossword-m1-uk-19-01.xml	SAT TT=0.883	SAT TT=5.176 CHECKS=562361 NODES=309	SAT TT=6.925 CHECKS=966890 NODES=309	? (TO) TT=1800.07	SAT TT=68.764 CHECKS=746010	SAT TT=27.379 CHECKS=149285	SAT TT=29.125 ASSIGNMENTS=146	SAT TT=65.627 ASSIGNMENTS=148	SAT TT=177.186 CHECKS=394318000 NODES=605	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.955 ASSIGNMENTS=168 CHECKS=175819	SAT TT=0.948 ASSIGNMENTS=168 CHECKS=175819	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.883 ASSIGNMENTS=168 CHECKS=175819	SAT TT=13.812 ASSIGNMENTS=3627 CHECKS=5037440	? (TO) TT=1800.07	SAT TT=112.345 ASSIGNMENTS=37431 CHECKS=51947300	SAT TT=1.044 ASSIGNMENTS=175 CHECKS=193230	? TT=79.855	? (TO) TT=1800.13	? (MO) TT=6.34
csp/ukHerald/ normalized-crossword-m1-uk-19-04.xml	SAT TT=0.884	SAT TT=4.284 CHECKS=402686 NODES=303	SAT TT=5.829 CHECKS=785714 NODES=304	? (TO) TT=1800.06	SAT TT=43.358 CHECKS=212130	SAT TT=37.909 CHECKS=184866	SAT TT=26.109 ASSIGNMENTS=178	SAT TT=64.389 ASSIGNMENTS=146	SAT TT=256.306 CHECKS=652979000 NODES=549	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=0.889 ASSIGNMENTS=173 CHECKS=151353	SAT TT=0.998 ASSIGNMENTS=173 CHECKS=151353	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=0.884 ASSIGNMENTS=172 CHECKS=153766	SAT TT=76.836 ASSIGNMENTS=25743 CHECKS=45344000	? (TO) TT=1800.09	SAT TT=53.358 ASSIGNMENTS=10581 CHECKS=10652000	SAT TT=0.989 ASSIGNMENTS=196 CHECKS=208081	? (MO) TT=40.503	? (TO) TT=1800.06	? (TO) TT=1800
csp/ukHerald/ normalized-crossword-m1-uk-19-05.xml	SAT TT=0.578	SAT TT=3.988 CHECKS=415238 NODES=294	SAT TT=5.809 CHECKS=711803 NODES=294	? (TO) TT=1800.07	SAT TT=20.76 CHECKS=199060	SAT TT=15.169 CHECKS=164919	SAT TT=30.108 ASSIGNMENTS=145	SAT TT=64.699 ASSIGNMENTS=153	SAT TT=233.301 CHECKS=532002000 NODES=352	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=0.613 ASSIGNMENTS=149 CHECKS=142805	SAT TT=0.627 ASSIGNMENTS=149 CHECKS=142805	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=0.578 ASSIGNMENTS=149 CHECKS=142805	SAT TT=2.763 ASSIGNMENTS=808 CHECKS=1224110	? (TO) TT=1800	SAT TT=30.603 ASSIGNMENTS=9426 CHECKS=16563700	SAT TT=0.614 ASSIGNMENTS=152 CHECKS=151127	? (MO) TT=30.333	? (TO) TT=1800.09	? (TO) TT=1800.04
csp/ukHerald/ normalized-crossword-m1-uk-19-08.xml	SAT TT=0.977	SAT TT=5.455 CHECKS=605917 NODES=306	SAT TT=7.162 CHECKS=1047760 NODES=301	? (TO) TT=1800.08	SAT TT=26.145 CHECKS=195273	SAT TT=17.47 CHECKS=150606	SAT TT=31.761 ASSIGNMENTS=157	SAT TT=69.351 ASSIGNMENTS=445	SAT TT=186.606 CHECKS=270481000 NODES=576	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=0.977 ASSIGNMENTS=188 CHECKS=193713	SAT TT=1.043 ASSIGNMENTS=188 CHECKS=193713	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1.042 ASSIGNMENTS=183 CHECKS=192874	SAT TT=3.072 ASSIGNMENTS=835 CHECKS=1164130	SAT TT=84.294	SAT TT=57.431 ASSIGNMENTS=18956 CHECKS=30979000	SAT TT=0.982 ASSIGNMENTS=165 CHECKS=174481	? (MO) TT=32.194	? (MO) TT=7.03	? (TO) TT=1800.03
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukHerald/ normalized-crossword-m1-uk-19-10.xml	SAT TT=0.768	SAT TT=5.392 CHECKS=620917 NODES=297	SAT TT=7.56 CHECKS=1227720 NODES=296	? (TO) TT=1800.08	SAT TT=20.186 CHECKS=256793	SAT TT=14.809 CHECKS=234835	SAT TT=32.523 ASSIGNMENTS=155	SAT TT=65.847 ASSIGNMENTS=135	SAT TT=206.331 CHECKS=533569000 NODES=508	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=0.768 ASSIGNMENTS=155 CHECKS=178397	SAT TT=0.825 ASSIGNMENTS=155 CHECKS=178397	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=0.812 ASSIGNMENTS=155 CHECKS=178397	SAT TT=1.262 ASSIGNMENTS=384 CHECKS=531593	SAT TT=19.472	SAT TT=87.007 ASSIGNMENTS=33061 CHECKS=71046500	SAT TT=0.82 ASSIGNMENTS=147 CHECKS=189234	? TT=79.018	? (TO) TT=1800.08	? (TO) TT=1800.04
csp/ukHerald/ normalized-crossword-m1-uk-21-02.xml	SAT TT=1.214	SAT TT=5.768 CHECKS=519482 NODES=374	SAT TT=8.513 CHECKS=960284 NODES=648	? (TO) TT=1800.14	SAT TT=37.847 CHECKS=229293	SAT TT=29.984 CHECKS=160252	SAT TT=35.257 ASSIGNMENTS=169	SAT TT=209.427 ASSIGNMENTS=8461	SAT TT=362.062 CHECKS=1270520000 NODES=702	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=1.36 ASSIGNMENTS=232 CHECKS=266580	SAT TT=1.354 ASSIGNMENTS=232 CHECKS=266580	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=1.315 ASSIGNMENTS=232 CHECKS=259831	SAT TT=47.348 ASSIGNMENTS=12305 CHECKS=18195500	SAT TT=143.473	SAT TT=124.792 ASSIGNMENTS=32369 CHECKS=47701200	SAT TT=1.214 ASSIGNMENTS=180 CHECKS=209962	? TT=65.758	? (TO) TT=1800.15	? (MO) TT=6.281
csp/ukHerald/ normalized-crossword-m1-uk-21-04.xml	SAT TT=5.888	SAT TT=11.48 CHECKS=1494660 NODES=2095	SAT TT=9.823 CHECKS=716755 NODES=1111	? (TO) TT=1800.16	SAT TT=59.402 CHECKS=867483	SAT TT=153.594 CHECKS=1937540	SAT TT=114.376 ASSIGNMENTS=779	? (TO) TT=1800.11	SAT TT=252.471 CHECKS=782416000 NODES=665	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=18.114 ASSIGNMENTS=1973 CHECKS=1698940	SAT TT=18.213 ASSIGNMENTS=1973 CHECKS=1698940	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=11.017 ASSIGNMENTS=1334 CHECKS=2083100	SAT TT=58.316 ASSIGNMENTS=11441 CHECKS=17480000	? (MO) TT=37.79	SAT TT=46.807 ASSIGNMENTS=10147 CHECKS=15381800	SAT TT=5.888 ASSIGNMENTS=792 CHECKS=1339600	? TT=82.69	? (TO) TT=1800.21	? (TO) TT=1800.17
csp/ukHerald/ normalized-crossword-m1-uk-23-01.xml	SAT TT=1.35	SAT TT=12.021 CHECKS=1354100 NODES=2088	SAT TT=13.91 CHECKS=1362450 NODES=1630	? (TO) TT=1800.11	SAT TT=53.6 CHECKS=763199	SAT TT=43.096 CHECKS=575273	SAT TT=69.315 ASSIGNMENTS=157	? (TO) TT=1800.06	SAT TT=175.647 CHECKS=196994000 NODES=994	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=2.01 ASSIGNMENTS=263 CHECKS=449526	SAT TT=1.884 ASSIGNMENTS=263 CHECKS=449526	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=2.387 ASSIGNMENTS=332 CHECKS=613928	SAT TT=71.243 ASSIGNMENTS=9228 CHECKS=18808600	? (MO) TT=41.13	SAT TT=374.255 ASSIGNMENTS=54622 CHECKS=133821000	SAT TT=1.35 ASSIGNMENTS=183 CHECKS=249968	? TT=93.939	? (MO) TT=7.406	? (MO) TT=6.98
csp/ukHerald/ normalized-crossword-m1-uk-23-02.xml	SAT TT=1.471	SAT TT=9.087 CHECKS=1290960 NODES=737	SAT TT=10.085 CHECKS=1446230 NODES=443	? (TO) TT=1800.15	SAT TT=47.458 CHECKS=408161	SAT TT=35.499 CHECKS=339184	SAT TT=44.654 ASSIGNMENTS=199	SAT TT=958.567 ASSIGNMENTS=30636	SAT TT=335.906 CHECKS=918327000 NODES=721	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1.681 ASSIGNMENTS=225 CHECKS=317981	SAT TT=1.942 ASSIGNMENTS=225 CHECKS=317981	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=1.71 ASSIGNMENTS=227 CHECKS=322505	SAT TT=11.792 ASSIGNMENTS=2614 CHECKS=4719430	? (MO) TT=39.95	SAT TT=168.643 ASSIGNMENTS=42650 CHECKS=77359600	SAT TT=1.471 ASSIGNMENTS=209 CHECKS=300938	? TT=94.037	? (MO) TT=8.12	? (MO) TT=8.17
csp/ukHerald/ normalized-crossword-m1-uk-23-07.xml	SAT TT=1.539	SAT TT=7.453 CHECKS=623282 NODES=454	SAT TT=12.283 CHECKS=1631290 NODES=877	? (TO) TT=1800.18	Signal TT=21.229	SAT TT=46.736 CHECKS=261306	SAT TT=59.87 ASSIGNMENTS=376	? (TO) TT=1800.12	SAT TT=440.563 CHECKS=1599670000 NODES=806	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=1.622 ASSIGNMENTS=192 CHECKS=278495	SAT TT=1.625 ASSIGNMENTS=192 CHECKS=278495	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=1.539 ASSIGNMENTS=192 CHECKS=278495	SAT TT=72.53 ASSIGNMENTS=12606 CHECKS=25315800	? (MO) TT=40.64	SAT TT=418.712 ASSIGNMENTS=86335 CHECKS=163247000	SAT TT=2.155 ASSIGNMENTS=284 CHECKS=463154	? (MO) TT=36.778	? (MO) TT=8	? (MO) TT=7.243
csp/ukHerald/ normalized-crossword-m1-uk-23-09.xml	SAT TT=1.388	SAT TT=12.913 CHECKS=2032160 NODES=1459	SAT TT=15.423 CHECKS=1762240 NODES=1294	? (TO) TT=1800.12	SAT TT=53.079 CHECKS=1452100	SAT TT=41.87 CHECKS=685117	SAT TT=68.736 ASSIGNMENTS=257	SAT TT=519.31 ASSIGNMENTS=9059	SAT TT=720.149 CHECKS=3126790000 NODES=859	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=1.897 ASSIGNMENTS=232 CHECKS=622054	SAT TT=1.888 ASSIGNMENTS=232 CHECKS=622054	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=2.341 ASSIGNMENTS=290 CHECKS=769641	SAT TT=57.252 ASSIGNMENTS=10767 CHECKS=29627900	? (MO) TT=40.3	SAT TT=232.74 ASSIGNMENTS=46448 CHECKS=129061000	SAT TT=1.388 ASSIGNMENTS=194 CHECKS=401189	? (MO) TT=35.066	? (MO) TT=6.327	? (TO) TT=1800.14
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle03.xml	SAT TT=0.026	SAT TT=0.803 CHECKS=1815 NODES=14	SAT TT=0.813 CHECKS=1513 NODES=0	SAT TT=0.349	SAT TT=0.259 CHECKS=1109	SAT TT=0.214 CHECKS=918	SAT TT=1.17 ASSIGNMENTS=80	SAT TT=1.025 ASSIGNMENTS=10	SAT TT=130.827 CHECKS=315682 NODES=14	SAT TT=70.561 CHECKS=530593 NODES=300015	SAT TT=84.724 CHECKS=761223 NODES=18	SAT TT=0.236 ASSIGNMENTS=1077 CHECKS=65303	SAT TT=0.253 ASSIGNMENTS=1077 CHECKS=65303	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=0.226 ASSIGNMENTS=769 CHECKS=51674	SAT TT=0.027 ASSIGNMENTS=53 CHECKS=2106	SAT TT=0.635	SAT TT=0.028 ASSIGNMENTS=51 CHECKS=2632	SAT TT=0.026 ASSIGNMENTS=80 CHECKS=4357	? (TO) TT=1800.15	SAT TT=1.805	SAT TT=2.543
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle04.xml	SAT TT=0.047	SAT TT=0.871 CHECKS=2467 NODES=19	SAT TT=0.887 CHECKS=5240 NODES=19	SAT TT=1.862	SAT TT=0.626 CHECKS=1738	SAT TT=0.477 CHECKS=1127	SAT TT=1.489 ASSIGNMENTS=66	SAT TT=1.215 ASSIGNMENTS=15	SAT TT=116.504 CHECKS=2756070 NODES=20	SAT TT=55.429 CHECKS=3288410 NODES=2550010	SAT TT=119.606 CHECKS=111861000 NODES=4952	SAT TT=0.375 ASSIGNMENTS=997 CHECKS=75703	SAT TT=0.354 ASSIGNMENTS=997 CHECKS=75703	? (TO) TT=1800	? (TO) TT=1800.07	SAT TT=0.475 ASSIGNMENTS=1832 CHECKS=125766	SAT TT=0.182 ASSIGNMENTS=424 CHECKS=23238	SAT TT=0.96	SAT TT=0.047 ASSIGNMENTS=27 CHECKS=1367	SAT TT=0.074 ASSIGNMENTS=363 CHECKS=12708	? (MO) TT=46.073	SAT TT=6.754	SAT TT=8.954
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle07.xml	SAT TT=0.076	SAT TT=0.905 CHECKS=4691 NODES=30	SAT TT=1.032 CHECKS=5537 NODES=0	SAT TT=2.087	SAT TT=0.941 CHECKS=2908	SAT TT=0.824 CHECKS=1868	SAT TT=7.555 ASSIGNMENTS=824	SAT TT=1.463 ASSIGNMENTS=22	SAT TT=121.185 CHECKS=5122460 NODES=31	SAT TT=146.875 CHECKS=195718000 NODES=294000000	SAT TT=1022.98 CHECKS=1455280000 NODES=85341	SAT TT=0.357 ASSIGNMENTS=968 CHECKS=86777	SAT TT=0.39 ASSIGNMENTS=968 CHECKS=86777	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=0.602 ASSIGNMENTS=1462 CHECKS=144297	SAT TT=0.171 ASSIGNMENTS=318 CHECKS=27838	SAT TT=1.392	SAT TT=0.081 ASSIGNMENTS=128 CHECKS=7361	SAT TT=0.076 ASSIGNMENTS=113 CHECKS=8072	? TT=99.585	SAT TT=12.823	SAT TT=14.045
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle08.xml	SAT TT=0.113	SAT TT=1.389 CHECKS=13338 NODES=41	SAT TT=1.273 CHECKS=10461 NODES=0	SAT TT=3.552	SAT TT=1.751 CHECKS=4697	SAT TT=1.662 CHECKS=5619	SAT TT=3.061 ASSIGNMENTS=282	SAT TT=2.55 ASSIGNMENTS=28	SAT TT=121.85 CHECKS=229328 NODES=41	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=0.657 ASSIGNMENTS=1746 CHECKS=361913	SAT TT=0.659 ASSIGNMENTS=1746 CHECKS=361913	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=0.643 ASSIGNMENTS=1546 CHECKS=335204	SAT TT=2.161 ASSIGNMENTS=1725 CHECKS=282309	SAT TT=3.287	SAT TT=0.113 ASSIGNMENTS=24 CHECKS=2799	SAT TT=0.151 ASSIGNMENTS=171 CHECKS=31449	? (TO) TT=1800.18	SAT TT=203.699	SAT TT=221.05
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle09.xml	SAT TT=0.16	SAT TT=1.111 CHECKS=6784 NODES=35	SAT TT=1.273 CHECKS=6058 NODES=0	SAT TT=4.772	SAT TT=1.786 CHECKS=2683	SAT TT=2.547 CHECKS=4877	SAT TT=4.565 ASSIGNMENTS=280	SAT TT=2.616 ASSIGNMENTS=23	SAT TT=130.85 CHECKS=4519480 NODES=35	? (TO) TT=1800	? (TO) TT=1800.04	SAT TT=1.487 ASSIGNMENTS=1833 CHECKS=497320	SAT TT=1.476 ASSIGNMENTS=1833 CHECKS=497320	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=1.305 ASSIGNMENTS=1569 CHECKS=437323	SAT TT=7.109 ASSIGNMENTS=4093 CHECKS=539529	SAT TT=3.394	SAT TT=0.27 ASSIGNMENTS=118 CHECKS=13089	SAT TT=0.16 ASSIGNMENTS=125 CHECKS=18633	? (MO) TT=32.903	SAT TT=211.699	SAT TT=226.039
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle10.xml	SAT TT=0.108	SAT TT=1.151 CHECKS=24482 NODES=40	SAT TT=1.127 CHECKS=16158 NODES=0	SAT TT=1355.1	SAT TT=2.545 CHECKS=7703	SAT TT=1.988 CHECKS=6570	SAT TT=3.312 ASSIGNMENTS=29	SAT TT=2.95 ASSIGNMENTS=28	SAT TT=129.193 CHECKS=106246 NODES=40	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=0.121 ASSIGNMENTS=24 CHECKS=5277	SAT TT=0.122 ASSIGNMENTS=24 CHECKS=5277	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=0.11 ASSIGNMENTS=24 CHECKS=5277	SAT TT=10.354 ASSIGNMENTS=7536 CHECKS=1293040	SAT TT=468.74	SAT TT=0.174 ASSIGNMENTS=105 CHECKS=18614	SAT TT=0.108 ASSIGNMENTS=29 CHECKS=5271	? (TO) TT=1800.09	SAT TT=291.449	SAT TT=281.36
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle11.xml	SAT TT=0.227	SAT TT=1.148 CHECKS=5174 NODES=38	SAT TT=1.146 CHECKS=1221 NODES=0	SAT TT=1350.29	SAT TT=1.981 CHECKS=2350	SAT TT=1.66 CHECKS=2096	SAT TT=3.891 ASSIGNMENTS=165	SAT TT=3.364 ASSIGNMENTS=19	SAT TT=106.108 CHECKS=183813000 NODES=38	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=0.66 ASSIGNMENTS=1031 CHECKS=180780	SAT TT=0.714 ASSIGNMENTS=1031 CHECKS=180780	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=0.706 ASSIGNMENTS=1029 CHECKS=177782	SAT TT=0.391 ASSIGNMENTS=119 CHECKS=18880	SAT TT=3.388	SAT TT=0.635 ASSIGNMENTS=295 CHECKS=32235	SAT TT=0.227 ASSIGNMENTS=131 CHECKS=18151	? TT=75.756	SAT TT=204.964	SAT TT=233.893
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle12.xml	SAT TT=0.102	SAT TT=1.255 CHECKS=25332 NODES=52	SAT TT=1.203 CHECKS=47841 NODES=52	SAT TT=2.954	SAT TT=1.23 CHECKS=7820	SAT TT=1.001 CHECKS=7088	SAT TT=3.715 ASSIGNMENTS=290	SAT TT=2.739 ASSIGNMENTS=30	SAT TT=123.203 CHECKS=6973150 NODES=53	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=0.997 ASSIGNMENTS=3328 CHECKS=1101320	SAT TT=1.007 ASSIGNMENTS=3328 CHECKS=1101320	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=1.569 ASSIGNMENTS=5479 CHECKS=1486600	SAT TT=3.133 ASSIGNMENTS=13071 CHECKS=2459550	? (TO) TT=1800.09	SAT TT=0.369 ASSIGNMENTS=740 CHECKS=158692	SAT TT=0.102 ASSIGNMENTS=129 CHECKS=57234	? (MO) TT=39.414	SAT TT=14.77	SAT TT=18.98
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle13.xml	SAT TT=0.162	SAT TT=1.699 CHECKS=44249 NODES=65	SAT TT=1.808 CHECKS=82027 NODES=65	SAT TT=1363.7	SAT TT=3.676 CHECKS=27505	SAT TT=3.337 CHECKS=27447	SAT TT=4.417 ASSIGNMENTS=43	SAT TT=5.291 ASSIGNMENTS=34	SAT TT=134.676 CHECKS=1416850 NODES=68	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=0.173 ASSIGNMENTS=46 CHECKS=11081	SAT TT=0.192 ASSIGNMENTS=46 CHECKS=11081	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=0.171 ASSIGNMENTS=46 CHECKS=11081	SAT TT=10.987 ASSIGNMENTS=17069 CHECKS=4218740	SAT TT=4.502	SAT TT=0.316 ASSIGNMENTS=289 CHECKS=74490	SAT TT=0.162 ASSIGNMENTS=39 CHECKS=11221	? (MO) TT=42.922	SAT TT=644.536	SAT TT=636.278
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle15.xml	SAT TT=0.115	SAT TT=1.621 CHECKS=69791 NODES=98	SAT TT=1.947 CHECKS=143798 NODES=98	SAT TT=12.197	SAT TT=6.078 CHECKS=46430	SAT TT=5.603 CHECKS=56144	SAT TT=5.349 ASSIGNMENTS=66	SAT TT=8.325 ASSIGNMENTS=55	SAT TT=129.709 CHECKS=356010 NODES=102	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.129 ASSIGNMENTS=68 CHECKS=22090	SAT TT=0.122 ASSIGNMENTS=68 CHECKS=22090	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=0.116 ASSIGNMENTS=68 CHECKS=22090	SAT TT=9.577 ASSIGNMENTS=26553 CHECKS=8537890	SAT TT=4.917	SAT TT=2.744 ASSIGNMENTS=2814 CHECKS=1438050	SAT TT=0.115 ASSIGNMENTS=66 CHECKS=24137	? (MO) TT=41.38	SAT TT=58.842	SAT TT=77.107
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle16.xml	SAT TT=0.284	SAT TT=2.207 CHECKS=140913 NODES=136	SAT TT=2.703 CHECKS=335213 NODES=136	SAT TT=14.623	SAT TT=6.019 CHECKS=40202	SAT TT=4.563 CHECKS=40753	SAT TT=7.583 ASSIGNMENTS=100	SAT TT=21.422 ASSIGNMENTS=78	SAT TT=205.709 CHECKS=468002000 NODES=218	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=0.305 ASSIGNMENTS=96 CHECKS=36156	SAT TT=0.307 ASSIGNMENTS=96 CHECKS=36156	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=0.304 ASSIGNMENTS=96 CHECKS=36156	SAT TT=19.123 ASSIGNMENTS=25436 CHECKS=14858700	SAT TT=7.324	SAT TT=5.752 ASSIGNMENTS=4365 CHECKS=2302620	SAT TT=0.284 ASSIGNMENTS=93 CHECKS=36316	? (MO) TT=57.712	SAT TT=296.957	SAT TT=301.171
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle17.xml	SAT TT=0.423	SAT TT=2.884 CHECKS=236831 NODES=183	SAT TT=3.682 CHECKS=514465 NODES=180	? (TO) TT=1800.14	SAT TT=12.03 CHECKS=68615	SAT TT=9.645 CHECKS=66258	SAT TT=12.831 ASSIGNMENTS=105	SAT TT=58.022 ASSIGNMENTS=95	SAT TT=196.235 CHECKS=355008000 NODES=274	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=0.463 ASSIGNMENTS=114 CHECKS=64953	SAT TT=0.464 ASSIGNMENTS=114 CHECKS=64953	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=0.447 ASSIGNMENTS=114 CHECKS=64953	SAT TT=34.202 ASSIGNMENTS=26549 CHECKS=23662900	? (TO) TT=1800.05	SAT TT=25.903 ASSIGNMENTS=6615 CHECKS=7068150	SAT TT=0.423 ASSIGNMENTS=102 CHECKS=63464	? TT=82.801	SAT TT=1641.3	? (TO) TT=1800.08
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle19.xml	SAT TT=0.894	SAT TT=3.011 CHECKS=169772 NODES=190	SAT TT=3.985 CHECKS=298553 NODES=190	? (TO) TT=1800.1	SAT TT=12.452 CHECKS=54182	SAT TT=12.883 CHECKS=58255	SAT TT=15.345 ASSIGNMENTS=101	SAT TT=44.029 ASSIGNMENTS=76	SAT TT=153.966 CHECKS=295613000 NODES=250	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=0.934 ASSIGNMENTS=128 CHECKS=78071	SAT TT=0.901 ASSIGNMENTS=128 CHECKS=78071	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=1.079 ASSIGNMENTS=162 CHECKS=99529	SAT TT=42.008 ASSIGNMENTS=27790 CHECKS=20524300	? (TO) TT=1800.01	SAT TT=47.406 ASSIGNMENTS=17135 CHECKS=10247800	SAT TT=0.894 ASSIGNMENTS=135 CHECKS=71067	? TT=82.311	? (TO) TT=1800.01	? (TO) TT=1800.06
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle22.xml	SAT TT=0.219	SAT TT=2.08 CHECKS=126191 NODES=193	SAT TT=2.39 CHECKS=177480 NODES=135	? (TO) TT=1800.12	SAT TT=8.853 CHECKS=47363	SAT TT=7.246 CHECKS=48707	SAT TT=11.823 ASSIGNMENTS=67	SAT TT=24.841 ASSIGNMENTS=87	SAT TT=133.931 CHECKS=2587760 NODES=134	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=0.245 ASSIGNMENTS=81 CHECKS=38680	SAT TT=0.238 ASSIGNMENTS=81 CHECKS=38680	? (TO) TT=1800	? (TO) TT=1800.05	SAT TT=0.219 ASSIGNMENTS=81 CHECKS=38680	SAT TT=27.076 ASSIGNMENTS=18427 CHECKS=10550200	SAT TT=27.304	SAT TT=9.226 ASSIGNMENTS=3810 CHECKS=3286960	SAT TT=0.226 ASSIGNMENTS=63 CHECKS=36795	? (MO) TT=34.985	SAT TT=645.075	SAT TT=849.984
csp/wordsHerald/ normalized-crossword-m1-words-05-01.xml	SAT TT=0.045	SAT TT=0.952 CHECKS=4459 NODES=30	SAT TT=1.1 CHECKS=18642 NODES=60	SAT TT=4.131	SAT TT=1.209 CHECKS=35034	SAT TT=1.095 CHECKS=33362	SAT TT=8.139 ASSIGNMENTS=719	SAT TT=1.986 ASSIGNMENTS=33	SAT TT=66.275 CHECKS=62943700 NODES=105	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=16.65 ASSIGNMENTS=719	SAT TT=7.495 ASSIGNMENTS=162 CHECKS=17924	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=4.257 ASSIGNMENTS=4006 CHECKS=2090980	SAT TT=1.877 ASSIGNMENTS=8321 CHECKS=914459	SAT TT=1.049	SAT TT=0.543 ASSIGNMENTS=652 CHECKS=244430	SAT TT=0.045 ASSIGNMENTS=162 CHECKS=17924	? (MO) TT=45.153	SAT TT=10.01	SAT TT=19.734
csp/wordsHerald/ normalized-crossword-m1-words-05-03.xml	SAT TT=0.037	SAT TT=0.839 CHECKS=742 NODES=21	SAT TT=0.915 CHECKS=891 NODES=0	SAT TT=2.01	SAT TT=0.296 CHECKS=1560	SAT TT=0.245 CHECKS=1513	SAT TT=2.378 ASSIGNMENTS=186	SAT TT=1.21 ASSIGNMENTS=10	SAT TT=82.834 CHECKS=14117600 NODES=22	SAT TT=416.227 CHECKS=1958090000 NODES=-1986620000	? (TO) TT=1800.05	SAT TT=0.938 ASSIGNMENTS=1828 CHECKS=246965	SAT TT=0.925 ASSIGNMENTS=1828 CHECKS=246965	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=2.106 ASSIGNMENTS=3784 CHECKS=566325	SAT TT=1.689 ASSIGNMENTS=4360 CHECKS=400578	SAT TT=0.945	SAT TT=0.087 ASSIGNMENTS=162 CHECKS=17362	SAT TT=0.037 ASSIGNMENTS=63 CHECKS=5430	? (MO) TT=33.852	SAT TT=4.911	SAT TT=6.251
csp/wordsHerald/ normalized-crossword-m1-words-05-04.xml	SAT TT=0.031	SAT TT=0.833 CHECKS=2050 NODES=19	SAT TT=0.876 CHECKS=4427 NODES=20	SAT TT=1.712	SAT TT=0.384 CHECKS=3178	SAT TT=0.27 CHECKS=2015	SAT TT=1.298 ASSIGNMENTS=64	SAT TT=1.03 ASSIGNMENTS=15	SAT TT=128.584 CHECKS=7367150 NODES=20	SAT TT=91.565 CHECKS=78564900 NODES=88050000	? (TO) TT=1800.05	SAT TT=0.372 ASSIGNMENTS=1135 CHECKS=99727	SAT TT=0.389 ASSIGNMENTS=1135 CHECKS=99727	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=0.44 ASSIGNMENTS=1541 CHECKS=130648	SAT TT=0.289 ASSIGNMENTS=1199 CHECKS=70623	SAT TT=0.641	SAT TT=0.041 ASSIGNMENTS=81 CHECKS=4996	SAT TT=0.031 ASSIGNMENTS=54 CHECKS=3932	? (MO) TT=44.249	SAT TT=2.812	SAT TT=3.571
csp/wordsHerald/ normalized-crossword-m1-words-05-08.xml	SAT TT=0.039	SAT TT=0.925 CHECKS=1544 NODES=23	SAT TT=0.879 CHECKS=1406 NODES=0	SAT TT=2.668	SAT TT=0.418 CHECKS=2565	SAT TT=0.301 CHECKS=1990	SAT TT=1.828 ASSIGNMENTS=134	SAT TT=1.453 ASSIGNMENTS=17	SAT TT=113.3 CHECKS=19294200 NODES=24	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.538 ASSIGNMENTS=1151 CHECKS=162787	SAT TT=0.527 ASSIGNMENTS=1151 CHECKS=162787	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=1.45 ASSIGNMENTS=3273 CHECKS=510343	SAT TT=1.496 ASSIGNMENTS=5671 CHECKS=465268	SAT TT=1.058	SAT TT=0.042 ASSIGNMENTS=55 CHECKS=6799	SAT TT=0.039 ASSIGNMENTS=98 CHECKS=7894	? (MO) TT=32.76	SAT TT=5.947	SAT TT=7.65
csp/wordsHerald/ normalized-crossword-m1-words-05-10.xml	SAT TT=0.03	SAT TT=0.867 CHECKS=3843 NODES=17	SAT TT=0.866 CHECKS=3799 NODES=0	SAT TT=1.075	SAT TT=0.204 CHECKS=1974	SAT TT=0.169 CHECKS=2064	SAT TT=1.544 ASSIGNMENTS=223	SAT TT=1.052 ASSIGNMENTS=11	SAT TT=121.587 CHECKS=5454510 NODES=17	SAT TT=79.937 CHECKS=6277100 NODES=8550010	SAT TT=87.306 CHECKS=45158600 NODES=8526	SAT TT=0.39 ASSIGNMENTS=1397 CHECKS=257440	SAT TT=0.39 ASSIGNMENTS=1397 CHECKS=257440	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=0.503 ASSIGNMENTS=2102 CHECKS=388492	SAT TT=0.135 ASSIGNMENTS=507 CHECKS=44182	SAT TT=0.591	SAT TT=0.032 ASSIGNMENTS=46 CHECKS=5560	SAT TT=0.03 ASSIGNMENTS=75 CHECKS=4517	? (MO) TT=42.651	SAT TT=2.653	SAT TT=3.063
csp/wordsHerald/ normalized-crossword-m1-words-15-02.xml	SAT TT=1.075	SAT TT=4.761 CHECKS=809987 NODES=976	SAT TT=6.345 CHECKS=1192720 NODES=1361	? (TO) TT=1800.07	SAT TT=59.89 CHECKS=2808580	SAT TT=16.86 CHECKS=984087	SAT TT=21.5 ASSIGNMENTS=369	SAT TT=102.681 ASSIGNMENTS=1364	SAT TT=885.714 CHECKS=4645810000 NODES=928	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=1.075 ASSIGNMENTS=297 CHECKS=533197	SAT TT=1.098 ASSIGNMENTS=297 CHECKS=533197	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=1.227 ASSIGNMENTS=361 CHECKS=643439	SAT TT=24.837 ASSIGNMENTS=11671 CHECKS=18541500	SAT TT=21.678	SAT TT=185.859 ASSIGNMENTS=90940 CHECKS=90050100	SAT TT=1.801 ASSIGNMENTS=454 CHECKS=899974	? (MO) TT=33.437	? (TO) TT=1800.02	? (TO) TT=1800.01
csp/wordsHerald/ normalized-crossword-m1-words-15-04.xml	SAT TT=9.996	SAT TT=19.365 CHECKS=4697600 NODES=8733	SAT TT=9.996 CHECKS=1955800 NODES=3680	? (TO) TT=1800.12	SAT TT=169.242 CHECKS=11930400	SAT TT=265.575 CHECKS=23472400	SAT TT=63.387 ASSIGNMENTS=2814	SAT TT=120.063 ASSIGNMENTS=4486	SAT TT=698.756 CHECKS=3984310000 NODES=907	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=23.795 ASSIGNMENTS=8733 CHECKS=4697600	SAT TT=24.006 ASSIGNMENTS=8733 CHECKS=4697600	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=22.528 ASSIGNMENTS=9940 CHECKS=16109000	SAT TT=67.573 ASSIGNMENTS=24827 CHECKS=40432900	SAT TT=800.625	SAT TT=244.611 ASSIGNMENTS=87647 CHECKS=117981000	SAT TT=68.244 ASSIGNMENTS=16330 CHECKS=42120800	? (MO) TT=36.649	? (TO) TT=1800.02	? (TO) TT=1800.05
csp/wordsHerald/ normalized-crossword-m1-words-15-06.xml	SAT TT=30.486	SAT TT=30.486 CHECKS=3973860 NODES=20398	SAT TT=30.869 CHECKS=5213310 NODES=18243	? (TO) TT=1800.13	? (TO) TT=1800.08	SAT TT=97.157 CHECKS=4793650	SAT TT=366.88 ASSIGNMENTS=11944	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=40.931 ASSIGNMENTS=9597 CHECKS=15938200	SAT TT=36.698 ASSIGNMENTS=20398 CHECKS=3973860	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=185.599 ASSIGNMENTS=49529 CHECKS=79345300	SAT TT=57.904 ASSIGNMENTS=19307 CHECKS=28690800	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=33.13 ASSIGNMENTS=9597 CHECKS=15938200	? (MO) TT=45.044	? (TO) TT=1800.04	? (TO) TT=1800.05
csp/wordsHerald/ normalized-crossword-m1-words-15-08.xml	SAT TT=0.246	SAT TT=2.435 CHECKS=149593 NODES=351	SAT TT=2.83 CHECKS=268775 NODES=333	? (TO) TT=1800.11	SAT TT=42.014 CHECKS=1247230	SAT TT=10.717 CHECKS=229204	SAT TT=11.066 ASSIGNMENTS=80	SAT TT=39.092 ASSIGNMENTS=142	SAT TT=217.1 CHECKS=610744000 NODES=297	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=0.303 ASSIGNMENTS=129 CHECKS=102862	SAT TT=0.306 ASSIGNMENTS=129 CHECKS=102862	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=0.295 ASSIGNMENTS=132 CHECKS=103219	SAT TT=20.943 ASSIGNMENTS=17755 CHECKS=22652000	? (TO) TT=1800.05	SAT TT=81.976 ASSIGNMENTS=53012 CHECKS=36679900	SAT TT=0.246 ASSIGNMENTS=84 CHECKS=68738	? (MO) TT=40.682	SAT TT=322.61	? (TO) TT=1800.01
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsHerald/ normalized-crossword-m1-words-19-01.xml	SAT TT=0.593	SAT TT=5.058 CHECKS=760956 NODES=503	SAT TT=6.509 CHECKS=1050920 NODES=496	? (TO) TT=1800.06	SAT TT=49.747 CHECKS=2618860	SAT TT=11.511 CHECKS=602217	SAT TT=24.86 ASSIGNMENTS=131	SAT TT=68.85 ASSIGNMENTS=217	SAT TT=270.747 CHECKS=887003000 NODES=603	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=1.726 ASSIGNMENTS=600 CHECKS=1430960	SAT TT=1.629 ASSIGNMENTS=600 CHECKS=1430960	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=2.327 ASSIGNMENTS=853 CHECKS=2081220	SAT TT=18.595 ASSIGNMENTS=8403 CHECKS=18053700	SAT TT=29.87	SAT TT=106.369 ASSIGNMENTS=63797 CHECKS=116453000	SAT TT=0.593 ASSIGNMENTS=176 CHECKS=273748	? (MO) TT=32.322	? (TO) TT=1800.11	? (TO) TT=1800.04
csp/wordsHerald/ normalized-crossword-m1-words-19-03.xml	SAT TT=4.442	SAT TT=23.536 CHECKS=5295640 NODES=7838	SAT TT=57.325 CHECKS=13343700 NODES=25509	? (TO) TT=1800.14	SAT TT=694.114 CHECKS=47077200	SAT TT=308.625 CHECKS=26102900	SAT TT=64.253 ASSIGNMENTS=1641	SAT TT=76.115 ASSIGNMENTS=593	SAT TT=283.064 CHECKS=101780000 NODES=2509	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=26.111 ASSIGNMENTS=6853 CHECKS=3811780	SAT TT=25.385 ASSIGNMENTS=6853 CHECKS=3811780	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=1069.06 ASSIGNMENTS=508283 CHECKS=824675000	SAT TT=59.471 ASSIGNMENTS=19162 CHECKS=45669500	? (TO) TT=1800.06	SAT TT=379.566 ASSIGNMENTS=114280 CHECKS=151196000	SAT TT=4.442 ASSIGNMENTS=1481 CHECKS=2499540	? (MO) TT=43.88	? (TO) TT=1800.11	? (TO) TT=1800.05
csp/wordsHerald/ normalized-crossword-m1-words-19-05.xml	SAT TT=1.032	SAT TT=5.636 CHECKS=733248 NODES=1356	SAT TT=6.144 CHECKS=1006730 NODES=1238	? (TO) TT=1800.05	SAT TT=82.476 CHECKS=9465730	SAT TT=9.213 CHECKS=606844	SAT TT=42.543 ASSIGNMENTS=930	SAT TT=68.104 ASSIGNMENTS=229	SAT TT=321.919 CHECKS=1013880000 NODES=441	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1.035 ASSIGNMENTS=226 CHECKS=814865	SAT TT=1.032 ASSIGNMENTS=226 CHECKS=814865	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=1.76 ASSIGNMENTS=459 CHECKS=1710190	SAT TT=16.346 ASSIGNMENTS=6350 CHECKS=17188500	? (TO) TT=1800.04	SAT TT=181.857 ASSIGNMENTS=65016 CHECKS=192796000	SAT TT=1.033 ASSIGNMENTS=220 CHECKS=856671	? (MO) TT=43.143	SAT TT=987.205	? (TO) TT=1800.06
csp/wordsHerald/ normalized-crossword-m1-words-19-08.xml	SAT TT=0.586	SAT TT=5.69 CHECKS=1004380 NODES=561	SAT TT=7.052 CHECKS=1524340 NODES=784	? (TO) TT=1800.09	SAT TT=14.042 CHECKS=608688	SAT TT=7.573 CHECKS=622707	SAT TT=25.691 ASSIGNMENTS=101	SAT TT=65.609 ASSIGNMENTS=146	SAT TT=225.689 CHECKS=539741000 NODES=582	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=0.605 ASSIGNMENTS=140 CHECKS=278988	SAT TT=0.607 ASSIGNMENTS=140 CHECKS=278988	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=0.586 ASSIGNMENTS=140 CHECKS=278988	SAT TT=19.286 ASSIGNMENTS=8133 CHECKS=21189900	? (TO) TT=1800.09	SAT TT=82.569 ASSIGNMENTS=41746 CHECKS=99388800	SAT TT=0.623 ASSIGNMENTS=173 CHECKS=360717	? (MO) TT=31.39	? (TO) TT=1800.02	? (TO) TT=1800.01
csp/wordsHerald/ normalized-crossword-m1-words-21-01.xml	SAT TT=45.202	SAT TT=367.338 CHECKS=88943200 NODES=84365	SAT TT=221.297 CHECKS=64692400 NODES=60778	? (TO) TT=1800.11	SAT TT=528.771 CHECKS=55155700	SAT TT=163.009 CHECKS=17593000	SAT TT=617.182 ASSIGNMENTS=19270	SAT TT=931.838 ASSIGNMENTS=29933	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=101.311 ASSIGNMENTS=20939 CHECKS=74833500	SAT TT=371.378 ASSIGNMENTS=84365 CHECKS=88943200	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=295.914 ASSIGNMENTS=75157 CHECKS=232868000	SAT TT=45.202 ASSIGNMENTS=10974 CHECKS=32270200	? (TO) TT=1800.04	SAT TT=402.652 ASSIGNMENTS=112731 CHECKS=293581000	SAT TT=92.725 ASSIGNMENTS=20939 CHECKS=74833500	? (MO) TT=33.649	? (TO) TT=1800.15	? (TO) TT=1800.06
csp/wordsHerald/ normalized-crossword-m1-words-21-05.xml	SAT TT=4.563	SAT TT=11.862 CHECKS=2069950 NODES=4123	SAT TT=8.487 CHECKS=753379 NODES=2024	? (TO) TT=1800.12	SAT TT=69.995 CHECKS=5019410	SAT TT=67.967 CHECKS=5581790	SAT TT=111.201 ASSIGNMENTS=2879	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=19.188 ASSIGNMENTS=4123 CHECKS=2069950	SAT TT=18.617 ASSIGNMENTS=4123 CHECKS=2069950	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=167.46 ASSIGNMENTS=50958 CHECKS=121384000	SAT TT=21.379 ASSIGNMENTS=9002 CHECKS=16298200	SAT TT=146.865	SAT TT=41.804 ASSIGNMENTS=21655 CHECKS=36903600	SAT TT=4.563 ASSIGNMENTS=1684 CHECKS=3836930	? (MO) TT=43.08	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/wordsHerald/ normalized-crossword-m1-words-21-07.xml	SAT TT=0.999	SAT TT=29.928 CHECKS=9495560 NODES=6682	SAT TT=13.178 CHECKS=3260890 NODES=3057	? (TO) TT=1800.11	SAT TT=97.58 CHECKS=7500180	SAT TT=41.712 CHECKS=3116670	SAT TT=68.122 ASSIGNMENTS=1497	? (TO) TT=1800.16	SAT TT=1084.61 CHECKS=5453890000 NODES=1637	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=1.504 ASSIGNMENTS=431 CHECKS=1012080	SAT TT=1.515 ASSIGNMENTS=431 CHECKS=1012080	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=5.341 ASSIGNMENTS=1884 CHECKS=5020640	SAT TT=21.829 ASSIGNMENTS=8561 CHECKS=16650400	? (TO) TT=1800.08	SAT TT=154.62 ASSIGNMENTS=76763 CHECKS=133447000	SAT TT=0.999 ASSIGNMENTS=309 CHECKS=639214	? (MO) TT=48.195	? (TO) TT=1800.12	? (TO) TT=1800.01
csp/wordsHerald/ normalized-crossword-m1-words-21-08.xml	SAT TT=0.628	SAT TT=5.714 CHECKS=613531 NODES=469	SAT TT=7.377 CHECKS=1019940 NODES=699	? (TO) TT=1800.07	SAT TT=50.986 CHECKS=2788160	SAT TT=15.922 CHECKS=977795	SAT TT=39.84 ASSIGNMENTS=870	? (TO) TT=1800.07	SAT TT=612.412 CHECKS=2687100000 NODES=982	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=0.677 ASSIGNMENTS=193 CHECKS=351784	SAT TT=0.677 ASSIGNMENTS=193 CHECKS=351784	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=0.628 ASSIGNMENTS=186 CHECKS=343283	SAT TT=21.557 ASSIGNMENTS=9616 CHECKS=23259500	SAT TT=182.1	SAT TT=193.662 ASSIGNMENTS=99617 CHECKS=223470000	SAT TT=0.74 ASSIGNMENTS=201 CHECKS=376638	? (MO) TT=34.98	? (TO) TT=1800.06	? (TO) TT=1800.01
csp/wordsHerald/ normalized-crossword-m1-words-21-10.xml		? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.1	? (MO) TT=34.181	? (TO) TT=1800.15	? (TO) TT=1800.03
csp/wordsHerald/ normalized-crossword-m1-words-23-03.xml	SAT TT=22.069	SAT TT=308.21 CHECKS=104121000 NODES=61251	SAT TT=196.868 CHECKS=65045800 NODES=35278	? (TO) TT=1800.07	SAT TT=457.118 CHECKS=47181600	SAT TT=190.128 CHECKS=21206600	SAT TT=219.231 ASSIGNMENTS=6191	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=29.15 ASSIGNMENTS=6131 CHECKS=19540800	SAT TT=302.926 ASSIGNMENTS=61251 CHECKS=104121000	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=121.893 ASSIGNMENTS=39827 CHECKS=106420000	SAT TT=31.339 ASSIGNMENTS=10392 CHECKS=26664300	? (TO) TT=1800	SAT TT=218.832 ASSIGNMENTS=75323 CHECKS=177307000	SAT TT=22.069 ASSIGNMENTS=6131 CHECKS=19540800	? (MO) TT=32.699	? (MO) TT=6.03	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsHerald/ normalized-crossword-m1-words-23-07.xml	SAT TT=3.82	SAT TT=12.955 CHECKS=2664720 NODES=2396	SAT TT=11.567 CHECKS=1423230 NODES=1736	? (TO) TT=1800.1	SAT TT=85.248 CHECKS=8815670	SAT TT=147.809 CHECKS=20175000	SAT TT=47.977 ASSIGNMENTS=348	? (TO) TT=1800.16	SAT TT=956.227 CHECKS=5250500000 NODES=1854	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=12.53 ASSIGNMENTS=1070 CHECKS=3017620	SAT TT=19.733 ASSIGNMENTS=2396 CHECKS=2664720	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=5.745 ASSIGNMENTS=1441 CHECKS=4922340	SAT TT=35.52 ASSIGNMENTS=10083 CHECKS=29737000	SAT TT=82.735	SAT TT=363.073 ASSIGNMENTS=127404 CHECKS=333911000	SAT TT=3.82 ASSIGNMENTS=1070 CHECKS=3017620	? (MO) TT=37.759	? (TO) TT=1800.1	? (TO) TT=1800.02
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle04.xml	SAT TT=0.026	SAT TT=0.813 CHECKS=2050 NODES=19	SAT TT=0.899 CHECKS=4427 NODES=20	SAT TT=1.706	SAT TT=0.283 CHECKS=1719	SAT TT=0.221 CHECKS=1413	SAT TT=1.253 ASSIGNMENTS=64	SAT TT=1.274 ASSIGNMENTS=15	SAT TT=135.292 CHECKS=7367150 NODES=20	SAT TT=80.531 CHECKS=78564900 NODES=88050000	? (TO) TT=1800.03	SAT TT=0.38 ASSIGNMENTS=1135 CHECKS=99727	SAT TT=0.381 ASSIGNMENTS=1135 CHECKS=99727	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=0.442 ASSIGNMENTS=1541 CHECKS=130648	SAT TT=0.026 ASSIGNMENTS=22 CHECKS=1452	SAT TT=0.635	SAT TT=0.042 ASSIGNMENTS=81 CHECKS=4996	SAT TT=0.031 ASSIGNMENTS=54 CHECKS=3932	? (MO) TT=43.125	SAT TT=3.303	SAT TT=3.833
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle06.xml	SAT TT=0.048	SAT TT=0.859 CHECKS=2857 NODES=23	SAT TT=0.868 CHECKS=1829 NODES=0	SAT TT=3.158	SAT TT=0.393 CHECKS=2232	SAT TT=0.463 CHECKS=3371	SAT TT=74.566 ASSIGNMENTS=13092	SAT TT=1.329 ASSIGNMENTS=13	SAT TT=90.101 CHECKS=15202600 NODES=26	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=1.318 ASSIGNMENTS=2060 CHECKS=373853	SAT TT=1.317 ASSIGNMENTS=2060 CHECKS=373853	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=5.777 ASSIGNMENTS=7762 CHECKS=1552520	SAT TT=0.524 ASSIGNMENTS=1564 CHECKS=154848	SAT TT=0.911	SAT TT=0.048 ASSIGNMENTS=86 CHECKS=9906	SAT TT=0.049 ASSIGNMENTS=118 CHECKS=11436	? (MO) TT=38.2	SAT TT=7.422	SAT TT=7.228
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle08.xml	SAT TT=0.045	SAT TT=1.162 CHECKS=12830 NODES=41	SAT TT=1.053 CHECKS=23376 NODES=42	SAT TT=1341.66	SAT TT=0.573 CHECKS=4576	SAT TT=0.493 CHECKS=5474	SAT TT=2.028 ASSIGNMENTS=26	SAT TT=2.106 ASSIGNMENTS=21	SAT TT=130.198 CHECKS=496657 NODES=44	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=0.058 ASSIGNMENTS=21 CHECKS=2877	SAT TT=0.059 ASSIGNMENTS=21 CHECKS=2877	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=0.045 ASSIGNMENTS=21 CHECKS=2877	SAT TT=0.713 ASSIGNMENTS=1177 CHECKS=243683	SAT TT=1.369	SAT TT=0.145 ASSIGNMENTS=200 CHECKS=32984	SAT TT=0.11 ASSIGNMENTS=81 CHECKS=25054	? (TO) TT=1800.18	SAT TT=29.779	SAT TT=32.801
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle09.xml	SAT TT=0.102	SAT TT=0.931 CHECKS=3535 NODES=35	SAT TT=1.035 CHECKS=10310 NODES=35	SAT TT=4.895	SAT TT=1.015 CHECKS=10238	SAT TT=1.028 CHECKS=10000	SAT TT=14.927 ASSIGNMENTS=887	SAT TT=2.256 ASSIGNMENTS=17	SAT TT=123.789 CHECKS=10306000 NODES=43	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=1.424 ASSIGNMENTS=956 CHECKS=308392	SAT TT=1.333 ASSIGNMENTS=956 CHECKS=308392	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=0.721 ASSIGNMENTS=755 CHECKS=242690	SAT TT=4.18 ASSIGNMENTS=4929 CHECKS=831056	SAT TT=1.339	SAT TT=0.264 ASSIGNMENTS=285 CHECKS=51922	SAT TT=0.102 ASSIGNMENTS=87 CHECKS=19959	? (MO) TT=37.533	SAT TT=33.757	SAT TT=38.675
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle10.xml	SAT TT=0.048	SAT TT=1.04 CHECKS=17681 NODES=44	SAT TT=1.042 CHECKS=17274 NODES=0	SAT TT=2.513	SAT TT=0.894 CHECKS=11376	SAT TT=0.636 CHECKS=9131	SAT TT=2.414 ASSIGNMENTS=17	SAT TT=2.371 ASSIGNMENTS=17	SAT TT=122.034 CHECKS=162704 NODES=40	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=0.06 ASSIGNMENTS=21 CHECKS=5716	SAT TT=0.061 ASSIGNMENTS=21 CHECKS=5716	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=0.048 ASSIGNMENTS=21 CHECKS=5716	SAT TT=3.757 ASSIGNMENTS=11337 CHECKS=1799110	SAT TT=2.52	SAT TT=0.178 ASSIGNMENTS=221 CHECKS=63884	SAT TT=0.051 ASSIGNMENTS=22 CHECKS=6151	? (TO) TT=1800.11	SAT TT=35.548	SAT TT=44.014
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle13.xml	SAT TT=0.067	SAT TT=1.285 CHECKS=37184 NODES=66	SAT TT=1.538 CHECKS=68604 NODES=66	SAT TT=3.583	SAT TT=1.071 CHECKS=18237	SAT TT=2.715 CHECKS=83837	SAT TT=3.444 ASSIGNMENTS=29	SAT TT=4.114 ASSIGNMENTS=25	SAT TT=130.187 CHECKS=2597130 NODES=69	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.08 ASSIGNMENTS=35 CHECKS=14078	SAT TT=0.078 ASSIGNMENTS=35 CHECKS=14078	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=0.068 ASSIGNMENTS=35 CHECKS=14078	SAT TT=4.562 ASSIGNMENTS=11962 CHECKS=4015900	SAT TT=1.985	SAT TT=1.105 ASSIGNMENTS=1685 CHECKS=776283	SAT TT=0.067 ASSIGNMENTS=34 CHECKS=14008	? (TO) TT=1802.2	SAT TT=36.178	SAT TT=45.008
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle14.xml	SAT TT=0.342	SAT TT=1.311 CHECKS=12479 NODES=67	SAT TT=1.287 CHECKS=25830 NODES=62	SAT TT=44.41	SAT TT=1.629 CHECKS=8750	SAT TT=2.681 CHECKS=24960	SAT TT=152.324 ASSIGNMENTS=9815	SAT TT=3.195 ASSIGNMENTS=26	SAT TT=139.966 CHECKS=21934100 NODES=66	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=162.135 ASSIGNMENTS=9815	SAT TT=152.612 ASSIGNMENTS=9815	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=35.039 ASSIGNMENTS=30934 CHECKS=14212700	SAT TT=7.333 ASSIGNMENTS=7491 CHECKS=2518680	SAT TT=2.279	SAT TT=1.278 ASSIGNMENTS=1324 CHECKS=390392	SAT TT=0.342 ASSIGNMENTS=316 CHECKS=143687	? (MO) TT=31.058	SAT TT=47.034	SAT TT=60.263
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle15.xml	SAT TT=0.08	SAT TT=1.695 CHECKS=59238 NODES=107	SAT TT=1.884 CHECKS=127940 NODES=159	SAT TT=10.715	SAT TT=3.584 CHECKS=78570	SAT TT=2.393 CHECKS=56888	SAT TT=4.623 ASSIGNMENTS=55	SAT TT=6.963 ASSIGNMENTS=52	SAT TT=132.085 CHECKS=1292310 NODES=197	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=0.091 ASSIGNMENTS=39 CHECKS=23590	SAT TT=0.09 ASSIGNMENTS=39 CHECKS=23590	? (TO) TT=1800	? (TO) TT=1800.07	SAT TT=0.08 ASSIGNMENTS=39 CHECKS=23590	SAT TT=7.902 ASSIGNMENTS=20432 CHECKS=8558900	SAT TT=2.704	SAT TT=2.038 ASSIGNMENTS=2831 CHECKS=1780010	SAT TT=0.088 ASSIGNMENTS=56 CHECKS=28723	? TT=52.103	SAT TT=24.442	SAT TT=44.505
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle16.xml	SAT TT=0.161	SAT TT=1.812 CHECKS=125604 NODES=137	SAT TT=2.364 CHECKS=251161 NODES=137	SAT TT=12.419	SAT TT=3.572 CHECKS=86776	SAT TT=2.398 CHECKS=95361	SAT TT=6.157 ASSIGNMENTS=79	SAT TT=23.059 ASSIGNMENTS=58	SAT TT=239.169 CHECKS=626844000 NODES=203	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=0.187 ASSIGNMENTS=86 CHECKS=45919	SAT TT=0.183 ASSIGNMENTS=86 CHECKS=45919	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=0.169 ASSIGNMENTS=86 CHECKS=45919	SAT TT=13.393 ASSIGNMENTS=16473 CHECKS=17541000	SAT TT=3.985	SAT TT=3.928 ASSIGNMENTS=4020 CHECKS=2634130	SAT TT=0.161 ASSIGNMENTS=77 CHECKS=42503	? (MO) TT=46.953	SAT TT=59.766	SAT TT=63.373
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle17.xml	SAT TT=0.278	SAT TT=2.903 CHECKS=344769 NODES=317	SAT TT=3.129 CHECKS=605257 NODES=342	SAT TT=16.272	SAT TT=5.747 CHECKS=113563	SAT TT=3.569 CHECKS=113563	SAT TT=10.876 ASSIGNMENTS=111	SAT TT=55.246 ASSIGNMENTS=83	SAT TT=223.522 CHECKS=535080000 NODES=303	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=0.297 ASSIGNMENTS=89 CHECKS=79736	SAT TT=0.292 ASSIGNMENTS=89 CHECKS=79736	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=0.278 ASSIGNMENTS=89 CHECKS=79736	SAT TT=26.692 ASSIGNMENTS=17414 CHECKS=29632700	? (TO) TT=1800.09	SAT TT=57.409 ASSIGNMENTS=36406 CHECKS=30307700	SAT TT=0.305 ASSIGNMENTS=124 CHECKS=98066	? TT=100.36	SAT TT=453.943	? (TO) TT=1800.06
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle18.xml	SAT TT=0.231	SAT TT=2.458 CHECKS=201114 NODES=187	SAT TT=2.912 CHECKS=345168 NODES=187	? (TO) TT=1800.1	SAT TT=40.341 CHECKS=2243140	SAT TT=3.789 CHECKS=233423	SAT TT=11.418 ASSIGNMENTS=90	SAT TT=63.201 ASSIGNMENTS=165	SAT TT=127.826 CHECKS=2479220 NODES=279	? (TO) TT=1800.05	? (TO) TT=1800	SAT TT=0.243 ASSIGNMENTS=110 CHECKS=84297	SAT TT=0.247 ASSIGNMENTS=110 CHECKS=84297	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=0.233 ASSIGNMENTS=110 CHECKS=84297	SAT TT=16.837 ASSIGNMENTS=20772 CHECKS=24590200	SAT TT=1520.13	SAT TT=90.702 ASSIGNMENTS=57346 CHECKS=46910300	SAT TT=0.231 ASSIGNMENTS=103 CHECKS=82641	? (MO) TT=64.548	SAT TT=87.269	SAT TT=517.768
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle19.xml	SAT TT=0.279	SAT TT=2.476 CHECKS=139837 NODES=338	SAT TT=2.798 CHECKS=204719 NODES=340	? (TO) TT=1800.13	SAT TT=6.689 CHECKS=158595	SAT TT=5.78 CHECKS=211835	SAT TT=12.175 ASSIGNMENTS=70	SAT TT=43.473 ASSIGNMENTS=57	SAT TT=239.318 CHECKS=870521000 NODES=360	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=0.831 ASSIGNMENTS=209 CHECKS=304176	SAT TT=0.845 ASSIGNMENTS=209 CHECKS=304176	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=0.751 ASSIGNMENTS=249 CHECKS=305184	SAT TT=21.939 ASSIGNMENTS=18024 CHECKS=20727600	? (TO) TT=1800.09	SAT TT=31.91 ASSIGNMENTS=17863 CHECKS=13366500	SAT TT=0.279 ASSIGNMENTS=85 CHECKS=69863	? (MO) TT=41.617	SAT TT=561.941	? (TO) TT=1800.05
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle20.xml	SAT TT=0.124	SAT TT=1.091 CHECKS=6921 NODES=53	SAT TT=1.136 CHECKS=14969 NODES=53	SAT TT=29.463	SAT TT=1.233 CHECKS=6491	SAT TT=1.299 CHECKS=7544	SAT TT=6.287 ASSIGNMENTS=543	SAT TT=2.689 ASSIGNMENTS=24	SAT TT=139.521 CHECKS=19814900 NODES=74	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=13.121 ASSIGNMENTS=543	SAT TT=13.857 ASSIGNMENTS=543	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=3.392 ASSIGNMENTS=3790 CHECKS=1634580	SAT TT=5.522 ASSIGNMENTS=6902 CHECKS=1603950	SAT TT=1.6	SAT TT=0.623 ASSIGNMENTS=659 CHECKS=164502	SAT TT=0.124 ASSIGNMENTS=215 CHECKS=43627	? (MO) TT=35.984	SAT TT=44.694	SAT TT=47.547
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle21.xml	SAT TT=0.121	SAT TT=1.848 CHECKS=104321 NODES=133	SAT TT=1.999 CHECKS=190961 NODES=132	SAT TT=8.471	SAT TT=7.255 CHECKS=215628	SAT TT=6.795 CHECKS=256717	SAT TT=5.875 ASSIGNMENTS=70	SAT TT=18.171 ASSIGNMENTS=60	SAT TT=278.965 CHECKS=867019000 NODES=168	? (TO) TT=1800.01	? (TO) TT=1800	SAT TT=0.133 ASSIGNMENTS=66 CHECKS=40534	SAT TT=0.146 ASSIGNMENTS=66 CHECKS=40534	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=0.121 ASSIGNMENTS=66 CHECKS=40534	SAT TT=8.903 ASSIGNMENTS=16160 CHECKS=10297800	? (TO) TT=1800.01	SAT TT=3.343 ASSIGNMENTS=3938 CHECKS=2227030	SAT TT=0.132 ASSIGNMENTS=72 CHECKS=37999	? (MO) TT=40.571	SAT TT=79.779	SAT TT=74.871
csp/wordsPuzzle/ normalized-crossword-m1-words-puzzle22.xml	SAT TT=0.169	SAT TT=3.626 CHECKS=724469 NODES=925	SAT TT=3.858 CHECKS=756368 NODES=758	? (TO) TT=1800.12	SAT TT=44.584 CHECKS=2875320	SAT TT=8.701 CHECKS=636622	SAT TT=11.511 ASSIGNMENTS=67	SAT TT=406.519 ASSIGNMENTS=64957	SAT TT=132.266 CHECKS=8054480 NODES=193	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=0.174 ASSIGNMENTS=84 CHECKS=92978	SAT TT=0.169 ASSIGNMENTS=84 CHECKS=92978	? (TO) TT=1800.06	? (TO) TT=1800	SAT TT=0.176 ASSIGNMENTS=104 CHECKS=113613	SAT TT=11.646 ASSIGNMENTS=9766 CHECKS=10421400	SAT TT=6.404	SAT TT=5.63 ASSIGNMENTS=3504 CHECKS=4149620	SAT TT=13.742 ASSIGNMENTS=7949 CHECKS=12476300	? (MO) TT=36.573	SAT TT=50.268	SAT TT=210.122

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	486	488	459	562	555	518	456	199	174	569	569	530	560	554	560	174	486	481
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	486	488	459	562	555	518	456	199	174	569	569	530	560	554	560	174	486	481
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	1	4	54	24	35	12	0	1	1	19	18	135	68	67	177	2	43	22
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0